Reliability assurance of big data in the cloud: cost-effective replication-based storage
Gespeichert in:
| Hauptverfasser: | , , |
|---|---|
| Format: | Buch |
| Sprache: | English |
| Veröffentlicht: |
Amsterdam [u.a.]
Morgan Kaufmann
2015
|
| Schlagworte: | |
| Online-Zugang: | Inhaltsverzeichnis |
| Beschreibung: | XII, 92 S. graf. Darst. |
| ISBN: | 9780128025727 |
Internformat
MARC
| LEADER | 00000nam a2200000 c 4500 | ||
|---|---|---|---|
| 001 | BV042363221 | ||
| 003 | DE-604 | ||
| 005 | 20150513 | ||
| 007 | t | ||
| 008 | 150216s2015 |||| |||| 00||| eng d | ||
| 020 | |a 9780128025727 |9 978-0-12-802572-7 | ||
| 035 | |a (OCoLC)909847075 | ||
| 035 | |a (DE-599)BVBBV042363221 | ||
| 040 | |a DE-604 |b ger |e rakwb | ||
| 041 | 0 | |a eng | |
| 049 | |a DE-473 |a DE-92 |a DE-523 | ||
| 084 | |a ST 530 |0 (DE-625)143679: |2 rvk | ||
| 100 | 1 | |a Li, Wenhao |e Verfasser |0 (DE-588)1070228850 |4 aut | |
| 245 | 1 | 0 | |a Reliability assurance of big data in the cloud |b cost-effective replication-based storage |c Wenhao Li, Yun Yang, Dong Yuan |
| 264 | 1 | |a Amsterdam [u.a.] |b Morgan Kaufmann |c 2015 | |
| 300 | |a XII, 92 S. |b graf. Darst. | ||
| 336 | |b txt |2 rdacontent | ||
| 337 | |b n |2 rdamedia | ||
| 338 | |b nc |2 rdacarrier | ||
| 650 | 0 | 7 | |a Big Data |0 (DE-588)4802620-7 |2 gnd |9 rswk-swf |
| 650 | 0 | 7 | |a Zuverlässigkeit |0 (DE-588)4059245-5 |2 gnd |9 rswk-swf |
| 689 | 0 | 0 | |a Big Data |0 (DE-588)4802620-7 |D s |
| 689 | 0 | 1 | |a Zuverlässigkeit |0 (DE-588)4059245-5 |D s |
| 689 | 0 | |5 DE-604 | |
| 700 | 1 | |a Yang, Yun |e Verfasser |0 (DE-588)134296419 |4 aut | |
| 700 | 1 | |a Yuan, Dong |e Verfasser |0 (DE-588)1041273452 |4 aut | |
| 856 | 4 | 2 | |m Digitalisierung UB Bamberg - ADAM Catalogue Enrichment |q application/pdf |u http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=027799629&sequence=000002&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |3 Inhaltsverzeichnis |
| 999 | |a oai:aleph.bib-bvb.de:BVB01-027799629 | ||
Datensatz im Suchindex
| _version_ | 1804152995479289856 |
|---|---|
| adam_text | Contents
About the Authors
ix
Preface
xi
Acknowledgments
xiii
1
Introduction
1
1.1 Data reliability in the Cloud
1
1.2
Background of Cloud storage
2
1.2.1
Distinctive features of Cloud storage systems
2
1.2.2
The Cloud data life cycle
4
1.3
Key issues of research
5
1.4
В(юк
overview
6
2
Literature review
9
2.1
Data reliability assurance in hardware
9
2.1.1
Disk
9
2.1.2 (
)ther storage
medias
1
2
2.2
Data reliability assurance in software
13
2.2.1
Replication for data reliability
13
2.2.2
Hrasure coding for data reliability
14
2.3
Data transfer for distributed systems
15
2.4
Summary 1
7
3
Motivating example and problem analysis
19
3.1
Motivating example
19
3.1.1
The pulsar searching application process 1
9
3.1.2
The pulsar searching application data flow
21
3.1.3
Storing pulsar searching data in the Cloud
23
3.2
Problem analysis
24
3.2.1
Two major factors of Cloud storage cost
24
3.2.2
Data storage devices and schemes
25
3.2.3
Cloud network and data transfer activities
26
3.2.4
Research issues
27
3.3
Summary
29
4
Generic data reliability model in the cloud
31
4.
1 Properties of the data reliability model
ЗІ
4.1.1
Reliability metrics
31
4.1.2
Data reliability model type
32
4.1.3
Failure rate pattern of storage devices
33
vi
Contents
4.2
Generic
data reliability model
33
4.2.1
Data reliability with static disk failure rate
33
4.2.2
Data reliability with variable disk failure rate
34
4.2.3
Generic data reliability model for multi-replicas
35
4.3
Summary
36
5
Minimum replication for meeting the data reliability requirement
37
5.1
The minimum replication calculation approach
37
5.1.1
Minimum replication calculation formulas
37
5.1.2
Optimization of the minimum replication calculation formulas
40
5.2
Minimum replication benchmark
41
5.3
Evaluation of the minimum replication calculation approach
42
5.4
Summary
43
6
Cost-effective data reliability assurance for data maintenance
45
6.1
Proactive replica checking
45
6.2
Overview of PRCR
46
6.2.1
User interface
47
6.2.2
PRCR node
48
6.3
Working process of PRCR
49
6.4
Optimization algorithms in PRCR
50
6.4.1
Minimum replication algorithm
50
6.4.2
Metadata distribution algorithm
52
6.5
Evaluation of PRCR
54
6.5.1
Performance of PRCR
55
6.5.2
Cost-effectiveness of PRCR
59
6.5.3
Summary of the evaluation
62
6.6
Summary
62
7
Cost-effective data transfer for data creation and data recovery
65
7.
1 Determining the deadline for data creation and data recovery
65
7.2
Cloud network model
66
7.2.1
Overall network model
67
7.2.2
Pipeline model
67
7.2.3
Pipeline agenda model
68
7.2.4
Overall agenda model
68
7.3
Energy consumption model for Cloud data transfer
69
7.4
Novel cost-cffcctivc data
transfer
strategy LRCDT
70
7.5
Evaluation of LRCDT
74
7.5.
1 Parameters of simulation
74
7.5.2
Energy consumption comparison
75
7.5.3
Task completion time comparison
77
7.6
Summary
78
Contents
vii
8
Conclusions and future
work
79
8.
1 Summary of this book
79
8.2
Key contributions of this
Ыюк
80
8.3
Further discussion and future work
8
1
8.3.1
Further discussions
81
8.3.2
Future work
82
Bibliography
83
Appendix
87
Index
89
|
| any_adam_object | 1 |
| author | Li, Wenhao Yang, Yun Yuan, Dong |
| author_GND | (DE-588)1070228850 (DE-588)134296419 (DE-588)1041273452 |
| author_facet | Li, Wenhao Yang, Yun Yuan, Dong |
| author_role | aut aut aut |
| author_sort | Li, Wenhao |
| author_variant | w l wl y y yy d y dy |
| building | Verbundindex |
| bvnumber | BV042363221 |
| classification_rvk | ST 530 |
| ctrlnum | (OCoLC)909847075 (DE-599)BVBBV042363221 |
| discipline | Informatik |
| format | Book |
| fullrecord | <?xml version="1.0" encoding="UTF-8"?><collection xmlns="http://www.loc.gov/MARC21/slim"><record><leader>01521nam a2200361 c 4500</leader><controlfield tag="001">BV042363221</controlfield><controlfield tag="003">DE-604</controlfield><controlfield tag="005">20150513 </controlfield><controlfield tag="007">t</controlfield><controlfield tag="008">150216s2015 |||| |||| 00||| eng d</controlfield><datafield tag="020" ind1=" " ind2=" "><subfield code="a">9780128025727</subfield><subfield code="9">978-0-12-802572-7</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(OCoLC)909847075</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(DE-599)BVBBV042363221</subfield></datafield><datafield tag="040" ind1=" " ind2=" "><subfield code="a">DE-604</subfield><subfield code="b">ger</subfield><subfield code="e">rakwb</subfield></datafield><datafield tag="041" ind1="0" ind2=" "><subfield code="a">eng</subfield></datafield><datafield tag="049" ind1=" " ind2=" "><subfield code="a">DE-473</subfield><subfield code="a">DE-92</subfield><subfield code="a">DE-523</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">ST 530</subfield><subfield code="0">(DE-625)143679:</subfield><subfield code="2">rvk</subfield></datafield><datafield tag="100" ind1="1" ind2=" "><subfield code="a">Li, Wenhao</subfield><subfield code="e">Verfasser</subfield><subfield code="0">(DE-588)1070228850</subfield><subfield code="4">aut</subfield></datafield><datafield tag="245" ind1="1" ind2="0"><subfield code="a">Reliability assurance of big data in the cloud</subfield><subfield code="b">cost-effective replication-based storage</subfield><subfield code="c">Wenhao Li, Yun Yang, Dong Yuan</subfield></datafield><datafield tag="264" ind1=" " ind2="1"><subfield code="a">Amsterdam [u.a.]</subfield><subfield code="b">Morgan Kaufmann</subfield><subfield code="c">2015</subfield></datafield><datafield tag="300" ind1=" " ind2=" "><subfield code="a">XII, 92 S.</subfield><subfield code="b">graf. Darst.</subfield></datafield><datafield tag="336" ind1=" " ind2=" "><subfield code="b">txt</subfield><subfield code="2">rdacontent</subfield></datafield><datafield tag="337" ind1=" " ind2=" "><subfield code="b">n</subfield><subfield code="2">rdamedia</subfield></datafield><datafield tag="338" ind1=" " ind2=" "><subfield code="b">nc</subfield><subfield code="2">rdacarrier</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Big Data</subfield><subfield code="0">(DE-588)4802620-7</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Zuverlässigkeit</subfield><subfield code="0">(DE-588)4059245-5</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="689" ind1="0" ind2="0"><subfield code="a">Big Data</subfield><subfield code="0">(DE-588)4802620-7</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="0" ind2="1"><subfield code="a">Zuverlässigkeit</subfield><subfield code="0">(DE-588)4059245-5</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="0" ind2=" "><subfield code="5">DE-604</subfield></datafield><datafield tag="700" ind1="1" ind2=" "><subfield code="a">Yang, Yun</subfield><subfield code="e">Verfasser</subfield><subfield code="0">(DE-588)134296419</subfield><subfield code="4">aut</subfield></datafield><datafield tag="700" ind1="1" ind2=" "><subfield code="a">Yuan, Dong</subfield><subfield code="e">Verfasser</subfield><subfield code="0">(DE-588)1041273452</subfield><subfield code="4">aut</subfield></datafield><datafield tag="856" ind1="4" ind2="2"><subfield code="m">Digitalisierung UB Bamberg - ADAM Catalogue Enrichment</subfield><subfield code="q">application/pdf</subfield><subfield code="u">http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=027799629&sequence=000002&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA</subfield><subfield code="3">Inhaltsverzeichnis</subfield></datafield><datafield tag="999" ind1=" " ind2=" "><subfield code="a">oai:aleph.bib-bvb.de:BVB01-027799629</subfield></datafield></record></collection> |
| id | DE-604.BV042363221 |
| illustrated | Not Illustrated |
| indexdate | 2024-07-10T01:19:34Z |
| institution | BVB |
| isbn | 9780128025727 |
| language | English |
| oai_aleph_id | oai:aleph.bib-bvb.de:BVB01-027799629 |
| oclc_num | 909847075 |
| open_access_boolean | |
| owner | DE-473 DE-BY-UBG DE-92 DE-523 |
| owner_facet | DE-473 DE-BY-UBG DE-92 DE-523 |
| physical | XII, 92 S. graf. Darst. |
| publishDate | 2015 |
| publishDateSearch | 2015 |
| publishDateSort | 2015 |
| publisher | Morgan Kaufmann |
| record_format | marc |
| spelling | Li, Wenhao Verfasser (DE-588)1070228850 aut Reliability assurance of big data in the cloud cost-effective replication-based storage Wenhao Li, Yun Yang, Dong Yuan Amsterdam [u.a.] Morgan Kaufmann 2015 XII, 92 S. graf. Darst. txt rdacontent n rdamedia nc rdacarrier Big Data (DE-588)4802620-7 gnd rswk-swf Zuverlässigkeit (DE-588)4059245-5 gnd rswk-swf Big Data (DE-588)4802620-7 s Zuverlässigkeit (DE-588)4059245-5 s DE-604 Yang, Yun Verfasser (DE-588)134296419 aut Yuan, Dong Verfasser (DE-588)1041273452 aut Digitalisierung UB Bamberg - ADAM Catalogue Enrichment application/pdf http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=027799629&sequence=000002&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA Inhaltsverzeichnis |
| spellingShingle | Li, Wenhao Yang, Yun Yuan, Dong Reliability assurance of big data in the cloud cost-effective replication-based storage Big Data (DE-588)4802620-7 gnd Zuverlässigkeit (DE-588)4059245-5 gnd |
| subject_GND | (DE-588)4802620-7 (DE-588)4059245-5 |
| title | Reliability assurance of big data in the cloud cost-effective replication-based storage |
| title_auth | Reliability assurance of big data in the cloud cost-effective replication-based storage |
| title_exact_search | Reliability assurance of big data in the cloud cost-effective replication-based storage |
| title_full | Reliability assurance of big data in the cloud cost-effective replication-based storage Wenhao Li, Yun Yang, Dong Yuan |
| title_fullStr | Reliability assurance of big data in the cloud cost-effective replication-based storage Wenhao Li, Yun Yang, Dong Yuan |
| title_full_unstemmed | Reliability assurance of big data in the cloud cost-effective replication-based storage Wenhao Li, Yun Yang, Dong Yuan |
| title_short | Reliability assurance of big data in the cloud |
| title_sort | reliability assurance of big data in the cloud cost effective replication based storage |
| title_sub | cost-effective replication-based storage |
| topic | Big Data (DE-588)4802620-7 gnd Zuverlässigkeit (DE-588)4059245-5 gnd |
| topic_facet | Big Data Zuverlässigkeit |
| url | http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=027799629&sequence=000002&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |
| work_keys_str_mv | AT liwenhao reliabilityassuranceofbigdatainthecloudcosteffectivereplicationbasedstorage AT yangyun reliabilityassuranceofbigdatainthecloudcosteffectivereplicationbasedstorage AT yuandong reliabilityassuranceofbigdatainthecloudcosteffectivereplicationbasedstorage |