Fault-tolerant and secure long term data storage:
Gespeichert in:
| 1. Verfasser: | |
|---|---|
| Format: | Abschlussarbeit Buch |
| Sprache: | English |
| Veröffentlicht: |
2012
|
| Schlagworte: | |
| Online-Zugang: | Inhaltsverzeichnis |
| Beschreibung: | XX, 169 S. Ill., graph. Darst. |
Internformat
MARC
| LEADER | 00000nam a2200000 c 4500 | ||
|---|---|---|---|
| 001 | BV040789655 | ||
| 003 | DE-604 | ||
| 005 | 20130617 | ||
| 007 | t | ||
| 008 | 130228s2012 ad|| m||| 00||| eng d | ||
| 035 | |a (OCoLC)849799887 | ||
| 035 | |a (DE-599)HBZHT017555440 | ||
| 040 | |a DE-604 |b ger |e rakwb | ||
| 041 | 0 | |a eng | |
| 049 | |a DE-188 | ||
| 082 | 0 | |a 004.5 |2 22//ger | |
| 100 | 1 | |a Klein, Henning |d 1980- |e Verfasser |0 (DE-588)103178134X |4 aut | |
| 245 | 1 | 0 | |a Fault-tolerant and secure long term data storage |c submitted by Henning Klein |
| 264 | 1 | |c 2012 | |
| 300 | |a XX, 169 S. |b Ill., graph. Darst. | ||
| 336 | |b txt |2 rdacontent | ||
| 337 | |b n |2 rdamedia | ||
| 338 | |b nc |2 rdacarrier | ||
| 502 | |a Hagen, Univ., Diss., 2012 | ||
| 655 | 7 | |0 (DE-588)4113937-9 |a Hochschulschrift |2 gnd-content | |
| 856 | 4 | 2 | |m DNB Datenaustausch |q application/pdf |u http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=025767827&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |3 Inhaltsverzeichnis |
| 999 | |a oai:aleph.bib-bvb.de:BVB01-025767827 | ||
Datensatz im Suchindex
| _version_ | 1804150121167847424 |
|---|---|
| adam_text | IMAGE 1
TABLE OF CONTENTS
SUMMARY I
FOREWORD III
TABLE OF CONTENT V
LIST OF TABLES IX
LIST OF CODE EXAMPLES XI
LIST OF FIGURES 13
LIST OF EQUATIONS 17
TABLE O F ABBREVIATIONS 19
1. INTRODUCTION 1
1.1. STORAGE MEDIA AND MOTIVATION 1
1.2. STORAGE REDUNDANCY 3
2. RESEARCH CONTRIBUTIONS AND STRUCTURE OF THIS THESIS 5
2.1. MOTIVATION AND RESEARCH CONTRIBUTION 5
2.2. STRUCTURE OF THIS THESIS 6
3. RELATED WORK 9
3.1. RELIABLE STORAGE 9
3.2. STORAGE SYSTEMS 9
3.2.1. MAGNETIC DISKS 9
3.2.2. CHIP-BASED DISKS (= SOLID STATE DISKS, SSD) 11
3.3. ERROR TYPES 16
3.3.1. DISK FAILURE 16
3.3.2. SECTOR ERRORS 18
3.4. FAULT TOLERANCE 2 1
3.4.1. DISK ARRAYS 22
3.4.1.1. STRIPING & MIRRORING 23
3.4.1.2. PARITY RAID 24
3.4.1.3. DEPRECATED OR SPECIAL PURPOSE RAID LEVELS 25
3.4.1.4. RAID LEVEL COMBINATIONS 26
3.4.1.5. PERFORMANCE OPTIMIZED PARITY RAID 27
3.4.2. ERROR CORRECTION WITHIN HARD DISKS 28
V
HTTP://D-NB.INFO/1033853062
IMAGE 2
3.4.2.1. BUILT-IN ERROR CORRECTION 28
3.4.2.2. INTRA-DISK REDUNDANCY 28
3.4.3. FAILURE TOLERANT FILE SYSTEMS 29
3.5. DISK SCRUBBING 30
3.6. DATA ENCRYPTION 32
3.7. INTEGRITY CHECKING 33
3.8. DISTRIBUTED STORAGE 33
3.9. ASSESSMENT O F STORAGE SYSTEMS 34
4. FAULT TOLERANT STORAGE 35
4.1. ENHANCING PARITY RAID 36
4.1.1. ERASURE CODING 36
4.1.2. ENHANCED PARITY SCHEME: RAID-HV X.Y 37
4.1.3. HORIZONTAL PARITY ENHANCEMENT 39
4.1.3.1. HORIZONTAL RAID LAYOUT 39
4.1.3.2. APPLYING THE REED SOLOMON CODING SCHEME 4 1
4.1.3.3. PERFORMANCE 45
4.1.3.4. RELIABILITY 46
4.1.4. VERTICAL PARITY ENHANCEMENT 50
4.1.4.1. VERTICAL PARITY RAID LAYOUT 50
4.1.4.2. ENCODING AND DECODING VERTICAL PARITY 5 1
4.1.4.3. LATENT ERROR DETECTION 52
4.1.4.4. RELIABILITY ENHANCEMENT 57
4.1.4.5. SYMBOL SIZES 57
4.2. PERFORMANCE OPTIMIZATION 58
4.2.1. BASIC OPTIMIZATIONS 58
4.2.2. OPERATION RESULT LOOKUP 59
4.2.3. MULTI-OPERATION RESULT LOOKUP 60
4.2.4. CACHE OPTIMIZATION 6 1
4.3. ERROR DETECTION ENHANCEMENTS 64
4.3.1. ENCRYPTION ASSISTED ERROR DETECTION 64
4.3.2. DETECTING AND CORRECTING SINGLE ERRORS 66
4.3.3. ERROR CORRECTING CAPABILITIES 67
4.4. SYSTEM INTEGRATION 69
V I
IMAGE 3
4.4.1. HARDWARE IMPLEMENTATION 70
4.4.2. SOFTWARE IMPLEMENTATION 70
4.4.2.1. PARALLELIZING PARITY COMPUTATION 72
4.4.2.2. OPTIMIZING WRITE ORDERS 73
4.4.2.3. OPTIMIZING READ ORDERS 74
4.4.2.4. OPTIMIZING MIXED READ AND WRITE ORDERS 74
4.4.2.5. THREAD ARCHITECTURE 75
4.5. PERFORMANCE ANALYSIS 76
4.5.1. TEST PREPARATIONS AND SETTINGS 76
4.5.2. PERFORMANCE O F COMMON SOLUTIONS 77
4.5.3. PERFORMANCE OF SPECIALIZED IMPLEMENTATION 8 1
4.5.4. MULTICORE IMPLEMENTATIONS 85
4.5.5. DATA RECOVERY 86
4.5.6. DIFFUSION AND ENCRYPTION 87
4.5.6.1. AES ENCRYPTION 87
4.5.6.2. DIFFUSION 88
5. LATENT SECTOR ERROR ACCUMULATION 9 1
5.1. PROPERTY ANALYSIS 9 1
5.1.1. DISK AGE 9 1
5.1.2. CONSECUTIVE LATENT ERRORS 92
5.1.3. TEMPORAL AFFINITY 93
5.1.4. SPATIAL AFFINITY 94
5.2. DISK SCRUBBING 95
5.2.1. HARD DISK DRIVES (HDD) 95
5.2.1.1. SCRUBBING ALGORITHM BASED ON ERROR PROBABILITIES 96
5.2.1.2. ALGORITHM PARAMETER SETTINGS 100
5.2.1.3. APPLYING ERROR PROBABILITY-BASED SCRUBBING 104
5.2.1.4. PERFORMANCE TEST 104
5.2.1.5. INCORPORATING USER ACCESSES 106
5.2.1.6. ADJUSTING SCRUBBING RATES 112
5.2.2. SOLID STATE DISKS (SSD) 114
6. SIMULATION O F FAULT TOLERANT DISK ARRAYS 117
6.1. SIMULATING STORAGE ARRAYS 117
VII
IMAGE 4
6.2. ARCHITECTURE O F THE SIMULATOR 118
6.2.1. GENERAL ARCHITECTURE 118
6.2.2. EXTENDING THE SIMULATOR 119
6.3. SIMULATION TECHNIQUE 119
6.3.1. SIMULATION LIFE CYCLE 119
6.3.2. SIMULATION FUNCTIONS 120
6.3.3. EXTENDING THE SIMULATOR FUNCTIONS 121
6.3.4. TEST ORDER FILE TIMELINE 123
6.3.5. ADJUSTING PARAMETERS 124
6.4. DISK ERROR SIMULATION 126
6.4.1. TOTAL DISK FAILURE 126
6.4.2. LATENT SECTOR ERRORS 128
6.4.2.1. LATENT SECTOR ERROR DEVELOPMENT 128
6.4.2.2. NUMBER O F CONSECUTIVE ERRORS 132
6.4.2.3. DISTANCE O F CONSECUTIVE ERRORS 133
6.4.2.4. INTERARRIVAL RATE O F CONSECUTIVE ERRORS 135
6.5. RAID SIMULATION 137
6.5.1. SINGLE PARITY (RAID-5) 138
6.5.2. DOUBLE PARITY (RAID-6) 139
6.5.3. TRIPLE PARITY RAID 140
6.5.4. VERTICALLY EXTENDED RAID (RAID-HV) 141
6.5.5. DISTRIBUTING SUB STRIPES 144
6.5.6. DISK SCRUBBING 145
6.6. SIMULATION SUMMARY 148
7. CONCLUSION 151
APPENDIX A: EXCHANGING DATA REGIONS 153
REGION EXCHANGE 153
VERTICAL PARITY SPLITTING 154
APPENDIX B: SIMULATOR TEST DEFINITION 157
REFERENCES 161
CURRICULUM VITAE 169
VIII
|
| any_adam_object | 1 |
| author | Klein, Henning 1980- |
| author_GND | (DE-588)103178134X |
| author_facet | Klein, Henning 1980- |
| author_role | aut |
| author_sort | Klein, Henning 1980- |
| author_variant | h k hk |
| building | Verbundindex |
| bvnumber | BV040789655 |
| ctrlnum | (OCoLC)849799887 (DE-599)HBZHT017555440 |
| dewey-full | 004.5 |
| dewey-hundreds | 000 - Computer science, information, general works |
| dewey-ones | 004 - Computer science |
| dewey-raw | 004.5 |
| dewey-search | 004.5 |
| dewey-sort | 14.5 |
| dewey-tens | 000 - Computer science, information, general works |
| discipline | Informatik |
| format | Thesis Book |
| fullrecord | <?xml version="1.0" encoding="UTF-8"?><collection xmlns="http://www.loc.gov/MARC21/slim"><record><leader>01078nam a2200289 c 4500</leader><controlfield tag="001">BV040789655</controlfield><controlfield tag="003">DE-604</controlfield><controlfield tag="005">20130617 </controlfield><controlfield tag="007">t</controlfield><controlfield tag="008">130228s2012 ad|| m||| 00||| eng d</controlfield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(OCoLC)849799887</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(DE-599)HBZHT017555440</subfield></datafield><datafield tag="040" ind1=" " ind2=" "><subfield code="a">DE-604</subfield><subfield code="b">ger</subfield><subfield code="e">rakwb</subfield></datafield><datafield tag="041" ind1="0" ind2=" "><subfield code="a">eng</subfield></datafield><datafield tag="049" ind1=" " ind2=" "><subfield code="a">DE-188</subfield></datafield><datafield tag="082" ind1="0" ind2=" "><subfield code="a">004.5</subfield><subfield code="2">22//ger</subfield></datafield><datafield tag="100" ind1="1" ind2=" "><subfield code="a">Klein, Henning</subfield><subfield code="d">1980-</subfield><subfield code="e">Verfasser</subfield><subfield code="0">(DE-588)103178134X</subfield><subfield code="4">aut</subfield></datafield><datafield tag="245" ind1="1" ind2="0"><subfield code="a">Fault-tolerant and secure long term data storage</subfield><subfield code="c">submitted by Henning Klein</subfield></datafield><datafield tag="264" ind1=" " ind2="1"><subfield code="c">2012</subfield></datafield><datafield tag="300" ind1=" " ind2=" "><subfield code="a">XX, 169 S.</subfield><subfield code="b">Ill., graph. Darst.</subfield></datafield><datafield tag="336" ind1=" " ind2=" "><subfield code="b">txt</subfield><subfield code="2">rdacontent</subfield></datafield><datafield tag="337" ind1=" " ind2=" "><subfield code="b">n</subfield><subfield code="2">rdamedia</subfield></datafield><datafield tag="338" ind1=" " ind2=" "><subfield code="b">nc</subfield><subfield code="2">rdacarrier</subfield></datafield><datafield tag="502" ind1=" " ind2=" "><subfield code="a">Hagen, Univ., Diss., 2012</subfield></datafield><datafield tag="655" ind1=" " ind2="7"><subfield code="0">(DE-588)4113937-9</subfield><subfield code="a">Hochschulschrift</subfield><subfield code="2">gnd-content</subfield></datafield><datafield tag="856" ind1="4" ind2="2"><subfield code="m">DNB Datenaustausch</subfield><subfield code="q">application/pdf</subfield><subfield code="u">http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=025767827&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA</subfield><subfield code="3">Inhaltsverzeichnis</subfield></datafield><datafield tag="999" ind1=" " ind2=" "><subfield code="a">oai:aleph.bib-bvb.de:BVB01-025767827</subfield></datafield></record></collection> |
| genre | (DE-588)4113937-9 Hochschulschrift gnd-content |
| genre_facet | Hochschulschrift |
| id | DE-604.BV040789655 |
| illustrated | Illustrated |
| indexdate | 2024-07-10T00:33:53Z |
| institution | BVB |
| language | English |
| oai_aleph_id | oai:aleph.bib-bvb.de:BVB01-025767827 |
| oclc_num | 849799887 |
| open_access_boolean | |
| owner | DE-188 |
| owner_facet | DE-188 |
| physical | XX, 169 S. Ill., graph. Darst. |
| publishDate | 2012 |
| publishDateSearch | 2012 |
| publishDateSort | 2012 |
| record_format | marc |
| spelling | Klein, Henning 1980- Verfasser (DE-588)103178134X aut Fault-tolerant and secure long term data storage submitted by Henning Klein 2012 XX, 169 S. Ill., graph. Darst. txt rdacontent n rdamedia nc rdacarrier Hagen, Univ., Diss., 2012 (DE-588)4113937-9 Hochschulschrift gnd-content DNB Datenaustausch application/pdf http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=025767827&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA Inhaltsverzeichnis |
| spellingShingle | Klein, Henning 1980- Fault-tolerant and secure long term data storage |
| subject_GND | (DE-588)4113937-9 |
| title | Fault-tolerant and secure long term data storage |
| title_auth | Fault-tolerant and secure long term data storage |
| title_exact_search | Fault-tolerant and secure long term data storage |
| title_full | Fault-tolerant and secure long term data storage submitted by Henning Klein |
| title_fullStr | Fault-tolerant and secure long term data storage submitted by Henning Klein |
| title_full_unstemmed | Fault-tolerant and secure long term data storage submitted by Henning Klein |
| title_short | Fault-tolerant and secure long term data storage |
| title_sort | fault tolerant and secure long term data storage |
| topic_facet | Hochschulschrift |
| url | http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=025767827&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |
| work_keys_str_mv | AT kleinhenning faulttolerantandsecurelongtermdatastorage |