Holdings: Fault-tolerant and secure long term data storage

Fault-tolerant and secure long term data storage:

Saved in:

Bibliographic Details
Main Author:	Klein, Henning 1980- (Author)
Format:	Thesis Book
Language:	English
Published:	2012
Subjects:	Hochschulschrift
Online Access:	Inhaltsverzeichnis
Physical Description:	XX, 169 S. Ill., graph. Darst.

Staff View

MARC


LEADER	00000nam a2200000 c 4500
001	BV040789655
003	DE-604
005	20130617
007	t
008	130228s2012 ad\|\| m\|\|\| 00\|\|\| eng d
035			\|a (OCoLC)849799887
035			\|a (DE-599)HBZHT017555440
040			\|a DE-604 \|b ger \|e rakwb
041	0		\|a eng
049			\|a DE-188
082	0		\|a 004.5 \|2 22//ger
100	1		\|a Klein, Henning \|d 1980- \|e Verfasser \|0 (DE-588)103178134X \|4 aut
245	1	0	\|a Fault-tolerant and secure long term data storage \|c submitted by Henning Klein
264		1	\|c 2012
300			\|a XX, 169 S. \|b Ill., graph. Darst.
336			\|b txt \|2 rdacontent
337			\|b n \|2 rdamedia
338			\|b nc \|2 rdacarrier
502			\|a Hagen, Univ., Diss., 2012
655		7	\|0 (DE-588)4113937-9 \|a Hochschulschrift \|2 gnd-content
856	4	2	\|m DNB Datenaustausch \|q application/pdf \|u http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=025767827&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA \|3 Inhaltsverzeichnis
999			\|a oai:aleph.bib-bvb.de:BVB01-025767827

Record in the Search Index

_version_	1804150121167847424
adam_text	IMAGE 1 TABLE OF CONTENTS SUMMARY I FOREWORD III TABLE OF CONTENT V LIST OF TABLES IX LIST OF CODE EXAMPLES XI LIST OF FIGURES 13 LIST OF EQUATIONS 17 TABLE O F ABBREVIATIONS 19 1. INTRODUCTION 1 1.1. STORAGE MEDIA AND MOTIVATION 1 1.2. STORAGE REDUNDANCY 3 2. RESEARCH CONTRIBUTIONS AND STRUCTURE OF THIS THESIS 5 2.1. MOTIVATION AND RESEARCH CONTRIBUTION 5 2.2. STRUCTURE OF THIS THESIS 6 3. RELATED WORK 9 3.1. RELIABLE STORAGE 9 3.2. STORAGE SYSTEMS 9 3.2.1. MAGNETIC DISKS 9 3.2.2. CHIP-BASED DISKS (= SOLID STATE DISKS, SSD) 11 3.3. ERROR TYPES 16 3.3.1. DISK FAILURE 16 3.3.2. SECTOR ERRORS 18 3.4. FAULT TOLERANCE 2 1 3.4.1. DISK ARRAYS 22 3.4.1.1. STRIPING & MIRRORING 23 3.4.1.2. PARITY RAID 24 3.4.1.3. DEPRECATED OR SPECIAL PURPOSE RAID LEVELS 25 3.4.1.4. RAID LEVEL COMBINATIONS 26 3.4.1.5. PERFORMANCE OPTIMIZED PARITY RAID 27 3.4.2. ERROR CORRECTION WITHIN HARD DISKS 28 V HTTP://D-NB.INFO/1033853062 IMAGE 2 3.4.2.1. BUILT-IN ERROR CORRECTION 28 3.4.2.2. INTRA-DISK REDUNDANCY 28 3.4.3. FAILURE TOLERANT FILE SYSTEMS 29 3.5. DISK SCRUBBING 30 3.6. DATA ENCRYPTION 32 3.7. INTEGRITY CHECKING 33 3.8. DISTRIBUTED STORAGE 33 3.9. ASSESSMENT O F STORAGE SYSTEMS 34 4. FAULT TOLERANT STORAGE 35 4.1. ENHANCING PARITY RAID 36 4.1.1. ERASURE CODING 36 4.1.2. ENHANCED PARITY SCHEME: RAID-HV X.Y 37 4.1.3. HORIZONTAL PARITY ENHANCEMENT 39 4.1.3.1. HORIZONTAL RAID LAYOUT 39 4.1.3.2. APPLYING THE REED SOLOMON CODING SCHEME 4 1 4.1.3.3. PERFORMANCE 45 4.1.3.4. RELIABILITY 46 4.1.4. VERTICAL PARITY ENHANCEMENT 50 4.1.4.1. VERTICAL PARITY RAID LAYOUT 50 4.1.4.2. ENCODING AND DECODING VERTICAL PARITY 5 1 4.1.4.3. LATENT ERROR DETECTION 52 4.1.4.4. RELIABILITY ENHANCEMENT 57 4.1.4.5. SYMBOL SIZES 57 4.2. PERFORMANCE OPTIMIZATION 58 4.2.1. BASIC OPTIMIZATIONS 58 4.2.2. OPERATION RESULT LOOKUP 59 4.2.3. MULTI-OPERATION RESULT LOOKUP 60 4.2.4. CACHE OPTIMIZATION 6 1 4.3. ERROR DETECTION ENHANCEMENTS 64 4.3.1. ENCRYPTION ASSISTED ERROR DETECTION 64 4.3.2. DETECTING AND CORRECTING SINGLE ERRORS 66 4.3.3. ERROR CORRECTING CAPABILITIES 67 4.4. SYSTEM INTEGRATION 69 V I IMAGE 3 4.4.1. HARDWARE IMPLEMENTATION 70 4.4.2. SOFTWARE IMPLEMENTATION 70 4.4.2.1. PARALLELIZING PARITY COMPUTATION 72 4.4.2.2. OPTIMIZING WRITE ORDERS 73 4.4.2.3. OPTIMIZING READ ORDERS 74 4.4.2.4. OPTIMIZING MIXED READ AND WRITE ORDERS 74 4.4.2.5. THREAD ARCHITECTURE 75 4.5. PERFORMANCE ANALYSIS 76 4.5.1. TEST PREPARATIONS AND SETTINGS 76 4.5.2. PERFORMANCE O F COMMON SOLUTIONS 77 4.5.3. PERFORMANCE OF SPECIALIZED IMPLEMENTATION 8 1 4.5.4. MULTICORE IMPLEMENTATIONS 85 4.5.5. DATA RECOVERY 86 4.5.6. DIFFUSION AND ENCRYPTION 87 4.5.6.1. AES ENCRYPTION 87 4.5.6.2. DIFFUSION 88 5. LATENT SECTOR ERROR ACCUMULATION 9 1 5.1. PROPERTY ANALYSIS 9 1 5.1.1. DISK AGE 9 1 5.1.2. CONSECUTIVE LATENT ERRORS 92 5.1.3. TEMPORAL AFFINITY 93 5.1.4. SPATIAL AFFINITY 94 5.2. DISK SCRUBBING 95 5.2.1. HARD DISK DRIVES (HDD) 95 5.2.1.1. SCRUBBING ALGORITHM BASED ON ERROR PROBABILITIES 96 5.2.1.2. ALGORITHM PARAMETER SETTINGS 100 5.2.1.3. APPLYING ERROR PROBABILITY-BASED SCRUBBING 104 5.2.1.4. PERFORMANCE TEST 104 5.2.1.5. INCORPORATING USER ACCESSES 106 5.2.1.6. ADJUSTING SCRUBBING RATES 112 5.2.2. SOLID STATE DISKS (SSD) 114 6. SIMULATION O F FAULT TOLERANT DISK ARRAYS 117 6.1. SIMULATING STORAGE ARRAYS 117 VII IMAGE 4 6.2. ARCHITECTURE O F THE SIMULATOR 118 6.2.1. GENERAL ARCHITECTURE 118 6.2.2. EXTENDING THE SIMULATOR 119 6.3. SIMULATION TECHNIQUE 119 6.3.1. SIMULATION LIFE CYCLE 119 6.3.2. SIMULATION FUNCTIONS 120 6.3.3. EXTENDING THE SIMULATOR FUNCTIONS 121 6.3.4. TEST ORDER FILE TIMELINE 123 6.3.5. ADJUSTING PARAMETERS 124 6.4. DISK ERROR SIMULATION 126 6.4.1. TOTAL DISK FAILURE 126 6.4.2. LATENT SECTOR ERRORS 128 6.4.2.1. LATENT SECTOR ERROR DEVELOPMENT 128 6.4.2.2. NUMBER O F CONSECUTIVE ERRORS 132 6.4.2.3. DISTANCE O F CONSECUTIVE ERRORS 133 6.4.2.4. INTERARRIVAL RATE O F CONSECUTIVE ERRORS 135 6.5. RAID SIMULATION 137 6.5.1. SINGLE PARITY (RAID-5) 138 6.5.2. DOUBLE PARITY (RAID-6) 139 6.5.3. TRIPLE PARITY RAID 140 6.5.4. VERTICALLY EXTENDED RAID (RAID-HV) 141 6.5.5. DISTRIBUTING SUB STRIPES 144 6.5.6. DISK SCRUBBING 145 6.6. SIMULATION SUMMARY 148 7. CONCLUSION 151 APPENDIX A: EXCHANGING DATA REGIONS 153 REGION EXCHANGE 153 VERTICAL PARITY SPLITTING 154 APPENDIX B: SIMULATOR TEST DEFINITION 157 REFERENCES 161 CURRICULUM VITAE 169 VIII
any_adam_object	1
author	Klein, Henning 1980-
author_GND	(DE-588)103178134X
author_facet	Klein, Henning 1980-
author_role	aut
author_sort	Klein, Henning 1980-
author_variant	h k hk
building	Verbundindex
bvnumber	BV040789655
ctrlnum	(OCoLC)849799887 (DE-599)HBZHT017555440
dewey-full	004.5
dewey-hundreds	000 - Computer science, information, general works
dewey-ones	004 - Computer science
dewey-raw	004.5
dewey-search	004.5
dewey-sort	14.5
dewey-tens	000 - Computer science, information, general works
discipline	Informatik
format	Thesis Book
fullrecord	<?xml version="1.0" encoding="UTF-8"?><collection xmlns="http://www.loc.gov/MARC21/slim"><record><leader>01078nam a2200289 c 4500</leader><controlfield tag="001">BV040789655</controlfield><controlfield tag="003">DE-604</controlfield><controlfield tag="005">20130617 </controlfield><controlfield tag="007">t</controlfield><controlfield tag="008">130228s2012 ad\|\| m\|\|\| 00\|\|\| eng d</controlfield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(OCoLC)849799887</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(DE-599)HBZHT017555440</subfield></datafield><datafield tag="040" ind1=" " ind2=" "><subfield code="a">DE-604</subfield><subfield code="b">ger</subfield><subfield code="e">rakwb</subfield></datafield><datafield tag="041" ind1="0" ind2=" "><subfield code="a">eng</subfield></datafield><datafield tag="049" ind1=" " ind2=" "><subfield code="a">DE-188</subfield></datafield><datafield tag="082" ind1="0" ind2=" "><subfield code="a">004.5</subfield><subfield code="2">22//ger</subfield></datafield><datafield tag="100" ind1="1" ind2=" "><subfield code="a">Klein, Henning</subfield><subfield code="d">1980-</subfield><subfield code="e">Verfasser</subfield><subfield code="0">(DE-588)103178134X</subfield><subfield code="4">aut</subfield></datafield><datafield tag="245" ind1="1" ind2="0"><subfield code="a">Fault-tolerant and secure long term data storage</subfield><subfield code="c">submitted by Henning Klein</subfield></datafield><datafield tag="264" ind1=" " ind2="1"><subfield code="c">2012</subfield></datafield><datafield tag="300" ind1=" " ind2=" "><subfield code="a">XX, 169 S.</subfield><subfield code="b">Ill., graph. Darst.</subfield></datafield><datafield tag="336" ind1=" " ind2=" "><subfield code="b">txt</subfield><subfield code="2">rdacontent</subfield></datafield><datafield tag="337" ind1=" " ind2=" "><subfield code="b">n</subfield><subfield code="2">rdamedia</subfield></datafield><datafield tag="338" ind1=" " ind2=" "><subfield code="b">nc</subfield><subfield code="2">rdacarrier</subfield></datafield><datafield tag="502" ind1=" " ind2=" "><subfield code="a">Hagen, Univ., Diss., 2012</subfield></datafield><datafield tag="655" ind1=" " ind2="7"><subfield code="0">(DE-588)4113937-9</subfield><subfield code="a">Hochschulschrift</subfield><subfield code="2">gnd-content</subfield></datafield><datafield tag="856" ind1="4" ind2="2"><subfield code="m">DNB Datenaustausch</subfield><subfield code="q">application/pdf</subfield><subfield code="u">http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=025767827&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA</subfield><subfield code="3">Inhaltsverzeichnis</subfield></datafield><datafield tag="999" ind1=" " ind2=" "><subfield code="a">oai:aleph.bib-bvb.de:BVB01-025767827</subfield></datafield></record></collection>
genre	(DE-588)4113937-9 Hochschulschrift gnd-content
genre_facet	Hochschulschrift
id	DE-604.BV040789655
illustrated	Illustrated
indexdate	2024-07-10T00:33:53Z
institution	BVB
language	English
oai_aleph_id	oai:aleph.bib-bvb.de:BVB01-025767827
oclc_num	849799887
open_access_boolean
owner	DE-188
owner_facet	DE-188
physical	XX, 169 S. Ill., graph. Darst.
publishDate	2012
publishDateSearch	2012
publishDateSort	2012
record_format	marc
spelling	Klein, Henning 1980- Verfasser (DE-588)103178134X aut Fault-tolerant and secure long term data storage submitted by Henning Klein 2012 XX, 169 S. Ill., graph. Darst. txt rdacontent n rdamedia nc rdacarrier Hagen, Univ., Diss., 2012 (DE-588)4113937-9 Hochschulschrift gnd-content DNB Datenaustausch application/pdf http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=025767827&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA Inhaltsverzeichnis
spellingShingle	Klein, Henning 1980- Fault-tolerant and secure long term data storage
subject_GND	(DE-588)4113937-9
title	Fault-tolerant and secure long term data storage
title_auth	Fault-tolerant and secure long term data storage
title_exact_search	Fault-tolerant and secure long term data storage
title_full	Fault-tolerant and secure long term data storage submitted by Henning Klein
title_fullStr	Fault-tolerant and secure long term data storage submitted by Henning Klein
title_full_unstemmed	Fault-tolerant and secure long term data storage submitted by Henning Klein
title_short	Fault-tolerant and secure long term data storage
title_sort	fault tolerant and secure long term data storage
topic_facet	Hochschulschrift
url	http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=025767827&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA
work_keys_str_mv	AT kleinhenning faulttolerantandsecurelongtermdatastorage

Holdings

There is no print copy available.

Interlibrary loan Place Request Caution: Not in THWS collection! Indexes

MARC

Record in the Search Index

There is no print copy available.

Similar Items