High-speed indexing and archival of network measurement data:
Saved in:
| Main Author: | |
|---|---|
| Format: | Thesis Book |
| Language: | English |
| Published: |
Aachen
Shaker
2012
|
| Series: | Berichte aus der Kommunikationstechnik
|
| Subjects: | |
| Online Access: | Inhaltsverzeichnis |
| Physical Description: | XII, 137 S. graph. Darst., Kt. 21 cm, 233 g |
| ISBN: | 9783844014648 |
Staff View
MARC
| LEADER | 00000nam a2200000 c 4500 | ||
|---|---|---|---|
| 001 | BV040798867 | ||
| 003 | DE-604 | ||
| 005 | 20130411 | ||
| 007 | t | ||
| 008 | 130306s2012 gw bd|| m||| 00||| eng d | ||
| 015 | |a 12,N45 |2 dnb | ||
| 015 | |a 13,A03 |2 dnb | ||
| 016 | 7 | |a 1027349889 |2 DE-101 | |
| 020 | |a 9783844014648 |c kart. : EUR 48.80 (DE), EUR 48.80 (AT), sfr 61.00 (freier Pr.) |9 978-3-8440-1464-8 | ||
| 024 | 3 | |a 9783844014648 | |
| 035 | |a (OCoLC)824727152 | ||
| 035 | |a (DE-599)DNB1027349889 | ||
| 040 | |a DE-604 |b ger |e rakddb | ||
| 041 | 0 | |a eng | |
| 044 | |a gw |c XA-DE-NW | ||
| 049 | |a DE-473 | ||
| 082 | 0 | |a 004.6 |2 22/ger | |
| 082 | 0 | |a 005.74 |2 22/ger | |
| 084 | |a ST 200 |0 (DE-625)143611: |2 rvk | ||
| 084 | |a 004 |2 sdnb | ||
| 100 | 1 | |a Fusco, Francesco |d 1982- |e Verfasser |0 (DE-588)1028530331 |4 aut | |
| 245 | 1 | 0 | |a High-speed indexing and archival of network measurement data |c Francesco Fusco |
| 264 | 1 | |a Aachen |b Shaker |c 2012 | |
| 300 | |a XII, 137 S. |b graph. Darst., Kt. |c 21 cm, 233 g | ||
| 336 | |b txt |2 rdacontent | ||
| 337 | |b n |2 rdamedia | ||
| 338 | |b nc |2 rdacarrier | ||
| 490 | 0 | |a Berichte aus der Kommunikationstechnik | |
| 502 | |a Zugl.: Zürich, Techn. Hochsch., Diss., 2012 | ||
| 650 | 0 | 7 | |a Monitoring |g Informatik |0 (DE-588)4522632-5 |2 gnd |9 rswk-swf |
| 650 | 0 | 7 | |a Abfrage |0 (DE-588)4198788-3 |2 gnd |9 rswk-swf |
| 650 | 0 | 7 | |a Indizierung |g Informatik |0 (DE-588)4385466-7 |2 gnd |9 rswk-swf |
| 650 | 0 | 7 | |a Datenkompression |0 (DE-588)4121121-2 |2 gnd |9 rswk-swf |
| 650 | 0 | 7 | |a Netzwerkverwaltung |0 (DE-588)4314339-8 |2 gnd |9 rswk-swf |
| 650 | 0 | 7 | |a Datenhaltung |0 (DE-588)4238909-4 |2 gnd |9 rswk-swf |
| 650 | 0 | 7 | |a Datenstrom |0 (DE-588)4410055-3 |2 gnd |9 rswk-swf |
| 655 | 7 | |0 (DE-588)4113937-9 |a Hochschulschrift |2 gnd-content | |
| 689 | 0 | 0 | |a Netzwerkverwaltung |0 (DE-588)4314339-8 |D s |
| 689 | 0 | 1 | |a Monitoring |g Informatik |0 (DE-588)4522632-5 |D s |
| 689 | 0 | 2 | |a Datenstrom |0 (DE-588)4410055-3 |D s |
| 689 | 0 | 3 | |a Indizierung |g Informatik |0 (DE-588)4385466-7 |D s |
| 689 | 0 | 4 | |a Datenkompression |0 (DE-588)4121121-2 |D s |
| 689 | 0 | 5 | |a Datenhaltung |0 (DE-588)4238909-4 |D s |
| 689 | 0 | 6 | |a Abfrage |0 (DE-588)4198788-3 |D s |
| 689 | 0 | |5 DE-604 | |
| 856 | 4 | 2 | |m DNB Datenaustausch |q application/pdf |u http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=025779009&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |3 Inhaltsverzeichnis |
| 999 | |a oai:aleph.bib-bvb.de:BVB01-025779009 | ||
Record in the Search Index
| _version_ | 1804150135842668544 |
|---|---|
| adam_text | IMAGE 1
TABLE OF CONTENTS
ABSTRACT HI
SOMMARIO V
TABLE O F CONTENTS VII
LIST O F FIGURES XI
LIST O F TABLES XIII
1 INTRODUCTION 1
1.1 NETWORK MEASUREMENTS 1
1.2 MOTIVATION 2
1.3 PROBLEM STATEMENT 4
1.4 SCOPE O F WORK AND CONTRIBUTIONS 4
1.5 OUTLINE 5
2 BACKGROUND 7
2.1 NETWORK TRAFFIC MONITORING 7
2.2 STREAM PROCESSING 8
2.3 TRAFFIC MONITORING TECHNOLOGIES 10
2.3.1 PACKET LEVEL TRAFFIC ANALYSIS 10
2.3.2 FLOW LEVEL TRAFFIC ANALYSIS 14
2.4 DATA STREAM WAREHOUSING 19
2.4.1 THE SETTINGS 20
HTTP://D-NB.INFO/1027349889
IMAGE 2
VLLL
TABLE O F CONTENTS
2.4.2 COMPRESSION 22
2.4.3 INDEXING 23
3 RELATED WORK 27
3.1 DATA MANAGEMENT SYSTEMS 27
3.2 TRAFFIC RECORDING SYSTEMS 29
3.3 NETWORK FLOW COLLECTORS 29
3.4 CLOUD-BASED NETWORK TRACES ANALYSIS 30
3.5 COMPRESSION 31
3.6 INDEXING 33
4 NET-FLI: INDEXING AND COMPRESSION O F STREAMING FLOW RECORDS 35 4.1
ARCHITECTURE 36
4.1.1 COMPRESSED ARCHIVE O F FLOW DATA 38
4.1.2 COMPRESSED INDEX O F FLOW RECORD ATTRIBUTES . . . . 39
4.1.3 QUERYING THE SYSTEM 41
4.2 COMPRESSED ADAPTIVE INDEX - COMPAX 43
4.2.1 ENCODING 43
4.2.2 COMPARISON WITH OTHER BITMAP INDEXING SCHEMES . . 47
4.2.3 ON-THE-FLY BITMAP INDEX CREATION 50
4.3 ONLINE-LSH (OLSH) STREAM REORDERING 51
4.4 EVALUATION 56
4.4.1 DISK UTILIZATION 58
4.4.2 STREAM RECORD PROCESSING RATES: ARCHIVE AND INDEX 61
4.4.3 EXTENDED COMPARISON WITH PLWAH 63
4.4.4 INDEX PERFORMANCE 66
4.4.5 QUERY PERFORMANCE 67
4.5 NET-FLI AT WORK 72
4.6 SUMMARY 75
5 RASTERZIP: A REAL-TIME COMPRESSOR WITH PARTIAL DECOMPRESSION 77
5.1 OVERVIEW O F THE APPROACH 78
5.1.1 ONLINE RECORD REORDERING 80
5.2 ALGORITHM 81
5.2.1 COMPRESSION 82
5.2.2 ENCODING PROPERTIES 86
IMAGE 3
TABLE O F CONTENTS IX
5.2.3 DECOMPRESSION 88
5.2.4 ADAPTIVE BLOCK DECOMPRESSION 93
5.3 EVALUATION 95
5.3.1 COMPRESSION RATIO 97
5.3.2 INSERTION RATE 97
5.3.3 ADAPTIVE DECOMPRESSION SELECTION 98
5.3.4 OVERALL PERFORMANCE 99
5.4 SUMMARY 101
6 PCAPLNDEX: INDEXING PACKETS WITH LEGACY COMPATIBILITY 103
6.1 FROM PACKET FILTERS TO INDEXES 104
6.2 ARCHITECTURE 106
6.2.1 PACKET INDEXER 107
6.2.2 QUERY PROCESSOR 109
6.3 IMPLEMENTATION I L L
6.4 EVALUATION 112
6.5 SUMMARY 116
7 CONCLUSIONS 117
7.1 FUTURE WORK 119
7.2 PUBLICATIONS 121
7.3 PATENTS 123
BIBLIOGRAPHY 125
ACKNOWLEDGMENTS 139
CURRICULUM VITAE 141
|
| any_adam_object | 1 |
| author | Fusco, Francesco 1982- |
| author_GND | (DE-588)1028530331 |
| author_facet | Fusco, Francesco 1982- |
| author_role | aut |
| author_sort | Fusco, Francesco 1982- |
| author_variant | f f ff |
| building | Verbundindex |
| bvnumber | BV040798867 |
| classification_rvk | ST 200 |
| ctrlnum | (OCoLC)824727152 (DE-599)DNB1027349889 |
| dewey-full | 004.6 005.74 |
| dewey-hundreds | 000 - Computer science, information, general works |
| dewey-ones | 004 - Computer science 005 - Computer programming, programs, data, security |
| dewey-raw | 004.6 005.74 |
| dewey-search | 004.6 005.74 |
| dewey-sort | 14.6 |
| dewey-tens | 000 - Computer science, information, general works |
| discipline | Informatik |
| format | Thesis Book |
| fullrecord | <?xml version="1.0" encoding="UTF-8"?><collection xmlns="http://www.loc.gov/MARC21/slim"><record><leader>02418nam a2200589 c 4500</leader><controlfield tag="001">BV040798867</controlfield><controlfield tag="003">DE-604</controlfield><controlfield tag="005">20130411 </controlfield><controlfield tag="007">t</controlfield><controlfield tag="008">130306s2012 gw bd|| m||| 00||| eng d</controlfield><datafield tag="015" ind1=" " ind2=" "><subfield code="a">12,N45</subfield><subfield code="2">dnb</subfield></datafield><datafield tag="015" ind1=" " ind2=" "><subfield code="a">13,A03</subfield><subfield code="2">dnb</subfield></datafield><datafield tag="016" ind1="7" ind2=" "><subfield code="a">1027349889</subfield><subfield code="2">DE-101</subfield></datafield><datafield tag="020" ind1=" " ind2=" "><subfield code="a">9783844014648</subfield><subfield code="c">kart. : EUR 48.80 (DE), EUR 48.80 (AT), sfr 61.00 (freier Pr.)</subfield><subfield code="9">978-3-8440-1464-8</subfield></datafield><datafield tag="024" ind1="3" ind2=" "><subfield code="a">9783844014648</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(OCoLC)824727152</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(DE-599)DNB1027349889</subfield></datafield><datafield tag="040" ind1=" " ind2=" "><subfield code="a">DE-604</subfield><subfield code="b">ger</subfield><subfield code="e">rakddb</subfield></datafield><datafield tag="041" ind1="0" ind2=" "><subfield code="a">eng</subfield></datafield><datafield tag="044" ind1=" " ind2=" "><subfield code="a">gw</subfield><subfield code="c">XA-DE-NW</subfield></datafield><datafield tag="049" ind1=" " ind2=" "><subfield code="a">DE-473</subfield></datafield><datafield tag="082" ind1="0" ind2=" "><subfield code="a">004.6</subfield><subfield code="2">22/ger</subfield></datafield><datafield tag="082" ind1="0" ind2=" "><subfield code="a">005.74</subfield><subfield code="2">22/ger</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">ST 200</subfield><subfield code="0">(DE-625)143611:</subfield><subfield code="2">rvk</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">004</subfield><subfield code="2">sdnb</subfield></datafield><datafield tag="100" ind1="1" ind2=" "><subfield code="a">Fusco, Francesco</subfield><subfield code="d">1982-</subfield><subfield code="e">Verfasser</subfield><subfield code="0">(DE-588)1028530331</subfield><subfield code="4">aut</subfield></datafield><datafield tag="245" ind1="1" ind2="0"><subfield code="a">High-speed indexing and archival of network measurement data</subfield><subfield code="c">Francesco Fusco</subfield></datafield><datafield tag="264" ind1=" " ind2="1"><subfield code="a">Aachen</subfield><subfield code="b">Shaker</subfield><subfield code="c">2012</subfield></datafield><datafield tag="300" ind1=" " ind2=" "><subfield code="a">XII, 137 S.</subfield><subfield code="b">graph. Darst., Kt.</subfield><subfield code="c">21 cm, 233 g</subfield></datafield><datafield tag="336" ind1=" " ind2=" "><subfield code="b">txt</subfield><subfield code="2">rdacontent</subfield></datafield><datafield tag="337" ind1=" " ind2=" "><subfield code="b">n</subfield><subfield code="2">rdamedia</subfield></datafield><datafield tag="338" ind1=" " ind2=" "><subfield code="b">nc</subfield><subfield code="2">rdacarrier</subfield></datafield><datafield tag="490" ind1="0" ind2=" "><subfield code="a">Berichte aus der Kommunikationstechnik</subfield></datafield><datafield tag="502" ind1=" " ind2=" "><subfield code="a">Zugl.: Zürich, Techn. Hochsch., Diss., 2012</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Monitoring</subfield><subfield code="g">Informatik</subfield><subfield code="0">(DE-588)4522632-5</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Abfrage</subfield><subfield code="0">(DE-588)4198788-3</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Indizierung</subfield><subfield code="g">Informatik</subfield><subfield code="0">(DE-588)4385466-7</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Datenkompression</subfield><subfield code="0">(DE-588)4121121-2</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Netzwerkverwaltung</subfield><subfield code="0">(DE-588)4314339-8</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Datenhaltung</subfield><subfield code="0">(DE-588)4238909-4</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Datenstrom</subfield><subfield code="0">(DE-588)4410055-3</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="655" ind1=" " ind2="7"><subfield code="0">(DE-588)4113937-9</subfield><subfield code="a">Hochschulschrift</subfield><subfield code="2">gnd-content</subfield></datafield><datafield tag="689" ind1="0" ind2="0"><subfield code="a">Netzwerkverwaltung</subfield><subfield code="0">(DE-588)4314339-8</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="0" ind2="1"><subfield code="a">Monitoring</subfield><subfield code="g">Informatik</subfield><subfield code="0">(DE-588)4522632-5</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="0" ind2="2"><subfield code="a">Datenstrom</subfield><subfield code="0">(DE-588)4410055-3</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="0" ind2="3"><subfield code="a">Indizierung</subfield><subfield code="g">Informatik</subfield><subfield code="0">(DE-588)4385466-7</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="0" ind2="4"><subfield code="a">Datenkompression</subfield><subfield code="0">(DE-588)4121121-2</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="0" ind2="5"><subfield code="a">Datenhaltung</subfield><subfield code="0">(DE-588)4238909-4</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="0" ind2="6"><subfield code="a">Abfrage</subfield><subfield code="0">(DE-588)4198788-3</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="0" ind2=" "><subfield code="5">DE-604</subfield></datafield><datafield tag="856" ind1="4" ind2="2"><subfield code="m">DNB Datenaustausch</subfield><subfield code="q">application/pdf</subfield><subfield code="u">http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=025779009&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA</subfield><subfield code="3">Inhaltsverzeichnis</subfield></datafield><datafield tag="999" ind1=" " ind2=" "><subfield code="a">oai:aleph.bib-bvb.de:BVB01-025779009</subfield></datafield></record></collection> |
| genre | (DE-588)4113937-9 Hochschulschrift gnd-content |
| genre_facet | Hochschulschrift |
| id | DE-604.BV040798867 |
| illustrated | Illustrated |
| indexdate | 2024-07-10T00:34:07Z |
| institution | BVB |
| isbn | 9783844014648 |
| language | English |
| oai_aleph_id | oai:aleph.bib-bvb.de:BVB01-025779009 |
| oclc_num | 824727152 |
| open_access_boolean | |
| owner | DE-473 DE-BY-UBG |
| owner_facet | DE-473 DE-BY-UBG |
| physical | XII, 137 S. graph. Darst., Kt. 21 cm, 233 g |
| publishDate | 2012 |
| publishDateSearch | 2012 |
| publishDateSort | 2012 |
| publisher | Shaker |
| record_format | marc |
| series2 | Berichte aus der Kommunikationstechnik |
| spelling | Fusco, Francesco 1982- Verfasser (DE-588)1028530331 aut High-speed indexing and archival of network measurement data Francesco Fusco Aachen Shaker 2012 XII, 137 S. graph. Darst., Kt. 21 cm, 233 g txt rdacontent n rdamedia nc rdacarrier Berichte aus der Kommunikationstechnik Zugl.: Zürich, Techn. Hochsch., Diss., 2012 Monitoring Informatik (DE-588)4522632-5 gnd rswk-swf Abfrage (DE-588)4198788-3 gnd rswk-swf Indizierung Informatik (DE-588)4385466-7 gnd rswk-swf Datenkompression (DE-588)4121121-2 gnd rswk-swf Netzwerkverwaltung (DE-588)4314339-8 gnd rswk-swf Datenhaltung (DE-588)4238909-4 gnd rswk-swf Datenstrom (DE-588)4410055-3 gnd rswk-swf (DE-588)4113937-9 Hochschulschrift gnd-content Netzwerkverwaltung (DE-588)4314339-8 s Monitoring Informatik (DE-588)4522632-5 s Datenstrom (DE-588)4410055-3 s Indizierung Informatik (DE-588)4385466-7 s Datenkompression (DE-588)4121121-2 s Datenhaltung (DE-588)4238909-4 s Abfrage (DE-588)4198788-3 s DE-604 DNB Datenaustausch application/pdf http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=025779009&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA Inhaltsverzeichnis |
| spellingShingle | Fusco, Francesco 1982- High-speed indexing and archival of network measurement data Monitoring Informatik (DE-588)4522632-5 gnd Abfrage (DE-588)4198788-3 gnd Indizierung Informatik (DE-588)4385466-7 gnd Datenkompression (DE-588)4121121-2 gnd Netzwerkverwaltung (DE-588)4314339-8 gnd Datenhaltung (DE-588)4238909-4 gnd Datenstrom (DE-588)4410055-3 gnd |
| subject_GND | (DE-588)4522632-5 (DE-588)4198788-3 (DE-588)4385466-7 (DE-588)4121121-2 (DE-588)4314339-8 (DE-588)4238909-4 (DE-588)4410055-3 (DE-588)4113937-9 |
| title | High-speed indexing and archival of network measurement data |
| title_auth | High-speed indexing and archival of network measurement data |
| title_exact_search | High-speed indexing and archival of network measurement data |
| title_full | High-speed indexing and archival of network measurement data Francesco Fusco |
| title_fullStr | High-speed indexing and archival of network measurement data Francesco Fusco |
| title_full_unstemmed | High-speed indexing and archival of network measurement data Francesco Fusco |
| title_short | High-speed indexing and archival of network measurement data |
| title_sort | high speed indexing and archival of network measurement data |
| topic | Monitoring Informatik (DE-588)4522632-5 gnd Abfrage (DE-588)4198788-3 gnd Indizierung Informatik (DE-588)4385466-7 gnd Datenkompression (DE-588)4121121-2 gnd Netzwerkverwaltung (DE-588)4314339-8 gnd Datenhaltung (DE-588)4238909-4 gnd Datenstrom (DE-588)4410055-3 gnd |
| topic_facet | Monitoring Informatik Abfrage Indizierung Informatik Datenkompression Netzwerkverwaltung Datenhaltung Datenstrom Hochschulschrift |
| url | http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=025779009&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |
| work_keys_str_mv | AT fuscofrancesco highspeedindexingandarchivalofnetworkmeasurementdata |