MapReduce design patterns: [building effective algorithms and analytics for Hadoop and other systems]
Gespeichert in:
| Hauptverfasser: | , |
|---|---|
| Format: | Buch |
| Sprache: | English |
| Veröffentlicht: |
Sebastopol, Calif. [u.a.]
O'Reilly
2012
|
| Ausgabe: | 1. ed. |
| Schlagworte: | |
| Online-Zugang: | Inhaltstext Contributor biographical information Publisher description Inhaltsverzeichnis |
| Beschreibung: | XVI, 232 S. graph. Darst. |
| ISBN: | 9781449327170 1449327176 |
Internformat
MARC
| LEADER | 00000nam a2200000 c 4500 | ||
|---|---|---|---|
| 001 | BV040442246 | ||
| 003 | DE-604 | ||
| 005 | 20201105 | ||
| 007 | t | ||
| 008 | 120926s2012 d||| |||| 00||| eng d | ||
| 010 | |a 2012289884 | ||
| 015 | |a 12,N28 |2 dnb | ||
| 016 | 7 | |a 1023963329 |2 DE-101 | |
| 020 | |a 9781449327170 |c : EUR 41.00 (DE) (freier Pr.) |9 978-1-449-32717-0 | ||
| 020 | |a 1449327176 |9 1-449-32717-6 | ||
| 024 | 3 | |a 978-1-449-32717-0 | |
| 035 | |a (OCoLC)815932077 | ||
| 035 | |a (DE-599)DNB1023963329 | ||
| 040 | |a DE-604 |b ger |e rakddb | ||
| 041 | 0 | |a eng | |
| 049 | |a DE-898 |a DE-861 |a DE-858 |a DE-91G |a DE-739 | ||
| 050 | 0 | |a QA76.76.P37 M56 2013 | |
| 082 | 0 | |a 005.12 | |
| 084 | |a ST 230 |0 (DE-625)143617: |2 rvk | ||
| 084 | |a DAT 516f |2 stub | ||
| 084 | |a DAT 315f |2 stub | ||
| 084 | |a 004 |2 sdnb | ||
| 084 | |a DAT 620f |2 stub | ||
| 084 | |a DAT 332f |2 stub | ||
| 100 | 1 | |a Miner, Donald |e Verfasser |0 (DE-588)1035800268 |4 aut | |
| 245 | 1 | 0 | |a MapReduce design patterns |b [building effective algorithms and analytics for Hadoop and other systems] |c Donald Miner and Adam Shook |
| 246 | 1 | 3 | |a Map Reduce Design Patterns |
| 250 | |a 1. ed. | ||
| 264 | 1 | |a Sebastopol, Calif. [u.a.] |b O'Reilly |c 2012 | |
| 300 | |a XVI, 232 S. |b graph. Darst. | ||
| 336 | |b txt |2 rdacontent | ||
| 337 | |b n |2 rdamedia | ||
| 338 | |b nc |2 rdacarrier | ||
| 630 | 0 | 4 | |a Apache Hadoop (Computer file) |
| 630 | 0 | 4 | |a MapReduce (Computer program) |
| 650 | 4 | |a Datenverarbeitung | |
| 650 | 4 | |a Electronic data processing / Distributed processing | |
| 650 | 4 | |a Cluster analysis / Data processing | |
| 650 | 4 | |a Software patterns | |
| 650 | 4 | |a Computer algorithms | |
| 650 | 0 | 7 | |a Framework |g Informatik |0 (DE-588)4464685-9 |2 gnd |9 rswk-swf |
| 689 | 0 | 0 | |a Framework |g Informatik |0 (DE-588)4464685-9 |D s |
| 689 | 0 | |5 DE-604 | |
| 700 | 1 | |a Shook, Adam |e Verfasser |0 (DE-588)1035800454 |4 aut | |
| 856 | 4 | 2 | |m X:MVB |q text/html |u http://deposit.dnb.de/cgi-bin/dokserv?id=4070643&prov=M&dok_var=1&dok_ext=htm |3 Inhaltstext |
| 856 | 4 | 2 | |q text/html |u http://www.loc.gov/catdir/enhancements/fy1312/2012289884-b.html |3 Contributor biographical information |
| 856 | 4 | 2 | |q text/html |u http://www.loc.gov/catdir/enhancements/fy1312/2012289884-d.html |3 Publisher description |
| 856 | 4 | 2 | |m Digitalisierung UB Passau - ADAM Catalogue Enrichment |q application/pdf |u http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=025290058&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |3 Inhaltsverzeichnis |
| 943 | 1 | |a oai:aleph.bib-bvb.de:BVB01-025290058 | |
Datensatz im Suchindex
| _version_ | 1806232516700405760 |
|---|---|
| adam_text |
Table of Contents Preface. ix 1. Design Patterns and MapReduce. 1 Design Patterns 2 MapReduce History 4 MapReduce and Hadoop Refresher 4 Hadoop Example: Word Count 7 Pig and Hive 11 2. Summarization Patterns. 13 Numerical Summarizations 14 Pattern Description 14 Numerical Summarization Examples 17 Inverted Index Summarizations 32 Pattern Description 32 Inverted Index Example 35 Counting with Counters 37 Pattern Description 37 Counting with Counters Example 40 3. Filtering Patterns. 43 Filtering 44 Pattern Description 44 Filtering Examples 47 Bloom Filtering 49 Pattern Description 49 Bloom Filtering Examples 53 Top Ten 58 Pattern Description 58
Top Ten Examples Distinct Pattern Description Distinct Examples 63 65 65 68 4. Data Organization Patterns. 71 Structured to Hierarchical Pattern Description Structured to Hierarchical Examples Partitioning Pattern Description Partitioning Examples Binning Pattern Description Binning Examples Total Order Sorting Pattern Description Total Order Sorting Examples Shuffling Pattern Description Shuffle Examples 5. Join Patterns. A Refresher on Joins Reduce Side Join Pattern Description Reduce Side Join Example Reduce Side Join with Bloom Filter Replicated Join Pattern Description Replicated Join Examples Composite Join Pattern Description Composite Join Examples Cartesian Product Pattern Description Cartesian Product Examples 72 72 76 82 82 86 88 88 90 92 92 95 99 99 101 103 104 108 108 111 117 119 119 121 123 123 126 128 128 132 6. Metapatterns. 139 Job Chaining With the Driver Job Chaining Examples vi I Table of Contents 139 140 141
With Shell Scripting With JobControl Chain Folding The ChainMapper and ChainReducer Approach Chain Folding Example Job Merging Job Merging Examples 150 153 157 162 162 167 169 7 input and Output Patterns. . 175 Customizing Input and Output in Hadoop InputFormat RecordReader OutputFormat RecordWriter Generating Data Pattern Description Generating Data Examples External Source Output Pattern Description External Source Output Example External Source Input Pattern Description External Source Input Example Partition Pruning Pattern Description Partition Pruning Examples 175 176 177 178 179 180 180 182 187 187 189 193 193 195 200 200 203 8. Final Thoughts and the Future of Design Patterns. . 215 Trends in the Nature of Data Images, Audio, and Video Streaming Data The Effects of YARN Patterns as a Library or Component How You Can Help 215 215 216 217 218 218 A. Bloom Filters. . 219 Index. . 225 Table of Contents I vii |
| any_adam_object | 1 |
| author | Miner, Donald Shook, Adam |
| author_GND | (DE-588)1035800268 (DE-588)1035800454 |
| author_facet | Miner, Donald Shook, Adam |
| author_role | aut aut |
| author_sort | Miner, Donald |
| author_variant | d m dm a s as |
| building | Verbundindex |
| bvnumber | BV040442246 |
| callnumber-first | Q - Science |
| callnumber-label | QA76 |
| callnumber-raw | QA76.76.P37 M56 2013 |
| callnumber-search | QA76.76.P37 M56 2013 |
| callnumber-sort | QA 276.76 P37 M56 42013 |
| callnumber-subject | QA - Mathematics |
| classification_rvk | ST 230 |
| classification_tum | DAT 516f DAT 315f DAT 620f DAT 332f |
| ctrlnum | (OCoLC)815932077 (DE-599)DNB1023963329 |
| dewey-full | 005.12 |
| dewey-hundreds | 000 - Computer science, information, general works |
| dewey-ones | 005 - Computer programming, programs, data, security |
| dewey-raw | 005.12 |
| dewey-search | 005.12 |
| dewey-sort | 15.12 |
| dewey-tens | 000 - Computer science, information, general works |
| discipline | Informatik |
| edition | 1. ed. |
| format | Book |
| fullrecord | <?xml version="1.0" encoding="UTF-8"?><collection xmlns="http://www.loc.gov/MARC21/slim"><record><leader>00000nam a2200000 c 4500</leader><controlfield tag="001">BV040442246</controlfield><controlfield tag="003">DE-604</controlfield><controlfield tag="005">20201105</controlfield><controlfield tag="007">t</controlfield><controlfield tag="008">120926s2012 d||| |||| 00||| eng d</controlfield><datafield tag="010" ind1=" " ind2=" "><subfield code="a">2012289884</subfield></datafield><datafield tag="015" ind1=" " ind2=" "><subfield code="a">12,N28</subfield><subfield code="2">dnb</subfield></datafield><datafield tag="016" ind1="7" ind2=" "><subfield code="a">1023963329</subfield><subfield code="2">DE-101</subfield></datafield><datafield tag="020" ind1=" " ind2=" "><subfield code="a">9781449327170</subfield><subfield code="c">: EUR 41.00 (DE) (freier Pr.)</subfield><subfield code="9">978-1-449-32717-0</subfield></datafield><datafield tag="020" ind1=" " ind2=" "><subfield code="a">1449327176</subfield><subfield code="9">1-449-32717-6</subfield></datafield><datafield tag="024" ind1="3" ind2=" "><subfield code="a">978-1-449-32717-0</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(OCoLC)815932077</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(DE-599)DNB1023963329</subfield></datafield><datafield tag="040" ind1=" " ind2=" "><subfield code="a">DE-604</subfield><subfield code="b">ger</subfield><subfield code="e">rakddb</subfield></datafield><datafield tag="041" ind1="0" ind2=" "><subfield code="a">eng</subfield></datafield><datafield tag="049" ind1=" " ind2=" "><subfield code="a">DE-898</subfield><subfield code="a">DE-861</subfield><subfield code="a">DE-858</subfield><subfield code="a">DE-91G</subfield><subfield code="a">DE-739</subfield></datafield><datafield tag="050" ind1=" " ind2="0"><subfield code="a">QA76.76.P37 M56 2013</subfield></datafield><datafield tag="082" ind1="0" ind2=" "><subfield code="a">005.12</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">ST 230</subfield><subfield code="0">(DE-625)143617:</subfield><subfield code="2">rvk</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">DAT 516f</subfield><subfield code="2">stub</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">DAT 315f</subfield><subfield code="2">stub</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">004</subfield><subfield code="2">sdnb</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">DAT 620f</subfield><subfield code="2">stub</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">DAT 332f</subfield><subfield code="2">stub</subfield></datafield><datafield tag="100" ind1="1" ind2=" "><subfield code="a">Miner, Donald</subfield><subfield code="e">Verfasser</subfield><subfield code="0">(DE-588)1035800268</subfield><subfield code="4">aut</subfield></datafield><datafield tag="245" ind1="1" ind2="0"><subfield code="a">MapReduce design patterns</subfield><subfield code="b">[building effective algorithms and analytics for Hadoop and other systems]</subfield><subfield code="c">Donald Miner and Adam Shook</subfield></datafield><datafield tag="246" ind1="1" ind2="3"><subfield code="a">Map Reduce Design Patterns</subfield></datafield><datafield tag="250" ind1=" " ind2=" "><subfield code="a">1. ed.</subfield></datafield><datafield tag="264" ind1=" " ind2="1"><subfield code="a">Sebastopol, Calif. [u.a.]</subfield><subfield code="b">O'Reilly</subfield><subfield code="c">2012</subfield></datafield><datafield tag="300" ind1=" " ind2=" "><subfield code="a">XVI, 232 S.</subfield><subfield code="b">graph. Darst.</subfield></datafield><datafield tag="336" ind1=" " ind2=" "><subfield code="b">txt</subfield><subfield code="2">rdacontent</subfield></datafield><datafield tag="337" ind1=" " ind2=" "><subfield code="b">n</subfield><subfield code="2">rdamedia</subfield></datafield><datafield tag="338" ind1=" " ind2=" "><subfield code="b">nc</subfield><subfield code="2">rdacarrier</subfield></datafield><datafield tag="630" ind1="0" ind2="4"><subfield code="a">Apache Hadoop (Computer file)</subfield></datafield><datafield tag="630" ind1="0" ind2="4"><subfield code="a">MapReduce (Computer program)</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Datenverarbeitung</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Electronic data processing / Distributed processing</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Cluster analysis / Data processing</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Software patterns</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Computer algorithms</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Framework</subfield><subfield code="g">Informatik</subfield><subfield code="0">(DE-588)4464685-9</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="689" ind1="0" ind2="0"><subfield code="a">Framework</subfield><subfield code="g">Informatik</subfield><subfield code="0">(DE-588)4464685-9</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="0" ind2=" "><subfield code="5">DE-604</subfield></datafield><datafield tag="700" ind1="1" ind2=" "><subfield code="a">Shook, Adam</subfield><subfield code="e">Verfasser</subfield><subfield code="0">(DE-588)1035800454</subfield><subfield code="4">aut</subfield></datafield><datafield tag="856" ind1="4" ind2="2"><subfield code="m">X:MVB</subfield><subfield code="q">text/html</subfield><subfield code="u">http://deposit.dnb.de/cgi-bin/dokserv?id=4070643&prov=M&dok_var=1&dok_ext=htm</subfield><subfield code="3">Inhaltstext</subfield></datafield><datafield tag="856" ind1="4" ind2="2"><subfield code="q">text/html</subfield><subfield code="u">http://www.loc.gov/catdir/enhancements/fy1312/2012289884-b.html</subfield><subfield code="3">Contributor biographical information</subfield></datafield><datafield tag="856" ind1="4" ind2="2"><subfield code="q">text/html</subfield><subfield code="u">http://www.loc.gov/catdir/enhancements/fy1312/2012289884-d.html</subfield><subfield code="3">Publisher description</subfield></datafield><datafield tag="856" ind1="4" ind2="2"><subfield code="m">Digitalisierung UB Passau - ADAM Catalogue Enrichment</subfield><subfield code="q">application/pdf</subfield><subfield code="u">http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=025290058&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA</subfield><subfield code="3">Inhaltsverzeichnis</subfield></datafield><datafield tag="943" ind1="1" ind2=" "><subfield code="a">oai:aleph.bib-bvb.de:BVB01-025290058</subfield></datafield></record></collection> |
| id | DE-604.BV040442246 |
| illustrated | Illustrated |
| indexdate | 2024-08-02T00:12:40Z |
| institution | BVB |
| isbn | 9781449327170 1449327176 |
| language | English |
| lccn | 2012289884 |
| oai_aleph_id | oai:aleph.bib-bvb.de:BVB01-025290058 |
| oclc_num | 815932077 |
| open_access_boolean | |
| owner | DE-898 DE-BY-UBR DE-861 DE-858 DE-91G DE-BY-TUM DE-739 |
| owner_facet | DE-898 DE-BY-UBR DE-861 DE-858 DE-91G DE-BY-TUM DE-739 |
| physical | XVI, 232 S. graph. Darst. |
| publishDate | 2012 |
| publishDateSearch | 2012 |
| publishDateSort | 2012 |
| publisher | O'Reilly |
| record_format | marc |
| spelling | Miner, Donald Verfasser (DE-588)1035800268 aut MapReduce design patterns [building effective algorithms and analytics for Hadoop and other systems] Donald Miner and Adam Shook Map Reduce Design Patterns 1. ed. Sebastopol, Calif. [u.a.] O'Reilly 2012 XVI, 232 S. graph. Darst. txt rdacontent n rdamedia nc rdacarrier Apache Hadoop (Computer file) MapReduce (Computer program) Datenverarbeitung Electronic data processing / Distributed processing Cluster analysis / Data processing Software patterns Computer algorithms Framework Informatik (DE-588)4464685-9 gnd rswk-swf Framework Informatik (DE-588)4464685-9 s DE-604 Shook, Adam Verfasser (DE-588)1035800454 aut X:MVB text/html http://deposit.dnb.de/cgi-bin/dokserv?id=4070643&prov=M&dok_var=1&dok_ext=htm Inhaltstext text/html http://www.loc.gov/catdir/enhancements/fy1312/2012289884-b.html Contributor biographical information text/html http://www.loc.gov/catdir/enhancements/fy1312/2012289884-d.html Publisher description Digitalisierung UB Passau - ADAM Catalogue Enrichment application/pdf http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=025290058&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA Inhaltsverzeichnis |
| spellingShingle | Miner, Donald Shook, Adam MapReduce design patterns [building effective algorithms and analytics for Hadoop and other systems] Apache Hadoop (Computer file) MapReduce (Computer program) Datenverarbeitung Electronic data processing / Distributed processing Cluster analysis / Data processing Software patterns Computer algorithms Framework Informatik (DE-588)4464685-9 gnd |
| subject_GND | (DE-588)4464685-9 |
| title | MapReduce design patterns [building effective algorithms and analytics for Hadoop and other systems] |
| title_alt | Map Reduce Design Patterns |
| title_auth | MapReduce design patterns [building effective algorithms and analytics for Hadoop and other systems] |
| title_exact_search | MapReduce design patterns [building effective algorithms and analytics for Hadoop and other systems] |
| title_full | MapReduce design patterns [building effective algorithms and analytics for Hadoop and other systems] Donald Miner and Adam Shook |
| title_fullStr | MapReduce design patterns [building effective algorithms and analytics for Hadoop and other systems] Donald Miner and Adam Shook |
| title_full_unstemmed | MapReduce design patterns [building effective algorithms and analytics for Hadoop and other systems] Donald Miner and Adam Shook |
| title_short | MapReduce design patterns |
| title_sort | mapreduce design patterns building effective algorithms and analytics for hadoop and other systems |
| title_sub | [building effective algorithms and analytics for Hadoop and other systems] |
| topic | Apache Hadoop (Computer file) MapReduce (Computer program) Datenverarbeitung Electronic data processing / Distributed processing Cluster analysis / Data processing Software patterns Computer algorithms Framework Informatik (DE-588)4464685-9 gnd |
| topic_facet | Apache Hadoop (Computer file) MapReduce (Computer program) Datenverarbeitung Electronic data processing / Distributed processing Cluster analysis / Data processing Software patterns Computer algorithms Framework Informatik |
| url | http://deposit.dnb.de/cgi-bin/dokserv?id=4070643&prov=M&dok_var=1&dok_ext=htm http://www.loc.gov/catdir/enhancements/fy1312/2012289884-b.html http://www.loc.gov/catdir/enhancements/fy1312/2012289884-d.html http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=025290058&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |
| work_keys_str_mv | AT minerdonald mapreducedesignpatternsbuildingeffectivealgorithmsandanalyticsforhadoopandothersystems AT shookadam mapreducedesignpatternsbuildingeffectivealgorithmsandanalyticsforhadoopandothersystems AT minerdonald mapreducedesignpatterns AT shookadam mapreducedesignpatterns |