Supervised sequence labelling with recurrent neural networks:
Gespeichert in:
| 1. Verfasser: | |
|---|---|
| Format: | Buch |
| Sprache: | English |
| Veröffentlicht: |
Berlin ; Heidelberg [u.a.]
Springer
2012
|
| Schriftenreihe: | Studies in computational intelligence
385 |
| Schlagworte: | |
| Online-Zugang: | Inhaltsverzeichnis |
| Beschreibung: | Literaturangaben |
| Beschreibung: | XII, 141 Seiten Illustrationen, Diagramme 25 cm |
| ISBN: | 9783642247965 3642247962 |
Internformat
MARC
| LEADER | 00000nam a2200000 cb4500 | ||
|---|---|---|---|
| 001 | BV040238691 | ||
| 003 | DE-604 | ||
| 005 | 20240419 | ||
| 007 | t | ||
| 008 | 120606s2012 a||| m||| 00||| eng d | ||
| 015 | |a 11,N40 |2 dnb | ||
| 015 | |a 12,A13 |2 dnb | ||
| 016 | 7 | |a 101553905X |2 DE-101 | |
| 020 | |a 9783642247965 |c Pp. : EUR 106.95 (DE) (freier Pr.), EUR 110.00 (AT) (freier Pr.), sfr 133.50 (freier Pr.) |9 978-3-642-24796-5 | ||
| 020 | |a 3642247962 |9 3-642-24796-2 | ||
| 024 | 3 | |a 9783642247965 | |
| 035 | |a (OCoLC)782967514 | ||
| 035 | |a (DE-599)DNB101553905X | ||
| 040 | |a DE-604 |b ger | ||
| 041 | 0 | |a eng | |
| 049 | |a DE-11 |a DE-945 |a DE-83 | ||
| 082 | 0 | |a 006.4 |2 22/ger | |
| 082 | 0 | |a 006.32 |2 22/ger | |
| 084 | |a ST 300 |0 (DE-625)143650: |2 rvk | ||
| 084 | |a 004 |2 sdnb | ||
| 100 | 1 | |a Graves, Alex |d 1976- |e Verfasser |0 (DE-588)136605621 |4 aut | |
| 245 | 1 | 0 | |a Supervised sequence labelling with recurrent neural networks |c Alex Graves |
| 264 | 1 | |a Berlin ; Heidelberg [u.a.] |b Springer |c 2012 | |
| 300 | |a XII, 141 Seiten |b Illustrationen, Diagramme |c 25 cm | ||
| 336 | |b txt |2 rdacontent | ||
| 337 | |b n |2 rdamedia | ||
| 338 | |b nc |2 rdacarrier | ||
| 490 | 1 | |a Studies in computational intelligence |v 385 | |
| 500 | |a Literaturangaben | ||
| 650 | 0 | 7 | |a Rekursives neuronales Netz |0 (DE-588)4379549-3 |2 gnd |9 rswk-swf |
| 650 | 0 | 7 | |a Mustererkennung |0 (DE-588)4040936-3 |2 gnd |9 rswk-swf |
| 650 | 0 | 7 | |a Sequenzieller Algorithmus |0 (DE-588)4719581-2 |2 gnd |9 rswk-swf |
| 650 | 0 | 7 | |a Maschinelles Lernen |0 (DE-588)4193754-5 |2 gnd |9 rswk-swf |
| 655 | 7 | |0 (DE-588)4113937-9 |a Hochschulschrift |2 gnd-content | |
| 689 | 0 | 0 | |a Maschinelles Lernen |0 (DE-588)4193754-5 |D s |
| 689 | 0 | 1 | |a Mustererkennung |0 (DE-588)4040936-3 |D s |
| 689 | 0 | 2 | |a Rekursives neuronales Netz |0 (DE-588)4379549-3 |D s |
| 689 | 0 | |5 DE-604 | |
| 689 | 1 | 0 | |a Rekursives neuronales Netz |0 (DE-588)4379549-3 |D s |
| 689 | 1 | 1 | |a Sequenzieller Algorithmus |0 (DE-588)4719581-2 |D s |
| 689 | 1 | 2 | |a Maschinelles Lernen |0 (DE-588)4193754-5 |D s |
| 689 | 1 | |5 DE-604 | |
| 776 | 0 | 8 | |i Erscheint auch als |n Druck-Ausgabe, Paperback |z 978-3-642-43218-7 |
| 776 | 0 | 8 | |i Erscheint auch als |n Online-Ausgabe |z 978-3-642-24797-2 |
| 830 | 0 | |a Studies in computational intelligence |v 385 |w (DE-604)BV020822171 |9 385 | |
| 856 | 4 | 2 | |m DNB Datenaustausch |q application/pdf |u http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=025094927&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |3 Inhaltsverzeichnis |
| 999 | |a oai:aleph.bib-bvb.de:BVB01-025094927 | ||
Datensatz im Suchindex
| _version_ | 1804149229359202304 |
|---|---|
| adam_text | IMAGE 1
C O N T E N T S
LIST O F T A B L E S I X
L I S T O F F I G U R E S X I
L I S T O F A L G O R I T H M S X I I I
1 I N T R O D U C T I O N 1
1.1 STRUCTURE OF THE BOOK 3
2 S U P E R V I S E D S E Q U E N C E L A B E L L I N G 5
2.1 SUPERVISED LEARNING 5
2.2 PATTERN CLASSIFICATION 6
2.2.1 PROBABILISTIC CLASSIFICATION 6
2.2.2 TRAINING PROBABILISTIC CLASSIFIERS 7
2.2.3 GENERATIVE AND DISCRIMINATIVE METHODS 8
2.3 SEQUENCE LABELLING 9
2.3.1 SEQUENCE CLASSIFICATION 11
2.3.2 SEGMENT CLASSIFICATION 11
2.3.3 TEMPORAL CLASSIFICATION 12
3 N E U R A L N E T W O R K S 1 5
3.1 MULTILAYER PERCEPTIONS 15
3.1.1 FORWARD PASS 16
3.1.2 O U T P U T LAYERS 18
3.1.3 LOSS FUNCTIONS 19
3.1.4 BACKWARD PASS 20
3.2 RECURRENT NEURAL NETWORKS 22
3.2.1 FORWARD PASS 22
3.2.2 BACKWARD PASS 23
3.2.3 UNFOLDING 24
3.2.4 BIDIRECTIONAL NETWORKS 24
3.2.5 SEQUENTIAL JACOBIAN 27
3.3 NETWORK TRAINING 29
3.3.1 GRADIENT DESCENT ALGORITHMS 29
3.3.2 GENERALISATION 30
HTTP://D-NB.INFO/101553905X
IMAGE 2
VI CONTENTS
3.3.3 INPUT REPRESENTATION 34
3.3.4 WEIGHT INITIALISATION 35
4 L O N G S H O R T - T E R M M E M O R Y 3 7
4.1 NETWORK ARCHITECTURE 37
4.2 INFLUENCE OF PREPROCESSING 41
4.3 GRADIENT CALCULATION 42
4.4 ARCHITECTURAL VARIANTS 42
4.5 BIDIRECTIONAL LONG SHORT-TERM MEMORY 43
4.6 NETWORK EQUATIONS 43
4.6.1 FORWARD PASS 44
4.6.2 BACKWARD PASS 44
5 A C O M P A R I S O N O F N E T W O R K A R C H I T E C T U R E S 4 7
5.1 EXPERIMENTAL SETUP 47
5.2 NETWORK ARCHITECTURES 48
5.2.1 COMPUTATIONAL COMPLEXITY 49
5.2.2 RANGE OF CONTEXT 49
5.2.3 OUTPUT LAYERS 49
5.3 NETWORK TRAINING 51
5.3.1 RETRAINING 51
5.4 RESULTS 52
5.4.1 PREVIOUS WORK 54
5.4.2 EFFECT OF INCREASED CONTEXT 54
5.4.3 WEIGHTED ERROR 56
6 H I D D E N M A R K O V M O D E L H Y B R I D S 5 7
6.1 BACKGROUND 57
6.2 EXPERIMENT: PHONEME RECOGNITION 58
6.2.1 EXPERIMENTAL SETUP 59
6.2.2 RESULTS 59
7 C O N N E C T I O N I S T T E M P O R A L C L A S S I F I C A T I O N
6 1
7.1 BACKGROUND 61
7.2 FROM OUTPUTS TO LABELLINGS 63
7.2.1 ROLE OF THE BLANK LABELS 64
7.2.2 BIDIRECTIONAL AND UNIDIRECTIONAL NETWORKS 64
7.3 FORWARD-BACKWARD ALGORITHM 64
7.3.1 LOG SCALE 68
7.4 LOSS FUNCTION 68
7.4.1 LOSS GRADIENT 69
7.5 DECODING 71
7.5.1 BEST P A T H DECODING 71
7.5.2 PREFIX SEARCH DECODING 72
7.5.3 CONSTRAINED DECODING 73
7.6 EXPERIMENTS 78
IMAGE 3
CONTENTS VII
7.6.1 PHONEME RECOGNITION 1 79
7.6.2 PHONEME RECOGNITION 2 80
7.6.3 KEYWORD SPOTTING 81
7.6.4 ONLINE HANDWRITING RECOGNITION 85
7.6.5 OFFLINE HANDWRITING RECOGNITION 88
7.7 DISCUSSION 91
8 M U L T I D I M E N S I O N A L N E T W O R K S 9 5
8.1 BACKGROUND 95
8.2 NETWORK ARCHITECTURE 97
8.2.1 MULTIDIRECTIONAL NETWORKS 100
8.2.2 MULTIDIMENSIONAL LONG SHORT-TERM MEMORY 102
8.3 EXPERIMENTS 104
8.3.1 AIR FREIGHT D A T A 104
8.3.2 MNIST D A T A 105
8.3.3 ANALYSIS 107
9 H I E R A R C H I C A L S U B S A M P L I N G N E T W O R K S 1 0 9
9.1 NETWORK ARCHITECTURE 110
9.1.1 SUBSAMPLING WINDOW SIZES 112
9.1.2 HIDDEN LAYER SIZES 112
9.1.3 NUMBER OF LEVELS 113
9.1.4 MULTIDIMENSIONAL NETWORKS 113
9.1.5 O U T P U T LAYERS 115
9.1.6 COMPLETE SYSTEM 116
9.2 EXPERIMENTS 117
9.2.1 OFFLINE ARABIC HANDWRITING RECOGNITION 119
9.2.2 ONLINE ARABIC HANDWRITING RECOGNITION 122
9.2.3 FRENCH HANDWRITING RECOGNITION 124
9.2.4 FARSI/ARABIC CHARACTER CLASSIFICATION 126
9.2.5 PHONEME RECOGNITION 127
R E F E R E N C E S 1 3 3
A C K N O W L E D G E M E N T S 1 4 1
|
| any_adam_object | 1 |
| author | Graves, Alex 1976- |
| author_GND | (DE-588)136605621 |
| author_facet | Graves, Alex 1976- |
| author_role | aut |
| author_sort | Graves, Alex 1976- |
| author_variant | a g ag |
| building | Verbundindex |
| bvnumber | BV040238691 |
| classification_rvk | ST 300 |
| ctrlnum | (OCoLC)782967514 (DE-599)DNB101553905X |
| dewey-full | 006.4 006.32 |
| dewey-hundreds | 000 - Computer science, information, general works |
| dewey-ones | 006 - Special computer methods |
| dewey-raw | 006.4 006.32 |
| dewey-search | 006.4 006.32 |
| dewey-sort | 16.4 |
| dewey-tens | 000 - Computer science, information, general works |
| discipline | Informatik |
| format | Book |
| fullrecord | <?xml version="1.0" encoding="UTF-8"?><collection xmlns="http://www.loc.gov/MARC21/slim"><record><leader>02522nam a2200589 cb4500</leader><controlfield tag="001">BV040238691</controlfield><controlfield tag="003">DE-604</controlfield><controlfield tag="005">20240419 </controlfield><controlfield tag="007">t</controlfield><controlfield tag="008">120606s2012 a||| m||| 00||| eng d</controlfield><datafield tag="015" ind1=" " ind2=" "><subfield code="a">11,N40</subfield><subfield code="2">dnb</subfield></datafield><datafield tag="015" ind1=" " ind2=" "><subfield code="a">12,A13</subfield><subfield code="2">dnb</subfield></datafield><datafield tag="016" ind1="7" ind2=" "><subfield code="a">101553905X</subfield><subfield code="2">DE-101</subfield></datafield><datafield tag="020" ind1=" " ind2=" "><subfield code="a">9783642247965</subfield><subfield code="c">Pp. : EUR 106.95 (DE) (freier Pr.), EUR 110.00 (AT) (freier Pr.), sfr 133.50 (freier Pr.)</subfield><subfield code="9">978-3-642-24796-5</subfield></datafield><datafield tag="020" ind1=" " ind2=" "><subfield code="a">3642247962</subfield><subfield code="9">3-642-24796-2</subfield></datafield><datafield tag="024" ind1="3" ind2=" "><subfield code="a">9783642247965</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(OCoLC)782967514</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(DE-599)DNB101553905X</subfield></datafield><datafield tag="040" ind1=" " ind2=" "><subfield code="a">DE-604</subfield><subfield code="b">ger</subfield></datafield><datafield tag="041" ind1="0" ind2=" "><subfield code="a">eng</subfield></datafield><datafield tag="049" ind1=" " ind2=" "><subfield code="a">DE-11</subfield><subfield code="a">DE-945</subfield><subfield code="a">DE-83</subfield></datafield><datafield tag="082" ind1="0" ind2=" "><subfield code="a">006.4</subfield><subfield code="2">22/ger</subfield></datafield><datafield tag="082" ind1="0" ind2=" "><subfield code="a">006.32</subfield><subfield code="2">22/ger</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">ST 300</subfield><subfield code="0">(DE-625)143650:</subfield><subfield code="2">rvk</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">004</subfield><subfield code="2">sdnb</subfield></datafield><datafield tag="100" ind1="1" ind2=" "><subfield code="a">Graves, Alex</subfield><subfield code="d">1976-</subfield><subfield code="e">Verfasser</subfield><subfield code="0">(DE-588)136605621</subfield><subfield code="4">aut</subfield></datafield><datafield tag="245" ind1="1" ind2="0"><subfield code="a">Supervised sequence labelling with recurrent neural networks</subfield><subfield code="c">Alex Graves</subfield></datafield><datafield tag="264" ind1=" " ind2="1"><subfield code="a">Berlin ; Heidelberg [u.a.]</subfield><subfield code="b">Springer</subfield><subfield code="c">2012</subfield></datafield><datafield tag="300" ind1=" " ind2=" "><subfield code="a">XII, 141 Seiten</subfield><subfield code="b">Illustrationen, Diagramme</subfield><subfield code="c">25 cm</subfield></datafield><datafield tag="336" ind1=" " ind2=" "><subfield code="b">txt</subfield><subfield code="2">rdacontent</subfield></datafield><datafield tag="337" ind1=" " ind2=" "><subfield code="b">n</subfield><subfield code="2">rdamedia</subfield></datafield><datafield tag="338" ind1=" " ind2=" "><subfield code="b">nc</subfield><subfield code="2">rdacarrier</subfield></datafield><datafield tag="490" ind1="1" ind2=" "><subfield code="a">Studies in computational intelligence</subfield><subfield code="v">385</subfield></datafield><datafield tag="500" ind1=" " ind2=" "><subfield code="a">Literaturangaben</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Rekursives neuronales Netz</subfield><subfield code="0">(DE-588)4379549-3</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Mustererkennung</subfield><subfield code="0">(DE-588)4040936-3</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Sequenzieller Algorithmus</subfield><subfield code="0">(DE-588)4719581-2</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Maschinelles Lernen</subfield><subfield code="0">(DE-588)4193754-5</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="655" ind1=" " ind2="7"><subfield code="0">(DE-588)4113937-9</subfield><subfield code="a">Hochschulschrift</subfield><subfield code="2">gnd-content</subfield></datafield><datafield tag="689" ind1="0" ind2="0"><subfield code="a">Maschinelles Lernen</subfield><subfield code="0">(DE-588)4193754-5</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="0" ind2="1"><subfield code="a">Mustererkennung</subfield><subfield code="0">(DE-588)4040936-3</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="0" ind2="2"><subfield code="a">Rekursives neuronales Netz</subfield><subfield code="0">(DE-588)4379549-3</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="0" ind2=" "><subfield code="5">DE-604</subfield></datafield><datafield tag="689" ind1="1" ind2="0"><subfield code="a">Rekursives neuronales Netz</subfield><subfield code="0">(DE-588)4379549-3</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="1" ind2="1"><subfield code="a">Sequenzieller Algorithmus</subfield><subfield code="0">(DE-588)4719581-2</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="1" ind2="2"><subfield code="a">Maschinelles Lernen</subfield><subfield code="0">(DE-588)4193754-5</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="1" ind2=" "><subfield code="5">DE-604</subfield></datafield><datafield tag="776" ind1="0" ind2="8"><subfield code="i">Erscheint auch als</subfield><subfield code="n">Druck-Ausgabe, Paperback</subfield><subfield code="z">978-3-642-43218-7</subfield></datafield><datafield tag="776" ind1="0" ind2="8"><subfield code="i">Erscheint auch als</subfield><subfield code="n">Online-Ausgabe</subfield><subfield code="z">978-3-642-24797-2</subfield></datafield><datafield tag="830" ind1=" " ind2="0"><subfield code="a">Studies in computational intelligence</subfield><subfield code="v">385</subfield><subfield code="w">(DE-604)BV020822171</subfield><subfield code="9">385</subfield></datafield><datafield tag="856" ind1="4" ind2="2"><subfield code="m">DNB Datenaustausch</subfield><subfield code="q">application/pdf</subfield><subfield code="u">http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=025094927&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA</subfield><subfield code="3">Inhaltsverzeichnis</subfield></datafield><datafield tag="999" ind1=" " ind2=" "><subfield code="a">oai:aleph.bib-bvb.de:BVB01-025094927</subfield></datafield></record></collection> |
| genre | (DE-588)4113937-9 Hochschulschrift gnd-content |
| genre_facet | Hochschulschrift |
| id | DE-604.BV040238691 |
| illustrated | Illustrated |
| indexdate | 2024-07-10T00:19:42Z |
| institution | BVB |
| isbn | 9783642247965 3642247962 |
| language | English |
| oai_aleph_id | oai:aleph.bib-bvb.de:BVB01-025094927 |
| oclc_num | 782967514 |
| open_access_boolean | |
| owner | DE-11 DE-945 DE-83 |
| owner_facet | DE-11 DE-945 DE-83 |
| physical | XII, 141 Seiten Illustrationen, Diagramme 25 cm |
| publishDate | 2012 |
| publishDateSearch | 2012 |
| publishDateSort | 2012 |
| publisher | Springer |
| record_format | marc |
| series | Studies in computational intelligence |
| series2 | Studies in computational intelligence |
| spelling | Graves, Alex 1976- Verfasser (DE-588)136605621 aut Supervised sequence labelling with recurrent neural networks Alex Graves Berlin ; Heidelberg [u.a.] Springer 2012 XII, 141 Seiten Illustrationen, Diagramme 25 cm txt rdacontent n rdamedia nc rdacarrier Studies in computational intelligence 385 Literaturangaben Rekursives neuronales Netz (DE-588)4379549-3 gnd rswk-swf Mustererkennung (DE-588)4040936-3 gnd rswk-swf Sequenzieller Algorithmus (DE-588)4719581-2 gnd rswk-swf Maschinelles Lernen (DE-588)4193754-5 gnd rswk-swf (DE-588)4113937-9 Hochschulschrift gnd-content Maschinelles Lernen (DE-588)4193754-5 s Mustererkennung (DE-588)4040936-3 s Rekursives neuronales Netz (DE-588)4379549-3 s DE-604 Sequenzieller Algorithmus (DE-588)4719581-2 s Erscheint auch als Druck-Ausgabe, Paperback 978-3-642-43218-7 Erscheint auch als Online-Ausgabe 978-3-642-24797-2 Studies in computational intelligence 385 (DE-604)BV020822171 385 DNB Datenaustausch application/pdf http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=025094927&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA Inhaltsverzeichnis |
| spellingShingle | Graves, Alex 1976- Supervised sequence labelling with recurrent neural networks Studies in computational intelligence Rekursives neuronales Netz (DE-588)4379549-3 gnd Mustererkennung (DE-588)4040936-3 gnd Sequenzieller Algorithmus (DE-588)4719581-2 gnd Maschinelles Lernen (DE-588)4193754-5 gnd |
| subject_GND | (DE-588)4379549-3 (DE-588)4040936-3 (DE-588)4719581-2 (DE-588)4193754-5 (DE-588)4113937-9 |
| title | Supervised sequence labelling with recurrent neural networks |
| title_auth | Supervised sequence labelling with recurrent neural networks |
| title_exact_search | Supervised sequence labelling with recurrent neural networks |
| title_full | Supervised sequence labelling with recurrent neural networks Alex Graves |
| title_fullStr | Supervised sequence labelling with recurrent neural networks Alex Graves |
| title_full_unstemmed | Supervised sequence labelling with recurrent neural networks Alex Graves |
| title_short | Supervised sequence labelling with recurrent neural networks |
| title_sort | supervised sequence labelling with recurrent neural networks |
| topic | Rekursives neuronales Netz (DE-588)4379549-3 gnd Mustererkennung (DE-588)4040936-3 gnd Sequenzieller Algorithmus (DE-588)4719581-2 gnd Maschinelles Lernen (DE-588)4193754-5 gnd |
| topic_facet | Rekursives neuronales Netz Mustererkennung Sequenzieller Algorithmus Maschinelles Lernen Hochschulschrift |
| url | http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=025094927&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |
| volume_link | (DE-604)BV020822171 |
| work_keys_str_mv | AT gravesalex supervisedsequencelabellingwithrecurrentneuralnetworks |