Explainable natural language processing:
Saved in:
| Main Author: | |
|---|---|
| Format: | Book |
| Language: | English |
| Published: |
San Rafael
Morgan & Claypool Publishers
2021
|
| Series: | Synthesis lectures on human language technologies
51 |
| Subjects: | |
| Online Access: | Inhaltsverzeichnis |
| Physical Description: | xv, 107 Seiten |
| ISBN: | 1636392156 9781636392158 163639213X 9781636392134 |
Staff View
MARC
| LEADER | 00000nam a22000008cb4500 | ||
|---|---|---|---|
| 001 | BV047573811 | ||
| 003 | DE-604 | ||
| 005 | 20220112 | ||
| 007 | t | ||
| 008 | 211104s2021 |||| 00||| eng d | ||
| 020 | |a 1636392156 |9 1-63639-215-6 | ||
| 020 | |a 9781636392158 |9 978-1-63639-215-8 | ||
| 020 | |a 163639213X |9 1-63639-213-X | ||
| 020 | |a 9781636392134 |9 978-1-63639-213-4 | ||
| 035 | |a (OCoLC)1298744776 | ||
| 035 | |a (DE-599)KXP1774448734 | ||
| 040 | |a DE-604 |b ger |e rda | ||
| 041 | 0 | |a eng | |
| 049 | |a DE-739 |a DE-29T | ||
| 084 | |a ST 306 |0 (DE-625)143654: |2 rvk | ||
| 100 | 1 | |a Søgaard, Anders |d ca. 20./21. Jh. |e Verfasser |0 (DE-588)1249359767 |4 aut | |
| 245 | 1 | 0 | |a Explainable natural language processing |c Anders Søgaard |
| 264 | 1 | |a San Rafael |b Morgan & Claypool Publishers |c 2021 | |
| 300 | |a xv, 107 Seiten | ||
| 336 | |b txt |2 rdacontent | ||
| 337 | |b n |2 rdamedia | ||
| 338 | |b nc |2 rdacarrier | ||
| 490 | 1 | |a Synthesis lectures on human language technologies |v 51 | |
| 650 | 0 | 7 | |a Automatische Sprachanalyse |0 (DE-588)4129935-8 |2 gnd |9 rswk-swf |
| 650 | 0 | 7 | |a Taxonomie |0 (DE-588)4184546-8 |2 gnd |9 rswk-swf |
| 689 | 0 | 0 | |a Automatische Sprachanalyse |0 (DE-588)4129935-8 |D s |
| 689 | 0 | 1 | |a Taxonomie |0 (DE-588)4184546-8 |D s |
| 689 | 0 | |5 DE-604 | |
| 830 | 0 | |a Synthesis lectures on human language technologies |v 51 |w (DE-604)BV035447238 |9 51 | |
| 856 | 4 | 2 | |m Digitalisierung UB Passau - ADAM Catalogue Enrichment |q application/pdf |u http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=032959371&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |3 Inhaltsverzeichnis |
| 943 | 1 | |a oai:aleph.bib-bvb.de:BVB01-032959371 | |
Record in the Search Index
| _version_ | 1809493389618446336 |
|---|---|
| adam_text |
Contents Acknowledgments . xv 1 Introduction. 1 1.1 1.3 Two Common Distinctions. 3 1.1.1 Local and Global Explanations .3 1.1.2 Intrinsic and Post-Hoc Explanations. 5 Shortcomings of Existing Taxonomies.6 1.2.1 Guidotti et al. (2018). 6 1.2.2 Adadi and Berrada (2019) . 7 1.2.3 Carvalho et al. (2019). 7 1.2.4 Molnar (2019).S 1.2.5 Zhang et al. (2020). 8 1.2.6 Danilevsky et al. (2020) . 9 1.2.7 Das et al. (2020).9 1.2.8 Atanasova et al. (2020). 10 1.2.9 Kotonya and Toni
(2020). 10 The Method-Form Fallacy.11 1.4 1.5 Inconsistent Classifications.11 A Novel Taxonomy . 11 1.2 2 A Framework for Explainable NLP. 13 2.1 NLP Architectures.13 2.1.1 Linear and Nonlinear Classification.13 2.1.2 Recurrent Models.14 2.1.3 Transformers.15 2.1.4 Overview of Applications and Architectures. 16 2.2 Local and Global Explanations. 17 2.3 2.4 2.5 Backward Methods . 17 Forward Explaining by Intermediate Representations. 18 Forward Explaining by Continuous Outputs.19 2.6 Forward Explaining by Discrete
Outputs. 19
xii 3 4 5 6 Local-Backward Explanations.21 3.1 3.2 3.3 3.4 Vanilla Gradients.21 Guided Back-Propagation.21 Layer-Wise Relevance Propagation. 22 Deep Taylor Decomposition. 23 3.5 Integrated Gradients .23 3.6 DeepLift. 24 Global-Backward Explanations.25 4.1 4.2 Post-Hoc Unstructured Pruning. 25 Lottery Tickets.26 4.3 4.4 Dynamic Sparse Training .27 Binary Networks and Sparse Coding. 28 Local-Forward Explanations of Intermediate Representations.31 5.1 5.2 5.3 5.4
Gates.31 Attention . 31 Attention Roll-Out and Attention Flow. 32 Layer-Wise Attention'fracing. 33 5.5 Attention Decoding. 34 Global-Forward Explanations of Intermediate Representations.35 6.1 6.2 7 8 Gate Pruning. 35 Attention I lead Pruning.36 Local-Forward Explanations of Continuous Output. 39 7.1 Word Association Norms.39 7.2 7.3 Word Analogies. 39 Time Step Dynamics.40 Global-Forward Explanations of Continuous Output.43 8.1 Correlation of Representations . 43 8.2 8.3
Clustering. 44 Probing Classifiers. 44 8.4 Concept Activation .45 8.5 Influential Examples . 46
XIII 9 Local-Forward Explanations of Discrete Output.49 9.1 9.2 9.3 10 Global-Forward Explanations of DiscreteOutput.53 10.1 10.2 10.3 11 12 Uptraining . 53 Meta-Analysis .54 Downstream Evaluation.54 Evaluating Explanations .55 11.1 Flavors of Explanations. 55 11.2 11.3 11.4 Heuristics.58 Human Annotations .60 Human Experiments.61 Perspectives. 63 12.1 12.2 12.3 13 Challenge Datasets. 49 Loca! Uptraining.50 Influential Examples
.51 General Observations. 63 Beyond Taxonomy.67 Moral Foundations of Explanations .68 Resources. 71 13.1 1.3.2 Code. 71 Datasets and Benchmarks. 73 Bibliography. 75 Author’s Biography.107 |
| adam_txt |
Contents Acknowledgments . xv 1 Introduction. 1 1.1 1.3 Two Common Distinctions. 3 1.1.1 Local and Global Explanations .3 1.1.2 Intrinsic and Post-Hoc Explanations. 5 Shortcomings of Existing Taxonomies.6 1.2.1 Guidotti et al. (2018). 6 1.2.2 Adadi and Berrada (2019) . 7 1.2.3 Carvalho et al. (2019). 7 1.2.4 Molnar (2019).S 1.2.5 Zhang et al. (2020). 8 1.2.6 Danilevsky et al. (2020) . 9 1.2.7 Das et al. (2020).9 1.2.8 Atanasova et al. (2020). 10 1.2.9 Kotonya and Toni
(2020). 10 The Method-Form Fallacy.11 1.4 1.5 Inconsistent Classifications.11 A Novel Taxonomy . 11 1.2 2 A Framework for Explainable NLP. 13 2.1 NLP Architectures.13 2.1.1 Linear and Nonlinear Classification.13 2.1.2 Recurrent Models.14 2.1.3 Transformers.15 2.1.4 Overview of Applications and Architectures. 16 2.2 Local and Global Explanations. 17 2.3 2.4 2.5 Backward Methods . 17 Forward Explaining by Intermediate Representations. 18 Forward Explaining by Continuous Outputs.19 2.6 Forward Explaining by Discrete
Outputs. 19
xii 3 4 5 6 Local-Backward Explanations.21 3.1 3.2 3.3 3.4 Vanilla Gradients.21 Guided Back-Propagation.21 Layer-Wise Relevance Propagation. 22 Deep Taylor Decomposition. 23 3.5 Integrated Gradients .23 3.6 DeepLift. 24 Global-Backward Explanations.25 4.1 4.2 Post-Hoc Unstructured Pruning. 25 Lottery Tickets.26 4.3 4.4 Dynamic Sparse Training .27 Binary Networks and Sparse Coding. 28 Local-Forward Explanations of Intermediate Representations.31 5.1 5.2 5.3 5.4
Gates.31 Attention . 31 Attention Roll-Out and Attention Flow. 32 Layer-Wise Attention'fracing. 33 5.5 Attention Decoding. 34 Global-Forward Explanations of Intermediate Representations.35 6.1 6.2 7 8 Gate Pruning. 35 Attention I lead Pruning.36 Local-Forward Explanations of Continuous Output. 39 7.1 Word Association Norms.39 7.2 7.3 Word Analogies. 39 Time Step Dynamics.40 Global-Forward Explanations of Continuous Output.43 8.1 Correlation of Representations . 43 8.2 8.3
Clustering. 44 Probing Classifiers. 44 8.4 Concept Activation .45 8.5 Influential Examples . 46
XIII 9 Local-Forward Explanations of Discrete Output.49 9.1 9.2 9.3 10 Global-Forward Explanations of DiscreteOutput.53 10.1 10.2 10.3 11 12 Uptraining . 53 Meta-Analysis .54 Downstream Evaluation.54 Evaluating Explanations .55 11.1 Flavors of Explanations. 55 11.2 11.3 11.4 Heuristics.58 Human Annotations .60 Human Experiments.61 Perspectives. 63 12.1 12.2 12.3 13 Challenge Datasets. 49 Loca! Uptraining.50 Influential Examples
.51 General Observations. 63 Beyond Taxonomy.67 Moral Foundations of Explanations .68 Resources. 71 13.1 1.3.2 Code. 71 Datasets and Benchmarks. 73 Bibliography. 75 Author’s Biography.107 |
| any_adam_object | 1 |
| any_adam_object_boolean | 1 |
| author | Søgaard, Anders ca. 20./21. Jh |
| author_GND | (DE-588)1249359767 |
| author_facet | Søgaard, Anders ca. 20./21. Jh |
| author_role | aut |
| author_sort | Søgaard, Anders ca. 20./21. Jh |
| author_variant | a s as |
| building | Verbundindex |
| bvnumber | BV047573811 |
| classification_rvk | ST 306 |
| ctrlnum | (OCoLC)1298744776 (DE-599)KXP1774448734 |
| discipline | Informatik |
| discipline_str_mv | Informatik |
| format | Book |
| fullrecord | <?xml version="1.0" encoding="UTF-8"?><collection xmlns="http://www.loc.gov/MARC21/slim"><record><leader>00000nam a22000008cb4500</leader><controlfield tag="001">BV047573811</controlfield><controlfield tag="003">DE-604</controlfield><controlfield tag="005">20220112</controlfield><controlfield tag="007">t</controlfield><controlfield tag="008">211104s2021 |||| 00||| eng d</controlfield><datafield tag="020" ind1=" " ind2=" "><subfield code="a">1636392156</subfield><subfield code="9">1-63639-215-6</subfield></datafield><datafield tag="020" ind1=" " ind2=" "><subfield code="a">9781636392158</subfield><subfield code="9">978-1-63639-215-8</subfield></datafield><datafield tag="020" ind1=" " ind2=" "><subfield code="a">163639213X</subfield><subfield code="9">1-63639-213-X</subfield></datafield><datafield tag="020" ind1=" " ind2=" "><subfield code="a">9781636392134</subfield><subfield code="9">978-1-63639-213-4</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(OCoLC)1298744776</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(DE-599)KXP1774448734</subfield></datafield><datafield tag="040" ind1=" " ind2=" "><subfield code="a">DE-604</subfield><subfield code="b">ger</subfield><subfield code="e">rda</subfield></datafield><datafield tag="041" ind1="0" ind2=" "><subfield code="a">eng</subfield></datafield><datafield tag="049" ind1=" " ind2=" "><subfield code="a">DE-739</subfield><subfield code="a">DE-29T</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">ST 306</subfield><subfield code="0">(DE-625)143654:</subfield><subfield code="2">rvk</subfield></datafield><datafield tag="100" ind1="1" ind2=" "><subfield code="a">Søgaard, Anders</subfield><subfield code="d">ca. 20./21. Jh.</subfield><subfield code="e">Verfasser</subfield><subfield code="0">(DE-588)1249359767</subfield><subfield code="4">aut</subfield></datafield><datafield tag="245" ind1="1" ind2="0"><subfield code="a">Explainable natural language processing</subfield><subfield code="c">Anders Søgaard</subfield></datafield><datafield tag="264" ind1=" " ind2="1"><subfield code="a">San Rafael</subfield><subfield code="b">Morgan & Claypool Publishers</subfield><subfield code="c">2021</subfield></datafield><datafield tag="300" ind1=" " ind2=" "><subfield code="a">xv, 107 Seiten</subfield></datafield><datafield tag="336" ind1=" " ind2=" "><subfield code="b">txt</subfield><subfield code="2">rdacontent</subfield></datafield><datafield tag="337" ind1=" " ind2=" "><subfield code="b">n</subfield><subfield code="2">rdamedia</subfield></datafield><datafield tag="338" ind1=" " ind2=" "><subfield code="b">nc</subfield><subfield code="2">rdacarrier</subfield></datafield><datafield tag="490" ind1="1" ind2=" "><subfield code="a">Synthesis lectures on human language technologies</subfield><subfield code="v">51</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Automatische Sprachanalyse</subfield><subfield code="0">(DE-588)4129935-8</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Taxonomie</subfield><subfield code="0">(DE-588)4184546-8</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="689" ind1="0" ind2="0"><subfield code="a">Automatische Sprachanalyse</subfield><subfield code="0">(DE-588)4129935-8</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="0" ind2="1"><subfield code="a">Taxonomie</subfield><subfield code="0">(DE-588)4184546-8</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="0" ind2=" "><subfield code="5">DE-604</subfield></datafield><datafield tag="830" ind1=" " ind2="0"><subfield code="a">Synthesis lectures on human language technologies</subfield><subfield code="v">51</subfield><subfield code="w">(DE-604)BV035447238</subfield><subfield code="9">51</subfield></datafield><datafield tag="856" ind1="4" ind2="2"><subfield code="m">Digitalisierung UB Passau - ADAM Catalogue Enrichment</subfield><subfield code="q">application/pdf</subfield><subfield code="u">http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=032959371&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA</subfield><subfield code="3">Inhaltsverzeichnis</subfield></datafield><datafield tag="943" ind1="1" ind2=" "><subfield code="a">oai:aleph.bib-bvb.de:BVB01-032959371</subfield></datafield></record></collection> |
| id | DE-604.BV047573811 |
| illustrated | Not Illustrated |
| index_date | 2024-07-03T18:31:15Z |
| indexdate | 2024-09-07T00:02:50Z |
| institution | BVB |
| isbn | 1636392156 9781636392158 163639213X 9781636392134 |
| language | English |
| oai_aleph_id | oai:aleph.bib-bvb.de:BVB01-032959371 |
| oclc_num | 1298744776 |
| open_access_boolean | |
| owner | DE-739 DE-29T |
| owner_facet | DE-739 DE-29T |
| physical | xv, 107 Seiten |
| publishDate | 2021 |
| publishDateSearch | 2021 |
| publishDateSort | 2021 |
| publisher | Morgan & Claypool Publishers |
| record_format | marc |
| series | Synthesis lectures on human language technologies |
| series2 | Synthesis lectures on human language technologies |
| spelling | Søgaard, Anders ca. 20./21. Jh. Verfasser (DE-588)1249359767 aut Explainable natural language processing Anders Søgaard San Rafael Morgan & Claypool Publishers 2021 xv, 107 Seiten txt rdacontent n rdamedia nc rdacarrier Synthesis lectures on human language technologies 51 Automatische Sprachanalyse (DE-588)4129935-8 gnd rswk-swf Taxonomie (DE-588)4184546-8 gnd rswk-swf Automatische Sprachanalyse (DE-588)4129935-8 s Taxonomie (DE-588)4184546-8 s DE-604 Synthesis lectures on human language technologies 51 (DE-604)BV035447238 51 Digitalisierung UB Passau - ADAM Catalogue Enrichment application/pdf http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=032959371&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA Inhaltsverzeichnis |
| spellingShingle | Søgaard, Anders ca. 20./21. Jh Explainable natural language processing Synthesis lectures on human language technologies Automatische Sprachanalyse (DE-588)4129935-8 gnd Taxonomie (DE-588)4184546-8 gnd |
| subject_GND | (DE-588)4129935-8 (DE-588)4184546-8 |
| title | Explainable natural language processing |
| title_auth | Explainable natural language processing |
| title_exact_search | Explainable natural language processing |
| title_exact_search_txtP | Explainable natural language processing |
| title_full | Explainable natural language processing Anders Søgaard |
| title_fullStr | Explainable natural language processing Anders Søgaard |
| title_full_unstemmed | Explainable natural language processing Anders Søgaard |
| title_short | Explainable natural language processing |
| title_sort | explainable natural language processing |
| topic | Automatische Sprachanalyse (DE-588)4129935-8 gnd Taxonomie (DE-588)4184546-8 gnd |
| topic_facet | Automatische Sprachanalyse Taxonomie |
| url | http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=032959371&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |
| volume_link | (DE-604)BV035447238 |
| work_keys_str_mv | AT søgaardanders explainablenaturallanguageprocessing |