Evaluating natural language processing systems:
Abstract: "This report presents a detailed analysis and review of NLP evaluation, in principle and in practice. Part 1 examines evaluation concepts and establishes a framework for NLP system evaluation. This makes use of experience in the related area of information retrieval and the analysis a...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Book |
| Language: | English |
| Published: |
Cambridge
1993
|
| Series: | Computer Laboratory <Cambridge>: Technical report
291 |
| Subjects: | |
| Summary: | Abstract: "This report presents a detailed analysis and review of NLP evaluation, in principle and in practice. Part 1 examines evaluation concepts and establishes a framework for NLP system evaluation. This makes use of experience in the related area of information retrieval and the analysis also refers to evaluation in speech processing. Part 2 surveys significant evaluation work done so far, for instance in machine translation, and discusses the particular problems of generic system evaluation. The conclusion is that evaluation strategies and techniques for NLP need much more development, in particular to take proper account of the influence of system tasks and settings Part 3 develops a general approach to NLP evaluation, aimed at methodologically-sound strategies for test and evaluation motivated by comprehensive performance factor identification. The analysis throughout the report is supported by extensive illustrative examples. |
| Physical Description: | 187 S. |
Staff View
MARC
| LEADER | 00000nam a2200000 cb4500 | ||
|---|---|---|---|
| 001 | BV010412217 | ||
| 003 | DE-604 | ||
| 005 | 19960925 | ||
| 007 | t | ||
| 008 | 951009s1993 |||| 00||| engod | ||
| 035 | |a (OCoLC)28691487 | ||
| 035 | |a (DE-599)BVBBV010412217 | ||
| 040 | |a DE-604 |b ger |e rakddb | ||
| 041 | 0 | |a eng | |
| 084 | |a DAT 710f |2 stub | ||
| 100 | 1 | |a Galliers, Julia R. |e Verfasser |4 aut | |
| 245 | 1 | 0 | |a Evaluating natural language processing systems |c J. R. Galliers and K. Sparck Jones |
| 264 | 1 | |a Cambridge |c 1993 | |
| 300 | |a 187 S. | ||
| 336 | |b txt |2 rdacontent | ||
| 337 | |b n |2 rdamedia | ||
| 338 | |b nc |2 rdacarrier | ||
| 490 | 1 | |a Computer Laboratory <Cambridge>: Technical report |v 291 | |
| 520 | 3 | |a Abstract: "This report presents a detailed analysis and review of NLP evaluation, in principle and in practice. Part 1 examines evaluation concepts and establishes a framework for NLP system evaluation. This makes use of experience in the related area of information retrieval and the analysis also refers to evaluation in speech processing. Part 2 surveys significant evaluation work done so far, for instance in machine translation, and discusses the particular problems of generic system evaluation. The conclusion is that evaluation strategies and techniques for NLP need much more development, in particular to take proper account of the influence of system tasks and settings | |
| 520 | 3 | |a Part 3 develops a general approach to NLP evaluation, aimed at methodologically-sound strategies for test and evaluation motivated by comprehensive performance factor identification. The analysis throughout the report is supported by extensive illustrative examples. | |
| 650 | 7 | |a Computer software |2 sigle | |
| 650 | 7 | |a Information theory |2 sigle | |
| 650 | 4 | |a Natural language processing (Computer science) | |
| 700 | 1 | |a Sparck Jones, Karen |d 1935-2007 |e Verfasser |0 (DE-588)122675436 |4 aut | |
| 830 | 0 | |a Computer Laboratory <Cambridge>: Technical report |v 291 |w (DE-604)BV004055605 |9 291 | |
| 999 | |a oai:aleph.bib-bvb.de:BVB01-006934079 | ||
Record in the Search Index
| _version_ | 1804124840774336512 |
|---|---|
| any_adam_object | |
| author | Galliers, Julia R. Sparck Jones, Karen 1935-2007 |
| author_GND | (DE-588)122675436 |
| author_facet | Galliers, Julia R. Sparck Jones, Karen 1935-2007 |
| author_role | aut aut |
| author_sort | Galliers, Julia R. |
| author_variant | j r g jr jrg j k s jk jks |
| building | Verbundindex |
| bvnumber | BV010412217 |
| classification_tum | DAT 710f |
| ctrlnum | (OCoLC)28691487 (DE-599)BVBBV010412217 |
| discipline | Informatik |
| format | Book |
| fullrecord | <?xml version="1.0" encoding="UTF-8"?><collection xmlns="http://www.loc.gov/MARC21/slim"><record><leader>02049nam a2200337 cb4500</leader><controlfield tag="001">BV010412217</controlfield><controlfield tag="003">DE-604</controlfield><controlfield tag="005">19960925 </controlfield><controlfield tag="007">t</controlfield><controlfield tag="008">951009s1993 |||| 00||| engod</controlfield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(OCoLC)28691487</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(DE-599)BVBBV010412217</subfield></datafield><datafield tag="040" ind1=" " ind2=" "><subfield code="a">DE-604</subfield><subfield code="b">ger</subfield><subfield code="e">rakddb</subfield></datafield><datafield tag="041" ind1="0" ind2=" "><subfield code="a">eng</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">DAT 710f</subfield><subfield code="2">stub</subfield></datafield><datafield tag="100" ind1="1" ind2=" "><subfield code="a">Galliers, Julia R.</subfield><subfield code="e">Verfasser</subfield><subfield code="4">aut</subfield></datafield><datafield tag="245" ind1="1" ind2="0"><subfield code="a">Evaluating natural language processing systems</subfield><subfield code="c">J. R. Galliers and K. Sparck Jones</subfield></datafield><datafield tag="264" ind1=" " ind2="1"><subfield code="a">Cambridge</subfield><subfield code="c">1993</subfield></datafield><datafield tag="300" ind1=" " ind2=" "><subfield code="a">187 S.</subfield></datafield><datafield tag="336" ind1=" " ind2=" "><subfield code="b">txt</subfield><subfield code="2">rdacontent</subfield></datafield><datafield tag="337" ind1=" " ind2=" "><subfield code="b">n</subfield><subfield code="2">rdamedia</subfield></datafield><datafield tag="338" ind1=" " ind2=" "><subfield code="b">nc</subfield><subfield code="2">rdacarrier</subfield></datafield><datafield tag="490" ind1="1" ind2=" "><subfield code="a">Computer Laboratory <Cambridge>: Technical report</subfield><subfield code="v">291</subfield></datafield><datafield tag="520" ind1="3" ind2=" "><subfield code="a">Abstract: "This report presents a detailed analysis and review of NLP evaluation, in principle and in practice. Part 1 examines evaluation concepts and establishes a framework for NLP system evaluation. This makes use of experience in the related area of information retrieval and the analysis also refers to evaluation in speech processing. Part 2 surveys significant evaluation work done so far, for instance in machine translation, and discusses the particular problems of generic system evaluation. The conclusion is that evaluation strategies and techniques for NLP need much more development, in particular to take proper account of the influence of system tasks and settings</subfield></datafield><datafield tag="520" ind1="3" ind2=" "><subfield code="a">Part 3 develops a general approach to NLP evaluation, aimed at methodologically-sound strategies for test and evaluation motivated by comprehensive performance factor identification. The analysis throughout the report is supported by extensive illustrative examples.</subfield></datafield><datafield tag="650" ind1=" " ind2="7"><subfield code="a">Computer software</subfield><subfield code="2">sigle</subfield></datafield><datafield tag="650" ind1=" " ind2="7"><subfield code="a">Information theory</subfield><subfield code="2">sigle</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Natural language processing (Computer science)</subfield></datafield><datafield tag="700" ind1="1" ind2=" "><subfield code="a">Sparck Jones, Karen</subfield><subfield code="d">1935-2007</subfield><subfield code="e">Verfasser</subfield><subfield code="0">(DE-588)122675436</subfield><subfield code="4">aut</subfield></datafield><datafield tag="830" ind1=" " ind2="0"><subfield code="a">Computer Laboratory <Cambridge>: Technical report</subfield><subfield code="v">291</subfield><subfield code="w">(DE-604)BV004055605</subfield><subfield code="9">291</subfield></datafield><datafield tag="999" ind1=" " ind2=" "><subfield code="a">oai:aleph.bib-bvb.de:BVB01-006934079</subfield></datafield></record></collection> |
| id | DE-604.BV010412217 |
| illustrated | Not Illustrated |
| indexdate | 2024-07-09T17:52:04Z |
| institution | BVB |
| language | English |
| oai_aleph_id | oai:aleph.bib-bvb.de:BVB01-006934079 |
| oclc_num | 28691487 |
| open_access_boolean | |
| physical | 187 S. |
| publishDate | 1993 |
| publishDateSearch | 1993 |
| publishDateSort | 1993 |
| record_format | marc |
| series | Computer Laboratory <Cambridge>: Technical report |
| series2 | Computer Laboratory <Cambridge>: Technical report |
| spelling | Galliers, Julia R. Verfasser aut Evaluating natural language processing systems J. R. Galliers and K. Sparck Jones Cambridge 1993 187 S. txt rdacontent n rdamedia nc rdacarrier Computer Laboratory <Cambridge>: Technical report 291 Abstract: "This report presents a detailed analysis and review of NLP evaluation, in principle and in practice. Part 1 examines evaluation concepts and establishes a framework for NLP system evaluation. This makes use of experience in the related area of information retrieval and the analysis also refers to evaluation in speech processing. Part 2 surveys significant evaluation work done so far, for instance in machine translation, and discusses the particular problems of generic system evaluation. The conclusion is that evaluation strategies and techniques for NLP need much more development, in particular to take proper account of the influence of system tasks and settings Part 3 develops a general approach to NLP evaluation, aimed at methodologically-sound strategies for test and evaluation motivated by comprehensive performance factor identification. The analysis throughout the report is supported by extensive illustrative examples. Computer software sigle Information theory sigle Natural language processing (Computer science) Sparck Jones, Karen 1935-2007 Verfasser (DE-588)122675436 aut Computer Laboratory <Cambridge>: Technical report 291 (DE-604)BV004055605 291 |
| spellingShingle | Galliers, Julia R. Sparck Jones, Karen 1935-2007 Evaluating natural language processing systems Computer Laboratory <Cambridge>: Technical report Computer software sigle Information theory sigle Natural language processing (Computer science) |
| title | Evaluating natural language processing systems |
| title_auth | Evaluating natural language processing systems |
| title_exact_search | Evaluating natural language processing systems |
| title_full | Evaluating natural language processing systems J. R. Galliers and K. Sparck Jones |
| title_fullStr | Evaluating natural language processing systems J. R. Galliers and K. Sparck Jones |
| title_full_unstemmed | Evaluating natural language processing systems J. R. Galliers and K. Sparck Jones |
| title_short | Evaluating natural language processing systems |
| title_sort | evaluating natural language processing systems |
| topic | Computer software sigle Information theory sigle Natural language processing (Computer science) |
| topic_facet | Computer software Information theory Natural language processing (Computer science) |
| volume_link | (DE-604)BV004055605 |
| work_keys_str_mv | AT galliersjuliar evaluatingnaturallanguageprocessingsystems AT sparckjoneskaren evaluatingnaturallanguageprocessingsystems |