Item characteristics and test-taker disengagement in PISA:
If test-takers do not engage with the assessment, the reliability of test scores and the validity of inferences about their proficiency may suffer. Test-taker disengagement is particularly likely in low-stakes assessments and, according to prior research, for certain types of students. But levels of...
Gespeichert in:
| 1. Verfasser: | |
|---|---|
| Weitere Verfasser: | , , |
| Format: | Elektronisch E-Book |
| Sprache: | English |
| Veröffentlicht: |
Paris
OECD Publishing
2024
|
| Schriftenreihe: | OECD Education Working Papers
|
| Schlagworte: | |
| Online-Zugang: | Volltext |
| Zusammenfassung: | If test-takers do not engage with the assessment, the reliability of test scores and the validity of inferences about their proficiency may suffer. Test-taker disengagement is particularly likely in low-stakes assessments and, according to prior research, for certain types of students. But levels of engagement may also be related to aspects that test developers can manipulate, such as item characteristics. This paper investigates which item characteristics are associated with two indicators of test-taker disengagement, rapid guessing and breakoffs, in an international assessment of reading. Analyses of data from almost 500 000 students from 67 countries and economies that took part in the 2018 Programme for International Student Assessment (PISA) show that rapid guessing was observed mainly on simple multiple-choice questions. Breakoffs were more likely in the presence of idiosyncratic selected-response formats, such as hot spot or matching tasks. Both rapid guessing and breakoffs were more frequent on tasks involving long and complex texts |
| Beschreibung: | 1 Online-Ressource (32 Seiten) 21 x 28cm |
| DOI: | 10.1787/7abea67b-en |
Internformat
MARC
| LEADER | 00000nam a2200000zc 4500 | ||
|---|---|---|---|
| 001 | BV050073831 | ||
| 003 | DE-604 | ||
| 007 | cr|uuu---uuuuu | ||
| 008 | 241209s2024 xx o|||| 00||| eng d | ||
| 024 | 7 | |a 10.1787/7abea67b-en |2 doi | |
| 035 | |a (ZDB-13-SOC)104405139 | ||
| 035 | |a (DE-599)BVBBV050073831 | ||
| 040 | |a DE-604 |b ger |e rda | ||
| 041 | 0 | |a eng | |
| 049 | |a DE-384 |a DE-91 |a DE-473 |a DE-824 |a DE-29 |a DE-739 |a DE-355 |a DE-20 |a DE-1028 |a DE-1049 |a DE-188 |a DE-521 |a DE-861 |a DE-898 |a DE-92 |a DE-573 |a DE-19 | ||
| 100 | 1 | |a Avvisati, Francesco |e Verfasser |4 aut | |
| 245 | 1 | 0 | |a Item characteristics and test-taker disengagement in PISA |c Francesco, Avvisati ... [et al] |
| 264 | 1 | |a Paris |b OECD Publishing |c 2024 | |
| 300 | |a 1 Online-Ressource (32 Seiten) |c 21 x 28cm | ||
| 336 | |b txt |2 rdacontent | ||
| 337 | |b c |2 rdamedia | ||
| 338 | |b cr |2 rdacarrier | ||
| 490 | 0 | |a OECD Education Working Papers | |
| 520 | |a If test-takers do not engage with the assessment, the reliability of test scores and the validity of inferences about their proficiency may suffer. Test-taker disengagement is particularly likely in low-stakes assessments and, according to prior research, for certain types of students. But levels of engagement may also be related to aspects that test developers can manipulate, such as item characteristics. This paper investigates which item characteristics are associated with two indicators of test-taker disengagement, rapid guessing and breakoffs, in an international assessment of reading. Analyses of data from almost 500 000 students from 67 countries and economies that took part in the 2018 Programme for International Student Assessment (PISA) show that rapid guessing was observed mainly on simple multiple-choice questions. Breakoffs were more likely in the presence of idiosyncratic selected-response formats, such as hot spot or matching tasks. Both rapid guessing and breakoffs were more frequent on tasks involving long and complex texts | ||
| 650 | 4 | |a Education | |
| 700 | 1 | |a Buchholz, Janine |4 ctb | |
| 700 | 1 | |a Piacentini, Mario |4 ctb | |
| 700 | 1 | |a Vargas Madriz, Luis Francisco |4 ctb | |
| 856 | 4 | 0 | |u https://doi.org/10.1787/7abea67b-en |x Verlag |z kostenfrei |3 Volltext |
| 912 | |a ZDB-13-SOC | ||
| 943 | 1 | |a oai:aleph.bib-bvb.de:BVB01-035411193 | |
Datensatz im Suchindex
| _version_ | 1822611095237427200 |
|---|---|
| adam_text | |
| any_adam_object | |
| author | Avvisati, Francesco |
| author2 | Buchholz, Janine Piacentini, Mario Vargas Madriz, Luis Francisco |
| author2_role | ctb ctb ctb |
| author2_variant | j b jb m p mp m l f v mlf mlfv |
| author_facet | Avvisati, Francesco Buchholz, Janine Piacentini, Mario Vargas Madriz, Luis Francisco |
| author_role | aut |
| author_sort | Avvisati, Francesco |
| author_variant | f a fa |
| building | Verbundindex |
| bvnumber | BV050073831 |
| collection | ZDB-13-SOC |
| ctrlnum | (ZDB-13-SOC)104405139 (DE-599)BVBBV050073831 |
| discipline | Wirtschaftswissenschaften |
| doi_str_mv | 10.1787/7abea67b-en |
| format | Electronic eBook |
| fullrecord | <?xml version="1.0" encoding="UTF-8"?><collection xmlns="http://www.loc.gov/MARC21/slim"><record><leader>00000nam a2200000zc 4500</leader><controlfield tag="001">BV050073831</controlfield><controlfield tag="003">DE-604</controlfield><controlfield tag="007">cr|uuu---uuuuu</controlfield><controlfield tag="008">241209s2024 xx o|||| 00||| eng d</controlfield><datafield tag="024" ind1="7" ind2=" "><subfield code="a">10.1787/7abea67b-en</subfield><subfield code="2">doi</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(ZDB-13-SOC)104405139</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(DE-599)BVBBV050073831</subfield></datafield><datafield tag="040" ind1=" " ind2=" "><subfield code="a">DE-604</subfield><subfield code="b">ger</subfield><subfield code="e">rda</subfield></datafield><datafield tag="041" ind1="0" ind2=" "><subfield code="a">eng</subfield></datafield><datafield tag="049" ind1=" " ind2=" "><subfield code="a">DE-384</subfield><subfield code="a">DE-91</subfield><subfield code="a">DE-473</subfield><subfield code="a">DE-824</subfield><subfield code="a">DE-29</subfield><subfield code="a">DE-739</subfield><subfield code="a">DE-355</subfield><subfield code="a">DE-20</subfield><subfield code="a">DE-1028</subfield><subfield code="a">DE-1049</subfield><subfield code="a">DE-188</subfield><subfield code="a">DE-521</subfield><subfield code="a">DE-861</subfield><subfield code="a">DE-898</subfield><subfield code="a">DE-92</subfield><subfield code="a">DE-573</subfield><subfield code="a">DE-19</subfield></datafield><datafield tag="100" ind1="1" ind2=" "><subfield code="a">Avvisati, Francesco</subfield><subfield code="e">Verfasser</subfield><subfield code="4">aut</subfield></datafield><datafield tag="245" ind1="1" ind2="0"><subfield code="a">Item characteristics and test-taker disengagement in PISA</subfield><subfield code="c">Francesco, Avvisati ... [et al]</subfield></datafield><datafield tag="264" ind1=" " ind2="1"><subfield code="a">Paris</subfield><subfield code="b">OECD Publishing</subfield><subfield code="c">2024</subfield></datafield><datafield tag="300" ind1=" " ind2=" "><subfield code="a">1 Online-Ressource (32 Seiten)</subfield><subfield code="c">21 x 28cm</subfield></datafield><datafield tag="336" ind1=" " ind2=" "><subfield code="b">txt</subfield><subfield code="2">rdacontent</subfield></datafield><datafield tag="337" ind1=" " ind2=" "><subfield code="b">c</subfield><subfield code="2">rdamedia</subfield></datafield><datafield tag="338" ind1=" " ind2=" "><subfield code="b">cr</subfield><subfield code="2">rdacarrier</subfield></datafield><datafield tag="490" ind1="0" ind2=" "><subfield code="a">OECD Education Working Papers</subfield></datafield><datafield tag="520" ind1=" " ind2=" "><subfield code="a">If test-takers do not engage with the assessment, the reliability of test scores and the validity of inferences about their proficiency may suffer. Test-taker disengagement is particularly likely in low-stakes assessments and, according to prior research, for certain types of students. But levels of engagement may also be related to aspects that test developers can manipulate, such as item characteristics. This paper investigates which item characteristics are associated with two indicators of test-taker disengagement, rapid guessing and breakoffs, in an international assessment of reading. Analyses of data from almost 500 000 students from 67 countries and economies that took part in the 2018 Programme for International Student Assessment (PISA) show that rapid guessing was observed mainly on simple multiple-choice questions. Breakoffs were more likely in the presence of idiosyncratic selected-response formats, such as hot spot or matching tasks. Both rapid guessing and breakoffs were more frequent on tasks involving long and complex texts</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Education</subfield></datafield><datafield tag="700" ind1="1" ind2=" "><subfield code="a">Buchholz, Janine</subfield><subfield code="4">ctb</subfield></datafield><datafield tag="700" ind1="1" ind2=" "><subfield code="a">Piacentini, Mario</subfield><subfield code="4">ctb</subfield></datafield><datafield tag="700" ind1="1" ind2=" "><subfield code="a">Vargas Madriz, Luis Francisco</subfield><subfield code="4">ctb</subfield></datafield><datafield tag="856" ind1="4" ind2="0"><subfield code="u">https://doi.org/10.1787/7abea67b-en</subfield><subfield code="x">Verlag</subfield><subfield code="z">kostenfrei</subfield><subfield code="3">Volltext</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">ZDB-13-SOC</subfield></datafield><datafield tag="943" ind1="1" ind2=" "><subfield code="a">oai:aleph.bib-bvb.de:BVB01-035411193</subfield></datafield></record></collection> |
| id | DE-604.BV050073831 |
| illustrated | Not Illustrated |
| indexdate | 2025-01-29T19:03:10Z |
| institution | BVB |
| language | English |
| oai_aleph_id | oai:aleph.bib-bvb.de:BVB01-035411193 |
| open_access_boolean | 1 |
| owner | DE-384 DE-91 DE-BY-TUM DE-473 DE-BY-UBG DE-824 DE-29 DE-739 DE-355 DE-BY-UBR DE-20 DE-1028 DE-1049 DE-188 DE-521 DE-861 DE-898 DE-BY-UBR DE-92 DE-573 DE-19 DE-BY-UBM |
| owner_facet | DE-384 DE-91 DE-BY-TUM DE-473 DE-BY-UBG DE-824 DE-29 DE-739 DE-355 DE-BY-UBR DE-20 DE-1028 DE-1049 DE-188 DE-521 DE-861 DE-898 DE-BY-UBR DE-92 DE-573 DE-19 DE-BY-UBM |
| physical | 1 Online-Ressource (32 Seiten) 21 x 28cm |
| psigel | ZDB-13-SOC |
| publishDate | 2024 |
| publishDateSearch | 2024 |
| publishDateSort | 2024 |
| publisher | OECD Publishing |
| record_format | marc |
| series2 | OECD Education Working Papers |
| spelling | Avvisati, Francesco Verfasser aut Item characteristics and test-taker disengagement in PISA Francesco, Avvisati ... [et al] Paris OECD Publishing 2024 1 Online-Ressource (32 Seiten) 21 x 28cm txt rdacontent c rdamedia cr rdacarrier OECD Education Working Papers If test-takers do not engage with the assessment, the reliability of test scores and the validity of inferences about their proficiency may suffer. Test-taker disengagement is particularly likely in low-stakes assessments and, according to prior research, for certain types of students. But levels of engagement may also be related to aspects that test developers can manipulate, such as item characteristics. This paper investigates which item characteristics are associated with two indicators of test-taker disengagement, rapid guessing and breakoffs, in an international assessment of reading. Analyses of data from almost 500 000 students from 67 countries and economies that took part in the 2018 Programme for International Student Assessment (PISA) show that rapid guessing was observed mainly on simple multiple-choice questions. Breakoffs were more likely in the presence of idiosyncratic selected-response formats, such as hot spot or matching tasks. Both rapid guessing and breakoffs were more frequent on tasks involving long and complex texts Education Buchholz, Janine ctb Piacentini, Mario ctb Vargas Madriz, Luis Francisco ctb https://doi.org/10.1787/7abea67b-en Verlag kostenfrei Volltext |
| spellingShingle | Avvisati, Francesco Item characteristics and test-taker disengagement in PISA Education |
| title | Item characteristics and test-taker disengagement in PISA |
| title_auth | Item characteristics and test-taker disengagement in PISA |
| title_exact_search | Item characteristics and test-taker disengagement in PISA |
| title_full | Item characteristics and test-taker disengagement in PISA Francesco, Avvisati ... [et al] |
| title_fullStr | Item characteristics and test-taker disengagement in PISA Francesco, Avvisati ... [et al] |
| title_full_unstemmed | Item characteristics and test-taker disengagement in PISA Francesco, Avvisati ... [et al] |
| title_short | Item characteristics and test-taker disengagement in PISA |
| title_sort | item characteristics and test taker disengagement in pisa |
| topic | Education |
| topic_facet | Education |
| url | https://doi.org/10.1787/7abea67b-en |
| work_keys_str_mv | AT avvisatifrancesco itemcharacteristicsandtesttakerdisengagementinpisa AT buchholzjanine itemcharacteristicsandtesttakerdisengagementinpisa AT piacentinimario itemcharacteristicsandtesttakerdisengagementinpisa AT vargasmadrizluisfrancisco itemcharacteristicsandtesttakerdisengagementinpisa |