Item characteristics and test-taker disengagement in PISA:
If test-takers do not engage with the assessment, the reliability of test scores and the validity of inferences about their proficiency may suffer. Test-taker disengagement is particularly likely in low-stakes assessments and, according to prior research, for certain types of students. But levels of...
Gespeichert in:
| 1. Verfasser: | |
|---|---|
| Weitere Verfasser: | , , |
| Format: | Elektronisch E-Book |
| Sprache: | English |
| Veröffentlicht: |
Paris
OECD Publishing
2024
|
| Schriftenreihe: | OECD Education Working Papers
no.312 |
| Schlagworte: | |
| Online-Zugang: | DE-862 DE-863 |
| Zusammenfassung: | If test-takers do not engage with the assessment, the reliability of test scores and the validity of inferences about their proficiency may suffer. Test-taker disengagement is particularly likely in low-stakes assessments and, according to prior research, for certain types of students. But levels of engagement may also be related to aspects that test developers can manipulate, such as item characteristics. This paper investigates which item characteristics are associated with two indicators of test-taker disengagement, rapid guessing and breakoffs, in an international assessment of reading. Analyses of data from almost 500 000 students from 67 countries and economies that took part in the 2018 Programme for International Student Assessment (PISA) show that rapid guessing was observed mainly on simple multiple-choice questions. Breakoffs were more likely in the presence of idiosyncratic selected-response formats, such as hot spot or matching tasks. Both rapid guessing and breakoffs were more frequent on tasks involving long and complex texts. |
| Beschreibung: | 1 Online-Ressource (32 Seiten) 21 x 28cm. |
Internformat
MARC
| LEADER | 00000cam a22000002 4500 | ||
|---|---|---|---|
| 001 | ZDB-13-SOC-104405139 | ||
| 003 | DE-627-1 | ||
| 005 | 20241028115212.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 240702s2024 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1787/7abea67b-en |2 doi | |
| 035 | |a (DE-627-1)104405139 | ||
| 035 | |a (DE-599)KEP104405139 | ||
| 035 | |a (FR-PaOEC)7abea67b-en | ||
| 035 | |a (DE-627-1)104405139 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rda | ||
| 041 | |a eng | ||
| 100 | 1 | |a Avvisati, Francesco |e VerfasserIn |4 aut | |
| 245 | 1 | 0 | |a Item characteristics and test-taker disengagement in PISA |c Francesco, Avvisati ... [et al] |
| 264 | 1 | |a Paris |b OECD Publishing |c 2024 | |
| 300 | |a 1 Online-Ressource (32 Seiten) |c 21 x 28cm. | ||
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a Computermedien |b c |2 rdamedia | ||
| 338 | |a Online-Ressource |b cr |2 rdacarrier | ||
| 490 | 0 | |a OECD Education Working Papers |v no.312 | |
| 520 | |a If test-takers do not engage with the assessment, the reliability of test scores and the validity of inferences about their proficiency may suffer. Test-taker disengagement is particularly likely in low-stakes assessments and, according to prior research, for certain types of students. But levels of engagement may also be related to aspects that test developers can manipulate, such as item characteristics. This paper investigates which item characteristics are associated with two indicators of test-taker disengagement, rapid guessing and breakoffs, in an international assessment of reading. Analyses of data from almost 500 000 students from 67 countries and economies that took part in the 2018 Programme for International Student Assessment (PISA) show that rapid guessing was observed mainly on simple multiple-choice questions. Breakoffs were more likely in the presence of idiosyncratic selected-response formats, such as hot spot or matching tasks. Both rapid guessing and breakoffs were more frequent on tasks involving long and complex texts. | ||
| 650 | 4 | |a Education | |
| 700 | 1 | |a Buchholz, Janine |e MitwirkendeR |4 ctb | |
| 700 | 1 | |a Piacentini, Mario |e MitwirkendeR |4 ctb | |
| 700 | 1 | |a Vargas Madriz, Luis Francisco |e MitwirkendeR |4 ctb | |
| 966 | 4 | 0 | |l DE-862 |p ZDB-13-SOC |q FWS_PDA_SOC |u https://doi.org/10.1787/7abea67b-en |m X:OECD |x Resolving-System |z lizenzpflichtig |3 Volltext |
| 966 | 4 | 0 | |l DE-863 |p ZDB-13-SOC |q FWS_PDA_SOC |u https://doi.org/10.1787/7abea67b-en |m X:OECD |x Resolving-System |z lizenzpflichtig |3 Volltext |
| 912 | |a ZDB-13-SOC-ebook | ||
| 912 | |a ZDB-13-SOC | ||
| 912 | |a BSZ-13-SOC-education | ||
| 951 | |a BO | ||
| 912 | |a ZDB-13-SOC | ||
| 049 | |a DE-862 | ||
| 049 | |a DE-863 | ||
Datensatz im Suchindex
| DE-BY-FWS_katkey | ZDB-13-SOC-104405139 |
|---|---|
| _version_ | 1826942497176158208 |
| adam_text | |
| any_adam_object | |
| author | Avvisati, Francesco |
| author2 | Buchholz, Janine Piacentini, Mario Vargas Madriz, Luis Francisco |
| author2_role | ctb ctb ctb |
| author2_variant | j b jb m p mp m l f v mlf mlfv |
| author_facet | Avvisati, Francesco Buchholz, Janine Piacentini, Mario Vargas Madriz, Luis Francisco |
| author_role | aut |
| author_sort | Avvisati, Francesco |
| author_variant | f a fa |
| building | Verbundindex |
| bvnumber | localFWS |
| collection | ZDB-13-SOC-ebook ZDB-13-SOC BSZ-13-SOC-education |
| ctrlnum | (DE-627-1)104405139 (DE-599)KEP104405139 (FR-PaOEC)7abea67b-en |
| discipline | Wirtschaftswissenschaften |
| format | Electronic eBook |
| fullrecord | <?xml version="1.0" encoding="UTF-8"?><collection xmlns="http://www.loc.gov/MARC21/slim"><record><leader>02358cam a22003852 4500</leader><controlfield tag="001">ZDB-13-SOC-104405139</controlfield><controlfield tag="003">DE-627-1</controlfield><controlfield tag="005">20241028115212.0</controlfield><controlfield tag="007">cr uuu---uuuuu</controlfield><controlfield tag="008">240702s2024 xx |||||o 00| ||eng c</controlfield><datafield tag="024" ind1="7" ind2=" "><subfield code="a">10.1787/7abea67b-en</subfield><subfield code="2">doi</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(DE-627-1)104405139</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(DE-599)KEP104405139</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(FR-PaOEC)7abea67b-en</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(DE-627-1)104405139</subfield></datafield><datafield tag="040" ind1=" " ind2=" "><subfield code="a">DE-627</subfield><subfield code="b">ger</subfield><subfield code="c">DE-627</subfield><subfield code="e">rda</subfield></datafield><datafield tag="041" ind1=" " ind2=" "><subfield code="a">eng</subfield></datafield><datafield tag="100" ind1="1" ind2=" "><subfield code="a">Avvisati, Francesco</subfield><subfield code="e">VerfasserIn</subfield><subfield code="4">aut</subfield></datafield><datafield tag="245" ind1="1" ind2="0"><subfield code="a">Item characteristics and test-taker disengagement in PISA</subfield><subfield code="c">Francesco, Avvisati ... [et al]</subfield></datafield><datafield tag="264" ind1=" " ind2="1"><subfield code="a">Paris</subfield><subfield code="b">OECD Publishing</subfield><subfield code="c">2024</subfield></datafield><datafield tag="300" ind1=" " ind2=" "><subfield code="a">1 Online-Ressource (32 Seiten)</subfield><subfield code="c">21 x 28cm.</subfield></datafield><datafield tag="336" ind1=" " ind2=" "><subfield code="a">Text</subfield><subfield code="b">txt</subfield><subfield code="2">rdacontent</subfield></datafield><datafield tag="337" ind1=" " ind2=" "><subfield code="a">Computermedien</subfield><subfield code="b">c</subfield><subfield code="2">rdamedia</subfield></datafield><datafield tag="338" ind1=" " ind2=" "><subfield code="a">Online-Ressource</subfield><subfield code="b">cr</subfield><subfield code="2">rdacarrier</subfield></datafield><datafield tag="490" ind1="0" ind2=" "><subfield code="a">OECD Education Working Papers</subfield><subfield code="v">no.312</subfield></datafield><datafield tag="520" ind1=" " ind2=" "><subfield code="a">If test-takers do not engage with the assessment, the reliability of test scores and the validity of inferences about their proficiency may suffer. Test-taker disengagement is particularly likely in low-stakes assessments and, according to prior research, for certain types of students. But levels of engagement may also be related to aspects that test developers can manipulate, such as item characteristics. This paper investigates which item characteristics are associated with two indicators of test-taker disengagement, rapid guessing and breakoffs, in an international assessment of reading. Analyses of data from almost 500 000 students from 67 countries and economies that took part in the 2018 Programme for International Student Assessment (PISA) show that rapid guessing was observed mainly on simple multiple-choice questions. Breakoffs were more likely in the presence of idiosyncratic selected-response formats, such as hot spot or matching tasks. Both rapid guessing and breakoffs were more frequent on tasks involving long and complex texts.</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Education</subfield></datafield><datafield tag="700" ind1="1" ind2=" "><subfield code="a">Buchholz, Janine</subfield><subfield code="e">MitwirkendeR</subfield><subfield code="4">ctb</subfield></datafield><datafield tag="700" ind1="1" ind2=" "><subfield code="a">Piacentini, Mario</subfield><subfield code="e">MitwirkendeR</subfield><subfield code="4">ctb</subfield></datafield><datafield tag="700" ind1="1" ind2=" "><subfield code="a">Vargas Madriz, Luis Francisco</subfield><subfield code="e">MitwirkendeR</subfield><subfield code="4">ctb</subfield></datafield><datafield tag="966" ind1="4" ind2="0"><subfield code="l">DE-862</subfield><subfield code="p">ZDB-13-SOC</subfield><subfield code="q">FWS_PDA_SOC</subfield><subfield code="u">https://doi.org/10.1787/7abea67b-en</subfield><subfield code="m">X:OECD</subfield><subfield code="x">Resolving-System</subfield><subfield code="z">lizenzpflichtig</subfield><subfield code="3">Volltext</subfield></datafield><datafield tag="966" ind1="4" ind2="0"><subfield code="l">DE-863</subfield><subfield code="p">ZDB-13-SOC</subfield><subfield code="q">FWS_PDA_SOC</subfield><subfield code="u">https://doi.org/10.1787/7abea67b-en</subfield><subfield code="m">X:OECD</subfield><subfield code="x">Resolving-System</subfield><subfield code="z">lizenzpflichtig</subfield><subfield code="3">Volltext</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">ZDB-13-SOC-ebook</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">ZDB-13-SOC</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">BSZ-13-SOC-education</subfield></datafield><datafield tag="951" ind1=" " ind2=" "><subfield code="a">BO</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">ZDB-13-SOC</subfield></datafield><datafield tag="049" ind1=" " ind2=" "><subfield code="a">DE-862</subfield></datafield><datafield tag="049" ind1=" " ind2=" "><subfield code="a">DE-863</subfield></datafield></record></collection> |
| id | ZDB-13-SOC-104405139 |
| illustrated | Not Illustrated |
| indexdate | 2025-03-18T14:28:57Z |
| institution | BVB |
| language | English |
| open_access_boolean | |
| owner | DE-862 DE-BY-FWS DE-863 DE-BY-FWS |
| owner_facet | DE-862 DE-BY-FWS DE-863 DE-BY-FWS |
| physical | 1 Online-Ressource (32 Seiten) 21 x 28cm. |
| psigel | ZDB-13-SOC FWS_PDA_SOC ZDB-13-SOC-ebook ZDB-13-SOC BSZ-13-SOC-education |
| publishDate | 2024 |
| publishDateSearch | 2024 |
| publishDateSort | 2024 |
| publisher | OECD Publishing |
| record_format | marc |
| series2 | OECD Education Working Papers |
| spelling | Avvisati, Francesco VerfasserIn aut Item characteristics and test-taker disengagement in PISA Francesco, Avvisati ... [et al] Paris OECD Publishing 2024 1 Online-Ressource (32 Seiten) 21 x 28cm. Text txt rdacontent Computermedien c rdamedia Online-Ressource cr rdacarrier OECD Education Working Papers no.312 If test-takers do not engage with the assessment, the reliability of test scores and the validity of inferences about their proficiency may suffer. Test-taker disengagement is particularly likely in low-stakes assessments and, according to prior research, for certain types of students. But levels of engagement may also be related to aspects that test developers can manipulate, such as item characteristics. This paper investigates which item characteristics are associated with two indicators of test-taker disengagement, rapid guessing and breakoffs, in an international assessment of reading. Analyses of data from almost 500 000 students from 67 countries and economies that took part in the 2018 Programme for International Student Assessment (PISA) show that rapid guessing was observed mainly on simple multiple-choice questions. Breakoffs were more likely in the presence of idiosyncratic selected-response formats, such as hot spot or matching tasks. Both rapid guessing and breakoffs were more frequent on tasks involving long and complex texts. Education Buchholz, Janine MitwirkendeR ctb Piacentini, Mario MitwirkendeR ctb Vargas Madriz, Luis Francisco MitwirkendeR ctb |
| spellingShingle | Avvisati, Francesco Item characteristics and test-taker disengagement in PISA Education |
| title | Item characteristics and test-taker disengagement in PISA |
| title_auth | Item characteristics and test-taker disengagement in PISA |
| title_exact_search | Item characteristics and test-taker disengagement in PISA |
| title_full | Item characteristics and test-taker disengagement in PISA Francesco, Avvisati ... [et al] |
| title_fullStr | Item characteristics and test-taker disengagement in PISA Francesco, Avvisati ... [et al] |
| title_full_unstemmed | Item characteristics and test-taker disengagement in PISA Francesco, Avvisati ... [et al] |
| title_short | Item characteristics and test-taker disengagement in PISA |
| title_sort | item characteristics and test taker disengagement in pisa |
| topic | Education |
| topic_facet | Education |
| work_keys_str_mv | AT avvisatifrancesco itemcharacteristicsandtesttakerdisengagementinpisa AT buchholzjanine itemcharacteristicsandtesttakerdisengagementinpisa AT piacentinimario itemcharacteristicsandtesttakerdisengagementinpisa AT vargasmadrizluisfrancisco itemcharacteristicsandtesttakerdisengagementinpisa |