Analysis of PISA 2006 Preferred Items Ranking Using the Percent-Correct Method:
This paper uses an approximate average percent-correct methodology to compare the ranks that would be obtained for PISA 2006 countries if the rankings had been derived from items judged by each country to be of highest priority for inclusion. The results reported show a remarkable consistency in the...
Gespeichert in:
| 1. Verfasser: | |
|---|---|
| Weitere Verfasser: | , |
| Format: | Elektronisch E-Book |
| Sprache: | English |
| Veröffentlicht: |
Paris
OECD Publishing
2010
|
| Schriftenreihe: | OECD Education Working Papers
|
| Schlagworte: | |
| Online-Zugang: | Volltext |
| Zusammenfassung: | This paper uses an approximate average percent-correct methodology to compare the ranks that would be obtained for PISA 2006 countries if the rankings had been derived from items judged by each country to be of highest priority for inclusion. The results reported show a remarkable consistency in the country rank orderings across different sets of countries' preferred items when comparing with the rank reported in the PISA 2006 initial report (OECD, 2007). On average, only few countries systemically go up or down in their ranking position. As these countries are in a group of moderate performers with very comparable outcomes, these shifts in the ranking would probably be associated with minor changes in mean performance on the final PISA scale. The analysis suggests that PISA rankings are noticeably stable thanks to the large enough pool of test items able to accommodate diverse preferences. The paper shows how important it is to base a choice of test items on a properly structured process which allows different experts and countries to equally contribute. The evidence presented demonstrates that in PISA, average rank positions of countries across different sets of preferred items are apparently stable and experts are not able to predict which items can elevate performance of their countries in the final test |
| Beschreibung: | 1 Online-Ressource (23 Seiten) 21 x 29.7cm |
| DOI: | 10.1787/5km4psmntkq5-en |
Internformat
MARC
| LEADER | 00000nam a2200000zc 4500 | ||
|---|---|---|---|
| 001 | BV047933667 | ||
| 003 | DE-604 | ||
| 007 | cr|uuu---uuuuu | ||
| 008 | 220413s2010 xx o|||| 00||| eng d | ||
| 024 | 7 | |a 10.1787/5km4psmntkq5-en |2 doi | |
| 035 | |a (ZDB-13-SOC)061290629 | ||
| 035 | |a (OCoLC)1312701695 | ||
| 035 | |a (DE-599)BVBBV047933667 | ||
| 040 | |a DE-604 |b ger |e aacr | ||
| 041 | 0 | |a eng | |
| 049 | |a DE-384 |a DE-91 |a DE-473 |a DE-824 |a DE-29 |a DE-739 |a DE-355 |a DE-20 |a DE-1028 |a DE-1049 |a DE-188 |a DE-521 |a DE-861 |a DE-898 |a DE-92 |a DE-573 |a DE-19 | ||
| 100 | 1 | |a Adams, Ray |e Verfasser |4 aut | |
| 245 | 1 | 0 | |a Analysis of PISA 2006 Preferred Items Ranking Using the Percent-Correct Method |c Ray Adams, Alla Berezner and Maciej Jakubowski |
| 264 | 1 | |a Paris |b OECD Publishing |c 2010 | |
| 300 | |a 1 Online-Ressource (23 Seiten) |c 21 x 29.7cm | ||
| 336 | |b txt |2 rdacontent | ||
| 337 | |b c |2 rdamedia | ||
| 338 | |b cr |2 rdacarrier | ||
| 490 | 0 | |a OECD Education Working Papers | |
| 520 | |a This paper uses an approximate average percent-correct methodology to compare the ranks that would be obtained for PISA 2006 countries if the rankings had been derived from items judged by each country to be of highest priority for inclusion. The results reported show a remarkable consistency in the country rank orderings across different sets of countries' preferred items when comparing with the rank reported in the PISA 2006 initial report (OECD, 2007). On average, only few countries systemically go up or down in their ranking position. As these countries are in a group of moderate performers with very comparable outcomes, these shifts in the ranking would probably be associated with minor changes in mean performance on the final PISA scale. The analysis suggests that PISA rankings are noticeably stable thanks to the large enough pool of test items able to accommodate diverse preferences. The paper shows how important it is to base a choice of test items on a properly structured process which allows different experts and countries to equally contribute. The evidence presented demonstrates that in PISA, average rank positions of countries across different sets of preferred items are apparently stable and experts are not able to predict which items can elevate performance of their countries in the final test | ||
| 650 | 4 | |a Education | |
| 700 | 1 | |a Berezner, Alla |4 ctb | |
| 700 | 1 | |a Jakubowski, Maciej |4 ctb | |
| 856 | 4 | 0 | |u https://doi.org/10.1787/5km4psmntkq5-en |x Verlag |z kostenfrei |3 Volltext |
| 912 | |a ZDB-13-SOC | ||
| 943 | 1 | |a oai:aleph.bib-bvb.de:BVB01-033315161 | |
Datensatz im Suchindex
| _version_ | 1818806050592129024 |
|---|---|
| adam_text | |
| adam_txt | |
| any_adam_object | |
| any_adam_object_boolean | |
| author | Adams, Ray |
| author2 | Berezner, Alla Jakubowski, Maciej |
| author2_role | ctb ctb |
| author2_variant | a b ab m j mj |
| author_facet | Adams, Ray Berezner, Alla Jakubowski, Maciej |
| author_role | aut |
| author_sort | Adams, Ray |
| author_variant | r a ra |
| building | Verbundindex |
| bvnumber | BV047933667 |
| collection | ZDB-13-SOC |
| ctrlnum | (ZDB-13-SOC)061290629 (OCoLC)1312701695 (DE-599)BVBBV047933667 |
| discipline | Wirtschaftswissenschaften |
| discipline_str_mv | Wirtschaftswissenschaften |
| doi_str_mv | 10.1787/5km4psmntkq5-en |
| format | Electronic eBook |
| fullrecord | <?xml version="1.0" encoding="UTF-8"?><collection xmlns="http://www.loc.gov/MARC21/slim"><record><leader>00000nam a2200000zc 4500</leader><controlfield tag="001">BV047933667</controlfield><controlfield tag="003">DE-604</controlfield><controlfield tag="007">cr|uuu---uuuuu</controlfield><controlfield tag="008">220413s2010 xx o|||| 00||| eng d</controlfield><datafield tag="024" ind1="7" ind2=" "><subfield code="a">10.1787/5km4psmntkq5-en</subfield><subfield code="2">doi</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(ZDB-13-SOC)061290629</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(OCoLC)1312701695</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(DE-599)BVBBV047933667</subfield></datafield><datafield tag="040" ind1=" " ind2=" "><subfield code="a">DE-604</subfield><subfield code="b">ger</subfield><subfield code="e">aacr</subfield></datafield><datafield tag="041" ind1="0" ind2=" "><subfield code="a">eng</subfield></datafield><datafield tag="049" ind1=" " ind2=" "><subfield code="a">DE-384</subfield><subfield code="a">DE-91</subfield><subfield code="a">DE-473</subfield><subfield code="a">DE-824</subfield><subfield code="a">DE-29</subfield><subfield code="a">DE-739</subfield><subfield code="a">DE-355</subfield><subfield code="a">DE-20</subfield><subfield code="a">DE-1028</subfield><subfield code="a">DE-1049</subfield><subfield code="a">DE-188</subfield><subfield code="a">DE-521</subfield><subfield code="a">DE-861</subfield><subfield code="a">DE-898</subfield><subfield code="a">DE-92</subfield><subfield code="a">DE-573</subfield><subfield code="a">DE-19</subfield></datafield><datafield tag="100" ind1="1" ind2=" "><subfield code="a">Adams, Ray</subfield><subfield code="e">Verfasser</subfield><subfield code="4">aut</subfield></datafield><datafield tag="245" ind1="1" ind2="0"><subfield code="a">Analysis of PISA 2006 Preferred Items Ranking Using the Percent-Correct Method</subfield><subfield code="c">Ray Adams, Alla Berezner and Maciej Jakubowski</subfield></datafield><datafield tag="264" ind1=" " ind2="1"><subfield code="a">Paris</subfield><subfield code="b">OECD Publishing</subfield><subfield code="c">2010</subfield></datafield><datafield tag="300" ind1=" " ind2=" "><subfield code="a">1 Online-Ressource (23 Seiten)</subfield><subfield code="c">21 x 29.7cm</subfield></datafield><datafield tag="336" ind1=" " ind2=" "><subfield code="b">txt</subfield><subfield code="2">rdacontent</subfield></datafield><datafield tag="337" ind1=" " ind2=" "><subfield code="b">c</subfield><subfield code="2">rdamedia</subfield></datafield><datafield tag="338" ind1=" " ind2=" "><subfield code="b">cr</subfield><subfield code="2">rdacarrier</subfield></datafield><datafield tag="490" ind1="0" ind2=" "><subfield code="a">OECD Education Working Papers</subfield></datafield><datafield tag="520" ind1=" " ind2=" "><subfield code="a">This paper uses an approximate average percent-correct methodology to compare the ranks that would be obtained for PISA 2006 countries if the rankings had been derived from items judged by each country to be of highest priority for inclusion. The results reported show a remarkable consistency in the country rank orderings across different sets of countries' preferred items when comparing with the rank reported in the PISA 2006 initial report (OECD, 2007). On average, only few countries systemically go up or down in their ranking position. As these countries are in a group of moderate performers with very comparable outcomes, these shifts in the ranking would probably be associated with minor changes in mean performance on the final PISA scale. The analysis suggests that PISA rankings are noticeably stable thanks to the large enough pool of test items able to accommodate diverse preferences. The paper shows how important it is to base a choice of test items on a properly structured process which allows different experts and countries to equally contribute. The evidence presented demonstrates that in PISA, average rank positions of countries across different sets of preferred items are apparently stable and experts are not able to predict which items can elevate performance of their countries in the final test</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Education</subfield></datafield><datafield tag="700" ind1="1" ind2=" "><subfield code="a">Berezner, Alla</subfield><subfield code="4">ctb</subfield></datafield><datafield tag="700" ind1="1" ind2=" "><subfield code="a">Jakubowski, Maciej</subfield><subfield code="4">ctb</subfield></datafield><datafield tag="856" ind1="4" ind2="0"><subfield code="u">https://doi.org/10.1787/5km4psmntkq5-en</subfield><subfield code="x">Verlag</subfield><subfield code="z">kostenfrei</subfield><subfield code="3">Volltext</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">ZDB-13-SOC</subfield></datafield><datafield tag="943" ind1="1" ind2=" "><subfield code="a">oai:aleph.bib-bvb.de:BVB01-033315161</subfield></datafield></record></collection> |
| id | DE-604.BV047933667 |
| illustrated | Not Illustrated |
| index_date | 2024-07-03T19:35:01Z |
| indexdate | 2024-12-18T19:03:36Z |
| institution | BVB |
| language | English |
| oai_aleph_id | oai:aleph.bib-bvb.de:BVB01-033315161 |
| oclc_num | 1312701695 |
| open_access_boolean | 1 |
| owner | DE-384 DE-91 DE-BY-TUM DE-473 DE-BY-UBG DE-824 DE-29 DE-739 DE-355 DE-BY-UBR DE-20 DE-1028 DE-1049 DE-188 DE-521 DE-861 DE-898 DE-BY-UBR DE-92 DE-573 DE-19 DE-BY-UBM |
| owner_facet | DE-384 DE-91 DE-BY-TUM DE-473 DE-BY-UBG DE-824 DE-29 DE-739 DE-355 DE-BY-UBR DE-20 DE-1028 DE-1049 DE-188 DE-521 DE-861 DE-898 DE-BY-UBR DE-92 DE-573 DE-19 DE-BY-UBM |
| physical | 1 Online-Ressource (23 Seiten) 21 x 29.7cm |
| psigel | ZDB-13-SOC |
| publishDate | 2010 |
| publishDateSearch | 2010 |
| publishDateSort | 2010 |
| publisher | OECD Publishing |
| record_format | marc |
| series2 | OECD Education Working Papers |
| spelling | Adams, Ray Verfasser aut Analysis of PISA 2006 Preferred Items Ranking Using the Percent-Correct Method Ray Adams, Alla Berezner and Maciej Jakubowski Paris OECD Publishing 2010 1 Online-Ressource (23 Seiten) 21 x 29.7cm txt rdacontent c rdamedia cr rdacarrier OECD Education Working Papers This paper uses an approximate average percent-correct methodology to compare the ranks that would be obtained for PISA 2006 countries if the rankings had been derived from items judged by each country to be of highest priority for inclusion. The results reported show a remarkable consistency in the country rank orderings across different sets of countries' preferred items when comparing with the rank reported in the PISA 2006 initial report (OECD, 2007). On average, only few countries systemically go up or down in their ranking position. As these countries are in a group of moderate performers with very comparable outcomes, these shifts in the ranking would probably be associated with minor changes in mean performance on the final PISA scale. The analysis suggests that PISA rankings are noticeably stable thanks to the large enough pool of test items able to accommodate diverse preferences. The paper shows how important it is to base a choice of test items on a properly structured process which allows different experts and countries to equally contribute. The evidence presented demonstrates that in PISA, average rank positions of countries across different sets of preferred items are apparently stable and experts are not able to predict which items can elevate performance of their countries in the final test Education Berezner, Alla ctb Jakubowski, Maciej ctb https://doi.org/10.1787/5km4psmntkq5-en Verlag kostenfrei Volltext |
| spellingShingle | Adams, Ray Analysis of PISA 2006 Preferred Items Ranking Using the Percent-Correct Method Education |
| title | Analysis of PISA 2006 Preferred Items Ranking Using the Percent-Correct Method |
| title_auth | Analysis of PISA 2006 Preferred Items Ranking Using the Percent-Correct Method |
| title_exact_search | Analysis of PISA 2006 Preferred Items Ranking Using the Percent-Correct Method |
| title_exact_search_txtP | Analysis of PISA 2006 Preferred Items Ranking Using the Percent-Correct Method |
| title_full | Analysis of PISA 2006 Preferred Items Ranking Using the Percent-Correct Method Ray Adams, Alla Berezner and Maciej Jakubowski |
| title_fullStr | Analysis of PISA 2006 Preferred Items Ranking Using the Percent-Correct Method Ray Adams, Alla Berezner and Maciej Jakubowski |
| title_full_unstemmed | Analysis of PISA 2006 Preferred Items Ranking Using the Percent-Correct Method Ray Adams, Alla Berezner and Maciej Jakubowski |
| title_short | Analysis of PISA 2006 Preferred Items Ranking Using the Percent-Correct Method |
| title_sort | analysis of pisa 2006 preferred items ranking using the percent correct method |
| topic | Education |
| topic_facet | Education |
| url | https://doi.org/10.1787/5km4psmntkq5-en |
| work_keys_str_mv | AT adamsray analysisofpisa2006preferreditemsrankingusingthepercentcorrectmethod AT berezneralla analysisofpisa2006preferreditemsrankingusingthepercentcorrectmethod AT jakubowskimaciej analysisofpisa2006preferreditemsrankingusingthepercentcorrectmethod |