Invariance analyses in large-scale studies:
Large-scale surveys such as the Programme for International Student Assessment (PISA), the Teaching and Learning International Survey (TALIS), and the Programme for the International Assessment of Adult Competences (PIAAC) use advanced statistical models to estimate scores of latent traits from mult...
Gespeichert in:
| 1. Verfasser: | |
|---|---|
| Weitere Verfasser: | , , |
| Format: | Elektronisch E-Book |
| Sprache: | English |
| Veröffentlicht: |
Paris
OECD Publishing
2019
|
| Schriftenreihe: | OECD Education Working Papers
|
| Schlagworte: | |
| Online-Zugang: | kostenfrei |
| Zusammenfassung: | Large-scale surveys such as the Programme for International Student Assessment (PISA), the Teaching and Learning International Survey (TALIS), and the Programme for the International Assessment of Adult Competences (PIAAC) use advanced statistical models to estimate scores of latent traits from multiple observed responses. The comparison of such estimated scores across different groups of respondents is valid to the extent that the same set of estimated parameters holds in each group surveyed. This issue of invariance of parameter estimates is addressed in model fit indices which gauge the likelihood that one set of parameters can be used across all groups. Therefore, the problem of scale invariance across groups of respondents can typically be framed as the question of how well a single model fits the responses of all groups. However, the procedures used to evaluate the fit of these models pose a series of theoretical and practical problems. The most commonly applied procedures to establish invariance of cognitive and non-cognitive scales across countries in large-scale surveys are developed within the framework of confirmatory factor analysis and item response theory. The criteria that are commonly applied to evaluate the fit of such models, such as the decrement of the Comparative Fit Index in confirmatory factor analysis, work normally well in the comparison of a small number of countries or groups, but can perform poorly in large-scale surveys featuring a large number of countries. More specifically, the common criteria often result in the non-rejection of metric invariance; however, the step from metric invariance (i.e. identical factor loadings across countries) to scalar invariance (i.e. identical intercepts, in addition to identical factor loadings) appears to set overly restrictive standards for scalar invariance (i.e. identical intercepts). This report sets out to identify and apply novel procedures to evaluate model fit across a large number of groups, or novel scaling models that are more likely to pass common model fit criteria |
| Beschreibung: | 1 Online-Ressource (110 Seiten) |
| DOI: | 10.1787/254738dd-en |
Internformat
MARC
| LEADER | 00000nam a2200000zc 4500 | ||
|---|---|---|---|
| 001 | BV047936848 | ||
| 003 | DE-604 | ||
| 007 | cr|uuu---uuuuu | ||
| 008 | 220413s2019 xx o|||| 00||| eng d | ||
| 024 | 7 | |a 10.1787/254738dd-en |2 doi | |
| 035 | |a (ZDB-13-SOC)061247286 | ||
| 035 | |a (OCoLC)1312688688 | ||
| 035 | |a (DE-599)BVBBV047936848 | ||
| 040 | |a DE-604 |b ger |e aacr | ||
| 041 | 0 | |a eng | |
| 049 | |a DE-384 |a DE-91 |a DE-473 |a DE-824 |a DE-29 |a DE-739 |a DE-355 |a DE-20 |a DE-1028 |a DE-1049 |a DE-188 |a DE-521 |a DE-861 |a DE-898 |a DE-92 |a DE-573 |a DE-19 | ||
| 100 | 1 | |a Van de Vijver, Fons J. R... |e Verfasser |4 aut | |
| 245 | 1 | 0 | |a Invariance analyses in large-scale studies |c Fons J. R. Van de Vijver ... [et al] |
| 264 | 1 | |a Paris |b OECD Publishing |c 2019 | |
| 300 | |a 1 Online-Ressource (110 Seiten) | ||
| 336 | |b txt |2 rdacontent | ||
| 337 | |b c |2 rdamedia | ||
| 338 | |b cr |2 rdacarrier | ||
| 490 | 0 | |a OECD Education Working Papers | |
| 520 | |a Large-scale surveys such as the Programme for International Student Assessment (PISA), the Teaching and Learning International Survey (TALIS), and the Programme for the International Assessment of Adult Competences (PIAAC) use advanced statistical models to estimate scores of latent traits from multiple observed responses. The comparison of such estimated scores across different groups of respondents is valid to the extent that the same set of estimated parameters holds in each group surveyed. This issue of invariance of parameter estimates is addressed in model fit indices which gauge the likelihood that one set of parameters can be used across all groups. Therefore, the problem of scale invariance across groups of respondents can typically be framed as the question of how well a single model fits the responses of all groups. However, the procedures used to evaluate the fit of these models pose a series of theoretical and practical problems. | ||
| 520 | |a The most commonly applied procedures to establish invariance of cognitive and non-cognitive scales across countries in large-scale surveys are developed within the framework of confirmatory factor analysis and item response theory. The criteria that are commonly applied to evaluate the fit of such models, such as the decrement of the Comparative Fit Index in confirmatory factor analysis, work normally well in the comparison of a small number of countries or groups, but can perform poorly in large-scale surveys featuring a large number of countries. More specifically, the common criteria often result in the non-rejection of metric invariance; however, the step from metric invariance (i.e. identical factor loadings across countries) to scalar invariance (i.e. identical intercepts, in addition to identical factor loadings) appears to set overly restrictive standards for scalar invariance (i.e. identical intercepts). | ||
| 520 | |a This report sets out to identify and apply novel procedures to evaluate model fit across a large number of groups, or novel scaling models that are more likely to pass common model fit criteria | ||
| 650 | 4 | |a Education | |
| 700 | 1 | |a Avvisati, Francesco |4 ctb | |
| 700 | 1 | |a Davidov, Eldad |4 ctb | |
| 700 | 1 | |a Eid, Michael |4 ctb | |
| 856 | 4 | 0 | |u https://doi.org/10.1787/254738dd-en |x Verlag |z kostenfrei |3 Volltext |
| 912 | |a ZDB-13-SOC | ||
| 943 | 1 | |a oai:aleph.bib-bvb.de:BVB01-033318342 | |
Datensatz im Suchindex
| _version_ | 1818806115029221376 |
|---|---|
| adam_text | |
| adam_txt | |
| any_adam_object | |
| any_adam_object_boolean | |
| author | Van de Vijver, Fons J. R.. |
| author2 | Avvisati, Francesco Davidov, Eldad Eid, Michael |
| author2_role | ctb ctb ctb |
| author2_variant | f a fa e d ed m e me |
| author_facet | Van de Vijver, Fons J. R.. Avvisati, Francesco Davidov, Eldad Eid, Michael |
| author_role | aut |
| author_sort | Van de Vijver, Fons J. R.. |
| author_variant | d v f j r v dvfjr dvfjrv |
| building | Verbundindex |
| bvnumber | BV047936848 |
| collection | ZDB-13-SOC |
| ctrlnum | (ZDB-13-SOC)061247286 (OCoLC)1312688688 (DE-599)BVBBV047936848 |
| discipline | Wirtschaftswissenschaften |
| discipline_str_mv | Wirtschaftswissenschaften |
| doi_str_mv | 10.1787/254738dd-en |
| format | Electronic eBook |
| fullrecord | <?xml version="1.0" encoding="UTF-8"?><collection xmlns="http://www.loc.gov/MARC21/slim"><record><leader>00000nam a2200000zc 4500</leader><controlfield tag="001">BV047936848</controlfield><controlfield tag="003">DE-604</controlfield><controlfield tag="007">cr|uuu---uuuuu</controlfield><controlfield tag="008">220413s2019 xx o|||| 00||| eng d</controlfield><datafield tag="024" ind1="7" ind2=" "><subfield code="a">10.1787/254738dd-en</subfield><subfield code="2">doi</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(ZDB-13-SOC)061247286</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(OCoLC)1312688688</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(DE-599)BVBBV047936848</subfield></datafield><datafield tag="040" ind1=" " ind2=" "><subfield code="a">DE-604</subfield><subfield code="b">ger</subfield><subfield code="e">aacr</subfield></datafield><datafield tag="041" ind1="0" ind2=" "><subfield code="a">eng</subfield></datafield><datafield tag="049" ind1=" " ind2=" "><subfield code="a">DE-384</subfield><subfield code="a">DE-91</subfield><subfield code="a">DE-473</subfield><subfield code="a">DE-824</subfield><subfield code="a">DE-29</subfield><subfield code="a">DE-739</subfield><subfield code="a">DE-355</subfield><subfield code="a">DE-20</subfield><subfield code="a">DE-1028</subfield><subfield code="a">DE-1049</subfield><subfield code="a">DE-188</subfield><subfield code="a">DE-521</subfield><subfield code="a">DE-861</subfield><subfield code="a">DE-898</subfield><subfield code="a">DE-92</subfield><subfield code="a">DE-573</subfield><subfield code="a">DE-19</subfield></datafield><datafield tag="100" ind1="1" ind2=" "><subfield code="a">Van de Vijver, Fons J. R...</subfield><subfield code="e">Verfasser</subfield><subfield code="4">aut</subfield></datafield><datafield tag="245" ind1="1" ind2="0"><subfield code="a">Invariance analyses in large-scale studies</subfield><subfield code="c">Fons J. R. Van de Vijver ... [et al]</subfield></datafield><datafield tag="264" ind1=" " ind2="1"><subfield code="a">Paris</subfield><subfield code="b">OECD Publishing</subfield><subfield code="c">2019</subfield></datafield><datafield tag="300" ind1=" " ind2=" "><subfield code="a">1 Online-Ressource (110 Seiten)</subfield></datafield><datafield tag="336" ind1=" " ind2=" "><subfield code="b">txt</subfield><subfield code="2">rdacontent</subfield></datafield><datafield tag="337" ind1=" " ind2=" "><subfield code="b">c</subfield><subfield code="2">rdamedia</subfield></datafield><datafield tag="338" ind1=" " ind2=" "><subfield code="b">cr</subfield><subfield code="2">rdacarrier</subfield></datafield><datafield tag="490" ind1="0" ind2=" "><subfield code="a">OECD Education Working Papers</subfield></datafield><datafield tag="520" ind1=" " ind2=" "><subfield code="a">Large-scale surveys such as the Programme for International Student Assessment (PISA), the Teaching and Learning International Survey (TALIS), and the Programme for the International Assessment of Adult Competences (PIAAC) use advanced statistical models to estimate scores of latent traits from multiple observed responses. The comparison of such estimated scores across different groups of respondents is valid to the extent that the same set of estimated parameters holds in each group surveyed. This issue of invariance of parameter estimates is addressed in model fit indices which gauge the likelihood that one set of parameters can be used across all groups. Therefore, the problem of scale invariance across groups of respondents can typically be framed as the question of how well a single model fits the responses of all groups. However, the procedures used to evaluate the fit of these models pose a series of theoretical and practical problems.</subfield></datafield><datafield tag="520" ind1=" " ind2=" "><subfield code="a">The most commonly applied procedures to establish invariance of cognitive and non-cognitive scales across countries in large-scale surveys are developed within the framework of confirmatory factor analysis and item response theory. The criteria that are commonly applied to evaluate the fit of such models, such as the decrement of the Comparative Fit Index in confirmatory factor analysis, work normally well in the comparison of a small number of countries or groups, but can perform poorly in large-scale surveys featuring a large number of countries. More specifically, the common criteria often result in the non-rejection of metric invariance; however, the step from metric invariance (i.e. identical factor loadings across countries) to scalar invariance (i.e. identical intercepts, in addition to identical factor loadings) appears to set overly restrictive standards for scalar invariance (i.e. identical intercepts).</subfield></datafield><datafield tag="520" ind1=" " ind2=" "><subfield code="a">This report sets out to identify and apply novel procedures to evaluate model fit across a large number of groups, or novel scaling models that are more likely to pass common model fit criteria</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Education</subfield></datafield><datafield tag="700" ind1="1" ind2=" "><subfield code="a">Avvisati, Francesco</subfield><subfield code="4">ctb</subfield></datafield><datafield tag="700" ind1="1" ind2=" "><subfield code="a">Davidov, Eldad</subfield><subfield code="4">ctb</subfield></datafield><datafield tag="700" ind1="1" ind2=" "><subfield code="a">Eid, Michael</subfield><subfield code="4">ctb</subfield></datafield><datafield tag="856" ind1="4" ind2="0"><subfield code="u">https://doi.org/10.1787/254738dd-en</subfield><subfield code="x">Verlag</subfield><subfield code="z">kostenfrei</subfield><subfield code="3">Volltext</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">ZDB-13-SOC</subfield></datafield><datafield tag="943" ind1="1" ind2=" "><subfield code="a">oai:aleph.bib-bvb.de:BVB01-033318342</subfield></datafield></record></collection> |
| id | DE-604.BV047936848 |
| illustrated | Not Illustrated |
| index_date | 2024-07-03T19:35:06Z |
| indexdate | 2024-12-18T19:04:38Z |
| institution | BVB |
| language | English |
| oai_aleph_id | oai:aleph.bib-bvb.de:BVB01-033318342 |
| oclc_num | 1312688688 |
| open_access_boolean | 1 |
| owner | DE-384 DE-91 DE-BY-TUM DE-473 DE-BY-UBG DE-824 DE-29 DE-739 DE-355 DE-BY-UBR DE-20 DE-1028 DE-1049 DE-188 DE-521 DE-861 DE-898 DE-BY-UBR DE-92 DE-573 DE-19 DE-BY-UBM |
| owner_facet | DE-384 DE-91 DE-BY-TUM DE-473 DE-BY-UBG DE-824 DE-29 DE-739 DE-355 DE-BY-UBR DE-20 DE-1028 DE-1049 DE-188 DE-521 DE-861 DE-898 DE-BY-UBR DE-92 DE-573 DE-19 DE-BY-UBM |
| physical | 1 Online-Ressource (110 Seiten) |
| psigel | ZDB-13-SOC |
| publishDate | 2019 |
| publishDateSearch | 2019 |
| publishDateSort | 2019 |
| publisher | OECD Publishing |
| record_format | marc |
| series2 | OECD Education Working Papers |
| spelling | Van de Vijver, Fons J. R... Verfasser aut Invariance analyses in large-scale studies Fons J. R. Van de Vijver ... [et al] Paris OECD Publishing 2019 1 Online-Ressource (110 Seiten) txt rdacontent c rdamedia cr rdacarrier OECD Education Working Papers Large-scale surveys such as the Programme for International Student Assessment (PISA), the Teaching and Learning International Survey (TALIS), and the Programme for the International Assessment of Adult Competences (PIAAC) use advanced statistical models to estimate scores of latent traits from multiple observed responses. The comparison of such estimated scores across different groups of respondents is valid to the extent that the same set of estimated parameters holds in each group surveyed. This issue of invariance of parameter estimates is addressed in model fit indices which gauge the likelihood that one set of parameters can be used across all groups. Therefore, the problem of scale invariance across groups of respondents can typically be framed as the question of how well a single model fits the responses of all groups. However, the procedures used to evaluate the fit of these models pose a series of theoretical and practical problems. The most commonly applied procedures to establish invariance of cognitive and non-cognitive scales across countries in large-scale surveys are developed within the framework of confirmatory factor analysis and item response theory. The criteria that are commonly applied to evaluate the fit of such models, such as the decrement of the Comparative Fit Index in confirmatory factor analysis, work normally well in the comparison of a small number of countries or groups, but can perform poorly in large-scale surveys featuring a large number of countries. More specifically, the common criteria often result in the non-rejection of metric invariance; however, the step from metric invariance (i.e. identical factor loadings across countries) to scalar invariance (i.e. identical intercepts, in addition to identical factor loadings) appears to set overly restrictive standards for scalar invariance (i.e. identical intercepts). This report sets out to identify and apply novel procedures to evaluate model fit across a large number of groups, or novel scaling models that are more likely to pass common model fit criteria Education Avvisati, Francesco ctb Davidov, Eldad ctb Eid, Michael ctb https://doi.org/10.1787/254738dd-en Verlag kostenfrei Volltext |
| spellingShingle | Van de Vijver, Fons J. R.. Invariance analyses in large-scale studies Education |
| title | Invariance analyses in large-scale studies |
| title_auth | Invariance analyses in large-scale studies |
| title_exact_search | Invariance analyses in large-scale studies |
| title_exact_search_txtP | Invariance analyses in large-scale studies |
| title_full | Invariance analyses in large-scale studies Fons J. R. Van de Vijver ... [et al] |
| title_fullStr | Invariance analyses in large-scale studies Fons J. R. Van de Vijver ... [et al] |
| title_full_unstemmed | Invariance analyses in large-scale studies Fons J. R. Van de Vijver ... [et al] |
| title_short | Invariance analyses in large-scale studies |
| title_sort | invariance analyses in large scale studies |
| topic | Education |
| topic_facet | Education |
| url | https://doi.org/10.1787/254738dd-en |
| work_keys_str_mv | AT vandevijverfonsjr invarianceanalysesinlargescalestudies AT avvisatifrancesco invarianceanalysesinlargescalestudies AT davidoveldad invarianceanalysesinlargescalestudies AT eidmichael invarianceanalysesinlargescalestudies |