Reproducibility and replicability in science: a consensus study report
Gespeichert in:
| Körperschaft: | |
|---|---|
| Format: | Buch |
| Sprache: | English |
| Veröffentlicht: |
Washington, DC
The National Academies Press
[2019]
|
| Schlagworte: | |
| Online-Zugang: | Inhaltsverzeichnis |
| Beschreibung: | xxi, 234 Seiten Illustrationen, Diagramme |
| ISBN: | 9780309486163 |
Internformat
MARC
| LEADER | 00000nam a2200000 c 4500 | ||
|---|---|---|---|
| 001 | BV047899535 | ||
| 003 | DE-604 | ||
| 005 | 20220511 | ||
| 007 | t | ||
| 008 | 220328s2019 xxua||| |||| 00||| eng d | ||
| 020 | |a 9780309486163 |9 978-0-309-48616-3 | ||
| 035 | |a (OCoLC)1129466263 | ||
| 035 | |a (DE-599)BVBBV047899535 | ||
| 040 | |a DE-604 |b ger |e rda | ||
| 041 | 0 | |a eng | |
| 044 | |a xxu |c XD-US | ||
| 049 | |a DE-739 | ||
| 084 | |a AK 28000 |0 (DE-625)2587: |2 rvk | ||
| 110 | 2 | |a National Academies of Sciences, Engineering, and Medicine |e Verfasser |0 (DE-588)1114889792 |4 aut | |
| 245 | 1 | 0 | |a Reproducibility and replicability in science |b a consensus study report |c The National Academies of Sciences, Engineering, Medicine ; Committee on Reproducibility and Replicability in Science |
| 264 | 1 | |a Washington, DC |b The National Academies Press |c [2019] | |
| 300 | |a xxi, 234 Seiten |b Illustrationen, Diagramme | ||
| 336 | |b txt |2 rdacontent | ||
| 337 | |b n |2 rdamedia | ||
| 338 | |b nc |2 rdacarrier | ||
| 650 | 0 | 7 | |a Reproduzierbarkeit |0 (DE-588)4586094-4 |2 gnd |9 rswk-swf |
| 650 | 0 | 7 | |a Wissenschaft |0 (DE-588)4066562-8 |2 gnd |9 rswk-swf |
| 689 | 0 | 0 | |a Wissenschaft |0 (DE-588)4066562-8 |D s |
| 689 | 0 | 1 | |a Reproduzierbarkeit |0 (DE-588)4586094-4 |D s |
| 689 | 0 | |5 DE-604 | |
| 710 | 2 | |a National Academies of Sciences, Engineering, and Medicine |b Committee on Reproducibility and Replicability in Science |0 (DE-588)1199461563 |4 oth | |
| 856 | 4 | 2 | |m Digitalisierung UB Passau - ADAM Catalogue Enrichment |q application/pdf |u http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=033281483&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |3 Inhaltsverzeichnis |
| 999 | |a oai:aleph.bib-bvb.de:BVB01-033281483 | ||
Datensatz im Suchindex
| _version_ | 1804183510658842624 |
|---|---|
| adam_text | Contents EXECUTIVE SUMMARY 1 SUMMARY 5 1 INTRODUCTION 21 2 SCIENTIFIC METHODS AND KNOWLEDGE What Is Science?, 27 Core Principles and Assumptions of Scientific Inquiry, 30 Nature Is Not Capricious, 30 Knowledge Grows Through Exploration of the Limits of Existing Rules and Mutually Reinforcing Evidence, 31 Science Is a Communal Enterprise, 32 Science Aims for Refined Degrees of Confidence, Rather Than Complete Certainty, 32 Scientific Knowledge Is Durable and Mutable, 33 Statistical Inference and Hypothesis Testing, 34 27 3 UNDERSTANDING REPRODUCIBILITY AND REPLICABILITY The Evolving Practices of Science, 39 Defining Reproducibility and Replicability, 42 Precision of Measurement, 46 Variations in Methods Employed in a Study, 51 Rigor and Transparency, 52 xtx 39
CONTENTS XX 4 REPRODUCIBILITY Widespread Use of Computational Methods, 55 Nonpublic Data and Code, 57 Resources and Costs of Reproducibility, 57 Assessing Reproducibility, 59 The Extent of Non-Reproducibility, 62 Sources of Non-Reproducibility, 67 Inadequate Recordkeeping, 67 Nontransparent Reporting, 69 Obsolescence of Digital Artifacts, 69 Flawed Attempts to Reproduce Others’ Research, 70 Barriers in the Culture of Research, 70 55 5 REPLICABILITY 71 Assessing Replicability, 72 The Extent of Non-Replicability, 75 Assessments of Replicability, 76 Perspectives of Researchers Who Have Studied Replicability, 82 Surveys, 82 Retraction Trends, 83 Sources of Non-Replicability, 85 Non-Replicability That Is Potentially Helpful to Science, 85 Unhelpful Sources of Non-Replicability, 90 Publication Bias, 91 Misaligned Incentives, 95 Inappropriate Statistical Inference, 96 Poor Study Design, 98 Errors, 98 Incomplete Reporting of a Study, 99 Fraud and Misconduct, 100 6 IMPROVING REPRODUCIBILITY AND REPLICABILITY Strengthening Research Practices: Broad Efforts and Responsibilities, 105 Education and Training, 108 Improving Knowledge and the Use of Statistical Significance Testing, 109 Efforts to Improve Reproducibility, 110 Recordkeeping, 111 Source Code and Data Version Control, 114 Scientific Workflow-Management Systems, 114 Tools for Reproduction of Results, 116 Publication Reproducibility Audits, 118 105
CONTENTS xxi Overcoming Technological and Infrastructure Barriers to Reproducibility, 119 Archival Repositories and Open Data Platforms, 119 Code Hosting and Collaboration Platforms, 121 Digital Object Identifiers, 122 Obsolescence of Data and Code Storage, 123 Implementation Challenges, 125 Efforts to Improve Replicability, 127 Openness Guidelines, 128 Journal Requirements, Badges, and Awards, 129 Introducing Prepublication Checks for Errors and Anomalous Results, 130 Preregistration of Studies, 132 Encouraging the Publication of All Results, 134 Additional Journal Initiatives, 136 Research Funder Efforts to Encourage Replicability, 137 Developing Effective Funder Mandates, 140 7 CONFIDENCE IN SCIENCE Research Synthesis, 144 Geoscience, 147 Genetics, 149 Psychology, 150 Social Science Research Using Big Data, 153 Public Perceptions of Reproducibility and Replicability, 155 Public Understanding of Science, 155 Public Trust in Science, 157 Media Coverage of Science, 158 143 REFERENCES 163 APPENDIXES A Biographical Sketches of Committee Members and Staff В Agendas of Open Committee Meetings C Recommendations Grouped by Stakeholder D Using Bayes Analysis for Hypothesis Testing E Conducting Replicable Surveys of Scientific Communities 189 199 209 221 231
|
| adam_txt |
Contents EXECUTIVE SUMMARY 1 SUMMARY 5 1 INTRODUCTION 21 2 SCIENTIFIC METHODS AND KNOWLEDGE What Is Science?, 27 Core Principles and Assumptions of Scientific Inquiry, 30 Nature Is Not Capricious, 30 Knowledge Grows Through Exploration of the Limits of Existing Rules and Mutually Reinforcing Evidence, 31 Science Is a Communal Enterprise, 32 Science Aims for Refined Degrees of Confidence, Rather Than Complete Certainty, 32 Scientific Knowledge Is Durable and Mutable, 33 Statistical Inference and Hypothesis Testing, 34 27 3 UNDERSTANDING REPRODUCIBILITY AND REPLICABILITY The Evolving Practices of Science, 39 Defining Reproducibility and Replicability, 42 Precision of Measurement, 46 Variations in Methods Employed in a Study, 51 Rigor and Transparency, 52 xtx 39
CONTENTS XX 4 REPRODUCIBILITY Widespread Use of Computational Methods, 55 Nonpublic Data and Code, 57 Resources and Costs of Reproducibility, 57 Assessing Reproducibility, 59 The Extent of Non-Reproducibility, 62 Sources of Non-Reproducibility, 67 Inadequate Recordkeeping, 67 Nontransparent Reporting, 69 Obsolescence of Digital Artifacts, 69 Flawed Attempts to Reproduce Others’ Research, 70 Barriers in the Culture of Research, 70 55 5 REPLICABILITY 71 Assessing Replicability, 72 The Extent of Non-Replicability, 75 Assessments of Replicability, 76 Perspectives of Researchers Who Have Studied Replicability, 82 Surveys, 82 Retraction Trends, 83 Sources of Non-Replicability, 85 Non-Replicability That Is Potentially Helpful to Science, 85 Unhelpful Sources of Non-Replicability, 90 Publication Bias, 91 Misaligned Incentives, 95 Inappropriate Statistical Inference, 96 Poor Study Design, 98 Errors, 98 Incomplete Reporting of a Study, 99 Fraud and Misconduct, 100 6 IMPROVING REPRODUCIBILITY AND REPLICABILITY Strengthening Research Practices: Broad Efforts and Responsibilities, 105 Education and Training, 108 Improving Knowledge and the Use of Statistical Significance Testing, 109 Efforts to Improve Reproducibility, 110 Recordkeeping, 111 Source Code and Data Version Control, 114 Scientific Workflow-Management Systems, 114 Tools for Reproduction of Results, 116 Publication Reproducibility Audits, 118 105
CONTENTS xxi Overcoming Technological and Infrastructure Barriers to Reproducibility, 119 Archival Repositories and Open Data Platforms, 119 Code Hosting and Collaboration Platforms, 121 Digital Object Identifiers, 122 Obsolescence of Data and Code Storage, 123 Implementation Challenges, 125 Efforts to Improve Replicability, 127 Openness Guidelines, 128 Journal Requirements, Badges, and Awards, 129 Introducing Prepublication Checks for Errors and Anomalous Results, 130 Preregistration of Studies, 132 Encouraging the Publication of All Results, 134 Additional Journal Initiatives, 136 Research Funder Efforts to Encourage Replicability, 137 Developing Effective Funder Mandates, 140 7 CONFIDENCE IN SCIENCE Research Synthesis, 144 Geoscience, 147 Genetics, 149 Psychology, 150 Social Science Research Using Big Data, 153 Public Perceptions of Reproducibility and Replicability, 155 Public Understanding of Science, 155 Public Trust in Science, 157 Media Coverage of Science, 158 143 REFERENCES 163 APPENDIXES A Biographical Sketches of Committee Members and Staff В Agendas of Open Committee Meetings C Recommendations Grouped by Stakeholder D Using Bayes Analysis for Hypothesis Testing E Conducting Replicable Surveys of Scientific Communities 189 199 209 221 231 |
| any_adam_object | 1 |
| any_adam_object_boolean | 1 |
| author_corporate | National Academies of Sciences, Engineering, and Medicine |
| author_corporate_role | aut |
| author_facet | National Academies of Sciences, Engineering, and Medicine |
| author_sort | National Academies of Sciences, Engineering, and Medicine |
| building | Verbundindex |
| bvnumber | BV047899535 |
| classification_rvk | AK 28000 |
| ctrlnum | (OCoLC)1129466263 (DE-599)BVBBV047899535 |
| discipline | Allgemeines |
| discipline_str_mv | Allgemeines |
| format | Book |
| fullrecord | <?xml version="1.0" encoding="UTF-8"?><collection xmlns="http://www.loc.gov/MARC21/slim"><record><leader>01724nam a2200361 c 4500</leader><controlfield tag="001">BV047899535</controlfield><controlfield tag="003">DE-604</controlfield><controlfield tag="005">20220511 </controlfield><controlfield tag="007">t</controlfield><controlfield tag="008">220328s2019 xxua||| |||| 00||| eng d</controlfield><datafield tag="020" ind1=" " ind2=" "><subfield code="a">9780309486163</subfield><subfield code="9">978-0-309-48616-3</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(OCoLC)1129466263</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(DE-599)BVBBV047899535</subfield></datafield><datafield tag="040" ind1=" " ind2=" "><subfield code="a">DE-604</subfield><subfield code="b">ger</subfield><subfield code="e">rda</subfield></datafield><datafield tag="041" ind1="0" ind2=" "><subfield code="a">eng</subfield></datafield><datafield tag="044" ind1=" " ind2=" "><subfield code="a">xxu</subfield><subfield code="c">XD-US</subfield></datafield><datafield tag="049" ind1=" " ind2=" "><subfield code="a">DE-739</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">AK 28000</subfield><subfield code="0">(DE-625)2587:</subfield><subfield code="2">rvk</subfield></datafield><datafield tag="110" ind1="2" ind2=" "><subfield code="a">National Academies of Sciences, Engineering, and Medicine</subfield><subfield code="e">Verfasser</subfield><subfield code="0">(DE-588)1114889792</subfield><subfield code="4">aut</subfield></datafield><datafield tag="245" ind1="1" ind2="0"><subfield code="a">Reproducibility and replicability in science</subfield><subfield code="b">a consensus study report</subfield><subfield code="c">The National Academies of Sciences, Engineering, Medicine ; Committee on Reproducibility and Replicability in Science</subfield></datafield><datafield tag="264" ind1=" " ind2="1"><subfield code="a">Washington, DC</subfield><subfield code="b">The National Academies Press</subfield><subfield code="c">[2019]</subfield></datafield><datafield tag="300" ind1=" " ind2=" "><subfield code="a">xxi, 234 Seiten</subfield><subfield code="b">Illustrationen, Diagramme</subfield></datafield><datafield tag="336" ind1=" " ind2=" "><subfield code="b">txt</subfield><subfield code="2">rdacontent</subfield></datafield><datafield tag="337" ind1=" " ind2=" "><subfield code="b">n</subfield><subfield code="2">rdamedia</subfield></datafield><datafield tag="338" ind1=" " ind2=" "><subfield code="b">nc</subfield><subfield code="2">rdacarrier</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Reproduzierbarkeit</subfield><subfield code="0">(DE-588)4586094-4</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Wissenschaft</subfield><subfield code="0">(DE-588)4066562-8</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="689" ind1="0" ind2="0"><subfield code="a">Wissenschaft</subfield><subfield code="0">(DE-588)4066562-8</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="0" ind2="1"><subfield code="a">Reproduzierbarkeit</subfield><subfield code="0">(DE-588)4586094-4</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="0" ind2=" "><subfield code="5">DE-604</subfield></datafield><datafield tag="710" ind1="2" ind2=" "><subfield code="a">National Academies of Sciences, Engineering, and Medicine</subfield><subfield code="b">Committee on Reproducibility and Replicability in Science</subfield><subfield code="0">(DE-588)1199461563</subfield><subfield code="4">oth</subfield></datafield><datafield tag="856" ind1="4" ind2="2"><subfield code="m">Digitalisierung UB Passau - ADAM Catalogue Enrichment</subfield><subfield code="q">application/pdf</subfield><subfield code="u">http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=033281483&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA</subfield><subfield code="3">Inhaltsverzeichnis</subfield></datafield><datafield tag="999" ind1=" " ind2=" "><subfield code="a">oai:aleph.bib-bvb.de:BVB01-033281483</subfield></datafield></record></collection> |
| id | DE-604.BV047899535 |
| illustrated | Illustrated |
| index_date | 2024-07-03T19:28:31Z |
| indexdate | 2024-07-10T09:24:36Z |
| institution | BVB |
| institution_GND | (DE-588)1114889792 (DE-588)1199461563 |
| isbn | 9780309486163 |
| language | English |
| oai_aleph_id | oai:aleph.bib-bvb.de:BVB01-033281483 |
| oclc_num | 1129466263 |
| open_access_boolean | |
| owner | DE-739 |
| owner_facet | DE-739 |
| physical | xxi, 234 Seiten Illustrationen, Diagramme |
| publishDate | 2019 |
| publishDateSearch | 2019 |
| publishDateSort | 2019 |
| publisher | The National Academies Press |
| record_format | marc |
| spelling | National Academies of Sciences, Engineering, and Medicine Verfasser (DE-588)1114889792 aut Reproducibility and replicability in science a consensus study report The National Academies of Sciences, Engineering, Medicine ; Committee on Reproducibility and Replicability in Science Washington, DC The National Academies Press [2019] xxi, 234 Seiten Illustrationen, Diagramme txt rdacontent n rdamedia nc rdacarrier Reproduzierbarkeit (DE-588)4586094-4 gnd rswk-swf Wissenschaft (DE-588)4066562-8 gnd rswk-swf Wissenschaft (DE-588)4066562-8 s Reproduzierbarkeit (DE-588)4586094-4 s DE-604 National Academies of Sciences, Engineering, and Medicine Committee on Reproducibility and Replicability in Science (DE-588)1199461563 oth Digitalisierung UB Passau - ADAM Catalogue Enrichment application/pdf http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=033281483&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA Inhaltsverzeichnis |
| spellingShingle | Reproducibility and replicability in science a consensus study report Reproduzierbarkeit (DE-588)4586094-4 gnd Wissenschaft (DE-588)4066562-8 gnd |
| subject_GND | (DE-588)4586094-4 (DE-588)4066562-8 |
| title | Reproducibility and replicability in science a consensus study report |
| title_auth | Reproducibility and replicability in science a consensus study report |
| title_exact_search | Reproducibility and replicability in science a consensus study report |
| title_exact_search_txtP | Reproducibility and replicability in science a consensus study report |
| title_full | Reproducibility and replicability in science a consensus study report The National Academies of Sciences, Engineering, Medicine ; Committee on Reproducibility and Replicability in Science |
| title_fullStr | Reproducibility and replicability in science a consensus study report The National Academies of Sciences, Engineering, Medicine ; Committee on Reproducibility and Replicability in Science |
| title_full_unstemmed | Reproducibility and replicability in science a consensus study report The National Academies of Sciences, Engineering, Medicine ; Committee on Reproducibility and Replicability in Science |
| title_short | Reproducibility and replicability in science |
| title_sort | reproducibility and replicability in science a consensus study report |
| title_sub | a consensus study report |
| topic | Reproduzierbarkeit (DE-588)4586094-4 gnd Wissenschaft (DE-588)4066562-8 gnd |
| topic_facet | Reproduzierbarkeit Wissenschaft |
| url | http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=033281483&sequence=000001&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |
| work_keys_str_mv | AT nationalacademiesofsciencesengineeringandmedicine reproducibilityandreplicabilityinscienceaconsensusstudyreport AT nationalacademiesofsciencesengineeringandmedicinecommitteeonreproducibilityandreplicabilityinscience reproducibilityandreplicabilityinscienceaconsensusstudyreport |