Impact evaluation in practice:
Saved in:
| Format: | Book |
|---|---|
| Language: | English |
| Published: |
Washington, D.C.
World Bank
2011
|
| Subjects: | |
| Online Access: | Inhaltsverzeichnis |
| Item Description: | Includes bibliographical references and index |
| Physical Description: | xvi, 244 p. ill. 24 cm |
| ISBN: | 9780821385418 |
Staff View
MARC
| LEADER | 00000nam a2200000zc 4500 | ||
|---|---|---|---|
| 001 | BV039800606 | ||
| 003 | DE-604 | ||
| 005 | 20121203 | ||
| 007 | t | ||
| 008 | 120112s2011 xxua||| |||| 00||| eng d | ||
| 010 | |a 2010034602 | ||
| 020 | |a 9780821385418 |c pbk. |9 978-0-8213-8541-8 | ||
| 035 | |a (OCoLC)658117354 | ||
| 035 | |a (DE-599)BVBBV039800606 | ||
| 040 | |a DE-604 |b ger |e aacr | ||
| 041 | 0 | |a eng | |
| 044 | |a xxu |c US | ||
| 049 | |a DE-29 |a DE-739 | ||
| 050 | 0 | |a HD75.9 | |
| 082 | 0 | |a 338.90072 | |
| 084 | |a QC 160 |0 (DE-625)141257: |2 rvk | ||
| 245 | 1 | 0 | |a Impact evaluation in practice |c Paul J. Gertler ... [et al.] |
| 264 | 1 | |a Washington, D.C. |b World Bank |c 2011 | |
| 300 | |a xvi, 244 p. |b ill. |c 24 cm | ||
| 336 | |b txt |2 rdacontent | ||
| 337 | |b n |2 rdamedia | ||
| 338 | |b nc |2 rdacarrier | ||
| 500 | |a Includes bibliographical references and index | ||
| 650 | 4 | |a Economic development projects |x Evaluation | |
| 650 | 4 | |a Evaluation research (Social action programs) | |
| 700 | 1 | |a Gertler, Paul J. |d 1955- |e Sonstige |0 (DE-588)114087741 |4 oth | |
| 776 | 0 | 8 | |i Erscheint auch als |n Online-Ausgabe |z 978-0-8213-8593-7 |
| 856 | 4 | 2 | |m Digitalisierung UB Passau |q application/pdf |u http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=024661086&sequence=000002&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |3 Inhaltsverzeichnis |
| 999 | |a oai:aleph.bib-bvb.de:BVB01-024661086 | ||
Record in the Search Index
| _version_ | 1804148728430329856 |
|---|---|
| adam_text | CONTENTS
Preface
xiii
PART ONE. INTRODUCTION TO IMPACT EVALUATION
1
Chapter
1.
Why Evaluate?
3
Evidence-Based Policy Making
3
What Is Impact Evaluation?
7
Impact Evaluation for Policy Decisions
8
Deciding Whether to Evaluate
10
Cost-Effectiveness Analysis
11
Prospective versus Retrospective Evaluation
13
Efficacy Studies and Effectiveness Studies
14
Combining Sources of Information to Assess Both the
What and the Why
15
Notes
17
References
18
Chapter
2.
Determining Evaluation Questions
21
Types of Evaluation Questions
22
Theories of Change
22
The Results Chain
24
Hypotheses for the Evaluation
27
Selecting Performance Indicators
27
Road Map to Parts
2
and
3 29
Note
■ 30
References
30
PART TWO. HOW TO EVALUATE
31
Chapter
3.
Causal Inference and Counterfactuals
33
Causal Inference
33
Estimating the Counterfactual
36
Two Counterfeit Estimates of the Counterfactual
40
Notes
47
Chapter
4.
Randomized Selection Methods
49
Randomized Assignment of the Treatment
50
Two Variations on Randomized Assignment
64
Estimating Impact under Randomized Offering
66
Notes
79
References
. 80
Chapter
5.
Regression Discontinuity Design
81
Case
1 :
Subsidies for Fertilizer in Rice Production
82
Case
2:
Cash Transfers
84
Using the Regression Discontinuity Design Method
to Evaluate the Health Insurance Subsidy Program
86
The RDD Method at Work
89
Limitations and Interpretation of the
Regression Discontinuity Design Method
91
Note
93
References
93
Chapter
6.
Difference-in-Differences
95
How Is the Difference-in-Differences Method Helpful?
98
Using Difference-in-Differences to Evaluate the Health
Insurance Subsidy Program
102
The Difference-in-Differences Method at Work
103
Limitations of the Difference-in-Differences Method
104
Notes
104
References
105
Chapter
7.
Matching
107
Using Matching Techniques to Select Participant and
Nonparticipant
Households in the Health Insurance
Subsidy Program
111
The Matching Method at Work
113
Limitations of the Matching Method
113
Notes
115
References
116
Chapter
8.
Combining Methods
117
Combining Methods
119
Imperfect Compliance
120
Spillovers
123
Additional Considerations
125
A Backup Plan for Your Evaluation
127
Note
127
References
128
Chapter
9.
Evaluating Multifaceted Programs
129
Evaluating Programs with Different Treatment Levels
130
Evaluating Multiple Treatments with Crossover Designs
132
Note
137
References
137
PART THREE. HOW TO IMPLEMENT
AN IIVPACT EVALUATION
139
Chapter
.10.
Operationalizing the Impact Evaluation Design
143
Choosing an Impact Evaluation Method
143
Is the Evaluation Ethical?
153
How to Set Up an Evaluation Team?
154
How to Time the Evaluation?
158
How to Budget for an Evaluation?
161
Notes
169
References
169
Chapter
11.
Choosing the Sample
171
What Kinds of Data Do I Need?
171
Power Calculations: How Big a Sample Do I Need?
175
Deciding on the Sampling Strategy
192
Notes
195
References
197
Chapter
12.
Collecting Data
199
Hiring Help to Collect Data
199
Developing the Questionnaire
201
Testing the Questionnaire
204
Conducting Fieldwork
204
Processing and Validating the Data
207
Note
209
References
209
Chapter
13.
Producing and Disseminating Findings
211
What Products Will the Evaluation Deliver?
211
How to Disseminate Findings?
219
Notes
221
References
222
Chapter
14.
Conclusion
223
Note
228
References
228
Glossary
229
Index
237
Boxes
1.1
Evaluations and Political Sustainability: The
Progresa/
Oportunidades
Conditional Cash Transfer Program in Mexico
5
1.2
Evaluating to Improve Resource Allocations: Family
Planning and Fertility in Indonesia
6
1.3
Evaluating to Improve Program Design: Malnourishment
and Cognitive Development in Colombia
9
1.4
Evaluating Cost-Effectiveness: Comparing Strategies to
Increase School Attendance in Kenya
2
2.1
Theory of Change: From Cement Floors to Happiness
in Mexico
23
3.1
Estimating the Counterfactual: Miss Unique and the
Cash Transfer Program
36
4.1
Conditional Cash Transfers and Education in Mexico
64
4.2
Randomized Offering of School Vouchers in Colombia
70
4.3
Promoting Education Infrastructure Investments in Bolivia
78
5.1
Social Assistance and Labor Supply in Canada
89
5.2
School Fees and Enrollment Rates in Colombia
90
5.3
Social Safety Nets Based on a Poverty Index in Jamaica
91
6.1
Water Privatization and Infant Mortality in Argentina
103
7.1
Workfare Program and Incomes in Argentina
113
7.2
Piped Water and Child Health in India
114
8.1
Checklist of Verification and Falsification Tests
118
8.2
Matched Difference-in-Differences: Cement Floors,
Child Health, and Maternal Happiness in Mexico
121
8.3
Working with Spillovers: Deworming, Externalities,
and Education in Kenya
124
9.1
Testing Program Alternatives for HIV/AIDS Prevention
in Kenya
135
9.2
Testing Program Alternatives for Monitoring Corruption
in Indonesia
136
10.1
Cash Transfer Programs and the Minimum Scale
of Intervention
152
12.1
Data Collection for the Evaluation of the
Nicaraguán
Atención
a Crisis Pilots
208
13.1
Outline of an Impact Evaluation Plan
212
13.2
Outline of a Baseline Report
213
13.3
Outline of an Evaluation Report
216
13.4
Disseminating Evaluation Findings to Improve Policy
221
Figures
2.1
What
Isa
Results Chain?
25
2.2
Results Chain for a High School Mathematics Program
26
3.1
The Perfect Clone
37
3.2
A Valid Comparison Group
39
3.3
Before and After Estimates of
a Microfinance
Program
41
4.1
Characteristics of Groups under Randomized Assignment
of Treatment
52
4.2
Random Sampling and Randomized Assignment of Treatment
54
4.3
Steps in Randomized Assignment to Treatment
57
4.4
Randomized Assignment to Treatment Using a Spreadsheet
58
4.5
Estimating Impact under Randomized Assignment
61
4.6
Randomized Offering of a Program
67
4.7
Estimating the Impact of Treatment on the Treated under
Randomized Offering
67
4.8
Randomized Promotion
74
4.9
Estimating Impact under Randomized Promotion
75
5.1
Rice Yield
83
5.2
Household Expenditures in Relation to Poverty (Preintervention)
84
5.3
A Discontinuity in Eligibility for the Cash Transfer Program
85
5.4
Household Expenditures in Relation to Poverty
(Postintervention)
86
5.5
Poverty Index and Health Expenditures at the Health Insurance
Subsidy Program Baseline
87
5.6
Poverty Index and Health Expenditures
—
Health Insurance
Subsidy Program Two Years Later
88
6.1
Dlfference-in-Differences
97
6.2
Difference-in-Differences when Outcome Trends Differ
100
7.1
Exact Matching on Four Characteristics
108
7.2
Propensity Score Matching and Common Support
110
8.1
Spillovers
125
9.1
Steps in Randomized Assignment of Two Levels of Treatment
131
9.2
Steps in Randomized Assignment of Two Interventions
133
9.3
Treatment and Comparison Groups for a Program with Two
Interventions
134
P3.1 Roadmap for Implementing an Impact Evaluation
141
11.1
A Large Sample Will Better Resemble the Population
177
11.2
A Valid Sampling Frame Covers the Entire Population of Interest
193
14.1
Number of Impact Evaluations at the World Bank by Region,
2004-10 227
Tables
2.1
Elements of a Monitoring and Evaluation Plan
28
3.1
Case
1—
H
ISP Impact Using Before-After
(Comparison of Means)
44
3.2
Case
1—
HISP Impact Using Before-After
(Regression Analysis)
44
3.3
Case
2—
HISP Impact Using Enrolled-Nonenrolled
(Comparison of Means)
46
3.4
Case
2—
HISP Impact Using Enrolled-Nonenrolled
(Regression Analysis)
47
4.1
Case
3—
Balance between Treatment and Comparison Villages
at Baseline
62
4.2
Case
3—
HISP Impact Using Randomized Assignment
(Comparison of Means)
63
4.3
Case
3—
HISP Impact Using Randomized Assignment
(Regression Analysis)
63
4.4
Case
4—
HISP Impact Using Randomized Promotion
(Comparison of Means)
76
4.5
Case
4—
HISP Impact Using Randomized Promotion
(Regression Analysis)
77
5.1
Case
5—
HISP Impact Using Regression Discontinuity Design
(Regression Analysis)
88
6.1 The Difference-in-Differences
Method
98
6 2
Case
6—
HISP Impact Using Difference-in-Differences
(Comparison of Means)
102
6.3
Case
6—
HISP Impact Using Difference-in-Differences
(Regression Analysis)
102
7.1
Estimating the Propensity Score Based on Observed
Characteristics
111
7.2
Case
7—
HISP Impact Using Matching (Comparison of Means)
112
7.3
Case
7—
HISP Impact Using Matching (Regression Analysis)
112
10.1
Relationship between a Program s Operational Rules and
Impact Evaluation Methods
148
10.2
Cost of Impact Evaluations of a Selection of World Bank-
Supported Projects
161
10.3
Disaggregated Costs of a Selection of World Bank-Supported
Projects
162
10.4
Work Sheet for Impact Evaluation Cost Estimation
166
10.5
Sample Impact Evaluation Budget
167
11.1
Examples of Clusters
181
11.2
Sample Size Required for Various Minimum Detectable Effects
(Decrease in Household Health Expenditures), Power
= 0.9,
No Clustering
186
11.3
Sample Size Required for Various Minimum Detectable Effects
(Decrease in Household Health Expenditures), Power
= 0.8,
No Clustering
186
11.4
Sample Size Required to Detect Various Minimum Desired
Effects (Increase in
Hospitalizaron
Rate), Power
= 0.9,
No Clustering
187
11.5
Sample Size Required for Various Minimum Detectable Effects
(Decrease in Household Health Expenditures), Power
= 0.9,
Maximum of
100
Clusters
190
11.6
Sample Size Required for Various Minimum Detectable Effects
(Decrease in Household Health Expenditures), Power
= 0.8,
Maximum of
100
Clusters
191
11.7
Sample Size Required to Detect a
$2
Minimum Impact
for Various Numbers of Clusters, Power
= 0.9 191
|
| any_adam_object | 1 |
| author_GND | (DE-588)114087741 |
| building | Verbundindex |
| bvnumber | BV039800606 |
| callnumber-first | H - Social Science |
| callnumber-label | HD75 |
| callnumber-raw | HD75.9 |
| callnumber-search | HD75.9 |
| callnumber-sort | HD 275.9 |
| callnumber-subject | HD - Industries, Land Use, Labor |
| classification_rvk | QC 160 |
| ctrlnum | (OCoLC)658117354 (DE-599)BVBBV039800606 |
| dewey-full | 338.90072 |
| dewey-hundreds | 300 - Social sciences |
| dewey-ones | 338 - Production |
| dewey-raw | 338.90072 |
| dewey-search | 338.90072 |
| dewey-sort | 3338.90072 |
| dewey-tens | 330 - Economics |
| discipline | Wirtschaftswissenschaften |
| format | Book |
| fullrecord | <?xml version="1.0" encoding="UTF-8"?><collection xmlns="http://www.loc.gov/MARC21/slim"><record><leader>01410nam a2200373zc 4500</leader><controlfield tag="001">BV039800606</controlfield><controlfield tag="003">DE-604</controlfield><controlfield tag="005">20121203 </controlfield><controlfield tag="007">t</controlfield><controlfield tag="008">120112s2011 xxua||| |||| 00||| eng d</controlfield><datafield tag="010" ind1=" " ind2=" "><subfield code="a">2010034602</subfield></datafield><datafield tag="020" ind1=" " ind2=" "><subfield code="a">9780821385418</subfield><subfield code="c">pbk.</subfield><subfield code="9">978-0-8213-8541-8</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(OCoLC)658117354</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(DE-599)BVBBV039800606</subfield></datafield><datafield tag="040" ind1=" " ind2=" "><subfield code="a">DE-604</subfield><subfield code="b">ger</subfield><subfield code="e">aacr</subfield></datafield><datafield tag="041" ind1="0" ind2=" "><subfield code="a">eng</subfield></datafield><datafield tag="044" ind1=" " ind2=" "><subfield code="a">xxu</subfield><subfield code="c">US</subfield></datafield><datafield tag="049" ind1=" " ind2=" "><subfield code="a">DE-29</subfield><subfield code="a">DE-739</subfield></datafield><datafield tag="050" ind1=" " ind2="0"><subfield code="a">HD75.9</subfield></datafield><datafield tag="082" ind1="0" ind2=" "><subfield code="a">338.90072</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">QC 160</subfield><subfield code="0">(DE-625)141257:</subfield><subfield code="2">rvk</subfield></datafield><datafield tag="245" ind1="1" ind2="0"><subfield code="a">Impact evaluation in practice</subfield><subfield code="c">Paul J. Gertler ... [et al.]</subfield></datafield><datafield tag="264" ind1=" " ind2="1"><subfield code="a">Washington, D.C.</subfield><subfield code="b">World Bank</subfield><subfield code="c">2011</subfield></datafield><datafield tag="300" ind1=" " ind2=" "><subfield code="a">xvi, 244 p.</subfield><subfield code="b">ill.</subfield><subfield code="c">24 cm</subfield></datafield><datafield tag="336" ind1=" " ind2=" "><subfield code="b">txt</subfield><subfield code="2">rdacontent</subfield></datafield><datafield tag="337" ind1=" " ind2=" "><subfield code="b">n</subfield><subfield code="2">rdamedia</subfield></datafield><datafield tag="338" ind1=" " ind2=" "><subfield code="b">nc</subfield><subfield code="2">rdacarrier</subfield></datafield><datafield tag="500" ind1=" " ind2=" "><subfield code="a">Includes bibliographical references and index</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Economic development projects</subfield><subfield code="x">Evaluation</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Evaluation research (Social action programs)</subfield></datafield><datafield tag="700" ind1="1" ind2=" "><subfield code="a">Gertler, Paul J.</subfield><subfield code="d">1955-</subfield><subfield code="e">Sonstige</subfield><subfield code="0">(DE-588)114087741</subfield><subfield code="4">oth</subfield></datafield><datafield tag="776" ind1="0" ind2="8"><subfield code="i">Erscheint auch als</subfield><subfield code="n">Online-Ausgabe</subfield><subfield code="z">978-0-8213-8593-7</subfield></datafield><datafield tag="856" ind1="4" ind2="2"><subfield code="m">Digitalisierung UB Passau</subfield><subfield code="q">application/pdf</subfield><subfield code="u">http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=024661086&sequence=000002&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA</subfield><subfield code="3">Inhaltsverzeichnis</subfield></datafield><datafield tag="999" ind1=" " ind2=" "><subfield code="a">oai:aleph.bib-bvb.de:BVB01-024661086</subfield></datafield></record></collection> |
| id | DE-604.BV039800606 |
| illustrated | Illustrated |
| indexdate | 2024-07-10T00:11:45Z |
| institution | BVB |
| isbn | 9780821385418 |
| language | English |
| lccn | 2010034602 |
| oai_aleph_id | oai:aleph.bib-bvb.de:BVB01-024661086 |
| oclc_num | 658117354 |
| open_access_boolean | |
| owner | DE-29 DE-739 |
| owner_facet | DE-29 DE-739 |
| physical | xvi, 244 p. ill. 24 cm |
| publishDate | 2011 |
| publishDateSearch | 2011 |
| publishDateSort | 2011 |
| publisher | World Bank |
| record_format | marc |
| spelling | Impact evaluation in practice Paul J. Gertler ... [et al.] Washington, D.C. World Bank 2011 xvi, 244 p. ill. 24 cm txt rdacontent n rdamedia nc rdacarrier Includes bibliographical references and index Economic development projects Evaluation Evaluation research (Social action programs) Gertler, Paul J. 1955- Sonstige (DE-588)114087741 oth Erscheint auch als Online-Ausgabe 978-0-8213-8593-7 Digitalisierung UB Passau application/pdf http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=024661086&sequence=000002&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA Inhaltsverzeichnis |
| spellingShingle | Impact evaluation in practice Economic development projects Evaluation Evaluation research (Social action programs) |
| title | Impact evaluation in practice |
| title_auth | Impact evaluation in practice |
| title_exact_search | Impact evaluation in practice |
| title_full | Impact evaluation in practice Paul J. Gertler ... [et al.] |
| title_fullStr | Impact evaluation in practice Paul J. Gertler ... [et al.] |
| title_full_unstemmed | Impact evaluation in practice Paul J. Gertler ... [et al.] |
| title_short | Impact evaluation in practice |
| title_sort | impact evaluation in practice |
| topic | Economic development projects Evaluation Evaluation research (Social action programs) |
| topic_facet | Economic development projects Evaluation Evaluation research (Social action programs) |
| url | http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=024661086&sequence=000002&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |
| work_keys_str_mv | AT gertlerpaulj impactevaluationinpractice |