Learning from the Experiments That Never Happened: Lessons from Trying to Conduct Randomized Evaluations of Matching Grant Programs in Africa
Matching grants are one of the most common policy instruments used by developing country governments to try to foster technological upgrading, innovation, exports, use of business development services and other activities leading to firm growth. However, since they involve subsidizing firms, the ris...
Gespeichert in:
1. Verfasser: | |
---|---|
Format: | Elektronisch E-Book |
Sprache: | English |
Veröffentlicht: |
Washington, D.C
The World Bank
2012
|
Online-Zugang: | Volltext |
Zusammenfassung: | Matching grants are one of the most common policy instruments used by developing country governments to try to foster technological upgrading, innovation, exports, use of business development services and other activities leading to firm growth. However, since they involve subsidizing firms, the risk is that they could crowd out private investment, subsidizing activities that firms were planning to undertake anyway, or lead to pure private gains, rather than generating the public gains that justify government intervention. As a result, rigorous evaluation of the effects of such programs is important. The authors attempted to implement randomized experiments to evaluate the impact of seven matching grant programs offered in six African countries, but in each case were unable to complete an experimental evaluation. One critique of randomized experiments is publication bias, whereby only those experiments with "interesting" results get published. The hope is to mitigate this bias by learning from the experiments that never happened. This paper describes the three main proximate reasons for lack of implementation: continued project delays, politicians not willing to allow random assignment, and low program take-up; and then delves into the underlying causes of these occurring. Political economy, overly stringent eligibility criteria that do not take account of where value-added may be highest, a lack of attention to detail in "last mile" issues, incentives facing project implementation staff, and the way impact evaluations are funded, and all help explain the failure of randomization. Lessons are drawn from these experiences for both the implementation and the possible evaluation of future projects |
Beschreibung: | 1 Online-Ressource (36 p) |
DOI: | 10.1596/1813-9450-6296 |
Internformat
MARC
LEADER | 00000nmm a2200000zc 4500 | ||
---|---|---|---|
001 | BV048265732 | ||
003 | DE-604 | ||
007 | cr|uuu---uuuuu | ||
008 | 220609s2012 |||| o||u| ||||||eng d | ||
024 | 7 | |a 10.1596/1813-9450-6296 |2 doi | |
035 | |a (ZDB-1-WBA)NLM010333886 | ||
035 | |a (OCoLC)1075759567 | ||
035 | |a (DE-599)GBVNLM010333886 | ||
040 | |a DE-604 |b ger |e rda | ||
041 | 0 | |a eng | |
049 | |a DE-12 |a DE-521 |a DE-573 |a DE-523 |a DE-Re13 |a DE-19 |a DE-355 |a DE-703 |a DE-91 |a DE-706 |a DE-29 |a DE-M347 |a DE-473 |a DE-824 |a DE-20 |a DE-739 |a DE-1043 |a DE-863 |a DE-862 | ||
100 | 1 | |a Campos, Francisco |e Verfasser |4 aut | |
245 | 1 | 0 | |a Learning from the Experiments That Never Happened |b Lessons from Trying to Conduct Randomized Evaluations of Matching Grant Programs in Africa |c Francisco Campos |
264 | 1 | |a Washington, D.C |b The World Bank |c 2012 | |
300 | |a 1 Online-Ressource (36 p) | ||
336 | |b txt |2 rdacontent | ||
337 | |b c |2 rdamedia | ||
338 | |b cr |2 rdacarrier | ||
520 | |a Matching grants are one of the most common policy instruments used by developing country governments to try to foster technological upgrading, innovation, exports, use of business development services and other activities leading to firm growth. However, since they involve subsidizing firms, the risk is that they could crowd out private investment, subsidizing activities that firms were planning to undertake anyway, or lead to pure private gains, rather than generating the public gains that justify government intervention. As a result, rigorous evaluation of the effects of such programs is important. The authors attempted to implement randomized experiments to evaluate the impact of seven matching grant programs offered in six African countries, but in each case were unable to complete an experimental evaluation. One critique of randomized experiments is publication bias, whereby only those experiments with "interesting" results get published. The hope is to mitigate this bias by learning from the experiments that never happened. This paper describes the three main proximate reasons for lack of implementation: continued project delays, politicians not willing to allow random assignment, and low program take-up; and then delves into the underlying causes of these occurring. Political economy, overly stringent eligibility criteria that do not take account of where value-added may be highest, a lack of attention to detail in "last mile" issues, incentives facing project implementation staff, and the way impact evaluations are funded, and all help explain the failure of randomization. Lessons are drawn from these experiences for both the implementation and the possible evaluation of future projects | ||
700 | 1 | |a Coville, Aidan |4 oth | |
700 | 1 | |a Fernandes, Ana M. |4 oth | |
700 | 1 | |a McKenzie, David |4 oth | |
700 | 1 | |a Campos, Francisco |4 oth | |
700 | 1 | |a Goldstein, Markus |4 oth | |
776 | 0 | 8 | |i Campos, Francisco |a Learning from the Experiments That Never Happened |
856 | 4 | 0 | |u https://doi.org/10.1596/1813-9450-6296 |x Verlag |z kostenfrei |3 Volltext |
912 | |a ZDB-1-WBA | ||
943 | 1 | |a oai:aleph.bib-bvb.de:BVB01-033645926 |
Datensatz im Suchindex
_version_ | 1812671731391791104 |
---|---|
adam_text | |
adam_txt | |
any_adam_object | |
any_adam_object_boolean | |
author | Campos, Francisco |
author_facet | Campos, Francisco |
author_role | aut |
author_sort | Campos, Francisco |
author_variant | f c fc |
building | Verbundindex |
bvnumber | BV048265732 |
collection | ZDB-1-WBA |
ctrlnum | (ZDB-1-WBA)NLM010333886 (OCoLC)1075759567 (DE-599)GBVNLM010333886 |
discipline | Wirtschaftswissenschaften |
discipline_str_mv | Wirtschaftswissenschaften |
doi_str_mv | 10.1596/1813-9450-6296 |
format | Electronic eBook |
fullrecord | <?xml version="1.0" encoding="UTF-8"?><collection xmlns="http://www.loc.gov/MARC21/slim"><record><leader>00000nmm a2200000zc 4500</leader><controlfield tag="001">BV048265732</controlfield><controlfield tag="003">DE-604</controlfield><controlfield tag="007">cr|uuu---uuuuu</controlfield><controlfield tag="008">220609s2012 |||| o||u| ||||||eng d</controlfield><datafield tag="024" ind1="7" ind2=" "><subfield code="a">10.1596/1813-9450-6296</subfield><subfield code="2">doi</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(ZDB-1-WBA)NLM010333886</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(OCoLC)1075759567</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(DE-599)GBVNLM010333886</subfield></datafield><datafield tag="040" ind1=" " ind2=" "><subfield code="a">DE-604</subfield><subfield code="b">ger</subfield><subfield code="e">rda</subfield></datafield><datafield tag="041" ind1="0" ind2=" "><subfield code="a">eng</subfield></datafield><datafield tag="049" ind1=" " ind2=" "><subfield code="a">DE-12</subfield><subfield code="a">DE-521</subfield><subfield code="a">DE-573</subfield><subfield code="a">DE-523</subfield><subfield code="a">DE-Re13</subfield><subfield code="a">DE-19</subfield><subfield code="a">DE-355</subfield><subfield code="a">DE-703</subfield><subfield code="a">DE-91</subfield><subfield code="a">DE-706</subfield><subfield code="a">DE-29</subfield><subfield code="a">DE-M347</subfield><subfield code="a">DE-473</subfield><subfield code="a">DE-824</subfield><subfield code="a">DE-20</subfield><subfield code="a">DE-739</subfield><subfield code="a">DE-1043</subfield><subfield code="a">DE-863</subfield><subfield code="a">DE-862</subfield></datafield><datafield tag="100" ind1="1" ind2=" "><subfield code="a">Campos, Francisco</subfield><subfield code="e">Verfasser</subfield><subfield code="4">aut</subfield></datafield><datafield tag="245" ind1="1" ind2="0"><subfield code="a">Learning from the Experiments That Never Happened</subfield><subfield code="b">Lessons from Trying to Conduct Randomized Evaluations of Matching Grant Programs in Africa</subfield><subfield code="c">Francisco Campos</subfield></datafield><datafield tag="264" ind1=" " ind2="1"><subfield code="a">Washington, D.C</subfield><subfield code="b">The World Bank</subfield><subfield code="c">2012</subfield></datafield><datafield tag="300" ind1=" " ind2=" "><subfield code="a">1 Online-Ressource (36 p)</subfield></datafield><datafield tag="336" ind1=" " ind2=" "><subfield code="b">txt</subfield><subfield code="2">rdacontent</subfield></datafield><datafield tag="337" ind1=" " ind2=" "><subfield code="b">c</subfield><subfield code="2">rdamedia</subfield></datafield><datafield tag="338" ind1=" " ind2=" "><subfield code="b">cr</subfield><subfield code="2">rdacarrier</subfield></datafield><datafield tag="520" ind1=" " ind2=" "><subfield code="a">Matching grants are one of the most common policy instruments used by developing country governments to try to foster technological upgrading, innovation, exports, use of business development services and other activities leading to firm growth. However, since they involve subsidizing firms, the risk is that they could crowd out private investment, subsidizing activities that firms were planning to undertake anyway, or lead to pure private gains, rather than generating the public gains that justify government intervention. As a result, rigorous evaluation of the effects of such programs is important. The authors attempted to implement randomized experiments to evaluate the impact of seven matching grant programs offered in six African countries, but in each case were unable to complete an experimental evaluation. One critique of randomized experiments is publication bias, whereby only those experiments with "interesting" results get published. The hope is to mitigate this bias by learning from the experiments that never happened. This paper describes the three main proximate reasons for lack of implementation: continued project delays, politicians not willing to allow random assignment, and low program take-up; and then delves into the underlying causes of these occurring. Political economy, overly stringent eligibility criteria that do not take account of where value-added may be highest, a lack of attention to detail in "last mile" issues, incentives facing project implementation staff, and the way impact evaluations are funded, and all help explain the failure of randomization. Lessons are drawn from these experiences for both the implementation and the possible evaluation of future projects</subfield></datafield><datafield tag="700" ind1="1" ind2=" "><subfield code="a">Coville, Aidan</subfield><subfield code="4">oth</subfield></datafield><datafield tag="700" ind1="1" ind2=" "><subfield code="a">Fernandes, Ana M.</subfield><subfield code="4">oth</subfield></datafield><datafield tag="700" ind1="1" ind2=" "><subfield code="a">McKenzie, David</subfield><subfield code="4">oth</subfield></datafield><datafield tag="700" ind1="1" ind2=" "><subfield code="a">Campos, Francisco</subfield><subfield code="4">oth</subfield></datafield><datafield tag="700" ind1="1" ind2=" "><subfield code="a">Goldstein, Markus</subfield><subfield code="4">oth</subfield></datafield><datafield tag="776" ind1="0" ind2="8"><subfield code="i">Campos, Francisco</subfield><subfield code="a">Learning from the Experiments That Never Happened</subfield></datafield><datafield tag="856" ind1="4" ind2="0"><subfield code="u">https://doi.org/10.1596/1813-9450-6296</subfield><subfield code="x">Verlag</subfield><subfield code="z">kostenfrei</subfield><subfield code="3">Volltext</subfield></datafield><datafield tag="912" ind1=" " ind2=" "><subfield code="a">ZDB-1-WBA</subfield></datafield><datafield tag="943" ind1="1" ind2=" "><subfield code="a">oai:aleph.bib-bvb.de:BVB01-033645926</subfield></datafield></record></collection> |
id | DE-604.BV048265732 |
illustrated | Not Illustrated |
index_date | 2024-07-03T19:59:52Z |
indexdate | 2024-10-12T04:01:14Z |
institution | BVB |
language | English |
oai_aleph_id | oai:aleph.bib-bvb.de:BVB01-033645926 |
oclc_num | 1075759567 |
open_access_boolean | 1 |
owner | DE-12 DE-521 DE-573 DE-523 DE-Re13 DE-BY-UBR DE-19 DE-BY-UBM DE-355 DE-BY-UBR DE-703 DE-91 DE-BY-TUM DE-706 DE-29 DE-M347 DE-473 DE-BY-UBG DE-824 DE-20 DE-739 DE-1043 DE-863 DE-BY-FWS DE-862 DE-BY-FWS |
owner_facet | DE-12 DE-521 DE-573 DE-523 DE-Re13 DE-BY-UBR DE-19 DE-BY-UBM DE-355 DE-BY-UBR DE-703 DE-91 DE-BY-TUM DE-706 DE-29 DE-M347 DE-473 DE-BY-UBG DE-824 DE-20 DE-739 DE-1043 DE-863 DE-BY-FWS DE-862 DE-BY-FWS |
physical | 1 Online-Ressource (36 p) |
psigel | ZDB-1-WBA |
publishDate | 2012 |
publishDateSearch | 2012 |
publishDateSort | 2012 |
publisher | The World Bank |
record_format | marc |
spellingShingle | Campos, Francisco Learning from the Experiments That Never Happened Lessons from Trying to Conduct Randomized Evaluations of Matching Grant Programs in Africa |
title | Learning from the Experiments That Never Happened Lessons from Trying to Conduct Randomized Evaluations of Matching Grant Programs in Africa |
title_auth | Learning from the Experiments That Never Happened Lessons from Trying to Conduct Randomized Evaluations of Matching Grant Programs in Africa |
title_exact_search | Learning from the Experiments That Never Happened Lessons from Trying to Conduct Randomized Evaluations of Matching Grant Programs in Africa |
title_exact_search_txtP | Learning from the Experiments That Never Happened Lessons from Trying to Conduct Randomized Evaluations of Matching Grant Programs in Africa |
title_full | Learning from the Experiments That Never Happened Lessons from Trying to Conduct Randomized Evaluations of Matching Grant Programs in Africa Francisco Campos |
title_fullStr | Learning from the Experiments That Never Happened Lessons from Trying to Conduct Randomized Evaluations of Matching Grant Programs in Africa Francisco Campos |
title_full_unstemmed | Learning from the Experiments That Never Happened Lessons from Trying to Conduct Randomized Evaluations of Matching Grant Programs in Africa Francisco Campos |
title_short | Learning from the Experiments That Never Happened |
title_sort | learning from the experiments that never happened lessons from trying to conduct randomized evaluations of matching grant programs in africa |
title_sub | Lessons from Trying to Conduct Randomized Evaluations of Matching Grant Programs in Africa |
url | https://doi.org/10.1596/1813-9450-6296 |
work_keys_str_mv | AT camposfrancisco learningfromtheexperimentsthatneverhappenedlessonsfromtryingtoconductrandomizedevaluationsofmatchinggrantprogramsinafrica AT covilleaidan learningfromtheexperimentsthatneverhappenedlessonsfromtryingtoconductrandomizedevaluationsofmatchinggrantprogramsinafrica AT fernandesanam learningfromtheexperimentsthatneverhappenedlessonsfromtryingtoconductrandomizedevaluationsofmatchinggrantprogramsinafrica AT mckenziedavid learningfromtheexperimentsthatneverhappenedlessonsfromtryingtoconductrandomizedevaluationsofmatchinggrantprogramsinafrica AT goldsteinmarkus learningfromtheexperimentsthatneverhappenedlessonsfromtryingtoconductrandomizedevaluationsofmatchinggrantprogramsinafrica |