Program evaluation & performance measurement: an introduction to practice
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Book |
| Language: | English |
| Published: |
Thousand Oaks <<[u.a.]>>
SAGE Publications
2006
|
| Subjects: | |
| Online Access: | Inhaltsverzeichnis |
| Item Description: | Includes bibliographical references and index Nebentitel: Program evaluation and performance measurement |
| Physical Description: | XVIII, 477 S. graph. Darst. |
| ISBN: | 1412906687 |
Staff View
MARC
| LEADER | 00000nam a2200000 c 4500 | ||
|---|---|---|---|
| 001 | BV024609941 | ||
| 003 | DE-604 | ||
| 005 | 20120530 | ||
| 007 | t | ||
| 008 | 090924s2006 d||| |||| 00||| eng d | ||
| 020 | |a 1412906687 |9 1-4129-0668-7 | ||
| 035 | |a (OCoLC)835592424 | ||
| 035 | |a (DE-599)BVBBV024609941 | ||
| 040 | |a DE-604 |b ger |e rakwb | ||
| 041 | 0 | |a eng | |
| 049 | |a DE-83 |a DE-188 |a DE-11 | ||
| 082 | 0 | |a 658.4013 | |
| 084 | |a CM 3000 |0 (DE-625)18945: |2 rvk | ||
| 084 | |a MR 2700 |0 (DE-625)123495: |2 rvk | ||
| 100 | 1 | |a McDavid, James C. |e Verfasser |4 aut | |
| 245 | 1 | 0 | |a Program evaluation & performance measurement |b an introduction to practice |c James C. McDavid and Laura R. L. Hawthorn |
| 246 | 1 | 3 | |a Program evaluation and performance measurement |
| 264 | 1 | |a Thousand Oaks <<[u.a.]>> |b SAGE Publications |c 2006 | |
| 300 | |a XVIII, 477 S. |b graph. Darst. | ||
| 336 | |b txt |2 rdacontent | ||
| 337 | |b n |2 rdamedia | ||
| 338 | |b nc |2 rdacarrier | ||
| 500 | |a Includes bibliographical references and index | ||
| 500 | |a Nebentitel: Program evaluation and performance measurement | ||
| 650 | 4 | |a Organizational effectiveness |x Measurement | |
| 650 | 4 | |a Performance |x Measurement | |
| 650 | 4 | |a Project management |x Evaluation | |
| 700 | 1 | |a Hawthorn, Laura R. L. |e Verfasser |4 aut | |
| 856 | 4 | 2 | |m HBZ Datenaustausch |q application/pdf |u http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=018582726&sequence=000002&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |3 Inhaltsverzeichnis |
| 999 | |a oai:aleph.bib-bvb.de:BVB01-018582726 | ||
Record in the Search Index
| _version_ | 1804140626470502400 |
|---|---|
| adam_text | CONTENTS
Dedication jj
Acknowledgments xv
Preface xvii
1. Key Concepts and Issues in Program
Evaluation and Performance Measurement 1
Introduction 3
A Typical Program Evaluation:
Assessing the Neighbourhood Integrated
Service Team Program 10
What Is a Program? 15
Key Concepts in Program Evaluation 15
Key Evaluation Questions 17
Formative and Summative Program Evaluations 21
Ex Ante and Ex Post Program Evaluations 22
Analyzing Cause and Effect
Linkages in Program Evaluations 23
The Process of Conducting a Program Evaluation 24
Summary 34
Discussion Questions 35
References 36
2. Understanding and Applying Program Logic Models 39
Introduction 41
A Basic Logic Modeling Approach 44
Logic Models That Categorize and
Specify Intended Causal Linkages 47
Flow Charts 57
Constructing Program Logics in Program Evaluations 58
Program Technologies 62
Program Objectives, Program
Environments, and Organizational Objectives 65
Strengths and Limitations of Program Logics 67
Summary 69
Discussion Questions 70
Appendix 1: Applying What You Have
Learned in Chapter 2: Developing a
Logic Model for the COMPASS Program 72
Answer Key 76
References 77
3. Research Designs for Program Evaluations 79
Introduction 81
What Is Research Design? 83
Why Pay Attention to Experimental Designs? 89
Using Experimental Designs to Evaluate Programs:
The Elmira Nurse Home Visitation Program 91
Establishing Validity in Research Designs 95
Defining and Working with the Four Kinds of Validity 96
Testing the Causal Linkages in Program Logic Models 114
Research Designs and Performance Measurement 118
Summary 120
Discussion Questions 122
References 125
4. Measurement in Program Evaluation 129
Introduction 131
Measurement Procedures 133
Illustrating Measurement Terminology 133
Measurement Validity 138
Levels of Measurement 142
Units of Analysis 145
Sources of Data in Program Evaluations
and Performance Measurement Systems 146
Using Surveys to Estimate the
Incremental Effects of Programs 156
Survey Designs and Research Designs 157
Validity of Measures and the
Validity of Causes and Effects 158
Summary 160
Discussion Questions 161
References 161
i
5. Applying Qualitative Evaluation Methods 165
Introduction 167
Comparing and Contrasting Different
Approaches to Qualitative Evaluation 168
Qualitative Evaluation Methods: Some Basics 172
Structuring Qualitative Program Evaluations 179
The Credibility and
Generalizability of Qualitative Findings 191
Connecting Qualitative Evaluation
Methods to Performance Measurement 194
The Power of Case Studies 196
Summary 197
Discussion Questions 198
References 198
6. Assessing the Need for Programs 201
Introduction 203
What Are Needs? 206
Benchmarking Needs: Criteria for Establishing
the Existence and Magnitude of Needs 208
Steps in Conducting Needs Assessments 212
The St. Columba Collaboration Project:
Needs Assessment in a Newark Neighborhood 230
Summary 235
Discussion Questions 236
Appendix: Designing a Needs
Assessment for a Small Nonprofit Organization 236
References 238
7. Concepts and Issues in Economic Evaluation 241
Introduction 243
Three Types of Economic Evaluation 247
Economic Evaluation in the
Performance Management Cycle 249
Historical Developments in Economic Evaluation 250
Cost-Effectiveness Analysis 252
Cost-Utility Analysis 262
Cost-Benefit Analysis 263
Cost-Effectiveness Analysis Example:
A Study of Falls Prevention Among the Elderly 266
Strengths and Limitations of Economic Evaluation 272
Summary 276
Discussion Questions 277
References 278
8. Performance Measurement
as an Approach to Evaluation 281
Introduction 282
Growth of Performance Measurement 283
Metaphors That Support and
Sustain Performance Measurement 288
Comparing Program Evaluation
and Performance Measurement 292
Summary 300
Discussion Questions 301
References 302
9- Design and Implementation of
Performance Measurement Systems 305
Introduction 307
Key Steps in Designing and Implementing
a Performance Measurement System 307
Summary 330
Discussion Questions 331
References 334
10. Using and Sustaining
Performance Measurement Systems 337
Introduction 339
Comparing Ideal and Real Organizations:
The Role of Organizational Politics in Designing and
Implementing Performance Measurement Systems 340
Intended Uses of Performance Measurement Systems 343
Actual Uses of Performance Measurement 349
Problems and Issues in Implementing and
Sustaining Performance Measurement Systems 354
Summary 367
Discussion Questions 368
References 368
11. Program Evaluation and Program
Management: Joining Theory and Practice 373
Introduction 375
Can Management and Evaluation Be Joined? 376
Prospects for Building
Cultures That Support Evaluation 378
Learning Organizations as Self-Evaluating Organizations 380
Can Program Managers Evaluate Their Own Programs? 383
How Should Evaluators Relate to Managers?
Striving for Objectivity in Program Evaluations 385
Can Program Evaluators Be Objective? 386
Criteria for Best Practices in Program
Evaluation: Assuring Stakeholders
That Evaluations Are High Quality 389
Ethics and Evaluation Practice 391
Summary 394
Discussion Questions 394
Appendix 1. A Case Study in Ethical Decision Making 395
References 397
12. The Nature and Practice of
Professional Judgment in Program Evaluation 401
Introduction 403
The Nature of the Evaluation Enterprise 403
Professionalism and Evaluation Practice 412
Understanding Professional Judgment 415
Improving Professional Judgment in Evaluation Practice 422
Evaluation as a Craft: Implications
for Professionalizing Evaluation 427
Teamwork and Professional Judgment 428
Summary 429
Discussion Questions 430
References 431
Glossary 435
Index 453
About the Authors 477
FIGURES AND TABLES
Figure 1.1. Performance Management Cycle 7
Figure 1.2. Linking Programs and Intended Objectives 16
Figure 1.3. The Two Program Effectiveness
Questions Involved in Most Evaluations 16
Figure 1.4. An Open Systems Model of
Programs and Key Evaluation Issues 20
Table 1.1. Summary of Key Questions and
Steps in Conducting Evaluation
Assessments and Evaluation Studies 26
Table 2.1. Program Logic Model of Laurel House 46
Table 2.2. A Framework for Modeling Program Logics 51
Figure 2.1. Income Self-Sufficiency Program: Logic Model 53
Figure 2.2. Logic Model for the
Alcohol and Drug Services Program 55
Figure 2.3. Flow Chart for Fire Codes Inspection Program 57
Table 2.3. Program Technologies and the Probability
That Outcomes Will Be Achieved 63
Table 2.4. Examples of Factors in the Environments
of Programs That Can Offer Opportunities
and Constraints to the Success of Programs 66
Figure 3.1. Did the Program Cause the Observed Outcomes? 83
Figure 3.2. Research Design to Test Seed Yields Where
Seed Type Is the Only Factor Being Manipulated 85
Figure 3-3- Research Design to Test Seed Yields Where
Seed Type, Fertilizer, and Contiguous Unplanted
Land Are All Possible Causes of Grain Yield 86
Figure 3.4. Visual Metaphor for a Defensible Research Design 87
Table 3.1. Two Experimental Designs 88
Table 3.2. Research Design for the Elmira
Nurse Home Visitation Program 93
Figure 3.5. The Four Kinds of
Validity in Research Designs 96
Figure 3.6. Reported Traffic
Fatalities in Connecticut: 1951-1959 102
Figure 37. Reported Traffic Fatalities in
Connecticut and Four Comparison
States: 1951-1959 (per 100,000 population) 103
Figure 3.8. Burglary Levels in York, Pennsylvania:
January 1974-February 1980 106
Figure 3.9. Implementation and Withdrawal of
Neighborhood Watch and Team Policing 107
Table 3.3. Program Logic for the York
Crime Prevention Program 115
Table 3.4. Summary of the Overall Evaluation Design
for the York Crime Prevention Program 116
Figure 4.1. Measurement in Program
Evaluation and Performance Measurement 132
Table 4.1. Research Design for the
Vancouver Radar Camera Evaluation 133
Table 4.2. Program Logic of the
Vancouver Radar Camera Intervention 134
Figure 4.2. Measuring Constructs in Evaluations 135
Figure 4.3. Measuring Mental Constructs 150
Table 4.3. Examples of Validity and
Reliability Issues Applicable to Surveys 154
Figure 5.1. The Old Woman or the Young Woman? 170
Table 5.1. Key Differences Between Qualitative
and Quantitative Evaluation Approaches 175
Table 5.2. Summary of Key Questions in
Conducting Qualitative Evaluation
Assessments and Evaluation Studies 177
Table 5.3. Sampling Strategies
for Qualitative Evaluations 183
Table 5.4. Open-Ended Questions for the Economic
Development Agreement Stakeholders Project 185
Table 5.5. Some Basics of Face-to-Face Interviewing 188
Table 5.6. Helpful Hints as You Analyze Qualitative Data 189
Table 5.7. Comparing Qualitative Validity with
Experimental and Quasi-Experimental Validity 192
Table 5.8. Ways of Testing and Confirming Qualitative Findings 193
Figure 6.1. Simplified Performance Management Cycle 204
Table 6.1. Maslow s Hierarchy of Needs 207
Table 6.2. Services Inventory for
Elderly Persons in a Population 216
Table 6.3- Ratings of the Importance That Services
Be Made Available to Airdrie Residents 219
Table 6.4. Need for the Services in Airdrie 219
Tkble 6.5. Ranking of Options for
Child Care in a Public Agency 220
Table 6.6. Sample Sizes for a 95% Level of
Confidence Depending on Population
Proportions Expected to Give a Particular
Answer and Acceptable Sampling Error 225
Figure 7.1. Economic Evaluation in the
Performance Management Cycle 249
Table 7.1. Example of a QALY League Table 263
Table 8.1. Comparisons Between Program
Evaluation and Performance Measurement 293
Figure 8.1. How an Internally Valid Research
Design Resolves the Attribution Problem 297
Table 9.1. Key Steps in Designing and Implementing
a Performance Measurement System 308
Figure 10.1. Public Sector Performance Management:
Impacts of Organizational Politics 342
Table 10.1. British Columbia Legislators Expected
Uses of Public Performance Reports 347
Table 10.2. British Columbia Legislators Survey:
Expected Single Biggest Benefit and Single
Biggest Downside of Having Annual Performance
Reports from Ministries and Crown Corporations 348
Table 10.3- Challenges in Implementing and
Sustaining Performance Measurement Systems 355
Table 11.1. Who Should Be Responsible for Program
Evaluation in the British Columbia Government? 379
Table 11.2. Building Blocks for Creating Learning Organizations 382
Table 11.3. Relationships Between the American
Evaluation Association Principles ¦
and Ethical Principles for Evaluators 393
Figure 12.1. The Professional Judgment Process 417
Table 12.1. Definitions of Constructs in the
Model of the Professional Judgment Process 419
Figure 12.2. The Three Triangles 421
Table 12.2. Types of Professional Judgment
That Are Relevant to Program Evaluation
and Performance Measurement 426
Table 12.3. Learning Activities to Increase Professional
Judgment Capacity in Novice Practitioners 427
|
| any_adam_object | 1 |
| author | McDavid, James C. Hawthorn, Laura R. L. |
| author_facet | McDavid, James C. Hawthorn, Laura R. L. |
| author_role | aut aut |
| author_sort | McDavid, James C. |
| author_variant | j c m jc jcm l r l h lrl lrlh |
| building | Verbundindex |
| bvnumber | BV024609941 |
| classification_rvk | CM 3000 MR 2700 |
| ctrlnum | (OCoLC)835592424 (DE-599)BVBBV024609941 |
| dewey-full | 658.4013 |
| dewey-hundreds | 600 - Technology (Applied sciences) |
| dewey-ones | 658 - General management |
| dewey-raw | 658.4013 |
| dewey-search | 658.4013 |
| dewey-sort | 3658.4013 |
| dewey-tens | 650 - Management and auxiliary services |
| discipline | Soziologie Psychologie Wirtschaftswissenschaften |
| format | Book |
| fullrecord | <?xml version="1.0" encoding="UTF-8"?><collection xmlns="http://www.loc.gov/MARC21/slim"><record><leader>01570nam a2200385 c 4500</leader><controlfield tag="001">BV024609941</controlfield><controlfield tag="003">DE-604</controlfield><controlfield tag="005">20120530 </controlfield><controlfield tag="007">t</controlfield><controlfield tag="008">090924s2006 d||| |||| 00||| eng d</controlfield><datafield tag="020" ind1=" " ind2=" "><subfield code="a">1412906687</subfield><subfield code="9">1-4129-0668-7</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(OCoLC)835592424</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(DE-599)BVBBV024609941</subfield></datafield><datafield tag="040" ind1=" " ind2=" "><subfield code="a">DE-604</subfield><subfield code="b">ger</subfield><subfield code="e">rakwb</subfield></datafield><datafield tag="041" ind1="0" ind2=" "><subfield code="a">eng</subfield></datafield><datafield tag="049" ind1=" " ind2=" "><subfield code="a">DE-83</subfield><subfield code="a">DE-188</subfield><subfield code="a">DE-11</subfield></datafield><datafield tag="082" ind1="0" ind2=" "><subfield code="a">658.4013</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">CM 3000</subfield><subfield code="0">(DE-625)18945:</subfield><subfield code="2">rvk</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">MR 2700</subfield><subfield code="0">(DE-625)123495:</subfield><subfield code="2">rvk</subfield></datafield><datafield tag="100" ind1="1" ind2=" "><subfield code="a">McDavid, James C.</subfield><subfield code="e">Verfasser</subfield><subfield code="4">aut</subfield></datafield><datafield tag="245" ind1="1" ind2="0"><subfield code="a">Program evaluation & performance measurement</subfield><subfield code="b">an introduction to practice</subfield><subfield code="c">James C. McDavid and Laura R. L. Hawthorn</subfield></datafield><datafield tag="246" ind1="1" ind2="3"><subfield code="a">Program evaluation and performance measurement</subfield></datafield><datafield tag="264" ind1=" " ind2="1"><subfield code="a">Thousand Oaks <<[u.a.]>></subfield><subfield code="b">SAGE Publications</subfield><subfield code="c">2006</subfield></datafield><datafield tag="300" ind1=" " ind2=" "><subfield code="a">XVIII, 477 S.</subfield><subfield code="b">graph. Darst.</subfield></datafield><datafield tag="336" ind1=" " ind2=" "><subfield code="b">txt</subfield><subfield code="2">rdacontent</subfield></datafield><datafield tag="337" ind1=" " ind2=" "><subfield code="b">n</subfield><subfield code="2">rdamedia</subfield></datafield><datafield tag="338" ind1=" " ind2=" "><subfield code="b">nc</subfield><subfield code="2">rdacarrier</subfield></datafield><datafield tag="500" ind1=" " ind2=" "><subfield code="a">Includes bibliographical references and index</subfield></datafield><datafield tag="500" ind1=" " ind2=" "><subfield code="a">Nebentitel: Program evaluation and performance measurement</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Organizational effectiveness</subfield><subfield code="x">Measurement</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Performance</subfield><subfield code="x">Measurement</subfield></datafield><datafield tag="650" ind1=" " ind2="4"><subfield code="a">Project management</subfield><subfield code="x">Evaluation</subfield></datafield><datafield tag="700" ind1="1" ind2=" "><subfield code="a">Hawthorn, Laura R. L.</subfield><subfield code="e">Verfasser</subfield><subfield code="4">aut</subfield></datafield><datafield tag="856" ind1="4" ind2="2"><subfield code="m">HBZ Datenaustausch</subfield><subfield code="q">application/pdf</subfield><subfield code="u">http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=018582726&sequence=000002&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA</subfield><subfield code="3">Inhaltsverzeichnis</subfield></datafield><datafield tag="999" ind1=" " ind2=" "><subfield code="a">oai:aleph.bib-bvb.de:BVB01-018582726</subfield></datafield></record></collection> |
| id | DE-604.BV024609941 |
| illustrated | Illustrated |
| indexdate | 2024-07-09T22:02:58Z |
| institution | BVB |
| isbn | 1412906687 |
| language | English |
| oai_aleph_id | oai:aleph.bib-bvb.de:BVB01-018582726 |
| oclc_num | 835592424 |
| open_access_boolean | |
| owner | DE-83 DE-188 DE-11 |
| owner_facet | DE-83 DE-188 DE-11 |
| physical | XVIII, 477 S. graph. Darst. |
| publishDate | 2006 |
| publishDateSearch | 2006 |
| publishDateSort | 2006 |
| publisher | SAGE Publications |
| record_format | marc |
| spelling | McDavid, James C. Verfasser aut Program evaluation & performance measurement an introduction to practice James C. McDavid and Laura R. L. Hawthorn Program evaluation and performance measurement Thousand Oaks <<[u.a.]>> SAGE Publications 2006 XVIII, 477 S. graph. Darst. txt rdacontent n rdamedia nc rdacarrier Includes bibliographical references and index Nebentitel: Program evaluation and performance measurement Organizational effectiveness Measurement Performance Measurement Project management Evaluation Hawthorn, Laura R. L. Verfasser aut HBZ Datenaustausch application/pdf http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=018582726&sequence=000002&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA Inhaltsverzeichnis |
| spellingShingle | McDavid, James C. Hawthorn, Laura R. L. Program evaluation & performance measurement an introduction to practice Organizational effectiveness Measurement Performance Measurement Project management Evaluation |
| title | Program evaluation & performance measurement an introduction to practice |
| title_alt | Program evaluation and performance measurement |
| title_auth | Program evaluation & performance measurement an introduction to practice |
| title_exact_search | Program evaluation & performance measurement an introduction to practice |
| title_full | Program evaluation & performance measurement an introduction to practice James C. McDavid and Laura R. L. Hawthorn |
| title_fullStr | Program evaluation & performance measurement an introduction to practice James C. McDavid and Laura R. L. Hawthorn |
| title_full_unstemmed | Program evaluation & performance measurement an introduction to practice James C. McDavid and Laura R. L. Hawthorn |
| title_short | Program evaluation & performance measurement |
| title_sort | program evaluation performance measurement an introduction to practice |
| title_sub | an introduction to practice |
| topic | Organizational effectiveness Measurement Performance Measurement Project management Evaluation |
| topic_facet | Organizational effectiveness Measurement Performance Measurement Project management Evaluation |
| url | http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=018582726&sequence=000002&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |
| work_keys_str_mv | AT mcdavidjamesc programevaluationperformancemeasurementanintroductiontopractice AT hawthornlaurarl programevaluationperformancemeasurementanintroductiontopractice AT mcdavidjamesc programevaluationandperformancemeasurement AT hawthornlaurarl programevaluationandperformancemeasurement |