Quantifying the user experience: practical statistics for user research
Gespeichert in:
| Hauptverfasser: | , |
|---|---|
| Format: | Buch |
| Sprache: | English |
| Veröffentlicht: |
Amsterdam [u.a.]
Elsevier/Morgan Kaufmann
2012
|
| Schlagworte: | |
| Online-Zugang: | Inhaltsverzeichnis |
| Beschreibung: | XV, 295 S. Ill., graph. Darst. |
| ISBN: | 9780123849687 |
Internformat
MARC
| LEADER | 00000nam a2200000 c 4500 | ||
|---|---|---|---|
| 001 | BV039996275 | ||
| 003 | DE-604 | ||
| 005 | 20160727 | ||
| 007 | t | ||
| 008 | 120402s2012 ad|| |||| 00||| eng d | ||
| 020 | |a 9780123849687 |9 978-0-12-384968-7 | ||
| 035 | |a (OCoLC)796190462 | ||
| 035 | |a (DE-599)BVBBV039996275 | ||
| 040 | |a DE-604 |b ger |e rakwb | ||
| 041 | 0 | |a eng | |
| 049 | |a DE-20 |a DE-355 |a DE-91G |a DE-11 |a DE-824 |a DE-473 |a DE-Aug4 |a DE-83 | ||
| 082 | 0 | |a 004.019 |2 23 | |
| 084 | |a SK 850 |0 (DE-625)143263: |2 rvk | ||
| 084 | |a ST 278 |0 (DE-625)143644: |2 rvk | ||
| 084 | |a SOZ 720f |2 stub | ||
| 084 | |a DAT 610f |2 stub | ||
| 100 | 1 | |a Sauro, Jeff |e Verfasser |0 (DE-588)1022650173 |4 aut | |
| 245 | 1 | 0 | |a Quantifying the user experience |b practical statistics for user research |c Jeff Sauro ; James R. Lewis |
| 264 | 1 | |a Amsterdam [u.a.] |b Elsevier/Morgan Kaufmann |c 2012 | |
| 300 | |a XV, 295 S. |b Ill., graph. Darst. | ||
| 336 | |b txt |2 rdacontent | ||
| 337 | |b n |2 rdamedia | ||
| 338 | |b nc |2 rdacarrier | ||
| 650 | 0 | 7 | |a Statistik |0 (DE-588)4056995-0 |2 gnd |9 rswk-swf |
| 650 | 0 | 7 | |a Benutzerfreundlichkeit |0 (DE-588)4005541-3 |2 gnd |9 rswk-swf |
| 689 | 0 | 0 | |a Benutzerfreundlichkeit |0 (DE-588)4005541-3 |D s |
| 689 | 0 | 1 | |a Statistik |0 (DE-588)4056995-0 |D s |
| 689 | 0 | |5 DE-604 | |
| 700 | 1 | |a Lewis, James R. |d 1953- |e Verfasser |0 (DE-588)133616134 |4 aut | |
| 856 | 4 | 2 | |m Digitalisierung UB Bamberg |q application/pdf |u http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=024853308&sequence=000004&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |3 Inhaltsverzeichnis |
| 999 | |a oai:aleph.bib-bvb.de:BVB01-024853308 | ||
Datensatz im Suchindex
| _version_ | 1804148993353056257 |
|---|---|
| adam_text | Contents
Acknowledgments
............................................................................xiii
About the Authors
.............................................................................xv
CHAPTER
1
Introduction and How to Use This Book
.......................................1
Introduction
....................................................................1
The Organization of This Book
.................................................1
How to Use This Book
.........................................................2
What Test Should I Use?
...................................................2
What Sample Size Do I Need?
.............................................6
You Don t Have to Do the Computations by Hand
..........................7
Key Points from the Chapter
....................................................7
Reference
......................................................................8
CHAPTER
2
Quantifying User Research
...................................................9
What is User Research?
.........................................................9
Data from User Research
.......................................................9
Usability Testing
...............................................................9
Sample Sizes
.............................................................10
Representativeness and Randomness
.......................................10
Data Collection
...........................................................12
Completion Rates
.........................................................12
Usability Problems
........................................................13
Task Time
................................................................14
Errors
....................................................................14
Satisfaction Ratings
.......................................................14
Combined Scores
.........................................................14
A/B Testing
...................................................................15
Clicks, Page Views, and Conversion Rates
.................................15
Survey Data
...................................................................15
Rating Scales
.............................................................15
Net Promoter Scores
......................................................16
Comments and Open-ended Data
..........................................16
Requirements Gathering
.......................................................16
Key Points from the Chapter
...................................................17
References
....................................................................17
VII
viii Contents
CHAPTER
3
How Precise Are Our Estimates? Confidence Intervals
........................19
Introduction
...................................................................
19
Confidence Interval
=
Twice the Margin of Error
..........................
I9
Confidence Intervals Provide Precision and Location
.......................19
Three Components of a Confidence Interval
...............................20
Confidence Interval for a Completion Rate
.....................................20
Confidence Interval History
...............................................21
Wald
Interval: Terribly Inaccurate for Small Samples
......................21
Exact Confidence Interval
.................................................22
Adjusted-Wald Interval: Add Two Successes and Two Failures
.............22
Best Point Estimates for a Completion Rate
................................24
Confidence Interval for a Problem Occurrence
.............................26
Confidence Interval for Rating Scales and Other Continuous Data
..............26
Confidence Interval for Task-time Data
....................................29
Mean or Median Task Time?
..............................................
30
Geometric Mean
..........................................................31
Confidence Interval for Large Sample Task Times
.........................33
Confidence Interval Around a Median
.....................................33
Key Points from the Chapter
...................................................36
References
....................................................................3°
CHAPTER
4
Did We Meet or Exceed Our Goal?
..........................................
41
Introduction
...................................................................
^*
One-Tailed and Two-Tailed Tests
..............................................
^
Comparing a Completion Rate to a Benchmark
.................................
^
Small-Sample Test
...............................,........................45
Large-Sample Test
........................................................
49
Comparing a Satisfaction Score to a Benchmark
................................*
Do at Least
75%
Agree? Converting Continuous Ratings to Discrete
.......52
Comparing a Task Time to a Benchmark
.......................................^4
Key Points from the Chapter
...................................................
5^
References
....................................................................62
CHAPTERS Is There a Statistical Difference between Designs?
...........................
63
Introduction
...................................................................63
Comparing Two Means (Rating Scales and Task Times)
........................
63
Wimin-subjeets Comparison (Paired
ř-test)
.................................63
Comparing Task Times
...................................................66
Between-subjects Comparison (Two-sample f-test)
.........................68
Assumptions of the /-tests
................................................. 73
Contents ix
Comparing Completion Rates, Conversion Rates, and A/B Testing
................74
Between-subjects
..........................................................75
Within-subjects
...........................................................84
Key Points from the Chapter
...................................................93
References
...................................................................102
CHAPTER
6
What Sample Sizes Do We Need? Part
1 :
Summative Studies
................105
Introduction
..................................................................105
Why Do We Care?
......................................................105
The Type of Usability Study Matters
.....................................105
Basic Principles of Summative Sample Size Estimation
...................106
Estimating Values
............................................................108
Comparing Values
...........................................................114
What can I Do to Control Variability?
........................................120
Sample Size Estimation for Binomial Confidence Intervals
....................121
Binomial Sample Size Estimation for Large Samples
......................121
Binomial Sample Size Estimation for Small Samples
......................123
Sample Size for Comparison with a Benchmark Proportion
................125
Sample Size Estimation for Chi-Square Tests
(Independent Proportions)
....................................................128
Sample Size Estimation for McNemar Exact Tests
(Matched Proportions)
........................................................131
Key Points from the Chapter
.................................................135
References
...................................................................141
CHAPTER
7
What Sample Sizes Do We Need? Part
2:
Formative Studies
.................143
Introduction
..................................................................143
Using a Probabilistic Model of Problem Discovery to Estimate
Sample Sizes for Formative User Research
....................................143
The Famous Equation: P{x
і
1)= 1 - (1
-ρ) .............................
143
Deriving a Sample Size Estimation Equation from
1 - (1
-p)
............145
Using the Tables to Plan Sample Sizes for Formative User Research
......146
Assumptions of the Binomial Probability Model
...............................148
Additional Applications of the Model
.........................................149
Estimating the Composite Value of
ρ
for Multiple Problems
or Other Events
..........................................................149
Adjusting Small Sample Composite Estimates of
ρ
........................149
Estimating the Number of Problems Available for Discovery and the
Number of Undiscovered Problems
.......................................155
What affects the Value of pi
.................................................157
Contents
What is a Reasonable Problem Discovery Goal?
..............................157
Reconciling the Magic Number
5
with Eight is not Enough
...............160
Some History: The
1980s................................................160
Some More History: The
1990s..........................................161
The Derivation of the Magic Number
5 ................................162
Eight Is Not Enough: A Reconciliation
...................................164
More About the Binomial Probability Formula and its Small
Sample Adjustment
..........................................................167
Origin of the Binomial Probability Formula
...............................167
How does the Deflation Adjustment Work?
...............................169
Other Statistical Models for Problem Discovery
...............................172
Criticisms of the Binomial Model for Problem Discovery
.................172
Expanded Binomial Models
..............................................173
Capture-recapture Models
................................................174
Why Not Use One of These Other Models When Planning Formative
User Research?
............................................................174
Key Points from the Chapter
.................................................178
References
...................................................................181
CHAPTER
8
Standardized Usability Questionnaires
......................................185
Introduction
..................................................................185
What is a Standardized Questionnaire?
...................................185
Advantages of Standardized Usability Questionnaires
.....................185
What Standardized Usability Questionnaires Are Available?
...............186
Assessing the Quality of Standardized Questionnaires:
Reliability, Validity, and Sensitivity
......................................187
Number of Scale Steps
...................................................187
Poststudy Questionnaires
.....................................................188
QUIS
(Questionnaire for User Interaction Satisfaction)
....................188
SUMI
(Software Usability Measurement Inventory)
.......................190
PSSUQ (Post-study System Usability Questionnaire)
......................192
SUS
(Software Usability Scale)
..........................................198
Experimental Comparison of Poststudy Usability Questionnaires
...........210
Post-Task Questionnaires
.....................................................212
ASQ (After-scenario Questionnaire)
......................................213
SEQ (Single Ease Question)
..............................................214
SMEQ (Subjective Mental Effort Question)
...............................214
ER
(Expectation Ratings)
................................................215
UME
(Usability Magnitude Estimation)
...................................217
Experimental Comparisons of Post-task Questionnaires
....................219
Contents xi
Questionnaires
for Assessing Perceived Usability of Websites
.................221
WAMMI (Website Analysis and Measurement Inventory)
.................222
SUPR-Q (Standardized Universal Percentile Rank Questionnaire)
..........223
Other Questionnaires for Assessing Websites
.............................224
Other Questionnaires of Interest
..............................................225
CSUQ (Computer System Usability Questionnaire)
.......................225
USE (Usefulness, Satisfaction, and Ease of Use)
..........................227
UMUX (Usability Metric for User Experience)
...........................227
HQ (Hedonic Quality)
...................................................228
ACSI (American Customer Satisfaction Index)
............................229
NPS (Net Promoter Score)
...............................................229
CxPi (Forrester Customer Experience Index)
..............................230
ТАМ
(Technology Acceptance Model)
...................................231
Key Points from the Chapter
.................................................232
References
...................................................................236
CHAPTER
9
Six Enduring Controversies in Measurement and Statistics
...................241
Introduction
..................................................................241
Is it Okay to Average Data from Multipoint Scales?
...........................242
On One Hand
...........................................................242
On the Other Hand
......................................................243
Our Recommendation
....................................................245
Do you Need to Test at Least
30
Users?
......................................246
On One Hand
...........................................................246
On the Other Hand
......................................................247
Our Recommendation
....................................................248
Should you Always Conduct a Two-Tailed Test?
..............................248
On One Hand
...........................................................248
On the Other Hand
......................................................250
Our Recommendation
....................................................250
Can you Reject the Null Hypothesis when
ρ
> 0.05?..........................251
On One Hand
...........................................................251
On the Other Hand
......................................................251
Our Recommendation
....................................................253
Can you Combine Usability Metrics into Single Scores?
.......................254
On One Hand
...........................................................254
On the Other Hand
......................................................255
Our Recommendation
....................................................256
What if you Need to Run more man One Test?
...............................256
On One Hand
...........................................................256
xii Contents
On the Other Hand
......................................................258
Our Recommendation
....................................................258
Key Points from the Chapter
.................................................262
References
...................................................................266
CHAPTER
10
Wrapping Up
.............................................................269
Introduction
..................................................................269
Getting More Information
....................................................269
Good Luck!
..................................................................272
Key Points from the Chapter
.................................................272
References
...................................................................272
Appendix: A Crash Course in Fundamental Statistical Concepts
.............................273
Introduction
..................................................................273
Types of Data
................................................................273
Populations and Samples
.....................................................274
Sampling
................................................................274
Measuring Central Tendency
.................................................274
Mean
....................................................................274
Median
..................................................................275
Geometric Mean
.........................................................275
Standard Deviation and Variance
.............................................276
The Normal Distribution
.....................................................276
z-scores
..................................................................278
Area Under the Normal Curve
................................................278
Applying the Normal Curve to User Research Data
...........................280
Central limit Theorem
.......................................................280
Standard
итог
of the Mean
...................................................282
Margin of Error
..............................................................283
r-Distribution
.................................................................283
Significance Testing and p-Values
............................................284
How much do Sample Means Fluctuate?
.................................285
The Logic of Hypothesis Testing
.............................................287
Errors in Statistics
............................................................288
Key Points from the Appendix
...............................................289
Index
....................,...............................................................
29Î
|
| any_adam_object | 1 |
| author | Sauro, Jeff Lewis, James R. 1953- |
| author_GND | (DE-588)1022650173 (DE-588)133616134 |
| author_facet | Sauro, Jeff Lewis, James R. 1953- |
| author_role | aut aut |
| author_sort | Sauro, Jeff |
| author_variant | j s js j r l jr jrl |
| building | Verbundindex |
| bvnumber | BV039996275 |
| classification_rvk | SK 850 ST 278 |
| classification_tum | SOZ 720f DAT 610f |
| ctrlnum | (OCoLC)796190462 (DE-599)BVBBV039996275 |
| dewey-full | 004.019 |
| dewey-hundreds | 000 - Computer science, information, general works |
| dewey-ones | 004 - Computer science |
| dewey-raw | 004.019 |
| dewey-search | 004.019 |
| dewey-sort | 14.019 |
| dewey-tens | 000 - Computer science, information, general works |
| discipline | Informatik Soziologie Mathematik |
| format | Book |
| fullrecord | <?xml version="1.0" encoding="UTF-8"?><collection xmlns="http://www.loc.gov/MARC21/slim"><record><leader>01628nam a2200397 c 4500</leader><controlfield tag="001">BV039996275</controlfield><controlfield tag="003">DE-604</controlfield><controlfield tag="005">20160727 </controlfield><controlfield tag="007">t</controlfield><controlfield tag="008">120402s2012 ad|| |||| 00||| eng d</controlfield><datafield tag="020" ind1=" " ind2=" "><subfield code="a">9780123849687</subfield><subfield code="9">978-0-12-384968-7</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(OCoLC)796190462</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(DE-599)BVBBV039996275</subfield></datafield><datafield tag="040" ind1=" " ind2=" "><subfield code="a">DE-604</subfield><subfield code="b">ger</subfield><subfield code="e">rakwb</subfield></datafield><datafield tag="041" ind1="0" ind2=" "><subfield code="a">eng</subfield></datafield><datafield tag="049" ind1=" " ind2=" "><subfield code="a">DE-20</subfield><subfield code="a">DE-355</subfield><subfield code="a">DE-91G</subfield><subfield code="a">DE-11</subfield><subfield code="a">DE-824</subfield><subfield code="a">DE-473</subfield><subfield code="a">DE-Aug4</subfield><subfield code="a">DE-83</subfield></datafield><datafield tag="082" ind1="0" ind2=" "><subfield code="a">004.019</subfield><subfield code="2">23</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">SK 850</subfield><subfield code="0">(DE-625)143263:</subfield><subfield code="2">rvk</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">ST 278</subfield><subfield code="0">(DE-625)143644:</subfield><subfield code="2">rvk</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">SOZ 720f</subfield><subfield code="2">stub</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">DAT 610f</subfield><subfield code="2">stub</subfield></datafield><datafield tag="100" ind1="1" ind2=" "><subfield code="a">Sauro, Jeff</subfield><subfield code="e">Verfasser</subfield><subfield code="0">(DE-588)1022650173</subfield><subfield code="4">aut</subfield></datafield><datafield tag="245" ind1="1" ind2="0"><subfield code="a">Quantifying the user experience</subfield><subfield code="b">practical statistics for user research</subfield><subfield code="c">Jeff Sauro ; James R. Lewis</subfield></datafield><datafield tag="264" ind1=" " ind2="1"><subfield code="a">Amsterdam [u.a.]</subfield><subfield code="b">Elsevier/Morgan Kaufmann</subfield><subfield code="c">2012</subfield></datafield><datafield tag="300" ind1=" " ind2=" "><subfield code="a">XV, 295 S.</subfield><subfield code="b">Ill., graph. Darst.</subfield></datafield><datafield tag="336" ind1=" " ind2=" "><subfield code="b">txt</subfield><subfield code="2">rdacontent</subfield></datafield><datafield tag="337" ind1=" " ind2=" "><subfield code="b">n</subfield><subfield code="2">rdamedia</subfield></datafield><datafield tag="338" ind1=" " ind2=" "><subfield code="b">nc</subfield><subfield code="2">rdacarrier</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Statistik</subfield><subfield code="0">(DE-588)4056995-0</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Benutzerfreundlichkeit</subfield><subfield code="0">(DE-588)4005541-3</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="689" ind1="0" ind2="0"><subfield code="a">Benutzerfreundlichkeit</subfield><subfield code="0">(DE-588)4005541-3</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="0" ind2="1"><subfield code="a">Statistik</subfield><subfield code="0">(DE-588)4056995-0</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="0" ind2=" "><subfield code="5">DE-604</subfield></datafield><datafield tag="700" ind1="1" ind2=" "><subfield code="a">Lewis, James R.</subfield><subfield code="d">1953-</subfield><subfield code="e">Verfasser</subfield><subfield code="0">(DE-588)133616134</subfield><subfield code="4">aut</subfield></datafield><datafield tag="856" ind1="4" ind2="2"><subfield code="m">Digitalisierung UB Bamberg</subfield><subfield code="q">application/pdf</subfield><subfield code="u">http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=024853308&sequence=000004&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA</subfield><subfield code="3">Inhaltsverzeichnis</subfield></datafield><datafield tag="999" ind1=" " ind2=" "><subfield code="a">oai:aleph.bib-bvb.de:BVB01-024853308</subfield></datafield></record></collection> |
| id | DE-604.BV039996275 |
| illustrated | Illustrated |
| indexdate | 2024-07-10T00:15:52Z |
| institution | BVB |
| isbn | 9780123849687 |
| language | English |
| oai_aleph_id | oai:aleph.bib-bvb.de:BVB01-024853308 |
| oclc_num | 796190462 |
| open_access_boolean | |
| owner | DE-20 DE-355 DE-BY-UBR DE-91G DE-BY-TUM DE-11 DE-824 DE-473 DE-BY-UBG DE-Aug4 DE-83 |
| owner_facet | DE-20 DE-355 DE-BY-UBR DE-91G DE-BY-TUM DE-11 DE-824 DE-473 DE-BY-UBG DE-Aug4 DE-83 |
| physical | XV, 295 S. Ill., graph. Darst. |
| publishDate | 2012 |
| publishDateSearch | 2012 |
| publishDateSort | 2012 |
| publisher | Elsevier/Morgan Kaufmann |
| record_format | marc |
| spelling | Sauro, Jeff Verfasser (DE-588)1022650173 aut Quantifying the user experience practical statistics for user research Jeff Sauro ; James R. Lewis Amsterdam [u.a.] Elsevier/Morgan Kaufmann 2012 XV, 295 S. Ill., graph. Darst. txt rdacontent n rdamedia nc rdacarrier Statistik (DE-588)4056995-0 gnd rswk-swf Benutzerfreundlichkeit (DE-588)4005541-3 gnd rswk-swf Benutzerfreundlichkeit (DE-588)4005541-3 s Statistik (DE-588)4056995-0 s DE-604 Lewis, James R. 1953- Verfasser (DE-588)133616134 aut Digitalisierung UB Bamberg application/pdf http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=024853308&sequence=000004&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA Inhaltsverzeichnis |
| spellingShingle | Sauro, Jeff Lewis, James R. 1953- Quantifying the user experience practical statistics for user research Statistik (DE-588)4056995-0 gnd Benutzerfreundlichkeit (DE-588)4005541-3 gnd |
| subject_GND | (DE-588)4056995-0 (DE-588)4005541-3 |
| title | Quantifying the user experience practical statistics for user research |
| title_auth | Quantifying the user experience practical statistics for user research |
| title_exact_search | Quantifying the user experience practical statistics for user research |
| title_full | Quantifying the user experience practical statistics for user research Jeff Sauro ; James R. Lewis |
| title_fullStr | Quantifying the user experience practical statistics for user research Jeff Sauro ; James R. Lewis |
| title_full_unstemmed | Quantifying the user experience practical statistics for user research Jeff Sauro ; James R. Lewis |
| title_short | Quantifying the user experience |
| title_sort | quantifying the user experience practical statistics for user research |
| title_sub | practical statistics for user research |
| topic | Statistik (DE-588)4056995-0 gnd Benutzerfreundlichkeit (DE-588)4005541-3 gnd |
| topic_facet | Statistik Benutzerfreundlichkeit |
| url | http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=024853308&sequence=000004&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |
| work_keys_str_mv | AT saurojeff quantifyingtheuserexperiencepracticalstatisticsforuserresearch AT lewisjamesr quantifyingtheuserexperiencepracticalstatisticsforuserresearch |