Introduction to combinatorial testing:
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Book |
| Language: | English |
| Published: |
Boca Raton, FL [u.a.]
CRC Press
2013
|
| Series: | Chapman & Hall, CRC innovations in software engineering and software development
|
| Subjects: | |
| Online Access: | Inhaltsverzeichnis Klappentext |
| Physical Description: | XXII, 319 S. graph. Darst. |
| ISBN: | 9781466552296 |
Staff View
MARC
| LEADER | 00000nam a2200000 c 4500 | ||
|---|---|---|---|
| 001 | BV041081331 | ||
| 003 | DE-604 | ||
| 005 | 20131125 | ||
| 007 | t | ||
| 008 | 130611s2013 d||| |||| 00||| eng d | ||
| 020 | |a 9781466552296 |9 978-1-4665-5229-6 | ||
| 035 | |a (OCoLC)856800636 | ||
| 035 | |a (DE-599)BVBBV041081331 | ||
| 040 | |a DE-604 |b ger |e rakwb | ||
| 041 | 0 | |a eng | |
| 049 | |a DE-703 |a DE-83 | ||
| 084 | |a ST 233 |0 (DE-625)143620: |2 rvk | ||
| 084 | |a 68N30 |2 msc | ||
| 100 | 1 | |a Kuhn, D. Richard |e Verfasser |4 aut | |
| 245 | 1 | 0 | |a Introduction to combinatorial testing |c D. Richard Kuhn ; Raghu N. Kacker ; Yu Lei |
| 246 | 1 | 3 | |a Combinatorial testing |
| 264 | 1 | |a Boca Raton, FL [u.a.] |b CRC Press |c 2013 | |
| 300 | |a XXII, 319 S. |b graph. Darst. | ||
| 336 | |b txt |2 rdacontent | ||
| 337 | |b n |2 rdamedia | ||
| 338 | |b nc |2 rdacarrier | ||
| 490 | 0 | |a Chapman & Hall, CRC innovations in software engineering and software development | |
| 650 | 0 | 7 | |a Programmverifikation |0 (DE-588)4135576-3 |2 gnd |9 rswk-swf |
| 650 | 0 | 7 | |a Software |0 (DE-588)4055382-6 |2 gnd |9 rswk-swf |
| 689 | 0 | 0 | |a Software |0 (DE-588)4055382-6 |D s |
| 689 | 0 | 1 | |a Programmverifikation |0 (DE-588)4135576-3 |D s |
| 689 | 0 | |5 DE-604 | |
| 700 | 1 | |a Kacker, Raghu N. |e Verfasser |0 (DE-588)1038567750 |4 aut | |
| 700 | 1 | |a Lei, Yu |e Verfasser |0 (DE-588)1011312026 |4 aut | |
| 856 | 4 | 2 | |m Digitalisierung UB Bayreuth - ADAM Catalogue Enrichment |q application/pdf |u http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=026058113&sequence=000003&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA |3 Inhaltsverzeichnis |
| 856 | 4 | 2 | |m Digitalisierung UB Bayreuth - ADAM Catalogue Enrichment |q application/pdf |u http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=026058113&sequence=000004&line_number=0002&func_code=DB_RECORDS&service_type=MEDIA |3 Klappentext |
| 999 | |a oai:aleph.bib-bvb.de:BVB01-026058113 | ||
Record in the Search Index
| _version_ | 1804150452864942080 |
|---|---|
| adam_text | Contents
Preface,
xiii
Authors,
xvii
Note of Appreciation,
xix
Nomenclature,
xxi
Chapter
1 ■
Combinatorial Methods in Testing
_______________1^
1.1
SOFTWARE FAILURES AND THE INTERACTION RULE
1
1.2
TWO FORMS OF COMBINATORIAL TESTING
8
1.2.1
Configuration Testing
9
1.2.2
Input Testing
10
1.3
COVERING ARRAYS
11
1.3.1
Covering Array Definition
12
1.3.2
Size of Covering Arrays
13
1.4
THE TEST ORACLE PROBLEM
15
1.5
QUICK START: HOW TO USE THE BASICS OF
COMBINATORIAL METHODS RIGHT AWAY
16
1.6
CHAPTER SUMMARY
17
REVIEW
18
Chapter
2 ■
Combinatorial Testing Applied
_________________21^
2.1
DOCUMENT OBJECT MODEL
21
Carmelo
Montanez-Rivera, D.
Richard Kuhn, Mary
Brady,
Rick Rjvello, Jenise Reyes Rodriguez, and Michael Powers
2.1.1
Constructing Tests for DOM Events
22
viii
■ Contents
Chapter
7 ■
Measuring Combinatorial Coverage
___________143
7.1
SOFTWARE TEST COVERAGE
144
7.2
COMBINATORIAL COVERAGE
145
7.2.1
Simple t-Way Combination Coverage
146
7.2.2
Simple
(ŕ
+
fc)-Way
147
7.2.3
Tuple Density
148
7.2.4
Variable-Value Configuration Coverage
149
7.3
USING COMBINATORIAL COVERAGE
152
7.4
COST AND PRACTICAL CONSIDERATIONS
156
7.5
ANALYSIS OF
(ř+D-WAY
COVERAGE
160
7.6
CHAPTER SUMMARY
161
REVIEW
161
Chapter
8 ■
Test Suite Prioritization by Combinatorial
____________
Coverage
___________________________________163
Renee
Bryce
and Sreedevi Sampath
8.1
COMBINATORIAL COVERAGE FOR TEST SUITE
PRIORITIZATION
163
8.2
ALGORITHM
166
8.3
PRIORITIZATION CRITERIA
167
8.4
REVIEW OF EMPIRICAL STUDIES
169
8.4.1
Subject Applications
169
8.4.2
Prioritization Criteria
169
8.4.2.1
Test Cases
170
8.4.2.2
Faults
170
8.4.2.3
Evaluation Metric
171
8.4.2.4
Results
171
8.5
TOOL: COMBINATORIAL-BASED PRIORITIZATION
FOR USER-SESSION-BASED TESTING
173
8.5.1
Apache Logging Module
173
8.5.2
Creating a User Session-Based Test Suite from
Usage Logs Using CPUT
173
8.5.3
Prioritizing and Reducing Test Cases
173
Contents ■ ix
8.6
OTHER APPROACHES TO TEST SUITE
PRIORITIZATION USING COMBINATORIAL
INTERACTIONS
174
8.7
COST AND PRACTICAL CONSIDERATIONS
175
8.8
CHAPTER SUMMARY
176
REVIEW
176
Chapter
9 ■
Combinatorial Testing and Random Test
Generation
179
9.1
COVERAGE OF RANDOM TESTS
180
9.2
ADAPTIVE RANDOM TESTING
184
9.3
TRADEOFFS: COVERING ARRAYS AND RANDOM
GENERATION
186
9.4
COST AND PRACTICAL CONSIDERATIONS
189
9.5
CHAPTER SUMMARY
190
REVIEW
191
Chapter
10 ■
Sequence-Covering Arrays
___________________193
10.1
SEQUENCE-COVERING ARRAY DEFINITION
193
10.2
SIZE AND CONSTRUCTION OF SEQUENCE-
COVERING ARRAYS
195
10.2.1
Generalized t-Way Sequence Covering
197
10.2.2
Algorithm Analysis
197
10.3
USING SEQUENCE-COVERING ARRAYS
198
10.4
COST AND PRACTICAL CONSIDERATIONS
199
10.5
CHAPTER SUMMARY
199
REVIEW
202
Chapter 11b Assertion-Based Testing
_____________________203
11.1
BASIC ASSERTIONS FOR TESTING
204
11.2
STRONGER ASSERTION-BASED TESTING
208
11.3
COST AND PRACTICAL CONSIDERATIONS
209
11.4
CHAPTER SUMMARY
210
REVIEW
210
χ
■ Contents
Chapter
12 ■
Model-Based Testing
_______________________213
12.1
OVERVIEW
214
12.2
ACCESS CONTROL SYSTEM EXAMPLE
215
123
SMV MODEL
216
12.4
INTEGRATING COMBINATORIAL TESTS
INTO THE MODEL
218
12.5
GENERATING TESTS FROM COUNTEREXAMPLES
222
12.6
COST AND PRACTICAL CONSIDERATIONS
224
12.7
CHAPTER SUMMARY
225
REVIEW
225
Chapter
13 ■
Fault Localization
__________________________227
13.1
FAULT LOCALIZATION PROCESS
228
13.1.1
Analyzing Combinations
229
13.1.2
New Test Generation
230
13.1.2.1
Alternate Value
230
13.1.2.2
Base Choice
230
13.2
LOCATING FAULTS: EXAMPLE
231
13.2.1
Generating New Tests
234
13.3
COSTÂND
PRACTICAL CONSIDERATIONS
235
13.4
CHAPTER SUMMARY
236
REVIEW
236
Chapter
14 ■
Evolution from Design of Experiments
________237
14.1
BACKGROUND
237
14.2
PAIRWISE (TWO-WAY) TESTING OF SOFTWARE
SYSTEMS
239
14.3
COMBINATORIAL
ŕ-WAY
TESTING OF SOFTWARE
SYSTEMS
245
14.4
CHAPTER SUMMARY
246
Contents ■ xi
Chapter
15 ■
Algorithms for Covering Array Construction
247
LlNBIN YU AND YU LEI
15.1
OVERVIEW
247
15.1.1
Computational Approaches
247
15.1.2
Algebraic Approaches
248
15.2
ALGORITHM AETG
249
15.3
ALGORITHM IPOG
252
15.4
COST AND PRACTICAL CONSIDERATIONS
255
15.4.1
Constraint Handling
255
15.4.2
Mixed-Strength Covering Arrays
256
15.4.3
Extension of an Existing Test Set
257
15.5
CHAPTER SUMMARY
258
REVIEW
258
APPENDIX A: MATHEMATICS REVIEW,
261
A.1 COMBINATORICS
261
A.
1.1
Permutations and Combinations
261
A.
1.2
Orthogonal Arrays
262
A.
1.3
Covering Arrays
263
A.
1.4
Number of Tests Required
264
A.2 REGULAR EXPRESSIONS
265
A.2.1 Expression Operators
265
A.2.2 Combining Operators
266
APPENDIX B: EMPIRICAL DATA ON SOFTWARE FAILURES,
267
APPENDIX C: RESOURCES FOR COMBINATORIAL TESTING,
273
APPENDIX D: TEST TOOLS,
277
D.1 ACTS USER GUIDE
278
xii ■ Contents
D.
1.1.
Core
Features 278
D.
1.1.1 t-Way Test Set Generation 278
D.
1.1.2
Mixed Strength
278
D.
1.1.3
Constraint Support
279
D.I. 1.4
Coverage Verification
279
D.I.2
Command Line Interface
279
D.1.3
lhe
GUI
282
D.
1.3.1
Create New System
284
D.I.3.2
Build Test Set
288
D.l.3.3 Modify System
289
D.
1.3.4
Save/Save as/Open System
291
D.
1.3.5
Import/Export Test Set
291
D.l.3.6 Verify t-Way Coverage
292
REFERENCES,
293
INDEX,
309
Computer Science/Computer
Engineering/Computing
Introduction to Combinatorial Testing
contained tutorial on advanced combinatorial testing methods for real-
world software. The book introduces key concepts and procedures
of combinatorial testing, explains how to use software tools for
generating combinatorial tests, and shows how this approach can be
integrated with existing practice. Detailed explanations and examples
clarify how and why to use various techniques. Sections on cost and
practical considerations describe tradeoffs and limitations that may
impact resources or funding. While the authors introduce some of the
theory and mathematics of combinatorial methods, you can use the
methods without in-depth knowledge of the underlying mathematics.
Features
•
Represents the first in-depth book on practical combinatorial
testing
•
Focuses on real-world software testing, including cost
considerations
•
Presents step-by-step procedures for applying advanced
combinatorial test methods
•
Requires no detailed knowledge of the underlying mathematics
•
Includes review questions and exercises in most chapters
•
Contains an extensive set of references that offer more detail on
each topic
(his book illustrates the practical application of combinatorial
lethods in software testing. Giving pointers to freely available tools
and offering resources on a supplementary website, it encourages
you to apply these methods in your own testing projects.
Tayior
&
Francis Croup
đn
informa
business
ISBN:
6000
Broken Sound Parkway, NW
Suite
300,
Boca Raton, FL
33487
711
Third Avenue
New York, NY
10017
2
Park Square, Milton
Рлгк
Abingdon, Oxon OX
14
4RN, UK
9 781466 552296
90000
|
| any_adam_object | 1 |
| author | Kuhn, D. Richard Kacker, Raghu N. Lei, Yu |
| author_GND | (DE-588)1038567750 (DE-588)1011312026 |
| author_facet | Kuhn, D. Richard Kacker, Raghu N. Lei, Yu |
| author_role | aut aut aut |
| author_sort | Kuhn, D. Richard |
| author_variant | d r k dr drk r n k rn rnk y l yl |
| building | Verbundindex |
| bvnumber | BV041081331 |
| classification_rvk | ST 233 |
| ctrlnum | (OCoLC)856800636 (DE-599)BVBBV041081331 |
| discipline | Informatik |
| format | Book |
| fullrecord | <?xml version="1.0" encoding="UTF-8"?><collection xmlns="http://www.loc.gov/MARC21/slim"><record><leader>01913nam a2200409 c 4500</leader><controlfield tag="001">BV041081331</controlfield><controlfield tag="003">DE-604</controlfield><controlfield tag="005">20131125 </controlfield><controlfield tag="007">t</controlfield><controlfield tag="008">130611s2013 d||| |||| 00||| eng d</controlfield><datafield tag="020" ind1=" " ind2=" "><subfield code="a">9781466552296</subfield><subfield code="9">978-1-4665-5229-6</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(OCoLC)856800636</subfield></datafield><datafield tag="035" ind1=" " ind2=" "><subfield code="a">(DE-599)BVBBV041081331</subfield></datafield><datafield tag="040" ind1=" " ind2=" "><subfield code="a">DE-604</subfield><subfield code="b">ger</subfield><subfield code="e">rakwb</subfield></datafield><datafield tag="041" ind1="0" ind2=" "><subfield code="a">eng</subfield></datafield><datafield tag="049" ind1=" " ind2=" "><subfield code="a">DE-703</subfield><subfield code="a">DE-83</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">ST 233</subfield><subfield code="0">(DE-625)143620:</subfield><subfield code="2">rvk</subfield></datafield><datafield tag="084" ind1=" " ind2=" "><subfield code="a">68N30</subfield><subfield code="2">msc</subfield></datafield><datafield tag="100" ind1="1" ind2=" "><subfield code="a">Kuhn, D. Richard</subfield><subfield code="e">Verfasser</subfield><subfield code="4">aut</subfield></datafield><datafield tag="245" ind1="1" ind2="0"><subfield code="a">Introduction to combinatorial testing</subfield><subfield code="c">D. Richard Kuhn ; Raghu N. Kacker ; Yu Lei</subfield></datafield><datafield tag="246" ind1="1" ind2="3"><subfield code="a">Combinatorial testing</subfield></datafield><datafield tag="264" ind1=" " ind2="1"><subfield code="a">Boca Raton, FL [u.a.]</subfield><subfield code="b">CRC Press</subfield><subfield code="c">2013</subfield></datafield><datafield tag="300" ind1=" " ind2=" "><subfield code="a">XXII, 319 S.</subfield><subfield code="b">graph. Darst.</subfield></datafield><datafield tag="336" ind1=" " ind2=" "><subfield code="b">txt</subfield><subfield code="2">rdacontent</subfield></datafield><datafield tag="337" ind1=" " ind2=" "><subfield code="b">n</subfield><subfield code="2">rdamedia</subfield></datafield><datafield tag="338" ind1=" " ind2=" "><subfield code="b">nc</subfield><subfield code="2">rdacarrier</subfield></datafield><datafield tag="490" ind1="0" ind2=" "><subfield code="a">Chapman & Hall, CRC innovations in software engineering and software development</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Programmverifikation</subfield><subfield code="0">(DE-588)4135576-3</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="650" ind1="0" ind2="7"><subfield code="a">Software</subfield><subfield code="0">(DE-588)4055382-6</subfield><subfield code="2">gnd</subfield><subfield code="9">rswk-swf</subfield></datafield><datafield tag="689" ind1="0" ind2="0"><subfield code="a">Software</subfield><subfield code="0">(DE-588)4055382-6</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="0" ind2="1"><subfield code="a">Programmverifikation</subfield><subfield code="0">(DE-588)4135576-3</subfield><subfield code="D">s</subfield></datafield><datafield tag="689" ind1="0" ind2=" "><subfield code="5">DE-604</subfield></datafield><datafield tag="700" ind1="1" ind2=" "><subfield code="a">Kacker, Raghu N.</subfield><subfield code="e">Verfasser</subfield><subfield code="0">(DE-588)1038567750</subfield><subfield code="4">aut</subfield></datafield><datafield tag="700" ind1="1" ind2=" "><subfield code="a">Lei, Yu</subfield><subfield code="e">Verfasser</subfield><subfield code="0">(DE-588)1011312026</subfield><subfield code="4">aut</subfield></datafield><datafield tag="856" ind1="4" ind2="2"><subfield code="m">Digitalisierung UB Bayreuth - ADAM Catalogue Enrichment</subfield><subfield code="q">application/pdf</subfield><subfield code="u">http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=026058113&sequence=000003&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA</subfield><subfield code="3">Inhaltsverzeichnis</subfield></datafield><datafield tag="856" ind1="4" ind2="2"><subfield code="m">Digitalisierung UB Bayreuth - ADAM Catalogue Enrichment</subfield><subfield code="q">application/pdf</subfield><subfield code="u">http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=026058113&sequence=000004&line_number=0002&func_code=DB_RECORDS&service_type=MEDIA</subfield><subfield code="3">Klappentext</subfield></datafield><datafield tag="999" ind1=" " ind2=" "><subfield code="a">oai:aleph.bib-bvb.de:BVB01-026058113</subfield></datafield></record></collection> |
| id | DE-604.BV041081331 |
| illustrated | Illustrated |
| indexdate | 2024-07-10T00:39:09Z |
| institution | BVB |
| isbn | 9781466552296 |
| language | English |
| oai_aleph_id | oai:aleph.bib-bvb.de:BVB01-026058113 |
| oclc_num | 856800636 |
| open_access_boolean | |
| owner | DE-703 DE-83 |
| owner_facet | DE-703 DE-83 |
| physical | XXII, 319 S. graph. Darst. |
| publishDate | 2013 |
| publishDateSearch | 2013 |
| publishDateSort | 2013 |
| publisher | CRC Press |
| record_format | marc |
| series2 | Chapman & Hall, CRC innovations in software engineering and software development |
| spelling | Kuhn, D. Richard Verfasser aut Introduction to combinatorial testing D. Richard Kuhn ; Raghu N. Kacker ; Yu Lei Combinatorial testing Boca Raton, FL [u.a.] CRC Press 2013 XXII, 319 S. graph. Darst. txt rdacontent n rdamedia nc rdacarrier Chapman & Hall, CRC innovations in software engineering and software development Programmverifikation (DE-588)4135576-3 gnd rswk-swf Software (DE-588)4055382-6 gnd rswk-swf Software (DE-588)4055382-6 s Programmverifikation (DE-588)4135576-3 s DE-604 Kacker, Raghu N. Verfasser (DE-588)1038567750 aut Lei, Yu Verfasser (DE-588)1011312026 aut Digitalisierung UB Bayreuth - ADAM Catalogue Enrichment application/pdf http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=026058113&sequence=000003&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA Inhaltsverzeichnis Digitalisierung UB Bayreuth - ADAM Catalogue Enrichment application/pdf http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=026058113&sequence=000004&line_number=0002&func_code=DB_RECORDS&service_type=MEDIA Klappentext |
| spellingShingle | Kuhn, D. Richard Kacker, Raghu N. Lei, Yu Introduction to combinatorial testing Programmverifikation (DE-588)4135576-3 gnd Software (DE-588)4055382-6 gnd |
| subject_GND | (DE-588)4135576-3 (DE-588)4055382-6 |
| title | Introduction to combinatorial testing |
| title_alt | Combinatorial testing |
| title_auth | Introduction to combinatorial testing |
| title_exact_search | Introduction to combinatorial testing |
| title_full | Introduction to combinatorial testing D. Richard Kuhn ; Raghu N. Kacker ; Yu Lei |
| title_fullStr | Introduction to combinatorial testing D. Richard Kuhn ; Raghu N. Kacker ; Yu Lei |
| title_full_unstemmed | Introduction to combinatorial testing D. Richard Kuhn ; Raghu N. Kacker ; Yu Lei |
| title_short | Introduction to combinatorial testing |
| title_sort | introduction to combinatorial testing |
| topic | Programmverifikation (DE-588)4135576-3 gnd Software (DE-588)4055382-6 gnd |
| topic_facet | Programmverifikation Software |
| url | http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=026058113&sequence=000003&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&local_base=BVB01&doc_number=026058113&sequence=000004&line_number=0002&func_code=DB_RECORDS&service_type=MEDIA |
| work_keys_str_mv | AT kuhndrichard introductiontocombinatorialtesting AT kackerraghun introductiontocombinatorialtesting AT leiyu introductiontocombinatorialtesting AT kuhndrichard combinatorialtesting AT kackerraghun combinatorialtesting AT leiyu combinatorialtesting |