Tsai / Qi Combinatorial Testing in Cloud Computing

1. Auflage 2017
ISBN: 978-981-10-4481-6
Verlag: Springer Nature Singapore
Format: PDF
Kopierschutz: 1 - PDF Watermark

E-Book, Englisch, 134 Seiten

Reihe: SpringerBriefs in Computer Science

This book introduces readers to an advanced combinatorial testing approach and its application in the cloud environment. Based on test algebra and fault location analysis, the proposed combinatorial testing method can support experiments with 250 components (with 2 * (250) combinations), and can detect the fault location based on the testing results. This function can efficiently decrease the size of candidate testing sets and therefore increase testing efficiency. The proposed solution's effectiveness in the cloud environment is demonstrated using a range of experiments.

Wei-Tek Tsai is currently a professor at both the School of Computing Informatics and Decision Systems Engineering at Arizona State University, USA and the School of Computer Science and Engineering at Beihang University, China. He received his PhD and MS in Computer Science from the University of California at Berkeley, and his BS in Computer Science and engineering from MIT. He has produced over 400 papers in various journals and conferences, received two Best Paper awards, and awarded several Guest Professorships. His work has been supported by the US Department of Defense, Department of Education, National Science Foundation, the EU, and industrial companies such as Intel, Fujitsu and Guidant. In the last ten years, he has focused his energies on service-oriented computing and SaaS, as well as various aspects of software engineering including blockchain, architecture, testing, and maintenance.
Guanqiu Qi received his PhD in Computer Science from Arizona State University in 2014. His research interests span many aspects of software engineering, such as SaaS (Software-as-a-Service), TaaS (Testing-as-a-Service), Big Data Testing, Combinatorial Testing, and Service-Oriented Computing, as well as blockchain.

Autoren/Hrsg.

Tsai, Wei-Tek

Qi, Guanqiu

Inhaltsverzeichnis

1;Preface;6
2;Contents;8
3;1 Introduction;12
3.1;1.1 Software Testing;12
3.2;1.2 Cloud Testing;13
3.3;1.3 Combinatorial Designs;14
3.3.1;1.3.1 Latin Square;14
3.3.2;1.3.2 Orthogonal Array;14
3.3.3;1.3.3 Covering Array;15
3.4;1.4 Combinatorial Testing;16
3.4.1;1.4.1 Covering Array for Testing;17
3.4.2;1.4.2 Automatic Efficient Test Generator;17
3.4.3;1.4.3 In-Parameter-Order;19
3.4.4;1.4.4 Genetic Algorithm;19
3.4.5;1.4.5 Backtracking Algorithm;20
3.4.6;1.4.6 Fault Detection;20
3.5;1.5 Structure of This Book;21
3.6;References;22
4;2 Combinatorial Testing in Cloud Computing;25
4.1;2.1 Combinatorial Testing in Cloud Computing;25
4.2;2.2 Improvements of Combinatorial Testing in Cloud Environment;26
4.3;2.3 Faulty Location Analysis in Combinatorial Testing;27
4.3.1;2.3.1 Fault Localization Based on Failure-Inducing Combinations;27
4.3.2;2.3.2 Identifying Failure-Inducing Combinations in a Combinatorial Test Set;28
4.3.3;2.3.3 Faulty Interaction Identification via Constraint Solving and Optimization;29
4.3.4;2.3.4 Characterizing Failure-Causing Parameter Interactions by Adaptive Testing;30
4.3.5;2.3.5 Comparisons of Existing Faulty Location Analysis Solutions;32
4.4;2.4 Related Work;32
4.5;References;33
5;3 Adaptive Fault Detection In Multi-tenancy Saas Systems;34
5.1;3.1 Adaptive Testing Framework;34
5.1.1;3.1.1 Learning from Earlier Test Results;34
5.1.2;3.1.2 AR Algorithm Framework;37
5.1.3;3.1.3 Relationship Between Faults, Final-Faults, and Candidate-Faults;38
5.2;3.2 Simulation of AR Algorithm;38
5.3;3.3 Incremental Testing to Allow New Components;41
5.4;References;45
6;4 Test Algebra for Concurrent Combinatorial Testing;46
6.1;4.1 Test Algebra;46
6.1.1;4.1.1 Learning from Previous Test Results;47
6.1.2;4.1.2 Changing Test Result Status;49
6.1.3;4.1.3 Matrix Representation;49
6.1.4;4.1.4 Relationship Between Configuration and Its Interactions;51
6.1.5;4.1.5 Merging Concurrent Testing Results;52
6.1.6;4.1.6 Distributive Rule;54
6.1.7;4.1.7 Incremental Development;54
6.2;4.2 Conclusion;55
6.3;A Commutativity of otimes;46
6.3.1;B Associativity of otimes;55
6.3.2;C Commutativity of oplus;56
6.3.3;D Associativity of oplus;57
6.3.4;E Distributivity of otimes Over oplus;59
6.3.5;Reference;61
7;5 Concurrent Test Algebra Execution with Combinatorial Testing;62
7.1;5.1 TA Analysis Framework;62
7.1.1;5.1.1 The Role of N in Concurrent Combinatorial Testing;67
7.1.2;5.1.2 Modified Testing Process;67
7.2;5.2 TA Analysis Algorithm;68
7.3;5.3 TA Analysis Process and Related Considerations;69
7.3.1;5.3.1 Analysis Process;69
7.3.2;5.3.2 Adjustment in Analyzing;70
7.4;5.4 Test Database Design;71
7.4.1;5.4.1 X and F Table Design;71
7.4.2;5.4.2 P Table Design;71
7.4.3;5.4.3 N and U Table Design;72
7.5;5.5 Experiment;72
7.6;5.6 Conclusion;76
7.7;References;76
8;6 Test Algebra Execution in a Cloud Environment;77
8.1;6.1 TA Concurrent Execution and Analysis;77
8.1.1;6.1.1 TA Concurrent Execution;77
8.1.2;6.1.2 NU Configuration;79
8.1.3;6.1.3 NU Configuration Selection Algorithms;80
8.1.4;6.1.4 Analysis Process of NU and U Configurations;82
8.2;6.2 TA Experiments;84
8.2.1;6.2.1 TA MapReduce Experiment Flowchart;84
8.2.2;6.2.2 Different Configuration Numbers of TA Experiments;84
8.2.3;6.2.3 Different Speedup Strategy for TA Experiments;84
8.2.4;6.2.4 Different Fault Rates for TA Experiments;85
8.2.5;6.2.5 Explanation on Simulated Data;87
8.2.6;6.2.6 Simulation with Different Clusters;87
8.2.7;6.2.7 Simulation using 37-node Cluster with Different Map Slots;87
8.3;6.3 Conclusion;89
8.4;Reference;90
9;7 Adaptive Reasoning Algorithm with Automated Test Cases Generation and Test Algebra in Saas System;91
9.1;7.1 Experimentation Using a MTA SaaS Sample;91
9.2;7.2 SaaS Testing;94
9.3;7.3 SaaS Test Case Generation;96
9.4;7.4 Simulation and Analysis;100
9.4.1;7.4.1 Simulation of ARP Algorithm;100
9.4.2;7.4.2 Incremental Testing with Automatic Test Generation;102
9.4.3;7.4.3 Simulation Experiments of ARP+PTR;103
9.4.4;7.4.4 Analysis of the Strategy on Test Generation;104
9.4.5;7.4.5 TA Simulation in SaaS;107
9.5;References;107
10;8 TaaS Design for Combinatorial Testing;108
10.1;8.1 TaaS Introduction;108
10.2;8.2 TaaS Design with TA and AR;109
10.3;8.3 TaaS as SaaS;112
10.3.1;8.3.1 GUIs;114
10.3.2;8.3.2 Workflows;114
10.3.3;8.3.3 Services;115
10.3.4;8.3.4 Runtime Composition, Execution and Scalability;115
10.4;8.4 Experimental Results;117
10.5;8.5 Conclusion;119
10.6;References;119
11;9 Integrated Taas with Fault Detection and Test Algebra;121
11.1;9.1 Framework;121
11.1.1;9.1.1 Integrated Process;121
11.1.2;9.1.2 Framework Illustration;122
11.2;9.2 Experiments and Results;125
11.2.1;9.2.1 Experiment Setup;125
11.2.2;9.2.2 Experiment Results;129
11.2.3;9.2.3 Measurements;129
11.3;9.3 Conclusion;133
11.4;References;134