Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2022 May 17;17(5):e0264972.
doi: 10.1371/journal.pone.0264972. eCollection 2022.

Value-based cost-cognizant test case prioritization for regression testing

Farrukh Shahzad Ahmed  1 , Awais Majeed  1 , Tamim Ahmed Khan  1 , Shahid Nazir Bhatti  2
Affiliations

Value-based cost-cognizant test case prioritization for regression testing

Farrukh Shahzad Ahmed et al. PLoS One. .

Abstract

Software Test Case Prioritization (TCP) is an effective approach for regression testing to tackle time and budget constraints. The major benefit of TCP is to save time through the prioritization of important test cases first. Existing TCP techniques can be categorized as value-neutral and value-based approaches. In a value-based fashion, the cost of test cases and severity of faults are considered whereas, in a value-neutral fashion these are not considered. The value-neutral fashion is dominant over value-based fashion, and it assumes that all test cases have equal cost and all software faults have equal severity. But this assumption rarely holds in practice. Therefore, value-neutral TCP techniques are prone to produce unsatisfactory results. To overcome this research gap, a paradigm shift is required from value-neutral to value-based TCP techniques. Currently, very limited work is done in a value-based fashion and to the best of the authors' knowledge, no comprehensive review of value-based cost-cognizant TCP techniques is available in the literature. To address this problem, a systematic literature review (SLR) of value-based cost-cognizant TCP techniques is presented in this paper. The core objective of this study is to combine the overall knowledge related to value-based cost-cognizant TCP techniques and to highlight some open research problems of this domain. Initially, 165 papers were reviewed from the prominent research repositories. Among these 165 papers, 21 papers were selected by using defined inclusion/exclusion criteria and quality assessment procedures. The established questions are answered through a thorough analysis of the selected papers by comparing their research contributions in terms of the algorithm used, the performance evaluation metric, and the results validation method used. Total 12 papers used an algorithm for their technique but 9 papers didn't use any algorithm. Particle Swarm Optimization (PSO) Algorithm is dominantly used. For results validation, 4 methods are used including, Empirical study, Experiment, Case study, and Industrial case study. The experiment method is dominantly used. Total 6 performance evaluation metrics are used and the APFDc metric is dominantly used. This SLR yields that value-orientation and cost cognition are vital in the TCP process to achieve its intended goals and there is great research potential in this research domain.

PubMed Disclaimer

Conflict of interest statement

The authors have declared that no competing interests exist.

Figures

Fig 1
Fig 1. Regression testing approaches.
Fig 2
Fig 2. Review protocol phases.
Fig 3
Fig 3. PRISMA flow diagram for search process and selection procedure.
Fig 4
Fig 4. Distribution of studies according to the algorithm used.
Fig 5
Fig 5. Distribution of studies according to results validation method used.
Fig 6
Fig 6. Test case prioritization process.
Fig 7
Fig 7. The objectives of test case prioritization.
Fig 8
Fig 8. Enhanced taxonomy of test case prioritization.
See this image and copyright information in PMC

References

    1. Faulk S. R., Harmon R. R., and Raffo D. M. “Value-Based Software Engineering (VBSE),” in Software Product Lines, Donohoe P., Ed. Boston, MA: Springer US, 2000, pp. 205–223.
    1. D. Zhang. “Machine Learning in Value-Based Software Test Data Generation,” in 2006 18th IEEE International Conference on Tools with Artificial Intelligence (ICTAI’06), Nov. 2006, pp. 732–736.
    1. Boehm B. W. “Value-Based Software Engineering: Overview and Agenda,” in Value-Based Software Engineering, Biffl S., Aurum A., Boehm B., Erdogmus H., and Grünbacher P., Eds. Berlin, Heidelberg: Springer Berlin Heidelberg, 2006, pp. 3–14.
    1. Dingsøyr T. and Lassenius C. “Emerging themes in agile software development: Introduction to the special section on continuous value delivery,” Inf. Softw. Technol., vol. 77, pp. 56–60, 2016.
    1. “On the Economics of Requirements-Based Test Case…—Google Scholar.” https://scholar.google.com.pk/scholar?hl=en&as_sdt=0%2C5&q=On+the+Econom... (accessed Sep. 16, 2018).

Publication types