Open Access Open Access  Restricted Access Subscription or Fee Access

Measuring Software Test Execution in Agile Development

Shailesh Misra, Dr. Ajay Rana


Software Testing is the process of executing a program with the intent of finding defects. While it is almost impossible to release software which is completely bug free, the objective of software testing is to achieve high quality within reasonable costs. It is therefore important to explore methods and techniques which can help us achieve better quality by optimizing test techniques while keeping costs under control. One of the challenges in real world software testing projects has been to accurately quantify and track progress of software testing projects. Effective software coverage measurement can ensure better execution of projects with controlled costs and accurate forecasting. This paper evaluates various approaches proposed in current work to measure testability and test coverage. Conventional approaches have included code coverage or test case count as methodologies for test coverage measurement. However, these techniques when implemented in real world projects have shown some shortcomings – either they do not account for scenarios of test coverage which were missed in coding/development or they discount size of a test event considering all events of equal size thereby resulting in skewed test coverage data. In addition, modern agile software development techniques demand ways that are easily adaptable and require minimal documentation or processing to track this data. This therefore leads to the need to evaluate better ways for test coverage measurement – which are more accurate and less error prone. This paper makes an attempt to address this problem by proposing a methodology which can be implemented in most software projects for effective software test coverage measurement and project planning.



Full Text:



User Defined Coverage – A tool Supported Methodology for Design Verification. Grinwald, R., et al. 1998, IBM Research Lab, pp. 158-163.

A Study on Test Coverage in Software Testing. Shahid1, Muhammad , Ibrahim , Suhaimi and Naz‟ri , Mohd . Singapore : s.n., 2011. 2011 International Conference on Telecommunication Technology and Applications.

Barry, Boehm. Software Engineering Economics. Englewood Cliffs, NJ : Prentice Hall., 1981.

ANSI/IEEE. IEEE Standard Glossary of Software Engineering Terminology, 610. New York : IEEE Press, 1990.

Software testability: the new verification. Voas, Jeffery M and Miller, Keith W. 1995, IEEE software Vol 12, pp. 17-28.

An empirical study into class testability. Bruntink, Magiel and Deursen, Arie van. 2006, Journal of Software Systems, pp. 1219–1232.

Garrett, Thom. Implementing Automated Software Testing - Continuously Track Progress and Adjust Accordingly. [Online] [Cited: May 30, 2012.]

Design for Testability in Object-Oriented Systems. Binder, R V. 1994, Communication of the ACM, Vol 37, pp. 87-101.

A Survey on Code Coverage as a Stopping Criterion for Unit Testing. Smith, Ben and Williams, Laurie .

Yang, Qian, Li, J. Jenny and Weiss, David M. A Survey of Coverage-Based Testing. 2007.

Analyzing structure-based techniques for test coverage on a J2ME software product line. L. , Silva and Soares , S. . s.l. : 10th Latin American Test Workshop, 2009.

How Well Do Professional Developers Test with Code Coverage Visualizations? an Empirical study. Joseph Lawrance, S. C., Margaret Burnett‡, Gregg Rothermel. : IEEE Symposium on Visual Languages and Human-Centric Computing, 2005.

A SURVEY ON AUTOMATIC TEST CASE. Prasanna, M., et al. s.l. : Academic Open Internet Journal (AOIJ), 2005, Vol. 15.

A Study on Test Coverage in Software Testing. Shahid, Muhammad, Ibrahim, Suhaimi and Mahrin, Mohd Naz‟ri . 2011 International Conference on Telecommunication Technology and Applications.

Test Coverage and Post-Verification Defects: A Multiple Case Study. Mockus, Audris. s.l. : the 3rd International Symposium on Empirical Software Engineering and Measurement, 2009.

Is Coverage a Good Measure of Testing Effectiveness? Wei, Y. Zurich, Switzerland : Chair of software engineering ETH Zurich, 2008.

Derezińska, A. Experiences from an Empirical Study of Programs Code Coverage. 2008.

Berner, S., R. Weber, et al. Enhancing Software Testing by Judicious Use of Code Coverage. s.l. : 29th International Conference on Software Engineering, 2007.

Efficient Use of Code Coverage in Large-Scale Software Development. Kim, Y. W. s.l. : Conference of the Centre for Advanced Studies on Collaborative research CASCON '03, 2003.

Software Measurements and Metrics: Role in effective software testing. Sheikh Umar Farooq, S. M. K. Quadri and Nesar Ahmad. s.l. : International Journal of Engineering Science and Technology (IJEST), Jan 2011. Vol. 3 No. 1.


  • There are currently no refbacks.

Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.