Skip to main content

The past, present, and future of experimental software engineering


This paper gives a 40 year overview of the evolution of experimental software engineering, from the past to the future, from a personal perspective. My hypothesis is that my work followed the evolution of the field. I use my own experiences and thoughts as a barometer of how the field has changed and present some opinions about where we need to go.


  1. V. Basili, A. Turner, Iterative Enhancement: A Practical Technique for Software Development,IEEE Transactions on Software Engineering, vol. 1(4), December 1975.

  2. V. Basili, R. Reiter, Jr., A Controlled Experiment Quantitatively Comparing Software Development ApproachesIEEE Transactions on Software Engineering, vol. 7(3): 299–320 (IEEE Computer Society Outstanding Paper Award), May 1981.

    Article  Google Scholar 

  3. V. Basili and M. Zelkowitz, Analyzing Medium Scale Software Development,in Proceedings of the Third International Conference on Software Engineering, May 1978.

  4. V. Basili, R. Selby, D. Hutchens, Experimentation in Software Engineering,IEEE Transactions on Software Engineering vol. 12(7): 733–743, July 1986.

    Google Scholar 

  5. B. Boehm and V. Basili, Software Defect Reduction Top 10 List,IEEE Computer, vol. 34(1): 135–137, January 2001.

    Google Scholar 

  6. V. Basili and B. Boehm, COTS-Based Systems Top 10 List,IEEE Computer, vol. 34(5): 91–93, May 2001.

    Google Scholar 

  7. W. Edwards Deming,Out of the Crisis (Cambridge, Massachusetts: MIT Press, Center for Advanced Engineering Study, 1986).

    Google Scholar 

  8. L. Hochstein, T. Nakamura, V.R. Basili, S. Asgari, M.V. Zelkowitz, J.K. Hollingsworth, F. Shull, J. Carver, M. Voelp, N. Zazworka, P. Johnson, Experiments to Understand HPC Time to Development,Cyberinfrastructure Technology Watch Quarterly, vol.2(4A): 24–32, November 2006.

    Google Scholar 

  9. J. Maldonado, J. Carver, F. Shull, S. Fabbri, E.Dória, L.Martimiano, M. Mendonça, V. Basili, Perspective-Based Reading: A Replicated Experiment Focused on Individual Reviewer Effectiveness,Empirical Software Engineering: An International Journal, vol. 11(1): March 2006.

Download references

Author information

Authors and Affiliations


Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License ( ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Basili, V.R. The past, present, and future of experimental software engineering. J Braz Comp Soc 12, 7–12 (2006).

Download citation

  • Issue Date:

  • DOI: