School of Computing

The evolution and testing of a medium sized numerical package

D.J. Barnes and T.R. Hopkins

In H.P. Langtangen, A.M. Bruaset, and E. Quak, editors, Advances in Software Tools for Scientific Computing, volume 10 of Lecture Notes in Computational Science and Engineering, pages 182-196. Springer-Verlag, Berlin, January 2000.

Abstract

We investigate the evolution of a medium sized software package, {\sc LAPACK}, through its public releases over the last six years and establish a correlation, at a subprogram level, between a simply computable software metric value and the number of coding errors detected in the released routines. We also quantify the code changes made between issues of the package and attempt to categorize the reasons for these changes.

We then consider the testing strategy used with {\sc LAPACK}. Currently this consists of a large number of mainly self-checking driver programs along with sets of configuration files. These suites of test codes run a very large number of test cases and consume significant amounts of cpu time. We attempt to quantify how successful this testing strategy is from the viewpoint of the coverage of the executable statements within the routines being tested.

Download publication 165 kbytes (PostScript)

Bibtex Record

@incollection{989,
author = {Barnes, D.J. and Hopkins, T.R.},
title = {The Evolution and Testing of a Medium Sized Numerical  Package},
month = {January},
year = {2000},
pages = {182-196},
keywords = {determinacy analysis, Craig interpolants},
note = {},
doi = {},
url = {http://www.cs.kent.ac.uk/pubs/2000/989},
    ISBN = {3-540-66557-9},
    address = {Berlin},
    booktitle = {Advances in Software Tools for Scientific Computing},
    editor = {Langtangen, H.P. and Bruaset, A.M. and Quak, E.},
    publication_type = {incollection},
    publisher = {Springer-Verlag},
    series = {Lecture Notes in Computational Science and Engineering},
    submission_id = {17887_950885066},
    volume = {10},
}

School of Computing, University of Kent, Canterbury, Kent, CT2 7NF

Enquiries: +44 (0)1227 824180 or contact us.

Last Updated: 21/03/2014