© University of Kent - Contact | Feedback | Legal | FOI | Cookies
Automated detection of performance regressions: The Mono experience
Tomas Kalibera, Lubomir Bulej, and Petr Tuma
In Proceedings of the 13th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS), pages 182-196. IEEE, September 2005 [doi].Abstract
Engineering a large software project involves tracking the impact of development and maintenance changes on the software performance. An approach for tracking the impact is regression benchmarking, which involves automated benchmarking and evaluation of performance at regular intervals. Regression benchmarking must tackle the nondeterminism inherent to contemporary computer systems and execution environments and the impact of the nondeterminism on the results. On the example of a fully automated regression benchmarking environment for the Mono opensource project, we show how the problems associated with nondeterminism can be tackled using statistical methods.
Download publication 427 kbytes (PDF)Bibtex Record
@inproceedings{3142,
author = {Tomas Kalibera and Lubomir Bulej and Petr Tuma},
title = {Automated Detection of Performance Regressions: The {Mono} Experience},
month = {September},
year = {2005},
pages = {182-196},
keywords = {determinacy analysis, Craig interpolants},
note = {},
doi = {10.1109/MASCOT.2005.18},
url = {http://www.cs.kent.ac.uk/pubs/2005/3142},
publication_type = {inproceedings},
submission_id = {20359_1312144451},
other_year = {2005},
ISBN = {0-7695-2458-3},
booktitle = {Proceedings of the 13th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS)},
publisher = {IEEE},
refereed = {yes},
}