© University of Kent - Contact | Feedback | Legal | FOI | Cookies
Repeated results analysis for middleware regression benchmarking
Lubomir Bulej, Tomas Kalibera, and Petr Tuma
Performance Evaluation, 60(1-4):182-196, May 2005 [doi].Abstract
The paper outlines the concept of regression benchmarking as a variant of regression testing focused at detecting performance regressions. Applying the regression benchmarking in the area of middleware development, the paper explains how the regression benchmarking differs from middleware benchmarking in general, and shows on real-world examples why the existing benchmarks do not give results sufficient for regression benchmarking. Considering two broad groups of benchmarks based on their complexity, novel techniques are proposed for the repeated analysis of results for the purpose of detecting performance regressions.
Download publication 280 kbytes (PDF)Bibtex Record
@article{3144,
author = {Lubomir Bulej and Tomas Kalibera and Petr Tuma},
title = {Repeated results analysis for middleware regression benchmarking},
month = {May},
year = {2005},
pages = {182-196},
keywords = {determinacy analysis, Craig interpolants},
note = {},
doi = {10.1016/j.peva.2004.10.013},
url = {http://www.cs.kent.ac.uk/pubs/2005/3144},
publication_type = {article},
submission_id = {21214_1312146554},
other_year = {2005},
ISSN = {0166-5316},
journal = {Performance Evaluation},
volume = {60},
number = {1--4},
publisher = {Elsevier},
}