School of Computing

Repeatability, reproducibility and rigor in systems research (invited paper)

Jan Vitek and Tomas Kalibera

In Proceedings of the 11th International Conference on Embedded Software (EMSOFT), pages 182-196. ACM, October 2011 [doi].


Computer systems research spans sub-disciplines that include embedded and real-time systems, compilers, networking, and operating systems. Our contention is that a number of structural factors inhibit quality research. We highlight some of the factors we have encountered in our work and observed in published papers and propose solutions that could both increase the productivity of researchers and the quality of their output.

Download publication 213 kbytes (PDF)

Bibtex Record

author = {Jan Vitek and Tomas Kalibera},
title = {Repeatability, Reproducibility and Rigor in Systems Research (Invited Paper)},
month = {October},
year = {2011},
pages = {182-196},
keywords = {determinacy analysis, Craig interpolants},
note = {},
doi = {10.1145/2038642.2038650},
url = {},
    publication_type = {inproceedings},
    submission_id = {1039_1319756109},
    ISBN = {978-1-4503-0714-7},
    booktitle = {Proceedings of the 11th International Conference on Embedded Software (EMSOFT)},
    publisher = {ACM},
    refereed = {No},

School of Computing, University of Kent, Canterbury, Kent, CT2 7NF

Enquiries: +44 (0)1227 824180 or contact us.

Last Updated: 21/03/2014