Independent validation of experimental results in the field of systems research is a
challenging task, mainly due to differences in software and hardware in computational …

Characterizing quantum systems through experimental data is critical to applications as
diverse as metrology and quantum computing. Analyzing this experimental data in a robust …

Analysis pipelines commonly use high-level technologies that are popular when created, but
are unlikely to be readable, executable, or sustainable in the long term. A set of criteria is …

This paper introduces PopperCI, a continous integration (CI) service hosted at UC Santa
Cruz that allows researchers to automate the end-to-end execution and validation of …

The stencil pattern represents a vast variety of applications, ranging from geophysics to
medical science. In application codes, the stencil kernel is often the part where most of the …

For decades, the majority of the experiments on parallel computers have been reported at
conferences and in journals usually without the possibility to verify the results presented …

Independent validation of experimental results in the field of parallel and distributed systems
research is a challenging task, mainly due to changes and differences in software and …

The field of two-dimensional classical spin systems has been studied for many decades
using a variety of analytical and numerical methods. This field of study contains many …

Reproducibility of published computational research has seen increased interest the last
twenty years. Regardless of academic field and the impact-factor of journals, studies of …

High performance computing systems are characterized by a high level of complexity both
on their hardware and software side. The hardware has evolved offering a lot of compute …