Microbenchmarking is a widely used form of performance testing in Java software. A
microbenchmark repeatedly executes a small chunk of code while collecting measurements …

As applications and operating systems are becoming more complex, the last decade has
seen the rise of many tracing tools all across the software stack. This article presents a …

Virtual Machines (VMs) with Just-In-Time (JIT) compilers are traditionally thought to execute
programs in two phases: the initial warmup phase determines which parts of a program …

Performance variability has been acknowledged as a problem for over a decade by cloud
practitioners and performance engineers. Yet, our survey of top systems conferences …

Rigorous performance engineering traditionally assumes measuring on bare-metal
environments to control for as many confounding factors as possible. Unfortunately, some …

Refactoring aims at improving the maintainability of source code without modifying its
external behavior. Previous works proposed approaches to recommend refactoring …

Microbenchmarking frameworks, such as Java's Microbenchmark Harness (JMH), allow
developers to write fine-grained performance test suites at the method or statement level …

Software benchmarks are only as good as the performance measurements they yield.
Unstable benchmarks show high variability among repeated measurements, which causes …

The usage of Python idioms is popular among Python developers in a formative study of 101
Python idiom performance related questions on Stack Overflow, we find that developers …

We propose a benchmarking strategy that is robust in the presence of timer error, OS jitter
and other environmental fluctuations, and is insensitive to the highly nonideal statistics …