Online controlled experiments, also called A/B testing, have been established as the mantra
for data-driven decision making in many web-facing companies. In recent years, there are …

Background: Choosing the right software test automation tool is not trivial, and recent
industrial surveys indicate lack of right tools as the main obstacle to test automation. Aim: In …

Where the creation, understanding, and assessment of software testing and regression
testing techniques are concerned, controlled experimentation is an indispensable research …

Modern web services routinely provide REST APIs for clients to access their functionality.
These APIs present unique challenges and opportunities for automated testing, driving the …

Context Continuous experimentation guides development activities based on data collected
on a subset of online users on a new experimental version of the software. It includes …

The adoption of agile approaches has put an increased emphasis on testing, resulting in
extensive test suites. These suites include a large number of tests, in which developers …

What is the impact of software engineering research on current practices in industry? In this
paper, I report on my direct experience as a PhD/post-doc working in software engineering …

Research on software testing produces many innovative automated techniques, but
because software testing is by necessity incomplete and approximate, any new technique …

Software testing is an important activity in the software development life-cycle. In an earlier
study in 2009, we reported the results of a regional survey of software testing practices …

This position paper aims at discussing a number of issues that typically arise when
performing empirical studies with software testing techniques. Though some problems are …