A/B testing, also referred to as online controlled experimentation or continuous
experimentation, is a form of hypothesis testing where two variants of a piece of software are …

Online controlled experiments (OCEs), also known as A/B tests, have become ubiquitous in
evaluating the impact of changes made to software products and services. While the concept …

This paper reports on novel statistical methodology, which has been deployed by the
commercial A/B testing platform Optimizely to communicate experimental results to their …

On the surface, design practices and data science may not seem like obvious partners. But
these disciplines actually work toward the same goal, helping designers and product …

Context: Continuous experimentation and A/B testing is an established industry practice that
has been researched for more than 10 years. Our aim is to synthesize the conducted …

Context Any newcomer or industrial practitioner is likely to experience difficulties in digesting
large volumes of knowledge in software testing. In an ideal world, all knowledge used in …

Online controlled experiments, also called A/B testing, have been established as the mantra
for data-driven decision making in many web-facing companies. In recent years, there are …

Background: Choosing the right software test automation tool is not trivial, and recent
industrial surveys indicate lack of right tools as the main obstacle to test automation. Aim: In …

Context Continuous experimentation guides development activities based on data collected
on a subset of online users on a new experimental version of the software. It includes …

Where the creation, understanding, and assessment of software testing and regression
testing techniques are concerned, controlled experimentation is an indispensable research …