[HTML][HTML] A/B testing: A systematic literature review

F Quin, D Weyns, M Galster, CC Silva - Journal of Systems and Software, 2024 - Elsevier
A/B testing, also referred to as online controlled experimentation or continuous
experimentation, is a form of hypothesis testing where two variants of a piece of software are …

Statistical challenges in online controlled experiments: A review of a/b testing methodology

N Larsen, J Stallrich, S Sengupta, A Deng… - The American …, 2024 - Taylor & Francis
The rise of internet-based services and products in the late 1990s brought about an
unprecedented opportunity for online businesses to engage in large scale data-driven …

[图书][B] Trustworthy online controlled experiments: A practical guide to a/b testing

R Kohavi, D Tang, Y Xu - 2020 - books.google.com
Getting numbers is easy; getting numbers you can trust is hard. This practical guide by
experimentation leaders at Google, LinkedIn, and Microsoft will teach you how to accelerate …

The netflix recommender system: Algorithms, business value, and innovation

CA Gomez-Uribe, N Hunt - ACM Transactions on Management …, 2015 - dl.acm.org
This article discusses the various algorithms that make up the Netflix recommender system,
and describes its business purpose. We also describe the role of search and related …

[PDF][PDF] Online controlled experiments and A/B tests

R Kohavi, R Longbotham - … of machine learning and data mining, 2015 - exp-platform.com
Many good resources are available with motivation and explanations about online
controlled experiments (Kohavi et al. 2009a, 2020; Thomke 2020; Luca and Bazerman …

Measuring the business value of recommender systems

D Jannach, M Jugovac - ACM Transactions on Management Information …, 2019 - dl.acm.org
Recommender Systems are nowadays successfully used by all major web sites—from e-
commerce to social media—to filter content and make suggestions in a personalized way …

Online controlled experiments at large scale

R Kohavi, A Deng, B Frasca, T Walker, Y Xu… - Proceedings of the 19th …, 2013 - dl.acm.org
Web-facing companies, including Amazon, eBay, Etsy, Facebook, Google, Groupon, Intuit,
LinkedIn, Microsoft, Netflix, Shop Direct, StumbleUpon, Yahoo, and Zynga use online …

The unfavorable economics of measuring the returns to advertising

RA Lewis, JM Rao - The Quarterly Journal of Economics, 2015 - academic.oup.com
Twenty-five large field experiments with major US retailers and brokerages, most reaching
millions of customers and collectively representing $2.8 million in digital advertising …

Top challenges from the first practical online controlled experiments summit

S Gupta, R Kohavi, D Tang, Y Xu, R Andersen… - ACM SIGKDD …, 2019 - dl.acm.org
Online controlled experiments (OCEs), also known as A/B tests, have become ubiquitous in
evaluating the impact of changes made to software products and services. While the concept …

Online evaluation for information retrieval

K Hofmann, L Li, F Radlinski - Foundations and Trends® in …, 2016 - nowpublishers.com
Online evaluation is one of the most common approaches to measure the effectiveness of an
information retrieval system. It involves fielding the information retrieval system to real users …