Experimental design in two-sided platforms: An analysis of bias

R Johari, H Li, I Liskovich… - Management …, 2022 - pubsonline.informs.org
We develop an analytical framework to study experimental design in two-sided
marketplaces. Many of these experiments exhibit interference, where an intervention applied …

Interference, bias, and variance in two-sided marketplace experimentation: Guidance for platforms

H Li, G Zhao, R Johari, GY Weintraub - Proceedings of the ACM Web …, 2022 - dl.acm.org
Two-sided marketplace platforms often run experiments (or A/B tests) to test the effect of an
intervention before launching it platform-wide. A typical approach is to randomize users into …

Experimenting in equilibrium

S Wager, K Xu - Management Science, 2021 - pubsonline.informs.org
Classical approaches to experimental design assume that intervening on one unit does not
affect other units. There are many important settings, however, where this noninterference …

[DOC][DOC] Online experimentation: Benefits, operational and methodological challenges, and scaling guide

I Bojinov, S Gupta - Harvard Data Science Review, 2022 - assets.pubpub.org
In the past decade, online controlled experimentation, or A/B testing, at scale has proved to
be a significant driver of business innovation. The practice was first pioneered by the …

Modeling interference using experiment roll-out

A Boyarsky, H Namkoong, J Pouget-Abadie - arXiv preprint arXiv …, 2023 - arxiv.org
Experiments on online marketplaces and social networks suffer from interference, where the
outcome of a unit is impacted by the treatment status of other units. We propose a framework …

Design and analysis of bipartite experiments under a linear exposure-response model

C Harshaw, F Sävje, D Eisenstat… - Electronic Journal of …, 2023 - projecteuclid.org
A bipartite experiment consists of one set of units being assigned treatments and another set
of units for which we measure outcomes. The two sets of units are connected by a bipartite …

Statistical inference and A/B testing for first-price pacing equilibria

L Liao, C Kroer - International Conference on Machine …, 2023 - proceedings.mlr.press
We initiate the study of statistical inference and A/B testing for first-price pacing equilibria
(FPPE). The FPPE model captures the dynamics resulting from large-scale first-price auction …

Adaptive experimental design with temporal interference: A maximum likelihood approach

PW Glynn, R Johari, M Rasouli - Advances in Neural …, 2020 - proceedings.neurips.cc
Suppose an online platform wants to compare a treatment and control policy (eg, two
different matching algorithms in a ridesharing system, or two different inventory management …

A/b testing for recommender systems in a two-sided marketplace

P Nandy, D Venugopalan, C Lo… - Advances in Neural …, 2021 - proceedings.neurips.cc
Two-sided marketplaces are standard business models of many online platforms (eg,
Amazon, Facebook, LinkedIn), wherein the platforms have consumers, buyers or content …

Correlated cluster-based randomized experiments: Robust variance minimization

O Candogan, C Chen, R Niazadeh - Management Science, 2024 - pubsonline.informs.org
Experimentation is prevalent in online marketplaces and social networks to assess the
effectiveness of new market intervention. To mitigate the interference among users in an …