In 2005 the government of India established Janani Suraksha Yojana (JSY), a conditional cash transfer programme to increase deliveries in health facilities. We re-examine an influential study published in 2010 on the effect of JSY on reproductive health coverage indicators and perinatal and neonatal mortality. We find the original authors’ results to be replicable and robust to various changes in model specifications and analysis. Through the use of multilevel models, we find meaningful heterogeneity across states and districts in the effects of JSY on the probabilities of in-facility delivery and skilled birth attendance, and neonatal mortality rates.