Atlantic Causal Inference Conference 2019 Data Challenge
Causal Competition 2019
The Challenge is Now Closed!
We thank all participants, and look forward to announcing preliminary results in Montréal!
Information about the DGPs, and the true population ATE for each dataset, will be posted here after the results have been announced.
The Fourth Annual Atlantic Causal Inference Conference (ACIC) Data Challenge provides an opportunity to compare causal inference methodologies across a variety of data generating processes (DGP). As in previous years, the challenge focuses on computational methods of inferring causal effects from quasi-real world data. This year the target of estimation is the population average treatment effect (ATE).
Covariates were drawn from publicly available data and also simulated. Identifiability of the parameter is guaranteed, however challenges to estimation have been built-in to the processes for generating the binary treatment assignment, and binary or continuous outcome. These include non-linearity of the response surface, treatment effect heterogeneity, varying proportion of true confounders among the observed covariates, and near violations of the positivity assumption.
This year's challenge has two tracks:
- Low dimensional datasets (varying size, e.g., 500 x 20)
- High dimensional datasets (varying size, e.g. 1000 x 200, 2000 x 200)
Participants (individuals or teams) will download the datasets for either track (3200 datasets per track), and run analyses using their own computing resources to estimate the ATE and a 95% confidence interval for each dataset. Results for all datasets within a single track should be saved to a file, then uploaded to the website for evaluation.
The 2019 Data Challenge is open mid-January through mid-April. Preliminary results will be announced at ACIC, 2019. The conference will take place at the McGill University, May 22 to May 24, 2019.
- mid-December, 2018: The Challenge website goes live. Sample datasets that can be used to develop your approach will be available for download.
- mid-January, 2019: Challenge Datasets are available for download
- mid-February, 2019: Submit Results by upload or email (deadline April 15, 2019)
- Susan Gruber, Putnam Data Sciences, LLC
- Geneviève Lefebvre, Université du Québec à Montréal
- Tibor Schuster, McGill University
- Alexandre Piché, Mila, Université de Montréal , Element AI
Contact us: sgruber[at]putnamds[dot]com