Atlantic Causal Inference Conference 2019 Data Challenge

Causal Competition 2019

Aug 20, 2019: R code for generating DGPs is available for download on the Data Challenge page

May 24, 2019: Performance Summary and true population ATE for each dataset available on the Data Challenge page
The Challenge Closed on April 15, 2019

We thank all participants!

The Fourth Annual Atlantic Causal Inference Conference (ACIC) Data Challenge provides an opportunity to compare causal inference methodologies across a variety of data generating processes (DGP). As in previous years, the challenge focuses on computational methods of inferring causal effects from quasi-real world data. This year the target of estimation is the population average treatment effect (ATE).

Covariates were drawn from publicly available data and also simulated. Identifiability of the parameter is guaranteed, however challenges to estimation have been built-in to the processes for generating the binary treatment assignment, and binary or continuous outcome. These include non-linearity of the response surface, treatment effect heterogeneity, varying proportion of true confounders among the observed covariates, and near violations of the positivity assumption.

This year's challenge has two tracks:

Low dimensional datasets (varying size, e.g., 500 x 20)
High dimensional datasets (varying size, e.g. 1000 x 200, 2000 x 200)

Participants (individuals or teams) will download the datasets for either track (3200 datasets per track), and run analyses using their own computing resources to estimate the ATE and a 95% confidence interval for each dataset. Results for all datasets within a single track should be saved to a file, then uploaded to the website for evaluation.

Timeline

The 2019 Data Challenge is open mid-January through mid-April. Preliminary results will be announced at ACIC, 2019. The conference will take place at the McGill University, May 22 to May 24, 2019.

Key Dates

mid-December, 2018: The Challenge website goes live. Sample datasets that can be used to develop your approach will be available for download.
mid-January, 2019: Challenge Datasets are available for download
mid-February, 2019: Submit Results by upload or email (deadline April 15, 2019)
May 24, 2019: True population ATE for each data file and performance summary available for download

Organizing Committee:

Susan Gruber, Putnam Data Sciences, LLC
Geneviève Lefebvre, Université du Québec à Montréal
Tibor Schuster, McGill University
Alexandre Piché, Mila, Université de Montréal , Element AI