News

My TED Talk is out! [January 2024]

Earned Imperial College Emerging  Alumni Leader Award [January 2024]

I feel very honored to have received the Emerging Alumni Leader Award from Imperial College London, where I did both my undergrad, earning an M.Eng. in Electrical & Electronic Engineering, and my PhD in Computing. See here for more information the award.

Paper accepted at AAAI [December 2023]

Our paper on "Learning fair policies for multi-stage selection problems from observational data" has been accepted for publication at AAAI! 

In this paper, we consider the problem of learning fair policies for multi-stage selection problems from observational data. This problem arises in several high-stakes domains such as company hiring, loan approval, or bail decisions where outcomes (e.g., career success, loan repayment, recidivism) are only observed for those selected. We propose a multi-stage framework that can be augmented with various fairness constraints, such as demographic parity or equal opportunity. This problem is a highly intractable infinite chance-constrained program involving the unknown joint distribution of covariates and outcomes.  Motivated by the potential impact of selection decisions on people’s lives and livelihoods, we propose to focus on interpretable linear selection rules. Leveraging tools from causal inference and sample average approximation, we obtain an asymptotically consistent solution to this selection problem by solving a mixed binary conic optimization problem, which can be solved using standard off-the-shelf solvers. We conduct extensive computational experiments on a variety of datasets adapted from the UCI repository on which we show that our proposed approaches can achieve an 11.6\% improvement in precision and a 38\% reduction in the measure of unfairness compared to the existing selection policy.  

Joining the Editorial Board of Operations Research as Associate Editor [December 2023]

I am so excited to be joining the editorial board of Operations Research as Associate Editor starting January 2024.  I will be AE for both the "Optimization" and "Real World OR Innovations" areas! I look forward to your submissions!

Congratulations Dr Sina Aghaei! [December 2023]

Congratulations to my second PhD student, Sina Aghaei, for successfully defending his thesis titled "Integer Optimization for Analytics in High-Stakes Domains"! He will be headed to Harvard to the Public Impact Analytics Science Lab (PIAS-Lab) where he will work with Dr Soroush Saghafian.

Our paper "Learning Optimal Classification Trees Robust to Distribution Shifts" under review [November 2023]

Our paper on "Learning Optimal Classification Trees Robust to Distribution Shifts" led by my PhD student Nathan Justin is now under review for publication at Operations Research.

I shared our research at the TED AI conference [October 2023]

One of the most exciting experiences of my career! I got to share our research on using AI to support vulnerable populations at the TED AI Conference in San Francisco.

Participated in the TED AI Panel on Responsible AI [October 2023]

I had the honor of talking about responsible AI at the inaugural TED Conference on AI.

Caroline Johnston received the Amazon SCOT/INFORMS Scholarship [October 2023]

Congratulations to Caroline for receiving the Amazon SCOT/INFORMS Scholarship!

This scholarship program, sponsored by Amazon SCOT, aims to foster the professional pipeline of operations research, management science, and analytics researchers.

I took part in the Time 100 Impact Dinner: Extraordinary Women Shaping the Future of AI [October 2023]

I took part in the Time 100 Impact Dinner to honor extraordinary women shaping the future of AI, co-hosted by Time CEO Jessica Sibley and Meta's VP or Media Partnerships, Campbell Brown.

I have been named Co-Director of the USC Center for AI in Society and honored with a Viterbi Early Career Chair in Engineering [August 2023]

I will be giving a TED AI Talk about our work on AI and policy [August 2023]

Register for the TED AI event here: https://www.ai-event.ted.com 

Our paper on "Learning optimal fair decision trees: trade-offs between interpretability, fairness, and accuracy" has been accepted for publication at AIES 2023 [May 2023]

The increasing use of machine learning in high-stakes domains – where people’s livelihoods are impacted – creates an urgent need for interpretable, fair, and highly accurate algorithms. With these needs in mind, we propose a mixed integer optimization (MIO) framework for learning optimal classification trees – one of the most interpretable models – that can be augmented with arbitrary fairness constraints. In order to better quantify the “price of interpretability”, we also propose a new measure of model interpretability called decision complexity that allows for comparisons across different classes of machine learning models. 

See here for more details: https://arxiv.org/pdf/2201.09932.pdf 

Our paper on "Fairness in contextual resource allocation systems: metrics and incompatibility results" has been accepted for publication at AAAI 2023 [December 2022]

In this paper, we study systems that allocate scarce resources to satisfy basic needs, such as homeless services that provide housing. We propose a framework for evaluating fairness in contextual resource allocation systems that is inspired by fairness metrics in machine learning. This framework can be applied to evaluate the fairness properties of a historical policy, as well as to impose constraints in the design of new (counterfactual) allocation policies. 

Our work culminates with a set of incompatibility results that investigate the interplay between the different fairness metrics we propose. Notably, we demonstrate that: 1) fairness in allocation and fairness in outcomes are usually incompatible; 2) policies that prioritize based on a vulnerability score will usually result in unequal outcomes across groups, even if the score is perfectly calibrated; 3) policies using contextual information beyond what is needed to characterize baseline risk and treatment effects can be fairer in their outcomes than those using just baseline risk and treatment effects; and 4) policies using group status in addition to baseline risk and treatment effects are as fair as possible given all available information. Our framework can help guide the discussion among stakeholders in deciding which fairness metrics to impose when allocating scarce resources.

See here for more details: https://arxiv.org/abs/2212.01725

Kathryn Dullerud received the 2022 INFORMS Scholarship Award [September 2022]

Congratulations to Kathryn Dullerud for being selected as one of the INFORMS 2022 undergraduate scholars and receiving the INFORMS Scholarship Award.

Caroline receives the 2022 WORMS Doctoral Student Colloquium Award [September 2022]

Congratulations Caroline Johnston for receiving the 2022 WORMS Doctoral Student Colloquium Award to attend the Doctoral Student Colloquium at INFORMS 2022.

Co-organized and co-hosted the CPAIOR2022 conference at USC in LA [June 2022]

It was a real honor to organize the 19th iteration of the CPAIOR conference with Bistra Dilkina, Sven Koenig, Thiago Serra, and Pierre Schaus among many others! For more information, see here: https://sites.google.com/usc.edu/cpaior-2022/.

Our paper "ROC++: Robust Optimization in C++" is accepted at INFORMS Journal on Computing   [May 2022]

Our paper and code for ROC++, a platform for modeling, automatically reformulating, and solving, decision-making problems affected by uncertainty is now accepted for publication at INFORMS Journal on Computing. It includes ROPy, a python interface in the form of a callable library that offers most of the functionality of ROC++.

Check it out here: https://sites.google.com/usc.edu/robust-opt-cpp/home

and here: http://www.optimization-online.org/DB_FILE/2020/06/7835.pdf

Congratulations to Dr Aida Rahmattalabi [May 2022]

Congratulations to Dr Rahmattalabi, my first PhD student to graduate. She received a PhD in Computer Science for her work on trustworthy and data-driven social interventions.

I received the USC Viterbi Junior Research Award [April 2022]

I am so excited and honored to have received the USC Viterbi Junior Research Award! I dedicate it to my students, collaborators, and mentors: I could not have earned this distinction without them.

Here, we are pictured with Dean Yortos and distinguished professor of Electrical & Computer Engineering, Mahta Moghaddam, see https://viterbischool.usc.edu/news/2022/05/usc-viterbi-faculty-and-staff-awards-2022-the-pre-post-covid-era/ 

My first PhD student Aida Rahmattalabi successfully defended her PhD thesis! [April 2022]

I am so proud of my first PhD student, Aida, who successfully defended her thesis titled "Towards trustworthy and data-driven social interventions"! Congratulations!

Chris Doehring wins the USC ISE Undergrad Research Award [April 2022]

Congratulations to my undergrad student Chris Doehring for winning the USC ISE Undergrad Research Award for his work on conservation in collaboration with Panthera!

PhD students Nathan Justin and Bill Tang awarded prestigious NSF GRFP Fellowship  [April 2022]

I am thrilled to annouce that Nathan Justin, second year PhD student in our group in Computer Science, and Bill Tang, second year PhD student in our group in ISE, have both  been awarded the prestigious Graduate Research Fellowship Program (GRFP) award from the National Science Foundation. Check-out this article about their award and research.

Nathan Justin, second year PhD student in our group in Computer Science

Bill Tang, second year PhD student in our group in ISE

New paper on "Optimal Fair Classification Trees" submitted [January 2022]

Check out our new paper on "Learning optimal fair classification trees"!

Our paper on "Learning Optimal Prescriptive Trees from Observational Data" has been accepted at AAAI 2022 Workshop [December 2021]

Our paper on "Learning optimal prescriptive trees from observational data" has been accepted at the AAAI Workshop on AI for Behavior Change!

Our paper on "Optimal Robust Classification Trees" has been accepted at AAAI 2022 Workshop  [December 2021]

Our paper on "Optimal robust classification trees" has been accepted at the AAAI Workshop on Adversarial Machine Learning and Beyond!

New course on "Analytics for Social Impact"  [November 2021]

I'll be teaching a new course on "Analytics for Social Impact" this coming Spring!

This course will introduce students to research in the emerging area of “Analytics for Social Impact” whose goal is to advance descriptive, predictive, and prescriptive analytics to address important societal challenges, e.g., in public health, social services provision, and conservation. Particular methods that the students will learn about relate to fairness, interpretability, and robustness, from the lens of optimization, machine learning, and causal inference.

E-mail me for more information.

PhD student Caroline Johnston won 1st place at the Bayer Women in OR Scholarship  [October 2021]

Caroline Johnston, third year PhD student in our group, won 1st place at the Bayer Women in OR Scholarship at INFORMS 2021!

Undergraduate student Nathanael Jo is a finalist for the INFORMS Undergraduate Operations Research Prize  [August 2021]

Congratulations to undergraduate student Nathan Jo for being a finalist for the INFORMS Undergraduate Operations Research Prize for his paper "Learning optimal prescriptive trees from observational data"!

New paper on "Learning Optimal Prescriptive Trees from Observational Data"   [August 2021]

Our new paper on "Learning optimal prescriptive trees from observational data" in now online. In this work, we consider the problem of learning an optimal prescriptive tree (i.e., a personalized treatment assignment policy in the form of a binary tree) of moderate depth, from observational data. This problem arises in numerous socially important domains such as public health and personalized medicine, where interpretable and data-driven interventions are sought based on data gathered in deployment, through passive collection of data, rather than from randomized trials.

WiSE Gabilan Assistant Professorship   [May 2021]

I am honored to have been appointed as holder of a WiSE Gabilan Assistant Professorship.

New version of our paper "ROC++: Robust Optimization in C++"   [May 2021]

We are excited to annouce a new version of our paper and code for ROC++, a platform for modeling, automatically reformulating, and solving, decision-making problems affected by uncertainty! It now includes ROPy, a python interface in the form of a callable library that offers most of the functionality of ROC++.


Check it out here: https://sites.google.com/usc.edu/robust-opt-cpp/home

and here: http://www.optimization-online.org/DB_FILE/2020/06/7835.pdf

Undergraduate student Nathanael Jo earns USC Discovery Scholar Prize  [April 2021]

Congratulations to undergrad student Nathan Jo who has earned the USC Discovery Scholar Prize for his first author paper on "Learning Optimal Prescriptive Trees from Observational Data." The award includes $10,000 prize to attend a PhD program! Check out this article about his work.

NSF CAREER AWARD  [April 2021]

I am really excited and honored that our group has received an NSF CAREER award for our proposal titled Robust, Interpretable, and Fair Allocation of Scarce Resources in Socially Sensitive Settings.”

CAIS Symposium on Equity & AI  [April 2021]

Eric Rice and I co-organized and co-hosted the CAIS Equity and AI Symposium that brought together leading scholars from industry and academia to exchange ideas and research findings.

Event link: https://sites.google.com/view/symposium-on-equity-and-ai/home

Event videos: 

Day 1: https://www.youtube.com/watch?v=Guls2WAd_lo

Day 2: https://www.youtube.com/watch?v=bHfjBz-oiOI

Caroline Johnston awarded NSF GRFP  [March 2021]

I am thrilled to annouce that Caroline Johnston, second year PhD student in our group, is a recipient of the prestigious Graduate Research Fellowship Program (GRFP) award from the National Science Foundation. Check out this article about her award!

Updated paper "Robust Optimization with Decision-Dependent Information Discovery"  [January, 2021]

An updated version of our paper on "Robust Optimization with Decision-Dependent Information Discovery" is now available online. It includes applications of our approach to R&D project porfolio selection and to the Pandora Box problem. We also evaluate our method on an instance of the active preference elicitation problem used to recommend kidney allocation policies to policymakers at the United Network for Organ Sharing based on real data from the U.S. Kidney Allocation System.

New paper on "Strong Optimal Classification Trees"  [January, 2021]

Our new paper on "Strong Optimal Classification Trees" is now under review at Operations Research. Our proposed approach is 31 times faster than state-of-the art MIO-based techniques and improves out of sample performance by up to 8%. Our formulation can accommodate side constraints to enable the design of interpretable and fair decision trees.

Associate Editor for Operations Research Letters  [December, 2020]

I am really excited to announce that, starting April 2021, I will be appointed Associate Editor for Operations Research Letters in the Optimization under Uncertainty and Machine Learning area.

"Fair Influence Maximization: a Welfare Optimization Approach"  [December, 2020]

Our paper on "Fair Influence Maximization: a Welfare Optimization Approach" has been accepted for publication in Proceedings of the AAAI Conference on Artificial Intelligence, 2020.

ExplOR Event  [November 7, 2020]

Organized explOR, a day-long program aimed to bring STEM education to underserved communities, focusing on topics in Operations Research (OR) and Artificial Intelligence (AI) applied to problems of Social Good in collaboration with educators, staff, and students at Code in the Schools and STEM Academy of Hollywood

Associate Editor for Computational Management Science [October 2020]

I am excited to have been appointed associate editor for Computational Management Science

"Cost-Sharing Mechanism Design for Ride-Sharing" [October 2020]

Our paper on "Cost-Sharing Mechanism Design for Ride-Sharing" has been submitted for publication.

Zumberge Faculty Research and Innovation Fund Special Solicitation for Epidemic and Virus Related Research and Development Award  [July 29, 2020]

We are very excited to have received a USC Zumberge Faculty Research and Innovation Fund Award to support our project on "Addressing Ethical Dilemmas during the COVID-19 Pandemic through AI."

"ROC++: Robust Optimization in C++" [June 2020]

Our paper "ROC++: Robust Optimization in C++" has been submitted for publication.

New project on ethics of resource allocation during the COVID19 pandemic  [April 10, 2020]

One of the major problems that has emerged during the COVID-19 pandemic is that hospitals and states have more cases than they have resources to respond to and treat positive patients (e.g., not enough personal protective equipment [PPE], not enough ventilators, not enough doctors, not enough nurses). This has placed decision makers in these systems (e.g., doctors and policymakers) in the extremely difficult position to have to choose who gets access to and priority for these resources. This poses huge ethical dilemmas (e.g., need to balance system efficiency with fairness considerations) which are complicated by the diversity of stakeholders in these systems (e.g., doctors, patients, hospitals, governments, population at-large) and by the high degree of uncertainty under which decisions must be made. Thus, there is an urgent need for disciplined, automated, data-driven approaches for coordinating the allocation of these scarce resources.

Figure. Model of the healthcare system during the COVID-19 pandemic as a queuing system. Individuals with different characteristics and conditions arrive over time and are matched to resources that are available (e.g., CCU beds, ventilators). The resource allocation policy determines which patients get matched to what resource and in turn impacts the fairness-efficiency characteristics of the policy.

Figure. Preference elicitation for allocation of COVID-19 resources: we propose to learn the preferences of stakeholders over policy characteristics (e.g., fairness/efficiency trade-off) by asking them pairwise comparisons over policy outcomes.

"Active Preference Elicitation via Adjustable Robust Optimization" [February 22, 2020]

Our paper on "Active Preference Elicitation via Adjustable Robust Optimization" with an application to learn the preferences of policy-makers to be able to design policies that better meet their needs has been submitted for publication.

"Learning Optimal Classification Trees: Strong Max-Flow Formulations" [February 7, 2020]

Our paper on "Learning Optimal Classification Trees: Strong Max-Flow Formulations" is now under review for publication in the proceedings of ICML.

Poster presentation at NeurIPS [December 12, 2019]

I had the honor of presenting our work at the NeurIPS conference in Vancouver, BC. Check-out our poster below.

"Robust Optimization with Decision-Dependent Information Discovery" [September 19, 2019]

Our paper on "Robust Optimization with Decision-Dependent Information Discovery" with an application to preference elicitation at the Los Angeles Homeless Services Authority has been submitted for publication.

Paper on suicide prevention accepted at NeurIPS [September 19, 2019]

We are grateful that our paper on "Exploring Algorithmic Fairness in Robust Graph Covering Problems" has been accepted for publication in the Proceedings of NeurIPS 2019. This paper proposes an algorithm for designing fair "Gatekeeper" training interventions for suicide prevention. We hope our work can help raise awareness of this important problem.

Our work on AI for Public Housing Allocation is covered by Medium [June 3, 2019]

We are excited that our work with my colleague Eric Rice in collaboration with the Los Angeles Homeless Services Authority (LAHSA) is featured in One Zero Medium

NSF Smart & Connected Communities Grant [September 13, 2018]

Together with Behavioral/Social Scientists, Physical Scientists, and Economists at RAND Corporation, Geological and Environmental Scientists at the University of Oregon, and partners at the Sitka Sound Science Center, we have been awarded an NSF Smart & Connected Cities $2,100,974 grant for our project "Landslide Risk Management in Remote Communities: Integrating Geoscience, Data Science, and Social Science in Local Context."

NSF CMMI-Operations Engineering Grant [July 15, 2018]

Together with my colleague, Bistra Dilkina, we are really excited to have been awarded a $535,335 NSF grant for our project "Preserving Biodiversity via Robust Optimization."