Learning how bias unintentionally manifests itself in data projects is important when designing and implementing systems that work for all. Data stewards have an obligation to make sure that data is used responsibly so that governments can equitably serve their communities. Taking the time to understand the myriad ways bias may be introduced into your project is a critical step, allowing you to both make corrections during project design and build in processes to mitigate harm in the future.
Generate a list of assumptions you have about the data, technical tools, and algorithms you’ll be using. Plan for the potential risks and sources of bias you can account for.
Document the existing and potential sources of bias in your project and how you plan to insulate against risk.
Build in mechanisms to regularly audit your project for bias so you may address inequities in real-time.
Draft documentation to help your stakeholders understand why and how decisions are being made with respect to project data.
What assumptions are you making about your data and the technical tools your project will depend on?
What are the technical drawbacks that create bias of different forms?
Have you considered opportunities for bias to be introduced into your project that isn’t from the data itself?
What are some strategies your team will employ to mitigate bias?
How will you ensure you’re mitigating risk to vulnerable populations?
Are you being transparent about the data decisions you’re making? How will you communicate this to your stakeholders?
Foundation of a Successful Data Project: Identifying and Mitigating Bias (Beeck Center for Social Impact + Innovation)
Toolkit for Centering Racial Equity Throughout Data Integration (AISP)
Data Protection, Privacy + Equity Impact Assessment (State of Connecticut)
Principles For Advancing Equitable Data Practice (Urban Institute)
The Beeck Center for Social Impact + Innovation at Georgetown University seeks to improve people’s daily lives by helping governments utilize data, design, technology, and policy to better meet the needs of their residents. An anchor of Georgetown University’s Tech and Society Initiative, the Beeck Center works alongside public, private, and non-profit organizations to identify and establish human-centered solutions that help government services work better for everyone, especially the most vulnerable and underserved populations.
The National Governors Association is the voice of the leaders of 55 states, territories, and commonwealths and supports governors in their work to develop innovative solutions to today’s problems. Through the NGA Center for Best Practices, Governors work with policy teams to identify priority issues and deal with matters of public policy and governance at the state, national and global levels.