Identify Bias
+ mitigate risk
Why it matters
Learning how bias unintentionally manifests itself in data projects is important when designing and implementing systems that work for all. Data stewards have an obligation to make sure that data is used responsibly so that governments can equitably serve their communities. Taking the time to understand the myriad ways bias may be introduced into your project is a critical step, allowing you to both make corrections during project design and build in processes to mitigate harm in the future.
Checklist
Generate a list of assumptions you have about the data, technical tools, and algorithms you’ll be using. Plan for the potential risks and sources of bias you can account for.
Document the existing and potential sources of bias in your project and how you plan to insulate against risk.
Build in mechanisms to regularly audit your project for bias so you may address inequities in real-time.
Draft documentation to help your stakeholders understand why and how decisions are being made with respect to project data.
Key Questions
What assumptions are you making about your data and the technical tools your project will depend on?
What are the technical drawbacks that create bias of different forms?
Have you considered opportunities for bias to be introduced into your project that isn’t from the data itself?
What are some strategies your team will employ to mitigate bias?
How will you ensure you’re mitigating risk to vulnerable populations?
Are you being transparent about the data decisions you’re making? How will you communicate this to your stakeholders?
Tools + Resources
Data Equity: What Is It, and Why Does It Matter? (Hawai'i Data Collaborative)
Foundation of a Successful Data Project: Identifying and Mitigating Bias (Beeck Center for Social Impact + Innovation)
Toolkit for Centering Racial Equity Throughout Data Integration (AISP)
Data Protection, Privacy + Equity Impact Assessment (State of Connecticut)
Principles For Advancing Equitable Data Practice (Urban Institute)
About the Beeck Center for Social Impact + Innovation
The Beeck Center for Social Impact + Innovation at Georgetown University brings together students, expert practitioners, and extended networks to work on projects that solve societal challenges using data, design, technology, and policy. Our projects test new ways for public and private institutions to leverage data and analytics, digital technologies, and service design to help more people.
About the national governors association
The National Governors Association is the voice of the leaders of 55 states, territories, and commonwealths and supports governors in their work to develop innovative solutions to today’s problems. Through the NGA Center for Best Practices, Governors work with policy teams to identify priority issues and deal with matters of public policy and governance at the state, national and global levels.