Towards an equitable cultural and linguistic representation and participation in today’s digital and AI-driven world
The Minimum Viable Dataset (MVD) Working Group has completed its work, and the final report has been published.
Artificial intelligence is changing how people search for information, learn new skills, access services, and communicate with one another. But not every language is being supported by the AI technologies people are increasingly relying on. Many risk being left behind entirely due to a lack of language data.
The Minimum Viable Dataset Working Group was convened as part of CODI's first research initiative focused on advancing multilingual AI. This diverse group of experts in artificial intelligence, linguistics, digital access, Indigenous data governance, and cultural preservation worked for months to answer one critical question: What does a language need to participate meaningfully in the age of AI?
The resulting framework introduces recommendations, guidelines, and practical tools to determine what makes a dataset culturally relevant and ethically sourced for use in generative AI models. Rather than dictating what communities should build, the report offers a flexible framework they can use to define their own goals.
Established the concept, scope, and intended outcomes of the Minimum Viable Dataset.
Created tiered dataset models and specify criteria for each tier, tied to real-world use cases.
Identified the core elements needed for authentic and comprehensive representation at each tier.
Recommended metadata structures, tagging conventions, and open protocols to ensure interoperability.
Adapted relevant standards from existing frameworks to ensure responsible creation, ownership, and use of datasets.
The MVD Working Group report marks the first phase of CODI's work to advance multilingual AI. The next phase will focus on practical implementation, transforming the framework into a usable toolkit for language communities. If you would like to collaborate with CODI, please contact us at info@codi.global.
As AI continues to shape how people experience the Internet, ensuring every language has the opportunity to participate is more important than ever.
Today, we invite you to explore the report, use the framework to assess where your language stands, and share what you learn as you put it into practice. Together, we can help build an AI future where every language belongs.