AI-powered Communication App for Deaf mob

Summary

This project proposes the development of a mobile application that utilizes AI-powered features to bridge communication gaps for deaf and hard-of-hearing Aboriginal people, specifically in legal and healthcare settings.

Introduction

In Australia, the rights of individuals with disabilities, including Deaf and hard-of-hearing communities, are safeguarded under the United Nations Convention on the Rights of Persons with Disabilities (UNCRPD). However, despite these international commitments, significant gaps persist in providing equitable access to essential services, particularly in healthcare and the justice system. Indigenous Deaf Australians face compounded challenges, navigating through systems that often fail to accommodate their communication needs and cultural nuances.

The marginalization of Indigenous Deaf people within the Australian Criminal Justice System exemplifies the systemic barriers they encounter. Legal proceedings, such as the inability of Deaf individuals to serve on juries due to restrictions on interpreter use, underscore the pervasive exclusionary practices. This issue extends beyond legal settings, permeating healthcare access and everyday interactions, perpetuating cycles of disenfranchisement and inequality.

Moreover, empirical evidence highlights disproportionate contact between First Nations people with disabilities and the criminal justice system. Factors such as cognitive disabilities, socio-economic disparities, and systemic racism intersect to create a complex web of challenges, further exacerbated by communication barriers. The Royal Commission into Aboriginal Deaths in Custody underscored the intersectionality of factors contributing to Indigenous incarceration rates, including the impact of hearing impairment on educational opportunities and subsequent involvement with the justice system.

These systemic shortcomings underscore the urgent need for innovative solutions to bridge communication gaps and address the multifaceted challenges faced by Indigenous Deaf communities.

Problem Statement

Deaf and hard-of-hearing Aboriginal people face significant communication barriers, hindering their access to legal and healthcare services. The lack of readily available Auslan interpreters creates frustration and limits their ability to participate effectively in crucial interactions.

Solution

This project proposes an AI-powered mobile application that offers a comprehensive communication support system, including:

Real-time translation:

• Multiple input options: Text, pictogram, and Auslan input translated into speech and/or text for seamless communication with anyone.

• Personalization: AI tailors translations to the user's communication style and vocabulary level, ensuring accuracy and clarity.

Asynchronous translation:

• Pre-recorded messages: Users can store commonly used phrases or questions for quick and easy access during interactions.

• Offline functionality: The app allows users to pre-translate documents or prepare for upcoming appointments, even without an internet connection.

Additional communication support tools:

• Legal term explanations: AI provides clear and concise explanations of complex legal terms used in documents and conversations.

• Stress management features: Breathing exercises, calming visuals, and other tools can help users manage anxiety in unfamiliar and high-stakes environments.

Target Community

• Deaf and hard-of-hearing Aboriginal people in [community]..

Project Benefits

1. Enhanced communication and participation: Real-time and asynchronous translation empowers users to actively engage in legal and healthcare settings.

2. Increased independence and confidence: Users can communicate directly with professionals without relying solely on interpreters.

3. Improved access to services: Reduced communication barriers lead to better understanding of legal rights and healthcare options.

4. Culturally appropriate communication: The app can be customized to accommodate Aboriginal languages, dialects, and communication preferences.

5. Reduced stress and anxiety: Features like pre-recorded messages and stress management tools promote a calmer and more productive communication experience.

Project Activities

• App Development: Develop a user-friendly mobile application with the aforementioned features.

• Community Engagement: Collaborate with Aboriginal deaf and hard-of-hearing communities for feedback and testing.

• Evaluation and Refinement: Analyze feedback to refine the app and ensure it meets user needs.

Project Timeline

• Month 1-3: App development and beta testing.

• Month 4-6: Community engagement and testing.

• Month 7-8: Evaluation, refinement, and finalization.

Funding Request

We request funding to cover the costs of app development, community engagement, and project evaluation.

Sustainability

The project aims to secure long-term funding through partnerships with government agencies and NGOs serving the deaf and hard-of-hearing Aboriginal community.

Conclusion

This AI-powered communication app has the potential to revolutionize access to legal and healthcare services for deaf and hard-of-hearing Aboriginal people. By empowering them to communicate effectively and independently, we can promote social inclusion and equity.

Appendices

Appendix 1 - Costs

Cost are broken down by the 3 main project activities;

1. 1. 1. App Development: Develop a user-friendly mobile application with the aforementioned features.

      2. Community Engagement: Collaborate with Aboriginal deaf and hard-of-hearing communities for feedback and testing.

      3. Evaluation and Refinement: Analyze feedback to refine the app and ensure it meets user needs.

IndigenousSign: Empowering Aboriginal Communities through Sign Language Recognition & Preservation.

Summary: This proposal outlines a project to develop a platform and mobile app to empower Aboriginal communities in preserving and utilizing Aborginal sign languages by leveraging new AI capabilities.

By prioritizing community ownership, diversity, and privacy, the platform will enable accurate recognition and preservation of Aboriginal sign language gestures and expressions while at the same time, fostering related digital skills within these communities. Through partnerships, gamification, and robust data collection methods, the project seeks to build a comprehensive database for AI development and accessibility improvements, ensuring the cultural significance and longevity of Aboriginal sign languages.

Introduction: Preserving Aboriginal Sign Languages1

In Aboriginal communities, sign languages hold profound cultural significance, serving as vital tools of communication within diverse linguistic landscapes. With multilingualism ingrained in Aboriginal and Torres Strait Islander cultures, adaptive communication processes have evolved to navigate this complexity. However, despite the existence of 18 identified sign languages and 55 signing systems, many indigenous languages face extinction, with only a fraction being learned by children.

Significantly, some indigenous spoken languages are intertwined with sign language, manifesting as 'alternate sign languages' used in various cultural contexts like mourning or hunting. These systems, developed organically within communities, reflect the rich cultural diversity of First Nations People worldwide and are utilized by both hearing and deaf individuals. Consequently, any sign language used by Deaf members originates from the organic evolution of gesturing within the community, distinct from recognized sign languages like ASL or BSL.

Given the decline of indigenous languages and the unique nature of village sign systems, documenting and preserving Aboriginal sign languages becomes imperative to safeguard cultural heritage. Fingerspelling, which closely mirrors spoken language, presents an accessible means of integration into AI systems for interpretation, offering potential avenues for preservation. As these unique forms of expression face the risk of disappearing, capturing and documenting them emerges as a pressing endeavor to ensure the continuity of cultural identity within Aboriginal communities.

 1 This section references Ethical AI, criminal justice and sign language: A literature review, Dr Leanne McRae, 2022.

Objective:

This project will develop a prototype platform and mobile app to empower Aboriginal communities in preserving and utilizing their sign languages through machine learning algorithms. By prioritizing community ownership, diversity, and privacy, we aim to document and save Aboriginal sign languages from disappearance while fostering digital skills within these communities.

Data Collection:

• Users will sign up for the app and participate in signing activities, incentivized through gamification techniques.

• Data includes isolated signs and continuous signing, with the initial focus on isolated signs of one Aboriginal sign language.

• Emphasis on diversity and accuracy in data collection to accommodate variations in signing styles and expressions.

Challenges and Solutions:

• Address the high cost of data collection through gamification and user incentives.

• Ensure data quality through partnerships with specialized organizations and rigorous quality assessment measures.

Business Model:

• Replicate the platform's services for collecting sign data from multiple Aboriginal sign languages, aiming for cost reduction and valuable data insights.

Approach to Database Collection:

• Outreach to organizations for existing sign language data, emphasizing partnerships and quality assessment.

• Utilize gamification to incentivize user participation, provide feedback, and enhance user engagement.

• Enhance onboarding processes to streamline data collection and ensure quality submissions.

Consent and Privacy:

• Obtain user consent for data collection and prioritize privacy, including considerations for facial expressions and gestures.

• Employ secure cloud storage solutions like AWS S3, ensuring compliance with privacy laws and robust security measures.

Future Development:

• Explore advanced machine learning techniques for improved accuracy and collaborate with AI researchers and innovators.

• Expand data collection efforts to encompass more complex signing structures and integrate gesture-based communication technologies while maintaining user privacy.

Conclusion:

Our project aims to empower Aboriginal communities to preserve and utilize their sign languages through a community-driven, pri vacy-conscious approach. By leveraging technology, partnerships, and gamification, we strive to build acomprehensive database for AI development and accessibility improvements, ensuring the longevity and cultural significance of Aboriginal sign languages.

Appendices

Appendix 1 - Costs: