A challenge for promoting automatic prediction of subjective ratings for voice.
Human listening tests are the gold standard for evaluating speech. Objective measures of speech quality have a low correlation with human ratings, and the generalization abilities of current data-driven quality prediction systems suffer significantly from domain mismatch. The VoiceMOS Challenge was founded in 2022, and we aim to encourage research in the area of automatic prediction of mean opinion score (MOS) for synthesized speech.
2025.9.3. The summary paper of the AudioMOS Challenge 2025 is on arXiv now! [Paper]
2025.8.17. A tutorial entitled "Automatic Quality Assessment for Speech and Beyond" was given by the main steering group members. [Slides]
2025.6.25. The AudioMOS Challenge 2025 is officially over! Please find the dataset links on the challenge page. We will release the summary paper after acceptance. Stay tuned!
2025.6.16. The AudioMOS Challenge 2025 results have been released to the participants! Please check if you received it or not!
2025.6.6. The AudioMOS Challenge 2025 evaluation phase is over! We have sent an email to participants regarding the ground truth label for the evaluation set and the system description form. Please check if you received it or not!
2025.5.28. The evaluation phase of the AudioMOS Challenge 2025 has started! The evaluation set links could be found on the CodaBench page. The submission deadline is June 4.
2025.4.22. We have received several inquiries from participants regarding confusion about the Track 3 setting. We have updated the description. Please refer to the Track 3 description page for more details.
2025.4.17. We have made an announcement regarding the Track 2 training data. Please see the announcements section on the AudioMOS Challenge 2025 page.
2025.4.17. We are pleased to inform you that the AudioMOS Challenge 2025 has been accepted as a challenge session at ASRU 2025, which will be held on Dec. 6 - 10 in Honolulu, Hawaii, USA!
2025.4.9: We have sent out emails to inform participants the CodaBench page and instructions on the training data! Please contact us if you registered but did not receive the email!
2025.3.21: The AudioMOS Challenge 2025 website and registration go public! We warmly invite you to participate in the challenge!
2024.6.14: The VoiceMOS Challenge 2024 is officially over! Now you can freely get the datasets by registering through the CodaBench page. Please check the details on the challenge page!
2024.4.11: The VoiceMOS Challenge 2024 CodaBench page is live and the training data is released! Participants, please check your email.
2024.4.3.: The VoiceMOS Challenge 2024 is announced! Please check the challenge page!