FSR Challenge 2018 Rules

Read these first

  • First, please read and agree to the following rules before participating
  • You should only register for the challenge if you actually plan to submit an entry to the challenge

Task

  • Build an ASR that is suitable for recognizing spontaneous Taiwanese Mandarin Speech (broadcast radio).

Evaluation Metric

  • Traditional Chinese character error rate (CER)

Material Provided in the Challenge

  • This challenge is based on the NER-Trs-Vol1 corpus selected from National Education Radio Archive.
  • NER-Trs-Vol1 is manually transcribed and consists 11 radio show series, in total about 107 hours (training set).

Instructions

  • Listening to the evaluation test data, or any other human interaction with the test data, is not allowed.
  • Participants should return both the recognition hypotheses (unit sequences) and the corresponding likelihoods of every units in the hypotheses.
  • The output hypotheses should only be UTF-8 encoded traditional Chinese (繁體中文) characters.
  • Some characters are exchangeable in Taiwan, for example,“台” and "臺"。 So either is fine(we will write a script to convert those characters)。
  • Participants need to complete a form giving the general technical specification of their developed speech recognition system to facilitate easy cross-system comparisons (e.g. is it a DNN-based system? what features and training procedures are adopted? etc.).
  • Each participant needs to submit a paper and is expected to present their works at a satellite workshop of the ISCSLP 2018.

Use of External Data

  • You are allowed to use external data in any way you wish, subject to any exclusions given in these rules and clear descriptions/statements are provided about what and how external databases are adopted (for cross-system comparisons).

Retention of Submitted Recognition Hypotheses

  • Any recognition hypotheses that you submit for evaluation will be retained by the FSR Challenge organizers for future use.
  • You must include in your submission a statement of whether you give the organizers permission to publicly distribute your results in anonymized form. We really appreciate if all participants approve this consent agreement!

How are these rules enforced?

  • This is a challenge, which is designed to answer scientific questions, and not a competition. Therefore, we rely on your honesty in preparing your entry.
  • If you have any doubt about how to apply these rules, please contact the organizers (yfliao@mail.ntut.edu.tw) immediately.