Restricted Translation Task  

Restricted Translation Task is one of the shared tasks provided at Workshop on Asian Translation (WAT). It will be collocated at Machine Translation Summit 2023 in Sep 4-8, 2023. Looking forward to your participation!

Task Description

Consistency is key to clear and accurate translations. It is practically important to have consistent terminology when translating documents related to science or business/marketing that include technical terms and proper nouns (See the examples below, where the tokens colored in red indicate some technical terms, and the boldface shows inconsistent translations among systems).

In this task, we will investigate translation with restricted target vocabularies. We will provide a list of target words as well as source sentences to represent word restriction.  Participants are required to submit translations that contain all the target words in each list. 

We will evaluate submissions by using two different metrics: 1) usual translation accuracy such as BLEU, and 2) a consistency score which evaluates how many word restrictions were satisfied in submitted translations. 


Example: (from ASPEC Corpus [1])

Input: この回路は ,入力信号位相の変化により共振周波数がシフトする帰還回路であり,2基のコイルの中央にある物体の磁気特性の変化を,高い感度と分解能で検出することができる。

Reference: This is a feedback circuit shifting resonance frequency by change of input signal phase, which can detect change of magnetic features of an object present at a center of two coils on high sensitivity and resolution.

Target vocabulary list: {magnetic features, resonance frequency, feedback circuit, resolution}


Online system A: This circuit is a feedback circuit whose resonance frequency shifts due to changes in the input signal phase, and can detect changes in the magnetic characteristics of the object in the center of the two coils with high sensitivity and resolution.

Online system B: This circuit is a feedback circuit in which the resonance frequency shifts due to changes in the input signal phase, and it is possible to detect changes in the magnetic properties of objects in the center of two coils with high sensitivity and resolution.

Reference

[1] Nakazawa et al., "ASPEC: Asian Scientific Paper Excerpt Corpus", in Proc. of LREC, 2016.

Task Organizers

Contact

For general questions, comments, etc. please email to "wat-organizer -at- googlegroups -dot- com".