TY - GEN
T1 - Meta-evaluation of machine translation using parallel legal texts
AU - Wong, Billy Tak Ming
AU - Kit, Chunyu
PY - 2009
Y1 - 2009
N2 - In this paper we report our recent work on the evaluation of a number of popular automatic evaluation metrics for machine translation using parallel legal texts. The evaluation is carried out, following a recognized evaluation protocol, to assess the reliability, the strengths and weaknesses of these evaluation metrics in terms of their correlation with human judgment of translation quality. The evaluation results confirm the reliability of the well-known evaluation metrics, BLEU and NIST for English-to-Chinese translation, and also show that our evaluation metric ATEC outperforms all others for Chinese-to-English translation. We also demonstrate the remarkable impact of different evaluation metrics on the ranking of online machine translation systems for legal translation.
AB - In this paper we report our recent work on the evaluation of a number of popular automatic evaluation metrics for machine translation using parallel legal texts. The evaluation is carried out, following a recognized evaluation protocol, to assess the reliability, the strengths and weaknesses of these evaluation metrics in terms of their correlation with human judgment of translation quality. The evaluation results confirm the reliability of the well-known evaluation metrics, BLEU and NIST for English-to-Chinese translation, and also show that our evaluation metric ATEC outperforms all others for Chinese-to-English translation. We also demonstrate the remarkable impact of different evaluation metrics on the ranking of online machine translation systems for legal translation.
KW - ATEC
KW - BLEU
KW - BLIS
KW - Legal Text
KW - Machine Translation Evaluation
UR - http://www.scopus.com/inward/record.url?scp=70350663031&partnerID=8YFLogxK
U2 - 10.1007/978-3-642-00831-3_33
DO - 10.1007/978-3-642-00831-3_33
M3 - Conference contribution
AN - SCOPUS:70350663031
SN - 3642008305
SN - 9783642008306
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 337
EP - 344
BT - Computer Processing of Oriental Languages
T2 - 22nd International Conference on Computer Processing of Oriental Languages, ICCPOL 2009
Y2 - 26 March 2009 through 27 March 2009
ER -