An Evaluation of Output Quality of Machine Translation (Padideh Software vs. Google Translate)
Haniyeh Sadeghi Azer, Mohammad Bagher Aghayi
Abstract
This study aims to evaluate the translation quality of two machine translation systems in translating six different text-types, from English to Persian. The evaluation was based on criteria proposed by Van Slype (1979). The proposed model for evaluation is a black-box type, comparative and adequacy-oriented evaluation. To conduct the evaluation, a questionnaire was assigned to end-users to evaluate the outputs to examine and determine, if the machine-generated translations are intelligible and acceptable from their point of view and which one of the machine-generated translations produced by Padideh software and Google Translate is more acceptable and useful from the end-users point of view. The findings indicate that, the machine-generated translations are intelligible and acceptable in translating certain text-types, for end-users and Google Translate is more acceptable from end-users point of view.
Arnold, D. (1994). Machine translation: an introductory guide. Blackwell Pub.
Van Slype, G. (1979). Critical study of methods for evaluating the quality of machine translation. Prepared for the Commission of European Communities Directorate General Scientific and Technical Information and Information Management. Report BR, 19142.
Volk, M. (1997, July). Probing the lexicon in evaluating commercial MT systems. In Proceedings of the eighth conference on European chapter of the Association for Computational Linguistics (pp. 112-119). Association for Computational Linguistics.
You may require to add the 'aiac.org.au' domain to your e-mail 'safe list’ If you do not receive e-mail in your 'inbox'. Otherwise, you may check your 'Spam mail' or 'junk mail' folders.