Shuang Zhang1, Xiuying Lu1,*, Yao Ruan2
1School of Foreign Languages, East China Jiaotong University, Nanchang 330000, Jiangxi, China.
2Jiangxi Vocational College of Mechanical & Electrical Technology, Nanchang 330000, Jiangxi, China.
*Corresponding author: Xiuying Lu
Funding: This work was supported by the Jiangxi Provincial Social Science Fund Under Grant 25YY07.
Abstract
Environmentally-themed documentaries have become a crucial medium for disseminating ecological values and promoting international environmental protec-tion cooperation. The quality of their translations directly affects the effectiveness of information transmission and the depth of cultural exchange. This study takes the environmental documentary Echoes of Lucid Waters and Lush Mountains as an example, conducts a comparative analysis of the use of LLMs such as Kimi, Doubao, and DeepSeek in the translation, and systematically evaluates the quality of their translated texts. Based on the Multidimensional Quality Metrics (MQM), it customizes a translation evaluation model with four core evaluation dimensions of terminology, accuracy, linguistic conventions, and style. Qualitative analysis and quantitative results indicate that DeepSeek outperforms the other models in translating the selected environmentally-themed documentary. On the basis of summarizing the types of translation errors, it further proposes optimization strategies for LLMs translation.
References
Chang, S., & Xu, J. (2024). The Role of Environmental Documentaries in Ecological Protection. Environmental Protection, 52(16), 74-75.
Feng, Z., & Zhang, D. (2024). Large Language Model in Artificial Intelligence. Foreign Languages and Literature, 40(3), 1-29.
Lommel, A., Uszkoreit, H., & Burchardt, A. (2014). Multidimensional Quality Metrics (MQM): A Framework for Declaring and Describing Translation Quality Metrics. Revista Tradumàtica, (12), 455-463.
Miao, Y. (2019). Existential Anxiety, Ecological Balance, and Responsibility: The Core Value of Environmental Documentaries. China Television, (6), 15-19.
Tian, P. (2020). Multidimensional Metrics for Translation Quality: Review and Implications. East Journal of Translation, (3), 23-30.
Yu, Q., & Wan, Q. (2025). Assessing the Translation Quality of Classical Chinese Texts by Large Language Models: A Case Study of Mencius: Liang Hui Wang Ⅰ. Chinese Science & Technology Translators Journal, 38(3), 50-53+57.
Zhang, S., & Zhao, C. (2025). Examining the Suitability of Large Language Models for Literary Translation: A Multi-Indicator Assessment of the English Translations of Biancheng. Foreign Languages in China, 22(4), 85-95.
Zhao, Y., Zhang, H., & Yang, Y. (2024). Comparative Study on the Translation Quality of Large Language Models: Taking the Translation of “Fan Hua” as an Example. Technology Enhanced Foreign Language Education, (4), 60-66+109.
How to cite this paper
Evaluation and Optimization of LLMs Translation for Environmentally-themed Documentaries Based on the MQM Quality Evaluation Model
How to cite this paper: Shuang Zhang, Xiuying Lu, Yao Ruan. (2025) Evaluation and Optimization of LLMs Translation for Environmentally-themed Documentaries Based on the MQM Quality Evaluation Model. Journal of Humanities, Arts and Social Science, 9(10), 1866-1873.
DOI: http://dx.doi.org/10.26855/jhass.2025.10.005