Translating culture through AI: Evaluating the performance of ChatGPT and Gemini in rendering Arabic and English proverbs
Main Article Content
Abstract
The use of artificial intelligence in various areas is a growing phenomenon. Translation is a field that has long been associated with machine assistance and automation. This study examines AI translation tools' abilities to adequately transfer meaning culturally and functionally beyond word replacement. For this purpose, a sample of 50 proverbs was selected due to their cultural non-literal sense. The prominent AI tools, namely Gemini and ChatGPT, were selected as translation programs due to their growing use, especially in translation. The analysis worked with Arabic and English, each serving as both source and target languages. The results showed that the translation program and translation direction influenced the outcomes. Additionally, the quantitative analysis showed that among literal translation, paraphrasing, and cultural substitution, GPT was most likely to employ the first strategy while Gemini showed a tendency for the last. Furthermore, GPT showed a more balanced distribution of strategies even across languages. Meanwhile, Gemini’s strategy use varied especially when comparing the use of paraphrase in each direction. The qualitative analysis indicated that Gemini outperformed ChatGPT. The analysis also showed that cultural substitution has the highest potential in recreating the function of the ST, while literal translation was most likely to cause translation loss. Moreover, the programs, especially ChatGPT, could still commit translation errors that modified sense even when employing strategies like paraphrase and cultural substitution as they lack cultural nuance and critical thinking skills. The study recommends the development of parallel corpora that contain culturally equivalent idioms based on usage, so people do not rely on programs that may fall short in transferring meaning.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
This open-access article is distributed under a Creative Commons Attribution (CC-BY) 4.0 license.
You are free to: Share — copy and redistribute the material in any medium or format. Adapt — remix, transform, and build upon the material for any purpose, even commercially. The licensor cannot revoke these freedoms as long as you follow the license terms.
Under the following terms: Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
No additional restrictions You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.
How to Cite
Share
References
Abu Rumman, R., Haider, A. S., Yagi, S., & Al-Adwan, A. (2023). A corpus-assisted cognitive analysis of metaphors in the Arabic subtitling of English TV series. Cogent Social Sciences, 9(1), 2231622. doi:https://doi.org/10.1080/23311886.2023.2231622
Ahmad, M., Haider, A. S., & Saed, H. (2025). Assessing AI-driven dubbing websites: Reactions of Arabic native speakers to AI-dubbed English videos in Arabic. Research Journal in Advanced Humanities, 6(1), 1-20. doi:https://doi.org/10.58256/64dz1c72
Akasheh, W. M., Haider, A. S., Al-Saideen, B., & Sahari, Y. (2024). Artificial intelligence-generated Arabic subtitles: insights from Veed. io's automatic speech recognition system of Jordanian Arabic. Texto Livre, 17, e46952-e46952. doi:10.1590/1983-3652.2024.46952.
Al-Darabee, M., & Farghal, M. (2025). Veed. AI Arabic subtitling of English taboo expressions in the movie The Wolf of Wall Street. Babel Revue internationale de la traduction / International Journal of Translation, 71(2), 1-25. doi:https://doi.org/10.1075/babel.24193.far
Al-Hamzi, A. M. S., Nababan, M., Santosa, R., & Anis, M. Y. (2023). The simile and metaphor in translation of Yemeni spoken Arabic common names of animals and supernatural creatures into English: A socio-pragmatic approach. Cogent Arts and Humanities, 10(1), 2223816. doi:https://doi.org/10.1080/23311983.2023.2223816
Al-khresheh, M. H., & Almaaytah, S. A. (2018). English proverbs into Arabic through machine translation. International Journal of Applied Linguistics and English Literature, 7(5), 158-166. doi:https://doi.org/10.7575/aiac.ijalel.v.7n.5p.158
Al-Momani, A., Haider, A. S., Dagamseh, M., & Akasheh, W. M. (2025). Audience Responses to Cultural and Linguistic Gaps in English–Arabic Auto-Subtitles on YouTube. Research Journal in Advanced Humanities, 6(3). doi:https://doi.org/10.58256/x3sten23
Al-Salman, S., & Haider, A. S. (2024). Assessing the accuracy of MT and AI tools in translating humanities or social sciences Arabic research titles into English: Evidence from Google Translate, Gemini, and ChatGPT International Journal of Data and Network Science, 8(4), 2483-2498. doi:https://doi.org/10.5267/j.ijdns.2024.5.009
Almahasees, Z. (2018). Assessment of Google and Microsoft Bing translation of journalistic texts. International Journal of Languages, Literature and Linguistics, 4(3), 231-235. doi:https://doi.org/10.18178/ijlll.2018.4.3.178
Almahasees, Z. (2021). Analysing English-Arabic Machine Translation: Google Translate, Microsoft Translator and Sakhr. London: Routledge.
Almahasees, Z. M. (2017). Machine Translation Quality of Khalil Gibran’s The Prophet. AWEJ for translation & Literary Studies, 1(4), 151-159. doi:10.2139/ssrn.3068518
Alquda, I., Al Saideen, B. M., Obeidat, M. M., Haider, A. S., Al-Abbas, L. S., & Dagamseh, M. (2025). One Story, Two Cultures: Readership Responses to the Cross-Cultural Translation of Jane the Virgin and El-Anisa Farah. Research Journal in Advanced Humanities, 5(4), 1-12.
Bachrun, N. A. (2023). Metaphors of Animal Lexeme Dog in English and Indonesian Proverbs: A Comparative Study. (PhD). Universitas Gadjah Mada, Indonesia.
Baker, M. (2018). In other words: A coursebook on translation: Routledge.
Bex, F. J. (2025). AI, Law and beyond. A transdisciplinary ecosystem for the future of AI & Law. Artificial Intelligence and Law, 33(1), 253-270. doi:https://doi.org/10.1007/s10506-024-09404-y
Bui, H. T. (2025). Examining the effect of AI advertising involvement disclosure on advertising value and purchase intentions. Journal of Research in Interactive Marketing, 1-20.
Campesato, O. (2024). Google Gemini for Python: Coding with Bard: Stylus Publishing, LLC.
Chan, V., & Tang, W. K.-W. (2024). GPT for translation: A systematic literature review. SN computer science, 5(8), 986.
Danielsson, P. (2007). In other words: Using paraphrases in translation. Paper presented at the Proceedings of Translating and the Computer 29.
Darwish, N., Haider, A., Rummana, B. T. R. A., Alantari, D., Saed, H., & Dagamseh, M. (2025). A Reception Study of AI-Translated Idioms and Proverbs between Arabic and English. Research Journal in Advanced Humanities, 6(3), 1-12. doi:https://doi.org/10.58256/k4d6pp20
Debbas, M., & Haider, A. S. (2020). Overcoming cultural constraints in translating English series: A case study of subtitling family guy into Arabic. 3L, Language, Linguistics, Literature, 26(1), 1-17. doi:https://doi.org/10.17576/3l-2020-2601-01
Donthi, S., Spencer, M., Patel, O., Doh, J., & Rodan, E. (2024). Improving LLM Abilities in Idiomatic Translation. arXiv preprint arXiv:2407.03518.
Fadhel, A. M., Alyami, N., & Almahasees, Z. (2025). Integrating AI Translation Ethics and Sociolinguistic Awareness into BA Programs at Saudi and Jordanian Universities. Forum for Linguistic Studies, 7(6), 161–174.
Farghal, M. (2020). Translating Arabic metaphorical expressions into English: Mahfouz’s morning and evening talk as an example. International Journal of Arabic-English Studies, 20(1), 105-124.
Farghal, M., & Al-Hamly, M. (2015). Arabic proverbs in fiction translation: Girls of Riyadh as an example. Jordan Journal of Modern Languages Literature, 7(1), 1-20.
Farghal, M., & Haider, A. S. (2024). Translating classical Arabic verse: human translation vs. AI large language models (Gemini and ChatGPT). Cogent Social Sciences, 10(1), 2410998. doi:https://doi.org/10.1080/23311886.2024.2410998
Filip, K., & Pavol, L. (2025). AI and the Translation of Idioms–Challenges, Success, and a Corpus Perspective. Jazykovedny Casopis, 76(1), 258-267.
Haider, A. S., Akar, R. A., Saed, H., Tair, S. A., & Ismail, H. H. (2024). AI-Powered Arabic Translation of Business and Finance Acronyms and Abbreviations: Evidence from Gemini, ChatGPT, and Google Translate. Paper presented at the International Conference on Technology and Innovation Management.
Haider, A. S., & AlKhatib, R. (2025). Evaluating Netflix, Machine, and Artificial Intelligence Subtitling of Arabic Legal Expressions into English. Comparative Legilinguistics.
Haider, A. S., Obeidat, M. M., Hamdan, Y., AlZghoul, O., & Abu-Rayyash, H. (2025). SDL Trados Live Cloud vs. Traditional Subtitling Workflows: An Empirical Evaluation of Performance. Research Journal in Advanced Humanities, 6(3), 1-11.
Haider, A. S., Saideen, B., & Hussein, R. F. (2023). Subtitling taboo expressions from a conservative to a more liberal culture: The case of the Arab TV series Jinn. Middle East Journal of Culture Communication Research, 16(4), 363–385. doi:https://doi.org/10.1163/18739865-tat00006
Haider, A. S., & Shohaibar, R. S. (2024). Netflix English subtitling of idioms in Egyptian movies: challenges and strategies. Humanities & Social Sciences Reviews, 11(1), 1-13. doi:https://doi.org/10.1057/s41599-024-03327-4
Halliday, M. A. K., & Hasan, R. (2014). Cohesion in english: Routledge.
Hoang, Q., & Oanh, T. T. K. (2025). Vietnamese-English Translation Errors Made by the Fourth-Year English Majors: A Case Study at Bac Lieu University. Technium Soc. Sci. J., 67, 137.
Jibreel, I. (2023). Online Machine Translation Efficiency in Translating Fixed Expressions Between English and Arabic (Proverbs as a Case-in-Point). Theory Practice in Language Studies, 13(5), 1148-1158. doi:https://doi.org/10.17507/tpls.1305.07
Khelf, Y. (2021). The Semantic Meaning and the Pragmatic Function of Animal Proverbs: A Contrastive Study between Arabic and English Proverbs. LANGUAGE ART, 6(3), 57-68.
Kwok, H. L., Shi, Y., Xu, H., Li, D., & Liu, K. (2025). GenAI as a translation assistant? A corpus-based study on lexical and syntactic complexity of GPT-post-edited learner translation. System, 130, 103618.
Li, S., Chen, J., Yuan, S., Wu, X., Yang, H., Tao, S., & Xiao, Y. (2024). Translate meanings, not just words: Idiomkb’s role in optimizing idiomatic translation with language models. Paper presented at the Proceedings of the AAAI Conference on Artificial Intelligence.
Madani, Z., Abusalim, N., & Rayyan, M. (2023). Gender representation in animal-related proverbs: Algerian vs. Jordanian Arabic. Frontiers in Sociology, 8, 1145200.
Malika, B. (2016). The Deficiencies of Machine Translation of Proverbs and Poetry: Google and Systran Translations as a case study. Algerian Scientific Journal Platform, 10(1), 222-240.
Mirzoyeva, L. (2023). Machine translation shortcomings and teaching translation. Revista Romaneasca pentru Educatie Multidimensionala, 15(3), 232-242. doi:https://doi.org/10.18662/rrem/15.3/764
Mohammed, A. S., Ghassemiazghandi, M., & Jamal, M. (2023). Post-Editing of Neural Machine Translation of the Novel “Murder of The Bookseller” from Arabic into English. International Journal of Language Literacy and Translation, 6(2), 102-114. doi:https://doi.org/10.36777/ijollt2023.6.2.080
Mohsen, M. (2024). Artificial Intelligence in Academic Translation: A Comparative Study of Large Language Models and Google Translate. PSYCHOLINGUISTICS, 35(2), 134-156. doi:https://doi.org/10.31470/2309-1797-2024-35-2-134-156
Mughal, U. A., Seemab, S., Zaigham, M. S., Bhatti, A., & Khan, H. (2024). The intersection of linguistics and artificial intelligence: a corpus-based study of idiom translation. Journal of Applied Linguistics and TESOL (JALT), 7(4), 1453-1460.
Musaad, M. M. A. M., & Al Towity, A. A. (2023). Translation Evaluation of Three Machine Translation Systems, with Special References to Idiomatic Expressions. Humanities and Educational Sciences Journal(29), 678-708. doi:https://doi.org/10.55074/hesj.vi29.700
Newmark, P. (2003). No global communication without translation. Translation today: Trends and perspectives, 55-67.
Nida, E. A. (1975). Language structure and translation; essays.
Obeidat, M. M., Haider, A. S., Tair, S. A., & Sahari, Y. (2024). Analyzing the Performance of Gemini, ChatGPT, and Google Translate in Rendering English Idioms into Arabic. FWU Journal of Social Sciences, 18(4), 1-18. doi:http://doi.org/10.51709/19951272/Winter2024/1
Öner Bulut, S., & Alimen, N. (2023). Translator education as a collaborative quest for insights into the re-positioning of the human translator (educator) in the age of machine translation: the results of a learning experiment. The Interpreter and Translator Trainer, 17(3), 375-392. doi:https://doi.org/10.1080/1750399x.2023.2237837
Qassem, M., & Aldaheri, M. M. (2023). Can Machine Translate Dialogue Acts: Evidence from Translating Dialogues from English to Arabic. 3L: Language, Linguistics, Literature, 29(4), 63-81. doi:https://doi.org/10.17576/3l-2023-2904-05
Rane, N., Choudhary, S., & Rane, J. (2024). Gemini Versus ChatGPT: Applications, Performance, Architecture, Capabilities, and Implementation. Performance, Architecture, Capabilities,and Implementation. doi:https://doi.org/10.2139/ssrn.4723687
Saed, H., Haider, A. S., Tair, S. A., & Darwish, N. (2024). Dubbing English edutainment: Localizing educational content for Arab children. Research Journal in Advanced Humanities, 5(3), 391-406. doi:https://doi.org/10.58256/bh9fhj11
Saideen, B., Thalji, A., Lababaneh, A., Tartory, R., Haider, A. S., & Obeidat, M. (2024). Netflix English subtitling of the Jordanian movie ‘The Alleys’: Challenges and strategies. Research Journal in Advanced Humanities, 5(1), 157-177. doi:https://doi.org/10.58256/sptxps94
Shalevska, E., Kostadinovska-Stojchevska, B., Janusheva, V., Janusheva, M., Stojanoska, M., & Talevska, M. (2025). AI in nonliteral language translation: Translating Macedonian proverbs and idioms. International journal of Education Teacher, 29, 60-66.
Shen, D. (1989). Literalism: Non" formal-equivalence". Babel, 35(4), 219-235.
Shiyab, S. M. (2017). Translation: concepts and critical issues: Maklu.
Shuhaiber, R., & Haider, A. S. (2023). Strategies of Subtitling Egyptian Idiomatic Expressions and Proverbs into English. Language Value, 16(2), 60-99. doi:https://doi.org/10.58256/sptxps94
Son, J., & Kim, B. (2023). Translation Performance from the User’s Perspective of Large Language Models and Neural Machine Translation Systems. Information, 14(10), 574. doi:https://doi.org/10.3390/info14100574
Tanjour, M. (2011). Bridging cultural gaps in English-Arabic translation. (MA Thesis). University of Leeds, United Kingdom.
Tannous, B., & Haider, A. S. (2025). Assessing the Accuracy of AI Tools (Google Translate and Gemini) in Translating Arabic Idiomatic Expressions and Proverbs into English. International Journal on Artificial Intelligence Tools, 34(04n05), 2550016. doi:https://doi.org/10.1142/s0218213025500162
Thalji, M. B., & Dweik, B. S. (2015). The Translation of Proverbs: Obstacles and Strategies. (MA). Middel East Universitiy, Jordan. Retrieved from https://meu.edu.jo/libraryTheses/5871fd344b5b6_1.pdf
Xia, C., Amini, M., & Lee, K.-F. (2023). Humor translation: A case study on the loss of humorous loads in SpongeBob SquarePants. Cadernos de Tradução, 43, e89705.
Yamada, M. (2023). Optimizing Machine Translation through Prompt Engineering: An Investigation into ChatGPT's Customizability. arXiv preprint arXiv:2308.01391.
Yang, Y., & Wang, X. (2019). Modeling the intention to use machine translation for student translators: An extension of Technology Acceptance Model. Computers & Education, 133, 116-126. doi:https://doi.org/10.1016/j.compedu.2019.01.015