Students’ Perceptions of AI Language Models as Virtual Assistants in Learning Writing- A Case Study at a Tertiary Institution
DOI:
https://doi.org/10.54855/ijte.25525Keywords:
AI language models, virtual assistant, learning writingAbstract
Research trends in AI language models for writing assistance are increasing, yet a gap exists concerning their impact on language learning, especially in Vietnam, as well as stakeholder attitudes. This study explores perceptions of 147 students, mainly English majors at Van Lang University, regarding AI tools such as ChatGPT, Poe, and Gemini in English writing. Combining quantitative and qualitative analysis through the use of questionnaires and in-depth interviews, the research found a generally favorable student attitude, recognizing AI's accessibility and flexibility. However, concerns about over-reliance and accuracy were identified. Highlighting implications for effective AI integration in Vietnamese writing pedagogy, this study contributes to understanding student perspectives on this evolving educational technology.
References
Abhishek, J. 2024. Google Forms. In P. Ashish, K.M. Amit & J. Abhishek (Eds.), Open electronic data capture tools for medical and biomedical research and medical allied professionals (pp. 331-378). Academic Press. https://doi.org/10.1016/B978-0-443-15665-6.00008-7.
Acharya, A. S., Prakash, A., Saxena, P., & Nigam, A. (2013). Sampling: Why and how of it? Indian Journal of Medical Specialities, 4(2). https://doi.org/10.7713/ijms.2013.0032
ALAfnan, M. A., Samira Dishari, Marina Jovic, & Koba Lomidze. (2023). ChatGPT as an Educational Tool: Opportunities, Challenges, and Recommendations for Communication, Business Writing, and Composition Courses. Journal of Artificial Intelligence and Technology, 3(2), 60–68. https://doi.org/10.37965/jait.2023.0184
Alharbi, W. (2023). AI in the foreign language classroom: A pedagogical overview of automated writing assistance tools. Education Research International, 2023, 1–15. https://doi.org/10.1155/2023/4253331
Alkharusi, H. (2022). A descriptive analysis and interpretation of data from Likert scales in educational and psychological research. . Indian Journal of Psychology and Education, 12(2), 13-16
Almalki, S. (2016). Integrating quantitative and qualitative data in mixed methods research—Challenges and benefits. Journal of Education and Learning, 5(3), 288. https://doi.org/10.5539/jel.v5n3p288
Athaluri, S. A., Manthena, S. V., Kesapragada, V. S. R. K. M., Yarlagadda, V., Dave, T., & Duddumpudi, R. T. S. (2023). Exploring the Boundaries of Reality: Investigating the Phenomenon of Artificial Intelligence Hallucination in Scientific Writing Through ChatGPT References. Cureus, 15(4), e37432. https://doi.org/10.7759/cureus.37432
Athanassopoulos, S., Manoli, P., Gouvi, M., Lavidas, K., & Komis, V. (2023). The use of ChatGPT as a learning tool to improve foreign language writing in a multilingual and multicultural classroom. Advances in Mobile Learning Educational Research, 3(2), 818–824. https://doi.org/10.25082/amler.2023.02.009
Bahdanau, D., Cho, K., & Bengio, Y. (2014). Neural machine translation by jointly learning to align and translate. arXiv.org. https://arxiv.org/abs/1409.0473v7
Baskara, F. (2023). Integrating ChatGPT into EFL writing instruction: Benefits and challenges. International Journal of Education and Learning, 5(1), 44-55. doi:https://doi.org/10.31763/ijele.v5i1.858
Bender, E M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021). On the dangers of stochastic parrots: Can language models be too big? The 2021 ACM Conference on Fairness, Accountability, and Transparency. https://doi.org/10.1145/3442188.3445922
Bhandari, P. (2020, June 19). What is qualitative research? | Methods & Examples. Scribbr. https://www.scribbr.com/methodology/qualitative-research/
Bonner, E., Lege, R., & Frazier, E. (2023). Large language model-based artificial intelligence in the language classroom: Practical ideas for teaching. Teaching English With Technology, 2023(1). https://doi.org/10.56297/bkam1691/wieo1749
Burkhard, M. (2022, November 22). Student perceptions of AI-powered writing tools: Towards individualized teaching strategies [Conference presentation abstract] .19th International Conference on Cognition and Exploratory Learning in Digital Age (CELDA 2022), https://eric.ed.gov/?id=ED626893
Carvalho, L., Martinez-Maldonado, R., Tsai, Y. S., Markauskaite, L., & De Laat, M. (2022). How can we design for learning in an AI world? Computers and Education: Artificial Intelligence, 3, 100053. https://doi.org/10.1016/j.caeai.2022.100053
Chassignol, M., Khoroshavin, A., Klimova, A., & Bilyatdinova, A. (2018). Artificial Intelligence trends in education: A narrative overview. Procedia Computer Science, 136, 16–24. https://doi.org/10.1016/j.procs.2018.08.233
Chu, Q. B., Nguyen, M. B., & Nguyen, A. P. (2024). Using Artificial Intelligence Tool in Studying English Skills in Vietnam – An Experimental Research for Vietnamese High School Students. Journal of Ecohumanism, 3(6), 1883–1894. https://doi.org/10.62754/joe.v3i6.4144
Cortina, J. M. (1993). What is coefficient alpha? An examination of theory and applications. Journal of Applied Psychology, 78(1), 98–104. https://doi.org/10.1037//0021-9010.78.1.98
Creswell, J. W. (2014). Research design: Qualitative, quantitative and mixed methods approaches. SAGE Publications.
Davis, F. D. (1989). Perceived usefulness, perceived ease of use and user acceptance of information technology. MIS Quarterly, 13(3), 319–340.
Duong, T. K. H., & Le , T. T. H. (2024). Utilizing Artificial Intelligence in Writing Feedback: Benefits and Challenges for First-Year Students at Hanoi University of Industry. Proceedings of the AsiaCALL International Conference, 6, 238–249. https://doi.org/10.54855/paic.24617
Fitria, T. N. (2023). Artificial intelligence (AI) technology in OpenAI ChatGPT application: A review of ChatGPT in writing English essay. ELT Forum: Journal of English Language Teaching, 12(1), 44–58. https://doi.org/10.15294/elt.v12i1.64069
Floridi, L. (2023). AI as agency without intelligence: On ChatGPT, large language models, and other generative models. Philosophy & Technology, 36(15), 1-15. https://doi.org/10.2139/ssrn.4358789
Fraenkel, J.R., Wallen, N.E., & Hyun, H.H. 2011. How to design and evaluate research in education. McGraw-Hill.
Gill, P., Stewart, K., Treasure, E., & Chadwick, B. (2008, March). Methods of data collection in qualitative research: Interviews and focus groups. British Dental Journal, 204(6), 291–295. https://doi.org/10.1038/bdj.2008.192
Godwin-Jones, R. (2022). Partnering with AI: Intelligent writing assistance and instructed language learning. Language Learning & Technology, 26(2), 5–24. http://doi.org/10125/73474
Golzar, J., Noor, S., & Tajik, O. (2022). Convenience Sampling. International Journal of Education &Language Studies, 1(2), 72-77. https://doi.org/10.22034/ijels.2022.162981
Ha, Y. N., & Ho, N. P. (2025). EFL postgraduate students’ perceptions on the use of Grammarly and peer feedback to improve their academic writing skills. International Journal of TESOL & Education, 5(1), 25-49. https://doi.org/10.54855/ijte.25512
Ho, P. X. P. (2024). Using ChatGPT in English language learning: A study on I.T. students’ attitudes, habits, and perceptions. International Journal of TESOL & Education, 4(1), 55-68. DOI: https://doi.org/10.54855/ijte.24414
Ji, Z., Yu, T., Xu, Y., Lee, N., Ishii, E., & Fung, P. (2023). Towards mitigating LLM hallucination via self reflection. In Findings of the Association for Computational Linguistics: EMNLP 2023 (pp. 1827–1843). Association for Computational Linguistics. https://doi.org/10.18653/v1/2023.findings-emnlp.123
Joshi, A., Kale, S., Chandel, S., & Pal, D. K. (2015). Likert scale: Explored and explained. British Journal of Applied Science & Technology, 7(4), 396-403. https://doi.org/10.9734/BJAST/2015/14975.
Jumriah, J., Susilawati, E. S., Supriatna, E., Smas, M. H., & Arini, I. (2024). Analysis of the use of ChatGPT to improve student performance. EDUKASIA: Jurnal Pendidikan Dan Pembelajaran, 5(1), 127-136. https://doi.org/10.62775/edukasia.v5i1.725
Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., Krusche, S., Kutyniok, G., Michaeli, T., Nerdel, C., Pfeffer, J., Poquet, O., Sailer, M., Schmidt, A., Seidel, T., . . . Kasneci, G. (2023, April). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 103, 102274. https://doi.org/10.1016/j.lindif.2023.102274
Katar, O., Özkan, D., -3, G., Yildirim, Z., & Acharya, U. R. (2023). Araştırma Makalesi Yazımında GPT-3 Yapay Zeka Dil Modeli Değerlendirmesi. Turkish Journal of Science and Technology, 18(2), 311–318. https://doi.org/10.55525/tjst.1272369
Kelle, U. (2006). Combining qualitative and quantitative methods in research practice: purposes and advantages. Qualitative Research in Psychology, 3(4), 293–311. https://doi.org/10.1177/1478088706070839
Li, J. (2024). The evolution, applications, and future prospects of large language models: An in-depth overview. Applied and Computational Engineering, 35(1), 234–244. https://doi.org/10.54254/2755-2721/35/20230399
Linguaserve (2023, November 24). What is neural machine translation (NMT) and how can it help you? https://www.linkedin.com/pulse/what-neural-machine-translation-nmt-how-can-help-you-linguaserve-nulpf/
Marzuki, A., Widiati, U., Rusdin, D., Darwin, , & Indrawati, I. (2023). The impact of AI writing tools on the content and organization of students’ writing: EFL teachers’ perspective. Cogent Education, 10(2). https://doi.org/10.1080/2331186X.2023.2236469
Micheni, E., Machii, J., & Murumba, J. (2024). The role of Artificial Intelligence in education. Open Journal for Information Technology, 7(1), 43-54. https://doi.org/10.32591/coas.ojit.0701.04043m
Miller, J. & Khera, O. 2017. Digital library adoption and the technology acceptance model: A cross-country analysis. The Electronic Journal of Information System in Developing Countries, 40(1), 1-19. https://doi.org/10.1002/j.1681-4835.2010.tb00288.x
Nguyen, H. H. B., Ngoc, H. H. B., & Dan, T. C. (2024). EFL Students’ Perceptions and Practices of Using ChatGPT for Developing English Argumentative Essay Writing Skills. European Journal of Alternative Education Studies, 9(1), 168-216. http://dx.doi.org/10.46827/ejae.v9i1.5341
Nguyen, T. T. H. (2023). EFL Teachers’ Perspectives toward the Use of ChatGPT in Writing Classes: A Case Study at Van Lang University. International Journal of Language Instruction, 2(3), 1-47. https://doi.org/10.54855/ijli.23231
Novarita, N. (2021). The students’ perception toward using mobile technology for learning English. Edukasi Lingua Sastra, 19(1), 74–82. https://doi.org/10.47637/elsa.v19i1.326
Pham, T. T., Nguyen , L. A. D., Dang, H. M., & Le, T. T. P. (2024). Exploring Tertiary Vietnamese EFL Students’ Engagement in Vocabulary Learning through the Use of an AI Tool. Proceedings of the AsiaCALL International Conference, 4, 129–149. https://doi.org/10.54855/paic.23410
Phan, T. N. L. (2023). Students’ perceptions of the AI technology application in English writing classes. AsiaCALL International Conference, 4, 45–62. https://doi.org/10.54855/paic.2344
Roose, K. (2023, January 12) Don’t ban ChatGPT in schools. Teach with it., The New York Times. https://www.nytimes.com/2023/01/12/technology/chatgpt-schools-teachers.html?smid=url-share
Sah, L. K., Singh, D. R., & Sah, R. K. (2020). Conducting qualitative interviews using virtual communication tools amid Covid-19 pandemic: A learning opportunity for future research. JNMA; Journal of the Nepal Medical Association, 58(232), 1103–1106. https://doi.org/10.31729/jnma.5738
Salloum, S. A., Alhamad, A. Q. M., Al-Emran, M., Monem, A. A., & Shaalan, K. (2019). Exploring students’ acceptance of e-learning through the development of a comprehensive technology acceptance model. IEEE Access, 7, 128445-128462. https://doi.org/10.1109/ACCESS.2019.2939467
Sari, A. N. (2024). Exploring the Potential of Using AI Language Models in Democratising Global Language Test Preparation. International Journal of TESOL & Education, 4(4), 111-126. https://doi.org/10.54855/ijte.24447
Sin Yin, T., Othman, A. R., Sulaiman, S., Mohamed-Ibrahim, M. I., & Razha-Rashid, M. (2016). Application of mean and standard deviation in questionnaire surveys: Construct validation. Jurnal Teknologi, 78(6-4), 99-105. https://doi.org/10.11113/jt.v78.8983
Sumakul, Y. G., Hamied, F. A., & Sukyadi, D. (2022). Students’ perceptions of the use of AI in a writing class. 67th TEFLIN International Virtual Conference & the 9th ICOELT 2021 (TEFLIN ICOELT 2021). https://doi.org/10.2991/assehr.k.220201.009
Tan, Z., Wang, S., Yang, Z., Chen, G., Huang, X., Sun, M., & Liu, Y. (2020). Neural machine translation: A review of methods, resources, and tools. AI Open, 1, 5–21. https://doi.org/10.1016/j.aiopen.2020.11.001
Tran, T. T. H. (2024). AI Tools in Teaching and Learning English Academic Writing Skills. Proceedings of the AsiaCALL International Conference, 4, 170–187. https://doi.org/10.54855/paic.23413
Vasantha Raju, N. N. S. H., & Harinarayana, N. S. (2016, January). Online survey tools: A case study of Google Forms [Conference presentation]. National conference on Scientific, Computational & Information research trends in engineering, GSSS-IETW, Mysore, India.
Vasantha Raju, N., Venkatesh, V., & Bala, H. (2008). Technology acceptance model 3 and a research agenda on interventions. Decision Sciences, 39(2), 273-315. https://doi.org/10.1111/j.1540-5915.2008.00192.x
Wakelin, K. J., McAra-Couper, J., & Fleming, T. (2024). Using an Online Platform for Conducting Face-To-Face Interviews. International Journal of Qualitative Methods, 23, 1-9. https://doi.org/10.1177/16094069241234183
Wittink, D.R. & Bayer, L.R.. (2003). The Measurement Imperative, 6. 14-23. https://www.researchgate.net/publication/292779687_The_Measurement_Imperative
Wu, Y., Schuster, M., Chen, Z., Le, Q., Norouzi, M., Macherey, W., Krikun, M., Cao, Y., Gao, Q., Macherey, K., Klingner, J., Shah, A., Johnson, M., Liu, X., Kaiser, L., Gouws, S., Kudo, T., Kazawa, H., & Dean, J. (2016). Google's neural machine translation system: Bridging the gap between human and machine translation. arXiv.org. https://doi.org/10.48550/arXiv.1609.08144
Xiao, Y., & Zhi, Y. (2023). An Exploratory Study of EFL Learners’ Use of ChatGPT for language learning tasks: Experience and perceptions. Languages, 8(3), 212. https://doi.org/10.3390/languages8030212
Yang, J., Jin, H., Tang, R., Han, X., Feng, Q., Jiang, H., Yin, B., & Hu, X. (2023, April 26). Harnessing the power of LLMs in practice: a survey on ChatGPT and beyond. arXiv.org. https://arxiv.org/abs/2304.13712v2
Ziwei, J., Nayeon, L., Rita, F., Tiehzheng, Y., Dan, S., …Pascal, F. (2022). Survey of hallucination in natural language generation. ACM Computing Surveys, 55(12), 1-38. https://doi.org/10.1145/3571730
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Pham Ngoc Thai Binh, Tran Thi Mai
This work is licensed under a Creative Commons Attribution 4.0 International License.
The copyright of all articles published in the International Journal of TESOL & Education (ijte) remains with the Authors, i.e. Authors retain full ownership of their article. Permitted third-party reuse of the open access articles is defined by the applicable Creative Commons (CC) end-user license which is accepted by the Authors upon submission of their paper. All articles in the ijte are published under the CC BY-NC 4.0 license, meaning that end users can freely share an article (i.e. copy and redistribute the material in any medium or format) and adapt it (i.e. remix, transform and build upon the material) on the condition that proper attribution is given (i.e. appropriate credit, a link to the applicable license and an indication if any changes were made; all in such a way that does not suggest that the licensor endorses the user or the use) and the material is only used for non-commercial purposes.
Authors retain copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution 4.0 International License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository, in a journal or publish it in a book), with an acknowledgment of its initial publication in this journal.
