Students’ Preference in Using Chatbots for Academic Writing

Anand Sasikumar; M V Sunil

doi:10.17485/IJST/v16i36.1850

Article

Students’ Preference in Using Chatbots for Academic Writing

VIEWS 696
PDF 145

Indian Journal of Science and Technology

DOI: 10.17485/IJST/v16i36.1850

Year: 2023, Volume: 16, Issue: 36, Pages: 2912-2919

Original Article

Students’ Preference in Using Chatbots for Academic Writing

Anand Sasikumar¹, M V Sunil^2*

¹Assistant Professor – Operations, SDM Institute for Management Development (SDMIMD), Mysore, Karnataka, India
²Assistant Professor – Systems and General Management, SDM Institute for Management Development (SDMIMD), Mysore, Karnataka, India

*Corresponding Author
Email: [email protected]

Received Date:23 July 2023, Accepted Date:24 August 2023, Published Date:27 September 2023

This work is licensed under a Creative Commons Attribution 4.0 International License.

Abstract

Objective: To study the feature preference(s) in Artificial Intelligence (AI) Chatbots among Post Graduate students in the Commerce and Management domain who have experienced Chatbots for academic writing. Methods: The authors used the combined AHP-TOPSIS method to approach the 214 student’s responses studying in autonomous institutions under the University of Mysore, India. Findings: The results show that the students prefer tools that provide information from authentic sources, followed by tools that are easy to use. Open source and style of presentation are the other preferences. This study has identified the top nine Chatbots identified by the students, and the authors used the AHP (Analytic Hierarchy Process) - TOPSIS (Technique for Order of Preference by Similarity to Ideal Solution) method to present the tools with a defined rank based on priority. Novelty: Authors observed during the literature review that there are research studies that record and discuss the experience of use of Chatbots. However, there needs to be more studies that analyse the user preferences in these AI tools focused on education. Considering the usage of these tools in academic writing, this study stands out and reports the gap in this area.

Keywords: Chatbots; Artificial Intelligence; Content Generative Tools; User Preference Study; AHPTOPSIS Model

References

Tlili A, Shehata B, Adarkwah MA, Bozkurt A, Hickey DT, Huang R, et al. What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education. Smart Learning Environments. 2023;10(15):1–24. Available from: https://doi.org/10.1186/s40561-023-00237-x
Chiu TKF, Moorhouse BL, Chai CS, Ismailov M. Teacher support and student motivation to learn with Artificial Intelligence (AI) based chatbot. Interactive Learning Environments. 2023;p. 1–17. Available from: https://doi.org/10.1080/10494820.2023.2172044
Guo K, Zhong Y, Li D, Chu SKW. Investigating students’ engagement in chatbot-supported classroom debates. Interactive Learning Environments. 2023;p. 1–17. Available from: https://doi.org/10.1080/10494820.2023.2207181
Adiguzel T, Kaya MH, Cansu FK. Revolutionizing education with AI: Exploring the transformative potential of ChatGPT. Contemporary Educational Technology. 2023;15(3):1–13. Available from: https://doi.org/10.30935/cedtech/13152
Essop L, Singh A, Wing J. Developing a comprehensive evaluation questionnaire for university FAQ administration chatbots. In: 2023 Conference on Information Communications Technology and Society (ICTAS). Durban, South Africa, 08-09 March 2023. IEEE. p. 1–7.
Thaiprasert B, Chimprasert P, Saeninyod W, Phattanasri P, Pangarad A. Development of a Class Materials Search System using LINE Chatbot. In: 2023 20th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON). Nakhon Phanom, Thailand, 09-12 May 2023. IEEE. p. 1–4.
Chen Y, Jensen S, Albert LJ, Gupta S, Lee T. Artificial Intelligence (AI) Student Assistants in the Classroom: Designing Chatbots to Support Student Success. Information Systems Frontiers. 2023;25(1):161–182. Available from: https://doi.org/10.1007/s10796-022-10291-4
Lin CCC, Huang AYQ, Yang SJH. A Review of AI-Driven Conversational Chatbots Implementation Methodologies and Challenges (1999–2022) Sustainability. 2023;15(5):1–13. Available from: https://doi.org/10.3390/su15054012
Wu R, Yu Z. Do AI chatbots improve students learning outcomes? Evidence from a meta-analysis. British Journal of Educational Technology. 2023. Available from: https://doi.org/10.1111/bjet.13334
Ade-Ibijola A, Okonkwo C. Artificial Intelligence in Africa: Emerging Challenges. In: Responsible AI in Africa , Social and Cultural Studies of Robots and AI . (pp. 101-117) Springer International Publishing. 2023.
Kılınç S. Embracing the future of distance science education: Opportunities and challenges of ChatGPT integration. Asian Journal of Distance Education. 2023;18(1):205–237. Available from: https://doi.org/10.5281/zenodo.7857396
Khademi A. Can ChatGPT and Bard Generate Aligned Assessment Items? A Reliability Analysis against Human Performance. Journal of Applied Learning and Teaching. 2023;6(1):75–80. Available from: https://doi.org/10.37074/jalt.2023.6.1.28
Kooli C. Chatbots in Education and Research: A Critical Examination of Ethical Implications and Solutions. Sustainability. 2023;15(7):1–15. Available from: https://doi.org/10.3390/su15075614
Chocarro R, Cortiñas M, Marcos-Matás G. Teachers’ attitudes towards chatbots in education: a technology acceptance model approach considering the effect of social language, bot proactiveness, and users’ characteristics. Educational Studies. 2023;49(2):295–313. Available from: https://doi.org/10.1080/03055698.2020.1850426
Xia Q, Chiu TKF, Chai CS, Xie K. The mediating effects of needs satisfaction on the relationships between prior knowledge and self‐regulated learning through artificial intelligence chatbot. British Journal of Educational Technology. 2023;54(4):967–986. Available from: https://doi.org/10.1111/bjet.13305
Saaty TL. Decision making with the analytic hierarchy process. International Journal of Services Sciences. 2008;1(1):83–98. Available from: https://www.rafikulislam.com/uploads/resourses/197245512559a37aadea6d.pdf
Mohammed HJ, Kasim MM, Shaharanee IN. Evaluation of E-Learning Approaches Using AHP-TOPSIS Technique. Journal of Telecommunication, Electronic and Computer Engineering. 2018;10(1-10):7–10. Available from: https://portal.arid.my/Publications/57b6252d-5df6-4472-8c4e-4821f4d90c8a.pdf
Jayant A, Gupta P, Garg SK, Khan M. TOPSIS-AHP Based Approach for Selection of Reverse Logistics Service Provider: A Case Study of Mobile Phone Industry. Procedia Engineering. 2014;97:2147–2156. Available from: https://doi.org/10.1016/j.proeng.2014.12.458
Abdullah S, Almagrabi AO, Ullah I. A New Approach to Artificial Intelligent Based Three-Way Decision Making and Analyzing S-Box Image Encryption Using TOPSIS Method. Mathematics. 2023;11(6):1–19. Available from: https://doi.org/10.3390/math11061559
Alawiah ET, Putri DA. Selection of Independent Curriculum Implementation with the TOPSIS Method. IJISTECH (International Journal of Information System and Technology). 2023;6(6):746–753. Available from: https://doi.org/10.30645/.v6i6.291
Prakash C, Barua MK. Integration of AHP-TOPSIS method for prioritizing the solutions of reverse logistics adoption to overcome its barriers under fuzzy environment. Journal of Manufacturing Systems. 2015;37(Part 3):599–615. Available from: https://doi.org/10.1016/j.jmsy.2015.03.001
Prakash C, Barua MK. Integration of AHP-TOPSIS method for prioritizing the solutions of reverse logistics adoption to overcome its barriers under fuzzy environment. Journal of Manufacturing Systems. 2015;37(Part 3):599–615. Available from: https://doi.org/10.1016/j.jmsy.2015.03.001
Cardona MA, Rodríguez RJ, Ishmael K. Artificial Intelligence and the Future of Teaching and Learning: Insights and Recommendations. 2023. Available from: https://www2.ed.gov/documents/ai-report/ai-report.pdf
Ross EM. Embracing Artificial Intelligence in the Classroom . Harvard Graduate School of Education. Available from: https://www.gse.harvard.edu/ideas/usable-knowledge/23/07/embracing-artificial-intelligence-classroom (accessed 2023-August-9)
Ha YJ, Hendrickson S, Nagy A, Sylvan E, Zick T. Exploring the Impacts of Generative AI on the Future of Teaching and Learning. Berkman Klein Center . Available from: https://cyber.harvard.edu/story/2023-06/impacts-generative-ai-teaching-learning (accessed 2023-August-9)
Marzuki, Widiati U, Rusdin D, Darwin, Indrawati I. The impact of AI writing tools on the content and organization of students’ writing: EFL teachers’ perspective. Cogent Education. 2023;10(2):1–17. Available from: https://doi.org/10.1080/2331186X.2023.2236469
Farrokhnia M, Banihashem SK, Noroozi O, Wals A. A SWOT analysis of ChatGPT: Implications for educational practice and research. Innovations in Education and Teaching International. 2023;p. 1–15. Available from: https://doi.org/10.1080/14703297.2023.2195846
Perera P, Lankathilaka M. AI in Higher Education: A Literature Review of ChatGPT and Guidelines for Responsible Implementation. International Journal of Research and Innovation in Social Science (IJRISS). 2023;VII(VI):306–314. Available from: https://dx.doi.org/10.47772/IJRISS.2023.7623

Copyright

© 2023 Sasikumar & Sunil. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Published By Indian Society for Education and Environment (iSee)