The effectiveness of using ChatGPT as a reference source in supporting students' academic courses: an experimental study
DOI:
https://doi.org/10.70000/cj.2025.77.672Keywords:
ChatGPT, Generative Artificial Intelligence, Reference resources, Library and Information StudentsAbstract
The study aims to evaluate the effectiveness of using generative artificial intelligence (ChatGPT) technology as a reference source in supporting the learning of the "Specialized Sources and References" course among fourth-year students in the Libraries and Information Division, Department of Documents, Libraries and Information, Faculty of Arabic Language, Al-Azhar University, Assiut Branch. The study seeks to analyze the extent to which students rely on ChatGPT technology in searching for concepts and reference information, and to compare the content it provides with traditional sources Measuring the impact of its use on developing skills to distinguish between types of sources and references, , identifying the most prominent challenges they face, and proposing mechanisms to employ it effectively in academic specialization. The study followed the experimental approach, and the study sample included (60) students, including (30 students) for the experimental group, which used ChatGPT technology as an auxiliary source in studying the course included in the training program, and the control group (30 students) relied on traditional paper and digital sources, and the data was collected using a controlled questionnaire that was applied before and after, while the results revealed a noticeable improvement in the performance of the experimental group after using ChatGPT The degree of approval of the tool's effectiveness in enhancing comparison skills between sources in terms of reliability and validity increased from (43.3%) to (73.3%), and the arithmetic mean improved from (2.17) to (2.67). The results showed a positive trend towards integrating the tool into curricula, and the effectiveness of training workshops in raising the efficiency of use. The study recommended integrating ChatGPT technology and artificial intelligence tools into courses of a reference and research nature. Organize regular training programs for students and faculty on the proper academic use of artificial intelligence technologies.
References
ʿAbd Rabbih, Īnās Jamīl ʿAbd al-Salām. (2024). Dawr taʿāwun al-maktabāt al-jāmiʿīyah maʿa al-bāḥithīn fī al-dhakāʾ al-iṣṭināʿī: Masār naḥwa al-riyādah wa-al-tamayyuz. al-Majallah al-Urdunīyah lil-Maktabāt wa-al-Maʿlūmāt, 59(4), p.p 53–77.
Abā Ḥusayn, Widād ʿAbd al-Raḥmān, wa ʿUmrī, Nawf bint Ḥasan. (2024). Taṭwīr mahārāt aʿḍāʾ hayʾat al-tadrīs wa-al-bāḥithīn li-istikhdām Chat GPT fī al-taʿlīm al-jāmiʿī: Dirāsah tajrībīyah. Majallat al-Buḥūth al-Tarbawīyah wa-al-Nawʿīyah, 25, p.p 1–26.
Ali, M. Y. (2023). AI ChatGPT applications in libraries – challenges and opportunities. Bilgi ve Belge Araştırmaları, p.p 18–26. https://doi.org/10.26650/bba.2023.20.1364582
ʿĀmirī, Aḥmad ibn Muḥammad. (2024). Dawr taṭbīqāt al-dhakāʾ al-iṣṭināʿī fī taṭwīr adāʾ al-muʿallimīn bi-Salṭanat ʿUmān: ChatGPT anmūdhajan. al-Majallah al-ʿArabīyah lil-Tarbīyah al-Nawʿīyah, 31, p.p 19–36.
Artificial intelligence: Threats and opportunities | News | European Parliament. (2023, June 20). https://www.europarl.europa.eu/news/en/headlines/society/20200918STO87404/artificial-intelligence-threats-and-opportunities
Birāhīm, Amal bint ʿAbd Allāh. (2024). Taṣawwurāt ʿuḍwāt hayʾat al-tadrīs fī Kullīyat al-Tarbīyah li-istikhdām taqniyāt al-dhakāʾ al-iṣṭināʿī al-tawlīdīyah ChatGPT fī al-taʿlīm. al-Majallah al-Dawlīyah lil-Dirāsāt al-Tarbawīyah wa-al-Nafsīyah, 13(4), p.p 758–775.
Cabezas Clavijo, Á., & Sidorenko Bautista, P. (2025, May 23). Assessing the performance of 8 AI chatbots in bibliographic reference retrieval: Grok and DeepSeek outperform ChatGPT, but none are fully accurate. arXiv. https://doi.org/10.48550/arXiv.2505.18059
Cambridge University Press. (n.d.). Artificial intelligence. In Cambridge Dictionary. Retrieved August 7, 2025, from https://dictionary.cambridge.org/dictionary/english/artificial-intelligence
Fāsī, Sufyān, wa Ṣabṭī, ʿUbaydah. (2024). Athar istikhdām taqniyat al-dhakāʾ al-iṣṭināʿī “Chat Gpt” ʿalā al-taḥṣīl al-ʿilmī lil-ṭalabah al-jāmiʿīyīn fī ẓill iqtiṣād al-maʿrifah. Majallat Dirāsāt Iqtiṣādīyah, 18(1), p.p 569–585.
González Espinoza, A., Jebbia, D., & Lan, H. (2025, April 24). Metadata augmentation using NLP, machine learning and AI chatbots: A comparison. arXiv. https://doi.org/10.48550/arXiv.2504.17189
Ḥasanayn, Asmāʾ Sayyid Muḥammad. (2024). Ittijāhāt akhṣāʾī al-maktabāt wa-al-maʿlūmāt bi-Jāmiʿat al-Azhar naḥwa istikhdām taqniyāt al-dhakāʾ al-iṣṭināʿī. Majallat Kullīyat al-Lughah al-ʿArabīyah bi-al-Minūfīyah, 39(1), p.p 2030–2102.
Hindī, Shīrīn Muḥammad Aḥmad ʿUmar. (2023). Taqabbul al-shabāb al-Miṣrī li-istikhdām taqniyat Chat GPT. Majallat al-Buḥūth al-Iʿlāmīyah, 66(1), p.p 9–74.
Ibrāhīm, Muḥammad Saʿd Aḥmad. (2023). al-Manhaj al-tajrībī wa-al-ʿulūm al-insānīyah al-raqmīyah. al-Majallah al-ʿArabīyah li-Buḥūth al-Iʿlām wa-al-Ittiṣāl, 40, p.p 4–7.
Ibrāhīm, Sulaymān ʿAbd al-Wāḥid Yūsuf, wa Faḍlī, Hudā Malūḥ ʿAskar. (2023). Ittijāhāt akhṣāʾī al-maktabāt wa-al-maʿlūmāt al-ʿArab. In Aʿmāl al-Muʾtamar al-ʿIlmī al-Rābiʿ, p.p 290–302.
Ittiḥād al-Dawlī li-Jamʿīyāt wa-Muʾassasāt al-Maktabāt [IFLA]. (2022). al-Qāmūs al-Dawlī li-Muṣṭalaḥāt ʿIlm al-Maktabāt wa-al-Maʿlūmāt. Retrieved from https://www.ifla.org
Khaḍr, Wafāʾ al-Sayyid Muḥammad Sālim. (2024). Fāʿilīyat istikhdām al-taqniyāt al-ḥadīthah. al-Majallah al-Miṣrīyah li-Buḥūth al-Raʾy al-ʿĀmm, 23(1), p.p 117–232.
Madunić, M., & Sovulj, A. (2024). Application of ChatGPT in information literacy instructional design. Journal of Academic Librarianship, 50(2), 102791. https://doi.org/10.1016/j.acalib.2024.102791
Maḥmūd, Sālī Muḥyī al-Dīn Muḥammad. (2019). Taṭbīqāt al-barmajīyāt al-ālīyah. Maktabāt Net, 20(1), p.p 4–12. Retrieved from http://search.mandumah.com/Record/1028776
Maʿmarī, Ḥamzah. (2023). Wāqiʿ istikhdām tiknūlūjiyāt al-maʿlūmāt wa-al-dhakāʾ al-iṣṭināʿī. In Aʿmāl al-Muʾtamar al-ʿIlmī al-Rābiʿ, p.p 303–311.
Maktab al-Dhakāʾ al-Iṣṭināʿī wa-al-Iqtiṣād al-Raqmī wa-Taṭbīqāt al-ʿAmal ʿan Buʿd. (2023). al-Muʿjam al-ʿArabī lil-Dhakāʾ al-Iṣṭināʿī. Available: https://ai.gov.ae/ar/ai-dictionary/
Mīryū, Fīlīb, wa Yūsufī, ʿAbd al-Salām. (2024). Barnāmaj al-muḥādathah ChatGPT. Majallat Fikr, 39, p.p 102–103.
OpenAI. (2023). ChatGPT: Optimizing language models for dialogue. Retrieved from https://openai.com/research/chatgpt
Oyelude, A. A. (2023). Much ado about ChatGPT: Libraries and librarians perspectives. Library Hi Tech News, 40(3), p.p 15–17. https://doi.org/10.1108/LHTN-03-2023-0050
Qarni, ʿAlī Suwayʿid ʿAlī Āl Ḥuraysin. (2024). Athar istikhdām ChatGPT ka-daʿāmah taʿlīmīyah. Majallat al-Jāmiʿah al-Islāmīyah lil-ʿUlūm al-Tarbawīyah wa-al-Ijtimāʿīyah, 18, p.p 11–46.
Qaḥṭānī, ʿAbīr Muḥammad Misfar. (2024). Taḥaddiyāt istikhdām ChatGPT. Majallat al-Tarbīyah, 203(1), p.p 557–593.
Qināwī, Yārah Māhir Muḥammad. (2024). Istikhdām taqniyat ChatGpt ka-adāh dhakīyah. al-Majallah al-Miṣrīyah li-ʿUlūm al-Maʿlūmāt, 11(1), p.p 505–540.
Rahman, A., & Islam, M. A. (2024). The impact of ChatGPT for enhancing knowledge management in university libraries. Education and Information Technologies, 29, Article 12723. https://doi.org/10.1007/s10639-024-12723-x
Ramabina, M. (2023). Exploring the utilisation of ChatGPT in academic libraries: A self-reflection perspective. Regional Journal of Information and Knowledge Management, 9(1), p.p 47–60. https://doi.org/10.70759/3ysrmw78
Ramabina, T. M. (2024). Exploring the utilisation of ChatGPT in academic libraries: A self-reflection perspective. African Journal of Library, Archives and Information Science, 34(1), p.p 17–31.
Sahlī, Khālid ibn Maṭar ibn Sumayr. (2024). Mustawā waʿy aʿḍāʾ hayʾat al-tadrīs. al-Majallah al-ʿIlmīyah li-Kullīyat al-Tarbīyah, 51, p.p 122–156.
Samārah, Hutūf Faraḥ. (2024). Ittijāhāt ṭalabat Jāmiʿat Ḥāʾil. Majallat al-Qirāʾah wa-al-Maʿrifah, 278, p.p 47–71.
Sardūk, ʿAlī. (2020). Istikhdām al-rūbūtāt al-dhakīyah. Majallat Dirāsāt al-Maʿlūmāt wa-al-Tiknūlūjiyā, 3(2), p.p 1–15.
Shuwaynī, Khālid, Sardūk, ʿAlī, wa Ḥammūsh, ʿAbd al-Razzāq. (2024). Tawẓīf taqniyat Chat GPT. Majallat al-Iʿlām wa-al-Mujtamaʿ, 8(1), p.p 403–421.
Ṭalabah, Isrāʾ Usāmah Muḥammad. (2018). Asālīb al-istishhādāt ṣiyāghat al-marjiʿīyah. al-Majallah al-ʿIlmīyah li-Kullīyat al-Ādāb, 65, p.p 101–115.
Tītīlah, Sārah. (2023). Istikhdām taqniyat CHAT GPT. Majallat al-Miʿyār, 27(5), p.p 1319–1332.
Downloads
Additional Files
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Hafez Elewa
This work is licensed under a Creative Commons Attribution 4.0 International License.
