PLS-SEM Analysis of Students’ AI Use Examining the Impact of Computational Thinking and Deep Learning Skills
Authors
-
Reny Refitaningsih Peby Ria
Universitas Islam Negeri Kiai Ageng Muhammad Besari Ponorogo
-
Nining Anggeraini
Universitas Bumigora
-
Lalu Setia Yuda
Universitas Negeri Yogyakarta
-
Mia Awaliyah
Universitas Negeri Yogyakarta
DOI:
https://doi.org/10.30812/upgrade.v3i2.6159Keywords:
AI Use, Computational Thinking, Deep Learning Skills, PLS-SEMAbstract
The massive integration of generative artificial intelligence (AI) in higher education, particularly in scientific writing, calls for a deeper examination of the cognitive foundations underlying students’ AI use. Although prior research has predominantly focused on AI adoption and attitudes, limited attention has been devoted to modeling the cognitive skills that meaningfully shape AI engagement. Addressing this gap, the present study develops and empirically tests a structural model of students’ AI use by investigating the roles of Computational Thinking (CT) and Deep Learning Skills (DLS).A quantitative correlational research design was employed, involving 273 undergraduate students from three teacher education programs. Data were collected using a structured self-administered questionnaire and analyzed through Partial Least Squares–Structural Equation Modeling (PLS-SEM) to evaluate both the measurement model (reliability and validity) and the structural relationships among constructs. The results indicate that both CT and DLS significantly predict students’ AI use in academic writing, with DLS demonstrating a stronger structural effect. The proposed model explains a moderate proportion of variance in AI utilization, suggesting that higher-order cognitive and learning competencies function as central determinants of effective and responsible AI engagement. These findings contribute theoretically by positioning AI use not merely as a technological adoption issue but as a cognitively grounded learning process. The study further implies that higher education curricula should systematically integrate CT and DLS development to ensure that AI serves as a cognitive augmentation tool that strengthens academic integrity and learning quality.
References
Abosaq, N. (2025). Potentializing Green-IoT, AI and 6G Technologies in Computational Thinking. Yanbu Journal of Engineering and Science, 20(2):26–31. https://doi.org/10.53370/001c.92146.
Alhajji, R. (2024). Assessing the Influence of AI on Modern Student Writing Standards: An Educators’ Perspective. Research Journal in Advanced Humanities, 5(3):375–388. https://doi.org/10.58256/5tpepv73.
Almufarreh, A. (2024). Determinants of Students’ Satisfaction With AI Tools in Education: A PLS-SEM-ANN Approach. Sustainability, 16(13):5354. https://doi.org/10.3390/su16135354.
Asirit, L. B. L. and Hua, J. H. (2023). Converging Perspectives: Assessing AI Readiness and Utilization in Philippine Higher Education. Polaris Global Journal of Scholarly Research and Trends, 2(3):1–50. https: //doi.org/10.58429/pgjsrt.v2n3a152.
Blancia, G. V. V., Fetalvero, E. G., Baldera, P. R., and Mani, M. C. (2024). The Mediating Effects of Artificial Intelligence Literacy on the Association Between Computational Thinking Skills and Organizational Agility Among Secondary School Teachers. Problems of Education in the 21st Century, 82(5):616–629. https: //doi.org/10.33225/pec/24.82.616.
Boadi, E. B., Chen, S., Amponsah, E. I., and Appiah, R. (2022). Antecedents of residential satisfaction in resettlement housing in Ellembelle: A PLS-SEM approach. Sustainability, 14(18):11256. https://doi.org/ 10.3390/su141811256.
Campbell, L. O., Frawley, C., Jones, J. L. T., Cabrera, K. S., and Vizcarra, B. D. (2025). Examining Artificial Intelligence Policies in Counsellor Education. Counselling and Psychotherapy Research, 25(1). https: //doi.org/10.1002/capr.12880.
Choi, J.-I., Yang, E. H. P., and Goo, E.-H. (2024). The Effects of an Ethics Education Program on Artificial Intelligence Among Middle School Students: Analysis of Perception and Attitude Changes. Applied Sciences, 14(4):1588. https://doi.org/10.3390/app14041588.
David, R. M. T. and Maroma, A. P. (2025). Exploring the Integration of ChatGPT in Pre-Service Teacher Education: Benefits, Challenges and Pedagogical Implications. International Journal of Multidisciplinary Applied Business and Education Research, 6(3):1333–1342. https://doi.org/10.11594/ijmaber.06.03.24.
Deb, S. K., Nafi, S. M., Mallik, N., and Valeri, M. (2023). Mediating Effect of Emotional Intelligence on the Relationship Between Employee Job Satisfaction and Firm Performance of Small Business. European Business Review, 35(5):624–651. https://doi.org/10.1108/ebr-12 2022-0249.
Fan, A., Kline, S. F., Liu, Y., and Byrd, K. (2023). Servicescape Effects on Hotel Guests’ Willingness to Pay Premiums at Different Stages of Pandemic: A Multi-Phase Study. Sustainability, 15(21):15252. https: //doi.org/10.3390/su152115252.
Grassini, S. (2023). Shaping the Future of Education: Exploring the Potential and Consequences of AI and ChatGPT in Educational Settings. Education Sciences, 13(7):692. https://doi.org/10.3390/educsci13070692.
Hair, J. F., Hult, G. T. M., Ringle, C. M., Sarstedt, M., Danks, N. P., and Ray, S. (2021). An Introduction to Structural
Equation Modeling. In: Partial Least Squares Structural Equation Modeling (PLS-SEM) Using R. Classroom Companion: Business. Springer, Cham. pages 1–29. https://doi.org/10.1007/978-3-030-80519-7_1.
Haq, M. Z. U., Cao, G., and Abukhait, R. (2025). Examining Students’ Attitudes and Intentions Towards Using ChatGPT in Higher Education. British Journal of Educational Technology, 56(6):2428–2452. https: //doi.org/10.1111/bjet.13582.
Kotsis, K. T. (2025). Legality of Employing Artificial Intelligence for Writing Academic Papers in Education. Journal of Contemporary Philosophical and Anthropological Studies, 3(1). https://doi.org/10.59652/ jcpas.v3i1.375.
Kusumo, Y. W., Simanjuntak, O. S., Wiendijarti, I., and Utami, Y. S. (2024). The Impact of Artificial Intelligence on Thesis Writing Skills and Quality Among Students at UPN "Veteran" Yogyakarta. Jurnal Ilmu Komunikasi, 22(3):346–361. https://doi.org/10.31315/jik.v22i3.14257.
Lane, S., Haley, T., and Brackney, D. E. (2024). Tool or Tyrant: Guiding and Guarding Generative Artificial Intelligence Use in Nursing Education. Creative Nursing, 30(2):125–132. https://doi.org/10.1177/ 10784535241247094.
Li, T. (2025). The Enduring Relevance of Essay Writing in the Age of AI. International Journal of Social Sciences Language and Linguistics, 05(09):1–4. https://doi.org/10.55640/ijssll-05-09-01.
Li, W. (2024). The Influence of Artificial Intelligence on the Education System. Lecture Notes in Education Psychology and Public Media, 65(1):137–142. https://doi.org/10.54254/2753-7048/65/20240158.
Li, X., Wang, S., Li, J., and Li, Z. (2023). A Study of Artificial Intelligence-Assisted Teaching on the Cultivation of Students’ Creative Ability. Applied Mathematics and Nonlinear Sciences, 9(1). https://doi.org/10.2478/ amns.2023.2.01283.
Matueny, R. M. and Nyamai, J. J. (2025). Illusion of Competence and Skill Degradation in Artificial Intelligence Dependency Among Users. International Journal of Research and Scientific Innovation, 12(5):1725–1738. https://doi.org/10.51244/ijrsi.2025.120500163.
Mukunya, D., Nantale, R., Kayemba, F., Ajalo, E., Pangholi, K., Babuya, J., Akuu, S. L., Namiiro, A. M., Tweheyo, R., Ekak, S., Nakitto, B., Nantongo, K., Mpagi, J., Musaba, M. W., Oguttu, F., Kuteesa, J., Mubuuke, A. G., Munabi, I. G., and Kiguli, S. (2025). Utilisation of ChatGPT and Other Artificial Intelligence Tools Among Medical Faculty in Uganda: A Cross-Sectional Study. Mededpublish, 14:245. https://doi.org/10.12688/ mep.20554.3.
Nufus, H., Subyantoro, S., Mardikantoro, H. B., Pristiwati, R., and Zainarthur, H. (2025). Empowering Edupreneur ship Through AI-Based Creative Journalism Education. Journal of Computer Science and Technology Applica tion, 2(2):12–22. https://doi.org/10.33050/corisinta.v2i2.112.
Pancic, M., Serdarusic, H., and Cucic, D. (2023). Green Marketing and Repurchase Intention: Stewardship of Green Advertisement, Brand Awareness, Brand Equity, Green Innovativeness, and Brand Innovativeness. Sustainability, 15(16):12534. https://doi.org/10.3390/su151612534.
Purnama, D. W., Rochman, C. B. A., Darmawan, R., Amaliyah, P., Baqi, A. D., and Zahidin, A. (2023). A Bibliometrics Analysis for Artificial Intelligence Implementation of Employment in Education Institutions. International Journal of Multidisciplinary Research and Analysis, 07(01). https://doi.org/10.47191/ ijmra/v7-i01-02.
Ranabhat, D., Sapkota, P., Malla, S., Shrestha, K., and Ranabhat, M. (2024). Use of ChatGPT and Its Impact on Students’ Learning Experience Among the Students From Higher Education Institutions in Pokhara. Journal of Interdisciplinary Studies, 13(1):59–74. https://doi.org/10.3126/jis.v13i1.73338.
Ria, R. R. P. and Susilowati, D. (2023a). Local Wisdom-based Computational Thinking Diagnostic Test: A Bibliometric Analysis Mapping State-of-the-Art and Research Gaps. Nusantara: Jurnal Pendidikan Indonesia, 3(3):371–394. https://doi.org/10.14421/njpi.2023.v3i3-2.
Ria, R. R. P. and Yuda, L. S. (2025). Efek Chat Generative Pre-training Transformer terhadap Kemampuan Berpikir Kritis dan Computational Thinking Mahasiswa dalam Penulisan Karya Ilmiah di Era Revolusi Industri 5.0. UPGRADE: Jurnal Pendidikan Teknologi Informasi, 2(2):9–19. https://doi.org/10.30812/upgrade. v2i2.4777.
Ria, R. R. P., Yuda, L. S., and Patty, E. N. S. (2025). Bibliometric Insights into Computational Thinking and Green Computing Awareness: Emerging Trends Toward Sustainable Digital Pedagogy (2015–2024). Jurnal Kolaboratif Sains, 8(11):6849–6858. https://doi.org/10.56338/jks.v8i11.9055.
Ria, R. R. P. R. and Susilowati, D. (2023b). Validity and reliability diagnostic test computational thinking based on local wisdom. Jurnal Kependidikan: Jurnal Hasil Penelitian dan Kajian Kepustakaan di Bidang Pendidikan, Pengajaran dan Pembelajaran, 9(4):1142–1149. https://doi.org/10.33394/jk.v9i4.8991.
Saputra, D. N. M. G., Kusuma, I. P. I., and Indrayani, L. (2025). Exploring Pre-Service Teachers’ TPACK Development and Academic Integrity Using ChatGPT. Ijlhe International Journal of Language Humanities and Education, 8(2):729–742. https://doi.org/10.52217/9qnm8841.
Shylla, E. D. (2025). A Study the Advantages and Disadvantages of Using the CHATGPT AI Interface in Academic Research. International Journal of Information Technology and Management, 20(1):189–200. https://doi.org/10.29070/8wetga52.
Subhaktiyasa, P. G. (2024). PLS-SEM for multivariate analysis: A practical guide to educational research using SmartPLS. EduLine: Journal of Education and Learning Innovation, 4(3):353–365. https://doi.org/10. 35877/454RI.eduline2861.
Vaez-Alaei, M., Deniaud, I., Marmier, F., Cowan, R., and Gourc, D. (2024). How Partners’ Knowledge Base and Complexity Are Related to Innovative Project Success: The Roles of Trust and Trust Capability of Partners. International Journal of Project Management, 42(1):102557. https://doi.org/10.1016/j.ijproman. 2023.102557.
Wang, Q., Li, C., and Lu, Z. (October-December, 2024). Analysis on the Acceptance of AIGC Technology by Art and Design Students in Universities in China. Abac Journal, 44(4):218–235. https://doi.org/10.59865/ abacj.2024.57.
Yola, R., Azizah, W., Azizah, N., and Sabarrudin, S. (2024). Implementation of Use Deep Artificial Intelligence (AI) Guidance and Counseling Student Learning Process. Bicc Proceedings, vol.2:138–142. https://doi.org/10.30983/bicc.v1i1.118.
Zafar, S., Shaheen, F., and Rehan, J. (2024). Use of ChatGPT and Generative AI in Higher Education: Opportunities, Obstacles and Impact on Student Performance. Irasd Journal of Educational Research, 5(1):1–12. https://doi.org/10.52131/jer.2024.v5i1.2463.
Zelinski, C., Margaret A. Winker, N., Rakesh Aggarwal, N., Lorraine E. Ferris, N., Markus Heinemann, N., Jose Florencio Lapeña None, J., Sanjay A. Pai, N., Edsel Ing, N., Leslie Citrome, N., Murad Alam, N., Michael Voight, N., and Farrokh Habibzadeh, N. (2023). Chatbots, Generative Ai, and Scholarly Manuscripts Wame Recommendations on Chatbots and Generative Artificial Intelligence in Relation to Scholarly Publications. Journal of Postgraduate Medical Institute, 37(3):221–224. https://doi.org/10.54079/jpmi.37.3.3284.
