Deteksi Teks Akademik berbasis Generative AI: Studi Akurasi ZeroGPT dan Implikasinya terhadap Keadilan Evaluasi Pembelajaran
DOI:
https://doi.org/10.63863/jce.v3i1.316Keywords:
Artificial Intelligence (AI), ai detector, zero-gpt, integritas akademik, evaluasi pembelajaranAbstract
Integrasi generative ai yang berkembang pesat dalam dunia pendidikan menimbulkan kekhawatiran terhadap integritas akademik, khususnya dalam evaluasi tugas tertulis. Penelitian ini bertujuan untuk menilai akurasi ZeroGPT sebagai alat deteksi teks yang dihasilkan kecerdasan buatan. Penelitian ini menggunakan pengujian dengan model evaluasi klasifikasi kinerja yang diinterpretasikan menggunakan analisa deskriptif kuantitatif dan kualitatif berdasarkan studi literatur. Objek penelitian berupa 80 teks akademik berbahasa Indonesia dengan topik materi evaluasi pembelajaran, secara rinci terdiri dari 40 teks hasil generasi AI dan 40 teks yang ditulis oleh mahasiswa program sarjana. Hasil pengujian menggunakan confussion matriks menunjukkan ZeroGPT mencapai akurasi keseluruhan sebesar 37,5%, dengan tingkat recall sebesar 55% untuk teks hasil AI serta tingkat kesalahan positif palsu (false positive) sebesar 80% pada teks yang ditulis manusia. Temuan ini menunjukkan keterbatasan reliabilitas ZeroGPT, sehingga menjadikannya tidak layak digunakan sebagai alat pendeteksi tunggal penilaian sumatif. Penelitian ini merekomendasikan agar pendidik: (1) menerapkan penelaahan manual dan pertimbangan profesional; (2) menggunakan ZeroGPT semata-mata sebagai alat pendukung; dan (3) merancang evaluasi yang menekankan proses, refleksi, dan pemahaman konseptual guna meminimalkan risiko otomatisasi.
Downloads
References
E. Kasneci et al., “ChatGPT for good? On opportunities and challenges of large language models for education,” Learn. Individ. Differ., vol. 103, p. 102274, 2023, doi: 10.1016/j.lindif.2023.102274.
Y. Zhang and Q. Wang, “AI-generated academic writing and integrity in higher education,” Computers & Education: Artificial Intelligence, vol. 5, p. 100146, 2024, doi: 10.1016/j.caeai.2024.100146.
M. Perkins, J. Roe, and D. Postma, “Detection of AI-generated text in higher education: Reliability and ethical considerations,” Assess. Eval. High. Educ., vol. 48, no. 8, pp. 1239–1254, 2023, doi: 10.1080/02602938.2023.2182337.
M. Sokolova and G. Lapalme, “A systematic analysis of performance measures for classification tasks,” Inf. Process. Manag., vol. 45, no. 4, pp. 427–437, 2009, doi: 10.1016/j.ipm.2009.03.002.
J. W. Creswell, Research design: Qualitative, quantitative, and mixed methods approaches, 5th ed. Thousand Oaks: SAGE Publications, 2018.
D. M. W. Powers, “Evaluation: From precision, recall and F-measure to ROC, informedness, markedness and correlation,” Journal of Machine Learning Technologies, vol. 2, no. 1, pp. 37–63, 2011.
D. Vlachopoulos, “Authentic assessment in higher education: A systematic literature review,” Assess. Educ., vol. 31, no. 1, pp. 1–21, 2024.
P. Sotiriadou, D. Logan, A. Daly, and R. Guest, “The role of authentic assessment in fostering academic integrity,” Assess. Eval. High. Educ., vol. 45, no. 3, pp. 416–431, 2020.
T. Bretag, “A conceptual framework for academic integrity in higher education,” Journal of Higher Education Research & Development, vol. 38, no. 3, pp. 353–365, 2019.
J. Roe and M. Perkins, “Generative AI in Self-Directed Learning: A Scoping Review,” ArXiv, 2024, doi: 10.48550/arXiv.2411.07677.
L. Elsen and A. Rotaru, “Algorithmic detection of AI-generated text: Ethical risks and pedagogical implications,” Comput. Educ., vol. 205, p. 104895, 2024.
D. Kovacevic, “Use of ChatGPT in ESP Teaching Process,” 2023 22nd International Symposium INFOTEH-JAHORINA (INFOTEH), pp. 1–5, 2023, doi: 10.1109/INFOTEH57020.2023.10094133.
W. Kim, “Analysis of the Educational Effects Regarding the Use of ChatGPT in Compulsory Basic Coding Subjects,” The Korean Association of General Education, 2023, doi: 10.46392/kjge.2023.17.5.113.
W. Holmes, K. Porayska-Pomsta, and K. Holstein, “Ethics of AI in Education: Towards Responsible and Trustworthy AI in EdTech,” British Journal of Educational Technology, vol. 53, no. 6, pp. 1623–1639, 2022.
E. Kessler and T. McLaughlin, “AI literacy as a foundation for academic integrity in the age of generative technologies,” J. Acad. Ethics, vol. 21, no. 4, pp. 789–803, 2023.
