Evaluasi Perkuliahan Daring Menggunakan Metode Naive Bayes dan Post-Study System Usability Questionnaire (PSSUQ)
Authors: Fiarni Cut , Yonata Yosi , Romario Romario 
Published: April 2024

Penularan Covid-19 yang menyebar ke hampir seluruh negara di dunia mempengaruhi berbagai aspek kehidupan manusia. Melalui Surat Edaran Nomor 4 Tahun 2020 Tentang Pelaksanaan Kebijakan Pendidikan Dalam Masa Darurat Penyebaran Covid-19, pemerintah memutuskan untuk mengganti pelaksanaan pembelajaran luring menjadi pembelajaran daring. Perguruan Tinggi XYZ di Kota Bandung telah memiliki Divisi Penjaminan Mutu yang bertugas untuk mengevaluasi pemanfaatan teknologi informasi (TI) untuk proses pembelajaran luring, akan tetapi dibutuhkan pula instrumen evaluasi pemanfaatan TI terkait keseluruhan aspek pembelajaran secara daring. Penelitian ini bertujuan untuk membuat sistem evaluasi pembelajaran daring berdasarkan standar internasional dengan mempertimbangkan aspek kualitas educational system, support system, learner quality, instructor quality, dan information quality. Digunakan metode PSSUQ untuk 4 kategori penilaian dengan 7 skala poin penilaian skala Likert terhadap konsep usabilty teknologi. Sementara itu, metode Naive Bayes digunakan untuk menganalisis polaritas komentar terkait efektivitas pemanfaatan TI pada proses pembelajaran daring. Hasil yang diperoleh dari penelitian terhadap mahasiswa Departemen Sistem Informasi angkatan 2018 dan 2019, didapatkan 18 subkategori berhasil melebih target dengan skor 5,18. Subkategori ease to learn dan ease to use memiliki rata-rata skor tertinggi yaitu 6,30, sedangkan subkategori previous experience memiliki rata-rata skor terendah yaitu 5,26. Untuk pengolahan polaritas komentar mengenai subkategori ease to use, didapatkan sentimen positif sebesar 90,3% yang divisualisasikan menggunakan word cloud. Hasil penelitian ini menunjukkan bahwa dari 24 subkategori aspek penilaian hanya 1 yang masih bernilai di bawah target rata-rata dan pemanfaatan TI pada proses pembelajaran daring tersebut memenuhi tujuan pemanfaatannya. Instrumen evaluasi yang dihasilkan dapat dimanfaatkan sebagai bagian proses penjaminan mutu yang berkelanjutan.

The spread of Covid-19 to almost all countries in the world affects various aspects of human life. Through Circular Letter Number 4 of 2020 concerning the Implementation of Education Policies in the Emergency Period of the Spread of Covid-19, the government decided to change the implementation of offline learning to online learning. XYZ University in Bandung City already has a Quality Assurance Division that is tasked with evaluating the use of information technology (IT) for the offline learning process, but it also needs an IT utilization evaluation instrument related to all aspects of online learning. This research aims to create an online learning evaluation system based on international standards by considering the quality aspects of the educational system, support system, learner quality, instructor quality, and information quality. PSSUQ method is used for 4 assessment categories with a 7-point Likert scale assessment of the technology usability concept. Meanwhile, the Naive Bayes method is used to analyse the polarity of comments related to the effectiveness of IT utilization in the online learning process. The results obtained from research on students of the Department of Information Systems class of 2018 and 2019, obtained 18 subcategories successfully exceeded the target with a score of 5.18. The ease to learn and ease to use subcategories have the highest average score of 6.30, while the previous experience subcategory has the lowest average score of 5.18. The ease to learn and ease to use subcategories have the highest average score of 6.30, while the previous experience subcategory has the lowest average score of 5.26. For processing the polarity of comments regarding the ease to use subcategory, a positive sentiment of 90.3% was obtained, visualized using a word cloud. The results of this study show that out of 24 subcategories of assessment aspects, only 1 is still below the average target and the utilization of IT in the online learning process meets its utilization objectives. The resulting evaluation instrument can be utilized as part of a sustainable quality assurance process.