Stabilitas Struktur Faktor Instrumen Literasi Digital Mahasiswa Sebelum dan Sesudah Transformasi Metode Summated Rating Scale

Andi Auliyah Warsyidah; Faridah Agus Setiawati; Edi Istiyono; Widihastuti Widihastuti

doi:10.59698/afeksi.v7i6.1040

Authors

Andi Auliyah Warsyidah UIN Alauddin Makassar, Indonesia
Faridah Agus Setiawati Universitas Negeri Yogyakarta, Indonesia
Edi Istiyono Universitas Negeri Yogyakarta, Indonesia
Widihastuti Widihastuti Universitas Negeri Yogyakarta, Indonesia

DOI:

https://doi.org/10.59698/afeksi.v7i6.1040

Keywords:

Analisis Faktor Eksploratori, Instrumen, Literasi Digital, MSRS, Transformasi Skala

Abstract

Instrumen literasi digital sering menggunakan respons tipe Likert, sedangkan sifat ordinal data tersebut menimbulkan pertanyaan apakah transformasi skor mengubah struktur laten yang diperoleh melalui exploratory factor analysis (EFA). Penelitian ini mengevaluasi kestabilan instrumen literasi digital mahasiswa yang terdiri atas 53 butir sebelum dan sesudah transformasi menggunakan Method of Summated Rating Scale (MSRS). Data diperoleh melalui kuesioner daring empat kategori yang diisi oleh 280 mahasiswa dari berbagai universitas di Indonesia. Instrumen sebelumnya ditelaah oleh lima ahli dan memperoleh koefisien validitas isi Aiken’s V = 0,98. EFA dilakukan dengan ekstraksi maximum likelihood dan rotasi varimax pada skor asli serta skor hasil transformasi MSRS. Selain membandingkan kecukupan data, struktur faktor, loading, dan konsistensi internal, matriks loading yang dilaporkan dianalisis kembali menggunakan korelasi, selisih absolut, dan root mean square error. Kedua data menghasilkan KMO = 0,91, uji Bartlett yang signifikan (p < 0,001), 12 faktor, dan alpha Cronbach = 0,95. Stabilitas loading tergolong tinggi (r = 0,915; rho = 0,944), dengan median selisih absolut 0,010, rerata selisih absolut 0,026, dan RMSE = 0,061; sebanyak 52 dari 53 butir berubah tidak lebih dari 0,10. Butir B_47 merupakan pengecualian utama karena loading meningkat dari 0,48 menjadi 0,88 dan perlu diverifikasi. Temuan menunjukkan kestabilan struktur pada tingkat makro setelah transformasi MSRS, tetapi tidak membuktikan bahwa data Likert ordinal selalu setara dengan data interval ataupun bahwa instrumen bersifat unidimensional. Validasi lanjutan perlu menggunakan korelasi polikorik, estimator ordinal, parallel analysis, rotasi oblique, reliabilitas omega, dan pengujian konfirmatori pada sampel independen.

References

Avinç, E. (2024). Digital literacy scale: Validity and reliability study with the Rasch model. Education and Information Technologies, 29(17), 22895–22941. https://doi.org/10.1007/s10639-024-12662-7

Basilotta-Gómez-Pablos, V., Matarranz, M., Casado-Aranda, L.-A., & Otto, A. (2022). Teachers’ digital competencies in higher education: A systematic literature review. International Journal of Educational Technology in Higher Education, 19, Article 8. https://doi.org/10.1186/s41239-021-00312-8

Boateng, G. O., Neilands, T. B., Frongillo, E. A., Melgar-Quiñonez, H. R., & Young, S. L. (2018). Best practices for developing and validating scales for health, social, and behavioral research: A primer. Frontiers in Public Health, 6, Article 149. https://doi.org/10.3389/fpubh.2018.00149

Buchan, M. C., Bhawra, J., & Katapally, T. R. (2024). Navigating the digital world: Development of an evidence-based digital literacy program and assessment tool for youth. Smart Learning Environments, 11, Article 8. https://doi.org/10.1186/s40561-024-00293-x

Chang, C.-Y., & Kuo, H.-C. (2025). The development and validation of the digital literacy questionnaire and the evaluation of students’ digital literacy. Education and Information Technologies, 30(9), 11549–11581. https://doi.org/10.1007/s10639-024-13216-7

Cosemans, T., Rosseel, Y., & Gelper, S. (2022). Exploratory graph analysis for factor retention: Simulation results for continuous and binary data. Educational and Psychological Measurement, 82(5), 880–910. https://doi.org/10.1177/00131644211059089

Falloon, G. (2020). From digital literacy to digital competence: The teacher digital competency (TDC) framework. Educational Technology Research and Development, 68, 2449–2472. https://doi.org/10.1007/s11423-020-09767-4

Febriana, B. W., & Setiawati, F. A. (2024). Increasing measurement accuracy: Scaling effect on academic resilience instrument using Method of Successive Interval (MSI) and Method of Summated Rating Scale (MSRS). Jurnal Penelitian dan Evaluasi Pendidikan, 28(1), 32–42. https://doi.org/10.21831/pep.v28i1.69334

Flora, D. B. (2020). Your coefficient alpha is probably wrong, but which coefficient omega is right? A tutorial on using R to obtain better reliability estimates. Advances in Methods and Practices in Psychological Science, 3(4), 484–501. https://doi.org/10.1177/2515245920951747

Foldnes, N., & Grønneberg, S. (2020). Pernicious polychorics: The impact and detection of underlying non-normality. Structural Equation Modeling: A Multidisciplinary Journal, 27(4), 525–543. https://doi.org/10.1080/10705511.2019.1673168

Godaert, E., Aesaert, K., Voogt, J., & van Braak, J. (2022). Assessment of students’ digital competences in primary school: A systematic review. Education and Information Technologies, 27(7), 9953–10011. https://doi.org/10.1007/s10639-022-11020-9

Goretzko, D. (2025). How many factors to retain in exploratory factor analysis? A critical overview of factor retention methods. Psychological Methods. https://doi.org/10.1037/met0000733

Goretzko, D., Pham, T. T. H., & Bühner, M. (2021). Exploratory factor analysis: Current use, methodological developments and recommendations for good practice. Current Psychology, 40(7), 3510–3521. https://doi.org/10.1007/s12144-019-00300-2

Harpe, S. E. (2015). How to analyze Likert and other rating scale data. Currents in Pharmacy Teaching and Learning, 7(6), 836–850. https://doi.org/10.1016/j.cptl.2015.08.001

Hayes, A. F., & Coutts, J. J. (2020). Use omega rather than Cronbach’s alpha for estimating reliability. But…. Communication Methods and Measures, 14(1), 1–24. https://doi.org/10.1080/19312458.2020.1718629

Hübner, N., Fahrbach, T., Lachner, A., & Scherer, R. (2023). What predicts students’ future ICT literacy? Evidence from a large-scale study conducted in different stages of secondary school. Computers & Education, 203, Article 104847. https://doi.org/10.1016/j.compedu.2023.104847

Jebb, A. T., Ng, V., & Tay, L. (2021). A review of key Likert scale development advances: 1995–2019. Frontiers in Psychology, 12, Article 637547. https://doi.org/10.3389/fpsyg.2021.637547

Jin, K.-J., Reichert, F., Cagasan, L. P., Jr., de la Torre, J., & Law, N. (2020). Measuring digital literacy across three age cohorts: Exploring the dimensionality and performance differences. Computers & Education, 157, Article 103968. https://doi.org/10.1016/j.compedu.2020.103968

Khan, N., Sarwar, A., Chen, T. B., & Khan, S. (2022). Connecting digital literacy in higher education to the 21st century workforce. Knowledge Management & E-Learning, 14(1), 46–61. https://doi.org/10.34105/j.kmel.2022.14.004

Lazonder, A. W., Walraven, A., Gijlers, H., & Janssen, N. (2020). Longitudinal assessment of digital literacy in children: Findings from a large Dutch single-school study. Computers & Education, 143, Article 103681. https://doi.org/10.1016/j.compedu.2019.103681

Markos, A., & Tsigilis, N. (2024). Dimensionality assessment in ordinal data: A comparison between parallel analysis and exploratory graph analysis. Frontiers in Psychology, 15, Article 1359111. https://doi.org/10.3389/fpsyg.2024.1359111

Marôco, J. (2024). Factor analysis of ordinal items: Old questions, modern solutions?. Stats, 7(3), 984–1001. https://doi.org/10.3390/stats7030060

Mieg, H. A., Klieme, K. E., Barker, E., Bryan, J., Gibson, C., Haberstroh, S., Odebiyi, F., Rismondo, F.-P., Römmer-Nossek, B., Thiem, J., & Unterpertinger, E. (2024). Short digital-competence test based on DigComp2.1: Does digital competence support research competence in undergraduate students?. Education and Information Technologies, 29(1), 139–160. https://doi.org/10.1007/s10639-023-12251-0

Pan, Q., Reichert, F., de la Torre, J., & Law, N. (2022). Measuring digital literacy during the COVID-19 pandemic: Experiences with remote assessment in Hong Kong. Educational Measurement: Issues and Practice, 41(1), 46–50. https://doi.org/10.1111/emip.12498

Pan, Q., Reichert, F., Liang, Q., de la Torre, J., & Law, N. (2025). Measuring digital literacy across ages and over time: Development and validation of a performance-based assessment. Education and Information Technologies, 30, 22065–22100. https://doi.org/10.1007/s10639-025-13592-8

Pedaste, M., Kallas, K., & Baucal, A. (2023). Digital competence test for learning in schools: Development of items and scales. Computers & Education, 203, Article 104830. https://doi.org/10.1016/j.compedu.2023.104830

Polizzi, G. (2020). Digital literacy and the national curriculum for England: Learning from how the experts engage with and evaluate online content. Computers & Education, 152, Article 103859. https://doi.org/10.1016/j.compedu.2020.103859

Reichert, F., Zhang, D. J., Law, N. W. Y., Wong, G. K. W., & de la Torre, J. (2020). Exploring the structure of digital literacy competence assessed using authentic software applications. Educational Technology Research and Development, 68(6), 2991–3013. https://doi.org/10.1007/s11423-020-09825-x

Schreiber, J. B. (2021). Issues and recommendations for exploratory factor analysis and principal component analysis. Research in Social and Administrative Pharmacy, 17(5), 1004–1011. https://doi.org/10.1016/j.sapharm.2020.07.027

Schwarz, S., Bieg, T., Svecnik, E., Schmölz, A., Geppert, C., & Gerdenitsch, C. (2024). Digital Competence Scale (DCS): A short self-assessment instrument for measuring digital competences. Nordic Journal of Digital Literacy, 19(3), 126–143. https://doi.org/10.18261/njdl.19.3.2

Sumin, Sukmawati, F., Setiawati, F. A., & Asmawi, S. (2022). The impact of Z-score transformation scaling on the validity, reliability, and measurement error of instrument SATS-36. JP3I (Jurnal Pengukuran Psikologi dan Pendidikan Indonesia), 11(2), 166–180. https://doi.org/10.15408/jp3i.v11i2.26591

Taber, K. S. (2018). The use of Cronbach’s alpha when developing and reporting research instruments in science education. Research in Science Education, 48, 1273–1296. https://doi.org/10.1007/s11165-016-9602-2

Tinmaz, H., Lee, Y.-T., Fanea-Ivanovici, M., & Baber, H. (2022). A systematic review on digital literacy. Smart Learning Environments, 9, Article 21. https://doi.org/10.1186/s40561-022-00204-y

Watkins, M. W. (2018). Exploratory factor analysis: A guide to best practice. Journal of Black Psychology, 44(3), 219–246. https://doi.org/10.1177/0095798418771807

Zhao, Y., Sánchez Gómez, M. C., Pinto Llorente, A. M., & Zhao, L. (2021). Digital competence in higher education: Students’ perception and personal factors. Sustainability, 13(21), Article 12184. https://doi.org/10.3390/su132112184

Zhou, X., Sun, K., Zhu, K., Feng, L., Sun, Q., & Zhong, D. (2025). The impact of digital literacy on university students’ innovation capability: Evidence from Ningbo, China. Frontiers in Psychology, 16, Article 1548817. https://doi.org/10.3389/fpsyg.2025.1548817