Development of SOLO-Based HOTS Assessment in Audio-Video Learning for 3T Vocational Schools: Integrating Religious Moderation in Mentawai
Abstract
Objective: This study aims to develop a High Order Thinking Skills (HOTS) assessment instrument based on the SOLO Taxonomy integrated with religious moderation values in Audio and Video Engineering learning at SMKN 1 Mentawai Islands, the 3T region of Indonesia. This study uses a Research and Development (R&D) approach involving five main stages: preliminary study, design of question grids, content validation by experts, field trials on 30 students, and limited implementation in class. The instrument consists of 30 contextual essay questions developed based on HOTS indicators (analysis, evaluation, creation), SOLO levels (multistructural, relational, extended abstract), and moderation values such as tolerance, cross-faith collaboration, and anti-extremism. The results of content validation using Aiken's V showed a value of ≥ 0.80, while empirical validity was obtained through Pearson correlation with 24 questions in the valid category. The reliability of the instrument reached Cronbach's Alpha 0.87, indicating very high internal consistency. Limited implementation shows that students are able to respond to questions reflectively and critically, and produce works based on diversity values. This study confirms that HOTS-based assessments integrated with religious moderation values are able to form students who think critically and have social awareness. These results recommend the widespread application of similar instruments in vocational education, especially in multicultural and outermost areas, as an effort to build in-depth, contextual, and character-based education.
Abstract View: 12 
PDF Download: 2
SIMILARITY CHECK Download: 1
Metrics
References
Adit, F., Aryanto, J., Fitra Andikos, A., & Andre, L. (2025). Practicality of Developing the Work Based Learning Higher Order Thinking Skills Employability (Wbl-Hotse) Model to Improve Critical Thinking Ability in 3T Regional Vocational High Schools. Data and Metadata, 4. https://doi.org/10.56294/dm2025654
Ahyanuardi, & Efronia, Y. (2022). Pedagogical Competence of Teachers in Planning Vocational High School Learning. Journal of Education Research and Evaluation, 6(3), 468–474. https://doi.org/10.23887/jere.v6i3.41556
Alafnan, M. A. (2025). Enhancing educational outcomes using AlAfnan taxonomy: integrating cognitive, affective, and psychomotor domains. International Journal of Evaluation and Research in Education, 14(3), 2419–2437. https://doi.org/10.11591/ijere.v14i3.33147
Arnadi. (2023). Hotel Pantura Sambas Challenges and Educational Efforts In Reaching Kalimantan Become The Capital City Of The Country Of Indonesia Arnadi 1 Institut Agama. 23–31.
Aryanto, B., Hariono, A., & Pahalawidi, C. (2019). Construct Validity For Talent Identification Test Athletic With Aiken’s V. January 2018. https://doi.org/10.2991/yishpess-cois-18.2018.167
Bello, M. B. (2023). An Understanding of Paulo Freire’s “Pedagogy of the Oppressed.” 15(1), 225–231.
Biggs, H. B. (1982). Evaluating The Quality of learning the SOLO Taxonomy.
Burhanuddin, A., Huda, N., Khoeroni, F., Miftah, M., Musawamah, M., Farmawati, C., Falah, A., Taubah, M., In, M., & Choir ad, A. (2021). Ki Hadjar Dewantara’s Thought About Holistic Education. Turkish Journal of Computer and Mathematics Education, 12(10), 589–611.
Casmudi, C., Sugianto, S., & Maulida, D. T. (2022). Implementation of Teaching Factory Vocational School of Center Of Excellence ( PK ) (Case Study of Learning Aspects of the Culinary and Clothing Expertise Program at SMK Negeri 4 Balikpapan). Budapest International Research and Critics Institute-Journal (BIRCI-Journal), 5(2), 11033–11045. https://bircu-journal.com/index.php/birci/article/view/4921
Fadli, M. R. (2024). Digital Pedagogy Philosophy: Building Critical Awareness of The Role of Technology in Education. Jurnal Filsafat, 34(2), 307. https://doi.org/10.22146/jf.93321
Fakhri, A. A., Sudira, P., & Nicosia, N. (2023). Study of Work-Based Learning Competencies. 13(3), 204–214.
Fauzi, M. R., & Usman, U. (2024). Freire’s Praxis, Democracy and Critical Consciousness in Islamic Education. Jurnal Filsafat, 34(2), 278. https://doi.org/10.22146/jf.93952
Ginting, A. A., & Kuswandono, P. (2020). Challenges Faced by English Teachers: Implementation of Higher Order Thinking Skills (HOTS) in Designing Assignments in East Indonesia. Pedagogy : Journal of English Language Teaching, 8(1), 13. https://doi.org/10.32332/pedagogy.v8i1.1688
Govindasamy, P., Cumming, T. M., & Abdullah, N. (2024). Validity and reliability of a needs analysis questionnaire for the development of a creativity module. Journal of Research in Special Educational Needs , 24(3), 637–652. https://doi.org/10.1111/1471-3802.12659
Hurley, D. J. (2024). Guide to Religion and Belief in the Australian Defence Force. https://www.adfcareers.gov.au/
Kelley, H. H., Marks, L. D., & Dollahite, D. C. (2022). Uniting and Dividing Influences of Religion on Parent–Child Relationships in Highly Religious Families. Psychology of Religion and Spirituality, 14(1), 128–139. https://doi.org/10.1037/rel0000321
Kousloglou, M., Petridou, E., Molohidis, A., & Hatzikraniotis, E. (2023). Promoting Students’ Critical Thinking & Problem Solving Skills Via Mobile-Supported Labs. Proceedings of the International Conferences on E-Society 2023, ES 2023 and Mobile Learning 2023, ML 2023, 367–374. https://doi.org/10.33965/es_ml2023_202302l045
Landorf, H., & Wadley, C. (2022). The importance of John Dewey’s philosophy for global learning theory and practice. Social Studies Research and Practice, 17(1), 6–18. https://doi.org/10.1108/ssrp-09-2021-0027
Leicht, A. Heiss, J. Byun, W. J. (2018). Issues and trends in Education for Sustainable Development. In UNESCO Publishing. https://bangkok.unesco.org/content/unesco-publication-issues-and-trends-education-sustainable-development
Lukman Hakim Saifuddin. (2022). Moderasi Beragama. In Jalsah : The Journal of Al-quran and As-sunnah Studies (Vol. 2, Issue 2). https://doi.org/10.37252/jqs.v2i2.342
Mahabub Mandal, M. (2023). Paulo Freire’s Pedagogy of Liberation: A Critical Analysis and Contemporary Perspectives. International Journal of Research Publication and Reviews Journal Homepage: Www.Ijrpr.Com, 4(7), 2328–2337. www.ijrpr.com
Masuwd, M. (2025). Classical Cooperative Learning Model for Reading Classic Literature : Enhancing Student Independence through Self-Regulation Classical Cooperative Learning Model for Reading Classic Literature : Enhancing Student Independence through Self-Regulation ثحبلا. Izdihar : Journal of Arabic Language Teaching, Linguistics, and Literature, 8(April), 105–120. https://doi.org/10.22219/jiz.v8i1.36829
Nisa, D. K., & Jaya, C. A. (2024). The role of creative learning resource design in enhancing literacy and numeracy skills : A study of the Kampus Mengajar program. 12(2), 123–135.
Putra, T. K., & Abdullah, D. F. (2019). Higher-Order Thinking Skill (Hots) Questions in English National Examination in Indonesia. Jurnal Bahasa Lingua Scientia, 11(1), 178–185. https://doi.org/10.21274/ls.2019.11.1.145-160
Putri, R. F., Sarajwati, M. K. A., Aini, F. A. N., Setiacahyandari, H. K., Dairina, I., & Dewi, A. K. (2023). Formal-Informal Employment and Poverty Dynamics: A Case Study of Mentawai Islands Regency, 2019-2021. IOP Conference Series: Earth and Environmental Science, 1233(1), 2019–2021. https://doi.org/10.1088/1755-1315/1233/1/012034
Putri, S. N., Anak Agung Gede Agung, & I Kadek Suartama. (2023). E-module with the Borg and Gall Model with a Contextual Approach to Thematic Learning. Journal for Lesson and Learning Studies, 6(1), 27–34. https://doi.org/10.23887/jlls.v6i1.57482
Rahayu, S., & Rosawati, E. E. (2023). The development of higher-order thinking skills (HOTS) assessment instrument in chemistry using socioscientific issues context: A preliminary trial. AIP Conference Proceedings, 2572(March). https://doi.org/10.1063/5.0118624
Rinorvian, R., Siringo, R., Firmansyah, J., & Alexander, O. (2024). Implementation of Higher-Order Thinking Skills ( HOTS ) -Based Curriculum in Elementary Education : Enhancing Educational Quality and Student Outcomes. L’Geneus: The Journal Language Generations of Intellectual Society, 13(2), 46–55.
Saifudin, A., Widjanarko, D., & Sudana, I. M. (2021). Journal of Vocational Career Education The Production Unit of the State Vocational High School 1 Warungasem the Department of Motorcycle Engineering and Business. Journal of Vocational Career Education, 6(4), 181–188.
SaThierbach, K., Petrovic, S., Schilbach, S., Mayo, D. J., Perriches, T., Rundlet, E. J. E. J. E. J., Jeon, Y. E., Collins, L. N. L. N., Huber, F. M. F. M., Lin, D. D. H. D. H., Paduch, M., Koide, A., Lu, V. T., Fischer, J., Hurt, E., Koide, S., Kossiakoff, A. A., Hoelz, A., Hawryluk-gara, L. A., … Hoelz, A. (2015). The Relevance of Ki Hajar Dewantara’s Philosophy of Education in Modern Education. Proceedings of the National Academy of Sciences, 3(1), 1–15. http://dx.doi.org/10.1016/j.str.2013.02.005%0
Setiawati, S., Yonariza, Y., Pal, I., Priyono, E., Agustinus, A., & Tasirikeru, A. (2025). Shock and adaption: the economic impact of COVID-19 in the Mentawai Islands, West Sumatra, Indonesia. E3S Web of Conferences, 604. https://doi.org/10.1051/e3sconf/202560402005
Taber, K. S. (2018). The Use of Cronbach’s Alpha When Developing and Reporting Research Instruments in Science Education. Research in Science Education, 48(6), 1273–1296. https://doi.org/10.1007/s11165-016-9602-2
Triana, H., Abustang, P. B., Utomo, E., Rakhman, G. G. F., & Fahrurrozi, F. (2023). Assessment Evaluation Using Solo Taxonomy for Measuring Levels of Critical Thinking Skills: PYP International Baccalaureate Case Study. Prisma Sains : Jurnal Pengkajian Ilmu Dan Pembelajaran Matematika Dan IPA IKIP Mataram, 11(2), 581. https://doi.org/10.33394/j-ps.v11i2.7894
Widiyarto, S., & Purnomo, B. (2023). Freedom to Learn in Ki Hajar Dewantara’s Perspective: Historical Studies and Their Relevance to Character Education. International Journal of Business, Law, and Education, 4(2), 837–844. https://doi.org/10.56442/ijble.v4i2.185
Wijaya, B. P. A., Dewantara, R., & Ruslijanto, P. A. (2022). Legal Aspects of Artificial Intelligence based on Legislation Regulations in Indonesia. International Journal of Multicultural and Multireligious Understanding, 9(10), 372–380. http://ijmmu.comhttp//dx.doi.org/10.18415/ijmmu.v9i10.4198
Wilson, L. O. (2016). Blooms Taxonomy Revised - Understanding the New Version of Bloom’s Taxonomy. A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom’s Taxonomy of Educational Objectives, 1(1), 1–8.
Copyright (c) 2025 Adi Fitra Andikos (Author)
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Abstract viewed = 12 times
PDF downloaded = 2 times
SIMILARITY CHECK downloaded = 1 times
