Instrument Development of Design Thinking Test for Graphic Design Students
Abstract
Objective: Design thinking is one of the methods used to carry out the design process. So, in solving this design problem, design students, especially Graphic Design students, should carry out the stages of design thinking for the work design process. The measurement of design thinking ability is a written exam to get a standardized assessment. This Research aims to describe the development of a design thinking test instrument for graphic design students. Method: The design thinking test instrument consists of 30 multiple-choice questions. After the questions were completed, five experts validated the question. The results of content validation to five experts were analyzed using the Content Validity Ratio. The question was then tested on 30 Unesa Graphic Design students. The results of each question item were tested for validity through the Rasch model with the STATA Program and ConQuest. Results: To test the reliability of the instrument using Cronbach Alpha. The result is CVR scoring between 0.500 and 1.000, and the alpha Reliability value exceeds 0.881. The results of the total item correlation test vary from -0.0391 to 0.465, while the INFIT MNSQ value of the Rasch model starts with a value of 0.500 to 1.300. Novelty: It is concluded that the written test assessment instrument is empirically valid, so the design thinking skills assessment instrument is feasible to use.
Abstract View: 277 
PDF Download: 179
Similarity Check Download: 31
Metrics
References
Altan, B. E., & Tan, S. (2021). Concepts of creativity in design based learning in STEM education. International Journal of Technology and Design Education, 31(3), 503–529. https://doi.org/10.1007/s10798-020-09569-y
Arifin, M. A. (2021). Validating an instrument for competency measurement: The art of using rasch measurement model. International Journal of Academic Research in Business and Social Sciences, 11(6), 1-10. https://doi.org/10.6007/ijarbss/v11-i6/10105
Avinç, E., & Doğan, F. (2024). Digital literacy scale: Validity and reliability study with the Rasch model. Education and Information Technologies, 1-14. https://doi.org/10.1007/s10639-024-12662-7
Azwar, S. (2019). Riliabilitas dan validitas. Pustaka Pelajar.
Balakrishnan, B. (2021). Exploring the impact of design thinking tool among design undergraduates : A study on creative skills and motivation to think creatively. International Journal of Technology and Design Education, 32(3), 1799–1812. https://doi.org/10.1007/s10798-021-09652-y
Calavia, M. B., Blanco, T., & Casas, R. (2021). Fostering creativity as a problem-solving competence through design: Think-Create-Learn, a tool for teachers. Thinking Skills and Creativity, 39, 1-19. https://doi.org/10.1016/j.tsc.2020.100761
Chang, T. S., Wang, H. C., Haynes, A. M., Song, M. M., Lai, S. Y., & Hsieh, S. H. (2022). Enhancing student creativity through an interdisciplinary, project-oriented problem-based learning undergraduate curriculum. Thinking Skills and Creativity, 46, 20-36. https://doi.org/https://doi.org/10.1016/j.tsc.2022.101173
Creswelll, J. W., & Creswell, J. D. (2018). Research design: qualitative, quantitative, and mixed methods approaches (5th ed.). SAGE Publication.
Dell’Era, C., Magistretti, S., Verganti, R., & Zurlo, F. (2020). Four kinds of design thinking : From ideating to making, engaging, and criticizing. Creative Innovation Management, 1(21), 1–21. https://doi.org/10.1111/caim.12353
Eklund, R. A., Navarro Aguiar, U., & Amacker, A. (2022). Design thinking as sensemaking: Developing a pragmatist theory of practice to (re)introduce sensibility. Journal of Product Innovation Management, 39(1), 24–43. https://doi.org/https://doi.org/10.1111/jpim.12604
Guaman-Quintanilla, S., Everaert, P., Chiluiza, K., & Valcke, M. (2023). Impact of design thinking in higher education: a multi-actor perspective on problem solving and creativity. International Journal of Technology and Design Education, 33(1), 217–240. https://doi.org/10.1007/s10798-021-09724-z
Gero, J. S., & Milovanovic, J. (2020). A framework for studying design thinking through measuring designers ’ minds, bodies, and brains. Design Science, 6(19), 1–40. https://doi.org/10.1017/dsj.2020.15
Irmayanti, R., Rusdi, M., & Yusnaidar, Y. (2023). The rasch model: Implementation of physics learning evaluation instrument based on higher order thinking skills. Integrated Science Education Journal, 4(2), 62–68. https://doi.org/10.37251/isej.v4i2.325
Joshi, A., Desai, P., & Tewari, P. (2020). Learning Analytics framework for measuring students’ performance and teachers’ involvement through problem based learning in engineering education. Procedia Computer Science, 172, 954–959. https://doi.org/https://doi.org/10.1016/j.procs.2020.05.138
Khidhir, R. J., & Rassul, T. H. (2023). Assessing the validity of experts’ value judgment over research instruments. ZANCO Journal of Humanity Sciences, 27(5), 324–343. https://doi.org/10.21271/zjhs.27.5.21
Klenner, N. F., Gemser, G., & Karpen, I. O. (2022). Entrepreneurial ways of designing and designerly ways of entrepreneuring: Exploring the relationship between design thinking and effectuation theory. Journal of Product Innovation Management, 39(1), 66–94. https://doi.org/10.1111/jpim.12587
Lin, L., Shadiev, R., Hwang, W. Y., & Shen, S. (2020). From knowledge and skills to digital works: An application of design thinking in the information technology course. Thinking Skills and Creativity, 36, 23-36. https://doi.org/10.1016/j.tsc.2020.100646
McLaughlin, J. E., Chen, E., Lake, D., Guo, W., Skywark, E. R., Chernik, A., & Liu, T. (2022). Design thinking teaching and learning in higher education: Experiences across four universities. PLoS ONE, 17(3), 1–16. https://doi.org/10.1371/journal.pone.0265902
Munna, A. S., & Kalam, M. A. (2021). Teaching and learning process to enhance teaching effectiveness: a literature review. International Journal of Humanities and Innovation (IJHI), 4(1), 1–4. https://doi.org/10.33750/ijhi.v4i1.102
Net, W. W. W. P., Rohmah, E. F., & Wahyuningsih, D. (2024). Content validity by experts judgment thermal and transport concept inventory (TTCI) assessment integrated STEM to measure student’s problem-solving skills. Pegem Journal of Education and Instruction, 14(2), 316–323. https://doi.org/10.47750/pegegog.14.02.36
Oguguo, B. C. E., Nannim, F. A., Agah, J. J., Ugwuanyi, C. S., Ene, C. U., & Nzeadibe, A. C. (2021). Effect of learning management system on Student’s performance in educational measurement and evaluation. Education and Information Technologies, 26(2), 1471–1483. https://doi.org/10.1007/s10639-020-10318-w
Pande, M., & Bharathi, S. V. (2020). Theoretical foundations of design thinking – A constructivism learning approach to design thinking. Thinking Skills and Creativity, 36, 157-189. https://doi.org/10.1016/j.tsc.2020.100637
Pratomo, L. C., Siswandari, & Wardani, D. K. (2021). The effectiveness of design thinking in improving student creativity skills and entrepreneurial alertness. International Journal of Instruction, 14(4), 695–712. https://doi.org/10.29333/iji.2021.14440a
Pressman, A. (2019). Design thinking. Routledge.
Sailer, M., Stadler, M., Schultz-Pernice, F., Franke, U., Schöffmann, C., Paniotova, V., Husagic, L., & Fischer, F. (2021). Technology-related teaching skills and attitudes: Validation of a scenario-based self-assessment instrument for teachers. Computers in Human Behavior, 115, 1-15. https://doi.org/10.1016/j.chb.2020.106625
Saris, B. (2020). A review of engagement with creativity and creative design processes for visual communication design (VCD) learning in china. International Journal of Art & Design Education, 39(2), 306–318. https://doi.org/https://doi.org/10.1111/jade.12262
Sürücü, L., & Maslakçı, A. (2020). Validity and reliability in quantitative research. Business & Management Studies: An International Journal, 8(3), 2694–2726. https://doi.org/10.15295/bmij.v8i3.1540
Taneri, B., & Dogan, F. (2021). How to learn to be creative in design: Architecture students’ perceptions of design, design process, design learning, and their transformations throughout their education. Thinking Skills and Creativity, 39, 100781. https://doi.org/10.1016/j.tsc.2020.100781
Tesio, L., Caronni, A., Simone, A., Kumbhare, D., & Scarano, S. (2024). Interpreting results from Rasch analysis 2. Advanced model applications and the data-model fit assessment. Disability and Rehabilitation, 46(3), 604–617. https://doi.org/10.1080/09638288.2023.2169772
Tessmer, M. (1994). Formative assessment alternatives. Performance Improvement Quarterly, 7(1), 3–18.
Tsai, M., & Wang, C. Y. (2020). Assessing young students ’ design thinking disposition and its relationship with computer programming. Journal of Educational Computing Research, 59(3), 1–19. https://doi.org/10.1177/0735633120967326
Tunç, E. B. (2023). A review of measurement tools developed and adapted based on the rasch model. İnsan ve Sosyal Bilimler Dergisi, 6(2), 249–275. https://doi.org/10.53048/johass.1369336
Urhahne, D., & Wijnia, L. (2021). A review on the accuracy of teacher judgments. Educational Research Review, 32, 12-25. https://doi.org/10.1016/j.edurev.2020.100374
Wilson, D. M., & Narasuman, S. (2020). Investigating teachers’ implementation and strategies on higher order thinking skills in school based assessment instruments. Asian Journal of University Education, 16(1), 70–84. https://doi.org/10.24191/ajue.v16i1.8991
Wolniak, R. (2023). Design thinking and its use to boast innovativeness. Scientific Papers of Silesian University of Technology. Organization and Management Series, 2023(170), 647–662. https://doi.org/10.29119/1641-3466.2023.170.39
Copyright (c) 2024 IJORER : International Journal of Recent Educational Research
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Abstract viewed = 277 times
PDF downloaded = 179 times
Similarity Check downloaded = 31 times
