REID (Research and Evaluation in Education)
Keywords
development; application; evaluation; teacher performance; smartphone
Document Type
Article
Abstract
This work seeks to design a smartphone application for assessing teacher performance utilizing a 4D development model modified with the Mardapi instrument development model of (1) define (defining); (2) design (deciding instrument requirements, determining application media specifications, creating flowcharts, and creating storyboards); (3) develop (assemble instruments, code, execute tests, evaluate test results, and interpret measurement findings); and (4) disseminate (spread). Proof of the application's viability was established through product testing with 26 principals acting as application users and evaluations by material and media specialists. The content validity of the acquired results was evaluated using the Aiken method, and the construct validity was evaluated using PLS (Partial Least Squares) analysis because the sample size does not have to be large, in accordance with this study where the number of samples is not so large. Using Cronbach's alpha to evaluate the reliability. The results demonstrated that the built application was “possible,“ as proven by the existing instruments in the valid and trustworthy application. This is proven by the fact that the content validity test utilizing the Aiken method yielded good validity results, with a mean score of 0.80 for material experts and 0.75 for media experts. The construct validity test using PLS (Partial Least Squares) yielded positive results for validity. The estimation of reliability using Cronbach's alpha yields positive findings. Therefore, it can be concluded that the developed application for teacher performance evaluation possesses the features of a valid and trustworthy assessment instrument.
Page Range
118-129
Issue
2
Volume
9
Digital Object Identifier (DOI)
10.21831/reid.v9i2.52384
Source
https://journal.uny.ac.id/index.php/reid/article/view/52384
Recommended Citation
Marlianawati, H., Suranto, S., & Kartowagiran, B. (2023). Smartphone application for assessing teacher performance. REID (Research and Evaluation in Education), 9(2), 118-129. https://doi.org/10.21831/reid.v9i2.52384
References
Aiken, L. R. (1985). Three coefficients for analyzing the reliability and validity of ratings. Educational and Psychological Measurement, 45(1), 131-142. https://doi.org/10.1177/0013164485451012
Andrian, D. (2019). Developing an instrument to evaluate the influential factors of the success of local curriculum. REID (Research and Evaluation in Education), 5(1), 75-84. https://doi.org/10.21831/reid.v5i1.23980
Arikunto, S. (2016). Prosedur penelitian: Suatu pendekatan praktik [Research procedures: A practical approach]. Rineka Cipta.
Suranto, S. (2018). Evaluasi program Desa Mandiri Informasi berbasis aplikasi Android Sistem Informasi Desa (Sifordes) [Evaluation of the Independent Information Village program based on the Android Village Information System (Sifordes) application]. Informasi, 48(1), 1-13. https://doi.org/10.21831/informasi.v48i1.20073
Bashooir, K., & Supahar, S. (2018). Validitas dan reliabilitas instrumen asesmen kinerja literasi sains pelajaran fisika berbasis STEM [Validity and reliability of scientific literacy performance assessment instruments in STEM-based physics lessons]. Jurnal Penelitian dan Evaluasi Pendidikan, 22(2), 219-230. https://doi.org/10.21831/pep.v22i2.19590
Cohen, L., Manion, L., & Morrison, K. (2007). Research methods in education (6th ed.). Routllege Falmer.
Djaali, D., Muljono, P., & Ramly, R. (2000). Pengukuran dalam bidang pendidikan [Measurement in the field of education]. Program Pascasarjana Universitas Negeri Jakarta.
Fauziyah, S., & Triyono, M. B. (2020). Pengaruh e-learning Edmodo dengan model blended learning terhadap minat belajar [The influence of Edmodo e-learning with a blended learning model on interest in learning]. Jurnal Kependidikan: Penelitian Inovasi Pembelajaran, 4(1), 112-124. https://doi.org/10.21831/jk.v4i1.27562
Ghozali, I., & Laten, H. (2015). Partial Least Squares: Konsep, teknik dan aplikasi menggunakan program SmartPLS 3.0 [Partial Least Squares: Concepts, techniques and applications using the SmartPLS 3.0 program] (2nd ed.). Badan Penerbit Universitas Diponegoro.
Hair, J. F., Hult, G. T. M., Ringle, C. M., Sarstedt, M., Danks, N. P., & Ray, S. (2021). Partial Least Squares Structural Equation Modeling (PLS-SEM) using R: A workbook. Springer International Publishing. https://doi.org/10.1007/978-3-030-80519-7
Hamid, M. A. (2016). Pengembangan instrumen penilaian hasil belajar siswa berbasis TIK pada pembelajaran dasar listrik elektronika [Development of an ICT-based instrument for assessing student learning outcomes in basic electrical and electronics learning]. VOLT: Jurnal Ilmiah Pendidikan Teknik Elektro, 1(1), 37-46. https://jurnal.untirta.ac.id/index.php/VOLT/article/view/822
Istiyono, E., Dwandaru, W. S. B., Setiawan, R., & Megawati, I. (2020). Developing of computerized adaptive testing to measure physics higher order thinking skills of senior high school students and its feasibility of use. European Journal of Educational Research, 9(1), 91-101. https://doi.org/10.12973/eu-jer.9.1.91
Jong, M. S. (2019). Sustaining the adoption of gamified outdoor social enquiry learning in high schools through addressing teachers' emerging concerns: A 3“year study. British Journal of Educational Technology, 50(3), 1275-1293. https://doi.org/10.1111/bjet.12767
Kaluge, L., Setiasih, S., & Tjahjono, H. (2004). The quality improvement of primary children learning through a school-based programme in Indonesia. A Research Paper, Universitas Surabaya.
Kwong, K., & Wong, K. (2013). Partial Least Squares Structural Equation Modeling (PLS-SEM) techniques using SmartPLS. Marketing Bulletin, 24, 1-32. http://marketing-bulletin.massey.ac.nz
Mehrens, W. A., & Lehmann, I. J. (1973). Measurement and evaluation in education and psychology. Holt, Rinehart and Winston, Inc.
Pradana, Y. F., & Kuswinardi, W. (2020). Rancang bangun aplikasi Android penilaian kinerja guru dengan metode Agile Development di MAN 1 Kabupaten Malang [Design and build an Android application for teacher performance assessment using the Agile Development method at MAN 1 Malang Regency]. Rainstek: Jurnal Terapan Sains dan Teknologi, 2(3), 182-191. https://doi.org/10.21067/jtst.v2i3.4177
Regulation of the Director General of Teachers and Educational Personnels of the Ministry of Education, Culture, Research, and Technology No. 5958/B/HK.03.01/2022 concerning the Technical Guidance of Teacher Assignment as School Principal. (2022).
Regulation of the Minister of Empowerment of State Apparatuses and Bureaucratic Reform No. 16 of 2009 concerning Teachers' Functional Positions and Credit Points. (2009).
Retnowati, T. H., Mardapi, D., Kartowagiran, B., & Suranto, S. (2017). Model evaluasi kinerja dosen: Pengembangan instrumen untuk mengevaluasi kinerja dosen [Lecturer performance evaluation model: Development of instruments to evaluate lecturer performance]. Jurnal Penelitian dan Evaluasi Pendidikan, 21(2), 206-214. https://doi.org/10.21831/pep.v21i2.16626
Saleh, A. M. (2016). Komunikasi dalam kepemimpinan organisasi [Communication in organizational leadership]. Universitas Brawijaya Press.
Sarstedt, M., Ringle, C. M., & Hair, J. F. (2017). Partial Least Square Stuctural Equation Modeling. In C. Homburg, M. Klarmann, & A. Vomberg (eds.), Handbook of market research (Chapter 15). Springer.
Sinaga, A. D., Lubis, J., & Sitanggang, N. (2021). Pengembangan model penilaian kinerja guru tetap SMP Perguruan Buddhist Manjusri Pematang Siantar [Development of a permanent teacher performance assessment model at SMP Perguruan Buddhist Manjusri Pematang Siantar]. Jurnal Serunai Bahasa Indonesia, 18(2), 95-104. https://doi.org/10.37755/jsbi.v18i2.462
Sudjana, N. (2010). Penilaian hasil proses belajar [Assessment of learning process results]. Remaja Rosdakarya.
Utami, N. R., Firdaus, E., Subakti, H., Purba, S., Salamun, S., Avicenna, A., Cecep, H., Cahyadin, W., Sakirman, S., Salim, N. A., Karwanto, K., & Tasrim, I. W. (2021). Supervisi pendidikan [Educational supervision]. Yayasan Kita Menulis.
Yuningsih, I., & Sunhaji, D. (2021). Analisis hasil penilaian kinerja guru [Analysis of teacher performance assessment results]. Educreative: Jurnal Pendidikan Kreativitas Anak, 6(1), 338-346. http://educreative.id/index.php/index