•  
  •  
 

REID (Research and Evaluation in Education)

Keywords

computer-based assessment, digital questionnaire, respondent factors, SIAP application

Document Type

Article

Abstract

Progress in the field of technology often facilitates human work. One of them is progress in the development of questionnaire modes. Currently, existing questionnaires have been based on a digital platform, which makes evaluators easy to design, disseminate, and conduct scoring. All are computer-based, making them reachable by the respondents no matter how far the location of the respondent is, as long as they are connected to the internet. However, any progress is accompanied by several obstacles. For example, the respondents experienced an error in responding to having the intent to respond 'Yes' option but pressing the 'No' button instead. It is very different from filling in paper and pencil based questionnaires in which they are sure to put a checkmark using a pencil on the answer choices. This problem is what the researchers found when distributing digital questionnaires to participants of the National Questions Writing Program based on the 'SIAP' (Sistem Inovatif Aplikasi Penilaian) application. On conditional questions (if you choose 'No', please stop), some respondents who have chosen 'No' answers still respond to the next questions. It causes the data obtained are unreliable. After conducting a more in-depth analysis, the researchers found that respondents' factors as psychological factors are the cause, such as the new experience of accessing applications, understanding of applications, stress, and personal health. Uniquely, the respondents who have problems are those in the context of productive age, i.e 30 to 39 years old, more than five years of teaching experience, postgraduate level, and female.

Page Range

144-151

Issue

2

Volume

5

Digital Object Identifier (DOI)

10.21831/reid.v5i2.26943

Source

https://journal.uny.ac.id/index.php/reid/article/view/26943

References

Ali, M. A. (1994). Identifying the location shift outliers that matter. Sankhyā: The Indian Journal of Statistics, Series A, 56(3), 500-511. Retrieved from https://www.jstor.org/stable/25051015

Cheng, Y. H., & Tsai, C. C. (2017). Online research behaviors of engineering graduate students in Taiwan. Journal of Educational Technology & Society, 20(1), 169-179. Retrieved from https://scholar.lib.ntnu.edu.tw/en/publications/online-research-behaviors-of-engineering-graduate-students-in-tai

Fíncher, C. (1981). AIR between forums: The literature of program evaluation. Research in Higher Education, 14(3), 277-280. Retrieved from https://www.jstor.org/stable/40195416

Harris, H. (2001). Content analysis of secondary data: A study of courage in managerial decision making. Journal of Business Ethics, 34, 191-208. https://doi.org/10.1023/A:1012534014727

Hastomo, F., & Yuhana, U. L. (2013). Perancangan dan pembuatan perangkat lunak aplikasi Android untuk pengolahan data transaksi pada perusahaan telekomunikasi “X“ dengan menggunakan Pentaho. Jurnal Teknik POMITS, 2(1), 77-82. Retrieved from http://ejurnal.its.ac.id/index.php/teknik/article/view/2733

Hornung, C. A. (1977). Social status, status inconsistency and psychological stress. American Sociological Review, 42(4), 623-638. https://doi.org/10.2307/2094560

Hovland, C. I. (1948). Social communication. Proceedings of the American Philosophical Society, 92(5), 371-375. Retrieved from https://www.jstor.org/stable/3143048

Martel, A. R. (2015). The detection of outliers in nondestructive integrations with the Generalized Extreme Studentized Deviate test. Publications of the Astronomical Society of the Pacific, 127, 258-265. Retrieved from https://iopscience.iop.org/article/10.1086/680382/meta

Maynard, D. W. (1988). Language, interaction, and social problems. Social Problems, 35(4), 311-334. https://doi.org/10.2307/800590

McArthur, D. L., & Choppin, B. H. (1984). Computerized diagnostic testing. Journal of Educational Measurement, 21(4), 391-397. https://doi.org/10.1111/j.1745-3984.1984.tb01042.x

McQuarrie, A. D., & Tsai, C.-L. (2003). Outlier detections in autoregressive models. Journal of Computational and Graphical Statistics, 12(2), 450-471. Retrieved from https://www.jstor.org/stable/1391204

Moenir, A. S. (2010). Manajemen pelayanan umum di Indonesia. Jakarta: Bumi Aksara.

Mulyana, A., & Sholekan, S. (2010). Aplikasi mini market online berbasis web. Bandung: Universitas Telkom.

Nezami, E., & Butcher, J. N. (2000). Objective personality assessment. In G. Goldstein & M. Hersen (Eds.), Handbook of Psychological Assessment (3rd ed., pp. 413-435). https://doi.org/10.1016/B978-008043645-6/50094-X

Nulty, D. D. (2008). The adequacy of response rates to online and paper surveys: What can be done? Assessment & Evaluation in Higher Education, 33(3), 301-314. https://doi.org/10.1080/02602930701293231

Onwuegbuzie, A. J., Mayes, E., Arthur, L., Johnson, J., Robinson, V., Ashe, S., “¦ Collins, K. M. T. (2004). Reading comprehension among African American graduate students. The Journal of Negro Education, 73(4), 443-457. https://doi.org/10.2307/4129628

Pangesti, B. N. A. (2017). Analisa kecepatan transfer data pada perancangan hotspot sederhana dengan system single sign on di perkantoran. Fountain of Informatics Journal, 2(1), 1-7. https://doi.org/10.21111/fij.v2i1.814

Parquette, W. S. (1952). Intensive reading. The English Journal, 41(2), 78-82. https://doi.org/10.2307/809208

Prescott, P. (1978). Examination of the behaviour of tests for outliers when more than one outlier is present. Journal of the Royal Statistical Society, Series C (Applied Statistics), 27(1), 10-25. Retrieved from https://www.jstor.org/stable/2346221

Qian, Y., Buchmann, C., & Zhang, Z. (2018). Gender differences in educational adaptation of immigrant-origin youth in the United States. Demographic Research, 38, 1155-1188. https://doi.org/10.4054/DemRes.2018.38.39

Rapallo, F. (2012). Outliers and patterns of outliers in contingency tables with algebraic statistics. Scandinavian Journal of Statistics, 39(4), 784-797. https://doi.org/10.1111/j.1467-9469.2012.00790.x

Reja, U., Manfreda, K. L., Hlebec, V., & Vehovar, V. (2003). Open-ended vs. close-ended questions in web questionnaires. Developments in Applied Statistics / Metodološki Zvezki, 19, 159-177.

Ross, L., & Cronbach, L. J. (1976). Handbook of evaluation research. Educational Researcher, 5(10), 9-19. https://doi.org/10.3102/0013189X005010009

Sevillano-García, M. L., & Vázquez-Cano, E. (2015). The impact of digital mobile devices in higher education. Educational Technology & Society, 18(1), 106-118.

Shubhi, M. M. F., Yuliana, M., & Winarno, I. (2011). Sistem monitoring jaringan menggunakan BREW (Binary Runtime Environment for Wireless). Retrieved from http://repo.pens.ac.id/1077/1/Paper_Sidang_TA.pdf

SIAP Application Development Questionnaire. (n.d.). No Title. Retrieved from https://docs.google.com/forms/d/e/1FAIpQLSemVx0QSQlom5UecJs55aVE2N5kHMcRJSQZTdXHp4EGcT-N-A/viewform

Yanxia, Y. (2017). Test anxiety analysis of Chinese college students in computer-based spoken English test. Journal of Educational Technology & Society, 20(2), 63-73. Retrieved from https://www.jstor.org/stable/90002164

Zamroni, M. (2009). Perkembangan teknologi komunikasi dan dampaknya terhadap kehidupan. Jurnal Dakwah: Media Komunikasi Dan Dakwah, 10(2), 195-211. https://doi.org/10.14421/jd.2009.10205

Download

Share

COinS