•  
  •  
 

REID (Research and Evaluation in Education)

Keywords

peer assessment, pre-instructional activities, perceptions, Statistical Methods, higher education

Document Type

Article

Abstract

There has been strong interest among higher education institution in implementing technology-enhanced peer assessment as a tool for enhancing students' learning. However, little is known on how to use the peer assessment system in pre-instructional activities. This study aims to explore how technology-enhanced peer assessment can be embedded into pre-instructional activities to enhance students' learning. Therefore, the present study was an explorative descriptive study that used the qualitative approach to attain the research aim. This study used a questionnaire, students' reflections, and interview in collecting student's perceptions toward the interventions. The results suggest that the technology-enhanced pre-instructional peer assessment helps students to prepare the new content acquisition and become a source of students' motivation in improving their learning performance for the following main body of the lesson. A set of practical suggestions is also proposed for designing and implementing technology-enhanced pre-instructional peer assessment.

Page Range

105-116

Issue

2

Volume

4

Digital Object Identifier (DOI)

10.21831/reid.v4i2.20951

Source

https://journal.uny.ac.id/index.php/reid/article/view/20951

References

Alfieri, L., Nokes-Malach, T. J., & Schunn, C. D. (2013). Learning through case comparisons: A meta-analytic review. Educational Psychologist, 48(2), 87-113. https://doi.org/10.1080/00461520.2013.775712

Ashton, S., & Davies, R. S. (2015). Using scaffolded rubrics to improve peer assessment in a MOOC writing course. Distance Education, 36(3), 312-334. https://doi.org/10.1080/01587919.2015.1081733

Bluman, A. G. (2012). Elementary statistics: A step by step approach (8th ed.). New York, NY: McGraw-Hill.

Brindley, C., & Scoffield, S. (1998). Peer assessment in undergraduate programmes. Teaching in Higher Education, 3(1), 79-90. https://doi.org/10.1080/1356215980030106

Chen, Y., & Tsai, C. (2009). An educational research course facilitated by online peer assessment. Innovations in Education and Teaching International, 46(1), 105-117. https://doi.org/10.1080/14703290802646297

Cheng, W., & Warren, M. (1999). Peer and teacher assessment of the oral and written tasks of a group project. Assessment & Evaluation in Higher Education, 24(3), 301-314. https://doi.org/10.1080/0260293990240304

Chi, M. T. H. (1996). Constructing self-explanations and scaffolded explanations in tutoring. Applied Cognitive Psychology, 10(7), 33-49. https://doi.org/10.1002/(SICI)1099-0720(199611)10:7<33::AID-ACP436>3.0.CO;2-E

Cho, K., Schunn, C. D., & Wilson, R. W. (2006). Validity and reliability of scaffolded peer assessment of writing from instructor and student perspectives. Journal of Educational Psychology, 98(4), 891-901. https://doi.org/10.1037/0022-0663.98.4.891.supp

Conner, K. (2015). Investigating diagnostic preassessments. Mathematics Teacher, 108(7), 536-542.

Davies, P. (2000). Computerized peer assessment. Innovations in Education and Training International, 37(4), 346-355. https://doi.org/10.1080/135580000750052955

Davies, R., & Berrow, T. (1998). An evaluation of the use of computer supported peer review for developing higher-level skills. Computers & Education, 30(1), 111-115.

Dick, W., Carey, L., & Carey, J. O. (2015). Systematic design of instruction (8th ed.). Boston, MA: Pearson.

Dooley, J. F. (2009). Peer assessments using the moodle workshop tool. In Proceedings of the 14th Annual ACM SIGCSE Conference on Innovation and Technology in Computer Science Education (Vol. 41, pp. 344-344). New York, NY: ACM. https://doi.org/10.1145/1562877.1562985

Friese, S. (2014). Qualitative data analysis with ATLAS.ti (2nd ed.). London: SAGE.

Gagné, R. M., Briggs, L. J., & Wager, W. W. (1992). Principles of instructional design (4th ed.). Fort Worth, TX: Harcourt Brace College.

Gibbs, G. (1988). Learning by doing: A guide to teaching and learning methods. London: FEU.

Gielen, M., & De Wever, B. (2015). Structuring the peer assessment process: A multilevel approach for the impact on product improvement and peer feedback quality. Journal of Computer Assisted Learning, 31(5), 435-449. https://doi.org/10.1111/jcal.12096

Haaga, D. A. F. (1993). Peer review of term papers in graduate psychology courses. Teaching of Psychology, 20(1), 28-32. https://doi.org/10.1207/s15328023top2001_5

Hafner, J., & Hafner, P. (2003). Quantitative analysis of the rubric as an assessment tool: An empirical study of student peer“group rating. International Journal of Science Education, 25(12), 1509-1528. https://doi.org/10.1080/0950069022000038268

Hanrahan, S. J., & Isaacs, G. (2001). Assessing self- and peer-assessment: The students' views. Higher Education Research & Development, 20(1), 53-70. https://doi.org/10.1080/07294360123776

Hwang, G.-J., Hung, C.-­Ming, & Chen, N.-S. (2014). Improving learning achievements, motivations and problem-solving skills through a peer assessment-­based game development approach. Educational Technology Research and Development, 62(2), 129-145.

Jenkins, M. (2005). Unfulilled Promise: Formative assessment using computer-aided assessment. Learning and Teaching in Higher Education, (1), 67-80.

Jones, I., & Alcock, L. (2014). Peer assessment without assessment criteria. Studies in Higher Education, 39(10), 1774-1787. https://doi.org/10.1080/03075079.2013.821974

Jonsson, A., & Svingby, G. (2007). The use of scoring rubrics: Reliability, validity and educational consequences. Educational Research Review, 2(2), 130-144. https://doi.org/10.1016/J.EDUREV.2007.05.002

Jungić, V., Kaur, H., Mulholland, J., & Xin, C. (2015). On flipping the classroom in large first year calculus courses. International Journal of Mathematical Education in Science and Technology, 46(4), 508-520. https://doi.org/10.1080/0020739X.2014.990529

Kwok, R. C. W., & Ma, J. (1999). Use of a group support system for collaborative assessment. Computers & Education, 32(2), 109-125.

Lee, A. Y., & Hutchison, L. (1998). Improving learning from examples through reflection. Journal of Experimental Psychology: Applied, 4(3), 187-210. https://doi.org/10.1037/1076-898X.4.3.187

Liu, E. Z.-F., Lin, S. S. J., Chiu, C.-H., & Yuan, S.-M. (2001). Web-based peer review: The learner as both adapter and reviewer. IEEE Transactions on Education, 44(3), 246-251. https://doi.org/10.1109/13.940995

Liu, N.-F., & Carless, D. (2006). Peer feedback: The learning element of peer assessment. Teaching in Higher Education, 11(3), 279-290. https://doi.org/10.1080/13562510600680582

Loch, B., Jordan, C. R., Lowe, T. W., & Mestel, B. D. (2014). Do screencasts help to revise prerequisite mathematics? An investigation of student performance and perception. International Journal of Mathematical Education in Science and Technology, 45(2), 256-268. https://doi.org/10.1080/0020739X.2013.822581

Love, B., Hodge, A., Corritore, C., & Ernst, D. C. (2015). Inquiry-based learning and the flipped classroom model. PRIMUS: Problems, Resources, and Issues in Mathematics Undergraduate Studies, 25(8), 745-762. https://doi.org/10.1080/10511970.2015.1046005

Mowl, G., & Pain, R. (1995). Using self and peer assessment to improve students' essay writing: A case study from geography. Innovations in Education and Training International, 32(4), 324-335. https://doi.org/10.1080/1355800950320404

Nastasi, B. K., & Clements, D. H. (1992). Social-cognitive behaviors and higher-order thinking in educational computer environments. Learning and Instruction, 2(3), 215-238. https://doi.org/10.1016/0959-4752(92)90010-J

Nicol, D. J., & Macfarlane-Dick, D. (2006). Formative assessment and self-regulated learning: A model and seven principles of good feedback practice. Studies in Higher Education, 31(2), 199-218.

Patchan, M. M., Schunn, C. D., & Clark, R. J. (2018). Accountability in peer assessment: Examining the effects of reviewing grades on peer ratings and peer feedback. Studies in Higher Education, 43(12), 2263-2278. https://doi.org/10.1080/03075079.2017.1320374

Peter, E. E. (2012). Critical thinking: Essence for teaching mathematics and mathematics problem solving skills. African Journal of Mathematics and Computer Science Research, 5(3), 39-43. https://doi.org/10.5897/AJMCSR11.161

Reinholz, D. (2016). The assessment cycle: A model for learning through peer assessment. Assessment & Evaluation in Higher Education, 41(2), 301-315. https://doi.org/10.1080/02602938.2015.1008982

Scott, F. J. (2017). A simulated peer-assessment approach to improve students' performance in numerical problem-solving questions in high school biology. Journal of Biological Education, 51(2), 107-122. https://doi.org/10.1080/00219266.2016.1177571

Sheatsley, P. B. (1983). Questionnaire construction and item writing. In P. H. Rossi, J. D. Wright, & A. B. Anderson (Eds.), Handbook of survey research (pp. 195-230). New York, NY: Academic Press.

Silver, H. F. (2010). Compare & contrast: Teaching comparative thinking to strengthen student learning (A strategic teacher PLC guide). Alexandria, VA: Association for Supervision & Curriculum Development.

Stefani, L. A. J. (1994). Peer, self and tutor assessment: Relative reliabilities. Studies in Higher Education, 19(1), 69-75. https://doi.org/10.1080/03075079412331382153

Strang, K. D. (2013). Determining the consistency of student grading in a Hybrid Business course using a LMS and statistical software. International Journal of Web-Based Learning and Teaching Technologies (IJWLTT), 8(2), 58-76. https://doi.org/10.4018/jwltt.2013040103

Sun, D. L., Harris, N., Walther, G., & Baiocchi, M. (2015). Peer assessment enhances student learning: The results of a matched randomized crossover experiment in a college statistics class. PLoS ONE, 10(12), e0143177. https://doi.org/10.1371/journal.pone.0143177

Tanner, H., & Jones, S. (1994). Using peer and self-assessment to develop modelling skills with students aged 11 to 16: A socio-constructive view. Educational Studies in Mathematics, 27(4), 413-431. https://doi.org/10.1007/BF01273381

Topping, K. (1998). Peer assessment between students in colleges and universities. Review of Educational Research, 68(3), 249-276. https://doi.org/10.3102/00346543068003249

Triola, M. F. (2012). Elementary statistics technology update (11th ed.). Boston, MA: Addison-Wisley.

van Woerkom, M. (2010). Critical reflection as a rationalistic ideal. Adult Education Quarterly, 60(4), 339-356. https://doi.org/10.1177/0741713609358446

Wain, A. (2017). Learning through reflection. British Journal of Midwifery, 25(10), 662-666. https://doi.org/10.12968/bjom.2017.25.10.662

Wen, M. L., & Tsai, C.-C. (2006). University students' perceptions of and attitudes toward (online) peer assessment. Higher Education, 51(1), 27-44. https://doi.org/10.1007/s10734-004-6375-8

Willey, K., & Gardner, A. (2010). Investigating the capacity of self and peer assessment activities to engage students and promote learning. European Journal of Engineering Education, 35(4), 429-443. https://doi.org/10.1080/03043797.2010.490577

Yang, Y.-F., & Tsai, C.-C. (2010). Conceptions of and approaches to learning through online peer assessment. Learning and Instruction, 20(1), 72-83.

Alfieri, L., Nokes-Malach, T. J., & Schunn, C. D. (2013). Learning through case comparisons: A meta-analytic review. Educational Psychologist, 48(2), 87-113. https://doi.org/10.1080/00461520.2013.775712

Ashton, S., & Davies, R. S. (2015). Using scaffolded rubrics to improve peer assessment in a MOOC writing course. Distance Education, 36(3), 312-334. https://doi.org/10.1080/01587919.2015.1081733

Bluman, A. G. (2012). Elementary statistics: A step by step approach (8th ed.). New York, NY: McGraw-Hill.

Brindley, C., & Scoffield, S. (1998). Peer assessment in undergraduate programmes. Teaching in Higher Education, 3(1), 79-90. https://doi.org/10.1080/1356215980030106

Chen, Y., & Tsai, C. (2009). An educational research course facilitated by online peer assessment. Innovations in Education and Teaching International, 46(1), 105-117. https://doi.org/10.1080/14703290802646297

Cheng, W., & Warren, M. (1999). Peer and teacher assessment of the oral and written tasks of a group project. Assessment & Evaluation in Higher Education, 24(3), 301-314. https://doi.org/10.1080/0260293990240304

Chi, M. T. H. (1996). Constructing self-explanations and scaffolded explanations in tutoring. Applied Cognitive Psychology, 10(7), 33-49. https://doi.org/10.1002/(SICI)1099-0720(199611)10:7<33::AID-ACP436>3.0.CO;2-E

Cho, K., Schunn, C. D., & Wilson, R. W. (2006). Validity and reliability of scaffolded peer assessment of writing from instructor and student perspectives. Journal of Educational Psychology, 98(4), 891-901. https://doi.org/10.1037/0022-0663.98.4.891.supp

Conner, K. (2015). Investigating diagnostic preassessments. Mathematics Teacher, 108(7), 536-542.

Davies, P. (2000). Computerized peer assessment. Innovations in Education and Training International, 37(4), 346-355. https://doi.org/10.1080/135580000750052955

Davies, R., & Berrow, T. (1998). An evaluation of the use of computer supported peer review for developing higher-level skills. Computers & Education, 30(1), 111-115.

Dick, W., Carey, L., & Carey, J. O. (2015). Systematic design of instruction (8th ed.). Boston, MA: Pearson.

Dooley, J. F. (2009). Peer assessments using the moodle workshop tool. In Proceedings of the 14th Annual ACM SIGCSE Conference on Innovation and Technology in Computer Science Education (Vol. 41, pp. 344-344). New York, NY: ACM. https://doi.org/10.1145/1562877.1562985

Friese, S. (2014). Qualitative data analysis with ATLAS.ti (2nd ed.). London: SAGE.

Gagné, R. M., Briggs, L. J., & Wager, W. W. (1992). Principles of instructional design (4th ed.). Fort Worth, TX: Harcourt Brace College.

Gibbs, G. (1988). Learning by doing: A guide to teaching and learning methods. London: FEU.

Gielen, M., & De Wever, B. (2015). Structuring the peer assessment process: A multilevel approach for the impact on product improvement and peer feedback quality. Journal of Computer Assisted Learning, 31(5), 435-449. https://doi.org/10.1111/jcal.12096

Haaga, D. A. F. (1993). Peer review of term papers in graduate psychology courses. Teaching of Psychology, 20(1), 28-32. https://doi.org/10.1207/s15328023top2001_5

Hafner, J., & Hafner, P. (2003). Quantitative analysis of the rubric as an assessment tool: An empirical study of student peer“group rating. International Journal of Science Education, 25(12), 1509-1528. https://doi.org/10.1080/0950069022000038268

Hanrahan, S. J., & Isaacs, G. (2001). Assessing self- and peer-assessment: The students' views. Higher Education Research & Development, 20(1), 53-70. https://doi.org/10.1080/07294360123776

Hwang, G.-J., Hung, C.-­Ming, & Chen, N.-S. (2014). Improving learning achievements, motivations and problem-solving skills through a peer assessment-­based game development approach. Educational Technology Research and Development, 62(2), 129-145.

Jenkins, M. (2005). Unfulilled Promise: Formative assessment using computer-aided assessment. Learning and Teaching in Higher Education, (1), 67-80.

Jones, I., & Alcock, L. (2014). Peer assessment without assessment criteria. Studies in Higher Education, 39(10), 1774-1787. https://doi.org/10.1080/03075079.2013.821974

Jonsson, A., & Svingby, G. (2007). The use of scoring rubrics: Reliability, validity and educational consequences. Educational Research Review, 2(2), 130-144. https://doi.org/10.1016/J.EDUREV.2007.05.002

Jungić, V., Kaur, H., Mulholland, J., & Xin, C. (2015). On flipping the classroom in large first year calculus courses. International Journal of Mathematical Education in Science and Technology, 46(4), 508-520. https://doi.org/10.1080/0020739X.2014.990529

Kwok, R. C. W., & Ma, J. (1999). Use of a group support system for collaborative assessment. Computers & Education, 32(2), 109-125.

Lee, A. Y., & Hutchison, L. (1998). Improving learning from examples through reflection. Journal of Experimental Psychology: Applied, 4(3), 187-210. https://doi.org/10.1037/1076-898X.4.3.187

Liu, E. Z.-F., Lin, S. S. J., Chiu, C.-H., & Yuan, S.-M. (2001). Web-based peer review: The learner as both adapter and reviewer. IEEE Transactions on Education, 44(3), 246-251. https://doi.org/10.1109/13.940995

Liu, N.-F., & Carless, D. (2006). Peer feedback: The learning element of peer assessment. Teaching in Higher Education, 11(3), 279-290. https://doi.org/10.1080/13562510600680582

Loch, B., Jordan, C. R., Lowe, T. W., & Mestel, B. D. (2014). Do screencasts help to revise prerequisite mathematics? An investigation of student performance and perception. International Journal of Mathematical Education in Science and Technology, 45(2), 256-268. https://doi.org/10.1080/0020739X.2013.822581

Love, B., Hodge, A., Corritore, C., & Ernst, D. C. (2015). Inquiry-based learning and the flipped classroom model. PRIMUS: Problems, Resources, and Issues in Mathematics Undergraduate Studies, 25(8), 745-762. https://doi.org/10.1080/10511970.2015.1046005

Mowl, G., & Pain, R. (1995). Using self and peer assessment to improve students' essay writing: A case study from geography. Innovations in Education and Training International, 32(4), 324-335. https://doi.org/10.1080/1355800950320404

Nastasi, B. K., & Clements, D. H. (1992). Social-cognitive behaviors and higher-order thinking in educational computer environments. Learning and Instruction, 2(3), 215-238. https://doi.org/10.1016/0959-4752(92)90010-J

Nicol, D. J., & Macfarlane-Dick, D. (2006). Formative assessment and self-regulated learning: A model and seven principles of good feedback practice. Studies in Higher Education, 31(2), 199-218.

Patchan, M. M., Schunn, C. D., & Clark, R. J. (2018). Accountability in peer assessment: Examining the effects of reviewing grades on peer ratings and peer feedback. Studies in Higher Education, 43(12), 2263-2278. https://doi.org/10.1080/03075079.2017.1320374

Peter, E. E. (2012). Critical thinking: Essence for teaching mathematics and mathematics problem solving skills. African Journal of Mathematics and Computer Science Research, 5(3), 39-43. https://doi.org/10.5897/AJMCSR11.161

Reinholz, D. (2016). The assessment cycle: A model for learning through peer assessment. Assessment & Evaluation in Higher Education, 41(2), 301-315. https://doi.org/10.1080/02602938.2015.1008982

Scott, F. J. (2017). A simulated peer-assessment approach to improve students' performance in numerical problem-solving questions in high school biology. Journal of Biological Education, 51(2), 107-122. https://doi.org/10.1080/00219266.2016.1177571

Sheatsley, P. B. (1983). Questionnaire construction and item writing. In P. H. Rossi, J. D. Wright, & A. B. Anderson (Eds.), Handbook of survey research (pp. 195-230). New York, NY: Academic Press.

Silver, H. F. (2010). Compare & contrast: Teaching comparative thinking to strengthen student learning (A strategic teacher PLC guide). Alexandria, VA: Association for Supervision & Curriculum Development.

Stefani, L. A. J. (1994). Peer, self and tutor assessment: Relative reliabilities. Studies in Higher Education, 19(1), 69-75. https://doi.org/10.1080/03075079412331382153

Strang, K. D. (2013). Determining the consistency of student grading in a Hybrid Business course using a LMS and statistical software. International Journal of Web-Based Learning and Teaching Technologies (IJWLTT), 8(2), 58-76. https://doi.org/10.4018/jwltt.2013040103

Sun, D. L., Harris, N., Walther, G., & Baiocchi, M. (2015). Peer assessment enhances student learning: The results of a matched randomized crossover experiment in a college statistics class. PLoS ONE, 10(12), e0143177. https://doi.org/10.1371/journal.pone.0143177

Tanner, H., & Jones, S. (1994). Using peer and self-assessment to develop modelling skills with students aged 11 to 16: A socio-constructive view. Educational Studies in Mathematics, 27(4), 413-431. https://doi.org/10.1007/BF01273381

Topping, K. (1998). Peer assessment between students in colleges and universities. Review of Educational Research, 68(3), 249-276. https://doi.org/10.3102/00346543068003249

Triola, M. F. (2012). Elementary statistics technology update (11th ed.). Boston, MA: Addison-Wisley.

van Woerkom, M. (2010). Critical reflection as a rationalistic ideal. Adult Education Quarterly, 60(4), 339-356. https://doi.org/10.1177/0741713609358446

Wain, A. (2017). Learning through reflection. British Journal of Midwifery, 25(10), 662-666. https://doi.org/10.12968/bjom.2017.25.10.662

Wen, M. L., & Tsai, C.-C. (2006). University students' perceptions of and attitudes toward (online) peer assessment. Higher Education, 51(1), 27-44. https://doi.org/10.1007/s10734-004-6375-8

Willey, K., & Gardner, A. (2010). Investigating the capacity of self and peer assessment activities to engage students and promote learning. European Journal of Engineering Education, 35(4), 429-443. https://doi.org/10.1080/03043797.2010.490577

Yang, Y.-F., & Tsai, C.-C. (2010). Conceptions of and approaches to learning through online peer assessment. Learning and Instruction, 20(1), 72-83.

Share

COinS