Jurnal Penelitian dan Evaluasi Pendidikan

Document Type



Numerous studies have accepted the flipped learning approach as an approach in implementing technological-based classroom environments. This article aims to identify the required constructs in developing an instrument for flipped learning in an ESL environment. This study uses the Fuzzy Delphi method to collect and analyze the viewpoints of 18 experts from relevant fields. An online questionnaire was developed to gather the experts' agreement towards seven constructs: flexible environments, the shift in learning culture, intentional content, progressive networking activities, professional educators, engaging & effective learning experiences, and diversified seamless learning platforms, and 68 items gathered from the literature. The Fuzzy Delphi Method (FDM) analysis rejected seven items, finalizing the instrument with seven constructs and 61 items. The instrument is beneficial to teachers and learners of ESL and developers of technology-based learning methods. The implication of the study is the provision of the constructs to help guide and implement the flipped learning approach in educational contexts. Furthermore, these constructs can be used as the basis for further investigations that lead to developing frameworks or models for the flipped learning approach. Future works on the topic may look at a bigger sample for stronger results. Furthermore, the instrument developed can be used on the student population and in other contexts as well.

First Page


Last Page






Digital Object Identifier (DOI)



Akçayır, G., & Akçayır, M. (2018). The flipped classroom: A review of its advantages and challenges. Computers & Education, 126, 334-345. https://doi.org/10.1016/j.compedu.2018.07.021

Aw-Yong, J., Anderson, N., & Chigeza, P. (2013). Developing culturally-responsive lessons on the iPAD for teaching English as Second Language to Chinese learners. 2013 IEEE 63rd Annual Conference International Council for Education Media (ICEM), 1-11. https://doi.org/10.1109/CICEM.2013.6820186

Azman, H., & Dollsaid, N. F. (2018). Applying massively multiplayer online games (MMOGs) in EFL teaching. Arab World English Journal, 9(4), 3-18. https://doi.org/10.24093/awej/vol9no4.1

Baepler, P., Walker, J. D., & Driessen, M. (2014). It's not about seat time: Blending, flipping, and efficiency in active learning classrooms. Computers & Education, 78, 227-236. https://doi.org/10.1016/j.compedu.2014.06.006

Balan, P., Clark, M., & Restall, G. (2015). Preparing students for flipped or team-based learning methods. Education + Training, 57(6), 639-657. https://doi.org/10.1108/ET-07-2014-0088

Bergmann, J., & Sams, A. (2012). Flip your classroom: Reach every student in every class every day. International Society for Technology in Education.

Bishop, J. L., & Verleger, M. A. (2013). The flipped classroom: A survey of the research. 120th ASEE Annual Conference & Exposition, 6219. https://peer.asee.org/the-flipped-classroom-a-survey-of-the-research

Bodomo, A. (2016). Afriphone literature as a prototypical form of African literature: Insights from prototype theory. Advances in Language and Literary Studies, 7(5), 262-267. http://www.journals.aiac.org.au/index.php/alls/article/view/2748

Bouzon, M., Govindan, K., Rodriguez, C. M. T., & Campos, L. M. S. (2016). Identification and analysis of reverse logistics barriers using Fuzzy Delphi method and AHP. Resources, Conservation and Recycling, 108, 182-197. https://doi.org/10.1016/j.resconrec.2015.05.021

Chen, Y., Wang, Y., Kinshuk, & Chen, N.-S. (2014). Is FLIP enough? Or should we use the FLIPPED model instead? Computers & Education, 79, 16-27. https://doi.org/10.1016/j.compedu.2014.07.004

Coufal, K. (2014). Flipped learning instructional model: Perceptions of video delivery to support engagement in eighth grade math. Doctoral thesis, Lamar University, Beaumont, TX.

Creswell, J. W. (2009). Research design: Qualitative, quantitative, and mixed methods approaches. SAGE Publication.

Davies, R. S., Dean, D. L., & Ball, N. (2013). Flipping the classroom and instructional technology integration in a college-level information systems spreadsheet course. Educational Technology Research and Development, 61(4), 563-580. https://doi.org/10.1007/s11423-013-9305-6

Embi, M. A., Hussin, S., & Panah, E. (2014). Flipped learning readiness amongst graduate and postgraduate students in UKM. In M. A. Embi (Ed.), Blended and flipped learning: Case studies in Malaysia HEIs (pp. 209-223). Centre for Teaching and Learning Technologies, Universiti Kebangsaan Malaysia.

Embi, M. A. (2014). Blended & flipped learning: Case studies in Malaysian HEIs (M. A. Embi (ed.); 1st ed.). Universiti Kebangsaan Malaysia.

Enfield, J. (2013). Looking at the impact of the flipped classroom model of instruction on undergraduate multimedia students at CSUN. TechTrends, 57(6), 14-27. https://doi.org/10.1007/s11528-013-0698-1

Hamdan, N., McKnight, P., McKnight, K., & Arfstrom, K. (2013). A review of flipped learning: Flipped learning network. Flipped Learning Network. https://flippedlearning.org/cms/lib07/VA01923112/Centricity/Domain/41/LitReview_FlippedLearning.pdf

Hao, Y. (2016). Exploring undergraduates' perspectives and flipped learning readiness in their flipped classrooms. Computers in Human Behavior, 59, 82-92. https://doi.org/10.1016/j.chb.2016.01.032

Hidayat, W. (2018). Developing and validating an inventory of a national character (IKB) for secondary school students. Doctoral thesis, Universiti Kebangsaan Malaysia, Selangor.

Hidayat, W., & Lawahid, N. A. (2020). Metode Fuzzy Delphi untuk penelitian sosial. Alfabeta.

Ishikawa, A., Amagasa, M., Shiga, T., Tomizawa, G., Tatsuta, R., & Mieno, H. (1993). The max-min Delphi method and Fuzzy Delphi method via fuzzy integration. Fuzzy Sets and Systems, 55(3), 241-253. https://doi.org/10.1016/0165-0114(93)90251-C

Jamaludin, R., & Osman, S. Z. M. (2014). The use of a flipped classroom to enhance engagement and promote active learning. Journal of Education and Practice, 5(2), 124-131. https://iiste.org/Journals/index.php/JEP/article/view/10648

Juhary, J., & Amir, A. F. (2018). Flipped classroom at the Defence University. 4th International Conference on Higher Education Advances (HEAd'18), 827-835. https://doi.org/10.4995/HEAD18.2018.8093

Kafi, Z., & Motallebzadeh, K. (2014). A flipped classroom: Project-based instruction and 21st century skills. International Journal of Language Learning and Applied Linguistics World (IJLLALW), 6(4), 35-46.

Kenna, D. C. (2014). A study of the effect the flipped classroom model on student self-efficacy. Master thesis, North Dakota State University, Fargo, North Dakota.

Lage, M. J., Platt, G. J., & Treglia, M. (2000). Inverting the classroom: A gateway to creating an inclusive learning environment. The Journal of Economic Education, 31(1), 30-43. https://doi.org/10.1080/00220480009596759

McLaughlin, J. E., Griffin, L. M., Esserman, D. A., Davidson, C. A., Glatt, D. M., Roth, M. T., Gharkholonarehe, N., & Mumper, R. J. (2013). Pharmacy student engagement, performance, and perception in a flipped satellite classroom. American Journal of Pharmaceutical Education, 77(9), 196. https://doi.org/10.5688/ajpe779196

Ministry of Education Malaysia. (2015). Malaysia education blueprint 2015-2025 (higher education). Ministry of Education Malaysia. https://www.um.edu.my/docs/um-magazine/4-executive-summary-pppm-2015-2025.pdf

Nederveld, A., & Berge, Z. L. (2015). Flipped learning in the workplace. Journal of Workplace Learning, 27(2), 162-172. https://doi.org/10.1108/JWL-06-2014-0044

O'Flaherty, J., & Phillips, C. (2015). The use of flipped classrooms in higher education: A scoping review. The Internet and Higher Education, 25, 85-95. https://doi.org/10.1016/j.iheduc.2015.02.002

Osman, S. Z. M., Jamaludin, R., & Mokhtar, N. E. (2014). Flipped classroom and traditional classroom: Lecturer and student perceptions between two learning cultures, a case study at Malaysian polytechnic. International Education Research, 2(4), 16-25. https://doi.org/10.12735/ier.v2i4p16

Patton, M. Q. (2002). Qualitative research & evaluation methods (3rd ed.). SAGE Publication.

Sanchez-Lezama, A. P., Cavazos-Arroyo, J., & Albavera-Hernandez, C. (2014). Applying the Fuzzy Delphi Method for determining socio-ecological factors that influence adherence to mammography screening in rural areas of Mexico. Cadernos de Saúde Pública, 30(2), 245-258. https://doi.org/10.1590/0102-311X00025113

Tongco, M. D. C. (2007). Purposive sampling as a tool for informant selection. Ethnobotany Research and Applications, 5, 147-158. https://ethnobotanyjournal.org/index.php/era/article/view/126

Tsay, C. H.-H., Kofinas, A., & Luo, J. (2018). Enhancing student learning experience with technology-mediated gamification: An empirical study. Computers & Education, 121, 1-17. https://doi.org/10.1016/j.compedu.2018.01.009

Wiginton, B. L. (2013). Flipped instruction: An investigation into the effect of learning environment on student self-efficacy, learning style, and academic achievement in an Algebra I classroom. Doctoral thesis, The University of Alabama, Tuscaloosa, AL.

Yemma, D. M. (2015). Impacting learning for 21st century students: A phenomenological study of higher education faculty utilizing a flipped learning approach. Doctoral thesis, Robert Morris University, Moon Twp, PA.