The washback of the abolition of the national examination in Indonesia

Ifan Rikhza Auladi

doi:10.61251/ijoep.v1i1.50

Authors

Ifan Rikhza Auladi English Education Department, Faculty of Languages and Communication Science, Universitas Islam Sultan Agung, Indonesia & MEd Teaching English to Speakers of Other Languages (TESOL), The University of Exeter, United Kingdom

DOI:

https://doi.org/10.61251/ijoep.v1i1.50

Keywords:

National Examination, School-Based Assessment

Abstract

The National Examination (NE) is abolished in 2021, marking the beginning of a new educational evaluation paradigm in Indonesia. The regulation considers some reasons: the suitability of the test, the development of teaching methods, and the enhancement of the quality of national education. Under the abolition of NE, the regulation constitutes the establishment of School-Based Assessment (SBA), conducted by the teachers in the forms of portfolios, assignments, tests, and/or other assessments following the regulation from each school. Therefore, the present research aims at investigating English teachers' perception towards the abolition of NE and the washback of the abolition of NE on the teaching plan of English language learning in the aspect of classroom instructional behaviours and the content of the curriculum. The sequential mixed-methods research (MMR) works with quantitative and qualitative data from 51 respondents in an online questionnaire and four teachers participated in a semi-structured interview. It was then found that the establishment of SBA replacing NE obtains positive responses from the teachers as it is perceived more reliable with objectives of the English curriculum, which attempts to elevate students' high order thinking skills. The abolition of NE triggers the teachers to vary their teaching methods and techniques by using more communicative approaches; however, the change in assessment does not influence teachers' domination in classroom activities and talking activity. The teachers highly emphasize the use of previous exam papers in the preparation of SBA. In addition, the teachers remain highly prioritizing students' success in SBA, which retains exam papers, as the level of students' language proficiency is relatively low. Referring to the findings, the related parties can measure the washback of the abolition of NE for further improvement in the language assessment.

References

Alderson, J. C. (2004). Foreword. In Cheng, L., Watanabe, Y., & Curtis, A. (Eds.), Washback in Language Testing: Research Context and Methods (pp. ix-xii). Lawrence Erlbaum Associates.

Alderson, J. C. & Hamp-Lyons, L. (1996). TOEFL preparation courses: A study of washback. Language Testing. 13(3), 280–297. https://doi.org/10.1177/026553229601300304

Alderson, J. C. & Wall, D. (1993). Does washback exist? Applied Linguistics. 14(2), 115-129. https://doi.org/10.1093/applin/14.2.115

Andrews, S. (1994). Washback or washout? The relationship between examination reform and curriculum innovation. In D. Nunan, R. Berry and V. Berry (Ed.), Bringing about change in language education (pp. 67-81). University of Hong Kong.

Auerbach, C. F. & Silverstein, L. B. (2003). Qualitative data: An Introduction to Coding and Analysis. New York University Press.

Bailey, K. M. (1996). Working for washback: A review of the washback concept in language testing. Language Testing. 13(3), 257–279. https://doi.org/10.1177/026553229601300303

Brinkmann, S. (2014). Unstructured and Semi-Structured Interviewing. In Leavy, P. (Ed.), The Oxford Handbook of Qualitative Research (pp. 277-299). Oxford University Press. https://doi.org/10.1093/oxfordhb/9780199811755.013.030

Brown, H. D. & Abeywickrama, P. (2010). Language Assessment: Principles and Classroom Practices. Pearson Longman.

Brown, J. D. (2014). Mixed Methods Research for TESOL. Edinburgh University Press.

Brown, J. D. & Hudson, T. (1998). The Alternative in Language Assessment. TESOL Quarterly. 32(4), 653–675. https://doi.org/10.2307/3587999

Chapman, D. W. & Snyder Jr, C. W. (2000). Can high stakes national testing improve instruction: reexamining conventional wisdom. International Journal of Educational Development. 20(6), 457-474. https://doi.org/10.1016/S0738-0593(00)00020-1

Cheng, L. (1997). How does washback influence teaching? Implications for Hong Kong. Language and Education. 11, 38–54. https://doi.org/10.1080/09500789708666717

Cheng, L. (2005). Changing language teaching through language testing: A washback study. Cambridge University Press.

Cheng, L. & Curtis, A. (2004). Washback or washout: A review of the impact of testing on teaching and learning. In Cheng, L. Watanabe, Y., and Curtis, A. (Eds.), Washback in Language Testing: Research Context and Methods (pp. 3-17). Lawrence Erlbaum Associates. https://doi.org/10.4324/9781410609731

Chin, H., Thien, L. M., & Chiew, C. M. (2019). The Reforms of National Assessments in Malaysian Education System. Journal of Nusantara Studies. 4(1), 93-111. https://doi.org/10.24200/jonus.vol4iss1pp93-111

Creswell, J. W. (2015). Educational Research Planning, Conducting, and Evaluating Quantitative and Qualitative Research (5th ed.). Pearson.

Creswell, J. W. & Clark, V. L. P. (2017). Designing and Conducting Mixed Methods Research (3rd ed.). Sage Publications.

Creswell, J. W. & Zhou, Y. What is mixed methods research? In Moeller, A. J., Creswell, J. W., & Saville, N. (Eds.), Second Language Assessment and Mixed Methods Research (pp. 35-50). Cambridge University Press.

David, M. & Sutton, C. D. (2011). Social Research: An Introduction. Sage Publications.

Davison, C. & Leung, C. (2009). Current Issues in English Language Teacher-Based Assessment. TESOL Quarterly. 43(3), 393-415. https://doi.org/10.1002/j.1545-7249.2009.tb00242.x

Dörnyei, Z. & Taguchi, T. (2010). Questionnaires in Second Language Research: Construction, Administration, and Processing (2nd ed.). Routledge. https://doi.org/10.4324/9780203864739

Fraenkel, J. R. & Wallen, N. E. (2009). How to Design and Evaluate Research in Education (7th ed.). McGraw-Hill Higher Education.

Fulcher, G. (2010). Practical Language Testing. Hodder Education.

Gillham, B. (2000). The Research Interview. Continuum.

Green, A. (2014). Exploring Language Assessment and Testing. Routledge. https://doi.org/10.4324/9781315889627

Grix, J. (2004). The Foundations of Research. Palgrave Macmillan.

Holliday, A. (2002). Doing and Writing Qualitative Research. Sage.

Hughes, A. & Hughes, J. (2020). Testing for Language Teachers (3rd ed.). Cambridge University Press. https://doi.org/10.1017/9781009024723

Hung, T.A. (2012). A washback study on e-portfolio assessment in an English as a foreign language teacher preparation program. Computed Assisted. 25(1), 21-36. https://doi.org/10.1080/09588221.2010.551756

Johnson, R. B. & Onwuegbuzie, A. J. (2004). Mixed Methods Research: A Research Paradigm Whose Time Has Come. Educational Researcher. 33(7), 14-26. https://doi.org/10.3102/0013189X033007014

Kemdikbud. (2021a). Circular Letter of Minister of Education and Culture Number 1 Year 2021. Ministry of Education and Culture.

Kemdikbud. (2021b). Daftar Tanya Jawab Kebijakan Ujian Nasional (UN) [The List of Questions and Answers on the Policy of the National Examination]. https://www.kemdikbud.go.id/main/tanya-jawab/tanya-jawab-ujian-nasional

Kemdiknas. (2010). Sejarah Ujian Nasional [History of the National Examination], retrieved from http://www.kemdiknas.go.id/orang-tua/ujian-nasional/sejarah-ujian-nasional.aspx.

Lam, H. P. (1995). Methodology washback - An insider's view. In Nunan, D., Berry, R., & Berry, V. (Eds.), Bringing about change in language education (pp. 83-102). The University of Hong Kong.

Lune, H. & Berg, B. L. (2017). Qualitative Research Methods for the Social Sciences (9th ed.). Pearson.

McNamara, T. (2000). Language Testing, Oxford University Press.

Mertens, D. M. (2010). Research and evaluation in education and psychology: integrating diversity with quantitative, qualitative, and mixed methods (3rd ed.). Sage Publications.

Messick, S. (1996). Validity and washback in language testing. Language Testing. 13(3), 241-256. https://doi.org/10.1177/026553229601300302

Nugroho. (2009). UN dan Mutu Pendidikan [UN – the National Examination – and Education Quality]. Suara Merdeka, 7 Desember 2009.

Onaiba, A. M. (2013). Investigating the Washback Effect of a Revised EFL Public Examination on Teachers’ Instructional Practices, Materials and Curriculum (Doctoral dissertation). University of Leicester. https://hdl.handle.net/2381/28561

Orafi, S. M. S. & Borg, S. (2009). Intentions and realities in implementing communicative curriculum reform. System. 37, 234-253. https://doi.org/10.1016/j.system.2008.11.004

Othman, I., Md Saleh, N., & Mohd Nooraini, N. A. (2013). The implementation of school-based assessment in primary school standard curriculum. International Journal of Education and Research. 1(7), 1-10.

Pallant, J. (2010). SPSS Survival Manual: A set by step guide to data analysis using SPSS (4th ed.). McGraw-Hill.

Puspitasari, M. (2020). Investigating the washback effect of the national examination on Indonesian practices: Perceptions of teachers, students and parents of test impact. (Doctoral dissertation). University of Glasgow. http://theses.gla.ac.uk/id/eprint/81300

Rea, L. M. & Parker, R. A. (2014). Designing and Conducting Survey Research: A Comprehensive Guide (4th ed.). Jossey-Bass.

Saif, S. (2006). Aiming for positive washback: a case study of international teaching assistants, Language Testing. 23(1), 1-34. https://doi.org/10.1191/0265532206lt322oa

Saukah, A. & Cahyono, A. E. (2015). National Exam in Indonesia and Its Implications to the Teaching and Learning of English. Jurnal Penelitian dan Evaluasi Pendidikan [Journal of Research and Evaluation in Education]. 19(2), 243-255. https://doi.org/10.21831/pep.v19i2.5583

Shohamy, E. (2001) The power of tests: A critical perspective on the uses of language tests. Longman.

Shohamy, E., Donitsa-Schmidt, S., & Ferman, I. (1996). Test Impact revisited: Washback effect over time. Language Testing. 13, 298–317. https://doi.org/10.1177/026553229601300305

Smith, M. L. (1991). Put to the test: The effects of external testing on teachers, Educational Researcher. 20(5), 8-11. https://doi.org/10.3102/0013189X020005008

Smith, M. L., Edelsky, C., Draper, K., Rottenberg, C., & Cherland, M. (1991). The role of testing in elementary schools (CSE Technical Report 321). University of California, Los Angeles, National Center for Research on Evaluation, Standards, and Student Testing (CRESST).

Sutari, V. R. (2017). National Examination in Indonesia and Its Backwash Effects: Teachers’ Perspective. Atlantis Press. 331-333. https://doi.org/10.2991/conaplin-16.2017.76

Teddlie, C. & Tashakkori, A. (2009). Foundations of Mixed Methods Research: Integrating Quantitative and Qualitative Approach in the Social and Behavioral Sciences. Sage.

Wall, D. (2005). The impact of high-stakes examinations on classroom teaching: a case study using insights from testing and innovation theory. Cambridge University Press.

Wall, D. & Alderson, J. C. (1993) Examining washback: the Sri Lankan impact study. Language Testing. 10, 41–69. https://doi.org/10.1177/026553229301000103

Watanabe, Y. (2004). Methodology in Washback Studies. In Cheng, L. Watanabe, Y., and Curtis, A. (Eds.), Washback in Language Testing: Research Context and Methods (pp. 19-36). Lawrence Erlbaum Associates.

Xu, Q. & Liu, J. (2018). A Study on the Washback Effects of the Test for English Majors (TEM): Implications for Testing and Teaching Reforms. Springer. https://doi.org/10.1007/978-981-13-1963-1

Ziegler, N. & Kang, L. (2016). Mixed methods design. In Moeller, A. J., Creswell, J. W., & Saville, N. (Eds.), Second Language Assessment and Mixed Methods Research (pp. 51-83). Cambridge University Press. https://doi.org/10.4324/9781315747293-10