Can Exams Change How and What Learners Learn? Investigating the Washback Effect of a University English Language Proficiency Test in the Turkish Context

Asli Lidice Gokturk Saglam, Hossein Farhady

Abstract


This article reports on a mixed-method study that examined the washback of a local integrated theme-based high-stakes English language proficiency test that is used in a university English for Academic Purposes (EAP) program in Turkey. The assumption behind employing an integrated theme-based test, which resembles authentic language use, was that it would bring about a positive washback on learning (Leki, Cumming & Silva, 2008: Leki & Carson 1997). The data were collected from both focus-group interviews after the instruction and pre- and post- proficiency test scores of 147 EFL students in the Preparatory English Language Program (PEP). Test of Readiness for Academic English (TRACE) was administered at the beginning and at the end of a 4-month English language instruction period. Repeated measure ANOVA and inductive analysis of the transcribed interview data were used for analyzing quantitative and qualitative data respectively. The findings indicated that the test had both positive and negative washback on the learning. Most students considered that using source-based information and their notes taken during the listening task into their writing raised their awareness in terms of generating, organizing and linking ideas as well as modelling vocabulary and sentence structures. However, the test also exerted negative washback upon learning since students were inclined to prioritize test-oriented practice. The implications of the study suggest that a theme-based integrated proficiency exam may elicit positive washback on learning that could be used for validity evidence in EAP contexts and lead to more appropriate language assessment. The procedures are detailed, the findings are presented and discussed, the applications and implications for teachers and test designers are explained, and some suggestions are made for further research.

Keywords


Washback Effect, Theme-Based Language Proficiency Test, Integrated Language Proficiency Test, Washback on Learning, English for Academic Purposes

Full Text:

PDF

References


Akpinar, K.D. & Cakildere, B. (2013). Washback effects of high-stakes language tests of Turkey (KPDS and UDS) on productive and receptive skills of academic personnel. Journal of Language and Linguistic Studies, 9(2), 81-94.

Amrein, A.L. & Berliner, D.C. (2002). High-stakes testing, uncertainty, and student learning. Education Policy Analysis Archives, 10(18), 1-74.

Bailey, K.M. (1996). Working for washback: A review of the washback concept in language testing. Language Testing, 13(3), 257-279. https://doi.org/10.1177/026553229601300303

Becker, B. (1990). Coaching for the Scholastic Aptitude Test: Further synthesis and appraisal. Review of Educational Research. 60(3), 373-417. https://doi.org/10.3102/00346543060003373

Cumming, A. (2013). Assessing integrated writing tasks for academic purposes: Promises and perils. Language Assessment Quarterly, 10(1), 1–8. https://doi.org/10.1080/15434303.2011.622016

Green, A. (2007). Washback to learning outcomes: a comparative study of IELTS preparation and university professional language courses. Assessment in Education, 14(1), 75-97. https://doi.org/10.1080/09695940701272880

Gosa, C. M. C. (2004). Investigating Washback: A case study using student diaries. Unpublished PhD thesis, Department of Linguistics and Modern English language, Lancaster University, Lancaster, England.

Hughes, A. (1988). Introducing a needs-based test of English into an English medium university in Turkey, in Hughes, A. (Eds) Testing English for University, Oxford: Modern English Publications, 134-153.

Hillocks, G. (2002). The testing trap: How state assessments of writing control learning, New York, NY: Teachers College Press.

Ferman, I. (2004). The washback of an EFL national oral matriculation test to teaching and learning. In L. Cheng, Y. Watanabe, & A. Curtis (Ed.), Washback in language testing: Research contexts and methods (pp. 3-18). Manwah, New Jersey: Lawrence Erlbaum Associates.

Klein, S.P., Hamiltion, L.S., Mc Caffrey, D. F. & Stecher, B. M. (2000). What do test scores in Texas tell us? Education Policy Analysis Archives, 8, 49. http://epaa.asu.edu/epaa/v8n49/

Leki, I., Carson, J. (1997). Completely different worlds: EAP and the writing experiences of ESL students in university courses. TESOL Quarterly, 31(1), 36–69. https://doi.org/10.2307/3587974

Leki, I., Carson, J., &Silva, T. (2008). A synthesis of research on second language writing. London, UK: Routledge.

Özmen, K. (2011). Washback effects of the inter-university foreign language examination on foreign language competences of candidate academics. Novitas-ROYAL Research on Youth and Language, 5 (2), p. 215-228.

Pan, Y. & Newfields, T. (2012). Tertiary EFL proficiency graduation requirements in Taiwan: A study of washback on learning. Electronic Journal of Foreign Language Teaching, 9(1), 108-122.

Plakans, L. (2009a). Discourse synthesis in integrated second language writing assessment. Language Testing, 26(4), 561–587. https://doi.org/10.1177/0265532209340192

Plakans, L. (2009b). The role of reading strategies in integrated L2 writing tasks. Journal of English for Academic Purposes, 8(4), 252–266. https://doi.org/10.1016/j.jeap.2009.05.001

Plakans, L., Gebril, A. (2012). A close investigation into source use in integrated second language writing tasks. Assessing Writing, 17(1), 18–34. https://doi.org/10.1016/j.asw.2011.09.002

Qi, L. (2004). Has a high-stakes test produced the intended changes. In L. Cheng, Y. Watanabe, & A. Curtis (Ed.), Washback in language testing: Research contexts and methods (pp. 171-191). Manwah, New Jersey: Lawrence Erlbaum Associates.

Robb, T. N., & Ercanbrack, J. (1999). A study of the effect of direct test preparation on the TOEIC scores of Japanese university students. Teaching English as a Second or Foreign Language, 3(4), 2-16

Read, J. &Hayes, B. (2003). IELTS test preparation in New Zealand: preparing students for the IELTS academic module. In R. Tolloh (Ed.), IELTS Research Report 4 (p. 153-2006). Canberra: IEALTS Australia Pty Limited.

Shih, C. (2007). A new washback model of students’ learning. The Canadian Modern Language Review, 64(1), 135-162. http://dx.doi.org/10.3138/cmlr.64.1.135

Shohamy, E., Donitsa-Schmidt, S. & Ferman, I. (1996). Test impact revisited: Washback effect over time. Language Testing, 13(3), 298-317. https://doi.org/10.1177/026553229601300305

Sawaki, Y., Quinlan, T. & Lee, Y. (2013). Understanding Learner Strengths and Weaknesses: Assessing Performance on an Integrated Writing Task. Language Assessment Quarterly, 10(1), 73-95.

http://dx.doi.org/10.1080/15434303.2011.633305

Tsagari, D. (2011). Washback of a high-stakes English exam on teachers’ perceptions and practices, selected papers from the 19th ISTAL.

Tsagari, D. (2009). The complexity of test washback. Frankfurt am Main: Peter Lang.

Tsagari, D. (2007) Review of Washback in Language Testing: What Has Been Done? What More Needs Doing? Washington, DC: Center for Applied Linguistics (ERIC Document Reproduction Services No. ED 497709). https://eric.ed.gov/?id=ED497709

http://www.eric.ed.gov/ERICWebPortal/custom/portlets/recordDetails/detailmini.jsp?_nfpb=true&_&ERICExtSearch_SearchValue_0=ED497709&ERICExtSearch_SearchType_0=eric_accno&accno=ED497709

Watanabe, Y. (1992). Washback effects of College Entrance Examination on language learning strategies. JACET, 175-194.

Weigle, S., Yang, W., Montee, M. (2013). Exploring reading processes in an academic reading test using short-answer questions. Language Assessment Quarterly, 10(1), 28–48. https://doi.org/10.1080/15434303.2012.750660

Xie, Q. (2013). Does test preparation work? Implications for score validity. Language Assessment Quarterly, 10(2), 196-218. https://doi.org/10.1080/15434303.2012.721423

Xie, Q. & Andrews, S (2012). Do test design and uses influence test preparation? Testing a model of washback with Structural Equation Modelling. Language Testing,30(1), 1-22. https://doi.org/10.1177/0265532212442634

Yu, G. (2013). From integrative to integrated language assessment: Are we there yet? Language Assessment Quarterly, 10(1), 110–114. https://doi.org/10.1080/15434303.2013.766744

Zhan, Y. & Andrews, S. (2014). Washback effects from a high-stakes examination on out-of-class English learning: Insights from possible self-theories. Assessment in Education, 21(1), 71-89.

https://doi.org/10.1080/0969594X.2012.757546




DOI: https://doi.org/10.7575/aiac.alls.v.10n.1p.177

Refbacks

  • There are currently no refbacks.


Bookmark and Share


Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

2010-2023 (CC-BY) Australian International Academic Centre PTY.LTD.

Advances in Language and Literary Studies

You may require to add the 'aiac.org.au' domain to your e-mail 'safe list’ If you do not receive e-mail in your 'inbox'. Otherwise, you may check your 'Spam mail' or 'junk mail' folders.