Appraising Pre-service EFL Teachers' Assessment in Language Testing Course Using Revised Bloom's Taxonomy

Elham Mohammadi, Gholam Reza Kiany, Reza Ghaffar Samar, Ramin Akbari

Abstract


The teachers need to be conceived as a “change agent” and not as a mere transmitter of knowledge and culture. In developing countries like Iran, one of the most significant concerns in the field of teachers’ education is efficiency of pre-service programs. To this aim, the current descriptive-evaluative study intended to describe the state of pre-service teachers' assessment in the field of language testing by (a) examining the exam questions to find out whether they are aligned with curriculum objectives and syllabus (content validity, (b) exploring whether they take care of higher order cognitive processes and (c) finding what combinations of cognitive process levels and knowledge types in Revised Bloom's Taxonomy are prevalent in the questions. The results exhibited an unbalanced coverage of content in exams. Also the questions were found to be inadequate in terms of measuring complex cognitive skills (Analyze and Evaluate); Remember and Understand domains take up 91.6 % of all questions and no item was found for Create. Three combinations of cognitive process level and knowledge type was dominant in the data set: (1) Remember Factual Knowledge, (2) Understand Conceptual Knowledge, and (3) Apply Procedural Knowledge. These associations confirm the Anderson and Krathwohl's (2001) proposition.


Keywords


Pre-service teachers, assessment, assessment literacy, Revised Bloom's Taxonomy, cognitive processes, knowledge types

Full Text:

PDF

References


Anderson, L. W., & Krathwohl, D. R. (2001). A taxonomy for learning, teaching and assessing: a revision of Bloom’s Taxonomy. New York. Longman Publishing.

Aviles, C. B. (1999). Understanding and testing for "critical thinking" with Bloom's taxonomy of educational objectives. Washington, DC: ERIC Clearinghouse.

Bailey, K. M., & Brown, J. D. (1996). Language testing courses: What are they? In A. Cunning & R. Berwick (Eds.), Validation in language testing (pp. 236-256). Clevedon, UK: Multilingual Matters.

Boyles, P. (2005). Assessment literacy. In M. Rosenbusch (Ed.), New visions in action: National assessment summit papers (pp. 18-23). Ames: Iowa State University.

Bransford, J., Brown, A., & Cocking, R. (1999). How people learn: Brain, mind, experience, and school. Washington, DC: National Academy Press.

Brindley, G. (2001). Language assessment and professional development. In C. Elder, A. Brown, E. Grove, K. Hill, N. Iwashita, T. Lumley, T. McNamara & K. O'Loughlin (Eds.), Experimenting with uncertainty: Essays in honour of Alan Davies (pp. 126-136). Cambridge: Cambridge University Press.

Brown, J. D., & Bailey, K. M. (2007). Language testing courses: What are they in 2007? Language Testing, 25(3), 349-383.

Buckles, S., & Siegfried, J. J. (2006). Using multiple-choice questions to evaluate in-depth learning of economics. Journal of Economic Education, 37(1), 48-57.

Çepni, S., Özsevgeç. T., & Gökdere, M. (2003). The comparing questions OSS and entrance high school exam according to cognitive level and the properties formal operational steps. National Educational Journal, 157, 1-9.

Chen, H. J. (2004). An analysis of computer science exam questions using revised Bloom's taxonomy. Unpublished master's thesis, National Taiwan Normal University, Taipei.

Dochy, F. (2009). The edumetric quality of new modes of assessment: Some issues and prospects. In G. Joughin (Ed.), Assessment, learning and judgement in Higher Education (pp. 85-114). New York: Springer.

Gronlund, N. E. (1985). Measurement and evaluation in teaching. New York: Macmillan.

Hand, B., Prain, V., & Wallace, C. (2002). Influence of writing task on students’ answers to recall and higher-level test questions. Research in Science Education, 32, 19-34.

Hüttner, J., Mehlmaur-Larcher, B., & Reichl, S. (2011). Theory and practice in EFL teacher education: Bridging the gap (New Perspectives on Language and Education). UK: Short Run Press.

Inbar-Lourie, O. (2008). Constructing a language assessment knowledge base: A focus on language assessment courses. Language Testing, 25(3), 385-402.

Jin, Y. (2010). The place of language testing and assessment in the professional preparation of foreign language teachers in China. Language Testing, 27(4), 555-584.

Johnson, K., & Johnson, H. (2001). Encyclopedic dictionary of applied linguistics. Oxford: Blackwell.

Karamustafaoğlu, S., Sevim, S., Karamustafaoğlu, O., & Çepni, S. (2003). Analysis of Turkish high-school chemistry examination questions according to Bloom’s taxonomy. Chemistry Education: Research and Practice, 4(1), 25-30.

Kleinsasser, R. C. (2005). Transforming a postgraduate level assessment course: A second language teacher educator's narrative. Prospect, 20(3), 77-102.

Kocakaya, S., & Gonen, S. (2010). Analysis of Turkish high-school physics-examination questions according to Bloom’s taxonomy. Asia-Pacific Forum on Science Learning and Teaching, 11(1).

Köğce, D. (2005). A comparison of the mathematics questions used in the University Entrance Exam (OSS) and high schools in terms of Bloom’s Taxonomy, Unpublished master's thesis, Institute of Science, Karadeniz Technical University, Trabzon.

Kozhageldyeva, L. (2005). Importance of testing and evaluation in foreign language teaching: A suggested syllable for a testing course in EFL departments in Kazakhstan universities. Unpublished master's thesis, Gazi University, Ankara.

Lam, R. (in press). Language assessment training in Hong Kong: Implications for language assessment literacy. Language Testing.

Lan, W. H., & Chern, C. L. (2010). Using Revised Bloom's Taxonomy to analyze reading comprehension questions on the SAET and the DRET. Contemporary Educational Research Quarterly, 18 (3), 165-206.

Masters, J. C., Hulsmeyer, B. S., Pike, M. E., Leichty, K., Miller, M. T., & Verst, A. L. (2001). Assessment of multiple-choice questions in selected test banks accompanying text books used in nursing education. Journal of Nursing Education, 40(1), 25-32.

Mollaeenezhad, A. & Zekavati, A. (2007). Comparative study of the curriculum of teacher education systems of England, Japan, France, Malaysia, and Iran. Educational Innovations Quarterly, 26 (2), 35-62.

Newfields, T. (2006). Teacher development and assessment literacy. Authentic Communication: Proceedings of the 5th Annual JALT Pan-SIG Conference. May 13-14, 2006. Shizuoka, Japan: Tokai University College of Marine Science, pp. 48-73.

Notar, C. E., Zuelke, D. C., Wilson, J. D., & Yunker, B. D. (2004). The table of specifications: Insuring accountability in teacher made tests. Journal of Instructional Psychology, 31, 115-129

Orpwood, G. (2001). The role of assessment in science curriculum reform. Assessment in Education. 8(2), pp. 135-151.

O'Loughlin, K. (2006). Learning about second language assessment: Insights from a postgraduate student on-line subject forum. University of Sydney Papers in TESOL, 1, 71–85.

Popham, W. J. (1987). The merits of measurement-driven instruction. Phi Delta Kappan, 68, 679-682.

Pintrich, P. R. (2002). The role of metacognitive knowledge in learning, teaching, and assessing. Theory into Practice, 41(4), 219-225.

Rabihavi, F., Parsa, A., & Elhampour, H. (2011). Study of compatibility of the exams of teacher training centers of Khouzestan province with psychomertry parameters. Paper Presented at Teacher Education Curriculum Conference.

Shohamy, E. (2005). The power of tests over teachers: The power of teachers over tests. In D. J. Tedick (Ed.), Second language teacher education (pp. 101-111). Mahwah, NJ and London: Lawrence Erlbaum.

Squire, P. J. (2001). Cognitive levels of testing agricultural science in senior secondary schools in Botswana. Education, 118(1), 100-110.

Stiggins, R. J. (1991). Assessment literacy. Phi Delta Kappan, 72, 534-539.

Stiggins, R. J. (1999, Spring). Evaluating classroom assessment training in teacher education programs. Educational Measurement: Issues and Practice, 23-27.

Stiggins, R. J. (2002). Assessment crisis: The absence of assessment for learning. Phi Delta Kappan, 83(10), 758-765.




DOI: https://doi.org/10.7575/aiac.ijalel.v.4n.4p.8

Refbacks

  • There are currently no refbacks.




Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

2012-2023 (CC-BY) Australian International Academic Centre PTY.LTD

International Journal of Applied Linguistics and English Literature

To make sure that you can receive messages from us, please add the journal emails into your e-mail 'safe list'. If you do not receive e-mail in your 'inbox', check your 'bulk mail' or 'junk mail' folders.