PERSON FIT ANALYSIS FOR ASSESSING ACADEMIC WRITING PERFORMANCE USING RASCH MODEL

Yenni Arif Rahman; Leny Hikmah Rentina; Ulfa Rahma Dhini

Authors

Yenni Arif Rahman Universitas Bina Sarana Informatika
Leny Hikmah Rentina Universitas Bina Sarana Informatika
Ulfa Rahma Dhini Universitas Bina Sarana Informatika

Keywords:

Person Fit, Writing Assessment, Rasch Model

Abstract

Assessing academic writing performance is a critical aspect of educational practices. The thesis is derived from writing is an essential skill that students need to develop to succeed academically and professionally. To fulfill this, the Rasch model offers important test statistics that play a crucial role in constructing tests related to evaluation and item selection problems, as well as in decision-making regarding the generated test scores. Building upon this narrative, this research is conducted with the aim of identifying person fit in assessing academic writing performance using the Rasch model. The sample in the form of essays was obtained from a group of 40 students who had previously undergone a six-month academic writing program. The data was then analyzed using Ministep 4.8.2.0 built for Rasch Model analysis. The analysis results indicated that there were 31 students in the person misfit category, suggesting a need to reconsider the appropriateness of the conducted treatment and whether there were other factors contributing to it. Additionally, a discrepancy was found in 5 students with persons misfit or overfit, and their better performance was observed on more difficult items, contrary to the Rasch model's profile

References

Andrich, D. (1978). A rating formulation for ordered response categories. Psychometrika, 43(1), 561â€“573. https://doi.org/https://doi.org/10.1007/BF02293814

Bond, T., & Fox, C. (2015). Applying the Rasch Model. Routledge. https://doi.org/https://doi.org/10.4324/9781315814698

Bond, T.G., & Fox, C. M. (2007). pplying the Rasch model: Fundamental measurement in the human sciences (2nd ed.). awrence Erlbaum Associate.

Boone, W. J., Staver, J. R., Yale, M. S., Boone, W. J., Staver, J. R., & Yale, M. S. (2014). Item Measures. Rasch Analysis in the Human Sciences. 93â€“110. https://doi.org/https://doi.org/10.1007/978-94-007-6857-4_5

Engelhard, G. (1992). The measurement of writing ability with a many-faceted Rasch model. Applied Measurement in Education, 5(3), 171â€“191.

Fisher, W. (2007). Rating scale instrument quality criteria. Rasch Measurement Transactions, 1.

Hambleton, R.K., Swaminathan, H., & R. H. J. (1991). Fundamental of item response theory. Sage Publishing.

Jacobs., Holly. L., Stephen, A., Zingkgraf., Deanne. R., Wormuth, V., Faye, H., Jane, B., H. (1981). Testing ESL Composition: A Practical Approach. Newbury House Publishers, Inc.

Karabatsos, G. (2003). Comparing the abberant response detection performance of thirty-six person-fit statistics. Applied Measurement in Education, 16(4), 277â€“298.

Li, G., Pan, Y., & Wang, W. (2021). Using Generalizability Theory and Many-Facet Rasch Model to Evaluate In-Basket Tests for Managerial Positions. 12(July), 1â€“10. https://doi.org/10.3389/fpsyg.2021.660553

Linacre, J. M. (2002). KR-20/Cronbach alpha or Rasch person reliability: Which tells us the truth? Rasch Measurement Transactions, 11, 580â€“581.

Linacre, J. M. (. (2002). What do infit and outfit mean-square and standardized mean? Rasch Measurement Transaction, 16, 878.

Meijer, R. R. (1996). Person-fit research: an introduction. Applied Measurement in Education, 9(1), 3â€“8.

Misbach, I. H., & Sumintono, B. (2014). Pengembangan dan Validasi Instrumen â€œPersepsi Siswa Tehadap Karakter Moral Guruâ€ di Indonesia dengan Model Rasch. . . PROCEEDING Seminar Nasional Psikometri, 148â€“162.

Osman, S. A., Naam, S. I., Jaafar, O., Badaruzzaman, W. H. W., & Rahmat, R. A. A. O. K. (2012). Application of Rasch Model in Measuring Studentsâ€™ Performance in Civil Engineering Design II Course. Procedia - Social and Behavioral Sciences, 56, 59â€“66. https://doi.org/10.1016/J.SBSPRO.2012.09.632

Rahman, Y. A. (2023). Person and Item Validity and Reliability in Essay Writing Using Rasch Model. 15(1), 41â€“55. https://doi.org/10.35457/konstruk.v15i1.2618

Razak, N. bin Abd, Khairani, A.Z. bin, & Thien, L. M. (2012). Examining quality of mathemtics test items using rasch model: Preminarily analysis. Procedia - Social and Behavioral Sciences, 69, 2205â€“2214. https://doi.org/https://doi.org/10.1016/j.sbspro.2012.12.187

Sumintono, B. & Widhiarso, W. (2013). Aplikasi Model Rasch untuk Penelitian Ilmu-Ilmu Sosial. Trim Komunikata Publishing House.

Tan, S. (2013). Validation of an Analytic Rating Scale for Writing: A Rasch Modeling Approach. Tabaran Institute of Higher Education. Iranian Journal of Language Testing, 3(1).

Wibisono, S. (2018). Aplikasi Model Rasch Untuk Validasi Instrumen Pengukuran Fundamentalisme Agama Bagi Responden Muslim. Jurnal Pengukuran Psikologi Dan Pendidikan Indonesia, 5(1). https://doi.org/https://doi.org/10.15408/jp3i.v5i1.9239