Developing a proficiency test of Academic English in the Indonesian higher education context
Downloads
Standardized tests remain crucial for students whose first language is not English in today’s globalized world, despite ongoing debates about their suitability. The purpose of this research is to develop an academic English proficiency test for higher education in Indonesia. The data were derived from a needs analysis conducted through focus group discussions (FGDs) and a pre-survey for the existing academic English proficiency test, followed by a test design process: creating a test blueprint and developing question items, and a second survey following a trial test with 538 test takers. The findings indicate that adjustments were required to the test format and duration, a basis for developing a new test format. Additionally, students reported a preference for computer-based tests. During the test design process, the research team revised the test, retained the test objectives, and modified the test item types. Lastly, post-test feedback and item analysis indicated an imbalance in item difficulty in the Structure and Written Expression section, while the Academic Listening and Academic Reading sections demonstrated relatively balanced difficulty levels. Overall, the findings of this research indicate a desire to revisit and refine the existing test to better meet students’ needs while maintaining its objectives.
Downloads
Al-Zboon, H. S., Alrekebat, A., & Abdelrahman, M. B. (2021). The effect of multiple-choice test items’ difficulty degree on the reliability coefficient and the standard error of measurement depending on the Item Response Theory (IRT). The International Journal of Higher Education, 10, 22. DOI: https://doi.org/10.5430/ijhe.v10n6p22
Canagarajah, S. (2006). Changing communicative needs, revised assessment objectives: Testing English as an international language. Language Assessment Quarterly, 3(3), 229-242. DOI: https://doi.org/10.1207/s15434311laq0303_1
Cappuzzo, B. (2024). Plurilingualism, multilingualism, and lingua Franca English in today’s globalised world. International Journal of Linguistics Literature and Culture. DOI: https://doi.org/10.19044/llc.v11no1a1
Chemir, S., & Kitila, T. (2022). English for academic purposes learners' needs analysis: Language difficulties encountered by university students in Ethiopia. Celtic : A Journal of Culture, English Language Teaching, Literature and Linguistics. DOI: https://doi.org/10.22219/celtic.v9i1.20646
Choi, I. -C. (2008). The impact of EFL testing on EFL education in Korea. Language Testing, 25(1), 39–62. DOI: https://doi.org/10.1177/0265532207083744
Damayanti, I. L., Derinalp, P., Asyifa, F., & Suryatama, K. (2024). Exploring English for academic purposes program: Needs analysis and impact evaluation. Studies in English Language and Education. DOI: https://doi.org/10.24815/siele.v11i3.38329
Faisal, A. H., Anshori, D. S., Sastromiharjo, A., & Mulyati, Y. (2024). Designing a data literacy-based speaking skills assessment instrument for high school students. JISAE: Journal of Indonesian Student Assessment and Evaluation. DOI: https://doi.org/10.21009/jisae.v10i1.43780
Hamid, M. O., Hoang, N. T. H., & Kirkpatrick, A. (2019). Language tests, linguistic gatekeeping and global mobility. Current Issues in Language Planning, 20(3), 226–244. DOI: https://doi.org/10.1080/14664208.2018.1495371
Hsieh, C. N. (2017). The case of Taiwan: Perceptions of college students about the use of the TOEIC® tests as a condition of graduation. ETS Research Report Series, 2017(1), 1-12. https://files.eric.ed.gov/fulltext/EJ1168727.pdf
Hu, G. W. (2012). Assessing English as an international language. In L. Alsagoff, S. L. McKay, G. W. Hu, & W. Renandya (Eds.), Principles and practices for teaching English as an international language (pp. 123-143). Routledge.
Huang, Z., Mustakim, S., & Ghazali, N. (2024). Analysing the challenges of developing English for Specific Purpose (ESP) courses for Sino-Foreign cooperative educational programs. Cakrawala Pendidikan: Jurnal Ilmiah Pendidikan, 43(3), 765-772. DOI: https://doi.org/10.21831/cp.v43i3.64927
Hughes, A. (2003). Testing for language teachers (2nd Ed.). Cambridge. DOI: https://doi.org/10.1017/CBO9780511732980
Iriani, T., Anisah, A., Luthfiana, Y., Maknun, J., & Dewi, N. I. K. (2023). Analytical rubric development design for objective test assessment. Proceedings of the 4th Annual Conference of Engineering and Implementation on Vocational Education, ACEIVE 2022, 20 October 2022, Medan, North Sumatra, Indonesia. DOI: https://doi.org/10.4108/eai.20-10-2022.2328882
Nhan, T. (2013). The TOEIC® test as an exit requirement in universities and colleges in Danang City, Vietnam: Challenges and impacts. International Journal of Innovative Interdisciplinary Research, 2(1), 33–50.
Ojha, L. P. (2022). World Englishes, monolingual bias, and standardized tests in a multilingual world: Ideologies, practices, and the missing link. Journal of NELTA, 27(1-2), 88-105. DOI: https://doi.org/10.3126/nelta.v27i1-2.53197
Pennycook, A., & Candlin, C. N. (2017). The cultural politics of English as an international language. Routledge.
Qian, D. D. (2008). English language assessment in Hong Kong: A survey of practices, developments and issues. Language Testing, 25(1), 85-110. DOI: https://doi.org/10.1177/0265532207083746
Sadeghpour, M., & Sharifian, F. (2019). World Englishes in English language teaching. World Englishes, 38(1-2), 245-258. DOI: https://doi.org/10.1111/weng.12372
Schissel, J. L., Leung, C., López-Gopar, M., & Davis, J. R. (2018). Multilingual learners in language assessment: Assessment design for linguistically diverse communities. Language and Education, 167-182. DOI: https://doi.org/10.1080/09500782.2018.1429463
Song, Y., & Zhou, J. (2022). Revising English language course curriculum among graduate students: An EAP needs analysis study. SAGE Open, 12. DOI: https://doi.org/10.1177/21582440221093040
Sumardi, S., & Muamaroh, M. (2020). Edmodo impacts: Mediating digital class and assessment in English language teaching. Cakrawala Pendidikan, 39(2), 319-331. DOI: https://doi.org/10.21831/cp.v39i2.30065
Tan, T. K. (2024). Evaluating assessment via item response theory utilizing information function with R. The Quantitative Methods for Psychology. https://doi.org/10.20982/tqmp.20.1.p033
Wang, Y., & Li, S. (2020). Issues, challenges, and future directions for multilingual assessment. Journal of Language Teaching and Research, 11(6), 914-919. http://dx.doi.org/10.17507/jltr.1106.06
Winantaka, B., Efendi, A., & Putro, N. H. P. S. (2025). Exploring flipped classroom for business English: Preliminary insights from student voices and reflections. Cakrawala Pendidikan: Jurnal Ilmiah Pendidikan, 44(3), pp.730-739. DOI https://doi.org/10.21831/cp.v44i3.65140
Zhang-Wu, Q., & Brisk, M. E. (2021). “I must have taken a fake TOEFL!”: Rethinking linguistically responsive instruction through the eyes of Chinese international freshmen. TESOL Quarterly, 55(4), 1136-1161. DOI: https://doi.org/10.1002/tesq.3077
Copyright (c) 2026 Didi Sukyadi, Fuad Abdul Hamied, Ika Damayanti, Ari Arifin Danuwijaya, Lukman Hakim, Firly Asyifa
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Jurnal Cakrawala Pendidikan, Jurnal Ilmiah Pendidikan, with ISSN: 0216-1370, is published by the Institute of Education Development and Quality Assurance (LPPMP UNY). Cakrawala Pendidikan has been recently has been re-accredited by Indonesian Ministry of Education and Culture decision Number 230/E/KPT/2022 which is valid for five years since enacted on 30 December 2022.
