Psychometric Analysis of Try-Out Test Items on English Phrase Structure
Keywords:
English phrase structure, head and modifier, deductive teaching, psychometric analysis, classical test theoryAbstract
This study was based on the fact that understanding phrase structure is fundamental to developing syntactic competence in EFL learners. It aims to evaluate the psychometric quality of a lecturer-based phrase structure test using Classical Test Theory (CTT). The test consisted of 20 multiple-choice items covering eight aspects of phrase structure and was administered to 25 students enrolled in a phrase structure course selected through cluster-purposive sampling. The analysis focused on item difficulty, discrimination index, validity, and reliability. The findings indicate that 60% of the items were straightforward (p ≥ 0.70), while 40% exhibited low discrimination indices (d < 0.20), thereby compromising their ability to distinguish between high- and low-performing students. Moreover, the test's reliability score is generally acceptable (Cronbach’s alpha = 0.79). These results suggest that although the test demonstrates internal consistency, several items require revision to improve their validity and diagnostic power. The findings imply that classroom-based syntax assessments must be systematically evaluated to ensure that the test items effectively differentiate students’ levels of understanding and accurately measure syntactic competence. While the results also suggest that deductive instruction on phrase structure supports student learning, the effectiveness of such instruction should be interpreted cautiously in light of the quality of the assessment instrument.
References
Aarts, B., & Haegeman, L. (2020). English word classes and phrases. In The Handbook of English Linguistics: Second Edition (pp. 103–129). https://doi.org/10.1002/9781119540618.ch7
Ahmedov, S., Lesinger, F. Y., Sanivar, O., & Sanivar, P. (2021). Teaching anatomy in physical education: Deductive versus inductive methodology. International Journal of Human Movement and Sports Sciences, 9(4), 678–681. https://doi.org/10.13189/saj.2021.090411
Alemu, A. T., Tesfa, H., Mulugeta, A., Fenta, E. T., & Belay, M. A. (2024). Quality of multiple choice question items: Item analysis. International Journal of Scientific Reports, 10(6), 195–199. https://doi.org/10.18203/issn.2454-2156.intjscirep20241316
Anggoro, A. R., Mukhrizal, M., & Sufiyandi, S. (2022). A Syntactical Analysis on Sentence Structures Spoken by Joe Biden and Donald Trump in the Election Night Speeches. Journal of English Education and Teaching, 6(2), 188–206. https://doi.org/10.33369/jeet.6.2.188-206
Azizovna, N. R. (2023). Types of Phrases in English. Eurasian Research Bulletin, 18, 28–30.
Carnie, A. (2021). Syntax: A Generative Introduction, 4th Edition. Wiley-Blackwell.
Chuenchaichon, Y. (2022). An Error Analysis of Written English Paragraphs at Lexical, Syntactic, and Paragraph Levels Made by Thai EFL Non-English Major Students. 3L: Language, Linguistics, Literature, 28(2), 96–108. https://doi.org/10.17576/3L-2022-2802-07
Coombe, C., Vafadar, H., & Mohebbi, H. (2020). Correction to: Language assessment literacy: What do we need to learn, unlearn, and relearn? Language Testing in Asia, 10(3), 1–16. https://doi.org/10.1186/s40468-020-00114-1
Darabi Bazvand, A., Izanloo, B., Amirian, S. M. R., & Jalilzadeh, K. (2025). Evaluating differential item functioning through effect size measures in logistic regression: implications for language assessment. Language Testing in Asia, 15(1), 1–23. https://doi.org/10.1186/s40468-025-00403-7
Fan, Y., van der Graaf, J., Lim, L., Raković, M., Singh, S., Kilgour, J., Moore, J., Molenaar, I., Bannert, M., & Gašević, D. (2022). Towards investigating the validity of measurement of self-regulated learning based on trace data. Metacognition and Learning, 17(3), 949–987. https://doi.org/10.1007/s11409-022-09291-1
Gao, F., Yang, L., Wong, L. P. W., Zhang, Q., Sin, K. F., & Romano, A. (2025). Promoting Sustainable Career Development in Inclusive Education: A Psychometric Study of Career Maturity Among Students with Special Educational Needs †. Sustainability (Switzerland), 17(14), 6641. https://doi.org/10.3390/su17146641
Giofré, V. (2022). Functions and Distribution of Determiners in Old English Genitive Noun Phrases. Brno Studies in English, 48(1), 25–50. https://doi.org/10.5817/BSE2022-1-2
Haryudin, A. (2015). Validity and Reliability of English Summative Tests At Junior High School in West Bandung. P2M STKIP Siliwangi, 2(1), 77–90. https://doi.org/10.22460/p2m.v2i1p77-90.167
Himmelmann, N. P. (2022). Prosodic phrasing and the emergence of phrase structure. Linguistics, 60(3), 715–743. https://doi.org/10.1515/ling-2020-0135
Jannah, R., Hidayat, D. N., Husna, N., & Khasbani, I. (2021). An item analysis on multiple-choice questions: a case of a junior high school English try-out test in Indonesia. Leksika: Jurnal Bahasa, Sastra Dan Pengajarannya, 15(1), 9–17. https://doi.org/10.30595/lks.v15i1.8768
Jheng, W. C. S. (2022). The syntax of nominal modification and complex noun phrases in Siwkolan Amis. Concentric: Studies in Linguistics, 48(1), 1–29. https://doi.org/10.1075/consl.21014.jhe
Jheng, W. C. S. (2025). On the syntax of restrictive relative clauses in Siwkolan Amis. Concentric: Studies in Linguistics, 51(1), 70–120. https://doi.org/10.1075/consl.24003.jhe
Lu, J., & Liu, H. (2020). Do English noun phrases tend to minimize dependency distance? Australian Journal of Linguistics, 40(2), 246–262. https://doi.org/10.1080/07268602.2020.1789552
Mangila, B., & Echavez, N. (2025). Linguistic Features Constructing Notions of Peace: A Descriptive Study of English and Filipino Language Textbooks. Center for Educational Policy Studies Journal. https://doi.org/10.26529/cepsj.2014
Marpaung, F. D. N., Donny Adiatmana Ginting, Muhammad Hassan, Rosmen, & Yunita Sari Adelina. (2025). English Syntax Learning; Student Errors in Analyzing Sentence Structure through Tree Diagrams. IDEAS: Journal on English Language Teaching and Learning, Linguistics and Literature, 12(2), 2967–2983. https://doi.org/10.24256/ideas.v12i2.6223
Maskour, L., El Batri, B., Ksiksou, J., Jeronen, E., Agorram, B., Alami, A., & Bouali, R. (2022). Views of Moroccan University Teachers on Plant Taxonomy and Its Teaching and Learning Challenges. Education Sciences, 12(11), 20. https://doi.org/10.3390/educsci12110799
Miller, T. L., & Sande, H. (2021). Is word-level recursion actually recursion? Languages, 6(2), 1–27. https://doi.org/10.3390/languages6020100
Preda, A. (2021). Modification versus Complementation in the Structure of English Noun Phrases. Studia Universitatis Babeș-Bolyai Philologia, 66(2). https://doi.org/10.24193/subbphilo.2021.2.17
Rankin, T., & Whong, M. (2020). A Guide to the Linguists’ Guide to Grammar. In Grammar (pp. 1–40). Cambridge University Press. https://doi.org/10.1017/9781108623360.001
Rezigalla, A. A., Eleragi, A. M. E. S. A., Elhussein, A. B., Alfaifi, J., ALGhamdi, M. A., Al Ameer, A. Y., Yahia, A. I. O., Mohammed, O. A., & Adam, M. I. E. (2024). Item analysis: the impact of distractor efficiency on the difficulty index and discrimination power of multiple-choice items. BMC Medical Education, 24(1), 445. https://doi.org/10.1186/s12909-024-05433-y
Sapong, C. B. (2020). Semantic-Based Description of Jose Garcia Villa’s Select Poetic Texts. ACADEME University of Bohol, Graduate School and Professional Studies, 17(1), 1–23. https://doi.org/10.15631/aubgsps.v17i1.152
Symons, J., Dillon, H., & Hoffbeck, J. (2024). The effect of deductive and inductive teaching methods in an introductory programming course. 9. https://doi.org/10.18260/1-2--31897
Trklja, A. (2025). Mapping Recurrent Lexico-grammatical Patterns in English Through Subtree Fragments. Jazykovedny Casopis, 76(1), 95–112. https://doi.org/10.2478/jazcas-2025-0009
Zhu, C., Yi, B., & Luo, L. (2024). Base on contextual phrases with cross-correlation attention for aspect-level sentiment analysis. Expert Systems with Applications, 241. https://doi.org/10.1016/j.eswa.2023.122683
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Eusabinus Bunau, Eka Fajar Rahmani
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with this journal agree to the following terms:
a. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License - Share Alike that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
b. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
c. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.
USER RIGHTS
All articles published Open Access will be immediately and permanently free for everyone to read and download. We are continuously working with our author communities to select the best choice of license options, currently being defined for this journal as follows: Creative Commons Attribution-Share Alike (CC BY-SA)
