Revolutionising Essay Evaluation DOI Creative Commons
Hassan Saleh Mahdi,

Abdullah Al-Khateeb

International Journal of Computer-Assisted Language Learning and Teaching, Journal Year: 2025, Volume and Issue: 15(1), P. 1 - 19

Published: Feb. 1, 2025

This study aims to develop a robust rubric for evaluating artificial intelligence (AI)–assisted essay writing in English as Foreign Language (EFL) contexts. Employing modified Delphi technique, we conducted comprehensive literature review and administered Likert scale questionnaires. process yielded nine key evaluation criteria, forming the initial rubric. The was applied evaluate 33 AI-assisted essays written by students part of an intensive course assignment. Statistical analysis revealed significant inter-rater reliability convergent validity coefficients, supporting adoption further development such rubrics across higher education institutions. developed subsequently used these using two AI tools: ChatGPT Claude. results indicated that both tools evaluated with similar scores, demonstrating consistency their assessment capabilities.

Language: Английский

Incorporating ChatGPT for EFL Writing and Its Effects on Writing Engagement DOI Creative Commons
Mark Feng Teng, Jerry Huang

International Journal of Computer-Assisted Language Learning and Teaching, Journal Year: 2025, Volume and Issue: 15(1), P. 1 - 21

Published: Jan. 23, 2025

Affective, behavioral, and cognitive engagements play crucial roles in how learners interact with process written feedback on their language production. The present study examines the efficacy of peer versus ChatGPT-generated an English as a Foreign Language (EFL) writing context. Participants (n = 169) were 1st-year undergraduate students at teacher education university China, enrolled mandatory class. control group 86) did not use ChatGPT, while treatment 83) engaged leveraging carefully designed prompts to receive writing. A survey instrument measuring affective, engagement was administered both start conclusion semester. Results revealed that ChatGPT has potential enhance specific aspects student engagement, like affective behavioral EFL Cognitive although slightly higher group, differ significantly between groups. findings suggest AI-generated can be integrated into instruction, its impact particularly warrants careful consideration. We finally provided pedagogical implications based findings.

Language: Английский

Citations

0
Revolutionising Essay Evaluation DOI Creative Commons
Hassan Saleh Mahdi,

Abdullah Al-Khateeb

International Journal of Computer-Assisted Language Learning and Teaching, Journal Year: 2025, Volume and Issue: 15(1), P. 1 - 19

Published: Feb. 1, 2025

This study aims to develop a robust rubric for evaluating artificial intelligence (AI)–assisted essay writing in English as Foreign Language (EFL) contexts. Employing modified Delphi technique, we conducted comprehensive literature review and administered Likert scale questionnaires. process yielded nine key evaluation criteria, forming the initial rubric. The was applied evaluate 33 AI-assisted essays written by students part of an intensive course assignment. Statistical analysis revealed significant inter-rater reliability convergent validity coefficients, supporting adoption further development such rubrics across higher education institutions. developed subsequently used these using two AI tools: ChatGPT Claude. results indicated that both tools evaluated with similar scores, demonstrating consistency their assessment capabilities.

Language: Английский

Citations

0