Is your curriculum GenAI-proof? A method for GenAI impact assessment and a case study

MedEdPublish, Journal Year: 2025, Volume and Issue: 15, P. 11 - 11

Published: March 26, 2025

Background Generative AI (GenAI) such as ChatGPT can take over tasks that previously could only be done by humans. Although GenAI provides many educational opportunities, it also poses risks invalid assessments and irrelevant learning outcomes. This article presents a broadly applicable method to (1) determine current assessment validity, (2) assess which outcomes are impacted student use (3) decide whether alter formats and/or is exemplified the case-study on our medical informatics curriculum. We developed five-step evaluate address impact of GenAI. In collaborative manner, courses in curriculum analysed their plans together with teachers, adapted usage. Results 57% assessments, especially writing programming, were at risk reduced validity relevance. was closer related content structure than complexity according Bloom’s taxonomy. During retreats, lecturers discussed relevance students should able achieve them or without Furthermore, results led plan increase literacy years study. Subsequently coordinators asked either adjust preclude use, include literacy. For 64% format for 36% adapted. Conclusion The majority outcomes, leading us adapt offer potential blueprint institutions facing similar challenges.

Language: Английский

---

Science Mapping of the Knowledge Base on the Effects of Artifcial Intelligence (AI)-Based Chatbots on Student Learning Outcomes: A Bibliometric Study

Studies in computational intelligence, Journal Year: 2025, Volume and Issue: unknown, P. 463 - 489

Published: Jan. 1, 2025

Language: Английский

---

Automatic Short Answer Grading in the LLM Era: Does GPT-4 with Prompt Engineering beat Traditional Models?

Published: Feb. 21, 2025

Language: Английский

---

Empowering Student Learning Through Artificial Intelligence: A Bibliometric Analysis

Journal of Educational Computing Research, Journal Year: 2024, Volume and Issue: 62(8), P. 2042 - 2075

Published: Aug. 28, 2024

Scholarly interest in artificial intelligence (AI) has surged as researchers delve into its transformative impact on various aspects of our lives. AI poses both benefits and challenges, particularly the context educators' endeavors to comprehend intricacies students' learning processes. Although use enhance assist student is relatively new, exponential growth scholarly attention publications recent years underscores compelling necessity for further inquiry. Investigating this area crucial understanding emerging trends research domain. This study aims provide insights burgeoning trajectories from a perspective. Using bibliometric approach, examined 663 articles pertaining interface between published 1961 2024. Our findings reveal four major thematic areas including education educational technology, AI-driven environments, essential enablers, human highlight promising avenues at intersection.

Language: Английский

---

Prompt Engineering for Automatic Short Answer Grading in Brazilian Portuguese

Published: Nov. 4, 2024

Automatic Short Answer Grading (ASAG) is a prominent area of Artificial Intelligence in Education (AIED). Despite much research, developing ASAG systems challenging, even when focused on single subject, mostly due to the variability length and content students' answers. While recent research has explored Large Language Models (LLMs) enhance efficiency ASAG, LLM performance highly dependent prompt design. In that context, engineering plays crucial role. However, best our knowledge, no systematically investigated ASAG. Thus, this study compares over 128 combinations for Portuguese dataset based GPT-3.5-Turbo GPT-4-Turbo. Our findings indicate role specific components improving GPT results shows GPT-4 consistently outperformed GPT-3.5 domain. These insights guide design context Brazilian Portuguese. Therefore, we recommend students, educators, developers leverage these optimize benefit from advancements offered by state-of-the-art LLMs whenever possible.

Language: Английский

---

Evaluating the role of Artificial Intelligence in sustainable development goals with an emphasis on “quality education”

Discover Sustainability, Journal Year: 2024, Volume and Issue: 5(1)

Published: Dec. 3, 2024

The integration of Artificial Intelligence (AI), particularly advancements in Generative AI technologies such as Large Language Models (LLMs)—of which ChatGPT is a notable example—marks pivotal step addressing global challenges within the framework Sustainable Development Goals (SDGs). Specifically, SDG4 (Quality Education), these open have potential to revolutionize education by providing scalable, personalized learning experiences, improving access quality education, and optimizing resource allocation. By reducing barriers educational equity supporting lifelong learning, contributes not only enhancing outcomes but also broader pillars sustainability—social, economic, environmental. Despite promising applications, existing literature reveals significant gaps understanding full scope AI's role achieving SDGs. This study employs bibliometric analysis quantify current research on contribution sustainable development, with particular focus sustainability. Our highlights emerging trends, key contributors, prevalent themes academic discourse, robust foundation for future research. We argue that deeper capabilities can inform more effective policies strategic initiatives, fostering equitable systems. Future should further explore ethical considerations long-term societal impacts into other sectors. offers comprehensive overview landscape, identifies critical areas investigation, sets stage continued inquiry

Language: Английский

---

Utilitarian Use vs. Hedonic Use? The Influence of ChatGPT Usage Type on User Satisfaction

Global Journal of Media Studies, Journal Year: 2024, Volume and Issue: 11(2), P. 79 - 98

Published: April 1, 2024

在不同的使用场景下,用户对ChatGPT 的期望和需求可能存在显著差异,这直接影响了用户的使用体验和满意度。现有关于ChatGPT使用满意度的研究相对有限,本研究从ChatGPT使用类型切入,立足于期望不一致理论,探讨ChatGPT 的不同使用类型(功能导向vs娱乐导向)对用户满意度的影响,并力图揭示其后的作用机制。通过开展一项嵌入于真实情境的单因素组间随机实验,研究者发现,与功能导向的ChatGPT 使用相比,娱乐导向ChatGPT 使用场景下用户的满意度更高。具体而言,在答案准确性和完整性满意度上,娱乐导向的ChatGPT使用显著高于功能导向使用,而在答案时效性方面,两组不存在显著差异。此外,挫败感在ChatGPT使用类型与用户满意度之间起中介作用。与功能导向ChatGPT 使用相比,娱乐导向使用情境中的用户挫败感更弱,进而导致了更高的满意度。

---

Automating board-game based learning. A comprehensive study to assess reliability and accuracy of AI in game evaluation

Intelligenza Artificiale, Journal Year: 2024, Volume and Issue: 18(1), P. 103 - 119

Published: July 12, 2024

Game-Based Learning (GBL) and its subset, Board (bGBL), are dynamic pedagogical approaches leveraging the immersive power of games to enrich learning experience. bGBL is distinguished by tactile social dimensions, fostering interactive exploration, collaboration, strategic thinking; however, adoption limited due lack preparation teachers educators instructional frameworks in scientific literature. Artificial intelligence (AI) tools have potential automate or assist design, but carry significant open questions, including bias, context sensitivity, privacy issues, evidence. This study investigates ChatGPT as a tool for selecting board educational purposes, testing reliability, accuracy, context-sensitivity through comparison with human experts evaluation. Results show high internal consistency, whereas correlation analyses reveal moderate agreement expert ratings. Contextual factors shown influence rankings, emphasizing need better understand both decision-making processes AI limitations. research provides novel approach bGBL, empirical evidence benefits integrating into highlights current challenges limitations theory, paving way more effective personalized experiences.

Language: Английский

---

Students' Perceptions of Using ChatGPT for Academic Writing in English

Półrocznik Językoznawczy Tertium, Journal Year: 2024, Volume and Issue: 9(1), P. 219 - 249

Published: Nov. 15, 2024

This article explores the perceptions of university students on use ChatGPT for academic writing in English. Participants (n = 79) are all mandatory English-language courses at a Language Centre Finland. They predominantly first-year bachelor’s degree from various programmes different faculties. Participants’ insights were collected via survey that was administered to several intact groups during autumn semester 2023. The quantitative and qualitative data which analysed discussed light students’ developing skills study sheds specific uses AI-driven tool as well their its impact not only process product, but also own skills. results indicated perceived have above average usability, finding supported elucidated by free responses concerning ways they used this technology. Conversely, reasons some had it included, amongst others, lack need, ethical concerns doubts about usefulness. Given continued development availability large language models such ChatGPT, research has clear implications stakeholders higher education. In particular, illustrating how utilise writing, provides teachers with needed ensure course outcomes, content assessments remain reflective knowledge practices.

Language: Английский

---

University Student Readiness and Academic Integrity in Using ChatGPT and AI Tools for Assessments

Lecture notes in educational technology, Journal Year: 2024, Volume and Issue: unknown, P. 69 - 88

Published: Jan. 1, 2024

Language: Английский

---