AI-generated feedback on writing: insights into efficacy and ENL student preference

International Journal of Educational Technology in Higher Education, Journal Year: 2023, Volume and Issue: 20(1)

Published: Oct. 26, 2023

Abstract The question of how generative AI tools, such as large language models and chatbots, can be leveraged ethically effectively in education is ongoing. Given the critical role that writing plays learning assessment within educational institutions, it growing importance for educators to make thoughtful informed decisions what capacity tools should assist development students’ skills. This paper reports on two longitudinal studies. Study 1 examined outcomes 48 university English a new (ENL) learners six-week long repeated measures quasi experimental design where group received feedback generated from ChatGPT (GPT-4) control their human tutor. 2 analyzed perceptions different 43 ENLs who both Results study showed no difference between groups. results revealed near even split preference AI-generated or human-generated feedback, with clear advantages forms apparent data. main implication these studies use likely incorporated into ENL essay evaluation without affecting outcomes, although we recommend blended approach utilizes strengths feedback. contribution this addressing an automatic evaluator while incorporating learner perspectives.

Language: Английский

---

Educational Design Principles of Using AI Chatbot That Supports Self-Regulated Learning in Education: Goal Setting, Feedback, and Personalization

Sustainability, Journal Year: 2023, Volume and Issue: 15(17), P. 12921 - 12921

Published: Aug. 27, 2023

The invention of ChatGPT and generative AI technologies presents educators with significant challenges, as concerns arise regarding students potentially exploiting these tools unethically, misrepresenting their work, or gaining academic merits without active participation in the learning process. To effectively navigate this shift, it is crucial to embrace a contemporary educational trend establish pedagogical principles for properly utilizing emerging like promote self-regulation. Rather than suppressing AI-driven tools, should foster collaborations among stakeholders, including educators, instructional designers, researchers, developers. This paper proposes three key integrating chatbots classrooms, informed by Zimmerman’s Self-Regulated Learning (SRL) framework Judgment (JOL). We argue that current conceptualization education inadequate, so we advocate incorporation goal setting (prompting), self-assessment feedback, personalization essential principles. First, propose teaching prompting important developing students’ SRL. Second, configuring reverse chatbot’s capability will help guide SRL monitoring understanding. Third, data-driven mechanism enables an chatbot provide analytics helps learners reflect on develop strategies. By bringing JOL, aim guidelines implementing contexts, focus promoting self-regulation higher through AI-assisted pedagogy design.

Language: Английский

---

Analyzing the students' views, concerns, and perceived ethics about chat GPT usage

Computers and Education Artificial Intelligence, Journal Year: 2023, Volume and Issue: 5, P. 100180 - 100180

Published: Jan. 1, 2023

Artificial Intelligence has greatly revolutionized education in many aspects. Today, AI-enabled language models, such as ChatGPT, are gaining popularity due to their characteristics and benefits. However, users also consider them a threat educational integrity purposes. This research examined ChatGPT usage among students the United Arab Emirates (UAE), views, concerns, perceived ethics. The data was gathered from 388 two universities Al Ain city using Yamane's formula. Findings showed that revolutionary technology helps ways. effect of Usage remained significant on students' views. path analysis supported second hypothesis, proposing Students' Concerns. Finally, findings indicated validation final showing Perceived Ethics UAE. Therefore, this study concluded useful concerning effects integrity. implementing practical guidelines can assist making informed decisions shaping policies within institutions. Recognizing complexities importance usage, teachers policymakers keep balance by leveraging improve while upholding ethical practices promote critical thinking, originality, students.

Language: Английский

---

Application of generative artificial intelligence (GenAI) in language teaching and learning: A scoping literature review

Computers and Education Open, Journal Year: 2024, Volume and Issue: 6, P. 100174 - 100174

Published: March 28, 2024

This scoping literature review examines the application of Generative Artificial Intelligence (GenAI), a disruptive technology, in language teaching and learning. Since its launch November 2022, GenAI has captured global attention with OpenAI's ChatGPT, powered by generative pre-trained transformer-3 (GPT-3) large-language model. The emergence holds immense implications across various domains, including education. aims to provide an overview current state research identify gaps future directions this emerging field. follows PRISMA-ScR guidelines includes eligible publications published between 2017 July 2023. Four electronic databases were searched 41 224 initial papers eventually selected for review. findings reveal key terms related education, most researched study education levels, areas research, attitudes towards GenAI, potential benefits challenges application. highlights several gaps, need more empirical studies assess effectiveness impact tools, discussion ethical considerations, targeted interventions specific skills, stakeholder engagement responsible integration. Educators are encouraged incorporate tools into their practices while remaining vigilant about risks. Continuous professional development educators is crucial ensure informed decision-making effective integration tools. contributes existing knowledge on use informs practice rapidly evolving

Language: Английский

---

AI literacy and its implications for prompt engineering strategies

Computers and Education Artificial Intelligence, Journal Year: 2024, Volume and Issue: 6, P. 100225 - 100225

Published: April 18, 2024

Artificial intelligence technologies are rapidly advancing. As part of this development, large language models (LLMs) increasingly being used when humans interact with systems based on artificial (AI), posing both new opportunities and challenges. When interacting LLM-based AI system in a goal-directed manner, prompt engineering has evolved as skill formulating precise well-structured instructions to elicit desired responses or information from the LLM, optimizing effectiveness interaction. However, research perspectives non-experts using through how literacy affects prompting behavior is lacking. This aspect particularly important considering implications LLMs context higher education. In present study, we address issue, introduce skill-based approach engineering, explicitly consider role non-experts' (students) their skills. We also provide qualitative insights into students' intuitive behaviors towards systems. The results show that higher-quality skills predict quality LLM output, suggesting indeed required for use generative tools. addition, certain aspects can play targeted adaptation within We, therefore, argue integration educational content current curricula enable hybrid intelligent society which students effectively tools such ChatGPT.

Language: Английский

---

The use of ChatGPT in teaching and learning: a systematic review through SWOT analysis approach

Frontiers in Education, Journal Year: 2024, Volume and Issue: 9

Published: Feb. 9, 2024

Introduction The integration of ChatGPT, an advanced AI-powered chatbot, into educational settings, has caused mixed reactions among educators. Therefore, we conducted a systematic review to explore the strengths and weaknesses using ChatGPT discuss opportunities threats in teaching learning. Methods Following PRISMA flowchart guidelines, 51 articles were selected 819 studies collected from Scopus, ERIC Google Scholar databases period 2022-2023. Results synthesis data extracted included revealed 32 topics including 13 strengths, 10 weaknesses, 5 4 We used Biggs’s Presage-Process-Product (3P) model learning categorize three components 3P model. Discussion In Presage stage, analyzed how interacts with student characteristics contexts ensure that technology adapts effectively diverse needs backgrounds. Process impacted activities determine its ability provide personalized, adaptive, effective instructional support. Finally, Product evaluated contributed outcomes. By carefully considering application each stage learning, educators can make informed decisions, leveraging addressing optimize processes.

Language: Английский

---

AI Chatbots in Chinese higher education: adoption, perception, and influence among graduate students—an integrated analysis utilizing UTAUT and ECM models

Frontiers in Psychology, Journal Year: 2024, Volume and Issue: 15

Published: Feb. 7, 2024

This study is centered on investigating the acceptance and utilization of AI Chatbot technology among graduate students in China its implications for higher education. Employing a fusion UTAUT (Unified Theory Acceptance Use Technology) model ECM (Expectation-Confirmation Model), research seeks to pinpoint pivotal factors influencing students' attitudes, satisfaction, behavioral intentions regarding Chatbots. The constructs comprising seven substantial predictors aimed at precisely foreseeing users' behavior with Collected from 373 enrolled various universities across China, self-reported data subject analysis using partial-least squares method structural equation modeling confirm model's reliability validity. findings validate out eleven proposed hypotheses, underscoring influential role constructs, particularly "Confirmation" "Satisfaction," outweighing impact behavior. Specifically, perceived confirmation significantly influences their satisfaction subsequent intention continue Additionally, "Personal innovativeness" emerges as critical determinant shaping intention. emphasizes need further exploration tool adoption educational settings encourages continued investigation potential teaching learning environments.

Language: Английский

---

Empowering education development through AIGC: A systematic literature review

Education and Information Technologies, Journal Year: 2024, Volume and Issue: 29(13), P. 17485 - 17537

Published: Feb. 29, 2024

Language: Английский

---

Generative Artificial Intelligence in Higher Education: Exploring Ways of Harnessing Pedagogical Practices with the Assistance of ChatGPT

Deleted Journal, Journal Year: 2024, Volume and Issue: 1(2), P. 103 - 111

Published: March 20, 2024

There is a growing interest in using generative artificial intelligence (AI) for educational purposes within the higher education environments, while AI applications (such as ChatGPT) can transform traditional teaching and learning methods. ChatGPT an advanced tool that generates new content human-like responses. The purpose of this paper to use research assistant order explore ways be harnessed enhance pedagogical practices education. This qualitative study, which output-responses generated by provided starting point investigation. various including personalized learning, automated assessment feedback generation, virtual assistants chatbots, creation, resource recommendation, time management, language translation support, assistance, simulations labs. Other affordances strengthen experience regard collaboration communication, accessibility inclusivity, well literacy. When implementing tools such education, ethical considerations (e.g., data privacy, transparency, accessibility, cultural sensitivity), potential misuses concerns need also addressed. Although aid generation content-ideas further exploration, it complementary-supportive tool, its output necessitates human evaluation review. integration other process/practices has implications educators, students, design curricula, university policy makers. Received: 17 January 2024 | Revised: 27 February Accepted: 19 March Conflicts Interest author declares she no conflicts work. Data Availability Statement sharing not applicable article were created or analyzed study.

Language: Английский

---

A systematic literature review of empirical research on ChatGPT in education

Discover Education, Journal Year: 2024, Volume and Issue: 3(1)

Published: May 26, 2024

Abstract Over the last four decades, studies have investigated incorporation of Artificial Intelligence (AI) into education. A recent prominent AI-powered technology that has impacted education sector is ChatGPT. This article provides a systematic review 14 empirical incorporating ChatGPT various educational settings, published in 2022 and before 10th April 2023—the date conducting search process. It carefully followed essential steps outlined Preferred Reporting Items for Systematic Reviews Meta-Analyses (PRISMA 2020) guidelines, as well Okoli’s (Okoli Commun Assoc Inf Syst, 2015) rigorous transparent review. In this review, we aimed to explore how students teachers utilized primary findings those studies. By employing Creswell’s (Creswell Educational research: planning, conducting, evaluating quantitative qualitative research [Ebook], Pearson Education, London, coding techniques data extraction interpretation, sought gain insight their initial attempts at approach also enabled us extract insights considerations can facilitate its effective responsible use future contexts. The results show learners virtual intelligent assistant, where it offered instant feedback, on-demand answers, explanations complex topics. Additionally, used enhance writing language skills by generating ideas, composing essays, summarizing, translating, paraphrasing texts, or checking grammar. Moreover, turned an aiding tool directed personalized learning assisting understanding concepts homework, providing structured plans, clarifying assignments tasks. However, specific (n = 3, 21.4%) overuse may negatively impact innovative capacities collaborative competencies among learners. Educators, on other hand, create lesson generate quizzes, provide additional resources, which helped them productivity efficiency promote different teaching methodologies. Despite these benefits, majority reviewed recommend importance training, support, clear guidelines both educators mitigate drawbacks. includes developing critical evaluation assess accuracy relevance information provided ChatGPT, strategies integrating human interaction collaboration activities involve AI tools. Furthermore, they ongoing proactive dialogue with policymakers, stakeholders, practitioners refine environments. could serve insightful resource who seek integrate stimulate further field.

Language: Английский

---