Emotion-Aware Embedding Fusion in Large Language Models (Flan-T5, Llama 2, DeepSeek-R1, and ChatGPT 4) for Intelligent Response Generation

AI, Journal Year: 2025, Volume and Issue: 6(3), P. 56 - 56

Published: March 13, 2025

Empathetic and coherent responses are critical in automated chatbot-facilitated psychotherapy. This study addresses the challenge of enhancing emotional contextual understanding large language models (LLMs) psychiatric applications. We introduce Emotion-Aware Embedding Fusion, a novel framework integrating hierarchical fusion attention mechanisms to prioritize semantic features therapy transcripts. Our approach combines multiple emotion lexicons, including NRC Emotion Lexicon, VADER, WordNet, SentiWordNet, with state-of-the-art LLMs such as Flan-T5, Llama 2, DeepSeek-R1, ChatGPT 4. Therapy session transcripts, comprising over 2000 samples, segmented into levels (word, sentence, session) using neural networks, while these pooling techniques refine representations. Attention mechanisms, multi-head self-attention cross-attention, further features, enabling temporal modeling shifts across sessions. The processed embeddings, computed BERT, GPT-3, RoBERTa, stored Facebook AI similarity search vector database, which enables efficient clustering dense spaces. Upon user queries, relevant segments retrieved provided context LLMs, their ability generate empathetic contextually responses. proposed is evaluated practical use cases demonstrate real-world applicability, AI-driven chatbots. system can be integrated existing mental health platforms personalized based on data. experimental results show that our enhances empathy, coherence, informativeness, fluency, surpassing baseline improving LLMs’ intelligence adaptability for

Language: Английский

---

Human guided empathetic AI agent for mental health support leveraging reinforcement learning-enhanced retrieval-augmented generation

Cognitive Systems Research, Journal Year: 2025, Volume and Issue: unknown, P. 101337 - 101337

Published: Feb. 1, 2025

Language: Английский

---

Navigating Emotions Through Art: Recommendations for Designing Art-Therapy Based Chatbots for Trauma-Impacted Youth

Published: April 23, 2025

Language: Английский

---

A Self-Determination Theory-based Career Counseling Chatbot: Motivational Interactions to Address Career Decision-Making Difficulties and Enhance Engagement

Published: April 23, 2025

Language: Английский

---

Artificial Intimacy: Exploring Normativity and Personalization Through Fine-tuning LLM Chatbots

Published: April 25, 2025

Language: Английский

---