惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

Google DeepMind News
Google DeepMind News
Engineering at Meta
Engineering at Meta
Vercel News
Vercel News
T
The Blog of Author Tim Ferriss
Y
Y Combinator Blog
B
Blog RSS Feed
Blog — PlanetScale
Blog — PlanetScale
腾
腾讯CDC
Last Week in AI
Last Week in AI
WordPress大学
WordPress大学
D
Docker
The Cloudflare Blog
C
Check Point Blog
T
Tailwind CSS Blog
月光博客
月光博客
IT之家
IT之家
博
博客园_首页
Hugging Face - Blog
Hugging Face - Blog
A
About on SuperTechFans
博
博客园 - 三生石上(FineUI控件)
P
Proofpoint News Feed
U
Unit 42
奇客Solidot–传递最新科技情报
奇客Solidot–传递最新科技情报
宝玉的分享
宝玉的分享

cs.AI updates on arXiv.org

Fairness is Not Flat: Geometric Phase Transitions Against Shortcut Learning Symmetry Reveals Layerwise Dynamics: How Transformers Perform In-Context Classification From Translation to Superset: Benchmark-Driven Evolution of a Production AI Agent from Rust to Python Learning from Contrasts: Synthesizing Reasoning Paths from Diverse Search Trajectories CoRe-ECG: Advancing Self-Supervised Representation Learning for 12-Lead ECG via Contrastive and Reconstructive Synergy Governance by Design: A Parsonian Institutional Architecture for Internet-Wide Agent Societies Do LLMs Know Tool Irrelevance? Demystifying Structural Alignment Bias in Tool Invocations Learning to Forget -- Hierarchical Episodic Memory for Lifelong Robot Deployment BankerToolBench: Evaluating AI Agents in End-to-End Investment Banking Workflows EmbodiedGovBench: A Benchmark for Governance, Recovery, and Upgrade Safety in Embodied Agent Systems Cost-optimal Sequential Testing via Doubly Robust Q-learning From Answers to Arguments: Toward Trustworthy Clinical Diagnostic Reasoning with Toulmin-Guided Curriculum Goal-Conditioned Learning Use of AI Tools: Guidelines to Maintain Academic Integrity in Computing Colleges Bottleneck Tokens for Unified Multimodal Retrieval Towards Proactive Information Probing: Customer Service Chatbots Harvesting Value from Conversation Delving Aleatoric Uncertainty in Medical Image Segmentation via Vision Foundation Models A molecular clock for writing systems reveals the quantitative impact of imperial power on cultural evolution Pseudo-Unification: Entropy Probing Reveals Divergent Information Patterns in Unified Multimodal Models Evaluating the Impact of Medical Image Reconstruction on Downstream AI Fairness and Performance Retinal Cyst Detection from Optical Coherence Tomography Images Resilient Write: A Six-Layer Durable Write Surface for LLM Coding Agents When More Thinking Hurts: Overthinking in LLM Test-Time Compute Scaling Preference-Agile Multi-Objective Optimization for Real-time Vehicle Dispatching LoViF 2026 The First Challenge on Weather Removal in Videos Universal statistical signatures of evolution in artificial intelligence architectures AI Patents in the United States and China: Measurement, Organization, and Knowledge Flows From Perception to Planning: Evolving Ego-Centric Task-Oriented Spatiotemporal Reasoning via Curriculum Learning Agent Mentor: Framing Agent Knowledge through Semantic Trajectory Analysis PEMANT: Persona-Enriched Multi-Agent Negotiation for Travel Rethinking the Diffusion Model from a Langevin Perspective
Emotion-Aware Embedding Fusion in LLMs (Flan-T5, LLAMA 2,...
Abdur Rasool, Muhammad Irfan Shahzad, Hafsa Aslam, Vincent Chan, · 2024-10-02 · via cs.AI updates on arXiv.org

Empathetic and coherent responses are critical in auto-mated chatbot-facilitated psychotherapy. This study addresses the challenge of enhancing the emotional and contextual understanding of large language models (LLMs) in psychiatric applications. We introduce Emotion-Aware Embedding Fusion, a novel framework integrating hierarchical fusion and attention mechanisms to prioritize semantic and emotional features in therapy transcripts. Our approach combines multiple emotion lexicons, including NRC Emotion Lexicon, VADER, WordNet, and SentiWordNet, with state-of-the-art LLMs such as Flan-T5, LLAMA 2, DeepSeek-R1, and ChatGPT 4. Therapy session transcripts, comprising over 2,000 samples are segmented into hierarchical levels (word, sentence, and session) using neural networks, while hierarchical fusion combines these features with pooling techniques to refine emotional representations. Atten-tion mechanisms, including multi-head self-attention and cross-attention, further prioritize emotional and contextual features, enabling temporal modeling of emotion-al shifts across sessions. The processed embeddings, computed using BERT, GPT-3, and RoBERTa are stored in the Facebook AI similarity search vector database, which enables efficient similarity search and clustering across dense vector spaces. Upon user queries, relevant segments are retrieved and provided as context to LLMs, enhancing their ability to generate empathetic and con-textually relevant responses. The proposed framework is evaluated across multiple practical use cases to demonstrate real-world applicability, including AI-driven therapy chatbots. The system can be integrated into existing mental health platforms to generate personalized responses based on retrieved therapy session data.