Published: Jan. 1, 2024

Emergency response missions require rapid and accurate information processing in noisy, chaotic environments where oral communications present significant challenges, leading to cognitive overload impaired decision-making. Augmented Reality (AR) Large Language Models (LLMs) have shown potential enhancing situational awareness by integrating digital data with the physical world improving dialogue management. However, effectively synthesizing these technologies into a system that aids first responders real-time remains challenge, clear need for research validate their impact on clarity coordination of during high-pressure missions. This study investigates integration AR LLMs emergency response, focusing controlling load related communications. Utilizing AR's capability overlay critical onto LLMs' advanced logic reasoning, aims develop an AI co-agent aiding audio dialogue-based tasks high-risk A customized system, incorporating Microsoft HoloLens2 monitoring, was tested participants human factor experiment (N=30). The 2x2 factorial evaluated effects LLM assistance performance load. Results showed notable improvements task accuracy reduced load, demonstrating effectiveness supporting operations. findings underline importance further this technologically innovative area, crucial optimizing strategies.

Language: Английский