2024 | Peter Andrews, Oda Nordberg, Stephanie Zubicueta Portales, Njål Borch, Frode Guribye, Kazuyuki Fujita, Morten Fjeld
AiCommentator is a Multimodal Conversational Agent (MCA) designed to enhance football viewing by providing both automated non-interactive and interactive commentary with embedded visualizations. The system integrates computer vision and large language models to offer tailored, interactive sports-viewing content. It uses a Discord bot for natural language interactions and a menu-based system for secondary device control. The study evaluates young adults' satisfaction and immersion across the two viewing modes, enhancing their understanding of in-game events and players. A mixed-methods evaluation with 16 participants found that while both modes were appreciated, the interactive mode was preferred for higher engagement and satisfaction. The paper presents the development of AiCommentator and the results from the user study, highlighting its potential to revolutionize sports viewing experiences.AiCommentator is a Multimodal Conversational Agent (MCA) designed to enhance football viewing by providing both automated non-interactive and interactive commentary with embedded visualizations. The system integrates computer vision and large language models to offer tailored, interactive sports-viewing content. It uses a Discord bot for natural language interactions and a menu-based system for secondary device control. The study evaluates young adults' satisfaction and immersion across the two viewing modes, enhancing their understanding of in-game events and players. A mixed-methods evaluation with 16 participants found that while both modes were appreciated, the interactive mode was preferred for higher engagement and satisfaction. The paper presents the development of AiCommentator and the results from the user study, highlighting its potential to revolutionize sports viewing experiences.