February 11–14, 2024, Denver, CO, USA | Cise Midoglu, Saeed Shafiee Sabet, Mehdi Houshmand Sarkhoosh, Mohammad Majidi, Sushant Gautam, Hakon Maric Solberg, Tomas Kupka, Pal Halvorsen
This paper presents an AI-based multimedia production framework for automatically generating and sharing sports highlights on social media. The framework addresses the tedious and manual process of publishing highlights, leveraging advancements in AI for content generation and personalization. The authors propose a comprehensive pipeline that includes event detection and classification, player detection and tracking, highlight clipping, cropping, thumbnail generation, game summarization, caption generation, and social media sharing. Each component of the pipeline is detailed, with experimental results and user studies demonstrating the effectiveness of the AI-driven approach. The framework aims to enhance audience engagement and improve the quality of experience (QoE) by automating various aspects of sports highlight production and distribution. The ultimate goal is to create a unified framework that can generate and share event/player video highlight compilations and textual summaries in an automated and end-to-end manner, with future work focusing on expanding the framework to different sports.This paper presents an AI-based multimedia production framework for automatically generating and sharing sports highlights on social media. The framework addresses the tedious and manual process of publishing highlights, leveraging advancements in AI for content generation and personalization. The authors propose a comprehensive pipeline that includes event detection and classification, player detection and tracking, highlight clipping, cropping, thumbnail generation, game summarization, caption generation, and social media sharing. Each component of the pipeline is detailed, with experimental results and user studies demonstrating the effectiveness of the AI-driven approach. The framework aims to enhance audience engagement and improve the quality of experience (QoE) by automating various aspects of sports highlight production and distribution. The ultimate goal is to create a unified framework that can generate and share event/player video highlight compilations and textual summaries in an automated and end-to-end manner, with future work focusing on expanding the framework to different sports.