Deep Learning Model Reuse in the HuggingFace Community: Challenges, Benefit and Trends

Deep Learning Model Reuse in the HuggingFace Community: Challenges, Benefit and Trends

24 Jan 2024 | Mina Taraghi, Gianolli Dorcelus, Armstrong Foundjem, Florian Tambon, Foutse Khomh
This paper presents an empirical study on the challenges, benefits, and trends of reusing Pre-Trained Models (PTMs) in the HuggingFace (HF) community. The study analyzes discussions on the HF Forums and the HF model hub to understand the challenges users face when reusing PTMs and the benefits the community provides. The findings reveal that the most common challenges include difficulties in understanding models, interpreting model outputs, and finding appropriate solutions for specific tasks. Additionally, the study identifies trends in model reuse, such as the popularity of BERT-based models and the lack of model documentation. The study also highlights the importance of community collaboration and the need for better model documentation and support for beginner users. The results suggest that while the HF community provides valuable resources for PTM reuse, there are still significant challenges that need to be addressed to improve the user experience and model usability. The study provides recommendations for stakeholders in the PTM reuse community to enhance the effectiveness of model reuse and improve the overall user experience.This paper presents an empirical study on the challenges, benefits, and trends of reusing Pre-Trained Models (PTMs) in the HuggingFace (HF) community. The study analyzes discussions on the HF Forums and the HF model hub to understand the challenges users face when reusing PTMs and the benefits the community provides. The findings reveal that the most common challenges include difficulties in understanding models, interpreting model outputs, and finding appropriate solutions for specific tasks. Additionally, the study identifies trends in model reuse, such as the popularity of BERT-based models and the lack of model documentation. The study also highlights the importance of community collaboration and the need for better model documentation and support for beginner users. The results suggest that while the HF community provides valuable resources for PTM reuse, there are still significant challenges that need to be addressed to improve the user experience and model usability. The study provides recommendations for stakeholders in the PTM reuse community to enhance the effectiveness of model reuse and improve the overall user experience.
Reach us at info@study.space
[slides and audio] Deep Learning Model Reuse in the HuggingFace Community%3A Challenges%2C Benefit and Trends