AraFinNLP 2024: The First Arabic Financial NLP Shared Task

AraFinNLP 2024: The First Arabic Financial NLP Shared Task

13 Jul 2024 | Sanad Malaysha, Mo El-Haj, Saad Ezzini, Mohammed Khalilia, Mustafa Jarrar, Sultan Almujaivel, Ismail Berrada, Houda Bouamor
The AraFinNLP 2024 shared task addresses the need for sophisticated Arabic NLP tools in the expanding financial markets of the Arab world, focusing on two subtasks: Multi-dialect Intent Detection and Cross-dialect Translation and Intent Preservation. The task uses the updated ArBanking77 dataset, which includes about 39k parallel queries in Modern Standard Arabic (MSA) and four dialects, labeled with one or more of 77 banking intents. A total of 45 teams registered, with 11 participating in Subtask 1 and 1 in Subtask 2. The winning team achieved an F1 score of 0.8773 in Subtask 1, and the only team in Subtask 2 achieved a BLEU score of 1.667. The paper provides an overview of the task, related work, dataset, and results, highlighting the importance of advanced NLP tools for financial services in Arabic-speaking regions.The AraFinNLP 2024 shared task addresses the need for sophisticated Arabic NLP tools in the expanding financial markets of the Arab world, focusing on two subtasks: Multi-dialect Intent Detection and Cross-dialect Translation and Intent Preservation. The task uses the updated ArBanking77 dataset, which includes about 39k parallel queries in Modern Standard Arabic (MSA) and four dialects, labeled with one or more of 77 banking intents. A total of 45 teams registered, with 11 participating in Subtask 1 and 1 in Subtask 2. The winning team achieved an F1 score of 0.8773 in Subtask 1, and the only team in Subtask 2 achieved a BLEU score of 1.667. The paper provides an overview of the task, related work, dataset, and results, highlighting the importance of advanced NLP tools for financial services in Arabic-speaking regions.
Reach us at info@study.space
[slides and audio] AraFinNLP 2024%3A The First Arabic Financial NLP Shared Task