Automatic Image Annotation and Retrieval using CrossMedia Relevance Models

Automatic Image Annotation and Retrieval using CrossMedia Relevance Models

2003 | J. Jeon, V. Lavrenko, R. Manmatha
This paper presents an automatic approach to image annotation and retrieval using cross-media relevance models. The authors propose a method that describes image regions using a small vocabulary of "blobs" generated from image features through clustering. Given a training set of annotated images, the model learns the joint distribution of blobs and words, allowing for the prediction of the probability of generating a word given the blobs in an image. This approach is evaluated through experiments, demonstrating that the proposed model outperforms existing methods in terms of mean precision and recall. The paper also discusses the limitations and potential improvements, such as better feature extraction and the use of continuous features. The authors conclude that cross-media relevance models are effective for image annotation and retrieval, and future work could focus on improving the performance and evaluation of these models.This paper presents an automatic approach to image annotation and retrieval using cross-media relevance models. The authors propose a method that describes image regions using a small vocabulary of "blobs" generated from image features through clustering. Given a training set of annotated images, the model learns the joint distribution of blobs and words, allowing for the prediction of the probability of generating a word given the blobs in an image. This approach is evaluated through experiments, demonstrating that the proposed model outperforms existing methods in terms of mean precision and recall. The paper also discusses the limitations and potential improvements, such as better feature extraction and the use of continuous features. The authors conclude that cross-media relevance models are effective for image annotation and retrieval, and future work could focus on improving the performance and evaluation of these models.
Reach us at info@study.space
Understanding Automatic image annotation and retrieval using cross-media relevance models