This paper evaluates three approximate inference algorithms for link-based classification: loopy belief propagation (LBP), mean field relaxation labeling (MF), and iterative classification (ICA). The goal is to compare their performance in terms of robustness to noise and varying types of link correlations. The study focuses on irregular graphs with cycles, which are common in real-world data such as webpages and social networks.
Link-based classification involves using relationships between entities to improve classification accuracy. Traditional algorithms struggle with this due to interdependencies between entities. The three algorithms considered are message-passing methods that iteratively refine classifications based on neighbor information.
LBP is a message-passing algorithm that computes approximate marginal probabilities by passing messages between nodes. It is more sophisticated than ICA and MF in handling complex interactions. MF uses a mean-field approximation to compute probabilities, while ICA iteratively updates labels based on neighborhood classifications.
The study compares these algorithms on synthetic and real-world datasets. It finds that MF often performs better than ICA and LBP in terms of accuracy and convergence. However, none of the algorithms guarantee convergence, and their performance depends on the graph structure and data characteristics.
The paper also discusses the theoretical foundations of these algorithms, noting that LBP and MF have been justified by theory, while ICA remains more heuristic. The study highlights the importance of considering graph structure and link patterns when applying these algorithms. It concludes that while these methods are effective for link-based classification, further research is needed to improve their performance and convergence properties.This paper evaluates three approximate inference algorithms for link-based classification: loopy belief propagation (LBP), mean field relaxation labeling (MF), and iterative classification (ICA). The goal is to compare their performance in terms of robustness to noise and varying types of link correlations. The study focuses on irregular graphs with cycles, which are common in real-world data such as webpages and social networks.
Link-based classification involves using relationships between entities to improve classification accuracy. Traditional algorithms struggle with this due to interdependencies between entities. The three algorithms considered are message-passing methods that iteratively refine classifications based on neighbor information.
LBP is a message-passing algorithm that computes approximate marginal probabilities by passing messages between nodes. It is more sophisticated than ICA and MF in handling complex interactions. MF uses a mean-field approximation to compute probabilities, while ICA iteratively updates labels based on neighborhood classifications.
The study compares these algorithms on synthetic and real-world datasets. It finds that MF often performs better than ICA and LBP in terms of accuracy and convergence. However, none of the algorithms guarantee convergence, and their performance depends on the graph structure and data characteristics.
The paper also discusses the theoretical foundations of these algorithms, noting that LBP and MF have been justified by theory, while ICA remains more heuristic. The study highlights the importance of considering graph structure and link patterns when applying these algorithms. It concludes that while these methods are effective for link-based classification, further research is needed to improve their performance and convergence properties.