Home

TAP Gibbs free energy belief propagation and sparsity


Author(s) : Ole Winther Lehel Csato, 
Publisher : N/A
Publication Date : 2002
ISSN : N/A
Abstract : The adaptive TAP Gibbs free energy for a general densely connected probabilistic model with qaudratic interactions and arbritary single site constraints is derived. We show how a specific sequential minimization of the free energy leads to a generalization of Minka's expectation propagation. Lastly, we derive a sparse representation version of the sequential algorithm. The usefulness of the approach is demonstrated on classification and density estimation with Gaussian processes and on an independent component analysis problem. 1,