Exponential family latent variable models can be formulated as conjugated harmoniums, which enable exact inference and learning algorithms.