HackerPapers

arXiv:1802.07535stat.ML

BRUNO: A Deep Recurrent Model for Exchangeable Data

Iryna Korshunova, Jonas Degrave, Ferenc Huszár, Yarin Gal, Arthur Gretton, Joni Dambre

Early discovery. Linked by one identifiable commenter. This paper is outside the main ranking; a mention is not an endorsement.

Abstract

We present a novel model architecture which leverages deep learning tools to perform exact Bayesian inference on sets of high dimensional, complex observations. Our model is provably exchangeable, meaning that the joint distribution over observations is invariant under permutation: this property lies at the heart of Bayesian inference. The model does not require variational approximations to train, and new samples can be generated conditional on previous samples, with cost linear in the size of the conditioning set. The advantages of our architecture are demonstrated on learning tasks that require generalisation from short observed sequences while modelling sequence variability, such as conditional image generation, few-shot learning, and anomaly detection.

arXiv comments
NIPS 2018
Journal reference
DOI
Subjects
stat.MLMachine Learning (Statistics)

On Hacker News

Linked by 1 identifiable commenter in 1 comment across 1 thread, from Jul 2018 to Jul 2018.

Comments linking this paper, per year.

Discussed in comments1 thread

    • It's the opposite, they are very data efficient (compared to neural networks). Also, they are a bayesian method and give some mathematical guarantees. They are computationally expensive though. You can use them in neural nets to do few shot learning [0]. [0]…

      317070View on HNParent context

Submitted to Hacker News

Connected through shared HN threads, not inferred similarity or a recommendation.