Automatic Differentiation Variational Inference · HackerPapers discussions

Automatic Differentiation Variational Inference — mentioned by xcodevn

Sun, 14 Oct 2018 16:34:30 GMT

I truly believe that Bayesian inference is the statistics of the 21st century. Recent advances in MCMC (e.g., NUTS, Stan [1]) and variational inference (e.g., ADVI [2], VAE [3], etc.) + more computing power than ever promise a near future in which Bayesian inference is the default inference engine. Prior distribution is a beautiful and logical mechanism for adding regularization, domain-specific knowledge to our model. [1] Stan, a platform for statistical modeling http://mc-stan.org/ [2] Automatic Differentiation Variational Inference https://arxiv.org/abs/1603.00788 [3] Auto-Encoding…

Paper and discussion history. A mention is not an endorsement.

Automatic Differentiation Variational Inference — mentioned by twiecki

Wed, 29 Mar 2017 07:15:20 GMT

No, back-propagation would not give full Bayesian inference (although there are some tricks [0]). They instead use variational inference[1], which allows for fast inference of continuous PGMs. [0] http://mlg.eng.cam.ac.uk/yarin/blog_2248.html [1] https://arxiv.org/abs/1603.00788

Paper and discussion history. A mention is not an endorsement.

Automatic Differentiation Variational Inference — mentioned by cf

Sun, 04 Sep 2016 19:17:18 GMT

There are two lines of research in this direction. So there is work from my lab [1] and some folks at ETH-Zurich [2] is automatically finding closed form solutions. These when used do give performance equivalent to handwritten methods. Beyond that we are seeing some cool stuff with Blackbox Variational Inference [3] and other Automatic Variational [4] solvers coming out of Blei's lab. At present these capabilities are spread about the different system but I expect all them to eventually end up available in whichever you choose to use. [1]…

Paper and discussion history. A mention is not an endorsement.