Deep Variational Information Bottleneck — mentioned by sdenton4

Sat, 15 Sep 2018 17:53:07 GMT

Two things I believe to be true... 1) Auto-encoders are overplayed, mostly because they're a pretty easy intro ML project. There was a brief moment (before ResNets and batch normalization showed up) when they were useful for bootstrapping a representation, but they aren't serving a terribly concrete purpose now that it's so much easier to get end-to-end deeper pipelines running and learning their own representations. The common criticism is that a representation that's great for reconstruction may still not be super useful for classification (or whatever your real goal is). And, compared to…

Paper and discussion history. A mention is not an endorsement.

Deep Variational Information Bottleneck · HackerPapers discussions

Deep Variational Information Bottleneck — mentioned by sdenton4