Efficient Neural Architecture Search via Proximal Iterations — mentioned by AbrahamParangi

Fri, 20 Sep 2019 18:49:51 GMT

I'll go further: For each problem there are a few sub-problems and a "right way" to do each of them where a "right way" corresponds to an algorithm which efficiently tackles some element of the implicit structure of the problem. I think within 5 years we will have made great progress on algorithmically discovering these "right ways" across many problem domains. I think both differentiable neural architecture search[0] and the MAML with implicit gradients[1] stuff is very interesting from this perspective. [0]https://arxiv.org/abs/1905.13577 [1]https://arxiv.org/abs/1909.04630

Paper and discussion history. A mention is not an endorsement.

Efficient Neural Architecture Search via Proximal Iterations · HackerPapers discussions

Efficient Neural Architecture Search via Proximal Iterations — mentioned by AbrahamParangi