Distributed Training of Deep Learning Models: A Taxonomic Perspective — mentioned by mattlutze

Tue, 18 Aug 2020 07:03:39 GMT

Distributed training is indeed a thing! A few random Arxiv pulls: https://arxiv.org/abs/2007.03970 https://arxiv.org/abs/1802.09941 Efficiency and resource cost is the big question though. You don't pay for the electricity or part wear that you don't use, and home computers or workstations may not be as efficient at performing a training run vs a task-specific setup. AI@home might end up costing even more, and increase the footprint of the model more, than doing it all together. Part of the magic really needed is finding simpler ways to achieve the same levels of model robustness.

Paper and discussion history. A mention is not an endorsement.

Distributed Training of Deep Learning Models: A Taxonomic Perspective · HackerPapers discussions

Distributed Training of Deep Learning Models: A Taxonomic Perspective — mentioned by mattlutze