Demystifying Parallel and Distributed Deep Learning: An In-Depth Concurrency Analysis — mentioned by mattlutze

Tue, 18 Aug 2020 07:03:39 GMT

Distributed training is indeed a thing! A few random Arxiv pulls: https://arxiv.org/abs/2007.03970 https://arxiv.org/abs/1802.09941 Efficiency and resource cost is the big question though. You don't pay for the electricity or part wear that you don't use, and home computers or workstations may not be as efficient at performing a training run vs a task-specific setup. AI@home might end up costing even more, and increase the footprint of the model more, than doing it all together. Part of the magic really needed is finding simpler ways to achieve the same levels of model robustness.

Paper and discussion history. A mention is not an endorsement.

Demystifying Parallel and Distributed Deep Learning: An In-Depth Concurrency Analysis — HN submission

Wed, 28 Feb 2018 14:32:58 GMT

Parallel and Distributed Deep Learning: An In-Depth Concurrency Analysis

4 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

Demystifying Parallel and Distributed Deep Learning: An In-Depth Concurrency Analysis · HackerPapers discussions

Demystifying Parallel and Distributed Deep Learning: An In-Depth Concurrency Analysis — mentioned by mattlutze

Demystifying Parallel and Distributed Deep Learning: An In-Depth Concurrency Analysis — HN submission