SGDR: Stochastic Gradient Descent with Warm Restarts · HackerPapers discussions

SGDR: Stochastic Gradient Descent with Warm Restarts — mentioned by jph00

Tue, 05 Sep 2023 00:17:23 GMT

That's fine - you can just use SGDR (SGD with restarts). https://arxiv.org/abs/1608.03983

Paper and discussion history. A mention is not an endorsement.

Tue, 05 Sep 2023 00:16:46 GMT

I haven't seen any researcher that supports your contention. SGDR (SGD with restarts) has been shown to work well. https://arxiv.org/abs/1608.03983

Paper and discussion history. A mention is not an endorsement.