Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problems — mentioned by dimatura

Mon, 19 Jul 2021 13:04:21 GMT

Yes. Unfortunately my experience in this area is about four years old, so maybe obsolete at this point. But at that time, for our problem -- which used many of the typical benchmark gym simulators -- the main bottleneck were CPUs, not GPUs. I suspect the equation changes on how complex the neural network is (if it's simple, not much is gained from GPU), whether the simulation can take advantage of GPUs (the ones we used didn't, but for 3D graphics-heavy simulation and other kinds of computation I'm sure it can help) and the algorithm -- some algorithms rely more on on-line evaluation and…

Paper and discussion history. A mention is not an endorsement.

Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problems · HackerPapers discussions

Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problems — mentioned by dimatura