Optimizing Distributed Training on Frontier for Large Language Models · HackerPapers discussions

Optimizing Distributed Training on Frontier for Large Language Models — mentioned by latchkey

Tue, 26 Mar 2024 20:09:45 GMT

> That's why for example noone is using AMD GPUs for ML You're right, they are behind, but to say that nobody is using it, is not truthful. AMD HPC clusters are being used [0] and [1] for AI/ML. The larger issue is that AMD has only been building HPC clusters for the last period of time. Now, with the release of MI300x, we have Azure and Oracle coming online with them now. Disclosure, my business is also building a MI300x super computer as well, with the express goal of enabling more access to developers. [0] https://defensescoop.com/2023/08/23/navys-new-25m-supercompu... [1]…

Paper and discussion history. A mention is not an endorsement.

Optimizing Distributed Training on Frontier for Large Language Models — HN submission

Mon, 22 Jan 2024 20:00:37 GMT

Optimizing Distributed Training on Frontier for Large Language Models

2 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

Optimizing Distributed Training on Frontier for Large Language Models — HN submission

Sat, 06 Jan 2024 03:20:02 GMT

Optimizing Distributed Training on Frontier for Large Language Models

2 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.