MiniMax-M1: Scaling Test-Time Compute Efficiently with Lightning Attention — mentioned by simonw

Fri, 20 Mar 2026 16:57:40 GMT

Some of the big LLM labs have written about their training hardware. DeepSeek v3 was trained on 2,048 NVIDIA H800s. https://arxiv.org/abs/2412.19437 MiniMax M1 used 512 H800s. https://arxiv.org/abs/2506.13585 The H800 wasn't banned in the first round of export controls - but was after October 2023: https://www.cnbc.com/2023/10/17/us-bans-export-of-more-ai-ch... Z.ai say they used Huawei hardware: https://www.theregister.com/2026/01/15/zhipu_glm_image_huawe... Qwen and Kimi haven't disclosed their hardware as far as I can tell.

Paper and discussion history. A mention is not an endorsement.

MiniMax-M1: Scaling Test-Time Compute Efficiently with Lightning Attention · HackerPapers discussions

MiniMax-M1: Scaling Test-Time Compute Efficiently with Lightning Attention — mentioned by simonw