Fire-Flyer AI-HPC: A Cost-Effective Software-Hardware Co-Design for Deep Learning · HackerPapers discussions

Fire-Flyer AI-HPC: A Cost-Effective Software-Hardware Co-Design for Deep Learning — mentioned by pella

Fri, 28 Feb 2025 08:41:33 GMT

related research paper (english - html ) - https://arxiv.org/html/2408.14158v2 arXiv:2408.14158v2 [cs.DC] 31 Aug 2024 "Fire-Flyer AI-HPC: A Cost-Effective Software-Hardware Co-Design for Deep Learning" Abstract: "The rapid progress in Deep Learning (DL) and Large Language Models (LLMs) has exponentially increased demands of computational power and bandwidth. This, combined with the high costs of faster computing chips and interconnects, has significantly inflated High Performance Computing (HPC) construction costs. To address these challenges, we introduce the Fire-Flyer AI-HPC architecture…

Paper and discussion history. A mention is not an endorsement.

Fire-Flyer AI-HPC: A Cost-Effective Software-Hardware Co-Design for Deep Learning — mentioned by teleforce

Sun, 23 Feb 2025 14:12:18 GMT

Paper by DeepSeek-AI team: https://arxiv.org/abs/2408.14158 Abstract: The rapid progress in Deep Learning (DL) and Large Language Models (LLMs) has exponentially increased demands of computational power and bandwidth. This, combined with the high costs of faster computing chips and interconnects, has significantly inflated High Performance Computing (HPC) construction costs. To address these challenges, we introduce the Fire-Flyer AI-HPC architecture, a synergistic hardware-software co-design framework and its best practices. For DL training, we deployed the Fire-Flyer 2 with 10,000 PCIe A100…

Paper and discussion history. A mention is not an endorsement.

Fire-Flyer AI-HPC: A Cost-Effective Software-Hardware Co-Design for Deep Learning — HN submission

Fri, 21 Feb 2025 08:06:01 GMT

Fire-Flyer AI-HPC: Cost-Effective Software-Hardware Co-Design for Deep Learning

2 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.