Recovering single precision accuracy from Tensor Cores while surpassing the FP32 theoretical peak performance · HackerPapers discussions

Recovering single precision accuracy from Tensor Cores while surpassing the FP32 theoretical peak performance — mentioned by Archit3ch

Sat, 03 May 2025 20:20:40 GMT

Not really. That's 15.8 fp16 ops compared to 14.7 fp32 ops (that are actually useful outside AI). It would be interesting to see if you can configure the ANE to recover fp32 precision at lower throughput [1]. [1] https://arxiv.org/abs/2203.03341

Paper and discussion history. A mention is not an endorsement.

Recovering single precision accuracy from Tensor Cores while surpassing the FP32 theoretical peak performance — mentioned by touisteur

Thu, 19 Jan 2023 10:12:48 GMT

Before I forget, here's the link to the tcFFT paper https://ar5iv.labs.arxiv.org/html/2104.11471v1 And the fp32-gemm-with-tf32 https://arxiv.org/abs/2203.03341

Paper and discussion history. A mention is not an endorsement.