Nanoscaling Floating-Point (NxFP): NanoMantissa, Adaptive Microexponents, and Code Recycling for Direct-Cast Compression of Large Language Models — mentioned by lifthrasiir

Sat, 13 Sep 2025 00:30:53 GMT

Hmm, you successfully nerd-sniped me. AFAIK there are at least: - 8-bit floating point types: (S1)E4M3 (finite only, has no-negative-zero variant), (S1)E5M2 (has no-negative-zero variant), E8M0 - 6-bit floating point types: (S1)E2M3, (S1)E3M2 - 4-bit floating point types: (S1)E2M1, NF4 - Block floating point types: MXFP8 (E5M2/E4M3*32+E8M0), MXFP6 (E3M2/E2M3*32+E8M0), MXFP4 (E2M1*32+E8M0), NXFP [1] [1] https://arxiv.org/pdf/2412.19821 Do you have anything to add on?

Paper and discussion history. A mention is not an endorsement.

Nanoscaling Floating-Point (NxFP): NanoMantissa, Adaptive Microexponents, and Code Recycling for Direct-Cast Compression of Large Language Models · HackerPapers discussions

Nanoscaling Floating-Point (NxFP): NanoMantissa, Adaptive Microexponents, and Code Recycling for Direct-Cast Compression of Large Language Models — mentioned by lifthrasiir