Convolutional Neural Networks using Logarithmic Data Representation · HackerPapers discussions

Convolutional Neural Networks using Logarithmic Data Representation — mentioned by fc417fc802

Fri, 20 Jun 2025 03:33:46 GMT

It's been done. [0][1] But the fact that BitNet [2] is possible calls into question the need for it. NNs are surprisingly robust to a wide array of distortions. [3] [0] https://arxiv.org/abs/1603.01025 [1] https://par.nsf.gov/servlets/purl/10163070 [2] https://arxiv.org/abs/2310.11453 [3] https://arxiv.org/abs/1606.01981

Paper and discussion history. A mention is not an endorsement.

Convolutional Neural Networks using Logarithmic Data Representation — mentioned by p1esk

Tue, 11 Oct 2016 16:32:10 GMT

FP16 performance is only relevant until people figure out how to train NNs using INT8. See, for example, [1] for recent advances in that direction. After that, it's going to be mostly about memory size and bandwidth. [1] https://arxiv.org/abs/1603.01025

Paper and discussion history. A mention is not an endorsement.