Hyper-optimized tensor network contraction — mentioned by dt

Tue, 01 Mar 2022 13:20:01 GMT

> Forget about performance for a moment, and just write those imbricated loops. Right, if we forget about performance a three-nested-loop GEMM is certainly better than any other implementation. But that's completely meaningless and you could find such examples for almost any task. This is almost as saying writing hash functions is easy as long as you forget about collisions and avalanche effects. > When you realize that most deep learning library, "einsum is all you need", and that einsum is just loops and sum, it kind of screams you are doing it the wrong way when using numerical libraries…

Paper and discussion history. A mention is not an endorsement.

Hyper-optimized tensor network contraction · HackerPapers discussions

Hyper-optimized tensor network contraction — mentioned by __dt__

Hyper-optimized tensor network contraction — mentioned by dt