HyperZ$\cdot$Z$\cdot$W Operator Connects Slow-Fast Networks for Full Context Interaction — mentioned by hyperzzw

Tue, 16 Sep 2025 14:34:20 GMT

Hi, I have read your interesting paper. I recommend you our previous HyperZZW paper (https://arxiv.org/pdf/2401.17948). I think there are a lot of similar concepts here. 1. Context-dependent convolution 2. Global & Local branches 3. Replace large-filter Conv with matrix multiplication 4. Information bottleneck -> Information loss I also want to share that Mamba is based on the concept of Hyena. And the simplicity is the best (HyperZZW), and Hyena is a failure.

Paper and discussion history. A mention is not an endorsement.

HyperZ$\cdot$Z$\cdot$W Operator Connects Slow-Fast Networks for Full Context Interaction · HackerPapers discussions

HyperZ$\cdot$Z$\cdot$W Operator Connects Slow-Fast Networks for Full Context Interaction — mentioned by hyperzzw