Fast and Simplex: 2-Simplicial Attention in Triton · HackerPapers discussions

Fast and Simplex: 2-Simplicial Attention in Triton — mentioned by shenberg

Wed, 04 Feb 2026 12:15:41 GMT

There are two ingredients that don't fit in the "attention-is-kernel-smoothing" as far as I can tell: positional encoding and causal masking (another way to say positional encoding, I guess) Also, Simplical attention is pretty much what the OP was going for, but the hardware lottery is such that it's gonna be pretty difficult to get competitive in terms of engineering, not that people aren't trying (e.g. https://arxiv.org/pdf/2507.02754)

Paper and discussion history. A mention is not an endorsement.

Fast and Simplex: 2-Simplicial Attention in Triton — HN submission

Sat, 05 Jul 2025 06:48:05 GMT

Fast and Simplex: 2-Simplicial Attention in Triton

3 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

Fast and Simplex: 2-Simplicial Attention in Triton — HN submission

Fri, 04 Jul 2025 16:11:28 GMT

Fast and Simplex: 2-Simplicial Attention in Triton

3 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.