Transformer Memory as a Differentiable Search Index · HackerPapers discussions

Transformer Memory as a Differentiable Search Index — mentioned by Koaisu

Fri, 29 Aug 2025 10:57:07 GMT

Sounds a bit like generative retrieval (e.g. this Google paper here: https://arxiv.org/abs/2202.06991)

Paper and discussion history. A mention is not an endorsement.

Transformer Memory as a Differentiable Search Index — mentioned by teleforce

Tue, 16 Apr 2024 01:02:29 GMT

Another potent alternative is perhaps Differentiable Search Index (DSI) based on Transformer Memory: Transformer Memory as a Differentiable Search Index: https://arxiv.org/abs/2202.06991

Paper and discussion history. A mention is not an endorsement.

Transformer Memory as a Differentiable Search Index — mentioned by haizhung

Sun, 07 Apr 2024 10:48:04 GMT

Differentiale search indices go into this direction: https://arxiv.org/abs/2202.06991 The approach in the paper has rough edges, but the metrics are bonkers (double digit percentage POINTS improvement over dual encoders). This paper was written before the LLM craze, and I am not aware of any further developments in that area. I think that this area might be ripe for some break through innovation.

Paper and discussion history. A mention is not an endorsement.

Transformer Memory as a Differentiable Search Index — mentioned by ignoramous

Wed, 16 Feb 2022 08:21:39 GMT

html: https://www.arxiv-vanity.com/papers/2202.06991/

Paper and discussion history. A mention is not an endorsement.

Transformer Memory as a Differentiable Search Index — HN submission

Wed, 16 Feb 2022 04:11:59 GMT

Transformer Memory as a Differentiable Search Index

80 points; 15 discussion replies on HN. Paper and source history. A submission is not an endorsement.