Explainability for Large Language Models: A Survey — mentioned by _heimdall

Sat, 08 Mar 2025 17:58:32 GMT

This paper [1] may be an interesting place to start. We only know how the structures are designed to work, and we have hypothesise of how they likely work. We can't interpret what actually happens when the LLM is actually going through the process of generating a response. That seems pedantic or unimportant on the surface, but there are some really important implications. At the more benign level, we don't know why a model gave a bad response when a person wasn't happy with the output. On the more important end, any concerns related to the risk of these models becoming self-directed or…

Paper and discussion history. A mention is not an endorsement.

Explainability for Large Language Models: A Survey · HackerPapers discussions

Explainability for Large Language Models: A Survey — mentioned by _heimdall