Information Theory for Complex Systems Scientists — HN submission

Sun, 11 Aug 2024 12:14:12 GMT

Information Theory for Complex Systems Scientists

2 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

Information Theory for Complex Systems Scientists — mentioned by tysam_and

Wed, 03 May 2023 02:41:36 GMT

Reasoning and hallucinating are terms that are more shallow that are oftentimes used in discussions of this topic, but ultimately don't cover where and how the model is fitting the underlying manifold of the data -- which is in fact described by information theory rather well. That's why I referenced Shannon entropy, which is important as an interpretive framework. It provides mathematical guarantees and ties nicely into the other information compressive measures which do I feel answer some of the queries you're noting seem more ambiguous to you. That is the trouble with mixing inductive…

Paper and discussion history. A mention is not an endorsement.

Information Theory for Complex Systems Scientists · HackerPapers discussions

Information Theory for Complex Systems Scientists — HN submission

Information Theory for Complex Systems Scientists — mentioned by tysam_and