arXiv:1601.06176nlin.AO
What is Information?
Early discovery. Linked by one identifiable commenter. This paper is outside the main ranking; a mention is not an endorsement.
Abstract
Information is a precise concept that can be defined mathematically, but its relationship to what we call "knowledge" is not always made clear. Furthermore, the concepts "entropy" and "information", while deeply related, are distinct and must be used with care, something that is not always achieved in the literature. In this elementary introduction, the concepts of entropy and information are laid out one by one, explained intuitively, but defined rigorously. I argue that a proper understanding of information in terms of prediction is key to a number of disciplines beyond engineering, such as physics and biology.
This is the best description of entropy and information I've read: https://arxiv.org/abs/1601.06176 Most of all, it highlights the subjective / relative foundations of these concepts. Entropy and Information only exist relative to a decision about the set of state an observer…
marojejianView on HNParent context