Criticality in Formal Languages and Statistical Physics · HackerPapers discussions

Criticality in Formal Languages and Statistical Physics — mentioned by throwaway000002

Tue, 11 Oct 2016 20:50:30 GMT

Thanks for sharing this lecture by Max Tegmark. He comments on the video linking to two papers on arXiv which relate to the material in the lecture: https://arxiv.org/abs/1608.08225 and https://arxiv.org/abs/1606.06737

Paper and discussion history. A mention is not an endorsement.

Criticality in Formal Languages and Statistical Physics — mentioned by clickok

Mon, 26 Sep 2016 07:01:25 GMT

According to a talk by Max Tegmark[0] (and its associated paper[1]), neural nets (particularly LSTMs) might be inherently better at this sort of thing due to the way they model mutual information. Markov models are best suited to situations where an observation k-steps in the past gives exponentially less information about the present[2] (decaying according to something like λ^k for 0 <= λ < 1). Intuitively, the amount of context imparted by a word or phrase decays somewhat more slowly. That is, if I know the previous five words, I can make a good prediction about the next one, and likely the…

Paper and discussion history. A mention is not an endorsement.

Criticality in Formal Languages and Statistical Physics — HN submission

Wed, 13 Jul 2016 09:54:29 GMT

Critical Behavior from Deep Dynamics: A Hidden Dimension in Natural Language

175 points; 44 discussion replies on HN. Paper and source history. A submission is not an endorsement.