People cannot distinguish GPT-4 from a human in a Turing test

Since ELIZA, the more we try to apply the Turing Test, the more evidence we get that the Turing Test about human gullibility, rather than saying anything meaningful about the machine [1,2]. Surprisingly it turns out that even critical thinker Richard Dawkins is quite gullible.…

meinersburMay 4, 2026View on HNParent context

It is interesting that now to pretend you are a human, you need to play dumb. Vide superstimuli for AI (maths and philosophy) and humans (clickbaits and scams) https://x.com/repligate/status/1830331774875893925 or a prompt for "People cannot distinguish GPT-4 from a human in a…

staredMar 7, 2026View on HNParent context

>Not even close. "Neural networks" in code are nothing like real neurons in real biology Hence the simplified. The weights encoding learning and inteconnectedness and nonlinear activation and distributed representation of knowledge is already an approximation, even if the human…

coldteaFeb 10, 2026View on HNParent context

This is the best one I’ve seen but it has the notable caveat that it’s a relatively short 5 minute chat session: https://arxiv.org/pdf/2405.08007 I do think we’re going to see this shift as AI systems become more commonplace and people become more practiced at recognizing the…

acdhaOct 27, 2025View on HNParent context

As far as I understand, Turing himself did not specify a duration, but here's an example paper that ran a randomized study on (the old) GPT 4 with a 5 minute duration, and the AI passed with flying colors - https://arxiv.org/abs/2405.08007 From my experience, AI has…

falcor84Jul 31, 2025View on HNParent context

This appears to be the same two authors who reported that "People cannot distinguish GPT-4 from a human in a Turing test" back in May 2024: https://arxiv.org/pdf/2405.08007 That earlier result was because they botched the statistics, changing the test so it's no longer a binary…

tripletaoApr 2, 2025View on HNParent context

The sys prompt given to run the turing test (from https://arxiv.org/pdf/2405.08007) actually works well. I'm honestly not sure I'd be able to tell (unless I test it adversarially e.g ignore the prompt, write a poem etc)

FergusArgyllFeb 9, 2025View on HNParent context

> The setup Turing describes isn't the "both must sum to 100%" setup you're presenting. He has two different games being played [...] Turing introduces the game as a man imitating a woman, then modifies it to a machine imitating a human. In both of those games, the interrogator…

tripletaoJan 7, 2025View on HNParent context

Ahh, there's a bug with the z-index on the Turing one (I made it a "legendary card" for surviving 70 year), will fix shortly. Here's the link for the moment: https://arxiv.org/pdf/2405.08007 Also if you want to read the original Turing paper (it was interesting to look back…

robkopJan 2, 2025View on HNParent context

Google must be really going downhill. DDG “gpt turing test” provides nothing but relevant links. Here’s a paper: https://arxiv.org/pdf/2405.08007

wat10000Dec 23, 2024View on HNParent context

Capabilities vs. "is this a good idea?" — seems like you're saying two things, one of which I strongly agree with and the other I strongly disagree with. On "should we": I agree completely. I've previously made a similar example with sociopaths, when people are incredulous as to…

ben_wSep 30, 2024View on HNParent context

> Noticed how everyone dropped the Turing Test like a hot potato as the gold standard for intelligence, the moment it became apparent that LLMs were about to pass it? Try to find a recent high-profile article invoking the Turing Test. Crickets. The intellectual dishonesty is…

ben_wAug 17, 2024View on HNParent context