Large Language Models Pass the Turing Test

Good old ELIZA doesn’t do that bad on the Turing Test, for all its historic significance, it really shouldn’t be invoked in discussions about LLMs [0] and has been beaten by all manner of models. [0] https://arxiv.org/html/2503.23674v1

TopfiOct 3, 2026View on HNParent context

AFAIK people refer to this paper [0]. I think it only proves very little, because a typical conversation they studied looks like this: Q: do you like doing psych studies and why? A: theyre chill, easy money tbh Q: yeah same. Could you give me an easy cupcake recipe off the top…

KotlopouOct 2, 2026View on HNParent context

LLMs started meaningfully passing the Turing test a year or two ago, around GPT-4.5. Is there another version or bar for "passing" you're looking for? [0] https://arxiv.org/pdf/2503.23674

drusepthSep 3, 2026View on HNParent context

> It hasn’t been passed https://arxiv.org/abs/2503.23674 From the abstract: "When prompted to adopt a humanlike persona, GPT-4.5 was judged to be the human 73% of the time: significantly more often than interrogators selected the real human participant. LLaMa-3.1, with the same…

akoboldfryingAug 22, 2026View on HNParent context

https://arxiv.org/abs/2503.23674 From the abstract: "When prompted to adopt a humanlike persona, GPT-4.5 was judged to be the human 73% of the time: significantly more often than interrogators selected the real human participant. LLaMa-3.1, with the same prompt, was judged to be…

akoboldfryingAug 17, 2026View on HNParent context

> With all due respect, your claim is ridiculous. It’s incredibly easy to spot an LLM in an interactive chat. The tells are endless. https://arxiv.org/abs/2503.23674?hl=en-GB "When prompted to adopt a humanlike persona, GPT-4.5 was judged to be the human 73% of the time…

akoboldfryingMay 21, 2026View on HNParent context

That’s misleading, because the reason Claude answers that way is almost certainly due to reinforcement learning that deliberately prevents models from claiming they’re conscious. That’s not a valid reason for saying they fail the Turing test. By most normal standards, they can…

antonvsMay 3, 2026View on HNParent context

When people judge blindly, the are more likely to think the human is the AI and the AI is the human. 73% judged GPT 4.5 (edit: had incorrectly said 4o before)to be the human. https://arxiv.org/abs/2503.23674 Not only are people bad at judging this, but are directionally wrong.

jmalickiApr 7, 2026View on HNParent context

Given the way the test was structured it does line up. https://arxiv.org/abs/2503.23674

jmalickiMar 26, 2026View on HNParent context

In the test mentioned in nearby comments (https://arxiv.org/abs/2503.23674) ELIZA only got 27% suggesting the test wasn't that easy to fool.

tim333Mar 26, 2026View on HNParent context

> nothing actually passes the Turing test Says who? I had already found this study, published almost a year ago, saying that they do: https://arxiv.org/abs/2503.23674 There doesn't seem to be a super-rigorous definition of the Turing Test, but I don't think it's reasonable to…

ufmaceMar 8, 2026View on HNParent context

"Proper" may be doing some work here, but such a test was run last year and GPT-4.5 and LLaMa-3.1-405B both passed. Oddly, GPT-4.5 was judged as human significantly more often than chance. https://arxiv.org/abs/2503.23674

wat10000Mar 4, 2026View on HNParent context

Landauer and Bellman, absolutely put ELIZA to an adversarial Turing test, and called it such, in 1999. [0] But... Over in 2025, ELIZA was once again, put to the Turing test in adversarial conditions. [1] And still had people think it was a real person, over 27% of the time. Over…

shaknaFeb 26, 2026View on HNParent context

>Not even close. "Neural networks" in code are nothing like real neurons in real biology Hence the simplified. The weights encoding learning and inteconnectedness and nonlinear activation and distributed representation of knowledge is already an approximation, even if the human…

coldteaFeb 10, 2026View on HNParent context

> the bar for the test gets raised and eventually humans won’t pass the test themselves. At this point LLMs usually beat humans at the Turing Test! People are more likely to pick the LLM as the human, rather than the human. https://arxiv.org/abs/2503.23674

canjobearJan 7, 2026View on HNParent context

"Someone" literally did that (+/- 2 years): https://link.springer.com/book/10.1007/978-3-540-68677-4 I think it was supposed to be a more useful term than the earlier and more common "Strong AI". With regards to strong AI, there was a widely accepted definition - i.e. passing…

bonplan23Dec 31, 2025View on HNParent context

Are you asking if they fool me, or if I believe they fool people in general? The former, how would I tell? I'd have to find someone whose writing style I don't know to be the human comparison, in order to blind myself. The latter: https://arxiv.org/abs/2503.23674

ben_wDec 27, 2025View on HNParent context

I thought it was funny that in the Cameron R. Jones attempt as doing the test, 75% of judges thought GPT-4o was the human rather than the actual human. I think it illustrates both the limits of the test and that LLMs are getting quite good. (paper…

tim333Oct 14, 2025View on HNParent context

Well, LLMs do pass the Turing Test, sort of. https://arxiv.org/abs/2503.23674

1unaJul 31, 2025View on HNParent context

>You are not just seeing consciousness in me; your brain is generating the feeling of another’s consciousness as the best explanation for the patterns you’re interacting with. It's ironic to see the most mundane and likely best answer to the problem from the model itself, while…

sigmoid10Jun 29, 2025View on HNParent context

Now that I have a little more time to search around, I easily found this study, published March 31st this year, so not quite 3 months ago: https://arxiv.org/abs/2503.23674 I only skimmed it, but I don't see anything clearly wrong about it. According to their results, GPT-4.5…

ufmaceJun 10, 2025View on HNParent context

You're right about interactivity, something that I overlooked -- but I think it's nevertheless the case that a large fraction of human interrogators could not distinguish a human from a suitably-system-prompted ChatGPT even over the course of an interactive discussion. ChatGPT…

akoboldfryingJun 9, 2025View on HNParent context

https://arxiv.org/abs/2503.23674

te0006Jun 7, 2025View on HNParent context