Non-Determinism of "Deterministic" LLM Settings — mentioned by yunohn

Thu, 09 Apr 2026 11:21:46 GMT

I initially thought the same, but apparently with the inaccuracies inherent to floating-point arithmetic and various other such accuracy leakage, it’s not true! https://arxiv.org/html/2408.04667v5

Paper and discussion history. A mention is not an endorsement.

Non-Determinism of "Deterministic" LLM Settings — mentioned by District5524

Tue, 04 Nov 2025 10:40:03 GMT

Not that it's incorrect but there is some data showing variability even with the very same input and all parameters. Especially if we have no control over the model behind the API with engineering optimizations etc. See Berk Atil et al.: Non-Determinism of "Deterministic" LLM Settings, https://arxiv.org/abs/2408.04667v5

Paper and discussion history. A mention is not an endorsement.

Non-Determinism of "Deterministic" LLM Settings · HackerPapers discussions

Non-Determinism of "Deterministic" LLM Settings — mentioned by yunohn

Non-Determinism of "Deterministic" LLM Settings — mentioned by District5524