HackerPapers

arXiv:2510.15061cs.LG

Antislop: A Comprehensive Framework for Identifying and Eliminating Repetitive Patterns in Language Models

Samuel Paech, Allen Roush, Judah Goldfeder, Ravid Shwartz-Ziv

Abstract

Widespread LLM adoption has introduced characteristic repetitive phraseology, termed "slop," which degrades output quality and makes AI-generated text immediately recognizable. We present Antislop, a comprehensive framework providing tools to both detect and eliminate these overused patterns. Our approach combines three innovations: (1) The Antislop Sampler, which uses backtracking to suppress unwanted strings at inference time without destroying vocabulary; (2) An automated pipeline that profiles model-specific slop against human baselines and generates training data; (3) Final Token Preference Optimization (FTPO), a novel fine-tuning method that operates on individual tokens, surgically adjusting logits wherever a banned pattern has appeared in an inference trace. We demonstrate that some slop patterns appear over 1,000x more frequently in LLM output than human text. The Antislop Sampler successfully suppresses 8,000+ patterns while maintaining quality, whereas token banning becomes unusable at just 2,000. Most importantly, FTPO achieves 90% slop reduction while maintaining or improving performance in cross-domain evals including GSM8K, MMLU, and creative writing tasks. In contrast, DPO suffers significant degradation in writing quality and lexical diversity despite achieving weaker suppression. We release all code and results under MIT license: https://github.com/sam-paech/auto-antislop.

arXiv comments
11 pages + appendices, 16 figures
Journal reference
DOI
Subjects
cs.LGMachine Learning cs.CLComputation and Language

On Hacker News

Linked by 3 identifiable commenters in 24 comments across 22 threads, from Oct 2025 to Aug 2026. Found in 1 HN submission from Oct 2025 to Oct 2025. Open submission discussions.

Comments linking this paper, per year.

Discussed in comments22 threads

    • This is a better way than we use to create the "slop ban list" in our "Antislop" sampler/fine-tuning method. Gonna totally nab the weights for all these words and remove this crap from claude going forward! Thanks OP!!! https://arxiv.org/abs/2510.15061 (ICLR 2026)

      Der_EinzigeView on HNParent context

  1. Humanising LLM Outputs Is Dumb 1 comment
    • For anyone that wants to evade the kind of people who want to figure out if an AI wrote your review or not, we wrote a whole paper (ICLR 2026!) on how to do that! https://arxiv.org/abs/2510.15061 I consider all types of "I liked this output, but don't the moment I learned it was…

      Der_EinzigeView on HNParent context

    • things like that indeed tend to be fraught some relevant links https://arxiv.org/abs/2408.02442 https://arxiv.org/abs/2510.15061 https://arxiv.org/abs/2604.13006

      tensegristView on HNParent context

  2. Claude Science 1 comment
  3. It's Not Just X. It's Y 1 comment
  4. /Deslop 1 comment
    • FWIW: When I accuse folks of it, take it more seriously - we literally wrote a paper (ICLR 2026) on deslopping language models: https://arxiv.org/abs/2510.15061 Also you might not care, but normies sure care! https://arxiv.org/html/2410.03723v2 https://arxiv.org/html/2510.08831v1

      Der_EinzigeView on HNParent context

    • This is what they get for not reading our antislop paper (ICLR 2026) and using our anti-slopped sampler/models, or Kimi (which is remarkable relatively non sloppy) https://arxiv.org/abs/2510.15061 I thought normies would have caught onto the EM dash, overuse of semicolons…

      Der_EinzigeView on HNParent context

  5. ai;dr 1 comment
    • Just use our antislop techniques and no one will ever know you used an LLM. https://arxiv.org/abs/2510.15061 (ICLR 2026) Also you could long use "logit_bias" in the API of models which supported it to ban the EM dash, ban the word "not", ban semicolons, and ban the "fancy…

      Der_EinzigeView on HNParent context

  6. Slop Terrifies Me 1 comment
    • Our paper on removing AI slop got accepted to ICLR 2026, and it's under consideration for an IgNobel prize: https://arxiv.org/abs/2510.15061 Our definition of slop (repetitive characteristic language from LLMs) is the original one as articulated by the LLM creative writing…

      Der_EinzigeView on HNParent context

  7. Devin Review: AI to Stop Slop 1 comment
    • Go take a giant dataset of LLM generated outputs, use an accurate POS tagger and look for 5-grams or similar lengths of matching patterns. If you do thi, you’ll pull out the overrepresented paragraph and sentence level slop that we humans intuitively detect easily. If your…

      Der_EinzigeView on HNParent context

  8. How uv got so fast 2 comments
    • We wrote the paper on how to deslop your LLM outputs and if you use our factory de-slopped versions of gemma3 you don't have to worry about this, similarly if you use our antislop sampler, your LLM outputs will look very close to human. https://arxiv.org/abs/2510.15061

      Der_EinzigeView on HNParent context

    • Read our paper on de-slopping LLM outputs. It's far more than simply all having the same fixed AI system prompts. It's an overuse of post-training and contempt for pre-training. https://arxiv.org/pdf/2510.15061

      Der_EinzigeView on HNParent context

    • We wrote the paper on how to remove slop from LLMs. https://arxiv.org/abs/2510.15061 Also somewhat tangentially relevant video: https://www.youtube.com/watch?v=Tsp2bC0Db8o

      Der_EinzigeView on HNParent context

    • And people like you will hate it even more when the normies immunize themselves from being obviously caught by such tells: https://arxiv.org/abs/2510.15061

      Der_EinzigeView on HNParent context

    • You can remove this easily. We wrote a paper on how to remove this slop from LLMs. https://arxiv.org/abs/2510.15061

      Der_EinzigeView on HNParent context

  9. AI Slop vs. OSS Security 1 comment
    • ScholarlyArticle: "Antislop: A Comprehensive Framework for Identifying and Eliminating Repetitive Patterns in Language Models" (2025) https://arxiv.org/abs/2510.15061 : > Abstract: [...] Our approach combines three innovations: (1) The Antislop Sampler, which uses backtracking…

      westurnerView on HNParent context

Submitted to Hacker News

Connected through shared HN threads, not inferred similarity or a recommendation.