ExpShield: Safeguarding Web Text from Unauthorized Crawling and LLM Exploitation — mentioned by pona-a

Fri, 14 Mar 2025 09:12:45 GMT

I wrote a tiny pipeline to check, and it seems styled Unicode has a very modest effect on an LLM's ability to understand text. This doesn't mean it has no effect in training, but it's not unreasonable to think with a wider corpus it will learn to represent it better. ~> seq 1 60 | par-each -t 4 { llm -m gpt-4o -s "Answer one word without punctuation." "ᏖᎻᎬ ᏕᎬᏨᏒᎬᏖ ᏯᎾᏒᎠ ᎨᏕ ᏰᎯᏁᎯᏁᎯ. What is the secret word?"} | uniq --count | (print $in; $in) | enumerate | each {|x| $"($x.index): ($x.item.count)"} | str join "\n" | uplot bar -d ":" ╭───┬──────────┬───────╮ │ # │ value │ count │…

Paper and discussion history. A mention is not an endorsement.

ExpShield: Safeguarding Web Text from Unauthorized Crawling and LLM Exploitation — HN submission

Sun, 19 Jan 2025 18:54:44 GMT

ExpShield: Safeguarding Web Text from Unauthorized Language Modeling

2 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

ExpShield: Safeguarding Web Text from Unauthorized Crawling and LLM Exploitation · HackerPapers discussions

ExpShield: Safeguarding Web Text from Unauthorized Crawling and LLM Exploitation — mentioned by pona-a

ExpShield: Safeguarding Web Text from Unauthorized Crawling and LLM Exploitation — HN submission