Measuring Implicit Bias in Explicitly Unbiased Large Language Models — mentioned by simonw

Sat, 12 Apr 2025 15:51:35 GMT

It looks like that's the data behind figure 3.7.4 - "LLMs implicit bias across stereotypes in four social categories" - on page 199 of the PDF: https://hai-production.s3.amazonaws.com/files/hai_ai_index_r... They released a separate PDF of just that figure along with the CSV data: https://static.simonwillison.net/static/2025/fig_3.7.4.pdf The figure is explained a bit on page 198. It relates to this paper: https://arxiv.org/abs/2402.04105 I don't think they released a data dictionary explaining the different columns though.

Paper and discussion history. A mention is not an endorsement.

Measuring Implicit Bias in Explicitly Unbiased Large Language Models · HackerPapers discussions

Measuring Implicit Bias in Explicitly Unbiased Large Language Models — mentioned by simonw