Divergent Creativity in Humans and Large Language Models — mentioned by orbital-decay

Sat, 12 Oct 2024 04:20:51 GMT

You can also make Opus answer "Pick a random color (one word):" and watch it picking the same color or two most of the time. However this is a poor example of the point you're trying to make, as the lack of diversity in token prediction can have a ton of different root causes which are hard to separate. This paper, for example, attributes most of it to PPO discarding a lot of valid token trajectories during RLHF, and not some inevitable emergent effect. [1] [2] > only the largest Anthropic model is breaking from stochastic outputs there Most models, even small ones, exhibit the lack of output…

Paper and discussion history. A mention is not an endorsement.

Divergent Creativity in Humans and Large Language Models · HackerPapers discussions

Divergent Creativity in Humans and Large Language Models — mentioned by orbital-decay