Bits of Grass: Does GPT already know how to write like Whitman? — mentioned by gwern

Fri, 09 Jun 2023 01:58:37 GMT

> However, once they've started writing rhyming poetry it's hard to get them to stop rhyming. They seem to have formed a strong association between rhyming and poetry. I've also been unable to get them to obey a specific rhyming scheme like ABBAB. Correct and commonly observed (eg. https://arxiv.org/abs/2305.11064 ). (At least, for GPT models. I don't know as much about the Anthropic models as I should, although I understand they do still use a BPE tokenization, unfortunately.) My theory is that it is a surprising interaction of BPEs with RLHF…

Paper and discussion history. A mention is not an endorsement.

Bits of Grass: Does GPT already know how to write like Whitman? · HackerPapers discussions

Bits of Grass: Does GPT already know how to write like Whitman? — mentioned by gwern