Self-critiquing models for assisting human evaluators — mentioned by nmca

Fri, 05 May 2023 10:29:11 GMT

It's important that humans are still able to understand the actions of these systems for safety reasons; the area focused on the problem you identify is "scalable oversight", see for example: https://arxiv.org/abs/2206.05802 https://arxiv.org/abs/2211.03540

Paper and discussion history. A mention is not an endorsement.

Self-critiquing models for assisting human evaluators · HackerPapers discussions

Self-critiquing models for assisting human evaluators — mentioned by nmca