AI Alignment at Your Discretion — HN submission

Thu, 20 Feb 2025 16:33:53 GMT

AI Alignment at Your Discretion

When feeding alignment principles to an AI, what does it prioritize? What are humans prioritizing when they give feedback? Does AI have the same priorities as human feedback? We formalize these questions as 'alignment discretion'. Just like we scrutinize judges when they interpret and balance legal principles (judicial discretion), we should scrutinize annotators and algorithms when they balance alignment principles. Our paper presents a set of metrics to do exactly this, and we find significant discrepancies between human and algorthmic discretion.

3 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

AI Alignment at Your Discretion · HackerPapers discussions

AI Alignment at Your Discretion — HN submission