Summary
As artificial intelligence (AI) systems are increasingly being used to make important decisions with limited human oversight, ensuring these decisions align with societal values becomes critical for accountability. However, teaching AI to make decisions that truly reflect human values is difficult, particularly as people cannot spell out their preferences for every situation. Further, AI must act appropriately even in novel situations that people have never faced before. Today's AI systems try to extrapolate from limited human input, which can lead to unpredictable or undesirable outcomes. The
