Perfectly Aligning AI’s Values With Humanity’s Is Impossible

One of the hardest problems in artificial intelligence is “alignment,” or making sure AI goals match our own, a challenge that may prove especially important if superintelligent AIs that outmatch us intellectually are ever developed. But scientists in England and their colleagues now report in the journal PNAS Nexus that perfect alignment between AI systems and human interests is mathematically impossible.
All may not be lost, the scientists say. To cope with this impossibility, they suggest a s