AI SAFETY & ETHICS
No Strong Orthogonality From Selection Pressure
LessWrong AI
•
A postratfic version of this essay, together with the acknlowlegenents for both, is available on Substack TL;DR If everything goes according to plan, by the end of this post we should have separated three claims that are too often bundled together: Intelligence does not imply human morality. Weird minds are possible. A reflective, recursively improving intelligence should be expected to remain bound to a semantically thin “terminal goal” that emerged during