Selecting AGI’s General Goal

The article argues that truly general intelligence requires learning guided by a general objective, analogous to humans’ hedonic reward system. If LLMs are extended with learning, the central challenge becomes which overarching goal their rewards should optimize. — This reframes AI alignment as a concrete design decision—choosing the objective function—rather than only controlling model behavior after the fact.