The 80/20 point is the part that matters most for builders. It leaves a concrete design question: when an agent has slack, what does it optimize? A booked meeting at any cost reads very differently to a buyer than a booked meeting with someone who genuinely benefits. What an agent does with slack is set by the object level values; how reliably it follows instructions is a separate question. I am building an AI go to market agent, so this is the version of the alignment problem I sit with. The long term vision is companies that run themselves, and that only works if the values underneath are right.
The 80/20 point is the part that matters most for builders. It leaves a concrete design question: when an agent has slack, what does it optimize? A booked meeting at any cost reads very differently to a buyer than a booked meeting with someone who genuinely benefits. What an agent does with slack is set by the object level values; how reliably it follows instructions is a separate question. I am building an AI go to market agent, so this is the version of the alignment problem I sit with. The long term vision is companies that run themselves, and that only works if the values underneath are right.