Alignment has a Fantasia problem
A paper from MIT names the failure mode where an LLM agent commits to an underspecified user intent and then faithfully executes the wrong thing. We turned the prescription into a routing skill.
Read the post →— Alignment has a Fantasia problem