“Scaling up” the agent means replacing the agent with a more sophisticated agent.

“Scaling up” the overseer means replacing the agent with one who defers to a more sophisticated overseer.