Give better answers. Sometimes this means replacing “I don’t know” with a definitive answer, sometimes it means improving the quality, sometimes it means replacing something malign with something benign.

The initial agent, e.g. a human, can’t behave corrigibly on all inputs.