The Master could be anywhere. He could be. And part of the Doctor doesn't want him to be an illusion. Part of him would rather die than lose the Master again.

He can't dispel it. Inside, he's too desperate for it to be real.

"Just go," he says. "We have to get out of here. Quickly, go, now!"