"That's why we have each other," the Doctor said. "To keep us in check. To keep us from...taking it out on the universe."

Which was something the Doctor could've very easily done. He still could very easily do. He was almost the Valeyard once in this incarnation. It could happen again if he wasn't careful.

"We'll find justice, you and me." He gave Jack a small, tight smile. "Together."