Stephen Colbert almost walked away from the very thing that made him a late-night force. The longtime host revealed how a ...