'I can't survive another two years of this,' ex-Disney CEO said before Bob Iger took back the job