The Americans who want America to stay white are actually a minority themselves