Americans really do have to work harder to stay middle class