Turns out there’s a downside for companies that allow working from home, too