The number of EU nationals coming to the UK for work has fallen by a third since the Brexit vote