Care worker migrant surge 'should have been obvious', says ex-borders inspector