James Cleverly says it is 'time to turn off the taps' to cheap overseas labour