Harry will have 'some explaining' to do if he doesn't return to UK in May