Concern over safety of asylum seekers