We should all be spending more time working together in office, civil servants told