Prince Harry warned his 'collapse is yet to come' as Duke misses opportunity to see King Charles again