Meghan was 'unsatisfied' with Charles' letter reply so turned down major invite