Charles's six-word response after reporters kept him awake with hot tub antics