Pierce Brosnan will 'cherish forever' his time with the late James Caan