No 10 behaving as if Rishi Sunak is 'as popular as two years ago', says minister