Should it be over for Starmer?

Grandees from all sides of politics have warned against changing PM. Are they right?