I think it’s both. Alex has the idea that Harriet is too tired to continue in her post, and Harriet becomes increasingly paranoid because she is constantly wondering what the Doctor said, and how it was going to end her political career. Since she’s paranoid, she starts acting more and more erratically, which feeds into the ‘too tired’ narrative, and eventually destroys her career.