One thing leads me to lean toward Carlyle's interpretation, which is the mention of Rousseau - he did seem to latch on to people whose reputations have stood some test of time (although in Johnson's case he is responsible for the reputation lasting so maybe it means nothing)

Of course I also wonder, if he was so awful what does it say about Johnson that he tolerated his company. Rousseau comes out looking better for that "Go Away"