Interesting that he refers to Ezra by his full name (as opposed to the pretty servant). Even though he doesn't know anything about the person but the way he looks, Franklin appears to admire him. On the other hand, perhaps so as to subdue his admiration/jealousy for him, he pities Ezra for "being unpopular everywhere," implicitly preening himself for being so well-known.

Ezra Jennings expressed his yearning for human sympathy and his admiration for Mr.Franklin here. It appeared to me that nearly every character of the novel had some reason to adore Mr.Franklin. The peculiarity of Jennings is that he had long been plagued by distrust and dwelt in solitude. This and the impending death painted his affection towards Franklin rather melancholy, since this affection was intertwined with his crave for youth, riches, health, etc., all of which he had never, and probably would never have, an opportunity, to possess.