The answer is: "'You’ve changed lots, Jimmy. I never thought you were so tall by two or three inches.'"
The statement itself contains the evidence. By admitting his awe that Jimmy has changed a lot, it implies that he is surprised at what his friend has become. Primarily due to his appearance. In this statement, he pinpointed the change in his height.