Does physical mean appearance here?
Yes, "physical" in this context is referring to the appearance, or what one can physically see. In this case, he is saying that Jake's only difference is his appearance, but he is the same on the inside. When describing appearance in this way, it is common to put "physical" next to "appearance". Ex: Her physical appearance is very nice but her personality is even better.