Joe sells the best fruit in the city.  He bans Kramer when Kramer tries to return one of Jerry's bad peaches.  Then Jerry is banned while trying to buy "some fruit for [him]self," which is really for Kramer.  This means that George is stuck buying fruit for both of them and was eyeballed the whole time by a suspicious Joe.