I would keep the apples picked off the first couple of years.
This is right. My inlaws trees have the same thingHard to tell from the picture, but if the leaves look burned, it could be fire blight. That would have to be cut off and destroyed (buried or burned far away from any fruit trees).