leaving a holey appearance, according to the Georgia Cooperative Extension. Caused by Xanthomonas pruni, bacterial spot also will cause the nectarine tree leaves to turn yellow and fall off. The disease, too, can weaken the tree as well ...