Fruit — If you have ragweed allergies, be careful with bananas. If you have grass allergies, be careful with tomatoes. If you have a negative reaction to birch, watch it with apples, plums, and peaches. These plants and fruits are pollinated with the same proteins, so they can cause negative allergic reactions.