Yellow Jackets. Yellow jackets are beneficial around home gardens and commercially grown fruits and vegetables at certain times because they feed on caterpillars and harmful flies. When the populations peak in late summer and early fall, the yellow jackets' feeding habits become a problem.