Control. 1  The best way to get rid of a yellow jacket nest is to spray SaferÂ® Wasp & Hornet Killer directly into the opening. 2  If you canât find the nest, hang reusable or disposable traps around backyards and patios, trash cans and campsites to reduce pest numbers.