 You know, with anything that you can scrape out dirt and weeds and probably got all kinds of gunk in there. You might even have a little filler left down in there and you get as much out as you can. That'd be best. And you don't want to just take a tube of caulking and start pumping that into this endless hole because the type of caulking that I'm going to recommend is not going to be real cheap.