Problem In Yahoo!'s Crawler?

Seems like there is a big problem with Yahoo!'s crawler. Reports coming from Search Engine Watch Forums and WebmasterWorld Forums indicate that Yahoo! Slurp is indexing pages which should not be indexed. It might be that some specific bots are not conforming to robots.txt file. The pages are being indexed at rates which can be very harmful. A member of Search Engine Watch Forums has posted an example:

Navneet Kaushal

Navneet Kaushal is the founder and CEO of PageTraffic, an SEO Agency in India with offices in Chicago, Mumbai and London. A leading search strategist, Navneet helps clients maintain an edge in search engines and the online media. Navneet's expertise has established PageTraffic as one of the most awarded and successful search marketing agencies.

PageTraffic Buzz brings you the latest happenings from all corners of the digital marketing world. You will find fast news, in-depth analysis, helpful articles, how-to-guides and a lot more right here, updated five times daily.