Q:

Robot request to an ASP.Net app

Is there a way to determine if a http request to an ASP.Net application is made from a browser or from a robot/crawler? I need to differentiate this two kind of requests. 
Thanks!

A:

No, there isn't. There is no fool proof to determine what originated a request - all HTTP headers can be spoofed.
Some crawlers (GoogleBot and such) do advertise themselves, but that doesn't mean a person browsing can't pretend to be GoogleBot. 
The best strategy it to look for the well known bots (by User-Agent header and possibly by the known IP address) and assume those are crawlers.

