I would like a script to scrape [url removed, login to view] continuously (i.e. I need an auto-crawler).
The data needed will be time, price, place of departure/arrival, duration of transportation, etc. and an exact list will be provided upon hiring.
After the data is scraped, it should be parsed into a MySQL database, which we will give the specifications for upon hiring. The script should not be a desktop application or excel macro.
We will want the source code when it is complete.
- Script can scrape the data repeatedly (auto-crawler)
- Flag if the site has changed or data is not properly loading
- Parse and output data to MySQL