Paul Maunders said me about cool scraping and crawling framework based on python – Scrapy. I’ve tried it and developed about 20 spiders. It’s really nice stuff but it would be great if scrapy’s developers will add some more features:

1. Rules for form submitting
2. Proxy server support

Visit scrapy website