crawler-python is a simple crawler framework for collection online data from websites for academic purpose.

• download or clone the source code
• ...

• Yelp
  • It's better to work with goengent (Oops, yelp blocks it)
• amazon
• gdgt

• buzzillion
• dpreviews
• sina_weibo

• crawling in paralles with eventlet

• http://23.244.180.162:8089 (2014-01-24)
• 192.3.25.99:7808
• 204.236.154.194:3128
• 202.187.160.140:3128
• 220.181.26.98:80
• 218.248.7.18:8080

• Free Proxy - Cyberghost
• ProxyNova website
• Proxy list