Setup easy_install and Scrapy

On windows,

Download Scrapy-0.16.3.tar.gz from http://pypi.python.org/pypi/Scrapy

tar xvf Scrapy-0.16.3.tar.gz

set HTTP_PROXY=http://USER:PASSWORD@company-proxy.com:PORT/

easy_install lxml==2.3

easy_install -U Scrapy-0.16.3

Scrapy Example

scrapy crawl <name> will throw the following error.

ImportError: Error loading object ‘scrapy.core.downloader.webclient.ScrapyHTTPClientFactory’: No module named win32api

Please refer to http://doc.scrapy.org/en/latest/faq.html

Install pywin32-218.win32-py2.7.exe from (for python 2.7 win32)http://sourceforge.net/projects/pywin32/files/pywin32/Build%20218/