Download

Here you can find links to download the latest Scrapy release, or get the latest development version. If this is your first time with Scrapy, we recommend you to read the Scrapy Tutorial.

Latest stable release: 0.8

The latest stable release is available from several sources:

• Download the source tarball: Scrapy-0.8.tar.gz
• Download the Windows installer: Scrapy-0.8.win32.exe
• Scrapy 0.8 on PyPI
  • install with: easy_install -U Scrapy
• Ubuntu PPA for Scrapy 0.8 (maintained by Insophia, the company behind Scrapy)
  • after adding PPA, install with: apt-get install scrapy
  • the PPA version also includes post-release bug fixes

Release checksums are available here.

Requirements

• Python 2.5 or above
• Twisted 2.5.0 or above
• libxml2 2.6.28 or above (including Python bidings)
• pyopenssl - only if you want to crawl secure (HTTPS) pages

Check the installation instructions for a guide on how to install them in several platforms (Linux, Windows, Mac OS X, etc).

Development snapshots

• Latest development snapshot (tarball): tip.tar.gz
• Latest development snapshot (zip file): tip.zip

Check out source code

You can clone either of the following repos

• Official Mercurial repository: http://hg.scrapy.org/scrapy/
• Official Github mirror: http://github.com/insophia/scrapy/
• Official Bitbucket mirror: http://bitbucket.org/insophia/scrapy/