Download

Here you can find links to download the latest Scrapy release, or get the latest development version. If this is your first time with Scrapy, we recommend you to read the Scrapy Tutorial.

Latest stable release: Scrapy 0.9

The latest stable release is available from several sources:

• Download the source tarball: Scrapy-0.9.tar.gz
• Download the Windows installer: Scrapy-0.9.win32.exe
• Scrapy 0.9 on PyPI
  • install with: easy_install -U Scrapy
• Official APT repositories for Ubuntu 10.04 and 9.10
  • updated periodically from stable repo so bug fixes get included before bugfix releases

Release files and checksums are available here.

Requirements

• Python 2.5 or above
• Twisted 2.5.0 or above
• libxml2 2.6.28 or above (including Python bidings)
• pyopenssl - only if you want to crawl secure (HTTPS) pages

Check the installation instructions for a guide on how to install them in several platforms (Linux, Windows, Mac OS X, etc).

Development snapshots (Scrapy 0.10)

• Latest development snapshot: Tarball | Zip file

Check out source code

You can clone either of the following repos:

• Main Mercurial repository: http://hg.scrapy.org/scrapy/
• Official Github mirror: http://github.com/insophia/scrapy/
• Official Bitbucket mirror: http://bitbucket.org/insophia/scrapy/