Deploy Scrapy to Production
The fastest way to take your spider live is Scrapy Cloud by Zyte — host, schedule, and monitor your crawls at scale, with a free tier to get started.
Host and monitor your spiders in the cloud
Scrapy Cloud is the managed platform from Zyte, the company behind Scrapy. Deploy with a single command and let Zyte handle scheduling, scaling, monitoring, and storage — no server to manage.
- Real-time dashboard
- Intelligent scheduling
- Built-in monitoring & logging
- Customizable containers
- Seamless Zyte API integration
- Zero vendor lock-in
Starter plan
Deploy your first spider with unlimited projects and requests — no credit card required.
Start freeGet started in three steps
Install shub
Zyte's command-line tool for Scrapy Cloud.
$ pip install shubLog in
Authenticate with your free API key.
$ shub loginDeploy
Push your project and run it in the cloud.
$ shub deployNeed the full walkthrough? Read the Scrapy Cloud get-started guide →
Simple, scalable pricing
What's a Scrapy unit?
A Scrapy unit is the building block you scale with: 1 unit = 1 GB of RAM and 1 concurrent crawl. Add more units to run additional spiders at the same time or to power heavier crawls — you only pay for what you need.
Starter
Everything you need to deploy your first spider.
- Unlimited projects
- Unlimited requests
- Unlimited team members
- 1 hour crawl time
- 1 concurrent crawl
- 7 day data retention
Professional
Scale up by adding units as your crawls grow.
- Everything in Starter
- Unlimited crawl time
- Unlimited concurrent crawls
- Intelligent crawl scheduling
- 120 day data retention
- Personalized support
Other ways to deploy
Scrapyd
The open source app for deploying and running Scrapy spiders on your own server, controlled over a JSON API.
Read the docs →scrapyd-client
Package and deploy your project to any Scrapyd instance with a single scrapyd-deploy command.
Get scrapyd-client →Docker
Containerize your spiders for reproducible runs anywhere — from a Raspberry Pi to a Kubernetes cluster.
Deployment guide →