Fork me on GitHub

Commercial support

The following companies offer support contracts and consultancy services for Scrapy, and can also develop bespoke crawlers to meet your needs:

Scrapinghub is currently the largest company sponsoring Scrapy development. It specializes in web crawling, it was founded by Scrapy creators and employs crawling experts including many Scrapy core developers.
Flax are experts in open source search and have used Scrapy in several projects, for clients in sectors including publishing, recruitment and broadcast. We recommend Scrapy as a first choice to clients looking to gather content for a search application.
GoScrape specializes in developing web crawlers via Scrapy for fulfilling information needs. They built their first commercial crawler nearly five years ago and have been developing professional scrapers and crawlers ever since. Their core services include scraping, crawling, and parsing data from a variety of sources; interacting with web APIs; and cleansing, analyzing, and presenting data using a variety of methods.
Sophilabs is a software engineering firm that provides Scrapy consulting and support, along with web design and development. They have been writing Scrapy crawlers for their customers since 2010, deploying them in scalable architectures that distribute load among many servers.
Arbisoft is using Scrapy for a number of aggregation projects for our clients and partners. They have more than 20 trained Scrapy/Python engineers and usually recommend it as the first choice when their partners ask for scraping services.
Tryolabs is a Boutique Python/Django Shop & Lab specialized in Internet applications with Artificial Intelligence Components. They embed Scrapy into their customers applications as well as into their own products.
Thalasar Ventures offers Scrapy support and development
Data Quarry designs data scrapers specifically to address the needs of e-commerce users and offers custom scrapy devlopment.

Does your company offer Scrapy development, consultancy or support?. Email and request to be added, or just fork this GitHub repo, add yourself and send a pull request.

Did you have a bad experience with any of these companies?. Email and tell us about it.