Welcome to pcrawler’s documentation!

pcrawler是一款python版本的爬虫程序,通过该爬虫程序可以非常快速方便的编写一个自己的爬虫程序。pcrawler主要 包含downloader、schedular、processor、storage四大组件组成。而且可以非常方便快捷的拓展各个组件。

The code is open source, and available on GitHub.

The main documentation for the site is organized into a couple sections:

Information about development is also available:

Developer Documentation

Designer Documentation