Welcome to pcrawler’s documentation!¶
pcrawler是一款python版本的爬虫程序,通过该爬虫程序可以非常快速方便的编写一个自己的爬虫程序。pcrawler主要 包含downloader、schedular、processor、storage四大组件组成。而且可以非常方便快捷的拓展各个组件。
The code is open source, and available on GitHub.
The main documentation for the site is organized into a couple sections:
Information about development is also available: