add two python crawling frameworks

This commit is contained in:
hitalex@laptop 2014-11-19 20:46:03 +08:00
parent 44e928f83c
commit 673626f86d

View File

@ -530,6 +530,8 @@ A curated list of awesome Python frameworks, libraries and software. Inspired by
* [feedparser](http://pythonhosted.org/feedparser/) - Universal feed parser. * [feedparser](http://pythonhosted.org/feedparser/) - Universal feed parser.
* [RoboBrowser](https://github.com/jmcarp/robobrowser) - A simple, Pythonic library for browsing the web without a standalone web browser. * [RoboBrowser](https://github.com/jmcarp/robobrowser) - A simple, Pythonic library for browsing the web without a standalone web browser.
* [MechanicalSoup](https://github.com/hickford/MechanicalSoup) - A Python library for automating interaction with websites. * [MechanicalSoup](https://github.com/hickford/MechanicalSoup) - A Python library for automating interaction with websites.
* [cola](https://github.com/chineking/cola) - Cola: A distributed crawling framework.
* [pyspider](https://github.com/binux/pyspider) - A Powerful Spider System in Python
## Web Content Extracting ## Web Content Extracting