From 673626f86dd2bfd700f7311d6b9f6948e35eeee0 Mon Sep 17 00:00:00 2001 From: "hitalex@laptop" Date: Wed, 19 Nov 2014 20:46:03 +0800 Subject: [PATCH] add two python crawling frameworks --- README.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/README.md b/README.md index 361c6063..f24b526c 100644 --- a/README.md +++ b/README.md @@ -530,6 +530,8 @@ A curated list of awesome Python frameworks, libraries and software. Inspired by * [feedparser](http://pythonhosted.org/feedparser/) - Universal feed parser. * [RoboBrowser](https://github.com/jmcarp/robobrowser) - A simple, Pythonic library for browsing the web without a standalone web browser. * [MechanicalSoup](https://github.com/hickford/MechanicalSoup) - A Python library for automating interaction with websites. +* [cola](https://github.com/chineking/cola) - Cola: A distributed crawling framework. +* [pyspider](https://github.com/binux/pyspider) - A Powerful Spider System in Python ## Web Content Extracting