mathdatech/awesome-python
1
0
Fork 0
mirror of https://github.com/vinta/awesome-python.git synced 2024-11-27 22:11:07 +00:00
Code Issues Packages Projects Releases Wiki Activity

Improve the concept of web crawling

Browse Source
This commit is contained in:
Filipe Filardi 2018-04-22 18:17:56 -03:00 committed by GitHub
parent 21ab061232
commit 9b8f935f2c
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 3 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
README.md
View File

@ -85,7 +85,7 @@ Inspired by [awesome-php](https://github.com/ziadoz/awesome-php).
- [URL Manipulation](#url-manipulation)
- [Video](#video)
- [Web Content Extracting](#web-content-extracting)
- [Web Crawling](#web-crawling)
- [Web Crawling & Web Scraping](#web-crawling-&-web-scraping)
- [Web Frameworks](#web-frameworks)
- [WebSocket](#websocket)
- [WSGI Servers](#wsgi-servers)
@ -1203,9 +1203,9 @@ Inspired by [awesome-php](https://github.com/ziadoz/awesome-php).
* [textract](https://github.com/deanmalmgren/textract) - Extract text from any document, Word, PowerPoint, PDFs, etc.
* [toapi](https://github.com/gaojiuli/toapi) - Every web site provides APIs.
## Web Crawling
## Web Crawling & Web Scraping
*Libraries for scraping websites.*
*Libraries to automate data extraction from websites.*
* [cola](https://github.com/chineking/cola) - A distributed crawling framework.
* [Demiurge](https://github.com/matiasb/demiurge) - PyQuery-based scraping micro-framework.