Add Crawlee for Python

This commit is contained in:
Saurav Jain 2024-07-24 12:10:46 +05:30 committed by GitHub
parent 2252650cfd
commit 4b9d56976e
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194

View File

@ -1133,11 +1133,13 @@ Inspired by [awesome-php](https://github.com/ziadoz/awesome-php).
*Libraries to automate web scraping.* *Libraries to automate web scraping.*
* [crawlee-python](https://github.com/apify/crawlee-python) - A web scraping and browser automation library to build reliable scrapers fast.
* [feedparser](https://github.com/kurtmckee/feedparser) - Universal feed parser. * [feedparser](https://github.com/kurtmckee/feedparser) - Universal feed parser.
* [grab](https://github.com/lorien/grab) - Site scraping framework. * [grab](https://github.com/lorien/grab) - Site scraping framework.
* [mechanicalsoup](https://github.com/MechanicalSoup/MechanicalSoup) - A Python library for automating interaction with websites. * [mechanicalsoup](https://github.com/MechanicalSoup/MechanicalSoup) - A Python library for automating interaction with websites.
* [scrapy](https://github.com/scrapy/scrapy) - A fast high-level screen scraping and web crawling framework. * [scrapy](https://github.com/scrapy/scrapy) - A fast high-level screen scraping and web crawling framework.
## Web Frameworks ## Web Frameworks
*Traditional full stack web frameworks. Also see [RESTful API](https://github.com/vinta/awesome-python#restful-api).* *Traditional full stack web frameworks. Also see [RESTful API](https://github.com/vinta/awesome-python#restful-api).*