mirror of https://github.com/hastagAB/Awesome-Python-Scripts.git synced 2024-11-23 20:11:07 +00:00

History

dependabot[bot] ac9f6ebb1c Bump requests from 2.22.0 to 2.31.0 in /Website_Url_Detector Bumps [requests](https://github.com/psf/requests) from 2.22.0 to 2.31.0. - [Release notes](https://github.com/psf/requests/releases) - [Changelog](https://github.com/psf/requests/blob/main/HISTORY.md) - [Commits](https://github.com/psf/requests/compare/v2.22.0...v2.31.0) --- updated-dependencies: - dependency-name: requests dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com>		2023-05-27 17:36:53 +00:00
..
detect_urls.py	Add the website URL detector (#230 )	2021-10-06 16:01:15 +05:30
README.md	Add the website URL detector (#230 )	2021-10-06 16:01:15 +05:30
requirements.txt	Bump requests from 2.22.0 to 2.31.0 in /Website_Url_Detector	2023-05-27 17:36:53 +00:00

README.md

Website URL Detector

Description

A python script that detects URLs on a given website.

Usage

>>> python detect_urls.py --website [website_url]

Example

>>> python detect_urls.py --website https://en.wikipedia.org/wiki/Guido_van_Rossum
https://upload.wikimedia.org/wikipedia/commons/thumb/e/e2/Guido-portrait-2014-drc.jpg/1200px-Guido-portrait-2014-drc.jpg
https://creativecommons.org/licenses/by-sa/3.0/
https://en.wikipedia.org/wiki/Guido_van_Rossum
https://gvanrossum.github.io/
http://mail.python.org/pipermail/python-dev/2007-January/070849.html
https://web.archive.org/web/20090908131440/http://mail.python.org/pipermail/python-dev/2007-January/070849.html
http://www.computerhistory.org/atchm/2018-chm-fellow-guido-van-rossum-python-creator-benevolent-dictator-for-life/
https://web.archive.org/web/20180724114116/http://www.computerhistory.org/atchm/2018-chm-fellow-guido-van-rossum-python-creator-benevolent-dictator-for-life/
https://web.archive.org/web/20081031103755/http://wiki.codecall.net/Guido_van_Rossum
http://wiki.codecall.net/Guido_van_Rossum
...