415 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
jeancf	efa84f85d3	Download nitter video	2020-12-18 13:26:26 +01:00
jeancf	b4a596eff2	Downloaded pics attachments	2020-12-18 11:45:43 +01:00
jeancf	14c24fe847	started process_attachments()	2020-12-17 22:59:21 +01:00
jeancf	8079914282	Reworked process_media_body	2020-12-17 22:08:43 +01:00
jeancf	711ec9677a	Added a bunch of TODO	2020-12-17 21:44:32 +01:00
jeancf	992f91537f	TODO done	2020-12-17 18:59:02 +01:00
jeancf	fbec4004f9	Handled reply-to	2020-12-17 17:56:12 +01:00
jeancf	557ef6deb9	Handling reply-to	2020-12-17 17:50:10 +01:00
jeancf	0787669a3a	Moved time check to beginning of process	2020-12-17 17:31:43 +01:00
jeancf	d92bcea2a7	Added cookie to preserve twitter and youtube addresses	2020-12-17 10:44:30 +01:00
jeancf	3a2c8093a3	Improved logging in cleanup_tweet_text	2020-12-17 10:15:46 +01:00
jeancf	08e80fd5bc	Updated readme stating that twoot is broken	2020-12-16 23:04:48 +01:00
jeancf	857a7f9b9e	Extracted full_status_url	2020-12-16 22:46:01 +01:00
jeancf	e6e24cbfd5	Extracted author, author_account, time_string, timestamp	2020-12-16 22:15:27 +01:00
jeancf	19d988dfcb	Removed extracting avatar	2020-12-16 22:03:09 +01:00
jeancf	4e6a97d765	Removed downloading of status page with uncensored pics	2020-12-16 21:58:24 +01:00
jeancf	e87599d40b	Removed downloading of full status page of the tweet	2020-12-16 21:57:03 +01:00
jeancf	7cc076053f	Extracted tweet_id and status_id	2020-12-16 21:55:13 +01:00
jeancf	c25e36b498	Extracted timeline	2020-12-16 20:55:26 +01:00
jeancf	910b7a8b13	Safer implementation	2020-12-16 20:48:00 +01:00
jeancf	e2841535f6	Extracted twit_account	2020-12-16 20:42:44 +01:00
jeancf	894c13d551	Download page from nitter.net	2020-12-16 19:43:17 +01:00
jeancf	9fc76b9981	Updated user agents	2020-12-16 18:47:27 +01:00
jeancf	372269c2be	Merge remote-tracking branch 'gitlab/logging'	2020-12-16 18:40:00 +01:00
BuildTools	c4bf95c1a7	Commented out printing of extracted tweets	2020-12-13 21:04:33 +01:00
jeancf	010f5fdeec	Merge remote-tracking branch 'gitlab/logging' into logging	2020-12-13 18:30:57 +01:00
jeancf	b7175067c0	Added timeout to execution of twitterdl.py	2020-12-13 18:25:27 +01:00
jeancf	267d4cb551	TODO is done	2020-12-13 10:44:07 +01:00
jeancf	4f326ee3cd	Added more debug messages	2020-11-09 15:55:42 +01:00
jeancf	1781eb5653	Basic logging setup	2020-10-14 21:51:00 +02:00
jeancf	67fdbba510	Stop trying to regex a string into linked picture file	2020-09-10 13:09:51 +02:00
jeancf	3500853dc8	Revert "Stop trying to regex a string into linked picture file" ... This reverts commit 9bcfe574683eaf9401bc9c8e6c6af6382f701ed7. # Conflicts: # twoot.py	2020-09-10 13:06:23 +02:00
JCF	c9d753a696	Update LICENSE	2020-04-09 16:44:04 +00:00
BuildTools	d37c47d6dc	Added __pycache__ to .gitignore	2020-04-09 18:41:51 +02:00
JC Francois	a95006fae6	Added tolerance for malformed URL in picture download	2020-04-09 18:17:13 +02:00
JC Francois	f635fb5eda	Merge branch 'video-dl'	2020-04-05 10:39:43 +02:00
JC Francois	092f2ab371	Cleanup and README.md update for release	2020-04-05 10:37:54 +02:00
JC Francois	e32620d79b	Implemented proper naming of downloaded videos	2020-03-29 17:16:54 +02:00
JC Francois	965317f5b2	Added details on optional dependencies to README.md	2020-03-29 13:57:18 +02:00
JC Francois	6fa2019618	Calling twitterdl.py as subprocess	2020-03-29 13:41:49 +02:00
jeancf	2090d214b6	Trying to stop debug messages	2020-03-28 14:11:06 +01:00
jeancf	9c56ad57c8	Added TODOs to improve management of locations of video download	2020-03-28 14:07:00 +01:00
jeancf	df4eaa0dd7	Set debug=0 on call to download to avoid mail spam	2020-03-28 13:55:43 +01:00
jeancf	ae60d2e002	Updated README.md with requirement to have ffmpeg installed	2020-03-28 11:59:47 +01:00
jeancf	cd482359a3	Updated .gitignore to disregard *.sh files	2020-03-28 11:55:13 +01:00
jeancf	d056497f65	Added additional dependencies to README.md	2020-03-28 11:47:53 +01:00
jeancf	b1c9ec3811	Added documentation of -v option to README.md	2020-03-28 11:33:38 +01:00
jeancf	ba3da6ab7c	Handled exception of video download directory absent when trying to delete it	2020-03-28 11:21:28 +01:00
jeancf	dd1d54d2a4	Check if tweet in db before ingest to speed up processing of feed	2020-03-28 11:08:09 +01:00
jeancf	2fe06c0bbc	Use correct capitalization of twitter account name for deleting video directory	2020-03-27 17:45:40 +01:00