72 Commits

Author	SHA1	Message	Date
jeancf	e87599d40b	Removed downloading of full status page of the tweet	2020-12-16 21:57:03 +01:00
jeancf	7cc076053f	Extracted tweet_id and status_id	2020-12-16 21:55:13 +01:00
jeancf	c25e36b498	Extracted timeline	2020-12-16 20:55:26 +01:00
jeancf	910b7a8b13	Safer implementation	2020-12-16 20:48:00 +01:00
jeancf	e2841535f6	Extracted twit_account	2020-12-16 20:42:44 +01:00
jeancf	894c13d551	Download page from nitter.net	2020-12-16 19:43:17 +01:00
jeancf	9fc76b9981	Updated user agents	2020-12-16 18:47:27 +01:00
BuildTools	c4bf95c1a7	Commented out printing of extracted tweets	2020-12-13 21:04:33 +01:00
jeancf	010f5fdeec	Merge remote-tracking branch 'gitlab/logging' into logging	2020-12-13 18:30:57 +01:00
jeancf	b7175067c0	Added timeout to execution of twitterdl.py	2020-12-13 18:25:27 +01:00
jeancf	267d4cb551	TODO is done	2020-12-13 10:44:07 +01:00
jeancf	4f326ee3cd	Added more debug messages	2020-11-09 15:55:42 +01:00
jeancf	1781eb5653	Basic logging setup	2020-10-14 21:51:00 +02:00
jeancf	67fdbba510	Stop trying to regex a string into linked picture file	2020-09-10 13:09:51 +02:00
JC Francois	a95006fae6	Added tolerance for malformed URL in picture download	2020-04-09 18:17:13 +02:00
JC Francois	092f2ab371	Cleanup and README.md update for release	2020-04-05 10:37:54 +02:00
JC Francois	e32620d79b	Implemented proper naming of downloaded videos	2020-03-29 17:16:54 +02:00
JC Francois	965317f5b2	Added details on optional dependencies to README.md	2020-03-29 13:57:18 +02:00
JC Francois	6fa2019618	Calling twitterdl.py as subprocess	2020-03-29 13:41:49 +02:00
jeancf	2090d214b6	Trying to stop debug messages	2020-03-28 14:11:06 +01:00
jeancf	9c56ad57c8	Added TODOs to improve management of locations of video download	2020-03-28 14:07:00 +01:00
jeancf	df4eaa0dd7	Set debug=0 on call to download to avoid mail spam	2020-03-28 13:55:43 +01:00
jeancf	ba3da6ab7c	Handled exception of video download directory absent when trying to delete it	2020-03-28 11:21:28 +01:00
jeancf	dd1d54d2a4	Check if tweet in db before ingest to speed up processing of feed	2020-03-28 11:08:09 +01:00
jeancf	2fe06c0bbc	Use correct capitalization of twitter account name for deleting video directory	2020-03-27 17:45:40 +01:00
jeancf	0231f224a3	Improved naming of downloaded videos and implemented cleanup	2020-03-27 17:26:04 +01:00
JC Francois	9a8cd0ef65	TODO's and FIXME's	2020-03-26 20:50:59 +01:00
JC Francois	04c95f3ad3	Added command-line option to download video from tweet and upload to Mastodon	2020-03-26 19:58:17 +01:00
JC Francois	99ffa52eb6	Added upload of video to Mastodon instance	2020-03-26 19:03:21 +01:00
jeancf	909183eb0a	Added comments and TODOs	2020-03-26 15:04:36 +01:00
jeancf	b768561662	Added video file path to dictionary with content of tweet	2020-03-26 14:50:03 +01:00
jeancf	ab7c68dff3	Added video download to cleanup_tweet_text()	2020-03-26 13:37:50 +01:00
jeancf	0f38bf283e	Adding twitter-video-downloader module	2020-03-25 17:40:07 +01:00
jeancf	305c3d05c7	Added .gitignore	2020-03-22 11:58:15 +01:00
jeancf	3201cc8169	Added option to include reply-to tweets (False by default)	2020-03-17 15:13:22 +01:00
jeancf	7b22838d35	Forgot to comment out one debug output	2020-03-06 18:02:21 +01:00
jeancf	eda84e78e7	Commented out debug prints	2020-03-06 17:44:10 +01:00
jeancf	6fb6a38732	Used session to manage cookies automatically	2020-03-06 17:40:13 +01:00
jeancf	fd9130c053	NOT WORKING: trying to get uncensored pic redirects to no_js page	2020-03-04 17:49:57 +01:00
JC François	3cb60ad963	Better spacing around RT mention	2020-02-17 11:40:02 +00:00
JC Francois	1acc33f7e7	Removed excess / in original tweet link	2020-02-15 17:06:56 +01:00
jeancf	6a397cc089	Removed debug print	2020-02-15 16:03:05 +01:00
jeancf	a5fde58615	Rewrite complete	2020-02-15 15:39:01 +01:00
jeancf	0b15b93d37	Loading full_status_page (headers not working)	2020-02-14 18:01:12 +01:00
jeancf	296d124c35	Text and links are fixed	2020-02-14 16:37:54 +01:00
JC Francois	9dbf40bb5d	WIP twitter changes	2020-02-14 07:58:39 +01:00
JC Francois	446f39f173	Added handling of no_js landing page	2020-02-13 18:01:45 +01:00
JC Francois	fdab0a0836	Add tolerance for TooManyRedirects in media search in linked page	2020-01-04 11:39:53 +01:00
JC Francois	bb226e54a9	Added handler (doing nothing) for tweet-poi-geo-text	2019-12-21 12:05:54 +01:00
JC Francois	56a89ec4f3	Added tolerance for invalid media links	2019-11-07 20:06:15 +01:00