418 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
jeancf	ba3da6ab7c	Handled exception of video download directory absent when trying to delete it	2020-03-28 11:21:28 +01:00
jeancf	dd1d54d2a4	Check if tweet in db before ingest to speed up processing of feed	2020-03-28 11:08:09 +01:00
jeancf	2fe06c0bbc	Use correct capitalization of twitter account name for deleting video directory	2020-03-27 17:45:40 +01:00
jeancf	0231f224a3	Improved naming of downloaded videos and implemented cleanup	2020-03-27 17:26:04 +01:00
JC Francois	9a8cd0ef65	TODO's and FIXME's	2020-03-26 20:50:59 +01:00
JC Francois	04c95f3ad3	Added command-line option to download video from tweet and upload to Mastodon	2020-03-26 19:58:17 +01:00
JC Francois	99ffa52eb6	Added upload of video to Mastodon instance	2020-03-26 19:03:21 +01:00
jeancf	909183eb0a	Added comments and TODOs	2020-03-26 15:04:36 +01:00
jeancf	b768561662	Added video file path to dictionary with content of tweet	2020-03-26 14:50:03 +01:00
jeancf	ab7c68dff3	Added video download to cleanup_tweet_text()	2020-03-26 13:37:50 +01:00
jeancf	0f38bf283e	Adding twitter-video-downloader module	2020-03-25 17:40:07 +01:00
jeancf	305c3d05c7	Added .gitignore	2020-03-22 11:58:15 +01:00
jeancf	aa50e934e6	Corrected typo in README.md	2020-03-17 15:53:52 +01:00
jeancf	01b08542ec	Added doc of -r switch to README.md	2020-03-17 15:19:06 +01:00
jeancf	3201cc8169	Added option to include reply-to tweets (False by default)	2020-03-17 15:13:22 +01:00
jeancf	7b22838d35	Forgot to comment out one debug output	2020-03-06 18:02:21 +01:00
jeancf	17c358a61c	Mentioned new functionality in README.md	2020-03-06 17:54:48 +01:00
jeancf	e1ed7780ad	Merge branch 'uncensored'	2020-03-06 17:46:56 +01:00
jeancf	eda84e78e7	Commented out debug prints	2020-03-06 17:44:10 +01:00
jeancf	6fb6a38732	Used session to manage cookies automatically	2020-03-06 17:40:13 +01:00
jeancf	fd9130c053	NOT WORKING: trying to get uncensored pic redirects to no_js page	2020-03-04 17:49:57 +01:00
JC François	3cb60ad963	Better spacing around RT mention	2020-02-17 11:40:02 +00:00
JC Francois	1acc33f7e7	Removed excess / in original tweet link	2020-02-15 17:06:56 +01:00
jeancf	266461a6cc	Updated README.md	2020-02-15 16:06:15 +01:00
jeancf	6a397cc089	Removed debug print	2020-02-15 16:03:05 +01:00
jeancf	a5fde58615	Rewrite complete	2020-02-15 15:39:01 +01:00
jeancf	0b15b93d37	Loading full_status_page (headers not working)	2020-02-14 18:01:12 +01:00
jeancf	296d124c35	Text and links are fixed	2020-02-14 16:37:54 +01:00
JC Francois	9dbf40bb5d	WIP twitter changes	2020-02-14 07:58:39 +01:00
JC Francois	446f39f173	Added handling of no_js landing page	2020-02-13 18:01:45 +01:00
JC Francois	fdab0a0836	Add tolerance for TooManyRedirects in media search in linked page	2020-01-04 11:39:53 +01:00
JC Francois	bb226e54a9	Added handler (doing nothing) for tweet-poi-geo-text	2019-12-21 12:05:54 +01:00
JC Francois	56a89ec4f3	Added tolerance for invalid media links	2019-11-07 20:06:15 +01:00
BuildTools	51f7ca9694	Added tolerance for missing mimetype in content	2019-10-24 19:35:24 +02:00
JC Francois	55f188b9f9	Added tolerance for encoding exception	2019-10-19 09:53:48 +02:00
JC Francois	65b3065a75	Merge remote-tracking branch 'gitlab/master' ... # Conflicts: # twoot.py	2019-10-19 09:51:51 +02:00
JC Francois	7cac6bb6c0	Added tolerance for encoding exception	2019-10-19 09:50:29 +02:00
jeancf	0222eb175b	Remove HTML-safe encoding from URL if any	2019-10-11 14:28:24 +02:00
jeancf	203a147fad	Added timeout to request of linked page	2019-09-27 11:44:11 +02:00
JC Francois	37970200c0	Merge remote-tracking branch 'gitlab/master'	2019-09-26 21:55:26 +02:00
JC François	3cc1f8ec3f	Updated user agents	2019-09-26 21:55:00 +02:00
JC François	2c0157ad44	Added missing mime_type argument to call to media-post()	2019-09-17 13:44:03 +00:00
JC François	a24f43dbfa	Fixed bug when tweet text is empty	2019-09-17 07:18:55 +00:00
JC Francois	3387e363d5	Try to not specify mime_type to fix crash when mime_type is NoneType	2019-09-08 20:01:26 +02:00
JC Francois	1d4270cb00	Another iteration on fix for crash when mime_type is NoneType	2019-09-08 19:11:35 +02:00
JC Francois	0eac3065d5	Added fix for crash when mime_type is NoneType	2019-09-08 19:03:43 +02:00
JC Francois	806b57f763	Added tolerance for MastodonIllegalArgumentError when visiting linked page to extract picture	2019-09-07 13:08:17 +02:00
JC Francois	1ec03c7d81	Added tolerance for ConnectionError when visiting linked page to extract picture	2019-08-31 20:30:40 +02:00
JC Francois	1b1faf2d59	Added tolerance for mastodonAPIError when uploading invalid media	2019-08-26 21:02:19 +02:00
jeancf	5b23c66b6b	Added option to scrape linked page if no pic is provided in tweet	2019-08-16 15:27:55 +02:00