Commit Graph

185 Commits

Author SHA1 Message Date
jeancf
f0b5ee98d2 Added missing parameter in docstring 2022-11-23 10:50:41 +01:00
jeancf
7e7fa4620f Implemented -l command-line option 2022-11-23 09:59:06 +01:00
jeancf
0d1be42dcc Added code to remove trackers from fragments 2022-11-22 22:01:27 +01:00
jeancf
9625c2128b modified get request in deredir_url() 2022-11-22 11:38:49 +01:00
jeancf
e11102f4a6 User agent removed 2022-11-22 11:33:45 +01:00
jeancf
68e4918b02 Added debug message 2022-11-22 11:08:29 +01:00
jeancf
40d14c4d5d Added de-redirection of URL in tweet 2022-11-22 11:05:16 +01:00
jeancf
6860c53b11 Trying additional instance 2022-11-22 10:11:02 +01:00
jeancf
19eae4f210 Removed unreliable nitter instance 2022-11-22 09:56:56 +01:00
jeancf
f88414bb35 Added _remove_tracker_fragment() 2022-11-19 13:12:41 +01:00
jeancf
e6e6a77d3e Looking for better nitter instances 2022-11-18 13:59:34 +01:00
jeancf
6308fdc348 Reduced debug logging to essential in clean_url() 2022-11-18 13:56:22 +01:00
jeancf
37a4419ea6 Added missing parameter to process_media_body() 2022-11-18 13:32:16 +01:00
jeancf
9b1f4c9cee Swapped another nitter instance 2022-11-18 13:04:30 +01:00
jeancf
203e90dcd4 Added debug messager to clean_url() 2022-11-18 12:57:44 +01:00
jeancf
2a736de0c7 Replaced poor performing nitter instances 2022-11-18 12:17:34 +01:00
BuildTools
e2eff0445c Changed mode of twoot.py 2022-11-18 12:07:02 +01:00
jeancf
26b0619880 added command-line option 2022-11-18 11:55:06 +01:00
jeancf
dc8c89243c Updated user agents 2022-11-17 20:56:21 +01:00
jeancf
a2c9deb250 Removed duplicate tracker tags and added 'xtor' 2022-11-17 20:53:03 +01:00
jeancf
6a20c257e5 Merged contribution from
mathdatech
2022-11-17 20:18:42 +01:00
jeancf
b04b7dc195 Removed temp debug 2022-11-14 12:40:56 +01:00
jeancf
f96d8fa93c Added missing logging 2022-11-14 12:36:06 +01:00
jeancf
514a1b3304 Added some temp debug code 2022-11-14 12:26:55 +01:00
jeancf
608bc7519f Corrected condition on retweet tag 2022-11-13 22:35:46 +01:00
jeancf
84b94a38b9 Implemented retweet suppression 2022-11-13 22:17:43 +01:00
jeancf
506c4a05b7 Merge branch timeout into vid_dl 2022-11-06 12:05:23 +01:00
BuildTools
bd7860bb43 Keep log file history 2022-11-06 11:56:29 +01:00
jeancf
11b88e729a Added timeout to all downloads 2022-11-06 11:50:08 +01:00
jeancf
e8c03ab50b youtube-dl set in quiet mode 2022-11-06 11:24:57 +01:00
jeancf
4d1fec306f using youtube-dl as a class 2022-11-03 22:10:23 +01:00
jeancf
10a329fdb1 Replaced twitterdl.py by youtube-dl 2022-11-03 16:53:17 +01:00
jeancf
9c2438382e Added timeout to get request 2022-11-02 18:38:23 +01:00
jeancf
ebf32cebc9 Initialized variable referenced later 2022-10-08 10:25:04 +02:00
BuildTools
216da5519f Removed n.actionsack.com 2022-09-24 13:26:08 +02:00
jeancf
cfd1232f35 Merge remote-tracking branch 'gitlab/master' into cleandb
# Conflicts:
#	twoot.py
2022-09-15 20:35:27 +02:00
jeancf
3273b21608 Fixed bug in query 2022-09-15 20:12:20 +02:00
jeancf
dada20d0b9 Added database cleanup (untested) 2022-09-15 19:58:17 +02:00
jeancf
7f462a5a6e Minor improvement to logging 2022-09-14 16:54:47 +02:00
jeancf
5e0fb1a9c3 Corrected typo 2022-09-14 16:35:10 +02:00
jeancf
bfbe9704f7 Cosmetic changes 2022-09-14 16:28:48 +02:00
jeancf
4ccce6aac1 asctime() instead 2022-09-08 10:19:23 +02:00
jeancf
392b0bafd0 more str conversion 2022-09-08 10:17:14 +02:00
jeancf
357e45844d convert int to str 2022-09-08 10:15:14 +02:00
jeancf
2b21a626d4 Less stupid 2022-09-08 10:11:37 +02:00
jeancf
ffdce1ad12 updated url 2022-09-08 10:05:19 +02:00
jeancf
63a7a578a4 epoch to local time 2022-09-08 09:37:30 +02:00
jeancf
a7b63f569f Changed logging to info 2022-09-08 09:35:02 +02:00
jeancf
4704890ddf check rate limit 2022-09-08 09:28:28 +02:00
jeancf
7ffa81ffbd No longer try creating unique index 2022-08-22 14:50:03 +02:00