Commit Graph

288 Commits

Author SHA1 Message Date
jeancf
8e4f13c26a placed nitter url in const 2021-02-11 19:03:12 +01:00
jeancf
3b752ffca1 Removed statement that twoot is broken 2020-12-19 11:47:33 +01:00
jeancf
7929d6e76a Merge remote-tracking branch 'gitlab/nitter' 2020-12-19 11:45:33 +01:00
jeancf
a9109884a4 More debug messages 2020-12-19 10:59:23 +01:00
jeancf
1d40071b27 Added log of twitter:image download 2020-12-19 10:53:11 +01:00
jeancf
40185ef817 Improved last logging syntax 2020-12-19 10:48:46 +01:00
jeancf
5df11dbe4b Fixed last logging syntax 2020-12-19 10:36:59 +01:00
jeancf
3c7693fe66 Updated README
Improved decimal format in log
2020-12-19 10:30:19 +01:00
jeancf
dc6c16ae16 Keep logs for now 2020-12-19 10:09:03 +01:00
jeancf
43d63b1e5a Added logging run time 2020-12-19 09:21:39 +01:00
jeancf
bb52e54c0d Logging set to debug 2020-12-18 22:43:50 +01:00
jeancf
066f737a61 quote is an 'a' tag 2020-12-18 22:41:57 +01:00
jeancf
60f7054fac Separate logging for exceptions 2020-12-18 22:16:27 +01:00
jeancf
1525955c52 Added info log messages 2020-12-18 22:09:34 +01:00
jeancf
33342cdfb7 Cards can have no pic 2020-12-18 21:32:26 +01:00
jeancf
986d902ccd Fixed video download url 2020-12-18 21:06:05 +01:00
jeancf
62ba2f505e Issues with video download 2020-12-18 17:55:12 +01:00
jeancf
a0ce29f4c5 Fine tuning 2020-12-18 17:35:50 +01:00
jeancf
67bf87213d Correct url in image downloads 2020-12-18 17:21:41 +01:00
jeancf
822215fefe download more images. Improved logging 2020-12-18 17:06:09 +01:00
jeancf
3a88438ec2 Some easy bugs squashed 2020-12-18 14:57:22 +01:00
jeancf
f229976861 Improved logging. "OMG, it's full of bugs!" 2020-12-18 14:39:13 +01:00
jeancf
551c47d576 Implemented process attachment 2020-12-18 14:28:17 +01:00
jeancf
efa84f85d3 Download nitter video 2020-12-18 13:26:26 +01:00
jeancf
b4a596eff2 Downloaded pics attachments 2020-12-18 11:45:43 +01:00
jeancf
14c24fe847 started process_attachments() 2020-12-17 22:59:21 +01:00
jeancf
8079914282 Reworked process_media_body 2020-12-17 22:08:43 +01:00
jeancf
711ec9677a Added a bunch of TODO 2020-12-17 21:44:32 +01:00
jeancf
992f91537f TODO done 2020-12-17 18:59:02 +01:00
jeancf
fbec4004f9 Handled reply-to 2020-12-17 17:56:12 +01:00
jeancf
557ef6deb9 Handling reply-to 2020-12-17 17:50:10 +01:00
jeancf
0787669a3a Moved time check to beginning of process 2020-12-17 17:31:43 +01:00
jeancf
d92bcea2a7 Added cookie to preserve twitter and youtube addresses 2020-12-17 10:44:30 +01:00
jeancf
3a2c8093a3 Improved logging in cleanup_tweet_text 2020-12-17 10:15:46 +01:00
jeancf
08e80fd5bc Updated readme stating that twoot is broken 2020-12-16 23:04:48 +01:00
jeancf
857a7f9b9e Extracted full_status_url 2020-12-16 22:46:01 +01:00
jeancf
e6e24cbfd5 Extracted author, author_account, time_string, timestamp 2020-12-16 22:15:27 +01:00
jeancf
19d988dfcb Removed extracting avatar 2020-12-16 22:03:09 +01:00
jeancf
4e6a97d765 Removed downloading of status page with uncensored pics 2020-12-16 21:58:24 +01:00
jeancf
e87599d40b Removed downloading of full status page of the tweet 2020-12-16 21:57:03 +01:00
jeancf
7cc076053f Extracted tweet_id and status_id 2020-12-16 21:55:13 +01:00
jeancf
c25e36b498 Extracted timeline 2020-12-16 20:55:26 +01:00
jeancf
910b7a8b13 Safer implementation 2020-12-16 20:48:00 +01:00
jeancf
e2841535f6 Extracted twit_account 2020-12-16 20:42:44 +01:00
jeancf
894c13d551 Download page from nitter.net 2020-12-16 19:43:17 +01:00
jeancf
9fc76b9981 Updated user agents 2020-12-16 18:47:27 +01:00
jeancf
372269c2be Merge remote-tracking branch 'gitlab/logging' 2020-12-16 18:40:00 +01:00
BuildTools
c4bf95c1a7 Commented out printing of extracted tweets 2020-12-13 21:04:33 +01:00
jeancf
010f5fdeec Merge remote-tracking branch 'gitlab/logging' into logging 2020-12-13 18:30:57 +01:00
jeancf
b7175067c0 Added timeout to execution of twitterdl.py 2020-12-13 18:25:27 +01:00