32 Commits

Author SHA1 Message Date
Vladyslav Fedoriuk
2ef96977a0 Implement a multiselect for dependencies 2023-09-19 19:51:01 +02:00
Vladyslav Fedoriuk
9d286f5c01 Implement basic searching 2023-09-17 14:23:04 +02:00
Vladyslav Fedoriuk
7bc2e6bb05 Add a draft of data table and display all the repos 2023-08-29 22:18:41 +02:00
Vladyslav Fedoriuk
f608ff0500 Create index.json 2023-08-28 21:29:03 +02:00
Vladyslav Fedoriuk
70a8895c22 Add some more TODO comments 2023-08-28 20:00:47 +02:00
Vladyslav Fedoriuk
ffec5edd43 Add some more TODOs 2023-08-28 11:35:09 +02:00
Vladyslav Fedoriuk
421d303464 Fix a test with updating the repos 2023-08-24 13:36:05 +02:00
Vladyslav Fedoriuk
a8fc5fcdc1 Refactor scraping 2023-08-16 23:29:38 +02:00
Vladyslav Fedoriuk
5f7aabc6e7 Optimize dependencies parsing
- Do not parse dependencies for a repo  when revision did not change
2023-08-16 23:07:17 +02:00
Vladyslav Fedoriuk
aa3ee07a90 Change the index columns in on_conflict statement for repo creation 2023-08-15 14:44:08 +02:00
Vladyslav Fedoriuk
102de55b12 Add a unique constraint for the repo url and source graph repo id 2023-08-15 14:30:44 +02:00
Vladyslav Fedoriuk
03e77f4092 Refactor and optimize scraping and dependencies parsing 2023-08-15 13:17:14 +02:00
Vladyslav Fedoriuk
44c0a8a409 Adjust the docstrings 2023-08-15 13:17:14 +02:00
Vladyslav Fedoriuk
09a5ef63f7 Add typer 2023-08-15 13:17:14 +02:00
Vladyslav Fedoriuk
1ec3c0d57f Add ReadTimeout for errors to retry for in SourceGraph client 2023-08-15 13:17:14 +02:00
Vladyslav Fedoriuk
e9f5426cd1 Add logic for parsing the dependencies and populating the database 2023-08-15 13:17:14 +02:00
Vladyslav Fedoriuk
874ba24db2 Make upserting possible for source graph data 2023-08-15 13:17:14 +02:00
Vladyslav Fedoriuk
c559765942 Fix mypy pre-commit and GitHub action 2023-08-15 13:17:14 +02:00
Vladyslav Fedoriuk
e634895392 Add mypy 2023-08-15 13:17:14 +02:00
Vladyslav Fedoriuk
6484b85956 Refactor the models and add a mapper
- A new mapper allows to create database repositories from the SourceGraph data
2023-08-15 13:17:14 +02:00
Vladyslav Fedoriuk
9d0e6e606d Fix waits in the SourceGraph client 2023-08-15 13:17:14 +02:00
Vladyslav Fedoriuk
193282b836 Ged rid of packages replaced by ruff 2023-08-15 13:17:14 +02:00
Vladyslav Fedoriuk
376d7200f6 Fix tests 2023-08-15 13:17:14 +02:00
Vladyslav Fedoriuk
9fa3b8e43b Add parsing of the SourceGraph SSE data 2023-08-15 13:17:14 +02:00
Vladyslav Fedoriuk
dae524ab0c Add a working prototype of SourceGraph client 2023-08-15 13:17:14 +02:00
Vladyslav Fedoriuk
61967ab207 Test listing the repositories 2023-08-15 13:17:14 +02:00
Vladyslav Fedoriuk
4cc03600c3 Add coverage report 2023-08-15 13:17:07 +02:00
Vladyslav Fedoriuk
b25f428467 Add coverage config 2023-07-29 12:23:26 +02:00
Vladyslav Fedoriuk
4c4dabb96c Extend tests 2023-07-29 11:50:31 +02:00
Vladyslav Fedoriuk
a0310ea3b1 Set up tests 2023-07-29 00:17:38 +02:00
Vladyslav Fedoriuk
e4e0ab47f7 Add tables and set up alembic 2023-07-28 22:56:43 +02:00
Vladyslav Fedoriuk
98e8a079e6 Remove old code 2023-07-27 09:29:43 +02:00