55 Commits

Author SHA1 Message Date
Vladyslav Fedoriuk
5f7aabc6e7 Optimize dependencies parsing
- Do not parse dependencies for a repo  when revision did not change
2023-08-16 23:07:17 +02:00
Vladyslav Fedoriuk
aa3ee07a90 Change the index columns in on_conflict statement for repo creation 2023-08-15 14:44:08 +02:00
Vladyslav Fedoriuk
102de55b12 Add a unique constraint for the repo url and source graph repo id 2023-08-15 14:30:44 +02:00
Vladyslav Fedoriuk
cca18fbd33 Make scraping run on push for now 2023-08-15 13:31:16 +02:00
Vladyslav Fedoriuk
03e77f4092 Refactor and optimize scraping and dependencies parsing 2023-08-15 13:17:14 +02:00
Vladyslav Fedoriuk
cd71346b17 Update the database 2023-08-15 13:17:14 +02:00
Vladyslav Fedoriuk
44c0a8a409 Adjust the docstrings 2023-08-15 13:17:14 +02:00
Vladyslav Fedoriuk
09a5ef63f7 Add typer 2023-08-15 13:17:14 +02:00
Vladyslav Fedoriuk
1ec3c0d57f Add ReadTimeout for errors to retry for in SourceGraph client 2023-08-15 13:17:14 +02:00
Vladyslav Fedoriuk
ffc62be92a Bring back the old config 2023-08-15 13:17:14 +02:00
Vladyslav Fedoriuk
0fb8956a17 Try manually trigger a workflow 2023-08-15 13:17:14 +02:00
Vladyslav Fedoriuk
95b3c397e0 Add a database and a cron GitHub Action job 2023-08-15 13:17:14 +02:00
Vladyslav Fedoriuk
e9f5426cd1 Add logic for parsing the dependencies and populating the database 2023-08-15 13:17:14 +02:00
Vladyslav Fedoriuk
874ba24db2 Make upserting possible for source graph data 2023-08-15 13:17:14 +02:00
Vladyslav Fedoriuk
1c05515551 Ignore factories 2023-08-15 13:17:14 +02:00
Vladyslav Fedoriuk
c559765942 Fix mypy pre-commit and GitHub action 2023-08-15 13:17:14 +02:00
Vladyslav Fedoriuk
d1f93f81ee Exclude tests from type checking 2023-08-15 13:17:14 +02:00
Vladyslav Fedoriuk
bfeca74e6b Remove redundant configs 2023-08-15 13:17:14 +02:00
Vladyslav Fedoriuk
11f142feb5 Try fixing mypy action 2023-08-15 13:17:14 +02:00
Vladyslav Fedoriuk
e634895392 Add mypy 2023-08-15 13:17:14 +02:00
Vladyslav Fedoriuk
6484b85956 Refactor the models and add a mapper
- A new mapper allows to create database repositories from the SourceGraph data
2023-08-15 13:17:14 +02:00
Vladyslav Fedoriuk
9d0e6e606d Fix waits in the SourceGraph client 2023-08-15 13:17:14 +02:00
Vladyslav Fedoriuk
193282b836 Ged rid of packages replaced by ruff 2023-08-15 13:17:14 +02:00
Vladyslav Fedoriuk
376d7200f6 Fix tests 2023-08-15 13:17:14 +02:00
Vladyslav Fedoriuk
9fa3b8e43b Add parsing of the SourceGraph SSE data 2023-08-15 13:17:14 +02:00
Vladyslav Fedoriuk
dae524ab0c Add a working prototype of SourceGraph client 2023-08-15 13:17:14 +02:00
Vladyslav Fedoriuk
61967ab207 Test listing the repositories 2023-08-15 13:17:14 +02:00
Vladyslav Fedoriuk
4cc03600c3 Add coverage report 2023-08-15 13:17:07 +02:00
Vladyslav Fedoriuk
058673ce8b Fix formatting of pyproject.toml 2023-07-29 12:41:04 +02:00
Vladyslav Fedoriuk
d240844f8e Fix formatting of pyproject.toml 2023-07-29 12:38:56 +02:00
Vladyslav Fedoriuk
d66e31aef6 Try fixing pyproject-fmt config 2023-07-29 12:38:00 +02:00
Vladyslav Fedoriuk
aebd17d299 Fix GithubActions workflow 2023-07-29 12:33:29 +02:00
Vladyslav Fedoriuk
f33f0d49a1 Adjust the GithubActions workflow 2023-07-29 12:28:50 +02:00
Vladyslav Fedoriuk
b25f428467 Add coverage config 2023-07-29 12:23:26 +02:00
Vladyslav Fedoriuk
4c4dabb96c Extend tests 2023-07-29 11:50:31 +02:00
Vladyslav Fedoriuk
a0310ea3b1 Set up tests 2023-07-29 00:17:38 +02:00
Vladyslav Fedoriuk
e4e0ab47f7 Add tables and set up alembic 2023-07-28 22:56:43 +02:00
Vladyslav Fedoriuk
f1daafe96c Adjust pre-commit and GitHub actions 2023-07-28 21:52:07 +02:00
Vladyslav Fedoriuk
988a9236ae Change README 2023-07-27 09:34:54 +02:00
Vladyslav Fedoriuk
d74c845971 Rename a GithubActions job 2023-07-27 09:32:06 +02:00
Vladyslav Fedoriuk
98e8a079e6 Remove old code 2023-07-27 09:29:43 +02:00
Vladyslav Fedoriuk
d00cd3845c Fix pyupgrade job
- Remove continue_on_error everywhere
2023-07-27 08:41:43 +02:00
Vladyslav Fedoriuk
4e446f6c9d Set up the web project dependencies
- Add linters, pre-commit, and GitHub Actions
- Add a Makefile
- Add a pyproject.toml
2023-07-26 21:54:18 +02:00
Marcelo Trylesinski
02fb674332
Update README.md 2022-10-11 16:56:56 +02:00
Marcelo Trylesinski
dbcab03897
🙈 Ignore VSCode files (#4) 2021-01-25 02:09:48 +01:00
Marcelo Trylesinski
08395001fb
Merge pull request #3 from sondrelg/patch-1
Add Netflix's Dispatch project
2020-12-29 19:03:48 -03:00
Sondre Lillebø Gundersen
6e8cd27f73
Add Netflix's Dispatch project 2020-12-29 22:57:08 +01:00
Marcelo Trylesinski
233b94976a feat: fix details about the project 2020-07-10 02:06:47 +02:00
Marcelo Trylesinski
0a8f209815 feat: add table to main readme 2020-07-10 01:55:33 +02:00
Marcelo Trylesinski
df20c48eb1 feat: format table 2020-07-10 01:47:51 +02:00