Commit Graph

183 Commits

Author SHA1 Message Date
vladfedoriuk
e3b1b1d96d Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2024-01-25 00:15:38 +00:00
vladfedoriuk
6d23cc9fe5 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2024-01-24 00:15:55 +00:00
vladfedoriuk
3dcbb4a1b4 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2024-01-23 00:28:35 +00:00
vladfedoriuk
d4ebecebf7 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2024-01-22 00:15:15 +00:00
vladfedoriuk
fbd5c862a2 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2024-01-21 00:15:41 +00:00
vladfedoriuk
18303671eb Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2024-01-20 00:15:16 +00:00
vladfedoriuk
86f396fe98 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2024-01-19 00:15:40 +00:00
vladfedoriuk
7cb425bd17 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2024-01-18 00:29:05 +00:00
vladfedoriuk
22766473e3 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2024-01-17 00:15:38 +00:00
vladfedoriuk
d377aa43c5 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2024-01-16 00:14:46 +00:00
vladfedoriuk
9c1af105cf Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2024-01-15 00:13:58 +00:00
vladfedoriuk
1ec2d0559f Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2024-01-14 00:13:32 +00:00
vladfedoriuk
06f07b75bd Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2024-01-12 00:13:39 +00:00
vladfedoriuk
b321cde63f Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2024-01-11 00:13:46 +00:00
vladfedoriuk
c4ab54f1c4 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2024-01-10 00:13:23 +00:00
vladfedoriuk
31ad60b63c Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2024-01-07 00:14:54 +00:00
vladfedoriuk
f8dbedc3aa Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2024-01-06 00:18:48 +00:00
vladfedoriuk
c7417ccf97 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2024-01-05 00:17:59 +00:00
vladfedoriuk
3a3ae6fd70 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2024-01-04 00:13:11 +00:00
vladfedoriuk
fb2aa35199 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2024-01-03 00:14:40 +00:00
vladfedoriuk
79823c1ea6 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2024-01-02 00:13:13 +00:00
vladfedoriuk
e19e619fc8 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2024-01-01 00:12:42 +00:00
vladfedoriuk
c27658b218 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-12-31 00:13:02 +00:00
vladfedoriuk
f0da561b3a Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-12-30 00:13:31 +00:00
vladfedoriuk
ef46c2caac Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-12-29 00:12:09 +00:00
vladfedoriuk
af6636e7b0 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-12-28 00:12:47 +00:00
vladfedoriuk
0599fe55f8 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-12-27 00:18:30 +00:00
vladfedoriuk
d2b43fdfc6 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-12-26 00:15:20 +00:00
vladfedoriuk
ef529fa4de Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-12-25 00:13:01 +00:00
vladfedoriuk
11a4bdebae Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-12-24 00:12:50 +00:00
vladfedoriuk
088de5ebb2 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-12-23 00:12:56 +00:00
vladfedoriuk
d99b351bdb Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-12-22 00:12:52 +00:00
vladfedoriuk
fc67ad7dad Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-12-21 00:12:54 +00:00
vladfedoriuk
0146d5cbe9 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-12-20 00:12:11 +00:00
vladfedoriuk
3bfb020708 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-12-19 00:13:47 +00:00
vladfedoriuk
9aca81e2f4 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-12-18 00:16:59 +00:00
vladfedoriuk
b5d3f086fb Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-12-17 00:16:29 +00:00
vladfedoriuk
b219dee832 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-12-16 00:21:54 +00:00
vladfedoriuk
12fa49f9c3 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-12-15 00:19:18 +00:00
vladfedoriuk
4147637d28 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-12-14 00:15:17 +00:00
vladfedoriuk
2c0fce82f5 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-12-13 00:13:33 +00:00
vladfedoriuk
ee9a84a392 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-12-12 00:14:49 +00:00
vladfedoriuk
f29df589aa Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-12-11 00:13:35 +00:00
vladfedoriuk
4d4ecfb6be Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-12-10 00:14:33 +00:00
vladfedoriuk
082fcadb0c Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-12-08 00:19:34 +00:00
vladfedoriuk
b848756e6c Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-12-07 00:13:48 +00:00
vladfedoriuk
43e05fd305 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-12-06 00:13:39 +00:00
vladfedoriuk
2a3c816451 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-12-05 00:14:59 +00:00
vladfedoriuk
2f1fc500da Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-12-04 00:13:42 +00:00
vladfedoriuk
5d5b4e8f1a Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-12-02 00:18:26 +00:00
vladfedoriuk
25f365cf5e Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-12-01 00:13:59 +00:00
vladfedoriuk
0f32c43730 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-30 00:13:42 +00:00
vladfedoriuk
adb4fa46d0 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-29 00:14:01 +00:00
vladfedoriuk
f2bd296da3 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-28 00:13:34 +00:00
vladfedoriuk
1c290e8e66 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-27 00:14:03 +00:00
vladfedoriuk
4ffaabf5f1 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-26 00:13:36 +00:00
vladfedoriuk
83891cbf72 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-25 00:12:39 +00:00
vladfedoriuk
ddf39ed05e Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-24 00:13:06 +00:00
vladfedoriuk
2d01c0c9ce Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-23 00:13:12 +00:00
vladfedoriuk
41e2e7fee1 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-22 00:17:48 +00:00
vladfedoriuk
d0ac2a6338 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-21 00:16:52 +00:00
vladfedoriuk
c2c42e5b13 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-19 22:33:35 +00:00
vladfedoriuk
a2ed5df38a Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-18 00:18:24 +00:00
vladfedoriuk
dec4271fd0 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-17 00:15:52 +00:00
vladfedoriuk
c28cfd13fa Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-16 00:12:46 +00:00
vladfedoriuk
b10f48bd1f Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-15 00:18:47 +00:00
vladfedoriuk
58bb511653 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-14 00:20:19 +00:00
vladfedoriuk
fe183a1783 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-13 00:20:35 +00:00
vladfedoriuk
9fdfde7c93 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-12 00:19:23 +00:00
vladfedoriuk
b90df462c3 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-11 00:17:03 +00:00
vladfedoriuk
c8dcbfcded Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-10 00:23:13 +00:00
vladfedoriuk
5cde169790 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-09 00:19:08 +00:00
vladfedoriuk
9d9dcaaba2 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-08 00:16:38 +00:00
vladfedoriuk
780becd58d Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-07 00:15:20 +00:00
vladfedoriuk
5d9ef83175 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-05 00:17:33 +00:00
vladfedoriuk
b1137f60e1 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-04 00:19:42 +00:00
vladfedoriuk
f8a2a4d384 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-03 00:16:42 +00:00
vladfedoriuk
a86e5cf052 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-02 00:16:57 +00:00
vladfedoriuk
4900721876 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-01 00:22:22 +00:00
vladfedoriuk
b5567d70c8 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-10-31 00:17:33 +00:00
vladfedoriuk
84201a6fdc Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-10-30 00:16:45 +00:00
vladfedoriuk
c8838d2ef9 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-10-28 19:54:22 +00:00
Vladyslav Fedoriuk
2fdd348a15
Web App (#25)
* Set up the web project dependencies

- Add linters, pre-commit, and GitHub Actions
- Add a Makefile
- Add a pyproject.toml

* Fix pyupgrade job

- Remove continue_on_error everywhere

* Remove old code

* Rename a GithubActions job

* Change README

* Adjust pre-commit and GitHub actions

* Add tables and set up alembic

* Set up tests

* Extend tests

* Add coverage config

* Adjust the GithubActions workflow

* Fix GithubActions workflow

* Try fixing pyproject-fmt config

* Fix formatting of pyproject.toml

* Fix formatting of pyproject.toml

* Add coverage report

* Test listing the repositories

* Add a working prototype of SourceGraph client

* Add parsing of the SourceGraph SSE data

* Fix tests

* Ged rid of packages replaced by ruff

* Fix waits in the SourceGraph client

* Refactor the models and add a mapper

- A new mapper allows to create database repositories from the SourceGraph data

* Add mypy

* Try fixing mypy action

* Remove redundant configs

* Exclude tests from type checking

* Fix mypy pre-commit and GitHub action

* Ignore factories

* Make upserting possible for source graph data

* Add logic for parsing the dependencies and populating the database

* Add a database and a cron GitHub Action job

* Try manually trigger a workflow

* Bring back the old config

* Add ReadTimeout for errors to retry for in SourceGraph client

* Add typer

* Adjust the docstrings

* Update the database

* Refactor and optimize scraping and dependencies parsing

* Make scraping run on push for now

* Add a unique constraint for the repo url and source graph repo id

* Change the index columns in on_conflict statement for repo creation

* Optimize dependencies parsing

- Do not parse dependencies for a repo  when revision did not change

* Scraped repositories from Source Graph

* Refactor scraping

* Set up frontend

* Scraped repositories from Source Graph

* Add TODOs

* Skip scraping when testing

* Fix a test with updating the repos

* Scraped repositories from Source Graph

* Add some more TODOs

* Scraped repositories from Source Graph

* Add some more TODO comments

* Add chadcn/ui

* Scraped repositories from Source Graph

* Create index.json

* Scraped repositories from Source Graph

* Add a draft of data table and display all the repos

* Scraped repositories from Source Graph

* Implement stars badges and description with overflow

* Format the links to Github repos

* Fix link clicking

* Scraped repositories from Source Graph

* Add simple pagination and stars column sorting

* Scraped repositories from Source Graph

* Implement basic searching

* Scraped repositories from Source Graph

* Implement a multiselect for dependencies

* Scraped repositories from Source Graph

* Implement actual filtering by dependencies

* Scraped repositories from Source Graph

* Add a workflow to deploy nextjs on github pages

* Try fixing the deployment job

* Enable static exports for app router

* Fix uploading arifacts for nextjs job

* Set base path to properly load JS and CSS

* Fix the base path

* Scraped repositories from Source Graph

* Add header

* Remove language version

* Scraped repositories from Source Graph

* Add some more TODOs

* Scraped repositories from Source Graph

* Adjust the pre-commit config

* Fix pipelines

* Scraped repositories from Source Graph

* Add a footer

* Create the indexes

* Scraped repositories from Source Graph

* Add more TODOs

* Introduce minor footer adjustments

* Adjust the scraping actions

* Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes

* Implement query params state

* Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes

* Do not commit query state on unmount

* Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes

* Hopefully fix query states and multiselect input

* Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes

* Extend the Makefile

* Resolve most of TODOs

* Resolve the conflicts with anyio version, bring back httpx

* Adjust the Makefile and README.md

* Fix a typo in README.md

* Adjust readme

* Fix the Makefile

* Fix some stuff

* Make some adjustments

* Possibly fix failing scraping jobs

* Load the repo project URL from env

---------

Co-authored-by: vladfedoriuk <vladfedoriuk@users.noreply.github.com>
Co-authored-by: Vladyslav Fedoriuk <vladyslav.fedoriuk@deployed.pl>
2023-10-28 21:39:02 +02:00