Commit Graph

37 Commits

Author SHA1 Message Date
Vladyslav Fedoriuk
d4c00793b8
Fix repos scraping and parsing (#28) 2023-11-19 23:17:57 +01:00
Vladyslav Fedoriuk
0610553651
Fix GitHub Actions Worklows and refactor tests (#27)
* Refactor conftest

* Fix docstrings
2023-11-18 20:27:38 +01:00
vladfedoriuk
a2ed5df38a Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-18 00:18:24 +00:00
vladfedoriuk
dec4271fd0 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-17 00:15:52 +00:00
vladfedoriuk
c28cfd13fa Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-16 00:12:46 +00:00
vladfedoriuk
b10f48bd1f Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-15 00:18:47 +00:00
vladfedoriuk
58bb511653 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-14 00:20:19 +00:00
vladfedoriuk
fe183a1783 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-13 00:20:35 +00:00
vladfedoriuk
9fdfde7c93 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-12 00:19:23 +00:00
vladfedoriuk
b90df462c3 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-11 00:17:03 +00:00
vladfedoriuk
c8dcbfcded Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-10 00:23:13 +00:00
vladfedoriuk
5cde169790 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-09 00:19:08 +00:00
vladfedoriuk
9d9dcaaba2 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-08 00:16:38 +00:00
vladfedoriuk
780becd58d Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-07 00:15:20 +00:00
vladfedoriuk
01fc66a519 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-06 00:17:09 +00:00
vladfedoriuk
5d9ef83175 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-05 00:17:33 +00:00
vladfedoriuk
b1137f60e1 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-04 00:19:42 +00:00
vladfedoriuk
f8a2a4d384 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-03 00:16:42 +00:00
vladfedoriuk
a86e5cf052 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-02 00:16:57 +00:00
vladfedoriuk
4900721876 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-11-01 00:22:22 +00:00
vladfedoriuk
b5567d70c8 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-10-31 00:17:33 +00:00
vladfedoriuk
84201a6fdc Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-10-30 00:16:45 +00:00
vladfedoriuk
e50a3443b4 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-10-29 00:16:09 +00:00
vladfedoriuk
c8838d2ef9 Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes 2023-10-28 19:54:22 +00:00
Vladyslav Fedoriuk
2fdd348a15
Web App (#25)
* Set up the web project dependencies

- Add linters, pre-commit, and GitHub Actions
- Add a Makefile
- Add a pyproject.toml

* Fix pyupgrade job

- Remove continue_on_error everywhere

* Remove old code

* Rename a GithubActions job

* Change README

* Adjust pre-commit and GitHub actions

* Add tables and set up alembic

* Set up tests

* Extend tests

* Add coverage config

* Adjust the GithubActions workflow

* Fix GithubActions workflow

* Try fixing pyproject-fmt config

* Fix formatting of pyproject.toml

* Fix formatting of pyproject.toml

* Add coverage report

* Test listing the repositories

* Add a working prototype of SourceGraph client

* Add parsing of the SourceGraph SSE data

* Fix tests

* Ged rid of packages replaced by ruff

* Fix waits in the SourceGraph client

* Refactor the models and add a mapper

- A new mapper allows to create database repositories from the SourceGraph data

* Add mypy

* Try fixing mypy action

* Remove redundant configs

* Exclude tests from type checking

* Fix mypy pre-commit and GitHub action

* Ignore factories

* Make upserting possible for source graph data

* Add logic for parsing the dependencies and populating the database

* Add a database and a cron GitHub Action job

* Try manually trigger a workflow

* Bring back the old config

* Add ReadTimeout for errors to retry for in SourceGraph client

* Add typer

* Adjust the docstrings

* Update the database

* Refactor and optimize scraping and dependencies parsing

* Make scraping run on push for now

* Add a unique constraint for the repo url and source graph repo id

* Change the index columns in on_conflict statement for repo creation

* Optimize dependencies parsing

- Do not parse dependencies for a repo  when revision did not change

* Scraped repositories from Source Graph

* Refactor scraping

* Set up frontend

* Scraped repositories from Source Graph

* Add TODOs

* Skip scraping when testing

* Fix a test with updating the repos

* Scraped repositories from Source Graph

* Add some more TODOs

* Scraped repositories from Source Graph

* Add some more TODO comments

* Add chadcn/ui

* Scraped repositories from Source Graph

* Create index.json

* Scraped repositories from Source Graph

* Add a draft of data table and display all the repos

* Scraped repositories from Source Graph

* Implement stars badges and description with overflow

* Format the links to Github repos

* Fix link clicking

* Scraped repositories from Source Graph

* Add simple pagination and stars column sorting

* Scraped repositories from Source Graph

* Implement basic searching

* Scraped repositories from Source Graph

* Implement a multiselect for dependencies

* Scraped repositories from Source Graph

* Implement actual filtering by dependencies

* Scraped repositories from Source Graph

* Add a workflow to deploy nextjs on github pages

* Try fixing the deployment job

* Enable static exports for app router

* Fix uploading arifacts for nextjs job

* Set base path to properly load JS and CSS

* Fix the base path

* Scraped repositories from Source Graph

* Add header

* Remove language version

* Scraped repositories from Source Graph

* Add some more TODOs

* Scraped repositories from Source Graph

* Adjust the pre-commit config

* Fix pipelines

* Scraped repositories from Source Graph

* Add a footer

* Create the indexes

* Scraped repositories from Source Graph

* Add more TODOs

* Introduce minor footer adjustments

* Adjust the scraping actions

* Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes

* Implement query params state

* Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes

* Do not commit query state on unmount

* Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes

* Hopefully fix query states and multiselect input

* Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes

* Extend the Makefile

* Resolve most of TODOs

* Resolve the conflicts with anyio version, bring back httpx

* Adjust the Makefile and README.md

* Fix a typo in README.md

* Adjust readme

* Fix the Makefile

* Fix some stuff

* Make some adjustments

* Possibly fix failing scraping jobs

* Load the repo project URL from env

---------

Co-authored-by: vladfedoriuk <vladfedoriuk@users.noreply.github.com>
Co-authored-by: Vladyslav Fedoriuk <vladyslav.fedoriuk@deployed.pl>
2023-10-28 21:39:02 +02:00
Marcelo Trylesinski
02fb674332
Update README.md 2022-10-11 16:56:56 +02:00
Marcelo Trylesinski
dbcab03897
🙈 Ignore VSCode files (#4) 2021-01-25 02:09:48 +01:00
Marcelo Trylesinski
08395001fb
Merge pull request #3 from sondrelg/patch-1
Add Netflix's Dispatch project
2020-12-29 19:03:48 -03:00
Sondre Lillebø Gundersen
6e8cd27f73
Add Netflix's Dispatch project 2020-12-29 22:57:08 +01:00
Marcelo Trylesinski
233b94976a feat: fix details about the project 2020-07-10 02:06:47 +02:00
Marcelo Trylesinski
0a8f209815 feat: add table to main readme 2020-07-10 01:55:33 +02:00
Marcelo Trylesinski
df20c48eb1 feat: format table 2020-07-10 01:47:51 +02:00
Marcelo Trylesinski
c2d44ac780 feat: add links to table 2020-07-10 01:41:21 +02:00
Marcelo Trylesinski
c0df8d6f92 feat: limit number of dependencies on table 2020-07-10 01:15:08 +02:00
Marcelo Trylesinski
b4343c261c feat: add dependency markdown table 2020-07-10 00:43:36 +02:00
Marcelo Trylesinski
795e9fe782 feat: add full scripts setup 2020-07-10 00:20:38 +02:00
Marcelo Trylesinski
2a70435cc9 Add readme 2020-06-01 22:04:19 +02:00