Web App (#25)
* Set up the web project dependencies
- Add linters, pre-commit, and GitHub Actions
- Add a Makefile
- Add a pyproject.toml
* Fix pyupgrade job
- Remove continue_on_error everywhere
* Remove old code
* Rename a GithubActions job
* Change README
* Adjust pre-commit and GitHub actions
* Add tables and set up alembic
* Set up tests
* Extend tests
* Add coverage config
* Adjust the GithubActions workflow
* Fix GithubActions workflow
* Try fixing pyproject-fmt config
* Fix formatting of pyproject.toml
* Fix formatting of pyproject.toml
* Add coverage report
* Test listing the repositories
* Add a working prototype of SourceGraph client
* Add parsing of the SourceGraph SSE data
* Fix tests
* Ged rid of packages replaced by ruff
* Fix waits in the SourceGraph client
* Refactor the models and add a mapper
- A new mapper allows to create database repositories from the SourceGraph data
* Add mypy
* Try fixing mypy action
* Remove redundant configs
* Exclude tests from type checking
* Fix mypy pre-commit and GitHub action
* Ignore factories
* Make upserting possible for source graph data
* Add logic for parsing the dependencies and populating the database
* Add a database and a cron GitHub Action job
* Try manually trigger a workflow
* Bring back the old config
* Add ReadTimeout for errors to retry for in SourceGraph client
* Add typer
* Adjust the docstrings
* Update the database
* Refactor and optimize scraping and dependencies parsing
* Make scraping run on push for now
* Add a unique constraint for the repo url and source graph repo id
* Change the index columns in on_conflict statement for repo creation
* Optimize dependencies parsing
- Do not parse dependencies for a repo when revision did not change
* Scraped repositories from Source Graph
* Refactor scraping
* Set up frontend
* Scraped repositories from Source Graph
* Add TODOs
* Skip scraping when testing
* Fix a test with updating the repos
* Scraped repositories from Source Graph
* Add some more TODOs
* Scraped repositories from Source Graph
* Add some more TODO comments
* Add chadcn/ui
* Scraped repositories from Source Graph
* Create index.json
* Scraped repositories from Source Graph
* Add a draft of data table and display all the repos
* Scraped repositories from Source Graph
* Implement stars badges and description with overflow
* Format the links to Github repos
* Fix link clicking
* Scraped repositories from Source Graph
* Add simple pagination and stars column sorting
* Scraped repositories from Source Graph
* Implement basic searching
* Scraped repositories from Source Graph
* Implement a multiselect for dependencies
* Scraped repositories from Source Graph
* Implement actual filtering by dependencies
* Scraped repositories from Source Graph
* Add a workflow to deploy nextjs on github pages
* Try fixing the deployment job
* Enable static exports for app router
* Fix uploading arifacts for nextjs job
* Set base path to properly load JS and CSS
* Fix the base path
* Scraped repositories from Source Graph
* Add header
* Remove language version
* Scraped repositories from Source Graph
* Add some more TODOs
* Scraped repositories from Source Graph
* Adjust the pre-commit config
* Fix pipelines
* Scraped repositories from Source Graph
* Add a footer
* Create the indexes
* Scraped repositories from Source Graph
* Add more TODOs
* Introduce minor footer adjustments
* Adjust the scraping actions
* Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes
* Implement query params state
* Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes
* Do not commit query state on unmount
* Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes
* Hopefully fix query states and multiselect input
* Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes
* Extend the Makefile
* Resolve most of TODOs
* Resolve the conflicts with anyio version, bring back httpx
* Adjust the Makefile and README.md
* Fix a typo in README.md
* Adjust readme
* Fix the Makefile
* Fix some stuff
* Make some adjustments
* Possibly fix failing scraping jobs
* Load the repo project URL from env
---------
Co-authored-by: vladfedoriuk <vladfedoriuk@users.noreply.github.com>
Co-authored-by: Vladyslav Fedoriuk <vladyslav.fedoriuk@deployed.pl>
2023-10-28 19:39:02 +00:00
|
|
|
# Sample workflow for building and deploying a Next.js site to GitHub Pages
|
|
|
|
#
|
|
|
|
# To get started with Next.js see: https://nextjs.org/docs/getting-started
|
|
|
|
#
|
|
|
|
name: Build and Deploy Next.js to GitHub Pages
|
|
|
|
|
|
|
|
on:
|
|
|
|
# https://docs.github.com/en/actions/using-workflows/events-that-trigger-workflows#workflow_run
|
|
|
|
workflow_run:
|
|
|
|
workflows:
|
|
|
|
- "Scraping the repositories from Source Graph"
|
|
|
|
- "Python App Quality and Testing"
|
2023-11-18 19:27:38 +00:00
|
|
|
branches: [master]
|
Web App (#25)
* Set up the web project dependencies
- Add linters, pre-commit, and GitHub Actions
- Add a Makefile
- Add a pyproject.toml
* Fix pyupgrade job
- Remove continue_on_error everywhere
* Remove old code
* Rename a GithubActions job
* Change README
* Adjust pre-commit and GitHub actions
* Add tables and set up alembic
* Set up tests
* Extend tests
* Add coverage config
* Adjust the GithubActions workflow
* Fix GithubActions workflow
* Try fixing pyproject-fmt config
* Fix formatting of pyproject.toml
* Fix formatting of pyproject.toml
* Add coverage report
* Test listing the repositories
* Add a working prototype of SourceGraph client
* Add parsing of the SourceGraph SSE data
* Fix tests
* Ged rid of packages replaced by ruff
* Fix waits in the SourceGraph client
* Refactor the models and add a mapper
- A new mapper allows to create database repositories from the SourceGraph data
* Add mypy
* Try fixing mypy action
* Remove redundant configs
* Exclude tests from type checking
* Fix mypy pre-commit and GitHub action
* Ignore factories
* Make upserting possible for source graph data
* Add logic for parsing the dependencies and populating the database
* Add a database and a cron GitHub Action job
* Try manually trigger a workflow
* Bring back the old config
* Add ReadTimeout for errors to retry for in SourceGraph client
* Add typer
* Adjust the docstrings
* Update the database
* Refactor and optimize scraping and dependencies parsing
* Make scraping run on push for now
* Add a unique constraint for the repo url and source graph repo id
* Change the index columns in on_conflict statement for repo creation
* Optimize dependencies parsing
- Do not parse dependencies for a repo when revision did not change
* Scraped repositories from Source Graph
* Refactor scraping
* Set up frontend
* Scraped repositories from Source Graph
* Add TODOs
* Skip scraping when testing
* Fix a test with updating the repos
* Scraped repositories from Source Graph
* Add some more TODOs
* Scraped repositories from Source Graph
* Add some more TODO comments
* Add chadcn/ui
* Scraped repositories from Source Graph
* Create index.json
* Scraped repositories from Source Graph
* Add a draft of data table and display all the repos
* Scraped repositories from Source Graph
* Implement stars badges and description with overflow
* Format the links to Github repos
* Fix link clicking
* Scraped repositories from Source Graph
* Add simple pagination and stars column sorting
* Scraped repositories from Source Graph
* Implement basic searching
* Scraped repositories from Source Graph
* Implement a multiselect for dependencies
* Scraped repositories from Source Graph
* Implement actual filtering by dependencies
* Scraped repositories from Source Graph
* Add a workflow to deploy nextjs on github pages
* Try fixing the deployment job
* Enable static exports for app router
* Fix uploading arifacts for nextjs job
* Set base path to properly load JS and CSS
* Fix the base path
* Scraped repositories from Source Graph
* Add header
* Remove language version
* Scraped repositories from Source Graph
* Add some more TODOs
* Scraped repositories from Source Graph
* Adjust the pre-commit config
* Fix pipelines
* Scraped repositories from Source Graph
* Add a footer
* Create the indexes
* Scraped repositories from Source Graph
* Add more TODOs
* Introduce minor footer adjustments
* Adjust the scraping actions
* Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes
* Implement query params state
* Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes
* Do not commit query state on unmount
* Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes
* Hopefully fix query states and multiselect input
* Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes
* Extend the Makefile
* Resolve most of TODOs
* Resolve the conflicts with anyio version, bring back httpx
* Adjust the Makefile and README.md
* Fix a typo in README.md
* Adjust readme
* Fix the Makefile
* Fix some stuff
* Make some adjustments
* Possibly fix failing scraping jobs
* Load the repo project URL from env
---------
Co-authored-by: vladfedoriuk <vladfedoriuk@users.noreply.github.com>
Co-authored-by: Vladyslav Fedoriuk <vladyslav.fedoriuk@deployed.pl>
2023-10-28 19:39:02 +00:00
|
|
|
types:
|
|
|
|
- completed
|
|
|
|
# Allows you to run this workflow manually from the Actions tab
|
|
|
|
# https://docs.github.com/en/actions/using-workflows/manually-running-a-workflow
|
|
|
|
# https://docs.github.com/en/actions/using-workflows/events-that-trigger-workflows#workflow_dispatch
|
|
|
|
workflow_dispatch:
|
2023-11-18 19:27:38 +00:00
|
|
|
# Allows to run this workflow on push events to the master branch
|
|
|
|
# https://docs.github.com/en/actions/using-workflows/triggering-a-workflow#using-activity-types-and-filters-with-multiple-events
|
|
|
|
push:
|
|
|
|
branches: [master]
|
|
|
|
page_build:
|
Web App (#25)
* Set up the web project dependencies
- Add linters, pre-commit, and GitHub Actions
- Add a Makefile
- Add a pyproject.toml
* Fix pyupgrade job
- Remove continue_on_error everywhere
* Remove old code
* Rename a GithubActions job
* Change README
* Adjust pre-commit and GitHub actions
* Add tables and set up alembic
* Set up tests
* Extend tests
* Add coverage config
* Adjust the GithubActions workflow
* Fix GithubActions workflow
* Try fixing pyproject-fmt config
* Fix formatting of pyproject.toml
* Fix formatting of pyproject.toml
* Add coverage report
* Test listing the repositories
* Add a working prototype of SourceGraph client
* Add parsing of the SourceGraph SSE data
* Fix tests
* Ged rid of packages replaced by ruff
* Fix waits in the SourceGraph client
* Refactor the models and add a mapper
- A new mapper allows to create database repositories from the SourceGraph data
* Add mypy
* Try fixing mypy action
* Remove redundant configs
* Exclude tests from type checking
* Fix mypy pre-commit and GitHub action
* Ignore factories
* Make upserting possible for source graph data
* Add logic for parsing the dependencies and populating the database
* Add a database and a cron GitHub Action job
* Try manually trigger a workflow
* Bring back the old config
* Add ReadTimeout for errors to retry for in SourceGraph client
* Add typer
* Adjust the docstrings
* Update the database
* Refactor and optimize scraping and dependencies parsing
* Make scraping run on push for now
* Add a unique constraint for the repo url and source graph repo id
* Change the index columns in on_conflict statement for repo creation
* Optimize dependencies parsing
- Do not parse dependencies for a repo when revision did not change
* Scraped repositories from Source Graph
* Refactor scraping
* Set up frontend
* Scraped repositories from Source Graph
* Add TODOs
* Skip scraping when testing
* Fix a test with updating the repos
* Scraped repositories from Source Graph
* Add some more TODOs
* Scraped repositories from Source Graph
* Add some more TODO comments
* Add chadcn/ui
* Scraped repositories from Source Graph
* Create index.json
* Scraped repositories from Source Graph
* Add a draft of data table and display all the repos
* Scraped repositories from Source Graph
* Implement stars badges and description with overflow
* Format the links to Github repos
* Fix link clicking
* Scraped repositories from Source Graph
* Add simple pagination and stars column sorting
* Scraped repositories from Source Graph
* Implement basic searching
* Scraped repositories from Source Graph
* Implement a multiselect for dependencies
* Scraped repositories from Source Graph
* Implement actual filtering by dependencies
* Scraped repositories from Source Graph
* Add a workflow to deploy nextjs on github pages
* Try fixing the deployment job
* Enable static exports for app router
* Fix uploading arifacts for nextjs job
* Set base path to properly load JS and CSS
* Fix the base path
* Scraped repositories from Source Graph
* Add header
* Remove language version
* Scraped repositories from Source Graph
* Add some more TODOs
* Scraped repositories from Source Graph
* Adjust the pre-commit config
* Fix pipelines
* Scraped repositories from Source Graph
* Add a footer
* Create the indexes
* Scraped repositories from Source Graph
* Add more TODOs
* Introduce minor footer adjustments
* Adjust the scraping actions
* Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes
* Implement query params state
* Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes
* Do not commit query state on unmount
* Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes
* Hopefully fix query states and multiselect input
* Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes
* Extend the Makefile
* Resolve most of TODOs
* Resolve the conflicts with anyio version, bring back httpx
* Adjust the Makefile and README.md
* Fix a typo in README.md
* Adjust readme
* Fix the Makefile
* Fix some stuff
* Make some adjustments
* Possibly fix failing scraping jobs
* Load the repo project URL from env
---------
Co-authored-by: vladfedoriuk <vladfedoriuk@users.noreply.github.com>
Co-authored-by: Vladyslav Fedoriuk <vladyslav.fedoriuk@deployed.pl>
2023-10-28 19:39:02 +00:00
|
|
|
|
|
|
|
# Sets permissions of the GITHUB_TOKEN to allow deployment to GitHub Pages
|
|
|
|
permissions:
|
|
|
|
contents: read
|
|
|
|
pages: write
|
|
|
|
id-token: write
|
|
|
|
|
|
|
|
# Allow only one concurrent deployment, skipping runs queued between the run in-progress and latest queued.
|
|
|
|
# However, do NOT cancel in-progress runs as we want to allow these production deployments to complete.
|
|
|
|
concurrency:
|
|
|
|
group: "pages"
|
|
|
|
cancel-in-progress: false
|
|
|
|
|
|
|
|
jobs:
|
|
|
|
# Build job
|
|
|
|
build:
|
|
|
|
runs-on: ubuntu-latest
|
|
|
|
# Use ``frontend`` as the working directory
|
|
|
|
# https://docs.github.com/en/actions/using-workflows/workflow-syntax-for-github-actions#jobsjob_iddefaultsrun
|
|
|
|
defaults:
|
|
|
|
run:
|
|
|
|
working-directory: ./frontend
|
|
|
|
strategy:
|
|
|
|
matrix:
|
|
|
|
node-version: [18.17.1]
|
|
|
|
steps:
|
|
|
|
- name: Checkout
|
|
|
|
uses: actions/checkout@v3
|
|
|
|
- name: Set up pnpm
|
|
|
|
uses: pnpm/action-setup@v2
|
|
|
|
with:
|
|
|
|
version: 8
|
|
|
|
- name: Setup Node.js
|
|
|
|
uses: actions/setup-node@v3
|
|
|
|
with:
|
|
|
|
node-version: ${{ matrix.node-version }}
|
|
|
|
cache: "pnpm"
|
|
|
|
cache-dependency-path: "./frontend/pnpm-lock.yaml"
|
|
|
|
- name: Install dependencies
|
|
|
|
run: pnpm install
|
|
|
|
- name: Setup Pages
|
|
|
|
uses: actions/configure-pages@v3
|
|
|
|
with:
|
|
|
|
# Automatically inject basePath in your Next.js configuration file and disable
|
|
|
|
# server side image optimization (https://nextjs.org/docs/api-reference/next/image#unoptimized).
|
|
|
|
#
|
|
|
|
# You may remove this line if you want to manage the configuration yourself.
|
|
|
|
static_site_generator: next
|
|
|
|
- name: Build with Next.js
|
|
|
|
run: pnpm next build
|
|
|
|
- name: Static HTML export with Next.js
|
|
|
|
run: pnpm next export
|
|
|
|
- name: Upload artifact
|
|
|
|
if: ${{ !env.ACT }} # skip during local actions testing
|
|
|
|
uses: actions/upload-pages-artifact@v2
|
|
|
|
with:
|
|
|
|
path: ./frontend/out
|
|
|
|
|
|
|
|
# Lint job
|
|
|
|
lint:
|
|
|
|
runs-on: ubuntu-latest
|
|
|
|
# Use ``frontend`` as the working directory
|
|
|
|
# https://docs.github.com/en/actions/using-workflows/workflow-syntax-for-github-actions#jobsjob_iddefaultsrun
|
|
|
|
defaults:
|
|
|
|
run:
|
|
|
|
working-directory: ./frontend
|
|
|
|
strategy:
|
|
|
|
matrix:
|
|
|
|
node-version: [18.17.1]
|
|
|
|
steps:
|
|
|
|
- name: Checkout
|
|
|
|
uses: actions/checkout@v3
|
|
|
|
- name: Set up pnpm
|
|
|
|
uses: pnpm/action-setup@v2
|
|
|
|
with:
|
|
|
|
version: 8
|
|
|
|
- name: Setup Node.js
|
|
|
|
uses: actions/setup-node@v3
|
|
|
|
with:
|
|
|
|
node-version: ${{ matrix.node-version }}
|
|
|
|
cache: "pnpm"
|
|
|
|
cache-dependency-path: "./frontend/pnpm-lock.yaml"
|
|
|
|
- name: Install dependencies
|
|
|
|
run: pnpm install
|
|
|
|
- name: Lint with ESLint
|
|
|
|
run: pnpm lint
|
|
|
|
- name: Lint with Prettier
|
|
|
|
run: pnpm prettier:lint
|
|
|
|
|
|
|
|
# Deployment job
|
|
|
|
deploy:
|
|
|
|
if: ${{ !github.event.act }} # skip during local actions testing
|
|
|
|
environment:
|
|
|
|
name: github-pages
|
|
|
|
url: ${{ steps.deployment.outputs.page_url }}
|
|
|
|
runs-on: ubuntu-latest
|
|
|
|
needs: build
|
|
|
|
steps:
|
|
|
|
- name: Deploy to GitHub Pages
|
|
|
|
id: deployment
|
|
|
|
uses: actions/deploy-pages@v2
|