awesome-fastapi-projects/Makefile
Vladyslav Fedoriuk 2fdd348a15
Web App (#25)
* Set up the web project dependencies

- Add linters, pre-commit, and GitHub Actions
- Add a Makefile
- Add a pyproject.toml

* Fix pyupgrade job

- Remove continue_on_error everywhere

* Remove old code

* Rename a GithubActions job

* Change README

* Adjust pre-commit and GitHub actions

* Add tables and set up alembic

* Set up tests

* Extend tests

* Add coverage config

* Adjust the GithubActions workflow

* Fix GithubActions workflow

* Try fixing pyproject-fmt config

* Fix formatting of pyproject.toml

* Fix formatting of pyproject.toml

* Add coverage report

* Test listing the repositories

* Add a working prototype of SourceGraph client

* Add parsing of the SourceGraph SSE data

* Fix tests

* Ged rid of packages replaced by ruff

* Fix waits in the SourceGraph client

* Refactor the models and add a mapper

- A new mapper allows to create database repositories from the SourceGraph data

* Add mypy

* Try fixing mypy action

* Remove redundant configs

* Exclude tests from type checking

* Fix mypy pre-commit and GitHub action

* Ignore factories

* Make upserting possible for source graph data

* Add logic for parsing the dependencies and populating the database

* Add a database and a cron GitHub Action job

* Try manually trigger a workflow

* Bring back the old config

* Add ReadTimeout for errors to retry for in SourceGraph client

* Add typer

* Adjust the docstrings

* Update the database

* Refactor and optimize scraping and dependencies parsing

* Make scraping run on push for now

* Add a unique constraint for the repo url and source graph repo id

* Change the index columns in on_conflict statement for repo creation

* Optimize dependencies parsing

- Do not parse dependencies for a repo  when revision did not change

* Scraped repositories from Source Graph

* Refactor scraping

* Set up frontend

* Scraped repositories from Source Graph

* Add TODOs

* Skip scraping when testing

* Fix a test with updating the repos

* Scraped repositories from Source Graph

* Add some more TODOs

* Scraped repositories from Source Graph

* Add some more TODO comments

* Add chadcn/ui

* Scraped repositories from Source Graph

* Create index.json

* Scraped repositories from Source Graph

* Add a draft of data table and display all the repos

* Scraped repositories from Source Graph

* Implement stars badges and description with overflow

* Format the links to Github repos

* Fix link clicking

* Scraped repositories from Source Graph

* Add simple pagination and stars column sorting

* Scraped repositories from Source Graph

* Implement basic searching

* Scraped repositories from Source Graph

* Implement a multiselect for dependencies

* Scraped repositories from Source Graph

* Implement actual filtering by dependencies

* Scraped repositories from Source Graph

* Add a workflow to deploy nextjs on github pages

* Try fixing the deployment job

* Enable static exports for app router

* Fix uploading arifacts for nextjs job

* Set base path to properly load JS and CSS

* Fix the base path

* Scraped repositories from Source Graph

* Add header

* Remove language version

* Scraped repositories from Source Graph

* Add some more TODOs

* Scraped repositories from Source Graph

* Adjust the pre-commit config

* Fix pipelines

* Scraped repositories from Source Graph

* Add a footer

* Create the indexes

* Scraped repositories from Source Graph

* Add more TODOs

* Introduce minor footer adjustments

* Adjust the scraping actions

* Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes

* Implement query params state

* Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes

* Do not commit query state on unmount

* Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes

* Hopefully fix query states and multiselect input

* Scraped repositories from Source Graph, parsed the dependencies, and generated the indexes

* Extend the Makefile

* Resolve most of TODOs

* Resolve the conflicts with anyio version, bring back httpx

* Adjust the Makefile and README.md

* Fix a typo in README.md

* Adjust readme

* Fix the Makefile

* Fix some stuff

* Make some adjustments

* Possibly fix failing scraping jobs

* Load the repo project URL from env

---------

Co-authored-by: vladfedoriuk <vladfedoriuk@users.noreply.github.com>
Co-authored-by: Vladyslav Fedoriuk <vladyslav.fedoriuk@deployed.pl>
2023-10-28 21:39:02 +02:00

140 lines
4.2 KiB
Makefile

# we want bash behaviour in all shell invocations
SHELL := bash
# Run each target in a separate shell
.ONESHELL:
# Fail on error inside any functions or subshells
.SHELLFLAGS := -eu -o pipefail -c
# Remove partially created files on error
.DELETE_ON_ERROR:
# Warn when an undefined variable is referenced
MAKEFLAGS += --warn-undefined-variables
# Disable built-in rules
MAKEFLAGS += --no-builtin-rules
# A catalog of requirements files
REQUIREMENTS?=requirements
help: # Show this help
@echo "Usage: make [target]"
@echo ""
@echo "Targets:"
@echo " help Show this help"
@echo " requirements-base Compile base requirements"
@echo " requirements-test Compile test requirements"
@echo " requirements-dev Compile dev requirements"
@echo " requirements Compile all requirements"
@echo " install Install the app locally"
@echo " install-front Install frontend"
@echo " install-test Install the app locally with test dependencies"
@echo " install-dev Install the app locally with dev dependencies"
@echo " install-test-dev Install the app locally with test and dev dependencies"
@echo " init-test-dev Install the app locally with test and dev dependencies. Also install pre-commit hooks."
@echo " reinit-test-dev Reinstall pre-commit hooks"
@echo " lint Run linters"
@echo " test Run tests"
@echo " migrate Run migrations"
@echo " revision Create a new migration"
@echo " front Run frontend"
@echo " scrape-repos Scrape repos"
@echo " parse-dependencies Scrape dependencies"
@echo " index-repos Index repos"
@echo " index-dependencies Index dependencies"
requirements-base: # Compile base requirements
python -m piptools compile \
--output-file=requirements/base.txt \
-v \
pyproject.toml
requirements-test: requirements-base # Compile test requirements
python -m piptools compile \
--extra=test \
--output-file=requirements/test.txt \
-v \
pyproject.toml
requirements-dev: requirements-base # Compile dev requirements
python -m piptools compile \
--extra=dev \
--output-file=requirements/dev.txt \
-v \
pyproject.toml
requirements: requirements-base requirements-test requirements-dev # Compile all requirements
.PHONY: requirements
install: # Install the app locally
python -m pip install -r $(REQUIREMENTS)/base.txt .
.PHONY: install
install-test: # Install the app locally with test dependencies
python -m pip install \
-r $(REQUIREMENTS)/base.txt \
-r $(REQUIREMENTS)/test.txt \
--editable .
.PHONY: install-test
install-dev: # Install the app locally with dev dependencies
python -m pip install \
-r $(REQUIREMENTS)/base.txt \
-r $(REQUIREMENTS)/dev.txt \
--editable .
.PHONY: install-dev
install-test-dev: # Install the app locally with test and dev dependencies
python -m pip install \
-r $(REQUIREMENTS)/base.txt \
-r $(REQUIREMENTS)/test.txt \
-r $(REQUIREMENTS)/dev.txt \
--editable .
.PHONY: install-test-dev
install-front: # Install frontend
cd frontend && pnpm install
.PHONY: install-front
init-test-dev: install-test-dev # Install the app locally with test and dev dependencies. Also install pre-commit hooks.
pre-commit install
.PHONY: init-test-dev
reinit-test-dev: init-test-dev # Reinstall pre-commit hooks
pre-commit install --install-hooks --overwrite
.PHONY: reinit-test-dev
lint: # Run linters
pre-commit run --all-files
.PHONY: lint
test: # Run tests
python -m pytest -vv -s --cov=app --cov-report=xml --cov-branch app
.PHONY: test
migrate: # Run migrations
python -m alembic upgrade heads
.PHONY: migrate
revision: # Create a new migration
python -m alembic revision --autogenerate -m "$(message)"
.PHONY: revision
front: install-front # Run frontend
cd frontend && pnpm dev
.PHONY: front
scrape-repos: # Scrape repos
python -m app.scrape scrape-repos
.PHONY: scrape-repos
parse-dependencies: # Scrape dependencies
python -m app.scrape parse-dependencies
.PHONY: parse-dependencies
index-repos: # Index repos
python -m app.index index-repos
.PHONY: index-repos
index-dependencies: # Index dependencies
python -m app.index index-dependencies
.PHONY: index-dependencies
.DEFAULT_GOAL := init-test-dev # Set the default goal to init-dev-test