Compose-Examples/examples/ollama-ui

References

• https://github.com/ollama/ollama
• https://hub.docker.com/r/ollama/ollama
• https://github.com/open-webui/open-webui

Notes

You should spawn ollama first and download the respective LLM models:

# spawn ollama
docker compose up -d ollama

# download an llm model
docker exec ollama ollama run llama3:8b

Afterwards, we can spawn Open WebUI and register our first user account:

# spawn ui
docker compose up -d ui

Finally, we may want to disable open user registration for Open WebUI by uncommenting the env ENABLE_SIGNUP variable and restarting the container.

Tip

You likely want to pass a GPU into the Ollama container. Please read this.