🦄 Self hosted, 🔒 private, 🐟 scalable, 🤑 commercially usable, 💬 LLM chat streaming service with 1-click Kubernetes cluster installation on any cloud
This project is inspired by LocalAI, privateGPT, local.ai, llama-cpp-python, closedai, closedai, mlc-llm, but with a focus on Kubernetes deployment, streaming, and commercially usable models only.
python3 -m venv .venv
source .venv/bin/activate
python3 -m pip install -r requirements.txt
pip freeze > requirements.txt