init vllm/0.0.11

2025-02-27 04:44:13 +00:00
parent 4a90238056
commit 1e33c0cb92
17 changed files with 874 additions and 0 deletions
@@ -0,0 +1,27 @@
+# vLLM Production Stack helm chart
+
+This helm chart lets users deploy multiple serving engines and a router into the Kubernetes cluster.
+
+## Key features
+
+- Support running multiple serving engines with multiple different models
+- Load the model weights directly from the existing PersistentVolumes
+
+## Prerequisites
+
+1. A running Kubernetes cluster with GPU. (You can set it up through `minikube`: <https://minikube.sigs.k8s.io/docs/tutorials/nvidia/>)
+2. [Helm](https://helm.sh/docs/intro/install/)
+
+## Install the helm chart
+
+```bash
+helm install llmstack . -f values-example.yaml
+```
+
+## Uninstall the deployment
+
+run `helm uninstall llmstack`
+
+## Configure the deployments
+
+See `helm/values.yaml` for mode details.