Repository for dip
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
 
 
ychangkim f6f3dd53c5 update 3 weeks ago
..
charts/nemo-common update 3 weeks ago
templates update 3 weeks ago
.helmignore update 3 weeks ago
Chart.lock update 3 weeks ago
Chart.yaml update 3 weeks ago
README.md update 3 weeks ago
values.yaml update 3 weeks ago

README.md

NeMo Deployment Management Microservice Helm Chart

Type: application

For deployment guide, see Admin Setup in the NeMo Microservices documentation.

Values

Key Type Default Description
affinity object {} Specifies affinity settings for the deployment. To learn more, refer to the Affinity and Anti-Affinity in the Kubernetes documentation.
autoscaling.enabled bool false Whether to enable autoscaling for the NeMo Deployment Management microservice.
autoscaling.maxReplicas int 100 The maximum number of replicas.
autoscaling.minReplicas int 1 The minimum number of replicas.
autoscaling.targetCPUUtilizationPercentage int 80 The target CPU utilization percentage.
deployments object {"autoscaling":{"enabled":false,"spec":{"maxReplicas":5,"metrics":[{"pods":{"metric":{"name":"gpu_cache_usage_perc"},"target":{"averageValue":"750m","type":"AverageValue"}},"type":"Pods"}],"minReplicas":1}},"defaultStorageClass":"","metrics":{"enabled":false},"nimImagePullSecrets":[],"nimPeftSource":"http://nemo-entity-store:8000","nimPvcSize":"25Gi"} Properties to configure NIM deployments for the NeMo Deployment Management microservice.
deployments.autoscaling.enabled bool false Whether to enable autoscaling for the NIM deployments.
deployments.autoscaling.spec object {"maxReplicas":5,"metrics":[{"pods":{"metric":{"name":"gpu_cache_usage_perc"},"target":{"averageValue":"750m","type":"AverageValue"}},"type":"Pods"}],"minReplicas":1} Autoscaling specification for the NIM deployments.
deployments.defaultStorageClass string "" The default storage class for NIM deployments.
deployments.metrics.enabled bool false Whether to enable metrics collection for the NIM deployments.
deployments.nimImagePullSecrets list [] List of image pull secrets for the NIM deployments.
deployments.nimPeftSource string "http://nemo-entity-store:8000" The URL for the NeMo Entity Store service.
deployments.nimPvcSize string "25Gi" The size of the PVC for the NIM deployments.
env object {} Additional environment variables to pass to the NeMo Deployment Management microservice container. The format is NAME: value or NAME: valueFrom: {object}.
fullnameOverride string "" String to fully override the name on resulting Kubernetes objects when the NeMo Deployment Management microservice is deployed.
image.pullPolicy string "IfNotPresent" The container image pull policy for the NeMo Deployment Management container.
image.repository string "nvcr.io/nvidia/nemo-microservices/deployment-management" The repository of the NeMo Deployment Management container image.
image.tag string "" The container image tag. If not set, the default value is appVersion from the Chart.yaml file.
imagePullSecrets list [{"name":"nvcrimagepullsecret"}] Image pull secrets for accessing the NGC container registry.
ingress.annotations object {} Ingress annotations.
ingress.className string "" The ingress class to use.
ingress.enabled bool false Whether to enable the ingress controller resource.
ingress.hosts list [] A list of maps, each containing the keys host and paths for the ingress resource. You must specify a list for configuring ingress for the microservice.
ingress.tls list [] Ingress TLS configuration.
livenessProbe.httpGet.path string "/health" The HTTP path for the Kubernetes liveness probe. Do not change this.
livenessProbe.httpGet.port string "http" The port name for the Kubernetes liveness probe. Do not change this.
monitoring object {"enabled":false} Prometheus metrics collection configuration for monitoring the NeMo Deployment Management microservice. To enable this, you should install the Prometheus operator before deploying the NeMo Deployment Management microservice.
monitoring.enabled bool false Whether to enable monitoring for the NeMo Deployment Management microservice.
nameOverride string "" String to partially override name on resulting Kubernetes objects when the NeMo Deployment Management microservice is deployed.
nimNamespace string "" Specifies a namespace to restrict the NeMo Deployment Management microservice to watch NIMs in. Leave it empty to watch all namespaces.
nodeSelector object {} Specifies labels to ensure that the microservice is deployed only on certain nodes. To learn more, refer to the Node Selector in the Kubernetes documentation.
podAnnotations object {} Pod annotations.
podLabels object {} Pod labels.
podSecurityContext object {} Pod security context settings. Use the default settings, unless you understand what changes in the pod security context settings you want to apply.
readinessProbe.httpGet.path string "/health" The HTTP path for the Kubernetes readiness probe. Do not change this.
readinessProbe.httpGet.port string "http" The port name for the Kubernetes readiness probe. Do not change this.
replicaCount int 1 The number of replicas for the NeMo Deployment Management service.
resources object {} Configures Kubernetes resource requests and limits for the NeMo Deployment Management microservice. Use the default settings and leave it with the empty object as is, unless you understand what changes you want to make.
securityContext object {"readOnlyRootFilesystem":true} Security context settings. Use the default settings, unless you understand what changes in the security context settings you want to apply.
securityContext.readOnlyRootFilesystem bool true Enable read-only root filesystem. You can also add any values for Kubernetes security context in this field.
service.deploymentPort.port int 8000 The port number for the service.
service.deploymentPort.type string "ClusterIP" The service type of the deployment port.
serviceAccount object {"annotations":{},"automount":true,"create":true,"name":""} Configures service account for RBAC for the NeMo Deployment Management microservice. Use the default setup, unless you understand what changes in RBAC settings you want to apply to the service.
serviceAccount.annotations object {} Annotations to add to the service account.
serviceAccount.automount bool true Automatically mount a ServiceAccount's API credentials.
serviceAccount.create bool true Whether to create a service account for the NeMo Deployment Management microservice. This is for setting RBAC up.
serviceAccount.name string "" The name of the service account to use. If not set and create is true, a name is generated using the fullname template.
tolerations list [] Specifies tolerations for pod assignment. To learn more, refer to the Taint and Toleration in the Kubernetes documentation.
volumeMounts list [] Additional volume mounts for the NeMo Deployment Management microservice. Use the default settings and leave it with the empty list as is, unless you understand what changes you want to make.
volumes list [] Additional volumes for the NeMo Deployment Management microservice. Use the default settings and leave it with the empty list as is, unless you understand what changes you want to make.