Change chart directory structure
This commit is contained in:
@@ -0,0 +1,27 @@
|
||||
NVIDIA NIMService "{{ .Values.nimService.name }}" has been deployed!
|
||||
|
||||
{{- if eq .Values.existingImagePullSecret "" }}
|
||||
NOTE: Image pull secrets have been created. Make sure to set the correct password in values.yaml or using --set imagePullSecrets[0].password=YOUR_PASSWORD
|
||||
{{- end }}
|
||||
|
||||
{{- if eq .Values.nimService.existingAuthSecret "" }}
|
||||
NOTE: NGC API authentication secret has been created. Make sure to set the correct NGC API key in values.yaml or using --set nimService.ngcAPIKey=YOUR_NGC_API_KEY
|
||||
{{- end }}
|
||||
|
||||
1. Check the status of the NIMService:
|
||||
kubectl get nimservice -n {{ .Release.Namespace }} {{ .Values.nimService.name }}
|
||||
|
||||
2. Access the NIMService API:
|
||||
kubectl port-forward -n {{ .Release.Namespace }} service/{{ .Values.nimService.name }} {{ .Values.nimService.expose.service.port }}:{{ .Values.nimService.expose.service.port }}
|
||||
|
||||
3. Example API request:
|
||||
curl -X POST http://localhost:{{ .Values.nimService.expose.service.port }}/v1/completions \
|
||||
-H "Content-Type: application/json" \
|
||||
-d '{
|
||||
"model": "{{ .Values.nimService.name }}",
|
||||
"prompt": "Hello, how are you?",
|
||||
"max_tokens": 100
|
||||
}'
|
||||
|
||||
For more information on using NVIDIA NIMService, visit:
|
||||
https://docs.nvidia.com/nim/
|
||||
Reference in New Issue
Block a user