You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
27 lines
1.2 KiB
27 lines
1.2 KiB
NVIDIA NIMService "{{ .Values.nimService.name }}" has been deployed!
|
|
|
|
{{- if eq .Values.existingImagePullSecret "" }}
|
|
NOTE: Image pull secrets have been created. Make sure to set the correct password in values.yaml or using --set imagePullSecrets[0].password=YOUR_PASSWORD
|
|
{{- end }}
|
|
|
|
{{- if eq .Values.nimService.existingAuthSecret "" }}
|
|
NOTE: NGC API authentication secret has been created. Make sure to set the correct NGC API key in values.yaml or using --set nimService.ngcAPIKey=YOUR_NGC_API_KEY
|
|
{{- end }}
|
|
|
|
1. Check the status of the NIMService:
|
|
kubectl get nimservice -n {{ .Release.Namespace }} {{ .Values.nimService.name }}
|
|
|
|
2. Access the NIMService API:
|
|
kubectl port-forward -n {{ .Release.Namespace }} service/{{ .Values.nimService.name }} {{ .Values.nimService.expose.service.port }}:{{ .Values.nimService.expose.service.port }}
|
|
|
|
3. Example API request:
|
|
curl -X POST http://localhost:{{ .Values.nimService.expose.service.port }}/v1/completions \
|
|
-H "Content-Type: application/json" \
|
|
-d '{
|
|
"model": "{{ .Values.nimService.name }}",
|
|
"prompt": "Hello, how are you?",
|
|
"max_tokens": 100
|
|
}'
|
|
|
|
For more information on using NVIDIA NIMService, visit:
|
|
https://docs.nvidia.com/nim/
|
|
|