service-catalog/charts/nim/CUSTOM-README.md

Nim 배포

1. 배포 방법

• 명령어

  $ helm upgrade --instal nim ../nim \
    --set nimService.name=custom-model \
    --set nimService.existingAuthSecret="" \
    --set image.repository=nvcr.io/nim/custom/model \
    --set image.tag=1.0.0 \
    --set nimService.ngcAPIKey=YOUR_NGC_API_KEY \
    --set imagePullSecrets[0].password=YOUR_PASSWORD
    --namespace nim \
    --create-namespace \
    -f custom-values.yaml
  

2. custom-values.yaml 설명

• custom-values.yaml에 정의된 값에 대한 설명이다.

1) Nim 설정

Name	설명	기본값
nimService.name	nim service 이름.	meta-llama3-8b-instruct
nimService.existingAuthSecret	nim service auth secret명.
image.repository	nim service model registry.	nvcr.io/nim/meta/llama-3.2-3b-instruct
image.tag	nim service model tag.	1.8.3
imagePullSecrets.name	nim service model secret 명.	nvcrimagepullsecret
imagePullSecrets.registry	nim model resistory.	nvcr.io
imagePullSecrets.username	nim model resistory username.	$oauthtoken
imagePullSecrets.password	nim model resistory password.