ychangkim
37 lines
1.3 KiB
Markdown
37 lines
1.3 KiB
Markdown
|
|
# Nim 배포
|
|
|
|
## 1. 배포 방법
|
|
|
|
- 명령어
|
|
|
|
``` sh
|
|
$ helm upgrade --instal nim ../nim \
|
|
--set nimService.name=custom-model \
|
|
--set nimService.existingAuthSecret="" \
|
|
--set image.repository=nvcr.io/nim/custom/model \
|
|
--set image.tag=1.0.0 \
|
|
--set nimService.ngcAPIKey=YOUR_NGC_API_KEY \
|
|
--set imagePullSecrets[0].password=YOUR_PASSWORD
|
|
--namespace nim \
|
|
--create-namespace \
|
|
-f custom-values.yaml
|
|
```
|
|
|
|
|
|
|
|
## 2. custom-values.yaml 설명
|
|
|
|
- custom-values.yaml에 정의된 값에 대한 설명이다.
|
|
|
|
### 1) Nim 설정
|
|
| Name | 설명 | 기본값 |
|
|
| ---------------------- | ------------------------------------------------------------ | ------ |
|
|
| `nimService.name` | nim service 이름. | `meta-llama3-8b-instruct` |
|
|
| `nimService.existingAuthSecret` | nim service auth secret명. | |
|
|
| `image.repository` | nim service model registry. | `nvcr.io/nim/meta/llama-3.2-3b-instruct` |
|
|
| `image.tag` | nim service model tag. | `1.8.3` |
|
|
| `imagePullSecrets.name` | nim service model secret 명. | `nvcrimagepullsecret` |
|
|
| `imagePullSecrets.registry` | nim model resistory. | `nvcr.io` |
|
|
| `imagePullSecrets.username` | nim model resistory username. | `$oauthtoken` |
|
|
| `imagePullSecrets.password` | nim model resistory password. | | |