This section describes the steps and references to create NVIDIA NIM remote repository and configure the repositories.
NIM Repository Prerequisites
Remote Docker repository pointing to the URL
https://nvcr.io
.NVIDIA NIM models are provided as prebuilt containers packaged with optimized models.
To resolve a model from NVIDIA NIM to a remote Docker repository, ensure that the repository is configured to download NVIDIA NIM containers. The URL parameter should be set to
https://nvcr.io/
, as NIMs are packaged as container images for individual models or model families. This URL points to the remote Docker repository from which the container can be downloaded.The authentication for the remote Docker repository:
Username: $oauthtoken
Password / Access Token: NVIDIA Personal Key
To create a remote repository to proxy a remote NVIDIA NIM registry, follow these steps:
From the Administration module, click Repositories.
Click Remote Repository from Add Repositories.
Click NVIDIA NIM Models in the Select Package Type dialog.
Set the Repository Key.
Note
URL is auto-populated:
https://api.ngc.nvidia.com
Username: Leave this field blank
Password / Access Token: NVIDIA Personal Key, generated as a prerequisite
For other Basic settings, refer to the Basic Settings for Remote Repositories.
For Advanced settings, refer to the Advanced Settings for Remote Repositories.
Click Create Remote Repository.