Connect your NVIDIA NIM Model Client to Artifactory

JFrog Artifactory Documentation
Products
JFrog Artifactory
Content Type
User Guide

This topic provides details on configuring NVIDIA NIM client to work with Artifactory. To get up and running quickly to use NVIDIA NIM, see Get Started with NVIDIA NIM.

Pre-requisite: Before connecting your NVIDIA NIM client to Artifactory, you must have an existing NVIDIA NIM repository in Artifactory. For more information, see Create an NVIDIA NIM Repository.

Supported NVIDIA NIM Clients

  • Docker

    Note

    Currently, we do not support NGC CLI and NGC SDK.

Configure your Docker Client to Work with NVIDIA NIM Packages

To configure your local machine to install NVIDIA NIM packages using Docker client:

  1. Set Environment Variables

    Open your terminal and set the following environment variables to configure access to the NVIDIA NIM repository:

    Note

    Make sure to replace the placeholders in bold with the appropriate values as follows:

    The following fields are populated by the user interface (UI):

    • <TOKEN>: Artifactory Repository token

    • <DOMAIN>: Use the domain without https://

    • <REPO>: The nim remote repository key

    • <PROTOCOL>: http | https

    • ./: Specify the directory on your local machine

    export NGC_API_KEY=<TOKEN>
export NGC_API_ENDPOINT=<DOMAIN>/artifactory/api/nimmodel/<REPO>
export NGC_AUTH_ENDPOINT=<DOMAIN>/artifactory/api/nimmodel/<REPO>
export NGC_API_SCHEME=<PROTOCOL>
export CACHE_DIR=./

    Where:

    • NGC_API_KEY=<TOKEN>: Your Artifactory repository token for authentication, generated by the Set Me UP. Replace <TOKEN> with your actual token.

    • NGC_API_ENDPOINT=<DOMAIN>/artifactory/api/nimmodel/<REPO>: The URL of the remote NIM repository. Replace <DOMAIN> with the repository domain and <REPO> with the model repository name.

    • NGC_API_AUTH_ENDPOINT=<DOMAIN>/artifactory/api/nimmodel/<REPO>: The authentication URL for the NIM repository. Replace <DOMAIN> with your repository's domain and <REPO> with the model repository name.

    • NGC_API_SCHEME=<PROTOCOL>: The protocol to use for communication. Set to http | https for secure connections.

    • CACHE_DIR=./: The local directory for storing cached files (for example, downloaded models). Replace ./ with the desired path.

  2. Authenticate with Docker Repository

    Log in to your Artifactory Docker repository using Docker. In your terminal, enter:

    docker login <DOMAIN>

    You will be prompted to enter your Artifactory username and password or API key.

    For example:

    docker login awesome.jfrog.io

    Note

    For alternative Docker authentication methods, such as manually configuring your credentials or using different clients or versions. For more information on Set Me Up, see Use Artifactory Set Me Up for Configuring Package Manager Clients.

Note: You can also use JFrog Set me up to copy the snippet populated with your token and environment. For more information, see Use Artifactory Set Me Up for Configuring Package Manager Clients.

Next Steps: