Configure NIM Client

JFrog Artifactory Documentation
Products
JFrog Artifactory
Content Type
User Guide
ft:sourceType
Paligo

This topic describes configuring the NIM Model client to point to remote repositories in Artifactory. It provides instructions for configuring the client to use the NIM remote repository that points to https://api.ngc.nvidia.com.

To set up the NIM client to work with Artifactory, follow these steps:

  1. Set Environment Variables

    Open your terminal and set the following environment variables to configure access to the NVIDIA NIM repository:

    Note

    Note:Make sure to replace the placeholders in bold with the appropriate values as follows:

    The following fields are populated by the user interface (UI):

    • <TOKEN>: Artifactory Repository token

    • <DOMAIN>: Use the domain without https://

    • <REPO>: The nim remote repository key

    • <PROTOCOL>: http | https

    • ./: Specify the directory on your local machine

    export NGC_API_KEY=<TOKEN>
export NGC_API_ENDPOINT=<DOMAIN>/artifactory/api/nimmodel/<REPO>
export NGC_AUTH_ENDPOINT=<DOMAIN>/artifactory/api/nimmodel/<REPO>
export NGC_API_SCHEME=<PROTOCOL>
export CACHE_DIR=./

    • NGC_API_KEY=<TOKEN>: Your Artifactory repository token for authentication, generated by the Set Me UP. Replace <TOKEN> with your actual token.

    • NGC_API_ENDPOINT=<DOMAIN>/artifactory/api/nimmodel/<REPO>: The URL of the remote NIM repository. Replace <DOMAIN> with the repository domain and <REPO> with the model repository name.

    • NGC_API_AUTH_ENDPOINT=<DOMAIN>/artifactory/api/nimmodel/<REPO>: The authentication URL for the NIM repository. Replace <DOMAIN> with your repository's domain and <REPO> with the model repository name.

    • NGC_API_SCHEME=<PROTOCOL>: The protocol to use for communication. Set to http | https for secure connections.

    • CACHE_DIR=./: The local directory for storing cached files (for example, downloaded models). Replace ./ with the desired path.

  2. Authenticate with Docker Repository

    Log in to your Artifactory Docker repository using Docker. In your terminal, enter:

    docker login <DOMAIN>

    You will be prompted to enter your Artifactory username and password or API key.

    For example:

    docker login awesome.jfrog.io

    Note

    For alternative Docker authentication methods, such as manually configuring your credentials or using different clients or versions, refer to the Set Me Up instructions for the Docker repository.