Hugging Face Model Type

Upload a Hugging Face Model to a Machine Learning Repository

Use the following function to upload a Hugging Face Transformers model to a Machine Learning repository in Artifactory:

import frogml

repository = "repository-name"
name = "model-name"
namespace = "namespace"
version = "version-1"
properties = {"key1": "value1"}
dependencies = ["path/to/dependencies/conda.yaml"]
code_dir = "full/path/to/code/dir"
model = get_huggingface_model() # Function that Returns a huggingface model
tokenizer = get_huggingface_tokenizer() # Function that Returns a huggingface tokenizer

frogml.huggingface.log_model(
    model=model,
    tokenizer=tokenizer,
    repository=repository,
    model_name=name,
    namespace=namespace,
    version=version,
    properties=properties,
    dependencies=dependencies,
    code_dir=code_dir,
)

Download a Hugging Face Model from a Machine Learning Repository

Use the following function to download a deserialized Hugging Face Transformers model from a Machine Learning repository in Artifactory:

import frogml

repository = "repository-name"
name = "model-name"
namespace = "namespace"
version = "version-1"
full_target_path = "full/path/to/target/path"

huggingface_deserialized_model = frogml.huggingface.load_model(
    repository=repository,
    namespace=namespace,
    model_name=name,
    version=version,
    target_path=full_target_path,
)

Get Information on a Hugging Face Model in a Machine Learning Repository

Use the following function to retrieve information on a specific Hugging Face Transformers model stored in a Machine Learning repository in Artifactory.

import frogml

repository = "repository-name"
name = "model-name"
namespace = "namespace"
version = "version-1"

frogml.huggingface.get_model_info(
    repository=repository,
    name=name,
    namespace=namespace,
    version=version,
)