ARTIFACTORY: Hugging Face GA Repository Structure Migration

Description

Starting from Artifactoty 7.77.X, you can access Hugging Face GA in Self-hosted environments. The GA version includes an update to the Hugging Face repository structure, which might cause storage issues in the local repositories you created during the beta. 

The layout change will make the stored file inaccessible to Hugging Face APIs and have the following side effects:

• Remote repositories: the models will be downloaded again from Hugging Face to the Artifactory cache
• Local repositories: the models are inaccessible and require a re-upload.

To learn more about the new features included in the GA version, see the release notes. 

Local Repository Structure Changes Overview 

The Hugging Face local repository before Artifactory 7.77.x is a beta version, with the following storage structure:

<local-repository>
    |
    —-models
        |
        —organization (optional)
            |
            —model_name
                    |
                    |—-main
                        |
                        —-model files

For example:


                            
            
The Hugging Face local repository after Artifactory 7.77.x is a GA with the structure of:

<local-repository>
    |
    —-models
        |
        —organization (optional)
            |
            —model_name
                    |—-main
                         |-----<UPLOAD_DATE>
                               |
                               |----------model files

For example: