Cold Storage Architecture

JFrog Platform Administration Documentation

Content Type
Administration / Platform
ft:sourceType
Paligo
cold_artifact_storage_1b.png

The Cold Storage archiving solution is comprised of three main components:

  • Live Artifactory instance

    Live Artifactory is a standard Artifactory instance from which artifacts or packages will be archived.

  • Cold Artifactory instance

    Cold Artifactory is a stripped-down, limited-functionality version of an Artifactory instance used for archiving purposes. The Cold instance is implemented as a dedicated Artifactory instance, connected to a binary storage provider (such as AWS Glacier).

    Note

    One Cold Artifactory instance can be connected to only one Live Artifactory cluster. Every cluster of Artifactory that needs to archive requires a single Cold Storage instance with a dedicated license.

  • Archive (binary storage provider)

    When setting up the Cold instance, you must connect it to a binary storage provider. You can use one of the following storage options:

    • A cloud provider

      • Supported: We currently support AWS S3 Glacier Flexible Retrieval for archiving and retrieving data.

        Note

        The other S3 Glacier classes are not supported:

        • S3 Glacier Instant Retrieval (GLACIER_IR)

        • S3 Glacier Deep Archive (DEEP_ARCHIVE)

      • Using S3 Glacier Flexible Retrieval: Configure the S3 Glacier Flexible Retrieval as your binary storage provider. Standard is the default retrievalTier in the binarystore.xml configuration file. This setting determines the speed and cost of data retrieval.

        Retrieval Tier Options: You can set the retrievalTier to one of the following three values:

        • Standard: Retrieves data in several hours. This tier is typically the most cost-effective for infrequent access.

        • Bulk: Suitable for large-scale retrievals, allowing you to retrieve data at a lower cost but with longer retrieval times ranging from several hours to a day.

        • Expedited: Allows you to retrieve data quickly in 1-5 minutes. This option is ideal for urgent access to specific data.

      • Example Configuration: Below is a sample entry in the binarystore.xml file that demonstrates how to set the retrieval tier for S3 Glacier Flexible Retrieval:

        <binary-store>
            <provider type="S3Glacier">
                <region>us-east-1</region>
                <bucket-name>your-bucket-name</bucket-name>
                <retrievalTier>Standard</retrievalTier> <!-- Specify your choice: Standard, Bulk, or Expedited -->
            </provider>
        </binary-store>
    • A local storage providerFilestore Configuration