Choosing your Runtime Image

JFrog Pipelines Documentation

ft:sourceType
Paligo

By default, your steps run inside a container from a standard runtime images library maintained by JFrog. You can control which runtime images your steps execute in through the Pipelines DSL.

If you need to execute your step directly on the build host node (not in a container), see Running Steps on the Host.

Default Runtime Image

The default runtime image used to execute a Bash step is a NodeJS image that matches the OS of your node pool. For a PowerShell step, the default is a .NET Core image. In both cases, the version selected is configurable as part of the Pipelines installation and an administrator may have configured a different default image in your installation. The default is usually most appropriate when your steps will only execute shell commands that are not specific to a language.

For native steps that perform language-specific operations (for example, MvnBuild or GoBuild), the default runtime image will be one appropriate to that language. Similarly, the runtime image chosen will be one that matches the OS of your node pool. Native steps without any language-specific operations will use the same default image as Bash on Ubuntu or CentOS and the same image as PowerShell on Windows Server.

Choosing Language and Version

JFrog Pipelines supports Java, C++, Node.js, .NET,, and Go programming languages out of the box. JFrog provides default images in a standard runtime images library, which already have the latest language versions pre-installed. You can use Pipelines to build with other languages by providing a custom image, or installing the language version you need as part of your onStart configuration.

In the runtime section of your YAML configuration you can specify a language and version , which Pipelines will use to select the matching language image. This setting can be configured at a pipeline or step level. As an example, pipeline level configuration is shown below:

pipelines:
  - name: pipeline_1
    configuration:
      runtime:
        type: image
        image:
          auto:
            language: node
            version: "18" # Either "version" or "versions" can be used.
            versions:
              - "18"

Tag

Description

language

Can be set to:

  • cpp for C/C++ steps

  • dotnetcore for .NET steps (Windows Server only)

  • go for Go steps

  • java for Java-based steps

  • node for Node.js steps

version

Can be set to a single version of the language you want to run your build against. Remember to put the version in double quotes, since the parser expects a string. For example: "9.0.0".

For information about the supported versions, see Runtime Images.

versions

Can be set to multiple versions of the language you want to run your build against. Remember to put the version in double quotes, since the parser expects a string. For example: "9.0.0".

For information about the supported versions, see Runtime Images.

If you need an unsupported version of a language, you can either install it in the onStart section, or use a custom Docker image.

Example 1: Specify the default image

pipelines:
  - name: myjfrog_ui_docker
    configuration:
      nodePool: my_cypress
      runtime:
        type: image
        image:
          custom:
            registry: docker
            sourceRepository: apps-docker-local
            name: test.mycompany.io/apps-docker-local/ci/builder-node14
            tag: 2022.8.1-BA-8212-remove-testexecutionreportpaths-property-validation

Example 2: Specify an image for a single step

    steps
      - name: new_cypress
        type: Matrix
        stepMode: Bash
        configuration:
          affinityGroup: group4
          runtime:
            type: image
            image:
              custom:
                registry: docker
                sourceRepository: docker-registry
                name: test.mycompany.io/docker-registry/cypress/base
                tag: 14.18.1
Using a Custom Runtime Image

In some cases, our standard images library might not satisfy your requirements, or you might have an internal image you want to use for step execution or you may want to use our standard images library with specific settings. Using your own custom image gives you better control over what is installed on the runtime images. It can also speed up step execution since you can pre-install dependencies into the image.

You can configure a custom runtime image by using the configuration shown below. This can be specified at a pipeline or step level. If specified at both levels, the step configuration will take precedence.

pipelines:
  - name: pipe1
    configuration: 
      runtime:       
        type: image
        image:
          custom:
            name: <string>                        # imageRepo/imageName format
            tag: <string>                         # version tag of the initial version of the Docker image
            options: "-e HOME=/root"          # Docker options
            autoPull: <boolean>                   # default true; pulls image before run
            registry: <integration>       # if custom image is private, an integration is required for authentication
            sourceRepository: <path>      # may be required if registry is Artifactory. e.g. docker-local
            region: <string>              # required if registry is AWS. e.g. us-east-1

Tag

Description

name

This is the fully qualified name of the Docker image.

tag

This is the Docker image tag you want to use.

options

This is any Docker option you want to use in the docker run command. You also need to include the$HOMEenvironment variable as shown if it is not already set in your image.

autopull

This is an option to automatically pull the image to the machine running the step. Defaults to true.

If your custom image is private, you will also need to create an integration with credentials for your Docker registry, and set additional values in the config:

Tag

Description

registry

This is the friendly name of your Docker registry integration. Supported integration types are Artifactory, Docker Registry, AWS Keys, and Google Cloud.

sourceRepository

The is not used with JFrog CLI v2.

This is only needed if your Docker registry is Artifactory and the pipeline is configured to use JFrog CLI v1. It is the name of the Docker registry on Artifactory.

region

This is only required if your Docker registry is AWS ECR.

Examples

Example 1

pipelines:
  - name: pipe1
    configuration: 
      runtime:       
        type: image
        image:
          custom:
            name: docker/jfrog_win
            tag: latest
            options: "-e HOME=/root"
            autoPull: false
            registry: PSSG_DockerRegistry

Example 2 - Artifactory registry

pipelines:
  - name: pipe2
    configuration: 
      runtime:       
        type: image
        image:
          custom:
            name: ubuntu
            tag: latest
            registry: myArtifactory
            sourceRepository: docker-local

Example 3 - AWS registry

pipelines:
  - name: pipe3
    configuration: 
      runtime:       
        type: image_aws
        image:
          custom:
            name: 541601.dkr.ecr.us-east-1.amazonaws.com/jfbeta
            tag: latest
            autoPull: false
            registry: AWS
            region: us-east-1
Minimum Requirements for Linux

Any custom runtime image specified for a step that will run in a Linux host node (Ubuntu, CentOS, or RHEL) needs to include this minimum set of components:

  • bash

  • /proc/sys/kernel/random/uuid

  • sed

  • GNU grep

  • ssh

  • coreutils

    • date

    • mkdir

    • cp

    • mv

    • touch

    • seq

    • cat

    • basename (for users usingsend_notification (email)command)

    • rm

    • uniq (for users usingcompare_gitcommand)

    • split (for users usingencrypt_string,decrypt_string,encrypt_file,decrypt_filecommands)

  • jfrog (when using an Artifactory integration or in a native step)

  • jq

  • awk (for users usingcompare_gitcommand)

  • git (for users usingcompare_gitcommand or GitRepo resources))

  • gettext (for users usingreplace_envs,send_notification (email)commands)

    • envsubst

  • curl (for users usingsend_notificationcommand)

  • base64 (for users usingsend_notification (email),encrypt_string,decrypt_string,encrypt_file,decrypt_filecommands)

  • openssl (for users using encrypt_string,decrypt_string,encrypt_file,decrypt_file commands)

Minimum Requirements for Windows Server

Any custom runtime image specified for a step that will run in a Windows Server host node needs to include this minimum set of components:

  • PowerShell 5

  • jq (for users using replicate_resource or send_notification commands)

  • git (for users using compare_git command or GitRepo resources)

  • openssl (for users using encrypt_string, decrypt_string, encrypt_file, decrypt_file commands)