Pipeline of Pipelines

JFrog Pipelines Documentation

Products
JFrog Pipelines
Content Type
User Guide
ft:sourceType
Paligo

One of the key features of JFrog Pipelines is the ability to create interconnected pipelines, called a pipeline of pipelines, that can span several different teams, technology platforms, and tools, enabling teams to collaborate on interdependent projects.

Consider the different stages of the SDLC, such as dev, test, deployment to staging, deployment to prod, and so on, with each team creating tens or even hundreds of individual software pipelines. Pipeline of pipelines enables you to easily connect these pipelines to create an end-to-end workflow and exchange information across the pipelines. There is no limit to the number of pipelines that can be interconnected. Pipeline of pipelines can be easily created using global resources, where a pipeline updates a resource, which is used as the input for triggering downstream pipelines.

After a pipeline of pipelines is created, you can view the end-to-end workflow in real-time, interactive Pipelines dashboard, with alerts and notifications, to easily identify and escalate bottlenecks and failures.

Create Pipeline of Pipelines

To create a pipeline of pipelines, you need:

  • At least two pipelines

  • A resource that connects these pipelines

Just like how dependent steps are connected using resources, dependent pipelines are also connected using resources.

In the image below, the first pipeline (app_dev_pipeline) ends with the output resource app_buildinfo. The second pipeline (app_prod_pipeline), which starts with the same resource, uses it as an input resource.

Note

By default, during a run, a dependent pipeline is triggered only when there is a new version of the resource that connects the pipelines.

pipeline_of_pipelines_1b.png
Examples

Here are two examples showing pipeline of pipelines.

Example 1

This example shows a pipeline of pipelines containing eight pipelines, interconnected using the PropertyBag resource.