By Damien Coraboeuf, Clear2Pay In a large company where several dozens of projects and branches will need their own pipelines, you cannot afford to maintain all the jobs, manually. For security reasons and knowledge limitations, Clear2Pay does not want to open Jenkins job configurations in the centralised master. Instead, the Clear2Pay team offers project teams a "shopping list" that they can use to automatically generate their own pipelines for all branches, without requiring the Jenkins administration team to intervene. Projects just update a jenkins.properties in the SCM branch and the pipeline for this branch is updated accordingly. This allows the number of projects to scale, each getting their own pipeline in the Jenkins master without having to worry about administering hundreds of jobs.

1. Jenkins World Tour 2015
London, UK, June 2015
1

2. #jenkinsconf
Scaling of Jenkins Pipelines
Damien Coraboeuf
Clear2Pay

3. #jenkinsconf
Footer
Jungle of jobs

4. #jenkinsconf
Footer
Jungle of jobs
4

5. #jenkinsconf
Footer
Goals
• Self service
• Security
• Simplicity
• Extensibility
5

6. #jenkinsconf
Footer
First steps
• Self service
• Security
• Simplicity
• Extensibility
6
Job DSL plug-in

7. #jenkinsconf
Footer
Going forward
• Self service
• Security
• Simplicity
• Extensibility
7
Most of the pipelines are the same

8. #jenkinsconf
Footer
Pipeline DSL library
8

9. #jenkinsconf
Footer
The Shopping List
• No code – properties
• Pipeline library
• Pipeline version
• Configuration
• Extensions
9
#
Which
pipeline/version
to
use
seed.dsl.libraries
=
com.clear2pay.build:opf-­‐pipeline:1.2.0
#
Configuration
of
the
pipeline
pipeline.notification.ci
=
my-­‐dev-­‐list
pipeline.notification.qa
=
my-­‐qa-­‐list
pipeline.ci.platforms
=
wps70,wps85
pipeline.qa
=
yes

10. #jenkinsconf
Footer
Pipeline as code
• The shopping list lives with your branch
• Traceability + pipeline history
10

11. #jenkinsconf
Footer
How does it look like?
11

12. #jenkinsconf
Footer
Branches
12

13. #jenkinsconf
Footer
Branch pipeline
13

14. #jenkinsconf
Footer
Overview

15. #jenkinsconf
Footer
Responsibilities
15

16. #jenkinsconf
Footer16
Out of the jungle…

17. #jenkinsconf
Footer17
Thanks you!
@DamienCoraboeuf
https://wiki.jenkins-ci.org/display/JENKINS/Seed+Plugin