Jenkins is one of the most popular tools for Continuous Integration and Continuous Delivery today. It’s easy to set up and get started with. But what are the best practices for building delivery pipelines with Jenkins? Should you use the traditional build jobs or opt for the new Jenkins pipelines? What options are there for, e.g. visualization or infrastructure as code support? How do I structure my shared libraries so that they’re easy to maintain? In this talk, I’ll share my many years of experiences from working with Jenkins for Continuous Delivery. We’ll take a look at pros and cons of different approaches but also how Jenkins compares to its competitors, where it shines, and where it leaves room for improvement. Presented at JAX DevOps & Finance, London, United Kingdom on April 10th 2018.

1. Continuous Delivery
with Jenkins:
the Good, the Bad and the Ugly
Tommy Tynjä
@tommysdk
tynja.com
diabol.se
diabol.se/blog
github.com/Diabol

3. Tommy Tynjä
@tommysdk

4. Topics
Challenges
Comparison
Options
Solution

7. Plugins

8. stats.jenkins.io

9. stats.jenkins.io

14. What requirements do we
have on a CI / CD tool?

15. Run on premise
Infrastructure as code
Deployment support Isolated builds
using containersCustomisable
Scalable Good pipeline visualisation
Community
Reasonable price

16. Goals
Satisfy our customers
Good ways of working with Jenkins

17. Comparing CI/CD tools
Jenkins, GoCD, TeamCity,
Concourse, Drone, Bamboo

18. Comparing CI/CD tools
Jenkins, GoCD, TeamCity,
Concourse, Drone, Bamboo

19. Open source and good community
Many integrations / plugins exist
We already know it!
Why Jenkins?

20. Traditional build jobs with
downstream dependencies

21. 🔵 🔆 Deploy
🔵 🔆 Test
🔵 🔆 Build

22. 🔵 🔆 Deploy
🔵 🔆 Integration Test
🔵 🔆 Build
🔵 🔆 Regression Test
🔵 🔆 Static code analysis

23. Jenkins pipelines

26. Blue Ocean Plugin

27. Blue Ocean Plugin

28. Blue Ocean Plugin

29. https://github.com/Diabol/delivery-pipeline-plugin
Delivery Pipeline Plugin

31. Jenkinsfile

32. https://plugins.jenkins.io/workflow-cps-global-lib
Pipeline: Shared Groovy Libraries
ID: workflow-cps-global-lib

33. https://github.com/Diabol/jenkins-pipeline-shared-library-template

34. $ tree
├── src
│ └── Example.groovy
├── test
│ └── ExampleTest.groovy
└── vars
└── deliveryPipeline.groovy

35. $ tree
├── src
│ └── Git.groovy
├── test
│ └── GitTest.groovy
└── vars
└── deliveryPipeline.groovy

36. $ tree
├── src
│ ├── Build.groovy
│ ├── Deployment.groovy
│ ├── Git.groovy
│ ├── Validation.groovy
│ └── Version.groovy
├── test
│ ├── BuildTest.groovy
│ ├── DeploymentTest.groovy
│ ├── GitTest.groovy
│ ├── ValidationTest.groovy
│ └── VersionTest.groovy
└── vars
└── deliveryPipeline.groovy

37. Easy to adopt
Convention over configuration

38. deliveryPipeline {
maintainer = 'Team 1337'
projectName = 'order-service'
type = 'library'
language = 'java'
}

42. jenkins-pipeline-dsl-latest
🔵 🔆 Tag
🔵 🔆 Test
🔵 🔆 Compile

45. Infrastructure as code?
Not enough!

46. Short feedback cycles
Continuous Delivery

49. ├── jenkins-agent
│ ├── certificates
│ │ └── ...
│ └── Dockerfile

50. ├── jenkins-agent
├── jenkins-master
│ ├── certificates
│ ├── init.groovy.d
│ ├── Dockerfile
│ └── plugins.txt
└── build.gradle

51. 1. Build containers
2. Run tests
3. Upload
(4. Deploy)

52. Tests
Spock (spockframework.org)
Testcontainers (testcontainers.org)

53. class PluginTest extends Specification {
@Shared
@ClassRule
JenkinsMasterContainer jenkinsContainer =
new JenkinsMasterContainer()
@Shared
Map<String, String> configuredPlugins =
collectEntriesFromPluginsTxt()
@Shared
List<Plugin> installedPlugins

54. class PluginTest extends Specification {
@Shared
@ClassRule
JenkinsMasterContainer jenkinsContainer =
new JenkinsMasterContainer()
@Shared
Map<String, String> configuredPlugins =
collectEntriesFromPluginsTxt()
@Shared
List<Plugin> installedPlugins

55. @Unroll
def 'Plugin is installed: #pluginId'() {
given: 'A configured plugin'
Plugin plugin = installedPlugins.find {
it.shortName == pluginId
}
expect: 'Plugin is present'
plugin
where:
pluginId << configuredPlugins.keySet()
}

58. init.groovy.d
BitbucketServerEndpoint endpoint =
new BitbucketServerEndpoint(server,
url, manageWebHooks, credentialsId)

59. Jenkins pipeline for Jenkins

60. Summary
Challenges
Everything as code
Continuous Delivery of
Continuous Delivery

61. Thank you!
Tommy Tynjä
@tommysdk
tynja.com
diabol.se
diabol.se/blog
github.com/Diabol