ZendCon 2015 - Las Vegas

2. 2 October 26, 2015

4. San Francisco, CA
Janine
Fiona
that’s me
Leo

5. Continuous Development
Continuous Delivery
Continuous Integration
Continuous Deployment
Continuous Monitoring
Continuous
Jenkins
Everything sounds better
with “continuous”

6. plan
code
build
test
deploy
operate

7. http://kirbiecravings.com/2014/08/blueberry-mug-cake-2.html

8. code

10. CMS
Magento
Solr
ERP
Project
Applications
MMagento
117
Magento
118
Magento
119
Builds
Release

11. Staging
Magento
72
Magento
103
Magento
119
Magento
72
Magento
103
Magento
119
Magento
72
Magento
103
Magento
119
Environment
Servers
Instances

12. StagingIntegrationDevbox ProductionDeploy
transient,
potentially broken

13. StagingIntegrationDevbox ProductionDeploy
VirtualBox
+ Vagrant
Jenkins
Server
identical
setup

14. One size doesn’t fit all!

16. What is it?
A simple shell script. That’s it!
No Ant, no Phing, no fancy PHP tool/framework
Where is it used?
In the build job of a Jenkins server
What does it need to know?
Where to get all the source code from
What does it do?
add metadata, composer, minify,
packaging, upload to S3

17. What is it?
A couple of chef cookbooks.
Run by AWS OpsWorks or Vagrant,…
Where is it used?
On the target servers
What does it need to know?
The role of the server (web server, devbox, Redis,…)
What does it do?
Installing and configuring web server,
PHP, MySQL, Redis,…

18. What is it?
A simple shell script.
Or the “deploy” chef cookbook
Or EasyDeployWorkflows
Where is it used?
On the target servers
What does it need to know?
How to get the build and where to deploy it to
What does it do?
(Resetting the environment), getting the build, extracting it, managing
release folders and symlinks, triggering installer,
cleanup old releases

19. What is it?
A simple shell script.
Sometimes triggered inside “deploy” before_migrate.rb
Where is it used?
On the target servers, called from deployment step
What does it need to know?
What environment this is. Injected settings
What does it do?
Run modman, apply settings, trigger update scripts, customize cache
prefix, indexing,…

20. doesn’t know anything about
the app, except where to get it
from and where to put it
knows how to get
the app up and
running

22. no creating
CMS blocks
no creating
product attributes
no updating of any
configuration settings!
no clearing
the cache
no purging CDN or
Reverse Proxy
content!

23. media directory
(sometimes
minified)
Database dump
(Vanilla)
Magento core
Modules
Scripts
Settings
Tools

24. Structure
Project

25. project web
root root
This is the complete
project
This is where your
webserver points to.

26. project web
root root

27. htdocs
<Name>
<theme>
layout
template
code
design
core
community
local
<area>
<Namespace>
<package>
app

28. htdocs
<Name>
<theme>
layout
template
code
design
etc
locale
<area>
core
community
local
<area>
<language>
modules
<package>
<Namespace>
<package>
*.xml
*.csv
<theme>
app
skin
lib
Module2
default
layout
template
code
design
etc
locale
frontend
local
frontend
de_DE
modules
base
My
base
My_Module2.xml
My_Module2.csv
default
app
skin
etc, Block, …
js, css, img, …
my_module2
my_module2
Magento My_Module
My_Module2
Module
default
layout
template
code
design
etc
locale
frontend
local
frontend
de_DE
modules
base
My
base
My_Module.xml
My_Module.csv
default
app
skin
etc, Block, …
js, css, img, …
my_module
my_module

29. htdocs
Module
default
layout
template
code
design
etc
locale
local
frontend
de_DE
modules
My
base
*.xml
app
My_Module2.xml
My_Module2.csv
my_module2
My_Module.xml
My_Module.csv
etc, Block, …
my_module
Module2
etc, Block, …
my_module2
my_module

30. by @colinmollenhour

31. htdocs
code
core
community
local
app
app/code/…/My/Module
.modman
My_Module
app/design/…
skin/frontend/…
app/etc/modules/My_Module.xml
modman
app/code/…/My/Module
My_Module2
app/design/…
skin/frontend/…
app/etc/modules/My_Module.xml
modman
<theme>
layout
template
design
etc
locale
<area>
<language>
modules
<package>
*.xml
modman
doesn’t even need to
be in the web root!

32. Vanilla
Magento
absolutely no
core hacks!
…and core bugs
you’ve fixed
(and submitted to
Magento, of course…)
(except official
patches)

33. modman “connects” existing modules to the Magento core,
but how do we manage them?

34. htdocs
code
core
community
local
app
app/code/…/My/Module
.modman
My_Module
app/design/…
skin/frontend/…
app/etc/modules/My_Module.xml
modman
app/code/…/My/Module
My_Module2
app/design/…
skin/frontend/…
app/etc/modules/My_Module.xml
modman
<theme>
layout
template
design
etc
locale
<area>
<language>
modules
<package>
*.xml
tools
n98-magerun.phar
phpunit.phar
modman
EnvSettingsTool
composer.phar
htdocs
.modman
Configuration
Installer
(Metadata, Doc,…)
My_Module
My_Module2
app,…
and usually there’s
even more stuff…
These should come
from different origins

36. “inspired” by
composer/installers
handles package types

37. <?php
namespace AoepeopleComposerInstallers;
class MagentoInstaller extends BaseInstaller
{
protected $locations = array(
'module' => '.modman/{$name}/',
'source' => 'htdocs/'
);
}

38. • Fully compatible with magento-hackathon/magento-composer-installer
• Adds support for type “magento-source”
• Only puts packages into place
• Native modman script is used to deploy modules
• Wrapped in a simple installer script

39. {
"minimum-stability":"dev",
"require":{
"aoepeople/composer-installers": "*",
"fbrnc/aoe_scheduler": "*",
"fbrnc/aoe_cachecleaner": "*",
"aoepeople/magento_enterprise": "1.13.1.0",
"aoepeople/envsettingstool": "*"
},
"config": {
"bin-dir": "bin"
}
}
replaces
Hackathon
Installer
some
modules
Vanilla
Magento
Source
Tools,…

40. Webroot:
/var/www/<projectName>/<environmentName>/current/htdocs
var
var
<projectName>
releases
<environmentName>
shared
www
media
build_117
build_118
build_119
.modman
htdocs
Configuration
tools
install.sh
app,…
var
media
previous
latest
current
next
My_Module
My_Module2

41. https://github.com/AOEpeople/Magento_Boilerplate

43. discover use
code
review
add
modman
add
composer
git integrate test
deploy
download
good luck
with that!
pay $xx
to author
provide FTP
access
seriously?!
one-click
install
upload
“Step 1”
upload
“Step 2”
clear
caches

44. Code Quality
Modules
Not enterprise
ready
Not production
ready
Not cloud ready Bad performance
Security

45. Urls
Database
Settings
Payment Provider
Configuration Feature
Flags…
Everything that’s
different between two
environments

46. Zettr

49. Every file is a potential
security risk
Don’t deploy anything
you don’t need to
operate the website

50. .git*
./htdocs/includes
./htdocs/downloader
./htdocs/pkginfo
./htdocs/LICENSE*
./htdocs/RELEASE_NOTES.txt
./htdocs/phpunit.xml*
./htdocs/*.sample
./htdocs/var
./htdocs/media
./.modman/Aoe_TemplateHints
./.modman/Aoe_Profiler
./.modman/EcomDev_PHPUnit
…

51. production,
staging,…
devbox and integration
environment

52. Vagrant
Boxes

53. Awesome
stuff
Every single
line potentially
can break
production!
Bratwurst
(Germans)
Donut
(Americans)
Pizza
(Italians)

54. master
Feature B
Feature A
Hotfix
(if master is not modified)
Hotfix
(if master is modified)
Feature C
build
install on
integration
tests
build
install on
integration
tests
install on
deploy
build
install on
integration
tests
deploy to
stage
deploy to
prod
build
install on
integration
tests
deploy to
stage
deploy to
prod
build
install on
integration
tests
deploy to
stage
deploy to
prod
single mainline
no commits,
only --no-ff
merges

55. Version Control
GIT, SVN,…
PHP lint

56. Version Control Code Reviews
Crucible,…

57. Version
Control
Code
Reviews
Build
Files
DB
Installer
Settings

58. Build
Files
ler
Settings
Static Code
Analysis
CodeSniffer
php-pmd
php-cpd
php-depend

59. Static Code
Analysis
Install on
“Integration”
First system where
code from all
developers/teams
meets each other
unstable system,
might be broken,
will be rebuilt
without warning

60. Install on
“Integration”
Unit Tests
PHPUnit

61. Unit Tests Integration Tests
AOE PMD
(for Magento)
broken links,
HTTP headers,
W3C validity,…
Test features that rely on other parts
(e.g. framework, external services,…)
External components
(SSL, Redis, Varnish,
ERP, Data Import,…)
Basically this is also
PHPUnit, but addressing
other things

62. Integration Tests Acceptance Tests
Selenium

63. Firefox
Chrome
browser
size
640
980
1280
1900
US
languagesUK DE FRIT

64. language
size
browser
touchstone job

65. Acceptance Tests
Install on
“Staging”
Behat,
PDIFF,…
Same setup as production,
but different machines
Client QA /
approval

66. Install on
“Staging”
Stress
Tests
JMeter
Spin up EC2
instances to
produce traffic

67. Again:
multiple servers or
autoscaling setup
Stress
Tests
Install on
“Production”
A/B
Deployments
on different
scales
Plan B:
rollback
Zero Downtime

71. Stress
Tests
Install on
“Production”

72. Deployment !=
Feature Release

73. Install on
“Production”
Enable Features

74. Version
Control
Code Reviews Build Static Code
Analysis
Install on
“Integration”
Unit Tests Integration
Tests
Acceptance
Tests
Install on
“Staging”
Install on
“Production”
Enable
Features

75. Pipeline Visualization
#284
#283
#282
#281
#280
Build
Static Code
Analysis
Unit
Tests
Install on
“Integration”
Integration
Tests
Acceptance
Tests
#285
for team dashboards

77. type “YESIKNOWWHATIMDOING” + click
automatically

78. http://joind.in/talk/view/15588

79. Follow me on twitter!
My blog