Nowadays there are a lot of cloud providers, with a wide range of offers. Web projects usually have continuously changing needs: what worked well yesterday may not be enough today. These two facts became quite obvious for us in the last year while migrating a PHP application from Rackspace to Amazon. In this session I’d like to share this experience highlighting infrastructure and code evolution, migration steps, cost analisys, issues.

1. Hopping
a tale of migration from one cloud provider to another
in
Clouds

2. Michele Orselli
CTO@Ideato
_orso_
micheleorselli / ideatosrl
mo@ideato.it

9. Let’s start from the beginning…

10. What is the national sport in
Italy?

12. “Italians lose wars as if they were football
matches, and football matches as if they
were wars”
Winston Churchill

14. Peaks on gen - jun - aug up to 70 M pg/mth
Peaks during big matches

16. PaaS Platform as a Service
(almost) Zero configuration
Put the code “on the cloud” and you’re done

18. Hard limits on resource (e.g 50 db con)
Deploy via ftp (sf cache mess)
Blackbox: No realtime log, no access
PHP 5.3

19. Macro services

20. Web: the main web (sf1)
Mobile: mobile version (sf components)
Vxl: community site (sf2 v2.3)

21. Talk: api for comments, votes, ratings (sf2 v2.3)
Adv: api for ads serving (sf2 v2.3)
Media: api for images mgnt (sf2 v2.3)

23. The problems began with talk…

25. Quick wins
Tuning the http response headers
Caching more endpoints
Optimize queries

27. Tuning the HTTP Response

28. 1 $date = new DateTime();
2 $date->modify("+$lifetime seconds");
3
4 $response->setExpires($date);
5 $response->setMaxAge($lifetime);
6 $response->setSharedMaxAge($lifetime);

31. the first candidate for migration was… the talk app

33. PHP from 5.3 to 5.6
Mysql from 5.0 to 5.6
Apache to nginx (+ php fpm)

34. Web servers ip are dynamic
Can connect only through bastion
Share session between servers

35. Web servers ip are dynamic
Can connect only through bastion
Share user sessions between servers

36. 1 'hosts' => function () {
2 $c = Ec2Client::factory([
3 'profile' => 'calciomercato',
4 'region' => 'eu-central-1',
5 ]);
6
7 $ips = new GetInstancesIps($c);
8
9 return $ips->execute();
10 }

37. 1 public function execute()
2 {
3 $instances = $this->ec2Client
4 ->describeInstances(
5 [
6 'DryRun' => false,
7 'Filters' => [
8 [
9 'Name' => 'instance.group-name',
10 'Values' => ['Web Public Auto-assign SG'],
11 ],
12 ],
13 ]);
14
15 return $instancesDescription->getPath(
16 'Reservations/*/Instances/*/NetworkInterfaces/*/
PrivateIpAddresses/*/PrivateIpAddress'
18 );
19 }

38. Web servers ip are dynamic
Can connect only through bastion
Share user sessions between servers

39. 1 Host cmbastion
2 HostName xx.xx.xx.xx
3 User ec2-user
4 Port 9760
5 StrictHostKeyChecking no
6 UserKnownHostsFile /dev/null
7 IdentityFile ~/.ssh/cm_bastion.pem
8 LogLevel quiet

40. 10 Host 10.0.14.*
11 User centos
12 StrictHostKeyChecking no
13 UserKnownHostsFile /dev/null
14 IdentityFile ~/.ssh/cm_production.pem
15 ProxyCommand ssh -W %h:%p cmbastion
16 LogLevel quiet
17
18 Host 10.0.24.*
19 User centos
20 StrictHostKeyChecking no
21 UserKnownHostsFile /dev/null
22 IdentityFile ~/.ssh/cm_production.pem
23 ProxyCommand ssh -W %h:%p cmbastion
24 LogLevel quiet

41. Web servers ip are dynamic
Can connect only through bastion
Share users sessions between servers

42. Nginx static cache

43. 1 fastcgi_cache_key
"$scheme$request_method$host$request_uri";
2 fastcgi_cache_lock on;
3 fastcgi_cache_revalidate on;
4 fastcgi_cache_valid 3m;

44. 1 if ($request_method ~ ^(POST|PUT|DELETE)$ ) {
2 set $no_cache 1;
3 }
4
5 if ($request_uri ~* "/api/queue") {
6 set $no_cache 1;
7 }
8
9 location ~ ^/(app|dev).php(/|$) {
[..]
17
18 # Enable fastcgi_cache
19 add_header X-Cache $upstream_cache_status;
20 fastcgi_cache CALCIOMERCATO_TALK;
21 fastcgi_cache_bypass $no_cache;
22 fastcgi_no_cache $no_cache;
23 }

45. 8
9 location ~ ^/(app|dev).php(/|$) {
10 fastcgi_split_path_info ^(.+.php)(/.*)$;
11 include fastcgi_params;
12 fastcgi_param SCRIPT_FILENAME $realpath_root
$fastcgi_script_name;
13 fastcgi_param DOCUMENT_ROOT $realpath_root;
14 fastcgi_param HTTPS off;
15 fastcgi_index app.php;
16 fastcgi_intercept_errors on;
17
18 # Enable fastcgi_cache
[..]
23 }

46. Load test using old logs
Create AMI Images
Deploy latest version of the code
Switch dns

50. Now we have the platform running on
two clouds: RCS and AWS

51. Adv

52. Only stateless apis
Small database small traffic
Infrastructure was already set
Easy peasy

53. Created 1 Cloudfront distribution
dynamic content (adv.calciomercato.com)

55. Mobile

56. No database, it consumes data from
other services
High impact, 40% of the total traffic

57. How to deal with static assets?

58. s3://com-calciomercato-cdn-mobile/

59. Created 2 Cloudfront distribution
dynamic content (m.calciomercato.com)
static content (cdnmobile.calciomercato.com)

60. Sync asset to s3 via s3cmd
s3cmd
-m text/javascript
--no-preserve sync
/var/www/mobile/content/js
s3://com-calciomercato-cdn-mobile/

61. Deploy on a sample machine
Performance test based on log
Deploy
Rebuilding AMI
Switch DNS

62. Community

63. Allows uses to create their own personal blog
First app that can be considered “complete”
Exposes api for user related stuff
Works as SSO

64. Web servers ip are dynamic
Can connect only through bastion
Share users sessions between servers

66. 1 services:
2 memcache:
3 class: Memcache
4 calls:
5 - [ addServer, [%memc_host%, %memc_port% ]]
6 session.handler.memcache:
7 class:
8 SymfonyComponentHttpFoundationSession
StorageHandlerMemcacheSessionHandler
10 arguments: [
11 @memcache,
12 { prefix: %session_memcache_prefix%,
13 expiretime: %session_memcache_expire% }
14 ]

67. 1 framework:
2 session:
3 handler_id: %session_handler_id%

68. Deal with User Generated Content

69. Created 2 Cloudfront distributions
dynamic content (vxl.calciomercato.com)
static content (cdnvxl.calciomercato.com)

70. Gaufrette
Filesystem abstraction layer
http://knplabs.github.io/Gaufrette/

71. 1 knp_gaufrette:
2 adapters:
3 photo_storage:
4 aws_s3:
5 service_id: cdn.amazon_s3
6 bucket_name: %amazon_s3_bucket_name%
7 options:
8 directory: data
9 filesystems:
10 photo_storage:
11 adapter: photo_storage
12 alias: photo_storage_filesystem
13

72. 8 cdn.amazon_s3:
9 class: AwsS3S3Client
10 factory_class: AwsS3S3Client
11 factory_method: 'factory'
12 arguments:
13 -
14 key: %cdn.amazon_s3.aws_key%
15 secret: %cdn.amazon_s3.aws_secret_key%
16 region: eu-central-1

73. 7 class PhotoUploader
8 {
[..]
27 public function upload(File $file, $dir)
28 {
29 $fullPath = $dir.'/'.$file->getFilename();
30
31 if (!in_array($file->getMimeType(), self::$allowedTypes)) {
32 throw new InvalidArgumentException($file->getMimeType());
35 }
36
40 return $this->filesystem->write(
41 $fullPath,
42 file_get_contents($file->getPathname())
43 );
44 }

74. 7 class PhotoUploader
8 {
[..]
27 public function upload(File $file, $dir)
28 {
29 $fullPath = $dir.'/'.$file->getFilename();
30
31 if (!in_array($file->getMimeType(), self::$allowedTypes)) {
32 throw new InvalidArgumentException($file->getMimeType());
35 }
36
40 return $this->filesystem->write(
41 $fullPath,
42 file_get_contents($file->getPathname())
43 );
44 }
return $this->filesystem->write(
41 $fullPath,
42 file_get_contents($file->getPathname())
43 );

75. Deploy on a sample machine
Performance test based on log
Deploy
Rebuilding AMI
Copy User Assets on S3
Switch DNS

77. Web

78. Oldest and biggest codebase
Proxy for mobile calls
High traffic 60%

79. PHP 5.6 not supported by symfony 1

80. Plan A: try to upgrade sf1 to support php 5.6
Plan B: deploy web on different machines

81. https://github.com/LExpress/symfony1

82. 1 protected function camelize($text)
2 {
3 return preg_replace(array('#/(.?)#e', '/(^|_|-)+(.)/
e'), array("'::'.
4 strtoupper('1')",
"strtoupper('2')"), $text);
5 }
6
7 public static function camelize($text)
8 {
9 return strtr(ucwords(strtr($text, array('/' =>
10 ':: ', '_' => ' ', '-' => ' '))),
array(' ' => ''));
11 }

83. Created 1 Cloudfront distribution
static content (cdnweb.calciomercato.com)

84. https://blog.cloudflare.com/zone-apex-naked-domain-root-domain-cname-supp/
calciomercato.com => cmelb-463612445.eu-central-1.elb.amazonaws.com

85. Deploy on a sample machine
Performance test based on log
Deploy
Rebuilding AMI
Switch DNS

87. Media

88. Only stateful api
Handles image thumbailing
Pretty big archive (70GB)

89. 1 public function generateThumbAndUploadToCdn(File $file, $width,
$height)
2 {
3 $downloadedFile = $this->downloadFromFileManager($file);
4
5 $cdnKey = $this->generateThumbCdnKey($file, $width, $height);
6 $resizedFile = $this->resizeFilesystemImage($downloadedFile,
$width, $height);
8
9 $optimizedFile = $this->optimizeImage($resizedFile);
10
11 $this->uploadFileToCdn($optimizedFile, $cdnKey)
12
13 $this->updateFileInfoTumbs($file, $width, $height, $cdnKey);
14
15 $this->deleteTemporaryFile($downloadedFile);
16 $this->deleteTemporaryFile($optimizedFile);
17
18 return true;
19 }

90. Transfer from Rackspace CDN to S3

91. #!/bin/bash
login="USERNAME_FTP"
pass="FTP_PASSWORD"
host="HOST_FTP_RACKSPACE"
remote_dir='/web/content/data'
local_dir=“/var/www/vhosts/media.calciomercato.pro/data"
base_name="$(basename "$0")"
lftp -u $login,$pass $host << EOF
set ftp:ssl-allow no
set mirror:use-pget-n 5
mirror -c -P5 --log="/var/log/$base_name.log"
"$remote_dir" "$local_dir"
quit

93. 1 public function slugifyFilename($text)
2 {
3 $text = preg_replace('~[^pLd]+~u', '.',
$text);
4 $text = trim($text, '-');
5
6 if (function_exists('iconv')) {
7 $text = iconv('utf-8', 'us - ascii//
TRANSLIT', $text);
8 }
9
10 $text = preg_replace('~[^-w.]+~', '', $text);
11
12 return $text;
13 }

96. Full migration took 1 year
from april 2015 to march 2016

97. 50% cost reduction

98. This talk is not about blaming RCS…

99. …simply it wasn’t suitable anymore
for our needs :-)

101. macro services FTW!
HTTP cache helped us a lot!
measure measure measure

102. Rationalizing api: less call, less $$$
Reorganize frontend stuff
Get rid of sf1
Upgrading to php7

103. Michele Orselli
CTO@Ideato
_orso_
micheleorselli / ideatosrl
mo@ideato.it
Thank you!
https://joind.in/talk/1cf3c
Thanks to @dennais, @paolo, @alemazz, @ricfrank