Nginx, PHP and Performance: Load Balancing and Caching

Nginx,
PHP,
Apache
and
Spelix
Harald
Zeitlhofer
October
2014
COMPANY CONFIDENTIAL 1 – DO NOT DISTRIBUTE #Dynatrace

Harald
Zeitlhofer
• Technology
Strategist
at
Dynatrace
• PHP
for
more
than
15
years
• Married,
2
kids
• Love
to
discover
new
things

Austria

Where
I’m
from…

Agenda
• MoNvaNon
• Nginx
• PHP-‐FPM
• IntegraNon
• Caching
• Load
balancing
• How
this
runs
in
Spelix

Nginx

• Lightweight
HTTP
server
• Fast
especially
at
high
load

Leading
among
top
10.000
websites

Nginx
SeTngs
• /etc/nginx/nginx.conf
# max_clients = worker_processes * worker_connections
worker_processes [number of CPUs];
worker_connections 1024;

Nginx
High
Load
• /etc/sysctl.conf
fs.file-max = 80000
• /etc/security/limits.conf
•
www-data soft nofile 40000
www-data hard nofile 70000
/etc/pam.d/su
session required pam_limits.so
• /etc/default/nginx
ULIMIT="-n 40000"

Nginx
High
Load
worker_processes 8;
worker_rlimit_nofile 40000;
events {
worker_connections 4096;
multi_accept on;
}
• 32768
concurrent
requests

PHP
FastCGI
Process
Manager

PHP-‐FPM
• FastCGI
Process
Manager
• Available
since
5.3.3,
stable
since
5.4.1
• Run
mulNple
PHP
worker
processes
to
serve
CGI
requests
• MulNple
connecNon
pools
• Different
php.ini
files
possible
• Very
helpful:
fastcgi_finish_request()

PHP-‐FPM
• InstallaNon
sudo apt-get install php5-fpm
• Pool
configuraNon
/etc/php5/fpm/pool.d/www.conf
[www]
user = www-data
group = www-data
listen = 127.0.0.1:9000 # for Unix socket: unix:/var/run/php5-fpm.sock;
root@hzvm01:/etc/nginx/sites-enabled# ps -ef | grep php
root 6435 1 0 14:39 ? 00:00:32 php-fpm: master process (/etc/php5/fpm/php-fpm.conf)
spelix 6439 6435 0 14:39 ? 00:00:00 php-fpm: pool batch
spelix 6440 6435 0 14:39 ? 00:00:00 php-fpm: pool batch
www-data 10576 6435 1 18:45 ? 00:00:48 php-fpm: pool www

PHP-‐FPM
• Process
Manager
[pool_name]
...
pm = [dynamic/static]
pm.max_children = 5
; only used for dynamic:
pm.start_servers = 2
pm.min_spare_servers = 1
pm.max_spare_servers = 3
pm.max_children
=
total
available
memory
/
memory
used
by
1
PHP
process

PHP-‐FPM
• Security
/etc/php5/fpm/php.ini
expose_php = Off
• Use
mulNple
configuraNons
/etc/init.d/php-fpm start
or
php-fpm -y /path/to/your/php-fpm.conf -c /path/to/your/php.ini

Nginx
and
PHP
/
IntegraNon

Nginx
and
PHP
• CommunicaNon
via
sockets
• TCP
vs
Unix
• Unix
slightly
faster
when
used
on
localhost
• Use
TCP
for
high
load
location ~* .php$ {
fastcgi_index index.php;
fastcgi_pass 127.0.0.1:9000;
include fastcgi_params;
fastcgi_param SCRIPT_FILENAME $document_root$fastcgi_script_name;
fastcgi_param SCRIPT_NAME $fastcgi_script_name;
}
fastcgi_pass unix:/var/run/php5-fpm.sock;

IntegraNon
• StaNc
content
to
be
served
by
Nginx
• Dynamic
requests
to
be
sent
to
PHP-‐FPM
server {
listen 80;
root /var/www/test;
index index.php index.html index.htm;
server_name test.whateveryourdomain.is;
location / {
try_files $uri $uri/ @notfound;
}
location ~ .(html|js|css|gif|jpg|jpe|jpeg|png|bmp|tif|pdf|ico)$ {
try_files $uri @notfound;
}
location ~* .php$ {
fastcgi_pass php;
}
locaation @notfound {
...
}
}

Nginx
–
PHP
transacNon
flow

PHAR
–
PHP
Archives
• Easy
way
to
deploy
your
applicaNon
• All
source
files
packed
into
one
*.phar
file
location ~* .(php|phar)$ {
fastcgi_pass 127.0.0.1:9000;
}

PHAR
example
root@hzvm01:/var/www/app/src# ls -lrtR
.:
total 8
drwxrwxr-x 2 root root 4096 Oct 10 16:27 lib
-rw-r--r-- 1 root root 27 Oct 10 16:27 index.php
./lib:
total 4
-rw-r--r-- 1 root root 87 Oct 10 16:27 App.php
root@hzvm01:/var/www/app/src# cat index.php
<?php
$app = new App();
?>
root@hzvm01:/var/www/app/src# cat lib/App.php
<?php
class App {
function __construct() {
echo "Starting Applicationn";
}
}

PHAR
Example
root@hzvm01:/var/www/app# phar pack -f myapp.phar src
lib/App.php
index.php
root@hzvm01:/var/www/app# l myapp.phar
-rw-r--r-- 1 root root 6923 Oct 10 19:51 myapp.phar
location /myapp {
fastcgi_pass 127.0.0.1:9000;
fastcgi_param SCRIPT_FILENAME $document_root/myapp.phar;
}

PHAR
execuNon

Performance

Benchmarking
Nginx
vs
Apache
• Nginx
running
with
default
seTngs
• Apache
• AllowOverride
None
• MulN-‐process
mode
to
allow
usage
of
mod_php

StaNc
HTML,
10k
requests,
concurrency
10
Server Software: Apache/2.4.7
Server Hostname: test.hzvm01
Server Port: 88
Document Path: /index.html
Document Length: 21 bytes
Concurrency Level: 10
Time taken for tests: 6.848 seconds
Complete requests: 10000
Failed requests: 0
Total transferred: 2660000 bytes
HTML transferred: 210000 bytes
Requests per second: 1460.25 [#/sec] (mean)
Time per request: 6.848 [ms] (mean)
Time per request: 0.685 [ms] (mean, across all concurrent requests)
Transfer rate: 379.32 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 2 0.9 2 24
Processing: 1 4 1.5 4 26
Waiting: 0 3 1.3 3 24
Total: 2 7 1.7 6 32
Percentage of the requests served within a certain time (ms)
50% 6
66% 7
75% 7
80% 7
90% 8
95% 9
98% 10
99% 12
100% 32 (longest request)
Server Software: nginx/1.4.6
Server Port: 80
Failed requests: 0
Connect: 0 2 1.1 2 31
Processing: 1 3 2.0 3 38
Waiting: 0 2 1.7 2 34
Total: 1 5 2.2 5 41
50% 5
66% 5
75% 5
80% 6
90% 6
95% 7
98% 9
99% 12

StaNc
HTML,
10k
requests,
concurrency
100
Server Port: 88
Failed requests: 0
Connect: 0 8 4.5 8 54
Processing: 15 45 18.5 51 120
Waiting: 12 42 18.7 49 108
Total: 26 53 18.2 58 132
50% 58
66% 60
75% 62
80% 64
90% 69
95% 87
98% 99
99% 105
Server Port: 80
Failed requests: 0
Connect: 9 23 4.4 23 40
Processing: 8 25 5.1 25 48
Waiting: 2 19 4.6 18 41
Total: 22 49 6.4 47 75
50% 47
66% 50
75% 52
80% 54
90% 58
95% 61
98% 64
99% 65

StaNc
HTML,
10k
requests,
concurrency
500
Server Port: 88
Failed requests: 0
Connect: 2 67 263.3 16 3050
Processing: 28 246 814.5 95 6605
Waiting: 21 240 814.9 90 6599
Total: 70 312 870.2 113 7556
50% 113
66% 130
75% 147
80% 158
90% 364
95% 1111
98% 3100
99% 6637
Server Port: 80
Failed requests: 0
Connect: 47 100 32.0 97 185
Processing: 50 110 36.1 108 231
Waiting: 20 82 30.3 76 188
Total: 119 210 57.8 220 334
50% 220
66% 248
75% 265
80% 271
90% 285
95% 293
98% 303
99% 306

StaNc
HTML,
10k
requests,
concurrency
1k
Server Port: 88
Failed requests: 0
Connect: 28 179 403.5 69 3106
Processing: 39 452 1262.7 117 6677
Waiting: 22 427 1267.6 91 6672
Total: 107 631 1447.3 182 9619
50% 182
66% 203
75% 258
80% 422
90% 1178
95% 3190
98% 7622
99% 7643
Server Port: 80
Failed requests: 0
Connect: 138 238 50.5 229 370
Processing: 72 269 59.7 257 514
Waiting: 62 195 58.3 184 377
Total: 338 507 56.0 518 651
50% 518
66% 541
75% 547
80% 551
90% 573
95% 580
98% 623
99% 638

Apache
vs
Nginx
(StaNc
HTML)
12
10
8
6
4
2
0
Apache/2.4.7
nginx/1.4.6
10
100
500
1000

Image
841
bytes,
10k
requests,
concurrency
500
Server Port: 88
Document Path: /images/plus.gif
Failed requests: 0
Connect: 0 63 273.3 7 3046
Processing: 19 229 815.9 80 6596
Waiting: 16 227 816.0 78 6596
Total: 54 293 881.4 88 7561
50% 88
66% 95
75% 104
80% 109
90% 318
95% 1094
98% 3289
99% 6623
Server Port: 80
Document Path: /images/plus.gif
Failed requests: 0
Connect: 55 119 22.0 118 183
Processing: 32 137 27.8 132 260
Waiting: 29 101 25.4 96 202
Total: 156 255 28.1 258 351
50% 258
66% 268
75% 275
80% 281
90% 288
95% 298
98% 310
99% 317

PHP,
1k
requests,
concurrency
500
Server Port: 88
Document Path: /index.php
Failed requests: 0
Connect: 0 25 30.0 1 68
Processing: 70 2344 4333.5 167 13205
Waiting: 69 2343 4333.4 165 13204
Total: 124 2369 4352.0 171 13264
50% 171
66% 211
75% 415
80% 7240
90% 13156
95% 13208
98% 13249
99% 13257
Server Port: 80
Failed requests: 0
Connect: 0 45 44.7 71 106
Processing: 72 643 708.7 204 3057
Waiting: 69 643 708.8 203 3057
Total: 163 688 732.1 227 3133
50% 227
66% 1147
75% 1215
80% 1249
90% 1380
95% 1433
98% 3128
99% 3131

PHP,
1k
requests,
concurrency
100
Server Port: 88
Failed requests: 0
Connect: 0 3 7.4 1 34
Processing: 34 112 23.2 107 250
Waiting: 29 111 22.8 106 249
Total: 49 116 22.6 109 250
50% 109
66% 115
75% 126
80% 133
90% 151
95% 157
98% 171
99% 192
Server Port: 80
Failed requests: 0
Connect: 0 5 10.3 1 76
Processing: 15 149 35.4 158 210
Waiting: 15 147 34.7 157 208
Total: 39 154 29.0 160 211
50% 160
66% 168
75% 173
80% 177
90% 185
95% 193
98% 200
99% 204

Apache
vs
Nginx
-‐
conclusion
• Nginx
faster
for
serving
staNc
files
• Apache
is
faster
for
serving
PHP
only
(low
load)

Nginx,
Apache
and
PHP

Nginx
–
more
performance
tweaks
• Setup
caching
and
disable
access
logging
expires 30d;
access_log off;
error_log off;
try_files $uri $uri/ =404;
}
• Change
Nmeouts
http {
keepalive_timeout 15;
client_body_timeout 12;
client_header_timeout 12;
send_timeout 10;
}

Caching

Caching
• Server
Side
• Opcode
cache
• Full
page
cache
• Pagelet
cache
• Data
cache
• Client
Side
• Browser
cache
• HTML5
applicaNon
cache
• HTML5
data
storage
(LocalStorage,
SessionStorage)

PHP
Opcode
Cache
• Integrated
Zend
OpCache
in
PHP
5.5
• Other
technologies
available
hjp://en.wikipedia.org/wiki/List_of_PHP_accelerators

PHP
OpCache
example

PHP
OpCache
disabled

PHP
OpCache
enabled

Full
page
cache
with
Nginx
and
Memcached
• ngx_hjp_memcached_module
server {
location / {
set $memcached_key "$uri";
memcached_pass host:11211;
error_page 404 502 504 = @fallback;
}
location @fallback {
proxy_pass http://backend;
}
}

Full
page
cache
with
Nginx
and
Memcached
• PHP
$ sudo apt-get install php5-memcached
<?php
…
function cachePage($content) {
$c = new Memcached();
$c->addServer('localhost',11211);
$c->set($_SERVER[”REQUEST_URI"], $content);
}
...
$content = $this->renderPage();
$this->cachePage($content);
...
?>

PHP,
5k
requests,
concurrency
100
Server Software: Nginx + PHP
Server Port: 80
Failed requests: 0
Connect: 0 2 3.2 1 38
Processing: 22 88 13.1 87 148
Waiting: 21 87 13.1 86 148
Total: 42 89 12.5 88 148
50% 88
66% 94
75% 97
80% 98
90% 104
95% 109
98% 125
99% 132

PHP,
5k
requests,
concurrency
100
Server Software: Nginx + Apache + PHP
Server Port: 81
Failed requests: 0
Connect: 0 10 17.0 2 138
Processing: 20 173 73.7 156 1254
Waiting: 19 168 72.3 152 1239
Total: 55 182 72.4 168 1254
50% 168
66% 197
75% 214
80% 224
90% 256
95% 287
98% 337
99% 427

PHP,
5k
requests,
concurrency
100
Server Port: 88
Failed requests: 0
Connect: 0 6 6.5 4 56
Processing: 30 138 57.2 120 938
Waiting: 30 135 56.4 117 937
Total: 55 144 55.8 126 938
50% 126
66% 151
75% 168
80% 178
90% 218
95% 239
98% 267
99% 299

PHP,
5k
requests,
concurrency
100
Server Software: nginx + Memcached
Server Port: 82
Failed requests: 0
Connect: 7 24 6.0 24 59
Processing: 8 36 7.8 36 75
Waiting: 6 28 7.4 29 69
Total: 32 60 9.3 60 101
50% 60
66% 63
75% 64
80% 66
90% 71
95% 80
98% 87
99% 92

Nginx
FastCGI
cache
• Part
of
the
Nginx
FastCGI
module
fastcgi_cache_path /etc/nginx/cache levels=1:2 keys_zone=APPKEY:100m inactive=60m;
fastcgi_cache_key "$scheme$request_method$host$request_uri";
location ~* .php$ {
fastcgi_pass 127.0.0.1:9000;
fastcgi_cache APPKEY;
fastcgi_cache_valid 200 60m;
}

TesNng
FastCGI
cache
<?php
echo time()."n";
?>
root@hzvm01:/var/www/test# curl http://test.hzvm01/index.php
1413229911
1413229912
1413229915
1413229917
1413229919
1413229921
1413229923
1413229925
1413229927
1413229929

TesNng
FastCGI
cache

TesNng
FastCGI
cache
• Config
for
cached
requests
running
on
port
83
root@hzvm01:/var/www/test# curl http://test.hzvm01:83/index.php
1413230226
1413230226
1413230226
1413230226
1413230226
1413230226
1413230226
1413230226
1413230226
1413230226

TesNng
FastCGI
cache

Pagelet
/
Data
cache
• Served
by
webserver
or
applicaNon
• Technologies
• Memcached
• FastCGI
cache
• APC
(alternaNve
PHP
cache)
• Redis

Client
Side
Caching
expires 30d;
access_log off;
error_log off;
try_files $uri $uri/ =404;
}
• HTML5
• applicaNon
cache
• LocalStorage
• SessionStorage

PHP,
5k
requests,
concurrency
100
Server Software: Nginx + FastCGI cache
Server Port: 83
Failed requests: 0
Connect: 11 23 5.3 22 46
Processing: 8 27 6.7 25 59
Waiting: 6 20 6.0 18 56
Total: 29 50 7.6 50 85
50% 50
66% 53
75% 55
80% 56
90% 61
95% 64
98% 67
99% 71

Load
balancing
• ngx_hjp_upstream_module
upstream php_loadbalancer {
server unix:/var/run/php5-fpm.sock weight=5;
server 192.168.56.12:7777 weight=2;
server 192.168.56.13:7777;
}
server {
listen 80;
root /home/www/test;
server_name test.hzvm01;
location / {
try_files $uri =405;
}
location ~ .php$ {
fastcgi_pass php_loadbalancer;
}
}

Load
balancing

Nginx
and
other
technologies

Nginx
security
server_tokens off;
location ~ /. {
access_log off;
log_not_found off;
deny all;
}

Spelix

Spelix
Technology
• PHP
ApplicaNon
• MySQL
• CouchDB
• Memcached
• Nginx
+
PHP-‐FPM
• HTML5
(LocalStorage,
Canvas,
ApplicaNon
Cache)
• JavaScript
(jQuery,
Leaflet
API)

Spelix

Nginx
and
other
technologies

Nginx
and
other
technologies
server {
server_name services.zitco.net;
listen 80;
location / {
proxy_set_header X-Real-IP $remote_addr;
proxy_set_header X-Forwarded-For $remote_addr;
proxy_set_header Host $host;
proxy_pass http://localhost:8080;
}
}

IntegraNon

Used
Tools
• Apache
Benchmark
• Dynatrace
ApplicaNon
Monitoring
• Free
Trial
for
30
days
• Free
for
developers
on
local
machine
• hjp://www.dynatrace.com
hjp://bitly.com/djrial

harald.zeitlhofer@dynatrace.com
@HZeitlhofer

Nginx, PHP and Performance: Load Balancing and Caching

Recommended

Recommended

More Related Content

What's hot

What's hot (19)

Viewers also liked

Viewers also liked (9)

Similar to Nginx, PHP and Performance: Load Balancing and Caching

Similar to Nginx, PHP and Performance: Load Balancing and Caching (20)

More from Harald Zeitlhofer

More from Harald Zeitlhofer (12)

Recently uploaded

Recently uploaded (20)

Nginx, PHP and Performance: Load Balancing and Caching