1. node.js
production site architecture

2. About me
Ben Lin
A full time entrepreneur & JavaScript lover
Fall in love with node.js on Jun 2011
dreamerslab.com
ben@dreamerslab.com
twitter.com/dreamerslab
github.com/dreamerslab

3. About me
COKE - Full stack node.js MVC framework
Vodka - Functional testing framework
Thunder - The lightning fast template engine
https://github.com/dreamerslab

5. Agenda
1. Super brief intro to node.js
2. Run node as a service
3. What if it crashes?
4. Monit VS Forever
5. Nginx or not
6. Scaling node.js
7. Deployment
8. Cloud service
9. Some useful tips
10. Q & A

6. What is node?
node is an evented, non-blocking I/O
server-side Javascript built on chrome V8

7. What is node?
Ryan Dahl talks about the history of
node.js
http://www.youtube.com/watch?v=SAc0vQCC6UQ

8. What is node?
But why node?
* node is fast
* node handles a lot of connection with very little resources
* You can develop your whole app with one language
* Easy to scale

9. What is node?
Achieves this by all making network I/O
nonblocking and all file I/O asynchronous.

10. What is node?
I/O latency
L1: 3 cycles
L2: 14 cycles
RAM: 250 cycles
DISK: 41,000,000 cycles
NETWORK: 240,000,000 cycles

11. What is node?
What’s wrong with PHP, Ruby, Python, etc...?

12. Run node as a service
Run your node app as daemon with upstart

13. Run node as a service
# Start your app
start your_app_name
# Stop your app
stop your_app_name
# Restart your app
restart your_app_name

14. What if it crashes?
Every little shit can fuck up your node app

15. Monitor your node app
Installation on Ubuntu
$ sudo apt-get install monit
Edit configs
* edit /etc/default/monit and set the "startup" variable to 1
* edit /etc/monit/monitrc and use the example file monitrc
Run
$ sudo /etc/init.d/monit start
$ sudo monit start your_app_name

16. Monit VS Forever

17. Monit VS Forever
With `forever` we kind of use an unstable
tool to monitor another unstable project?!

18. Nginx or not?
* Nginx runs faster with serving static files
* Use it as a reverse proxy to load balance with
multiple nodes

19. Scaling node.js

20. Scaling node.js
Start small with built-in static server, node.js app & database all on the same server.

21. Scaling node.js
Use nginx as static server for better performance.

22. Scaling node.js
Use nginx as as proxy server as well to load balance requests.
The number of node.js app instance depends on how many CPU cores on the machine.

23. Scaling node.js
Split static files to different server for easier maintenance.

24. Scaling node.js
Use aws S3 for easier setup and maintenance.

25. Scaling node.js
Split database to another server. Make the node.js app server an unit.

26. Scaling node.js
Add a load balancer, add more app unit as the site scales up.

27. Scaling node.js
Add replica set if the database hits its limit.

28. Scaling node.js
Add CDN for static files for cross reign performance.

29. Scaling node.js
Split app to difference services as it scales up. Previous scaling steps apply to those services too.

30. Deployment

31. Deployment
With ssh, git; The server must stop during deployment.

32. Deployment
With ssh, git; 0 downtime deployment is possible since we have more than 1 instance( repo ).

33. Deployment
With ssh, git; Split static file makes it easier to deploy with multi instance( repo ) app.

34. Deployment
Deploying with multi machine it’s better to use image files on aws ec2.

35. Cloud service

36. Cloud service
How about using services like Heroku,
Nodejitsu, mongoHQ?

37. Some useful tips

38. Some useful tips
Set your max file limit
sudo vi /etc/security/limits.conf
# add the following 4 lines
root soft nofile 51200
root hard nofile 51200
* soft nofile 51200
* hard nofile 51200
sudo vi /etc/pam.d/common-session
# add
session required pam_limits.so
sudo vi /etc/profile
# add
ulimit -SHn 51200

39. Some useful tips
This ensure that your node app never dies but
use with care
process.on('uncaughtException', function (e) {
console.dir(e);
});

40. THE END
Thanks

41. QUESTIONS?

42. HIRING
Web & iOS Dev
Your Github account speak for you,
Please mail to job@woomoo.in