https://www.youtube.com/watch?v=ubQzzOcU-pU The story of how we integrated Node.js into the Netflix ecosystem. This talk was given at NodeDay 2014 @ Intuit. Image credits are as follow, which are free for non commercial use. If you would like your image removed, please let me know and I will update it. Images Oz The Great and Powerful http://www.themoviedb.org/movie/68728-oz-the-great-and-powerful/backdrops Puzzle of complexity https://www.flickr.com/photos/picturewendy/8365723674/ Blades https://www.flickr.com/photos/zagrobot/2731084578/ Question https://www.flickr.com/photos/weesen/3588493923 Dictionary https://ww2.distek.com/blog/mbsd-data-dictionary/ All The Things http://hyperboleandahalf.blogspot.com/2010/06/this-is-why-ill-never-be-adult.html Light Bulb Icon http://pixabay.com/p-151383/?no_redirect Light Bulb https://www.flickr.com/photos/joffi/5176923568/ Sandbox http://commons.wikimedia.org/wiki/File:Sandbox_with_toys_detail.JPG Chicken and Egg http://painwithjoy.blogspot.com/2013/03/chicken-or-egg-fms-or-digestive-trouble.html Kid Stormtrooper http://car-memes.com/these-are-not-the-droids-you-39-re-looking-for/ Prana backdrop http://breastcanceryogablog.com/tag/prana/ Batman and Robin I can’t remember where I found this image. Let me know if you find out! AFAIK, this is from the SDCC 08 convention. The Noun Project Jam designed by Joe Harrison from the thenounproject.com Tire designed by Ryan Spiering from the thenounproject.com Unsplash https://unsplash.imgix.net/uploads/14131528928453585b6dc/829d24cf?q=75&fm=jpg&s=eaf9f7f2b07eabc753b9ea3c7c65b2d7

1. Integrating
Node
into your ecosystem

2. hello world
Alex Liu
@stinkydofu
aliu@netflix.com

12. node.js

13. $ npm install service-discovery
npm ERR! 404 Not Found
$ npm install dynamic-config
npm ERR! 404 Not Found
$ npm install metrics-client
npm ERR! 404 Not Found

15. What is your goal?
answer the simple questions first.

16. “ I want
to use …

17. “ I want
to use node.js

18. “ I don’t want
to rebuild my
entire app

19. “ I want
to move
incrementally

20. “ I am going
off the
paved road

21. The 6 Step Plan
( aka, The Netflix Story™ )

22. 1
Identify your
ecosystem.

23. What does your
ecosystem look like?
your answer can make a difference!

24. monolithic application
A single-tiered software application in which
the user interface and data access code are
combined into a single program from a single
platform.

25. UI
business logic
data access logic
database

26. UI
business logic
data access logic

27. UI
business logic
data access logic

28. SOA (service oriented architecture)
A design pattern based on distinct pieces of
software providing application functionality
as services to other applications via a protocol.

29. UI
service
business logic
service service
business logic business logic

30. REST all the things!

31. service
service
service

32. service
service
service

33. service
service
service

34. service
service
service

35. 2
Use configurable
routing

36. reverse
proxy
/home
/test
service
service
service

37. Use a reverse proxy
as a configurable
routing layer.
top tip

38. /home
/profil e

39. Control
Test

40. 90%
10%

41. US
EU

42. ON

43. OFF

44. Avoid subdomains.
top tip

45. 3
Identify necessary
ecosystem services.

46. service discovery
discover, and be discovered

47. service discovery
> registration
> health check
> client discovery

48. configuration
configuration management on
a per environment basis

49. configuration
> storage
> (de-)centralized config
> dynamic config

50. metrics
observability is of the
utmost importance

51. metrics
> observability
> real time metrics
> monitoring
> alerts
> logging vs. metrics

52. build + deploy
determine your minimum
units of deployment

53. build + deploy
> VMs
> AMIs
> CI + CD
> Docker

54. What are our
options?

55. 4
Rebuild or reuse?

56. Measure success by the
cost of maintenance.
top tip

57. Rebuild

58. It’s an opportunity
for a fresh start.
Rebuild

59. Lightweight modules
are great for
prototyping.
Rebuild

60. Don’t rebuild your
entire ecosystem.
Rebuild

61. Chicken, meet Egg.

62. Reuse

63. You’re not
reinventing
the wheel.
Reuse

64. You can reduce
overall platform
maintenance cost.
Reuse

65. It’s a medium-term
migration strategy.
Reuse

66. You can stay focused
on your goal.
Reuse

67. > reverse proxy / configurable routing
> service discovery
> service client(s)
> configuration
> metrics
> build + deployment

68. But it’s not
JavaScript. :(

70. 5
Add a sidecar to
reuse existing code.

71. sidecar
A process which runs on instance along with
your application, hosting all the things
necessary for it to integrate seamlessly within
an existing ecosystem.

72. main process sidecar

73. J

74. main process sidecar

75. service
service
service

77. Don’t add new
functionality in
your sidecar.
sidecar top tip

78. Rebuild Reuse
> configuration
> metrics collection
> dynamic configuration
> configurable routing
> service discovery
> builds + deployment
> metrics reporting

79. Use light weight
modules.
sidecar top tip

80. [LIGHT]
config client
[FULL]
config client

81. [LIGHT]
config client
[FULL]
config client
http://127.0.0.1/config?id=configA&id=configB&id=configC

82. [LIGHT]
config client
[FULL]
config client config
service
http://127.0.0.1/config?id=configA&id=configB&id=configC

83. [LIGHT]
config client
[FULL]
config client
> serialization
> deserialization
> caching + TTL
> retries
> env logic
> REST calls
config
service

84. The sidecar is
a black box.
sidecar top tip

85. [LIGHT]
config client
[FULL]
config client
> serialization
> deserialization
> caching + TTL
> retries
> env logic
> REST calls
config
service

86. [LIGHT]
config client
> REST calls
config
service

87. [LIGHT]
config client
> REST calls
config
service

88. config
service
[FULL]
config client
> serialization
> deserialization
> caching + TTL
> retries
> env logic

89. metrics
[collection]
metrics
[reporting]

90. Watch your
resource
management.
sidecar top tip

91. inbound outbound

92. inbound outbound

93. inbound outbound

94. inbound outbound

95. Real time metrics
are a must.
sidecar top tip

96. Sidecar
Prana
https://github.com/Netflix/Prana

98. 6
node.js it up!

99. Don’t worry, I got it.

100. thank you
Alex Liu
@stinkydofu
aliu@netflix.com