The adoption of Cloud Computing Solutions in datacenters worldwide has proven to be the right path, as it reduces costs, automates operation tasks and improve time-to-market for newly developed applications. However, cloud solutions are still in an early stage and do not meet all requirements for company environments, especially those with high capacity With that in mind, Globo.com embraced an open cloud solutions, Cloudstack, and began developing together with the community to fulfill all its high availability, high capacity and high throughput requirements. Integration between Cloudstack and Globo.com’s infrastructure happens in all levels, with an special attention to network equipment management, DNS automation and load balancing.

1. globo .com
Orchestrating Shared
Networks, Physical LB
and DNS on Cloudstack

2. Team

5. Broadcast TV Books and Magazines Music Movies
Pay TV Newspsaper Music Internet

6. Globo.com
‣ 2 Datacenters
‣ Rio de Janeiro (Main Datacenter)
‣ São Paulo (CDN)
‣ More than 1 Tbps of internet connectivity
‣ More than 2000 Servers
‣ More than 400 Developers

7. New DataCenter in Rio (2015-03)
‣ Capacity for more than 10000 servers

8. Globo.com
‣ We are a technology company
‣ Developers and Services providers for:
‣ Content Management System (CMS)
‣ Internet Infra Structure
‣ Connectivity
‣ Hosting
‣ CDN
‣ Information Security
‣ New Technologies (Private Cloud and PaaS)

9. IaaS at Globo.com
‣ CloudStack
‣ Private Cloud
‣ Launched in Jan/2014
‣ opensource.globo.com

10. Setup of ACS
‣ Advanced Zone Type
‣ Shared Networks
‣ XenServer 6.2
‣ ACS Version 4.3+

11. DNS Integration

12. DNS on unmodified ACS
News APP Network
VR's name resolution is only within network
MySQL Network
Virtual Router
(DHCP, DNS)
News MySQL
VR's name resolution is only within network
Virtual Router
(DHCP, DNS)
Internal DNS
delegate
delegate
Who Is
news.mysql.globo.com?
News App

13. GloboDNS
‣ Manage Bind Server
‣ Fork of PowerDNS on Rails
‣ HTTP(S) API
‣ Import data from Bind
‣ Open Source
‣ https://github.com/globocom/GloboDNS

14. GloboDNS plugin
Now the name "news.mysql.globo.com" is globally
available to all networks

15. With GloboDNS plugin
Internal DNS
Naming resolution Naming resolution
MySQL Network News APP Network
X X
news.mysql.globo.com
Virtual Router
(DHCP, DNS)
Virtual Router
(DHCP, DNS)
newsapp.globo.com

16. Creating a new domain
is easy using templates

17. Administrators
are responsible
for managing
complexity

18. Load Balancer

19. LB on unmodified ACS

20. LB with GloboNetworkAPI
‣ LB IP in different network
‣ Doesn't work as LB in ACS
‣ Uses new commands
‣ Hardware-based
‣ GloboNetworkAPI abstract hardware
‣ Usually LB have public IPs, not VMs

21. LB with GloboNetworkAPI

22. Shared Networks

23. Shared Networks
Unmodified ACS With GloboNetwork

24. Shared Networks

25. GloboNetworkAPI

26. What is GloboNetworkAPI?
‣ Open Source REST API for IP Networking Control
‣ Automates provisioning of network resources
‣ Vendor agnostic
‣ Plugin based

27. Features
‣ Cabling documentation (patch-panels/DIO’s capability)
‣ Layer 2 documentation (vlan)
‣ Layer 3 documentation (IP networks)
‣ Automatic allocation of Vlans, Networks and IP’s
‣ IPv6 support
‣ ACL (access control list) documentation/versioning/applying
‣ Load-Balancer support
‣ Automated equipment configuration (plugin based)
‣ User/Equipment Group based authorization

28. Globo NetworkAPI
‣ globonetworkapi.rtfd.org
‣ globonetworkapi-webui.rtfd.org
‣ globonetworkapi-client-python.rtfd.org
‣ https://github.com/globocom/GloboNetworkAPI-client-
java

29. Environment

30. Globo NetworkAPI
‣ Environment:
‣ Vlan/IP network usable range
‣ Templates for equipment configuration (plugins)
‣ Resources allocated/deployed on demand

31. Environment Config

32. Environment Config

33. Tradicional DC Infrastructure

34. GloboNetworkAPI + ACS
‣ Zones per type of traffic
‣ Type of traffic defines the Environments
‣ ACS maps zones to environments
‣ Xen Servers with tagged vlans (802.1Q)

35. Virtualized DC Infrastructure

37. Globo NetworkAPI Load
Balancer
‣ Load balancer has its own environment
‣ In front of VM networks
‣ LB across zones
‣ LB as an additional plugin on Cloudstack

38. GloboNetworkAPI WebUI

39. Roadmap
‣ On ACS
‣ Integrating with baseline (GloboDNS on 4.5?)
‣ OAuth2 (in progress)
‣ ACL API
‣ IPv6 Support
‣ Native Load Balancer Support

40. References
‣ opensource.globo.com
‣ https://github.com/globocom/GloboDNS
‣ https://github.com/globocom/cloudstack
‣ globonetworkapi.rtfd.org
‣ https://cwiki.apache.org/confluence/display/CLOUDSTACK/Bind
+and+PowerDNS+integration+by+Globo+DNSAPI

41. Maurício Kilikrates A N dos Anjos <mkilikrates@corp.globo.com>
Silvano Nogueira Buback <silvano@corp.globo.com>
Marcus Vinicius Gonçalves Cesário <marcus.vinicius@corp.globo.com>
Questions?
iaas@corp.globo.com
We are hiring
https://github.com/globocom/IWantToWorkAtGloboCom