My talk at QCon São Paulo 2010. In that opportunity, I talked about possible uses of the "automatable" infrastructure provided by most cloud vendors (like Locaweb, Amazon and Rackspace).

1. Usando o Cloud
como desenvolvedor!
@fabiokung
fabio.kung@gmail.com
fabio.kung@locaweb.com.br

2. Como usar
tudo isso?

3. Administração Remota

4. Gerenciador
...
DHCP Proxy Firewall

5. Gerenciador
WS WS WS WS WS WS WS WS WS
...
DHCP Proxy Firewall

6. Gerenciador
WS WS
WS WS WS WS WS WS WS WS WS
...
DHCP Proxy Firewall

7. Gerenciador
WS WS
WS WS WS WS WS WS WS WS WS
...
DHCP Proxy Firewall

8. Gerenciador
WS WS
Autenticação?
Monitoração?
Criptografia?
...
WS WS WS WS WS WS WS WS WS
...
DHCP Proxy Firewall

9. Gerenciador
WS WS
ESB
WS WS WS WS WS WS WS WS WS
...
DHCP Proxy Firewall

10. Gerenciador
WS WS
ESB
WS WS WS WS WS WS WS WS WS
...
DHCP Proxy Firewall

11. Gerenciador
WS WS
ESB
WS WS WS WS WS WS WS WS WS
...
DHCP Proxy Firewall

12. KISSH

13. Gerenciador
Logica
sudoers,
pub/priv keypairs
SSH SSH SSH
...
DHCP Proxy Firewall

14. SSHService

15. require "net/ssh"
Net::SSH.start("host", "user", options) do |ssh|
ssh_result = ssh.open_channel do |channel|
channel.exec command
channel.on_data do |ch, data|
ch[:out] << data
end
channel.on_request("exit-status") do |ch, req|
ch[:status] = req.read_long
end
end
ssh.loop
end

16. one master, several slaves

17. Gerenciador
Hypervisor Hypervisor Hypervisor ...

18. Load Balancer
Proxy Reverso
WebServer WebServer WebServer ...

19. APIs

20. http://deltacloud.org

21. a unified interface to the cloud
libcloud is a standard client library for many popular cloud providers,
written in python

22. http://github.com/geemus/fog

23. http://github.com/jclouds/jclouds
http://dasein-cloud.sourceforge.net/

24. http://openstack.org

25. Gerenciador
e com muitos nós?
Hypervisor Hypervisor Hypervisor ...

26. Árvore de requisições

27. Gerenciador
Agregador Agregador
Worker Worker Worker Worker Worker ...

28. o informante
canary requests

29. backup requests
volume

30. many internal services
"break large complex systems down into many services"
-- Google

31. self-test boot
dependências

32. Comunicações
REST, Protocol Buffers, Thrift

33. Controle de tarefas
Mundo Assíncrono
filas no DB? :-(

34. process :of => :uninstall do
must_be :uninstalling
transition :power_off_if_needed,
:from => :uninstalling,
:to => :powered_off
transition :delete_snapshots,
:from => :powered_off,
:to => :snapshots_deleted
transition :delete_disks,
:from => :snapshots_deleted,
:to => :disks_deleted
transition :delete_machine,
máquinas de estado
:from => :disks_deleted,
:to => :machine_deleted

35. Resque

36. tolerate failures
Jason McHugh, Principal Engineer at Amazon

37. back of the envelope
calculations
thumbnails

38. Cache!
disco, virtualização

40. Instant Messaging

41. XMPP JIDs
username@domain /resource

42. fabiokung@servidor

43. machine01@servidor
machine02@servidor
fabiokung@servidor
machine03@servidor

44. installer@servidor
cloner@servidor
fabiokung@servidor
uninstaller@servidor

45. XMPP4R
http://home.gna.org/xmpp4r

46. múltiplos workers
installer@servidor
...
frontend@servidor
installer@servidor

47. frontend@servidor installer@servidor/A
...
installer@servidor/B

48. quem pode?
to: installer@servidor
frontend@servidor installer@servidor/A
...
installer@servidor/B

49. quem pode?
to: installer@servidor
installer@servidor/A
frontend@servidor eu posso!
from: installer@servidor/A
...
eu posso!
from: installer@servidor/B
installer@servidor/B

50. quem pode?
to: installer@servidor
installer@servidor/A
frontend@servidor eu posso!
from: installer@servidor/A
...
eu posso!
from: installer@servidor/B
ok, então instala!
to: installer@servidor/B
installer@servidor/B

51. quem pode?
to: installer@servidor
installer@servidor/A
frontend@servidor eu posso!
from: installer@servidor/A
...
...
eu posso!
from: installer@servidor/B
ok, então instala!
to: installer@servidor/B
frontend@servidor installer@servidor/B

52. presença,
pubsub...

53. Configuration
Management

54. •Puppet
•Chef
•CFEngine

55. Chef

56. recipes
chef-client
recipes
chef-server recipes chef-client
chef-client

57. file "/etc/myapp.conf" do
owner www-data
group www-data
mode "0600"
action :create
end
package "mysql-server" do
action :install
end
execute "open http port" do
command "iptables -I INPUT -p tcp --dport 80 -j ACCEPT"
creates "/var/run/http_port_opened"
end

58. package "sudo" do
action :upgrade
end
user "sshservice" do
system true
action :create
end
template "/etc/sudoers" do
source "sudoers.erb"
mode 0440
owner "root"
group "root"
variables(:user => "sshservice")
action :create
end

59. bundle common control
{
bundlesequence => { "ssh" };
inputs => { "cfengine_stdlib.cf" }
}
bundle agent ssh
{
packages:
"sudo"
package_policy => "add"
package_method => "deb"
files:
"/etc/sudoers"
edit_defaults => empty,
edit_line => expand_template("sudoers.in"),
perms => mog("0440", root, root),
create => "true";
methods:
"sshservice" usebundle => create_user("sshservice")
}

60. http://cookbooks.opscode.com
http://github.com/37signals/37s_cookbooks
http://github.com/engineyard/ey-cloud-recipes

61. Snapshots

62. clones

63. Testes
multiplos browsers, drivers, ...

64. Multiplos envs
dev, staging, preproduction, integration, production, ...

65. Blue Green
deployments
http://martinfowler.com/bliki/BlueGreenDeployment.html

66. continuous Deployment

67. Capistrano
maven, ant, make, ...

68. Chef?
deploy "/srv/my-cms" do
repo "git://github.com/radiant/radiant.git"
revision "HEAD"
user "cms"
migrate true
migration_command "rake db:migrate"
environment "production"
action :deploy
restart_command "touch tmp/restart.txt"
end

69. Pacotes!
deb, rpm, ...

70. require'drb';F,D,C,P,M,U,*O=File,Class,Dir,*ARGV;def s(p)F.split(p[/[^|].*/])[-1
]end;def c(u);DRbObject.new((),u)end;def x(u)[P,u].hash;end;M=="client"&&c(U).f(
x(U)).each{|n|p,c=x(n),c(n);(c.f(p,O[0],0).map{|f|s f}-D["*"]).each{|f|F.open(f,
"w"){|o|o<<c.f(p,f,1)}}}||(DRb.start_service U,C.new{def f(c,a=[],t=2)c==x(U)&&(
t==0&&D[s(a)]||t==1&&F.read(s(a))||p(a))end;def y()(p(U)+p).each{|u|c(u).f(x(u),
p(U))rescue()};self;end;private;def p(x=[]);O.push(*x).uniq!;O;end}.new.y;sleep)
http://ansuz.sooke.bc.ca/software/molester/2004121602.php
P2P

71. build process generating
images
Michael T. Nygard - “Release It”

72. Multitenancy
chargeback, isolamento, segurança

73. • novas linguagens (programação e consulta)
• preprocessador/otimizador de queries
• analise continua de logs
• monitoramento de queries executadas no banco

74. Gregos e Troianos
• clients must be demanding 8 different things;
• doing 6 of them is easy;
• handling 7 of them requires real thought;
• dealing with all 8 usually results in a worse system;

75. Game Days
“be prepared”

76. Dúvidas?
fabio.kung@gmail.com
fabio.kung@locaweb.com.br Obrigado!
http://twitter.com/fabiokung