rabbitMQ测评之修正版

1. Taste
jeff@techparty.org

2. What‘s a MQ

3. What‘s a MQ
queue

4. What‘s a MQ
message
queue

5. What‘s a MQ
message
Producer
queue

6. What‘s a MQ
Consumer
message
Producer
queue

7. Why MQ
De-couple
Higher performance
Another IPC

8. Why rabbitMQ?
Based on Erlang
Reliable
Highly available
Scalable
portable
Implemented AMQP Standard and More
100% OpenSource

9. I have a log system

10. register Login
logout
Log System
DataBase

11. register Login
log = getLog(request)
if log.type == ‘login’:
logout # balabala .......
if log.type == ‘register’:
# balabala .......
log.save()
Log System
DataBase

12. register Login
log = getLog(request)
if log.type == ‘login’:
logout # balabala .......
if log.type == ‘register’:
# balabala .......
log.save()
Log System
I need ...
1. better performance
2. cleaner code DataBase
3. easier to test
4. ....

13. Step1. work with Queue

14. Step1. work with Queue
.......
log = getLog(request)
channel.publish(None,‘log-queue’,None,log)

15. Step1. work with Queue
.......
log = getLog(request)
channel.publish(None,‘log-queue’,None,log)
def onLog(log):
if log.type == ‘login’:
# balabala
if log.type == ‘logout’:
# balabala
log.save()

16. Step1. work with Queue
.......
log = getLog(request)
channel.publish(None,‘log-queue’,None,log)
def onLog(log):
if log.type == ‘login’:
# balabala
if log.type == ‘logout’:
# balabala
log.save()

17. Step1. work with Queue
.......
log = getLog(request)
channel.publish(None,‘log-queue’,None,log)
def onLog(log):
if log.type == ‘login’:
yep. performance better now # balabala
but. that if log.type == ‘logout’:
codes still smell bad~~ # balabala
log.save()

18. step2. Split Queues
login
logout

19. step2. Split Queues
.......
log = getLog(request)
channel.publish(None,log.type,None,log)
login
logout

20. step2. Split Queues
....... def onLog(loginlog):
log = getLog(request) # balabala
channel.publish(None,log.type,None,log) loginlog.save()
login
logout

21. step2. Split Queues
....... def onLog(loginlog):
log = getLog(request) # balabala
channel.publish(None,log.type,None,log) loginlog.save()
login
logout
def onLog(logoutlog):
# balabala
logoutlog.save()

22. step2. Split Queues
....... def onLog(loginlog):
log = getLog(request) # balabala
channel.publish(None,log.type,None,log) loginlog.save()
login
logout
def onLog(logoutlog):
# balabala
What’s that guy?
logoutlog.save()

23. Say hi to Exchange

24. Direct Exchange

25. Fanout Exchange

26. Topic Exchange

27. step3. Share message
c#
x
login c1
P
x
c2
logout

28. step3. Share message
.......
log = getLog(request)
channel.exchange_declare(log.type,‘fanout’)
channel.publish(log.type,’’,None,log)
c#
x
login c1
P
x
c2
logout

29. step3. Share message
.......
log = getLog(request) def onLog(loginlog):
channel.exchange_declare(log.type,‘fanout’) # balabala
channel.publish(log.type,’’,None,log) loginlog.save()
c#
x
login c1
P
x
c2
logout

30. step3. Share message
.......
log = getLog(request) def onLog(loginlog):
channel.exchange_declare(log.type,‘fanout’) # balabala
channel.publish(log.type,’’,None,log) loginlog.save()
c#
x
login c1
P
x
c2
logout
def onLog(logoutlog):
# balabala
logoutlog.save()

31. Performance test
non-persist-mode
100000 msg
en-queue de-queue
10,000/s
7,500/s
5,000/s
2,500/s
0/s
128 512 1024 3072 10240

32. Performance tune
Parameters for multiple consumer toning:
QOS
consumer count
autoAck?

33. clustering to scale
Start rabbit nodes:
rabbit1$ rabbitmq-server
rabbit2$ rabbitmq-server

34. clustering to scale
create cluster:
rabbit2$ rabbitmqctl stop_app
Stopping node rabbit@rabbit2 ...done.
rabbit2$ rabbitmqctl reset
Resetting node rabbit@rabbit2 ...done.
rabbit2$ rabbitmqctl cluster rabbit@rabbit1
Clustering node rabbit@rabbit2 with [rabbit@rabbit1] ...done.
rabbit2$ rabbitmqctl start_app
Starting node rabbit@rabbit2 ...done.

35. clustering to scale
Check it out:
rabbit1$ rabbitmqctl status
Status of node rabbit@rabbit1 ...
[...,
{nodes,[{disc,[rabbit@rabbit1]},{ram,[rabbit@rabbit2]}]},
{running_nodes,[rabbit@rabbit2,rabbit@rabbit1]}]
...done.

36. Highly Available

37. discuss ......

38. Thank you
http://jeffkit.info
http://twitter.com/jeff_kit
jeff@techparty.org