AWSKRUG #architecture 모임 2019년 3월 28일

1. ON-PREMISE
IOT
AWS -

2. Experience
• ZOYI AdbyMe (2012 ~ 2014)
• AdbyMe:
• AdbyMePlay:
• Cooki:
• CarryU:
• ZOYI Corperation CTO of WI (2014 ~ current)
• (Walkinsight):
• (Walkin):
Technical Experience
• Ruby On Rails, Dropwizard, Spring, Play, React
• Kubernetes, Kops, Docker, Terraform
• Kafka, Storm, Hbase, Hadoop, Spark
• https://stackshare.io/kty1965/job-stack
• https://github.com/kty1965

3. WALK INSIGHTS

4. ©ZOYI Corporation
https://zoyi.co
©Walkinsights
https://walkinsights.com

6. - 24 , 365

7. - 24 , 365

8. S
A
L
E
34%
55%
2
VMD
15%
72%
(FUNNEL)
12% 8%

9. ©ZOYI Corporation
https://zoyi.co
©Walkinsights
https://walkinsights.com
ON-PREMISE

10. AS IS REQUIREMENTS
5000
WIFI TPS 4 ~ 5000 , 2MB
Batch Job
State

11. !

13. 2014 MVP .

14. OPENWRT REST API

15. MVP …
command async
WIFI signal Debugging
HTTP , overhead
http, https port

16. !

17. ?
RabbitMQ
• Queue
Web socket RabbitMQ produce
Java Worker(by RabbitMQ client) consume

18. …

19. RABBITMQ
Consume rate produce rate
Queue size
Memory Produce rate

20. ,

21. KAFKA
LinkedIn
High-throughput
Distributed
Low Latency
Scalability
Fault-Tolerant
Durability
High Concurrency
Consumer Friendly
RabbitMQ

22. STORM
Twitter
Scalability
Low latency
Reliable
Easy to operate
Data guarantee
Java consumer

27. ON-PREMISE IDC

29. ,
• CPU
• Memory
• Board
,
• Raid
• Network card
• throughput
• Ip

30. AWS .

31. ©ZOYI Corporation
https://zoyi.co
©Walkinsights
https://walkinsights.com
AWS -

33. AWS IOT CORE
MQTT
MQTT via WebSocket

34. AWS IOT CORE
MQTT (Message Queue Telemetry Transport)
Pub/Sub

35. AWS IOT CORE
Topic pub/sub
room/A/sensors/:uuid_a/temperature
room/A/sensors/:uuid_b/moisture
room/B/sensors/:uuid_c/temperature
Wildcard
• #:
• +:
topic
• $aws/events/presence/connected/clientId
• $aws/events/presence/disconnected/clientId
• $aws/things/thingName/shadow/get
• $aws/rules/ruleName
• …
MQTT (1/2)

36. QoS(Quality of Service)
• 0: at most once
• 1: at least once
• 2: exactly once
AWS Qos 0,1
AWS IOT CORE
MQTT (2/2)

37. AWS IOT RULE
AWS IoT MQTT
SQL
• Sns
• Sqs
• S3
• DynamoDB
• Kinesis
• Lambda

38. AWS IOT RULE
{
"topicRulePayload": {
"sql": "SELECT * FROM room/+/sensors/+/temp where temp >= 30",
"ruleDisabled": false,
"awsIotSqlVersion": "2016-03-23",
"actions": [{
"lambda": {
"functionArn":
“arn:aws:lambda:us-east-2:123456789012:function:hotRoomAlert"
}
}]
}
}

39. AWS IOT RULE
Kafka Kinesis
Kafka produce web socket == IOT Rule + Trigger
IOT Rule Lambda

41. AWS EMR SPARK STREAM
UpdateStateByKey, Redis state

42. AWS ATHENA
S3
• Csv
• Json
• Parquet
• Orc
Glue Table/Crawler

45. Q & A