2018/3/19 配信分: AWS Black Belt Online Seminar データウェアハウスのAWSクラウドへの移行

1. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
0 . 3
8 9 1 2
AWS Black Belt Online Seminar

2. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
t : A@
- 23 3
a S
r hk e W f Td k
f Td R
S -,
i m osA Dw S

3. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
• u (t )s j nl Mca S b
/. hiojgm 0 A 0 0 2 W
• y S Mdb /. hiojgm
w /. hiojgm f W b
• b su v M z q prf e w
f W b
• /. 3 A 18 38 82 C A /. 828 8A C1:82: 0 08:01: 0 3 8A AC19 2
2 0 8 022 30 2 8 /. ,CA 0 08:01: 0
0 A 0 0 2 0 828 8 0 8 8 2:C3 3 8 8A 3 2C 8A
83 3 : 0A 0 A 8 0 CA0 2 0 A /. A 82 A 10A 3 2 08
8 0 8 0 C 0 83 3 : 2 0 A 8:: 1 10A 3 C 02 C0: CA
/. A 82 A 0 3 0 0 A 8 0 A 83 3

4. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
• IB+ 4 D
• 4
• H A
• A
• H
• +
Agenda

5. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
H
•
H
• H
• W
•
• 5 5
• D

6. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
3
• 6 D
W D
• S
•
•
• H
• A
•
• 3
S
•

7. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
•
W
• D
•
S
• A
•
• D
H
•
•
• 7 D

8. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
DWH RDB
; PgSQL
$1,000/TB/ ; $0.314/
S3
Amazon
Redshift
2018 3

9. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
L
• S L/
• 1
9 Q
• 9 O I L 9
•

10. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
C C
• D 2 1 C D
H D 8
• CD D H
DC2 - Dense Compute
vCPU (GB) C H ( )
dc2.large 2 15 0.16TB NVMe SSD 1~32 $0.314 /1
dc2.8xlarge 32 244 2.56TB NVMe SSD 2~128 $6.095 /1
DS2 – Dense Storage
ds2.xlarge 4 31 2TB HDD 1~32 $1.190 /1
ds2.8xlarge 36 244 16TB HDD 2~128 $9.520 /1
S 22018 3 0

11. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
1 1
1
H D
1 3

12. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
C O
HA 2 1
12
HA 2 1 S
S
1
H C A E
W C A
C O
HA 2 1
12
HA 2 1 S
S
1
C O
HA 2 1
12
HA 2 1 S
S
1

13. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

14. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
2 3 1 4
. PC

15. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
.
• 5 1 ( 5 1 ( C S S
Id li D c
• c S ( nae 5 5
(
S
S
S
S
Id
S
( c ()
W
S
S
N S
o V (EC2)
DB P(RDS)nae c
5 5

16. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
$
.
.96 %Df S
• 0 31 % a D S
• % fh D
.96 %
• ieDn s * D f
• t ~ o
• mz
• $ R A d $
2018 3 C G C

17. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
D
QEMW
3
QEM
R T
B C
3
A3
L
L
2
2 3
QEM
E IS
2
GQEM I F D
Amazon Lex
Amazon Polly
Amazon
Rekognition
AmazonMachine
Learning
A 2
AWS Glue

18. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
1 2
...
N
3
• 1 P
Li C r SQ
q
• R S VC
e q
• S d s t
VL f h
a q uLe
S3
V
3 8
Spectrum

19. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
9 ,
• SR B E
• , QB I ACD
+1 2 + , 1

20. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
S 2 a
A a2
3
Amazon Redshift
DC
RDBMS Amazon S3
Amazon EC2
0BI
1,Book,100⏎
2,Pen,50⏎
…
n,Eraser,10⏎
Web
2018-03-05 12:00:00
192.168.0.2
http://www.amazon.com
2018-03-05 12:00:01 …
A VPN
21
Direct Connect
.
Amazon
QuickSight

21. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

22. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
DWH
2
DWH
DWH
DWH 2
Redshift
OR OR

23. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
1 342
eH f
Rd T WF E
i W .
U
t DD I f H
L tA
Hs hI
I
SdA

24. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
o 4 C 4
4 2
P

25. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
U h fs GD O2 5
B I IME
• 1 CL 1 JSF
• i F U g F
• i e
• d g
• i e JS D
• 0 R Q
• IMDS
•
0
/
CPU CPU CPU CPU CPU CPU
2 5
t

26. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
i 6
hd d
hd N N fd OR O M
hd OR e IZ
S IZ ) t AY
h E hS R t D
B hS RLBMT N KD D
h R Z 2 V )) C
U
t s OS t s
R R t sD Z
h t s h PN
hS R 2 11

27. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
DCP EQ
y _s a m eut
w cn o n s
z p 3LQDOJDASDC MOQ DU
DCP EQ NDBQORK n v lfj
3CDLQ QU
w w gt _s
6l:UQ ML m fi 02 y v
:UQ ML o8RK:U B :U :ALCAPrhn n:UQ ML v 02m
t v
4 8m z n n s o
_is(7. n o ) dn n o 6v
QQNP, CMBP ATP AKA ML BMK IA IN ODCP EQ JAQDPQ CF O / 1 1 .61 RP
AFD QKJ

28. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
t
d
W PQ
d
aS
t d A
d H h CL
d W PQ
f
t
2
d aS r
D 8 ML
f A
d W e
A
i
R u A
M d
aS o
o
d
W
d
aS
2 s BL

29. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
• RTR L C M P EE / 9
/ 2 2 G
• 2 2P C e ol
G G / G G
EXP
Amazon S3Direct
Connect
Glue EMR EC2
Amazon Redshift

30. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
4 oxz b tRuag d U f
• C8 ED 4,
• 4, m O m c
• GEG8 0M 3/ 08G 8, 2E G 3/ 1G8 B 3/ G G
• G LB8G a 26 . fa
• 1 , z rnm c k
• R rn h xz Rs c
• Q e bk O z rn d k
• 26O Oyous d g P pv
ua 26 d pv udgdc
• 08GA B8 Wi l k z rnd O
c S c

31. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
W
• HL 1
HB L
• HB R
3
• 1
L
1 D D3HB
L
Redshift

32. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
)( (
• 2 3
• F D
3
• D R 2
P D B
• R 2
C
A C

33. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
ALL
Node 1
Slice
1
Slice
2
Node 2
Slice
3
Slice
4
KEY(DISTKEY)
Node 1
Slice
1
Slice
2
Node 2
Slice
3
Slice
4
key1
key2
key3
key4
Node 1
Slice
1
Slice
2
Node 2
Slice
3
Slice
4
EVEN
P
3 RM

34. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
XW
• EP c
A O e
R
• ia T CR c
V S
•D V
• 44 b
• 4 33
DC
orders1.csv
1,pencil,100,18-01-01
2,eraser,50,18-01-02
…
:::
ordersN.csv
30,pen,150,18-01-28
31,book,50,18-01-29
…
•
•
DX b
D
VPN
OR

35. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
E-ink
“8.5G ”
50TB/ 80TB
10Gb
&
&
5 3
AWS Snowball

36. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
+

37. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
RS S
f At
• R RS WR R 7
A 3
•
• C P
• d e
sh oe
h i t

38. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
8 B
a s V 8 SP
DCIm e r I
• 8 ) Dok I
• PW A
) Dok r
3
• H p SP 8
A I zcn r
Amazon
Redshift
Amazon
WorkSpaces
(VDI)
PCoIP
BI Server

39. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
e
R
i d
3
• 3 9
f
R e
e h

40. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
) (
• M 4 M F
M 0 S A
• M
L
• O Q W

41. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Workload Management (WLM)
Workload Management (WLM)
1 4
1
SQL SQL SQL SQL SQL
SQL

42. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
) ) (
P2 8 2 B 80
2 8 PA G O
2 1 U 0 0 0
R C 0LO U
G O 1 40
0 4
4LO U U 6
4 T 8
4 T P

43. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
BI
Long
Query Group
52
Short
Query Group
3
1804∞

44. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
• R I
I N 4 e f
• O d
• O B h R i
d
https://docs.aws.amazon.com/ja_jp/redshift/latest/dg/r_enable_result_cache_for_session.html

45. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
4 S 5 5
f
S
t
3 p d S S
s R iu
mr h 5
Amazon
Redshift
...
1 2 3 4 N
2013
ec
2017 2018
2014 2015 2016

46. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

47. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
uH Idt
b a U Rr
: R Rh d WT D 0/423 5 B
B D7 t i T G G
T R nh g v P 7 D d D igP G
k SfoO TdUeL mB R
zl Wb (sp
A
( B AE A
B
) B AE A
D
s d
B C
VY sp
• +
•
• Te s
Wt fT
+
R + HB 0/423 5

48. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

49. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
• t h
• % P R e
D 5 T i
• T
9 0 s
• H
s O R
• 4 W H
D A
• % P R T
i C O R f
9 d
https://classmethod.jp/download/technical-library-aws-dwh/http://www.ctc-g.co.jp/report/casestudy/videor/index.html

50. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
• 0 5
LT I B
•
• - B E
•
• W H
•

51. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
? A 0 h jg
• B ? A A? =B D
? A 0 a l n
• B ? A A? =B A ? A D
? A 0 d mj / RopuQtsN q 1SW n
• B AD ? ? A A? AD ? = B AD ?-
? A 0 0 .A opu rwN
• B ? A A? D A ? A 0
? A 0 Qcd in l bn b 2AB
• B IB B A? =B AB B D AD? : AD ? A D ?
? A 0 1B D ? Qf em T
• B ? A A? =B 5 A: 5 BD AD ? A D B D ?
1 : A:
• B ? A A? =B 5 A: 5 :

52. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

53. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
& S W
• . 5 : 3 5 : 5 /3 / 3
& / 3 & ./ - Q
• & A a
• . 5 : 5-5 5

54. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
8/
F : A
@awscloud_jp
5
45 5
. 1 1

55. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
S W he c
a
- 5/. /- /.
: A

56. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
• -166 / 4 1/ 10 W g d p oc aQh tr
- n S W Q s pj
A
: :.21 . /6 0 / 7 166 . / 4 1/ 10 / 6 4 2 5: 76
• lemi
• u w

57. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.