[Code night 20200531]machine learning for begginer generation of virtual reality by next generation ai gan

1. 2021 5 31
AI GAN

2. 2 Copyright © 2021 Oracle and/or its affiliates.
• GAN
•
• GAN
•
Agenda

3. 3 Copyright © 2021 Oracle and/or its affiliates.
Generative Adversarial Network( )
Generative
Adversarial
Network
:
https://www.jstage.jst.go.jp/article/jjmi/88/4/88_490/_pdf/-char/en
CT MRI

4. 4 Copyright © 2021 Oracle and/or its affiliates.
: Wikipedia
https://ja.wikipedia.org/wiki/%E7%A5%9E%E7%B5%8C%E7%B4%B0%E8%83%9E
𝑥0
𝑥1
𝑥2
𝑥𝑛
𝑤0
𝑤1
𝑤𝑛
𝑤3
𝑏0 𝑏1 𝑏2 𝑏3 𝑏𝑛
𝑢0
ニューロン 脳の神経細胞
シナプス ニューロンと他のニューロンとの接合部分
シナプス結合 ニューロンから別のニューロンへ信号が伝達される状態
活性化 ニューロンが受け取った刺激の大きさが特定の大きさを超える
と、次のニューロンへと信号を伝達する。この状態を活性化と
呼ぶ。
レイヤー(層) 入力層、中間層(隠れ層)、出力層。各層はバイアス変数(b)を持つ。
人工ニューロン ニューロンに相当。重み変数(w)を持つ。
エッジ シナプス結合に相当。ノード間を接続する。
活性化関数 活性化に相当。次ノードへ伝えるインプット値を決める関数。重
みw、バイアスb、活性化関数の計算値から次ノードへのイン
プット値を決める。

5. 5 Copyright © 2021 Oracle and/or its affiliates.
𝑥0
𝑥1
𝑥2
𝑥𝑛
𝑤0
𝑤1
𝑤𝑛
𝑤2
𝑏0 𝑏1 𝑏2 𝑏3 𝑏𝑛
Cat or Tiger ?
( )
[Cat, Tiger] = [1, 0]
100 pixel
60
pixel
0.8
0.2
1
0
Cat
Tiger
𝑤
𝑤
𝑤
𝑤
𝑤
𝑤
𝑤
𝑤
𝑤
𝑤
𝑤
𝑤
𝑤
𝑤
𝑤
𝑤
𝑤
𝑢0
↓
= (loss)
↓
( )
𝑥0
𝑥1
𝑥2
w0
w1
𝑤2
y0
input
output
𝑢0 = 𝑥0𝑤0 + 𝑥1𝑤1 + 𝑥2𝑤2 + 𝑏0
𝑢0
𝑓 𝑢0
y0 = 𝑓 𝑢0

6. 6 Copyright © 2021 Oracle and/or its affiliates.
𝑥0
𝑥1
𝑥2
𝑥𝑛
𝒘𝟎
𝒘𝟏
𝒘𝒏
𝒘𝟐
𝑏0 𝑏1 𝑏2 𝑏3 𝑏𝑛
Cat or Tiger ?
( )
[Cat, Tiger] = [1, 0]
100 pixel
60
pixel
0.8
0.2
1
0
Cat
Tiger
𝒘
𝒘
𝒘
𝒘
𝒘
𝒘
𝒘
𝒘
𝒘
𝒘
𝒘
𝒘
𝒘
𝒘
𝒘
𝒘
𝒘
↓
= (loss)
↓
( )
(w)
𝑥0
𝑥1
𝑥2
w0
w1
𝑤2
y0
input
output
𝑢0 = 𝑥0𝑤0 + 𝑥1𝑤1 + 𝑥2𝑤2 + 𝑏0
𝑢0
𝑓 𝑢0
y0 = 𝑓 𝑢0
𝑢0

7. 7 Copyright © 2021 Oracle and/or its affiliates.
𝑥0
𝑥1
𝑥2
𝑥𝑛
𝒘𝟎
𝒘𝟏
𝒘𝒏
𝑏0 𝑏1 𝑏2 𝑏3 𝑏𝑛
Cat or Tiger ?
( )
[Cat, Tiger] = [1, 0]
100 pixel
60
pixel
0.8
0.2
1
0
Cat
Tiger
𝒘
𝒘
𝒘
𝒘
𝒘
𝒘
𝒘
𝒘
𝒘
𝒘
𝒘
𝒘
𝒘
𝒘
𝒘
𝒘
𝒘
↓
= (loss)
↓
( )
𝑥0
𝑥1
𝑥2
w0
w1
𝑤2
y0
input
output
𝑢0 = 𝑥0𝑤0 + 𝑥1𝑤1 + 𝑥2𝑤2 + 𝑏0
𝑢0
𝑓 𝑢0
y0 = 𝑓 𝑢0
(loss) (w)
↓
( )
(w)
𝑢0
𝒘𝟐
[ ] [ ]

8. 8 Copyright © 2021 Oracle and/or its affiliates.
Cat
[0.2, 0.5,
0.8, 0.2,
0.3, 0.5
….
0.4 , 0.9]
( )
( )
Cat or Tiger?
OpenCV
[ ] [ ]

9. 9 Copyright © 2021 Oracle and/or its affiliates.
GAN 2 Generator Discriminator
Generator
or
Discriminator
( ) Generator
( )
Discriminator Generator
Generator

10. 10 Copyright © 2021 Oracle and/or its affiliates.
Discriminator
1
( )
Generator Discriminator
Generator
: The Chinese University of Hong Kong
Large-scale CelebFaces Attributes (CelebA) Dataset
http://mmlab.ie.cuhk.edu.hk/projects/CelebA.html
CelebA
0.8
0.2
( )
0
( )
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
Generator 0
1 ( )
Discriminator

11. 11 Copyright © 2021 Oracle and/or its affiliates.
Generator
Generator Discriminator
Generator
0.2
( )
w
0.8
1
( )
0
( )
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
: The Chinese University of Hong Kong
Large-scale CelebFaces Attributes (CelebA) Dataset
http://mmlab.ie.cuhk.edu.hk/projects/CelebA.html
Generator Discriminator
1 (
) Generator

12. 12 Copyright © 2021 Oracle and/or its affiliates.
Generator Discriminator
0 ( )
1 ( )
Generator Discriminator
Generator
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
Generator 0
1 ( )
Discriminator
Generator Discriminator
1 (
) Generator

13. 13 Copyright © 2021 Oracle and/or its affiliates.
Generator Discriminator
Generator Discriminator
Generator
0 ( )
1 ( )
: The Chinese University of Hong Kong
Large-scale CelebFaces Attributes (CelebA) Dataset
http://mmlab.ie.cuhk.edu.hk/projects/CelebA.html

14. 14 Copyright © 2021 Oracle and/or its affiliates.
Generator Discriminator
Generator Discriminator
Generator
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
0 ( )
1 ( )
Generator 0
1 ( )
Discriminator

15. 15 Copyright © 2021 Oracle and/or its affiliates.
Generator Discriminator
Generator Discriminator
Generator
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
Discriminator
Generator
0 ( )
1 ( )
Generator 0
1 ( )
Discriminator

16. 16 Copyright © 2021 Oracle and/or its affiliates.
Generator Discriminator
Generator Discriminator
Generator
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w 0 ( )
1 ( )
Generator 0
1 ( )
Discriminator
Generator Discriminator
1 (
) Generator

17. 17 Copyright © 2021 Oracle and/or its affiliates.
Generator Discriminator
Generator Discriminator
Generator
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
Generator
Discriminator
0 ( )
1 ( )
Generator Discriminator
1 (
) Generator

18. 18 Copyright © 2021 Oracle and/or its affiliates.
Generator Discriminator
Generator Discriminator
Generator
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w 0 ( )
1 ( )
Generator 0
1 ( )
Discriminator
Generator Discriminator
1 (
) Generator

19. 19 Copyright © 2021 Oracle and/or its affiliates.
Generator Discriminator
Generator
Generator
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
Generator
Discriminator
Discriminator
Generator
0 ( )
1 ( )
Discriminator

20. Discriminator
20 Copyright © 2021 Oracle and/or its affiliates.
Generator
Generator
Generator
Discriminator
Discriminator
Generator
0 ( )
1 ( )

21. 21 Copyright © 2021 Oracle and/or its affiliates.
Generator Discriminator
Generator
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
Generator
Discriminator
Discriminator
Generator
0 ( )
1 ( )

22. 22 Copyright © 2021 Oracle and/or its affiliates.
Generator Discriminator
Generator
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
Generator
Discriminator
Discriminator
Generator
0 ( )
1 ( )

23. 23 Copyright © 2021 Oracle and/or its affiliates.
Generator Discriminator
Generator
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
Generator
Discriminator
Discriminator
Generator
0 ( )
1 ( )

24. 24 Copyright © 2021 Oracle and/or its affiliates.
Generator Discriminator
Generator
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
Generator
Discriminator
Discriminator
Generator
0 ( )
1 ( )

25. Discriminator
25 Copyright © 2021 Oracle and/or its affiliates.
GAN
Generator Discriminator
Generator
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
w
Generator
Discriminator
Discriminator
Generator
0 ( )
1 ( )

26. 26 Copyright © 2021 Oracle and/or its affiliates.

27. 27 Copyright © 2021 Oracle and/or its affiliates.
: THE MNIST DATABASE of handwritten digits
http://yann.lecun.com/exdb/mnist/
MNIST
Generator Discriminator
Generator
1 ( )
0 ( )

28. 28 Copyright © 2021 Oracle and/or its affiliates.
GAN
StyleGAN
(
)
Pix2pix
Age-cGAN
DCGAN
AttnGAN
StackGAN

29. 29 Copyright © 2021 Oracle and/or its affiliates.
•
- https://www.slideshare.net/KenichiSonoda/20210226oracle-code-night
- https://www.youtube.com/watch?v=hrsvcZrzphk&t=388s&ab_channel=JapanOracleDevelopers
•
OpenCV
- https://www.slideshare.net/KenichiSonoda/20200812-cbject-detection-with-opencv-and-cnn
- https://www.youtube.com/watch?v=olPF7MXhDhk&t=3428s&ab_channel=JapanOracleDevelopers
•
BERT
- https://www.slideshare.net/KenichiSonoda/code-night-natural-language-proccessing-and-machine-learning
- https://www.youtube.com/watch?v=Q4MsoJoGeEY&t=4968s&ab_channel=JapanOracleDevelopers
• Oracle
- https://www.youtube.com/watch?v=OSKYBipSzMA&t=805s&ab_channel=JapanOracleDevelopers
• Apache Spark
- https://www.slideshare.net/KenichiSonoda/oracle-big-data-jam-session-1-apache-spark

30. 30 Copyright © 2021 Oracle and/or its affiliates.
github Oracle
https://github.com/oracle-japan/oci-datascience-gan-demo/tree/main