5. 5
LET’S TALK ABOUT DEEPFAKES!
1. In December 2017, a user
named “DeepFakes”
announce the tool on
Reddit Community of
developers.
2. DeepFakes is a tool that
utilizes deep learning to
recognize and swap faces
in pictures and videos.
5
11. HOW DEEPFAKES WORK?
>Steps for: DeepFaceLab
2 31
Extract image
from source
video.
Extract faces
from source
and target
image.
4
Manually
remove
error image.
5
Model
Training
6
Extract image
from target
video.
Debug & Convert
image to mp4
11
12. HOW DEEPFAKES WORK?
>Extract image from source&target video.
FFmpeg
FFmpeg is the leading
multimedia framework,
able to decode, encode,
transcode, mux, demux,
stream, filter and play
pretty much anything
that humans and
machines have created.
ffmpeg -i clipname -vf fps=framerate -qscale:v 2 "imagename%04d.jpg"Command_
12
13. HOW DEEPFAKES WORK?
>Extract faces from source and target image
(Ref: Facial landmarks with dlib, OpenCV, and Python)
Divided a face into the following areas:
1. eyes(left/right)
2. eyebrows(left/right)
3. nose
4. chin
13
25. HOW DEEPFAKES WORK?
>Debug & Convert image to mp4
Debug Mode
Use predicted mask? 1
Erosion (-100 to +100): (default = 0) 1
Seamless Erosion (0 to 40): (default = 0) 20
Blur (-200 to +200): (default = 0) 40
Hist-match threshold (0 to 255): (default = 255) default
Face Scale (-50 to +50): (default = 0) default
Transfer Color from predicted face? (LCT/RCT/no): (default = no) RCT
Degrade Color Power of Final Image: (default = 0) default
25
26. HOW DEEPFAKES WORK?
>Debug & Convert image to mp4
Debug Mode
Use predicted mask? 1
Erosion (-100 to +100): (default = 0) 1
Seamless Erosion (0 to 40): (default = 0) 20
Blur (-200 to +200): (default = 0) 40
Hist-match threshold (0 to 255): (default = 255) default
Face Scale (-50 to +50): (default = 0) default
Transfer Color from predicted face? (LCT/RCT/no): (default = no) RCT
Degrade Color Power of Final Image: (default = 0) default
26
27. HOW DEEPFAKES WORK?
>Debug & Convert image to mp4
Debug Mode
Use predicted mask? 1
Erosion (-100 to +100): (default = 0) 1
Seamless Erosion (0 to 40): (default = 0) 20
Blur (-200 to +200): (default = 0) 40
Hist-match threshold (0 to 255): (default = 255) default
Face Scale (-50 to +50): (default = 0) default
Transfer Color from predicted face? (LCT/RCT/no): (default = no) RCT
Degrade Color Power of Final Image: (default = 0) default
27
28. HOW DEEPFAKES WORK?
>Debug & Convert image to mp4
Debug Mode
Use predicted mask? 1
Erosion (-100 to +100): (default = 0) 1
Seamless Erosion (0 to 40): (default = 0) 20
Blur (-200 to +200): (default = 0) 40
Hist-match threshold (0 to 255): (default = 255) default
Face Scale (-50 to +50): (default = 0) default
Transfer Color from predicted face? (LCT/RCT/no): (default = no) RCT
Degrade Color Power of Final Image: (default = 0) default
28
29. HOW DEEPFAKES WORK?
>Debug & Convert image to mp4
Debug Mode
Use predicted mask? 1
Erosion (-100 to +100): (default = 0) 1
Seamless Erosion (0 to 40): (default = 0) 20
Blur (-200 to +200): (default = 0) 40
Hist-match threshold (0 to 255): (default = 255) default
Face Scale (-50 to +50): (default = 0) default
Transfer Color from predicted face? (LCT/RCT/no): (default = no) RCT
Degrade Color Power of Final Image: (default = 0) default
29
30. HOW DEEPFAKES WORK?
>Debug & Convert image to mp4
Debug Mode
Use predicted mask? 1
Erosion (-100 to +100): (default = 0) 1
Seamless Erosion (0 to 40): (default = 0) 20
Blur (-200 to +200): (default = 0) 40
Hist-match threshold (0 to 255): (default = 255) default
Face Scale (-50 to +50): (default = 0) default
Transfer Color from predicted face? (LCT/RCT/no): (default = no) RCT
Degrade Color Power of Final Image: (default = 0) default
30
31. HOW DEEPFAKES WORK?
>Debug & Convert image to mp4
Debug Mode
Use predicted mask? 1
Erosion (-100 to +100): (default = 0) 1
Seamless Erosion (0 to 40): (default = 0) 20
Blur (-200 to +200): (default = 0) 40
Hist-match threshold (0 to 255): (default = 255) default
Face Scale (-50 to +50): (default = 0) default
Transfer Color from predicted face? (LCT/RCT/no): (default = no) RCT
Degrade Color Power of Final Image: (default = 0) default
31
40. CAN YOU TELL A FAKE VOICE FROM A REAL ONE?
40
(Ref: https://lyrebird.ai/)
41. • create a digitized version of your own voice.
• Uses deep learning frameworks on AWS to develop and
train its AI models
What is Lyrebird?
Record & Upload
voice samples
Train by DL Framework
on AWS EC2 P3
Digital Voice
Generated
Optput audio of
requested dialog
(Ref: https://lyrebird.ai/)41
42. LYREBIRD LIVE DEMO
This is my honored to talk to everyone here.
However, can you trust your eyes and ears to perceive reality?
Machine learning can artificially mimic natural sounds to create digital voice.
Just like me!
42
43. Why my voice sounds awful?
43
(Ref: https://lyrebird.ai/)