TensorFlow Lite, Mediapipe, ML Kit

1. DeepLearning (α )
!1

2. •
→ MLOps
Edge AI ( )
• ML CV (´ )
• ML
2
@cocodrips

3. Topic
• TF Lite
• Convert
• TF Lite AI framework
3

4. TF Lite

5. TensorFlow Lite
• ( ) IoT
•
5

6. TensorFlow Lite
• Weight : float16, uint8(dynamic range)
‣ float16/integer option convert
‣
• Weight Activation : uint8
‣
‣
6

7. Weight
• Tensorflow float32 Weight
‣
‣
‣
• Weight Float16 : 1/2
• Weight uint8 : 1/4, 2~3
※Activation Full integer quantization
1/4 3
7

8. 8
*1: coco-dataset, *2: open-images-v4

9. ( )
• weight float16 faiss
uint8
• uint8 Face detection
demo
9

10. Convert

11. convert
1. SavedModel convert
2. checkpoint convert
11

12. SavedModel convert
SavedModel convert ( )
‣ TF Lite
‣ Tensorflow → TensorFlow Lite
mapping
‣ or SavedModel TF Lite
12

13. Checkpoint Convert
Checkpoint+GraphDef convert
‣ TF Lite
‣ shape: -1
‣ TF ObjectDetection API Slim( )
exporter GraphDef
13

14. Convert
• Python API:
• tflite_convert:
• toco:
14

15. Python API
•
• SavedModel Keras
• option (input_shapes )
• v2 API post_training_quantize
v1 API
15

16. tflite_convert
• SavedModel Keras
•
tflite_convert
• PythonAPI TF2 install tflite_convert
TF1
16

17. toco
• tflite_convert Python API
• saved_model, graphdef
• bazel build
• convert
• checkpoint + graph def convert
•
17

18. convert
18
slim
slim exporter
freeze_graph
batch_size
toco convert
float16

19. • convert
•
19

20. 20

21. Convert
( !!)
> [Tensorflow Lite] Various Neural Network Model
quantization methods for Tensorflow Lite (Weight
Quantization, Integer Quantization, Full Integer Quantization,
Float16 Quantization, EdgeTPU). As of May 05, 2020.
slim convert
> Tensorflow TFLite convert convert
21

22. TF Lite framework

23. Firebase MLKit (β)
23
• Android / iOS SDK
• TFLite
• 10
• firebase up DL
• RemoteConfig(Firebase) AB ?

24. Core ML
• iOS SDK
• TFLite
• iOS11 OS
• Android framework
24

25. Mediapipe
• framework
‣
‣ UI
• TFLite
• Android/iOS
iOS obj-c framework
25

26. 26

27. • TensorFlow Lite
• convert & weight
• TensorFlow Lite AI Framework
• TF Lite
• TF Lite v1, v2 API
27