Invited talk at IROS2018 Workshop on Language and Robotics http://iros2018.emergent-symbol.systems/program Tittle: Real-World Objects Interaction with Unconstrained Spoken Language Instructions Speaker: Kuniyuki Takahashi Date: 1st October, 2018

1. Twitter: @Georgekt0927
Slide is available
↑
1

2. < Career >
- 2007.4 - 2017.3
- 2015.2 - 2016.3, 2017.2-2017.3
Technical University of Munich, Germany
Twitter: @Georgekt0927
↑
Slide is available
2

3. Preferred Networks (PFN)
•
•
•
•
•
Deep learning Industrial IoT
Manufacturing
Automotive
Healthcare
3

4. credits:
gpu by Misha Petrishchev from the Noun Project
Network Switch by Creaticca Creative Agency from the Noun Project
4

5. Challenges in current robotics
Source http://www.appraccel.com/blog/2017/1/4/freeing-up-humans-to-do-meaningful-work
…
Source http://toyota.jp/mirai/grade/Source http://toyota.jp/mirai/grade/
5

6. New Area in Robotics
Source http://www.appraccel.com/blog/2017/1/4/freeing-up-humans-to-do-meaningful-work
6

7. New Area in Robotics
7

8. Today’s topics
8

9. ●
Previous works
● (e.g. [Yamada+ 2017])
● [Paul+ 2017] [Shridhar+ 2017]
9

10. ●
●
10

11. !
"
!
"
11

12. 12
1x
12

13. 13
1x
13

14. !
14

15. ●
●
!
Margin
15

16. About 100 types of commodities
English 91k instructions, Japanese 7.7k instructions
(At least three people give sentences
to each object by crowdsourcing)
16

17. Our dataset
17

18. ●
●
18

19. ●
●
●
19

20. 20
1x
20

21. ●
●
21

22. ●
●
22

23. ●
●
● 92.7% in English, and 84.1% in Japanese
23

24. !
How to judge the texture
of the object from the image?
Today’s topics
24

25. 25

26. 26

27. 27

28. 28

29. 29

30. 30

31. 31

33. 33

34. 34
24
25
23

35. ?
35

36. 36

37. 37

38. Summary
Twitter: @Georgekt0927
↑
Slide is available
38