Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
NIPS 2016
Supervised Word Mover's Distance
http://qiita.com/tmshn/items/3ccc5d84daa23a98d4be
Supervied Word Mover's Distance

G. Huang, C. Guo, M.J. Kusner, Y. Sun, K.Q. Weinberger, F. Sha, In NIPS 2016.

‣
https://...
Supervied Word Mover's Distance

G. Huang, C. Guo, M.J. Kusner, Y. Sun, K.Q. Weinberger, F. Sha, In NIPS 2016.

‣
https://...
[Mikolov et al., '13]
Paris - France + Italy = Rome.
Paris
France
Rome
Italy
[Rubner et al., '98]
Icon designed by Freepik from Flaticon
http://www.flaticon.com/free-icon/truck-cleaner-snow_96129


















T
i
=
db


T da
j


T da
j
i
=
db
[Kusner et al., '15]
X ∈ Rd×n
da, db
[Kusner et al., '15]
X ∈ Rd×n
da, db
[Kusner et al., '15]
X ∈ Rd×n
da, db


L2
[Kusner et al., '15]
X ∈ Rd×n
da, db


L2
[Kusner et al., '15]
X ∈ Rd×n
da, db


L2
O(p3 log p)
O(p)
p da, db
O(dp) d
L2
A
dA(x, y) = d(Ax, Ay)
A
A
k
[Goldberger et al., '05]
k


P(i j)
A1 A2
A
pij
A1 A2
A
A2
A1
i
j
k
[Huang et al., '16]
A w
k
[Huang et al., '16]
A w
k
‣ w0 = 1
‣ w0 = 1
‣ A0 = WCD NCA
‣ w0 = 1
‣ A0 = WCD NCA 

A0
‣ w0 = 1
‣ A0 = WCD NCA 

A0
A0, w0
k 

L2
k 

L2
k 

L2
P(a's NN is b) b
O(p3 log p) O(p2)
O(p3 log p) O(p2)
k


L2
[Huang et al., '16] Supervised Word Mover's Distance
G. Huang, C. Guo, M.J. Kusner, Y. Sun, K.Q. Weinberger, F. Sha.
Super...
[Kusner et al., '15] Word Mover's Distance
M.J. Kusner, Y. Sun, N.I. Kolkin, K.Q. Weinberger. From Word
Embedding To Docum...
Word Mover's Distance
http://yubessy.hatenablog.com/entry/2017/01/10/122737
http://www.slideshare.net/kentonozawa75/from-w...
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
NIPS 2016 輪読: Supervised Word Movers Distance
Upcoming SlideShare
Loading in …5
×

NIPS 2016 輪読: Supervised Word Movers Distance

Slideshare のバグ(?)でリンクが表示されていませんが、
・ダウンロードすれば閲覧できます
・ページ下部の transcript 部分にも記載されています
・冒頭3ページ以外はリンク自体は生きているのでクリックもできます

NIPS 2016 で発表された "Supervised Word Mover's Distance" の解説スライド。

  • Be the first to comment

NIPS 2016 輪読: Supervised Word Movers Distance

  1. 1. NIPS 2016 Supervised Word Mover's Distance
  2. 2. http://qiita.com/tmshn/items/3ccc5d84daa23a98d4be
  3. 3. Supervied Word Mover's Distance G. Huang, C. Guo, M.J. Kusner, Y. Sun, K.Q. Weinberger, F. Sha, In NIPS 2016. ‣ https://papers.nips.cc/paper/6139-supervised-word-movers-distance ‣ https://channel9.msdn.com/Events/Neural-Information-Processing-Systems- Conference/Neural-Information-Processing-Systems-Conference-NIPS-2016/ Supervised-Word-Movers-Distance ‣ https://github.com/gaohuang/S-WMD ‣
  4. 4. Supervied Word Mover's Distance G. Huang, C. Guo, M.J. Kusner, Y. Sun, K.Q. Weinberger, F. Sha, In NIPS 2016. ‣ https://papers.nips.cc/paper/6139-supervised-word-movers-distance ‣ https://channel9.msdn.com/Events/Neural-Information-Processing-Systems- Conference/Neural-Information-Processing-Systems-Conference-NIPS-2016/ Supervised-Word-Movers-Distance ‣ https://github.com/gaohuang/S-WMD ‣ 

  5. 5. [Mikolov et al., '13] Paris - France + Italy = Rome. Paris France Rome Italy
  6. 6. [Rubner et al., '98]
  7. 7. Icon designed by Freepik from Flaticon http://www.flaticon.com/free-icon/truck-cleaner-snow_96129
  8. 8.
  9. 9.
  10. 10.
  11. 11.
  12. 12.
  13. 13.
  14. 14.
  15. 15.
  16. 16. 
 T i = db
  17. 17. 
 T da j
  18. 18. 
 T da j i = db
  19. 19. [Kusner et al., '15] X ∈ Rd×n da, db
  20. 20. [Kusner et al., '15] X ∈ Rd×n da, db
  21. 21. [Kusner et al., '15] X ∈ Rd×n da, db 
 L2
  22. 22. [Kusner et al., '15] X ∈ Rd×n da, db 
 L2
  23. 23. [Kusner et al., '15] X ∈ Rd×n da, db 
 L2
  24. 24. O(p3 log p) O(p) p da, db O(dp) d L2
  25. 25. A dA(x, y) = d(Ax, Ay) A A
  26. 26. k [Goldberger et al., '05]
  27. 27. k 
 P(i j) A1 A2 A pij A1 A2 A A2 A1 i j k
  28. 28. [Huang et al., '16] A w k
  29. 29. [Huang et al., '16] A w k
  30. 30. ‣ w0 = 1
  31. 31. ‣ w0 = 1 ‣ A0 = WCD NCA
  32. 32. ‣ w0 = 1 ‣ A0 = WCD NCA A0
  33. 33. ‣ w0 = 1 ‣ A0 = WCD NCA A0 A0, w0
  34. 34. k 
 L2
  35. 35. k 
 L2
  36. 36. k 
 L2 P(a's NN is b) b
  37. 37. O(p3 log p) O(p2)
  38. 38. O(p3 log p) O(p2)
  39. 39. k 

  40. 40. L2
  41. 41. [Huang et al., '16] Supervised Word Mover's Distance G. Huang, C. Guo, M.J. Kusner, Y. Sun, K.Q. Weinberger, F. Sha. Supervised Word Mover's Distance. In NIPS 2016. https://papers.nips.cc/paper/6139-supervised-word-movers-distance [Mikolov et al., '13] word2vec T. Mikolov, K. Chen, G. Corrado, J. Dean. Efficient Estimation of Word Representations in Vector Space. In ICLR 2013 Workshop. https://arxiv.org/abs/1301.3781 [Rubner et al., '98] Eearth Mover's Distance Y. Rubner, C. Tomasi, L.J. Guibas. A Metric for Distributions with Applications to Image Databases. In ICCV 1998. http://ieeexplore.ieee.org/abstract/document/710701/ http://ai.stanford.edu/~rubner/papers/rubnerIccv98.pdf
  42. 42. [Kusner et al., '15] Word Mover's Distance M.J. Kusner, Y. Sun, N.I. Kolkin, K.Q. Weinberger. From Word Embedding To Documents Distances. In ICML 2015. http://www.jmlr.org/proceedings/papers/v37/kusnerb15.html [Goldberger et al., '05] Neighborhood Component Analysis J. Goldberger, S. Roweis, G. Hinton, R. Salakhutdinov. Neighborhood Component Analysis. In NIPS 2005. https://papers.nips.cc/paper/2566-neighbourhood-components-analysis
  43. 43. Word Mover's Distance http://yubessy.hatenablog.com/entry/2017/01/10/122737 http://www.slideshare.net/kentonozawa75/from-word-embeddings- to-document-distances Earth Mover's Distance http://aidiary.hatenablog.com/entry/20120804/1344058475

    Be the first to comment

    Login to see the comments

  • trokuse

    Feb. 12, 2017
  • Hironsan

    Apr. 20, 2017
  • takatsugunokubi

    Sep. 5, 2017
  • ssuserf1bbe6

    Sep. 5, 2017

Slideshare のバグ(?)でリンクが表示されていませんが、 ・ダウンロードすれば閲覧できます ・ページ下部の transcript 部分にも記載されています ・冒頭3ページ以外はリンク自体は生きているのでクリックもできます NIPS 2016 で発表された "Supervised Word Mover's Distance" の解説スライド。

Views

Total views

2,569

On Slideshare

0

From embeds

0

Number of embeds

164

Actions

Downloads

23

Shares

0

Comments

0

Likes

4

×