SlideShare a Scribd company logo
1 of 38
Download to read offline
-           -




MATSUURA Satoshi
matsuura@is.naist.jp




         1
2
3
20%   35%       85%




            4
P (C|D)

D
    C       P


        5
P (C|D)




      6
7
P (D|C)P (C)
P (C|D) =
              P (D)



          8
9
P (CD)

D
    C


        10
P (CD) = P (C|D)P (D)
           = P (D|C)P (C)

•   D                 C        x   D
            P (C|D)                    P (D)

•       C             D        x       C
            P (D|C)                    P (C)

                          11
P (D|C)P (C)
P (C|D) =
              P (D)



          12
P (D|C)P (C)
P (C|D) =
              P (D)


P (D)
        P (C|D)



                  13
P (D|C)P (C)
P (C|D) =
              P (D)


 P (C)       C
    C                    /



            14
P (D|C)P (C)
   P (C|D) =
                 P (D)


    P (D|C)       C
              D

P (D|C) =

                  15
16
D


P (D|C)


          17
bag of words



    18
ick
                 -k 0




                        FIFA
      hat
           relew nder-2
         f ye lo u c
     Con fed er        ar d    tric
                                   k
      goal       at i on s
           ke hooligan
       off    ep er
                      nte ring
             s i d ce
                  e goal




19
P (D|C) =

            P (W1|C)P (W2|C) · · · P (Wn|C)


       P (Wi|C) =             Wi




             D            W




                     20
21
P (D|C)P (C)
        P (C|D) =
                      P (D)
    P (D|C)  P (W1 |C)P (W2 |C) · · · P (Wn |C)
                              P (Wi|C) =       Wi




•
    ★                           (          )
    ★

                         22
Wa
    Wb
    Wc
    Wx
    Wy




         Wa Wy                Wx
                                    Wc
          Wb Wb               Wa             W     W
W                                                W W   W W
                                             W
          bag of words        bag of words




                         23
bag of words




               24
25
Wa Wz
 Wy Wb
 bag of words




26
Wa Wz            Wa
         Wy Wb           Wb
         bag of words    Wc
                         Wx
                         Wy



                  4
P (Cs )P (D|Cs )  P (Wa |Cs )P (Wb |Cs )P (Wy |Cs )P (Wz |Cs )
                  7
                  4 1 2 1 0
                 = × × × × )                Wz
                  7 4 4 4 4
                 =0




                              27
28
29
Wnew
P (Wnew |C)



P (Wnew |C) =
                ×
                                popfile




                    Wi
  P (Wi|C) =

                           Wi    α
           →
                                 α×


                α



                           30
popfile




         31
Wa Wz                  Wa
                Wy Wb                 Wb
                bag of words          Wc
                                      Wx
                                      Wy




                                                               4
                                            P (Cs )P (D|Cs )  P (Wa |Cs )P (Wb |Cs )P (Wy |Cs )P (Wz |Cs )
                                                               7
                                                               4 1 2 1              1
                                                             = × × × ×                  )
                                                               7 4 4 4 10 × 7
                                                                 1
                                                             =
                                                               3920



                                                               3
                                            P (Cp )P (D|Cp )  P (Wa |Cp )P (Wb |Cp )P (Wy |Cp )P (Wz |Cp )
                                                               7
                                                               3 1        1          1          1
                                                             = × ×            ×          ×         )
                                                               7 3 10 × 7 10 × 7 10 × 7
                                                                  1
P (Cs )P (D|Cs )  P (Cp )P (D|Cp )                          =
                                                               2401000


                                           32
33
34
35
36
DEMO




 37
•                               (          )

    •     Web+DB vol.56 p.134-142,                  , May. 2010.

•   4.2

    •                                          , p.101-117,         , Aug, 2010.

•                                                          (                       )

    •     http://gihyo.jp/dev/serial/01/machine-learning/0003
•

    •     http://d.hatena.ne.jp/kogecoo/20091103/1257281433
•                                               (               )

    •     http://homepage3.nifty.com/DO/ensyu3_class2.pdf

                                                         38

More Related Content

What's hot

What's hot (20)

Clustering in Hilbert simplex geometry
Clustering in Hilbert simplex geometryClustering in Hilbert simplex geometry
Clustering in Hilbert simplex geometry
 
1 ESO - Unit 04 - Exercises 1.4.2. - Adding and Subtracting Integers
1 ESO - Unit 04 - Exercises 1.4.2. - Adding and Subtracting Integers1 ESO - Unit 04 - Exercises 1.4.2. - Adding and Subtracting Integers
1 ESO - Unit 04 - Exercises 1.4.2. - Adding and Subtracting Integers
 
Bregman Voronoi Diagrams (SODA 2007)
Bregman Voronoi Diagrams (SODA 2007)  Bregman Voronoi Diagrams (SODA 2007)
Bregman Voronoi Diagrams (SODA 2007)
 
Graph Edit Distance: Basics & Trends
Graph Edit Distance: Basics & TrendsGraph Edit Distance: Basics & Trends
Graph Edit Distance: Basics & Trends
 
Computational Information Geometry: A quick review (ICMS)
Computational Information Geometry: A quick review (ICMS)Computational Information Geometry: A quick review (ICMS)
Computational Information Geometry: A quick review (ICMS)
 
Distributed Support Vector Machines
Distributed Support Vector MachinesDistributed Support Vector Machines
Distributed Support Vector Machines
 
Hat04 0205
Hat04 0205Hat04 0205
Hat04 0205
 
445 colouring0
445 colouring0445 colouring0
445 colouring0
 
1 ESO - Unit 04 - Exercises 1.4.3. - Integer Multiplication and Division.
1  ESO - Unit 04 - Exercises 1.4.3. - Integer Multiplication and Division.1  ESO - Unit 04 - Exercises 1.4.3. - Integer Multiplication and Division.
1 ESO - Unit 04 - Exercises 1.4.3. - Integer Multiplication and Division.
 
Clustering in Hilbert geometry for machine learning
Clustering in Hilbert geometry for machine learningClustering in Hilbert geometry for machine learning
Clustering in Hilbert geometry for machine learning
 
Nodal Domain Theorem for the p-Laplacian on Graphs and the Related Multiway C...
Nodal Domain Theorem for the p-Laplacian on Graphs and the Related Multiway C...Nodal Domain Theorem for the p-Laplacian on Graphs and the Related Multiway C...
Nodal Domain Theorem for the p-Laplacian on Graphs and the Related Multiway C...
 
Graph kernels
Graph kernelsGraph kernels
Graph kernels
 
Slides: The dual Voronoi diagrams with respect to representational Bregman di...
Slides: The dual Voronoi diagrams with respect to representational Bregman di...Slides: The dual Voronoi diagrams with respect to representational Bregman di...
Slides: The dual Voronoi diagrams with respect to representational Bregman di...
 
The Digital Image Processing Q@A
The Digital Image Processing Q@AThe Digital Image Processing Q@A
The Digital Image Processing Q@A
 
Divergence center-based clustering and their applications
Divergence center-based clustering and their applicationsDivergence center-based clustering and their applications
Divergence center-based clustering and their applications
 
Slides: Total Jensen divergences: Definition, Properties and k-Means++ Cluste...
Slides: Total Jensen divergences: Definition, Properties and k-Means++ Cluste...Slides: Total Jensen divergences: Definition, Properties and k-Means++ Cluste...
Slides: Total Jensen divergences: Definition, Properties and k-Means++ Cluste...
 
Small updates of matrix functions used for network centrality
Small updates of matrix functions used for network centralitySmall updates of matrix functions used for network centrality
Small updates of matrix functions used for network centrality
 
Optimal L-shaped matrix reordering, aka graph's core-periphery
Optimal L-shaped matrix reordering, aka graph's core-peripheryOptimal L-shaped matrix reordering, aka graph's core-periphery
Optimal L-shaped matrix reordering, aka graph's core-periphery
 
Divergence clustering
Divergence clusteringDivergence clustering
Divergence clustering
 
Complexity Classes and the Graph Isomorphism Problem
Complexity Classes and the Graph Isomorphism ProblemComplexity Classes and the Graph Isomorphism Problem
Complexity Classes and the Graph Isomorphism Problem
 

Similar to 分類器 (ナイーブベイズ)

Triangle counting handout
Triangle counting handoutTriangle counting handout
Triangle counting handout
csedays
 
Link-based document classification using Bayesian Networks
Link-based document classification using Bayesian NetworksLink-based document classification using Bayesian Networks
Link-based document classification using Bayesian Networks
Alfonso E. Romero
 
Teknik Menjawab Kertas 1 Matematik Tambahan
Teknik Menjawab Kertas 1 Matematik TambahanTeknik Menjawab Kertas 1 Matematik Tambahan
Teknik Menjawab Kertas 1 Matematik Tambahan
Zefry Hanif
 

Similar to 分類器 (ナイーブベイズ) (20)

0209 ch 2 day 9
0209 ch 2 day 90209 ch 2 day 9
0209 ch 2 day 9
 
Ml4nlp04 1
Ml4nlp04 1Ml4nlp04 1
Ml4nlp04 1
 
Triangle counting handout
Triangle counting handoutTriangle counting handout
Triangle counting handout
 
Cpt 2009 qa
Cpt 2009 qaCpt 2009 qa
Cpt 2009 qa
 
Naive Bayesian Text Classifier Event Models
Naive Bayesian Text Classifier Event ModelsNaive Bayesian Text Classifier Event Models
Naive Bayesian Text Classifier Event Models
 
Query Suggestion @ tokyotextmining#2
Query Suggestion @ tokyotextmining#2Query Suggestion @ tokyotextmining#2
Query Suggestion @ tokyotextmining#2
 
Link-based document classification using Bayesian Networks
Link-based document classification using Bayesian NetworksLink-based document classification using Bayesian Networks
Link-based document classification using Bayesian Networks
 
Modeling Transformations
Modeling TransformationsModeling Transformations
Modeling Transformations
 
Comparing estimation algorithms for block clustering models
Comparing estimation algorithms for block clustering modelsComparing estimation algorithms for block clustering models
Comparing estimation algorithms for block clustering models
 
近似ベイズ計算によるベイズ推定
近似ベイズ計算によるベイズ推定近似ベイズ計算によるベイズ推定
近似ベイズ計算によるベイズ推定
 
Triggering patterns of topology changes in dynamic attributed graphs
Triggering patterns of topology changes in dynamic attributed graphsTriggering patterns of topology changes in dynamic attributed graphs
Triggering patterns of topology changes in dynamic attributed graphs
 
NTHU AI Reading Group: Improved Training of Wasserstein GANs
NTHU AI Reading Group: Improved Training of Wasserstein GANsNTHU AI Reading Group: Improved Training of Wasserstein GANs
NTHU AI Reading Group: Improved Training of Wasserstein GANs
 
Model Selection with Piecewise Regular Gauges
Model Selection with Piecewise Regular GaugesModel Selection with Piecewise Regular Gauges
Model Selection with Piecewise Regular Gauges
 
Testing for mixtures at BNP 13
Testing for mixtures at BNP 13Testing for mixtures at BNP 13
Testing for mixtures at BNP 13
 
Integral
IntegralIntegral
Integral
 
Probabilistic Retrieval
Probabilistic RetrievalProbabilistic Retrieval
Probabilistic Retrieval
 
確率伝播その2
確率伝播その2確率伝播その2
確率伝播その2
 
0208 ch 2 day 8
0208 ch 2 day 80208 ch 2 day 8
0208 ch 2 day 8
 
Low Complexity Regularization of Inverse Problems
Low Complexity Regularization of Inverse ProblemsLow Complexity Regularization of Inverse Problems
Low Complexity Regularization of Inverse Problems
 
Teknik Menjawab Kertas 1 Matematik Tambahan
Teknik Menjawab Kertas 1 Matematik TambahanTeknik Menjawab Kertas 1 Matematik Tambahan
Teknik Menjawab Kertas 1 Matematik Tambahan
 

Recently uploaded

Recently uploaded (20)

Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Spring Boot vs Quarkus the ultimate battle - DevoxxUK
Spring Boot vs Quarkus the ultimate battle - DevoxxUKSpring Boot vs Quarkus the ultimate battle - DevoxxUK
Spring Boot vs Quarkus the ultimate battle - DevoxxUK
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Cyberprint. Dark Pink Apt Group [EN].pdf
Cyberprint. Dark Pink Apt Group [EN].pdfCyberprint. Dark Pink Apt Group [EN].pdf
Cyberprint. Dark Pink Apt Group [EN].pdf
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024
 

分類器 (ナイーブベイズ)

  • 1. - - MATSUURA Satoshi matsuura@is.naist.jp 1
  • 2. 2
  • 3. 3
  • 4. 20% 35% 85% 4
  • 5. P (C|D) D C P 5
  • 7. 7
  • 8. P (D|C)P (C) P (C|D) = P (D) 8
  • 9. 9
  • 10. P (CD) D C 10
  • 11. P (CD) = P (C|D)P (D) = P (D|C)P (C) • D C x D P (C|D) P (D) • C D x C P (D|C) P (C) 11
  • 12. P (D|C)P (C) P (C|D) = P (D) 12
  • 13. P (D|C)P (C) P (C|D) = P (D) P (D) P (C|D) 13
  • 14. P (D|C)P (C) P (C|D) = P (D) P (C) C C / 14
  • 15. P (D|C)P (C) P (C|D) = P (D) P (D|C) C D P (D|C) = 15
  • 16. 16
  • 17. D P (D|C) 17
  • 19. ick -k 0 FIFA hat relew nder-2 f ye lo u c Con fed er ar d tric k goal at i on s ke hooligan off ep er nte ring s i d ce e goal 19
  • 20. P (D|C) = P (W1|C)P (W2|C) · · · P (Wn|C) P (Wi|C) = Wi D W 20
  • 21. 21
  • 22. P (D|C)P (C) P (C|D) = P (D) P (D|C) P (W1 |C)P (W2 |C) · · · P (Wn |C) P (Wi|C) = Wi • ★ ( ) ★ 22
  • 23. Wa Wb Wc Wx Wy Wa Wy Wx Wc Wb Wb Wa W W W W W W W W bag of words bag of words 23
  • 25. 25
  • 26. Wa Wz Wy Wb bag of words 26
  • 27. Wa Wz Wa Wy Wb Wb bag of words Wc Wx Wy 4 P (Cs )P (D|Cs ) P (Wa |Cs )P (Wb |Cs )P (Wy |Cs )P (Wz |Cs ) 7 4 1 2 1 0 = × × × × ) Wz 7 4 4 4 4 =0 27
  • 28. 28
  • 29. 29
  • 30. Wnew P (Wnew |C) P (Wnew |C) = × popfile Wi P (Wi|C) = Wi α → α× α 30
  • 31. popfile 31
  • 32. Wa Wz Wa Wy Wb Wb bag of words Wc Wx Wy 4 P (Cs )P (D|Cs ) P (Wa |Cs )P (Wb |Cs )P (Wy |Cs )P (Wz |Cs ) 7 4 1 2 1 1 = × × × × ) 7 4 4 4 10 × 7 1 = 3920 3 P (Cp )P (D|Cp ) P (Wa |Cp )P (Wb |Cp )P (Wy |Cp )P (Wz |Cp ) 7 3 1 1 1 1 = × × × × ) 7 3 10 × 7 10 × 7 10 × 7 1 P (Cs )P (D|Cs ) P (Cp )P (D|Cp ) = 2401000 32
  • 33. 33
  • 34. 34
  • 35. 35
  • 36. 36
  • 38. ( ) • Web+DB vol.56 p.134-142, , May. 2010. • 4.2 • , p.101-117, , Aug, 2010. • ( ) • http://gihyo.jp/dev/serial/01/machine-learning/0003 • • http://d.hatena.ne.jp/kogecoo/20091103/1257281433 • ( ) • http://homepage3.nifty.com/DO/ensyu3_class2.pdf 38

Editor's Notes

  1. \n
  2. \n
  3. \n
  4. \n
  5. \n
  6. \n
  7. \n
  8. \n
  9. \n
  10. \n
  11. \n
  12. \n
  13. \n
  14. \n
  15. \n
  16. \n
  17. \n
  18. \n
  19. \n
  20. \n
  21. \n
  22. \n
  23. \n
  24. \n
  25. \n
  26. \n
  27. \n
  28. \n
  29. \n
  30. \n
  31. \n
  32. \n
  33. \n
  34. \n
  35. \n
  36. \n
  37. \n
  38. \n