SlideShare a Scribd company logo
1 of 46
Download to read offline
A B I N J O: U C 
 L  C R  I

  Hannes Schulz, Hauke Strasdat, and Sven Behnke

                    University of Freiburg
               Institute of Computer Science



                    Nov 29, 2007
Balls and Non-Balls        Finding Ball Candidates   Classification of Ball Candidates   Experiments


 M




       The ball

               is small,
Balls and Non-Balls        Finding Ball Candidates   Classification of Ball Candidates   Experiments


 M




       The ball

               is small,
               is easy to confuse with other objects
Balls and Non-Balls        Finding Ball Candidates   Classification of Ball Candidates   Experiments


 M




       The ball

               is small,
               is easy to confuse with other objects
               is the most important object on the field:
               You cannot play sensibly without knowing its position
Balls and Non-Balls        Finding Ball Candidates   Classification of Ball Candidates   Experiments


 M




       The ball

               is small,
               is easy to confuse with other objects
               is the most important object on the field:
               You cannot play sensibly without knowing its position

          We should put a lot of effort into finding the single real ball.
O



  1   I  B  N-B


  2   F B C


  3   C  B C


  4   E
O



  1   I  B  N-B


  2   F B C


  3   C  B C


  4   E
Balls and Non-Balls   Finding Ball Candidates   Classification of Ball Candidates   Experiments


 H D B L L?
Balls and Non-Balls   Finding Ball Candidates   Classification of Ball Candidates   Experiments


 H D B L L?



                                    T E C
Balls and Non-Balls   Finding Ball Candidates    Classification of Ball Candidates   Experiments


 H D B L L?



                                    L C
Balls and Non-Balls   Finding Ball Candidates     Classification of Ball Candidates   Experiments


 H D B L L?



                                    M B
Balls and Non-Balls   Finding Ball Candidates    Classification of Ball Candidates   Experiments


 H D B L L?



                                    C W L
Balls and Non-Balls   Finding Ball Candidates      Classification of Ball Candidates   Experiments


 H D B L L?



                                    C R
Balls and Non-Balls   Finding Ball Candidates   Classification of Ball Candidates   Experiments


 H D N-B L L?
Balls and Non-Balls   Finding Ball Candidates   Classification of Ball Candidates   Experiments


 H D N-B L L?



                                    H  F
Balls and Non-Balls   Finding Ball Candidates   Classification of Ball Candidates   Experiments


 H D N-B L L?



                                    O O
Balls and Non-Balls   Finding Ball Candidates   Classification of Ball Candidates   Experiments


 H D N-B L L?



                                    O O
Balls and Non-Balls   Finding Ball Candidates   Classification of Ball Candidates   Experiments


 H D N-B L L?



                                    F
Balls and Non-Balls   Finding Ball Candidates   Classification of Ball Candidates   Experiments


 H D N-B L L?



                                    F
O



  1   I  B  N-B


  2   F B C


  3   C  B C


  4   E
Balls and Non-Balls   Finding Ball Candidates   Classification of Ball Candidates   Experiments


 C  E  YUV S
Balls and Non-Balls   Finding Ball Candidates     Classification of Ball Candidates   Experiments


 C  E  YUV S




                                                Two ellipses for “orange”
                                                      Actual ball color
                                                      Wider, brownish color
Balls and Non-Balls   Finding Ball Candidates     Classification of Ball Candidates   Experiments


 C  E  YUV S




                                                Two ellipses for “orange”
                                                      Actual ball color
                                                      Wider, brownish color
                                                      Allows for motion blur
Balls and Non-Balls   Finding Ball Candidates            Classification of Ball Candidates     Experiments


 S  C I



                                                                               orange
           YUV Camera Image
                                                                               (-candidate)


                                                                               white


                                                                               green

                                                64 : 1
Balls and Non-Balls   Finding Ball Candidates            Classification of Ball Candidates     Experiments


 S  C I


           1. Find Maximum
           2. Find Weighted Mean                                               orange
                                                                               (-candidate)


                                                                               white


                                                                               green

                                                64 : 1
Balls and Non-Balls   Finding Ball Candidates            Classification of Ball Candidates     Experiments


 S  C I



                                                                               orange
        cut corresponding area
                                                                               (-candidate)


                                                                               white


                                                                               green

                                                64 : 1
Balls and Non-Balls     Finding Ball Candidates            Classification of Ball Candidates     Experiments


 S  C I



                                                                                 orange
        cut corresponding area
                                                                                 (-candidate)


                                                                                 white


       Box size depends on position in image
                                                                                 green

                                                  64 : 1
O



  1   I  B  N-B


  2   F B C


  3   C  B C


  4   E
Balls and Non-Balls   Finding Ball Candidates   Classification of Ball Candidates   Experiments


 P  C
Balls and Non-Balls      Finding Ball Candidates   Classification of Ball Candidates   Experiments


 P  C




               Projection changes with ellipses: Robust to changes in
               lighting conditions
Balls and Non-Balls      Finding Ball Candidates   Classification of Ball Candidates   Experiments


 P  C




               Projection changes with ellipses: Robust to changes in
               lighting conditions
Balls and Non-Balls      Finding Ball Candidates         Classification of Ball Candidates   Experiments


 P  L



                 YUV-Image                         Y-Image                Subsampled Y-Image




               Subtraction of mean: Robust to changes in lighting conditions
Balls and Non-Balls   Finding Ball Candidates   Classification of Ball Candidates   Experiments


 H L F
Balls and Non-Balls   Finding Ball Candidates   Classification of Ball Candidates   Experiments


 H L F
Balls and Non-Balls   Finding Ball Candidates   Classification of Ball Candidates   Experiments


 H L F


                                                                         -
                                                                       - + -
                                                                         -
                                                                         -
                                                                       - + -
                                                                         -
Balls and Non-Balls   Finding Ball Candidates   Classification of Ball Candidates   Experiments


 N N C




                                                               1: Ball


                                                              0: No Ball


           -
         - + -
           -
O



  1   I  B  N-B


  2   F B C


  3   C  B C


  4   E
Balls and Non-Balls   Finding Ball Candidates              Classification of Ball Candidates   Experiments


 NR KS 06 – T

                                                H
                                                    520 MHz ARM PocketPC
                                                    VGA HTC Camera

                                                D S
                                                    160 balls
                                                    440 non-balls
                                                    divided randomly in training set
                                                    (80%) and test set (20%)
Balls and Non-Balls   Finding Ball Candidates              Classification of Ball Candidates   Experiments


 NR KS 06 – T

                                                H
                                                    520 MHz ARM PocketPC
                                                    VGA HTC Camera

                                                D S
                                                    160 balls
                                                    440 non-balls
                                                    divided randomly in training set
                                                    (80%) and test set (20%)

                                                P (T S)
                                                    100% of distractors classified
                                                    correctly
                                                    1 ball out of 32 not recognized
Balls and Non-Balls   Finding Ball Candidates           Classification of Ball Candidates   Experiments


 NR KS 06 – R T


                                                H
                                                    520 MHz ARM PocketPC
                                                    VGA HTC Camera

                                                R T T




                                                    Robot decides autonomously
                                                    which object to approach.
Balls and Non-Balls   Finding Ball Candidates    Classification of Ball Candidates   Experiments


 NR KS 2007

                                                H
                                                     1.33 GHz PC
                                                     WVGA µEye Camera
Balls and Non-Balls   Finding Ball Candidates              Classification of Ball Candidates   Experiments


 NR KS 2007

   S D                                  D S
                                                    273 balls
                                                    548 non-balls
                                                    training set 62%, validation set
                                                    13%, test set 25%
                                                    varying lighting conditions
Balls and Non-Balls   Finding Ball Candidates              Classification of Ball Candidates   Experiments


 NR KS 2007

   A S                             D S
        Avg Luminance                               273 balls
   ball            non-ball                         548 non-balls
                                                    training set 62%, validation set
                                                    13%, test set 25%
                                                    varying lighting conditions

    Avg Orange-Greenness
   ball            non-ball
Balls and Non-Balls   Finding Ball Candidates              Classification of Ball Candidates   Experiments


 NR KS 2007

   A S                             D S
        Avg Luminance                               273 balls
   ball            non-ball                         548 non-balls
                                                    training set 62%, validation set
                                                    13%, test set 25%
                                                    varying lighting conditions

    Avg Orange-Greenness                        R  T S
   ball            non-ball                         91.1% accuracy
                                                    76.6% if stimuli flipped up/down.
                                                    Drop suggests dependency on
                                                    gradient.
                                                    88.2% if lighting in testset differs.
                                                    Classifier seems indifferent.
Balls and Non-Balls       Finding Ball Candidates          Classification of Ball Candidates   Experiments


 C  C




                                               Classifier
       Task           Neural Net        Linear Classifier            KNN (k = 5)
       Regular            91.1%                     86.5%                      88.5%
       Flipped            74.0%                     70.0%                      76.6%
Balls and Non-Balls      Finding Ball Candidates   Classification of Ball Candidates   Experiments


 C




               The ball has properties aside from being orange
               These properties are exploited by our Neural Network
               Classifiers
               Changes in Lighting conditions can be dealt with by projection
               to lines in YUV-space and Luminance.
               The method introduced here can be generalized to other
               small-sized objects on the field.

More Related Content

Viewers also liked

Using Communication Effectively
Using Communication EffectivelyUsing Communication Effectively
Using Communication EffectivelyOwen Kulemeka
 
Cascao Cortona Gambella Sharing Water Land Resources
Cascao Cortona Gambella Sharing Water Land ResourcesCascao Cortona Gambella Sharing Water Land Resources
Cascao Cortona Gambella Sharing Water Land ResourcesAna Cascao
 
Trauma Equipo7 SecciòN13
Trauma Equipo7 SecciòN13Trauma Equipo7 SecciòN13
Trauma Equipo7 SecciòN13Adrián Chávez
 
Using GradeMark For Effective Feedback
Using GradeMark For Effective FeedbackUsing GradeMark For Effective Feedback
Using GradeMark For Effective FeedbackKarl Luke
 
AEGIS Conference of African Studies 2011 - Uppsala [Land grabbing in Gambella...
AEGIS Conference of African Studies 2011 - Uppsala [Land grabbing in Gambella...AEGIS Conference of African Studies 2011 - Uppsala [Land grabbing in Gambella...
AEGIS Conference of African Studies 2011 - Uppsala [Land grabbing in Gambella...Ana Cascao
 
Seconda Campagna Indagini Relazione Arta Vasto
Seconda Campagna Indagini Relazione Arta VastoSeconda Campagna Indagini Relazione Arta Vasto
Seconda Campagna Indagini Relazione Arta Vastonanni1952
 
The Changing Landscape of Public Relations
The Changing Landscape of Public RelationsThe Changing Landscape of Public Relations
The Changing Landscape of Public RelationsGlen Turpin
 
Starbucks Brandz Report
Starbucks Brandz ReportStarbucks Brandz Report
Starbucks Brandz Reportpmbaird
 
13 Frases Para Vivir
13 Frases Para Vivir13 Frases Para Vivir
13 Frases Para Vivirsutrisno2629
 
Renkomäen koulun veso 30.5.2011
Renkomäen koulun veso 30.5.2011Renkomäen koulun veso 30.5.2011
Renkomäen koulun veso 30.5.2011Jukka Manninen
 
Adding A Course Using Web Reg Revised
Adding A Course Using Web Reg RevisedAdding A Course Using Web Reg Revised
Adding A Course Using Web Reg Revisedjfgodwin
 
CEx sells @ Bienalto
CEx sells @ BienaltoCEx sells @ Bienalto
CEx sells @ BienaltoZafer Bilda
 
Cascao London Resistance Counter-hegemony Transboundary Basins
Cascao London Resistance Counter-hegemony Transboundary BasinsCascao London Resistance Counter-hegemony Transboundary Basins
Cascao London Resistance Counter-hegemony Transboundary BasinsAna Cascao
 

Viewers also liked (20)

Using Communication Effectively
Using Communication EffectivelyUsing Communication Effectively
Using Communication Effectively
 
Knovel2008
Knovel2008Knovel2008
Knovel2008
 
Coffee1
Coffee1Coffee1
Coffee1
 
Cascao Cortona Gambella Sharing Water Land Resources
Cascao Cortona Gambella Sharing Water Land ResourcesCascao Cortona Gambella Sharing Water Land Resources
Cascao Cortona Gambella Sharing Water Land Resources
 
Trauma Equipo7 SecciòN13
Trauma Equipo7 SecciòN13Trauma Equipo7 SecciòN13
Trauma Equipo7 SecciòN13
 
Para Pensar 12
Para Pensar 12Para Pensar 12
Para Pensar 12
 
Using GradeMark For Effective Feedback
Using GradeMark For Effective FeedbackUsing GradeMark For Effective Feedback
Using GradeMark For Effective Feedback
 
AEGIS Conference of African Studies 2011 - Uppsala [Land grabbing in Gambella...
AEGIS Conference of African Studies 2011 - Uppsala [Land grabbing in Gambella...AEGIS Conference of African Studies 2011 - Uppsala [Land grabbing in Gambella...
AEGIS Conference of African Studies 2011 - Uppsala [Land grabbing in Gambella...
 
Seconda Campagna Indagini Relazione Arta Vasto
Seconda Campagna Indagini Relazione Arta VastoSeconda Campagna Indagini Relazione Arta Vasto
Seconda Campagna Indagini Relazione Arta Vasto
 
Lead Management
Lead ManagementLead Management
Lead Management
 
The Changing Landscape of Public Relations
The Changing Landscape of Public RelationsThe Changing Landscape of Public Relations
The Changing Landscape of Public Relations
 
Starbucks Brandz Report
Starbucks Brandz ReportStarbucks Brandz Report
Starbucks Brandz Report
 
Dades i operadors
Dades i operadorsDades i operadors
Dades i operadors
 
13 Frases Para Vivir
13 Frases Para Vivir13 Frases Para Vivir
13 Frases Para Vivir
 
Renkomäen koulun veso 30.5.2011
Renkomäen koulun veso 30.5.2011Renkomäen koulun veso 30.5.2011
Renkomäen koulun veso 30.5.2011
 
Tudlo journey
Tudlo journeyTudlo journey
Tudlo journey
 
Adding A Course Using Web Reg Revised
Adding A Course Using Web Reg RevisedAdding A Course Using Web Reg Revised
Adding A Course Using Web Reg Revised
 
CEx sells @ Bienalto
CEx sells @ BienaltoCEx sells @ Bienalto
CEx sells @ Bienalto
 
Cascao London Resistance Counter-hegemony Transboundary Basins
Cascao London Resistance Counter-hegemony Transboundary BasinsCascao London Resistance Counter-hegemony Transboundary Basins
Cascao London Resistance Counter-hegemony Transboundary Basins
 
Tu Amistad
Tu AmistadTu Amistad
Tu Amistad
 

More from cijat

Learning Kinematics from direct Self-Observation using Nearest-Neighbour Methods
Learning Kinematics from direct Self-Observation using Nearest-Neighbour MethodsLearning Kinematics from direct Self-Observation using Nearest-Neighbour Methods
Learning Kinematics from direct Self-Observation using Nearest-Neighbour Methodscijat
 
Toward Optimal Configuration Space Sampling
Toward Optimal Configuration Space SamplingToward Optimal Configuration Space Sampling
Toward Optimal Configuration Space Samplingcijat
 
CRF-Filters: Discriminative Particle Filters for Sequential State Estimation
CRF-Filters: Discriminative Particle Filters for Sequential State EstimationCRF-Filters: Discriminative Particle Filters for Sequential State Estimation
CRF-Filters: Discriminative Particle Filters for Sequential State Estimationcijat
 
RoboCup Introduction
RoboCup IntroductionRoboCup Introduction
RoboCup Introductioncijat
 
Local and Global Gating of Synaptic Plasticity
Local and Global Gating of Synaptic PlasticityLocal and Global Gating of Synaptic Plasticity
Local and Global Gating of Synaptic Plasticitycijat
 
Auxiliary
AuxiliaryAuxiliary
Auxiliarycijat
 
Affordances
AffordancesAffordances
Affordancescijat
 

More from cijat (7)

Learning Kinematics from direct Self-Observation using Nearest-Neighbour Methods
Learning Kinematics from direct Self-Observation using Nearest-Neighbour MethodsLearning Kinematics from direct Self-Observation using Nearest-Neighbour Methods
Learning Kinematics from direct Self-Observation using Nearest-Neighbour Methods
 
Toward Optimal Configuration Space Sampling
Toward Optimal Configuration Space SamplingToward Optimal Configuration Space Sampling
Toward Optimal Configuration Space Sampling
 
CRF-Filters: Discriminative Particle Filters for Sequential State Estimation
CRF-Filters: Discriminative Particle Filters for Sequential State EstimationCRF-Filters: Discriminative Particle Filters for Sequential State Estimation
CRF-Filters: Discriminative Particle Filters for Sequential State Estimation
 
RoboCup Introduction
RoboCup IntroductionRoboCup Introduction
RoboCup Introduction
 
Local and Global Gating of Synaptic Plasticity
Local and Global Gating of Synaptic PlasticityLocal and Global Gating of Synaptic Plasticity
Local and Global Gating of Synaptic Plasticity
 
Auxiliary
AuxiliaryAuxiliary
Auxiliary
 
Affordances
AffordancesAffordances
Affordances
 

Recently uploaded

Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024The Digital Insurer
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...apidays
 
HTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesHTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesBoston Institute of Analytics
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProduct Anonymous
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAndrey Devyatkin
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherRemote DBA Services
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodJuan lago vázquez
 
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...Principled Technologies
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024The Digital Insurer
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Scriptwesley chun
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)wesley chun
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024The Digital Insurer
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsJoaquim Jorge
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc
 

Recently uploaded (20)

Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
HTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesHTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation Strategies
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 

The ball is not just orange.

  • 1. A B I N J O: U C  L  C R  I Hannes Schulz, Hauke Strasdat, and Sven Behnke University of Freiburg Institute of Computer Science Nov 29, 2007
  • 2. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments M The ball is small,
  • 3. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments M The ball is small, is easy to confuse with other objects
  • 4. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments M The ball is small, is easy to confuse with other objects is the most important object on the field: You cannot play sensibly without knowing its position
  • 5. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments M The ball is small, is easy to confuse with other objects is the most important object on the field: You cannot play sensibly without knowing its position We should put a lot of effort into finding the single real ball.
  • 6. O 1 I  B  N-B 2 F B C 3 C  B C 4 E
  • 7. O 1 I  B  N-B 2 F B C 3 C  B C 4 E
  • 8. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D B L L?
  • 9. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D B L L? T E C
  • 10. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D B L L? L C
  • 11. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D B L L? M B
  • 12. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D B L L? C W L
  • 13. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D B L L? C R
  • 14. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D N-B L L?
  • 15. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D N-B L L? H  F
  • 16. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D N-B L L? O O
  • 17. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D N-B L L? O O
  • 18. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D N-B L L? F
  • 19. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D N-B L L? F
  • 20. O 1 I  B  N-B 2 F B C 3 C  B C 4 E
  • 21. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments C  E  YUV S
  • 22. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments C  E  YUV S Two ellipses for “orange” Actual ball color Wider, brownish color
  • 23. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments C  E  YUV S Two ellipses for “orange” Actual ball color Wider, brownish color Allows for motion blur
  • 24. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments S  C I orange YUV Camera Image (-candidate) white green 64 : 1
  • 25. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments S  C I 1. Find Maximum 2. Find Weighted Mean orange (-candidate) white green 64 : 1
  • 26. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments S  C I orange cut corresponding area (-candidate) white green 64 : 1
  • 27. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments S  C I orange cut corresponding area (-candidate) white Box size depends on position in image green 64 : 1
  • 28. O 1 I  B  N-B 2 F B C 3 C  B C 4 E
  • 29. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments P  C
  • 30. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments P  C Projection changes with ellipses: Robust to changes in lighting conditions
  • 31. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments P  C Projection changes with ellipses: Robust to changes in lighting conditions
  • 32. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments P  L YUV-Image Y-Image Subsampled Y-Image Subtraction of mean: Robust to changes in lighting conditions
  • 33. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H L F
  • 34. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H L F
  • 35. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H L F - - + - - - - + - -
  • 36. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments N N C 1: Ball 0: No Ball - - + - -
  • 37. O 1 I  B  N-B 2 F B C 3 C  B C 4 E
  • 38. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments NR KS 06 – T H 520 MHz ARM PocketPC VGA HTC Camera D S 160 balls 440 non-balls divided randomly in training set (80%) and test set (20%)
  • 39. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments NR KS 06 – T H 520 MHz ARM PocketPC VGA HTC Camera D S 160 balls 440 non-balls divided randomly in training set (80%) and test set (20%) P (T S) 100% of distractors classified correctly 1 ball out of 32 not recognized
  • 40. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments NR KS 06 – R T H 520 MHz ARM PocketPC VGA HTC Camera R T T Robot decides autonomously which object to approach.
  • 41. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments NR KS 2007 H 1.33 GHz PC WVGA µEye Camera
  • 42. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments NR KS 2007 S D D S 273 balls 548 non-balls training set 62%, validation set 13%, test set 25% varying lighting conditions
  • 43. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments NR KS 2007 A S D S Avg Luminance 273 balls ball non-ball 548 non-balls training set 62%, validation set 13%, test set 25% varying lighting conditions Avg Orange-Greenness ball non-ball
  • 44. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments NR KS 2007 A S D S Avg Luminance 273 balls ball non-ball 548 non-balls training set 62%, validation set 13%, test set 25% varying lighting conditions Avg Orange-Greenness R  T S ball non-ball 91.1% accuracy 76.6% if stimuli flipped up/down. Drop suggests dependency on gradient. 88.2% if lighting in testset differs. Classifier seems indifferent.
  • 45. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments C  C Classifier Task Neural Net Linear Classifier KNN (k = 5) Regular 91.1% 86.5% 88.5% Flipped 74.0% 70.0% 76.6%
  • 46. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments C The ball has properties aside from being orange These properties are exploited by our Neural Network Classifiers Changes in Lighting conditions can be dealt with by projection to lines in YUV-space and Luminance. The method introduced here can be generalized to other small-sized objects on the field.