SlideShare a Scribd company logo
1 of 19
Download to read offline
Exploiting context for rumour detection in social media
Arkaitz Zubiaga, Maria Liakata, Rob Procter
9th International Conference on Social Informatics (SocInfo 2017)
15th
September 2017
What IS a rumour?
What IS NOT a rumour?
●
There is confusion in the CS/CSS literature,
with many classifying rumour (false) vs
news (true).
●
Rumour not necessarily fake, it’s not the
same as a hoax!
What IS a rumour?
Oxford English Dictionary:
A currently circulating story or report of
uncertain or doubtful truth.
e.g. ‘they were investigating rumours of a
massacre’
What IS a rumour?
●
In line with other scientists since (Allport &
Postman, 1946):
“unverified and instrumentally relevant
information statements in circulation”
(Di Fonzo & Bordia, 2007)
So… rumour detection?
●
Rumour detection consists in identifying
the parts of information that, while in
circulation, are unverified.
●
We do this for breaking news stories.
Manual annotation of rumours
Performed by journalism partners.
Rumour dataset
Automated rumour detection
●
Only work by (Zhao et al., 2015). Looking at
how others reply, e.g. is this true?
●
Limitations:
– Regexps, not generalisable.
– Replies may delay or never come.
Automated rumour detection
Our proposal
●
Classify in real-time as soon as we observe
a tweet, don’t wait for replies.
●
Caveat: Tweet may not say much, e.g.:
“Strange flag in #Sydney, not the one affiliated with #ISIS.”
“10 people have died”
Our proposal
●
Look at context:
– What has been said before throughout the event?
– How do those help determine if current tweet is a
rumour?
Our proposal
Our proposal
●
We leverage context using CRF.
Results
Results by event
Discussion
●
Preceding context boosts real-time rumour
detection.
●
Important to do it in real-time, prevent
rumour spreading!
●
Rumour detection ≠ hoax detection!
– Nor fake news detection.
Questions?
●
Further reading:
Arkaitz Zubiaga, Ahmet Aker, Kalina Bontcheva, Maria Liakata, Rob Procter. Detection
and Resolution of Rumours in Social Media: A Survey. ACM Computing Surveys.
Forthcoming, pre-print at:
https://arxiv.org/abs/1704.00656
●
Dataset:
https://bitly.com/rumour-data
Contact: a.zubiaga@warwick.ac.uk, Twitter: @arkaitz
Discussion

More Related Content

Similar to Exploiting context for rumour detection in social media

“I have done some things that would quite be qualified as journalism, but I d...
“I have done some things that would quite be qualified as journalism, but I d...“I have done some things that would quite be qualified as journalism, but I d...
“I have done some things that would quite be qualified as journalism, but I d...
Janet Fulton
 
MEDIT Seminar: First Week is Editorial, Second Week is Algorithmical: the New...
MEDIT Seminar: First Week is Editorial, Second Week is Algorithmical: the New...MEDIT Seminar: First Week is Editorial, Second Week is Algorithmical: the New...
MEDIT Seminar: First Week is Editorial, Second Week is Algorithmical: the New...
Tiziano Bonini
 
Running Head ACCOUNTABILITY IN THE MEDIA1ACCOUNTABILITY IN .docx
Running Head ACCOUNTABILITY IN THE MEDIA1ACCOUNTABILITY IN .docxRunning Head ACCOUNTABILITY IN THE MEDIA1ACCOUNTABILITY IN .docx
Running Head ACCOUNTABILITY IN THE MEDIA1ACCOUNTABILITY IN .docx
SUBHI7
 

Similar to Exploiting context for rumour detection in social media (20)

Indian chronicles summary
Indian chronicles summaryIndian chronicles summary
Indian chronicles summary
 
Infographics- getting the message
Infographics- getting the messageInfographics- getting the message
Infographics- getting the message
 
Role of a journalist in the age of open data and rise of Fifth Estate
Role of a journalist in the age of open data and rise of Fifth EstateRole of a journalist in the age of open data and rise of Fifth Estate
Role of a journalist in the age of open data and rise of Fifth Estate
 
“I have done some things that would quite be qualified as journalism, but I d...
“I have done some things that would quite be qualified as journalism, but I d...“I have done some things that would quite be qualified as journalism, but I d...
“I have done some things that would quite be qualified as journalism, but I d...
 
State of the newsroom report 2017
State of the newsroom report 2017State of the newsroom report 2017
State of the newsroom report 2017
 
The rise of fact checking sites in europe
The rise of fact checking sites in europeThe rise of fact checking sites in europe
The rise of fact checking sites in europe
 
Runnymede workshop 4: PR
Runnymede workshop 4: PRRunnymede workshop 4: PR
Runnymede workshop 4: PR
 
The Hitchhiker's Guide to Disinformation, Public Opinion Swinging and False F...
The Hitchhiker's Guide to Disinformation, Public Opinion Swinging and False F...The Hitchhiker's Guide to Disinformation, Public Opinion Swinging and False F...
The Hitchhiker's Guide to Disinformation, Public Opinion Swinging and False F...
 
MEDIT Seminar: First Week is Editorial, Second Week is Algorithmical: the New...
MEDIT Seminar: First Week is Editorial, Second Week is Algorithmical: the New...MEDIT Seminar: First Week is Editorial, Second Week is Algorithmical: the New...
MEDIT Seminar: First Week is Editorial, Second Week is Algorithmical: the New...
 
Writing Infographic.pptx
Writing Infographic.pptxWriting Infographic.pptx
Writing Infographic.pptx
 
A STUDY ON THE STATE OF INVESTIGATIVE JOURNALISM IN NEPAL A PROJECT WORK
A STUDY ON THE STATE OF INVESTIGATIVE JOURNALISM IN NEPAL A PROJECT WORKA STUDY ON THE STATE OF INVESTIGATIVE JOURNALISM IN NEPAL A PROJECT WORK
A STUDY ON THE STATE OF INVESTIGATIVE JOURNALISM IN NEPAL A PROJECT WORK
 
nopeyy
nopeyynopeyy
nopeyy
 
Running Head ACCOUNTABILITY IN THE MEDIA1ACCOUNTABILITY IN .docx
Running Head ACCOUNTABILITY IN THE MEDIA1ACCOUNTABILITY IN .docxRunning Head ACCOUNTABILITY IN THE MEDIA1ACCOUNTABILITY IN .docx
Running Head ACCOUNTABILITY IN THE MEDIA1ACCOUNTABILITY IN .docx
 
Print Press Prospects : Future of Journalsim (Free Book)
Print Press Prospects : Future of Journalsim (Free Book)Print Press Prospects : Future of Journalsim (Free Book)
Print Press Prospects : Future of Journalsim (Free Book)
 
Media Bias Essay
Media Bias EssayMedia Bias Essay
Media Bias Essay
 
Singer
SingerSinger
Singer
 
Detecting Patterns in News Media Content
Detecting Patterns in News Media ContentDetecting Patterns in News Media Content
Detecting Patterns in News Media Content
 
Oii Sdp Nils Yana 10 07 09
Oii Sdp Nils Yana 10 07 09Oii Sdp Nils Yana 10 07 09
Oii Sdp Nils Yana 10 07 09
 
Documents
DocumentsDocuments
Documents
 
hutchison effect scientists
hutchison effect scientists hutchison effect scientists
hutchison effect scientists
 

More from azubiaga

Mining Twitter for Real-Time Trend and Information Discovery
Mining Twitter for Real-Time Trend and Information DiscoveryMining Twitter for Real-Time Trend and Information Discovery
Mining Twitter for Real-Time Trend and Information Discovery
azubiaga
 
Newspaper Editors vs the Crowd: On the Appropriateness of Front Page News Sel...
Newspaper Editors vs the Crowd: On the Appropriateness of Front Page News Sel...Newspaper Editors vs the Crowd: On the Appropriateness of Front Page News Sel...
Newspaper Editors vs the Crowd: On the Appropriateness of Front Page News Sel...
azubiaga
 
Harnessing Folksonomies for Resource Classification
Harnessing Folksonomies for Resource ClassificationHarnessing Folksonomies for Resource Classification
Harnessing Folksonomies for Resource Classification
azubiaga
 
Tags vs Shelves: From Social Tagging to Social Classification
Tags vs Shelves: From Social Tagging to Social ClassificationTags vs Shelves: From Social Tagging to Social Classification
Tags vs Shelves: From Social Tagging to Social Classification
azubiaga
 

More from azubiaga (14)

Crowdsourcing the Annotation of Rumourous Conversations in Social Media
Crowdsourcing the Annotation of Rumourous Conversations in Social MediaCrowdsourcing the Annotation of Rumourous Conversations in Social Media
Crowdsourcing the Annotation of Rumourous Conversations in Social Media
 
Microposts2015 - Social Spam Detection on Twitter
Microposts2015 - Social Spam Detection on TwitterMicroposts2015 - Social Spam Detection on Twitter
Microposts2015 - Social Spam Detection on Twitter
 
Curating and Contextualizing Twitter Stories to Assist with Social Newsgathering
Curating and Contextualizing Twitter Stories to Assist with Social NewsgatheringCurating and Contextualizing Twitter Stories to Assist with Social Newsgathering
Curating and Contextualizing Twitter Stories to Assist with Social Newsgathering
 
Mining Twitter for Real-Time Trend and Information Discovery
Mining Twitter for Real-Time Trend and Information DiscoveryMining Twitter for Real-Time Trend and Information Discovery
Mining Twitter for Real-Time Trend and Information Discovery
 
Newspaper Editors vs the Crowd: On the Appropriateness of Front Page News Sel...
Newspaper Editors vs the Crowd: On the Appropriateness of Front Page News Sel...Newspaper Editors vs the Crowd: On the Appropriateness of Front Page News Sel...
Newspaper Editors vs the Crowd: On the Appropriateness of Front Page News Sel...
 
Harnessing Folksonomies for Resource Classification
Harnessing Folksonomies for Resource ClassificationHarnessing Folksonomies for Resource Classification
Harnessing Folksonomies for Resource Classification
 
Clasificación de Páginas Web con Anotaciones Sociales
Clasificación de Páginas Web con Anotaciones SocialesClasificación de Páginas Web con Anotaciones Sociales
Clasificación de Páginas Web con Anotaciones Sociales
 
Content-based Clustering for Tag Cloud Visualization
Content-based Clustering for Tag Cloud VisualizationContent-based Clustering for Tag Cloud Visualization
Content-based Clustering for Tag Cloud Visualization
 
Getting the Most Out of Social Annotations for Web Page Classification
Getting the Most Out of Social Annotations for Web Page ClassificationGetting the Most Out of Social Annotations for Web Page Classification
Getting the Most Out of Social Annotations for Web Page Classification
 
Enhancing Navigation on Wikipedia with Social Tags
Enhancing Navigation on Wikipedia with Social TagsEnhancing Navigation on Wikipedia with Social Tags
Enhancing Navigation on Wikipedia with Social Tags
 
Is Unlabeled Data Suitable for Multiclass SVM-based Web Page Classification?
Is Unlabeled Data Suitable for Multiclass SVM-based Web Page Classification?Is Unlabeled Data Suitable for Multiclass SVM-based Web Page Classification?
Is Unlabeled Data Suitable for Multiclass SVM-based Web Page Classification?
 
Etiketa-lainoen ikuskera hobetzeko multzokatzea
Etiketa-lainoen ikuskera hobetzeko multzokatzeaEtiketa-lainoen ikuskera hobetzeko multzokatzea
Etiketa-lainoen ikuskera hobetzeko multzokatzea
 
Master thesis presentation
Master thesis presentationMaster thesis presentation
Master thesis presentation
 
Tags vs Shelves: From Social Tagging to Social Classification
Tags vs Shelves: From Social Tagging to Social ClassificationTags vs Shelves: From Social Tagging to Social Classification
Tags vs Shelves: From Social Tagging to Social Classification
 

Recently uploaded

Chemical Tests; flame test, positive and negative ions test Edexcel Internati...
Chemical Tests; flame test, positive and negative ions test Edexcel Internati...Chemical Tests; flame test, positive and negative ions test Edexcel Internati...
Chemical Tests; flame test, positive and negative ions test Edexcel Internati...
ssuser79fe74
 
Hubble Asteroid Hunter III. Physical properties of newly found asteroids
Hubble Asteroid Hunter III. Physical properties of newly found asteroidsHubble Asteroid Hunter III. Physical properties of newly found asteroids
Hubble Asteroid Hunter III. Physical properties of newly found asteroids
Sérgio Sacani
 
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune WaterworldsBiogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Sérgio Sacani
 
SCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptx
SCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptxSCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptx
SCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptx
RizalinePalanog2
 
GUIDELINES ON SIMILAR BIOLOGICS Regulatory Requirements for Marketing Authori...
GUIDELINES ON SIMILAR BIOLOGICS Regulatory Requirements for Marketing Authori...GUIDELINES ON SIMILAR BIOLOGICS Regulatory Requirements for Marketing Authori...
GUIDELINES ON SIMILAR BIOLOGICS Regulatory Requirements for Marketing Authori...
Lokesh Kothari
 
Biopesticide (2).pptx .This slides helps to know the different types of biop...
Biopesticide (2).pptx  .This slides helps to know the different types of biop...Biopesticide (2).pptx  .This slides helps to know the different types of biop...
Biopesticide (2).pptx .This slides helps to know the different types of biop...
RohitNehra6
 
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
Lokesh Kothari
 
Disentangling the origin of chemical differences using GHOST
Disentangling the origin of chemical differences using GHOSTDisentangling the origin of chemical differences using GHOST
Disentangling the origin of chemical differences using GHOST
Sérgio Sacani
 

Recently uploaded (20)

Chemical Tests; flame test, positive and negative ions test Edexcel Internati...
Chemical Tests; flame test, positive and negative ions test Edexcel Internati...Chemical Tests; flame test, positive and negative ions test Edexcel Internati...
Chemical Tests; flame test, positive and negative ions test Edexcel Internati...
 
Hubble Asteroid Hunter III. Physical properties of newly found asteroids
Hubble Asteroid Hunter III. Physical properties of newly found asteroidsHubble Asteroid Hunter III. Physical properties of newly found asteroids
Hubble Asteroid Hunter III. Physical properties of newly found asteroids
 
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune WaterworldsBiogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
 
Pulmonary drug delivery system M.pharm -2nd sem P'ceutics
Pulmonary drug delivery system M.pharm -2nd sem P'ceuticsPulmonary drug delivery system M.pharm -2nd sem P'ceutics
Pulmonary drug delivery system M.pharm -2nd sem P'ceutics
 
SCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptx
SCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptxSCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptx
SCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptx
 
GBSN - Biochemistry (Unit 1)
GBSN - Biochemistry (Unit 1)GBSN - Biochemistry (Unit 1)
GBSN - Biochemistry (Unit 1)
 
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...
 
High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...
High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...
High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...
 
GUIDELINES ON SIMILAR BIOLOGICS Regulatory Requirements for Marketing Authori...
GUIDELINES ON SIMILAR BIOLOGICS Regulatory Requirements for Marketing Authori...GUIDELINES ON SIMILAR BIOLOGICS Regulatory Requirements for Marketing Authori...
GUIDELINES ON SIMILAR BIOLOGICS Regulatory Requirements for Marketing Authori...
 
GBSN - Microbiology (Unit 2)
GBSN - Microbiology (Unit 2)GBSN - Microbiology (Unit 2)
GBSN - Microbiology (Unit 2)
 
Biological Classification BioHack (3).pdf
Biological Classification BioHack (3).pdfBiological Classification BioHack (3).pdf
Biological Classification BioHack (3).pdf
 
Recombinant DNA technology (Immunological screening)
Recombinant DNA technology (Immunological screening)Recombinant DNA technology (Immunological screening)
Recombinant DNA technology (Immunological screening)
 
Chemistry 4th semester series (krishna).pdf
Chemistry 4th semester series (krishna).pdfChemistry 4th semester series (krishna).pdf
Chemistry 4th semester series (krishna).pdf
 
Zoology 4th semester series (krishna).pdf
Zoology 4th semester series (krishna).pdfZoology 4th semester series (krishna).pdf
Zoology 4th semester series (krishna).pdf
 
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...
 
Biopesticide (2).pptx .This slides helps to know the different types of biop...
Biopesticide (2).pptx  .This slides helps to know the different types of biop...Biopesticide (2).pptx  .This slides helps to know the different types of biop...
Biopesticide (2).pptx .This slides helps to know the different types of biop...
 
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
 
Isotopic evidence of long-lived volcanism on Io
Isotopic evidence of long-lived volcanism on IoIsotopic evidence of long-lived volcanism on Io
Isotopic evidence of long-lived volcanism on Io
 
SAMASTIPUR CALL GIRL 7857803690 LOW PRICE ESCORT SERVICE
SAMASTIPUR CALL GIRL 7857803690  LOW PRICE  ESCORT SERVICESAMASTIPUR CALL GIRL 7857803690  LOW PRICE  ESCORT SERVICE
SAMASTIPUR CALL GIRL 7857803690 LOW PRICE ESCORT SERVICE
 
Disentangling the origin of chemical differences using GHOST
Disentangling the origin of chemical differences using GHOSTDisentangling the origin of chemical differences using GHOST
Disentangling the origin of chemical differences using GHOST
 

Exploiting context for rumour detection in social media

  • 1. Exploiting context for rumour detection in social media Arkaitz Zubiaga, Maria Liakata, Rob Procter 9th International Conference on Social Informatics (SocInfo 2017) 15th September 2017
  • 2. What IS a rumour?
  • 3. What IS NOT a rumour? ● There is confusion in the CS/CSS literature, with many classifying rumour (false) vs news (true). ● Rumour not necessarily fake, it’s not the same as a hoax!
  • 4. What IS a rumour? Oxford English Dictionary: A currently circulating story or report of uncertain or doubtful truth. e.g. ‘they were investigating rumours of a massacre’
  • 5. What IS a rumour? ● In line with other scientists since (Allport & Postman, 1946): “unverified and instrumentally relevant information statements in circulation” (Di Fonzo & Bordia, 2007)
  • 6. So… rumour detection? ● Rumour detection consists in identifying the parts of information that, while in circulation, are unverified. ● We do this for breaking news stories.
  • 7. Manual annotation of rumours Performed by journalism partners.
  • 9. Automated rumour detection ● Only work by (Zhao et al., 2015). Looking at how others reply, e.g. is this true? ● Limitations: – Regexps, not generalisable. – Replies may delay or never come.
  • 11. Our proposal ● Classify in real-time as soon as we observe a tweet, don’t wait for replies. ● Caveat: Tweet may not say much, e.g.: “Strange flag in #Sydney, not the one affiliated with #ISIS.” “10 people have died”
  • 12. Our proposal ● Look at context: – What has been said before throughout the event? – How do those help determine if current tweet is a rumour?
  • 14. Our proposal ● We leverage context using CRF.
  • 17. Discussion ● Preceding context boosts real-time rumour detection. ● Important to do it in real-time, prevent rumour spreading! ● Rumour detection ≠ hoax detection! – Nor fake news detection.
  • 18. Questions? ● Further reading: Arkaitz Zubiaga, Ahmet Aker, Kalina Bontcheva, Maria Liakata, Rob Procter. Detection and Resolution of Rumours in Social Media: A Survey. ACM Computing Surveys. Forthcoming, pre-print at: https://arxiv.org/abs/1704.00656 ● Dataset: https://bitly.com/rumour-data Contact: a.zubiaga@warwick.ac.uk, Twitter: @arkaitz