Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Sentiment Analysis in Twitter Contributed by: Ayushi Dalmia (ayushi.Dalmia@research.iiit.ac.in) Mayank Gupta(mayank.g@stud...
What is Sentiment Analysis? • It is classification of the polarity of a given text in the document, sentence or phrase • T...
Positive Negative Neutral
Why is Sentiment Analysis Important? • Microblogging has become popular communication tool • Opinion of the mass is import...
Using Twitter for Sentiment Analysis • Popular microblogging site • Short Text Messages of 140 characters • 240+ million a...
Problem Statement The problem at hand consists of two subtasks: • Phrase Level Sentiment Analysis in Twitter : Given a mes...
Challenges • Tweets are highly unstructured and also non-grammatical • Out of Vocabulary Words • Lexical Variation • Exten...
Approach SVM Classifier and Prediction Feature Extractor Preprocessing Tokeniser Tweet Downloader
• Tweet Downloader • Download the tweets using Twitter API • Tokenisation • Twitter specific POS Tagger developed by ARK S...
• Feature Extractor • Polarity Score of the Tweet • Percentage of Capitalised Words • Number of Positive/Negative Capitali...
Results A baseline model by taking the unigrams, bigrams and trigrams and compare it with the feature based model for both...
Conclusion • We investigated two kinds of models: Baseline and Feature Based Models and demonstrate that combination of bo...
Upcoming SlideShare
Loading in …5
×

Sentiment Analysis in Twitter

32,987 views

Published on

SentiTweet is a sentiment analysis tool for identifying the sentiment of the tweets as positive, negative and neutral.SentiTweet comes to rescue to find the sentiment of a single tweet or a set of tweets. Not only that it also enables you to find out the sentiment of the entire tweet or specific phrases of the tweet.

Published in: Software, Technology, Business
no profile picture user
  • Writing a good research paper isn't easy and it's the fruit of hard work. For help you can check writing expert. Check out, please ⇒ www.HelpWriting.net ⇐ I think they are the best
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • You might get some help from ⇒ www.WritePaper.info ⇐ Success and best regards!
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • I’ve personally never heard of companies who can produce a paper for you until word got around among my college groupmates. My professor asked me to write a research paper based on a field I have no idea about. My research skills are also very poor. So, I thought I’d give it a try. I chose a writer who matched my writing style and fulfilled every requirement I proposed. I turned my paper in and I actually got a good grade. I highly recommend ⇒ www.WritePaper.info ⇐
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • panels searching for survey takers! =>> https://t.cn/A6ybK3XL
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • If you want to discover how you can increase your cup size within 6 weeks then you need to see this new website... This is an all natural alternative to painful surgery or expensive pills... It's what plastic surgeons have been hiding for years. Jenny went from an A cup to a C cup in just 6 weeks. Want to do the same yourself... ➽➽ https://t.cn/A6Li7dmy
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
Show More
Show More

Sentiment Analysis in Twitter

  1. 1. Sentiment Analysis in Twitter Contributed by: Ayushi Dalmia (ayushi.Dalmia@research.iiit.ac.in) Mayank Gupta(mayank.g@student.iiit.ac.in) Arpit Kumar Jaiswal(arpitkumar.jaiswal@students.iiit.ac.in) Chinthala Tharun Reddy(tharun.chinthala@students.iiit.ac.in) Course: Information Retrieval and Extraction, IIIT Hyderabad Instructor: Dr. Vasudeva Varma Source Code: [http://github.com/mayank93/Twitter-Sentiment-Analysis] Demo: [http://10.2.4.49:8000/TSAA/]
  2. 2. What is Sentiment Analysis? • It is classification of the polarity of a given text in the document, sentence or phrase • The goal is to determine whether the expressed opinion in the text is positive, negative or neutral.
  3. 3. Positive Negative Neutral
  4. 4. Why is Sentiment Analysis Important? • Microblogging has become popular communication tool • Opinion of the mass is important • Political party may want to know whether people support their program or not. • Before investing into a company, one can leverage the sentiment of the people for the company to find out where it stands. • A company might want find out the reviews of its products
  5. 5. Using Twitter for Sentiment Analysis • Popular microblogging site • Short Text Messages of 140 characters • 240+ million active users • 500 million tweets are generated everyday • Twitter audience varies from common man to celebrities • Users often discuss current affairs and share personal views on various subjects • Tweets are small in length and hence unambiguous
  6. 6. Problem Statement The problem at hand consists of two subtasks: • Phrase Level Sentiment Analysis in Twitter : Given a message containing a marked instance of a word or a phrase, determine whether that instance is positive, negative or neutral in that context. • Sentence Level Sentiment Analysis in Twitter: Given a message, decide whether the message is of positive, negative, or neutral sentiment. For messages conveying both a positive and negative sentiment, whichever is the stronger sentiment should be chosen. The task is inspired from SemEval 2013 , Task 9 : Sentiment Analysis in Twitter
  7. 7. Challenges • Tweets are highly unstructured and also non-grammatical • Out of Vocabulary Words • Lexical Variation • Extensive usage of acronyms like asap, lol, afaik
  8. 8. Approach SVM Classifier and Prediction Feature Extractor Preprocessing Tokeniser Tweet Downloader
  9. 9. • Tweet Downloader • Download the tweets using Twitter API • Tokenisation • Twitter specific POS Tagger developed by ARK Social Media Search • Preprocessing • Removing non-English Tweets • Replacing Emoticons by their polarity • Remove URL, Target Mentions, Hashtags, Numbers. • Replace Negative Mentions • Replace Sequence of Repeated Characters eg. ‘coooooooool’ by ‘coool’ • Remove Nouns and Prepositions Approach
  10. 10. • Feature Extractor • Polarity Score of the Tweet • Percentage of Capitalised Words • Number of Positive/Negative Capitalised Words • Number of Positive/Negative Hashtags • Number of Positive/Negative/Extremely Positive/Extremely Negative Emoticons • Number of Negation • Positive/Negative special POS Tags Polarity Score • Number of special characters : ?,!,* • Number of special POS • Classifier and Prediction • The features extracted are next passed on to SVM classifier. • The model built is used to predict the sentiment of the new tweets. Approach
  11. 11. Results A baseline model by taking the unigrams, bigrams and trigrams and compare it with the feature based model for both the sub-tasks Sub-Task Baseline Model Feature Based Model Baseline + Feature Based Model Phrase Based 62.24 % 77.33% 79.90% Sentence Based 52.54% 57.57% 58.36% Accuracy F1 Score Sub-Task Baseline Model Feature Based Model Baseline + Feature Based Model Phrase Based 76.27* 75.23 75.98 Sentence Based 55.70 59.86 60.55 *Classifies in positive classes only, hence high recall.
  12. 12. Conclusion • We investigated two kinds of models: Baseline and Feature Based Models and demonstrate that combination of both these models perform the best. • For our feature-based approach, feature analysis reveals that the most important features are those that combine the prior polarity of words and their parts-of-speech tags.

×