Sentiment Analysis with Topic Modelling
What is it
Sentiments, feelings and emotions are an integral part of human nature. Over 2.5 quintillion bytes of data are created every single day. Twitter itself generates 500 million tweets every day. Sentiment Analysis deals with examining the study of textual data like posts, blogs, reviews, etc., expressed by users regarding their views and opinions about a specific product, service, event, idea, news or person.
The most common use of Sentiment Analysis is classifying the text into class(es). It can be binary like positive/negative, yes/no, etc., or multi-class like positive-negative-neutral, yes-no-maybe, etc. Sentiment Analysis aids organisations to track the following:
· Brand popularity and acceptance
· New product anticipation and perception
· Company reputation
· Understand the customer experience
What we did
During our analysis of social media comments for one of the biggest cosmetic giants of the US and France, we followed the protocol of Natural Language Processing (NLP). We first analyze raw data, which contains text and tons of emoticons. Besides analysing long reviews and posts that mention multiple products, our challenges were complicated sentences, sarcasm, slang. For example, in beauty parlance, “It just sucks everything from my pores” would mean a positive sentiment OR “I am dying to use ABC product” would mean a positive sentiment.
Our solution design not only concentrated around the classification of data as positive/negative/neutral, but also topic modeling. Topic modeling is a process to automatically detect topics in the text and derive hidden patterns in the corpus, thus assisting in better decision-making. Topics can also be defined as a repeated pattern of most occurring terms in a corpus of text.
As shown above, in a snapshot, the terms that were relevant for the highlighted topic in red give an indication of what is important to the user for that term. For e.g. When the topic “glow” is used, terms like “abhcosmetics”, “mabelline”, “purpleheart”, etc. are most frequently used. This provides a detailed insight to the business owners for marketing the right products in the right category or to provide the right offers on brands when the customer is looking for “glow”.
Where is the future
Topic Models are advantageous in domains like HR Recruitment, where the right candidates can be mapped to the right job profile. It can also aid the News industry where the correct articles are recommended to the right set of users. Or to gauge public opinion on policy announcements and campaign messages ahead of presidential elections. Thus, sentiment analysis, along with topic modelling, can not only help you know what people are thinking about you but also about your competitors.
For a customized solution to your business problem, please contact us.