Automated sentiment analysis is one of the most criticized features within Social media analytics / monitoring family.
From my experience I have an idea that out of all comments generated by any tool, be it Radian6, Alterian SM2, or any other tool, there is an accuracy gap. I believe that the inaccuracy of measuring sentiment by any tool is about 70%. Most of these gaps occur when the sentiment is marked neutral. Another reason of gap is these tools are not able to identify local slangs, words or phrases translated or written in English, sarcasm and mood of author.
When I recently read the news that Viralheat, a social media monitoring tool, has released free Chrome plug-in that adds sentiment analysis to Twitter timeline, I decided to give it a shot.
Viralheat’s this new plugin can be found easily on Chrome web store and it takes couple of minutes to install. Once the plug-in is installed, and you open your Twitter page on Chrome, the plug-in adds a bar on top of Twitter page and displays aggregated sentiment for displayed tweets on that page. When user searches for any brand i.e. ‘iPhone’, it will provide sentiment for all relevant tweets.
My first thought was that the tool is pretty handy if I am on my Twitter page. It lets me see the sentiment of the post and get overall idea of what’s happening around the brand, product or service I search for. One other feature I found interesting was that it lets you change the sentiment on Twitter page itself.
This tool can prove handy to see the sentiment around a live event or a hashtag (#).
I thought to run a small test on the accuracy of the tool. I took a sample of 50 tweets and compared the sentiment provided by the tool with manually analysed sentiments for same tweets.
I noticed, the tool analysed multiple posts on same topic with different sentiments. For example, a news article which was shared by many users, “Samsung Galaxy SII sales hit 10 Million, excluding United States” was analysed incorrectly 85% times. The overall accuracy was observed to 30%.
Disclaimer: Views of authors are personal and do not represent the views of Blogworks, or any of its clients.