Archive for the ‘Buzz tracking’ Category.

What type of brand are you online?

Ripstop nylon is the primary material used in ...
Image via Wikipedia

There are four types of brands online, and you can distinguish between them by listening to and analysing the conversations about the brands. This is an insightful takeaway from one of the most interesting presentations at the Social Media Marketing 2010 conference in London earlier in June. The presentation from web monitoring company Synthesio presented these four types of brand, showed the nature of conversations about them online and then showed some best practice examples of how such brands can engage online.

Given that we’re a social media agency, and we’ve just published our Social Media Monitoring 2010 review , we were interested by these four types of brand. We certainly recognise some and the types and the characteristics of them. The full presentation is at the bottom of this post, but Synthesio’s four types of brands online are:

1. The Boring Brand

The boring brand does not generate spontaneous interest in it – insurance, home cleaning products and some FMCG brands can typically fall into this category. Whilst there is an average level of buzz about the brand the conversations rarely express positive or negative sentiment, presence online tends to be low and there are few long conversations about the brand.

A great example of where a typically boring brand has been turned around is Compare the Meerkat. You can also often generate interest in these brands by focusing not on the product itself but on other elements of the experience, such as the Keep Britain Biking site for Devitt Insurance.

2. The Functional Brand

Functional brands go beyond the name or image of the brand, the products they represent have to deliver a certain level of service or experience – mobile phone companies or business hotels would be typical examples. These brands have a high volume of buzz, and a relatively high proportion of these are expressing positive or negative sentiment. They also have a high presence in social media, but the conversations still tend to be more descriptive than discursive. There are typically a lot of individual comments about the brand rather than long discussions and debates online.

3. The Exciting Brand

Exciting brands are ones that people desire and that signal much about consumers who buy them. Apple would be a typical brand in this type. These brands generate a lot of buzz, although much of it is neutral in nature (people discussing the brand rather than expressing an opinion either way). The brands have high presence in social media and also tend to attract discussions between people rather than just a lot of individual comments.

The best thing for such brands to do is to find a way to nurture this enthusiasm and these conversations. The best such brands will turn these volume of conversations into positive word of mouth and value for them.

4. The Vital Brand

Vital brands are ones that concern issues you really care about, concerns and needs that are important to you. Health and environmental brands are typically in this category. They attract a lot of buzz online, although this tends not to be overly positive or negative in sentiment. There is a high presence in social media and a very high proportion of comments are discussions between people online rather than just isolated comments.

Do you recognise your brand as being one of these four? Is this a good way of segmenting brands online based on discussions about them?

Managing your reputation online – responding to criticism

online_message_reaching_wider_audienceYou’ve probably heard how a Greenpeace attack on Nestle’s business ethics resulted in a social media encounter that damaged Nestle’s reputation worldwide.

Or, more recently, how BP has been facing daily attacks from a fake BP Twitter account about the oil spillage in the Gulf of Mexico. Both situations highlight the importance of online reputation management.

A recent article about social media and online reputation management, published by Director magazine, suggests that businesses are weary of using social media for fear that it’s like “giant focus groups” but with two crucial differences - ”the questions can’t be controlled and the debate takes place in public.”

That’s not to say that businesses should avoid using social media. Quite the opposite in fact, given that the benefits of using social media far outweigh the concerns that organisations have about safeguarding their online reputation. After all, even if your business chooses not to engage in the online conversation, people are talking about your products and services whether you like it or not. Surely it’s far better to acknowledge the presence of these conversations rather than ignoring them to the potential detriment of your business, especially given that any business would be adequtely prepared to enter the world of social media without fear with the right social media strategy and social media policy in place.

In fact, brands who take on board the criticisms they hear on Facebook, Twitter or through social media monitoring, and then try to improve on them, will be the ones who continue to grow and prosper. Every single piece of information that is picked up online, be it good or bad, is a valuable learning. As Twitter co-founder Evan Williams stated, businesses need to work on their “ability to embrace criticism as well as praise” when it comes to social media.

A good example of a brand that has taken Evan’s advice is Domino’s pizza. Instead of cowering in shame or responding angrily to negative online reviews and comments about their products, Dominos pizza met the criticism head on. They made a documentary describing the extent of their problems and the efforts they were making to improve their products and services. They posted the documentary on YouTube, including the fairly harsh responses from a focus group which deemed the pizza “devoid of any flavour”. The cameras then followed the chefs as they made improvements to the pizzas and then asked focus groups to re-test the new and improved version. They also added a completely un-moderated section to their website to allow people to say whatever the hell they liked about the new offering.

What’s refreshing about this reaction is that it’s completely transparent and wholly honest. Dominos acknowledged the shortcomings their customers highlighted and made every effort to address the issues.

Even more intelligent is the fact that Dominos clearly thought about their long-term business strategy rather than the immediate need to quell any negative comments. They openly addressed the issues that their customers were complaining about so that these same people would  spread word of their proactive response via the same fast-spreading medium. In other words, if you act on negative comments and turn them into positive experiences then the people who you’ve listened to are likely to become your biggest advocates and will start doing your marketing work on your behalf.

To find out more about manging your reputation online and responding to criticism come to B2B Marketing’s seminar about online reputation management.

Three ways to act on your social media monitoring

sydney opera house - surreal steps
Image by Chewy Chua via Flickr

This week we published the final report in our Review of Social Media Monitoring Tools (download the final report here). Reflecting on the report and its findings with clients and others this week, we have found ourselves discussing the importance of not just listening (although this can often be a good first step for those who are not yet doing it) but also acting on what is said about your brand and other terms of interest in social media. As the report shows, the different social media tools are of value for different purposes and choosing the one that is most suited to your brand and your needs is an important step.

Even before you have your social media monitoring in place, any brand can benefit from working out a plan for what you will do with all this information you are going to gather. Dashboards and reports can be useful, but the ability to take actions or make decisions using this information is much more useful for any brand. What you do with your social media monitoring is as important, if not more important, than getting the monitoring in place in the first place.

Different brands will want to engage with the conversations they discover online in different ways. The following are three great ways for any brand to engage with these conversations. The first two are ways in which you can capitalise upon the outputs of your social media monitoring internally and the last one on how you can use it to engage externally. They all require you to connect with different teams and functions in your brand and may need internal process change to make a real difference.

1. Inform the language of your marketing and communications

Observing and analysing the way people talk about your brand, competitor brands and the market you are in more generally can be a real and valuable source of insight for marketing and communications teams. It lets you learn how people talk about you, the language they use and how they compare you to other competitors and substitutes in the market. By properly searching not just for brand terms but also the terms that people use in relation to them you can start to explore the language that people use. This has a number of benefits. You can use the language and keywords to refine and ammend your search strategy. You can use relevant language and expressions in your marketing and PR activities. And you can start to use the same language when you are engaging in social media.

This relies on you ensuring that different teams across your brand are connected to what your social media monitoring reveals. And probably more importantly that you set up the reporting and analysis to ensure you are looking not just at what is said, but more importantly at how you can change your own communications and language on the basis of this.

2. Predict market changes

One of the real benefits of social media monitoring is that it allows you to track over time the things that are discussed in relation to your brand and your market. By tracking what is discussed over time allows you to identify when more conversations about certain issues being to emerge. Imagine, for example, that you are a large chain of pizza restaurants. One of the the things you might monitor is references to pizza being bought in a supermarket or eaten from take-away restaurants. Your social media monitoring should be set to alert you when and unusually large number of conversations of one of these kinds are present in social media. What is causing people to talk more than is usual about a topic and what can you do about it.

This kind of trend spotting can be of huge value to any business but relies on you having the mechanisms to capitalise upon this knowledge. Usually this would be a good indicator for your insight or research teams, or a marketing function to explore the trends that appear to be emerging and to make sure you are putting plans in place for any changes it may be spotting early.

3. React and respond to mentions of your brand online

Finally, any brand should consider its process for reacting and responding to what people say abotu you online. Whilst the previous two activities are very internal, this is external and involves engaging directly with people in social media.

There are many ways in which people refer to and mention a given brand online. And in most instances there is typically no need to respond. You can just leave the mention and monitor it if you think relevant. We have written before about how to react if somebody writes about your brand online, and the process described here is a great starting point. The next step is to integrate this with your own internal processes and to change these to ensure conversations online are engaged with and responded to when relevant.

This touches heavily on the importance of sentiment analysis – often negative comments need to be responded to in one way and by one set of people, and positive comments in a different way by a different set of people. We’ve written before about the problem with automated sentiment analysis and the best advice is to make sure that you keep a level of human involvement and analysis to make sure you’re responding to the right things in the right ways.

Read the other posts from our social media monitoring review 2010 or download our final report

Social media monitoring review 2010 – download the final report

social-media-monitoring-toolsOver the last few months we’ve been conducting an in-depth review of the leading social media monitoring tools in conjunction with our sister company, FreshMinds Research.

We’ve compared how Alterian, Brandwatch, Biz360, Neilsen Buzzmetrics, Radian6Scoutlabs and Sysomos performed when monitoring conversations about global coffee brand Starbucks. We compared over 19,000 online conversations and have written about the following topics:

If you’ve enjoyed our posts so far you can find a more detailed analysis of all these topics and more in our final report – “Turning Conversations into Insights: a Comparison of Social Media Monitoring Tools”.

Click here to download the final report from social media agency FreshNetworks

20 Social media speakers and experts

Image via Flickr by 160e29c6

Image via Flickr by 160e29c6

We’ve spoken at more social media conferences and events in the last three months than in the first three years of FreshNetworks’ existence. One of the benefits of all the talking has been the opportunity to listen to other social media speakers and experts.

As a social media agency we’re often  asked to recommend a few social media speakers for events (particularly in London and the UK), so I thought it might be useful to note down  some of the people who have recently impressed us and why.

Neville Hobson @jangles – sage advice with a strong PR-slant on social media. I thought Neville was at his best when it came to social media disaster scenarios and social media crisis management.

Gary Veynerchuck – Gary was the highlight of SXSW for me. He’s brimming with passion and energy and has some excellent hands-on social media experience. He spent 10 minutes talking and 45 minutes answering questions. You can easily get a taste of Gary online – just search YouTube. Or submit yourself to the full experience by listening to him read Crush It, his new book

Michelle Goodall @greenwellys – from Econsultancy. Michelle is a great social media trainer. Especially good at educating an audience to give them a common understanding of social media. I’ve heard Michelle speak about social media at a couple of events recently – Technology for Marketing and Advertising and FreshIdeas Events – and both times walked away feeling the learning points were super clear.

Joanne Jacobs @joannejacobs is a force of nature. Guaranteed to wake up any audience, she combines years of  social media experience with a ferocious presenting style. I am certain there is no one more capable of keeping a post-lunch audience stimulated.

James Hart @ASOS_James is eCommerce Director at ASOS.com. James (and ASOS) have been among the early adopters in community building and social media marketing in the UK. He’s a wonderfully open and frank speaker (no social hype, just his practical experience). However, I am told he may have recently hung up his speaking boots.

Geoff Quinn, CEO TM Lewin – I was on stage with Geoff at a recent Retail Week e-commerce Conference. I think it’s hard to beat listening to a CEO talk about where they see social media fit in to their broader business goals. In addition to the fact that Geoff is really open and frank about the process, they have been  giving real ROI numbers and developing detailed plans for the future. You can get a sense of his style from this recent Radio4 Bottom Line interview (disclaimer TM Lewin is a client).

Brad Little @bradleyjlittle – Brad runs Neilsen Buzzmetrics in Europe. As a result he’s great on social media monitoring content and thinking. He’s also full of energy and enthusiasm, and a great speaker.

Anna Rafferty @raffers from Penguin Books. Anna has a great case study on building a community on a budget that really engaged Penguin’s customers. An engaging speaker who provides good takeaways.  Oh and Anna recently recommended Jon Davie from Zone as a great speaker.

Steve Dunn Steve is a very energetic performer. I spoke alongside him at a CIM event and he did a good job of covering off high-level social media basics. In particular he brought a PR perspective.

Chris Brogan – Chris is one of the handful of truly global social media gurus (although I am sure he’d hate the term). I really enjoyed his combination of a conversational and relaxed style with excellent story telling. Chris is particularly good on B2B and SME social media.

Steve Bridger @stevebridger has years of community management experience working with charities and membership organisations. Steve always brings solid, practical tips to his social media sessions.

Louise White @louisecwhite – I really enjoyed listening to Louise recently. She has a refreshingly honest and open style giving a no-holds barred account of life inside a publisher as digital and social are changing the world around them.

Paul Hopkins, Head of Customer Experience at easyJet – I was on a panel with Paul at the Call Centre and Customer Management Conference. As you’d expect, Paul is particularly knowledgeable speaker on customer service opportunities and issues arising from social media. He is heavily involved on a day-to-day basis with easyJet’s activity.

Martha Lane Fox – @marthalanefox – As Digital Inclusion Champion, Martha is clearly an expert on digital engagement issues. She’s also a captivating speaker, always good at pulling out key facts to get her point across.

Dom Sparkes @DomSparkes – Dom runs the moderation agency, Tempero. He’s especially strong on community management of children’s websites and the processes required to run them in a safe manner.

Thomas Power – I have not heard him speak myself, but heard a rave review from Neville Hobsbon on his podcast. Thomas set up Ecademy and is famous for being one of London’s great connectors. Whilst I don’t agree with all he says e.g. “the most important thing about your network is size, not quality” he’s clearly very enthusiastic and engaging.

Matt Rhodes – OK, so Matt works with me at FreshNetworks. I am biased. But time and again he gets rave reviews from his audiences whenever he’s asked to speak about social media. Matt is one of the foremost thinkers on social media in the UK (he’s the reason why this blog is consistently one of Europe’s Top 3 social marketing blogs). And despite being a Cambridge graduate, he generally has an insightful perspective on all social media topics.

Tim Hwang’s SXSW talk was one of the most entertaining in Austin. Not because of his speaking style, but purely down to the content: What we learned watching kids with homemade flamethrowers. You can catch a great video here.


Two more speakers

These two don’t fit into the social media speaker bracket, but they are two of my favourite business speakers ever:
Dennis Turner – Dennis is Chief Economist at HSBC. He manages to make macroeconomics both enthrawling and easy to understand. A delight to watch.

BJ Cunningham – BJ tells a fantastic story about Death Cigarettes – a brand he founded 20 years ago. He’s a superb speaker.

Your turn
Have you been struck by an excellent social media speaker? who was it and why were they good?

The social media monitoring tool with the most up-to-date results? Brandwatch.

social-media-monitoring-toolsOur sixth post from the social media monitoring review 2010 series will look at the issue of data latency.

While most tools prioritise key websites to ensure the fastest possible upload of conversations, we found that some tools can take several days before the  conversation that’s being held online is available in the tool. This delay is known as data latency.

Of the seven tools we tested, we found that Brandwatch was the fastest at searching for and processing new online data, while some parts of Nielsen Buzzmetrics proved the slowest at collecting up-to-date information.  It’s important to note that Brandwatch doesn’t cover as many geographies and conversation types as Nielsen does.

As mentioned in previous posts, one of the ways that social media monitoring tools gather data is by using similar web-crawlers to those that Google uses to produce its Search Engine Results Pages (SERPs). This is an automated process that copies content from a list of websites into the tool.

Once the conversations have been collected they are processed – sometimes by analysts but mostly by automated processes. The speed at which conversations are collected by a tool is limited by the frequency of the web-crawlers and the length of time it takes the tool to process the data.

This has an obvious impact on clients wanting to look at up-to-date conversations. It can also skew historical data as it’s possible to look at a conversation trends for the last few days, but then the next day more conversations may arrive from the previous day, changing the results.

People carrying out social media monitoring need to be aware of data latency and to keep it in mind when using the tools to track online conversations.

Tracking specific influencers

In the video below, Charlie, one of the Directors at FreshNetworks,  talks through an example of a client who needed to track a small number of key influencers. They could not afford to wait days or even hours for updates and had to find a unique social media monitoring solution.

The Hare and the Tortoise

Social media has driven a yearning for real-time information. A desperation to know exactly what’s going on right now. As a result you might believe that a faster tool is the better tool. However, as with the other comparative measures between the tools, it depends on your business need.

Our experience of the different social media monitoring tools suggested that high latency was often the result of more sophisticated data processing and de-duplication. Thus if your goal is to track what’s going on with minimal effort, or to see only the really important conversations, you may be better off with an apparently ’slow’ tool because it will cut out more of the online waffle.

To give an example, some of us at FreshNetworks like to read the most important blog posts from all of AdAge’s 150 top blogs. To do this we use Postrank to filter out the most popular posts and then Feedburner to email them once a week. It can occasionally feel like you’re a day behind on the news, but it’s certain that you will be seeing the most important posts by the end of the week. This system only works because Postrank tracks whether other people think a post is great – a process that performs better after a post has been live for a couple of days. Hence, in this case, higher latency drives better results.

Our next post will look at sentiment analysis across the seven tools.

Read the other posts in our social media monitoring 2010 review series.

Follow the launch of the Social Media Monitoring Review 2010

Can’t make it to the launch of our Social Media Monitoring Review 2010? We’ll soon be posting the findings from the research into seven of the leading social media monitoring tools – Alterian, Brandwatch, Biz360, Neilsen Buzzmetrics, Radian6Scoutlabs and Sysomos. In the meantime you can follow the discussions and debates from the breakfast launch below. Join in and let us know your experiences and thoughts on social media monitoring and the tools we are investigating.

So what are social media monitoring tools?

In a nutshell, social media monitoring tools pretty much do what they say on the tin – they monitor online conversations taking place through social media.  They track anything that’s being said about your business or your brand on blogs, forums, Twitter and other social spaces. Each tool is different, varying in complexity and in the way they gather and process the information, as we will show you over the next few weeks.

Our sister company, FreshMinds Research, has been using social media tools to generate customer insights for years. We usually work with FreshMinds Research to conduct social media audits or monitoring when establishing a  social media strategy for clients. So over the next few weeks you’ll benefit from the unique findings of a research company working in collaboration with a social media agency.

We’ll start with the basics and work through our research step-by-step. If at any time you want us to explore a certain aspect in more detail, please let us know. Our next post will explore the basics of social media monitoring.

Read the other posts from our social media monitoring review 2010.

Social media monitoring and duplication (duplication, duplication!)

social-media-monitoring-toolsThis is the fifth post in our Social Media Monitoring – 2010 review series. In it we’ll be looking at the issue of duplication, one reason for some of the seemingly large differences between the seven leading social media monitoring tools under investigation – Alterian, Brandwatch, Biz360, Neilsen Buzzmetrics, Radian6Scoutlabs and Sysomos.

We saw from the first test in our review that the different tools produced markedly different volumes for the search terms we were using – all associated with Starbucks. The smallest number of conversations was found by Biz360 and the largest by Radian6 – over 11x the difference.

So which tools are reflecting better the conversations and discussions about Starbucks? Is bigger necessarily better? Are the tools with the largest number of conversations the best? We don’t think so.

The difference in volumes is striking. If you were using Radian6 you would get the impression that eleven times as many conversations were going on about Starbucks and related terms than if you were using Biz360. There are many reasons for this and bigger is not in this case necessarily better.

Think about the following: retweets, spam, signatures, adverts. Should these be counted in your study or not? Different tools treat them in different ways and so, as we saw with the issue of location, the actual number of conversations is not always as it seems.

Firstly, there’s the source of the conversation – who did is start with? Is there more than one conversation around the same topic or is someone copying it? Is this the same tweet that’s been retweeted or is it a new conversation? These distinctions are important. If a Tweet contains certain keywords it is often retweeted automatically many many times by ‘bots’ which search Twitter for these terms and automatically reposts them.

How do you deal with spam and adverts – taking blog posts titles or key terms from them and posting them on other sites. Should these be included or not in your counts of conversations? Are they real conversations if they are automatically taken from your site and used on others? Are they important to understand if they are being used in spam sites. Or indeed sites or an unsavoury nature (you know the ones I mean!)?

How many times should a comment in a forum thread be counted? If a comment is repeated in different places or on different pages should it be counted as a new conversation? Indeed if one person posts their comment on multiple sites to try to drive traffic or showcase their point of view should all of these instances be counted as a new conversation?

You need a social media monitoring tool that deals with these and other situations. The tools that identify the most conversations are often not the most useful or accurate. They may include a range of conversations that are irrelevant, spam or double-counted. Whereas any organisation looking to understand what people are saying about your brand online wants a more accurate portrayal of what is being said.

Bigger is not necessarily better and duplication is a serious issue that needs to be addressed in any social media monitoring.

Next…

More detail on these tests, and the results,  can be found in our final report which will be available to download on Friday 16th April. We’re also holding a free social media monitoring breakfast seminar on 15th April in London, where we’ll be presenting the findings of our report, as well as giving practical tips and advice about social media monitoring and the best way to analyse results. This event is now fully booked but you can follow the results live as they are announced on Twitter from 08.30 (London time) on Thursday by following #smm10.

The location of social media conversations is not always what it seems

social-media-monitoring-toolsThis is the fourth post in our Social Media Monitoring – 2010 review series. In it we’ll be looking at the  location of conversations.

In the last post in our series on social media monitoring we saw that the different tools being reviewed produced dramatically different results in terms of the number of conversations they identified for our key search terms associated with Starbucks. The smallest number of conversations was found by Biz360 and the largest by Radian6 – over 11x the difference.

When we were first analysing the results of our tests, it was pretty surprising to find that, using similar searches, we got such varied results from the different tools. Our research is intended to compare the tools without prejudice for those without prior knowledge of social media monitoring. And for an untrained eye, the reasons for these differences might not be clear.

One basic factor that needs to be considered when looking at social media monitoring is the location of the conversations about your brand. In fact, different social media monitoring tools classify the location of conversations in different ways using different approaches.

Location: Region, Geography or Language?!

Brands are generally interested in where the conversations are originating – a brand looking to understand sentiment about its product in the Argentinian market, for example, is probably less interested in conversations happening in the Philippines or Spain, even if they are all in the Spanish language. The social media monitoring tools use three main ways to determine the origin of the conversations, some more accurately that others:

  1. Using the URL: It’s actually harder than you might think to use the URL of a site where conversations happen to determine the location of the conversation itself.  It’s not as simple as looking at .co.uk for the UK and .fr for France. Site URLs are not especially helpful in defining location.
  2. The IP address: So each site has a unique IP address right? And these are allocated to counties? Well sometimes. However major social media platforms tend to be hosted in the US, whilst their users may be commenting from around the world. For example, Twitter gives the impression that all of its users are in the US.
  3. Language being used: Some providers use the actual words in the conversations to identify the country.  This is pretty advanced and can work. But nuances in, for example, International English are extremely hard to infer location from.

Each of the tools addresses the issue of location in a different way. Looking through the conversations manually it’s easy to find examples that aren’t categorised correctly. As a result it makes the job of comparing the different tools much harder.

Next…

More detail on these tests, and the results, can be found in our final report which will be available to download on Friday 16th April. We’re also holding a free social media monitoring breakfast seminar on 15th April in London, where we’ll be presenting the findings of our report, as well as giving practical tips and advice about social media monitoring and the best way to analyse results. You can register for the event by clicking on the button below:

Register for Social media monitoring in London, United Kingdom  on Eventbrite

Read the other posts from our social media monitoring review 2010.

Social media monitoring review 2010: Test 1 results

social-media-monitoring-toolsThis is our second post from the Social Media Monitoring – 2010 review series.

In it we’ll be giving you an insight into how we have set up the comaprison of tools (which proved rather a challenge) and the volume of online conversations that each social media monitoring tool was able to uncover.

Setting up the search string
We decided to use Starbucks as a test brand for our social media monitoring because it’s a global brand that is frequently discussed online. Also, the word ‘Starbucks’ doesn’t have any other meaning or use other than being a brand/company name.

As well as tracking the word ‘Starbucks’, we also tracked the phrase ‘Flat White’, a new addition to the Starbucks coffee range which launched in December 2009 . We also tracked their new ready brew coffee, ‘Via’, which was released in the autumn of last year in the US and in March 2010 in the UK. We wanted to see what impact this new development was having on online conversations about the brand . Finally, because Starbucks is associated with its ‘Reward Card’ and the phrase ‘Fair Trade’ we tracked these subjects too. To keep things fair we created a similar search string for each tool.

It is important to note that some tools are capable of more sophisticated search strings than others. So we were testing to the lowest-common-denominator in this sense.

Comparison challenges
Although the tools are very different, we wanted to try and evaluate them all as fairly as possible. Thus the tools were used ‘out-of-the-box’, as they come, for the fairest comparison. Again, there are limitations with this approach. Some of the more sophisiticated options offered in some tools are only relevant to more experienced users. And some providers (e.g. Neilsen) are set up to provide a much greater level of analyst support than, for example more technology focussed firms like Radian6.

Our sense for the market is that most firms are still learning the art of social media monitoring and that tools are often managed day-to-day by people with only limited training in how to use them in anger. This drove our approach to the research.

Coverage
As the tools all have different coverage, whether it’s for different media or markets, we set up the same filters for each tool to create a comparable ‘universe’ of conversations for Starbucks. Our test was carried out using only the English language and for the same time period on each tool.

Sentiment analysis
One of the areas we wanted to test was the sentiment analysis accuracy of each tool. In order to compare the automated sentiment (ie, sentiment that is coded automatically positive or negative by the tool) with our own analysis we had to extract the conversations and manually code them. Some tools don’t allow you to extract certain conversations, others do. Where we weren’t able to extract sentiment for some reason, we’ve marked the tool:

Picture4

Number of conversations
The seven tools gave very different results when looking at overall conversations -  the smallest number of conversations was found by Biz360 and the largest by Radian6 – over 11x the difference! But remember, more conversations is not necessarily better – there is often duplication.

Picture1*You can usually make arrangements with your account manager if you need more data.

Conversation types
When you compare the conversations by media type, again each of the tools shows quite a different result:

Picture2

*Scoutlabs doesn’t allow you to extract Twitter conversations with sentiment. The tool does allow you to browse the latest twitter conversations though.

At this top-level, it’s clear the tools are each doing something quite different…

Next…
More detail on these tests, and the results,  can be found in our final report which will be available to download on Friday 16th April. We’re also holding a free social media monitoring breakfast seminar on 15th April in London, where we’ll be presenting the findings of our report, as well as giving practical tips and advice about social media monitoring and the best way to analyse results. You can register for the event by clicking on the button below:

Register for Social media monitoring in London, United Kingdom  on Eventbrite

Read the other posts from our social media monitoring review 2010.