Contact
Recent Comments
- Perry Williams: Hello Dear, I am strongly agree with your point that the web analytics is associated with the social...
- Philip Sheldrake: Nice overview Marianina. I wanted to post a link to an article in Business Week from June about the...
- Luisa Woods: Hi Marianina, I think you make a very good point about the importance of segmentation. I like to carry...
- Eric T. Peterson: Marianina, Nice to have seen you Monday in London! I just got this post so perhaps something odd is...
- Marianina Manning: Hi Luisa, Thanks for your thought-provoking comment! I agree that new ways of looking at web...
Recent Posts
- 7 Ways to make web analytics work better in companies
- Measuring social media, influence, debate, buzz monitoring
- Web analytics winners and losers? It’s the people that make the difference.
- Simple segmentation for your website and better web analytics understanding
- Web Analytics Wednesday in London – the future of web analytics
- Digital cream: revealing debating at econsultancy’s marketing event
- Google Analytics Tip: Ecommerce tracking set up, screenshots and why it’s useful
- Reliving my customer’s experience and some nice screenshots
- Internal site search part 2
- The best charts ever and food for thought for us web analysts
Archives
- August 2008 (1)
- May 2008 (1)
- April 2008 (1)
- March 2008 (3)
- February 2008 (2)
- January 2008 (3)
- December 2007 (3)
- November 2007 (5)
- October 2007 (4)
- September 2007 (5)
- August 2007 (4)
- July 2007 (6)
- June 2007 (3)
My Blogger Friends
Say for example, we would like to compare the performance of three different marketing campaigns against one another, by which I mean organic, ppc, online banner advertising, we would want to analyse the conversion rate of the campaigns over time.
First of all, we would take the average conversion rate on a daily basis, by average I mean the central tendency for our data to centre around a particular value, be that mode, median or mode. And then compare these average conversion rates over time for each individual campaign against one another.
However, when we are looking at how the data is dispersed, we may see some points that either stick out too high or too low. So how can we tell whether these are significant data points. If we look at all of the raw data that makes up the averages, it may be that there is one number that is so off the charts that it is completely skewing the whole average – these are called outliers.
It is important to get rid of outliers, otherwise you would have no idea whether or not one campaign is performing better than others.
I think of web analytics like a puzzle. You need to get all the bits together and understand their context and importance in order to get a big picture overview.
For example, today if we look at the key conversion rate for your website (whatever that might be). Everytime there is a fluctuation in the conversion rate, upper management will be querying the reasons why and next actions which can begin to become unhelpful and also waste a lot of the web analyst’s time. And usually the more senior they are, the more suggestive (dictatorial) they get.
The thing is that a conversion rate, like any other rate, will always naturally fluctuate over time. So what is meaningful and what isn’t? This is where we call statistics into the web analyst’s arsenal to enable us to make more informed conclusions and decisions.
For example, here is my fluctuating conversion rate for a website – without any use of statistics. There appear to be a number of worrying/exciting fluctuations. Where do I start?
Click the chart to make it bigger and see how little help it is.
This is not about needing to become a qualified statistician but knowing enough about statistics to be able use to them effectively in one’s web analytics data and have an intelligent conversation with a statistician, “statistics without tears” in other words. Don’t look up standard deviation in wikipedia or speak to a professional dataminer/statistician and begin to feel statistically challenged/mathematically innumerate, please.
My introductory guide to statistics without tears
Here is my guide to statistics without tears to enable you to make the informed decisions you need to make with your web analytics data.
In statistics, here are some things that help me to make more informed decisions:
1. the mean – or the average or central location of my data
2. the trend – when we look at data over time, we apply statistics to give us a trend
3. the standard deviation – describes the spread on either side of the mean
4. upper and lower control limits – setting limits on my data to a specified standard deviation to see if anything stands out or is statistically significant
5. statistical significance – a result is called significant in statistics if it is unlikely that it happened by chance.
6. probability modelling – to determine how long until something happens, how many goal conversions will we see over a given period of time and given an opportunity to do something, how many people will choose to do it.
Conversion rate analysis using control limits, standard deviation and a trend
Here is my analysis of my conversion rate with the use of standard deviation, upper and lower control limits and a trend line. The brilliant thing about this is that it took me less than 5 minutes to do in excel.
Click to make this chart bigger and look at the datapoints that stand out.
Instantly we can see numbers that are standing out on either the top end or bottom end of the control limits, which are set to a specified standard deviation.
To do this in excel have two columns, one with the daily conversion rate and the other with each days date. Then insert a line chart which shows the conversion rate over time. Right click on the line in the chart and choose format data series. Choose “error bar”, “display both” and “standard deviation” and specify your standard deviation, for example I specified 1.7 and set values for those data points that stand out. Then add a trend line to your data, again by using excel. This error bar gives us an upper and lower control limit based on a standard deviation from the mean that helps us to see the data that stands out and has a statistically higher chance of being significant/meaningful. The trend line (which I set to be linear) gives a good idea of where our data is going, which we can’t get merely by looking at the data itself.
This is the equation that excel that uses to work out the standard deviation (which is why it is great when excel can do the job for us):
Where
s = series number
i = point number in series s
m = number of series for point y in chart
n = number of points in each series
yis = data value of series s and the ith point
ny = total number of data values in all series
M = arithmetic mean
To conclude:
The result is we can instantly see which data points are standing out from the average conversion rate and correlate these backwards to company activity. For example, was there additional marketing activity such as SEO or direct marketing. Or were changes to the actual website design or copy primarily responsible? Were there periods where we would have expected the conversion rate to stand out, but it underperformed? What could the underlying reasons be? What action can we take as a result of this analysis – for example to examine all marketing activity and changes to the site during a period of a higher than normal conversion rate to see what was contributing to this success and to apply this to the future. And similarly, to see if any company activity can explain the lower than average conversion rate and highlight these as problem areas.
In my next post on statistics, I will be using probability to make projections about company performance that can really help with one’s marketing.
As usual, I very much welcome your feedback, agreement or complete disagreement and most importantly THANKS FOR READING!!
Introduction
Tags
- Campaign effectiveness (7)
- Consumer segmentation (3)
- Customer experience (5)
- Engagement metrics (5)
- Events (7)
- Google Analytics (5)
- Ideas (12)
- Influence (3)
- Management theory (2)
- Marketing (18)
- Microsoft Gatineau (1)
- Podcasting (1)
- Site search (2)
- Social Media (7)
- Social media analytics (2)
- Social media strategy (3)
- Statistics (2)
- Virtual Worlds (1)
- Web Analytics (39)
Subscribe
Calendar
M | T | W | T | F | S | S |
---|---|---|---|---|---|---|
« Aug | ||||||
1 | 2 | 3 | 4 | 5 | 6 | 7 |
8 | 9 | 10 | 11 | 12 | 13 | 14 |
15 | 16 | 17 | 18 | 19 | 20 | 21 |
22 | 23 | 24 | 25 | 26 | 27 | 28 |
29 | 30 | 31 |
recent posts
- 7 Ways to make web analytics work better in companies
- Measuring social media, influence, debate, buzz monitoring
- Web analytics winners and losers? It’s the people that make the difference.
- Simple segmentation for your website and better web analytics understanding
- Web Analytics Wednesday in London – the future of web analytics
- Digital cream: revealing debating at econsultancy’s marketing event
- Google Analytics Tip: Ecommerce tracking set up, screenshots and why it’s useful
- Reliving my customer’s experience and some nice screenshots
- Internal site search part 2
- The best charts ever and food for thought for us web analysts
recent comments
- Perry Williams: Hello Dear, I am strongly agree with your point that the web analytics is associated with the social...
- Philip Sheldrake: Nice overview Marianina. I wanted to post a link to an article in Business Week from June about the...
- Luisa Woods: Hi Marianina, I think you make a very good point about the importance of segmentation. I like to carry...
- Eric T. Peterson: Marianina, Nice to have seen you Monday in London! I just got this post so perhaps something odd is...
- Marianina Manning: Hi Luisa, Thanks for your thought-provoking comment! I agree that new ways of looking at web...
Wordpress theme by Wordpress Themes
Web Analytics Princess by Marianina Chaplin