I say it a lot, but two data points are not a trend. I didn't invent that idea, of course, but I've tried to help leaders and organizations stop reacting to every up and down in a metric through the methods I share in my book Measures of Success: React Less, Lead Better, Improve More.
We are bombarded — in organizations and in the media — by two data point comparisons.
My friend and sometimes collaborator Chris Chapman, as he often does, shared a great example of this “journalistic malpractice” in a recent tweet:
I added, in a comment retweet,
“Reporting figures this way should also be considered management malpractice in a business or hospital, but it happens all the time.”
Thanks to what I've learned from Don Wheeler, PhD on this subject, I'm pretty immune to two data point comparisons. When I can (like in a meeting), I would ask for more data points. We can't directly ask the media to show charts that give context to data over time… well, I guess we can tweet about it.
When I was logged into LinkedIn recently, they showed me this representation of some data:
The number of 3,379 is missing context. Comparing that number to the previous week doesn't add much context at all.
So the number is 10% lower. The math probably checks out. But what can I really do with that information, true as the 10% comparison is? NOTHING.
Oh, and they made the number red, as if the negative sign wasn't clue enough that it was lower.
LinkedIn thankfully allows you to click to “show trends.” You get a line chart (aka run chart) that's much more helpful than the two data point comparison:
Eyeballing it, there is no “trend,” just fluctuation around a stable average. Some weeks the number goes up, some weeks it goes down.
As you mouse over the data points, the chart cheerfully shows you a red or a green number each time (except for the one time when the number was exactly the same as the week before).
I was grabbing those exact data points because I, of course, want to build a “Process Behavior Chart” that would tell me even more about this data over time.
As a quick aside, this metric (how many people have viewed my profile) is absolutely a “vanity metric” (hat tip to Eric Ries) since I don't get paid for each view. If anything, the number of views is an indirect predictor of my success in getting more clients, speaking engagements, etc.
Here is the “X and MR chart” pairing that makes up the full blown Process Behavior Chart methodology:
Do I see any evidence of a “signal” in either the X Chart or the MR Chart? No. There are no data points outside of the limits (Rule 1), no runs of 8 or more consecutive data points above or below the average (Rule 2), and we ALMOST see a “Rule 3” signal — if we saw 3 consecutive or 3 out of 4 data points closer to a limit than the average.
These 3 data points are ALMOST that signal, but the first two data points are a touch below that midway point between the average and the upper limit.
That's the week ending July 11 which might still have some effect from the 4th of July holiday.
Either way, I'm not going to worry about that data point. It would be a waste of time to try to ascribe any cause-and-effect relationships between any of my actions and that number.
Were the numbers higher some weeks because of the particular content I posted? Not in a statistically meaningful way.
Instead of worrying about or thinking about every up and down, if I really cared about this metric, I might take actions that would be intended to boost the AVERAGE over time. I'd look to see if there were any signals in the chart over time…
What do you think? Please scroll down (or click) to post a comment. Or please share the post with your thoughts on LinkedIn – and follow me or connect with me there.
Did you like this post? Make sure you don't miss a post or podcast — Subscribe to get notified about posts via email daily or weekly.
Check out my latest book, The Mistakes That Make Us: Cultivating a Culture of Learning and Innovation: