Interesting that imports from China slowed last month, at least if you’re comparing just two data points. Analysts think there is good news to be found here that the economy is not slowing down (which I hope to be true).
But, the statistical “analysis” that’s presented in the news media reminds me of the very practical statistical lessons taught in my favorite book, Understanding Variation. I’m convinced that the tools presented in the book (and Dr. Wheeler’s website) will help you more than the whole arsenal of Black Belt tools.
Some headlines basically presented the trade deficit data as two data points — the deficit improved, so that’s good. Some analysts called it a “whopping” improvement. But if we view just those data points, we see this “trend” (note — going up is “good” here, less of a deficit).
“Two data points do not make a trend.” We can’t really tell how the deficit is doing from this view — better than last month, big deal, you might say.
Some articles, including the one linked above, go one step better, pointing out that it’s the smallest deficit in six months. Now that data puts things in perspective and almost becomes “information” that we could use to draw conclusions.
Looking at six data points (the raw data is found here, by the way), we see a more complete picture:
Now the “improvement” seems a little less clear. It looks like normal variation in the monthly (albeit adjusted) deficit. It looks like we are fluctuating around a mean of about $58 billion dollars. Is $3 billion better than the mean a “whopping” difference?
Looking at a more complete picture, what headline would you write seeing three years worth of data, viewing it through the control chart “lens”?
Looking at the full data set…. I draw the conclusion we’re still heading in the wrong direction, that one month of “bettter than last month” data doesn’t convince me that the trade deficit is improving. It was pretty stable in 2003, then around December 2003, the deficit took a sudden drop and then stabilized again for six months. In June 2004, we see another “shift in the mean” and it looks like the deficit could merely be fluctuating around that new mean.
Does this remind you of ways your organization abuses data and “statistics”? Do you hear applause because quality or on-time delivery were “better than last month?” If so, check out Dr. Wheeler’s book or click “Comments”, below, to chime in.
Thanks for reading! I’d love to hear your thoughts. Please scroll down to post a comment. Click here to receive posts via email. Learn more about Mark Graban’s speaking, writing, and consulting.