Preparing For The Coming Flood ... Of Statistical Malfeasance: — Identifying & Understanding Statistics Problems

 


‘The nonstatistician cannot always recognize a statistical problem when he sees one

— W. Edwards Deming

 

'The key element for a successful (big) data analytics and
data science future is statistical rigor and statistical thinking of humans'

— Diego Kuonen

 

For business, the recent growth in fact-based decision making has provided a path to innovative new products and an escape for companies in disrupted industries.  Over the coming years, we should expect a corresponding growth in statistical malfeasance.  How large, you may well ask.  We can not be sure, even measuring today's statistical malfeasance is difficult.  In addition to market forces, an important ingredient in this flood is a number of misunderstandings about the purview of statistics, statistical thinking, and the underlying statistical assumptions. 

 

The best protection from statistical malfeasance is to leverage three pillars for Best Statistical Practice: Statistical Qualifications, Diagnostics, & Review (QDR) (see 'A Practitioner's Guide To Business Analytics,' McGraw-Hill (2013), Chapters 7-9).  The better we understand statistics problems, the better we can identify the best Statistical Qualifications, interpret the right Statistical Diagnostics, and apply an appropriate Statistical Review.  We need to use Statistical Diagnostics to measure the accuracy and reliability of results.  Diagnostics are far more important for statistics problems, which do not have unique solutions in the way that we can mathematically deduce one answer.  We need Statistical Review to continuously improve decision making, data analysis, and data management.  Again, these three pillars are best facilitated using a savvy understanding of statistics problems. 

 

The article continues in the May/June 2015 issue of Analytics Magazine, http://goo.gl/Wod3gk. 

Write a comment

Comments: 2
  • #1

    Kisha Schwein (Wednesday, 01 February 2017 05:02)


    Just want to say your article is as astonishing. The clarity in your post is simply excellent and i could assume you're an expert on this subject. Well with your permission allow me to grab your RSS feed to keep updated with forthcoming post. Thanks a million and please keep up the enjoyable work.

  • #2

    Randy Bartlett (Saturday, 18 March 2017 21:37)

    Kisha,
    Thank you for the kind words. I tried to contact you. You may reach me at RandyBartlett@BlueSigmaAnalytics.com.

    Hope to hear from you.

    Randy