Body
Any article about control charts leads to inevitable (and torturous) discussions of special cause tests—all nine of them. No wonder confused people continue to use things like trend lines. But I’m getting ahead of myself.
…
Want to continue?
Log in or create a FREE account.
By logging in you agree to receive communication from Quality Digest.
Privacy Policy.
Comments
Great points, as usual!
Thanks, Davis, I liked this for several reasons. Software gives us many rules, and evaluates them with the click of a mouse. Wheeler and Chambers demonstrated a number of years ago that the four primary WE Zone tests (1, 2, 3 and 4—1, 2, 5 and 6 for Minitab and JMP) offer the best trade-off between finding signals that are there and tampering by reacting to false signals. When using software, I generally use one other rule with XbarR or XbarS charts (in Minitab, it’s test 7)…15 points within one sigma of the center line. This doesn’t indicate special cause; it just tells you that you’re subgrouping unlike things. Bill Woodall mentioned offhandedly, at the 2001 FTC here in Minneapolis, that “of course, no statistician uses the trend rule in control charting.” I still see it often, though.
Great point about plotting the dots, too. Deming once did a lecture series for Ford statisticians (Bill Scherkenbach has the transcripts and shared them with me). This conversation always stuck with me:
“DR DEMING: I'll tell you a couple of tools that I find to be useful. One is a piece of paper, and another was a pencil. And almost nobody has those tools on hand. To save his soul from hell, he won't use them. He's gotta do it by computer, or some statistical test.
“Had some data. I can't call them clients…They had troubles. Asked if they'd collect some data on beginning, middle, and end of several batches...hardness of what comes out after vulcanization. They did. And they plotted points...run charts, like this. And I said, ‘now look, that's awful hard for me to see anything there.’ This is beginning, middle, end...beginning, middle, end..awful hard to follow.
“Let's just take the chart, plot it in a different way. Use a dot for the beginning of the batch, an open dot for the middle. I don't care what you use. And X for the end. Plotted sixteen batches in a row. Here they are: Sixteen in a row. one, two, three, four. Sixteen. In every case, the end was lowest of the three, except for one tie. Just eyeball test. That stuff is either not mixed or it is aging.
“It's helped people. It's a simple graphical representation. Some of it's in my book, chapter thirteen. Nothing unusual. Nothing spectacular. Nothing new. Anybody can look and draw that conclusion. The stuff is aging, or it's not mixed. One or the other. They were engineers...so called. Had the privilege to study. It has helped them. Least they said it did. Piece of paper and a pencil. Yes...
“NEW VOICE: If you had that data for sixteen in a row, where the end was always at the lower hardness, could you then do a heads and tails calculation on that?
“DR DEMING: Well hell fire, why do it? Make a lot of nonsense out of it? Why make nonsense out of it? There it is. We have a job to do. Let's try to be helpful.”
The point about the p-value is well-made, too. I don’t see it as much from people claiming trends, though, as I do from people claiming significant correlations or regression models. Someone told a lot of people that a low p-value signals a significant correlation. They didn’t explain that it just signals a slope significantly different from zero. I have seen tables in peer-reviewed studies claiming significant effects from treatments with p-values of less than .001, but r-squared values of 4.5%! The “peers” must have gone to the same stats class as the author, I guess. I try to explain that that p-value is as useful as an average phone number.
Past Vs Future
I am not a statistician. I took statistics twice in college in an effort to try to maintain some statisicatal ability but that was 20 years ago. Anyway, I am one of the confused, non-statisticians.
Figure 1 does not show a trend? I am not asking if the trend has any significance or requires any reaction. I dont understand how that figure doesn't show a general trend. Maybe my confusion is based on one's defintion of the word "trend?"At the end of the article I think you provided a definition of trend. But I don't understand what the following means, "trend = transition to the new process you are “perfectly designed to get,” given your new inputs vis-à-vis your old status quo."
Also, if I was using a control chart to look into the past for potential non-conforming output, I might start my investigation with points charted outside of the control limits. I use the term "potential non-conmformance" becasue this is a control chart and does not include specification limits. If I was using the control chart as a predictive tool, I would look at process's central tendency. Does that seem reasonable?
The two "needle shifts" are not special cause events? The needle shifts are not a special circumstance or an assignable cause? I am not implying they require investiagtion but a "a major intervention to improve the process" is not a special casue? I am confused.
"Quality improvement is the mind-set that knows how to ask the right questions" is a gem!! That is going on my cube wall. I will not treat it as a slogan but I will try to use it in suport of my constancy of purpose.
Thank you,
Dirk van Putten
Clarifications
Thanks for reading, Dirk. So, you took statistics 20 years ago? As I tell my seminar participants, "Relax...forget everything you've ever learned," to which they reply, "Don't worry, we already have!"
I think the term "trend" is WAY overused and, if people understood process-oriented thinking, should actually be banished from corporate jargon. It seems to be a generic term for "getting better." As Juran liked to say, "There is NO such thing as 'improvment in general'."
The first figure shows a process that has gotten better--but, not necessarily in a vague LINEAR fashion. In fact, there were indeed two special causes--deliberate, already-known INTERVENTIONS on the process in the hopes of improving it, and the "needle shifts" show that they did indeed work. There was no need to investigate them. THOSE were the special causes in the data--NOT the points outside the control limits on the first control chart in Figure 2, which is a BOGUS chart. Note that adjusting for those two interventions in the subsequent control chart made all the other special cause tests go away--they were an artifact of the underlying "needle bump."...and plotting the chart incorrectly.
[See the excellent comment by Rip Stauffer above--it's all about plotting data over time and asking the right questions before proceeding with any techniques/analysis]
To clarify the last point: You initially had a process performing at what it is "perfectly designed to get"--with what were its CURRENT inputs. You have a theory about how to improve it, so you CHANGE some of the inputs. If the changes have an effect (hopefully in the direction intended) the process output "transitions" to what it is "perfectly designed to get"...with the NEW inputs. People seem to think that improvement should continue, but why should it? The process levels off and you now have to make a decision about whether to make ANOTHER intervention to "bump the needle" to yet another more desirable level. Things happen in STAGES in the improvement world--more of a series of "step changes" rather than "trend" indicating "improvement in general"...of which there is NO such thing!
Hope this helped and thanks for your kind feedback on the quote.
Best,
Davis
The Moving Range
Wouldn't using the moving Range chart (XmR) identified the two process shifts?
Rich DeRoeck
Add new comment