Evidently Steven Ouellette did not like my June column, “Is the Part in Spec?” The adjectives he used were “complicated,” “unhelpful,” “backward,” “confusing,” “unnecessary,” “crazy,” and “disastrous.” (Ouellette’s response, “Know the Process Before Altering Its Specifications,” can be read here.) Yet, before he published his column he had in his possession the full mathematical explanation for the results I presented in that column. Without going into all the calculus, this column will outline the justification for manufacturing specifications and explain their use.
For the record, my June column had nothing to say about the important questions of process performance and measurement system acceptability, yet these are the only two questions addressed in Ouellette’s reply. So to be clear on this point: The only way to avoid shipping some nonconforming product is to avoid making nonconforming product in the first place. To do this, you must have a capable process and then you will need to operate that process predictably and on target. In my books I call this “operating in the ideal state.” Moreover, to track process changes in a timely manner, you will need a measurement system that is at least a “Third Class Monitor.” I will say more on this topic later.
…
Comments
Six Sigma Heretic Responds... :)
Hi all, Steve Ouellette, Six Sigma Heretic here.
.
First off, I am glad to see Dr. Wheeler add to his earlier article. If he had included the second and third paragraphs in his first article, I would have had much less concern that our readers would have made the erroneous conclusion that I feared they would.
.
Dr. Wheeler starts off with a strawman argument: that I am arguing with the math. The math is not the issue, what I was arguing against was changing rejection specifications without an understanding of your process. Following the that first article without knowing more than was in the article would have led to, yes, disaster.
.
I will hazard a guess and say that Dr. Wheeler and I would agree that you should tighten the rejection specifications as shown in his original article if:
.
-you have no clue about your process through time (control)
-you have a measurement system with large measurement error as compared to the specification AND an as-measured Cpk lower than 1
-you have a process where there is large liability associated with making an incorrect classification and a measurement system that varies by some "large" amount as compared to the specification OR the process is out of control
.
My position though, is that if any of those pertain at best you use the tightened rejection limits for a very limited amount of time until you fix your process. If these situations do not pertain, you are in control and your as-measured Cpk (which includes measurement error) is greater than or equal to 1, tightening the rejection limits only costs you money for protection against an eventuality that is very unlikely to happen.
.
Heck, even if you have a Cpk of less than 1, with a huge enough %R&R you probably are still not making anything out of spec. The problem is convincing anyone of that...and detecting a real process shift in time to stop it from shipping.
.
In my experience, most processes today are not like the ones described above. Most industries no longer live in the world of Cpks of 0.5. And if you do, get out! :-)
.
Oh, and the ICC used for gauge measurement *acceptability* is bogus. Plain and simple. It is the right answer to the wrong question: "Can my gauge detect out-of-control events on the control chart?" The right question for gauge acceptability is: "Can I use this gauge to properly make conformance decisions while controlling risk?" Which is properly informed by (not decided by) %R&R or P/T ratios. (My previous articles too talked about taking an average of readings in order to reduce measurement error - just be sure your measurement system is in control before doing so!)
.
I think the whole thing hinges on understanding the difference between measurement system capability (comparing measurement error to the spec width, e.g. P/T or %R&R) and measurement system acceptability (can I use the gauge in this application to make conformance decisions), which uses capability as one input.
.
Ironically, I don't think Dr. Wheeler and I disagree on actions to take most of the time. My concern was his first article as-written told people to do something that probably doesn't make sense for them to do, and didn't clarify when the procedure was useful. Hopefully my article provided a service in doing do.
.
Oh, and on my "math errors" - loosening the spec in the presence of gauge error doesn't make any sense in any context, and isn't what the article described, so not sure what Dr. Wheeler is referring to here. Feel free to educate me. Guardbanding still isn't needed in the vast majority of processes I see anyway...
Article and rebuttal
These are robust academic arguments, but I'd like to see these arguments laid out in the context of a real-world scenario with all the complications that can arise in a plant. I'll leave it to the imagination what those are.
MSA Scenarios
Hmm, that was part of what I was trying to do by extending the viscosity measurement device and describing some of those scenarios. You might check out my MSA articles below for real examples, though I spend more time talking about the rationale and basis for MSA than in fully fleshing out the scenarios.
.
Letting You In On a Little Secret
http://www.qualitydigest.com/inside/quality-insider-column/letting-litt…
.
The Mystery Measurement Theatre
http://www.qualitydigest.com/inside/quality-insider-column/mystery-meas…
.
Performing a Short-Term MSA Study
http://www.qualitydigest.com/inside/quality-insider-column/performing-s…
.
Performing a Long-Term MSA Study
http://www.qualitydigest.com/inside/quality-insider-column/performing-l…
.
Destructive Gauges and Measurement System Analysis
http://www.qualitydigest.com/inside/quality-insider-column/destructive-…
Luxury!
Steve apparently has the luxury of seeing lots of processes with Cpks greater than 0.5.; my experience is that "most" companies are still pretty far from having this universal. I have worked with many companies where they had no SPC going at all yet. Just getting them to the threshhold state (in control, some nonconformance) was a challenge.
Hi Rip!
Heh, well maybe so. In my experience, most companies are right at the borderline - achieving control usually gets them pretty close to Cpk = 1, and then we start wading into the bushes to reduce variability - always the tough part. I'd say it is about 25-75 in terms of majority of variation coming from the "good ol' measurement system" vs. the majority coming from the process.
Watershed Specifications
In Wheelers column "Is the Part in Spec?", there is a section titled Watershed Specifications in which he describes how the manufacturing specifications are adjusted to account for discontinuity as a result of gage resolution. Im not sure I would go so far as to say Wheeler would consider this is equivalent to "widening" the specifications, but the effect is similar in that numerical value range of the Watershed Specifications is indeed larger than that of the Manufacturing Specifications.
I have read Wheelers manuscripts from his reading room and I must say there are some very thorough arguments on how traditional education of gage R&R makes a number of "leaps of faith" - Wheeler does a good job of filling those gaps with sound mathematics, presenting the intraclass correlation coefficient as the correct workhorse for characterizing the measurement system in context of the product being judged.
Side note: I think the QD community benefits when experts such as Wheeler and Oullette spar a bit... here's to both of you for stickin' your necks out for the benefit of the rest of us :)
Thanks VPSchroder! I (and
Thanks VPSchroder!
I (and I'll be so bold as to speak for Wheeler to say he is too) are scientists at heart, so I hope that I'll be questioning and learning until my grave!
On ICC, you might investigate the history of the P/T ratio before you toss it. It really does answer a different question than the ICC. Nothing wrong with ICC unless you use it as a metric for gauge acceptability.
Thank you Don. Both of your
Thank you Don. Both of your articles are very clear, useful and easy to understand.
By contrast, Ouellette’s responses are tainted by emotion “crazy”, “disastrous”, perhaps driven by tall poppy syndrome; are vague; and show a lack of understanding. At least Ouellette calls himself a six sigma "heretic", so I can assume he is not quite as deluded as the masses that blindly follow the six sigma nonsense.
Hi ADB
Good to see your comments again - you might recall our discussions about the usefulness of "sigma" many moons ago (not much if you recall...) I put that debate to rest (I wish) in a sequence of articles a while ago - I hope you caught them!
I am sorry that my article seemed vague to you - have you read the MSA articles that are linked within it? That is where I lay out the way I do MSA and provides the context for that last article. I don't think I lack understanding about Wheeler's approach, I just don't think that it is very useful or practical except in very restricted circumstances. And I (and others I have talked with and had e-mail from) think that last article could have been misleading if you lacked knowledge about Wheeler's greater body of knowledge. Consider how you might have read that article without such expertise. Not everyone may read it the way I did, but I know a lot of people did. See the comments under my article.
As far as being tainted by emotion, well, that is the gadfly persona, I am afraid. If it gets a person to read about a concept that they need to know and otherwise might have skipped, I'll take the hit in karma. At the least, we can hope that someone understands something more about the decomposition of the as-measured variance into measurement vs. product.
And I have no delusions about Six Sigma, I assure you. I re-train Master Black Belts and Black Belts every day. :-) That doesn't mean that I can't agitate for some meaningful change from within, though....shhhhh don't tell anyone though.
SS "Nonsense"
I made a habit of being outspoken and iconoclastic until I got slapped down one too many times. Now I realize that all companies have the right to mediocrity and most of them excel at it. Even mighty Toyota has stumbled! It's good to see someone else still has some fight in them. While I agree that SS earns the "nonsense" badge (which is not to say it's complete nonsense), I'm curious, ADB, exactly what about it you find objectionable. Regardless of the name or slogans applied, a properly implemented CI effort with valid goals must deliver results. That's a tautology.
Six Sigma Nonsense
Some of my objectives are:
The "Belt" mentality
The mythical 1.5 sigma process shift
Does not address the homogeneity question (predictable vs. unpredictable process)
Obsession with the Normal Distribution
Inflated $ money saved claims
Rich DeRoeck
@Rich
My $0.02: see the Wikipedia entry for Six Sigma. I initiated the "Criticism" section a few years ago and took dead aim at the Belt Machine (I earned my SSBB certification from ASQ and let it lapse after 3 years due to the rigor of retaking the test and the hypocrisy of recerting by attending dinner meetings), pointing out that Toyota, IMHO the greatest company in the history of manufacturing, simply did what was necessary without smoke and mirrors. The entry has since evolved to a less acerbic tone than I used, which is just as well b/c Wikipedia ought not to be a flamefest, but the points are all valid.
LOL
I propose the formation of ASSS - the Anti-Six Sigma Society.
Manf. Specs
Donald - you did a masterful job explaining this. I read both previous articles, and found this explanation very thorough and complete. Steve made a good point in his comment that your first article could have been misinterpreted by someone without the knowledge base you posses (I almost made the very error counseled against in the latest paper due to my lack of experience).
This article was both helpful and clear, without being overbearing. Thanks for taking time to respond to Steve's critique - it shows your willingness to listen, and shows in part why you have been as successful as you have. The lack of arrogance is refreshing, and the tone of the article was anything but confrontational or defensive; both would have been easy mistakes.
Props to both of you for expanding my knowledge base, and for taking time to explain the intricate thought processes that go into making a decision.
Doug
Add new comment