Body
So I thought I was done with measurement system analysis after my last column, but I just finished reading Don Wheeler’s June 1 column, “Is the Part in Spec?” and the first thing I thought was, “Well, that was… complicated and ultimately unhelpful in answering the article’s title question.” I like a diversity of viewpoints, but they have to make sense. Does Wheeler’s? Let’s take a closer look.
…
Want to continue?
Log in or create a FREE account.
By logging in you agree to receive communication from Quality Digest.
Privacy Policy.
Comments
Guardbands [mfg limits]
In a previous automotive manufacturing enviroment we established 'guardbands' set at 3 std dev on the gage error. This to ensure we did not pass any product that might be rejected by the customer if tested. The product was crash sensors. We were willing to make a class one error to avoid a class two. In all the millions we made, we have never had one come back or lost in litigation as when retested, they were always within spec. We have had lawyers bringing product back in plastic bags that we could not touch unless under their supervision. They always passed wthin specification. We used horizontal linear accelerators to simulate a crash speed. We could measure in units of .001 MPH or less, but we had multiple test machines. The specification was to 0.1 All were correlated back to a master thruster that was tracable to the NBS. We always used two accelerometers that were compared to each other. If one started to drift the test would abort and the thruster would shut down until re-correlated with new acclerometers.
We were aware we could be calling good product bad, but due to the nature of the product we could not afford to pass bad product. If the reject rate increased statistically, the thruster would be shut down and maintence performed untill the varation was reduced.
Although I am now in a different industry now, I still believe the method we used was valid. All correlations used were stastically based using ANOVAs. The exact method is proprietary
Guardbanding
Hey guys, thanks for reading and posting!
.
As far as guardbands, I have no quarrel with these at all, as long as you understand the costs. We too have had to do similar things over the years, but my point is that you have to make such decisions with an understanding of the process as well as the costs involved.
.
For the example with crash sensors, if you had a control chart on this product characteristic and it showed that you were in control, you probably never made an accelerometer anywhere near a spec limit in your life, and every single one you scrapped was not just, perfectly OK, but darn near the target. On the other hand, if your control chart was out of control (as it sounds like from your description) - long-term you should have been working to attain control so that you didn't have the anxiety of knowing that measurement error could be allowing bad stuff to ship, at the potential cost of someone's life. Short-term you might use temporary rejection limits to make up for your lack of control.
.
It all has to do with decomposing the sources of variation (as I did in those graphs above). Which I bet was involved in your ANOVA-based approach. ;-)
.
That said, in some cases (e.g. aerospace, auto safety) due to non-mathematical considerations (and nothing is ever just a cost-benefit analysis), you might very well have crazy rejection limits. I am only saying you had better understand those costs and build them into the price.
Altering Specs
I also used guardbanding when I worked in the semiconductor industry. The test specs would be tightened-up by 2 PE which would provide additional assurance that what we were shipping to our customer would meet their specification requirements. The thought process was that it was better to scrap some borderline product than have a customer return, complaint, SCAR, factory visit........you get the idea.
Rich
A more thorough reading might be needed
Having read and used all of Wheeler's material on EMP, I might be biased, but I didn't see any problem with his column. He is not talking about changing the specifications, he's talking about how much of the specification is useful when the measurement error is shown to be of some certain value. If I measure something that's technically "in spec" at 6.1 units, but I have .5 units of probable measurement error, there is a chance at I am actually out of spec. All Wheeler is talking about is how that can be quantified and adjusted for. He's not talking about changing the specs, he's talking about playing the slice in the measurement system so we can be sure that what we are measuring is in specifications.
Hi Rip, . You might be right
Hi Rip,
.
You might be right - that is Dr. Wheeler's position as to what the article is about. But I just don't see it, and I spent weeks looking at it and had multiple people read it, and they all concluded that he was saying to tighten rejection limits in response to high gauge variability in order to ship conforming product. So at least a few of us are reading it that way, and I thought it valuable to point out the fallacy of that approach.
.
But note: if that thing you measure at 6.1 comes from a process that is in control with a Cpk > 1, it is almost certainly in spec. If that 6.1 is taken without any process context, sure, it might be out of spec or in spec. My article is trying to get you to look at that extra context in order to make informed conformance decisions.
.
Thanks for reading!!
Guardbanding
I don't think this is an either/or situation. Wheeler answered a narrow question with a viable narrow answer.
He never said we shouldn't improve our processes or our measurement systems - in fact he is one of the longest (living) proponents of doing exactly that. He simply addressed a means of dealing with results that are at the limit(s) in the presence of significant measurement error.
I too advocate and have been very successful at improving process performance and measurement system performance, BUT I've also used guardbanding and still use it to protect the customer until the process or measurement system can be improved. And in several industries that I've been in, the measurement systems may be difficult to improve to the point where guardbanding can be eliminated quickly even when the process itself is greatly improved. Processes go out of control, vendors go out of control, physics happens. 'Marginal' materila will be produced. And while the author is correct that simply changing the limit at which we accept or reject product doesn't improve the PROCESS OUTPUT, it does improve the quality of the SHIPPED product. A little bit of scrapp or rework is far less expensive than failures in the Customer's hands...
Hi BDaniels, and thanks for
Hi BDaniels, and thanks for reading and commenting!
.
My position is that Wheeler's article does not convey to those reading that article alone without the context of other materials what the correct actions should be. So this is partly an issue about communication, partly a difference of approach. I know Wheeler knows this stuff, but you can't judge the impact of an article on what you think the author meant, you must judge it on what is in the article. The problem is that the article tells the reader that in order to ship high conformance stuff, you must tighten the manufacturing specs, and this is simply not true. Or rather, it is only true in narrow circumstances and is not true across the board. And we are not talking about a "little" scrap and re-work...in the example above, we know that it will be around 30% scrapped and reworked that are in fact really close to target and far away from spec limits. I call that unnecessary waste.
.
Had the article been an article about the very narrow question "how to determine if a part is in spec regardless of process understanding and in the presence of known gauge error" then the article would have been a lot shorter and would have mentioned the caveats that are applicable. But when multiple people read it and conclude that it is an article about a process used to ship conforming product (which I contend is a possible reading), we have a problem.
.
As you say, in the few circumstances where this applies, this should be a temporary (and expensive) holding action. You and I and maybe Wheeler know this, and yet the concept is not in the article.
.
As you say, it is only relevant in the situation where you have high gauge variability and a process that is either out of control or with a Cpk < 1 (or possibly high-risk as other comments present). You and I and maybe Wheeler know this, but it too is not in the article.
.
I read Wheeler's article and thought, "Oh my goodness, people are going to read that and think they need to decrease internal rejection specs in order to get conformance." I base this reaction on specific sentences that say exactly that. And this interpretation drives incorrect (and unnecessarily expensive) behavior.
.
I fully concede that I may be interpreting the article incorrectly, but if so I am not the only one and I think it is valuable to point out how this interpretation could be devastating.
.
Anyway, I hope my article is entertaining and useful!
Trend in Quality Digest Articles
I see a trend in Quality Digest articles i.e. criticize Don Wheeler and try to become famous by doing so :)
Just kidding!
Guru
(Gurbachan Chadha)
Hi Guru, . Jeez, I hope not.
Hi Guru,
.
Jeez, I hope not. I respect Dr. Wheeler quite a bit, though I think he is wrong about a few things, we are very collegial about it.
Education...
Wheeler provides access to other publications on his website that provide the theory and rationale for this latest Quality Digest article. Those who have read these corresponding publications should recognize the profound and extremely important points he is trying to make with respect to the improper estimation and application of traditional gauge R&R..
However, I must admit that I have found the path from paper to practice much clearer with his previous articles (in fact we have implemented his teachings from nearly all of his past articles over the years); in contrast, for this article, the path is a bit muddy... and so I tend to agree with Steven that the intent of this latest article could be misunderstood and misapplied.
Perhaps Dr. Wheeler may find this feedback useful and offer a clarification to his fan base...
Thanks for reading the
Thanks for reading the article VPSCHROEDER, and for your feedback!
Personal sniping at Don ?
Don Wheeler has provided another of his excellent, informative and well explained articles. Steve's reply seems almost like personal sniping at Don, with nonsensical comments like "Wheeler’s notion seems to allow for the backward view that changing a specification will magically cause the process to produce product that meets that specification."
Hi ADB, thanks for reading
Hi ADB, thanks for reading and commenting.
.
I hope this does not come across as personal attacks. When I write these Six Sigma Heretic articles, they tend to come out snarky for some reason - ever since the beginning - but hopefully not disrespectful. I think it is coming clear that people who are familiar with Wheeler's approach (as I am too) see past the article to what they think he meant, whereas people who are not familiar with the approach could read that article and get the wrong idea.
.
Consider the possibility and see what you think.
Specs
I think whether to use or not to use Dr. Wheelers approach for setting the specs "depends on" the type of industry you are in....If you are in the health care, aero space or auto safety industry, the ramifications of a product failure is not worth the the risk...this approach is applicable there. However, we must at the same time must work to improve: 1. the measurement system and 2. the process. We can use this approach until we have some success. In the mean time we understand that we are throwing away lot of conforming product due to misclassifcation errors.
But if you are in the consumer goods industry like adhesive tape we don't have to kill ourselves by tightening the specs, because it is worth to take the risk by minimizing the producers risk otherwise we will scrap or rework lots of good product by misclassifcation (type 1 error).
The answer to the question is (every enginneers and statisticians favorite answer): "It depnds"
Robin Francis
Hi RFRANCIS2 - thanks for
Hi RFRANCIS2 - thanks for reading and commenting!
.
It makes more sense to me to use that approach, at most, as a stopgap. If I am in a high-risk industry, why should I tolerate high gauge variation as a proportion of spec?
.
Anyway, that is my thought, which hopefully the article conveys.
Add new comment