In Reply to: RE: A Challenge To Measurements & DBT Proponents posted by EBradMeyer on September 21, 2007 at 06:45:24:
"Only in audio would anyone think to ask that someone prove the 'validity' of double-blind testing"This is because in audio, DBT's application has been so abused, in the context of DBT's intended purpose.
First, using it to test "listener acuity".... Its proper application is to find out whether or not perceived differences between products or condtions can be resolved to hard data. To show, using tangible evidence from the test data, that a new product or process may be an advancement in performance or technology. (DBT is actually most-effective when one of "less acuity" happens to be able to perceive differences. For it's a sign that test results being repeatable and reliable, an important requisite for passing DBT.)
Second, in the event of no difference initially being resolved (or the differences resolved are not yet reliable and/or repeatable), the lack of correspondence to refine and zero-in on the differences thought to be perceived between products or conditions. But instead, the snap judgment questioning the existence of differences. Often with the citation of the listener being "delusional in overestimating his hearing acuity" for claiming to perceive such differences. (As if such citation has ever been constructive.)
And third, in the event of no differences being resolved, jumping to the erroneous conclusion that differences unequivocally don't exist. Where the deduction should be that the test's results were merely inconclusive. A DBT's objective is to resolve perceived differences- Any test that is unsuccessful in meeting that objective does not necessarily mean the differences are not there. There is the possibility that the differences are there, but the test wasn't able to resolve them.
Since I haven't really checked closely with DBTs done in other fields of industry, I cannot say or presume the "questioning" is unique to audio. But I do notice that most DBTs outside of audio do follow the proper protocol- Where the product, not the person consuming it, is the focus of the testing. And adjustments are made to zero-in on the product's effects where differences in human perception or reaction can be correlated to hard data.
This post is made possible by the generous support of people like you and our sponsors:
Follow Ups
- RE: A Challenge To Measurements & DBT Proponents - Todd Krieger 09/22/0701:30:25 09/22/07 (14)
- Agree and disagree - AJinFLA 09:01:45 09/22/07 (0)
- Well-answered! If I may recast it a bit... - clarkjohnsen 08:56:05 09/22/07 (12)
- RE: "unqualified test subjects" - tlyyra 03:59:33 09/23/07 (2)
- Time to put a stop to the lies and the LIAR who tells them. - clarkjohnsen 12:09:14 09/23/07 (1)
- Would hearing OMG improvement in a grinded/inked cd qualify someone? Eliminate them as a moron? (nt) - AJinFLA 17:00:23 09/23/07 (0)
- Catch 22 - AJinFLA 09:13:11 09/22/07 (8)
- Question - E-Stat 09:23:06 09/22/07 (7)
- RE: Question - AJinFLA 09:34:48 09/23/07 (6)
- Congratulations! - E-Stat 09:44:49 09/23/07 (5)
- RE: Congratulations! - AJinFLA 12:21:06 09/23/07 (4)
- Rick what scientifically acceptable method should be used to demonstrate that audiophiles do indeed "hear it"? - AJinFLA 15:53:37 09/24/07 (1)
- Only too happy to repeat the answer - E-Stat 09:23:15 09/26/07 (0)
- Gotcha - E-Stat 06:15:19 09/24/07 (1)
- Rick? - AJinFLA 08:46:09 09/26/07 (0)