In Reply to: Known Flaws In DBTS! posted by thetubeguy1954 on June 19, 2008 at 08:39:56:
TG54
"Audio DBTs are simply not trustworthy for being able to discern if the participants are able to detect sonic differences."
My comment:
It all depends on what you mean by trustworthy and "able to detect sonic differences." If one gets consistently positive results, that does show that one can reliably detect the differences in question by sound alone.
TG54 continues:
"The reality is this: The correct way to describe the negative results of any test like this (whether ABX or any other double-blind format) is that under the conditions of this test, listeners were unable to distinguish one component from another by sound alone."
My comment:
We have told you nothing else, and your starting out with "The reality is" doesn't change the facts. With large scale tests, with suitable controls (which would include calibration), it is possible to make generalisations for a larger population. Dr. Floyd Toole has done some of that for speakers. But they remain probabilities.
TG54
"That does NOT mean that all components are audibly indistinguishable to all listeners under all circumstances. They were just indistinguishable to these participants in these circumstances."
My comment:
Richard has many times told you that informal DBTs apply to the participants and occasion. You should give credit where its due.
Moreover, if you bother to read the ABX site, you will find that it is clearly stated that one cannot prove the null hypothesis. I wonder whether you bother to read through any links others provide, but here goes again.
As for the rest of your post, you seem to find something the matter with choosing a specific sort of population for a blind test, but provide no reason for it.
Ensuring that participants do not know what the DUT is and cannot identify it in advance must mean that audio DBTs are in that respect more rigorous than those medical DBTs where the drugs look, taste, or feel different.
So, all your have shown is that DBTs can be done poorly, but then no one doubts that.
-
"It pertains to all men to know themselves and to be temperate."
---Heraclitus of Ephesus (trans. Wheelwright)
This post is made possible by the generous support of people like you and our sponsors:
Follow Ups
- It seems we have taught you something . . . - Pat D 06/19/0814:21:15 06/19/08 (0)