Home Propeller Head Plaza

Technical and scientific discussion of amps, cables and other topics.

RE: A Challenge To Measurements & DBT Proponents

"Only in audio would anyone think to ask that someone prove the 'validity' of double-blind testing"

This is because in audio, DBT's application has been so abused, in the context of DBT's intended purpose.

First, using it to test "listener acuity".... Its proper application is to find out whether or not perceived differences between products or condtions can be resolved to hard data. To show, using tangible evidence from the test data, that a new product or process may be an advancement in performance or technology. (DBT is actually most-effective when one of "less acuity" happens to be able to perceive differences. For it's a sign that test results being repeatable and reliable, an important requisite for passing DBT.)

Second, in the event of no difference initially being resolved (or the differences resolved are not yet reliable and/or repeatable), the lack of correspondence to refine and zero-in on the differences thought to be perceived between products or conditions. But instead, the snap judgment questioning the existence of differences. Often with the citation of the listener being "delusional in overestimating his hearing acuity" for claiming to perceive such differences. (As if such citation has ever been constructive.)

And third, in the event of no differences being resolved, jumping to the erroneous conclusion that differences unequivocally don't exist. Where the deduction should be that the test's results were merely inconclusive. A DBT's objective is to resolve perceived differences- Any test that is unsuccessful in meeting that objective does not necessarily mean the differences are not there. There is the possibility that the differences are there, but the test wasn't able to resolve them.

Since I haven't really checked closely with DBTs done in other fields of industry, I cannot say or presume the "questioning" is unique to audio. But I do notice that most DBTs outside of audio do follow the proper protocol- Where the product, not the person consuming it, is the focus of the testing. And adjustments are made to zero-in on the product's effects where differences in human perception or reaction can be correlated to hard data.



This post is made possible by the generous support of people like you and our sponsors:
  VH Audio  


Follow Ups Full Thread
Follow Ups

FAQ

Post a Message!

Forgot Password?
Moniker (Username):
Password (Optional):
  Remember my Moniker & Password  (What's this?)    Eat Me
E-Mail (Optional):
Subject:
Message:   (Posts are subject to Content Rules)
Optional Link URL:
Optional Link Title:
Optional Image URL:
Upload Image:
E-mail Replies:  Automagically notify you when someone responds.