|
General Asylum General audio topics that don't fit into specific categories. |
|
|
|
General Asylum General audio topics that don't fit into specific categories. |
|
In Reply to: Bind ABX has limits but don't tell them that posted by Feanor on December 19, 2020 at 06:21:27:
I have been making the reliability vs validity argument for years.
And statistical significance is also interesting. 9/10 correct guesses meets the 0.5% statistical significance criteria that your answers were not a function of mere chance.
But so does 59/100 (6/10 times with one miss). This ALSO meets the SAME 0.5% significance criteria that you chose right and it was not a function of mere chance.
So on something audible that is harder to detect - more trials are better.
The test needs to be ONE listener (not added results of multiple listeners as most outfits wrongly do them). But 59/100 would be a tough sell as a reason to buy something - 9/10 looks better right. So marketing gets in the way especially if you are the guy selling the $200 amplifier and want to convince people it sounds no different than the $20,000 amplifier. So you want the result in your favor as fast as possible. See the listener only got 7/10 so he failed so he can't tell the difference between a Pass Labs and a $55 amplifier from parts Express.
Umm but 7/10 is not a fail - keep going and maybe he gets 70/100 which exceeds 9/10.
And that's just for reliability. Validity is a whole other thing but arguing that to them is a tougher argument. There are test stress arguments as well that we know about in Education. I have no problem with blind tests they are a tool but the application isn't that strong in audio. It was meant for medical purposes not subjective tests like this.
I don't blame them though - I wish a $200 amp sounded just as good as any $20,000 amp etc. Just like I wish my Kia Rondo Minivan was a Bugatti. Perhaps if I put both vehicles on a roller at 30mph my Rondo would win because it would go the same speed and blindfolded it might be deemed more comfortable to sit in. I can't afford the Bugatti so perhaps I need to convince myself it's as good or better.
This post is made possible by the generous support of people like you and our sponsors:
Follow Ups
- RE: Bind ABX has limits but don't tell them that - RGA 12/19/2020:13:25 12/19/20 (0)
Top of Page ]
[ Contact Us ]
[ Support/Wish List ]
[ Copyright © 2024, Audio Asylum, all rights reserved ]
