Home Critic's Corner

Discuss a review. Provide constructive feedback. Talk to the industry.

It took you over 100 blind tests to come to the conclusion that blind tests are a waste of time?

You must enjoy wasting your time in blind tests, or are you implying that the blind tests you participate in use the "proper methodology" and are valid?

But then you reverse yourself by bragging about positive results in some blind tests. So now are you implying that when you have positive results, the tests were done properly and you deserve accolades ... while the null results were from poorly managed tests ... or don't matter?

So I guess your conclusion is blind tests can't be trusted ... unless you are there to see they are done correctly ... and you have positive results.

Not that your positive results mean much in relation to the products tested in Stereophile: We already knew loudspeakers and cartridges are likely to have audible differences ... and sometimes tube amps may have small audible differences. That's been done before. And your claimed results were no surprise. Of course we really don't know if your test results were very decisive ... or just better than random guessing -- we only know you claimed to "pass the tests", but for some reason you didn't mention your scores.

Now what about all those null results you gloss over?
Are you going to claim they are meaningless?
In fact they are important as a psychological test to demonstrate a listener bias toward claiming to hear differences among components.

How often were you confident you heard differences in the sighted warm-up auditions only to find out that minutes later you really heard no differences when the brand names were hidden.

I'll answer the question for you because I assume you'll ignore it: -- In the sighted warm-up auditions most blind test participants thought they heard differences (as in almost all sighted auditions) ... so the fact that they could not hear differences minutes later under blind conditions strongly suggests the "audible" differences were nothing but their imaginations (expectations).

The "imagined differences" hypothesis is easily tested by allowing audiophiles to compare a component with itself under "blind conditions", while allowing them assume there are two components.

The result will typically be "differences heard" in 50% to 75% of the "A-A" comparisons.

Knowing the brand of component being heard adds no value to a description of the sound quality. That knowledge can only bias the listener.

Comparing two components playing at different SPL's can not add value to a description of sound quality differences ... not to mention comparing two components heard in different rooms.

I know you or your reviewers will never risk demonstrating to witnesses the claimed ability to be able to hear differences among all audio components ... even though doing this would boost subscriptions and make you world famous as a real "proven" golden ear.

Of course I should mention it's quite rare for people to be known for having exceptional skills, yet they have never proven or demonstrated their skills to others. High end audio is very unusual in that regard. Most public "experts" want to prove their skills or knowledge to others. If not, can we have confidence they are anything but self-proclaimed experts?

I do enjoy your "verbal tapdancing" to explain why blind auditions are no good ... while you participate in over 100 of them ... and brag about the few "positives".

The staff of Stereophile claims to have excellent hearing ability.

No one can prove it, or will try (at least not in "public").

Even those who do try will dismiss most of their results as "nulls" ... yet will never discuss why sighted comparisons almost never have "nulls", even the sighted warm-up auditions minutes before a blind test!

Why do all stereo components sound different?
Stereophile answer: Because we say so ... and we could prove it ... but no test is good enough ... unless we participate and have positive results ... which happened a few times, mainly for speakers and cartridges that we already knew were likely to sound different!




This post is made possible by the generous support of people like you and our sponsors:
  Kimber Kable  


Follow Ups Full Thread
Follow Ups


You can not post to an archived thread.