Testing audiophile claims and myths
post-14871636
Post #12,616 of 14,076

bfreedma

The Hornet!
Joined
Feb 3, 2012
Messages
2,419
Reaction score
1,287
Joined
Feb 3, 2012
Posts
2,419
Likes
1,287
At first, I thought the following ( found today on FB ) is an April Fool's joke - but, no, Devious Machines https://www.deviousmachines.com/ actually exists :
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Devious Machines are proud to present a revolution in audiophile signal processing: the DFA-3000 High End Audio Interconnect Simulator.

For the very first time, you can reproduce the highly sought after sound of the very highest quality audio interconnects, previously only available to elite audiophiles: right in your DAW!

Our patented algorithm accurately models every nuance of the most highly sought after components, including quantum effects and electrostatic flux. Using this technique, we were able to accurately model the exact sound of cables costing from $10 right up to the very best products costing $10,000.

Features:

*) Accurate modelling of the highest quality cables and connectors
*) Adjustable "Detail" and "Depth" controls
*) Adjustable "Price" slider, to model cables from $10 to $10,000!
*) Superior detail
*) Unbelievable depth and focus
*) Enhanced power and forceful dynamics
*) Superior digital noise rejection

For a limited time, we're making this exclusive audiophile technology available to you for the unbelievable introductory price of £499 (RRP £1499)
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

" Adjustable Price Slider " - hard one to top for any marketing type ...
Virtualized snake oil. Cool...
 
     Share This Post       
post-14871999
Post #12,617 of 14,076

old tech

500+ Head-Fier
Joined
Jul 8, 2015
Messages
702
Reaction score
314
Location
Sydney, Australia
Joined
Jul 8, 2015
Location
Sydney, Australia
Posts
702
Likes
314
First off, I'll admit that I skimmed the article... although I did so pretty carefully... and I found a few things a bit odd.

Quite interestingly, listener A posted nearly random results.... except for the results with one particular track... (the Daft Punk track).
Oddly, on that one, he got 8/8 right on the first pass... (which seemed to surprise him - and which he seemed especially eager to credit to "probably being luck").
Then, when he repeated the test, he got more or less random results (which seemed to be what he expected).
(It kind of makes me wonder if he had an expectation bias not to hear any significant difference.)

There also didn't seem to be any detailed results for Listener B.

And, obviously, only two test subjects, two pairs of headphones, and a rather limited assortment of tracks, were included.

I would add it to the list of tests which seem to suggest that, if you expect to hear major obvious differences, you're likely to be disappointed....
However, at least to me, it falls far short of supporting an authoritative claim that "there are no audible differences"....
Therefore, their "conclusion" is really a pretty long reach from what the results would support....
(I should note that Tom's is a discussion forum for computer folks... They never claimed that their results were conclusive - and even suggested that more testing was indicated.)
Yes, it certainly falls short of anything we could call definitive, but less so than most subjective reviews of these products where the person(s) reviewing them have no controls at all, just beliefs.

For all its shortcomings, the findings do have a basis in audio science unless someone is able to explain why a $2000 DAC should sound better, without resorting to myths and psuedoscience.

Consistent with my own beliefs, the authors have not concluded that these products should be avoided as they do have many benefits around functionallity, convenience, features and looks. Rather, if the purpose is solely for high fidelity output there is little reason to invest more cash these days over modern codecs that come standard with PC motherboards.
 
Last edited:
     Share This Post       
post-14872002
Post #12,618 of 14,076

old tech

500+ Head-Fier
Joined
Jul 8, 2015
Messages
702
Reaction score
314
Location
Sydney, Australia
Joined
Jul 8, 2015
Location
Sydney, Australia
Posts
702
Likes
314
At first, I thought the following ( found today on FB ) is an April Fool's joke - but, no, Devious Machines https://www.deviousmachines.com/ actually exists :
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Devious Machines are proud to present a revolution in audiophile signal processing: the DFA-3000 High End Audio Interconnect Simulator.

For the very first time, you can reproduce the highly sought after sound of the very highest quality audio interconnects, previously only available to elite audiophiles: right in your DAW!

Our patented algorithm accurately models every nuance of the most highly sought after components, including quantum effects and electrostatic flux. Using this technique, we were able to accurately model the exact sound of cables costing from $10 right up to the very best products costing $10,000.

Features:

*) Accurate modelling of the highest quality cables and connectors
*) Adjustable "Detail" and "Depth" controls
*) Adjustable "Price" slider, to model cables from $10 to $10,000!
*) Superior detail
*) Unbelievable depth and focus
*) Enhanced power and forceful dynamics
*) Superior digital noise rejection

For a limited time, we're making this exclusive audiophile technology available to you for the unbelievable introductory price of £499 (RRP £1499)
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

" Adjustable Price Slider " - hard one to top for any marketing type ...
Fools and their money and all that.
 
     Share This Post       
post-14902854
Post #12,619 of 14,076

E1DA

Member of the Trade: E1DA
Joined
Sep 4, 2018
Messages
90
Reaction score
49
Location
South China
Joined
Sep 4, 2018
Location
South China
Posts
90
Likes
49
I was surprised when noticed that this area of audio industry so much relaxed regarding official specs! Even the output power isn't specified sometimes, or specified at THD 10% that's really cheap cheat )) The same thing regarding the THD+N, I never see any conditions for that, only the number. In audio-amps area I always have to specify the THD+N and the power where it was measured, usually, it is 1/2 of max power, where is max power = power when THD+N reached 1%. If that power is not specified, it is cheating again because a vendor may found the particular power level where is THD+N is minimal. Sometimes I saw vendors simply copy/paste specs from parts used in that product. If somebody did see that nice recourse https://www.audiosciencereview.com/forum/index.php?reviews/ check this out, how often real measurements mismatch vs claimed specs ))
 
     Share This Post       
post-14905191
Post #12,620 of 14,076

KeithEmo

Member of the Trade: Emotiva
Joined
Aug 13, 2014
Messages
1,696
Reaction score
848
Joined
Aug 13, 2014
Posts
1,696
Likes
848
The simple reality is that vendors who sell products are mostly free to post whatever specifications they like, in whatever form they like, as long as there is no legally-provable "intent to mislead or defraud". Note that we have many laws concerning "truth in advertising" and "accuracy of product claims" - however, in most cases, they are based on product safety and liability. (For example, medicines and foods are most tightly regulated, because they have the greatest chance of causing harm if they are misrepresented.)

About the only specific legal regulations regarding how audio equipment is described occur in the original "FTC Requirements for Power Amplifier Specifications" document published at or about 1972 by the US Federal Trade Commission (who regulates interstate commerce of retail products). Recognizing that misrepresentation was very common in amplifier power measurements, and partly in response to lobbying from several "reputable audio companies", the Federal Trade Commission published a legal requirement for how the power rating on home audio amplifiers MUST be both measured and described in advertisements. This is the "standard" that is often referenced - and which refers to things like specifying power as "watts RMS continuous", including THD in the measurement, and providing a specific "pre-conditioning warmup period". Note that this paper is very limited, applies almost entirely to only "stereo audio equipment" (it's applicability to "multi-channel gear", "car audio equipment", and "pro audio gear" is extremely limited), and has been revised several times.

The reality is that, in most cases, the manufacturer is free to provide whatever specifications they prefer, in whatever form they prefer, as long as they don't "intentionally outright lie".


It's also worth noting that there are very few specifications that are actually "universally agreed upon" for audio gear.

For example, you may consider 10% THD to be totally unacceptable for an audiophile quality home audio amplifier, but it may be quiet acceptable for a stadium public address system, or for a low cost table radio or portable music player. Therefore, it's not unreasonable to suggest that it's up to the consumer to decide what specifications THEY consider to be important, and to simply refuse to purchase products whose manufacturers fail to provide those specs.


You also need to realize that published specifications are intended to sell products... usually to specific markets...

So, for example, let's say I had an amplifier that produced 72 watts at 0.01% THD, 92 watts at 0.1% THD, and 102 watts at 10% THD.
(These would be typical measurements for a medium-sized solid state amplifier.)

If I was attempting to market that amplifier to audiophiles, who strongly favor very low THD numbers...
I would probably rate it conservatively at "65 watts at 0.01% THD".

However, if I was marketing it to typical consumers, and one of my main competitors had a similar model rated at "75 watts @ 0.1%"...
I would rate mine as "90 watts at 0.1%" to emphasize the fact that it was more powerful than my competitor's product at the same rated distortion.

And, if I was selling it as an amplifier to be used with public address equipment in small theaters...
I might rate it as "a 100 watt public address amplifier" - and only mention that rating was at 10% in the proverbial fine print.
(Note that, for PA equipment, 10% THD is considered perfectly acceptable, but maximum available volume is important, and "100" is a nice round number.)

Note that NONE of those rating is incorrect, misleading, or "bad" - they just provide the information in the form preferred by the "target market".

I was surprised when noticed that this area of audio industry so much relaxed regarding official specs! Even the output power isn't specified sometimes, or specified at THD 10% that's really cheap cheat )) The same thing regarding the THD+N, I never see any conditions for that, only the number. In audio-amps area I always have to specify the THD+N and the power where it was measured, usually, it is 1/2 of max power, where is max power = power when THD+N reached 1%. If that power is not specified, it is cheating again because a vendor may found the particular power level where is THD+N is minimal. Sometimes I saw vendors simply copy/paste specs from parts used in that product. If somebody did see that nice recourse https://www.audiosciencereview.com/forum/index.php?reviews/ check this out, how often real measurements mismatch vs claimed specs ))
 
     Share This Post       
post-14905678
Post #12,622 of 14,076

KeithEmo

Member of the Trade: Emotiva
Joined
Aug 13, 2014
Messages
1,696
Reaction score
848
Joined
Aug 13, 2014
Posts
1,696
Likes
848
I'm not sure there is any conclusion to be had...
You can't really claim that anybody is cheating simply because they fail to provide the specs that you find useful - because there are no "official specs"...
Each manufacturer simply publishes the specs that they believe will impress the people they hope will buy their product.

And, yes, if they fail to meet the specs they claim, under the exact conditions they specify, then it might be reasonable to say they're misleading you.
However, if the manufacturer simply fails to provide complete information, you can't say they're "cheating" simply because you made incorrect assumptions.
(So, for example, if they describe it as "a 100 watt amplifier", but don't specify the THD, then it's your fault if you assume they measured it at 0.1% THD, but they used 10% THD.)

So, the conclusion is?
 
     Share This Post       
  • Like
Reactions: gargani
post-14906043
Post #12,623 of 14,076

Steve999

smooth, DARK
Joined
Jul 15, 2002
Messages
2,467
Reaction score
286
Joined
Jul 15, 2002
Posts
2,467
Likes
286
I'm not sure there is any conclusion to be had...
You can't really claim that anybody is cheating simply because they fail to provide the specs that you find useful - because there are no "official specs"...
Each manufacturer simply publishes the specs that they believe will impress the people they hope will buy their product.

And, yes, if they fail to meet the specs they claim, under the exact conditions they specify, then it might be reasonable to say they're misleading you.
However, if the manufacturer simply fails to provide complete information, you can't say they're "cheating" simply because you made incorrect assumptions.
(So, for example, if they describe it as "a 100 watt amplifier", but don't specify the THD, then it's your fault if you assume they measured it at 0.1% THD, but they used 10% THD.)
The conclusion that there is no conclusion to be had is demonstrably, inherently and deductively false because the conclusion that there is no conclusion to be had is a conclusion itself. There must be a conclusion other than that there is no conclusion to be had.
 
Last edited:
     Share This Post       
post-14906310
Post #12,624 of 14,076

E1DA

Member of the Trade: E1DA
Joined
Sep 4, 2018
Messages
90
Reaction score
49
Location
South China
Joined
Sep 4, 2018
Location
South China
Posts
90
Likes
49
I do the conclusion that smart users choose with reviewers help(like z-reviews, forums like this one etc), most advanced users probably will try the product in offline shops(that's become an exotic way nowadays) or analyze deep in-tech reviews from www.audiosciencereview.com. To other users price and color is enough )) BTW, for an ideal case, which should be quite close to any linear amp clipping behavior, THD 1% vs 10% makes +23% up power rating. Power amps is a much more challenging task vs HPA due to higher currents, voltages and powers(about 1000 times) involved. DAC and HPA area is really trivial technically, any cheating attempts there can show us just shamefully low engineering level.
 
     Share This Post       
  • Like
Reactions: rocksteady65
post-14906324
Post #12,625 of 14,076

TheSonicTruth

500+ Head-Fier
Joined
Dec 19, 2014
Messages
992
Reaction score
118
Joined
Dec 19, 2014
Posts
992
Likes
118
The conclusion that there is no conclusion to be had is demonstrably, inherently and deductively false because the conclusion that there is no conclusion to be had is a conclusion itself. There must be a conclusion other than that there is no conclusion to be had.
This reply sooo reminds me of former secretary of defense Donald Rumsfeld's famous "known unknowns" response at a press conference some years ago! lol

 
Last edited:
     Share This Post       
  • Like
Reactions: GearMe
post-14906777
Post #12,627 of 14,076

bigshot

Headphoneus Supremus
Joined
Nov 16, 2004
Messages
21,383
Reaction score
3,483
Location
Hollywood USA
Joined
Nov 16, 2004
Location
Hollywood USA
Posts
21,383
Likes
3,483
Website
www.facebook.com
"You can't know anything because you can't know everything." --A. Internet Genius
 
     Share This Post       
  • Like
Reactions: GearMe
post-14985519
Post #12,629 of 14,076

GearMe

Headphoneus Supremus
Joined
Feb 17, 2013
Messages
3,225
Reaction score
2,079
Joined
Feb 17, 2013
Posts
3,225
Likes
2,079

Users Who Are Viewing This Thread (Users: 1, Guests: 1)

  • Top