Discussion:
INTERNET TEST: 24-bit vs. 16-bit Audio - Results Posted
Archimago
2014-06-27 15:01:56 UTC
Permalink
Okay boys. Results posted now.

I'll get some of the subjective comments up in Part III. Looks to me
like the blinding procedures did the job and as far as I can tell, most
respondents did try to have a good listen. Thanks for all the help guys
:cool:

http://archimago.blogspot.com/2014/06/24-bit-vs-16-bit-audio-test-part-ii.html



Archimago's Musings: (archimago.blogspot.com) A 'more objective'
audiophile blog.
------------------------------------------------------------------------
Archimago's Profile: http://forums.slimdevices.com/member.php?userid=2207
View this thread: http://forums.slimdevices.com/showthread.php?t=101766
Wombat
2014-06-27 15:23:13 UTC
Permalink
Now this is nicely done and looks like a lot of work! Thank you very
much for this!!



Transporter (modded) -> RG142 -> Avantgarde Acoustic based 500VA
monoblocks -> Sommer SPK240 -> self-made speakers
------------------------------------------------------------------------
Wombat's Profile: http://forums.slimdevices.com/member.php?userid=4113
View this thread: http://forums.slimdevices.com/showthread.php?t=101766
Archimago
2014-06-27 15:33:13 UTC
Permalink
Post by Wombat
Now this is nicely done and looks like a lot of work! Thank you very
much for this!!
And thank you for the suggestions!

If anyone was wondering, alas, I did not get any response from Neil
Young... Pity... :(



Archimago's Musings: (archimago.blogspot.com) A 'more objective'
audiophile blog.
------------------------------------------------------------------------
Archimago's Profile: http://forums.slimdevices.com/member.php?userid=2207
View this thread: http://forums.slimdevices.com/showthread.php?t=101766
darrenyeats
2014-06-27 16:25:56 UTC
Permalink
Archimago,
Many thanks for your work - and this is a very interesting result.
Darren



Check it, add to it! http://www.dr.loudness-war.info/

http://www.amazon.co.uk/gp/richpub/listmania/byauthor/A3H57URKQB8AQO/ref=cm_pdp_content_listmania/203-7606506-5721503.

SB Touch
------------------------------------------------------------------------
darrenyeats's Profile: http://forums.slimdevices.com/member.php?userid=10799
View this thread: http://forums.slimdevices.com/showthread.php?t=101766
Pascal Hibon
2014-06-27 16:47:55 UTC
Permalink
Yes, great work and always very interesting to read !!
Thanks for your efforts.

Neil Young maybe participated under a different name?



'M-DAC' (http://www.audiolab.co.uk/M-DAC%20Series.aspx?lang=En) ->
'Cambridge Audio Azur 840E'
(http://www.cambridgeaudio.com/products/azur-840e-pre-amplifier) ->
'Focal MP1200' (http://www.mp1200.co.nf/) -> 'Focal Electra 1028 Be'
(http://www.focal.com/en/electra-1000-be-2/209-electra-1028-be-3544053695099.html)
1 x SB3, 1 x SB Boom, 1 x SB Radio and 2 x SB Touch - all wireless
1 x Wandboard Dual behind the bedroom ceiling
1 x Wandboard Dual for 'msqueeze' (http://www.msqueeze.co.nf/index.html)
project
1 x Wandboard Quad (will eventually become my LMS server)
ReadyNAS NVX running LMS 7.8.0.
iPeng 7 on iPhone.
SqueezePad & iPeng 7 on iPad.
http://www.last.fm/user/phibon
------------------------------------------------------------------------
Pascal Hibon's Profile: http://forums.slimdevices.com/member.php?userid=7969
View this thread: http://forums.slimdevices.com/showthread.php?t=101766
marflao
2014-06-27 20:16:06 UTC
Permalink
Well done, Archimago.
Brilliant documentation.
I'm looking forward to the next test. :-)
Thanks again.




------------------------------------------------------------------------
marflao's Profile: http://forums.slimdevices.com/member.php?userid=57334
View this thread: http://forums.slimdevices.com/showthread.php?t=101766
garym
2014-06-27 20:53:16 UTC
Permalink
Great work. Thanks!



*Location 1:* VortexBox 4TB (2.2) > LMS 7.8 > Transporter, Touch, Boom,
Radio w/Battery (all ethernet except Radio)
*Location 2:* VBA 3TB (2.2) > LMS 7.8 > Touch > Benchmark DAC I, Boom,
Radio w/Battery (all ethernet except Radio)
*Office:* Win7(64) > LMS 7.8 > Squeezelite
*Spares:* VBA 4TB, SB3, Touch (3), Radio (3), CONTROLLER
*Controllers:* iPhone4S & iPad2 (iPeng7 & Squeezepad), CONTROLLER, or
SqueezePlay 7.8 on Win7(64) laptop
Ripping (FLAC) - dbpoweramp, Tagging - mp3tag, Streaming - Spotify
------------------------------------------------------------------------
garym's Profile: http://forums.slimdevices.com/member.php?userid=17325
View this thread: http://forums.slimdevices.com/showthread.php?t=101766
Mnyb
2014-06-27 21:41:02 UTC
Permalink
Exellent work , the number of downöoads suggest that more people tried
than actually did the survey :)

You may have inspered some to test thier assumptions .

The missunderstandings about digital audio are truly limitless , just
the other day some one asked for 352kHz support on USB for. Touch ?



--------------------------------------------------------------------
Main hifi: Touch + CIA PS +MeridianG68J MeridianHD621 MeridianG98DH 2 x
MeridianDSP5200 MeridianDSP5200HC 2 xMeridianDSP3100 +Rel Stadium 3
sub.
Bedroom/Office: Boom
Kitchen: Touch + powered Fostex PM0.4
Misc use: Radio (with battery)
iPad1 with iPengHD & SqueezePad
(in storage SB3, reciever ,controller )
server HP proliant micro server N36L with ClearOS Linux

http://people.xiph.org/~xiphmont/demo/neil-young.html
------------------------------------------------------------------------
Mnyb's Profile: http://forums.slimdevices.com/member.php?userid=4143
View this thread: http://forums.slimdevices.com/showthread.php?t=101766
Archimago
2014-06-28 00:27:26 UTC
Permalink
Post by Mnyb
Exellent work , the number of downöoads suggest that more people tried
than actually did the survey :)
You may have inspered some to test thier assumptions .
The missunderstandings about digital audio are truly limitless , just
the other day some one asked for 352kHz support on USB for. Touch ?
Also doesn't help when manufacturers are clearly engaged in a
"samplerate war" with 192, 352, 384, DSD128, DSD256, DSD512 at this
point to sell hardware with presumably the software to follow. I think
what happens to Pono should be interesting in the days ahead...

I wonder what happened at this AES workshop in April?
http://www.aes.org/events/136/workshops/?ID=3970

I do believe that doing the test opened some eyes to preconceived
beliefs. I'll post the subjective comments ("testimonies") in Part III.



Archimago's Musings: (archimago.blogspot.com) A 'more objective'
audiophile blog.
------------------------------------------------------------------------
Archimago's Profile: http://forums.slimdevices.com/member.php?userid=2207
View this thread: http://forums.slimdevices.com/showthread.php?t=101766
foxx
2014-06-28 05:13:15 UTC
Permalink
Great job and well done!
Thanks for the tremendous effort.

Not that I would have expected a different result, but test like this
are necessary to prove the obvious.


------------------------------------------------------------------------
foxx's Profile: http://forums.slimdevices.com/member.php?userid=36364
View this thread: http://forums.slimdevices.com/showthread.php?t=101766
Wombat
2014-06-28 15:48:35 UTC
Permalink
One question out of curiousity. Was there any participant from the CA
forum and outed himself as such? It would be the first time i'd see some
worthy input. So far on several events all i read there is bashing
afterwards in a poor way.



Transporter (modded) -> RG142 -> Avantgarde Acoustic based 500VA
monoblocks -> Sommer SPK240 -> self-made speakers
------------------------------------------------------------------------
Wombat's Profile: http://forums.slimdevices.com/member.php?userid=4113
View this thread: http://forums.slimdevices.com/showthread.php?t=101766
P Nelson
2014-07-01 00:40:34 UTC
Permalink
I was surprised that you did not include an ABx for each sound track so
you could actually test if people accurately could test the difference
between the two tracks. Then you could test the does 24 bit or 16 bit
sound better. Regardless, I think the data shows that people were
effectively guessing as the number of people that got all right or all
wrong is right in line with what you would expect with a 50/50 guess.
In any guess, even with an ABx layered on top of which is the 24 bit, a
few could still guess and get it right. Those with golden ears will
ignore the evidence.

I did not keep records of which answers I made. The only one I thought
might be different wa the Bozza track. No idea which sounded better.

Good job. I am glad I have not wasted money on HD tracks.


------------------------------------------------------------------------
P Nelson's Profile: http://forums.slimdevices.com/member.php?userid=58158
View this thread: http://forums.slimdevices.com/showthread.php?t=101766
Mnyb
2014-07-01 01:25:13 UTC
Permalink
Post by P Nelson
I was surprised that you did not include an ABx for each sound track so
you could actually test if people accurately could test the difference
between the two tracks. Then you could test the does 24 bit or 16 bit
sound better. Regardless, I think the data shows that people were
effectively guessing as the number of people that got all right or all
wrong is right in line with what you would expect with a 50/50 guess.
In any guess, even with an ABx layered on top of which is the 24 bit, a
few could still guess and get it right. Those with golden ears will
ignore the evidence.
I did not keep records of which answers I made. The only one I thought
might be different wa the Bozza track. No idea which sounded better.
Good job. I am glad I have not wasted money on HD tracks.
It would not have worked as x could not really be x as he had to
slightly fudge the files to avoid people cheating ,it had been a third
variant not a or b .

But anyway , with HD tracks you don't actually know when your wasting
your money . You could get a better master of some recordings you could
also get something else they simple don't have 100% knowledge of the
source ( or actually don't care) . The may correct errors after the fact
in some cases but that's simply not good enough .
Given thier history I'm not realy trusting their different versions of
release to be just different sample rates ? The 16/44.1 version of an
album is cheaper in thier store

The fact that I sometimes buy stuff there is just because there is not
enough good online stores for lossles downloads, sometimes they are a
viable option . And bussiness wise they kind of work you get your stuff
( whatever it is )

But we will be saved it's not DSD ! :D

* new marketing opurtunity for some successor to HD tracks or HD tracks
themselfs if they can adapt .
* new opurtunity for denial for the devoted audiophile all PCM sound the
same ;)



--------------------------------------------------------------------
Main hifi: Touch + CIA PS +MeridianG68J MeridianHD621 MeridianG98DH 2 x
MeridianDSP5200 MeridianDSP5200HC 2 xMeridianDSP3100 +Rel Stadium 3
sub.
Bedroom/Office: Boom
Kitchen: Touch + powered Fostex PM0.4
Misc use: Radio (with battery)
iPad1 with iPengHD & SqueezePad
(in storage SB3, reciever ,controller )
server HP proliant micro server N36L with ClearOS Linux

http://people.xiph.org/~xiphmont/demo/neil-young.html
------------------------------------------------------------------------
Mnyb's Profile: http://forums.slimdevices.com/member.php?userid=4143
View this thread: http://forums.slimdevices.com/showthread.php?t=101766
cliveb
2014-07-01 13:03:45 UTC
Permalink
Post by Mnyb
It would not have worked as x could not really be x as he had to
slightly fudge the files to avoid people cheating ,it had been a third
variant not a or b .
I've just seen this and don't understand what you're trying to get at.
You seem to be under the impression that an ABX test involves three
files?

An ABX test involves just two files - A and B. The test subject is
allowed to listen to A and B (knowing which is which) as often as he
likes in order to familiarise himself with how they sound. Then X (which
is either A or B, but unknown to the test subject) is presented and the
listener must decide whether it is A or B. Do at least 10 trials
(preferably 20) to get a statistically meaningful result.

Maybe I've misunderstood what you were trying to say.



Transporter -> ATC SCM100A
------------------------------------------------------------------------
cliveb's Profile: http://forums.slimdevices.com/member.php?userid=348
View this thread: http://forums.slimdevices.com/showthread.php?t=101766
Mnyb
2014-07-01 14:37:47 UTC
Permalink
Post by cliveb
I've just seen this and don't understand what you're trying to get at.
You seem to be under the impression that an ABX test involves three
files?
An ABX test involves just two files - A and B. The test subject is
allowed to listen to A and B (knowing which is which) as often as he
likes in order to familiarise himself with how they sound. Then X (which
is either A or B, but unknown to the test subject) is presented and the
listener must decide whether it is A or B. Do at least 10 trials
(preferably 20) to get a statistically meaningful result.
Maybe I've misunderstood what you were trying to say.
Your rigth abx does not use 3 files but x is iether one of the other
files , thats how do it ! Rigth .

But for a cheater it would be really easy to match a or b with x any
cheap software



--------------------------------------------------------------------
Main hifi: Touch + CIA PS +MeridianG68J MeridianHD621 MeridianG98DH 2 x
MeridianDSP5200 MeridianDSP5200HC 2 xMeridianDSP3100 +Rel Stadium 3
sub.
Bedroom/Office: Boom
Kitchen: Touch + powered Fostex PM0.4
Misc use: Radio (with battery)
iPad1 with iPengHD & SqueezePad
(in storage SB3, reciever ,controller )
server HP proliant micro server N36L with ClearOS Linux

http://people.xiph.org/~xiphmont/demo/neil-young.html
------------------------------------------------------------------------
Mnyb's Profile: http://forums.slimdevices.com/member.php?userid=4143
View this thread: http://forums.slimdevices.com/showthread.php?t=101766
P Nelson
2014-07-01 14:45:30 UTC
Permalink
Post by Mnyb
It would not have worked as x could not really be x as he had to
slightly fudge the files to avoid people cheating ,it had been a third
variant not a or b .
I thought about what can be done to prevent accidental cheating by
looking at file size or some other metric that would be visible.
Remove a a different amount of seconds from each file and disclose that
ending of each sample track is different and people should focus on the
first 2 minutes of the track. Thus all three files are slightly
different lengths, but 2 are actually exactly the same.

Still a great survey.

Mnyb now wants a CD vs DSD test.

Paul


------------------------------------------------------------------------
P Nelson's Profile: http://forums.slimdevices.com/member.php?userid=58158
View this thread: http://forums.slimdevices.com/showthread.php?t=101766
Archimago
2014-07-04 15:16:40 UTC
Permalink
Part III with people's subjective descriptions and testimony about how
"easy" or "hard" this test was is now up...

Also some final thoughts and a link to the Pono advert for come contrast
and comparison.

http://archimago.blogspot.ca/2014/07/24-bit-vs-16-bit-audio-test-part-iii.html



Archimago's Musings: (archimago.blogspot.com) A 'more objective'
audiophile blog.
------------------------------------------------------------------------
Archimago's Profile: http://forums.slimdevices.com/member.php?userid=2207
View this thread: http://forums.slimdevices.com/showthread.php?t=101766
Wombat
2014-07-12 15:50:24 UTC
Permalink
Even if the numbers say that the ones that were right could be right by
chance it could be interesting to try one more. There is the chance one
of the components in the listeners playback chain adds own noise due to
bad implemented volume change or alike. For these it will be nice to
test a noise shaped dithered testfile. It can have a full bit of dither
depth then.
I still wonder how many cheated or were influenced by looking with an
editor prior to testing.



Transporter (modded) -> RG142 -> Avantgarde Acoustic based 500VA
monoblocks -> Sommer SPK240 -> self-made speakers
------------------------------------------------------------------------
Wombat's Profile: http://forums.slimdevices.com/member.php?userid=4113
View this thread: http://forums.slimdevices.com/showthread.php?t=101766
Archimago
2014-07-13 19:25:45 UTC
Permalink
Post by Wombat
Even if the numbers say that the ones that were right could be right by
chance it could be interesting to try one more. There is the chance one
of the components in the listeners playback chain adds own noise due to
bad implemented volume change or alike. For these it will be nice to
test a noise shaped dithered testfile. It can have a full bit of dither
depth then.
I still wonder how many cheated or were influenced by looking with an
editor prior to testing.
Indeed, lots of possibilities could not have been controlled for. In any
case, despite all that, the results are quite clear. It's HDTracks,
Pono, etc.'s turn to give some evidence to justify their position that
24-bit hi-res in whatever sample rate has any value even within the
audiophile crowd.

As for people cheating, notice the 'engineer' subgroup scored better
slightly. There's of course no way to know but certainly that would be
the demographic to look for such a thing... Even there, the slightly
higher accuracy rate wasn't impressive which suggests the blinding
procedure did the job :-). I think there is evidence elsewhere in MP3
tests that musicians generally don't do as well in listening tests... I
personally would not trust rock musicians' hearing!



Archimago's Musings: (archimago.blogspot.com) A 'more objective'
audiophile blog.
------------------------------------------------------------------------
Archimago's Profile: http://forums.slimdevices.com/member.php?userid=2207
View this thread: http://forums.slimdevices.com/showthread.php?t=101766
Julf
2014-07-13 19:55:33 UTC
Permalink
It's HDTracks, Pono, etc.'s turn to give some evidence to justify their
position that 24-bit hi-res in whatever sample rate has any value even
within the audiophile crowd.
Hear, hear!



"To try to judge the real from the false will always be hard. In this
fast-growing art of 'high fidelity' the quackery will bear a solid gilt
edge that will fool many people" - Paul W Klipsch, 1953
------------------------------------------------------------------------
Julf's Profile: http://forums.slimdevices.com/member.php?userid=42050
View this thread: http://forums.slimdevices.com/showthread.php?t=101766
stunts
2014-07-14 19:08:19 UTC
Permalink
Congratulations on your awesome survey, Archimago. Great job!

Is there any way to look up my own survey answers? I forgot to write
them down (stupid :rolleyes: )
Hope there is a possibility! Thanks! :)


------------------------------------------------------------------------
stunts's Profile: http://forums.slimdevices.com/member.php?userid=63102
View this thread: http://forums.slimdevices.com/showthread.php?t=101766
Archimago
2014-07-15 00:51:48 UTC
Permalink
Post by stunts
Congratulations on your awesome survey, Archimago. Great job!
Is there any way to look up my own survey answers? I forgot to write
them down (stupid :rolleyes: )
Hope there is a possibility! Thanks! :)
Hello. Yeah, I can look up your response for you if you can give me some
details... Perhaps you can PM me and let me know what equipment you
entered in the survey so I can reference the entry.



Archimago's Musings: (archimago.blogspot.com) A 'more objective'
audiophile blog.
------------------------------------------------------------------------
Archimago's Profile: http://forums.slimdevices.com/member.php?userid=2207
View this thread: http://forums.slimdevices.com/showthread.php?t=101766
pablolie
2014-07-23 20:20:55 UTC
Permalink
I didn't participate in the survey, but downloaded and listened to the
samples. I was not able to tell the difference either through my pretty
revealing bookshelf setup or my Grado RS1 headphones. The external DAC
is a Benchmark HGC2 that doubles as headphone amp. I could not tell an
ounce of a difference.

Now I am sure some critics will resort to the "I need a great recording
I have more emotional engagement and I am more familiar with". I have
done that repeatedly. When some of my favorite recordings, which I had
ripped from CD at the usual 16/44 became available sometimes as high as
192/24 I got them. Sometimes I have liked them better because -I assume-
they were somewhat remastered etc; but as a rule I find it very hard and
mostly impossible to tell a difference. Certainly the difference is not
worth 15$ an album for my 4000 album collection :-D

In audio we often run into diminishing returns. Most of the time the
gatekeeper is not the sampling rate or the number of bits per sample -
it is the recording studio. I kinda laugh when they put out some old
Motown album as 192/24, because it probably warrants 192k MP3 at most
from a recording quality point of view (and I love Motown music).

I personally think that 20bits and 44.1kHz is something that gives me
the *psychological* assurance I am surely can't be possibly missing out
on anything. Just like plopping $500 on RCA connectors. In our hobby it
is natural to invite in some borderline irrationality. It is all good.



...pablo
Server: Virtual Machine running Ubuntu 12.04 + LMS 7.7.3 on VMware
Player
System: SB Touch --optical->- Benchmark DAC2HGC --AnalysisPlus Oval
Copper XLR->- Creek Destiny Power Amp --AnalysisPlus Black Mesh Oval->-
KEF LS50
Other Rooms: 2x SB Boom; 1x SB Radio; 1x SB Classic-> AudioEngine5
------------------------------------------------------------------------
pablolie's Profile: http://forums.slimdevices.com/member.php?userid=3816
View this thread: http://forums.slimdevices.com/showthread.php?t=101766
Archimago
2014-07-25 02:22:20 UTC
Permalink
Post by pablolie
I didn't participate in the survey, but downloaded and listened to the
samples. I was not able to tell the difference either through my pretty
revealing bookshelf setup or my Grado RS1 headphones. The external DAC
is a Benchmark HGC2 that doubles as headphone amp. I could not tell an
ounce of a difference.
Now I am sure some critics will resort to the "I need a great recording
I have more emotional engagement and I am more familiar with". I have
done that repeatedly. When some of my favorite recordings, which I had
ripped from CD at the usual 16/44 became available sometimes as high as
192/24 I got them. Sometimes I have liked them better because -I assume-
they were somewhat remastered etc; but as a rule I find it very hard and
mostly impossible to tell a difference. Certainly the difference is not
worth 15$ an album for my 4000 album collection :-D
In audio we often run into diminishing returns. Most of the time the
gatekeeper is not the sampling rate or the number of bits per sample -
it is the recording studio. I kinda laugh when they put out some old
Motown album as 192/24, because it probably warrants 192k MP3 at most
from a recording quality point of view (and I love Motown music).
I personally think that 20bits and 44.1kHz is something that gives me
the *psychological* assurance I am surely can't be possibly missing out
on anything. Just like plopping $500 on RCA connectors. In our hobby it
is natural to invite in some borderline irrationality. It is all good.
Thanks for the comment and sharing the personal experience Pablo.

I believe the fact that 16/44 CD-quality audio has survived 30+ years
despite various attempts at higher resolution - HDCD, SACD, DVD-A -
having all failed to make much difference, is evidence of that point of
"diminishing returns". The marketplace IMO has already spoken to there
not being a "need" for a better consumer audio format (at least in terms
of bit depth and samplerate). Other than the small number of audiophiles
and evangelists, I have never heard anyone really complain (as compared
to say the complaints of poor video quality projecting a DVD on to a 65"
screen then seeing the Blu-ray). It's clearly not as the proponents of
high-res digital audio claim (like those silly Pono testimonial
videos).

Personally, I don't think the "emotional engagement" argument makes any
sense either. Personally, the more emotionally engaged with the music I
become, the more I enjoy and like to listen -irrespective -of the
quality. Those engaging songs are indeed the personal "soundtrack" to my
life! When I listen to them, my mind is more focused on the feelings of
when I first heard the piece, or the thoughts they evoke rather than
focus on the sound quality. I'm even tempted to tap the rhythm and sing
along which is "distortion" of the sound in the room :-).

I would certainly like to see some evidence that higher quality audio
makes any difference through a "subliminal" effect out of reach of
conscious awareness which seems to be what the emotional engagement
argument seems to be about!



Archimago's Musings: (archimago.blogspot.com) A 'more objective'
audiophile blog.
------------------------------------------------------------------------
Archimago's Profile: http://forums.slimdevices.com/member.php?userid=2207
View this thread: http://forums.slimdevices.com/showthread.php?t=101766
probedb
2014-07-25 12:45:46 UTC
Permalink
Post by Archimago
Personally, I don't think the "emotional engagement" argument makes any
sense either. Personally, the more emotionally engaged with the music I
become, the more I enjoy and like to listen -irrespective -of the
quality.
Spot on :) I always feel that people that claim they hear differences
are not listening to the music at all.



'last.fm' (http://www.last.fm/user/probedb)
------------------------------------------------------------------------
probedb's Profile: http://forums.slimdevices.com/member.php?userid=7825
View this thread: http://forums.slimdevices.com/showthread.php?t=101766
garym
2014-07-28 20:31:50 UTC
Permalink
This might have been posted already, but ran across it today and thought
it fit here regarding 16/44.1 vs hi-res.

http://www.aes.org/e-lib/browse.cfm?elib=14195



*Location 1:* VortexBox 4TB (2.3) > LMS 7.8 > Transporter, Touch, Boom,
Radio w/Battery (all ethernet except Radio)
*Location 2:* VBA 3TB (2.3) > LMS 7.8 > Touch > Benchmark DAC I, Boom,
Radio w/Battery (all ethernet except Radio)
*Office:* Win7(64) > LMS 7.8 > Squeezelite
*Spares:* VBA 4TB, SB3, Touch (3), Radio (3), CONTROLLER
*Controllers:* iPhone4S & iPad2 (iPeng7 & Squeezepad), CONTROLLER, or
SqueezePlay 7.8 on Win7(64) laptop
Ripping (FLAC) - dbpoweramp, Tagging - mp3tag, Streaming - Spotify
------------------------------------------------------------------------
garym's Profile: http://forums.slimdevices.com/member.php?userid=17325
View this thread: http://forums.slimdevices.com/showthread.php?t=101766
Wombat
2014-07-29 00:09:06 UTC
Permalink
Just realized that this one is not the one that was discussed lately at
hydrogen but as i started to type i have to ask if this paper is freely
available somewhere?

btw. these tests will never proove anything to the ones that made up
their mind. If they didn't hear the difference in the test they
obviously used the wrong SATA cable...



Transporter (modded) -> RG142 -> Avantgarde Acoustic based 500VA
monoblocks -> Sommer SPK240 -> self-made speakers
------------------------------------------------------------------------
Wombat's Profile: http://forums.slimdevices.com/member.php?userid=4113
View this thread: http://forums.slimdevices.com/showthread.php?t=101766
garym
2014-07-29 00:11:36 UTC
Permalink
Post by Wombat
Just realized that this one is not the one that was discussed lately at
hydrogen but as i started to type i have to ask if this paper is freely
available somewhere?
btw. these tests will never proove anything to the ones that made up
their mind. If they didn't hear the difference in the test they
obviously used the wrong SATA cable...
not sure if it is available. I don't have access. And yes, the
audiophools will claim bad test, bad cable, equipment that is not
revealing, etc. etc. etc. It's a religion and facts and science surely
can't explain things.... oh well....



*Location 1:* VortexBox 4TB (2.3) > LMS 7.8 > Transporter, Touch, Boom,
Radio w/Battery (all ethernet except Radio)
*Location 2:* VBA 3TB (2.3) > LMS 7.8 > Touch > Benchmark DAC I, Boom,
Radio w/Battery (all ethernet except Radio)
*Office:* Win7(64) > LMS 7.8 > Squeezelite
*Spares:* VBA 4TB, SB3, Touch (3), Radio (3), CONTROLLER
*Controllers:* iPhone4S & iPad2 (iPeng7 & Squeezepad), CONTROLLER, or
SqueezePlay 7.8 on Win7(64) laptop
Ripping (FLAC) - dbpoweramp, Tagging - mp3tag, Streaming - Spotify
------------------------------------------------------------------------
garym's Profile: http://forums.slimdevices.com/member.php?userid=17325
View this thread: http://forums.slimdevices.com/showthread.php?t=101766
Archimago
2014-08-03 02:10:14 UTC
Permalink
Post by Wombat
Just realized that this one is not the one that was discussed lately at
hydrogen but as i started to type i have to ask if this paper is freely
available somewhere?
btw. these tests will never proove anything to the ones that made up
their mind. If they didn't hear the difference in the test they
obviously used the wrong SATA cable...
I believe this is the AES paper:
http://www.aes.org/e-lib/browse.cfm?elib=15398

Here's the Hydrogen Audio thread:
http://www.hydrogenaud.io/forums/index.php?showtopic=82264

Look at krabapple's comment. Looks like he "took one for the team" and
got a copy of the paper. Curious as to what headphone / speaker was used
to evaluate.

Anyhow, only 3/16 test subjects were able to achieve significance in the
test and they "selected the wrong answer"... Does this mean they
consistently selected the 44kHz sample thinking it's 88kHz? Who knows.

I'd personally love to have a read of the paper myself but I'd rather
spend the $20 or so on some music... :D

Happy weekend everyone!



Archimago's Musings: (archimago.blogspot.com) A 'more objective'
audiophile blog.
------------------------------------------------------------------------
Archimago's Profile: http://forums.slimdevices.com/member.php?userid=2207
View this thread: http://forums.slimdevices.com/showthread.php?t=101766
Wombat
2014-08-03 13:39:13 UTC
Permalink
Post by Archimago
http://www.aes.org/e-lib/browse.cfm?elib=15398
I saw this also somewhere quoted as prove for 88.2 superiority but it
seems very specific to some harware/software faults.
To this the best summary i found is written by Werner at pinkfishmedia
http://www.pinkfishmedia.net/forum/showpost.php?p=2307803&postcount=9



Transporter (modded) -> RG142 -> Avantgarde Acoustic based 500VA
monoblocks -> Sommer SPK240 -> self-made speakers
------------------------------------------------------------------------
Wombat's Profile: http://forums.slimdevices.com/member.php?userid=4113
View this thread: http://forums.slimdevices.com/showthread.php?t=101766
Archimago
2014-08-03 14:26:00 UTC
Permalink
Post by Wombat
I saw this also somewhere quoted as prove for 88.2 superiority but it
seems very specific to some harware/software faults.
To this the best summary i found is written by Werner at pinkfishmedia
http://www.pinkfishmedia.net/forum/showpost.php?p=2307803&postcount=9
Nice summary! Thanks.



Archimago's Musings: (archimago.blogspot.com) A 'more objective'
audiophile blog.
------------------------------------------------------------------------
Archimago's Profile: http://forums.slimdevices.com/member.php?userid=2207
View this thread: http://forums.slimdevices.com/showthread.php?t=101766
cliveb
2014-07-01 09:09:52 UTC
Permalink
Post by P Nelson
In any guess, even with an ABx layered on top of which is the 24 bit, a
few could still guess and get it right. Those with golden ears will
ignore the evidence.
Probability theory tells us that in a meaningfully large sample size, we
should expect a few people to get it completely right purely by chance.

The problem is that the hi-res believers will grasp the fact that
someone got it right as evidence to support their claims. But it does
nothing of the sort. The people who got it right must now repeat the
test, and get it right again before we can conclude that they do
genuinely hear a difference. Otherwise they were just an (expected)
outlier in the stats.



Transporter -> ATC SCM100A
------------------------------------------------------------------------
cliveb's Profile: http://forums.slimdevices.com/member.php?userid=348
View this thread: http://forums.slimdevices.com/showthread.php?t=101766
lrossouw
2014-07-01 12:06:45 UTC
Permalink
Great stuff. I agree with the conclusions that a sample of audiophile
enthusiasts can't reliably say which is better.

I would believe a stronger conclusion is possible, namely that such a
group of people can't here any difference (better or worse).

If we had a 100 takers of the study using the design as is (as I
understand it). The overall result of the study could be 50:50 A:B but
we are not sure whether it is because they can't agree which is better
or whether they can't hear any difference at all. If 50 of people can't
hear a difference they'd be 25:25 A:B. If the other 50 can here a
difference and half of them believe A is better and the other half
believe B is better they'd be 25:25 A:B. I think we need to at some
point split out the two effects to understand it.
From a practical stand point of course if you can't tell which is better
you are already not going to spend money on recordings/equipment. But
of course if you cannot hear a difference that would be a little
stronger argument?



Louis
'Last.fm' (http://www.last.fm/user/lrossouw)
------------------------------------------------------------------------
lrossouw's Profile: http://forums.slimdevices.com/member.php?userid=3416
View this thread: http://forums.slimdevices.com/showthread.php?t=101766
marflao
2014-08-05 17:35:40 UTC
Permalink
I don't know if this has already been mentioned somewhere but I think it
"fits" to this thread.
At "Audiostream" a new 16/44 vs 24/96 test is mentioned.
Here is the link to the article:
http://www.audiostream.com/content/avsaix-high-resolution-audio-test

I haven't done the test yet and won't do it because Archimago's test
already showed me that I won't hear a difference.

Funny extract from the Audiostream article:
" Interestingly enough, at least one person so far has taken these
files, loaded them up into the Foobar2000 ABX comparator and picked the
correct files every time. But this really shouldn't come as a big
surprise, should it?"




------------------------------------------------------------------------
marflao's Profile: http://forums.slimdevices.com/member.php?userid=57334
View this thread: http://forums.slimdevices.com/showthread.php?t=101766
Wombat
2014-08-05 17:58:30 UTC
Permalink
There are several foobar abx results of one person that hears
differences no one heard. His business is audio, he is a former
Microsoft CEO and was nerved a while already by members in forums like
whatsbest and avs. He knkws how to do business and mind building. My
personal meaning to this is to don't believe to much of any of these abx
results. Just download 2 files to test, make one of it silence and claim
the best abx result ever.
There is also a thread at hydrogen.
http://www.hydrogenaud.io/forums/index.php?showtopic=106442



Transporter (modded) -> RG142 -> Avantgarde Acoustic based 500VA
monoblocks -> Sommer SPK240 -> self-made speakers
------------------------------------------------------------------------
Wombat's Profile: http://forums.slimdevices.com/member.php?userid=4113
View this thread: http://forums.slimdevices.com/showthread.php?t=101766
Archimago
2014-08-07 15:27:19 UTC
Permalink
Post by Wombat
There are several foobar abx results of one person that hears
differences no one heard. His business is audio, he is a former
Microsoft CEO and was nerved a while already by members in forums like
whatsbest and avs for objective tests. Now he creates facts the business
likes and they spread well. He knows how to do business and mind
building. My personal meaning to this is to don't believe to much of any
of these abx results. Just download 2 files to test, make one of it
silence and claim the best abx result ever.
There is also a thread at hydrogen.
http://www.hydrogenaud.io/forums/index.php?showtopic=106442
I was looking at his post here:
http://www.whatsbestforum.com/showthread.php?15255-Conclusive-quot-Proof-quot-that-higher-resolution-audio-sounds-different

He did all his testing with the internal sound card from an HP Zbook 14
laptop + Etymotic ER-4p (the consumer version made for low power
portables with lower impedance of the ER-4 series). I'll need to see if
anyone has the Zbook to measure and see what kind of audio that thing is
capable of! But I've not met a good Windows Ultrabook with great sound
yet :-).

I also have the Etymotic ER-4b so know what these headphones sound like
- good... Quite limited ultrasonic response I believe.



Archimago's Musings: (archimago.blogspot.com) A 'more objective'
audiophile blog.
------------------------------------------------------------------------
Archimago's Profile: http://forums.slimdevices.com/member.php?userid=2207
View this thread: http://forums.slimdevices.com/showthread.php?t=101766
Wombat
2014-08-07 16:36:42 UTC
Permalink
You'll like that one:
http://www.avsforum.com/forum/91-audio-theory-setup-chat/1532092-debate-thread-scott-s-hi-res-audio-test-98.html#post26245673
Since he surely used the same hardware it must be very simple to hear
bit depth. If you can't the files are not of enough bjt information :)
Means that all must hear differences, if not you are deaf. This is
intelligent marketing to me. It will for sure leave some people feeling
proved right.



Transporter (modded) -> RG142 -> Avantgarde Acoustic based 500VA
monoblocks -> Sommer SPK240 -> self-made speakers
------------------------------------------------------------------------
Wombat's Profile: http://forums.slimdevices.com/member.php?userid=4113
View this thread: http://forums.slimdevices.com/showthread.php?t=101766
Archimago
2014-08-08 13:54:35 UTC
Permalink
Post by Wombat
http://www.avsforum.com/forum/91-audio-theory-setup-chat/1532092-debate-thread-scott-s-hi-res-audio-test-98.html#post26245673
Since he surely used the same hardware it must be very simple to hear
bit depth. If you can't the files are not of enough bit information :)
Means that all must hear differences, if not you are deaf. This is
intelligent marketing to me. It will for sure leave some people feeling
proved right.
Wow. That guy is something! He "da man"...

Not saying the guy can't possibly hear a difference but as you've noted
previously, posting up ABX logs isn't definitive proof of anything since
it's all so easy to fake. What would have been impressive is if he did
these ABX tests before the fact during the 2 months the test was up, AND
could have completed my survey with a comment about his ABX result with
consistently "correct" results like always picking the 24-bit or 16-bit
sample indicating *strong confidence*.

I really need to seriously look around for one of these HP Zbook 14's to
see if I can get some measurements on the "ninja" sound system/headphone
amp on that puppy :confused:.



Archimago's Musings: (archimago.blogspot.com) A 'more objective'
audiophile blog.
------------------------------------------------------------------------
Archimago's Profile: http://forums.slimdevices.com/member.php?userid=2207
View this thread: http://forums.slimdevices.com/showthread.php?t=101766
bartman
2014-09-13 22:39:36 UTC
Permalink
Very interesting study

I think the reason SACD and other hi resolution formats did not succeed
- or do as well as they could of -- is the simple fact that too many
recordings that were not well mastered - were released in this format
and they really should not have been. The term "polished turd" comes to
mind - all in the interest of selling us another copy of a favorite
recording we already own.

I understand the business side of this ---- but if there was a clear
advantage that we knew for a fact we could hear -- then these premium
formats would have justified their premium price tags. We all know the
audible differences experienced moving from Cassette or 8 track to CD --
SD to SACD -- not so much ----- because we are now dealing more closely
with the source material.

I've heard hi res digital recordings that sound amazing (24/96 flac)
----- but I've also heard the exact same recordings at 320k mp3's --
that also sound amazing -- I have not a/b'd them -- but my 60 year old
ears likely couldn't tell the difference even if I could.

If the industry would limit the release of higher resolution product
(formats) -- to recordings that were originally well recorded - we would
all have an easier time understanding the benefits (if there truly are
any that are audible).

I still get digital material in the highest / best format I can -- just
because I'm hoping one day I might get that magic component in my set up
that clearly reveals the difference ( or I get whacked on the side of
the head and my hearing improves to a level that I can hear a
difference)

Bart


------------------------------------------------------------------------
bartman's Profile: http://forums.slimdevices.com/member.php?userid=63250
View this thread: http://forums.slimdevices.com/showthread.php?t=101766
Archimago
2014-09-14 05:28:57 UTC
Permalink
Nice one Bart. I posted a 'list of upsampled SACDs'
(http://archimago.blogspot.ca/2013/07/list-suspected-44-or-48khz-pcm.html)
a number of moons ago as well. I'm sure I missed many others!


-"just because I'm hoping one day I might get that magic component in my
set up that clearly reveals the difference"-

Perhaps that's the issue with audiophilia in a nutshell. That insatiable
splinter, wish, yearning, and -faith- in the idea that some "magic
component" exists. Perhaps that next fancy component, the newly
introduced cable made with unobtanium wrapped in patent pending geometry
lined with quantum dielectric, or how about that miraculous black box
that imparts anthropomorphic "tranquility".

Perhaps it just is what it is... Most albums are recorded suboptimally.
There just never was any "holographic" realism and detail to extract.
Get accurate, well engineered gear that reproduces it within the
empirical limits of human hearing. Optimize the listening room.
Essentially that is all...



Archimago's Musings: (archimago.blogspot.com) A 'more objective'
audiophile blog.
------------------------------------------------------------------------
Archimago's Profile: http://forums.slimdevices.com/member.php?userid=2207
View this thread: http://forums.slimdevices.com/showthread.php?t=101766
Archimago
2014-08-07 01:58:23 UTC
Permalink
Post by marflao
I don't know if this has already been mentioned somewhere but I think it
"fits" to this thread.
At "Audiostream" a new 16/44 vs 24/96 test is mentioned.
http://www.audiostream.com/content/avsaix-high-resolution-audio-test
I haven't done the test yet and won't do it because Archimago's test
already showed me that I won't hear a difference.
" Interestingly enough, at least one person so far has taken these
files, loaded them up into the Foobar2000 ABX comparator and picked the
correct files every time. But this really shouldn't come as a big
surprise, should it?"
I just did the test this afternoon and sent off my results. I used my
ASUS Xonar Essence One --> Sennheiser HD800.

Afterwards I had a look and see I got 2/3 - not bad... Confidence low
though.

*This test is exactly the kind of procedure I wanted to avoid with the
recent 24-bit vs. 16-bit survey.* IMO there's just not enough controls
in place to develop confidence in the results. Heck, it took me all of 2
minutes if not less to load up the file to have a look at the spectra
and tell exactly what's what. I wrote Scott W briefly about my
concerns.

The issue is that no matter how this turns out, it doesn't likely help
the community. If the results show that there's no statistical
differences, then we're in exactly the same place as today - small tests
suggesting that maybe some people can tell a difference, and larger
tests not showing a statistical advantage to high-res. However, if it
turns out to show 24/96 sounds "better" (especially if there's a huge
number of + results), then we're just going to see more comments like
the one from Mike L. above but anyone who spends 5 minutes to review the
procedure will clearly understand the methodological inadequacy. I try
not to be paranoid, but at the eve of hype like the pending release of
Pono and the audiophile press going ga-ga at Neil Young as some kind of
audio quality cruisader, let's not be naive about how "industry" would
want tests like this to turn out...

I've watched a number of Scott W's podcasts and he seems like a sensible
guy. Hopefully whatever the final outcome, it will be presented in a
realistic context.



Archimago's Musings: (archimago.blogspot.com) A 'more objective'
audiophile blog.
------------------------------------------------------------------------
Archimago's Profile: http://forums.slimdevices.com/member.php?userid=2207
View this thread: http://forums.slimdevices.com/showthread.php?t=101766
Continue reading on narkive:
Loading...