I second the Notes. I don't know why the S series gets the rep for audio, the Notes all sounded more neutral to me and cleaner. My SGS was too warm, the SGS3 (non-Wolfson, if that matters) was more neutral in the overall tone but the bass to lower midrange was distorting. It's not overexcursion with say the bass drum going "thum-thwack!" but the bass guitar can get boomy but doesn't sound deep.
Also, GSMArena measurements show the Note 3/4/5 comparable enough that for an audiophile you can choose it for its other features than sacrificing on some features and paying more for the LG G5 + B&O HiFi DAC module. I mean, native high res files are debatable in terms of benefits solely from high res encoding and playback vs redbook anyway. Even I only have FLAC on my microSD because I use it as a music server with a dock (and USB OTG); music that don't have much information in the lows (or bassy but aren't exactly
that critical, like party music and pop) are the ones I run from Spotify.
Note 3 (what I'm using now)
http://www.gsmarena.com/samsung_galaxy_note_3-review-996p8.php
LG G5 (includes B&O module)
http://www.gsmarena.com/lg_g5-review-1416p6.php
The Note5 is even better than the Note3 and
really puts into question whether you'd want to give B&O any of your money.