I think a lot of people don't realize how much the amplification matters here. I was using the Chord Hugo 2, which was supposed to be TOTL, but now am listening with an old Schitt Magni instead of directly out of the headphone outlet of the CH2, and find the sound much better. I think the CH2 is an amazing DAC, but it's not a very good headphone amplifier unless your headphones are above 32Ohms, and otherwise relatively easy to drive.
This has been discussed to some length over on the Hugo 2 thread. There is nothing wrong with the Hugo 2 output stage it is plenty powerful for 99% of headphones, its just that you prefer the sound signature of your Schitt Magni.
No problem we are all different and like different things.