I read in another post somewhere here on head-fi that Jude's review has been delayed by an illness in the family.
Yep, it's my one and only headphone DAC and amplifier. I personally don't want any coloration in my headphone amp (or DAC for that matter) and find the one in the DA11, to my ears, to be neutral with plenty of power and detail. IMHO, you hear what's on the recording with the DA11, good or bad.
One of the primary reasons I even considered the DA11 is it's remote control support. I frequently adjust the volume while listening with the remote so I rarely even interact with the toggle switch.
Ouch, your situation just mirrors mine...
I use the DA11 exclusively now as DAC and headphone amp combo. I love the remote feature and never use the toggle switch neither. I also have the PIC always defeated (zero).
I think the headphone amp of the DA11 is trully shining with low impedance phones. It might be just a bit short of voltage swing (17 Volts peak to peak) to get the very best of high impedance phone (my K501 for example were driven with more authority when balanced).
My headphone of choice today are the Beyer DT48E (25 ohms) and the association with the DA11 is by far the best I have heard to date (but please keep in mind I have also little experience...)