Like DAVE, the Hugo isn't a DAC with added headphone amp. The DAC is the headphone amp at the same time. And an excellent one at that. Extremely low output impedance, the same with harmonic distortion, and enough power to drive every dynamic headphone on the planet with ease, except for some demanding exotics.
On the other hand I agree that such add-ons in pure DAC concepts most likely won't do the quality of the high-caliber DAC justice, and be it a Nagra or Lampizator.
With Hugo and DAVE, there's no headphone-amp stage to be bypassed, so amplifying the output signal won't «improve» it. The Hugo sounds as it sounds (when heard through headphones). You seem to believe that «top tier amps» are exemplary when it comes to neutrality. I say the «improvement» they provide in the case of Hugo (if they do) is due to euphonic/synergetic coloration. I'm speaking of own experience and experiments to verify amplifier sound. Sure, expensive amps offer higher chance to at least sound more transparent than cheaper ones, but they're not necessarily less colored.
I really hope you won't add an amp to DAVE with dynamic headphones! (This although its output power isn't miles higher than Hugo's.) You'd sacrifice a lot of its merits. If you need a correction of sonic balance (which is always a possibility if not even a must), there are more plausible tools than amplifiers.
So have fun with your Lampizator or DAVE anyway!