I found my Hugo needed a good 100+ hours on it before it started to lose some of that harshness as you put it. Though it was excellent to start with! It now has 300+ hours and it sounds creamy smooth. I am using Audirvana + but will try Amarra today.
I prefer the sound without Audirvana up sampling. I found it lost a little bit of PRAT.