It depends largely on the dynamic range of the songs you're playing through it.
Take, for example, a Jethro Tull song:
And next, a Kanye West song:
The Kanye West song is dynamically compressed so that it sounds loud on lesser systems that would otherwise run into clipping issues if they tried to play the high dynamic range song at a volume that matched the average level of the compressed song.
It could be that you're listening to lots of high dynamic range songs without much dynamic compression.
Another reason is maybe that your computer's volume level isn't maxed. I know that on Windows at least, Modi does not disallow volume control on the computer's internal volume. On OSX it does. So if you're not using OSX, then max your computer's volume.
Reductive EQ needs lots of headroom, so you'll always find yourself turning the volume pot position up on the amp. For instance, whenever I use a reductive EQ that gives me 6db of bass boost, I usually turn the Magni to around 11 o' clock.
If your computer's volume is maxed, you're not using any reductive EQ and the songs you're using don't have much dynamic range, then you're listening at very high levels and might be damaging your hearing.