No, I highly suspect it's the sensitivity of your cans since as you said the onboard was fine with less sensitive iems.
The output of your phone is typically not going to be much better, if not worse than onboard audio, but it should have less output power which may be why it's fine. Not making any promise, though - just saying, super sensitive gear around 110db/mw++ tends to do weird stuff.