I've never had an E10K but I just checked its output specs and I do have a portable amp on hand that's in the same ballpark, along with my 6XX, so I tested it and it sounds fine.
Scaling up with the 6XX I think gives it more dynamics, more quantity and quality bass, and thicker mids, maybe a bit more treble extension though that can vary depending on amp, but all the ingredients that give the 6XX its signature appeal are present running out of anything I've ever heard it from, including 3.5mm jacks on a few phones.
A lot of times when we say things like "this more expensive amp made me feel like I'm hearing my 6XX for the first time" the implication is that it sounds bad on lower powered equipment, but in reality it just sounds great on that lower-powered gear and sounds greater on better gear.
Now granted I'm sure there are some really trashy setups that would make the 6XX sound bad, but I think at that point they'd just make everything sound bad to be honest.
If you have your source at 40% twice over and are at 30% with the X3 on the FiiO, I think you will certainly have enough headroom to run the 6XX competently and then it will also get a nice bump once you upgrade amps. But in the meantime, assuming you actually like the sound sig of the 6XX itself, I think you would be satisfied running it from the FiiO.