From memory the resistor box was for convenience (XLR plug on the front) and safety (making sure there is always some load across the speaker terminals). So if you are happy to modify a cable (or possibly Joe could make a custom one?) and leave it always connected to the speaker taps, then you should be fine.
Again, from memory someone unplugged their Abyss with the amp switched OFF and still blew a fuse, so be extra careful.
Also, I think I remembered someone saying the resistor box degrades the sound. Not sure how correct that is, and if so, how significant the effect is.
Probably not the right person to answer this question though as I just have a headphone amp... They really aren't that power hungry - especially the phi.
If you already have a speaker amp you like though, it makes a lot of sense to go that route.
I think we can all forget the talk about power figuers of an amp, it does not say anything on how it deliver its power or how it presenting the music.
I have tested nearly 25 amps during the last 2-3 years, and if the amp just can pull out 1,5-2 watts @ 46 Ohm you are perfectly fine with the power. Then the A current is another figure that not so many take in consideration of an amp.
What you cant read out from the specs is how the amp sound; if a gitarr sound like a violin or Frank Sinatra sound more as a piipy teenager, nyances sounds flat, and does not have the pre visceral sound, where the amp builds up a tension before the tone hits you etc etc..
What we do know is that a bigger amp often does sound more effortless, and can project the sound with more layers , finesse and greater control than a smaller amp with less power reserve, and more compromises dun on its design. . Not a rule, more a pointer.
The SimAudio Moon i-7 , new 600i V2 or the 700i is just 3 speaker amps that i highly recomend, one great thing is its 530 steped bit perfect optical e.volume, that makes it more gentle for headphones than most other amps on the market does.
Just a pointer in the right direction and one stone narrower to make the most out of your high end headphones.
You can also drive them with small DAP / AQ Dragonfly driven by your iphone, take a listen and decide on what level you want your sound.
It is a matter of budjet to spend and taste.