You sound like I was about 5 years ago. I had always been a big 2 channel stereo speaker system audiophile. I had some of the best... like Wilson Watt, Puppies and Whow driven by Audio Research amps and etc. But, we moved to Athens, GA out of a big house with dedicated listening room to an apartment to help raise our granddaughter... and things changed.
I have a modest system in conjunction with a 60" LCD... it consists of Epos speakers with a REL sub. driven by the Peachtree Audio Decco 65 and a Oppo 105 do everything player, and that does the trick watching TV and movies... and even some CD listening.
But, missing the high end, I started into headphones. I've gone thru a few of those and enjoyed trying different solid state and tube amps to drive them. But, being a tube guy, I came around to Little Dot amps and then I turned to Schiit... pardon the expression... to drive a really good high end headphone... the HE-500.
I have used the little Schiit Vali with the HE-500s and they make a very good partnership. It's amazing how that little amp can perform like that... and it's only $119. But, I purchased my 2nd Schiit Lyr recently, primarily if I want to go to the HE-6... I'm always tempted to try it. But, in the meantime, with the right tubes in my Lyr... like Bugle Boys or Voskhod Gray Shields, I am in audiophile heaven... very good sound that will make you forget you were ever in speakers. The HE-500s and Lyr combo... fed by an Oppo 105 that has an excellent DAC... and good cables is a great place to start or even end. The sound stage is wide and enveloping, and you will find that little nuances that could be lost in a speaker system because of room environment, you hear it all in a headphone system like this.
Believe me... once you really get into a good headphone system like this, you will sit for hours listening to good music. Hey, go pick up one of those used HE-500s for less than $500... and a used Lyr or a new Vali... and sit back and wait and see what finally comes out in the 560. Fang always improves every headphone he puts out months after the initial production has time to be critiqued.
Have fun and enjoy the headphile world.