I would say it's pretty much all about stress, emotional stress effects hearing, you may feel calm but your stress level can still be higher than normal.   I have in my stereo setup (not hedphones) also experienced a less detailed and a "nervous" soundstage gets better at late evening or...