Your point is valid, as it's the "core" of hi-end audio. It's also a reason why hi-end is dying out -- high-priced gear, lack of appreciation for great sound among the masses (even the younger gen prefer their iDevice earbuds). But it has nothing to do with the operational principle of neutrality and accuracy in audio gear.
From the standpoint of an audio engineer designing amps, personal prefs and listening differences are not relevant. S/he aims to design amps/speakers that are dead neutral/accurate.
Neutrality/accuracy is objectively measurable -- output/input ratio of an amp/speaker, at any/all sound frequencies. From the engineer's standpoint, it is not open for individual interpretation. I'm not talking about the recording quality or artists' preferences with the way the music is recorded. Only the final product (CD, LP, tape recording) played back through an amp. The output of the amp is measurable and comparable to its input signal.
If I have a recording that is warm (tilted up in the mid-bass/trble roll off) I have a choice -- I can get a transducer that plays it accurately so I hear it as it is, warm. OR I can get one that plays it even warmer or cooler (brighter). Not neutral/accurate. It's a question of preference as you say. But that choice does not, and should not, concern the designers if their goal is accuracy.
Personally, I like accuracy. If it's a warm rec, I want to hear it as such, and also not soften any brighter recs I may have. I find that accurate gear serves me well and stands the test of time down the road. I don't want my violins sounding like cellos.
cheers enjoy your music -- whatever it sounds like.