Precisely. Making a hybrid/ss switchable would be quite a challenge, as far as I can tell: even circuits which allow for certain stages to be either tube or ss still have so many differences in other parts that a simple "switch" would be pretty much impossible. I suppose it could be done with enough design time and relays, but that would be an incredible project that in the end would just be a compromise - the kind of person who would build such a device would do so for the challenge alone, I think.
By putting in the tube buffer in the beginning, you can "flavor" the sound of a ss amp at your leisure :) It will be much simpler to build, and more versatile.