as a speaker amp, you want to turn up the gain to around 20x or so. for most speakers lower is OK, but it should be higher than 8x. it's easiest to get higher gain by using balanced, since the stock build for the balanced is already 16x gain. for 2/3-channel higher gain would mean tighter transistor matching. I would also turn up the Class A bias a little, and use larger heatsinks. I don't hear any difference with Class AB and Class A on this amp, but if you're using very efficient speakers it's not too hard to acheive pure Class A.
also beef up the heatsinks on the S22. the math says that one is enough for 2-channel Beta22 speaker amp, and two is enough for 4-channel Beta22 speaker amp. But using more S22 spreads the load and it doesn't have to handle as much heat. You don't really need a big transformer since even the recommended Beta22 build is all about overkill and going over that is overkill of the overkill. Transformers are heavy.
the 2-channel and 3-channel Beta22 has around 20W of continuous output and the 4-channel version 3 to 4x that. but don't be too obsessed with power output, 20W is pretty loud already. most speakers that advertise 300W of output will actually melt if you give it a 10W sine wave (the tweeters will melt). Besides that, for music the peak output is more important, and the amp can deliver very high peak power.