Well, while I get to order the new caps and the new opamps, this is the plan:
1. This weekend try the batteries and see what it gets me. The cans were borrowed by a friend but the speakers is what I use the most for evaluating changes. From your impressions, it does seem that I won't find much to like. What the heck, it is an easy thing to try anyway. I'll report by the end of Sunday.
2. Probably by Sunday evening, switch to a shielded cable. I am not betting that this will affect the Musiland itself but rather the rest of the gear. I already know that removing the Musiland improves the sound on SACDs by virtue of not having its power cable active (I am forced to route it rather too close to signal cables).
Since I have to open the Musiland for #2, I'll take stock of the final parts to order and compare it to the picture you and others have so kindly shared. In addition, I will try to figure out what I would need to do for an external linear PS, and later check notes here.
In any event, I suspect that there is more to gained by fully isolating the USB hookup than by upgrading the existing board power supply. The problem "may" be that there are reports of incompatibilities when using some isolators. If costs keep piling up, at some point I may want to go for a better DAC and I have some Shiite in mind.