I've ruined two sound cards over the years trying to swap the opamps (an Echo Mia, and Emu 1212m). I'm not bad with soldering or anything, and I used low temperature and took many precautions, it's just something about the PCBs used for those cards. The pads and traces pull off/out so easily. Sometimes when this happens you can fix it, sometimes you can't.
I'm just saying, be careful. It's risky, tricky work, and you may not like the replacement any better.
Swapping the output caps is not especially risky, and the results will be somewhat more predictable, if you're already familiar with the sound of various electrolytics. I know that in the Echo and Emu cards, the caps were necessary, because there was DC offset - so I would be surprised if they were not necessary on the 2496 as well.