I sure wouldn't connect a USB DAC to an external hub, that's for sure.......so if you are short on USB ports, I'd bet that you are subject to more problems with USB versus TOSLINK out of an AV-710.
If I am running Foobar and my 0404 USB on my desktop PC, then attempt to transfer files from my desktop HD to my USB HD, as often as not, I get clicks/pops/dropouts. Thus, it seems to me that overloading the USB bus to the point where it has a very negative impact is not too hard. Personally, I tend to have only the 0404 and mouse active as USB devices when listening--my printer is turned off and the scanner is on standby.
Someone else might be able to lead you to a good combination of drivers/settings on the AV-710 to ensure that you get the best end result. I didn't go into detail in my response in an earlier thread of yours, but I would get strange "zip-zip-zip" noises from running the TOSLINK out of my AV-710 into my 0404 USB. Never got those when running TOSLINK from various CD or DVD players into it, so something was odd about the AV-710 configuration. I spent a couple of hours trying various fixes, nothing worked, so I just went back to using the USB connection and all is well.