Indeed I do blame my PC, but I'm not going to go down the rabbit hole of other computers/OS's/USB fixing solutions any time soon, the DX80 is a great workaround for me.
I just wish that performance out of a regular windows PC was better. This isn't Schiit's fault at all. It's disappointing how crappy it sounds without having to do a bunch of extra stuff and using different software.
Lucky me that my PC is dead silent.