OK, I'm gonna dip my toe in this water..
I've been ripping vinyl for a while now, for a long time I was using a Turtle Beach Santa Cruz which has 18 bit ADC's and 20 bit DAC's.
When I look at the waveforms on the screen, the ticks, clicks and pops stand out vividly, particularly when I use spectral display mode.
The rise time of the tics and clicks is far shorter than any of the musical information I am recording and at 16 bits and 44.1 kHz I can visually confirm them as being recorded rather faithfully since I have used an HP digital storage oscilloscope to do the same thing and I don't see any difference in the waveforms.
As far as USB not transmitting data perfectly, it has to or USB hard drives and the like would be impossible to use. Digital data is either correct or it is not, there is no middle ground at all.
I've been using an external USB drive case with a laptop hard drive for almost ten years now and I don't recall ever once having an error in reading a file I had written to that drive. I use the drive to lug around data from place to place on a regular basis.
I've run a webcam at 30 fps 640 x 480 on a twenty five foot USB extension cable with no amp and not had any problems at all with it. And this was about seven years ago.
With sufficient buffering on the DAC side, I see no reason why a USB DAC would not be fidelity limited by the precision of the DAC and amp and the accuracy and stability of the clock driving the whole thing. The buffering of the USB data may cause a latency of a millisecond or two but we aren't speaking of studio type software where latency is a concern.
As an example here is the spectral and normal view of a large click during music.