I have noticed this on my Bifrost as well. It happens only very rarely, and a quick restart of the laptop fixes it up right quick.
I had this issue with my Modi. I would get lots of jitter and sometimes Windows would lose connection of the device. I found out, when I used my 3+ FT long USB cable, it causes this issue. I switched to the shorter USB cable that I bought from schiit and that solved the problem.