You could do like AudioPhilleo and connect direct to back of your DAC with an adapter, but the HiFace was designed to plug into the back of the computer, using a USB cable changes the level of jitter the device and drivers is designed around IMO. With my modified hiface I found it sounded best when plugged directly into the computer. Might be different with the HiFace 2, ie XMOS and Thescyon drivers.
When I had heaps of things hanging off my computer I used to tie a little piece of string from one of the bolts to the appendage in question in order to relieve stress. Not pretty I know