It's definitely conceivable that you may have received a partially faulty unit or that it was damaged during shipping. The reasons that the others are offering are really plausible, but the Geek Out's topology utilizes a good deal of power regulation such that hiss, even if audible, should be like what you're describing.
Some of the Geek 1000 owners are reporting some hiss with IEMs, but that's the 1000. If anything, all of the Geek's shunt regulators being equal, the 450 should be better about the hiss and residual noise.
FAD's IEMs are all hiss monsters, but even so, I doubt you'd hear none from the HiFiMeDIY DAC and a ton from the Geek 450. It doesn't make sense.