Have you tried another pair of headphones or earphones to verify it’s not elsewhere in your audio chain?
You were right. Thank you! Plugged in a different set of headphones and still heard the same issue. Turns out the problem is with my amplifier. If I set the volume too high on high gain (I try to keep the Windows volume lower to prevent audio clipping), that's when the background static appears in quiet tracks/short sounds.