There are probably two separate things going on: grainyness and the AD1852's trademark sound.
Grainyness is usually caused by the analog output stage that follows the DAC itself. Obviously with a sound card there are necessary compromises in the analog stage, since there isn't space for a separate analog power supply, a proper grounding scheme, etc. One solution (if you're handy with a soldering iron) would be to bypass the RME's output stage with a pair of Edcor or Lundahl transformers. This would probably be a dramatic improvement, but for space reasons you'd have to mount the transformers in a box outside the computer.
The other thing you may be hearing is the AD1852 DAC chip's trademark sound: very detailed, huge dynamic range, but also very dry and somewhat cold. It also has a bit of an upper midrange stridency that I've never quite been able to get rid of, even with separate clean linear power supplies for the both the analog and digital sections. This, combined with a grainy output stage, can get kind of fatiguing, if you're looking for a warm, natural sound. I have had a lot of luck using output transformers with this particular DAC chip though.