Reading that I have to say I'm quite happy with CoreAudio...
Btw.: the U05 works with an iDevice connected through the Camera Connection Kit. Very welcome indeed.
I know you are against putting anything in front of the U05...but if you want to make good use of the CCK you should check out USB Regen thread http://www.head-fi.org/t/762967/uptone-audio-usb-regen/550_50#post_12079318 and the acrual product http://uptoneaudio.com/products/usb-regen. There is plenty of happy CCK/USB Regen users around. It will still be Core Audio!