I'm a computer technician who has a virtually silent PC which I use as a transport, so I thought maybe I'd offer my humble oppinion.
As was said a long time ago in this thread, a CD is basically a series of 1s and 0s on a disc. A computer using EAC can rip those 1s and 0s perfectly, with as much error correction as needed. A CD player gets once chance to get it right. There is limited error correction, but it's not perfect.
So, once you have your 1s and 0s, you need to transport them. You need an accurate clock, with a good PSU to feed it. Computer PSUs can actually be pretty good. Consider the speeds at which computer components operate at, compared to the speeds required for audio. On a good sound card, jitter should really be zero. Also, don't forget there is USB, which does not use a clock as such. It sends a chunk of data and error corrects it if necessary, where it is then clocked by the receiver. If the receiver is also the DAC, then you end up with only one clock instead of the usual two (transport+DAC), thus reducing the chances of jitter even more.
As for PC noise levels, these days I don't think they are a major problem. My PC is water cooled, but now you can easily get close to absolute silence on air cooling alone. AMD's Cool 'n' Quiet is a useful technology here. See http://www.silentpcreview.com/
for more info, but basically with a 2.5" laptop HDD, good case and some work you can build a PC that is silent at 1m. If that isn't enough, then get a USB extenion cable, a longer coax lead or a Squeezebox.
One caviat with the PC is that you need to make sure you are getting the best sound from it. Most people here will already know about kernel streaming/ASIO, but it's pretty essential. Also, if your sound card does have optical out, make sure it's bit perfect. I don't think the Audigy is, for example, so it might not stand up to a £2000 CD player.
As for blue screens in Windows, it shouldn't happen. If it does, it's probably a dodgy driver or broken hardware (RAM is a good place to start). My computer never, ever blue screens. Well, it did once a few days after I built it, but that was bad RAM. A lot of other computer issues are down to spyware. In my job, it's unusual to see a PC that doesn't have any spyware on it - it really is that bad. My tip is use Firefox instead of IE.
At the end of the day, £500 spend on a PC will give you a really good spec system, virtually silent and with the potential for at least as good quality optical out as a £2000 CD player. Plus, it will store thousands of tracks ready for instant access.