I don't think a PC set-up would be preferable, sonically, to a $2k-$3.5k used cd player. That would be one strong cd player. Audiogon and Audio Asylum forums have far more threads and digital front geek audiogeeks than here, so if you have not done so already, I'd do searches there as well.
Based on reading, and a discussions with friends, and research, I think there's a really long list of players that fit that price tag. Some have already been mentioned. Some brand names and models to consider after a persusal of Audiogon listings with some knowledge of what folks frequently suggest/rave about include:
- Linn (eg, Ikemi, Unidisk)
- Lector (eg, cdp 0.5 cdp 7)
- Ayre cx-7
- Mark Levinson (eg, No. 39)
- Cary (eg, 303/300)
- Sim Audio Eclipse
- Meridian G07/G08 (a fave here, but not nearly as popular in the other forums)
- Naim (cd5x new is in your price range, used it would be a cdx2)
- Esoteric DV-50
- Consonance Droplet 5.0 (new $3k, getting strong reviews and a friend of mine looooves it)
- Various Sony sacd players with mods
- Wadia (eg, 302)
- Electrocompaniet
There's so many to choose from. You'll need to audition. That's your priority, and if you can't...think about what type of sound flavor you most like (warm, musical, analytical, fast, neutral, etc.), and read the forums and then get a short list. I got my Moon Nova that way. I knew I wanted something clean sounding, neutral and fast (but not a Naim as Naim seems to want matching components and cables optimal sound, which is cool, but I did not want to go down that road...I like what I heard though) and had a price range, and...
Good luck, - walkman