Depends on what you mean with expensive. Rega is a good alternative with players at different prices. The relatively cheap P2 and P3 and more expensive as P25 and P9. Rega has recently updated the whole line so there may be new old ones for a good price.
The old P2 and P3 are upgradable with kits from Rega, I like that. Another good thing is that there are third party upgrade kits for the arm, making the cheap RB250/300 competitive with expensive arms.
This is just one suggestion, there are other alternatives in US that I have never seen in real life (Music Hall, VPI). A good alternative is also to buy an old turntable with a good deck and a good arm and put in a new cartridge.
You will probably also need a phono preamp. Most amplifiers nowadays have no phono input. May be nothing to grieve about because these were usually very cheap stages with bad performance. Don't buy a dirt cheap phono stage ($30 etc) if you want performance. Creek has a relatively cheap one and an enhanced version, there are also Musical Fidelity XPLS and the Lehmann Black Cube, which cost a little more.
If you are on a low budget, used gear (except the cartridge) is probably the only option for performance.
British magazines regularily review turntables etc (Hifi News, Hifi Choice, What Hifi, and also the less expensive models). You can also look in Stereophile, but the focus is on expensive gear.
If you get a decent turntable combination, you will be surprised by how good it sounds!