I would suggest not getting into vinyl.
It's not that I believe CD sounds better than vinyl - in fact I think CD sounds much worse than vinyl. It's just that, once you get into vinyl you introduce a whole new layer of hi fi obsessiveness, paranoia and expense.
Five or six years ago I owned no records and no turntable. I bought a cheap turntable just to play some second hand records I saw in a store once that I thought it would be fun to buy. Six years later, and many many thousands of dollars later, I have a full spec LP12, with Ekos, Naim Armageddon power supply, a Lyra Clavis Evolve cartridge, with a Clavis DC and Ortofon Rohmann sitting in a drawer, Exposure 13, Michell Delphini and Black Cube phono stages, and about 2000 LPs. The turntable blows away any digital source I have ever heard, and most people who visit my home are impressed that records sound so much better, so obviously better in every respect, and by a large margin, than CDs on my Meridian 508.24.
But be warned, once you start collecting vinyl, you will start obsessing about tracking weight and VTA, stylus wear, new arms, what material the turntable mat should be made of, belt wear, cartridge upgrades, replacing all your favourite CDs with LPs, VPI cleaning machines ... the list - and the expense - is endless.
My advice is: listen to your CDs and be happy.