"CD quality" (16/44.1) is generally better than human hearing and WAY better than analog vinyl.
But if you have a separate phono preamp there are LOTS of
USB audio interfaces with switchable mic/line inputs and most support 24/96. Most have XLR/TS/TRS combo-connectors so you'll need the appropriate adapters. There are some
Zoom interfaces and recorders that support 32-bit floating point. With floating point they can go over 0dB without clipping, but don't expect 32-bit "accuracy".
The lack of a recording level control can be an issue with the inexpensive Behringer interfaces if you clip the DAC.
...I bought an
ART USB Phono Plus [link corrected] when the old receiver I was using as a preamp died. I was using a regular soundcard in a tower computer. I ended up not using it (yet?) because I found a digital copy of the record... Possibly the last record I'll ever digitize. It doesn't support high resolution and
it was "not recommended" by Amir because of noise.
On another topic - I've used
Wave Repair ($30 USD) to fix-up clicks & pops for a long time. It does an audibly perfect job on most (but not all) clicks & pops. It's manual which means it only "touches" the audio where you identify a defect but that also means it's VERY time consuming! Wave repair also does not support high resolution files. I also have
Wave Corrector which is FREE and fully automatic but I don't have as much experience with it.
And since you are probably using Audacity, it has
Click Removal (automatic) and
Repair (manual). Audacity also has regular
Noise Reduction which sometimes works on the constant background noise. But if the noise is bad you can get artifacts and
"the cure can be worse than the disease", so it's something you have to experiment with.