Tape and vinyl are somewhat close in noise floor (crackling of poorly maintained records notwithstanding), and the low frequency extension is similar, but tape has worse LF extension as speed in increased. Tape has better high frequency headroom than vinyl and they have roughly equivalent HF extension with tape having a bit of an advantage here.
The main difference is that they have radically different harmonic distortion signatures - tape distortion consists almost entirely of the odd order harmonic distortion components which are harsher to the ear, while vinyl has a more natural (to the ear) mix of even order harmonics and odd order harmonics. The presence of stronger even order harmonics tends to cover up the harsher odd order harmonics; vinyl tends to sound 'euphonic' in a more pleasing way than tape.
Beyond this, unless you are willing to purchase current production pre-recorded tapes which cost >= $400, there is nothing to listen to. The old 4 track pre-recorded tapes from the 1960s-1970s were mass duplicated at several times normal speed; they were hissy, lacked definition compared to the vinyl version, and were duplicated on rather primitive tape formulations of the day. I collected these when they were originally made, so I know!
So unless you're just obsessed with getting a reel to reel, I'd pass and stick with vinyl.
Here is a spectrum analyzer plot of tape verses vinyl: note the almost total absence of even order harmonic distortion components in the tape plot. Their total harmonic distortion is almost identical at their respective reference levels, but the nature of the distortion is very different.
View attachment 127823