A tantalum is a semiconductor capacitor an MUST have a DC voltage across it. It cannot be used with AC signals unless it is biased with a DC voltage higher than the AC.
An electrolytic capacitor also should have a DC on it. When this is not possible they should be used in anti-series which is equivalent to a bi-polar capacitor.
I prefer to use the term non-polar for capacitors without an electrolytic.
In this case (AC coupling) the problem is not the voltage across it (there should not be any) but the current flow (which there is) which is the problem.
Biassing the electrolytic lowers this distortion.
Would be fun to test perhaps using a battery in series with the load resistor for instance.
Tantalum are very poor audio coupling caps but work well as power supply rail caps. Also not very suited for low leakage current applications (timers).
Another option for tantalum is to use 2 in anti-series and bias the middle with an appropriate DC voltage but this better be very low noise
I often see electrolytics used in the feedback path of a power amp (to ground) which also is poor practice. Also sometimes see electrolytics as an input capacitor on amps without any bias voltage. Poor engineering.