It depends on the situation and the type of music. I love many different genres of music and pass a considerable amount of my time listening to it. However, I can only really enjoy it if I am in control of the source. If a neighbour has the radio on in the garden a hundred metres down the road then my thoughts immediately turn to murder and monstrous tortures I would inflict on this person for invading my auditory space. I have no problem with, for example, the sound of hammering or a pneumatic drill from some nearby roadworks. But if the workmen have a radio on (which they inevitably do) I will run for cover, even if it's music I enjoy when played freely on my own system.
While I have nothing against 'Classical' music as such, I find much big symphonic orchestral music utterly baffling. Whether its Beethoven, Stockhausen, Schönberg or Schumann it just sounds like 'orchestra' to me: an amorphous grey aural sludge with little discernable musical content. However, I can easily enjoy the same pieces arranged for a small chamber quartet or solo instrument ...