This is meant in a lighthearted fashion - but you would feel guilty listening to Barry Manilow? These days, the colloquialism, "guilty pleasure," is meant to be funny, not to invoke actual guilt.
That being said, the concept of feeling guilty when appropriate, actually serves a useful purpose. Those on the anti-social personality disorder spectrum lack a sense of guilt, which is why they so often purposely hurt others. To me, that is evil personified.
In psychology, it is said that all of the disorders in the DSM usually only hurt the person who has the disorder. The exception is the anti-social spectrum disorders - those are the disorders that hurt everyone else. It is said jokingly, however it is truer than not.
Anyway, linguistics is an interesting topic because language literally shapes our perceptions, whether we are consciously aware of it or not.
Add to that the concept of cognitive dissonance, and how our behavior changes in accordance with our words, and you soon realize how powerful language is.
Words have the power to shape what we see, quite literally, and words can determine how we act. This isn't new, it is why we pledge allegiance to our respective flags, or take oaths, or swear on a bible in court to tell the truth.
I'm currently working on a post about the subject, so please stay tuned...
I think you are talking about guilty pleasures, yes?
From Wikipedia: A guilty pleasure is something, such as a film, a television program, or a piece of music, that one enjoys despite understanding that it is not generally held in high regard, or is seen as unusual or weird. https://en.wikipedia.org/wiki/Guilty_pleasure
Personally, I like the more common phrase,"guilty pleasure" better, because I wouldn't want to label anything I do as evil. How can secretly listening to Barry Manilow be considered evil? lol