I hear ya with the desensitized argument but I still don't care about other people's private affairs. Especially people who I don't know or isn't part of my immediate family whose actions have no impact on me.
Also, speaking for myself, because I don't care about Irvin and his wife doesn't mean I endorse adultey. It's just I don't care because it doesn't involve me or impact me in any way.
I understand your position. I'm just pointing out the societal impact it has. People may want to deny it, but when we normalize bad behavior, it encourages others to act badly, particularly those who don't have stronger moral, spiritual, ethical restraints in place to curb their natural urges.
When people aren't held accountable for their actions, it encourages them and others think they can do bad things sans consequences.