Asshole is a non-binary term. Just because you think someone is an asshole, doesn't mean everyone has to consider that person an asshole. Likewise, someone you think isn't an asshole, I might have a different opinion of.
The idea that someone is or isn't an asshole is dumb. We're all assholes, and none of us are assholes. Depends who you're asking.