I'm afraid to ask, but why does he of all people give you violent urges? He's the wise and sage master of the fade who just happens to be the greatest trickster in all of Thedas. Sure he's made some pretty bad mistakes, but he's also been fully committed to helping the Inquisition every way he could.
It's the whole giving the orb to a Darkspawn Magister deal. It's just like, 'Really, Solas, really?' How many people died because of stupid Corphy? I'm certainly not the biggest Chantry supporter, but honestly, the Divine was trying to make peace, and there were a ton of good people there (like poor Cass's beloved). And you never get to call him on this: Anders blows up a slightly smaller amount of people, but you get to harry him about it, yell at him, scream at him, maybe kill him (and depending on how you followed it, he may have went to remove the bomb and then Justice took him over and stopped him, anyway). Solas? Gets no such call out.
(We could argue that it wasn't Solas who directly blew up the Temple, sure: but he gave the orb to a Darkspawn Magister. So, yeah, I'm going to hold him to blame for that as well.)
Top that off with him actually telling you 'You are a credit to your race' (which causes RL flashbacks and is just a jackass thing to say all around), him telling you don't let Morrigan drink from the well then throwing a tantrum if you actually drink from the well (because, hey, he refuses too, obviously), the whole lying to my character about your identity while they're having a relationship with them (Blackwall is far worse for this and because of that I will never romance him again, but Solas does it as well) is a crime where I live (and creeps me out so much), and then the whole 'I am wise and you should come to me with all questions' but if you actually push him with questions about suspicious things he's doing (such as at the ball) he gets snitty...
So, yeah, in general, he makes me want to punch him, mostly because he won't leave. He's of course extremely helpful at the beginning: without him, the Inquisitor proably would have died and he shows her/him how to seal the breach. But after? He mocks you that you can't get rid of him, as he's the fade expert, but he never really does anything else useful- he just wants the stupid orb.