It makes the dalish look like a bunch of thick headed ignorant elves that hate and only praise him to appease him. I'm sure he wouldn't care about people praising him, but to think that most of them hate him for something that's not true. I don't blame him for being sad or annoyed when Morrigan was speaking about him in the temple. People see him as the villain when he's just a bundle of knowledge that the dalish are throwing away--not that they know who he really is. I wonder if he has ever cried himself to sleep.
And yet, it's implied that he actually did lock up the pantheon or something like them (Cole: "They sleep, masked in a mirror, hiding, hurting, waiting, and to wake them--"), that his actions really did somehow lead to the downfall of Arlathan and/or result in the elves being left vulnerable to being conquered by Tevinter (Solas: "What if you wake up to a world that is worse than the one you sought to change?")
While the Dalish might be mistaken about the details of his personality and motivation, it sounds like they got the overall big picture right. And if I were them, I wouldn't be too pleased either. A thousand years of slavery + 700 years of diaspora + almost complete cultural genocide would lead a people to not be too fond of the person at the center of where things started to go wrong.
As for Solas, he doesn't really cut them much slack either. He compares them to children acting out traditions they don't understand, yet he has all this knowledge and doesn't share. While he implies he has tried to teach some elves in the past and they rejected him, the PC can point out (on multiple occassions, I believe) that he's now "decided their reaction for them." Pre-emptly decides they'll reject him and so doesn't bother, which keeps them in ignorance, which he then looks down on. He's decided that all modern Dalish / elves are like those few he encountered before and sneers at the rest. What's more, he judges them for coping with the hand he's implied to have dealt them in a way he doesn't approve of, when he had the luxury of sleeping through the consequences of his past decision while the elves have dealt with the brunt of it and now have to pick up the pieces.
I love Solas, but yeah. I don't think the Dalish are completely ignorant, malicious slanderers nor that Solas is an innocent little bunny cruelly maligned and rejected for no good reason either. As with most conflicts in Thedas, both sides have faults.