Then we get to Skyhold and agree to become a leader so technically we're everyone's boss from then on, but I feel the Advisors are not just soldiers we can order around expecting absolute obedience. We may be the Inquisitor but they're the ones who keep the Inquisition going. 
Yeah, we definitely call the shots, but a good leader knows when to delegate and stay out of her specialists' hair to avoid stressing everyone out (more). Plus, I think by the time we get to Skyhold, there's probably a bond of trust between the leadership -- and I count Cassandra in that circle too -- or they'd never have handed us all that power. I imagine the five of them as a relatively harmonious group when it comes to leading the inquisition ... most of the time. My Karis has a huge respect for what the advisors do.
I have a headcanon that sometimes, when Leliana is thinking of/worrying for/getting sad about the Warden, Cole goes out and finds that place where those Andraste's Grace flowers grow in Redcliffe, and subtly leaves them for Leliana.
Aw.
As someone who adores our spirit buddy, I may happily borrow that headcanon. It makes perfect sense, and adds a little weight to the Warden's impact on Leliana. He can't really pop over to Redcliffe as quickly and easily as the game pretends (everyone zips across the continent like we had teleporters and that gets silly at times), but "my" Cole will absolutely keep an eye out for that flower on now when the group's out and about.