If you use the DAI mod manager suite, its actually not too bad or frustrating. It will automatically look for updates to the mod manager, and a lot of the time you just need to remerge them all, and you can tell which mods need to be updated by the creator and re-downloaded by you because you get error messages with the name of the mod as you redownload it. Deactivating the particular mods doesn't usually break your save at all either.
I personally tend to stay away from complexion mods and the like since they are the ones that tend to break the Black emporium, which is fine for me since im happy with a lot of the default complexions.
Ah, thanks for the insight. I used one or two mods a while back, but when the game got patched it did't work anymore for quite some time. I didn't want that to happen with important mods that I need for playing. But by the time I start my next character that won't be a problem anymore either way, I think. ^^ Not sure if I even want to download anything for my current character by now, I'm used to having him the way he is.
@ Arthierry: great faces, very real looking!
@ Will-o'-wisp: Aldous is fun to look at, such a great character face 
Hey, thank you!

Here, have a derpy smile of gratitude!

(looks a bit worse than my other pics cause I had to take it on a weaker PC, I'm afraid ^^')