Yea, that one is rather silly, a plan for doing so, say to see friends or family members might be more reasonable? Or some ancient elven portal to find and restore akin to ESO?
Mass effect took us across the galaxy faster than it would take to walk across the street, but should that apply here? Don't think there is any way around it w/o some plan scheduling how you use your time and while that might add realism and immersion, some folks, well they'll bark anyway. So here are some thoughts to consider.
What if you might need to establish trade relations just to get there?
What about adding critical events with a time limit -forces you to look more closely to the map and these should not be perfect rescues -hard choices, do you have the time and resources? Can you schedule the rescue with other pressing concerns to mitigate risks to a larger group?
What if you could also tap into the quest system and establish new quests that merge others and change the goals to your needs - this could get pretty complicated.
I'd, merge all the "I lost my ???" quests into not my problem-is there cost sure! Realistically, the sky is falling -get someone else. Your team members should echo this, unless there is a boon they want.