basically you can leave the island any time you want, but NOT if you still have missions in your mission journal. As they can't be abandoned, they'd be stuck in there forever if u could leave with them still active.
just finish your current missions 'n try again
