I'm currently trying to rewrite the invite link removal process to fix this vulnerability. If I get it, I'll include a patch in the next post.
Perhaps the best solution would be to use a password when creating the invitation link and not share it with the link.