BuddyPress.org

I wrote a plugin called Invite Anyone that doesn’t do quite what you are looking for (it doesn’t restrict registration) but it could be modified to do what you’re asking: https://wordpress.org/extend/plugins/invite-anyone/