BuddyPress.org

No plugin, just a setting ! You can create a hidden group for these users.

Hidden groups are invisible to non-members. These group names and descriptions are not listed in sitewide directories, and their contents are accessible only to members of the group. Because the group is unlisted, users cannot request membership. Instead, individuals can only join the group by invitation.

Group Settings and Roles