BuddyPress.org

One option could be to use group hierarchy to nest the city groups within countries. Another option is to take a look at the group types plugins that will allow you to have different categories for groups in effect, you could then add cope to change how WordPress/BuddyPress behaves with those groups.