BuddyPress.org

The default avatar is exactly that, a default. It’s not per-user, so it can’t be deleted. There must be an avatar of some sort.

If you don’t like mystery man, you can always replace the graphic used with something custom, or use a gravatar (Settings > Discussion, in wp-admin).