BuddyPress.org

Even if you have unread messages, your notifications might be zero. Is that because you’ve visited your profile screen since receiving the mail?

My vote would be for the notification to remain in the admin bar until after you’ve actually clicked on the message – or at least visited the messages screen.