BuddyPress.org

Try this, and put rel=”fancybox” on your links. I doubt the script is ever gonna work like that with buddypress.

$('a[rel*=fancybox]').fancybox();