If you are using hooks that fire before bp_init then you can keep them in the loader file. You must be very sure that aren’t calling any BuddyPress functions though.
If you’re not sure just deactivate buddypress with your plugin active and see if it crashes.
