BuddyPress.org

yes, you have to fix it via css.

No, change password for is not the only one. almost all the core settings(core notification/password change) and many plugins use this plugin-template.php for showing the content.

Please check do you have this tag in your plugin template.php

<?php do_action('bp_template_title') ?>

This is used for showing the title, you should never hard code the title there.