Re: Which template file is Settings?
yes, you have to fix it via css.
No, change password for is not the only one. almost all the core settings(core notification/password change) and many plugins use this plugin-template.php for showing the content.
Please check do you have this tag in your plugin template.php
<?php do_action('bp_template_title') ?>
This is used for showing the title, you should never hard code the title there.