You should be able to edit your sidebar.php in your child theme and change the ‘standard divs’ to your custom divs/css.
Had a look at some of the theme’s im using and really cant give you an example as it wouldn’t make sense. Also try looking in your functions.php as you could also play around with divs/css.