Hello,

Unfortunately, there is no way to set the different sidebar to the different categories. However, there is the option in the Attribute filter widget (WOODMART WooCommerce Layered Nav) to set showing in the certain category so that you could have an individual set of attributes for each category. https://xtemos.com/docs/woodmart/widgets/

Best Regards