Hello,

Try to create a custom sidebar and add the widgets.
https://xtemos.com/docs-topic/sidebars/

Then, try to use the Theme’s Layout Builder. You can create Custom Layouts for WooCommerce pages like Shop, Category, Single Product page, Cart, and Checkouts. So, you can use that to create your own custom layouts for specific category and choose the sidebar.

Further, you can read more about the Layout Builder here: https://xtemos.com/docs-topic/woodmart-woocommerce-layout-builder/

Best Regards.