Welcome,
You can specify the separate filters for each category in the shop widget area by adding specific WooCommerce WoodMart layered nav widget for each specific category from Appearance >> Widgets. In this way you can avoid that category where you don’t want to show that filter.
Unfortunately there is no such option currently available to show the filter on more than one specific categories or hide it from a specific category. But we already added this improvement in our to do list and it will be implemented soon.
Best Regards.