Hello,

There is no option from the default Woocommerce, unfortunately. You can hide an empty category in the widget. And you can configure which categories to display in the Product category element. However, as for the default categories display in the heading or in widgets/search it is not possible to hide a category.

Best Regards