Hello,
Unfortunately, we are not able to change this functionality in WooCommerce. If the category contains products (even if they are out of stock) it is not marked as “empty”. That is why it will be displayed in the page title anyway.
So the only workaround here is to exclude empty categories with out of stock products manually using an appropriate option in Theme Settings.
Kind Regards