After some analysis it seems that the problem in php woocommerce/theme side. If I delete the variable product, the situation definitely better but the search still struggle if I switch between bigger categories.

I may setup a debug environment the debug the code but I’m not sure I want to do that:)