I’m just sharing this in case someone faced a similar issue.
The product duplication (each product showing in both languages on shop page) was caused by Elastic Search Plugin. Deactivating plugin resolves the issue.

Regarding the categories counter widget on the sidebar, it works fine when selecting “Order by Name”. However, it doesn’t show all categories when selecting “Category order”. Which is fine by me. But you might want to check this behaviour.