Hello,
I have checked that issue on the default theme and there is the same issue with the side cart:
Here is a video on the default theme from your side: https://take.ms/O7iYy
Here is the same theme from my side: https://take.ms/DfATr
As you can see, the same issue is on the default theme so I suggest you contact with WooCommerce support team for further solutions.
Kind Regards