stock count and atributes are strange

When creating a product and we add all the attributes to it if will always show up as a result even though there arent anymore products in the inventory.

The right way should be that a product should only show up in the results from which attribute it has. For example i have 1 product that is size 6M, however it shows up under filter 9M even though in my variables there arent anymore items to sell.

How do i fix that because if there isnt a fix that is a lot of manual work to keep adding and removing attributes with each purchase.