Hello,

When you add an attribute filter, there is the option to determine the category where this attribute would appear: https://gyazo.com/a113b7f2d2b1c87a9efd425b56da41f9

You will choose the category, then the appropriate attributes would be shown and all the products assigned to these attributes would be filtered out.

If you have any questions please feel free to contact us.

Best Regards