Hello,

Yes you need to assign the attribute brands to the products in order to display them on the brand pages.

This document will be helpful:
https://woocommerce.com/document/managing-product-taxonomies/

Best Regards