Hello,

You need to create an attribute in Product > Attributes. As soon as you add an Attribute, you will find the option, Configure items, you can add more colors to the existing or if it is a new attribute add the items you need. More details here: https://docs.woocommerce.com/document/managing-product-taxonomies/

Custom attributes are effective only on the product page.

Best Regards