Hello,

To change the icons for the category you need to Go to Products >> Categories >> Edit Category. You can change Icon to display in the main menu.

Screenshot for Clarification: https://ibb.co/MfxxFrL

Best Regards