Hello,

Please add below Custom CSS code to Theme Settings > Custom CSS > Global custom CSS:

.widget_product_categories .product-categories li {
    border: 1px solid black;
}

Best Regards.