Hello,

Yes lazy loading functionality is not for those icons, Lazy loading is for product grid images and other images so that images loaded only when user will scroll the page.

You can check the below article about the WP Super Cache:
https://www.yourhowto.net/how-to-fix-wp-super-cache-0-cached-pages/

Best Regards.