Hello,
As you mentioned the New Label is appearing on some Products, so could you please edit those Products > and then go to the bottom of the Product edit area > there you can find the Product Settings area > in that if you find any Date added their for that respective Product then first try removing that Date and then check back the Product again. If there isn’t any Date added, then try turning off the Permanent “New” label option and then check back the Product again: https://ibb.co/qWqzbV9
Hopefully, this will work for you !
Best Regards