Yes, you can deactivate or delete the Safe SVG plugin, if you did not use any svg photo on your site.
Because the main purpose of this plugin is, It gives you the ability to allow SVG uploads whilst making sure that they’re sanitized to stop SVG/XML vulnerabilities affecting your site and It also gives you the ability to preview your uploaded SVGs in the media library in all views.