Yes, this request to the Google API server may take some time and slow down your website a bit. All optimizations plugins and cache can’t change anything about this request.