The more times you press the vendor follow button if you press fast while following for the first time, the more times it appears in the buyer followed list.
Could you please check how it works with some default WordPress themes like TwentyTwenty or WooCommerce Storefront to understand is it our theme issue or not?