First of all thanks for choosing our Theme, we are glad to be you in WoodMart WordPress family
Primary color only changes the background color for the theme buttons and some other colored elements not all the elements of theme. And secondary color effect other minor elements.
Screenshot of my test site where I set primary and secondary color: https://jmp.sh/ac1tt75
Result is in this video for your satisfaction: https://jmp.sh/znCiPUB
You just need to clear your site and browser cache because at my end your colors working just fine.
Screenshot for clarification: https://jmp.sh/SJC6Fxj