Hi,
This is actually possible regardless of what Avinash says. The idea is to add the attribute disabled="true" to your button.
In order to do that ( since it's based on conditions like the specific group ), you will need to follow these steps :
1- Js : call the FormController and specifically function renderButtons.
2- The conditions you need to check are : your model because if not it these changes would apply on all toggle_active buttons.
3- RPC call to check the user's groups in python side ( very simple solution ). The function call will return True is user has group ( to whom the button won't be 'clickable' )
4- in JS, if result, then : point your button with a specific class in XML to be easily identified and then : $('.o-your-class-here').prop('disabled', true);
All these steps are a little bit complicated to put together. So even it's true to be possible, you may consider just Hiding the button with groups. It's much easier.
Upvote if this helps.
Regards.