As you may know, invisible elements are still available in the DOM so can the can easily be restored.
https://www.odoo.com/nl_NL/forum/help-1/odoo-security-issue-for-invisible-fields-86106
What about removing:
this.$("button.o_invisible_modifier").remove();
Still not perfect but better?
What do you think?
Thanks,
Alexander
Odoo13 (all versions)