Looking to override the default xml of (permission_panel.xml) inside the knowledge module.

Logged in portal users do NOT need to see which other users have been given access to a particular article. I want to hide the entire "Member" button to prevent them from seeing other portal users names. (See image) This seems hard coded via XML and not something I can adjust through debug mode with a view. 

I'm on SH, how can I accomplish  this?

Screenshot of the view from a logged in portal user. An article might be shared with hundreds or thousands of other users. This membership list should not be visible to a portal user.