There's only one user that actually needs some read permission on fields. Now, without giving him the whole view or model of the module.
Like this one. We need to add the user to the 'Employees / Officer: Manage all employees' group to access that specific field. So, adding the user to that group got all the access on other HR modules.