Context

I'm creating a custom module that will allow users to have a quick and centralized area for outside resources. An outside resource could be a URL, pdf, or other document. Pretty much anything that could be used by the business that is outside our typical system. 

Goal

I have all of the functionality working for the module, except for some of the permissions. What I'm looking to do is make user groups that will filter out what tiles that permission level has access to. In addition to this I would like to be able to whitelist users for a specific module.

Question

Has anyone created kanban permissions similar to what I described above? Is it even possible?

 My Approach

I'm thinking I could create a related field in my model that would house the individual users who have special access to that tile, but I'm not sure how I would tell my view to filter based on the group or individual. Then for the group permissions I would like to use the built in security .csv  and .xml to define the groups.

Thanks in advance