Hello there, I find the solution, I'm gonna share it for anyone who have the same issue :  

If you're experiencing empty pages due to hidden records still occupying space when using t-set for filtering on the front end, you can resolve this by setting a domain directly in the record rules on the backend. Here's how you can do it:

1. Navigate to Record Rules:
   • Go to the Settings app in your Odoo backend.
   • Activate the developer mode if it's not already enabled.
   • Navigate to Technical > Security > Record Rules.
2. Create a New Record Rule:
   • Click on the Create button to add a new record rule.
   • Fill in the necessary details:
     • Name: Provide a meaningful name for the rule.
     • Object: Select the model where you want to apply the filter (e.g., your custom records model).
     • Domain: Use the following domain to filter records based on the current user's partner ID:

       [('x_your_many2many_partner_field', 'in', [user.partner_id.id])]
       

     • Groups: Assign this rule to the appropriate user groups that should have this filtering applied.

This approach filters the records at the backend level, preventing unwanted records from being loaded and thus eliminating empty pages caused by hidden records.