In the second case, I have just that problem you mentioned, there is a inherit or some inherits that adds more filters but I need to remove them, any ideas @Dimitrios Tanis?. Thank you.

Do you want to do that in a specific view of the res.partner OR all views of it?

In first case, just create a new search view and add it to the act_window as a search view to override the default.

In the second case, the easiest way would be to create a view that inherits the base search view for partner, replace the whole <search> ... </search> and then under a new search tag add the filters you want.
Be careful though there might be other modules that inherit from the search view you replaced and may add their filters too.