This is not possible without custom code (probably JavaScript to update the Window Action context dynamically based on the View type).

The best you could do would be to create a second Menu with a different Window Action where you can have a different context than the first.

Remember that the step to change the filter will almost certainly become invisible (combined via muscle memory into a larger step) after Users have done it enough times, just like someone who drives a car makes the steps "move foot to the brake pedal" and "depress the brake pedal" and "move hand to the car ignition point" and "start the car" invisible (combined into one) after they have driven for a few weeks.

In other words, such a change doesn't seem to have a high return on investment.