So what's the current thinking on using phosphate removers?

I use to use one at the end of every season, but last year I stopped doing it since it seemed the message here was that they are a waste of money.

Now I see more discussion about possible benefits of removing phosphates. I'm sure my pool has phosphates since I add 6 oz of Jack's Magic Purple stuff each week to keep stains from appearing on the steps (interestingly, the bucket metals test recommended here was negative for any metals).

So, should I resume my annual phosphate treatment or is phosphate removal only recommended for "problem pools"?

For reference my pools stays clear and CL holds overnight. I keep FC 5-6ppm and CYA 70-80 (recommended CYA level for my SWCG).