If it doesn't bother you to swim with the stains, I personally would wait until swim season is over, in case something comes up that requires you to close the pool for awhile.

Welcome to the forum!