What's called 'mustard algae' commonly behaves as you describe . . . and is quite chlorine resistant.

But, on vinyl or other slick surface pools, it's pretty easy to get rid of with high chlorine AND brushing.