The easiest thing I know to use is a sponge with a paste made of baking soda and water. It doesn't create a chlorine demand if it gets into the water, and doesn't mess up any chemistry.
Others have suggested Magic Eraser, but I'm nervous about any of the soapy stuff getting into my pool.
Janet
Bookmarks