Yes, I would use a magic eraser, it will not hurt your water balance. Or you can wait, the yellow will probably lift after a while if it is a stain from the organic material that was in the water all winter. The eraser will be faster.