Dirt, pollen and dead algae both tend to be brown. Dead algae tends to be 'fluffy-er'.
But, if you haven't had LIVE green or mustard (yellow-brown, but in thin patches that do NOT float away if you wave your hand near them), you probably don't have dead algae.
Bookmarks