DE leaking into the pool will usually appear as a tan to light brown dust accumulating in corners or crevices. If you collect a bit with a dropper, it will feel slight like DE, not sand, and it will NOT dissolve in vinegar.

Sand algae residue can be tan to darker brown, and if it comes off as particles, will (a) feel like sand between your fingers and (b) WILL dissolve in vinegar.