I think you are onto something as we've been bombarded with pollen lately here in Western PA. Our vehicles are covered in it and it makes total sense that it could be what's at the bottom of the pool. And, well duh on me, but we are building a deck around the pool and it could be sawdust.