I think we figured it out. I googled pool silt and it actually led me to old posts on this forum about skimmer socks. Maybe those should be bumped up so people can find them if they search dirt, dust or silt in pool. Put one on this morning so we'll see how that does (when we get a new pump...different day, different post).
Thanks