If you've ever used a clarifier or floc product, sometime you get a residual like you describe--I would just vac it to waste, if you can. If not, you can add a handful of DE to your sand filter (just enough to raise the pressure by 1 psi) and it will help trap smaller particles than the sand can filter alone.