Is it sand?

Get some and see. If it REALLY is sand, it's almost certainly from your filter.