I usually see a little sand in the cracks of my driveway after backwash. By a little, I mean a few tablespoons.
Do you open the filter and inspect the sand once in a while?