If you already know your builder cut corners, he might well have used sand-blasting sand because it's cheaper. Even at its cheapest ($5 for 5#) your filter sand costs $95. At its most expensive, it's something like $225.

It wouldn't be the first time.