tamp the sand or what ever you use down tightly.
Like maxx said "layers", if you do it a bit at a time it will compact easier and better than if you fill the whole hole and try to do it.
JJ