How long do you backwash? You may not be getting all the dirt out. A good technique is to catch some of the backwash water in a white plastic pitcher and run the cycle until the water in the pitcher is clear. And don't forget the rinse cycle for a good 30 seconds or longer to pack the sand back down.

This can take quite a bit of water so be sure your pool is very full when you start.