A classic cause of medium coming back into the pool is a pump that has a higher capacity than the filter can handle.

That's after you eliminate broken laterals in a sand filter, and torn screens or fingers in a DE filter.