You certainly have some 'bypassing' going on with the valve

Without having to change out the valve, can you simply put a plug into the port where the backwash hose attaches? It's not a 'true' fix, but will work