OK SUPER DUMB QUESTION!!

I do not turn off the pump to change valve positions.... that's bad right?? I assume could be causing sand in pool?