When you say shut off the skimmer, do you mean shut off the pump? How long are you going to be gone? The worst thing that could happen is you'll have some algae but that can easily be cleaned up with a few days of shocking.