Thanks for the tips guys. For now I just have the pump off. I've run it a few times then added water just to circulate some chlorine.

I picked up a plug but havn't had a chance to do anything with it. I think I'm going to pull the valve apart and see what the inside looks like (stand by for my "where does this piece go " thread). I've been trying to get finished moving and tomorrow is my last day so maybe then I'll have a chance to tackle this issue.