Add a half a box of Borax slowly to the skimmer while the pump is running, breaking up any clumps. After a few hours, retest and redose until you get the pH where you want it.

CYA is raised by either adding some directly as a separate ingredient or using a stabilized form of chlorine such as dichlor or trichlor. Do you have either one of those at home already?