You should absolutely test your CYA level, before attempting to lower it: you may find you have NO CYA left!

While the only way to lower CYA in-season is to drain and replace, it commonly biodegrades over the winter. Occasionally, this causes real problems when the end product formed is ammonia, rather than nitrogen gas.