The major contributors to TDS in a well balanced swimming pool are salt, calcium and magnesium to a lesser extent. So if your calcium is under control and your water tastes like salt, my guess is salt. The only time when high TDS can be a problem is when it is something other than salt. So if you don't mind the taste, I don't see any reason to drain and refill.
Bookmarks