The chlorine will kill the algae, and the filter will catch the debris and flush out when you backwash. It is best to get rid as much as practical- but you don't have to get every little piece.
It may cause your filter to need backwashed a couple times while completely clearing, but that is all!