You can vacuum them up into the filter and don't backwash for a week.

However, if they were put in the skimmer, they should have gotten caught in the filter in the first place...