Since you are getting suction from the sweeper then it sounds like your pump is OK.

Is there a valve that allows you to adjust the suction between the skimmer and the sweeper? If so, try pulling it apart, there may be something partially plugging the port to the skimmer side.