Pavers have to be flush with the base, there's no way around it and no way to cheat it, your pool will hold a tremendous amount of weight.
If you think it's alot of work now wait until your done and you fill it up and then it leaks and you have to drain it and rip it apart and fix it.
Fix it now while you can.