Sounds like a pretty good plan. Be sure the sand / gravel won't wash out and that the pavers are set on solid ground - not sand or gravel.