Vinyl in ground pools (at least the one we used to have) have a cement structure to them. We did the same thing our first year in the house (drained the pool for winter) and when we re-filled it in the spring, our liner had shrunk... It just pulled away from the cement wall. We drained it again, replaced the liner, and that was it.
In short, my answer is... it probably can't happen with an in-ground pool.
Bookmarks