I've seen a similar situation on another pool where the fine dirt settles along the liner seams and when you go over with the vacuum it doesn't pick it up immediately. Going back and forth over the spot a few times and it will pick up. Don't really understand why but I suspect the design of the vacuum brush. My brush, which picks stuff up usually on the first pass, and this other one have different bristle patterns. Best I can suggest.
Al