Well, here is what I came up with...

I put a tee fitting on the return line just before the union where it transitions to the pipe underground, on the tee'd part I put a 2" x 3/4" threaded bushing in, from there a 3/4" threaded male fitting, a 3/4" PVC check valve with 1/2" lb spring pressure (for a positive seal), a 3/4" PVC ball valve, then about 8 feet of 3/4" flex PVC to a 3/4" nylon hose barb x 1/2" MPT male fitting(I know I am looking for a brass one, but for starters the nylon will work fine, but it will be swapped in the near future) to a 1/2" brass gate valve to a 1/2" tee fitting (with the original hose bib on the tee'd part) to a 1/2" vacuum breaker (I was shocked they had one) and finally to the copper line going into the houses main water supply (non-softened)...

Overall I like the fact it has 2 check valves so I have zero concern about pool water backing up through the houses water feed. I also like the fact of two valves to control the flow of water into the pool...

The one issue with the vacuum breaker inline is the ability to winterize the hose bib. I really have zero interest is continuously removing and reinstalling a 1/2" vacuum breaker every winter and spring, so I am going to try to find a 1/2" bleeder valve to add to the line prior to the vacuum breaker so I can drain the entire assembly for winter.

Overall I like the "manual solution" I came up with and am really happy I don't have to drag the hose over to the pool... I already hate having to do it for the hot tub and that is only about 10 feet away from the hose bib...