I hate to tell you this, but the flying ants (and yes, that's exactly what they are!) is something you will have to get used to. They are "swarming" and it's something they frequently do on clear, sunny days. Several times a month we will go out to swim and they will be all over our pool. At first we just stayed out of the pool on those days for fear of getting stung, but after almost 5 years, we have taken back our pool.
We just get in and make as big of waves as we can to drown as many as we can at once. Also, it seems the splashing about inhibits more from coming in.
We try not to leave any toys floating in the pool for them to climb up on and that seems to help, too.
No amount of insecticide will alleviate the flying ant problem as they "fly in" from other locations, but it will definitely help with other bugs.
I have NO idea what the brown, wormy things are.
Sorry I can't be more help.
Good luck!