Yep, I see what you mean. Got to be a tough spot to fly in. No way the wind isn't swirling in there.
Just for the heck of it, go out and cut yourself four or five small saplings, 6 - 8 foot long, and sharpen one end with a hatchet. Then attach a 2 or 3 foot piece of surveyor's tape, to the other end, and go stick these in the ground. Put one one your right, one on your left, one to the right of the kite wind-window, one to the left of the kite wind-window, and finally, one in the center of the wind-window, just out past where your kite travels. Now, as you fly, take a look at the tell-tales on the sticks, an you'll probably be amazed at how many different directions, the wind is actually blowing...............(just something to do, one day when you are bored)