The pilot stated that the purpose of the flight was to fly his sister around the traffic pattern. After engine start he taxied to runway 36, and departed. Shortly after takeoff, he remained in the traffic pattern and noticed personnel associated with gliders setting up for launches using runway 18. He was informed that the wind had shifted and was picking up from the south. He returned for landing on runway 18, and reported the approach was a bit high due to a glider that was being positioned at the threshold of runway 18. About that time, the wind shifted from the north as he was landing to the south. He recognized that the airplane was not slowing and initiated a go-around. While about clear of a fence at the departure end of the runway, the flight airplane encountered a downdraft and a gust. He The pilot applied aft elevator control but a portion of the airplane collided with the fence. He continued the go-around and looked outside the airplane noticing damage to a wheel pant; the airplane was flying normally at that time. At that moment, the glider business operator said that the wind was now blowing from the north again and that they were switching back to runway 36. Following an uneventful landing the pilot secured the airplane and inspected it for damage. The leading edges of both horizontal stabilizers, the bottom side of the left horizontal stabilizer, and also the leading edge of the left elevator exhibited damage.