After a preflight inspection of the tailwheeled airplane, the pilot did a run up, verified flight controls, checked engine instruments, and set his flight instruments. The pilot slowly applied full power and began the takeoff roll on the runway center line. Just after the tail lifted off the ground, an unexpected wind gust came from the right and the airplane veered to the left of centerline. The pilot began corrections by applying right rudder and another gust of wind raised the right wing the airplane veered further to the left. The pilot pulled the throttle to idle in an attempt to slow down and abort the takeoff. As the airplane began to stabilize, the pilot thought that he could continue the takeoff so he began to apply full throttle, but the airplane continued to veer to the left. The pilot then immediately pulled the throttle back to idle as the airplane departed the left side of the runway. The pilot thought that he had the airplane under control at that point. While rolling on dirt aside the runway surface, the tailwheel ran over a hole and dug into the dirt and the right main wheel dug into the dirt. The pilot said that this caused the airplane to stop rolling forward. The airplane started to slide sideways and the right wing hit the ground, resulting in structural damage to the wing. The airplane came to a stop and the pilot exited the airplane uninjured. After the accident, the pilot stated that if the tailwheel of the airplane had not dug into the hole, he could have salvaged the runway departure without damage to the airplane.