The pilot reported that he landed the airplane on a road in order to visit a ranch. After walking over to the ranch, he found that he had landed at the wrong location. He walked back to the airplane, performed a preflight inspection, and proceeded to takeoff from the road. During the takeoff initial climb, he felt the airplane sinking. The left main landing gear wheel struck a fence, and the airplane nosed over and came to rest inverted. Both wings sustained structural damage. The pilot reported no mechanical malfunctions or failures with the airplane or engine.