The certified flight instructor reported that he was providing instruction to a student with about 10 hours of flight experience. During the first takeoff roll, the student attempted to steer the airplane with the control yoke versus the rudder pedals. The flight instructor provided verbal instruction and then attempted to take control of the airplane. The student continued by applying full left rudder, which the flight instructor was unable to counter. The flight instructor was eventually able to take control and the takeoff was rejected. The instructor could not stop the airplane before it overran the runway and collided with the glide slope antenna. An inspector with the Federal Aviation Administration inspected the wreckage and confirmed substantial damage to the fuselage and horizontal stabilizer. Skid marks confirmed the flight instructor's attempt to stop the airplane.