The student pilot reported that he lost directional control of the tailwheel-equipped airplane during the takeoff roll. The airplane veered off the right side of the runway and hit a taxiway berm that resulted in substantial damage to the empennage. The flight instructor reported that the airplane initially yawed to the left. He took over the controls and attempted to correct the yaw, but the airplane veered off the right side of the runway. The flight instructor had a total of 563 flight hours, but reported no flight time in the make and model of the accident airplane. The student pilot reported that he had a total of 9.8 hours of flight time with 4.5 hours in make and model. The flight instructor stated that he should have closed the throttle as soon as directional control was lost, and that he should have “executed a positive exchange of flight controls.”