CRJ-900 flight crew reported loss of aircraft control while taking the runway for takeoff. Flight crew regained control and departed uneventfully.

Narrative

On Date 0 I was Captain; Pilot Flying on Aircraft X from ZZZ-ZZZ1. Preflight; pushback; taxi procedures went great; as this was the 3rd leg of the pairing on day 1 of a 4 day trip. Once holding short of Runway XX in ZZZ; we contacted Tower for clearance; and continued holding short for wake turbulence separation. After a few minutes; we were cleared for takeoff. The lineup was standard; however; I added too much power too early while still in the turn using the tiller. This caused the aircraft to swerve too far right; then left; then right before reducing power significantly to regain directional control. Once directional control was regained; on the roll; a normal takeoff was continued; and the flight continued without incident. Hindsight is 20/20; but I learned a valuable lesson to never add power in the turn- either wait till you are established fully on the centerline straight ahead; or just come to a complete stop. In short; I overcorrected using the tiller. I never realized how delayed the reaction is; which caused us to momentarily lose directional control. This lesson is valuable for both myself; as well as future takeoffs when handing the controls over to First Officers- will be extra vigilant that we are properly lined up before handing over the controls. Will forever be embarrassed that I; as Captain; Pilot Flying; managed to mess a normal takeoff up; but this valuable lesson will always be in the back of my mind.Loss of directional control caused by adding power too early in the turn using the tiller exacerbated by an overcorrection.