The pilot reported that during the takeoff roll on runway 23, he felt what seemed like 'a hand shove the plane left.' The airplane departed the left side of the runway onto an intersecting taxiway. The airplane was returning to the runway when it impacted a snowbank which was located on the intersecting taxiway and extended 2 feet onto runway 23. The Airport Daily Inspection Report, listed the condition of the airport surface areas, and snowbanks as 'O.K.' A weather observation taken after the accident reported the wind from 260 degrees at 17 knots, gusting to 24 knots.