According to the pilot, during the takeoff initial climb, at about 40 feet agl, the control stick came out of its attach point. He reduced power, and the airplane descended and impacted terrain in approximately a 30 degree pitch down attitude. The pilot stated that the reason the control stick came out was that he had "improperly installed" it during preventative maintenance.