C99 Captain reported rejecting a take off due to a Cargo Door Warning Light illuminating.

Narrative

I went to take off Runway XXR at ZZZ and everything looked great. I set take-off power and I had a Master Warning Light Annunciator so I aborted a takeoff and exited the Runway. I look over to see that it was a Baggage Door annunciator so I taxied off and shut down the airplane. I informed Dispatch and called the Chief Pilot on call for the aborted take off. I also discussed with him if it would happen again because sitting on the ground the annunciator was off after shutting down and we decided if it happened again we would squawk it. So I think I fixed the problem annunciator is out I start up and I depart Runway XXR after departing at 400 ft. I brought my props back and the annunciator illuminated again. So I requested to return back to ZZZ. I returned and we off loaded the cargo I squawked the Maintenance item and called the Chief Pilot and Dispatch and Maintenance control. According to the local Maintenance Guy that worked on the airplane he said that the guide between the latch and where the latch contacts the sensor was loose. So the vibrations and the cargo that was in the nose pressed against is and it ended up creating a slight disconnect.