Air carrier Captain reported while on a visual approach descending below a safe altitude resulting in flight towards obstructions resulting in ATC issuing a low altitude alert. The flight crew climbed to a safe altitude and landed safely at the airport.

Narrative

We were set up to land on XX in ZZZ. 10 miles north east of the field they cleared us direct to the field and then for the visual. As a captain this was my first approach into ZZZ and my first time landing on XX into this airport. I did not properly brief all of the towers; only the tallest tower at XXXX on the downwind. Using heading select I turned us on a downwind. I mistakenly thought the final approach fix was ZZZZZ at 2100. I selected 2100 and used vertical speed to descend down. I started to notice on the terrain map we were getting yellow spots and a few seconds later was alerted by ATC that we were a low altitude alert. I immediately kicked off autopilot and climbed to 2900. I asked the first officer to verify the FAF and was corrected that it was ZZZZZ1 at 2900. We then maintained 2900 and turned to final where I intercepted the path for the RNAV approach. We did brief the tower as a threat but failed to brief all of the towers as a threat. I did brief that it was my first time to this airport in a long time and my first landing on XX. We also briefed the fact that I am a high minimums captain. In the future I will ask to be vectored for the RNAV approach and take extra caution of the towers in the area.