Corporate pilot reported receiving a low altitude alert from ATC while crossing a mountain ridge during descent.

Narrative

Inbound to the airport on an IFR flight plan. VMC conditions with some local summertime haze in areas and virga NW of the airport. Very familiar with the airport and local terrain and called the airport in sight from a radar vector and was cleared for the visual from approach control. Started a turn towards the airport direct to a left base and was immediately cleared to land. In order to make the airport I immediately started to slow with spoilers and started a descent while further configuring with flaps and gear as we got closer. This airport is notorious for having a tailwind all the way down final so I didn't want to be high and fast as we'd never get down to a stabilized approach. My goal was completely on slowing down and getting down. As we crossed the ridge approximately 1000-1500' AGL we got a low altitude alert from the tower controller and were queried if we had all terrain in sight (we clearly did.) The ridge immediately falls away to the valley floor so we were only at that AGL for literally a few seconds. On the subsequent leg home I was debriefing myself and flying partner and we agreed that it was inadvertent to cross the ridge at that altitude as our whole focus was to get lower and configure; we were very aware of the terrain but it was not an immediate concern. Both of us are very comfortable flying in the mountains very close to terrain as we both fly tailwheels in the backcountry and didn't really even give it a second thought.In the future; we agreed a better plan with regard to terrain would be slow at altitude and configure early for the descent; rather than boresight at the airport and rush to configure for the approach. We also briefed to be cognizant of flight altitudes per FAR 91.515 (even though we were technically IFR on a visual approach.)