General aviation pilot reported flight toward terrain while maneuvering during cruise.

Narrative

I was ferrying an OV-10 Bronco from ZZZ to ZZZ1 to an Air Museum that was putting on a tribute. It was early morning; and noise abatement is always a concern; and I knew that the area I was near had a resident who was extremely noise sensitive and would report airplanes flying over. Anyways; there were various clouds layers; and in order to fly as far away from the homes; while still staying VFR under the cloud layer; I tucked the airplane up as high as I safely could into the hills. As I was cruising along the hills; I cleared a ridge and made a turn; I flew near a several trucks that were doing some work in the mountains on an area of steep terrain. I did not expect them to be there as the entire area was uninhabited and I believed it was free of persons or property. I flew just south of and well above the trucks as I could not turn away in time; and I estimate my distance was at least 500'; but it was closer than I ever would want to fly to persons or property on the surface in cruise flight. I continued my cruise flight and was able to climb higher between layers and proceeded on my way further minimizing noise on this morning.This could have been prevented if I had elected to fly further towards the populated area. My emphasis on noise abatement was so strong that it affected my decision as to where I should fly in cruise flight; and in retrospect; I should have flown a mile or so closer to the area in order to give me more maneuvering room and time to spot the equipment. I'm very comfortable flying in the mountains; and this has been the first time I've encountered such trucks on the steep areas in the mountains. I will plan my route more carefully next time in relation to this possibility.