A C172 pilot reported a NMAC with a skydiving aircraft while operating near a charted skydiving area.

Narrative

After some practice maneuvers in the vicinity of ZZZ1; I was returning to home airport; ZZZ2; via direct to ZZZZZ intersection; direct to ZZZ2. In the vicinity of ZZZ; my GPS navigator sounded an alarm of proximate aircraft well above me; and then quickly at my 6 o'clock less than a mile. I silenced that alert; and received a second alert at my 4 o'clock less than a mile; and then an aircraft appeared at my 3 o'clock same altitude and airspeed. It was within 100 yards of my aircraft. The other aircraft then descended; and passed under me. Upon landing at ZZZ2; I was given a telephone number to call by the refueling person who received it from FBO Dispatch.I called the number; left a message and eventually received a call back from Person A; Chief Pilot for a flight operation at ZZZ airport. HE ACKNOWLEDGED THAT HE WAS THE PILOT OF THE AIRCRAFT THAT BUZZED ME. I told him I was very disturbed by his action; and that the action jeopardized my safety. He said he was a pilot for sky divers and had dropped the divers off and they were in the area; and he was mad at my being in the area. I routinely monitor the local ATC frequency and did so in this case monitoring XXX.XX in the vicinity of ZZZ; and then switching to the primary frequency for ZZZ3; XXX.XX1. I noted to Person A during a call that the area around ZZZ is noted as an area of frequent parachute jumping; but does not restrict or prohibit pilots from transiting the area. Vigilance is always important. I told Person A I believed he had operated his aircraft in a very unsafe manner; and likely in violation of FARs.