Air carrier First Officer reported the ground crew continued with the pushback although instructed multiple times to stop; resulting in coming in close proximity to another aircraft.

Narrative

The language barrier caused a simple confusion about pushback clearance. The Captain cleared the ground crew to begin the push and immediately told them to stop pushing; the pushback crew coordinator continued pushing; and the Captain immediately commanded them to stop the push. The ground personnel questioned the Captain; and continued to push. The Captain again commanded they stop pushing and they continued to question why they should stop; while continuing to move aircraft. We had moved approximately 5 feet when they finally stopped. On the Captain's initial command; we move had moved approximately three inches. An aircraft was pushed and starting in the rear corner of our wing behind us. Again; it took 3 calls to the ground agent to stop the push. The aircraft passed behind us without issue. Cause: Language barrier; confusion on the clearance received; and the ground crew; not stopping immediately when commanded by the Captain. Suggestions: Prior to pushback stopping to discuss each parent to receiving the barrier feels confusing. Using your words and commanding the crew to stop