Try your best to avoid the call. Consider going to the Cops as the last resort.
If things get worse & you are going to approach the cops, record some of his calls as evidence.
Also in no way threaten him. If you do so you might be charged for a crime.