This sounds more like extortion than a legitimate lawsuit. He's suing you for breach of contract when the breached clauses don't exist, and based on false pretenses, while exploiting an asymmetry in financial resources. I wouldn't be surprised if a good lawyer would find cause for you to turn around and sue him.

Lawyer up. Lawyer up. Lawyer up. Do not pass Go, do not collect $200 until you lawyer up.