A client that does not pay is not a customer or client. They offer attain the status of client or customer when the bill is paid.

What many do is to cut them off and walk away. If they threaten to sue let them since it ends quickly in court since they didn't pay so there is no contract, etc.