File a complaint against a contractor with State Home Improvement Commission

[Remi Nguyen]

Hello BP family, 
I signed a contract with a construction company to do egress windows. The contractor concurrently started the job applied for a building permit a couple days later. They finished about 80% of the job and left, never followed up with the permit application. 60 days after the date of permit application, I visited the county Permitting office and found out there's tasks pending on applicant, i.e the contractor.
So I reminded the contractor they need to fulfill the tasks. They submitted some docs, but not others.

Yesterday, the permit coordinator emailed me that there's one more document needed. The contractor bursted out with lots if insulting language toward me and finally texted "done", "bye", "bring me to court if you want", "you have no legs on this", plus all other insulting language that you don't need to hear. 

Now I'm going to get other contractors to bid on the left over and finish it. Meanwhile I'm looking at these options to deal with the flaw contractor:
1. Filing a complaint to State Home Improvement Commission for contractor's unfinished job. If approved, I can then file a claim to get some compensation from the state Guarantee Fund to get back the cost I paid new contractor to finish the job.
2. Go to Small Claim Court to hopefully get a judgment against the previous contractor up to $5000 (Better than nothing, if I ever get it)

What would you do in my situation? Do you see any other options?
Any insight, experience or advice is much appreciated.

Thank you