Need Opinion on refinance Contract..

[Rylan Powell]

Hi! Need a little bit of advice from you pros. I'm 21- itching to be a landlord.

I purchased my first home last year on 11/8/18. I used a first time home buyer program to purchase- so my interest rate was a little bit higher than what I wanted. I had planned to, after a year, purchase another home contingent on having a signed lease for my first home. The contract required that residence to be my primary for 12 months. Recently, I refinanced to lower my rate, get a lower payment, and go to a conventional loan so that the rent would bring in more money for me and I could use FHA for the next purchase.. This moved my loan from one company to a new one. After the refinance, I contacted the new company to see if they would allow me to move out a month early and start looking for another home. They responded and said that I am mistaken and this has to be my primary residence until 9/8/2020 now.. Reading the contract, though, it states that the home must be my primary residence for 12 months starting when I first occupy the property. Nowhere does it say a refinance resets this 12 month period.. I have the documents showing where I closed and made it my primary on 11/8/18.

 Did I screw myself over refinancing? Let me know your opinion on this and what you would do in my situation.. 

Thanks!