Can You Change Your Primary Residence in the 1st Year???

[Stephen DeThample]

Can you change your primary residence in the 1st year of ownership to a new house?  

For example: You buy a house 3 months ago as your primary residence and you find a better house and can afford both loans, is it possible to change your primary residence or do you have to wait a year and refinance? 

Thank You,