How soon can I refinance owner occupy to investment?

[Byron Broughten]

I've been digging through old threads and haven't found a clear answer to this.

If I get a conventional loan for a primary residence duplex, lets say with 5% down, but then I quickly build equity up to 20%, can I--before a year is up--legally move out of the property and rent out the unit I was occupying if I refinance under the pretense that the property will be used as an investment property? And if so, how long must I wait to do that refinance?