Commercial to Residential??

[Kameron Wilson]

This might be a bit of a stretch but im sure someone in the forums can probably answer this. 

I know that in order to get residential loans the multi family must be 1-4 units. So my question, is it possible to convert a 5 unit into a 4 unit by combining 2 of the units together and then qualify for residential lending?? 

For example can you get a hard money loan to buy the building, convert the 5 into a 4 for personal use and then refi out of the HML with a residential loan??