Looking for non commercial loan on rental property, can it be done.

[Carter Catlett]

I am trying to get a fixed term note of 15 or 30 years for a rental property ( non owner occupied)that has two duplexes on the same parcel of land. I have talked to several banks and mortgage brokers and am being told the only way to refinance this property is with another commercial 5 year note. The government regs say you can refinance using a Fannie Mae/ Freddie Mac backed loan on properties with up to four units, however, everyone so far says the units need to be under one roof. Has anybody had this experience and if so how did it work out?