Owner Occupied Multifamily Financing with <5% down?

[Matt Rothwell]

I'm looking to buy a duplex to live in. I've been pursuing FHA loans because I'd like to put as little cash down as possible to have money for renovations, maintenance and improvements. However, the fees associated with the FHA loans seriously make my head spin. The consensus, from calling around random lenders, is that while its not illegal to lend on >80% LTV loans for multifamily properties, nobody does it. That seems crazy to me though, like they'd be missing a huge corner of the loan market.

Does anyone know of any banks that will do a ~95% LTV loan on an owner occupied multifamily property in North Carolina (specifically the Raleigh Durham Triangle Area?)