Duplex under contract! Lender want 20% down. Primary res

[Micah Carter]

Have a duplex under contract. Moving into the top unit and renting the bottom unit out. Currently working with a credit union but appraiser went out.. called it a duplex instead of a SFR because the basement isn't accessible from the main floor. They are now requiring 20% down. Calling around to different lenders now... I have heard a lot of people talk about conventional financing with 5% down on a primary residence with 1-4 units.. any recommendations??? Help!!!