Funding first multifamily least amount down

[Amanda W.]

Hi bigger pockets family! 

I have two single family homes in Philadelphia, currently rented, so far all good.  Funded purchase and rehab largely with cash.  Value of both $280K, I did pull $75K out of house #1 to fund purchase and rehab of second one.  

Now looking to leap to my first multifamily with OPM in Philadelphia or Northern DE.  Tri or quad.

Talked to a lender, getting advice "there's no such thing as less than 20% down", 6% interest, Fannie Mae requires 4 points at closing due to multifamily.  

I am nervous about pulling more equity out of my first two homes and want to get a mortgage with as little money down on the multifamily. 

For those who have invested in multifamily, is this what you are hearing?  Is there a better option?

Thanks!

Amanda