Purchasing a 3rd Property - Duplex

[Rodrigo O.]

Hi everyone, this is my first post in the community. I've been following BiggerPockets for a while, but have not really dipped my feet in too much in fear of getting an information overload. But I think it's time now, before I make my next big purchase!

Basically, I have 2 properties:

1st, I purchased a Condo 3 yrs ago, where I live now.
2nd, I purchased a single-family residence 3 months ago, currently rented.

My intentions were to move into the 2nd home, but the renters have been living there for 3 years and are happy there, plus I am comfortable in the Condo. I took out a conventional home mortgage for both homes and put 20% down on both. My goal is a healthy cash flow; hence I didn't want to pay PMI on either and have low monthly payments. The bank lent me a 2nd home mortgage since my initial intention was to move in, but I later changed my mind when I talked to the tenants.

Now that I covered my background, my next wish is to buy a duplex. However, I think I screwed up in using a "Home" loan for the single-family home, so I'm worried I will have to get an investor's loan and have to put 20-25% down forcibly. Will this happen? I will be moving into one side of the duplex, and rent the second. Since I have 20%+ equity in both of my present properties, will a bank allow me to use a home-buyer's conventional or FHA loan on the duplex? Is it really subjective? Any recommendations on how I can buy a duplex putting only 3.5 or 5% down?

Thanks all!!