How do I finance buying land and building a fourplex?

[Ellie Narie]

I'm interested in house hacking. In my area, it is cheaper to build than to buy, and there aren't that many houses to buy to begin with, because it's a small town. So, I'm interested in buying land, building a fourplex, and living in one of the units. How do I finance this? 

I looked into FHA, but they say that constuction-to-perm is only for single family homes. USDA is also only for single family homes. Do I really have to cough up the 20% down payment to do this? Or are there other options with a low downpayment?