We were able to get into it with a 5% down primary residence loan.

If so and the monthly payment isn't too bad then you're still moving the needle forward if your main goal is wealth generation and not just cash flow. 

Quote from @Zeona McIntyre: Hey @Blake Winiecki I imagine you live in Florida but I would reconsider investing the area for one main reason - climate change.

That is me reading between the lines, and I would suggest partnering with someone who has the money.

To me house hacking is one of the simplest ways of jumping into real estate an acquiring properties, especially if you are handy. 

Several options you can explore to get the down payment capital: Solo401k; HELOC on personal residence or from equity of the SFR; Cash Value Life Insurance Policy; Business Credit; Private Lenders, to name a few.

You can apply for permanent residency after five years.

This means that your permanent residence is excluded (except if you are doing a house hack in which the part that is rented out is eligible for cost segregation).

-how many bathrooms per resident have you found to be successful?

Quote from @Salil Surendran: Just rented out my primary residence and researching insurance coverage.