Or even better check into the HUD rehab financing program known as 203(K). 

My partner was about to spend $25k on a flipping program.

We bought a duplex in south Austin with the intent of living there and renting out the other half through the 203K loan program.  

Sounds like you're familiar with the HERO program or Cal First.

For those of you who have a vacation condo, do you use the resort’s rental program or do you market your rental yourself through sites like VRBO or HOMEAWAY and find your own cleaning company, etc.?

@Emilio Vernaza I spoke with a lender friend of mine that says he has lending programs that will work for you.  

Don't buy crap that you don't needThere are down payment assistance programs that can help you, but without your debt to earnings ratio and your credit history being strong, all the down payment assistance is not going to help you with the end goal of owning a home@Bill Gulley

That is one of the basic eligibility requirements of the program.

Along with being in an real estate education program. 

I served 4 years in the US Navy and currently work in the Hospitality industry.I have had an interest in REI for quite some time now, I purchased a program ($2,500) a couple years ago but did nothing with it as I was working two jobs and was "overwhelmed" which should have been no excuse but you live and you learn.