From a tax implication standpoint, it can be tricky but if done correctly, not a problem.

Zero capital gain tax, next to zero income tax, property Tax is super small.  

If your bottom line numbers on tax returns and W2 income are not strong however, this will be an abrupt dead end.

Meet with a local banker & schedule a time to talk with a mortgage broker, they'll give you at least a baseline of what kind of down payment options and rates are out there.After that, if you're still wanting to research more creative options, do some looking into seller financing (a very hot topic with good, and bad, advice out there), look into private lenders, and commercial financing options.If you're wanting to live in 1/4 of your quadplex, then conventional residential loans may in fact be your best option as you can purchase that with a fannie/freddy loan with very low down, and use up to 75% of the income from the property toward your own income. 

I had to redo everything they did on my taxes. 

I have family in Houston, Dallas, and the Valley, I was networking with brokers in San Antonio, but the Taxes seem to be quite high as well in that State, although much favorable laws/regs on the landlord side.

I recommend that you find a trusted or recommended Mortgage Loan Originator (MLO), who can give you options for property-based loans (mostly investment loans) and they don't use your taxes but the P&L of the property.

If you need financial help, ask under the "Finance, Tax, and Legal" forum.

@Armell MayersBigger Pockets is a great place to find a real estate tax accountant.

I do like the tax benefits and leverage.