Not that there isn't some opportunity, but investing from afar, I don't really have the chance to get a crew that can do the rehab on the homes that I think would turn a profit. 

CA has no financial capacity to fill that void, not a chance.

I'll only add when talking to brokers have a "buy box" defined and research commercial deals to understand it as best you can before you have your first meeting or your broker contact will likely consider you to be a low-chance buyer and not take you seriously.

You need to minimize upfront expenses because 100% of your investment is at risk and lost if the lot is not buildable.My favorite strategy is to locate the property and tie it up for usually no more than $100 for a period of 8-12 months, analyze it myself and if I believe it to have a chance at being buildable I create a permitting plan and market the property to other investors/builders willing to take on the permitting risk.  

If I don't feel comfortable I also give folks a chance to get a cosigners.

After a bit of back-and-forth on the repair costs, I negotiated it down to $69,000, convincing them the extent of repairs was higher than they initially estimated.

After a bit of back-and-forth on the repair costs, I negotiated it down to $69,000, convincing them the extent of repairs was higher than they initially estimated.

I could put a down payment for a conventional (20-25%) 550k duplex, but I feel it could hurt my chances of buying as many duplexes in a 5 year period (for example) if I go conventional VS an FHA at 3.5%. 

People all of the time, "over estimate" the opportunity and "underestimate" the cost and challenges in doing a profitable flip.

Ask them to do a cost estimate.