I think the biggest obstacle I am thinking of after reading some comments would be the objection from neighbors.

It depends on your objectives and capabilities. 

You propose it is not a "business model" or a "process" but you real objections seem to be with the quality of the deals presented.   

Started by building a personal home with the objective to turn it into an investment property How did you find this deal and how did you negotiate it?

That way you take a less emotional stance and look at applicants objectively.  

Avoid the "shiny object syndrome" by narrowing down your niche as soon as possible.

However, generally speaking those will be C-Class single families but it all depends on your goals and objectives.

I will talk with my partner and we are going to do our best to find a solution for every objection a RE investor like you may have. 

More information is needed, and I’m curious about the reason for your question and the objective.

Really defining what your definition of wealth is can (1) provide that continuous motivation to save towards your goals and (2) help prevent you from spending on things that diverge from your goals due to “shiny object syndrome”.Again, I think your on the right path and kudos to you!