Seeking Feedback: Starting RE Portfolio w/ Time Constraints

[Justin Raddatz]

Like many folks, I desire a future of financial independence.  However, I want to give special consideration to the time demands of building a portfolio.

For folks who have completed more than a few deals, I would love your candid feedback regarding whether or not it makes sense for me to step into the game given my resource constraints.  A few highlights below to frame the situation:

• I am in my 30s, married, with our 5th child on the way.
• My learning curve is shorter than most:  I work full time W2 developing for and managing a 1,500+ unit low-income housing portfolio.
• I have access to capital (initially up to $75k friends and family, up to $40k of my own).  My private money network is much bigger after proof of concept with the first deal.
• The "Why" attached to my reasoning for considering RE is to create time, flexibility, and funds so that I can be present and participate in my family the way I want.
• I need to ensure I make family time a current priority, even during the initial stages of building a portfolio.  Until I am financially independent and can leave my W2 position, at the very most I could commit 4-6 weekday daytime hours, 3 late-night hours each night, and 3 hours each Saturday.  

Again, if you are a seasoned investor and recall the demands of getting started, would you advise someone like me towards or away from jumping into the RE game given my conditions?

Thank you.