Portfolio management vs time management

[Glen Olson]

I am a busy professional with a day job that is unrelated to real estate.  I make good money, and recently left the military.  As a new civilian, I am now a 1099 employee and do not have any W-2 income.  My wife and I got into real estate for investment and tax purposes.  We have been investing in real estate for just under 3 years now.  We have several different "types" of properties to include traditional single family rentals, one multifamily rental, lease to buy options with tenants who hope to buy from us, two short term rentals, and some agricultural farm land that is cash rent.  My question is fairly vague, but here goes.  I'm trying to decide when or if I should transition from "building the portfolio" and acquiring properties and move to paying down the loans and building cash flow.  I realize that buying more properties would allow for greater equity appreciation, but I also need to maintain awareness that buying more properties will also necessitate more time on my part.  My wife has zero interest in real estate and is not involved in the acquisition or management of real estate in any way.  I have 3 young children and need to focus on family and I don't need a second full time job.  For reference sake, we have one mortgage at 7.5%; one at 5%; and all other financing below 4% with an overall portfolio weighted average interest rate of 3.785%

I don't care too much if you have 5 properties or 500, but I'm curious if others have gone through this thought process at some point in their real estate investment journey and if so how did you make this decision?

Thanks in advance!