I personally am aiming for 7.5% ROI and consider diversification to be key. I will say that I'm interested in "hitting singles and doubles" and I think your active approach to investing is more like swinging for the fences. That is, with the kind of equity you have, I would say you could continue to increase and diversify your passive investments, and aim for a "barbell strategy" that combines the double-digit returns commonly earned in the MF/commercial value-add and stabilized sphere with the single digit gains you can get from anything from CDs (paying 5% per year now) to debt funds which pay 6-10% per year to stocks with dividends (2%-X% per year overall, over time).
In short, there is a huge potential to gain some major windfalls in active investing, but there is SO much work involved, and a fair amount of risk. I would say it only beats passive investing if a) you're loving the hell out of it and b) making 15%+ per year more years than not.
Otherwise, I would advise taking the easier path and letting GPs in numerous MF and commercial/industrial funds do the heavy lifting for you. You're a millionaire, that's what a millionaire can do. It's true capitalism. When that works, it's called "mailbox money," and it's absolutely feasible if you have $5m to put at risk. Using $5m in equity, an LP using a diversified barbell strategy will probably see $350k+ per year in cash flow and equity gains on average..... I left "toilets, tenants and trash", lenders, real estate agents, handymen, property managers, etc. behind a few years ago, and it's one of the best decisions my wife and I ever made. No doubt about it.
Obviously you can IM me, but I would also refer you to Brian Burke's great book The Hands-Off Investor, published by BP. It's a roadmap to making solid investments as an LP, and Praxis is a pretty good model for how a value-add MF sponsor makes money for it's investors.