The biggest factor that "gurus" like Ramsey and Orman stress is your level of comfort with risk. How are your other finances, other debt, stable job, good steady income, family counting on you? Higher risk can come with higher reward...but if those risks backfire how screwed are you going to be? Long term, can you weather a down turn or are you going to be hosed if the market goes down for a couple of years? Or one deal kicks you in the nuts and you lose a big chunk of $$....can you handle it?
The upside of paying down your mortgage early is that you can save a ton of $$ on interest in the long run. But you COULD make more $$ by investing it... the big part of that is COULD...... again, if you play conservative with your investments you make conservative gains.... go risky and you may make more $$ but can you handle the years when you don't?
Upside of paying off your mortgage early........ the house is paid for.... as long as you can pay the taxes, insurance and basic utilities, then you will never be out on the streets if you lose your job, get sick/injured etc. Its also an asset you can leverage via HELOCs etc.
There is no right answer.....if you like to play it safe, then pay off the house IF you can do it quickly. If making those extra payments only pays if off 5 years early, an until then, you cant get into other investments, then its a bad idea.
I started off doing traditional investments while paying extra on my mortgage...... our income went up and I started buying rentals too, while paying extra on my mortgage..... got a small inheritance....bought some more rentals. With my income going up and my rentals doing well, I was just able to pay the last 82k on my primary residence mortgage... its done.... could I have used that 82k to invest in something else that MAY have netted me more $$?...maybe. But I chose the safety and satisfaction and net interest saving of paying off my house. Now I'm planning on using my HELOC to leverage and buy more rentals. via the BRRR method.
My "traditional" investments were netting on average 6% over the last 7-8 years with some years complete **** and other decent. My mortgage was 3.5% 30 year fixed. When I looked at how much $$ I was actually paying for my house over that 30 year period, I wanted to vomit. It was pretty much double....
Its all risk vs reward and your situation financially and your goals. Risk may pay off big time or it may kick you in the nuts.... its up to you to decide what YOU feel comfortable with...