We owe about $840,000, so we now have a total of ~$702,500 in equity, we are now only about 54% leveraged with our commercial loan, and we have a "machine" that cashflows a total of ~$3649/mo (once those two vacant units are filled).

Now, you very likely do not mean it that way but that is what it means to loan originators.

If you can't fully pay it off, you can most likely ask your lender to recast the loan for a small one-time fee (e.g. $400). 

However, I do have about $100k in student loans at a 5.5% interest rate over a 10-year term.

Currently I own a home which I purchased at the end of 2020 with a conventional loan, 2.62% interest rate and 20% down.

Good chance you'll be required to personally guarantee the loan anyways, no matter what your structure is. 

I've called a few lenders and landed on one that's gotten me pre-approved for a loan so I know what price range I should look in.

My realtor let me know they’re wanting a cash buyer.So my question is, would me(the buyer intending to use VA Loan) still be able to pursue this property with a loan if they’re trying to get cash..?

And I do believe this industry needs restructuration in term of the length of financing being offered, maybe by 2033 there is no more lending offering 5 years loan, everyone is offering 15 years loan for CRE.

What is the total loan amount?