I do sincerely appreciate it. 

I sincerely doubt I will get any interest on my funds and I'm sure the contract is bullet proof not in my favor.

I mean this sincerely but it seems like an odd question to ask.  

I would do recommend an amended refinance, which includes this balance and any other cost you may incur, and escrow for his taxes and since rates are rising I would recommend an increase in interest rate for your troubles. 

I started a refi process in Q4 last year to use the proceeds for a new investment property but for various reasons wasn't able to complete the transaction, thankfully since rates have come way down.

I agree with the House hacking, and sincerely wish I had been aware of this back when I first forayed into REI!

Hang on guys, before y'all go saying find a new agent and get that guy off your team, let's take a step back and think this through ... this is a RE agent, and sounds like a long time friend, telling the OP to NOT buy anything for a year at least ... the agent has negative incentive for giving this advice, so I'd say it is safe to say that it is sincere and not biased by financial incentive.

I currently live in NYC, but looking to to invest where I grew up (Lehigh Valley) since real estate prices are more reasonable there.  

I also agree that since real estate is an extremely vast and complicated matter at times that Josh and Brandon or other moderators can't be expected to be fully informed as to what is legal, ethical or good business practice in every case.

Things I do include:- Job walk with them to gauge compatibility, sincerity, aptitude- call references (what do you ask their references?)