May require paying a tiny bit more and having all of your personal and rental policies with the same company, but honestly not having the extra complexity is nice.

I talk a lot about opportunity cost and long term outlook here in the forums, so let's compare the two strategies over the next 20-30-years:You could stay in your interest only loan and enjoy better cash flow, to the tune of an extra $450/mo in your pocket.

Agree with @Michael Hacker, the extra weight might be your biggest concern. 

Typically, no extra cost, if there is town pick up.

It takes 45 days or more to close with a 203(k) due to all the red tape and contractors and our seller kept threatening to back out of the deal and demanding extra money every time it delayed but we eventually did close and it was worth it. 

I would assume you spent extra money on this mirror so you could attract and keep a quality tennant and would hate to loose out and have to pay to have a vaccancy and find a new tennant.  

I would imagine that in your part of New Jersey, the extra income would be significant (maybe 12k per year?).

Personally, spending the extra money on a home warranty for rentals is a waste of money.

You might have a few dripping faucets and a toilet running occasionally costing you a few hundred extra per month.  

@Nate Bulkowski - If you go the route of 1031 and have have difficulties completing the 1031 exchange on the capital gain portion, consider opportunity zone investments.