It is always going to be painful, though, because our tax code is set up to punish you for excelling.

@Jeremy SchreiberI want to second the comment that managing a property out of state on your own would be a royal pain.  

As a word of caution the bigger the bank the longer and more painful the process.

I feel your pain.

It would be painful to have to revisit this in 15 years and try to argue your case.

If your answer is that I should just give them notice, then do you also have any strategies you use in cases like this to help minimize the pain?

You can't use your VA loan, the terms are worse (which is painful as a beginner), finding financing is harder, and getting sued is a statistical unicorn.

It is still a bit painful for me to even type this out.

The assessed values for tax purposes on all my properties are higher than their actual values.The county assessment is usually quite accurate and to be painfully honest if your is on the money you are lucky as assessments are usually on average higher than comps.You would wasting your time challenging what you already know is right.

It'll be a pain in your ***, but doable.