There are obviously tax implications to differentiating between the two...the biggest being that you can only deduct a portion of the depreciation on a "Second home" (based on how many days you, personally, spent in it the previous year). 

Where do I plug the numbers now for legal fees spent trying to recoup this lost taxable income? 

I'd recommend taking a Saturday afternoon drive to see it up close if you haven't spent much time down here.

Growing up I spent a lot time with my Dad flipping SFH homes.

This is not a revelation to anyone.You're also correct when you say there is only so much agent advertising dollars being spent.

I leased the office under my brokerage but the majority of my time will be spent wholesaling/real estate investing.

If I spent half as much time on BiggerPockets as I did on the Lincoln strip in college, I'd probably be retired.I'm going to throw you a bone here.

Having spent a few years there after getting out of the military (Navy) I somehow ended up in Saratoga Springs in upstate New York.

We spent about a week doing clean up, repainting and new carpets.

My wife will say I've spent too much time in the 'hood when I'm talking like an ex-con at home.Currently reading Millionaire Real Estate Investor by Gary Keller.