Mainly because our equity would have soared since then, we would have definitely been able to rent it out now with a great cash flow, and the commute would have been better for us. 

Ooohkay , So are we all just going to ignore Jim K's comment ummk.

If so, are their any time constraints on building our primary residence?

Regardless of my personal situation or that of the properties themselves.I am trying to work with local banks and credit unions; while that is much more difficult to navigate, and the fixed costs of doing so are high, we haven't even gotten to the point of the question of 4 properties or more - which I now need to start asking up front.Problem is, at least in the case of TD, I am even being told they won't do a refinancing for me on this property because of '4 being financed', which seems crazy to me.Does anybody have any ideas or guidance as to how I could proceed to try to pull some equity out of this place?

Your housing market is insanely high and so are your property taxes.

If so are there any specific rules against it?

Most of the apartment communities off of Wendover are pretty decent, so are some of the communities off of McConnel but again make sure you do your due diligence and look at the crime reports.

@Kevin Nisly yes you are crazy but so are are most of us on BP!

Yup so are we , Look here comes Steve , he called him too .  

We are in Chattanooga, TN but have invested in South Georgia so are often coming through the Atlanta area.