How do I find a GSA loan agent Any reputable mortgage company will have FHA fannie or freddie products. 

Most brokers we call joker brokers and they destroy any reputation quickly.

Im curious if anyone knows a reputable property manager in the New Haven area that could manage a duplex? 

The ride is 2 hours one way(4 hours round-trip).If you were serious - I would consider making the trip to explore the market every so often.

I recommend Lev Capital as a broker to explore this with.

Perhaps it is worth exploring the reason a naysayer is a problem.  

When my current tenants move out I'm considering exploring this option to encourage a long term tenant.  

Our realtors reputation is what gets us our houses, on the other hand, they have to preserve it too.

Have a conversation with the association to get their side of the story and build a relationship (they have a great reputation in town so wondering why they've gotten into this mess).

you will need a private money second or a money partner.Things to watch out for: Only use a reputable lender, watch out for all the fees (appraisal, loan app fee, processing fee, notary fee, points, etc), be careful of those who may promise one thing but have more intention or ability to perform on it (over promise, under deliver), and make sure you fully understand all the docs you are signing.