LIke You I look at every property to see what would be the best end result and match that to my current needs. 

where are you looking for the perfect tenant?

They are after all perfect examples of what NOT to do. 

So I figure this would be the perfect time to start.

An excuse to talk to the boss would be perfect to verify this.

A mortgage broker working with investors should also have a good network of private lenders s/he can match-up with investor borrowers.While you have what sounds like a good rapport with your existing broker, have a blunt discussion with her to verify she has the experience and reach to embark on this venture with you.

Don't get hung up on getting it perfect because it will never be perfect.

Certain aspects of the lot make it less than perfect, but will also probably help to keep me within reality budget wise as I move forward building my first (and hopefully my 'dream') home!  

Welcome @Nicholas Romeo a fellow newbie and NJ resident :) I'm intrigued by note investing as well and BP is the perfect place to learn. 

No company is perfect by any means but if your looking for excellent customer service and a quality product from a reputable company you might want to contact @Chris Clothier who is a regular here also.