You know Annette, I've come to realize that people always want to see you doing great, but nobody ever wants to see you do better than them. The reason the naysayers exist to begin with is because they don't feel that they themselves can do what you're doing, or maybe they tried to do it and it didn't work out for them. Those naysayers will say whatever it is to justify their own failures such as, "Yeah, Real Estate is a tough gig, are you sure you want to do it? I mean, I tried to get into it last year and let me tell ya, I couldn't find any good deals! The market just isn't quite like how it was in 2008!" (Can you tell I've heard this once or twice before? :] )
Sadly, we live in a society where we've been molded to believe that the path to a successful life is to go college, and then work at some 9 - 5 job for most of your life, and then retire at 65. Doing anything else is seen as extreme, or crazy and will guarantee you criticism from people who don't understand why it is that you're doing what you're doing.
You sound like you know what it is you want from life, Annette. Keep doing what you're doing and I have no doubt that you'll go far!