(IE I hate people selling me things, but I'm going to have to be a salesman of sorts myself if I hope to be successful.)
My friend, I think you are confusing what it is to sale something. It's only negative if you're offering a bad product or dishonest service. If I'm selling kids drugs that's bad, if I'm selling the cure to cancer that's good. What you have to offer is good because you're not going to take advantage of people, whether it be as a landlord (buy and hold), selling a home to someone (flipping) or anything else related to RE.
You're right, you might someday get taken of advantage of, that is a possibility. You might get a bad deal, or a tenant that doesn't pay rent or destroys your property. Bad things are going to happen to you rather you chase this dream or not, that's life. The important question we must ask ourselves is not what happens to us but how we respond. So I encourage you to get over whatever hurdles have been keeping you down and make it happen in your life :) Have a wonderful night