Molly, I have a similar situation where my close network of friends also want nothing to do with real estate investment for a myriad of reasons. I'm the lone investor in my group charging ahead with buying rentals. I still have a full-time job, but I'm getting extremely close to having the ability to support my family from rental income and other related investments if I lost my job.
I tend not to talk about RE investment with friends not in the business, but recently one of my friends did ask me why I put so much at risk buying rentals. He said it definitely wasn't for him. The funny thing was that this friend recently purchased a new truck for $40K. In 3 years that truck will have a value of about $18K. It's a mindset that some people will never have or get. Maybe they didn't have a mentor at a younger age to teach them cash-flow, or maybe the RE bubble scared them. Who knows, but it all makes sense to me, and over the past 6 years of buying rental property I haven't regretted any of my purchases. My only regret is that I didn't get started at a younger age.
We have not had any catastrophic events happen either, other than one or two bad tenants that have cost us a few thousand in repairs/rent, but these are lessons learned and were completed expected to happen at one point in this business.
Good luck, and I wouldn't let the lack of interest of your friends question your strategy and long term goals. Mitigate your risk by purchasing smartly and incorporating solid layers of protection from catastrophic and liability events and you will be fine.