So any hiccup in life, they would need to worry about how to pay rent or buy food if they spend all their money on a wholesaling operation that still required them to essentially give up all their free hours.Maybe I'm too risk adverse.

If you are risk adverse real estate, (especially out of state) is not for you.

My first year there were a lot of struggles and I faced a lot of adversity but I just kept pushing and during my second year I made 3 times my annual salary of my old job. 

You'll want to start building a credibility kit and getting some references, etc. to overcome all that stuff.

Their excitement level increases and a sense of joy overcomes them just to find out that the letter is from a stranger wanting to buy their house.With that said some of these people are just crazy anyway.

A notice is taken to be received:i.in the case of a notice delivered by hand, when so delivered;ii.in the case of a notice sent by pre paid post, on the third day after the date of posting;iii.in the case of a notice sent by facsimile, upon the receipt by the sender of a transmission report from the dispatching facsimile machine which confirms that the facsimile has been successfully sent; oriv.in the case of a notice sent by email, upon the receipt by the sender of a confirmation from the recipient or the recipient's email server that the email has been received by the recipient.b.If any provision of this Agreement is judged invalid or unenforceable for any reason whatsoever by a court of competent jurisdiction, such invalidity or unenforceability (unless deletion of such provision would materially adversely affect one of the parties) will not affect the operation or interpretation of any other provision of this Agreement to the intent that the invalid or unenforceable provision will be treated as severed from this Agreement.c.This agreement is governed by, and must be construed in accordance with, the laws of the State of Victoria, Australia and the parties irrevocably submit to the exclusive jurisdiction of the courts of the State of Victoria, Australia and their Courts of Appeal.

My friend Ed (an octogenarian) reminds me, "Any problem that you can fix with a checkbook really isn't much of a problem".From Napoleon Hill: "In every adverse event lies the seed of an equal or greater benefit".

To overcome fear and conquer your demons is absolutely a rush that all should experience.

I suggest you find another agent or tell your existing agent that he/she needs to come up with a better pitch and figure out how to overcome the objections. 

As others get more risk tolerant, the smart investor becomes more adverse.