@Takeshia Martin Ultimately, this is a question of how risk averse you are. I definitely feel your pain and many of us have had this same inner conversation. However, as much as I would love to be a full time investor, I'm too risk averse to walk away from a good paying job to take such a big chance. I've decided to keep working until I'm able to replace my current income w/ passive income. The pro is the ability to save, plan and not have to worry about paying my bills. The con, is I'm giving up ~40hrs/ wk that could be used to look for deals/ submit offers/ market/ etc.
Maybe there's a middle option here? For example, I used to work a lot of hours as well (I was a consultant). When I quit, I made it a point to find someplace that values work-life balance. Now, I have a lot more free time to focus on REI without giving up on the stability that I value from being employed.
Whatever you do, make sure you think the decision through. The best time to take a risk is when you're young. However, that doesn't mean taking a risk is the right thing to do. I wish you well either way :)