@Matthew Hamilton
So, for what it's worth, here's my $0.02. If you were in your 30's or 40's and had a wife and a couple kids, I would say to stick with your job and grind it out. However, you're in a great position (early 20's, unmarried, no kids) to be flexible and make a drastic change. If you really hate your job and you know 100% that it's NOT what you want, I would say make the switch as soon as possible. Life is too short to spend it doing things that make you miserable.
With that being said, I would still advise you to be smart about how you proceed. Making a career switch while also moving to a new city could mean no income for a while so if I were you, I would make sure that I was 100% debt free (no CC debt, no car payment) and that I had significant reserves in the bank to cover my living expenses for at least 3-6 months. This will give you time to get settled into your new city, get a job (whether RE agent, PM, etc), and get some steady income flowing.
As others have mentioned, not having W-2 income will make it nearly impossible to get a loan so you may have to delay your investment goals until you get established in your new career. The rule of thumb for 1099 income (such as the commission-based income that RE agents make) is that lenders like to see 2 years of history before they'll lend to you. But if you're ok with delaying your investment goals for the short term so that you can make a long term play, it can definitely be done. Investing as an agent/PM will also be much easier for you and you'll come across much better deals since you'll be tied into the local RE network and will be among the first to know about off-market listings, pocket listings, reluctant and tired landlords etc.
And regarding being an RE agent, others have cautioned you that you probably won't make any money your first year and possibly very little in your second year. While there is truth in that statement for the average person, I would say that it doesn't apply to everyone. You, my friend, are not average. If you were, you'd be content with your LE job, your steady pay and your benefits. If you were average, you wouldn't be considering doing what your considering, and you wouldn't be on this message board. You know yourself, your work ethic, and your level of commitment. If you really want this and you're willing to grind 24/7 to get off to a fast start as an agent, it can be done. My wife made over $100,000 in her first 9 months as an agent while she had classmates from her RE school that had to pick up 2nd jobs just to get by. She succeeded where her classmates didn't because she put the work in and was committed. She made herself available to her clients 24/7 and was appropriately compensated. Being a great RE agent is NOT a part time gig. Clients aren't willing to work around your full time job. They expect you to work around theirs and to be available when they need you to be. To be successful and to make a name for yourself, you have to be willing to hustle and hustle hard. If you can do that, you'll be just fine.
I would advise you to start researching the market where you plan to move to. Find out who the top agents in the area are (a simple google search will answer this). Find out who the top RE teams are. Reach out to those people, let them know your plans, ask for advice, and start networking. Research the local economy. Make sure it's an expanding market with lots of potential. You don't want to move to a declining or stagnant market to be an RE agent because you'd just be setting yourself up for failure.
I think @Brad Larsen also gave you some great advice about the benefits of a career in Property Management as well as advice on taking a gamble on yourself, the way he did. I concur with him when he said to take action now. Be smart and have a plan but if you know this is what you want, then go get it. Fortune favors the bold my friend.
Good luck!