Me and my husband are in a similar situation like yours, we both still have our full-time jobs AND an active investor, and my husband is still doing his side hustle as an agent, keep in mind that we still manage our client properties too. He's still doing that for 10 years and work PERFECTLY for both of us!
Writing up an offer for client is the most challenging one for the first time because you need to setup everything at first, but because you're working remotely, you have no problem with that. Everything can be done electronically nowadays. Showing properties to client can be done during weekend and after work. During escrow process is also time consuming because you need to submit a lot of paperwork to escrow, but if you only have 1-2 clients, you won't have a problem with that.
My husband likes to have his time allocated to find some investment properties for our portfolios rather than being a full-time real estate agent and I fully support him and we are right on track. We have 30 investment properties all over the states already by now.
Bottomline: You do NOT need to be a full-time real estate agent to be successful.
Hope that helps!