@Tyler Hardy, I own a small office building in Brunswick, ME population 20,000. Here's some info:
1) Prior to purchasing my 4-office building, I rented space in a 15-office building. We had one receptionist for the building and most of the business were 1 or 2 people companies. There were a couple sales reps for a food company as well.
2) I bought my building 4 years ago and had no trouble finding tenants. One tenant left in April of this year due to the impact of COVID on her business. I had multiple great applications for the office space and moved a quality tenant in on July 1.
3) I cover all utilities except phone (most of us use VOIP). I do this because I want it to be very easy for a tenant to move in and just pay the one monthly bill. This would be particularly beneficial for someone looking for their first office. It's a really big deal for the micro-business to get their first brick and mortar office and simplifying that process for them makes them more likely to select your building.
4) Dedicated off-street parking and every office has its own entrance. There's a severe shortage of parking in our small town so this was huge. I have enough parking that in addition to the four offices, I lease 6 parking spots to an area business.
5) Co-working space is a different animal than what I am doing and may be a good set up for you. It takes more work to manage co-working space, however, and would come with more upfront costs, furniture being the big one.
6) In addition to my accounting practice, I had another tenant lined up prior to closing. That relieved a lot of pressure.
7) Regardless of what the economy looks like post-COVID, I believe that the type of small office space you are describing will always be in demand for exactly the reason that you are looking for it.
Hope this helps,