Thanks for the input folks. That's all great and useful advice. In response to some:
I do have a contractor coming through that I plan to bounce these ideas off of. I'll advise what the options are.
I also have a property manager who will be walking through to property soon to give an idea of what rents will be reno vs. no reno, but I'm anticipating something in the neighborhood of $800-$900 for little/no reno, vs $1100-$1200 for light rehab (patch/paint drywall, some floors, and probably these bathrooms). I believe the neighborhood is sort of a C+ neighborhood bordering some B/B+ neighborhoods.
I want to renovate the baths for two reasons. First, I'd like to force some equity for when the time comes to put a mortgage on the property and cash-out. This will be far from a perfect BRRRR as I'll be leaving cash in the deal for sure, but if I can spend $10k on the bath and get an extra $15k on appraisal it seems to make sense. Second, I feel like the property would be crossed off of a lot of potential tenants lists having no shower, and in its current configuration, if I just threw a shower in there without replacing the window/tub/surround it would only be a matter of time (probably not much time) before water started getting out and eating the house which I hope to own for a long time. I try to imagine my young kids using this bathroom and what it would look like over time if they did, and based on how it looks now, I'm certain my kids would have that place consistently soaked with water going everywhere and covered in mold/mildew/rot within less than a year :P
I'm definitely not against leaving them as is if it makes more sense financially, I'm just not convinced that it will in the long term.