Hey @Conner Hitchcock, hate to hear this for you man. Fellow investor and Richmond Realtor here.
Unfortunately, it sounds like you were underrepresented by your agent and missed out on having a qualified set of inspector eyes to scope this home out in 2020. Buying a poorly flipped house, in my opinion, can hurt a lot more than buying an old, completely outdated house.
A few questions. Where is this house located? Is it in an area that is appreciating? You said if you sold, you'd lose most of the equity (down payment) in the sale, and then would move back into the townhouse to begin saving again. If you're in an appreciating area, I'd really try and keep the house, so you don't start back at zero to begin saving again. I'd love to see you salvage the equity you have and see it grow.
In order to see if that is worth the effort, I'd highly recommend having an inspector come and check the house out to see what else is going on. I'd also get some 2nd opinions on the crawl space. Hopefully you didn't have JES come out - they'll upsell and over charge every time. I have a fantastic Renovation Coach who isn't an inspector, but knows homes better than anyone I've seen. For $150, he'll walk the property and "inspect" it and help you know if you have any other major red flags to deal with. Let me know if you'd like his contact.
If the inspections are satisfactory, I might use some equity (or cash flow) from the townhouse to begin paying down the roof debt, and find a way to improve the mess that the flippers left, and keep the house. (This coming from a realtor who benefits from selling houses). Then, when rates come back down in 1-2 years, you could refinance and improve your rate and payment a bit, maybe even get enough money out of the refi to pay off your roof debt.
If this house is not in an appreciating area, or if the inspections reveal more necessary repairs than you can stomach, then maybe it's time to sell. The problem being, the next buyer's inspection will likely reveal these same issues, and you could be caught needing to make the repairs or issuing credits to a future buyer. At the end of the day, they still may bite you. The best you could hope for in that case would be selling in a hot Spring market where some/all of the inspection is waived by the buyer.
I'd be happy to process more with you, send some good contacts your way, or bow out. Let me know if I can help!