Help: Paint peeling off walls like rubber

[Revis Boyd Isbell III]

I just bought a foreclosure and am in the process of renovating and getting it ready to put on the market for rent. We were not able to view the property before hand but did have pictures and a assessment of the property to go off of.

When we finally closed and went inside to look it over and get a plan together, we noticed that the paint was peeling (the LR and hallway are a lime green and every other room in the house is a different color) in just about every room.

I started to peel a bit off to see what the deal was and the paint peels off in huge sheets and feels almost like rubber. In the other rooms it peels the same but is not as thick and does not peel off in sheets. Pics are below.

My question is how do I get this paint off the walls in a quick and efficient way. I do not want to paint over them for fear of the new paint eventually doing the same thing when I have a tenant in the home. Any and all help is appreciated. Thanks