She was a great tenant, but one day I get a call from the police saying they have my tenant with them and would like me to talk with her.

If this is the case, then I will have to file a police report documenting the theft. 

Would you call the police or just fix it, put a lock on and move on?

My attorney and my home insurance adjuster have both said I should file a Police report, and pursue damages.

The city isn't currently strong on policing BUT you could get into trouble if one of the neighbors is an str hater and documents the guests/nights.

There is a zero percent chance the police are going to remove an occupant who has lives in the property. 

Normally you should call the police, but it may not be worth it and will inflate an issue that most likly is going to go away by itself once you have rented your property.  

Hi, My name is Aaron Murray and I live in Red Bluff, California where  work as a police sergeant.

This crime area covers Post to Mitthoeffer West to East and 42nd to 38th North to South. https://www.wthr.com/article/one-fatally-shot-anot...https://www.wthr.com/article/metro-police-investig...https://www.wishtv.com/news/crime-watch-8/resident...https://fox59.com/2018/01/18/impd-discovers-body-b...

The police know them by name, no doubt.