tenant moving, one week notice, still has property in unit

[Kyle Reed]

I have a rental in Manitowoc WI and have had an interesting time so far in the approximately two months I've owned it.  On December 9th I had a tenant text me that they would be out as of the following Saturday(12/15/18).  So Sunday 12/16/18 I went to the property, and nobody was there but the door was wide open.  Upon inspection the tenant still had table, chairs, random junk, tons of clothes, and garbage strung out across the unit, not to mention a broken window and holes in walls where it appears a body was slammed against.  I texted the tenant asking them why their stuff was not out yet and if they were planning on getting it out among other texts for keys, payments they owe, how they plan on paying for damages, etc.  They have only responded once since then and refuses to answer calls.  They simply responded "Yes I do sorry been busy" to the text asking if they still planned on getting their stuff cleaned out.  

My question to the BP World is can I legally get their stuff out so I can get it ready to rent again?  Can I change the locks since I have written notice of them being out 3 days ago?  I imagine if I do get their stuff out I have to store it for 30 days.  They were on a month to month lease the old owner had them on when they still owned it.  I elected not to make long term leases at the time of purchase since I knew nothing about the renters and wanted to wait until spring to get some history with them and make a lease during a more easily rent-able time of year.  I posted a 5 day on their door yesterday just to get the ball rolling on an eviction if necessary.  I am new to the real estate world and this is my first property.  I have and will learn a lot from this first investment and will make and have made plenty of mistakes already.  I just want to cover my bases and make sure the tenant has no ground to stand on to sue me or counter sue me as I assume I will be taking them to small claims court to get back money owed, which I assume I'll never see.