Hey there Casey! Although I have no experience with this, perhaps in order to prevent similar situations in the future, your lease should contain statements such as:
-zero tolerance for any illegal activity
-rights to enter the rental/property, for which reasons (i.e. repairs, inspections, etc.), how many days prior you must notify them, and how the notification will be issued.
*For your situation, maybe bring a legit inspector with you who can more easily identify suspicious activity. Also, after issuing the notification, perhaps monitor their specific section of the property, and gather intel on their doings (people coming and going, boxes/packages/backpacks/duffelbags coming and going). At least, this is what I'd do. You can always setup security cameras (all around the property, not clearly in that section alone so as to alert them that they're under surveillance).
-the consequences of continued noise complaints from neighbors/3 warning maximum for example. Then after repeated violations of the clear statement in the lease, begin filing for eviction.
OR as Brandon Turner suggests, pay the tenant two months rent to leave by a certain date. Although, not all of us can afford to do that.
From what I understand, from all of the studying I've been doing, the lease is your main source of power as a landlord/property manager. What I plan to do myself, is initiate new tenants onto my property with monthly leases/rental agreements for a month or 3 so as to get a feel for them, and if they seem fit, then offer them a yearly lease upon renewal. I feel that quality people would understand this process, should they look at things from your point of view.
I hope this helps, godspeed.