Tenant's BF is living in unit, not on lease

[Tracie Van]

In my lease I have anything longer than 2 weeks stay they need to be on the lease or get permission from me. I also include no keys given out to anyone not on the lease. 

I know this guy is living in the unit based on other tenants accounts, his car is there day and night, he takes garbage to the dumpster, he does laundry, etc. I have seen this myself as I live very close to the building. But of course, I can't really prove it. I feel like the two week section of my lease is kind of worthless in most cases  unless the tenant is willing to follow the rules. Which luckily for me, most do.

I know his name and looked him up in the court system and this is someone I do not want in my building. Eviction on file, drug charges, money owed out the butt. No job either. He also walks around the building just pacing around and its creepy because it all one-level. He is walking and pacing around people's windows. 

I'm at a loss as to what to do to get this guy out. I guess I could tell him he needs to apply, which of course would be denied as he doesn't meet the criteria, but then what? My gut tells me he will still continue to reside there.