@Leeling Chew, Sounds like you have an irrational tenant. So advice to get the house against him and he will move out on his own is HIGHLY unlikely. From what you stated, you have enough to substantiate his eviction, but you must be able to prove those incidents. This is where you might be lacking.
You have not documented these incidents, nor have YOU informed your tenant this behavior is unacceptable. Any Judge you tell that in court, will NOT be sympathetic to you, if you have not informed the tenant of these violations. Nor will you get a Constable to go with you if you have not confronted the issues ahead of time......unless you encounter physical violence or a threat to your life, I highly doubt you will get any support in giving an eviction notice to a tenant. You can't even get an officer to a traffic accident anymore and how many domestic violence situations happen with little to no attention.
DISCLOSURE
THE FOLLOWING IS FOR INFORMATION ONLY, AS I AM NOT AN ATTORNEY, YOU SHOULD SEEK PROFESSIONAL LEGAL ADVICE.
So what must you do? Start by being actively involved with your PROPERTY MANAGEMENT duties. You don't have a property manager, because if you did they would be handling these duties. But you are putting your other tenants in danger by not managing YOUR RESPONSIBILITIES. You need to either, hire a competent property manager or GROW a BACKBØNE and manage your properties.
Steps to do now.
1. Type up a DEMAND LETTER (some people call it a NOTICE TO EVICT). Out-line in that letter the violations according to the lease that he is in violation. I am assuming this is in TEXAS (I am editing this as I thought I was in the Austin Fourm, I understand now that you might not be in Texas) as each state has their own set of laws that property managers must follow. You have to give a time period for him to fix or "cure" these violations. Until you do this step, no court will even address your concerns. For MOST counties the time period is at least 3 days notice required (for your tenant to comply). If not then the letter says he must move out. In many cases, this solves your problem, either they start complying or they actually move out!!!!! You must give him this letter in writing, or certified mail, or tape the letter on his door.
2. If he doesn't move out you have to go to your county precinct office and file for eviction, at which time they will give you a court date and a constable will notify your tenant of the court date. Then at the court you will be the "prosecutor" and must out line the violations according to the lease, and show the efforts you gave your tenant to solve those items.
3. If you do a good job, the judge will reward you with an eviction, usually 5 days for the tenant to vacate (five days because that is the time period that tenant has to file for an appeal of the judges verdict). Now, if the tenant does not vacate after 5 days, then you must go back to the court to get a Writ of Possession. Then the court will send out a constable to physically remove the tenant.
Now some food for thought. The fact you brought this up on this board with this situation tells me that you are fairly new to renting by the room. This is usually done to increase your rental income but it comes with a price as you are finding out. Additionally, I am beginning to believe you don't live there to be the "house monitor" as this seems to be going on for a time period.
YOU need to understand that you are ASSUMING a lot of RISK managing your property as you are (room by room). YOU and ONLY YOU, are responsible for maintaining order in your house. If you were renting to an only a couple as a long term tenant and they beat each other up (domestic violence) your liability is minimal. But because you rent by the room and YOU SELECTED the roommates (for which the other roommates had no control over), that makes you directly responsible to the other tenants should any harm or damage come to them. If the rules are violated and you were lazy-fare in addressing the violations, YOU become directly responsible legal and otherwise.
You should consult a lawyer to completely understand your responsibilities and your liabilities as they are magnified when renting room by room. Good luck.