He was sick and had a psychiatric evaluation in case his mental state was in question because he was sick.I have spoken with various Real Estate and Estate attorneys regarding this and have been told that given the details of the scenario, I "should" be able to eject. 

My lease states this: (still working on the correct legal wording) Emotional Support Animals (ESA):Tenant will provide a copy of letter from a licensed mental health professional (therapist, psychologist, psychiatrist -NOT the family doctor) on his/her letterhead that states the person is under his/her care, is emotionally or psychiatrically disabled, and prescribes for the person an emotional support animal.

Are you providing psychiatric treatment to the patient?

But, unless someone is under psychiatric care, and considered a risk, gun ownership cannot be denied.

And you're right that psychiatric or emotional support animals are not allowed in public. 

The ESA doctor website says: "Although support animals provide companionship, they are not given basic legal protections like service animals (SA) or Psychiatric Service Dogs (PSD) under ADA.

Background as a psychiatric, pediatric, and school nurse, also a professor, and a mom.