Chad, I do share some secured and confidential information with my VA's like email accounts but I would definitely think twice about delegating that kind of work where you will have to give someone else access to that kind of sensitive info. Unless of course, the person has worked for you a long time and you have gauged her integrity, if you've come to fully trust someone.
You can outsource most admin and support tasks but if there are monetary transactions and funds or bank accounts involved, you'd want to limit it to where the VA won't need to have access to it.
I understand how those kind of work can eat up valuable time on your part, as well. Maybe what you can do is, hire from a VA company instead. Those agencies that have people work for them and accept clients wanting work to be outsourced. I think these companies have contracts and the workers are managed. Cost may be slightly more but I'm almost sure for not much.
My VA's are freelancers, they work on their own so I wouldn't know of any specific place where to find those but I'm sure there are out there.