rental duplex is dirty - can I back off?

[Il-Hyung Cho]

I got into my rental duplex last night. Before signing the lease, I asked one of my wife's collegue to check for it. (I was in MI, now I am in WA.)
He said it looked OK, and the landlord said the duplex would be professionially cleaned before move in. What I found was dirty floor, dirty oven, dirty bathroom (walls with molds and strange orange/brown color stuff), not working blinds, window screens with many holes, front porch with lots of spider webs, holes (punched in) in a bedroom door, etc. (I am in a college town.)
What is my choice?
I already paid the first month and the last month rent. I still need to pay for the security deposit.
Can I back off and ask for a full refund? This landlord seems to be a typical one that would give tennants a headache after headache.
Can a landloard legally rent a property not cleaned?

Thanks for your help,.