Should I expect a contractor to work everyday?

[Joe Cassandra]

Working on a cosmetic flip. 

The contractor I found bid out another house but didn't get the job. I liked him though, good family business. Got 5-stars on Google/Thumbtack.

Gave him the next house. Pretty basic ---> kitchen, 2 baths, flooring, paint and windows

He gave me a 5 week timeline which I accepted. 

PROBLEMS:

1) Every time I visit the job site, no one is ever there. Stuff is moving slowly along, but not at the pace I thought. 

2) They seem inefficient. They painted the interior and exterior of the house first before any rough plumbing/electrical which is weird

3) Very slow to communicate. I'll ask for an update 1-2X per week, and it'll take sometimes more than a day to get a response. 

*Before anyone asks. All I've paid is an initial deposit. The job is about $50k. All I've given him after 4 weeks is $4k. I legit ask him every week "What do I need to pay you for the work you've done?" And he always says "I'll let you know." Then never gets me a number. So, no, I haven't paid him a lot upfront and he's ducked out. 

-----------------

I've brought up my concerns 2X with him about no one working. He is very nice, but always says something like "Oh, we are going through growing pains and having trouble getting subs managed to each job site." One of the reasons was his drywalll guy got hurt, or his tile guy had other work to do. 

We have one week until our deadline and there is still a lot to do. Technically, if they work 8-10 hours per day with multiple subs it could probably get done, but up to now, it seems they've only been working 10-12 hours per week on our jobsite. 

QUESTION: 

Should I have no expectation for how often a GC/Sub should be at the job site? It sounds like other people on here expect a 8 hour day with subs showing up at 7am (the sign of a good contractor). 

Again, my GC is very nice, hasn't taken any money or anything. Just seems very disorganized. Or do I have high expectations for how often they should be working

*FURTHER NOTES: 

1) I didn't haggle any of their prices

2) I get them materials when they ask for them (90% of the time the materials sit in the garage for a week+)

3) I don't badger them much at all. Again, just 1-2X per week I'll send them a message or they'll call/text me for something

What do you think?