Hey, haven't been here for awhile...
Answering your question: why do you even consider it a problem? It shouldn't be! Just look at it from the bright side - you are always home, there for your child... What can be better?
About the phone calls:
I have a 2 year old daughter and a 6 year old karateka-son. You can't even imagine what dojo I live in! Kiyaaa! There is no phone answering. At all. My husband calls from work and I do not asnwer it. I call back. I listen to the message, then grab my cell, go to the bathroom or into the driveway, and call people back.
You may say: ah, it is so rude (unprofessional, unsensitive, ignorant, blah blah blah). Not if you inform callers to leave a message. For example, I have business cards that say Tel: xxx-xxx-xxxx (leave a message), so they know PRIOR to calling that I won't answer and that they are supposed to leave a message. I don't think that it would be more professional if they heard kids screaming and doing karate chops in the background.
The funny part is that when I call them back (usually 5-10 minutes after they leave the message), they are all surprised and happy - wow, you called back so fast! :D Sure, why not? I AM good!
Plus, when people leave messages it gives me some time to recall my business case with that particular person, and I am ready for a talk.