Indeed, congratulations and many years! I think the first time I left the house after our daughter was born was day 6 and it was with mixed feelings. I was glad to see the outdoors but I was terrified of how to get this fragile little girl from point A to point B.
Yeah, as far as physically and emotionally it takes a couple of weeks to feel up to going any where and I really didn't even feel human again until six weeks after birth. As far as the church goes, there is nothing I know of forbidding your wife from attending, confessing, or taking communion. My priest advised me to come back when I felt ready and I believe we came two weeks after she was born. Of course, as mentioned by others, there are cultural differences in each parish.