Yea, all my guy friends told me that the first few months were boring because they didn't really do anything; but I took all 3 months of my Parental leave and then another of PTO because they were twins and my wife would need the help. The bond I created with them in those few months is EXTREMELY evident now and I wouldn't take that time back for anything. I found them to be different right off the bat and those differences have been getting more pronounced as they get older (6 months old today).Before my daughter was born I always figured that the first few months would be incredibly boring and I would enjoy parenthood a lot more once she grew up a bit and was more interactive.
After reading some parenting books that go into the development and bonding that happens early on I made sure I was set up so I basically didn't have to work for the first 3 months and I am very grateful I did.
You won't ruin your kid if you can't take a bunch of paternity right when they are born, but if you can afford it and your job allows for it I'd recommend taking full advantage.
It is worth pointing out I basically work from home so I still get a bunch of time with my daughter even now, but if I did have to go into an office, now that I experienced having that time off, I would prioritize taking my PTO for right after my kid was born rather than putting it off till they were a bit older.
Also, Cad is correct about the nanny/au pair. They are worth every damn penny since they focus solely on your children and know more than you do about early child development. Hell, our au pair only had experience with one other small infant and she is still the one pushing the envelope with them to sit, crawl, eat solids, etc.