Maybe it is because parents get to sleep more when there is the first baby? You can sleep during naptime with one. With two...or three....yikes!
My Grandpa would say to my dad "What, you only had 4 kids?!! what is wrong with your sperm??".
My how times change through the generations!! Now if couples have more than 2, it is out of this world!