“Certainly it may, under present imperfect conditions, often be a duty not to destroy the outward form of marriage for the sake of the children. But by no means can this duty be preached as universally binding.”