That's right. Invalid arguments can have true premises and a true conclusion.
It is true that Mary is my wife and it is true that Mary is the mother of my children. But it would be possible for her to be my wife and not be the mother of my children, so the conclusion does not really follow.