Slaves were mostly confined to one home, not always with family members.  Most family got separated when their masters sold them on the slave block.

http://www.history.com/topics/black-history/slavery