This only makes sense if they are all descended from the Doughfaces, though there are some episodes where it’s suggested that the mixed-race people are the product of technological tinkering.