Passports exist because borders started to become real. Prior to that groups of people of various backgrounds moved around freely and all paid taxes to the same ruler. The genetic data you speak of clearly shows blending across European populations.