Mapping hybrid defects in contact zones between incipient species can identify genomic regions contributing to reproductive isolation and reveal genetic mechanisms of speciation. The house mouse features a rare combination of sophisticated genetic tools and natural hybrid zones between subspecies. Male hybrids often show reduced fertility, a common reproductive barrier between incipient species. Laboratory crosses have identified sterility loci, but each encompasses hundreds of genes. We map genetic determinants of testis weight and testis gene expression using offspring of mice captured in a hybrid zone between M. musculus musculus and M. m. domesticus. Many generations of admixture enables high-resolution mapping of loci contributing to these sterility-related phenotypes. We identify complex interactions among sterility loci, suggesting multiple, non-independent genetic incompatibilities contribute to barriers to gene flow in the hybrid zone.

The identification of the genes involved in morphological variation in nature is still a major challenge. Here we explore a new approach: we combine 178 samples from a natural hybrid zone between two subspecies of the house mouse (Mus musculus domesticus and Mus musculus musculus), and high coverage of the genome (~145K SNPs) to identify loci underlying craniofacial shape variation. Due to the long history of recombination in the hybrid zone, high mapping resolution is anticipated. The combination of genomes from subspecies allows the mapping of both, variation within subspecies and intersubspecific differences, thereby increasing the overall amount of causal genetic variation than can be detected. Skull and mandible shape were measured using 3D landmarks and geometric morphometrics. Using principle component axes as phenotypes, and a linear mixed model accounting for genetic relatedness in the mapping populations, we identified 9 genomic regions associated with skull and 10 with mandible shape. High mapping resolution (median size of significant regions = 148 kb) enabled identification of single or few candidate genes in most cases. Some of the genes act as regulators or modifiers of signaling pathways relevant for morphological development and bone formation, including several with known craniofacial phenotypes in mice and humans. The significant associations combined explain 13% and 7% of the skull and mandible shape variation. In addition, a positive correlation was found between chromosomal length and proportion of variation explained. Our results suggest a complex genetic architecture for shape traits, and support a polygenic model.

Barriers to gene flow between naturally hybridizing taxa reveal the initial stages of speciation. Reduced hybrid fertility is a common feature of reproductive barriers separating recently diverged species. In house mice (Mus musculus), hybrid male sterility has been studied extensively using experimental crosses between subspecies. Here, we present the first detailed picture of hybrid male fertility in the European M. m. domesticus – M. m. musculus hybrid zone. Complete sterility appears rare or absent in natural hybrids but a large proportion of males (~30%) have sperm count or relative testis weight below the range in pure subspecies, and likely suffer reduced fertility. Comparison of a suite of traits related to fertility among subfertile males indicates reduced hybrid fertility in the contact zone is highly variable among individuals and ancestry groups in the type, number and severity of spermatogenesis defects present. Taken together, these results suggest multiple underlying genetic incompatibilities are segregating in the hybrid zone, which likely contribute to reproductive isolation between subspecies.