Although language difficulties are common in children born prematurely, robust neuroanatomical correlates of these impairments remain to be established. This study investigated whether the greater prevalence of language problems in preterm (versus term-born) children might reflect injury to major intra- or interhemispheric white matter pathways connecting frontal and temporal language regions. To investigate this, we performed a comprehensive assessment of language and academic abilities in a group of adolescents born prematurely, some of whom had evidence of brain injury at birth (n = 50, mean age: 16 years, mean gestational age: 27 weeks) and compared them to a term-born control group (n = 30). Detailed structural magnetic resonance imaging and diffusion-tractography analyses of intrahemispheric and interhemispheric white matter bundles were performed. Analysis of intrahemispheric pathways included the arcuate fasciculus (dorsal language pathway) and uncinate fasciculus/extreme capsule (ventral language pathway). Analysis of interhemispheric pathways (in particular, connections between the temporal lobes) included the two major commissural bundles: the corpus callosum and anterior commissure. We found language impairment in 38% of adolescents born preterm. Language impairment was not related to abnormalities of the arcuate fasciculus (or its subsegments), but was associated with bilateral volume reductions in the ventral language pathway. However, the most significant volume reduction was detected in the posterior corpus callosum (splenium), which contains interhemispheric connections between the occipital, parietal and temporal lobes. Diffusion tractography showed that of the three groups of interhemispheric fibres within the splenium, only those connecting the temporal lobes were reduced. Crucially, we found that language impairment was only detectable if the anterior commissure (a second temporal lobe commissural pathway) was also small. Regression analyses showed that a combination of anatomical measures of temporal interhemispheric connectivity (through the splenium of the corpus callosum and anterior commissure) explained 57% of the variance in language abilities. This supports recent theories emphasizing the importance of interhemispheric connections for language, particularly in the developing brain.