The ability to acquire the speech sounds of a second language has consistently been found to be constrained with increasing age of acquisition. Such constraints have been explained either through cross-linguistic influence in bilingual speakers or as the result of maturational declines in neural plasticity with age. Here, we disentangle these two explanations by investigating speech production in adults who were adopted from China to Sweden as toddlers, lost their first language, and became monolingual speakers of the second language. Although we find support for predictions based on models of bilingual language acquisition, these results cannot be explained by the bilingual status of the learners, indicating instead a long-term influence of early specialization for speech that is independent of bilingual language use. These findings are discussed in light of first-language interference and the theory of maturational constraints for language acquisition.