Gall wasps (Hymenoptera: Cynipidae) comprise 13 distinct tribes whose interrelationships remain incompletely understood. Recent analyses of ultra-conserved elements (UCEs) represent the first attempt at resolving these relationships using phylogenomics. Here, we present the first analysis based on protein-coding sequences from genome and transcriptome assemblies. Unlike UCEs, these data allow more sophisticated substitution models, which can potentially resolve issues with long-branch attraction. We include data for 37 cynipoid species, including two tribes missing in the UCE analysis: Aylacini (s. str.) and Qwaqwaiini. Our results confirm the UCE result that Cynipidae are not monophyletic. Specifically, the Paraulacini and Diplolepidini + Pediaspidini fall outside a core clade (Cynipidae s. str.), which is more closely related to the insect-parasitic Figitidae, and this result is robust to the exclusion of long-branch taxa that could mislead the analysis. Given this, we here divide the Cynipidae into three families: the Paraulacidae stat. prom., Diplolepididae stat. prom. and Cynipidae (s. str.). Our results suggest that the Eschatocerini are the sister group of the remaining Cynipidae (s. str.). Within the Cynipidae (s. str.), the Aylacini (s. str.) are more closely related to oak gall wasps (Cynipini) and some of their inquilines (Ceroptresini) than to other herb gallers (Aulacideini and Phanacidini), and the Qwaqwaiini likely form a clade together with Synergini (s. str.) and Rhoophilini. Several alternative scenarios for the evolution of cynipid life histories are compatible with the relationships suggested by our analysis, but all are complex and require multiple shifts among parasitoids, inquilines and gall inducers.

Probabilistic Programming Languages (PPLs) allow users to encode statistical inference problems and automatically apply an inference algorithm to solve them. Popular inference algorithms for PPLs, such as sequential Monte Carlo (SMC) and Markov chain Monte Carlo (MCMC), are built around checkpoints—relevant events for the inference algorithm during the execution of a probabilistic program. Deciding the location of checkpoints is, in current PPLs, not done optimally. To solve this problem, we present a static analysis technique that automatically determines checkpoints in programs, relieving PPL users of this task. The analysis identifies a set of checkpoints that execute in the same order in every program run—they are aligned. We formalize alignment, prove the correctness of the analysis, and implement the analysis as part of the higher-order functional PPL Miking CorePPL. By utilizing the alignment analysis, we design two novel inference algorithm variants: aligned SMC and aligned lightweight MCMC. We show, through real-world experiments, that they significantly improve inference execution time and accuracy compared to standard PPL versions of SMC and MCMC.

Probabilistic programming languages (PPLs) allow users to encode arbitrary inference problems, and PPL implementations provide general-purpose automatic inference for these problems. However, constructing inference implementations that are efficient enough is challenging for many real-world problems. Often, this is due to PPLs not fully exploiting available parallelization and optimization opportunities. For example, handling probabilistic checkpoints in PPLs through continuation-passing style transformations or non-preemptive multitasking—as is done in many popular PPLs—often disallows compilation to low-level languages required for high-performance platforms such as GPUs. To solve the checkpoint problem, we introduce the concept of PPL control-flow graphs (PCFGs)—a simple and efficient approach to checkpoints in low-level languages. We use this approach to implement RootPPL: a low-level PPL built on CUDA and C++ with OpenMP, providing highly efficient and massively parallel SMC inference. We also introduce a general method of compiling universal high-level PPLs to PCFGs and illustrate its application when compiling Miking CorePPL—a high-level universal PPL—to RootPPL. The approach is the first to compile a universal PPL to GPUs with SMC inference. We evaluate RootPPL and the CorePPL compiler through a set of real-world experiments in the domains of phylogenetics and epidemiology, demonstrating up to 6 × speedups over state-of-the-art PPLs implementing SMC inference. 

Despite more than 250 years of taxonomic research, we still have only a vague idea about the true size and composition of the faunas and floras of the planet. Many biodiversity inventories provide limited insight because they focus on a small taxonomic subsample or a tiny geographic area. Here, we report on the size and composition of the Swedish insect fauna, thought to represent roughly half of the diversity of multicellular life in one of the largest European countries. Our results are based on more than a decade of data from the Swedish Taxonomy Initiative and its massive inventory of the country's insect fauna, the Swedish Malaise Trap Project The fauna is considered one of the best known in the world, but the initiative has nevertheless revealed a surprising amount of hidden diversity: more than 3,000 new species (301 new to science) have been documented so far. Here, we use three independent methods to analyze the true size and composition of the fauna at the family or subfamily level: (1) assessments by experts who have been working on the most poorly known groups in the fauna; (2) estimates based on the proportion of new species discovered in the Malaise trap inventory; and (3) extrapolations based on species abundance and incidence data from the inventory. For the last method, we develop a new estimator, the combined non-parametric estimator, which we show is less sensitive to poor coverage of the species pool than other popular estimators. The three methods converge on similar estimates of the size and composition of the fauna, suggesting that it comprises around 33,000 species. Of those, 8,600 (26%) were unknown at the start of the inventory and 5,000 (15%) still await discovery. We analyze the taxonomic and ecological composition of the estimated fauna, and show that most of the new species belong to Hymenoptera and Diptera groups that are decomposers or parasitoids. Thus, current knowledge of the Swedish insect fauna is strongly biased taxonomically and ecologically, and we show that similar but even stronger biases have distorted our understanding of the fauna in the past. We analyze latitudinal gradients in the size and composition of known European insect faunas and show that several of the patterns contradict the Swedish data, presumably due to similar knowledge biases. Addressing these biases is critical in understanding insect biomes and the ecosystem services they provide. Our results emphasize the need to broaden the taxonomic scope of current insect monitoring efforts, a task that is all the more urgent as recent studies indicate a possible worldwide decline in insect faunas.

The Swedish Malaise Trap Project (SMTP) is one of the most ambitious insect inventories ever attempted. The project was designed to target poorly known insect groups across a diverse range of habitats in Sweden. The field campaign involved the deployment of 73 Malaise traps at 55 localities across the country for three years (2003-2006). Over the past 15 years, the collected material has been hand sorted by trained technicians into over 300 taxonomic fractions suitable for expert attention. The resulting collection is a tremendous asset for entomologists around the world, especially as we now face a desperate need for baseline data to evaluate phenomena like insect decline and climate change. Here, we describe the history, organisation, methodology and logistics of the SMTP, focusing on the rationale for the decisions taken and the lessons learned along the way. The SMTP represents one of the early instances of community science applied to large-scale inventory work, with a heavy reliance on volunteers in both the field and the laboratory. We give estimates of both staff effort and volunteer effort involved. The project has been funded by the Swedish Taxonomy Initiative; in total, the inventory has cost less than 30 million SEK (approximately 3.1 million USD). Based on a subset of the samples, we characterise the size and taxonomic composition of the SMTP material. Several different extrapolation methods suggest that the material comprises around 20 million specimens in total. The material is dominated by Diptera (75% of the specimens) and Hymenoptera (15% of specimens). Amongst the Diptera, the dominant groups are Chironomidae (37% of specimens), Sciaridae (15%), Phoridae (13%), Cecidomyiidae (9.5%) and Mycetophilidae (9.4%). Within Hymenoptera, the major groups are Ichneumonidae (44% of specimens), Diaprioidea (19%), Braconidae (9.6%), Platygastroidea (8.5%) and Chalcidoidea (7.9%). The taxonomic composition varies with latitude and season. Several Diptera and Hymenoptera groups are more common in non-summer samples (collected from September to April) and in the North, while others show the opposite pattern. About 1% of the total material has been processed and identified by experts so far. This material represents over 4,000 species. One third of these had not been recorded from Sweden before and almost 700 of them are new to science. These results reveal the large amounts of taxonomic work still needed on Palaearctic insect faunas. Based on the SMTP experiences, we discuss aspects of planning and conducting future large-scale insect inventory projects using mainly traditional approaches in relation to more recent approaches that rely on molecular techniques.

DNA metabarcoding allows the analysis of insect communities faster and more efficiently than ever before. However, metabarcoding can be conducted through several approaches, and the consistency of results across methods has rarely been studied. We compare the results obtained by DNA metabarcoding of the same communities using two different markers - COI and 16S - and three different sampling methods: (a) homogenized Malaise trap samples (homogenate), (b) preservative ethanol from the same samples, and (c) soil samples. Our results indicate that COI and 16S offer partly complementary information on Malaise trap samples, with each marker detecting a significant number of species not detected by the other. Different sampling methods offer highly divergent estimates of community composition. The community recovered from preservative ethanol of Malaise trap samples is significantly different from that recovered from homogenate. Small and weakly sclerotized insects tend to be overrepresented in ethanol while strong and large taxa are overrepresented in homogenate. For soil samples, highly degenerate COI primers pick up large amounts of nontarget DNA and only 16S provides adequate analyses of insect diversity. However, even with 16S, very little overlap in molecular operational taxonomic unit (MOTU) content was found between the trap and the soil samples. Our results demonstrate that none of the tested sampling approaches is satisfactory on its own. For instance, DNA extraction from preservative ethanol is not a valid replacement for destructive bulk extraction but a complement. In future metabarcoding studies, both should ideally be used together to achieve comprehensive representation of the target community.

Researchers in the field of insect diversity can greatly benefit from DNA metabarcoding due to its accuracy, low cost and short processing time compared to manual sorting and identification. But most existing metabarcoding protocols require homogenization of the sample, thus prohibiting any further work on the captured individuals. A mild digestion of the tissue by incubation of the specimens in a lysis buffer has been proposed as an alternative to sample homogenization. Several mild lysis protocols have been presented but they have not been properly evaluated against each other. Here, we analyze the effects of two different mild lysis buffers (one more aggressive than the other), two different incubation times, and two different DNA purification methods (a manual precipitation method and an automated robotic protocol) on metabarcoding performance. Performance was measured as the accuracy of retrieving the true composition of mock insect communities using two different mitochondrial markers (COI and 16S). We found that the variation in concentration and purity of the DNA extracts produced by the different lysis treatments and purification methods had little effect on the recovery of species. However, the two lysis treatments differed significantly in how well they allowed quantification of species abundances. Digestion in the gentler buffer and for a shorter time resulted in metabarcoding results that were more representative of the original sample, while a more aggressive buffer or a longer incubation reduced the values of alpha diversity and increased the differences between metabarcoding results and the true species- abundance distribution. In summary, our results show that the details of non-destructive DNA metabarcoding protocols can have a significant effect on performance. Specifically, our results suggest that a short and mild lysis treatment is the best choice for recovering the true composition of the processed sample. Short and mild lysis protocols not only improve accuracy, they also come with a lower cost and a faster processing time.

The oak gall-wasps (Cynipidae: Cynipini) make some of the most complex plant galls found in nature. The shape of the outer gall varies spectacularly among species, and is characterised by traits that appear to have evolved to defend the larva or larvae inside in an intense evolutionary arms race with predators and parasitoids. It is still unclear how the oak gall-wasps achieve this unusual level of host manipulation. Here, we take a comparative genomic approach to gain some insight into the underlying mechanisms, assuming that the arms race should result in unusually rapid evolution in the proteins involved. Specifically, we compared genomes of Cynipini species making complex and diverse outer galls to those of related lineages making simple galls. We analysed over 5,000 orthologous genes using the recent Bayescode tool, which controls for the background levels of evolution in the genes and lineages involved using a whole-genome approach. We then used gene set enrichment analysis to identify which Gene Ontology terms were more often associated with genes that had an unusually high rate of nonsynonymous evolution in the complex gallers. The complex gallers did not have an elevated number of such genes. However, the genes that had elevated rates in complex gallers were associated with biological-process gene ontology terms related to the formation of the egg follicle and to cell movement, suggesting that these genes may play a role in the formation of complex outer galls, and that they would be interesting target genes for experimental studies.

The phylogeny of gall wasps (Cynipidae) and their parasitic relatives has attracted considerable attention in recent years. The family is now widely recognized to fall into thirteen natural lineages, designated tribes, but the relationships among them have remained elusive. This has stymied any progress in understanding how cynipid gall inducers evolved from insect parasitoids, and what role inquilinism (development as a herbivore inside galls induced by other cynipids) might have played in this transition. A recent analysis of ultraconserved elements (UCEs) represents the first attempt at resolving these questions using phylogenomics. Here, we present the first analysis based on protein-coding sequences from genome and transcriptome assemblies. To address potential problems due to model misfit, we focus on models that accommodate site-specific amino-acid profiles and that are less sensitive than standard models to long-branch attraction. Our results show that the Cynipidae as previously circumscribed are not monophyletic. Specifically, the Paraulacini and a clade formed by Diplolepidini + Pediaspidini both fall outside a core clade (Cynipidae s. str.), which is more closely related to Figitidae. This result is robust to the exclusion of long-branch taxa that could potentially mislead the analysis, and it is consistent with the UCE analysis. Given this, we propose that the Cynipidae be divided into three families: the Paraulacidae, Diplolepididae and Cynipidae (s. str.). Our results suggest that the Eschatocerini are the sister group of the remaining Cynipidae (s. str.). Within the latter, our results are consistent with the UCE analysis but place two additional tribes: (1) the Aylacini (s. str.), more closely related to the oak gall wasps (Cynipini) and some of their inquilines (Ceroptresini) than to other herb gallers (Aulacideini and Phanacidini); and (2) the Qwaqwaiini, likely the sister group to Synergini (s. str.) + Rhoophilini. Several alternative scenarios for the evolution of cynipid life histories are compatible with the relationships suggested by our analysis, but all are complex and require multiple shifts between parasitoids, inquilines and gall inducers. Linking the different types of life-history transitions to specific genomic signatures may be one of the best ways of differentiating among these alternative scenarios. Our study represents the first step towards enabling such analyses.

The genus Megaselia is one of the largest in the animal kingdom, with 1,600 described species and many more remaining to be discovered according to most experts. The biology is poorly known; some well-studied species have been shown to be parasitoids or extreme omnivores but it is suspected that larvae are mostly decomposers or fungivores. The genus can be found in most regions of the world but it is most diverse in the Holarctic, from temperate to arctic climates, at least judging from the described fauna. Work on Megaselia taxonomy is challenging due to the extreme species diversity, the poor knowledge of the higher-level phylogeny and the lack of molecular data. In this paper, we provide the first comprehensive study of Megaselia relationships based on molecular data. Although basal relationships in the genus remain uncertain, we identify 22 well-supported terminal clades, which we recognize as informal species groups. We briefly discuss the morphological characteristics of each species group, and the implications of our phylogenetic results for the genus-level classification of Megaselia and its closest relatives. We also provide molecular and brief morphological characterization of 45 Megaselia species new to science.