CARDINALE Bradley
Recommendations: 0
Review: 1
Review: 1
InsectChange: Comment
Why we need to clean the Augean stables of ecology – the case of InsectChange
Recommended by Francois Massol based on reviews by Bradley Cardinale and 1 anonymous reviewerAs biodiversity has become a major global concern for a variety of stakeholders, and society in general, assessments of biodiversity trends at all spatial scales have flourished in the past decades. To assess trends, one needs data, and the more precise the data, the more precise the trend. Or, if precision is not perfect, uncertainty in the data must be acknowledged and accounted for. Such considerations have already been raised in ecology, most notably regarding the value of species distribution data to model the current and future distribution of species (Rocchini et al., 2011, Duputié et al., 2014, Tessarolo et al., 2021), leading to serious doubts regarding the value of public databases (Maldonado et al., 2015). And more recently similar issues have been raised regarding databases of species traits (Augustine et al., 2024), emphasizing the importance of good data practice and traceability.
Science is by nature a self-correcting human process, with many steps of the scientific activity prone to errors and misinterpretations. Collation of ecological data, sadly, is proof of this. Spurred by the astonishing results of Hallmann et al. (2017) regarding the decline of insect biomass, and to more precisely answer the question of biodiversity trends in insects and settle an ongoing debate (Cardinale et al., 2018), van Klink et al. (2020, 2021) established the InsectChange database. Several perceptive comments have already been made regarding the possible issues in the methods and interpretations of this study (Desquilbet et al., 2020, Jähnig et al., 2021, Duchenne et al., 2022). However, the biggest issue might have been finally unearthed by Gaume & Desquilbet (2024): with poorly curated data, the InsectChange database is unlikely to support most of the initial claims regarding insect biodiversity trends.
The compilation of errors and inconsistencies present in InsectChange and evinced by Gaume & Desquilbet (2024) is stunning to say the least, with a mix of field and experimental data combined without regard for experimental manipulation of environmental factors, non-standardised transformations of abundances, the use of non-insect taxa to compute insect trends, and inadequate geographical localizations of samplings. I strongly advise all colleagues interested in the study of biodiversity from global databases to consider the points raised by the authors, as it is quite likely that other databases might suffer from the same ailments as well. Reading this paper is also educating and humbling in its own way, since the publication of the original papers based on InsectChange seems to have proceeded without red flags from reviewers or editors. The need for publishing fast results that will make the next buzz, thus obeying the natural selection of bad science (Smaldino and McElreath, 2016), might be the systemic culprit. However, this might also be the opportunity ecology needs to consider the reviewing and curation of data as a crucial step of science quality assessment. To make final assessments, let us proceed with less haste.
References
Augustine, S. P., Bailey-Marren, I., Charton, K. T., Kiel, N. G. & Peyton, M. S. (2024) Improper data practices erode the quality of global ecological databases and impede the progress of ecological research. Global Change Biology, 30, e17116. https://doi.org/10.1111/gcb.17116
Cardinale, B. J., Gonzalez, A., Allington, G. R. H. & Loreau, M. (2018) Is local biodiversity declining or not? A summary of the debate over analysis of species richness time trends. Biological Conservation, 219, 175-183. https://doi.org/10.1016/j.biocon.2017.12.021
Desquilbet, M., Gaume, L., Grippa, M., Céréghino, R., Humbert, J.-F., Bonmatin, J.-M., Cornillon, P.-A., Maes, D., Van Dyck, H. & Goulson, D. (2020) Comment on “Meta-analysis reveals declines in terrestrial but increases in freshwater insect abundances”. Science, 370, eabd8947. https://doi.org/10.1126/science.abd8947
Duchenne, F., Porcher, E., Mihoub, J.-B., Loïs, G. & Fontaine, C. (2022) Controversy over the decline of arthropods: a matter of temporal baseline? Peer Community Journal, 2. https://doi.org/10.24072/pcjournal.131
Duputié, A., Zimmermann, N. E. & Chuine, I. (2014) Where are the wild things? Why we need better data on species distribution. Global Ecology and Biogeography, 23, 457-467. https://doi.org/10.1111/geb.12118
Gaume, L. & Desquilbet, M. (2024) InsectChange: Comment. biorXiv, ver.4 peer-reviewed and recommended by PCI Ecology https://doi.org/10.1101/2023.06.17.545310
Hallmann, C. A., Sorg, M., Jongejans, E., Siepel, H., Hofland, N., Schwan, H., Stenmans, W., Müller, A., Sumser, H., Hörren, T., Goulson, D. & de Kroon, H. (2017) More than 75 percent decline over 27 years in total flying insect biomass in protected areas. PLOS ONE, 12, e0185809. https://doi.org/10.1371/journal.pone.0185809
Jähnig, S. C., Baranov, V., Altermatt, F., Cranston, P., Friedrichs-Manthey, M., Geist, J., He, F., Heino, J., Hering, D., Hölker, F., Jourdan, J., Kalinkat, G., Kiesel, J., Leese, F., Maasri, A., Monaghan, M. T., Schäfer, R. B., Tockner, K., Tonkin, J. D. & Domisch, S. (2021) Revisiting global trends in freshwater insect biodiversity. WIREs Water, 8, e1506. https://doi.org/10.1002/wat2.1506
Maldonado, C., Molina, C. I., Zizka, A., Persson, C., Taylor, C. M., Albán, J., Chilquillo, E., Rønsted, N. & Antonelli, A. (2015) Estimating species diversity and distribution in the era of Big Data: to what extent can we trust public databases? Global Ecology and Biogeography, 24, 973-984. https://doi.org/10.1111/geb.12326
Rocchini, D., Hortal, J., Lengyel, S., Lobo, J. M., Jiménez-Valverde, A., Ricotta, C., Bacaro, G. & Chiarucci, A. (2011) Accounting for uncertainty when mapping species distributions: The need for maps of ignorance. Progress in Physical Geography, 35, 211-226. https://doi.org/10.1177/0309133311399491
Smaldino, P. E. & McElreath, R. (2016) The natural selection of bad science. Royal Society Open Science, 3. https://doi.org/10.1098/rsos.160384
Tessarolo, G., Ladle, R. J., Lobo, J. M., Rangel, T. F. & Hortal, J. (2021) Using maps of biogeographical ignorance to reveal the uncertainty in distributional data hidden in species distribution models. Ecography, 44, 1743-1755. https://doi.org/10.1111/ecog.05793
van Klink, R., Bowler, D. E., Comay, O., Driessen, M. M., Ernest, S. K. M., Gentile, A., Gilbert, F., Gongalsky, K. B., Owen, J., Pe'er, G., Pe'er, I., Resh, V. H., Rochlin, I., Schuch, S., Swengel, A. B., Swengel, S. R., Valone, T. J., Vermeulen, R., Wepprich, T., Wiedmann, J. L. & Chase, J. M. (2021) InsectChange: a global database of temporal changes in insect and arachnid assemblages. Ecology, 102, e03354. https://doi.org/10.1002/ecy.3354
van Klink, R., Bowler, D. E., Gongalsky, K. B., Swengel, A. B., Gentile, A. & Chase, J. M. (2020) Meta-analysis reveals declines in terrestrial but increases in freshwater insect abundances. Science, 368, 417-420. https://doi.org/10.1126/science.aax9931