Marks lost in action, biased estimations
Mark loss can strongly bias estimates of demographic rates in multi-state models: a case study with simulated and empirical datasets
Recommendation: posted 09 November 2023, validated 09 November 2023
Billiard, S. (2023) Marks lost in action, biased estimations. Peer Community in Ecology, 100416. 10.24072/pci.ecology.100416
Capture-Mark-Recapture (CMR) data are commonly used to estimate ecological variables such as abundance, survival probability, or transition rates from one state to another (e.g. from juvenile to adult, or migration from one site to another). Many studies have shown how estimations can be affected by neglecting one aspect of the population under study (e.g. the heterogeneity in survival between individuals) or one limit of the methodology itself (e.g. the fact that observers might not detect an individual although it is still alive). Strikingly, very few studies have yet assessed the robustness of one fundamental assumption of all CMR-based inferences: marks are supposed definitive and immutable. If they are not, how are estimations affected? Addressing this issue is the main goal of the paper by Touzalin et al. (2023), and they did a very nice work. But, because the answer is not that simple, it also calls for further investigations.
When and why would mark loss bias estimation? In at least two situations. First, when estimating survival rates: if an individual loses its mark, it will be considered as dead, hence death rates will be overestimated. Second, more subtly, when estimating transition rates: if one individual loses its mark at the specific moment where its state changes, then a transition will be missed in data. The history of the marked individual would then be split into two independent CMR sequences as if there were two different individuals, including one which died.
Touzalin et al. (2023) thoroughly studied these two situations by estimating ecological parameters on 1) well-thought simulated datasets, that cover a large range of possible situations inspired from a nice compilation of hundreds of estimations from fish and bats studies, and 2) on their own bats dataset, for which they had various sources of information about mark losses, i.e. different mark types on the same individuals, including mark based on genotypes, and marks found on the soil in the place where bats lived. Their main findings from the simulated datasets are that there is a general trend for underestimation of survival and transition rates if mark loss is not accounting for in the model, as it would be intuitively expected. However, they also showed from the bats dataset that biases do not show any obvious general trend, suggesting complex interactions between different ecological processes and/or with the estimation procedure itself.
The results by Touzalin et al. (2023) strongly suggest that mark loss should systematically be included in models estimating parameters from CMR data. In addition to adapt the inferential models, the authors also recommend considering either a double marking, or even a single but ‘permanent’ mark such as one based on the genotypes. However, the potential gain of a double marking or of the use of genotypes is still to be evaluated both in theory and practice, and it seems to be not that obvious at first sight. First because double marking can be costly for experimenters but also for the marked animals, especially as several studies showed that marks can significantly affect survival or recapture rates. Second because multiple sources of errors can affect genotyping, which would result in wrong individual assignations especially in populations with low genetic diversity or high inbreeding, or no individual assignation at all, which would increase the occurrence of missing data in CMR datasets. Touzalin et al. (2023) supposed in their paper that there were no genotyping errors, but one can doubt it to be true in most situations. They have now important and interesting other issues to address.
Frédéric Touzalin, Eric J. Petit, Emmanuelle Cam, Claire Stagier, Emma C. Teeling, Sébastien J. Puechmaille (2023) Mark loss can strongly bias demographic rates in multi-state models: a case study with simulated and empirical datasets. BioRxiv, ver. 3 peer-reviewed and recommended by Peer Community in Ecology. https://doi.org/10.1101/2022.03.25.485763
The recommender in charge of the evaluation of the article and the reviewers declared that they have no conflict of interest (as defined in the code of conduct of PCI) with the authors or with the content of the article. The authors declared that they comply with the PCI rule of having no financial conflicts of interest in relation to the content of the article.
This project was funded by an Irish Research Council Postdoctoral Fellowship Grant GOIPD/2018/256 awarded to F.T., a European Research Council Research Grant ERC-2012StG311000 and an Irish Research Council Laureate Award awarded to E.C.T. The French field study was supported by the European Regional Development Fund EU000141 and a Contrat Nature grant awarded to Bretagne Vivante (BV). S.J.P. was supported by a Junior chair from the Institut Universitaire de France.
Evaluation round #2
DOI or URL of the preprint: https://doi.org/10.1101/2022.03.25.485763
Version of the preprint: 2
Author's Reply, 12 Oct 2023
Decision by Sylvain Billiard, posted 24 Aug 2023, validated 28 Aug 2023
a reviewer and myself have thoroughly evaluated the revised version of your manuscript. We both agree that you did a very nice job and I will be happy to recommend it.
You will find attached a pdf file with many annotations, comments and other minor corrections I would like you to consider as they would further improve the quality of your paper. The large majority of these corrections and suggestions are languages, typos, consistencies in the redaction or notation, etc. Even though I am not a native english speaker myself, I found that the english could be susbtantially improved. If by any chance you could find some help for that, I think it would help the diffusion of your paper.
You will also find a couple more substantial comments but that do not need much work.
As soon as the new revised version is submitted, I will publish my recommendation.
Sylvain BilliardDownload recommender's annotations
Reviewed by Olivier Gimenez, 22 Aug 2023
Evaluation round #1
DOI or URL of the preprint: https://doi.org/10.1101/2022.03.25.485763
Author's Reply, 12 Aug 2023
Decision by Sylvain Billiard, posted 27 May 2022
based on the reports of three external reviewers, my own reading of your paper, and the help of Camille Jolivel for an extra careful reading of your manuscript, I would be happy to recommend your paper for PCI Ecology, pending some modifications and corrections.
The three reviewers, myself and Camille Jolivel have appreciated a lot your paper. The topic discussed is very interesting because CMR-based methods consider heavy assumptions, which could have large consequences on the final results. It is therefore interesting to see to what extent these assumptions are justifiable. The particular impact of mark-loss on estimation biases is scarce in the literature and is worth being studied further as you show here, especially because mark losses can have counter-intuitive effects.
Please find in the companion file a complete and detailed list of comments and suggestions.
Dr. Sylvain Billiard for PCI Ecology
Download recommender's annotations