Assessing the reliability of the methods we use in actually measuring the intended trait should be one of our first priorities when designing a study – especially when the trait in question is not directly observable and is measured through a proxy. 

This is the case for cognitive traits, which are often quantified through measures of behavioral performance. Behavioral flexibility is of particular interest in the context of great environmental changes that a lot of populations have to experiment. This type of behavioral performance is often measured through reversal learning experiments (Bond 2007). In these experiments, individuals first learn a preference, for example for an object of a certain type of form or color, associated with a reward such as food. The characteristics of the rewarded object then change, and the individuals hence have to learn these new characteristics (to get the reward). The time needed by the individual to make this change in preference has been considered a measure of behavioral flexibility.

Although reversal learning experiments have been widely used, their construct validity to assess behavioral flexibility has not been thoroughly tested. This was the aim of McCune and collaborators' (2023) study, through the test of the repeatability of individual performance within and across contexts of reversal learning, in the great-tailed grackle.

This manuscript presents a post-study of the preregistered study* (Logan et al. 2019) that was peer-reviewed and received an In Principle Recommendation for PCI Ecology (Coulon 2019; the initial preregistration was split into 3 post-studies).
Using 34 great-tailed grackles wild-caught in Tempe, Arizona (USA), the authors tested in aviaries 2 hypotheses:

• First, that the behavioral flexibility measured by reversal learning is repeatable within individuals across sessions of the same experiment;
• Second, that there is repeatability of the measured behavioral flexibility (within individuals) across different types of reversal learning experiments (context).

The first hypothesis was tested by measuring the repeatability of the time needed by individuals to switch color preference in a color reversal learning task (colored tubes), over serial sessions of this task. The second one was tested by measuring the time needed by individuals to switch solutions, within 3 different contexts: (1) colored tubes, (2) plastic and (3) wooden multi-access boxes involving several ways to access food.

Despite limited sample sizes, the results of these experiments suggest that there is both temporal and contextual repeatability of behavioral flexibility performance of great-tailed grackles, as measured by reversal learning experiments.

Those results are a first indication of the construct validity of reversal learning experiments to assess behavioral flexibility. As highlighted by McCune and collaborators, it is now necessary to assess the discriminant validity of these experiments, i.e. checking that a different performance is obtained with tasks (experiments) that are supposed to measure different cognitive abilities.
 
* A pre-registered study is a study in which context, aims, hypotheses and methodologies have been written down as an empirical paper, peer-reviewed and pre-accepted before research is undertaken. Pre-registrations are intended to reduce publication bias and reporting bias.
 
REFERENCES
 
Bond, A. B., Kamil, A. C., & Balda, R. P. (2007). Serial reversal learning and the evolution of behavioral
flexibility in three species of north american corvids (Gymnorhinus cyanocephalus, Nucifraga columbiana,
Aphelocoma californica). Journal of Comparative Psychology, 121 (4), 372. https://doi.org/10.1037/0735-7036.121.4.372

Coulon, A. (2019) Can context changes improve behavioral flexibility? Towards a better understanding of species adaptability to environmental changes. Peer Community in Ecology, 100019. https://doi.org/10.24072/pci.ecology.100019

Logan, CJ, Lukas D, Bergeron L, Folsom M, & McCune, K. (2019).  Is behavioral flexibility related to foraging and social behavior in a rapidly expanding species? In Principle Acceptance by PCI Ecology of the Version on 6 Aug 2019. http://corinalogan.com/Preregistrations/g_flexmanip.html

McCune KB, Blaisdell AP, Johnson-Ulrich Z, Lukas D, MacPherson M, Seitz BM, Sevchik A, Logan CJ (2023) Using repeatability of performance within and across contexts to validate measures of behavioral flexibility. EcoEvoRxiv, ver. 5 peer-reviewed and recommended by Peer Community in Ecology. https://doi.org/10.32942/X2R59K

Whether individuals are able to cope with new environmental conditions, and whether this ability can be improved, is certainly of great interest in our changing world. One way to cope with new conditions is through behavioral flexibility, which can be defined as “the ability to adapt behavior to new circumstances through packaging information and making it available to other cognitive processes” (Logan et al. 2023). Flexibility is predicted to be positively correlated with innovativeness, the ability to create a new behavior or use an existing behavior in a few situations (Griffin & Guez 2014). 
The post-study manuscript by Logan et al. (2023) proposes to test flexibility manipulability, and the relationship between flexibility and innovativeness. The authors did so with an experimental study on great-tailed grackles (Quiscalus mexicanus), an expanding species in the US, known to be flexible. 
The authors used serial reversal learning to investigate (1) whether behavioral flexibility, as measured by reversal learning using tubes of different shades, is manipulable; (2) whether manipulating (improving/training) behavioral flexibility improves flexibility and innovativeness in new contexts; (3) the type of learning strategy used by the individuals throughout the serial reversals.
The study described in this manuscript was pre-registered in Logan et al. (2019) and received in-principle recommendation on 26 Mar 2019 (Coulon 2019). One hypothesis from this original preregistration will be treated in a separate manuscript.
Among several interesting results, what I found most striking is that flexibility, in this species, seems to be a trait that is acquired by experience (vs. inherent to the individual). This opens exciting interrogations on the role of social learning, and on the impact of rapid environmental changes (which may force the individuals to experiment new ways to access to resources, for example), on individual flexibility and adaptability to new conditions. 
 
REFERENCES

Coulon A (2019) Can context changes improve behavioral flexibility? Towards a better understanding of species adaptability to environmental changes. Peer Community in Ecology, 100019. https://doi.org/10.24072/pci.ecology.100019

Griffin, A. S., & Guez, D. (2014). Innovation and problem solving: A review of common mechanisms. Behavioural Processes, 109, 121–134. https://doi.org/10.1016/j.beproc.2014.08.027

Logan C, Rowney C, Bergeron L, Seitz B, Blaisdell A, Johnson-Ulrich Z, McCune K (2019)
Is behavioral flexibility manipulatable and, if so, does it improve flexibility and problem solving in a new context? In Principle Recommendation 2019. PCI Ecology. http://corinalogan.com/Preregistrations/g_flexmanip.html

Logan CJ, Lukas D, Blaisdell AP, Johnson-Ulrich Z, MacPherson M, Seitz B, Sevchik A, McCune KB (2023) Behavioral flexibility is manipulable and it improves flexibility and innovativeness in a new context. EcoEcoRxiv, version 5 peer-reviewed and recommended by Peer Community in Ecology. https://doi.org/10.32942/osf.io/5z8xs

Behavioral flexibility is a key for species adaptation to new environments. Predicting species responses to new contexts hence requires knowledge on the amount to and conditions in which behavior can be flexible. This is what Logan and collaborators propose to assess in a series of experiments on the great-tailed grackles, in a context of rapid range expansion. This pre-registration is integrated into this large research project and concerns more specifically the manipulability of the cognitive aspects of behavioral flexibility. Logan and collaborators will use reversal learning tests to test whether (i) behavioral flexibility is manipulatable, (ii) manipulating flexibility improves flexibility and problem solving in a new context, (iii) flexibility is repeatable within individuals, (iv) individuals are faster at problem solving as they progress through serial reversals. The pre-registration carefully details the hypotheses, their associated predictions and alternatives, and the plan of statistical analyses, including power tests. The ambitious program presented in this pre-registration has the potential to provide important pieces to better understand the mechanisms of species adaptability to new environments.