Nehal, K. R., Steendam, L. M., Campos Ponce, M., van der Hoeven, M., & Smit, G. S. A. (2021). Worldwide Vaccination Willingness for COVID-19: A Systematic Review and Meta-Analysis. Vaccines, 9(10), 1071. https://doi.org/10.3390/vaccines9101071

Lopez-Leon, S., Wegman-Ostrosky, T., Valle, N. C. A. del, Perelman, C., Sepulveda, R., Rebolledo, P. A., Cuapio, A., & Villapol, S. (2022). Long COVID in Children and Adolescents: A Systematic Review and Meta-analyses. (p. 2022.03.10.22272237). medRxiv. https://doi.org/10.1101/2022.03.10.22272237

Peter R. Hansen. (2022, February 3). Weighting, is the answer. The only study to find lockdowns ⬆️mortality is given weight 91.8% = 7390/8030, and then you get -0.2% to be the estimate. To summarize: -0.2% META-STUDY ESTIMATE is based on 91.8% ONE STUDY and 8.2% ALL OTHER STUDIES. https://t.co/j6e7ziPNAI [Tweet]. @ProfPHansen. https://twitter.com/ProfPHansen/status/1489366528956919808

Bower, Dr Marlee, Scarlett Smout, Amarina Donohoe-Bales, Lily Teesson, Eleisha Lauria, Julia Boyle, Philip Batterham, et al. ‘A Hidden Pandemic? An Umbrella Review of Global Evidence on Mental Health in the Time of COVID-19’. PsyArXiv, 14 January 2022. https://doi.org/10.31234/osf.io/bzpvw.

AIMOS. (2021, November 30). How can we connect #metascience to established #science fields? Find out at this afternoon’s session at #aimos2021 Remco Heesen @fallonmody Felipe Romeo will discuss. Come join us. #OpenScience #OpenData #reproducibility https://t.co/dEW2MkGNpx [Tweet]. @aimos_inc. https://twitter.com/aimos_inc/status/1465485732206850054

Sah, P., Fitzpatrick, M. C., Zimmer, C. F., Abdollahi, E., Juden-Kelly, L., Moghadas, S. M., Singer, B. H., & Galvani, A. P. (2021). Asymptomatic SARS-CoV-2 infection: A systematic review and meta-analysis. Proceedings of the National Academy of Sciences, 118(34). https://doi.org/10.1073/pnas.2109229118

Okoli, G. N., Abou-Setta, A. M., Neilson, C. J., Chit, A., Thommes, E., & Mahmud, S. M. (2019). Determinants of Seasonal Influenza Vaccine Uptake Among the Elderly in the United States: A Systematic Review and Meta-Analysis. Gerontology and Geriatric Medicine, 5, 2333721419870345. https://doi.org/10.1177/2333721419870345

Rogers, J. P., Watson, C. J., Badenoch, J., Cross, B., Butler, M., Song, J., Hafeez, D., Morrin, H., Rengasamy, E. R., Thomas, L., Ralovska, S., Smakowski, A., Sundaram, R. D., Hunt, C. K., Lim, M. F., Aniwattanapong, D., Singh, V., Hussain, Z., Chakraborty, S., … Rooney, A. G. (2021). Neurology and neuropsychiatry of COVID-19: A systematic review and meta-analysis of the early literature reveals frequent CNS manifestations and key emerging narratives. Journal of Neurology, Neurosurgery & Psychiatry, jnnp-2021-326405. https://doi.org/10.1136/jnnp-2021-326405

Parsons, J. E., Newby, K. V., & French, D. P. (2018). Do interventions containing risk messages increase risk appraisal and the subsequent vaccination intentions and uptake? – A systematic review and meta‐analysis. British Journal of Health Psychology, 23(4), 1084–1106. https://doi.org/10.1111/bjhp.12340

Lytras, T., Kopsachilis, F., Mouratidou, E., Papamichail, D., & Bonovas, S. (2015). Interventions to increase seasonal influenza vaccine coverage in healthcare workers: A systematic review and meta-regression analysis. Human Vaccines & Immunotherapeutics, 12(3), 671–681. https://doi.org/10.1080/21645515.2015.1106656

Brewer, N. T., DeFrank, J. T., & Gilkey, M. B. (2016). Anticipated Regret and Health Behavior: A Meta-Analysis. Health Psychology : Official Journal of the Division of Health Psychology, American Psychological Association, 35(11), 1264–1275. https://doi.org/10.1037/hea0000294

Chen, X., Chen, Z., Azman, A. S., Deng, X., Sun, R., Zhao, Z., Zheng, N., Chen, X., Lu, W., Zhuang, T., Yang, J., Viboud, C., Ajelli, M., Leung, D. T., & Yu, H. (2021). Serological evidence of human infection with SARS-CoV-2: A systematic review and meta-analysis. The Lancet Global Health, 0(0). https://doi.org/10.1016/S2214-109X(21)00026-7

Conference Details. (n.d.). AIMOS. Retrieved 5 March 2021, from https://aimos.community/2020-details

Soderberg, C. K., Errington, T., Schiavone, S. R., Bottesini, J. G., Thorn, F. S., Vazire, S., Esterling, K. M., & Nosek, B. A. (2020). Research Quality of Registered Reports Compared to the Traditional Publishing Model. MetaArXiv. https://doi.org/10.31222/osf.io/7x9vy

Offeddu, V., Yung, C. F., Low, M. S. F., & Tam, C. C. (2017). Effectiveness of Masks and Respirators Against Respiratory Infections in Healthcare Workers: A Systematic Review and Meta-Analysis. Clinical Infectious Diseases, 65(11), 1934–1942. https://doi.org/10.1093/cid/cix681

Siemieniuk, R. A., Bartoszko, J. J., Ge, L., Zeraatkar, D., Izcovich, A., Kum, E., Pardo-Hernandez, H., Rochwerg, B., Lamontagne, F., Han, M. A., Liu, Q., Agarwal, A., Agoritsas, T., Chu, D. K., Couban, R., Darzi, A., Devji, T., Fang, B., Fang, C., … Brignardello-Petersen, R. (2020). Drug treatments for covid-19: Living systematic review and network meta-analysis. BMJ, 370. https://doi.org/10.1136/bmj.m2980

Smith, C. F., Drew, S., Ziebland, S., & Nicholson, B. D. (2020). Understanding the role of GPs’ gut feelings in diagnosing cancer in primary care: A systematic review and meta-analysis of existing evidence. British Journal of General Practice, 70(698), e612–e621. https://doi.org/10.3399/bjgp20X712301

Mohammadi, A., Esmaeilzadeh, E., Li, Y., Bosch, R. J., & Li, J. Z. (2020). SARS-CoV-2 detection in different respiratory sites: A systematic review and meta-analysis. EBioMedicine, 0(0). https://doi.org/10.1016/j.ebiom.2020.102903

Cevik, M., Tate, M., Lloyd, O., Maraolo, A. E., Schafers, J., & Ho, A. (2020). SARS-CoV-2, SARS-CoV-1 and MERS-CoV viral load dynamics, duration of viral shedding and infectiousness: A living systematic review and meta-analysis. MedRxiv, 2020.07.25.20162107. https://doi.org/10.1101/2020.07.25.20162107

Su, Q., Hu, J., Lin, H., Zhang, Z., Zhu, E. C., Zhang, C., Wang, D., Gao, Z., & Cao, B. (2020). Prevalence and risks of severe events for cancer patients with COVID-19 infection: A systematic review and meta-analysis. MedRxiv, 2020.06.23.20136200. https://doi.org/10.1101/2020.06.23.20136200

Chu, D. K., Akl, E. A., Duda, S., Solo, K., Yaacoub, S., Schünemann, H. J., Chu, D. K., Akl, E. A., El-harakeh, A., Bognanni, A., Lotfi, T., Loeb, M., Hajizadeh, A., Bak, A., Izcovich, A., Cuello-Garcia, C. A., Chen, C., Harris, D. J., Borowiack, E., … Schünemann, H. J. (2020). Physical distancing, face masks, and eye protection to prevent person-to-person transmission of SARS-CoV-2 and COVID-19: A systematic review and meta-analysis. The Lancet, 0(0). https://doi.org/10.1016/S0140-6736(20)31142-9

Chu, D., Akl, E., El-Harakeh, A., Bognanni, A., Lotf, T., Loeb, M., ... & Chen, C. (2020). Physical Distancing, Face Masks, and Eye Protection to Prevent Person-Person COVID-19 Transmission: A Systematic Review and Meta-Analysis.

Buitrago-Garcia, D. C., Egli-Gany, D., Counotte, M. J., Hossmann, S., Imeri, H., Salanti, G., & Low, N. (2020). The role of asymptomatic SARS-CoV-2 infections: Rapid living systematic review and meta-analysis [Preprint]. Epidemiology. https://doi.org/10.1101/2020.04.25.20079103

Fischer, R., Karl, J. A., Bortolini, T., Zilberberg, M., Robinson, K., Rabelo, A. L. A., … Mattos, P. (2020, April 22). Rapid review and meta-meta-analysis of self-guided interventions to address anxiety, depression and stress during COVID-19 social distancing. https://doi.org/10.31234/osf.io/ndyf4

This firing of Snopes managing editor reiterates previous concerns over an unhealthy working environment. This article is old enough I'd like to see followups.

Impressive. Her alleged painstaking data-hoarding makes me like her. I'm not sure what to think of David's ambiguity yet.

In his commentary, Alex Holcombe makes the argument that only ‘one or two exemplars of a color category’ are typically examined in color studies, and this is problematic because a color such as ‘red’ is a category, not a single hue.

Although in some fields it is very important to examine a range of stimuli, and in general examining the generalizability of findings has an important place in research lines, I do not think that currently this issue is a pressing concern in color psychology. Small variations in hue and brightness naturally occur in online studies, and these are assumed not to matter for the underlying mechanism. Schietecat, Lakens, IJsselsteijn, and De Kort (2018) write: “In addition, we conducted Experiments 1 and 3 in a laboratory environment, but Experiments 2, 4, and 5 were conducted in participants’ homes with an internet-based method. Therefore, we could not be completely sure that the presentation of the stimuli on their personal computers was identical for every participant in those experiments. However, we expected that the impact of these variations on our results is not substantial. The labels of the IAT (i.e., red vs blue) increased the salience of the relevant hue dimension, and we do not expect our results to hold for very specific hues, but for colors that are broadly categorized as red, blue, and green. The similar associative patterns across Experiments 2 and 3 seem to support this expectation.”

We wrote this because there is nothing specific about the hue that is expected to drive the effects in association based accounts of psychological effects of colors. If the color ‘red’ is associated with specific concepts (and the work by Schietecat at all supports the idea that red can activate associations related to either activity and evaluation, such as aggression or enthusiasm, depending on the context). This means that the crucial role of the stimulus is to activate the association with ‘red’, no the perceptual stimulation of the eye in any specific way. The critical manipulation check would thus be is people categorize a stimulus as ‘red’. As long as this is satisfied, we can assume the concept ‘red’ is activated, which can then activate related associations, depending on the context.

Obviously, the author is correct that there are benefits in testing multiple variations of the color ‘red’ to demonstrate the generalizability of observed effects. However, the authors is writing too much as a perception researcher I fear. If there is a strong theoretical reason to assume slightly different hues and chromas will not matter (because as long as a color is recognized as ‘red’ it will activate specific associations) the research priority of varying colors is much lower than in other fields (e.g., research on human faces) where it is more plausible that the specifics of the stimuli matter. A similar argument holds for the question whether “any link is specifically to red, rather than extending to green, yellow, purple, and brown”. This is too a-theoretical, and even though not all color research has been replicable, and many studies suffered from problems identified during the replication crisis, the theoretical models are still plausible, and specific to predictions about certain hues. We know quite a lot about color associations for prototypical colors in terms of their associations with valence and activity (e.g., Russell & Mehrabian, 1977) and this can be used to make more specific predictions than to a-theoretically test the entire color spectrum.

Indeed, across the literature many slightly different variations of red are used, or in online studies (Schietecat et al., 2018) studies have been performed online, where different computer screens will naturally lead to some variation in the exact colors presented. This doesn’t mean that more dedicated exploration of the boundaries of these effects can be worthwhile in the future. But currently, the literature is more focused on examining whether these effects are reliable to begin with, and explaining basic questions about their context dependency, than that they are concerned about testing the range of hues for which effects can be observed. So, although in principle it is often true that the generalizability of effects is understudies and deserved more attention, it is not color psychology’s most pressing concern, because we have theoretical predictions about specific colors, and because theoretically as long as a color activates the concept (e.g., ‘red’), the associated concepts that influence subsequent psychological responses are assumed to be activated, irrespective of minor differences in for example hue or brightness.

Daniel Lakens

References

Russell, J. A., & Mehrabian, A. (1977). Evidence for a three-factor theory of emotions. Journal of Research in Personality, 11(3), 273–294. DOI: https://doi.org/10.1016/0092-6566(77)90037-X Schietecat, A. C., Lakens, D., IJsselsteijn, W. A., & Kort, Y. A. W. de. (2018). Predicting Context-dependent Cross-modal Associations with Dimension-specific Polarity Attributions. Part 2: Red and Valence. Collabra: Psychology, 4(1). https://doi.org/10.1525/COLLABRA.126

good meta-review -> weight more heavily from reviews, and why

good meta-review: -> consider all of the reviewers' opinions