Brown, R. C. H., Kelly, D., Wilkinson, D., & Savulescu, J. (2020). The scientific and ethical feasibility of immunity passports. The Lancet Infectious Diseases, 0(0). https://doi.org/10.1016/S1473-3099(20)30766-0

Health Nerd on Twitter. (n.d.). Twitter. Retrieved October 17, 2020, from https://twitter.com/GidMK/status/1316511734115385344

Yang Chan, E. Y., Shahzada, T. S., Sham, T. S. T., Dubois, C., Huang, Z., Liu, S., Ho, J. Y., Hung, K. K. C., Kwok, K. O., & Shaw, R. (n.d.). Narrative review of non-pharmaceutical behavioural measures for the prevention of COVID-19 (SARS-CoV-2) based on the Health-EDRM framework. British Medical Bulletin. https://doi.org/10.1093/bmb/ldaa030

r/BehSciResearch—Review on combatting the COVID misinformation flood. (n.d.). Reddit. Retrieved October 12, 2020, from https://www.reddit.com/r/BehSciResearch/comments/j9mrlp/review_on_combatting_the_covid_misinformation/

This is reminiscent of the idea that indigenous peoples regularly met at annual feasts to not only celebrate, but to review over their memory palaces and perform their rituals as a means of reviewing and strengthening their memories and ideas.

Do your colleagues who read your work, annotate it, and comment on it not count as peer-review?

Am I wasting my time by annotating all of this? :) (I don't think so...)

For a while I've been doing PESOS from reading.am to my website privately. Then a day or so later I come back to the piece to think about it again and post any additional thoughts, add tags, etc. I often find that things I missed the first time around manage to resurface. Unless I've got a good reason not to I usually then publish it.

lit review

PREreview, Daniela Saderi, Ph D. , Co-Founder and Director of. ‘Crowdsourcing Preprint Reviews: PREreview and COS Call for Feedback on Infrastructure Integration’. Accessed 2 October 2020. https://www.cos.io/blog/prereview-and-cos-call-for-feedback-on-infrastructure-integration.

Prof Fiona Fidler | Collaborative assessment for trustworthy science: The repliCATS project. (2020, July 27). https://www.youtube.com/watch?v=KhDKzEsPouI&feature=youtu.be

Merrill, K. A., William, T., Joyce, K. M., Roos, L. E., & Protudjer, J. (2020). Potential psychosocial impact of COVID-19 on children: A scoping review of pandemics & epidemics [Preprint]. PsyArXiv. https://doi.org/10.31234/osf.io/ucdg9

Daniël Lakens on Twitter. (n.d.). Twitter. Retrieved September 23, 2020, from https://twitter.com/lakens/status/1308115862247952386

The Contagion Externality of a Superspreading Event: The Sturgis Motorcycle Rally and COVID-19 | NCRC. (2020, September 3). 2019 Novel Coronavirus Research Compendium (NCRC). https://ncrc.jhsph.edu/research/the-contagion-externality-of-a-superspreading-event-the-sturgis-motorcycle-rally-and-covid-19/

Offeddu, V., Yung, C. F., Low, M. S. F., & Tam, C. C. (2017). Effectiveness of Masks and Respirators Against Respiratory Infections in Healthcare Workers: A Systematic Review and Meta-Analysis. Clinical Infectious Diseases, 65(11), 1934–1942. https://doi.org/10.1093/cid/cix681

Giles, J. R., Erbach-Schoenberg, E. zu, Tatem, A. J., Gardner, L., Bjørnstad, O. N., Metcalf, C. J. E., & Wesolowski, A. (2020). The duration of travel impacts the spatial dynamics of infectious diseases. Proceedings of the National Academy of Sciences, 117(36), 22572–22579. https://doi.org/10.1073/pnas.1922663117

Siemieniuk, R. A., Bartoszko, J. J., Ge, L., Zeraatkar, D., Izcovich, A., Kum, E., Pardo-Hernandez, H., Rochwerg, B., Lamontagne, F., Han, M. A., Liu, Q., Agarwal, A., Agoritsas, T., Chu, D. K., Couban, R., Darzi, A., Devji, T., Fang, B., Fang, C., … Brignardello-Petersen, R. (2020). Drug treatments for covid-19: Living systematic review and network meta-analysis. BMJ, 370. https://doi.org/10.1136/bmj.m2980

JNOLive | Multiplicity of Randomized Clinical Trials for Coronavirus Disease 2019. (2020, July 14). https://www.youtube.com/watch?v=H-MWPqgLUvA&feature=youtu.be

Max Primbs on Twitter. (n.d.). Twitter. Retrieved September 14, 2020, from https://twitter.com/MaxPrimbs/status/1304516869509066760

Outbreak Science Rapid PREreview • Dashboard. (n.d.). Retrieved September 11, 2020, from https://outbreaksci.prereview.org/dashboard?q=COVID-19&q=Coronavirus&q=SARS-CoV-2

Rapid Reviews COVID-19. (n.d.). Rapid Reviews COVID-19. Retrieved September 11, 2020, from https://rapidreviewscovid19.mitpress.mit.edu/

Marcus, A. A. (2020, September 8). COVID-19 arrived on a meteorite, claims Elsevier book chapter. Retraction Watch. https://retractionwatch.com/2020/09/08/covid-19-arrived-on-a-meteorite-claims-elsevier-book-chapter/

r/BehSciMeta - Comment by u/dawnlxh on ”A completely re-imagined approach to peer review and publishing: PRINCIPIA”. (n.d.). Reddit. Retrieved September 10, 2020, from https://www.reddit.com/r/BehSciMeta/comments/if03sk/a_completely_reimagined_approach_to_peer_review/g4nnuc5

Rajkumar, R. P. (2020). Novel Coronavirus Disease (COVID-19) and Suicide: Conceptual and Practical Considerations [Preprint]. PsyArXiv. https://doi.org/10.31234/osf.io/z7drs

Paudel, Dhirendra. ‘ABC Framework of Fear of COVID-19 for Psychotherapeutic Intervention in Nepal: A Review’. Preprint. PsyArXiv, 4 September 2020. https://doi.org/10.31234/osf.io/9sj4a.

BAME COVID-19 DEATHS - What do we know? Rapid Data & Evidence Review. (n.d.). CEBM. Retrieved June 2, 2020, from https://www.cebm.net/covid-19/bame-covid-19-deaths-what-do-we-know-rapid-data-evidence-review/

r/BehSciMeta—No appeasement of bad faith actors. (n.d.). Reddit. Retrieved June 2, 2020, from https://www.reddit.com/r/BehSciMeta/comments/gv0y99/no_appeasement_of_bad_faith_actors/

Clements, J. C. (2020). Don’t be a prig in peer review. Nature. https://doi.org/10.1038/d41586-020-02512-0

Kapatel, P. M., & Malik, N. ara. (2020). Probable immersions for novel Coronavirus and its preventions: A systematic review [Preprint]. PsyArXiv. https://doi.org/10.31234/osf.io/y34uv

Smith, C. F., Drew, S., Ziebland, S., & Nicholson, B. D. (2020). Understanding the role of GPs’ gut feelings in diagnosing cancer in primary care: A systematic review and meta-analysis of existing evidence. British Journal of General Practice, 70(698), e612–e621. https://doi.org/10.3399/bjgp20X712301

About | OpenReview. (n.d.). Retrieved May 30, 2020, from https://openreview.net/about

Larsen, D., Dinero, R. E., Asiago-Reddy, E., Green, H., Lane, S., Shaw, A., Zeng, T., & Kmush, B. (2020). A review of infectious disease surveillance to inform public health action against the novel coronavirus SARS-CoV-2 [Preprint]. SocArXiv. https://doi.org/10.31235/osf.io/uwdr6

Acosta, M., & Nestore, M. (2020). Comparing public policy implementation in Taiwan and Vietnam in the early stages of the COVID-19 outbreak: A review [Preprint]. SocArXiv. https://doi.org/10.31235/osf.io/69hqx

Naikoba, S., & Hayward, A. (2001). The effectiveness of interventions aimed at increasing handwashing in healthcare workers—A systematic review. Journal of Hospital Infection, 47(3), 173–180. https://doi.org/10.1053/jhin.2000.0882

A Literature Review of the Economics of COVID-19. COVID-19 and the Labor Market. (n.d.). IZA – Institute of Labor Economics. Retrieved July 31, 2020, from https://covid-19.iza.org/publications/dp13411/

Rahvy, A., & Ridlo, I. A. (2020). A Timeline Response: How Does Islamic Organizations Respond to COVID-19 in Indonesia? https://doi.org/10.31235/osf.io/kzhy9

Bababekov, Y. J., Hung, Y.-C., Hsu, Y.-T., Udelsman, B. V., Mueller, J. L., Lin, H.-Y., Stapleton, S. M., & Chang, D. C. (2019). Is the Power Threshold of 0.8 Applicable to Surgical Science?—Empowering the Underpowered Study. Journal of Surgical Research, 241, 235–239. https://doi.org/10.1016/j.jss.2019.03.062

Mambrini, A., Baronchelli, A., Starnini, M., Marinazzo, D., & De Domenico, M. (2020). PRINCIPIA: A Decentralized Peer-Review Ecosystem. ArXiv:2008.09011 [Nlin, Physics:Physics]. http://arxiv.org/abs/2008.09011

Mambrini. A. Baronchelli. A. Starnini. M. Marinazzo. D. De Domenico, M. (2020) .PRINCIPIA: a Decentralized Peer-Review Ecosystem. Retrieved from: chrome-extension://bjfhmglciegochdpefhhlphglcehbmek/pdfjs/web/viewer.html?file=https%3A%2F%2Farxiv.org%2Fpdf%2F2008.09011.pdf

Lawlor, Jennifer, Zachary Neal, and Kyle Metta. ‘What Is a Coalition? A Systematic Review of Coalitions in Community Psychology’. Preprint. PsyArXiv, 20 August 2020. https://doi.org/10.31234/osf.io/ba4yw.

Mohammadi, A., Esmaeilzadeh, E., Li, Y., Bosch, R. J., & Li, J. Z. (2020). SARS-CoV-2 detection in different respiratory sites: A systematic review and meta-analysis. EBioMedicine, 0(0). https://doi.org/10.1016/j.ebiom.2020.102903

Cevik, M., Tate, M., Lloyd, O., Maraolo, A. E., Schafers, J., & Ho, A. (2020). SARS-CoV-2, SARS-CoV-1 and MERS-CoV viral load dynamics, duration of viral shedding and infectiousness: A living systematic review and meta-analysis. MedRxiv, 2020.07.25.20162107. https://doi.org/10.1101/2020.07.25.20162107

Ventilator Allocation for Covid-19, Mask Sterilization, HIV Life Expectancy, and more #JNOLive. (2020, June 23). https://www.youtube.com/watch?v=3htA-tav11M&feature=emb_logo

Schalkwyk, M. C. I. van, Hird, T. R., Maani, N., Petticrew, M., & Gilmore, A. B. (2020). The perils of preprints. BMJ, 370. https://doi.org/10.1136/bmj.m3111. https://t.co/qNPLYCeT99?amp=1

Arqoub, O. A., Elega, A. A., Özad, B. E., Dwikat, H., & Oloyede, F. A. (2020). Mapping the Scholarship of Fake News Research: A Systematic Review. Journalism Practice, 0(0), 1–31. https://doi.org/10.1080/17512786.2020.1805791

Besançon, L., Peiffer-Smadja, N., Segalas, C., Jiang, H., Masuzzo, P., Smout, C., Deforet, M., & Leyrat, C. (2020). Open Science Saves Lives: Lessons from the COVID-19 Pandemic. BioRxiv, 2020.08.13.249847. https://doi.org/10.1101/2020.08.13.249847

Erev, I., Plonsky, O., & Roth, Y. (2020). Complacency, panic, and the value of gentle rule enforcement in addressing pandemics. Nature Human Behaviour, 1–3. https://doi.org/10.1038/s41562-020-00939-z

Avery, C., Bossert, W., Clark, A., Ellison, G., & Ellison, S. F. (2020). Policy Implications of Models of the Spread of Coronavirus: Perspectives and Opportunities for Economists (Working Paper No. 27007; Working Paper Series). National Bureau of Economic Research. https://doi.org/10.3386/w27007

Michael Eisen on Twitter: “A core problem in science publishing today is that we have a system where the complex, multidimensional assessment of the rigor, validity, utility, audience and impact of a work that emerges from peer review gets reduced to a single overvalued ‘accept/reject’ decision.” / Twitter. (n.d.). Twitter. Retrieved August 10, 2020, from https://twitter.com/mbeisen/status/1291752487448276992

Collins, G. S., & Wilkinson, J. (n.d.). Statistical issues in the development a COVID-19 prediction models. Journal of Medical Virology, n/a(n/a). https://doi.org/10.1002/jmv.26390

Esther Choo, MD MPH on Twitter: “Question for Twitter. Why didn’t academia take the lead on Covid information? Why didn’t schools of med & public health across the US band together, put forth their experienced scientists in epidemiology, virology, emergency & critical care, pandemic and disaster response...” / Twitter. (n.d.). Twitter. Retrieved August 10, 2020, from https://twitter.com/choo_ek/status/1291789978716868608

Parikh, D. (2020, May 27). How we write rebuttals. Medium. https://medium.com/@deviparikh/how-we-write-rebuttals-dc84742fece1

‘OSF: A Project Management Service Built for Research - ROpenSci - Open Tools for Open Science’. Accessed 10 August 2020. https://ropensci.org/blog/2020/08/04/osf/.

Taraborelli, D., Taraborelli, D., & Taraborelli, D. (2020, August 5). How the COVID-19 crisis has prompted a revolution in scientific publishing. Fast Company. https://www.fastcompany.com/90537072/how-the-covid-19-crisis-has-prompted-a-revolution-in-scientific-publishing

Quinn, A. E., Trachtenberg, A. J., McBrien, K. A., Ogundeji, Y., Souri, S., Manns, L., Rennert-May, E., Ronksley, P., Au, F., Arora, N., Hemmelgarn, B., Tonelli, M., & Manns, B. J. (2020). Impact of payment model on the behaviour of specialist physicians: A systematic review. Health Policy, 124(4), 345–358. https://doi.org/10.1016/j.healthpol.2020.02.007

Hoekstra, R., & Vazire, S. (2020, July 29). Hoekstra & Vazire (2020), Intellectual humility is central to science. https://doi.org/10.31234/osf.io/edh2s

Oxford COVID-19 study: Face masks and coverings work – act now | University of Oxford. (n.d.). Retrieved 27 July 2020, from https://www.ox.ac.uk/news/2020-07-08-oxford-covid-19-study-face-masks-and-coverings-work-act-now

Younes, G. A., Ayoubi, C., Ballester, O., Cristelli, G., de Rassenfosse, G., Foray, D., Gaule, P., Pellegrino, G., van den Heuvel, M., Webster, B., & Zhou, L. (2020). COVID-19_Insights from Innovation Economists [Preprint]. SocArXiv. https://doi.org/10.31235/osf.io/b5zae

Kundu, B., & Bhowmik, D. (2020). Societal impact of novel corona virus (COVID ̶ 19 pandemic) in India [Preprint]. SocArXiv. https://doi.org/10.31235/osf.io/vm5rz

Sehgal, D. (2020). Analysis of Vaccines to tackle COVID-19 with Patent Review [Preprint]. SocArXiv. https://doi.org/10.31235/osf.io/q96wj

Eisen, M. B., & Tibshirani, R. (2020, July 20). Opinion | How to Identify Flawed Research Before It Becomes Dangerous. The New York Times. https://www.nytimes.com/2020/07/20/opinion/coronavirus-preprints.html

Protogerou, Cleo, and Martin S. Hagger. ‘A Checklist to Assess the Quality of Survey Studies in Psychology’, 14 July 2020. https://doi.org/10.31234/osf.io/uqak8.

Nieto, I., Navas, J. F., & Vazquez, C. (2020). The quality of research on mental health effects of the COVID-19 pandemic: A note of caution after a systematic review. https://doi.org/10.31234/osf.io/ndgkj

Dan Quintana on Twitter: “Tomorrow at 1pm CEST I’ll be doing a virtual talk for the Rotterdam R.I.O.T. Science Club (@rdam_riots) on using Twitter for science 🧬 I’ll be covering both the why and the how + I’ll be leaving plenty of time for a Q&A session. Watch here: https://t.co/nXHry9Inyi https://t.co/T6u7lvgAhO” / Twitter. (n.d.). Twitter. Retrieved June 17, 2020, from https://twitter.com/dsquintana/status/1264623289814659072

COVID-19, preprints, and the information ecosystem. (n.d.). Retrieved June 17, 2020, from https://www.youtube.com/watch?v=yWi4Q5rZiO0

Brock. J. (2020). Rapid Registered Reports initiative aims to stop coronavirus researchers following false leads. Nature index

Yesilada. M. (2020). From peer review to “science without the drag” via PsyArXiv. Psychonomic Society.

Clark, J., Glasziou, P., Mar, C. D., Bannach-Brown, A., Stehlik, P., & Scott, A. M. (2020). A full systematic review was completed in 2 weeks using automation tools: A case study. Journal of Clinical Epidemiology, 121, 81–90. https://doi.org/10.1016/j.jclinepi.2020.01.008

Andrew (2020, June 11) bla bla bla PEER REVIEW bla bla bla.. Retrieved from https://statmodeling.stat.columbia.edu/2020/06/11/bla-bla-bla-peer-review-bla-bla-bla/

Henley, J. (2020, June 26). Swedes rapidly losing trust in Covid-19 strategy, poll finds. The Guardian. https://www.theguardian.com/world/2020/jun/26/swedes-rapidly-losing-trust-in-covid-19-strategy-poll-finds

Sasaki, K., & Yamada, Y. (2020). The pandemic threatens the Registered Reports system as well as human lives [Preprint]. PsyArXiv. https://doi.org/10.31234/osf.io/6wdaz

Su, Q., Hu, J., Lin, H., Zhang, Z., Zhu, E. C., Zhang, C., Wang, D., Gao, Z., & Cao, B. (2020). Prevalence and risks of severe events for cancer patients with COVID-19 infection: A systematic review and meta-analysis. MedRxiv, 2020.06.23.20136200. https://doi.org/10.1101/2020.06.23.20136200

Peer Review Practices

Guide the reviewer during the review process

Inspection rate Defect rate Defect density

Set few tangible goals. Fix more bugs is not a good example.

Only less than 500 LOC per hour

<400 LOC

Dr Daniel Quintana | Using Twitter for Science | R.I.O.T. Science Club—YouTube. (2020, May 26). https://www.youtube.com/watch?v=pA5Y4cO934I

Mis-allocated scrutiny. (2020, June 24). The 100% CI. http://www.the100.ci/2020/06/24/mis-allocated-scrutiny/

Palayew, A., Norgaard, O., Safreed-Harmon, K. et al. Pandemic publishing poses a new COVID-19 challenge. Nat Hum Behav (2020). https://doi.org/10.1038/s41562-020-0911-0

Horbach, S. P. J. M. (2020). Pandemic Publishing: Medical journals drastically speed up their publication process for Covid-19. BioRxiv, 2020.04.18.045963. https://doi.org/10.1101/2020.04.18.045963