Susan Athey, July 22, 2020. (2020, August 2). https://www.youtube.com/watch?v=hqTOPrUxDzM

Hahn, U., & Oaksford, M. (2006). A Normative Theory of Argument Strength. Informal Logic, 26(1), 1–24. https://doi.org/10.22329/il.v26i1.428

Goldman, E. (2020). Exaggerated risk of transmission of COVID-19 by fomites. The Lancet Infectious Diseases, 0(0). https://doi.org/10.1016/S1473-3099(20)30561-2

ScD, N. N. A. (2020, June 11). A Guide to Understanding Pandemic Predictions. Medium. https://elemental.medium.com/a-guide-to-understanding-pandemic-predictions-8ae3439b8224

Daeschler, S. C., Manson, N., Joachim, K., Chin, A. W. H., Chan, K., Chen, P. Z., Jones, A., Tajdaran, K., Mirmoeini, K., Zhang, J. J., Maynes, J. T., Zhang, L., Science, M., Darbandi, A., Stephens, D., Gu, F., Poon, L. L. M., & Borschel, G. H. (2020). Effect of moist heat reprocessing of N95 respirators on SARS-CoV-2 inactivation and respirator function. CMAJ. https://doi.org/10.1503/cmaj.201203

Sun, W., McCroskery, S., Liu, W.-C., Leist, S. R., Liu, Y., Albrecht, R. A., Slamanig, S., Oliva, J., Amanat, F., Schäfer, A., Dinnon, K. H., Innis, B. L., García-Sastre, A., Krammer, F., Baric, R. S., & Palese, P. (2020). A Newcastle disease virus (NDV) expressing membrane-anchored spike as a cost-effective inactivated SARS-CoV-2 vaccine. BioRxiv, 2020.07.30.229120. https://doi.org/10.1101/2020.07.30.229120

Jørgensen, F. J., Bor, A., Lindholt, M. F., & Petersen, M. B. (2020). Lockdown Evaluations During the First Wave of the COVID-19 Pandemic [Preprint]. PsyArXiv. https://doi.org/10.31234/osf.io/4ske2

Chetty, R., Friedman, J. N., Hendren, N., Stepner, M., & Team, T. O. I. (2020). How Did COVID-19 and Stabilization Policies Affect Spending and Employment? A New Real-Time Economic Tracker Based on Private Sector Data (Working Paper No. 27431; Working Paper Series). National Bureau of Economic Research. https://doi.org/10.3386/w27431

Cognitive Performance in the Home Office – Evidence from Professional Chess. COVID-19 and the Labor Market. (n.d.). IZA – Institute of Labor Economics. Retrieved July 29, 2020, from https://covid-19.iza.org/publications/dp13491/

Azim, S. S., roy, arindam, Aich, A., & Dey, D. (2020). Fake news in the time of environmental disaster: Preparing framework for COVID-19 [Preprint]. SocArXiv. https://doi.org/10.31235/osf.io/wdr5v

Barton, C. M., Alberti, M., Ames, D., Atkinson, J.-A., Bales, J., Burke, E., Chen, M., Diallo, S. Y., Earn, D. J. D., Fath, B., Feng, Z., Gibbons, C., Hammond, R., Heffernan, J., Houser, H., Hovmand, P. S., Kopainsky, B., Mabry, P. L., Mair, C., … Tucker, G. (2020). Call for transparency of COVID-19 models. Science, 368(6490), 482.2-483. https://doi.org/10.1126/science.abb8637

Eisen, M. B., & Tibshirani, R. (2020, July 20). Opinion | How to Identify Flawed Research Before It Becomes Dangerous. The New York Times. https://www.nytimes.com/2020/07/20/opinion/coronavirus-preprints.html

Cazabet, R., Boudebza, S., & Rossetti, G. (2020). Evaluating Community Detection Algorithms for Progressively Evolving Graphs. ArXiv:2007.08635 [Physics]. http://arxiv.org/abs/2007.08635

Mulligan, M. J., Lyke, K. E., Kitchin, N., Absalon, J., Gurtman, A., Lockhart, S. P., Neuzil, K., Raabe, V., Bailey, R., Swanson, K. A., Li, P., Koury, K., Kalina, W., Cooper, D., Fonter-Garfias, C., Shi, P.-Y., Tuereci, O., Tompkins, K. R., Walsh, E. E., … Jansen, K. U. (2020). Phase 1/2 Study to Describe the Safety and Immunogenicity of a COVID-19 RNA Vaccine Candidate (BNT162b1) in Adults 18 to 55 Years of Age: Interim Report. MedRxiv, 2020.06.30.20142570. https://doi.org/10.1101/2020.06.30.20142570

Schraff, D. (2020). Political trust during the Covid-19 pandemic: Rally around the flag or lockdown effects? [Preprint]. SocArXiv. https://doi.org/10.31235/osf.io/pu47c

Protogerou, Cleo, and Martin S. Hagger. ‘A Checklist to Assess the Quality of Survey Studies in Psychology’, 14 July 2020. https://doi.org/10.31234/osf.io/uqak8.

Belli, S., & Alonso, C. V. (2020). COVID-19 Pandemic and Emotional Contagion: Societies facing Collapse [Preprint]. SocArXiv. https://doi.org/10.31235/osf.io/gdbw6

Project background – Critical Analysis Project. (n.d.). Retrieved July 10, 2020, from http://critical-analysis.org/project-background/

Argument Quality in Real World Argumentation. (2020). Trends in Cognitive Sciences, 24(5), 363–374. https://doi.org/10.1016/j.tics.2020.01.004

Di Lauro, F., Croix, J.-C., Berthouze, L., & Kiss, I. (2020). PDE-limits of stochastic SIS epidemics on networks. ArXiv:2007.01043 [Physics, q-Bio]. http://arxiv.org/abs/2007.01043

Spreckelsen, P. von, Wessel, I., Glashouwer, K., & Jong, P. J. de. (2020). Preprint Averting Repulsion? Body-Directed Self-Disgust and Autobiographical Memory Retrieval. https://doi.org/10.31234/osf.io/qhc35

Midgley, C., Thai, S., Lockwood, P., Kovacheff, C., & Page-Gould, E. (2020). When Every Day is a High School Reunion: Social Media Comparisons and Self-Esteem [Preprint]. PsyArXiv. https://doi.org/10.31234/osf.io/zmy29

DELVE group publishes evidence paper on the use of face masks in tackling Coronavirus (COVID-19) pandemic | Royal Society. (2020 May 04). https://royalsociety.org/news/2020/05/delve-group-publishes-evidence-paper-on-use-of-face-masks/

Infurna, F. J., & Luthar, S. S. (2018). Re-evaluating the notion that resilience is commonplace: A review and distillation of directions for future research, practice, and policy. Clinical Psychology Review, 65, 43–56. https://doi.org/10.1016/j.cpr.2018.07.003

Leplaa, H. J., Rietbergen, C., & Hoijtink, H. (2020). Bayesian evaluation of replication studies [Preprint]. PsyArXiv. https://doi.org/10.31234/osf.io/49tbz

Bell, K., & Green, J. (2020). Premature evaluation? Some cautionary thoughts on global pandemics and scholarly publishing. Critical Public Health, 0(0), 1–5. https://doi.org/10.1080/09581596.2020.1769406

Bell, Kirsten, and Judith Green. “Premature Evaluation? Some Cautionary Thoughts on Global Pandemics and Scholarly Publishing.” Critical Public Health 0, no. 0 (May 22, 2020): 1–5. https://doi.org/10.1080/09581596.2020.1769406.

Why We Fall Prey to Misinformation. (n.d.). Association for Psychological Science - APS. Retrieved May 29, 2020, from https://www.psychologicalscience.org/news/releases/why-we-fall-prey-to-misinformation.html

Jørgensen, F. J., Bor, A., & Petersen, M. (2020, May 19). Compliance Without Fear: Predictors of Protective Behavior During the First Wave of the COVID-19 Pandemic. https://doi.org/10.31234/osf.io/uzwgf

La motivation et l'assiduité sont à prendre avec précaution tant les attendus des enseignants peuvent être en décalage avec ce que les élèves ont pu percevoir des consignes passées par l’entonnoir du numérique.

Tsitsulin, A. & Perozzi B. Understanding the Shape of Large-Scale Data. (2020 May 05). Google AI Blog. http://ai.googleblog.com/2020/05/understanding-shape-of-large-scale-data.html

Davis, N. (2020, May 4). Report on face masks’ effectiveness for Covid-19 divides scientists. The Guardian. https://www.theguardian.com/world/2020/may/04/scientists-disagree-over-face-masks-effect-on-covid-19

ReconfigBehSci en Twitter: “There is now a flood of COVID-19 preprints from the behavioural sciences - these need critical evaluation and discussion! Are you a behavioural scientist? Then please join our community-based discussion platform now, see: https://t.co/zDXjvZFtkM” / Twitter. (n.d.). Twitter. Retrieved May 6, 2020, from https://twitter.com/SciBeh/status/1257923658334511104

Pearson, H., & Balas, B. (2020, May 5). Can naive observers detect suicidality in face images? A replication and extension of Kleiman and Rule (2013). https://doi.org/10.31234/osf.io/prfm3

Kamorowski, J., de Ruiter, C., Schreuder, M., Ask, K., & Jelicic, M. (2020, April 16). Forensic Mental Health Practitioners’ Use of Structured Risk Assessment Instruments, Views About Bias in Risk Evaluations, and Strategies to Counteract It. https://doi.org/10.31234/osf.io/te5c2

Beitner, J., Brod, G., Gagl, B., Kraft, D., & Schultze, M. (2020, April 23). Offene Wissenschaft in der Zeit von Covid-19 – Eine Blaupause für die psychologische Forschung?. https://doi.org/10.31234/osf.io/sh8xg

Giangreco, G. (n.d.). Case fatality rate analysis of Italian COVID-19 outbreak. Journal of Medical Virology, n/a(n/a). https://doi.org/10.1002/jmv.25894

How Complex Systems Fail

Montreal Declaration on Evaluation and Social Impact Measurement (TIESS)

Openness on including and/or creating new/different evaluation strategies that are sensitive to personal dimensions of works produced in the experience.

This is a very rich section: openness in developing skills, connecting materials, skills, roles, feedback and evaluation to other learners, and including other learners in the experience.

This article discusses whether or not online professors are assessed and by whom. Nearly 60% of online teachers are never evaluated! Because of this Learning House recommends incentivized trainings, regular feedback/evaluation, professional development and a uniform learning experience with standard components for all online classes. Rating 6/10

This is a discussion of informal learning that focuses on ensuring that incidences of informal learning are recognized. This discussion portrays it has happening through casual conversations, online discussions, or social media. The page is easy enough to read though it does not try to be comprehensive. rating 2/5

Gagne's nine events of instruction I am including this page for myself because it is a nice reference back to Gagne's nine events and it gives both an example of each of the events as well as a list of four essential principles. It also includes some of his book titles. rating 4/5

Edward Thorndike's three laws of learning. The page does not explain this, but his theories came out in about 1900. His three laws of learning appear to be relevant to our course work. This simple page features black text on a white page. It is brief and it simply describes the three laws of learning. rating 5/5

Jack Phillips and ROI. This page describes the Phillips Return on Investment model. The model as presented here is an alternative to Kirkpatrick's model. There's a bulleted list of the components of the model as well as a nice graphic that briefly describes the levels. There is an explanation about how to apply the model, though I think more information would be needed for real world practice. Rating 4/5

This is Bloom's taxonomy of cognitive objectives. I selected this page because it explains both the old and new versions of the taxonomy. When writing instructional objectives for adult learning and training, one should identify the level of learning in Blooms that is needed. This is not the most attractive presentation but it is one of the more thorough ones. rating 4/5

Human Performance Technology Model This page is an eight page PDF that gives an overview of the human performance technology model. This is a black and white PDF that is simply written and is accessible to the layperson. Authors are prominent writers in the field of performance technology. Rating 5/5

This link is to a three-page PDF that describes Gagne's nine events of instruction, largely in in the form of a graphic. Text is minimized and descriptive text is color coded so it is easy to find underneath the graphic at the top. The layout is simple and easy to follow. A general description of Gagne's work is not part of this page. While this particular presentation does not have personal appeal to me, it is included here due to the quality of the page and because the presentation is more user friendly than most. Rating 4/5

This page is a simply presented list of many learning theories, both popular and less well known. The layout is clean. The pages to which the listed items link are somewhat minimal in nature so this would give a basic tour or overview of the models and would allow viewers to review the names of some of the learning theories. This page does not prioritize learning theories or identify and establish those theories that are the most prominent.

This is one of many discussions of Kirkpatrick's four levels of evaluation. More of the page is taken up with decoration and graphics than needs to be the case but this page is included in this list because it offers a printable guide and because the hierarchy of the four levels is clearly shown. The text itself is printed in black on a white background and it is presented as a bulleted list (the bullets are not organized as well as they could be). Nonetheless it is a usable presentation of this model. rating 3/5

This 69 page PDF offers good advice on writing a variety of types of test questions. It is called "Is this a trick question?" Despite the length of the PDF, it is easy to browse if you are interested in writing a specific type of question. As may be suggested by the length, this resource is more comprehensive than others. Rating 5/5

This is a description of the form of backward design referred to as Understanding by Design. In its simplest form, this is a three step process in which instructional designers first specify desired outcomes and acceptable evidence before specifying learning activities. This presentation may be a little boring to read as it is text-heavy and black and white, but those same attributes make it printer friendly. rating 3/5

This is a lot. How do we currently do this? How is this successful?

The Rubric for E-Learning Tool Evaluation offers educators a framework, with criteria and levels of achievement, to assess the suitability of an e-learning tool for their learners' needs and for their own learning outcomes and classroom context.

该文做的实验是探索对数据集进行 shifts (某种可控的扰动) 后的模型表现，提出了classifier-based的方法/pipeline 来观察和评价：

这对于我的引力波数据研究来说，可以借鉴其数据的 shift 方法以及评价机制 （two-sample tests）。

精心构造了一个度量：generalized discrimination value（GDV），实现了对网络各层中对不同输入类别的量化评价。这个评价定义还关于输入数据有平移不变性和缩放不变性 ，同时，并不依赖特征图的数目，也不依赖于每层中神经元的数目和排序。

深度神经网络训练(收敛/泛化性能)的近似Fisher信息矩阵表征，可自动优化mini-batch size/learning rate

挺有趣的 paper，提出了从 Fisher 矩阵抽象出新的量用来衡量训练过程中的模型表现，来优化mini-batch sizes and learning rates | 另外 paper 中的figure画的很好看 | 作者认为逐步增加batch sizes的传统理解只是partially true，存在逐步递减该 size 来提高 model 收敛和泛化能力的可能。

This is a cool trick and it sounds like partial evaluation and just-in-time compilation.

In todays society life satisfaction and happiness is presented in the form of a college degree, a powerful career, and the amount of money you have. It seems like the only way to make it in this world is to be robotic and follow the system. We have lost touch of what life should consist of. Todays youth are conditioned to follow the path of money and power instead of happiness. Kids should be kids, not robots.

Thus the question of the decade is answered. The amount of time spent with parents has increased because of the intense competition for spots in top universities. Parents are prepared to do anything like signing their children up for extra circular activities, sports, even volunteer work in hopes that scholarships and acceptance will be rewarded.

With more and more people attending college and getting a degree, the market for a successful career is quickly becoming less tangible. This has created an extreme competition between the youth to secure their futures.

The process to attend an elite university was ultimately built for the rich and powerful. Any college you choose could teach you a profession, but these were built to be superior. You could attend a state school for a good price, but some are willing to pay tens of thousands of dollars to secure themselves a spot at the top of the social hierarchy.

Higher education then was considered the practical way to study, and learn trade skills to get a dependable career.

The correlation between mothers having high-powered, well-paid professional positions and child outsourcing had an unexpected outcome. Working, better educated, and higher earning parents actually spend more time with their children.

Despite living in an area that is home to one of the best public school systems in the country, these parents worry that their children having only a public school education isn't enough. Consequently causing parents to push their kids harder and put way more pressure on them to succeed. Their elite education prior to college significantly increases attendance to the top tier Universities like Yale or Harvard.

The author knows that she can't push her own hopes onto her children too aggressively because extreme authoritative parenting is ultimately counterproductive. Each child's mind and physical development is different. Although there are countless possibilities of the child's character and personality, good parenting is crucial in their development.

Recommendation 4

Reasons why scholarly editions aren't valued in the academy (c 2008)

This is pointing to an expanded definition of literacy with the growth of technology. It argues that literacy in today's world goes far beyond just knowing how to read and write.

Online ratings about the same or higher than paper ratings, and the properties (selection, etc.) similar.

Otto, James, Douglas A. Sanford Jr, and Douglas N. Ross. 2008. “Does Ratemyprofessor.com Really Rate My Professor?” Assessment & Evaluation in Higher Education 33 (4): 355–68. doi:10.1080/02602930701293405.

Legg, Angela M., and Janie H. Wilson. 2012. “RateMyProfessors.com Offers Biased Evaluations.” Assessment & Evaluation in Higher Education 37 (1): 89–97. doi:10.1080/02602938.2010.507299.

Wearable are something that I think are huge for the future. This article does an excellent job in showing what some of the features that can be sued with them are. It goes into the health industry and analyzes some of the pros and cons that come with wearables. This will help me in evaluating wearable technology in the more general term other than physical fitness.

Not only can wearables be used to tracking fitness and encouraging physical activity, parents can use them to help monitor where their kid is and making sure that are safe and out of harms way. However, making sure that the kids keep these devices on is an obstacle that the parents will have to hurdle.

evaluation systems and publication performance

RK&A types of eval: front-end evaluation (after concept-development but before design develops), formative evaluation (evaluating prototypes), remedial evaluation (post-installation/troubleshooting), summative evaluation (at end of everything)

Ramus' point.

The difference between Ramus and others.