- Last 7 days
-
aimos.community aimos.community
-
Conference Details. (n.d.). AIMOS. Retrieved 5 March 2021, from https://aimos.community/2020-details
-
-
twitter.com twitter.com
-
ReconfigBehSci. (2020, November 23). RT @lakens: Ongoing, an incredibly awesome talk on computational reproducibility by @AdinaKrik. Slides: Https://t.co/QslHW3gEtm. If you are… [Tweet]. @SciBeh. https://twitter.com/SciBeh/status/1331265422109396995
-
- Feb 2021
-
osf.io osf.io
-
Armeni, Kristijan, Loek Brinkman, Rickard Carlsson, Anita Eerland, Rianne Fijten, Robin Fondberg, Vera Ellen Heininga, et al. ‘Towards Wide-Scale Adoption of Open Science Practices: The Role of Open Science Communities’. MetaArXiv, 6 October 2020. https://doi.org/10.31222/osf.io/7gct9.
-
-
osf.io osf.io
-
Peer, L., Orr, L., & Coppock, A. (2020). Active Maintenance: A Proposal for the Long-term Computational Reproducibility of Scientific Results. SocArXiv. https://doi.org/10.31235/osf.io/8jwhk
-
- Dec 2020
-
-
Perkel. J. M., (2020). Challenge to scientists: does your ten-year-old code still run? Nature. Retrieved from: https://www.nature.com/articles/d41586-020-02462-7?utm_source=twt_nnc&utm_medium=social&utm_campaign=naturenews&sf237106326=1
-
-
twitter.com twitter.com
-
Brian Nosek {@BrianNosek} (2020) RT @BrianNosek Preprint "conversations about reproducibility have a clear underlying structure, despite the broad scope..of the crisis. ..… Twitter. Retrieved from: https://twitter.com/SciBeh/status/1298941122912440320
-
- Nov 2020
-
-
Grant, S., Wendt, K., Leadbeater, B. J., Supplee, L. H., Mayo-Wilson, E., Gardner, F., & Bradshaw, C. (2020). Transparent, Open, and Reproducible Prevention Science. MetaArXiv. https://doi.org/10.31222/osf.io/d2y43
-
-
github.com github.com
-
That's why reproducible test cases are so good
-
-
-
Now that Rails has a dependency on Webpack, it then has a dependency on Node.js and Yarn, surprise! Which means we also need to ensure the versions used for those binaries are specific.
-
- Oct 2020
-
www.theatlantic.com www.theatlantic.com
-
People are rewarded for being productive rather than being right, for building ever upward instead of checking the foundations. These incentives allow weak studies to be published. And once enough have amassed, they create a collective perception of strength that can be hard to pierce.
We desperately need to fix these foundations of science to focus on solid foundations and reproducibility...
-
-
www.wesjones.com www.wesjones.com
-
Weber notes that according to any economic theory that posited man as a rational profit-maximizer, raising the piece-work rate should increase labor productivity. But in fact, in many traditional peasant communities, raising the piece-work rate actually had the opposite effect of lowering labor productivity: at the higher rate, a peasant accustomed to earning two and one-half marks per day found he could earn the same amount by working less, and did so because he valued leisure more than income. The choices of leisure over income, or of the militaristic life of the Spartan hoplite over the wealth of the Athenian trader, or even the ascetic life of the early capitalist entrepreneur over that of a traditional leisured aristocrat, cannot possibly be explained by the impersonal working of material forces,
Science could learn something from this. Science is too far focused on the idealized positive outcomes that it isn't paying attention to the negative outcomes and using that to better define its outline or overall shape. We need to define a scientific opportunity cost and apply it to the negative side of research to better understand and define what we're searching for.
Of course, how can we define a new scientific method (or amend/extend it) to better take into account negative results--particularly in an age when so many results aren't even reproducible?
-
- Sep 2020
-
-
separate the workflow description from its execution.
Separating a workflow description from its execution is an important aspect of reproducibility.
Tags
Annotators
URL
-
-
psycnet.apa.org psycnet.apa.org
-
Moreau, D., & Gamble, B. (2020). Conducting a meta-analysis in the age of open science: Tools, tips, and practical recommendations. Psychological Methods, No Pagination Specified-No Pagination Specified. https://doi.org/10.1037/met0000351
-
-
github.com github.com
-
aaronpeikert. (2020). Aaronpeikert/reproducible-research [TeX]. https://github.com/aaronpeikert/reproducible-research (Original work published 2019)
-
- Aug 2020
-
elifesciences.org elifesciences.org
-
Welcome to a new ERA of reproducible publishing. (2020, August 24). ELife; eLife Sciences Publications Limited. https://elifesciences.org/labs/dc5acbde/welcome-to-a-new-era-of-reproducible-publishing
-
-
journals.sagepub.com journals.sagepub.com
-
Hohn, R. E., Slaney, K. L., & Tafreshi, D. (2020). An Empirical Review of Research and Reporting Practices in Psychological Meta-Analyses. Review of General Psychology, 1089268020918844. https://doi.org/10.1177/1089268020918844
-
-
osf.io osf.io
-
Nelson, N. C., Ichikawa, K., Chung, J., & Malik, M. (2020). Mapping the discursive dimensions of the reproducibility crisis: A mixed methods analysis [Preprint]. MetaArXiv. https://doi.org/10.31222/osf.io/sbv3q
-
-
www.youtube.com www.youtube.comYouTube1
-
Supporting Open Science Data Curation, Preservation, and Access by Libraries. (n.d.). Retrieved 24 August 2020, from https://www.youtube.com/watch?v=SbmGWHpzAHs
-
-
-
Peterson, David, and Aaron Panofsky. ‘Metascience as a Scientific Social Movement’. Preprint. SocArXiv, 4 August 2020. https://doi.org/10.31235/osf.io/4dsqa.
-
- Jul 2020
-
www.youtube.com www.youtube.comYouTube1
-
Supporting Open Science Data Curation, Preservation, and Access by Libraries. (2020, June 25). https://www.youtube.com/watch?v=SbmGWHpzAHs&feature=youtu.be
-
-
www.bio-rad.com www.bio-rad.com
-
Poisson distribution can be used in place of other standard curves to determine template concentration, which means that data can be reliably obtained from the same samples across multiple instruments and laboratories.
-
- Jun 2020
-
zoom.us zoom.us
-
Welcome! You are invited to join a webinar: Supporting Open Science Data Curation, Preservation, and Access by Libraries. After registering, you will receive a confirmation email about joining the webinar. (n.d.). Zoom Video. Retrieved June 28, 2020, from https://zoom.us/webinar/register/2615905946283/WN_W6dYUXQFTqGQjGAZPRB74w
-
-
psyarxiv.com psyarxiv.com
-
Minocher, R., Atmaca, S., Bavero, C., McElreath, R., & Beheim, B. (2020, June 24). Reproducibility of social learning research declines exponentially over 63 years of publication. https://doi.org/10.31234/osf.io/4nzc7
-
-
www.reddit.com www.reddit.com
-
BehSciMeta repost. (2020, June 17). "Reproducibility scores for behavioural science: what are the merits and drawbacks?" Reddit. https://www.reddit.com/r/BehSciMeta/comments/har2np/reproducibility_scores_for_behavioural_science/
-
-
www.bristol.ac.uk www.bristol.ac.uk
-
UKRN position on covid 19 research. (2020 May 01). School of Psychological Science | University of Bristol. http://www.bristol.ac.uk/psychology/research/ukrn/news/2020/ukrn-position-on-covid-19-research.html
-
-
www.nature.com www.nature.com
-
Chawla, D. S. (2020). Critiqued coronavirus simulation gets thumbs up from code-checking efforts. Nature. https://doi.org/10.1038/d41586-020-01685-y
-
-
psyarxiv.com psyarxiv.com
-
Leplaa, H. J., Rietbergen, C., & Hoijtink, H. (2020). Bayesian evaluation of replication studies [Preprint]. PsyArXiv. https://doi.org/10.31234/osf.io/49tbz
-
- May 2020
-
psyarxiv.com psyarxiv.com
-
Peikert, A., & Brandmaier, A. M. (2019). A Reproducible Data Analysis Workflow with R Markdown, Git, Make, and Docker. https://doi.org/10.31234/osf.io/8xzqy
-
-
github.com github.com
-
This tightly controlled build environment is sometimes called a "holy build box". The Traveling Ruby project provides such a holy build box.
-
-
docs.gitlab.com docs.gitlab.com
-
In the examples below, we are using Docker images tags to specify a specific version, such as docker:19.03.8. If tags like docker:stable are used, you have no control over what version is going to be used and this can lead to unpredictable behavior, especially when new versions are released.
-
- Apr 2020
-
www.mdpi.com www.mdpi.com
-
This all comes as part of a wider global shift towards more open research practices, and the geochemistry community needs to make sure it is engaging widely with these, as well as connected issues like research integrity and reproducibility, if it is to maintain its relevance in the modern research age.
Prinsip utama yang patut menjadi pegangan para peneliti/dosen masa depan adalah: keinginan pribadi (self-driven initiative) untuk menyebar-luaskan berbagai hasil risetnya secara luas.
Untuk itu teknologi digital dan internet harus dimanfaatkan dengan maksimal. Seringkali dosen/peneliti melupakan hal ini, bahwa internet ditemukan untuk mempercepat dan memperluas penyebaran ide.
Integritas riset dan reprodusibilitas adalah dua nilai yang perlu ditonjolkan agar relevan dengan kemajuan era internet, bukan hanya menonjolkan nama jurnalnya dan JIFnya.
-
-
eartharxiv.org eartharxiv.org
-
research integrity and reproducibility, if it is to maintain its relevance in the modern research age
Integritas riset dan reprodusibilitas adalah dua nilai yang perlu ditonjolkan agar relevan dengan kemajuan era internet, bukan hanya menonjolkan nama jurnalnya dan JIFnya.
Tags
Annotators
URL
-
- Mar 2020
-
-
For automated testing, include the parameter is_test=1 in your tests. That will tell Akismet not to change its behaviour based on those API calls – they will have no training effect. That means your tests will be somewhat repeatable, in the sense that one test won’t influence subsequent calls.
-
- Feb 2020
-
-
Nix helps you make sure that package dependency specifications are complete. In general, when you’re making a package for a package management system like RPM, you have to specify for each package what its dependencies are, but there are no guarantees that this specification is complete. If you forget a dependency, then the component will build and work correctly on your machine if you have the dependency installed, but not on the end user's machine if it's not there.
-
- Jan 2020
-
ambrevar.xyz ambrevar.xyz
- Aug 2016
-
www.sciencedirect.com www.sciencedirect.com
-
There are major differences in the physicochemical properties of commercially available EGFR inhibitors.
-
-
www.thenewatlantis.com www.thenewatlantis.com
-
But in the meantime, the paper has been cited in about 500 other papers, many of which may have been cited multiple times in turn. In
Argument for the reproducibility channel
-
- Jul 2016
-
www.economist.com www.economist.com
-
Computer says: oops
The computer may be saying "oops", but I suspect that researchers are using stronger language.
-
- Mar 2016
-
download.springer.com download.springer.com
-
By contrast, others use it in thepublication process solely to maintain their competitive bid for priority in a line ofresearch inquiry, as a way to sabotage others’ progress. A scientist in an early-career group acknowledged the need to make results reproducible by telling people‘‘the whole recipe of the whole method’’ if asked directly, but then she talkedabout the ‘‘little trick’’ of not including all the details in a publication orpresentation. Like the scientists in a different group quoted above, she mentionedothers’ practice of taking photographs of poster presentations in order then topublish the results first. She said that people, in defense, ‘‘omit tiny little details’’:‘‘But sometimes in the publication, people, just to protect themselves, will not giveall the details. It’s always right, but maybe it’s not totally complete—to protectthemselves. Because your ideas get stolen constantly, and it’s so competitive ifyou’re a small lab.
sabotaging reproducibility
-
A more deliberate form of not sharing is the omission of critical details inpresentations, papers and grant proposals so that others will have difficultyreplicating and extending one’s own research.
Sabotaging reproducibility.
-
- Feb 2016
-
www.nature.com www.nature.com
-
For one article that we believed contained an invalidating error, our options were to post a comment in an online commenting system or pay a 'discounted' submission fee of US$1,716. With another journal from the same publisher, the fee was £1,470 (US$2,100) to publish a letter
I think this is one of the most outrageous statements I have ever heard.
-
- Sep 2015
-
www.bmj.com www.bmj.com
-
Martin has been under pressure to retract the paper for years, including from within his own society.
Was there not even an editorial expression of concern or whatever they call that?
-
It is often said that science self corrects. But for those who have been calling for a retraction of the Keller paper for many years, the system has failed. None of the paper’s 22 mostly academic university authors, nor the journal’s editors, nor the academic and professional institutions they belong to, have intervened to correct the record.
Wow. That is a very strong indictment. Big argument for why independent channels on top of the literature are so important.
-
but by an outside medical writer hired by GSK
I'm not sure that ghost writing is a bad thing as long as "writer" is not confused with lead scientist. Yet another strong argument for contributor roles rather than authors. https://www.force11.org/blog/are-we-ready-define-scholarly-commons-thoughts-force2015
Tags
Annotators
URL
-
-
europepmc.org europepmc.org
-
This is problematic because the article has been influential in the literature supporting the use of antidepressants in adolescents.
Example of the type of harm that lack of transparency can lead to.
-
- Jul 2015
-
f1000research.com f1000research.com
-
It is clear from the use of ES2 and RMG-II cell lines that the Atlas Antibodies ARID1A antibody is specific for ARID1A in both Western blots and formalin-fixed paraffin embedded preparations of human origin and, coupled with the literature evidence, that it is validated in human tissue.
Validation statement RRID:AB_1078205 Summary
-
A No Primary antibody control (NPA) showed no staining in the epithelial or nuclear compartment (Figure 3B; Dataset e).
Validation statement RRID:AB_1078205 No primary control
-
There was no cytoplasmic or extracellular stromal background staining present and the antibody titrated successfully losing the intensity of staining, as expected
Validation statement RRID:AB_1078205 Titration curve
-
Control slides, omitting the primary antibody, were negative except for the ER2 condition in the RMG-II cell pellet where a weak cytoplasmic background could be seen (Figure 2; Dataset d). Thus there was minimal background inherent in the staining procedure. It was therefore determined that the antibody showed specificity for formalin-fixed paraffin embedded tissues and could be run on murine tissue.
Omission of primary antibody
Validation statement RRID:AB_1078205
-
Using Western blot and IHC on murine wild-type and knockout tissue we have demonstrated that this antibody to ARID1A correctly stains murine tissue by immunohistochemistry.
Validation claim
-
It could be demonstrated that the HPA ARID1A antibody showed positive expression in ES-2 cell lines at the expected size of 270 kDa and no staining for RMG-II.
Validation statement for RRID:AB_1078205
-
- Jun 2015
-
journals.plos.org journals.plos.org
-
For this paper, we adopt an inclusive definition of irreproducibility that encompasses the existence and propagation of one or more errors, flaws, inadequacies, or omissions (collectively referred to as errors) that prevent replication of results.
Definition of reproducibility
Tags
Annotators
URL
-
- May 2015
-
nymag.com nymag.com
-
Broockman has ideas about how to reform things. He thinks so-called “post-publication peer review” — a system which, to oversimplify a bit, makes it easier to evaluate the strength of previously published findings — has promise.
-
-
www.sciencedirect.com www.sciencedirect.com
-
Research publication can both communicate and miscommunicate
Great quote; of course, this statement is true of all communications. We have entire industries devoted to spin.
-
-
www.newyorker.com www.newyorker.com
-
The bias was first identified by the statistician Theodore Sterling, in 1959, after he noticed that ninety-seven per cent of all published psychological studies with statistically significant data found the effect they were looking for.
That is rather outrageous that we've known about this since 1959 and have done nothing about it.
-
But while Schooler was publishing these results in highly reputable journals, a secret worry gnawed at him: it was proving difficult to replicate his earlier findings. “I’d often still see an effect, but the effect just wouldn’t be as strong,” he told me. “It was as if verbal overshadowing, my big new idea, was getting weaker.”
Another case for annotation
-
The test of replicability, as it’s known, is the foundation of modern research.
Nice quote
-
-
lifescivc.com lifescivc.com
-
The company spent $5M or so trying to validate a platform that didn’t exist
Costs of irreproducibility
-
-
www.nature.com www.nature.com
-
However, validation projects that were started in our company based on exciting published data have often resulted in disillusionment when key data could not be reproduced.
-
-
www.ncbi.nlm.nih.gov www.ncbi.nlm.nih.gov
-
Error rates detected by the double-entry method ranged from 2.3 to 26.9%.
-
-
dynamicecology.wordpress.com dynamicecology.wordpress.com
-
“.. the majority of medical errors do not result from individual recklessness or the actions of a particular group–this is not a “bad apple” problem. More commonly, errors are caused by faulty systems, processes, and conditions that lead people to make mistakes or fail to prevent them.”
Great quote for reproducibility
-
Of course I do not knowingly have any mistakes in print. But I could have a mistake out there I don’t know about.
The importance of post-publication annotation. To me, this is the critical missing piece.
-
The reason my syllogism doesn’t eliminate science as a paragon of correctness is that – contrary to the popular view about lone geniuses – science is not about individuals or single papers. It is about the community and the total body of evidence. One individual can be right, wrong, a crack-pot, a genius, mistaken, right for the wrong reasons, and etc. But the community as a whole (given time) checks each other and identifies wrong ideas and mistakes.
The essence of science
-
- Apr 2015
-
europepmc.org europepmc.org
-
However, it is worth noting that academic journal publication may ultimately prove to be a red herring, as an indicator of transparency. Academic publishing decisions can be arbitrary, and introduce lengthy delays in access to knowledge. Furthermore, there is a growing body of evidence demonstrating that journals often fall short of the basic expected standards for reporting of clinical trials. It is commonplace to find that primary outcomes have been switched, for example [7]; findings are routinely “spun” [8]; and compliance with reporting standards such as CONSORT is highly variable. When compared with the long and formal structured Clinical Study Reports created for all industry-sponsored trials, academic papers have been shown to be incomplete and inconsistent [9].
Another damning statement.
Tags
Annotators
URL
-
- Apr 2014
-
www.newschallenge.org www.newschallenge.org
-
Reproducibility
Reproducibility is mentioned in the title of this section, but it is not mentioned elsewhere in the document and I don't see it addressed in what's written in this section.
-