8,260 Matching Annotations
  1. Oct 2020
    1. I find it somewhat interesting to note that with 246 public annotations on this page using Hypothes.is, that from what I can tell as of 4/2/2019 only one of them is a simple highlight. All the rest are highlights with an annotation or response of some sort.

      It makes me curious to know what the percentage distribution these two types have on the platform. Is it the case that in classroom settings, which many of these annotations appear to have been made, that much of the use of the platform dictates more annotations (versus simple highlights) due to the performative nature of the process?

      Is it possible that there are a significant number of highlights which are simply hidden because the platform automatically defaults these to private? Is the friction of making highlights so high that people don't bother?

      I know that Amazon will indicate heavily highlighted passages in e-books as a feature to draw attention to the interest relating to those passages. Perhaps it would be useful/nice if Hypothes.is would do something similar, but make the author of the highlights anonymous? (From a privacy perspective, this may not work well on articles with a small number of annotators as the presumption could be that the "private" highlights would most likely be directly attributed to those who also made public annotations.

      Perhaps the better solution is to default highlights to public and provide friction-free UI to make them private?

      A heavily highlighted section by a broad community can be a valuable thing, but surfacing it can be a difficult thing to do.

    1. I mean, posting constantly online about this cool spectacle thing I’m reading about and don’t understand is probably a good way of being part of the spectacle. (The first rule of Spectacle Club is: you do not talk about Spectacle Club?). But I think IndieWeb, Fediverse, etc, doing it in small, decentralised groupings, you break down the possibility of being in thrall to the spectacle. What’s the biggest blog you know? How do you even know that?

      I would push back on this. I have a feeling the effect may seem different because the network is so small. Making specific choices as we scale up may help to mitigate the effect, but eventually we will assuredly see some of the same problems because while the technology will help to mitigate some of the underlying problems with society, culture, and our media, it is not going to cure them.

      A case in point is the small network on Micro.blog, which, while generally warm and welcoming, is more monolithic towards the tech space, the Apple space, and has a high proportion of white, cis-gender males. This "founder effect" is likely going to heavily influence this community for a long time. Most times I spend time there, I'm subtly surrounded by the spectacle of Apple.

    1. Think of this essay as a series of strongly held hypotheses; without access to the types of data which i’m not even sure exists, it’s difficult to be definitive. As ever, my wise readers will add or push back as they always do.

      Push back, sure, but where? Where would we find this push back? The comments section only has a few tidbits. Perhaps the rest is on Twitter, Facebook, or some other social silo where the conversation is fraught-fully fragmented. Your own social capital is thus spread out and not easily compiled or compounded. As a result I wonder who may or may not have read this piece...

    1. I’ve believed that today’s women representatives objectify them in a similar as the women depicted in the Renaissance paintings Berger argues about. He considers nudity an art form. To be naked is to be seen by others without knowing you. However, In European nude paintings, this is not considered art. The video mentions the development and changes of nude art in different periods. For example, in the book of Genesis, Adam and Eve did not see each other’s naked bodies until they had eaten the fruit, so the naked bodies were created in the observer’s mind. Then there is the striking fact that women have been subservient to men, seeing them as agents of god. It wasn’t until medieval art that nudity began to become secularized. The mirror became a symbol of female vanity. Also, the video mentions another mythological theme in the Bible, in which men judge beauty and not beauty by looking at a woman’s naked body. Moreover, in Europe 10 oil paintings, most of the nudity is intended to please the male audience owner. Even today, the way women dress plays the role they want to play. Self-image is more based on how other people perceive you. Even the image of women in the media is still determined by the gaze of men. However, in today’s female images, the role of sex seems to have undergone some subtle changes. They no longer think of men as narcissistic and think of men and women as narcissistic, but they feel differently. A woman’s jealousy is how she feels about herself, not just what other people think of her. We could even say it’s a product of human interaction, a product that builds a sense of self-worth. They just want to see the image they want and may even be ready to become liberators and find their true selves.

      Great points!

    1. Reviewer #3:

      The manuscript by Hutchings et al. describes several previously uncharacterised molecular interactions in the coats of COP-II vesicles by using a reconstituted coats of yeast COPI-II. They have improved the resolution of the inner coat to 4.7A by tomography and subtomogram averaging, revealing detailed interactions, including those made by the so-called L-loop not observed before. Analysis of the outer layer also led to new interesting discoveries. The sec 31 CTD was assigned in the map by comparing the WT and deletion mutant STA-generated density maps. It seems to stabilise the COP-II coats and further evidence from yeast deletion mutants and microsome budding reconstitution experiments suggests that this stabilisation is required in vitro. Furthermore, COP-II rods that cover the membrane tubules in right-handed manner revealed sometimes an extra rod, which is not part of the canonical lattice, bound to them. The binding mode of these extra rods (which I refer to here a Y-shape) is different from the canonical two-fold symmetric vertex (X-shape). When the same binding mode is utilized on both sides of the extra rod (Y-Y) the rod seems to simply insert in the canonical lattice. However, when the Y-binding mode is utilized on one side of the rod and the X-binding mode on the other side, this leads to bridging different lattices together. This potentially contributes to increased flexibility in the outer coat, which may be required to adopt different membrane curvatures and shapes with different cargos. These observations build a picture where stabilising elements in both COP-II layers contribute to functional cargo transport. The paper makes significant novel findings that are described well. Technically the paper is excellent and the figures nicely support the text. I have minor suggestions that I think would improve the text and figures.

      L 108: "We collected .... tomograms". While the meaning is clear to a specialist, this may sound somewhat odd to a generic reader. Perhaps you could say "We acquired cryo-EM data of COP-II induced tubules as tilt series that were subsequently used to reconstruct 3D tomograms of the tubules."

      L 114: "we developed an unbiased, localisation-based approach". What is the part that was developed here? It seems that the inner layer particle coordinates where simply shifted to get starting points in the outer layer. Developing an approach sounds more substantial than this. Also, it's unclear what is unbiased about this approach. The whole point is that it's biased to certain regions (which is a good thing as it incorporates prior knowledge on the location of the structures).

      L 124: "The outer coat vertex was refined to a resolution of approximately ~12 A, revealing unprecedented detail of the molecular interactions between Sec31 molecules (Supplementary Fig 2A)". The map alone does not reveal molecular interactions; the main understanding comes from fitting of X-ray structures to the low-resolution map. Also "unprecedented detail" itself is somewhat problematic as the map of Noble et al (2013) of the Sec31 vertex is also at nominal resolution of 12 A. Furthermore, Supplementary Fig 2A does not reveal this "unprecedented detail", it shows the resolution estimation by FSC. To clarify, these points you could say: "Fitting of the Sec31 atomic model to our reconstruction vertex at 12-A resolution (Supplementary Fig 2A) revealed the molecular interactions between different copies of Sec31 in the membrane-assembled coat.

      L 150: Can the authors exclude the possibility that the difference is due to differences in data processing? E.g. how the maps’ amplitudes have been adjusted?

      L 172: "that wrap tubules either in a left- or right-handed manner". Don't they always do both on each tubule? Now this sentence could be interpreted to mean that some tubules have a left-handed coat and some a right-handed coat.

      L276: "The difference map" hasn't been introduced earlier but is referred to here as if it has been.

      L299: Can "Secondary structure predictions" denote a protein region "highly prone to protein binding"?

      L316: It's true that the detail in the map of the inner coat is unprecedented and the model presented in Figure 7 is partially based on that. But here "unprecedented resolution" sounds strange as this sentence refers to a schematic model and not a map.

      L325: "have 'compacted' during evolution" -> remove. It's enough to say it's more compact in humans and less compact in yeast as there could have been different adaptations in different organisms at this interface.

      L327: What's exactly meant by "sequence diversity or variability at this density".

      L606-607: The description of this custom data processing approach is difficult to follow. Why is in-plane flip needed and how is it used here?

      L627: "Z" here refers to the coordinate system of aligned particles not that of the original tomogram. Perhaps just say "shifted 8 pixels further away from the membrane"

      L642-643: How can the "left-handed" and "right-handed" rods be separated here? These terms refer to the long-range organisation of the rods in the lattice; it's not clear how they were separated in the early alignments.

      Figure 2B. It's difficult to see the difference between dark and light pink colours.

      Figure 3C. These panels report the relative frequency of neighbouring vertices at each position; "intensity" does not seem to be the right measure for this. You could say that the colour bar indicates the "relative frequency of neighbouring vertices at each position" and add detail how the values were scaled between 0 and 1. The same applies to SFigure 1E.

      Figure 4. The COP-II rods themselves are relatively straight, and they are not left-handed or right-handed. Here, more accurate would be "architecture of COPII rods organised in a left-handed manner". (In the text the authors may of course define and then use this shorter expression if they so wish.) Panel 4B top panel could have the title "left-handed" and the lower panel should have the title "right-handed" (for consistency and clarity).

  2. inst-fs-iad-prod.inscloudgate.net inst-fs-iad-prod.inscloudgate.net
    1. You are encountering evidence that inequality not only exists, but is deeply structured into society in ways that secure its reproduction. You are also beginning to realize that, contrary to what you have always been taught, categories of difference (such as gender, race, and class) rather than merit alone, do matter and contribute significantly to people’s experiences and life opportunities.

      This is important to me because we often think to ourselves that this is basic knowledge, however, there are those who may not be exposed to it, are uneducated, or simply deny the reality of our systems. As we get older we experience more and for those who haven't been as exposed to it realizing the importance of evidence about inequality is essential to education. (Gerrymandering, institutionalized racism, voter oppression, higher rates of hate crimes and violence against people of color, outdated policing systems and education)

    2. Throughout your course, you will likely be studying key concepts such as so-cialization, oppression, privilege, and ideology and doing coursework that challeng-es your worldview by suggesting that you may not be as open-minded as you may have thought.

      This is an interesting concept, especially as someone from this generation. Our generation has been one of the most open minded to date, however, we live in the United States, a country that is notorious for leaning toward conservative views. Some of us may not have a concept of what politics in other places are and we may not be as open minded as we think.

    1. Unfortunately, there are still a number of people who continue in the fatal belief that government rests on natural laws, that it maintains social order and harmony, that it diminishes crime, and that it prevents the lazy man from fleecing his fellows. I shall therefore examine these contentions. A natural law is that factor in man which asserts itself freely and spontaneously without any external force, in harmony with the requirements of nature. For instance, the demand for nutrition, for sex gratification, for light, air, and exercise, is a natural law. But its expression needs not the machinery of government, needs not the club, the gun, the handcuff, or the prison. To obey such laws, if we may call it obedience, requires only spontaneity and free opportunity. That governments do not maintain themselves through such harmonious factors is proven by the terrible array of violence, force, and coercion all governments use in order to live. Thus Blackstone is right when he says, "Human laws are invalid, because they are contrary to the laws of nature."

      As human beings we ruled ourselves without any goverments or governers. Humans doesn't need these things at all,a governer can only provide unfair punishments to us.The idea that Anarchy lead us to chaos is only for corrupted minds. Our nature is not available for a governor to rule us.Since the Homo Sapiens are te only mankinds on this earth we know we never had it in our nature.That's why anarchy maybe good for our routine.So thats the way I think about that part

    1. To illustrate: very many professed popularizers of the results of scientific inquiry, as well as laymen, seem to think that the entire psychology of vision is explained when we have a complete knowledge of the anatomy of the retina, of its nervous connection with the brain, and of the centre in the latter which serves for visual functions; or that we know all about memory if we can discover that certain brain cells store up nervous impressions, and certain fibres serve to connect these cells,-- the latter producing the association of ideas, while the former occasion their reproduction. In short, the commonest view of physiological psychology seems to be that it is a science which shows that some or all of the events of our mental life are physically conditioned upon certain nerve-structures, and thereby explains these events. Nothing could be further from the truth. So far as I know, all the leading investigators clearly realize that explanations of psychical events, in order to explain, must themselves be psychical and not physiological. However important such knowledge as that of which we have just been speaking may be for physiology, it has of itself no value for psychology. It tells simply what and how physiological elements serve as a basis for psychical acts; what the latter are, or how they are to be explained, it tells us not at all. Physiology can no more, of itself, give us the what, why, and how of psychical life, than the physical geography of a country can enable us to construct or explain the history of the nation that has dwelt within that country. However important, however indispensable the land with all its qualities is as a basis for that history, that history itself can be ascertained and explained only through historical records and historic conditions. And so psychical events can be observed only through psychical means, and interpreted and explained by psychical conditions and facts.

      This paragraph basically states the fact that physiology is completely different from psychology in the fact that it focuses on strictly physical things. This reiterates the fact that psychology is it's own individual science. That we have made psychology unique and formed it and branched it off of other sciences and theories

    1. (“I don’t think I’ve ever used the word ‘consent’ with a three-year-old before,” Kahn says.) The goal is that “if a kid doesn’t want to be hugged by another kid, he can say, ‘This is my body,’ and be understood.”

      Most of us as humans grow up being taught to respect personal space. Gideon Kahn says that he doesn't think that he's ever used the word consent when teaching young children. I think it's important to start using that word and teaching children at younger age. It may be hard for some of the kids to understand but it still needs to be a conversation. We should all start learning at a younger age so we can realize the full extent of consent before reaching the age where kids start to develop a sex drive. Without this understanding, you may unintentionally hurt somebody by not respecting their space.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Response to Reviewers and Revision Plan

      We thank all three reviewers for their time and their comments on our manuscript.

      Reviewer #1 (Evidence, reproducibility and clarity (Required)):

      Here Ryan et al. have used localization analysis following induced rapid relocalization of endogenous proteins to investigate the composition and recruitment hierarchy of a clathrin-TACC3-based spindle complex that is important for microtubule organization and stability.

      The authors generate different HeLa cell lines, each with one of four complex members (TACC3, CLTA, chTOG and GTSE1) endogenously tagged with FKBP-GFP via Cas9-mediated editing. This tag allows rapid recruitment to the mitochondria upon rapamycin addition ("knocksideways"). They ultimately quantify each of the 4 components' localization to the spindle following knocksideways of each component using fluorescently-tagged transfected constructs. The authors' interpretation of the results of this analysis are summarized in the last model figure, in which a core MT-binding complex of clathrin and TACC3 recruit the ancillary components GTSE1 and chTOG. In addition, the authors investigate the contribution of individual clathrin-binding LIDL motifs in GTSE1 to the recruitment of clathrin and GTSE1 to spindles. Their findings here largely agree with and confirm a recent report regarding the contribution of these motifs to GTSE1 recruitment to the spindle. They further analyzed GTSE1 fragments for interphase and mitotic microtubule localization, and identified a second region of GTSE1 required (but not sufficient) for spindle localization. Finally, the authors report that PIK3C2A is not part of this complex, contradicting (correcting) a previously published study.

      **Major comments:**

      1.The chTOG-FKBP-GFP cell line the authors generate has only a small fraction of chTOG tagged, and thus should not be used for any conclusions about protein localization dependency on chTOG. Because they were unable to construct a HeLa cell line with all copies tagged, the authors expect that the homozygous knock-in of chTOG-FKBP-GFP is lethal, and thus their experience is appropriate to report. However, the authors should not use this cell line alone to make statements about chTOG dependency. They would have to use similar localization analysis, but after another method to disrupt chTOG (as a second-best approach), such as RNAi. In fact, they have reported this in a previous publication (Booth et al 2011). However, the result was different. There, loss of chTOG resulted in reduced clathrin on spindles, suggesting it may stabilize or help recruit the complex. Alternatively, they could remove their chTOG data, but this would compromise the "comprehensive" nature of the work.

      The referee is correct. The point here is to show the results we had using this approach for all four proteins under study. For this reason, we do not want to remove this data and prefer to show our results “warts-and-all”. We feel that the shortcomings of our approach are honestly presented and discussed in the manuscript. While only a fraction of chTOG was tagged, we should expect some co-removal after its induced mislocalization. Since we saw no change, we concluded that chTOG is auxiliary.

      The “second best” approach suggested (RNAi of chTOG) is problematic for two reasons. First, chTOG RNAi results in gross changes to spindle structure (multipolar spindles) and it is difficult to pick apart differences in protein partner localization that result from loss of chTOG from those resulting from changes in spindle structure. Second, the paper is about induced mislocalization as a method for determining protein complexes once a normal spindle has formed. So, removing chTOG prior to mitosis is not comparable. If we get the same or different result, does it confirm or conflict with the data we have? Nonetheless, given the discrepancy with our earlier work, we should investigate this further.

      To address this concern, we will stain endogenous clathrin, TACC3 and GTSE1 following chTOG RNAi and measure their relative levels at the spindle.

      Making the chTOG-FKBP-GFP cell line was difficult. As described in the paper, we only recovered heterozygous clones despite repeated attempts. Since submission, we have been made aware of a HCT116 chTOG-FKBP-GFP cell line that is reported to be homozygously tagged (Cherry et al. 2019 doi: 10.1002/glia.23628).

      A note about this cell line has been added to the paper (Results section, final sentence of 1st paragraph).

      2.The authors initially analyze complex member localization after knocksideways experiments by antibody staining, which has the advantage of analyzing endogenous proteins (versus the later transfected fluorescent constructs). Setting aside potential artefacts from fixation, this would seem to be a better method for controlled analysis to take advantage of their setup (short of generating stable cell lines with second proteins endogenously tagged in a second color - a huge undertaking). The authors conclude that antibody specificity problems confounded their analysis and explained unusual results. However, I think is worth investing a little more effort to sort this out, rather than bringing doubt to the whole data set. Verifying and then using another antibody for chTOG localization would be informative. Of course, the negative control should not be their chTOG-FKBP-GFP line, as it does not relocalize most of chTOG.

      In the case of GTSE1, an alternative explanation to antibody specificity issues would be that the GTSE1-FKBP-GFP cell line is not in fact homozygously tagged. Given the low expression levels on the western provided, and the detection of GTSE1 on the spindle in the induced GTSE1-FKBP-GFP cell line (but not TACC3-FKBP-GFP), it seems plausible that an untagged copy remains. If there are multiple copies of GTSE1 in Hela cells, one untagged copy could represent a small fraction of total GTSE1. This should thus be ruled out. GTSE1 clones should be analyzed with more protein extracts loaded - dilutions of the extracts can determine the sensitivity of the blot to lower protein levels. In addition, sequencing of genomic DNA can reveal a small percentage with different reads.

      We used a two-pronged approach for assessing relocalization of protein partners (staining vs transfected constructs). The staining approach is superior since endogenous proteins are examined, but it is limited by antibody specificity. The transfection approach overcomes this limitation but is in turn limited by effects of overexpression and tagging. Together the two approaches allow us, and anyone employing this method, to get a picture of protein complexes. We didn’t want to create the impression that one or other approach is confounded, but the referee is correct that this analysis would benefit from further work.

      Specifically, to address these concerns:

      • We will verify and use alternative chTOG antibodies to try to improve this dataset.
      • We will test the possibility that an untagged allele of GTSE1 remains. We will use western blotting and a summary of our genomic analysis will be added to the paper.

        3.There is a lot of data contained in the small graphs summarizing quantification of localization in Figs 3 and 4. They would be more accessible to the reader if they were larger and/or an "example" of the chart with labels was present explaining it (essentially what is in the figure legends). Furthermore, there is no statistical test applied to this data that I see. This is needed. How do authors determine whether there is an "effect"?

      Our aim was to compress a lot of information into a small space, while still showing some example primary data. All reviewers raised the same concern which tells us that we went too far towards “data visualization”.

      To address this point, we will rework these figures.

      **Minor issues:**

      1.The GTSE1 constructs used for mutation and localization analysis are 720 amino acids long. A recent study analyzing similar mutations uses a 739 amino acid construct (Rondelet et al 2020). The latter is the predominant transcript in NCBI and Ensembl databases. It appears the construct used by the authors omits the first 19 a.a.. I do not think using the truncated transcript affects conclusions of the manuscript, but it could generate confusion when identifying residues based on a.a.#s of mutant constructs (Fig 6). This should be somehow clarified.

      We were aware of the longer transcript but were using the 720 residue form since it is the canonical sequence in Uniprot (https://www.uniprot.org/uniprot/Q9NYZ3). We did not know that the 739 form is the predominant transcript. We agree this is unlikely to affect our work but that the numbering may cause confusion.

      We have added a note to the Methods (Molecular Biology section) to accurately describe what we and Rondelet et al. have used.

      2.The labeling of constructs in Fig 6C/D is confusing, and appears shifted by eye at places. Please relabel this more clearly.

      Apologies for the error.

      We have relabeled Figure 6C,D and also made a similar alteration to Figure 5C.

      The recommended new experimental data (Analysis complex member levels on spindles after full perturbation of spindle chTOG; new chTOG antibody stainings in the FKBP lines; reanalysis of GTSE1 DNA/protein in GTSE1-FKBP line) should only require a new antibody/siRNA, plus a few weeks time to repeat the analyses already in the paper with new reagents.

      Reviewer #1 (Significance (Required)):

      While multiple individual components of this complex have been previously characterized, the structure and nature of the complex formation and its recruitment to microtubules/spindles remains a complex problem that has yet to be solved.

      Overall this study represents a comprehensive localization-dependency analysis of the Clathrin-TACC3 based spindle complex using a consistent methodology. Although several of the conclusions of the findings echo previous reports, some of the previous literature is contradictory within itself as well as with the conclusions here. Analyzing all components with a single, rapid-perturbation technique thus has great value to present a clear data set, given that the experimental setup conditions and analysis are solid (a goal to which the majority of comments refer).

      Beyond the complex localization/recruitment analysis, two novel findings of this study that emerge are:

      a)GTSE1 contains a second, separate protein region, distinct from the clathrin-binding motifs that is required for its localization to the spindle, and most likely a microtubule-interaction site. This suggests that GTSE1 recruitment to the spindle is more complex than previously reported.

      b)PI3KC2A, which has been reported previously to be a stabilizing member of this complex, is in fact not a member, nor localizes to spindles, nor displays a mitotic defect after loss. This is important conclusion to be made as it would correct the literature, and avoid future confusion.

      --

      Reviewer #2 (Evidence, reproducibility and clarity (Required)):

      In this paper, the authors investigate the nature of interactions between members of the TACC3-chTOG-clathrin-GTSE1 complex on the mitotic spindle. By using a series of HeLa cell lines that they have created by CRISPR/Cas9 editing to enable spatial manipulation (knocksideways) of either TACC3, chTOG, clathrin and GTSE1, they show that on spindle microtubules TACC3 and clathrin represent core complex members whereas chTOG and GTSE1 bind to them respectively but not to each other. Additionally, the authors find that the protein PIK3C2A, which has been implicated in this complex previously is in fact not a component of this complex in mitotic cells. The main advance of the paper in my opinion is the endogenous tagging of the proteins for knocksideways experiments since former experiments depended on RNAi silencing and expression of tagged proteins from plasmids, which introduced issues of protein silencing efficiency and plasmid overexpression problems. This approach seems to alleviate these problems, except in the case of chTOG which seems to be lethal in its homozygous variant.

      **Major comments:**

      I find the key conclusions regarding the localization of the components of the complex convincing. There are some issues regarding the specificity of antibodies in immunostaining experiments (Fig 3.) and the influence of mCherry-TACC3 expression on distorted localization of the complex prior to knocksideways. However, I think the general conclusion about which complex components (clathrin and TACC3) influence the localization of the other proteins in the complex (chTOG and GTSE1) stands. One thing that I miss from the paper is the data on the consequences on the spindle shape and morphology after knocksideways. I have noticed on images in both Figure 3 and Figure 4 that in some cases distribution of the signal seems to influence quite a bit the spindle morphology. Also, In Figure 3 I have noticed what seems to me a quite big variation in spindle size in tubulin signal in both untreated and rapamycin cells. Since authors have many of these images already, I believe it would be realistic, not costly and of additional value for the paper to provide more data on the consequences of the knocksideways experiments. Change of spindle size, tubulin intensity and DNA/kinetochore misalignment upon knocksideways would be helpful to appreciate more the findings of the paper. More so since the authors on more than one occasion find their motivation in the field of cancer research and spindle stability relation to it. Some data connection to this motivation would be of value. Experiments seem reproducible.

      The focus of the paper is on using the knocksideways methodology to understand a protein complex during mitosis, rather than looking at its function. We are not keen to do new experiments that are not part of the central message of the paper. However, the Reviewer is correct that we do already have a dataset that can be mined in the manner described.

      To address this point, we will analyze spindle size parameters and also the intensity of tubulin. Our analysis will be limited to the short timeframe of our experiments, but it should reveal or refute any changes in spindle structure that may result from loss of complex members.

      **Minor comments:**

      I have some problems with the clarity of Figure 3 and 4. For Figure 3. In Figure 3 plots on the right are a bit small and not easy to read. Some reorganization of the figure might be beneficial. In Figure 4 plots to the right are also too small to be clear. Also, I miss the number of cells (n) I can't see the number of individual arrows because of the size of graphs.

      Our aim was to compress a lot of information into a small space, while still showing some example primary data. All reviewers raised the same concern which tells us that we went too far towards “data visualization”.

      To address this point, we will rework these figures.

      Reviewer #2 (Significance (Required)):

      I find that the biggest significance of the paper is in the creation of new tools (cell lines) to study the localization of proteins TACC3, chTOG, clathrin and GTSE1. Cell lines where endogenous proteins can be delocalized rapidly will be of value for scientist working not only in mitosis but such as in the case of clathrin research, vesicle formation and trafficking or p53-dependent apoptosis in the case of GTSE1. In the field of mitosis it will surely help and speed up the research concerning the role of these proteins in spindle assembly and stability.

      Field of expertise: mitotic spindle

      --

      Reviewer #3 (Evidence, reproducibility and clarity (Required)):

      **Summary:**

      This papers analyses the chTog/TACC3/clathrin/GTSE1 complex that crosslinks and stabilises microtubule bundles in the mitotic spindle. The authors have developed an elegant knock sideways approach to specifically analyse the effects of removing individual components of the complex from the spindle and study the effect this has on the other interactors. They report, based on these assays that the core of the complex is formed by TACC3 and Clathrin while GTSE1 and chTog are auxiliary interactors. They also refute previous evidence that this complex also incorporates PIK3C2A. Overall, this is an interesting study that distinguishes itself predominantly by its methodology. However, some of the reported results need more thorough analysis to allow convincing conclusions.

      **Major comments:**

      1)The knockside way method is the main highlight if this paper. Unlike previous studies by the PI, this time endogenous genes are tagged which is a key advance and allows much better interpretation of the results. I am not sure why the authors have chosen HeLa cells as their model here, given the messed up genome of these cells. A non-transformed cell line would have been preferable, but as a proof of principle study, I think HeLa are acceptable, and I wouldn't expect the authors to repeat all the experiment in another system.

      Figure 1,2 and S1 are describing and validating this approach in some detail, but this will require some more work.

      The authors state that gene targeting was validated using a combination of PCR, sequencing, Western blotting, but show only the results for westerns. PCR analysis that demonstrates homozygous or heterozygous gene targeting should be shown here.

      Another issue is the penetrance of the phenotypes induced by Rapamycin. The authors show nice data of the system working in individual cells but do not give us an idea if this happens in all cells. The localisation of the individual tagged genes should be quantified (ideally with line plots) in 50 randomly chosen mitotic cells with 3 repeats before and after rapamycin treatment. Moreover, the analysis of mitotic duration (Figure S1D) should be extended to include a plus Rapamycin cohort and this should be moved in the main Figure.

      If the system works only in a small proportion of cells, this should be clearly stated. I don't think this would prevent publication, but it is an important piece of information that is missing.

      The Reviewer raises two issues here.

      • PCR analysis should be shown. This issue was also partly raised by Reviewer 1. A summary of our PCR analysis was actually included in Table 1, since the analysis we did is pretty unwieldy. We agree though that presenting our evidence for homozygosity of the cell lines would be useful. To address this point, we will add more detail of the PCR and sequencing work done to validate these cell lines.
      • Does knocksideways happen in all cells? The answer to this depends on the transient expression of MitoTrap and sufficient application of rapamycin. We agree that this will be a useful piece of information to add to the manuscript. A related issue is whether knocksideways of complex members affects mitotic progression. We have established through other experiments that rapamycin application to wild-type cells alters mitotic progression, although application of Rapalog does not have this effect. Our plan to address these points is 1) to analyze the efficacy of knocksideways that readers can expect to achieve using these, or similar cells, and 2) analyze mitotic duration in rapalog-treated cells expressing a rapalog sensitive MitoTrap.

        2)Apart from a simple quantification of mitotic duration, I believe a more detailed mitotic phenotype analysis for each knock-side way gene, especially the homozygous targeted clones, should be included. This can involve more high-resolution live cell imaging of mitotic progression with SiR-DNA and GFP-tubulin, using the dark mitotrap.

      We don’t agree that such an analysis should be included. The focus of this paper is on using the knocksideways methodology to understand a protein complex during mitosis, and not looking at its function. There are several papers on the mitotic phenotypes of these genes probed using RNAi in different cellular systems (examples for chTOG: 10.1101/gad.245603; TACC3/clathrin: 10.1038/emboj.2011.15, 10.1242/jcs.075911, 10.1083/jcb.200911091, 10.1083/jcb.200911120; GTSE1: 10.1083/jcb.201606081). Moreover, our 2013 paper used knocksideways (with RNAi and overexpression) and has a detailed analysis of mitotic progression, microtubule stability, checkpoint activity and kinetochore motions (Cheeseman et al., 2013 doi: 10.1242/jcs.124834).

      New experiments that are not part of the central message of the paper and are unlikely to give new insight are not the best use of our revision efforts for this paper (especially during the pandemic). Having said this, Reviewer 2’s suggestion to use our existing dataset to investigate mitotic phenotypes, will largely answer Reviewer 3’s request.

      We will analyze spindle size parameters and also the intensity of tubulin. Our analysis will be limited to the short timeframe of our experiments, but it should reveal or refute any changes in spindle structure that result from the loss of complex members.

      3)Overall, the quantitative analysis in Figure 3 ,4 and 7 is not good enough and sometimes doesn't fully support the conclusions. In Figure 3,4 a convoluted way of demonstrating the change in localisation is shown and this panel is so small that is almost impossible to read. Also, there is no statistical analysis, and the sample size seems very small . At least 25 cells should be analysed here in 3 repeats. I would suggest to unify the quantification in the MS and use the line plots shown in Figure 5 and 6 and compare each protein before and after rapamycin addition. This is much easier to read and more convincing. The images of the cells panels can be moved to a supplement as they contain very little information. This would generate space to expand the size and depth of the quantitative analysis. Instead of Anova tests, I would recommend using a simple t-test comparing each condition to its relevant control since this is the only relevant comparison in the experiment. Statistical significance should be calculated for each experiment with sufficient sample size. It would also be better to show the individual data points from the three repeats in different colours so that the reproducibility between repeat can be judged.

      This type of statistical analysis should be uniformly done throughout the MS and also extended to Figure 7.

      The referee raises several issues here with our data presentation and statistical analysis.

      • Our aim in Figures 3 and 4 was to compress a lot of information into a small space, while still showing some example primary data. All reviewers raised the same concern about these figures which tells us that we went too far towards “data visualization”. To address this point, we will rework Figures 3 and 4 to provide more clear data presentation.
      • The Reviewer’s comments about statistical analysis however are not sound. First, it is incorrect to state that simple t-tests can be applied (this is a form of p-hacking). Correction for multiple testing must be done on these datasets. Second, the reviewer arbitrarily states numbers for cells and experimental repeats without considering the effect size or it seems, understanding the structure of the data that we have collected. Sample sizes are small but they are taken from many independent replicates. Third, and related to the previous point, the fixed and live cell data are structured differently which means that a uniform data presentation is not possible. The live data has a paired design and each cell is an independent replicate (with replicates done over several trials). The fixed data is unpaired and we have taken measures from several experiments (independent replicates). The point about applying statistical tests to the data is also made by Reviewer 1 and we will use appropriate tests (NHST or estimation statistics) as we re-work the figures.

        Reviewer #3 (Significance (Required)):

      In my opinion, the most interesting aspect of the MS is the methodology. Based on this, publication is justified and will be of interest to a wider audience. That is why a more detailed analysis of the penetrance of this manipulation across the cell population will be critical.

      The application of this method to analyse the composition of the TACC3/Clathrin complex on the spindle is the main biological advance, and the novel information is rather limited but not unimportant.

      Overall, if these results can be properly quantified I would recommend publication.

    1. What I'm up to is this: I'm trying to provide students with an op-portunity to think about ordinary things in their lives, like classroom furniture arrangements, and push them to find connections between how they sit in a classroom and how they learn to view themselves in a larger political world. I want them to think about what other than math or English is being taught in a classroom divided into rows. What "hidden lessons" are being imparted about power, learning, and equali-ty, what lessons do students learn about who they are from the material shaping of their space?

      I think this is a crucial note; however, I think the central focus of this is warped deeply by the reality of social distancing. I wonder how we may be able to find "hidden lessons" within the (no pun intended) small wiggle room we have physically/spatially in the classroom as of now.

    1. South African literature is a literature in bondage, as it reveals in even its highest m om ents, shot through as they are with feelings of homelessness and yearnings for a nameless liber-ation.

      I think the author is referring to how even though it may seem there is movement towards equality, the damage and trauma done under apartheid and colonialism cannot be forgotten among South Africans, which is seen in South African literature. The author's discussion about power dynamics reminded me of a previous reading we discussed about minor literatures. One of the struggles they may be dealing with is being a minor literature in their own country - even though they are technically the majority, they are fighting for their rights and freedoms.

    1. Jonathan Edwards catalyzed the revivals known as the Great Awakening. While Edwards was not the most prolific revivalist of the era—that honor belonged to George Whitefield—he did deliver the most famous sermon of the eighteenth century, commonly called “Sinners in the Hands of Angry God.” This excerpt is drawn from the final portion of the sermon, known as the application, where hearers were called to take action.     That world of misery, that lake of burning brimstone is extended abroad under you. There is the dreadful pit of the glowing flames of the wrath of God; there is hell’s wide gaping mouth open; and you have nothing to stand upon, nor anything to take hold of: there is nothing between you and hell but the air; ’tis only the power and mere pleasure of God that holds you up. You probably are not sensible of this; you find you are kept out of hell, but don’t see the hand of God in it, but look at other things, as the good state of your bodily constitution, your care of your own life, and the means you use for your own preservation. But indeed these things are nothing; if God should withdraw his hand, they would avail no more to keep you from falling, than the thin air to hold up a person that is suspended in it…. The God that holds you over the pit of hell, much as one holds a spider, or some loathsome insect, over the fire, abhors you, and is dreadfully provoked; his wrath towards you burns like fire; he looks upon you as worthy of nothing else, but to be cast into the fire; he is of purer eyes than to bear to have you in his sight; you are ten thousand times so abominable in his eyes as the most hateful venomous serpent is in ours. You have offended him infinitely more than ever a stubborn rebel did his prince: and yet ’tis nothing but his hand that holds you from falling into the fire every moment; ’tis to be ascribed to nothing else, that you did not go to hell the last night; that you was suffered to awake again in this world, after you closed your eyes to sleep: and there is no other reason to be given why you have not dropped into hell since you arose in the morning, but that God’s hand has held you up; there is no other reason to be given why you han’t gone to hell since you have sat here in the house of God, provoking his pure eyes by your sinful wicked manner of attending his solemn worship: yea, there is nothing else that is to be given as a reason why you don’t this very moment drop down into hell. O sinner! Consider the fearful danger you are in: ’tis a great furnace of wrath, a wide and bottomless pit, full of the fire of wrath, that you are held over in the hand of that God, whose wrath is provoked and incensed as much against you as against many of the damned in hell; you hang by a slender thread, with the flames of divine wrath flashing about it, and ready every moment to singe it, and burn it asunder; and you have no interest in any mediator, and nothing to lay hold of to save yourself, nothing to keep off the flames of wrath, nothing of your own, nothing that you ever have done, nothing that you can do, to induce God to spare you one moment… Consider this, you that are here present, that yet remain in an unregenerate state. That God will execute the fierceness of his anger, implies that he will inflict wrath without any pity… you will be a vessel of wrath fitted to destruction; and there will be no other use of this vessel but only to be filled full of wrath: God will be so far from pitying you when you cry to him, that ’tis said he will only laugh and mock (Proverbs 1:25-32)… How dreadful is the state of those that are daily and hourly in danger of this great wrath, and infinite misery! But this is the dismal case of every soul in this congregation, that has not been born again, however moral and strict, sober and religious they may otherwise be. Oh that you would consider it, whether you be young or old. There is reason to think, that there are many in this congregation now hearing this discourse, that will actually be the subjects of this very misery to all eternity. We know not who they are, or in what seats they sit, or what thoughts they now have: it may be they are now at ease, and hear all these things without much disturbance, and are now flattering themselves that they are not the persons, promising themselves that they shall escape. If we knew that there was one person, and but one, in the whole congregation that was to be the subject of this misery, what an awful thing would it be to think of! If we knew who it was, what an awful sight would it be to see such a person! How might all the rest of the congregation lift up a lamentable and bitter cry over him! But alas! instead of one, how many is it likely will remember this discourse in hell? And it would be a wonder if some that are now present, should not be in hell in a very short time, before this year is out. And it would be no wonder if some person that now sits here in some seat of this meeting house in health, and quiet and secure, should be there before tomorrow morning. Those of you that finally continue in a natural condition, that shall keep out of hell longest, will be there in a little time! your damnation don’t slumber; it will come swiftly, and in all probability very suddenly upon many of you. You have reason to wonder, that you are not already in hell. ‘Tis doubtless the case of some that heretofore you have seen and known, that never deserved hell more than you, and that heretofore appeared as likely to have been now alive as you: their case is past all hope; they are crying in extreme misery and perfect despair; but here you are in the land of the living, and in the house of God, and have an opportunity to obtain salvation. What would not those poor damned, hopeless souls give for one day’s such opportunity as you now enjoy! And now you have an extraordinary opportunity, a day wherein Christ has flung the door of mercy wide open, and stands in the door calling and crying with a loud voice to poor sinners; a day wherein many are flocking to him, and pressing into the kingdom of God; many are daily coming from the east, west, north and south; many that were very lately in the same miserable condition that you are in, are in now an happy state, with their hearts filled with love to him that has loved them and washed them from their sins in his own blood, and rejoicing in hope of the glory of God. How awful is it to be left behind at such a day! To see so many others feasting, while you are pining and perishing! To see so many rejoicing and singing for joy of heart, while you have cause to mourn for sorrow of heart, and howl for vexation of spirit! How can you rest one moment in such a condition? Are not your souls as precious as the souls of the people at Suffield,7 where they are flocking from day to day to Christ? … And you children that are unconverted, don’t you know that you are going down to hell, to bear the dreadful wrath of that God that is now angry with you every day, and every night? Will you be content to be the children of the devil, when so many other children in the land are converted, and are become the holy and happy children of the King of kings? And let everyone that is yet out of Christ, and hanging over the pit of hell, whether they be old men and women, or middle aged, or young people, or little children, now hearken to the loud calls of God’s Word and providence. This acceptable year of the Lord, that is a day of such great favor to some, will doubtless be a day of as remarkable vengeance to others… Therefore let everyone that is out of Christ, now awake and fly from the wrath to come. The wrath of almighty God is now undoubtedly hanging over great part of this congregation: let everyone fly out of Sodom. Haste and escape for your lives, look not behind you, escape to the mountain, lest you be consumed [Genesis 19:17].

      This sermon is truly eye opening to those who have never read it before. I have never seen such bold, outright wording in a religious setting and am somewhat shocked by the abrasiveness of the pastor. Edwards warns the audience that they will go to hell if they don't repent for their sins and find their way back to God. The audience is obviously church-goers yet Edwards is fervent in his accusations that they are not righteous people. The message was well-received due to the impact it left and may have been well-intended. However, the pastor could have shown more care in his more outrageous accusations. Religion is very important to some people but it is not something that should consume ones whole life. God is meant to be fair and loving therefore presenting him as a being that is dangling people and waiting for them to drop into hell is quite shocking and somewhat dramatic. God would not abandon one of his creations because they don't worship the same way as someone else.

    2. There is reason to think, that there are many in this congregation now hearing this discourse, that will actually be the subjects of this very misery to all eternity. We know not who they are, or in what seats they sit, or what thoughts they now have: it may be they are now at ease, and hear all these things without much disturbance, and are now flattering themselves that they are not the persons, promising themselves that they shall escape.

      Edwards here makes the strongest connection to his audience in the document as he specifically points out people who may have not been getting his message. In pointing out people who may be listening but change nothing or simply choose to not believe him are the most likely to simply put themselves in a position where God will not allow them to escape. I feel that at the time this sermon was given there were defiantly people listening to his sermon that just though about how all he was saying were lies and to stick to the old ways of thinking, but I wonder how these people were effected when this truly blew up with the great awakening and if they themselves had to come to terms with accepting this new way of thinking or being push away. It is an interesting point because many people were effected by the sermon some fainting others crying but what about the ones who thought it was all some big hoax?

    1. Reviewer #1

      The authors propose two related (though distinct) methods for the improvement of pharmacological screening analysis and related biomarker analyses. The first is a Gaussian process (GP) approach to dose-response curve fitting for the estimation of IC50, AUC, and related quantities. The goal of this method is to improve point and uncertainty estimates of these quantities through more flexible functional specification and outlier-robust error modeling. The second method is a hierarchical Bayesian approach to biomarker association analysis. This incorporates uncertainty estimates produced by the GP modeling with the aim of providing more sensitive association analyses with fewer false positives.

      The combination of methods presented has some potential. Flexible modeling of dose-response relationships and better estimation of uncertainty are interesting axes to wring more information out of large-scale screening datasets. There are a few areas to shore up in the paper to increase confidence in the empirical results and generalizability of the methods.

      1) There are a number of fixed parameters in the proposed methods, and the calibration procedure used to set these is unclear to me. For the GP models, there are a set of noise parameters for Beta mixture and the length scales and variance parameter for the kernel. I'm not sure how one would generalize the GP methods to other screening datasets as a result of this ambiguity (e.g., how would one determine appropriate noise parameters?). For the hierarchical Bayesian biomarker association model, we have prior scale parameters related to both the effect size and variance parameters. The number of researcher degrees of freedom introduced by these tuned parameters also raises some concerns about the sensitivity of empirical results (e.g., 24 clinically established biomarkers and 6 novel) to these choices. It's not clear if we're seeing a corner case or a robust result. I think the work would benefit from both sensitivity analyses with respect to tuned parameters and guidance on or methods for their estimation. The latter is particularly important if other researchers hope to employ these methods in a different context.

      2) The proposed hierarchical Bayesian approach to biomarker association analysis is a reasonable start, but it was unclear to me whether changes in performance stemmed from correcting misspecification in original ANOVA or the use of uncertainty estimates. I suggest comparing results to a heteroskedasticity-robust estimator (e.g., HC3, see Long and Ervin, 2000), which would be valid under the stated model without the requirement for explicit uncertainty estimates or priors. The transformations and tuning applied to uncertainty estimates in this context also make generalization of the approach challenging. The need for the c (power) parameter suggests a potential misspecification or miscalibration at some point in the modeling chain. It would be useful to understand this misspecification better, particularly for researchers hoping to extend or reuse these methods.

      3) The GP method provides reasonable estimates of uncertainty, but it would be useful to see them compared to those from the sigmoid model (e.g., from the delta method). It wasn't clear to me how much of the difference in results is coming from incorporation of uncertainty estimates as opposed to changes in the point estimates.

      4) The handling of cases with IC50 beyond the maximum observed dose (extrapolating to 10x the maximum concentration) provided a reasonable starting point, but a few subtleties in the handling of corner cases remain unaddressed (e.g., GPs allow positive slope at right edge of range). It would be useful to provide a more general, systematic procedure to address these. Imposing monotonicity may not be the best path, but additional guidance for researchers applying these methods in other contexts would help.

    1. Preprint Review

      This preprint was reviewed using eLife’s Preprint Review service, which provides public peer reviews of manuscripts posted on bioRxiv for the benefit of the authors, readers, potential readers, and others interested in our assessment of the work. This review applies only to version 3 of the manuscript.

      Summary

      In this manuscript the authors propose the identification of a novel protein involved in outer membrane remodelling, named BdpA (BAR domain-like protein A). According to the proposed model BdpA has a conserved role in membrane curvature control during formation of outer membrane vesicle (OMV) and of outer membrane extension (OMEs) in Shewanella oneidensis. The authors also provide evidence that heterologous expression of BdpA promotes formation of OMEs in other bacteria (namely in E. coli), and that BdpA is sufficient to induce OME-like structures when expressed in conditions where OMEs are normally not formed. In eukaryotes proteins containing BAR domains are important for shaping membrane curvature. Given the homology of BdpA to eukaryotic BAR-domain proteins, the authors suggest that BdpA and its homologs define the first prokaryotic family of BAR proteins or pBARs, with eukaryotic-like roles in membrane curvature modulation.

      Overall, the reviewers think that this is a very interesting study, and provided that further support is obtained to substantiate the proposed model the reviewers agree that the findings described here tackle a number of significant questions of broad interest. However, the reviewers also think that the evidence provided in this manuscript still does not fully support the conclusion that BdpA protein is involved in membrane curvature control as the eukaryotic proteins containing the BAR domains.

      We have compiled a list of comments that we hope will help the authors address the concerns of the reviewers to obtain stronger support for the function of BdpA.

      1) The reviewers are concerned that some of the conclusions are based on qualitative observations of microscopy analysis of OMVs and OMEs, and quantitative analyses are lacking to validate qualitative observations. As specified in with examples in the list of minor points below the reviewers propose that the data should be re-analyzed to obtain quantitative results. Specifically, a size distribution analysis could be applied to some microscopy data. Also note that the microscopy methods are poorly described, and as the calculation methods used are not fully available it is difficult to understand if the appropriate methods were used. Please specify how many cells were examined microscopically and how many biological replicates (cultures) were used in each experiment.

      2) Statistical analyses were not always the most accurate. In figure 2 unpaired t-test was used for samples that have high variance, this approach may inflate the statistical difference between the strains. For figure 2 a histogram of size distribution analyses could be shown for each strain.

      3) The reviewers are concerned that the proteomic data is not clear enough to conclude that the BdpA protein is localized to or enriched in OMV/OME. Could the results be complemented with some other method to confirm BdpA localization? The reviewers are particularly concerned by the fact that a large number of proteins were identified in the OMV fraction. Could it be that some of the OMV/OME fractions were contaminated? What controls were used to ensure that the purification procedure was working effectively? Could the data be strengthened by some quality control analyses to determine how many of those proteins are actually predicted to localize to the outer membrane and periplasm? From the methods it seems that the culture conditions used to prepare the OM versus OMV were different, is this so? If yes, why were the culture conditions different? This could affect protein expression? Please include the detailed growth conditions in the method section.

      4) The conclusion that BdpA is a BAR-domain protein is largely based on homology. The supplementary information file includes homology models that show striking similarity with eukaryotic BAR proteins. However, as the authors state, BdpA barely meets the cutoff for a BAR-domain protein. The results with the phenotype of the BdpA mutant, complementations and sufficiency data provide good support to the functional role of BdpA in membrane remodelling. However, the effect of BdpA on membrane stability could be indirect or the result of binding to outer membrane features in a manner distinct from other BAR proteins. Could these results be strengthened with some biochemical corroboration of its activity on membranes or structural data to confirm its relationship to eukaryotic Bar domain proteins? Or structural data to confirm its relationship to eukaryotic BAR domain proteins?

      5) The reviewers propose that the paper would be strengthened with the addition of topological studies in OMVs and OMEs. The reviewers had problems in reconciling the presence of a galactose-binding domain in BdpA and LPS sugar binding. The authors hypothesize that the putative Galactose-binding domain of BdpA mediates binding to LPS. However, it is also possible that it binds to peptidoglycan components. This would suggest that the proteins interact with the periplasmic side of the outer membrane rather than coat the OMV to promote OMV formation and release (which one could assume based on the role of some eukaryotic BARs). The addition of topological studies (or some biochemical approach) could make these models less speculative, strengthening the conclusions.

      6) Heterologous expression of BdpA in other bacteria provides important compelling arguments for its central role in producing OMEs. However, the imaging data provided do not provide the clearest evidence for induction of OMEs in M. atlanticus and E. coli. This is especially the case with the E. coli images. The extended web of staining in 4c does not resemble the tubules seen in S. oneidensis. It would be great to have some electron microscopy data and/or higher resolution fluorescence images of these bacteria as corroborating evidence. Additionally, only a few cells are shown and quantification of the proportion of cells with OMEs is needed. Thus, as already discussed in point 1, quantitative analyses could improve this important point.

    1. But with whatever success the doctrine of Inherited Variation may be applied to explain the existence of Varieties, it is certain that the origin of Species can be accounted for on the Development Theory, if at all, only by Cumulative Variation, -- that is, only by supposing a vast number of Inherited Variations to be successively superinduced one upon another. Doubts have been raised upon this point only on account of ambiguity in the meaning of words, or from want of agreement as to the principles of classification. Many races, both of animals and vegetables, appear to be so nearly allied to each other, that certain naturalists consider them as mere Varieties; others persist in considering them as so many distinct Species.

      This is quite important to Development Theory, as it presents ideas about different ways of thinking. It shows that people, including scientists think differently about this topic even when evidence may be presented for a different side. There is also evidence for that other side as well, which may bring up we do not know exact origins of species, especially back then.

    2. Mr. Darwin has invented a new scheme of cosmogony, and finds that, like other cosmogonies, it is a blank hypothesis, not susceptible either of proof or disproof, and needing an eternity for its development. There is nothing new in such a speculation of what is possible in an infinite lapse of years. This latest form of the speculation has no advantage over the one first propounded some three thousand years ago; -- that a chaos of atoms, moving about fortuitously in infinite space, may have happened, in an eternity, to settle into the present kosmos; for the chance of order and fitness is at least one out of an infinite number of chances of disorder and confusion; and in an infinite series of years, this solitary chance must sooner or later be realized....  

      I don't think that Darwin's theory of evolution was proposed in order to track origins of the universe. It was developed as an explanation for the changes in species we see on earth and even if it were to be considered a theory of cosmogony, it would have many advantages over the other theory of cosmogony which was stated.

    1. (A) One of the most important objects of measurement is hardly if at all alluded to here and should be emphasised. It is to obtain a general knowledge of the capacities of a man by sinking shafts, as it were, at a few critical points. In order to ascertain the best points for the purpose, the sets of measures should be compared with an independent estimate of the man's powers. We thus may learn which of the measures are the most instructive, The sort of estimate I have in view and which I would suggest should benoted [? for private use] is something of this kind,-"mobile, eager, energetic; well shaped; successful at games requiring good eye and hand; sensitive; good at music and drawing". Such estimates would be far from worthless when made after only a few minutes' talk; they ought to be exact when made of students who have been for months and years under observation. I lately saw a considerable collection of such estimates, made by a medical man for a special purpose. They were singularly searching and they hit off, with a few well chosen epithets, a very great variety of different characters. I could not induce the medical man to consent to the publication of specimens of his excellent analyses, nor even of fancy specimens. Even these would have sufficed to show that if psychologists seriously practised the art of briefly describing characters. they might raise that art to a high level. (B) The method I have long used for testing keenness of eye-sight in persons whose powers of eye-adaptation are normal, still seems to me quite effective. It is to register the greatest distance at which numerals printed in diamond type can be read. Strips of paper cut out at random from a small sheet printed all over with these numerals, are mounted on blocks set at successive distances from the eye-hole. They can easily be changed when dirty. Fair light is wanted, but that is all that is needed for ordinary test purposes. C) I have constructed an instrument which is not yet quite as I desire , of which the first part would I think greatly facilitate [p. 381] the working with the Hipp chronograph. I had found great trouble in inducing coarse and inexperienced persons to deliver their blows aright. They bungled and struck the instrument wrongly, and often broke it. Then I made it more massive, yet still they broke it and often hurt themselves much in doing so. My present plan is to give them nothing more than one end of a long thread to hold. The other end passes round a spring reel, like the tape in a spring measuring tape. The string when left to itself will reel home much faster than the swiftest blow can travel. All that the experimentee does is to retard it; the quickest man retarding it the least. The string travels smoothly and swiftly in a straight line between two eyelet holes. A bead attached to that part of the string would make the necessary breaks of electric contact with great neatness. The thread has a stop to cheek it when it has run far enough home. My reel is nothing more than a very light wooden wheel with a groove in it, some 3 inches in diameter, and with a brass axis turning freely between fixed points. One thread passes round the axis, and is tied at the other end to an india rubber band. The other thread passes in the opposite direction round the grooved wheel, and then through the eyelet holes. The experimentee is placed well back, quite clear of the apparatus. Nothing can act better than this part of my new instrument. (D) I now use a very neat, compact, and effective apparatus (made for me by Groves, 89, Bolsover Street, Portland Street, W.) which is a half-second's pendulum, held by a detent 18º from the vertical. The blow of a released hammer upon the detent gives the sound-signal and simultaneously lets the pendulum go. An elastic thread is fixed to the pendulum parallel to its axis, but about 1½ inch apart from it. As the pendulum oscillates this thread travels between 2 bars; the one fixed, the other movable. The fixed bar lies horizontally between the pendulum and the thread and is graduated. The movable bar nips the thread when a key is touched. Doing this, constitutes the response. The pendulum itself receives no jar through the act, owing to the elasticity of the thread. The graduations on the bar, that forms the chord to an arc of 18º on each side of the vertical, are calculated and published in the Jour. Anthrop. Inst. early last year, 1889, together with my description of the first form of the instrument. I exhibited the revised form of it at the British Association last autumn ; a brief description of it will appear in their Journal. The instrument is arranged for sight-signals as well. It is also arranged to measure the rapidity with which any given act can be performed. The experimentee touches a key that releases the pendulum ; then he performs the act; finally he touches the second key, that causes the thread to be nipped. Footnotes [1] Mr. Francis Galton, in his Anthropometric Laboratory at South Kensignton Museum, already uses some of these tests, and I hope the series here suggested will meet with his approval. It is convenient to follow Mr. Galton in combining tests of body, such as weight, size, colour of eyes, & c., with psychophysical and mental determinations, but these latter alone are the subject of the present discussion. The name (or initials) of the experimentee should be recorded, the nationality (including that of the parents), and the age, sex, occupation and sate of health. [See Remark (a) by Mr. Galton] [2] Sharpness of sight (including colour-vision) and hearing might, perhaps, be included in the list. I have omitted them because it requires considerable time to discover the amount and nature of the defect (which is usually bodily, not mental), and because abundant statistics have been published, and are being collected by oculists and aurists. [See Remark ( b )] [3] See Remark ( c ). [4] See Remark ( d ) [5] Organic sensations and sensations of motion, equilibrium and dizziness, should perhaps be included in this series.

      This is just slight changes to tests that Cattel now uses to conduct research. Mostly changes in apparatus to provide a slightly more accurate measurement.

    1. Lawn- care vendor's focused on the new suburban yard, specialized sports fields, golf courses, and municipal landscaping as bounteous new surfaces on which to wield their wares. Monsanto , Dupont, and other companies marketed the dream of the perfect carpet lawn through "time-saving" lawn care systems that included nitrogen, phosphorus, potassium, (N-P-K) fertilizers, Engineered seeds , pesticides and equipment. A lush, homogeneous lawn soon became the underlay of the American dream. The greener, more neatly shorn or the more homogenous of the surface the better. Chemically fertilized turf grass now pervades the American landscape, from golf courses to Central Park's Sheep Meadow, covering an estimated 28 million acres.

      Relate:

      When talking about turf in the landscape I think there are a lot of levels to the idea of using it in the landscape. It is a complicated subject because it has become so ingrained into our culture. If it is using over 70 million tons of pesticides to manage it then how do, we reduce that and change the culture of these huge lawns. I don’t think that all lawns should be disposed of, but we could reduce the amount that is in the landscape. When I was working for a landscaping company there would be these huge hillsides of perfectly manicured turf that provided no recreation or real purpose to the design. I think if we reduces the amount of these areas , but also stopped trying to put turf in the wrong environments then they may not have as many problems with pests, or we could just reduce the amount of turf used. I also think the idea of not using turf in all areas should be advertised as something unique and prideful the same way turf was advertised.

    1. There is nothing that is definite or absolute. We try all the time to interpret, through their gestures, words, and actions, how they are living through an experience; and then we go on from there

      I think this is important to note. Though the teachers are trying to find those moments of "knots" through observations, the receptiveness of the children may not be what the teacher is hoping to see as a "sticking point".

    1. the good life, if we can call it that, cannot be achieved apart from humans

      Who's to say that our standard of living as we take care of animals is better for them. it may be more humane but i dont think humans can judge happiness for animals. they would probably rather be left alone. its in there nature to survive and they don't need humans until humans make it impossible for them to live without the help of us.

    1. Why Are Finland’s Schools Successful? The country’s achievements in education have other nations, especially the United States, doing their homework <img src="https://thumbs-prod.si-cdn.com/thzZYTv2Evhq3x8iHdcaakihfVE=/800x600/filters:no_upscale()/https://public-media.si-cdn.com/filer/cd/ee/cdee1c82-f8e3-4de4-983e-8599d4485745/finland-smiles-wr.jpg" alt="Kirkkojarvi School" itemprop="image"> "This is what we do every day," says Kirkkojarvi Comprehensive School principal Kari Louhivuori, "prepare kids for life." (Stuart Conway) By LynNell Hancock Smithsonian Magazine | Subscribe September 2011 AddThis Sharing ButtonsShare to FacebookFacebookShare to TwitterTwitterShare to RedditReddit78Share to PinterestPinterest997Share to LinkedInLinkedInShare to FlipboardFlipboardShare to EmailEmailShare to PrintPrintShare to MoreAddThis934 It was the end of term at Kirkkojarvi Comprehensive School in Espoo, a sprawling suburb west of Helsinki, when Kari Louhivuori, a veteran teacher and the school’s principal, decided to try something extreme—by Finnish standards. One of his sixth-grade students, a Kosovo-Albanian boy, had drifted far off the learning grid, resisting his teacher’s best efforts. The school’s team of special educators—including a social worker, a nurse and a psychologist—convinced Louhivuori that laziness was not to blame. So he decided to hold the boy back a year, a measure so rare in Finland it’s practically obsolete. function dispatchComscoreLoadedEvent(){ let event = new Event('MPlayerComscoreLoaded'); window.dispatchEvent(event); } !function(e){var t={};function n(r){if(t[r])return t[r].exports;var i=t[r]={i:r,l:!1,exports:{}};return e[r].call(i.exports,i,i.exports,n),i.l=!0,i.exports}n.m=e,n.c=t,n.d=function(e,t,r){n.o(e,t)||Object.defineProperty(e,t,{enumerable:!0,get:r})},n.r=function(e){"undefined"!==typeof Symbol&&Symbol.toStringTag&&Object.defineProperty(e,Symbol.toStringTag,{value:"Module"}),Object.defineProperty(e,"__esModule",{value:!0})},n.t=function(e,t){if(1&t&&(e=n(e)),8&t)return e;if(4&t&&"object"===typeof e&&e&&e.__esModule)return e;var r=Object.create(null);if(n.r(r),Object.defineProperty(r,"default",{enumerable:!0,value:e}),2&t&&"string"!=typeof e)for(var i in e)n.d(r,i,function(t){return e[t]}.bind(null,i));return r},n.n=function(e){var t=e&&e.__esModule?function(){return e.default}:function(){return e};return n.d(t,"a",t),t},n.o=function(e,t){return Object.prototype.hasOwnProperty.call(e,t)},n.p="",n(n.s=68)}([function(e,t){e.exports=function(e,t,n){return t in e?Object.defineProperty(e,t,{value:n,enumerable:!0,configurable:!0,writable:!0}):e[t]=n,e}},function(e,t){e.exports=function(e,t){if(!(e instanceof t))throw new TypeError("Cannot call a class as a function")}},function(e,t){function n(e,t){for(var n=0;n<t.length;n++){var r=t[n];r.enumerable=r.enumerable||!1,r.configurable=!0,"value"in r&&(r.writable=!0),Object.defineProperty(e,r.key,r)}}e.exports=function(e,t,r){return t&&n(e.prototype,t),r&&n(e,r),e}},function(e,t){e.exports=function(e){if(void 0===e)throw new ReferenceError("this hasn't been initialised - super() hasn't been called");return e}},function(e,t,n){e.exports=n(47)},function(e,t){function n(t){return e.exports=n=Object.setPrototypeOf?Object.getPrototypeOf:function(e){return e.__proto__||Object.getPrototypeOf(e)},n(t)}e.exports=n},function(e,t,n){"use strict";var r=n(21),i=Object.prototype.toString;function o(e){return"[object Array]"===i.call(e)}function a(e){return"undefined"===typeof e}function s(e){return null!==e&&"object"===typeof e}function u(e){return"[object Function]"===i.call(e)}function c(e,t){if(null!==e&&"undefined"!==typeof e)if("object"!==typeof e&&(e=[e]),o(e))for(var n=0,r=e.length;n<r;n++)t.call(null,e[n],n,e);else for(var i in e)Object.prototype.hasOwnProperty.call(e,i)&&t.call(null,e[i],i,e)}e.exports={isArray:o,isArrayBuffer:function(e){return"[object ArrayBuffer]"===i.call(e)},isBuffer:function(e){return null!==e&&!a(e)&&null!==e.constructor&&!a(e.constructor)&&"function"===typeof e.constructor.isBuffer&&e.constructor.isBuffer(e)},isFormData:function(e){return"undefined"!==typeof FormData&&e instanceof FormData},isArrayBufferView:function(e){return"undefined"!==typeof ArrayBuffer&&ArrayBuffer.isView?ArrayBuffer.isView(e):e&&e.buffer&&e.buffer instanceof ArrayBuffer},isString:function(e){return"string"===typeof e},isNumber:function(e){return"number"===typeof e},isObject:s,isUndefined:a,isDate:function(e){return"[object Date]"===i.call(e)},isFile:function(e){return"[object File]"===i.call(e)},isBlob:function(e){return"[object Blob]"===i.call(e)},isFunction:u,isStream:function(e){return s(e)&&u(e.pipe)},isURLSearchParams:function(e){return"undefined"!==typeof URLSearchParams&&e instanceof URLSearchParams},isStandardBrowserEnv:function(){return("undefined"===typeof navigator||"ReactNative"!==navigator.product&&"NativeScript"!==navigator.product&&"NS"!==navigator.product)&&"undefined"!==typeof window&&"undefined"!==typeof document},forEach:c,merge:function e(){var t={};function n(n,r){"object"===typeof t[r]&&"object"===typeof n?t[r]=e(t[r],n):t[r]=n}for(var r=0,i=arguments.length;r<i;r++)c(arguments[r],n);return t},deepMerge:function e(){var t={};function n(n,r){"object"===typeof t[r]&&"object"===typeof n?t[r]=e(t[r],n):t[r]="object"===typeof n?e({},n):n}for(var r=0,i=arguments.length;r<i;r++)c(arguments[r],n);return t},extend:function(e,t,n){return c(t,function(t,i){e[i]=n&&"function"===typeof t?r(t,n):t}),e},trim:function(e){return e.replace(/^\s*/,"").replace(/\s*$/,"")}}},function(e,t){function n(e,t,n,r,i,o,a){try{var s=e[o](a),u=s.value}catch(c){return void n(c)}s.done?t(u):Promise.resolve(u).then(r,i)}e.exports=function(e){return function(){var t=this,r=arguments;return new Promise(function(i,o){var a=e.apply(t,r);function s(e){n(a,i,o,s,u,"next",e)}function u(e){n(a,i,o,s,u,"throw",e)}s(void 0)})}}},function(e,t,n){var r=n(48);e.exports=function(e,t){if("function"!==typeof t&&null!==t)throw new TypeError("Super expression must either be null or a function");e.prototype=Object.create(t&&t.prototype,{constructor:{value:e,writable:!0,configurable:!0}}),t&&r(e,t)}},function(e,t,n){var r=n(49),i=n(3);e.exports=function(e,t){return!t||"object"!==r(t)&&"function"!==typeof t?i(e):t}},function(e,t,n){var r=n(42),i=n(43),o=n(18),a=n(44);e.exports=function(e,t){return r(e)||i(e,t)||o(e,t)||a()}},function(e,t,n){var r=n(39),i=n(40),o=n(18),a=n(41);e.exports=function(e){return r(e)||i(e)||o(e)||a()}},function(e,t,n){var r=n(45);e.exports=function(e,t){if(null==e)return{};var n,i,o=r(e,t);if(Object.getOwnPropertySymbols){var a=Object.getOwnPropertySymbols(e);for(i=0;i<a.length;i++)n=a[i],t.indexOf(n)>=0||Object.prototype.propertyIsEnumerable.call(e,n)&&(o[n]=e[n])}return o}},function(e,t,n){var r=n(50);function i(t,n,o){return"undefined"!==typeof Reflect&&Reflect.get?e.exports=i=Reflect.get:e.exports=i=function(e,t,n){var i=r(e,t);if(i){var o=Object.getOwnPropertyDescriptor(i,t);return o.get?o.get.call(n):o.value}},i(t,n,o||t)}e.exports=i},function(e,t,n){"use strict";e.exports=n(36)},function(e,t,n){"use strict";var r=n(14),i={childContextTypes:!0,contextType:!0,contextTypes:!0,defaultProps:!0,displayName:!0,getDefaultProps:!0,getDerivedStateFromError:!0,getDerivedStateFromProps:!0,mixins:!0,propTypes:!0,type:!0},o={name:!0,length:!0,prototype:!0,caller:!0,callee:!0,arguments:!0,arity:!0},a={$$typeof:!0,compare:!0,defaultProps:!0,displayName:!0,propTypes:!0,type:!0},s={};function u(e){return r.isMemo(e)?a:s[e.$$typeof]||i}s[r.ForwardRef]={$$typeof:!0,render:!0,defaultProps:!0,displayName:!0,propTypes:!0},s[r.Memo]=a;var c=Object.defineProperty,l=Object.getOwnPropertyNames,d=Object.getOwnPropertySymbols,p=Object.getOwnPropertyDescriptor,f=Object.getPrototypeOf,h=Object.prototype;e.exports=function e(t,n,r){if("string"!==typeof n){if(h){var i=f(n);i&&i!==h&&e(t,i,r)}var a=l(n);d&&(a=a.concat(d(n)));for(var s=u(t),y=u(n),g=0;g<a.length;++g){var v=a[g];if(!o[v]&&(!r||!r[v])&&(!y||!y[v])&&(!s||!s[v])){var m=p(n,v);try{c(t,v,m)}catch(b){}}}}return t}},function(e,t,n){"use strict";(function(e,r){var i,o=n(29);i="undefined"!==typeof self?self:"undefined"!==typeof window?window:"undefined"!==typeof e?e:r;var a=Object(o.a)(i);t.a=a}).call(this,n(37),n(38)(e))},function(e,t){e.exports=function(e,t){(null==t||t>e.length)&&(t=e.length);for(var n=0,r=new Array(t);n<t;n++)r[n]=e[n];return r}},function(e,t,n){var r=n(17);e.exports=function(e,t){if(e){if("string"===typeof e)return r(e,t);var n=Object.prototype.toString.call(e).slice(8,-1);return"Object"===n&&e.constructor&&(n=e.constructor.name),"Map"===n||"Set"===n?Array.from(e):"Arguments"===n||/^(?:Ui|I)nt(?:8|16|32)(?:Clamped)?Array$/.test(n)?r(e,t):void 0}}},function(e,t){var n,r,i=e.exports={};function o(){throw new Error("setTimeout has not been defined")}function a(){throw new Error("clearTimeout has not been defined")}function s(e){if(n===setTimeout)return setTimeout(e,0);if((n===o||!n)&&setTimeout)return n=setTimeout,setTimeout(e,0);try{return n(e,0)}catch(t){try{return n.call(null,e,0)}catch(t){return n.call(this,e,0)}}}!function(){try{n="function"===typeof setTimeout?setTimeout:o}catch(e){n=o}try{r="function"===typeof clearTimeout?clearTimeout:a}catch(e){r=a}}();var u,c=[],l=!1,d=-1;function p(){l&&u&&(l=!1,u.length?c=u.concat(c):d=-1,c.length&&f())}function f(){if(!l){var e=s(p);l=!0;for(var t=c.length;t;){for(u=c,c=[];++d<t;)u&&u[d].run();d=-1,t=c.length}u=null,l=!1,function(e){if(r===clearTimeout)return clearTimeout(e);if((r===a||!r)&&clearTimeout)return r=clearTimeout,clearTimeout(e);try{r(e)}catch(t){try{return r.call(null,e)}catch(t){return r.call(this,e)}}}(e)}}function h(e,t){this.fun=e,this.array=t}function y(){}i.nextTick=function(e){var t=new Array(arguments.length-1);if(arguments.length>1)for(var n=1;n<arguments.length;n++)t[n-1]=arguments[n];c.push(new h(e,t)),1!==c.length||l||s(f)},h.prototype.run=function(){this.fun.apply(null,this.array)},i.title="browser",i.browser=!0,i.env={},i.argv=[],i.version="",i.versions={},i.on=y,i.addListener=y,i.once=y,i.off=y,i.removeListener=y,i.removeAllListeners=y,i.emit=y,i.prependListener=y,i.prependOnceListener=y,i.listeners=function(e){return[]},i.binding=function(e){throw new Error("process.binding is not supported")},i.cwd=function(){return"/"},i.chdir=function(e){throw new Error("process.chdir is not supported")},i.umask=function(){return 0}},function(e,t){!function(){"use strict";if("object"===typeof window)if("IntersectionObserver"in window&&"IntersectionObserverEntry"in window&&"intersectionRatio"in window.IntersectionObserverEntry.prototype)"isIntersecting"in window.IntersectionObserverEntry.prototype||Object.defineProperty(window.IntersectionObserverEntry.prototype,"isIntersecting",{get:function(){return this.intersectionRatio>0}});else{var e=window.document,t=[];r.prototype.THROTTLE_TIMEOUT=100,r.prototype.POLL_INTERVAL=null,r.prototype.USE_MUTATION_OBSERVER=!0,r.prototype.observe=function(e){if(!this._observationTargets.some(function(t){return t.element==e})){if(!e||1!=e.nodeType)throw new Error("target must be an Element");this._registerInstance(),this._observationTargets.push({element:e,entry:null}),this._monitorIntersections(e.ownerDocument),this._checkForIntersections()}},r.prototype.unobserve=function(e){this._observationTargets=this._observationTargets.filter(function(t){return t.element!=e}),this._unmonitorIntersections(e.ownerDocument),0==this._observationTargets.length&&this._unregisterInstance()},r.prototype.disconnect=function(){this._observationTargets=[],this._unmonitorAllIntersections(),this._unregisterInstance()},r.prototype.takeRecords=function(){var e=this._queuedEntries.slice();return this._queuedEntries=[],e},r.prototype._initThresholds=function(e){var t=e||[0];return Array.isArray(t)||(t=[t]),t.sort().filter(function(e,t,n){if("number"!=typeof e||isNaN(e)||e<0||e>1)throw new Error("threshold must be a number between 0 and 1 inclusively");return e!==n[t-1]})},r.prototype._parseRootMargin=function(e){var t=(e||"0px").split(/\s+/).map(function(e){var t=/^(-?\d*\.?\d+)(px|%)$/.exec(e);if(!t)throw new Error("rootMargin must be specified in pixels or percent");return{value:parseFloat(t[1]),unit:t[2]}});return t[1]=t[1]||t[0],t[2]=t[2]||t[0],t[3]=t[3]||t[1],t},r.prototype._monitorIntersections=function(t){var n=t.defaultView;if(n&&-1==this._monitoringDocuments.indexOf(t)){var r=this._checkForIntersections,a=null,s=null;if(this.POLL_INTERVAL?a=n.setInterval(r,this.POLL_INTERVAL):(i(n,"resize",r,!0),i(t,"scroll",r,!0),this.USE_MUTATION_OBSERVER&&"MutationObserver"in n&&(s=new n.MutationObserver(r)).observe(t,{attributes:!0,childList:!0,characterData:!0,subtree:!0})),this._monitoringDocuments.push(t),this._monitoringUnsubscribes.push(function(){var e=t.defaultView;e&&(a&&e.clearInterval(a),o(e,"resize",r,!0)),o(t,"scroll",r,!0),s&&s.disconnect()}),t!=(this.root&&this.root.ownerDocument||e)){var u=d(t);u&&this._monitorIntersections(u.ownerDocument)}}},r.prototype._unmonitorIntersections=function(t){var n=this._monitoringDocuments.indexOf(t);if(-1!=n){var r=this.root&&this.root.ownerDocument||e;if(!this._observationTargets.some(function(e){var n=e.element.ownerDocument;if(n==t)return!0;for(;n&&n!=r;){var i=d(n);if((n=i&&i.ownerDocument)==t)return!0}return!1})){var i=this._monitoringUnsubscribes[n];if(this._monitoringDocuments.splice(n,1),this._monitoringUnsubscribes.splice(n,1),i(),t!=r){var o=d(t);o&&this._unmonitorIntersections(o.ownerDocument)}}}},r.prototype._unmonitorAllIntersections=function(){var e=this._monitoringUnsubscribes.slice(0);this._monitoringDocuments.length=0,this._monitoringUnsubscribes.length=0;for(var t=0;t<e.length;t++)e[t]()},r.prototype._checkForIntersections=function(){var e=this._rootIsInDom(),t=e?this._getRootRect():{top:0,bottom:0,left:0,right:0,width:0,height:0};this._observationTargets.forEach(function(r){var i=r.element,o=s(i),a=this._rootContainsTarget(i),u=r.entry,c=e&&a&&this._computeTargetAndRootIntersection(i,o,t),l=r.entry=new n({time:window.performance&&performance.now&&performance.now(),target:i,boundingClientRect:o,rootBounds:t,intersectionRect:c});u?e&&a?this._hasCrossedThreshold(u,l)&&this._queuedEntries.push(l):u&&u.isIntersecting&&this._queuedEntries.push(l):this._queuedEntries.push(l)},this),this._queuedEntries.length&&this._callback(this.takeRecords(),this)},r.prototype._computeTargetAndRootIntersection=function(t,n,r){if("none"!=window.getComputedStyle(t).display){for(var i=n,o=l(t),c=!1;!c&&o;){var d=null,p=1==o.nodeType?window.getComputedStyle(o):{};if("none"==p.display)return null;if(o==this.root||9==o.nodeType)if(c=!0,o==this.root||o==e)d=r;else{var f=l(o),h=f&&s(f),y=f&&this._computeTargetAndRootIntersection(f,h,r);h&&y?(o=f,d=u(h,y)):(o=null,i=null)}else{var g=o.ownerDocument;o!=g.body&&o!=g.documentElement&&"visible"!=p.overflow&&(d=s(o))}if(d&&(i=a(d,i)),!i)break;o=o&&l(o)}return i}},r.prototype._getRootRect=function(){var t;if(this.root)t=s(this.root);else{var n=e.documentElement,r=e.body;t={top:0,left:0,right:n.clientWidth||r.clientWidth,width:n.clientWidth||r.clientWidth,bottom:n.clientHeight||r.clientHeight,height:n.clientHeight||r.clientHeight}}return this._expandRectByRootMargin(t)},r.prototype._expandRectByRootMargin=function(e){var t=this._rootMarginValues.map(function(t,n){return"px"==t.unit?t.value:t.value*(n%2?e.width:e.height)/100}),n={top:e.top-t[0],right:e.right+t[1],bottom:e.bottom+t[2],left:e.left-t[3]};return n.width=n.right-n.left,n.height=n.bottom-n.top,n},r.prototype._hasCrossedThreshold=function(e,t){var n=e&&e.isIntersecting?e.intersectionRatio||0:-1,r=t.isIntersecting?t.intersectionRatio||0:-1;if(n!==r)for(var i=0;i<this.thresholds.length;i++){var o=this.thresholds[i];if(o==n||o==r||o<n!==o<r)return!0}},r.prototype._rootIsInDom=function(){return!this.root||c(e,this.root)},r.prototype._rootContainsTarget=function(t){return c(this.root||e,t)&&(!this.root||this.root.ownerDocument==t.ownerDocument)},r.prototype._registerInstance=function(){t.indexOf(this)<0&&t.push(this)},r.prototype._unregisterInstance=function(){var e=t.indexOf(this);-1!=e&&t.splice(e,1)},window.IntersectionObserver=r,window.IntersectionObserverEntry=n}function n(e){this.time=e.time,this.target=e.target,this.rootBounds=e.rootBounds,this.boundingClientRect=e.boundingClientRect,this.intersectionRect=e.intersectionRect||{top:0,bottom:0,left:0,right:0,width:0,height:0},this.isIntersecting=!!e.intersectionRect;var t=this.boundingClientRect,n=t.width*t.height,r=this.intersectionRect,i=r.width*r.height;this.intersectionRatio=n?Number((i/n).toFixed(4)):this.isIntersecting?1:0}function r(e,t){var n=t||{};if("function"!=typeof e)throw new Error("callback must be a function");if(n.root&&1!=n.root.nodeType)throw new Error("root must be an Element");this._checkForIntersections=function(e,t){var n=null;return function(){n||(n=setTimeout(function(){e(),n=null},t))}}(this._checkForIntersections.bind(this),this.THROTTLE_TIMEOUT),this._callback=e,this._observationTargets=[],this._queuedEntries=[],this._rootMarginValues=this._parseRootMargin(n.rootMargin),this.thresholds=this._initThresholds(n.threshold),this.root=n.root||null,this.rootMargin=this._rootMarginValues.map(function(e){return e.value+e.unit}).join(" "),this._monitoringDocuments=[],this._monitoringUnsubscribes=[]}function i(e,t,n,r){"function"==typeof e.addEventListener?e.addEventListener(t,n,r||!1):"function"==typeof e.attachEvent&&e.attachEvent("on"+t,n)}function o(e,t,n,r){"function"==typeof e.removeEventListener?e.removeEventListener(t,n,r||!1):"function"==typeof e.detatchEvent&&e.detatchEvent("on"+t,n)}function a(e,t){var n=Math.max(e.top,t.top),r=Math.min(e.bottom,t.bottom),i=Math.max(e.left,t.left),o=Math.min(e.right,t.right),a=o-i,s=r-n;return a>=0&&s>=0&&{top:n,bottom:r,left:i,right:o,width:a,height:s}||null}function s(e){var t;try{t=e.getBoundingClientRect()}catch(n){}return t?(t.width&&t.height||(t={top:t.top,right:t.right,bottom:t.bottom,left:t.left,width:t.right-t.left,height:t.bottom-t.top}),t):{top:0,bottom:0,left:0,right:0,width:0,height:0}}function u(e,t){var n=t.top-e.top,r=t.left-e.left;return{top:n,left:r,height:t.height,width:t.width,bottom:n+t.height,right:r+t.width}}function c(e,t){for(var n=t;n;){if(n==e)return!0;n=l(n)}return!1}function l(t){var n=t.parentNode;return 9==t.nodeType&&t!=e?d(t):n&&11==n.nodeType&&n.host?n.host:n&&n.assignedSlot?n.assignedSlot.parentNode:n}function d(e){try{return e.defaultView&&e.defaultView.frameElement||null}catch(t){return null}}}()},function(e,t,n){"use strict";e.exports=function(e,t){return function(){for(var n=new Array(arguments.length),r=0;r<n.length;r++)n[r]=arguments[r];return e.apply(t,n)}}},function(e,t,n){"use strict";var r=n(6);function i(e){return encodeURIComponent(e).replace(/%40/gi,"@").replace(/%3A/gi,":").replace(/%24/g,"$").replace(/%2C/gi,",").replace(/%20/g,"+").replace(/%5B/gi,"[").replace(/%5D/gi,"]")}e.exports=function(e,t,n){if(!t)return e;var o;if(n)o=n(t);else if(r.isURLSearchParams(t))o=t.toString();else{var a=[];r.forEach(t,function(e,t){null!==e&&"undefined"!==typeof e&&(r.isArray(e)?t+="[]":e=[e],r.forEach(e,function(e){r.isDate(e)?e=e.toISOString():r.isObject(e)&&(e=JSON.stringify(e)),a.push(i(t)+"="+i(e))}))}),o=a.join("&")}if(o){var s=e.indexOf("#");-1!==s&&(e=e.slice(0,s)),e+=(-1===e.indexOf("?")?"?":"&")+o}return e}},function(e,t,n){"use strict";e.exports=function(e){return!(!e||!e.__CANCEL__)}},function(e,t,n){"use strict";(function(t){var r=n(6),i=n(57),o={"Content-Type":"application/x-www-form-urlencoded"};function a(e,t){!r.isUndefined(e)&&r.isUndefined(e["Content-Type"])&&(e["Content-Type"]=t)}var s={adapter:function(){var e;return"undefined"!==typeof XMLHttpRequest?e=n(25):"undefined"!==typeof t&&"[object process]"===Object.prototype.toString.call(t)&&(e=n(25)),e}(),transformRequest:[function(e,t){return i(t,"Accept"),i(t,"Content-Type"),r.isFormData(e)||r.isArrayBuffer(e)||r.isBuffer(e)||r.isStream(e)||r.isFile(e)||r.isBlob(e)?e:r.isArrayBufferView(e)?e.buffer:r.isURLSearchParams(e)?(a(t,"application/x-www-form-urlencoded;charset=utf-8"),e.toString()):r.isObject(e)?(a(t,"application/json;charset=utf-8"),JSON.stringify(e)):e}],transformResponse:[function(e){if("string"===typeof e)try{e=JSON.parse(e)}catch(t){}return e}],timeout:0,xsrfCookieName:"XSRF-TOKEN",xsrfHeaderName:"X-XSRF-TOKEN",maxContentLength:-1,validateStatus:function(e){return e>=200&&e<300},headers:{common:{Accept:"application/json, text/plain, */*"}}};r.forEach(["delete","get","head"],function(e){s.headers[e]={}}),r.forEach(["post","put","patch"],function(e){s.headers[e]=r.merge(o)}),e.exports=s}).call(this,n(19))},function(e,t,n){"use strict";var r=n(6),i=n(58),o=n(22),a=n(60),s=n(63),u=n(64),c=n(26);e.exports=function(e){return new Promise(function(t,l){var d=e.data,p=e.headers;r.isFormData(d)&&delete p["Content-Type"];var f=new XMLHttpRequest;if(e.auth){var h=e.auth.username||"",y=e.auth.password||"";p.Authorization="Basic "+btoa(h+":"+y)}var g=a(e.baseURL,e.url);if(f.open(e.method.toUpperCase(),o(g,e.params,e.paramsSerializer),!0),f.timeout=e.timeout,f.onreadystatechange=function(){if(f&&4===f.readyState&&(0!==f.status||f.responseURL&&0===f.responseURL.indexOf("file:"))){var n="getAllResponseHeaders"in f?s(f.getAllResponseHeaders()):null,r={data:e.responseType&&"text"!==e.responseType?f.response:f.responseText,status:f.status,statusText:f.statusText,headers:n,config:e,request:f};i(t,l,r),f=null}},f.onabort=function(){f&&(l(c("Request aborted",e,"ECONNABORTED",f)),f=null)},f.onerror=function(){l(c("Network Error",e,null,f)),f=null},f.ontimeout=function(){var t="timeout of "+e.timeout+"ms exceeded";e.timeoutErrorMessage&&(t=e.timeoutErrorMessage),l(c(t,e,"ECONNABORTED",f)),f=null},r.isStandardBrowserEnv()){var v=n(65),m=(e.withCredentials||u(g))&&e.xsrfCookieName?v.read(e.xsrfCookieName):void 0;m&&(p[e.xsrfHeaderName]=m)}if("setRequestHeader"in f&&r.forEach(p,function(e,t){"undefined"===typeof d&&"content-type"===t.toLowerCase()?delete p[t]:f.setRequestHeader(t,e)}),r.isUndefined(e.withCredentials)||(f.withCredentials=!!e.withCredentials),e.responseType)try{f.responseType=e.responseType}catch(b){if("json"!==e.responseType)throw b}"function"===typeof e.onDownloadProgress&&f.addEventListener("progress",e.onDownloadProgress),"function"===typeof e.onUploadProgress&&f.upload&&f.upload.addEventListener("progress",e.onUploadProgress),e.cancelToken&&e.cancelToken.promise.then(function(e){f&&(f.abort(),l(e),f=null)}),void 0===d&&(d=null),f.send(d)})}},function(e,t,n){"use strict";var r=n(59);e.exports=function(e,t,n,i,o){var a=new Error(e);return r(a,t,n,i,o)}},function(e,t,n){"use strict";var r=n(6);e.exports=function(e,t){t=t||{};var n={},i=["url","method","params","data"],o=["headers","auth","proxy"],a=["baseURL","url","transformRequest","transformResponse","paramsSerializer","timeout","withCredentials","adapter","responseType","xsrfCookieName","xsrfHeaderName","onUploadProgress","onDownloadProgress","maxContentLength","validateStatus","maxRedirects","httpAgent","httpsAgent","cancelToken","socketPath"];r.forEach(i,function(e){"undefined"!==typeof t[e]&&(n[e]=t[e])}),r.forEach(o,function(i){r.isObject(t[i])?n[i]=r.deepMerge(e[i],t[i]):"undefined"!==typeof t[i]?n[i]=t[i]:r.isObject(e[i])?n[i]=r.deepMerge(e[i]):"undefined"!==typeof e[i]&&(n[i]=e[i])}),r.forEach(a,function(r){"undefined"!==typeof t[r]?n[r]=t[r]:"undefined"!==typeof e[r]&&(n[r]=e[r])});var s=i.concat(o).concat(a),u=Object.keys(t).filter(function(e){return-1===s.indexOf(e)});return r.forEach(u,function(r){"undefined"!==typeof t[r]?n[r]=t[r]:"undefined"!==typeof e[r]&&(n[r]=e[r])}),n}},function(e,t,n){"use strict";function r(e){this.message=e}r.prototype.toString=function(){return"Cancel"+(this.message?": "+this.message:"")},r.prototype.__CANCEL__=!0,e.exports=r},function(e,t,n){"use strict";function r(e){var t,n=e.Symbol;return"function"===typeof n?n.observable?t=n.observable:(t=n("observable"),n.observable=t):t="@@observable",t}n.d(t,"a",function(){return r})},function(e,t,n){"use strict";(function(e){n.d(t,"a",function(){return f});var r=function(){for(var e=0,t=0,n=arguments.length;t<n;t++)e+=arguments[t].length;var r=Array(e),i=0;for(t=0;t<n;t++)for(var o=arguments[t],a=0,s=o.length;a<s;a++,i++)r[i]=o[a];return r},i=function(){return function(e,t,n){this.name=e,this.version=t,this.os=n,this.type="browser"}}(),o=function(){return function(t){this.version=t,this.type="node",this.name="node",this.os=e.platform}}(),a=function(){return function(e,t,n,r){this.name=e,this.version=t,this.os=n,this.bot=r,this.type="bot-device"}}(),s=function(){return function(){this.type="bot",this.bot=!0,this.name="bot",this.version=null,this.os=null}}(),u=function(){return function(){this.type="react-native",this.name="react-native",this.version=null,this.os=null}}(),c=/(nuhk|Googlebot|Yammybot|Openbot|Slurp|MSNBot|Ask\ Jeeves\/Teoma|ia_archiver)/,l=3,d=[["aol",/AOLShield\/([0-9\._]+)/],["edge",/Edge\/([0-9\._]+)/],["edge-ios",/EdgiOS\/([0-9\._]+)/],["yandexbrowser",/YaBrowser\/([0-9\._]+)/],["kakaotalk",/KAKAOTALK\s([0-9\.]+)/],["samsung",/SamsungBrowser\/([0-9\.]+)/],["silk",/\bSilk\/([0-9._-]+)\b/],["miui",/MiuiBrowser\/([0-9\.]+)$/],["beaker",/BeakerBrowser\/([0-9\.]+)/],["edge-chromium",/Edg\/([0-9\.]+)/],["chromium-webview",/(?!Chrom.*OPR)wv\).*Chrom(?:e|ium)\/([0-9\.]+)(:?\s|$)/],["chrome",/(?!Chrom.*OPR)Chrom(?:e|ium)\/([0-9\.]+)(:?\s|$)/],["phantomjs",/PhantomJS\/([0-9\.]+)(:?\s|$)/],["crios",/CriOS\/([0-9\.]+)(:?\s|$)/],["firefox",/Firefox\/([0-9\.]+)(?:\s|$)/],["fxios",/FxiOS\/([0-9\.]+)/],["opera-mini",/Opera Mini.*Version\/([0-9\.]+)/],["opera",/Opera\/([0-9\.]+)(?:\s|$)/],["opera",/OPR\/([0-9\.]+)(:?\s|$)/],["ie",/Trident\/7\.0.*rv\:([0-9\.]+).*\).*Gecko$/],["ie",/MSIE\s([0-9\.]+);.*Trident\/[4-7].0/],["ie",/MSIE\s(7\.0)/],["bb10",/BB10;\sTouch.*Version\/([0-9\.]+)/],["android",/Android\s([0-9\.]+)/],["ios",/Version\/([0-9\._]+).*Mobile.*Safari.*/],["safari",/Version\/([0-9\._]+).*Safari/],["facebook",/FBAV\/([0-9\.]+)/],["instagram",/Instagram\s([0-9\.]+)/],["ios-webview",/AppleWebKit\/([0-9\.]+).*Mobile/],["ios-webview",/AppleWebKit\/([0-9\.]+).*Gecko\)$/],["searchbot",/alexa|bot|crawl(er|ing)|facebookexternalhit|feedburner|google web preview|nagios|postrank|pingdom|slurp|spider|yahoo!|yandex/]],p=[["iOS",/iP(hone|od|ad)/],["Android OS",/Android/],["BlackBerry OS",/BlackBerry|BB10/],["Windows Mobile",/IEMobile/],["Amazon OS",/Kindle/],["Windows 3.11",/Win16/],["Windows 95",/(Windows 95)|(Win95)|(Windows_95)/],["Windows 98",/(Windows 98)|(Win98)/],["Windows 2000",/(Windows NT 5.0)|(Windows 2000)/],["Windows XP",/(Windows NT 5.1)|(Windows XP)/],["Windows Server 2003",/(Windows NT 5.2)/],["Windows Vista",/(Windows NT 6.0)/],["Windows 7",/(Windows NT 6.1)/],["Windows 8",/(Windows NT 6.2)/],["Windows 8.1",/(Windows NT 6.3)/],["Windows 10",/(Windows NT 10.0)/],["Windows ME",/Windows ME/],["Open BSD",/OpenBSD/],["Sun OS",/SunOS/],["Chrome OS",/CrOS/],["Linux",/(Linux)|(X11)/],["Mac OS",/(Mac_PowerPC)|(Macintosh)/],["QNX",/QNX/],["BeOS",/BeOS/],["OS/2",/OS\/2/]];function f(t){return t?y(t):"undefined"===typeof document&&"undefined"!==typeof navigator&&"ReactNative"===navigator.product?new u:"undefined"!==typeof navigator?y(navigator.userAgent):"undefined"!==typeof e&&e.version?new o(e.version.slice(1)):null}function h(e){return""!==e&&d.reduce(function(t,n){var r=n[0],i=n[1];if(t)return t;var o=i.exec(e);return!!o&&[r,o]},!1)}function y(e){var t=h(e);if(!t)return null;var n=t[0],o=t[1];if("searchbot"===n)return new s;var u=o[1]&&o[1].split(/[._]/).slice(0,3);u?u.length<l&&(u=r(u,function(e){for(var t=[],n=0;n<e;n++)t.push("0");return t}(l-u.length))):u=[];var d=u.join("."),f=function(e){for(var t=0,n=p.length;t<n;t++){var r=p[t],i=r[0],o=r[1],a=o.exec(e);if(a)return i}return null}(e),y=c.exec(e);return y&&y[1]?new a(n,d,f,y[1]):new i(n,d,f)}}).call(this,n(19))},function(e,t){function n(){return e.exports=n=Object.assign||function(e){for(var t=1;t<arguments.length;t++){var n=arguments[t];for(var r in n)Object.prototype.hasOwnProperty.call(n,r)&&(e[r]=n[r])}return e},n.apply(this,arguments)}e.exports=n},function(e,t,n){e.exports=n(52)},function(e,t,n){e.exports=n(34)()},function(e,t,n){"use strict";var r=n(35);function i(){}function o(){}o.resetWarningCache=i,e.exports=function(){function e(e,t,n,i,o,a){if(a!==r){var s=new Error("Calling PropTypes validators directly is not supported by the `prop-types` package. Use PropTypes.checkPropTypes() to call them. Read more at http://fb.me/use-check-prop-types");throw s.name="Invariant Violation",s}}function t(){return e}e.isRequired=e;var n={array:e,bool:e,func:e,number:e,object:e,string:e,symbol:e,any:e,arrayOf:t,element:e,elementType:e,instanceOf:t,node:e,objectOf:t,oneOf:t,oneOfType:t,shape:t,exact:t,checkPropTypes:o,resetWarningCache:i};return n.PropTypes=n,n}},function(e,t,n){"use strict";e.exports="SECRET_DO_NOT_PASS_THIS_OR_YOU_WILL_BE_FIRED"},function(e,t,n){"use strict";var r="function"===typeof Symbol&&Symbol.for,i=r?Symbol.for("react.element"):60103,o=r?Symbol.for("react.portal"):60106,a=r?Symbol.for("react.fragment"):60107,s=r?Symbol.for("react.strict_mode"):60108,u=r?Symbol.for("react.profiler"):60114,c=r?Symbol.for("react.provider"):60109,l=r?Symbol.for("react.context"):60110,d=r?Symbol.for("react.async_mode"):60111,p=r?Symbol.for("react.concurrent_mode"):60111,f=r?Symbol.for("react.forward_ref"):60112,h=r?Symbol.for("react.suspense"):60113,y=r?Symbol.for("react.suspense_list"):60120,g=r?Symbol.for("react.memo"):60115,v=r?Symbol.for("react.lazy"):60116,m=r?Symbol.for("react.block"):60121,b=r?Symbol.for("react.fundamental"):60117,O=r?Symbol.for("react.responder"):60118,_=r?Symbol.for("react.scope"):60119;function S(e){if("object"===typeof e&&null!==e){var t=e.$$typeof;switch(t){case i:switch(e=e.type){case d:case p:case a:case u:case s:case h:return e;default:switch(e=e&&e.$$typeof){case l:case f:case v:case g:case c:return e;default:return t}}case o:return t}}}function E(e){return S(e)===p}t.AsyncMode=d,t.ConcurrentMode=p,t.ContextConsumer=l,t.ContextProvider=c,t.Element=i,t.ForwardRef=f,t.Fragment=a,t.Lazy=v,t.Memo=g,t.Portal=o,t.Profiler=u,t.StrictMode=s,t.Suspense=h,t.isAsyncMode=function(e){return E(e)||S(e)===d},t.isConcurrentMode=E,t.isContextConsumer=function(e){return S(e)===l},t.isContextProvider=function(e){return S(e)===c},t.isElement=function(e){return"object"===typeof e&&null!==e&&e.$$typeof===i},t.isForwardRef=function(e){return S(e)===f},t.isFragment=function(e){return S(e)===a},t.isLazy=function(e){return S(e)===v},t.isMemo=function(e){return S(e)===g},t.isPortal=function(e){return S(e)===o},t.isProfiler=function(e){return S(e)===u},t.isStrictMode=function(e){return S(e)===s},t.isSuspense=function(e){return S(e)===h},t.isValidElementType=function(e){return"string"===typeof e||"function"===typeof e||e===a||e===p||e===u||e===s||e===h||e===y||"object"===typeof e&&null!==e&&(e.$$typeof===v||e.$$typeof===g||e.$$typeof===c||e.$$typeof===l||e.$$typeof===f||e.$$typeof===b||e.$$typeof===O||e.$$typeof===_||e.$$typeof===m)},t.typeOf=S},function(e,t){var n;n=function(){return this}();try{n=n||new Function("return this")()}catch(r){"object"===typeof window&&(n=window)}e.exports=n},function(e,t){e.exports=function(e){if(!e.webpackPolyfill){var t=Object.create(e);t.children||(t.children=[]),Object.defineProperty(t,"loaded",{enumerable:!0,get:function(){return t.l}}),Object.defineProperty(t,"id",{enumerable:!0,get:function(){return t.i}}),Object.defineProperty(t,"exports",{enumerable:!0}),t.webpackPolyfill=1}return t}},function(e,t,n){var r=n(17);e.exports=function(e){if(Array.isArray(e))return r(e)}},function(e,t){e.exports=function(e){if("undefined"!==typeof Symbol&&Symbol.iterator in Object(e))return Array.from(e)}},function(e,t){e.exports=function(){throw new TypeError("Invalid attempt to spread non-iterable instance.\nIn order to be iterable, non-array objects must have a [Symbol.iterator]() method.")}},function(e,t){e.exports=function(e){if(Array.isArray(e))return e}},function(e,t){e.exports=function(e,t){if("undefined"!==typeof Symbol&&Symbol.iterator in Object(e)){var n=[],r=!0,i=!1,o=void 0;try{for(var a,s=e[Symbol.iterator]();!(r=(a=s.next()).done)&&(n.push(a.value),!t||n.length!==t);r=!0);}catch(u){i=!0,o=u}finally{try{r||null==s.return||s.return()}finally{if(i)throw o}}return n}}},function(e,t){e.exports=function(){throw new TypeError("Invalid attempt to destructure non-iterable instance.\nIn order to be iterable, non-array objects must have a [Symbol.iterator]() method.")}},function(e,t){e.exports=function(e,t){if(null==e)return{};var n,r,i={},o=Object.keys(e);for(r=0;r<o.length;r++)n=o[r],t.indexOf(n)>=0||(i[n]=e[n]);return i}},function(e,t){},function(e,t,n){var r=function(e){"use strict";var t,n=Object.prototype,r=n.hasOwnProperty,i="function"===typeof Symbol?Symbol:{},o=i.iterator||"@@iterator",a=i.asyncIterator||"@@asyncIterator",s=i.toStringTag||"@@toStringTag";function u(e,t,n){return Object.defineProperty(e,t,{value:n,enumerable:!0,configurable:!0,writable:!0}),e[t]}try{u({},"")}catch(M){u=function(e,t,n){return e[t]=n}}function c(e,t,n,r){var i=t&&t.prototype instanceof g?t:g,o=Object.create(i.prototype),a=new C(r||[]);return o._invoke=function(e,t,n){var r=d;return function(i,o){if(r===f)throw new Error("Generator is already running");if(r===h){if("throw"===i)throw o;return D()}for(n.method=i,n.arg=o;;){var a=n.delegate;if(a){var s=P(a,n);if(s){if(s===y)continue;return s}}if("next"===n.method)n.sent=n._sent=n.arg;else if("throw"===n.method){if(r===d)throw r=h,n.arg;n.dispatchException(n.arg)}else"return"===n.method&&n.abrupt("return",n.arg);r=f;var u=l(e,t,n);if("normal"===u.type){if(r=n.done?h:p,u.arg===y)continue;return{value:u.arg,done:n.done}}"throw"===u.type&&(r=h,n.method="throw",n.arg=u.arg)}}}(e,n,a),o}function l(e,t,n){try{return{type:"normal",arg:e.call(t,n)}}catch(M){return{type:"throw",arg:M}}}e.wrap=c;var d="suspendedStart",p="suspendedYield",f="executing",h="completed",y={};function g(){}function v(){}function m(){}var b={};b[o]=function(){return this};var O=Object.getPrototypeOf,_=O&&O(O(R([])));_&&_!==n&&r.call(_,o)&&(b=_);var S=m.prototype=g.prototype=Object.create(b);function E(e){["next","throw","return"].forEach(function(t){u(e,t,function(e){return this._invoke(t,e)})})}function w(e,t){var n;this._invoke=function(i,o){function a(){return new t(function(n,a){!function n(i,o,a,s){var u=l(e[i],e,o);if("throw"!==u.type){var c=u.arg,d=c.value;return d&&"object"===typeof d&&r.call(d,"__await")?t.resolve(d.__await).then(function(e){n("next",e,a,s)},function(e){n("throw",e,a,s)}):t.resolve(d).then(function(e){c.value=e,a(c)},function(e){return n("throw",e,a,s)})}s(u.arg)}(i,o,n,a)})}return n=n?n.then(a,a):a()}}function P(e,n){var r=e.iterator[n.method];if(r===t){if(n.delegate=null,"throw"===n.method){if(e.iterator.return&&(n.method="return",n.arg=t,P(e,n),"throw"===n.method))return y;n.method="throw",n.arg=new TypeError("The iterator does not provide a 'throw' method")}return y}var i=l(r,e.iterator,n.arg);if("throw"===i.type)return n.method="throw",n.arg=i.arg,n.delegate=null,y;var o=i.arg;return o?o.done?(n[e.resultName]=o.value,n.next=e.nextLoc,"return"!==n.method&&(n.method="next",n.arg=t),n.delegate=null,y):o:(n.method="throw",n.arg=new TypeError("iterator result is not an object"),n.delegate=null,y)}function T(e){var t={tryLoc:e[0]};1 in e&&(t.catchLoc=e[1]),2 in e&&(t.finallyLoc=e[2],t.afterLoc=e[3]),this.tryEntries.push(t)}function A(e){var t=e.completion||{};t.type="normal",delete t.arg,e.completion=t}function C(e){this.tryEntries=[{tryLoc:"root"}],e.forEach(T,this),this.reset(!0)}function R(e){if(e){var n=e[o];if(n)return n.call(e);if("function"===typeof e.next)return e;if(!isNaN(e.length)){var i=-1,a=function n(){for(;++i<e.length;)if(r.call(e,i))return n.value=e[i],n.done=!1,n;return n.value=t,n.done=!0,n};return a.next=a}}return{next:D}}function D(){return{value:t,done:!0}}return v.prototype=S.constructor=m,m.constructor=v,v.displayName=u(m,s,"GeneratorFunction"),e.isGeneratorFunction=function(e){var t="function"===typeof e&&e.constructor;return!!t&&(t===v||"GeneratorFunction"===(t.displayName||t.name))},e.mark=function(e){return Object.setPrototypeOf?Object.setPrototypeOf(e,m):(e.__proto__=m,u(e,s,"GeneratorFunction")),e.prototype=Object.create(S),e},e.awrap=function(e){return{__await:e}},E(w.prototype),w.prototype[a]=function(){return this},e.AsyncIterator=w,e.async=function(t,n,r,i,o){void 0===o&&(o=Promise);var a=new w(c(t,n,r,i),o);return e.isGeneratorFunction(n)?a:a.next().then(function(e){return e.done?e.value:a.next()})},E(S),u(S,s,"Generator"),S[o]=function(){return this},S.toString=function(){return"[object Generator]"},e.keys=function(e){var t=[];for(var n in e)t.push(n);return t.reverse(),function n(){for(;t.length;){var r=t.pop();if(r in e)return n.value=r,n.done=!1,n}return n.done=!0,n}},e.values=R,C.prototype={constructor:C,reset:function(e){if(this.prev=0,this.next=0,this.sent=this._sent=t,this.done=!1,this.delegate=null,this.method="next",this.arg=t,this.tryEntries.forEach(A),!e)for(var n in this)"t"===n.charAt(0)&&r.call(this,n)&&!isNaN(+n.slice(1))&&(this[n]=t)},stop:function(){this.done=!0;var e=this.tryEntries[0].completion;if("throw"===e.type)throw e.arg;return this.rval},dispatchException:function(e){if(this.done)throw e;var n=this;function i(r,i){return s.type="throw",s.arg=e,n.next=r,i&&(n.method="next",n.arg=t),!!i}for(var o=this.tryEntries.length-1;o>=0;--o){var a=this.tryEntries[o],s=a.completion;if("root"===a.tryLoc)return i("end");if(a.tryLoc<=this.prev){var u=r.call(a,"catchLoc"),c=r.call(a,"finallyLoc");if(u&&c){if(this.prev<a.catchLoc)return i(a.catchLoc,!0);if(this.prev<a.finallyLoc)return i(a.finallyLoc)}else if(u){if(this.prev<a.catchLoc)return i(a.catchLoc,!0)}else{if(!c)throw new Error("try statement without catch or finally");if(this.prev<a.finallyLoc)return i(a.finallyLoc)}}}},abrupt:function(e,t){for(var n=this.tryEntries.length-1;n>=0;--n){var i=this.tryEntries[n];if(i.tryLoc<=this.prev&&r.call(i,"finallyLoc")&&this.prev<i.finallyLoc){var o=i;break}}o&&("break"===e||"continue"===e)&&o.tryLoc<=t&&t<=o.finallyLoc&&(o=null);var a=o?o.completion:{};return a.type=e,a.arg=t,o?(this.method="next",this.next=o.finallyLoc,y):this.complete(a)},complete:function(e,t){if("throw"===e.type)throw e.arg;return"break"===e.type||"continue"===e.type?this.next=e.arg:"return"===e.type?(this.rval=this.arg=e.arg,this.method="return",this.next="end"):"normal"===e.type&&t&&(this.next=t),y},finish:function(e){for(var t=this.tryEntries.length-1;t>=0;--t){var n=this.tryEntries[t];if(n.finallyLoc===e)return this.complete(n.completion,n.afterLoc),A(n),y}},catch:function(e){for(var t=this.tryEntries.length-1;t>=0;--t){var n=this.tryEntries[t];if(n.tryLoc===e){var r=n.completion;if("throw"===r.type){var i=r.arg;A(n)}return i}}throw new Error("illegal catch attempt")},delegateYield:function(e,n,r){return this.delegate={iterator:R(e),resultName:n,nextLoc:r},"next"===this.method&&(this.arg=t),y}},e}(e.exports);try{regeneratorRuntime=r}catch(i){Function("r","regeneratorRuntime = r")(r)}},function(e,t){function n(t,r){return e.exports=n=Object.setPrototypeOf||function(e,t){return e.__proto__=t,e},n(t,r)}e.exports=n},function(e,t){function n(t){return"function"===typeof Symbol&&"symbol"===typeof Symbol.iterator?e.exports=n=function(e){return typeof e}:e.exports=n=function(e){return e&&"function"===typeof Symbol&&e.constructor===Symbol&&e!==Symbol.prototype?"symbol":typeof e},n(t)}e.exports=n},function(e,t,n){var r=n(5);e.exports=function(e,t){for(;!Object.prototype.hasOwnProperty.call(e,t)&&null!==(e=r(e)););return e}},function(e){e.exports=JSON.parse('{"name":"mplayer","version":"4.0.13","description":"minute media player","author":"minute media","private":true,"scripts":{"start":"yarn compile && PORT=2001 per-env","start:production":"npm run -s serve","start:development":"npm run -s dev","build":"preact build --no-prerender","serve":"preact build && serve build --single","dev":"preact watch","lint":"./node_modules/.bin/eslint --cache --ext .js,.ts,.tsx ./src/.","test":"jest","compile":"webpack","compile:production":"NODE_ENV=production webpack","compile:qa":"NODE_ENV=qa webpack"},"devDependencies":{"@babel/cli":"^7.8.4","@babel/core":"^7.8.4","@babel/plugin-proposal-class-properties":"^7.8.3","@babel/plugin-transform-react-jsx":"^7.8.3","@babel/plugin-transform-runtime":"^7.9.0","@babel/preset-env":"^7.8.4","@babel/preset-react":"^7.8.3","@babel/preset-typescript":"^7.8.3","@typescript-eslint/eslint-plugin":"^2.10.0","@typescript-eslint/parser":"^2.10.0","eslint":"^6.7.2","eslint-config-mm":"git+https://github.com/FTBpro/eslint-config-mm.git#v3.1","eslint-loader":"3.0.2","identity-obj-proxy":"^3.0.0","jest":"^24.9.0","jest-emotion":"^10.0.32","jest-preset-preact":"^1.0.0","per-env":"^1.0.2","preact-cli":"^3.0.0-rc.6","react":"^16.13.1","react-dom":"^16.13.1","serve":"^11.1.0"},"dependencies":{"@emotion/core":"^10.0.28","axios":"^0.19.2","babel-loader":"^8.0.6","detect-browser":"^5.1.0","emotion":"^10.0.27","enzyme":"^3.11.0","enzyme-adapter-preact-pure":"^2.2.0","hls.js":"^0.13.2","intersection-observer":"^0.8.0","jest-enzyme":"^7.1.2","jest-junit":"^10.0.0","preact":"^10.0.1","preact-render-to-string":"^5.1.8","react-redux":"^7.2.0","react-svg-loader":"^3.0.3","redux":"^4.0.5","redux-thunk":"^2.3.0","terser-webpack-plugin":"1.2.3","webpack":"^4.41.6","webpack-cli":"^3.3.11"}}')},function(e,t,n){"use strict";var r=n(6),i=n(21),o=n(53),a=n(27);function s(e){var t=new o(e),n=i(o.prototype.request,t);return r.extend(n,o.prototype,t),r.extend(n,t),n}var u=s(n(24));u.Axios=o,u.create=function(e){return s(a(u.defaults,e))},u.Cancel=n(28),u.CancelToken=n(66),u.isCancel=n(23),u.all=function(e){return Promise.all(e)},u.spread=n(67),e.exports=u,e.exports.default=u},function(e,t,n){"use strict";var r=n(6),i=n(22),o=n(54),a=n(55),s=n(27);function u(e){this.defaults=e,this.interceptors={request:new o,response:new o}}u.prototype.request=function(e){"string"===typeof e?(e=arguments[1]||{}).url=arguments[0]:e=e||{},(e=s(this.defaults,e)).method?e.method=e.method.toLowerCase():this.defaults.method?e.method=this.defaults.method.toLowerCase():e.method="get";var t=[a,void 0],n=Promise.resolve(e);for(this.interceptors.request.forEach(function(e){t.unshift(e.fulfilled,e.rejected)}),this.interceptors.response.forEach(function(e){t.push(e.fulfilled,e.rejected)});t.length;)n=n.then(t.shift(),t.shift());return n},u.prototype.getUri=function(e){return e=s(this.defaults,e),i(e.url,e.params,e.paramsSerializer).replace(/^\?/,"")},r.forEach(["delete","get","head","options"],function(e){u.prototype[e]=function(t,n){return this.request(r.merge(n||{},{method:e,url:t}))}}),r.forEach(["post","put","patch"],function(e){u.prototype[e]=function(t,n,i){return this.request(r.merge(i||{},{method:e,url:t,data:n}))}}),e.exports=u},function(e,t,n){"use strict";var r=n(6);function i(){this.handlers=[]}i.prototype.use=function(e,t){return this.handlers.push({fulfilled:e,rejected:t}),this.handlers.length-1},i.prototype.eject=function(e){this.handlers[e]&&(this.handlers[e]=null)},i.prototype.forEach=function(e){r.forEach(this.handlers,function(t){null!==t&&e(t)})},e.exports=i},function(e,t,n){"use strict";var r=n(6),i=n(56),o=n(23),a=n(24);function s(e){e.cancelToken&&e.cancelToken.throwIfRequested()}e.exports=function(e){return s(e),e.headers=e.headers||{},e.data=i(e.data,e.headers,e.transformRequest),e.headers=r.merge(e.headers.common||{},e.headers[e.method]||{},e.headers),r.forEach(["delete","get","head","post","put","patch","common"],function(t){delete e.headers[t]}),(e.adapter||a.adapter)(e).then(function(t){return s(e),t.data=i(t.data,t.headers,e.transformResponse),t},function(t){return o(t)||(s(e),t&&t.response&&(t.response.data=i(t.response.data,t.response.headers,e.transformResponse))),Promise.reject(t)})}},function(e,t,n){"use strict";var r=n(6);e.exports=function(e,t,n){return r.forEach(n,function(n){e=n(e,t)}),e}},function(e,t,n){"use strict";var r=n(6);e.exports=function(e,t){r.forEach(e,function(n,r){r!==t&&r.toUpperCase()===t.toUpperCase()&&(e[t]=n,delete e[r])})}},function(e,t,n){"use strict";var r=n(26);e.exports=function(e,t,n){var i=n.config.validateStatus;!i||i(n.status)?e(n):t(r("Request failed with status code "+n.status,n.config,null,n.request,n))}},function(e,t,n){"use strict";e.exports=function(e,t,n,r,i){return e.config=t,n&&(e.code=n),e.request=r,e.response=i,e.isAxiosError=!0,e.toJSON=function(){return{message:this.message,name:this.name,description:this.description,number:this.number,fileName:this.fileName,lineNumber:this.lineNumber,columnNumber:this.columnNumber,stack:this.stack,config:this.config,code:this.code}},e}},function(e,t,n){"use strict";var r=n(61),i=n(62);e.exports=function(e,t){return e&&!r(t)?i(e,t):t}},function(e,t,n){"use strict";e.exports=function(e){return/^([a-z][a-z\d\+\-\.]*:)?\/\//i.test(e)}},function(e,t,n){"use strict";e.exports=function(e,t){return t?e.replace(/\/+$/,"")+"/"+t.replace(/^\/+/,""):e}},function(e,t,n){"use strict";var r=n(6),i=["age","authorization","content-length","content-type","etag","expires","from","host","if-modified-since","if-unmodified-since","last-modified","location","max-forwards","proxy-authorization","referer","retry-after","user-agent"];e.exports=function(e){var t,n,o,a={};return e?(r.forEach(e.split("\n"),function(e){if(o=e.indexOf(":"),t=r.trim(e.substr(0,o)).toLowerCase(),n=r.trim(e.substr(o+1)),t){if(a[t]&&i.indexOf(t)>=0)return;a[t]="set-cookie"===t?(a[t]?a[t]:[]).concat([n]):a[t]?a[t]+", "+n:n}}),a):a}},function(e,t,n){"use strict";var r=n(6);e.exports=r.isStandardBrowserEnv()?function(){var e,t=/(msie|trident)/i.test(navigator.userAgent),n=document.createElement("a");function i(e){var r=e;return t&&(n.setAttribute("href",r),r=n.href),n.setAttribute("href",r),{href:n.href,protocol:n.protocol?n.protocol.replace(/:$/,""):"",host:n.host,search:n.search?n.search.replace(/^\?/,""):"",hash:n.hash?n.hash.replace(/^#/,""):"",hostname:n.hostname,port:n.port,pathname:"/"===n.pathname.charAt(0)?n.pathname:"/"+n.pathname}}return e=i(window.location.href),function(t){var n=r.isString(t)?i(t):t;return n.protocol===e.protocol&&n.host===e.host}}():function(){return!0}},function(e,t,n){"use strict";var r=n(6);e.exports=r.isStandardBrowserEnv()?{write:function(e,t,n,i,o,a){var s=[];s.push(e+"="+encodeURIComponent(t)),r.isNumber(n)&&s.push("expires="+new Date(n).toGMTString()),r.isString(i)&&s.push("path="+i),r.isString(o)&&s.push("domain="+o),!0===a&&s.push("secure"),document.cookie=s.join("; ")},read:function(e){var t=document.cookie.match(new RegExp("(^|;\\s*)("+e+")=([^;]*)"));return t?decodeURIComponent(t[3]):null},remove:function(e){this.write(e,"",Date.now()-864e5)}}:{write:function(){},read:function(){return null},remove:function(){}}},function(e,t,n){"use strict";var r=n(28);function i(e){if("function"!==typeof e)throw new TypeError("executor must be a function.");var t;this.promise=new Promise(function(e){t=e});var n=this;e(function(e){n.reason||(n.reason=new r(e),t(n.reason))})}i.prototype.throwIfRequested=function(){if(this.reason)throw this.reason},i.source=function(){var e;return{token:new i(function(t){e=t}),cancel:e}},e.exports=i},function(e,t,n){"use strict";e.exports=function(e){return function(t){return e.apply(null,t)}}},function(e,t,n){"use strict";n.r(t);var r={};n.r(r),n.d(r,"render",function(){return B}),n.d(r,"hydrate",function(){return H}),n.d(r,"createElement",function(){return b}),n.d(r,"h",function(){return b}),n.d(r,"Fragment",function(){return S}),n.d(r,"createRef",function(){return _}),n.d(r,"isValidElement",function(){return a}),n.d(r,"Component",function(){return E}),n.d(r,"cloneElement",function(){return q}),n.d(r,"createContext",function(){return W}),n.d(r,"toChildArray",function(){return R}),n.d(r,"__u",function(){return U}),n.d(r,"options",function(){return o});var i={};n.r(i),n.d(i,"useState",function(){return te}),n.d(i,"useReducer",function(){return ne}),n.d(i,"useEffect",function(){return re}),n.d(i,"useLayoutEffect",function(){return ie}),n.d(i,"useRef",function(){return oe}),n.d(i,"useImperativeHandle",function(){return ae}),n.d(i,"useMemo",function(){return se}),n.d(i,"useCallback",function(){return ue}),n.d(i,"useContext",function(){return ce}),n.d(i,"useDebugValue",function(){return le}),n.d(i,"useErrorBoundary",function(){return de});var o,a,s,u,c,l,d,p=n(0),f=n.n(p),h={},y=[],g=/acit|ex(?:s|g|n|p|$)|rph|grid|ows|mnc|ntw|ine[ch]|zoo|^ord|itera/i;function v(e,t){for(var n in t)e[n]=t[n];return e}function m(e){var t=e.parentNode;t&&t.removeChild(e)}function b(e,t,n){var r,i,o,a=arguments,s={};for(o in t)"key"==o?r=t[o]:"ref"==o?i=t[o]:s[o]=t[o];if(arguments.length>3)for(n=[n],o=3;o<arguments.length;o++)n.push(a[o]);if(null!=n&&(s.children=n),"function"==typeof e&&null!=e.defaultProps)for(o in e.defaultProps)void 0===s[o]&&(s[o]=e.defaultProps[o]);return O(e,s,r,i,null)}function O(e,t,n,r,i){var a={type:e,props:t,key:n,ref:r,__k:null,__:null,__b:0,__e:null,__d:void 0,__c:null,constructor:void 0,__v:i};return null==i&&(a.__v=a),null!=o.vnode&&o.vnode(a),a}function _(){return{current:null}}function S(e){return e.children}function E(e,t){this.props=e,this.context=t}function w(e,t){if(null==t)return e.__?w(e.__,e.__.__k.indexOf(e)+1):null;for(var n;t<e.__k.length;t++)if(null!=(n=e.__k[t])&&null!=n.__e)return n.__e;return"function"==typeof e.type?w(e):null}function P(e){var t,n;if(null!=(e=e.__)&&null!=e.__c){for(e.__e=e.__c.base=null,t=0;t<e.__k.length;t++)if(null!=(n=e.__k[t])&&null!=n.__e){e.__e=e.__c.base=n.__e;break}return P(e)}}function T(e){(!e.__d&&(e.__d=!0)&&s.push(e)&&!A.__r++||c!==o.debounceRendering)&&((c=o.debounceRendering)||u)(A)}function A(){for(var e;A.__r=s.length;)e=s.sort(function(e,t){return e.__v.__b-t.__v.__b}),s=[],e.some(function(e){var t,n,r,i,o,a,s;e.__d&&(a=(o=(t=e).__v).__e,(s=t.__P)&&(n=[],(r=v({},o)).__v=r,i=L(s,o,r,t.__n,void 0!==s.ownerSVGElement,null,n,null==a?w(o):a),x(n,o),i!=a&&P(o)))})}function C(e,t,n,r,i,o,a,s,u,c){var l,d,p,f,g,v,b,_=r&&r.__k||y,E=_.length;for(u==h&&(u=null!=a?a[0]:E?w(r,0):null),n.__k=[],l=0;l<t.length;l++)if(null!=(f=n.__k[l]=null==(f=t[l])||"boolean"==typeof f?null:"string"==typeof f||"number"==typeof f?O(null,f,null,null,f):Array.isArray(f)?O(S,{children:f},null,null,null):null!=f.__e||null!=f.__c?O(f.type,f.props,f.key,null,f.__v):f)){if(f.__=n,f.__b=n.__b+1,null===(p=_[l])||p&&f.key==p.key&&f.type===p.type)_[l]=void 0;else for(d=0;d<E;d++){if((p=_[d])&&f.key==p.key&&f.type===p.type){_[d]=void 0;break}p=null}g=L(e,f,p=p||h,i,o,a,s,u,c),(d=f.ref)&&p.ref!=d&&(b||(b=[]),p.ref&&b.push(p.ref,null,f),b.push(d,f.__c||g,f)),null!=g?(null==v&&(v=g),u=D(e,f,p,_,a,g,u),c||"option"!=n.type?"function"==typeof n.type&&(n.__d=u):e.value=""):u&&p.__e==u&&u.parentNode!=e&&(u=w(p))}if(n.__e=v,null!=a&&"function"!=typeof n.type)for(l=a.length;l--;)null!=a[l]&&m(a[l]);for(l=E;l--;)null!=_[l]&&U(_[l],_[l]);if(b)for(l=0;l<b.length;l++)j(b[l],b[++l],b[++l])}function R(e,t){return t=t||[],null==e||"boolean"==typeof e||(Array.isArray(e)?e.some(function(e){R(e,t)}):t.push(e)),t}function D(e,t,n,r,i,o,a){var s,u,c;if(void 0!==t.__d)s=t.__d,t.__d=void 0;else if(i==n||o!=a||null==o.parentNode)e:if(null==a||a.parentNode!==e)e.appendChild(o),s=null;else{for(u=a,c=0;(u=u.nextSibling)&&c<r.length;c+=2)if(u==o)break e;e.insertBefore(o,a),s=a}return void 0!==s?s:o.nextSibling}function M(e,t,n){"-"===t[0]?e.setProperty(t,n):e[t]=null==n?"":"number"!=typeof n||g.test(t)?n:n+"px"}function I(e,t,n,r,i){var o,a;if(i&&"className"==t&&(t="class"),"style"===t)if("string"==typeof n)e.style=n;else{if("string"==typeof r&&(e.style=r=""),r)for(t in r)n&&t in n||M(e.style,t,"");if(n)for(t in n)r&&n[t]===r[t]||M(e.style,t,n[t])}else"o"===t[0]&&"n"===t[1]?(o=t!==(t=t.replace(/Capture$/,"")),(a=t.toLowerCase())in e&&(t=a),t=t.slice(2),e.l||(e.l={}),e.l[t]=n,n?r||e.addEventListener(t,k,o):e.removeEventListener(t,k,o)):"list"!==t&&"tagName"!==t&&"form"!==t&&"type"!==t&&"size"!==t&&"download"!==t&&"href"!==t&&!i&&t in e?e[t]=null==n?"":n:"function"!=typeof n&&"dangerouslySetInnerHTML"!==t&&(t!==(t=t.replace(/xlink:?/,""))?null==n||!1===n?e.removeAttributeNS("http://www.w3.org/1999/xlink",t.toLowerCase()):e.setAttributeNS("http://www.w3.org/1999/xlink",t.toLowerCase(),n):null==n||!1===n&&!/^ar/.test(t)?e.removeAttribute(t):e.setAttribute(t,n))}function k(e){this.l[e.type](o.event?o.event(e):e)}function N(e,t,n){var r,i;for(r=0;r<e.__k.length;r++)(i=e.__k[r])&&(i.__=e,i.__e&&("function"==typeof i.type&&i.__k.length>1&&N(i,t,n),t=D(n,i,i,e.__k,null,i.__e,t),"function"==typeof e.type&&(e.__d=t)))}function L(e,t,n,r,i,a,s,u,c){var l,d,p,f,h,y,g,m,b,O,_,w=t.type;if(void 0!==t.constructor)return null;(l=o.__b)&&l(t);try{e:if("function"==typeof w){if(m=t.props,b=(l=w.contextType)&&r[l.__c],O=l?b?b.props.value:l.__:r,n.__c?g=(d=t.__c=n.__c).__=d.__E:("prototype"in w&&w.prototype.render?t.__c=d=new w(m,O):(t.__c=d=new E(m,O),d.constructor=w,d.render=F),b&&b.sub(d),d.props=m,d.state||(d.state={}),d.context=O,d.__n=r,p=d.__d=!0,d.__h=[]),null==d.__s&&(d.__s=d.state),null!=w.getDerivedStateFromProps&&(d.__s==d.state&&(d.__s=v({},d.__s)),v(d.__s,w.getDerivedStateFromProps(m,d.__s))),f=d.props,h=d.state,p)null==w.getDerivedStateFromProps&&null!=d.componentWillMount&&d.componentWillMount(),null!=d.componentDidMount&&d.__h.push(d.componentDidMount);else{if(null==w.getDerivedStateFromProps&&m!==f&&null!=d.componentWillReceiveProps&&d.componentWillReceiveProps(m,O),!d.__e&&null!=d.shouldComponentUpdate&&!1===d.shouldComponentUpdate(m,d.__s,O)||t.__v===n.__v){d.props=m,d.state=d.__s,t.__v!==n.__v&&(d.__d=!1),d.__v=t,t.__e=n.__e,t.__k=n.__k,d.__h.length&&s.push(d),N(t,u,e);break e}null!=d.componentWillUpdate&&d.componentWillUpdate(m,d.__s,O),null!=d.componentDidUpdate&&d.__h.push(function(){d.componentDidUpdate(f,h,y)})}d.context=O,d.props=m,d.state=d.__s,(l=o.__r)&&l(t),d.__d=!1,d.__v=t,d.__P=e,l=d.render(d.props,d.state,d.context),d.state=d.__s,null!=d.getChildContext&&(r=v(v({},r),d.getChildContext())),p||null==d.getSnapshotBeforeUpdate||(y=d.getSnapshotBeforeUpdate(f,h)),_=null!=l&&l.type==S&&null==l.key?l.props.children:l,C(e,Array.isArray(_)?_:[_],t,n,r,i,a,s,u,c),d.base=t.__e,d.__h.length&&s.push(d),g&&(d.__E=d.__=null),d.__e=!1}else null==a&&t.__v===n.__v?(t.__k=n.__k,t.__e=n.__e):t.__e=V(n.__e,t,n,r,i,a,s,c);(l=o.diffed)&&l(t)}catch(e){t.__v=null,o.__e(e,t,n)}return t.__e}function x(e,t){o.__c&&o.__c(t,e),e.some(function(t){try{e=t.__h,t.__h=[],e.some(function(e){e.call(t)})}catch(e){o.__e(e,t.__v)}})}function V(e,t,n,r,i,o,a,s){var u,c,l,d,p,f=n.props,g=t.props;if(i="svg"===t.type||i,null!=o)for(u=0;u<o.length;u++)if(null!=(c=o[u])&&((null===t.type?3===c.nodeType:c.localName===t.type)||e==c)){e=c,o[u]=null;break}if(null==e){if(null===t.type)return document.createTextNode(g);e=i?document.createElementNS("http://www.w3.org/2000/svg",t.type):document.createElement(t.type,g.is&&{is:g.is}),o=null,s=!1}if(null===t.type)f!==g&&e.data!==g&&(e.data=g);else{if(null!=o&&(o=y.slice.call(e.childNodes)),l=(f=n.props||h).dangerouslySetInnerHTML,d=g.dangerouslySetInnerHTML,!s){if(null!=o)for(f={},p=0;p<e.attributes.length;p++)f[e.attributes[p].name]=e.attributes[p].value;(d||l)&&(d&&l&&d.__html==l.__html||(e.innerHTML=d&&d.__html||""))}(function(e,t,n,r,i){var o;for(o in n)"children"===o||"key"===o||o in t||I(e,o,null,n[o],r);for(o in t)i&&"function"!=typeof t[o]||"children"===o||"key"===o||"value"===o||"checked"===o||n[o]===t[o]||I(e,o,t[o],n[o],r)})(e,g,f,i,s),d?t.__k=[]:(u=t.props.children,C(e,Array.isArray(u)?u:[u],t,n,r,"foreignObject"!==t.type&&i,o,a,h,s)),s||("value"in g&&void 0!==(u=g.value)&&u!==e.value&&I(e,"value",u,f.value,!1),"checked"in g&&void 0!==(u=g.checked)&&u!==e.checked&&I(e,"checked",u,f.checked,!1))}return e}function j(e,t,n){try{"function"==typeof e?e(t):e.current=t}catch(e){o.__e(e,n)}}function U(e,t,n){var r,i,a;if(o.unmount&&o.unmount(e),(r=e.ref)&&(r.current&&r.current!==e.__e||j(r,null,t)),n||"function"==typeof e.type||(n=null!=(i=e.__e)),e.__e=e.__d=void 0,null!=(r=e.__c)){if(r.componentWillUnmount)try{r.componentWillUnmount()}catch(e){o.__e(e,t)}r.base=r.__P=null}if(r=e.__k)for(a=0;a<r.length;a++)r[a]&&U(r[a],t,n);null!=i&&m(i)}function F(e,t,n){return this.constructor(e,n)}function B(e,t,n){var r,i,a;o.__&&o.__(e,t),i=(r=n===l)?null:n&&n.__k||t.__k,e=b(S,null,[e]),a=[],L(t,(r?t:n||t).__k=e,i||h,h,void 0!==t.ownerSVGElement,n&&!r?[n]:i?null:t.childNodes.length?y.slice.call(t.childNodes):null,a,n||h,r),x(a,e)}function H(e,t){B(e,t,l)}function q(e,t,n){var r,i,o,a=arguments,s=v({},e.props);for(o in t)"key"==o?r=t[o]:"ref"==o?i=t[o]:s[o]=t[o];if(arguments.length>3)for(n=[n],o=3;o<arguments.length;o++)n.push(a[o]);return null!=n&&(s.children=n),O(e.type,s,r||e.key,i||e.ref,null)}function W(e,t){var n={__c:t="__cC"+d++,__:e,Consumer:function(e,t){return e.children(t)},Provider:function(e,n,r){return this.getChildContext||(n=[],(r={})[t]=this,this.getChildContext=function(){return r},this.shouldComponentUpdate=function(e){this.props.value!==e.value&&n.some(T)},this.sub=function(e){n.push(e);var t=e.componentWillUnmount;e.componentWillUnmount=function(){n.splice(n.indexOf(e),1),t&&t.call(e)}}),e.children}};return n.Provider.__=n.Consumer.contextType=n}o={__e:function(e,t){for(var n,r;t=t.__;)if((n=t.__c)&&!n.__)try{if(n.constructor&&null!=n.constructor.getDerivedStateFromError&&(r=!0,n.setState(n.constructor.getDerivedStateFromError(e))),null!=n.componentDidCatch&&(r=!0,n.componentDidCatch(e)),r)return T(n.__E=n)}catch(t){e=t}throw e}},a=function(e){return null!=e&&void 0===e.constructor},E.prototype.setState=function(e,t){var n;n=null!=this.__s&&this.__s!==this.state?this.__s:this.__s=v({},this.state),"function"==typeof e&&(e=e(v({},n),this.props)),e&&v(n,e),null!=e&&this.__v&&(t&&this.__h.push(t),T(this))},E.prototype.forceUpdate=function(e){this.__v&&(this.__e=!0,e&&this.__h.push(e),T(this))},E.prototype.render=S,s=[],u="function"==typeof Promise?Promise.prototype.then.bind(Promise.resolve()):setTimeout,A.__r=0,l=h,d=0;var z,G,$,K=0,Y=[],Z=o.__r,X=o.diffed,J=o.__c,Q=o.unmount;function ee(e,t){o.__h&&o.__h(G,e,K||t),K=0;var n=G.__H||(G.__H={__:[],__h:[]});return e>=n.__.length&&n.__.push({}),n.__[e]}function te(e){return K=1,ne(ve,e)}function ne(e,t,n){var r=ee(z++,2);return r.t=e,r.__c||(r.__c=G,r.__=[n?n(t):ve(void 0,t),function(e){var t=r.t(r.__[0],e);r.__[0]!==t&&(r.__=[t,r.__[1]],r.__c.setState({}))}]),r.__}function re(e,t){var n=ee(z++,3);!o.__s&&ge(n.__H,t)&&(n.__=e,n.__H=t,G.__H.__h.push(n))}function ie(e,t){var n=ee(z++,4);!o.__s&&ge(n.__H,t)&&(n.__=e,n.__H=t,G.__h.push(n))}function oe(e){return K=5,se(function(){return{current:e}},[])}function ae(e,t,n){K=6,ie(function(){"function"==typeof e?e(t()):e&&(e.current=t())},null==n?n:n.concat(e))}function se(e,t){var n=ee(z++,7);return ge(n.__H,t)?(n.__H=t,n.__h=e,n.__=e()):n.__}function ue(e,t){return K=8,se(function(){return e},t)}function ce(e){var t=G.context[e.__c],n=ee(z++,9);return n.__c=e,t?(null==n.__&&(n.__=!0,t.sub(G)),t.props.value):e.__}function le(e,t){o.useDebugValue&&o.useDebugValue(t?t(e):e)}function de(e){var t=ee(z++,10),n=te();return t.__=e,G.componentDidCatch||(G.componentDidCatch=function(e){t.__&&t.__(e),n[1](e)}),[n[0],function(){n[1](void 0)}]}function pe(){Y.some(function(e){if(e.__P)try{e.__H.__h.forEach(he),e.__H.__h.forEach(ye),e.__H.__h=[]}catch(t){return e.__H.__h=[],o.__e(t,e.__v),!0}}),Y=[]}o.__r=function(e){Z&&Z(e),z=0;var t=(G=e.__c).__H;t&&(t.__h.forEach(he),t.__h.forEach(ye),t.__h=[])},o.diffed=function(e){X&&X(e);var t=e.__c;t&&t.__H&&t.__H.__h.length&&(1!==Y.push(t)&&$===o.requestAnimationFrame||(($=o.requestAnimationFrame)||function(e){var t,n=function(){clearTimeout(r),fe&&cancelAnimationFrame(t),setTimeout(e)},r=setTimeout(n,100);fe&&(t=requestAnimationFrame(n))})(pe))},o.__c=function(e,t){t.some(function(e){try{e.__h.forEach(he),e.__h=e.__h.filter(function(e){return!e.__||ye(e)})}catch(n){t.some(function(e){e.__h&&(e.__h=[])}),t=[],o.__e(n,e.__v)}}),J&&J(e,t)},o.unmount=function(e){Q&&Q(e);var t=e.__c;if(t&&t.__H)try{t.__H.__.forEach(he)}catch(e){o.__e(e,t.__v)}};var fe="function"==typeof requestAnimationFrame;function he(e){"function"==typeof e.u&&e.u()}function ye(e){e.u=e.__()}function ge(e,t){return!e||t.some(function(t,n){return t!==e[n]})}function ve(e,t){return"function"==typeof t?t(e):t}function me(e,t){for(var n in t)e[n]=t[n];return e}function be(e,t){for(var n in e)if("__source"!==n&&!(n in t))return!0;for(var r in t)if("__source"!==r&&e[r]!==t[r])return!0;return!1}function Oe(e){this.props=e}(Oe.prototype=new E).isPureReactComponent=!0,Oe.prototype.shouldComponentUpdate=function(e,t){return be(this.props,e)||be(this.state,t)};var _e=o.__b;o.__b=function(e){e.type&&e.type.__f&&e.ref&&(e.props.ref=e.ref,e.ref=null),_e&&_e(e)};var Se="undefined"!=typeof Symbol&&Symbol.for&&Symbol.for("react.forward_ref")||3911;var Ee=function(e,t){return e?R(R(e).map(t)):null},we={map:Ee,forEach:Ee,count:function(e){return e?R(e).length:0},only:function(e){var t=R(e);if(1!==t.length)throw"Children.only";return t[0]},toArray:R},Pe=o.__e;function Te(e){return e&&((e=me({},e)).__c=null,e.__k=e.__k&&e.__k.map(Te)),e}function Ae(e){return e&&(e.__v=null,e.__k=e.__k&&e.__k.map(Ae)),e}function Ce(){this.__u=0,this.t=null,this.__b=null}function Re(e){var t=e.__.__c;return t&&t.o&&t.o(e)}function De(){this.u=null,this.i=null}o.__e=function(e,t,n){if(e.then)for(var r,i=t;i=i.__;)if((r=i.__c)&&r.__c)return null==t.__e&&(t.__e=n.__e,t.__k=n.__k),r.__c(e,t.__c);Pe(e,t,n)},(Ce.prototype=new E).__c=function(e,t){var n=this;null==n.t&&(n.t=[]),n.t.push(t);var r=Re(n.__v),i=!1,o=function(){i||(i=!0,t.componentWillUnmount=t.__c,r?r(a):a())};t.__c=t.componentWillUnmount,t.componentWillUnmount=function(){o(),t.__c&&t.__c()};var a=function(){var e;if(!--n.__u)for(n.__v.__k[0]=Ae(n.state.o),n.setState({o:n.__b=null});e=n.t.pop();)e.forceUpdate()};n.__u++||n.setState({o:n.__b=n.__v.__k[0]}),e.then(o,o)},Ce.prototype.componentWillUnmount=function(){this.t=[]},Ce.prototype.render=function(e,t){return this.__b&&(this.__v.__k&&(this.__v.__k[0]=Te(this.__b)),this.__b=null),[b(S,null,t.o?null:e.children),t.o&&e.fallback]};var Me=function(e,t,n){if(++n[1]===n[0]&&e.i.delete(t),e.props.revealOrder&&("t"!==e.props.revealOrder[0]||!e.i.size))for(n=e.u;n;){for(;n.length>3;)n.pop()();if(n[1]<n[0])break;e.u=n=n[2]}};function Ie(e){return this.getChildContext=function(){return e.context},e.children}function ke(e){var t=this,n=e.l,r=b(Ie,{context:t.context},e.__v);t.componentWillUnmount=function(){var e=t.s.parentNode;e&&e.removeChild(t.s),U(t.v)},t.l&&t.l!==n&&(t.componentWillUnmount(),t.h=!1),e.__v?t.h?(n.__k=t.__k,B(r,n),t.__k=n.__k):(t.s=document.createTextNode(""),t.__k=n.__k,H("",n),n.appendChild(t.s),t.h=!0,t.l=n,B(r,n,t.s),n.__k=t.__k,t.__k=t.s.__k):t.h&&t.componentWillUnmount(),t.v=r}(De.prototype=new E).o=function(e){var t=this,n=Re(t.__v),r=t.i.get(e);return r[0]++,function(i){var o=function(){t.props.revealOrder?(r.push(i),Me(t,e,r)):i()};n?n(o):o()}},De.prototype.render=function(e){this.u=null,this.i=new Map;var t=R(e.children);e.revealOrder&&"b"===e.revealOrder[0]&&t.reverse();for(var n=t.length;n--;)this.i.set(t[n],this.u=[1,0,this.u]);return e.children},De.prototype.componentDidUpdate=De.prototype.componentDidMount=function(){var e=this;this.i.forEach(function(t,n){Me(e,n,t)})};var Ne=/^(?:accent|alignment|arabic|baseline|cap|clip(?!PathU)|color|fill|flood|font|glyph(?!R)|horiz|marker(?!H|W|U)|overline|paint|stop|strikethrough|stroke|text(?!L)|underline|unicode|units|v|vector|vert|word|writing|x(?!C))[A-Z]/;E.prototype.isReactComponent={};var Le="undefined"!=typeof Symbol&&Symbol.for&&Symbol.for("react.element")||60103;var xe=o.event;function Ve(e,t){e["UNSAFE_"+t]&&!e[t]&&Object.defineProperty(e,t,{get:function(){return this["UNSAFE_"+t]},set:function(e){this["UNSAFE_"+t]=e}})}o.event=function(e){xe&&(e=xe(e)),e.persist=function(){};var t=!1,n=!1,r=e.stopPropagation;e.stopPropagation=function(){r.call(e),t=!0};var i=e.preventDefault;return e.preventDefault=function(){i.call(e),n=!0},e.isPropagationStopped=function(){return t},e.isDefaultPrevented=function(){return n},e.nativeEvent=e};var je,Ue={configurable:!0,get:function(){return this.class}},Fe=o.vnode;o.vnode=function(e){e.$$typeof=Le;var t=e.type,n=e.props;if(t){var r;if(n.class!=n.className&&(Ue.enumerable="className"in n,null!=n.className&&(n.class=n.className),Object.defineProperty(n,"className",Ue)),"function"!=typeof t)for(r in n.defaultValue&&void 0!==n.value&&(n.value||0===n.value||(n.value=n.defaultValue),n.defaultValue=void 0),"select"===t&&n.multiple&&Array.isArray(n.value)&&(R(n.children).forEach(function(e){-1!=n.value.indexOf(e.props.value)&&(e.props.selected=!0)}),n.value=void 0),!0===n.download&&(n.download=""),n){var i=Ne.test(r);i&&(e.props[r.replace(/[A-Z0-9]/,"-$&").toLowerCase()]=n[r]),(i||null===n[r])&&(n[r]=void 0)}else t.prototype&&!t.prototype.p&&(t.prototype.p=!0,Ve(t.prototype,"componentWillMount"),Ve(t.prototype,"componentWillReceiveProps"),Ve(t.prototype,"componentWillUpdate"));!function(t){var n=e.type,r=e.props;if(r&&"string"==typeof n){var i={};for(var o in r)/^on(Ani|Tra|Tou)/.test(o)&&(r[o.toLowerCase()]=r[o],delete r[o]),i[o.toLowerCase()]=o;if(i.ondoubleclick&&(r.ondblclick=r[i.ondoubleclick],delete r[i.ondoubleclick]),i.onbeforeinput&&(r.onbeforeinput=r[i.onbeforeinput],delete r[i.onbeforeinput]),i.onchange&&("textarea"===n||"input"===n.toLowerCase()&&!/^fil|che|ra/i.test(r.type))){var a=i.oninput||"oninput";r[a]||(r[a]=r[i.onchange],delete r[i.onchange])}}}()}Fe&&Fe(e)};var Be=o.__r;o.__r=function(e){Be&&Be(e),je=e.__c};function He(e){return!!e&&e.$$typeof===Le}var qe=function(e,t){return e(t)},We={useState:te,useReducer:ne,useEffect:re,useLayoutEffect:ie,useRef:oe,useImperativeHandle:ae,useMemo:se,useCallback:ue,useContext:ce,useDebugValue:le,version:"16.8.0",Children:we,render:function(e,t,n){if(null==t.__k)for(;t.firstChild;)t.removeChild(t.firstChild);return B(e,t),"function"==typeof n&&n(),e?e.__c:null},hydrate:function(e,t,n){return H(e,t),"function"==typeof n&&n(),e?e.__c:null},unmountComponentAtNode:function(e){return!!e.__k&&(B(null,e),!0)},createPortal:function(e,t){return b(ke,{__v:e,l:t})},createElement:b,createContext:W,createFactory:function(e){return b.bind(null,e)},cloneElement:function(e){return He(e)?q.apply(null,arguments):e},createRef:_,Fragment:S,isValidElement:He,findDOMNode:function(e){return e&&(e.base||1===e.nodeType&&e)||null},Component:E,PureComponent:Oe,memo:function(e,t){function n(e){var n=this.props.ref,r=n==e.ref;return!r&&n&&(n.call?n(null):n.current=null),t?!t(this.props,e)||!r:be(this.props,e)}function r(t){return this.shouldComponentUpdate=n,b(e,t)}return r.displayName="Memo("+(e.displayName||e.name)+")",r.prototype.isReactComponent=!0,r.__f=!0,r},forwardRef:function(e){function t(t,n){var r=me({},t);return delete r.ref,e(r,(n=t.ref||n)&&("object"!=typeof n||"current"in n)?n:null)}return t.$$typeof=Se,t.render=t,t.prototype.isReactComponent=t.__f=!0,t.displayName="ForwardRef("+(e.displayName||e.name)+")",t},unstable_batchedUpdates:qe,StrictMode:S,Suspense:Ce,SuspenseList:De,lazy:function(e){var t,n,r;function i(i){if(t||(t=e()).then(function(e){n=e.default||e},function(e){r=e}),r)throw r;if(!n)throw t;return b(n,i)}return i.displayName="Lazy",i.__f=!0,i},__SECRET_INTERNALS_DO_NOT_USE_OR_YOU_WILL_BE_FIRED:{ReactCurrentDispatcher:{current:{readContext:function(e){return je.__n[e.__c].props.value}}}}},ze=(n(33),We.createContext(null));var Ge=function(e){e()},$e=function(){return Ge},Ke={notify:function(){}};var Ye=function(){function e(e,t){this.store=e,this.parentSub=t,this.unsubscribe=null,this.listeners=Ke,this.handleChangeWrapper=this.handleChangeWrapper.bind(this)}var t=e.prototype;return t.addNestedSub=function(e){return this.trySubscribe(),this.listeners.subscribe(e)},t.notifyNestedSubs=function(){this.listeners.notify()},t.handleChangeWrapper=function(){this.onStateChange&&this.onStateChange()},t.isSubscribed=function(){return Boolean(this.unsubscribe)},t.trySubscribe=function(){this.unsubscribe||(this.unsubscribe=this.parentSub?this.parentSub.addNestedSub(this.handleChangeWrapper):this.store.subscribe(this.handleChangeWrapper),this.listeners=function(){var e=$e(),t=null,n=null;return{clear:function(){t=null,n=null},notify:function(){e(function(){for(var e=t;e;)e.callback(),e=e.next})},get:function(){for(var e=[],n=t;n;)e.push(n),n=n.next;return e},subscribe:function(e){var r=!0,i=n={callback:e,next:null,prev:n};return i.prev?i.prev.next=i:t=i,function(){r&&null!==t&&(r=!1,i.next?i.next.prev=i.prev:n=i.prev,i.prev?i.prev.next=i.next:t=i.next)}}}}())},t.tryUnsubscribe=function(){this.unsubscribe&&(this.unsubscribe(),this.unsubscribe=null,this.listeners.clear(),this.listeners=Ke)},e}();var Ze=function(e){var t=e.store,n=e.context,r=e.children,i=se(function(){var e=new Ye(t);return e.onStateChange=e.notifyNestedSubs,{store:t,subscription:e}},[t]),o=se(function(){return t.getState()},[t]);re(function(){var e=i.subscription;return e.trySubscribe(),o!==t.getState()&&e.notifyNestedSubs(),function(){e.tryUnsubscribe(),e.onStateChange=null}},[i,o]);var a=n||ze;return We.createElement(a.Provider,{value:i},r)};function Xe(){return(Xe=Object.assign||function(e){for(var t=1;t<arguments.length;t++){var n=arguments[t];for(var r in n)Object.prototype.hasOwnProperty.call(n,r)&&(e[r]=n[r])}return e}).apply(this,arguments)}function Je(e,t){if(null==e)return{};var n,r,i={},o=Object.keys(e);for(r=0;r<o.length;r++)n=o[r],t.indexOf(n)>=0||(i[n]=e[n]);return i}var Qe=n(15),et=n.n(Qe),tt=n(14),nt="undefined"!==typeof window&&"undefined"!==typeof window.document&&"undefined"!==typeof window.document.createElement?ie:re,rt=[],it=[null,null];function ot(e,t){var n=e[1];return[t.payload,n+1]}function at(e,t,n){nt(function(){return e.apply(void 0,t)},n)}function st(e,t,n,r,i,o,a){e.current=r,t.current=i,n.current=!1,o.current&&(o.current=null,a())}function ut(e,t,n,r,i,o,a,s,u,c){if(e){var l=!1,d=null,p=function(){if(!l){var e,n,p=t.getState();try{e=r(p,i.current)}catch(f){n=f,d=f}n||(d=null),e===o.current?a.current||u():(o.current=e,s.current=e,a.current=!0,c({type:"STORE_UPDATED",payload:{error:n}}))}};n.onStateChange=p,n.trySubscribe(),p();return function(){if(l=!0,n.tryUnsubscribe(),n.onStateChange=null,d)throw d}}}var ct=function(){return[null,0]};function lt(e,t){void 0===t&&(t={});var n=t,r=n.getDisplayName,i=void 0===r?function(e){return"ConnectAdvanced("+e+")"}:r,o=n.methodName,a=void 0===o?"connectAdvanced":o,s=n.renderCountProp,u=void 0===s?void 0:s,c=n.shouldHandleStateChanges,l=void 0===c||c,d=n.storeKey,p=void 0===d?"store":d,f=(n.withRef,n.forwardRef),h=void 0!==f&&f,y=n.context,g=void 0===y?ze:y,v=Je(n,["getDisplayName","methodName","renderCountProp","shouldHandleStateChanges","storeKey","withRef","forwardRef","context"]),m=g;return function(t){var n=t.displayName||t.name||"Component",r=i(n),o=Xe({},v,{getDisplayName:i,methodName:a,renderCountProp:u,shouldHandleStateChanges:l,storeKey:p,displayName:r,wrappedComponentName:n,WrappedComponent:t}),s=v.pure;var c=s?se:function(e){return e()};function d(n){var r=se(function(){var e=n.reactReduxForwardedRef,t=Je(n,["reactReduxForwardedRef"]);return[n.context,e,t]},[n]),i=r[0],a=r[1],s=r[2],u=se(function(){return i&&i.Consumer&&Object(tt.isContextConsumer)(We.createElement(i.Consumer,null))?i:m},[i,m]),d=ce(u),p=Boolean(n.store)&&Boolean(n.store.getState)&&Boolean(n.store.dispatch);Boolean(d)&&Boolean(d.store);var f=p?n.store:d.store,h=se(function(){return function(t){return e(t.dispatch,o)}(f)},[f]),y=se(function(){if(!l)return it;var e=new Ye(f,p?null:d.subscription),t=e.notifyNestedSubs.bind(e);return[e,t]},[f,p,d]),g=y[0],v=y[1],b=se(function(){return p?d:Xe({},d,{subscription:g})},[p,d,g]),O=ne(ot,rt,ct),_=O[0][0],S=O[1];if(_&&_.error)throw _.error;var E=oe(),w=oe(s),P=oe(),T=oe(!1),A=c(function(){return P.current&&s===w.current?P.current:h(f.getState(),s)},[f,_,s]);at(st,[w,E,T,s,A,P,v]),at(ut,[l,f,g,h,w,E,T,P,v,S],[f,g,h]);var C=se(function(){return We.createElement(t,Xe({},A,{ref:a}))},[a,t,A]);return se(function(){return l?We.createElement(u.Provider,{value:b},C):C},[u,C,b])}var f=s?We.memo(d):d;if(f.WrappedComponent=t,f.displayName=r,h){var y=We.forwardRef(function(e,t){return We.createElement(f,Xe({},e,{reactReduxForwardedRef:t}))});return y.displayName=r,y.WrappedComponent=t,et()(y,t)}return et()(f,t)}}function dt(e,t){return e===t?0!==e||0!==t||1/e===1/t:e!==e&&t!==t}function pt(e,t){if(dt(e,t))return!0;if("object"!==typeof e||null===e||"object"!==typeof t||null===t)return!1;var n=Object.keys(e),r=Object.keys(t);if(n.length!==r.length)return!1;for(var i=0;i<n.length;i++)if(!Object.prototype.hasOwnProperty.call(t,n[i])||!dt(e[n[i]],t[n[i]]))return!1;return!0}var ft=n(16),ht=function(){return Math.random().toString(36).substring(7).split("").join(".")},yt={INIT:"@@redux/INIT"+ht(),REPLACE:"@@redux/REPLACE"+ht(),PROBE_UNKNOWN_ACTION:function(){return"@@redux/PROBE_UNKNOWN_ACTION"+ht()}};function gt(e){if("object"!==typeof e||null===e)return!1;for(var t=e;null!==Object.getPrototypeOf(t);)t=Object.getPrototypeOf(t);return Object.getPrototypeOf(e)===t}function vt(e,t,n){var r;if("function"===typeof t&&"function"===typeof n||"function"===typeof n&&"function"===typeof arguments[3])throw new Error("It looks like you are passing several store enhancers to createStore(). This is not supported. Instead, compose them together to a single function.");if("function"===typeof t&&"undefined"===typeof n&&(n=t,t=void 0),"undefined"!==typeof n){if("function"!==typeof n)throw new Error("Expected the enhancer to be a function.");return n(vt)(e,t)}if("function"!==typeof e)throw new Error("Expected the reducer to be a function.");var i=e,o=t,a=[],s=a,u=!1;function c(){s===a&&(s=a.slice())}function l(){if(u)throw new Error("You may not call store.getState() while the reducer is executing. The reducer has already received the state as an argument. Pass it down from the top reducer instead of reading it from the store.");return o}function d(e){if("function"!==typeof e)throw new Error("Expected the listener to be a function.");if(u)throw new Error("You may not call store.subscribe() while the reducer is executing. If you would like to be notified after the store has been updated, subscribe from a component and invoke store.getState() in the callback to access the latest state. See https://redux.js.org/api-reference/store#subscribelistener for more details.");var t=!0;return c(),s.push(e),function(){if(t){if(u)throw new Error("You may not unsubscribe from a store listener while the reducer is executing. See https://redux.js.org/api-reference/store#subscribelistener for more details.");t=!1,c();var n=s.indexOf(e);s.splice(n,1),a=null}}}function p(e){if(!gt(e))throw new Error("Actions must be plain objects. Use custom middleware for async actions.");if("undefined"===typeof e.type)throw new Error('Actions may not have an undefined "type" property. Have you misspelled a constant?');if(u)throw new Error("Reducers may not dispatch actions.");try{u=!0,o=i(o,e)}finally{u=!1}for(var t=a=s,n=0;n<t.length;n++){(0,t[n])()}return e}return p({type:yt.INIT}),(r={dispatch:p,subscribe:d,getState:l,replaceReducer:function(e){if("function"!==typeof e)throw new Error("Expected the nextReducer to be a function.");i=e,p({type:yt.REPLACE})}})[ft.a]=function(){var e,t=d;return(e={subscribe:function(e){if("object"!==typeof e||null===e)throw new TypeError("Expected the observer to be an object.");function n(){e.next&&e.next(l())}return n(),{unsubscribe:t(n)}}})[ft.a]=function(){return this},e},r}function mt(e,t){var n=t&&t.type;return"Given "+(n&&'action "'+String(n)+'"'||"an action")+', reducer "'+e+'" returned undefined. To ignore an action, you must explicitly return the previous state. If you want this reducer to hold no value, you can return null instead of undefined.'}function bt(e,t){return function(){return t(e.apply(this,arguments))}}function Ot(e,t){if("function"===typeof e)return bt(e,t);if("object"!==typeof e||null===e)throw new Error("bindActionCreators expected an object or a function, instead received "+(null===e?"null":typeof e)+'. Did you write "import ActionCreators from" instead of "import * as ActionCreators from"?');var n={};for(var r in e){var i=e[r];"function"===typeof i&&(n[r]=bt(i,t))}return n}function _t(e,t,n){return t in e?Object.defineProperty(e,t,{value:n,enumerable:!0,configurable:!0,writable:!0}):e[t]=n,e}function St(e,t){var n=Object.keys(e);return Object.getOwnPropertySymbols&&n.push.apply(n,Object.getOwnPropertySymbols(e)),t&&(n=n.filter(function(t){return Object.getOwnPropertyDescriptor(e,t).enumerable})),n}function Et(){for(var e=arguments.length,t=new Array(e),n=0;n<e;n++)t[n]=arguments[n];return 0===t.length?function(e){return e}:1===t.length?t[0]:t.reduce(function(e,t){return function(){return e(t.apply(void 0,arguments))}})}function wt(){for(var e=arguments.length,t=new Array(e),n=0;n<e;n++)t[n]=arguments[n];return function(e){return function(){var n=e.apply(void 0,arguments),r=function(){throw new Error("Dispatching while constructing your middleware is not allowed. Other middleware would not be applied to this dispatch.")},i={getState:n.getState,dispatch:function(){return r.apply(void 0,arguments)}},o=t.map(function(e){return e(i)});return function(e){for(var t=1;t<arguments.length;t++){var n=null!=arguments[t]?arguments[t]:{};t%2?St(n,!0).forEach(function(t){_t(e,t,n[t])}):Object.getOwnPropertyDescriptors?Object.defineProperties(e,Object.getOwnPropertyDescriptors(n)):St(n).forEach(function(t){Object.defineProperty(e,t,Object.getOwnPropertyDescriptor(n,t))})}return e}({},n,{dispatch:r=Et.apply(void 0,o)(n.dispatch)})}}}function Pt(e){return function(t,n){var r=e(t,n);function i(){return r}return i.dependsOnOwnProps=!1,i}}function Tt(e){return null!==e.dependsOnOwnProps&&void 0!==e.dependsOnOwnProps?Boolean(e.dependsOnOwnProps):1!==e.length}function At(e,t){return function(t,n){n.displayName;var r=function(e,t){return r.dependsOnOwnProps?r.mapToProps(e,t):r.mapToProps(e)};return r.dependsOnOwnProps=!0,r.mapToProps=function(t,n){r.mapToProps=e,r.dependsOnOwnProps=Tt(e);var i=r(t,n);return"function"===typeof i&&(r.mapToProps=i,r.dependsOnOwnProps=Tt(i),i=r(t,n)),i},r}}var Ct=[function(e){return"function"===typeof e?At(e):void 0},function(e){return e?void 0:Pt(function(e){return{dispatch:e}})},function(e){return e&&"object"===typeof e?Pt(function(t){return Ot(e,t)}):void 0}];var Rt=[function(e){return"function"===typeof e?At(e):void 0},function(e){return e?void 0:Pt(function(){return{}})}];function Dt(e,t,n){return Xe({},n,{},e,{},t)}var Mt=[function(e){return"function"===typeof e?function(e){return function(t,n){n.displayName;var r,i=n.pure,o=n.areMergedPropsEqual,a=!1;return function(t,n,s){var u=e(t,n,s);return a?i&&o(u,r)||(r=u):(a=!0,r=u),r}}}(e):void 0},function(e){return e?void 0:function(){return Dt}}];function It(e,t,n,r){return function(i,o){return n(e(i,o),t(r,o),o)}}function kt(e,t,n,r,i){var o,a,s,u,c,l=i.areStatesEqual,d=i.areOwnPropsEqual,p=i.areStatePropsEqual,f=!1;function h(i,f){var h=!d(f,a),y=!l(i,o);return o=i,a=f,h&&y?(s=e(o,a),t.dependsOnOwnProps&&(u=t(r,a)),c=n(s,u,a)):h?(e.dependsOnOwnProps&&(s=e(o,a)),t.dependsOnOwnProps&&(u=t(r,a)),c=n(s,u,a)):y?function(){var t=e(o,a),r=!p(t,s);return s=t,r&&(c=n(s,u,a)),c}():c}return function(i,l){return f?h(i,l):(s=e(o=i,a=l),u=t(r,a),c=n(s,u,a),f=!0,c)}}function Nt(e,t){var n=t.initMapStateToProps,r=t.initMapDispatchToProps,i=t.initMergeProps,o=Je(t,["initMapStateToProps","initMapDispatchToProps","initMergeProps"]),a=n(e,o),s=r(e,o),u=i(e,o);return(o.pure?kt:It)(a,s,u,e,o)}function Lt(e,t,n){for(var r=t.length-1;r>=0;r--){var i=t[r](e);if(i)return i}return function(t,r){throw new Error("Invalid value of type "+typeof e+" for "+n+" argument when connecting component "+r.wrappedComponentName+".")}}function xt(e,t){return e===t}function Vt(e){var t=void 0===e?{}:e,n=t.connectHOC,r=void 0===n?lt:n,i=t.mapStateToPropsFactories,o=void 0===i?Rt:i,a=t.mapDispatchToPropsFactories,s=void 0===a?Ct:a,u=t.mergePropsFactories,c=void 0===u?Mt:u,l=t.selectorFactory,d=void 0===l?Nt:l;return function(e,t,n,i){void 0===i&&(i={});var a=i,u=a.pure,l=void 0===u||u,p=a.areStatesEqual,f=void 0===p?xt:p,h=a.areOwnPropsEqual,y=void 0===h?pt:h,g=a.areStatePropsEqual,v=void 0===g?pt:g,m=a.areMergedPropsEqual,b=void 0===m?pt:m,O=Je(a,["pure","areStatesEqual","areOwnPropsEqual","areStatePropsEqual","areMergedPropsEqual"]),_=Lt(e,o,"mapStateToProps"),S=Lt(t,s,"mapDispatchToProps"),E=Lt(n,c,"mergeProps");return r(d,Xe({methodName:"connect",getDisplayName:function(e){return"Connect("+e+")"},shouldHandleStateChanges:Boolean(e),initMapStateToProps:_,initMapDispatchToProps:S,initMergeProps:E,pure:l,areStatesEqual:f,areOwnPropsEqual:y,areStatePropsEqual:v,areMergedPropsEqual:b},O))}}var jt=Vt();Ge=qe;var Ut={BORDER_RADIUS:{EXTRA_TINY:"1px",TINY:"2px",SMALL:"3px",MEDIUM:"4px"},COLORS:{BLACK:"#000000",WHITE:"#ffffff",TRANSPARENT:"transparent",GRADIENT_BLACK:"linear-gradient(to bottom, rgba(0, 0, 0, 0.63), rgba(0, 0, 0, 0.62) 19%, rgba(0, 0, 0, 0))",LIGHT_GRAY_TRANSPARENT:"rgba(255, 255, 255, 0.23)",GRAY_TRANSPARENT:"rgba(143, 143, 143, 0.46)",BLACK_TRANSPARENT:"rgba(0, 0, 0, 0.7)",BLACK_80_OPACITY:"rgba(0, 0, 0, 0.8)",BLUR_TRANSPARENT:"rgba(0, 0, 0, 0.48)",GRAY:"rgba(0, 0, 0, 0.35)",SELECTED:"rgba(255, 255, 255, 0.1)",SCROLL_BAR:"rgba(255, 255, 255, 0.64)",TRANSPARENT_30_OPACITY:"rgba(0, 0, 0, 0.31)"},TEXT_FONT_FAMILY:{LATO:"Lato"},FONT_SIZE:{EXTRA_TINY:"8px",TINY:"10px",EXTRA_SMALL:"12px",SMALL:"14px",MEDIUM:"18px"}},Ft="179px",Bt="269px",Ht="180px",qt="270px",Wt="300px",zt="301px",Gt="500px",$t="501px",Kt="800px",Yt="801px";function Zt(e,t){var n=Object.keys(e);if(Object.getOwnPropertySymbols){var r=Object.getOwnPropertySymbols(e);t&&(r=r.filter(function(t){return Object.getOwnPropertyDescriptor(e,t).enumerable})),n.push.apply(n,r)}return n}function Xt(e){for(var t=1;t<arguments.length;t++){var n=null!=arguments[t]?arguments[t]:{};t%2?Zt(Object(n),!0).forEach(function(t){f()(e,t,n[t])}):Object.getOwnPropertyDescriptors?Object.defineProperties(e,Object.getOwnPropertyDescriptors(n)):Zt(Object(n)).forEach(function(t){Object.defineProperty(e,t,Object.getOwnPropertyDescriptor(n,t))})}return e}var Jt=function e(t){return t&&t.length>0?t.reduce(function(t,n){return n?Array.isArray(n)?Xt(Xt({},t),e(n)):Xt(Xt({},t),n):t},{}):null},Qt=function(e){return function(t){t({type:"[CORE] change video tag status",payload:e})}},en=function(e){return function(t){t({type:"[CORE] update video current fragment position",payload:e})}},tn=function(e){return function(t){t({type:"[CORE] update video current position",payload:e})}},nn=function(e){return function(t){t({type:"[CORE] update video current buffered time",payload:e})}},rn=function(e){return function(t){t({type:"[CORE] update video current duration",payload:e})}},on=function(e,t){return function(n){n({type:"[COMMON] set pending video status",payload:{pendingStatusObject:{type:e,value:t}}})}},an=function(e){return function(t){t({type:"[COMMON] set mute video",payload:e})}},sn=function(e){return function(t){t({type:"[COMMON] set volume",payload:e})}},un=function(e){return function(t){t({type:"[CORE] change loading player status",payload:e})}},cn=function(e){return function(t){t({type:"[COMMON] show black screen with loader",payload:e})}},ln=function(e){return function(t){t({type:"[CORE] set player size",payload:e})}},dn=function(e){return function(t){t({type:"[COMMON] set error message",payload:e})}},pn={mediaData:function(e){return e.mediaData},playerData:function(e){return e.playerData},dependenciesLoadingStatus:function(e){return e.dependenciesLoadingStatus},brandingData:function(e){return e.brandingData},anchorOptions:function(e){return e.anchorOptions},semanticOptions:function(e){return e.semanticOptions},monetization:function(e){return e.monetization},userInteraction:function(e){return e.userInteraction},splitView:function(e){return e.splitView},discovery:function(e){return e.discovery}},fn=pn.playerData,hn={playerId:function(e){return fn(e).playerId},videoTagStatus:function(e){return fn(e).videoTagStatus},pendingVideoTagStatus:function(e){return fn(e).pendingVideoTagStatus},currentVideoTime:function(e){return fn(e).currentVideoTime},currentVideoTimeFragment:function(e){return fn(e).currentVideoTimeFragment},currentVideoDuration:function(e){return fn(e).currentVideoDuration},currentVideoBufferedTime:function(e){return fn(e).currentVideoBufferedTime},playerMode:function(e){return fn(e).playerMode},playerSettings:function(e){return fn(e).playerSettings},playbackMethod:function(e){return fn(e).playbackMethod},playerVisibility:function(e){return fn(e).playerVisibility},playerPlaceholderVisibility:function(e){return fn(e).playerPlaceholderVisibility},playerInstanceUniqId:function(e){return fn(e).playerInstanceUniqId},showBlackScreen:function(e){return fn(e).loader.showBlackScreen},playerSize:function(e){return fn(e).playerSize},errorMessage:function(e){return fn(e).errorMessage},loadingPlayer:function(e){return fn(e).loadingPlayer}},yn=hn.playerSettings,gn={volume:function(e){return yn(e).volume},muted:function(e){return yn(e).muted},quality:function(e){return yn(e).quality},speed:function(e){return yn(e).speed},selectedSettingsCategory:function(e){return yn(e).selectedSettingsCategory},fullscreen:function(e){return yn(e).fullscreen},pendingFullscreenRequest:function(e){return this.fullscreen(e).pendingFullscreenRequest},isFullscreenOn:function(e){return this.fullscreen(e).isFullscreenOn}},vn=function(e){return"".concat("mplayer-monetization-placeholder","-").concat(e)},mn=function(e){return"".concat("mplayer-player-placeholder","-").concat(e)},bn=function(e){return"".concat("mplayer-player-container","-").concat(e)},On=function(e){return"".concat("mplayer-controls-placeholder","-").concat(e)},_n=function(e){return"".concat("mplayer-split-view-placeholder","-").concat(e)},Sn=function(e){return"".concat("mplayer-discovery-placeholder","-").concat(e)},En=function(e){return"".concat("mplayer-content-video","-").concat(e)},wn=function(e){return"".concat("mplayer","-").concat("error-page-message","-").concat(e)},Pn=function(e){return"".concat("mplayer","-").concat("loader","-").concat(e)},Tn=function(e){return"".concat("mplayer","-").concat("mplayer-close-bar-placeholder","-").concat(e)},An=pn.mediaData,Cn={mediaId:function(e){return An(e).mediaId},mediaType:function(e){return An(e).mediaType},videoList:function(e){return An(e).videoList},videoData:function(e){return An(e).videoData},activeVideoIndex:function(e){return An(e).activeVideoIndex},mediaRequest:function(e){return An(e).mediaRequest},mediaLoadingError:function(e){return An(e).mediaLoadingError}},Rn=Cn.videoData,Dn={creator:function(e){return Rn(e).creator},description:function(e){return Rn(e).description},duration:function(e){return Rn(e).duration},externalId:function(e){return Rn(e).externalId},index:function(e){return Rn(e).index},mediaId:function(e){return Rn(e).mediaId},provider:function(e){return Rn(e).provider},sources:function(e){return Rn(e).sources},tags:function(e){return Rn(e).tags},thumbnail:function(e){return Rn(e).thumbnail},title:function(e){return Rn(e).title},showTitle:function(e){return Rn(e).showTitle}},Mn=n(11),In=n.n(Mn);function kn(e){var t=arguments.length>1&&void 0!==arguments[1]?arguments[1]:[];return se(function(){return e.apply(void 0,In()(t))},[e,t])}var Nn={root:{height:"100%",left:0,display:"block",width:"100%"}},Ln=function(){return{playerStyle:[Nn.root]}},xn=n(30),Vn=Object(xn.a)(),jn=function(e){return"undefined"===typeof e},Un=function(e){return jn(e)||null===e||0===e.length},Fn=function(){return null!==navigator.userAgent.match(/(iPad)|(iPhone)|(iPod)|(android)|(webOS)/i)},Bn=function(){return"iOS"===Vn.os},Hn=function(e){return Math.floor(10*e)/10},qn=function(){var e=arguments.length>0&&void 0!==arguments[0]?arguments[0]:"0";return parseInt(e,10)/1e3},Wn=function(e,t){return jn(e)||jn(t)?0:e>t?1:-1},zn=function(e,t){var n;return function(){for(var r=arguments.length,i=new Array(r),o=0;o<r;o++)i[o]=arguments[o];clearTimeout(n),n=setTimeout(function(){n=null,e(i)},t)}},Gn=function(e){var t=e.clientWidth*(9/16),n=e.clientHeight;return Math.abs(t-n)>2?t:n},$n=function(e){return function(e){return!e.dataLayer||Array.isArray(e.dataLayer)}(e)?"dataLayer":"mmVideoDataLayer"},Kn=function(e){var t=ue(e,arguments.length>1&&void 0!==arguments[1]?arguments[1]:[]);re(function(){t()},[t]),re(function(){var e=zn(t,150);return window.addEventListener("resize",e),function(){window.removeEventListener("resize",e)}},[t])},Yn=pn.splitView,Zn=function(e){return Yn(e).splitViewRatio},Xn={GENERAL_ERROR:"An error has occurred, please try again later",VIDEO_ERROR:"The video is currently unavailable"},Jn=jt(function(e,t){return{thumbnail:Dn.thumbnail(e),playerId:t.playerId,muted:gn.muted(e),volume:gn.volume(e),currentVideoTime:hn.currentVideoTime(e),playbackMethod:hn.playbackMethod(e),splitViewRatio:Zn(e),playerSize:hn.playerSize(e),isFullscreenOn:gn.isFullscreenOn(e),playerMode:hn.playerMode(e),speed:gn.speed(e)}},function(e){return Ot({updateVideoTagStatus:Qt,updateVideoTime:tn,updateVideoTimeFragment:en,changeLoadingPlayerStatus:un,showBlackScreenLoader:cn,updateVideoDuration:rn,updateMute:an,updateVolume:sn,updateCurrentVideoBufferedTime:nn,setPlayerSize:ln,onErrorMessage:dn},e)})(function(e){var t=e.thumbnail,n=e.playerId,r=e.updateVideoTagStatus,i=e.updateVideoTime,o=e.updateCurrentVideoBufferedTime,a=e.muted,s=e.volume,u=e.currentVideoTime,c=e.playbackMethod,l=e.changeLoadingPlayerStatus,d=e.showBlackScreenLoader,p=e.updateVideoDuration,f=e.updateMute,h=e.updateVolume,y=e.updateVideoTimeFragment,g=e.setPlayerSize,v=e.splitViewRatio,m=e.playerSize,O=e.isFullscreenOn,_=e.playerMode,S=e.onErrorMessage,E=e.speed,w=oe(null),P=!Un(v),T=kn(Ln,[]).playerStyle,A=document.getElementById(bn(n));re(function(){w.current.playbackRate=E},[E]),Kn(function(){if(!Un(A)){var e=function(e,t,n,r,i){var o=e.style.width;return n?"desktop"===r||"miniDesktop"===r||"stickyDesktop"===r?"extraLarge":"medium":"100%"===o?t:i&&o<=Bt?"extraSmall":i&&o>=qt&&o<=Wt?"small":o<=Ft?"extraSmall":o>=Ht&&o<=Wt?"small":o>=zt&&o<=Gt?"medium":o>=$t&&o<=Kt?"large":o>=Yt?"extraLarge":null}(A,m,O,_,P);Un(e)||g(e)}},[A,m,O,_,P,g]);var C="autoplay"===c?"":t;return b("video",{ref:w,style:Jt(T),key:En(n),id:En(n),onEnded:function(){r("complete")},onDurationChange:function(e){var t,n=e.target.duration;t=n,Number.isNaN(t)||"number"!==typeof t||p(n)},onTimeUpdate:function(e){var t=e.target.currentTime;y(t);var n=parseInt(t.toString(),10);n!==u&&i(n)},onVolumeChange:function(e){var t=e.target,n=t.volume,r=t.muted;n!==s&&h(n),a!==r&&f(r)},onPause:function(){r("paused")},onPlaying:function(){r("playing")},onError:function(){r("error"),S(Xn.VIDEO_ERROR)},onLoadStart:function(){l(!0),d(!0)},onCanPlayThrough:function(){l(!1),d(!1),S("")},onCanPlay:function(){l(!1),S("")},onWaiting:function(){l(!0)},onSeeking:function(){r("seeking")},onProgress:function(e){var t=e.target.buffered,n=t.length;n>0&&o(t.end(n-1))},volume:s,muted:a,poster:C,playsInline:!0,"webkit-playsinline":""},b("track",{kind:"captions"}))}),Qn=function(e){return function(t){t({type:"[CORE] update ima status",payload:e})}},er=function(e){return function(t){t({type:"[CORE] update hls status",payload:e})}},tr=function(){return{adBlockCheckerStyle:{backgroundColor:Ut.COLORS.TRANSPARENT,height:"1px",width:"1px"}}},nr=jt(null,function(e){return{onAdBlockDetected:function(){return Qn("blocked")(e)}}})(function(e){var t=oe(),n=kn(tr,[]).adBlockCheckerStyle;return re(function(){0!==t.current.clientHeight&&0!==t.current.clientWidth||(0,e.onAdBlockDetected)()},[e]),b("div",{ref:t},b("div",{class:"adBanner",style:n}))}),rr=n(10),ir=n.n(rr);n(20);var or={root:null,threshold:[0,.1,.2,.3,.4,.5,.6,.7,.8,.9,1],rootMargin:"0px"},ar=function(e){var t=e.id,n=e.updateContainerVisibility,r=e.shouldObserve,i=e.regularMode,o=e.stickyAnchorMode,a=e.children,s=e.style,u=e.isPlaceholder,c=e.splitViewRatio,l=e.className,d=oe(),p=te(null),f=ir()(p,2),h=f[0],y=f[1];return re(function(){null!==h&&h.observe(d.current)},[h]),re(function(){!function(e,t,n){e&&t(new IntersectionObserver(function(e){var t=e[0];n(t.intersectionRatio)},or))}(r,y,n)},[r,n]),Kn(function(){u?function(e,t){var n=e.parentElement.clientWidth;e.style.maxWidth="".concat(n,"px"),Un(t)?e.style.height="".concat(Gn(e),"px"):e.style.height="".concat(Gn(e)*(t/100),"px")}(d.current,c):function(e,t,n){t?(e.style.width="".concat(e.parentElement.clientWidth,"px"),e.style.height="".concat(e.parentElement.clientHeight,"px")):n&&(e.style.width="".concat(e.parentElement.clientWidth,"px"),e.style.height="".concat(e.parentElement.clientHeight+24,"px"))}(d.current,i,o)},[u,i,o]),b("div",{className:l,id:t,ref:d,style:s},a)};function sr(e,t){var n=Object.keys(e);if(Object.getOwnPropertySymbols){var r=Object.getOwnPropertySymbols(e);t&&(r=r.filter(function(t){return Object.getOwnPropertyDescriptor(e,t).enumerable})),n.push.apply(n,r)}return n}function ur(e){for(var t=1;t<arguments.length;t++){var n=null!=arguments[t]?arguments[t]:{};t%2?sr(Object(n),!0).forEach(function(t){f()(e,t,n[t])}):Object.getOwnPropertyDescriptors?Object.defineProperties(e,Object.getOwnPropertyDescriptors(n)):sr(Object(n)).forEach(function(t){Object.defineProperty(e,t,Object.getOwnPropertyDescriptor(n,t))})}return e}var cr={display:"flex",flexDirection:"row"},lr=(ur(ur({},cr),{},{justifyContent:"flex-end"}),ur(ur({},cr),{},{justifyContent:"center"})),dr=ur(ur({},cr),{},{justifyContent:"space-between"}),pr=(ur(ur({},dr),{},{alignItems:"baseline"}),ur(ur({},lr),{},{alignItems:"center"})),fr=ur(ur({},cr),{},{justifyContent:"flex-start"}),hr=(ur(ur({},fr),{},{alignItems:"center"}),ur(ur({},fr),{},{alignItems:"flex-end",flexWrap:"wrap"}),{display:"flex",flexDirection:"column"}),yr=(ur(ur({},hr),{},{justifyContent:"flex-start"}),ur(ur({},hr),{},{justifyContent:"center"})),gr=(ur(ur({},hr),{},{justifyContent:"flex-end",alignItems:"center"}),ur(ur({},yr),{},{alignItems:"center"}));function vr(e,t){var n=Object.keys(e);if(Object.getOwnPropertySymbols){var r=Object.getOwnPropertySymbols(e);t&&(r=r.filter(function(t){return Object.getOwnPropertyDescriptor(e,t).enumerable})),n.push.apply(n,r)}return n}function mr(e){for(var t=1;t<arguments.length;t++){var n=null!=arguments[t]?arguments[t]:{};t%2?vr(Object(n),!0).forEach(function(t){f()(e,t,n[t])}):Object.getOwnPropertyDescriptors?Object.defineProperties(e,Object.getOwnPropertyDescriptors(n)):vr(Object(n)).forEach(function(t){Object.defineProperty(e,t,Object.getOwnPropertyDescriptor(n,t))})}return e}var br=mr(mr({},hr),{},{position:"relative",background:Ut.COLORS.BLACK}),Or=pn.anchorOptions,_r=function(e){return Or(e).orientation},Sr=function(e){return Or(e).canClose},Er=function(e){return Or(e).anchorData},wr=function(e){return Er(e).anchorDisabledByUser},Pr=function(e){return Er(e).anchorStatus};function Tr(e,t){var n=Object.keys(e);if(Object.getOwnPropertySymbols){var r=Object.getOwnPropertySymbols(e);t&&(r=r.filter(function(t){return Object.getOwnPropertyDescriptor(e,t).enumerable})),n.push.apply(n,r)}return n}function Ar(e){for(var t=1;t<arguments.length;t++){var n=null!=arguments[t]?arguments[t]:{};t%2?Tr(Object(n),!0).forEach(function(t){f()(e,t,n[t])}):Object.getOwnPropertyDescriptors?Object.defineProperties(e,Object.getOwnPropertyDescriptors(n)):Tr(Object(n)).forEach(function(t){Object.defineProperty(e,t,Object.getOwnPropertyDescriptor(n,t))})}return e}var Cr=jt(function(e){return{shouldObserve:"lazyplay"===hn.playbackMethod(e)||"autoplay_when_viewable"===hn.playbackMethod(e),regularMode:"inactive"===Pr(e)||!Un(Zn(e)),stickyAnchorMode:"sticky"===_r(e)&&"active"===Pr(e)&&Sr(e),style:Ar({},mr({},br)),isPlaceholder:!1}},function(e){return{updateContainerVisibility:function(t){return function(e){return function(t){t({type:"[CORE] update player visibility",payload:e})}}(t)(e)}}})(ar);function Rr(e,t){var n=Object.keys(e);if(Object.getOwnPropertySymbols){var r=Object.getOwnPropertySymbols(e);t&&(r=r.filter(function(t){return Object.getOwnPropertyDescriptor(e,t).enumerable})),n.push.apply(n,r)}return n}function Dr(e){for(var t=1;t<arguments.length;t++){var n=null!=arguments[t]?arguments[t]:{};t%2?Rr(Object(n),!0).forEach(function(t){f()(e,t,n[t])}):Object.getOwnPropertyDescriptors?Object.defineProperties(e,Object.getOwnPropertyDescriptors(n)):Rr(Object(n)).forEach(function(t){Object.defineProperty(e,t,Object.getOwnPropertyDescriptor(n,t))})}return e}var Mr={width:"100%",clear:"both",margin:"16px 0"};function Ir(e,t){var n=Object.keys(e);if(Object.getOwnPropertySymbols){var r=Object.getOwnPropertySymbols(e);t&&(r=r.filter(function(t){return Object.getOwnPropertyDescriptor(e,t).enumerable})),n.push.apply(n,r)}return n}function kr(e){for(var t=1;t<arguments.length;t++){var n=null!=arguments[t]?arguments[t]:{};t%2?Ir(Object(n),!0).forEach(function(t){f()(e,t,n[t])}):Object.getOwnPropertyDescriptors?Object.defineProperties(e,Object.getOwnPropertyDescriptors(n)):Ir(Object(n)).forEach(function(t){Object.defineProperty(e,t,Object.getOwnPropertyDescriptor(n,t))})}return e}var Nr=jt(function(e){return{shouldObserve:"sticky"!==_r(e),style:kr({},Dr({},Mr)),splitViewRatio:Zn(e),isPlaceholder:!0,className:"monti-placeholder-mm-player"}},function(e){return{updateContainerVisibility:function(t){return function(e){return function(t){t({type:"[CORE] update placeholder visibility",payload:e})}}(t)(e)}}})(ar),Lr=function(){return{monetizationStyle:{position:"absolute",width:"100%",top:"0",display:"none"}}},xr=function(e){var t=e.playerId,n=kn(Lr,[]).monetizationStyle,r=oe();return Kn(function(){console.log("the monetization parent element : ",r.current.parentElement),r.current.style.height="".concat(Gn(r.current.parentElement),"px")}),b("div",{id:vn(t),style:n,ref:r})};function Vr(e,t){var n=Object.keys(e);if(Object.getOwnPropertySymbols){var r=Object.getOwnPropertySymbols(e);t&&(r=r.filter(function(t){return Object.getOwnPropertyDescriptor(e,t).enumerable})),n.push.apply(n,r)}return n}function jr(e){for(var t=1;t<arguments.length;t++){var n=null!=arguments[t]?arguments[t]:{};t%2?Vr(Object(n),!0).forEach(function(t){f()(e,t,n[t])}):Object.getOwnPropertyDescriptors?Object.defineProperties(e,Object.getOwnPropertyDescriptors(n)):Vr(Object(n)).forEach(function(t){Object.defineProperty(e,t,Object.getOwnPropertyDescriptor(n,t))})}return e}var Ur={position:"relative",color:Ut.COLORS.WHITE,fontFamily:Ut.TEXT_FONT_FAMILY.LATO,fontWeight:"bold",textAlign:"center",tiny:{fontSize:Ut.FONT_SIZE.EXTRA_TINY},big:{fontSize:Ut.FONT_SIZE.SMALL}},Fr={position:"relative",color:Ut.COLORS.WHITE,tiny:{height:"12px",width:"12px",marginBottom:"8px"},big:{height:"24px",width:"24px",marginBottom:"16px"}},Br=jr(jr({},gr),{},{width:"100%",height:"100%",position:"absolute",top:0,backdropFilter:"blur(3px)",webkitBackdropFilter:"blur(3px)",backgroundColor:Ut.COLORS.BLUR_TRANSPARENT}),Hr=function(e){var t="extraSmall"===e||"small"===e,n="medium"===e||"large"===e||"extraLarge"===e;return{errorMessageStyle:[Ur,t&&Ur.tiny,n&&Ur.big],iconStyle:[Fr,t&&Fr.tiny,n&&Fr.big],screenStyle:jr({},Br)}},qr=n(12),Wr=n.n(qr);function zr(){return(zr=Object.assign||function(e){for(var t=1;t<arguments.length;t++){var n=arguments[t];for(var r in n)Object.prototype.hasOwnProperty.call(n,r)&&(e[r]=n[r])}return e}).apply(this,arguments)}function Gr(){return(Gr=Object.assign||function(e){for(var t=1;t<arguments.length;t++){var n=arguments[t];for(var r in n)Object.prototype.hasOwnProperty.call(n,r)&&(e[r]=n[r])}return e}).apply(this,arguments)}function $r(){return($r=Object.assign||function(e){for(var t=1;t<arguments.length;t++){var n=arguments[t];for(var r in n)Object.prototype.hasOwnProperty.call(n,r)&&(e[r]=n[r])}return e}).apply(this,arguments)}var Kr={CLOSE_FILL:function(e){e.styles;var t=Wr()(e,["styles"]);return We.createElement("svg",Gr({xmlns:"http://www.w3.org/2000/svg",viewBox:"0 0 24 24",width:"24",height:"24"},t),We.createElement("path",{fill:"none",d:"M0 0h24v24H0z"}),We.createElement("path",{d:"M12 10.586l4.95-4.95 1.414 1.414-4.95 4.95 4.95 4.95-1.414 1.414-4.95-4.95-4.95 4.95-1.414-1.414 4.95-4.95-4.95-4.95L7.05 5.636z",fill:"rgba(255,255,255,1)"}))},ERROR_WARNING_FILL:function(e){e.styles;var t=Wr()(e,["styles"]);return We.createElement("svg",zr({xmlns:"http://www.w3.org/2000/svg",viewBox:"0 0 24 24",width:"24",height:"24"},t),We.createElement("path",{fill:"none",d:"M0 0h24v24H0z"}),We.createElement("path",{d:"M12 22C6.477 22 2 17.523 2 12S6.477 2 12 2s10 4.477 10 10-4.477 10-10 10zm-1-7v2h2v-2h-2zm0-8v6h2V7h-2z",fill:"rgba(255,255,255,1)"}))},PLAY_BLUR:function(e){e.styles;var t=Wr()(e,["styles"]);return We.createElement("svg",$r({xmlns:"http://www.w3.org/2000/svg",viewBox:"0 0 60 60"},t),We.createElement("circle",{cx:"30",cy:"30",r:"30",fillRule:"evenodd",clipRule:"evenodd",fillOpacity:".35"}),We.createElement("path",{fill:"none",d:"M11 11h38v38H11z"}),We.createElement("path",{d:"M43.3 30.7L22.1 44.8c-.3.2-.7.2-1 0-.3-.2-.5-.5-.5-.9V15.8c0-.4.2-.7.5-.9.3-.2.7-.2 1 0L43.3 29c.3.2.4.5.4.8s-.2.7-.4.9z",fill:"currentColor"}))}},Yr=n(31),Zr=n.n(Yr);function Xr(e,t){var n=Object.keys(e);if(Object.getOwnPropertySymbols){var r=Object.getOwnPropertySymbols(e);t&&(r=r.filter(function(t){return Object.getOwnPropertyDescriptor(e,t).enumerable})),n.push.apply(n,r)}return n}function Jr(e){for(var t=1;t<arguments.length;t++){var n=null!=arguments[t]?arguments[t]:{};t%2?Xr(Object(n),!0).forEach(function(t){f()(e,t,n[t])}):Object.getOwnPropertyDescriptors?Object.defineProperties(e,Object.getOwnPropertyDescriptors(n)):Xr(Object(n)).forEach(function(t){Object.defineProperty(e,t,Object.getOwnPropertyDescriptor(n,t))})}return e}var Qr=Ut.COLORS.WHITE,ei=function(e,t){var n=function(e){return{root:Jr(Jr({},cr),{},{alignItems:"center",width:"fit-content",height:"fit-content",outline:"none",color:e}),focused:{outline:"".concat(Ut.COLORS.WHITE," solid 1px")}}}(t||Qr);return{iconStyle:[n.root,e&&n.focused]}},ti=function(e){var t=e.icon,n=e.style,r=e.onClick,i=e.onMouseEnter,o=e.onMouseLeave,a=e.onKeyDown,s=e.id,u=e.color,c=e.clickable,l=void 0===c||c,d=e.focusable,p=void 0===d||d,f=te(!1),h=ir()(f,2),y=h[0],g=h[1],v=te(!1),m=ir()(v,2),O=m[0],_=m[1],S=kn(ei,[O,u]).iconStyle,E=l?{onClick:r,onMouseEnter:i,onMouseLeave:o,onFocus:function(e){y||_(!0),jn(i)||i(e)},onBlur:function(){document.hasFocus()&&g(!1),_(!1)},onKeyDown:function(e){jn(a)||a(e),"Enter"!==e.key||jn(r)||r()},onMouseDown:function(){g(!0),_(!1)}}:{},w=p?{tabIndex:0}:{};return b("span",Zr()({id:s,style:Jt([S,n])},E,w),b(t,null))},ni=jt(function(e){return{playerSize:hn.playerSize(e),playerErrorMessage:hn.errorMessage(e),mediaErrorMessage:Cn.mediaLoadingError(e),playerUniqId:hn.playerInstanceUniqId(e)}})(function(e){var t,n=e.playerSize,r=e.playerErrorMessage,i=e.mediaErrorMessage,o=e.playerUniqId,a=kn(Hr,[n]),s=a.errorMessageStyle,u=a.iconStyle,c=a.screenStyle,l=r||i;return Un(r)&&Un(i)?null:b("div",{id:(t=o,"".concat("mplayer","-").concat("error-page","-").concat(t)),style:c},b(ti,{icon:Kr.ERROR_WARNING_FILL,style:Jt(u)}),b("div",{id:wn(o),style:Jt(s)},l))}),ri=function(e,t){var n=function(e){return{height:"100%",left:0,display:"block",width:"100%",position:"relative",splitView:{width:"".concat(e/(9/16),"px")}}}(e);return{playerWrapperStyle:[n,t&&n.splitView]}},ii=jt(function(e){return{splitViewRatio:Zn(e)}})(function(e){var t=e.splitViewRatio,n=e.children,r=oe(),i=te(null),o=ir()(i,2),a=o[0],s=o[1],u=!Un(t),c=kn(ri,[a,u]).playerWrapperStyle;return Kn(function(){s(r.current.parentElement.clientHeight)},[r]),b("div",{ref:r,style:Jt(c)},n)});function oi(e,t){var n=Object.keys(e);if(Object.getOwnPropertySymbols){var r=Object.getOwnPropertySymbols(e);t&&(r=r.filter(function(t){return Object.getOwnPropertyDescriptor(e,t).enumerable})),n.push.apply(n,r)}return n}function ai(e){for(var t=1;t<arguments.length;t++){var n=null!=arguments[t]?arguments[t]:{};t%2?oi(Object(n),!0).forEach(function(t){f()(e,t,n[t])}):Object.getOwnPropertyDescriptors?Object.defineProperties(e,Object.getOwnPropertyDescriptors(n)):oi(Object(n)).forEach(function(t){Object.defineProperty(e,t,Object.getOwnPropertyDescriptor(n,t))})}return e}var si=ai(ai({},cr),{},{position:"absolute",width:"100%",height:"100%"}),ui={width:"100%",height:"100%",position:"relative"},ci={display:"flex",position:"relative",flexGrow:"1"},li={position:"absolute",zIndex:"1",width:"100%",top:"0",height:"100%",pointerEvents:"none"},di={position:"absolute",zIndex:"2",width:"100%",top:"0",height:"100%",pointerEvents:"none"},pi=function(){return{splitViewWrapperStyle:ai({},si),playerAndControlsWrapperStyle:ai({},ui),splitViewPlaceholderStyle:ai({},ci),controlsPlaceholderStyle:ai({},li),discoveryPlaceholderStyle:ai({},di)}};function fi(e,t){var n=Object.keys(e);if(Object.getOwnPropertySymbols){var r=Object.getOwnPropertySymbols(e);t&&(r=r.filter(function(t){return Object.getOwnPropertyDescriptor(e,t).enumerable})),n.push.apply(n,r)}return n}function hi(e){for(var t=1;t<arguments.length;t++){var n=null!=arguments[t]?arguments[t]:{};t%2?fi(Object(n),!0).forEach(function(t){f()(e,t,n[t])}):Object.getOwnPropertyDescriptors?Object.defineProperties(e,Object.getOwnPropertyDescriptors(n)):fi(Object(n)).forEach(function(t){Object.defineProperty(e,t,Object.getOwnPropertyDescriptor(n,t))})}return e}var yi={position:"absolute",overflow:"hidden",backgroundColor:Ut.COLORS.GRAY_TRANSPARENT,borderRadius:Ut.BORDER_RADIUS.SMALL,height:"6px",small:{width:"120px",height:"4px"},medium:{width:"200px"},largeAndExtraLarge:{width:"220px"},splitView:{width:"120px",height:"4px"},error:{display:"none"}},gi=hi(hi({},pr),{},{width:"100%",height:"100%",position:"absolute",top:"0",backgroundColor:Ut.COLORS.TRANSPARENT,blackScreen:{backgroundColor:Ut.COLORS.BLACK}}),vi=function(e,t,n,r,i){var o,a=!Un(n),s="small"===e,u="medium"===e,c="large"===e||"extraLarge"===e,l=i||Ut.COLORS.WHITE,d=(o=l,{position:"relative",width:"100%",height:"6px",borderRadius:Ut.BORDER_RADIUS.SMALL,animationName:"loaderAnimation",animationDuration:"3.5s",animationIterationCount:"infinite",animationTimingFunction:"ease-in-out",backgroundColor:o,small:{height:"4px"},splitView:{height:"4px"}});return{loaderStyle:[yi,r&&yi.error,s&&yi.small,u&&yi.medium,c&&yi.largeAndExtraLarge,a&&yi.splitView],barStyle:[d,s&&d.small,a&&d.splitView],screenStyle:[gi,t&&gi.blackScreen]}},mi=pn.monetization,bi={continuePlayingWhileWaitingForAd:function(e){return mi(e).continuePlayingWhileWaitingForAd},midrolls:function(e){return mi(e).midrolls},prerollEnabled:function(e){return mi(e).prerollEnabled},vpaidMode:function(e){return mi(e).vpaidMode},adRequestTimeout:function(e){return mi(e).adRequestTimeout},adsData:function(e){return mi(e).adsData}},Oi=bi.adsData,_i={adTagUrlTemplate:function(e){return Oi(e).adTagUrlTemplate},adType:function(e){return Oi(e).adType},adStatus:function(e){return Oi(e).adStatus},pendingAdStatus:function(e){return Oi(e).pendingAdStatus},adErrorMessage:function(e){return Oi(e).adErrorMessage},adDuration:function(e){return Oi(e).adDuration},playedMidrolls:function(e){return Oi(e).playedMidrolls},adImpression:function(e){return Oi(e).adImpression},adOpportunity:function(e){return Oi(e).adOpportunity},isVastAd:function(e){return Oi(e).isVastAd},adCurrentTime:function(e){return Oi(e).adCurrentTime},adMuted:function(e){return Oi(e).adMuted},adVolume:function(e){return Oi(e).adVolume},currentAdTag:function(e){return Oi(e).currentAdTag},adUnit:function(e){return Oi(e).adUnit},slotNumber:function(e){return Oi(e).slotNumber},podNumber:function(e){return Oi(e).podNumber},loadingAd:function(e){return Oi(e).loadingAd}},Si=pn.brandingData,Ei=function(e){return Si(e).brandingColor},wi=jt(function(e){return{showBlackScreen:hn.showBlackScreen(e),playerSize:hn.playerSize(e),splitViewRatio:Zn(e),playerUniqId:hn.playerInstanceUniqId(e),playerErrorMessage:hn.errorMessage(e),mediaErrorMessage:Cn.mediaLoadingError(e),loadingPlayer:hn.loadingPlayer(e),loadingAd:_i.loadingAd(e),brandingColor:Ei(e)}})(function(e){var t,n=e.playerSize,r=e.showBlackScreen,i=e.splitViewRatio,o=e.playerUniqId,a=e.playerErrorMessage,s=e.mediaErrorMessage,u=e.loadingPlayer,c=e.loadingAd,l=e.brandingColor,d=!Un(a)||!Un(s),p=u||c,f=kn(vi,[n,r,i,d,l]),h=f.loaderStyle,y=f.barStyle,g=f.screenStyle;return p?b("div",{id:(t=o,"".concat("mplayer","-").concat("loader-page","-").concat(t)),style:Jt(g)},b("div",{id:Pn(o),style:Jt(h)},b("div",{style:Jt(y)}))):null}),Pi=function(e){var t=e.playerId,n=e.store,r=e.playerPosition,i=kn(pi,[]),o=i.splitViewWrapperStyle,a=i.playerAndControlsWrapperStyle,s=i.splitViewPlaceholderStyle,u=i.controlsPlaceholderStyle,c=i.discoveryPlaceholderStyle;return re(function(){!function(e){var t=document.createElement("link");t.setAttribute("href","https://fonts.googleapis.com/css2?family=Lato:wght@300;400&display=swap"),t.setAttribute("rel","stylesheet"),t.setAttribute("type","text/css"),e.appendChild(t)}(r),function(e){var t=document.createElement("style");t.type="text/css",t.textContent="@keyframes loaderAnimation {0% {left: -100%}49% {left: 100%}50% {left: 100%}100% {left: -100%}}",e.appendChild(t)}(r)},[r]),b(Ze,{store:n},b(Nr,{id:mn(t)},b(Cr,{id:bn(t)},b("div",{id:Tn(t)}),b("div",{style:a},b("div",{style:o},b(ii,null,b(Jn,{playerId:t}),b(xr,{playerId:t}),b(wi,null),b(nr,null)),b("div",{id:_n(t),style:s})),b("div",{id:On(t),style:u}),b("div",{id:Sn(t),style:c}),b(ni,null)))))},Ti=n(1),Ai=n.n(Ti),Ci=function e(){var t=this;Ai()(this,e),f()(this,"HLS_MAIN_SCRIPT","https://cdn.jsdelivr.net/npm/hls.js@0.9.1"),f()(this,"HLS_FALLBACK_SCRIPT","https://www.oo-syringe.com/newplayer/mplayer_hls_wrapper.0.0.0.js"),f()(this,"IMA_SCRIPT","https://imasdk.googleapis.com/js/sdkloader/ima3.js"),f()(this,"MMPLUS_CONTAINER_ID","GTM-PL4PD49"),f()(this,"MM_CONTAINER_ID","GTM-TCW5HW"),f()(this,"dependenciesCallbacks",void 0),f()(this,"imaLoadingStatus",""),f()(this,"hlsLoadingStatus",""),f()(this,"gtmLoaded",!1),f()(this,"addDependenciesCallback",function(e){t.dependenciesCallbacks.includes(e)||t.dependenciesCallbacks.push(e)}),f()(this,"isDependenciesReady",function(){return t.gtmLoaded&&"loading"!==t.getHLSLoadingStatus()&&"loading"!==t.getIMALoadingStatus()}),f()(this,"getIMALoadingStatus",function(){return t.imaLoadingStatus}),f()(this,"getHLSLoadingStatus",function(){return t.hlsLoadingStatus}),f()(this,"removeDependenciesCallback",function(e){t.dependenciesCallbacks.filter(function(t){return t===e})}),f()(this,"loadScript",function(e,t,n){var r=document.createElement("script");r.setAttribute("src",e),r.addEventListener("load",t),r.addEventListener("error",n),document.body.appendChild(r)}),f()(this,"onScriptLoaded",function(e){t.dependenciesCallbacks.forEach(function(t){t.onDependencyReady(e)})}),f()(this,"onScriptFailed",function(e,n){t.dependenciesCallbacks.forEach(function(t){t.onDependencyFailure(e,n)})}),f()(this,"onHlsScriptLoaded",function(){void 0!==window.Hls?t.onScriptLoaded("hls"):t.onHlsLoadError()}),f()(this,"onHlsLoadError",function(){t.loadScript(t.HLS_FALLBACK_SCRIPT,t.onMMhlsScriptLoaded,t.onMMHlsScriptFailure)}),f()(this,"onMMhlsScriptLoaded",function(){t.onScriptLoaded("hls")}),f()(this,"onMMHlsScriptFailure",function(e){t.onScriptFailed("hls",e)}),f()(this,"onImaLoadError",function(e){t.imaLoadingStatus="error",t.onScriptFailed("ima",e)}),f()(this,"onImaLoaded",function(){t.onScriptLoaded("ima"),t.imaLoadingStatus="success"}),f()(this,"shouldLoadMmGTM",function(){var e=window.google_tag_manager;return!e||!e[t.MMPLUS_CONTAINER_ID]&&!e[t.MM_CONTAINER_ID]}),f()(this,"loadGTMifNeeded",function(){if(t.shouldLoadMmGTM()){var e,n;try{e=window.parent,n=window.parent.document}catch(u){e=window,n=window.document}var r=$n(e),i="dataLayer"!==r?"&l=".concat(r):"";e[r]=e[r]||[],e[r].push({"gtm.start":(new Date).getTime(),event:"gtm.js"});var o=n.getElementsByTagName("script")[0],a=n.createElement("script");a.setAttribute("async",""),a.setAttribute("src","https://www.googletagmanager.com/gtm.js?id=GTM-PL4PD49".concat(i)),o.parentNode.insertBefore(a,o);var s=n.createElement("iframe");s.src="https://www.googletagmanager.com/ns.html?id=GTM-PL4PD49",s.height="0",s.width="0",s.style="display:none;visibility:hidden",n.body.appendChild(s),t.gtmLoaded=!0}}),f()(this,"loadHLS",function(){Bn()||"safari"===Vn.name?t.hlsLoadingStatus="no-need":(t.loadScript(t.HLS_MAIN_SCRIPT,t.onHlsScriptLoaded,t.onHlsLoadError),t.hlsLoadingStatus="loading")}),f()(this,"loadIMA",function(){t.loadScript(t.IMA_SCRIPT,t.onImaLoaded,t.onImaLoadError),t.imaLoadingStatus="loading"}),f()(this,"loadExternalDependencies",function(){""===t.getIMALoadingStatus()&&t.loadIMA(),""===t.getHLSLoadingStatus()&&t.loadHLS(),t.gtmLoaded||t.loadGTMifNeeded()}),this.dependenciesCallbacks=[]};f()(Ci,"instance",void 0),f()(Ci,"getInstance",function(){return Ci.instance||(Ci.instance=new Ci),Ci.instance});var Ri=function(e){return"".concat("mplayer-monetization-ad-container","-").concat(e)},Di=function(e){return"".concat("mplayer-monetization-safari-video-ad","-").concat(e)},Mi=jt(function(e){return{contentVideoTime:hn.currentVideoTime(e),playerUniqId:hn.playerInstanceUniqId(e)}})(function(e){var t=e.contentVideoTime,n=e.playerUniqId,r=oe();return re(function(){Un(r.current)||(r.current.currentTime=t)},[t]),b("video",{id:Di(n),ref:r,style:{backgroundColor:"rgb(0, 0, 0)",width:"100%",height:"100%"},title:"Advertisement",preload:"auto",muted:!0,playsInline:!0,"webkit-playsinline":""})});function Ii(e,t){var n=Object.keys(e);if(Object.getOwnPropertySymbols){var r=Object.getOwnPropertySymbols(e);t&&(r=r.filter(function(t){return Object.getOwnPropertyDescriptor(e,t).enumerable})),n.push.apply(n,r)}return n}function ki(e){for(var t=1;t<arguments.length;t++){var n=null!=arguments[t]?arguments[t]:{};t%2?Ii(Object(n),!0).forEach(function(t){f()(e,t,n[t])}):Object.getOwnPropertyDescriptors?Object.defineProperties(e,Object.getOwnPropertyDescriptors(n)):Ii(Object(n)).forEach(function(t){Object.defineProperty(e,t,Object.getOwnPropertyDescriptor(n,t))})}return e}var Ni=jt(function(e,t){return ki(ki({},t),{},{adStatus:_i.adStatus(e)})})(function(e){var t=e.playerId,n=e.adStatus,r="playing"===n||"paused"===n;return re(function(){document.getElementById(vn(t)).style.display=r?"flex":"none"},[t,r]),b("div",{style:{width:"100%",height:"100%"}},b("div",{id:Ri(t),style:{height:"100%",width:"100%"}},Bn()&&b(Mi,null)))}),Li=function(e){var t=e.store,n=e.playerId;return b(Ze,{store:t},b(Ni,{playerId:n}))},xi=n(2),Vi=n.n(xi),ji=(n(46),function(){function e(t,n,r){Ai()(this,e),f()(this,"store",void 0),f()(this,"getDependenciesElements",void 0),f()(this,"oldState",void 0),f()(this,"unsubscribe",void 0),f()(this,"onChange",void 0),this.store=t,this.oldState=t.getState(),this.getDependenciesElements=n,this.unsubscribe=t.subscribe(this.onStateChanged.bind(this)),this.onChange=r}return Vi()(e,[{key:"stopSubscription",value:function(){this.unsubscribe(),this.oldState=null,this.getDependenciesElements=null,this.store=null,this.unsubscribe=null,this.onChange=null}},{key:"onStateChanged",value:function(){var e=this.store.getState(),t=this.getDependenciesElements(this.oldState),n=this.getDependenciesElements(e);t.every(function(e,t){return e===n[t]})||this.onChange(e),this.oldState=e}}]),e}()),Ui=pn.dependenciesLoadingStatus,Fi={loadingImaStatus:function(e){return Ui(e).loadingImaStatus},loadingHLSStatus:function(e){return Ui(e).loadingHLSStatus}},Bi=function(e){return"blocked"===Fi.loadingImaStatus(e)},Hi=function(e){return"playing"===e||"requested"===e||"loaded"===e||"paused"===e},qi=function(){function e(t,n){Ai()(this,e),f()(this,"videoTimeSubscriber",void 0),f()(this,"adsScheduler",void 0),this.videoTimeSubscriber=new ji(t,e.getVideoTimeDependencies,this.onVideoTimeChanged.bind(this)),this.adsScheduler=n}return Vi()(e,[{key:"onVideoTimeChanged",value:function(t){"seeking"!==hn.videoTagStatus(t)&&(e.shouldRequestAd(t)?this.adsScheduler.onPreAdTimeReached(e.getMidroll(t)):e.isOnAdTime(t)&&this.adsScheduler.onAdTimeReached())}}],[{key:"getVideoTimeDependencies",value:function(e){return[hn.currentVideoTime(e)]}},{key:"isTimeInPreAdRange",value:function(e,t){return t>=e&&e>=t-$i}},{key:"getNextSpecificMidrollTime",value:function(t,n){return-1!==t.indexOf(n)?n:t.find(function(t){return e.isTimeInPreAdRange(n,t)})}},{key:"getNextReocurringMidrollNumber",value:function(e,t){var n=t/e;return t%e===0?n:Math.ceil(n)}},{key:"getMidroll",value:function(t){var n=hn.currentVideoTime(t),r=bi.midrolls(t),i=r.every,o=r.on,a=Dn.mediaId(t);if(!Un(i)){var s=e.getNextReocurringMidrollNumber(i,n);return{currentTime:n,mediaId:a,midrollNumber:s,midrollTime:s*i}}if(!Un(o)){var u=e.getNextSpecificMidrollTime(o,n);return{midrollNumber:o.indexOf(u)+1,currentTime:n,midrollTime:u,mediaId:a}}return null}},{key:"isMidrollAlreadyPlayed",value:function(e,t){return-1!==e.indexOf(t)}},{key:"isMidrollReached",value:function(t){var n=hn.currentVideoTime(t),r=bi.midrolls(t),i=r.every,o=r.on,a=_i.playedMidrolls(t);if(!Un(i)&&n>0){var s=e.getNextReocurringMidrollNumber(i,n),u=s*i;return!this.isMidrollAlreadyPlayed(a,s)&&e.isTimeInPreAdRange(n,u)}if(!Un(o)){var c=e.getNextSpecificMidrollTime(o,n),l=o.indexOf(c)+1;return l>0&&!this.isMidrollAlreadyPlayed(a,l)}return!1}},{key:"shouldRequestAd",value:function(e){var t=_i.adStatus(e);return!Bi(e)&&!Hi(t)&&this.isMidrollReached(e)}},{key:"isOnAdTime",value:function(t){var n=hn.currentVideoTime(t),r=bi.midrolls(t),i=r.every,o=r.on,a=_i.playedMidrolls(t);if(Bi(t))return!1;if(!Un(i)){var s=e.getNextReocurringMidrollNumber(i,n);return 0!==n&&n%i===0&&!this.isMidrollAlreadyPlayed(a,s)}if(!Un(o)){var u=o.indexOf(n);return-1!==u&&!this.isMidrollAlreadyPlayed(a,u)}return!1}}]),e}(),Wi=function(){function e(t){var n=this;Ai()(this,e),f()(this,"referrerUrl",void 0),f()(this,"staticAdTag",void 0),f()(this,"generate",function(e,t){var r=encodeURIComponent(n.referrerUrl);return Un(n.staticAdTag)?n.adTagFromApi(e,r,t):n.parseAdTag(n.staticAdTag,e,r,t)}),this.staticAdTag=t,this.referrerUrl=window.location.href}return Vi()(e,[{key:"parseAdTag",value:function(t,n,r,i){var o=t.replace("##AdUnit##",e.parseAdName(n)).replace("##DESCRIPTION_URL_UNESC##",r).replace("##REFERRER_URL_UNESC##",encodeURIComponent(this.referrerUrl)).replace("##CACHEBUSTER##",e.cacheBuster(n)).replace("##MIDROLL_ORDER##",e.adIndexFromName(n));return o=e.replaceVideoId(o,"##VIDEO_ID##",i),o=e.addHacksToAdTag(o)}},{key:"adTagFromApi",value:function(e,t,n){try{var r=window.getVideoTag(t,e);return Un(r)?null:this.parseAdTag(r,e,t,n)}catch(i){return null}}}],[{key:"getCCPAConsent",value:function(t){try{var n="";return window.__uspapi&&window.__uspapi("getUSPData",1,function(e,t){t&&(n=e.uspString)}),e.setSearchParamToAdTag(t,"us_privacy",n)}catch(r){return t}}},{key:"replaceVideoId",value:function(e,t,n){return e.replace(t,n).replace(encodeURIComponent(t),n).replace(encodeURIComponent(encodeURIComponent(t)),n)}},{key:"cacheBuster",value:function(t){return"".concat((new Date).getTime()).concat(e.adIndexFromName(t))}},{key:"parseAdName",value:function(t){return t.startsWith("preroll")?"PR":"MR".concat(e.adIndexFromName(t))}},{key:"adIndexFromName",value:function(e){return e.replace(/[^\d]*/g,"")}}]),e}();f()(Wi,"setSearchParamToAdTag",function(e,t,n){var r=new URL(e),i=decodeURIComponent(n);return r.searchParams.set(t,i),r.href}),f()(Wi,"getSearchParamFromAdTag",function(e,t){return new URL(e).searchParams.get(t)}),f()(Wi,"addHacksToAdTag",function(e){var t=e,n=Wi.getSearchParamFromAdTag(t,"cust_params");if(!jn(window.mmAPSbids)&&!Un(n)){var r="".concat(window.mmAPSbids,"&").concat(n);t=Wi.setSearchParamToAdTag(t,"cust_params",r)}if(!jn(window.shouldPlayAdRules)){var i=window.shouldPlayAdRules?"1":"0";t=Wi.setSearchParamToAdTag(t,"ad_rule",i)}return t=Wi.getCCPAConsent(t)});var zi=function(){function e(t,n){Ai()(this,e),f()(this,"store",void 0),f()(this,"videoTagStatusSubscriber",void 0),f()(this,"adsScheduler",void 0),f()(this,"previousVideoTagStatus",void 0);var r=t.getState;this.store=t,this.adsScheduler=n,this.previousVideoTagStatus=hn.videoTagStatus(r()),this.videoTagStatusSubscriber=new ji(t,e.getVideoTagStatusDependencies,this.onVideoTagStatusChanged.bind(this))}return Vi()(e,[{key:"onVideoTagStatusChanged",value:function(t){var n=hn.videoTagStatus(t),r=_i.adStatus(t);"seeking"===this.previousVideoTagStatus&&(Hi(r)?this.adsScheduler.onSeekedWhileAdInProgress():e.isSeekedOverMidroll(t)&&this.adsScheduler.onSeekToAdOpportunity(e.getSeekedMidroll(t))),this.previousVideoTagStatus=n}}],[{key:"getVideoTagStatusDependencies",value:function(e){return[hn.videoTagStatus(e)]}},{key:"getClosestSkippedUnplayedMidroll",value:function(e,t){for(var n=t;n>0;n-=1)if(-1===e.indexOf(n))return n;return null}},{key:"getClosestLowerSeekedMidrollNumber",value:function(e,t){var n=In()(e).reverse().find(function(e){return e<=t});return e.indexOf(n)+1}},{key:"getSeekedSpecificMidroll",value:function(e,t,n,r){var i=this.getClosestLowerSeekedMidrollNumber(e,t),o=this.getClosestSkippedUnplayedMidroll(r,i);return{midrollNumber:o,currentTime:t,midrollTime:e[o-1],mediaId:n}}},{key:"isSeekedOverSpecificMidroll",value:function(e,t,n){if(jn(e))return!1;var r=this.getClosestLowerSeekedMidrollNumber(e,n);return null!==this.getClosestSkippedUnplayedMidroll(t,r)}},{key:"getSeekedReoccuringMidroll",value:function(e,t,n,r){var i=Math.floor(t/e),o=this.getClosestSkippedUnplayedMidroll(r,i);return{midrollTime:o*e,currentTime:t,midrollNumber:o,mediaId:n}}},{key:"isSeekedOverReoccuringMidroll",value:function(e,t,n){if(jn(e))return!1;var r=Math.floor(n/e);return null!==this.getClosestSkippedUnplayedMidroll(t,r)}},{key:"getSeekedMidroll",value:function(e){var t=_i.playedMidrolls(e),n=hn.currentVideoTime(e),r=bi.midrolls(e),i=r.every,o=r.on,a=Cn.mediaId(e);return this.isSeekedOverReoccuringMidroll(i,t,n)?this.getSeekedReoccuringMidroll(i,n,a,t):this.isSeekedOverSpecificMidroll(o,t,n)?this.getSeekedSpecificMidroll(o,n,a,t):null}},{key:"isSeekedOverMidroll",value:function(e){var t=_i.playedMidrolls(e),n=hn.currentVideoTime(e),r=bi.midrolls(e),i=r.every,o=r.on,a=o;return bi.prerollEnabled(e)&&(a=o.filter(function(e){return 0!==e})),this.isSeekedOverReoccuringMidroll(i,t,n)||this.isSeekedOverSpecificMidroll(a,t,n)}}]),e}(),Gi=function e(t,n){var r=this;Ai()(this,e),f()(this,"pendingAdStatusStoreSubscriber",void 0),f()(this,"adsScheduler",void 0),f()(this,"onPendingAdStatusChanged",function(e){var t=_i.pendingAdStatus(e).type,n=_i.adStatus(e);if("playPreroll"===t&&!Hi(n)){var i=Cn.activeVideoIndex(e),o=Dn.mediaId(e);r.adsScheduler.onPrerollReached(o,i+1)}}),this.adsScheduler=n,this.pendingAdStatusStoreSubscriber=new ji(t,e.getPendingAdStatusDependencies,this.onPendingAdStatusChanged.bind(this))};f()(Gi,"getPendingAdStatusDependencies",function(e){return[_i.pendingAdStatus(e)]});var $i=3,Ki=function e(t,n){var r=this;Ai()(this,e),f()(this,"videoTimeSubscriber",void 0),f()(this,"videoSeekSubscriber",void 0),f()(this,"adTagGenerator",void 0),f()(this,"monetization",void 0),f()(this,"lastRequestedMidroll",null),f()(this,"prerollScheduler",void 0),f()(this,"generateMidrollTag",function(e){var t="midroll".concat(e.midrollNumber);return r.adTagGenerator.generate(t,e.mediaId)}),f()(this,"generatePrerollTag",function(e,t){var n="preroll".concat(t);return r.adTagGenerator.generate(n,e)}),f()(this,"onAdTimeReached",function(){r.monetization.onMidrollAdOpportunity()}),f()(this,"onPreAdTimeReached",function(e){r.onPreMidrollAdOpportunity(e)}),f()(this,"onSeekToAdOpportunity",function(e){r.onPreMidrollAdOpportunity(e)}),f()(this,"isMidrollAlreadyRequested",function(e){return e.midrollNumber===r.lastRequestedMidroll.midrollNumber&&e.mediaId===r.lastRequestedMidroll.mediaId&&e.midrollTime===r.lastRequestedMidroll.midrollTime}),f()(this,"onPreMidrollAdOpportunity",function(e){if(Un(r.lastRequestedMidroll)||!r.isMidrollAlreadyRequested(e)){r.lastRequestedMidroll=e;var t=r.generateMidrollTag(e);r.monetization.onPreMidrollAdOpportunity(e,t)}}),f()(this,"onPrerollReached",function(e,t){var n=r.generatePrerollTag(e,t);r.monetization.onPrerollAdOpportunity(n)}),f()(this,"onSeekedWhileAdInProgress",function(){r.monetization.onMidrollAdOpportunity()});var i=t.getState;this.monetization=n,this.videoTimeSubscriber=new qi(t,this),this.videoSeekSubscriber=new zi(t,this),this.prerollScheduler=new Gi(t,this);var o=_i.adTagUrlTemplate(i());this.adTagGenerator=new Wi(o)},Yi=function(){function e(){Ai()(this,e)}return Vi()(e,null,[{key:"generateAdRequest",value:function(e,t,n){var r=new google.ima.AdsRequest;return r.adTagUrl=e,Fn()||r.setAdWillPlayMuted(t),r.vastLoadTimeout=n,r}}]),e}(),Zi=function(e){return function(t){t({type:"[MONETIZATION] change ad status",payload:e})}},Xi=function(e){return function(t){t({type:"[COMMON] set pending video status",payload:{pendingStatusObject:{type:e,value:""}}})}},Ji=function(e){return function(t){t({type:"[MONETIZATION] change loading ad status",payload:e})}},Qi=function(e){return function(t){t({type:"[MONETIZATION] update ad muted",payload:e})}},eo=function(e){return function(t){t({type:"[MONETIZATION] change ad volume",payload:e})}},to=function e(t,n,r,i,o){var a=this;Ai()(this,e),f()(this,"store",void 0),f()(this,"IMAAdManager",void 0),f()(this,"adsLoader",void 0),f()(this,"adDisplayContainer",void 0),f()(this,"adVideoElement",void 0),f()(this,"videoPlayerElement",void 0),f()(this,"adContainerElement",void 0),f()(this,"anchorStatusStoreSubscriber",void 0),f()(this,"totalAdRequestMadeAmount",0),f()(this,"registerForWindowResize",function(){var e=zn(a.onResize.bind(a),80);window.addEventListener("resize",e)}),f()(this,"initMutationObserver",function(e){new MutationObserver(a.onResize).observe(e,{attributes:!0,childList:!1,subtree:!1})}),f()(this,"loadNewAd",function(e,t){var n=a.store.dispatch;a.clearOldAdManagerIfExist();var r=a.createAdRequest(e);try{a.validateAdRequestCorrectness(r),a.adsLoader.requestAds(r),function(e,t){return function(n){n({type:"[MONETIZATION] change ad tag",payload:{adTag:e,adUnit:t}})}}(e,t)(n),Zi("requested")(n),a.totalAdRequestMadeAmount+=1}catch(i){a.onAdError(a.getLoadingError(r))}}),f()(this,"playAd",function(){try{a.IMAAdManager.init(a.videoPlayerElement.clientWidth,a.videoPlayerElement.clientHeight,google.ima.ViewMode.NORMAL);try{a.IMAAdManager.start()}catch(e){return!1}return!0}catch(t){return a.onAdError(a.getPlayAdError("ad manager start error")),!1}}),f()(this,"clearOldAdManagerIfExist",function(){Un(a.IMAAdManager)||(a.IMAAdManager.destroy(),a.IMAAdManager=null)}),f()(this,"createAdLoader",function(e,t){var n=bi.vpaidMode(e);a.adsLoader=new google.ima.AdsLoader(t),a.adsLoader.getSettings().setDisableCustomPlaybackForIOS10Plus(!0),a.adsLoader.getSettings().setVpaidMode(google.ima.ImaSdkSettings.VpaidMode[n]),a.adsLoader.addEventListener(google.ima.AdsManagerLoadedEvent.Type.ADS_MANAGER_LOADED,a.onIMAAdsManagerLoaded.bind(a),!1,a),a.adsLoader.addEventListener(google.ima.AdErrorEvent.Type.AD_ERROR,a.onAdError.bind(a),!1,a)}),f()(this,"createAdRequest",function(e){var t=a.store.getState,n=gn.muted(t()),r=bi.adRequestTimeout(t());return Yi.generateAdRequest(e,n,r)}),f()(this,"validateAdRequestCorrectness",function(e){e&&e.adTagUrl&&decodeURIComponent(e.adTagUrl.replace(/\+/g," "))}),f()(this,"getLoadingError",function(e){var t=function(){return"bad ad request ".concat(JSON.stringify(e))};return{getError:function(){return{getMessage:t}}}}),f()(this,"getPlayAdError",function(e){var t=function(){return"play ad error: ".concat(JSON.stringify(e))};return{getError:function(){return{getMessage:t}}}}),f()(this,"setAdVolume",function(e){var t=a.store,n=t.getState,r=t.dispatch,i=gn.volume(n());Bn()||gn.muted(n())?(e.setVolume(0),Qi(!0)(r)):(e.setVolume(gn.volume(n())),eo(i)(r),Qi(!1)(r))}),f()(this,"createIMAAdManager",function(t){a.IMAAdManager=t.getAdsManager(a.adVideoElement,e.getAdsRenderingSettings()),a.setAdVolume(a.IMAAdManager)}),f()(this,"registerToAdManagerEvents",function(){a.IMAAdManager.addEventListener(google.ima.AdErrorEvent.Type.AD_ERROR,a.onAdError),a.IMAAdManager.addEventListener(google.ima.AdEvent.Type.CONTENT_PAUSE_REQUESTED,a.onContentPauseRequested),a.IMAAdManager.addEventListener(google.ima.AdEvent.Type.CONTENT_RESUME_REQUESTED,a.onContentResumeRequested),a.IMAAdManager.addEventListener(google.ima.AdEvent.Type.STARTED,a.onAdStarted),a.IMAAdManager.addEventListener(google.ima.AdEvent.Type.IMPRESSION,a.onAdImpression),a.IMAAdManager.addEventListener(google.ima.AdEvent.Type.SKIPPED,a.onAdSkipped),a.IMAAdManager.addEventListener(google.ima.AdEvent.Type.COMPLETE,a.onAdCompleted),a.IMAAdManager.addEventListener(google.ima.AdEvent.Type.PAUSED,a.onAdPaused),a.IMAAdManager.addEventListener(google.ima.AdEvent.Type.RESUMED,a.onAdStarted),a.IMAAdManager.addEventListener(google.ima.AdEvent.Type.AD_PROGRESS,a.onAdProgressChanged),a.IMAAdManager.addEventListener(google.ima.AdEvent.Type.VOLUME_CHANGED,a.onVolumeChanged),a.IMAAdManager.addEventListener(google.ima.AdEvent.Type.VOLUME_MUTED,a.onAdVolumeMutedChanged),a.IMAAdManager.addEventListener(google.ima.AdEvent.Type.ALL_ADS_COMPLETED,a.onAdCompleted)}),f()(this,"onIMAAdsManagerLoaded",function(e){var t=a.store.dispatch;a.createIMAAdManager(e),a.registerToAdManagerEvents(),Zi("loaded")(t)}),f()(this,"onAdError",function(e){var t=a.store.dispatch;!function(e){return function(t){t({type:"[MONETIZATION] change ad error",payload:e})}}(e.getError().getMessage())(t),Ji(!1),a.continuePlayingContent()}),f()(this,"onAdImpression",function(e){var t=a.store.dispatch,n=!e.getAd().g.vpaid;a.setPodInfo(e),function(e){e({type:"[MONETIZATION] increase ad impression counter"})}(t),function(e){return function(t){t({type:"[MONETIZATION] update is vast ad",payload:e})}}(n)(t)}),f()(this,"onVolumeChanged",function(e){var t=a.store.dispatch;eo(e.target.getVolume())(t)}),f()(this,"onAdVolumeMutedChanged",function(e){var t=a.store.dispatch;0===e.target.getVolume()?Qi(!0)(t):Qi(!1)(t)}),f()(this,"continuePlayingContent",function(){var e=a.store,t=e.getState,n=e.dispatch,r=hn.videoTagStatus(t());Xi("idle"===r?"play":"resume")(n)}),f()(this,"stopPlayingContent",function(){var e=a.store.dispatch;Xi("pause")(e)}),f()(this,"onContentPauseRequested",function(){a.stopPlayingContent()}),f()(this,"onContentResumeRequested",function(){a.continuePlayingContent()}),f()(this,"onAdPaused",function(){var e=a.store.dispatch;Zi("paused")(e)}),f()(this,"setPodInfo",function(e){var t=e&&e.getAd()&&e.getAd().getAdPodInfo();if(!Un(t)){var n=a.store.dispatch;!function(e,t){return function(n){n({type:"[MONETIZATION] change pod info",payload:{slotNumber:e,podNumber:t}})}}(t.getAdPosition(),a.totalAdRequestMadeAmount)(n)}}),f()(this,"onAdStarted",function(){var e=a.store,t=e.dispatch,n=e.getState,r=gn.volume(n());Zi("playing")(t),0===a.IMAAdManager.getVolume()?a.IMAAdManager.setVolume(0):window.shouldPlayAdRule||a.IMAAdManager.setVolume(r),a.onResize()}),f()(this,"onAdCompleted",function(){var e=a.store.dispatch;Zi("completed")(e)}),f()(this,"onAdSkipped",function(){var e=a.store.dispatch;Zi("skipped")(e)}),f()(this,"onResize",function(){Un(a.IMAAdManager)||(a.IMAAdManager.resize(a.videoPlayerElement.clientWidth,a.videoPlayerElement.clientHeight,google.ima.ViewMode.NORMAL),a.adContainerElement.style.height="".concat(a.videoPlayerElement.clientHeight,"px"))}),f()(this,"onAdProgressChanged",function(e){var t,n,r=a.store,i=r.dispatch,o=r.getState,s=e.getAdData().currentTime,u=e.getAdData().duration,c=_i.adDuration(o());(t=s,function(e){e({type:"[MONETIZATION] change ad current time",payload:t})})(i),c!==u&&(n=u,function(e){e({type:"[MONETIZATION] change ad duration",payload:n})})(i)}),f()(this,"onAnchorStatusChanged",function(){var e=a.store.getState;"processing"!==Pr(e())&&a.onResize()}),f()(this,"changeAdVolume",function(e){Un(a.IMAAdManager)||a.IMAAdManager.setVolume(e)}),f()(this,"changeAdMuted",function(e,t){Un(a.IMAAdManager)||(t?a.IMAAdManager.setVolume(0):a.IMAAdManager.setVolume(e))}),f()(this,"changeAdStatus",function(e){Un(a.IMAAdManager)||("playing"===e&&a.IMAAdManager.resume(),"paused"===e&&a.IMAAdManager.pause())});var s=t.getState;this.store=t,this.adVideoElement=r,this.videoPlayerElement=i,this.adContainerElement=n,this.adDisplayContainer=new google.ima.AdDisplayContainer(n,r),this.createAdLoader(s(),this.adDisplayContainer),this.adDisplayContainer.initialize(),this.anchorStatusStoreSubscriber=new ji(t,e.getAnchorDependencies,this.onAnchorStatusChanged.bind(this)),this.registerForWindowResize(),this.initMutationObserver(o)};f()(to,"getAdsRenderingSettings",function(){var e=new google.ima.AdsRenderingSettings;return e.restoreCustomPlaybackStateOnAdBreakComplete=!0,e.enablePreloading=!1,e.uiElements=[],e.loadVideoTimeout=15e3,e}),f()(to,"getAnchorDependencies",function(e){return[Pr(e)]});var no=function e(t,n,r,i,o,a){var s=this;Ai()(this,e),f()(this,"store",void 0),f()(this,"playerId",void 0),f()(this,"adScheduler",void 0),f()(this,"adHandler",void 0),f()(this,"imaLoadingStatusSubscriber",void 0),f()(this,"adStatusSubscriber",void 0),f()(this,"videoTagStatusSubscriber",void 0),f()(this,"adContainer",void 0),f()(this,"adVideoElement",void 0),f()(this,"videoPlayerElement",void 0),f()(this,"playerContainer",void 0),f()(this,"pendingMidrollAdPlay",!1),f()(this,"pendingPrerollAdPlay",!1),f()(this,"pendingPrerollAdTag",null),f()(this,"pendingMidrollNumber",null),f()(this,"pendingAdStatusStoreSubscriber",void 0),f()(this,"adMutedStoreSubscriber",void 0),f()(this,"adVolumeStoreSubscriber",void 0),f()(this,"onMidrollAdOpportunity",function(){var e=s.store,t=e.dispatch,n=e.getState,r=_i.adStatus(n()),i=bi.continuePlayingWhileWaitingForAd(n());"loaded"===r?s.playAd(!0):"requested"===r&&(s.pendingMidrollAdPlay=!0,i||(Xi("pause")(t),Ji(!0)(t))),function(e){e({type:"[MONETIZATION] increase ad Opportunity counter"})}(t)}),f()(this,"onPrerollAdOpportunity",function(e){var t=s.store,n=t.getState,r=t.dispatch,i=Fi.loadingImaStatus(n());Un(s.adHandler)?"loading"!==i&&""!==i||(Ji(!0)(r),s.pendingPrerollAdPlay=!0,s.pendingPrerollAdTag=e):(s.pendingPrerollAdPlay=!0,Ji(!0)(r),s.adHandler.loadNewAd(e,"preroll"))}),f()(this,"onPreMidrollAdOpportunity",function(e,t){Un(s.adHandler)||(e.currentTime>=e.midrollTime&&(s.pendingMidrollAdPlay=!0),s.pendingMidrollNumber=e.midrollNumber,s.adHandler.loadNewAd(t,"midroll"))}),f()(this,"hasPendingAd",function(){return s.hasPendingMidrollAdPlay()||s.hasPendingPrerollAdPlay()}),f()(this,"onAdStatusChanged",function(e){var t=s.store.dispatch,n=_i.adStatus(e);"completed"===n&&Ji(!1)(t);var r=bi.continuePlayingWhileWaitingForAd(e),i=_i.loadingAd(e);"playing"!==n&&"error"!==n||r||!i||Ji(!1)(t),s.hasPendingAd()&&"loaded"===n?s.playAd(s.hasPendingMidrollAdPlay()):s.hasPendingAd()&&"error"===n?(Ji(!1),s.clearPendingMidroll(),s.clearPendingPreroll()):Hi(n)||(Ji(!1),function(e){e({type:"[MONETIZATION] clear ad data"})}(t))}),f()(this,"clearPendingMidroll",function(){s.pendingMidrollNumber=null,s.pendingMidrollAdPlay=!1}),f()(this,"clearPendingPreroll",function(){s.pendingPrerollAdPlay=!1,s.pendingPrerollAdTag=null}),f()(this,"onVideoTagStatusChanged",function(e){"complete"===hn.videoTagStatus(e)&&function(e){e({type:"[MONETIZATION] clear played midrolls"})}(s.store.dispatch)}),f()(this,"hasPendingMidrollAdPlay",function(){return s.pendingMidrollAdPlay}),f()(this,"hasPendingPrerollAdPlay",function(){return s.pendingPrerollAdPlay}),f()(this,"playAd",function(e){var t,n=s.store.dispatch,r=s.adHandler.playAd();e?((t=s.pendingMidrollNumber,function(e){e({type:"[MONETIZATION] add played midroll number",payload:t})})(n),s.clearPendingMidroll()):s.clearPendingPreroll(),r||(Ji(!1)(n),Xi("resume")(n))}),f()(this,"onIMALoadingStatusChanged",function(t){e.canUseIMA(t)&&(Un(s.adHandler)&&(s.adHandler=new to(s.store,s.adContainer,s.adVideoElement,s.videoPlayerElement,s.playerContainer)),s.hasPendingPrerollAdPlay()&&s.adHandler.loadNewAd(s.pendingPrerollAdTag,"preroll"))}),f()(this,"onPendingAdStatusChanged",function(){var e=s.store.getState,t=_i.pendingAdStatus(e()).type;switch(t){case"paused":case"playing":s.adHandler.changeAdStatus(t)}}),f()(this,"onAdMutedChanged",function(){var e=s.store.getState,t=_i.adMuted(e()),n=gn.volume(e());s.adHandler.changeAdMuted(n,t)}),f()(this,"onAdVolumeChanged",function(){var e=s.store.getState,t=_i.adVolume(e());s.adHandler.changeAdVolume(t)});var u=t.getState;this.store=t,this.playerId=n,this.adContainer=r,this.adVideoElement=i,this.videoPlayerElement=o,this.playerContainer=a,this.adScheduler=new Ki(t,this),this.adStatusSubscriber=new ji(t,e.getAdStatusDependencies,this.onAdStatusChanged.bind(this)),this.videoTagStatusSubscriber=new ji(t,e.getVideoTagStatusDependencies,this.onVideoTagStatusChanged.bind(this)),e.canUseIMA(u())?this.adHandler=new to(t,r,i,o,a):this.imaLoadingStatusSubscriber=new ji(t,e.getIMALoadingStatusDependencies,this.onIMALoadingStatusChanged.bind(this)),this.pendingAdStatusStoreSubscriber=new ji(t,e.getPendingAdStatusDependencies,this.onPendingAdStatusChanged.bind(this)),this.adMutedStoreSubscriber=new ji(t,e.getAdMutedDependencies,this.onAdMutedChanged.bind(this)),this.adVolumeStoreSubscriber=new ji(t,e.getAdVolumeDependencies,this.onAdVolumeChanged.bind(this))};f()(no,"getAdStatusDependencies",function(e){return[_i.adStatus(e)]}),f()(no,"getVideoTagStatusDependencies",function(e){return[hn.videoTagStatus(e)]}),f()(no,"getIMALoadingStatusDependencies",function(e){return[Fi.loadingImaStatus(e)]}),f()(no,"canUseIMA",function(e){return"success"===Fi.loadingImaStatus(e)}),f()(no,"getPendingAdStatusDependencies",function(e){return[_i.pendingAdStatus(e)]}),f()(no,"getAdMutedDependencies",function(e){return[_i.adMuted(e)]}),f()(no,"getAdVolumeDependencies",function(e){return[_i.adVolume(e)]});var ro=function(e,t){!function(e,t){var n=document.getElementById(vn(t));B(b(Li,{store:e,playerId:t}),n)}(e,t);var n=function(e){var t=Ri(e);return document.getElementById(t)}(t),r=function(e){var t=Bn()?Di(e):En(e);return document.getElementById(t)}(t),i=function(e){var t=En(e);return document.getElementById(t)}(t),o=function(e){var t=bn(e);return document.getElementById(t)}(t);return new no(e,t,n,r,i,o)},io=n(4),oo=n.n(io),ao=n(7),so=n.n(ao),uo=function(){function e(){Ai()(this,e),f()(this,"duration",void 0),f()(this,"position",void 0),f()(this,"previousPosition",void 0),f()(this,"loadTime",void 0),f()(this,"adOrder",void 0),f()(this,"adType",void 0),f()(this,"adDuration",void 0),f()(this,"errorMessage",void 0),f()(this,"adPodNumber",void 0),f()(this,"adSlotNumber",void 0)}return Vi()(e,[{key:"setDuration",value:function(e){return this.duration=e,this}},{key:"setPosition",value:function(e){return this.position=e,this}},{key:"setPreviousPosition",value:function(e){return this.previousPosition=e,this}},{key:"setLoadTime",value:function(e){return this.loadTime=e,this}},{key:"setAdOrder",value:function(e){return this.adOrder=e,this}},{key:"setAdType",value:function(e){return this.adType=e,this}},{key:"setAdDuration",value:function(e){return this.adDuration=e,this}},{key:"setErrorMessage",value:function(e){return this.errorMessage=e,this}},{key:"setAdPodNumber",value:function(e){return this.adPodNumber=e,this}},{key:"setAdSlotNumber",value:function(e){return this.adSlotNumber=e,this}},{key:"build",value:function(){var e=[];return jn(this.position)||e.push("video current position=".concat(Hn(this.position),"sec")),jn(this.duration)||e.push("video duration time=".concat(Hn(this.duration),"sec")),jn(this.loadTime)||e.push("video load time=".concat(this.loadTime,"milliseconds")),jn(this.previousPosition)||e.push("previous position=".concat(Hn(this.previousPosition),"sec")),jn(this.adOrder)||e.push("ad order=".concat(this.adOrder)),jn(this.adType)||e.push("ad type=".concat(this.adType)),jn(this.adDuration)||e.push("ad duration=".concat(Hn(Number(this.adDuration)),"sec")),jn(this.adPodNumber)||e.push("pod number=".concat(this.adPodNumber)),jn(this.adSlotNumber)||e.push("slot number=".concat(this.adSlotNumber)),jn(this.errorMessage)||e.push("error message=".concat(this.errorMessage)),e.join(";")}}]),e}(),co="mmPlus GTM data ready to GA",lo="mmPlus GTM event to GA",po={EMBED:"vplayer video player embed",FIRST_PLAY:"vplayer video first play",COMPLETION_25_PERCENTAGE:"vplayer video 25% complete",COMPLETION_50_PERCENTAGE:"vplayer video 50% complete",COMPLETION_75_PERCENTAGE:"vplayer video 75% complete",COMPLETION_90_PERCENTAGE:"vplayer video 90% complete",AD_BLOCK:"vplayer video ad block",AD_REQUEST:"vplayer video ad request",AD_IMPRESSION:"vplayer video ad impression",AD_ERROR:"vplayer video ad error",AD_VIEWABLE_IMPRESSION:"vplayer video ad viewable impression",AD_COMPLETE:"vplayer video ad complete",AD_SKIP:"vplayer video ad skip",AD_PAUSE:"vplayer video ad pause",VIDEO_COMPLETE:"vplayer video complete",FULLSCREEN_ON:"vplayer video fullscreen on",FULLSCREEN_OFF:"vplayer video fullscreen off",SEEK:"vplayer video position seeked",VIDEO_MUTE:"vplayer video mute",VIDEO_UNMUTE:"vplayer video unmute",CONTROLS_MUTE_OR_UNMUTE:"controls Mute/Unmute button click",CONTROLS_PLAY_OR_PAUSE:"controls Play/Pause button click",CONTROLS_FULLSCREEN:"controls Fullscreen button click",CONTROLS_NEXT_VIDEO:"controls Next Video button click",CONTROLS_SETTINGS:"controls Settings button click",MINI_PLAYER_CLOSE:"vplayer video miniplayer close",LOADING_CONTENT_ERROR:"vplayer video player error",PLAYER_ERROR:"vplayer general player error",CONTENT_VIEWABLE_IMPRESSION:"vplayer video content viewable impression"},fo="loading ad provider library failed",ho="mid",yo=function e(t,n){var r=this;Ai()(this,e),f()(this,"store",void 0),f()(this,"analyticsEventsCallbacks",void 0),f()(this,"videoMuteSubscriber",void 0),f()(this,"videoFullscreenSubscriber",void 0),f()(this,"onMuteStateChanged",function(e){var t=gn.muted(e),n=hn.currentVideoTimeFragment(e),i=(new uo).setPosition(n).build(),o=t?po.VIDEO_MUTE:po.VIDEO_UNMUTE;r.analyticsEventsCallbacks.onEvent(o,i)}),f()(this,"onFullsScreenStateChanged",function(e){var t=gn.fullscreen(e),n=hn.currentVideoTimeFragment(e),i=(new uo).setPosition(n).build(),o=t?po.FULLSCREEN_ON:po.FULLSCREEN_OFF;r.analyticsEventsCallbacks.onEvent(o,i)}),this.store=t,this.analyticsEventsCallbacks=n,this.videoMuteSubscriber=new ji(t,e.getVideoMuteDependencies,this.onMuteStateChanged.bind(this)),this.videoFullscreenSubscriber=new ji(t,e.getVideoFullscreenDependencies,this.onFullsScreenStateChanged.bind(this))};f()(yo,"getVideoMuteDependencies",function(e){return[gn.muted(e)]}),f()(yo,"getVideoFullscreenDependencies",function(e){return[gn.fullscreen(e)]});var go=n(3),vo=n.n(go),mo=n(8),bo=n.n(mo),Oo=n(9),_o=n.n(Oo),So=n(5),Eo=n.n(So);n(20);var wo={root:null,threshold:.5,rootMargin:"0px"},Po=function(){function e(t,n,r){Ai()(this,e),f()(this,"store",void 0),f()(this,"observableElement",void 0),f()(this,"callback",void 0),f()(this,"isViewableTimeoutHandler",null),f()(this,"observer",void 0),f()(this,"didReport",!1),this.store=t,this.observableElement=n,this.callback=r,this.observer=new IntersectionObserver(this.onIntersecting.bind(this),wo)}return Vi()(e,[{key:"unobserve",value:function(){this.observer.unobserve(this.observableElement),this.clearIsViewableTimeout()}},{key:"observe",value:function(){this.observer.observe(this.observableElement)}},{key:"onPlay",value:function(){this.didReport||this.observe()}},{key:"onPause",value:function(){this.unobserve()}},{key:"onComplete",value:function(){this.didReport=!1,this.unobserve()}},{key:"onIntersecting",value:function(e){var t=e[0].isIntersecting;null===this.isViewableTimeoutHandler&&t?this.isViewableTimeoutHandler=setTimeout(this.notifyViewable.bind(this),2e3):this.clearIsViewableTimeout()}},{key:"clearIsViewableTimeout",value:function(){clearTimeout(this.isViewableTimeoutHandler),this.isViewableTimeoutHandler=null}},{key:"notifyViewable",value:function(){var e=this.store.getState;this.didReport=!0,this.callback(e()),this.unobserve()}}]),e}();function To(e){var t=function(){if("undefined"===typeof Reflect||!Reflect.construct)return!1;if(Reflect.construct.sham)return!1;if("function"===typeof Proxy)return!0;try{return Date.prototype.toString.call(Reflect.construct(Date,[],function(){})),!0}catch(e){return!1}}();return function(){var n,r=Eo()(e);if(t){var i=Eo()(this).constructor;n=Reflect.construct(r,arguments,i)}else n=r.apply(this,arguments);return _o()(this,n)}}var Ao=function(e){bo()(n,e);var t=To(n);function n(e,r,i){var o;return Ai()(this,n),o=t.call(this,e,r,i),f()(vo()(o),"videoTagStatusSubscriber",void 0),f()(vo()(o),"onVideoTagStatusChanged",function(e){var t=hn.videoTagStatus(e);"playing"===t?o.onPlay():"paused"===t||"seeking"===t?o.onPause():"complete"!==t&&"error"!==t||o.onComplete()}),o.videoTagStatusSubscriber=new ji(e,n.getVideoTagStatusDependencies,o.onVideoTagStatusChanged.bind(vo()(o))),o}return n}(Po);f()(Ao,"getVideoTagStatusDependencies",function(e){return[hn.videoTagStatus(e)]});var Co=function e(t,n,r,i){var o=this;Ai()(this,e),f()(this,"store",void 0),f()(this,"videoTagStatusSubscriber",void 0),f()(this,"analyticsEventsCallbacks",void 0),f()(this,"videoViewableImpressionObserver",void 0),f()(this,"firstPlayReportedIndex",-1),f()(this,"loadingStartTime",-1),f()(this,"registerVideoCallbacksIdNeeded",function(e,t){"none"!==hn.playbackMethod(e)&&document.getElementById(En(t)).addEventListener("loadstart",o.onLoadStart.bind(o),{once:!0})}),f()(this,"onLoadStart",function(){o.loadingStartTime=Date.now()}),f()(this,"getFirstPlayLabel",function(e){var t=hn.currentVideoTimeFragment(e),n=hn.currentVideoDuration(e),r=-1===o.loadingStartTime?-1:Date.now()-o.loadingStartTime;return(new uo).setPosition(t).setLoadTime(r).setDuration(n).build()}),f()(this,"onVideoTagStatusChanged",function(e){var t=hn.videoTagStatus(e),n=Cn.activeVideoIndex(e);if(!(n===o.firstPlayReportedIndex)&&"playing"===t){o.firstPlayReportedIndex=n;var r=o.getFirstPlayLabel(e);o.analyticsEventsCallbacks.onEvent(po.FIRST_PLAY,r)}}),f()(this,"reportVideoViewableImpression",function(e){var t=hn.currentVideoTimeFragment(e),n=(new uo).setPosition(t).build();o.analyticsEventsCallbacks.onEvent(po.CONTENT_VIEWABLE_IMPRESSION,n)}),this.store=t,this.analyticsEventsCallbacks=n,this.videoViewableImpressionObserver=new Ao(t,r,this.reportVideoViewableImpression.bind(this)),this.videoTagStatusSubscriber=new ji(t,e.getVideoTagDependencies,this.onVideoTagStatusChanged.bind(this)),this.registerVideoCallbacksIdNeeded(t.getState(),i)};f()(Co,"getVideoTagDependencies",function(e){return[hn.videoTagStatus(e)]});var Ro=[25,50,75,90],Do=function(){function e(){Ai()(this,e),f()(this,"lastReportedPercentage",void 0),this.lastReportedPercentage=0}return Vi()(e,[{key:"clear",value:function(){this.lastReportedPercentage=0}},{key:"updateConsumption",value:function(e,t){var n=e.position,r=e.duration,i=Math.round(n/r*100);i>this.lastReportedPercentage&&this.notifyReportableConsumption(e,i,t)}},{key:"notifyReportableConsumption",value:function(e,t,n){var r=this;Ro.filter(function(e){return e>r.lastReportedPercentage&&e<=t}).forEach(function(t){return n(t,e.position,e.duration)}),this.lastReportedPercentage=t}}]),e}(),Mo=function(){function e(t,n){var r=this;Ai()(this,e),f()(this,"store",void 0),f()(this,"analyticsEventsCallbacks",void 0),f()(this,"videoTimeSubscriber",void 0),f()(this,"videoTagStatusSubscriber",void 0),f()(this,"videoDataStoreSubscriber",void 0),f()(this,"percentageConsumption",void 0),f()(this,"previousVideoTagStatus",void 0),f()(this,"lastPlayedPosition",void 0),f()(this,"getVideoPercentageAction",function(e){switch(e){case 25:return po.COMPLETION_25_PERCENTAGE;case 50:return po.COMPLETION_50_PERCENTAGE;case 75:return po.COMPLETION_75_PERCENTAGE;case 90:return po.COMPLETION_90_PERCENTAGE;default:return""}}),f()(this,"onVideoTimeChanged",function(e){var t=hn.currentVideoDuration(e),n=hn.currentVideoTimeFragment(e);r.percentageConsumption.updateConsumption({position:n,duration:t},r.onVideoTimeReport.bind(r))}),f()(this,"onVideoTagStatusChanged",function(e){var t=hn.videoTagStatus(e),n=hn.currentVideoTimeFragment(e),i=hn.currentVideoDuration(e);if("seeking"===r.previousVideoTagStatus){var o=(new uo).setPosition(n).setPreviousPosition(r.lastPlayedPosition).build();r.analyticsEventsCallbacks.onEvent(po.SEEK,o)}else"seeking"===t&&(r.lastPlayedPosition=n);r.previousVideoTagStatus=t,"complete"===t&&r.onComplete(i)}),f()(this,"onVideoDataChanged",function(){r.percentageConsumption.clear()}),f()(this,"onComplete",function(e){var t=(new uo).setDuration(e).build();r.analyticsEventsCallbacks.onEvent(po.VIDEO_COMPLETE,t),r.percentageConsumption.clear()}),this.store=t,this.analyticsEventsCallbacks=n,this.videoTimeSubscriber=new ji(t,e.getVideoTimeDependencies,this.onVideoTimeChanged.bind(this)),this.videoTagStatusSubscriber=new ji(t,e.getVideoTagStatusDependencies,this.onVideoTagStatusChanged.bind(this)),this.videoDataStoreSubscriber=new ji(t,e.getVideoDataDependencies,this.onVideoDataChanged.bind(this)),this.percentageConsumption=new Do}return Vi()(e,[{key:"onVideoTimeReport",value:function(e,t,n){var r=this.getVideoPercentageAction(e),i=(new uo).setPosition(t).setDuration(n).build();this.analyticsEventsCallbacks.onEvent(r,i)}}]),e}();f()(Mo,"getVideoTimeDependencies",function(e){return[hn.currentVideoTime(e)]}),f()(Mo,"getVideoTagStatusDependencies",function(e){return[hn.videoTagStatus(e)]}),f()(Mo,"getVideoDataDependencies",function(e){return[Cn.videoData(e)]});var Io=function e(t,n,r,i){Ai()(this,e),f()(this,"store",void 0),f()(this,"timeEvents",void 0),f()(this,"videoSettingsEvents",void 0),f()(this,"videoTagStatusEvents",void 0),this.store=t,this.timeEvents=new Mo(t,n),this.videoSettingsEvents=new yo(t,n),this.videoTagStatusEvents=new Co(t,n,r,i)},ko=n(13),No=n.n(ko),Lo=function(){function e(){Ai()(this,e),f()(this,"batteryLevel","N/A"),f()(this,"batteryChargingState",!1),f()(this,"connectionSpeed","N/A"),f()(this,"connectionType","N/A"),this.setConnectionParams()}return Vi()(e,[{key:"setConnectionParams",value:function(){var e=this,t=navigator.connection||navigator.mozConnection||navigator.webkitConnection;t&&(this.updateConnectionParams(t.effectiveType,t.downlink),t.addEventListener("change",function(){return e.updateConnectionParams(t.effectiveType,t.downlink)}))}},{key:"updateConnectionParams",value:function(e,t){this.connectionType=e,this.connectionSpeed=t}},{key:"attach",value:function(){var e=so()(oo.a.mark(function e(){var t,n=this;return oo.a.wrap(function(e){for(;;)switch(e.prev=e.next){case 0:if(!navigator.getBattery){e.next=7;break}return e.next=3,navigator.getBattery();case 3:t=e.sent,this.updateBatteryParams(t.level,t.charging),t.ondischargingtimechange=function(e){return n.updateBatteryParams(e.target.level,e.target.charging)},t.onchargingtimechange=function(e){return n.updateBatteryParams(e.target.level,e.target.charging)};case 7:case"end":return e.stop()}},e,this)}));return function(){return e.apply(this,arguments)}}()},{key:"updateBatteryParams",value:function(e,t){this.batteryLevel="".concat(100*e),this.batteryChargingState=t}},{key:"getBatteryLevel",value:function(){return this.batteryLevel}},{key:"getBatteryChargingState",value:function(){return this.batteryChargingState}},{key:"getConnectionSpeed",value:function(){return this.connectionSpeed}},{key:"getConnectionType",value:function(){return this.connectionType}}]),e}(),xo=function(){"undefined"===typeof window["$$mm-analytics"]&&(window["$$mm-analytics"]={});var e=window;return"undefined"===typeof e["$$mm-analytics"].firstEmbed&&(e["$$mm-analytics"].firstEmbed=Date.now()),e["$$mm-analytics"].firstEmbed},Vo=function(){return"time in process=".concat(Date.now()-xo()," milliseconds")},jo=function(){function e(t,n){var r=this;Ai()(this,e),f()(this,"videoTag",null),f()(this,"deviceParams",void 0),f()(this,"trafficDomain",void 0),f()(this,"adTimeoutDuration",void 0),f()(this,"playbackMethod",void 0),f()(this,"configName",void 0),f()(this,"playerUniqKey",void 0),f()(this,"attach",so()(oo.a.mark(function e(){return oo.a.wrap(function(e){for(;;)switch(e.prev=e.next){case 0:return r.deviceParams=new Lo,e.next=3,r.deviceParams.attach();case 3:case"end":return e.stop()}},e)}))),f()(this,"translatePlaybackMethod",function(e){switch(e){case"lazyplay":return"scroll to play";case"autoplay":return"auto play";case"autoplay_when_viewable":return"auto play when viewable";case"none":return"click to play";default:return"none"}}),f()(this,"getAdTimeout",function(e){return e?"".concat(qn(e)," sec"):"none"}),f()(this,"getVideoTag",function(){return null===r.videoTag&&(r.videoTag=document.getElementById(En(r.playerUniqKey))),r.videoTag}),f()(this,"getUnitSize",function(){var e=r.getVideoTag();return null!==e?"".concat(e.clientWidth,":").concat(e.clientHeight):"none"}),f()(this,"getBatteryCharging",function(){return r.deviceParams.getBatteryChargingState()?"yes":"no"});var i=t.publisher_contribution,o=t.monetization,a=t.playback_method,s=t.config_name;this.playerUniqKey=n,this.trafficDomain=i,this.adTimeoutDuration=o&&o.ad_request_timeout?this.getAdTimeout(o.ad_request_timeout):"none",this.playbackMethod=this.translatePlaybackMethod(a),this.configName=s}return Vi()(e,[{key:"getDimensions",value:function(){return{mmPlusConfigName:this.configName,mmPlusPlaybackMethod:this.playbackMethod,mmPlusPrePvTimeInProcess:Vo(),mmPlusTrafficDomain:this.trafficDomain,mmPlusUnitSize:this.getUnitSize(),mmPlusUnitType:"video",mmPlusUserBatteryCharging:this.getBatteryCharging(),mmPlusUserBatteryLevel:this.deviceParams.getBatteryLevel(),mmPlusUserConnectionSpeed:this.deviceParams.getConnectionSpeed(),mmPlusUserConnectionType:this.deviceParams.getConnectionType(),mmPlusAdTimeoutDuration:this.adTimeoutDuration}}}]),e}();function Uo(e,t){var n=Object.keys(e);if(Object.getOwnPropertySymbols){var r=Object.getOwnPropertySymbols(e);t&&(r=r.filter(function(t){return Object.getOwnPropertyDescriptor(e,t).enumerable})),n.push.apply(n,r)}return n}function Fo(e){for(var t=1;t<arguments.length;t++){var n=null!=arguments[t]?arguments[t]:{};t%2?Uo(Object(n),!0).forEach(function(t){f()(e,t,n[t])}):Object.getOwnPropertyDescriptors?Object.defineProperties(e,Object.getOwnPropertyDescriptors(n)):Uo(Object(n)).forEach(function(t){Object.defineProperty(e,t,Object.getOwnPropertyDescriptor(n,t))})}return e}function Bo(e){var t=function(){if("undefined"===typeof Reflect||!Reflect.construct)return!1;if(Reflect.construct.sham)return!1;if("function"===typeof Proxy)return!0;try{return Date.prototype.toString.call(Reflect.construct(Date,[],function(){})),!0}catch(e){return!1}}();return function(){var n,r=Eo()(e);if(t){var i=Eo()(this).constructor;n=Reflect.construct(r,arguments,i)}else n=r.apply(this,arguments);return _o()(this,n)}}var Ho=function(e){bo()(n,e);var t=Bo(n);function n(e,r){var i,o;return Ai()(this,n),o=t.call(this,e,r),f()(vo()(o),"domain",void 0),f()(vo()(o),"getDimensions",function(){return Fo(Fo({},No()((i=vo()(o),Eo()(n.prototype)),"getDimensions",i).call(i)),{},{mmPlusDomain:o.domain})}),o.domain=window.location.hostname,o}return n}(jo);function qo(e,t){var n=Object.keys(e);if(Object.getOwnPropertySymbols){var r=Object.getOwnPropertySymbols(e);t&&(r=r.filter(function(t){return Object.getOwnPropertyDescriptor(e,t).enumerable})),n.push.apply(n,r)}return n}function Wo(e){for(var t=1;t<arguments.length;t++){var n=null!=arguments[t]?arguments[t]:{};t%2?qo(Object(n),!0).forEach(function(t){f()(e,t,n[t])}):Object.getOwnPropertyDescriptors?Object.defineProperties(e,Object.getOwnPropertyDescriptors(n)):qo(Object(n)).forEach(function(t){Object.defineProperty(e,t,Object.getOwnPropertyDescriptor(n,t))})}return e}function zo(e){var t=function(){if("undefined"===typeof Reflect||!Reflect.construct)return!1;if(Reflect.construct.sham)return!1;if("function"===typeof Proxy)return!0;try{return Date.prototype.toString.call(Reflect.construct(Date,[],function(){})),!0}catch(e){return!1}}();return function(){var n,r=Eo()(e);if(t){var i=Eo()(this).constructor;n=Reflect.construct(r,arguments,i)}else n=r.apply(this,arguments);return _o()(this,n)}}var Go=function(e){bo()(n,e);var t=zo(n);function n(e,r,i){var o;Ai()(this,n),o=t.call(this,i,r),f()(vo()(o),"store",void 0),f()(vo()(o),"playerUniqId",void 0),f()(vo()(o),"autoPlay",void 0),f()(vo()(o),"streamType",void 0),f()(vo()(o),"gaProperty",void 0),f()(vo()(o),"booleanToYesOrNo",function(e){return e?"yes":"no"}),f()(vo()(o),"getAspectRatio",function(e,t){var r=n.getCommonDenominator(e,t),i=t/r;return"".concat(e/r,":").concat(i)}),f()(vo()(o),"getUnitRadio",function(){var e=o.getVideoTag();if(null!==e){var t=e.clientWidth,n=e.clientHeight;return o.getAspectRatio(t,n)}return"none"}),f()(vo()(o),"getVideoDuration",function(e){var t=Dn.duration(e);return t?"".concat(t," sec"):"none"});var a=i.playback_method,s=i.content_type,u=i.ga_property;return o.store=e,o.playerUniqId=r,o.autoPlay=o.booleanToYesOrNo("none"!==a),o.streamType=s,o.gaProperty=u||o.trafficDomain,o}return Vi()(n,[{key:"getDimensions",value:function(){var e=this.store.getState;return Wo(Wo({},No()(Eo()(n.prototype),"getDimensions",this).call(this)),{},{mmPlusVideoPlayerId:this.playerUniqId,mmPlusUnitId:Dn.mediaId(e())||"none",mmPlusUnitTitle:Dn.title(e())||"none",mmPlusVideoAutoplay:this.autoPlay,mmPlusVideoDuration:this.getVideoDuration(e()),mmPlusVideoStreamType:this.streamType,mmPlusVideoPlaylistId:Cn.mediaId(e())||"none",mmPlusVideoMuted:this.booleanToYesOrNo(gn.muted(e())),mmPlusUnitTags:Dn.tags(e()).toString()||"none",mmPlusUnitOrderNumber:Cn.activeVideoIndex(e()),mmPlusTrafficReferrer:document.referrer,mmPlusUnitProvider:Dn.provider(e())||"none",mmPlusUnitCreator:Dn.creator(e())||"none",mmPlusUnitExternalId:Dn.externalId(e())||"none",mmPlusUnitRatio:this.getUnitRadio(),mmPlusGaProperty:this.gaProperty,mmPlusVideoPlayerType:"vplayer",mmPlusVideoThumbnailsOn:"none",mmPlusVideoClosedCaptionsOn:"none",mmPlusVideoRecommendationsVisible:"none"})}}]),n}(jo);function $o(e){var t=function(){if("undefined"===typeof Reflect||!Reflect.construct)return!1;if(Reflect.construct.sham)return!1;if("function"===typeof Proxy)return!0;try{return Date.prototype.toString.call(Reflect.construct(Date,[],function(){})),!0}catch(e){return!1}}();return function(){var n,r=Eo()(e);if(t){var i=Eo()(this).constructor;n=Reflect.construct(r,arguments,i)}else n=r.apply(this,arguments);return _o()(this,n)}}f()(Go,"getCommonDenominator",function(e,t){for(var n=e,r=t;r;){var i=r;r=n%r,n=i}return n});var Ko=function(e){bo()(n,e);var t=$o(n);function n(e,r,i){var o;return Ai()(this,n),o=t.call(this,e,r,i),f()(vo()(o),"adStatusSubscriber",void 0),f()(vo()(o),"onAdStatusChanged",function(e){var t=_i.adStatus(e);"playing"===t?o.onPlay():"paused"===t?o.onPause():Hi(t)||o.onComplete()}),o.adStatusSubscriber=new ji(e,n.getAdStatusDependencies,o.onAdStatusChanged.bind(vo()(o))),o}return n}(Po);f()(Ko,"getAdStatusDependencies",function(e){return[_i.adStatus(e)]});var Yo=function e(t,n,r){var i=this;Ai()(this,e),f()(this,"store",void 0),f()(this,"analyticsCallback",void 0),f()(this,"adStatusSubscriber",void 0),f()(this,"adImpressionSubscriber",void 0),f()(this,"adProviderLoadingStatusSubscriber",void 0),f()(this,"adViewableImpressionObserver",void 0),f()(this,"initAdBlockChecker",function(t){""===Fi.loadingImaStatus(t.getState())?i.adProviderLoadingStatusSubscriber=new ji(t,e.getAdProviderLoadingStatusDependencies,i.onAdProviderLoadingStatusChanged.bind(i)):i.onAdProviderLoadingStatusChanged(t.getState())}),f()(this,"getAdOrderFromPlayedMidrolls",function(e){return e&&e.length>0?e[e.length-1]:0}),f()(this,"getFullAdLabel",function(e){var t=hn.currentVideoTimeFragment(e),n=_i.adDuration(e),r=_i.playedMidrolls(e),o=_i.slotNumber(e),a=_i.podNumber(e),s=i.getAdOrderFromPlayedMidrolls(r);return(new uo).setAdType(ho).setPosition(t).setAdDuration(n).setAdOrder(s).setAdSlotNumber(o).setAdPodNumber(a).build()}),f()(this,"reportAdBlock",function(){i.analyticsCallback.onEvent(po.AD_BLOCK)}),f()(this,"reportError",function(e){var t=(new uo).setErrorMessage(e).build();i.analyticsCallback.onEvent(po.PLAYER_ERROR,t)}),f()(this,"reportAdRequested",function(e){var t=hn.currentVideoTimeFragment(e),n=_i.playedMidrolls(e),r=i.getAdOrderFromPlayedMidrolls(n),o=(new uo).setPosition(t).setAdOrder(r).build();i.analyticsCallback.onEvent(po.AD_REQUEST,o)}),f()(this,"reportAdImpression",function(e){var t=i.getFullAdLabel(e);i.analyticsCallback.onEvent(po.AD_IMPRESSION,t)}),f()(this,"reportAdError",function(e){var t=_i.adErrorMessage(e),n=_i.slotNumber(e),r=_i.podNumber(e),o=(new uo).setAdType(ho).setErrorMessage(t).setAdPodNumber(r).setAdSlotNumber(n).build();i.analyticsCallback.onEvent(po.AD_ERROR,o)}),f()(this,"reportAdComplete",function(e){var t=i.getFullAdLabel(e);i.analyticsCallback.onEvent(po.AD_COMPLETE,t)}),f()(this,"reportAdSkipped",function(e){var t=i.getFullAdLabel(e);i.analyticsCallback.onEvent(po.AD_SKIP,t)}),f()(this,"reportAdPaused",function(e){var t=i.getFullAdLabel(e);i.analyticsCallback.onEvent(po.AD_PAUSE,t)}),f()(this,"reportAdViewableImpression",function(e){var t=hn.currentVideoTimeFragment(e),n=_i.adDuration(e),r=_i.slotNumber(e),o=_i.podNumber(e),a=(new uo).setPosition(t).setAdType(ho).setAdDuration(n).setAdPodNumber(o).setAdSlotNumber(r).build();i.analyticsCallback.onEvent(po.AD_VIEWABLE_IMPRESSION,a)}),f()(this,"onAdStatusChanged",function(e){var t=_i.adStatus(e);"requested"===t&&i.reportAdRequested(e),"error"===t&&i.reportAdError(e),"completed"===t&&i.reportAdComplete(e),"skipped"===t&&i.reportAdSkipped(e),"paused"===t&&i.reportAdPaused(e)}),f()(this,"onAdProviderLoadingStatusChanged",function(e){var t=Fi.loadingImaStatus(e);"blocked"===t?i.reportAdBlock():"error"===t&&i.reportError(fo)}),f()(this,"onAdImpressionChanged",function(e){i.reportAdImpression(e)}),this.store=t,this.analyticsCallback=n,this.adStatusSubscriber=new ji(t,e.getAdStatusDependencies,this.onAdStatusChanged.bind(this)),this.adImpressionSubscriber=new ji(t,e.getAdImpressionDependencies,this.onAdImpressionChanged.bind(this)),this.adViewableImpressionObserver=new Ko(t,r,this.reportAdViewableImpression.bind(this)),this.initAdBlockChecker(t)};f()(Yo,"getAdProviderLoadingStatusDependencies",function(e){return[Fi.loadingImaStatus(e)]}),f()(Yo,"getAdStatusDependencies",function(e){return[_i.adStatus(e)]}),f()(Yo,"getAdImpressionDependencies",function(e){return[_i.adImpression(e)]});var Zo=pn.userInteraction,Xo=function(e){return Zo(e).userInteractionType},Jo=function e(t,n){var r=this;Ai()(this,e),f()(this,"store",void 0),f()(this,"analyticsCallbacks",void 0),f()(this,"userInteraction",void 0),f()(this,"getLabel",function(e){var t=hn.currentVideoTimeFragment(e);return(new uo).setPosition(t).build()}),f()(this,"reportMuteOrUnmute",function(e){r.analyticsCallbacks.onEvent(po.CONTROLS_MUTE_OR_UNMUTE,r.getLabel(e))}),f()(this,"reportFullscreen",function(e){r.analyticsCallbacks.onEvent(po.CONTROLS_FULLSCREEN,r.getLabel(e))}),f()(this,"reportPlayOrPause",function(e){r.analyticsCallbacks.onEvent(po.CONTROLS_PLAY_OR_PAUSE,r.getLabel(e))}),f()(this,"reportNextVideo",function(e){r.analyticsCallbacks.onEvent(po.CONTROLS_NEXT_VIDEO,r.getLabel(e))}),f()(this,"reportSettings",function(e){r.analyticsCallbacks.onEvent(po.CONTROLS_SETTINGS,r.getLabel(e))}),f()(this,"reportMiniPlayerClosed",function(e){r.analyticsCallbacks.onEvent(po.MINI_PLAYER_CLOSE,r.getLabel(e))}),f()(this,"onUserInteractionChanged",function(e){switch(Xo(e)){case"mute":case"unmute":r.reportMuteOrUnmute(e);break;case"fullscreen":r.reportFullscreen(e);break;case"play":case"pause":r.reportPlayOrPause(e);break;case"settings":r.reportSettings(e);break;case"nextVideo":r.reportNextVideo(e);break;case"closeMiniPlayer":r.reportMiniPlayerClosed(e)}}),this.store=t,this.analyticsCallbacks=n,this.userInteraction=new ji(t,e.getUserInteractionDependencies,this.onUserInteractionChanged.bind(this))};function Qo(e,t){var n=Object.keys(e);if(Object.getOwnPropertySymbols){var r=Object.getOwnPropertySymbols(e);t&&(r=r.filter(function(t){return Object.getOwnPropertyDescriptor(e,t).enumerable})),n.push.apply(n,r)}return n}function ea(e){for(var t=1;t<arguments.length;t++){var n=null!=arguments[t]?arguments[t]:{};t%2?Qo(Object(n),!0).forEach(function(t){f()(e,t,n[t])}):Object.getOwnPropertyDescriptors?Object.defineProperties(e,Object.getOwnPropertyDescriptors(n)):Qo(Object(n)).forEach(function(t){Object.defineProperty(e,t,Object.getOwnPropertyDescriptor(n,t))})}return e}f()(Jo,"getUserInteractionDependencies",function(e){return[Xo(e)]});var ta=function e(t,n,r,i){var o=this;Ai()(this,e),f()(this,"store",void 0),f()(this,"videoEventsReporter",void 0),f()(this,"monetizationEventsReporter",void 0),f()(this,"userInteractionReporter",void 0),f()(this,"eventCustomDimensions",void 0),f()(this,"dataLayer",null),f()(this,"attach",function(){var e=so()(oo.a.mark(function e(t,n,r){return oo.a.wrap(function(e){for(;;)switch(e.prev=e.next){case 0:return o.eventCustomDimensions=new Go(t,n,r),e.next=3,o.eventCustomDimensions.attach();case 3:return e.next=5,o.reportReady(t,n,r);case 5:o.reportEmbed();case 6:case"end":return e.stop()}},e)}));return function(t,n,r){return e.apply(this,arguments)}}()),f()(this,"initDataLayer",function(){var e;try{e=$n(window.parent)}catch(t){e=$n(window)}o.dataLayer=window[e]}),f()(this,"reportReady",function(){var e=so()(oo.a.mark(function e(t,n,r){var i;return oo.a.wrap(function(e){for(;;)switch(e.prev=e.next){case 0:return i=new Ho(r,n),e.next=3,i.attach();case 3:o.dataLayer.push(ea({event:co},i.getDimensions()));case 4:case"end":return e.stop()}},e)}));return function(t,n,r){return e.apply(this,arguments)}}()),f()(this,"reportEmbed",function(){o.onEvent(po.EMBED)}),f()(this,"onEvent",function(e,t,n,r){var i=r||o.eventCustomDimensions.getDimensions(),a=n||lo;o.dataLayer.push(ea(ea({event:a,mmPlusGA_event_action:e,mmPlusGA_event_label:t,mmPlusGA_event_category:"MMVideo"},i),{},{time:Date.now()}))}),this.store=t,this.initDataLayer(),this.videoEventsReporter=new Io(t,this,i,n),this.monetizationEventsReporter=new Yo(t,this,i),window.monetizationEventsReporter=this.monetizationEventsReporter,this.userInteractionReporter=new Jo(t,this),this.attach(t,n,r)},na=pn.discovery,ra=function(e){return na(e).nextVideo},ia=n(51).version,oa=function e(){var t=this;Ai()(this,e),f()(this,"controlsLoaded",void 0),f()(this,"loadInternalPlugins",function(e,n,r){var i=r.dev_config,o=e.getState,a=i&&!Un(i.pluginsPath)?i.pluginsPath:function(){try{return"https://www.oo-syringe.com/prod/players"}catch(w){return"./dist/bundle"}}();t.loadAnalyticsPlugin(e,n,r),t.loadActionsPlugin(n,a),t.loadMonetizationPlugin(e,n),t.loadControlsPlugin(n,a),t.loadAnchorPlugin(n,a),t.loadComscorePlugin(n,r,a),Sr(o())&&Un(Zn(o()))&&t.loadCloseBarPlugin(n,a),"none"!==ra(o())&&t.loadDiscoveryPlugin(n,a),Un(Zn(o()))||t.loadSplitViewPlugin(n,a)}),f()(this,"loadActionsPlugin",function(e,t){if(window.monti.dataset&&window.monti.dataset.plugins.actionsPlugin)window.monti.dataset.plugins.actionsPlugin(e);else{var n=document.createElement("script");n.setAttribute("type","text/javascript"),n.setAttribute("src","".concat(t,"/mplayer_actions_plugin.").concat(ia,".js")),n.addEventListener("load",function(){window.monti.dataset.plugins.actionsPlugin(e)}),n.addEventListener("error",function(){console.log("ACTIONS PLUGIN LOADER ERROR !")}),document.body.appendChild(n)}}),f()(this,"loadMonetizationPlugin",function(e,t){ro(e,t)}),f()(this,"loadControlsPlugin",function(e,t){if(window.monti.dataset&&window.monti.dataset.plugins.controlsPlugin)window.monti.dataset.plugins.controlsPlugin(e);else{var n=document.createElement("script");n.setAttribute("src","".concat(t,"/mplayer_controls_plugin.").concat(ia,".js")),n.setAttribute("type","text/javascript"),n.addEventListener("load",function(){window.monti.dataset.plugins.controlsPlugin(e)}),n.addEventListener("error",function(){console.log("CONTROLS PLUGIN LOADER ERROR !")}),document.body.appendChild(n)}}),f()(this,"loadAnchorPlugin",function(e,t){if(window.monti.dataset&&window.monti.dataset.plugins.anchorPlugin)window.monti.dataset.plugins.anchorPlugin(e);else{var n=document.createElement("script");n.setAttribute("src","".concat(t,"/mplayer_anchor_plugin.").concat(ia,".js")),n.setAttribute("type","text/javascript"),n.addEventListener("load",function(){window.monti.dataset.plugins.anchorPlugin(e)}),n.addEventListener("error",function(){console.log("ANCHOR PLUGIN LOADER ERROR !")}),document.body.appendChild(n)}}),f()(this,"loadSplitViewPlugin",function(e,t){if(window.monti.dataset&&window.monti.dataset.plugins.splitViewPlugin)window.monti.dataset.plugins.splitViewPlugin(e);else{var n=document.createElement("script");n.setAttribute("src","".concat(t,"/mplayer_split_view_plugin.").concat(ia,".js")),n.setAttribute("type","text/javascript"),n.addEventListener("load",function(){window.monti.dataset.plugins.splitViewPlugin(e)}),n.addEventListener("error",function(){console.log("SPLIT VIEW PLUGIN LOADER ERROR !")}),document.body.appendChild(n)}}),f()(this,"loadComscorePlugin",function(e,t,n){if(window.monti.dataset&&window.monti.dataset.plugins.comscorePlugin)window.monti.dataset.plugins.comscorePlugin(e,t);else{var r=document.createElement("script");r.setAttribute("src","".concat(n,"/mplayer_comscore_plugin.").concat(ia,".js")),r.setAttribute("type","text/javascript"),r.addEventListener("load",function(){window.monti.dataset.plugins.comscorePlugin(e,t)}),r.addEventListener("error",function(){console.log("COMSCORE PLUGIN LOADER ERROR !")}),document.body.appendChild(r)}}),f()(this,"loadAnalyticsPlugin",function(e,t,n){!function(e,t,n){var r=document.getElementById(bn(t));new ta(e,t,n,r)}(e,t,n)}),f()(this,"loadDiscoveryPlugin",function(e,t){if(window.monti.dataset&&window.monti.dataset.plugins.discoveryPlugin)window.monti.dataset.plugins.discoveryPlugin(e);else{var n=document.createElement("script");n.setAttribute("src","".concat(t,"/mplayer_discovery_plugin.").concat(ia,".js")),n.setAttribute("type","text/javascript"),n.addEventListener("load",function(){window.monti.dataset.plugins.discoveryPlugin(e)}),n.addEventListener("error",function(){console.log("DISCOVERY PLUGIN LOADER ERROR !")}),document.body.appendChild(n)}}),f()(this,"loadCloseBarPlugin",function(e,t){if(window.monti.dataset&&window.monti.dataset.plugins.closeBar)window.monti.dataset.plugins.closeBarPlugin(e);else{var n=document.createElement("script");n.setAttribute("src","".concat(t,"/mplayer_close_bar_plugin.").concat(ia,".js")),n.setAttribute("type","text/javascript"),n.addEventListener("load",function(){window.monti.dataset.plugins.closeBarPlugin(e)}),n.addEventListener("error",function(){console.log("CLOSE BAR PLUGIN LOADER ERROR !")}),document.body.appendChild(n)}}),this.controlsLoaded=!1};function aa(e){return function(t){var n=t.dispatch,r=t.getState;return function(t){return function(i){return"function"===typeof i?i(n,r,e):t(i)}}}}f()(oa,"instance",void 0),f()(oa,"getInstance",function(){return oa.instance||(oa.instance=new oa),oa.instance});var sa=aa();sa.withExtraArgument=aa;var ua=sa;function ca(e,t){var n=Object.keys(e);if(Object.getOwnPropertySymbols){var r=Object.getOwnPropertySymbols(e);t&&(r=r.filter(function(t){return Object.getOwnPropertyDescriptor(e,t).enumerable})),n.push.apply(n,r)}return n}function la(e){for(var t=1;t<arguments.length;t++){var n=null!=arguments[t]?arguments[t]:{};t%2?ca(Object(n),!0).forEach(function(t){f()(e,t,n[t])}):Object.getOwnPropertyDescriptors?Object.defineProperties(e,Object.getOwnPropertyDescriptors(n)):ca(Object(n)).forEach(function(t){Object.defineProperty(e,t,Object.getOwnPropertyDescriptor(n,t))})}return e}var da={loadingHLSStatus:"",loadingImaStatus:""};function pa(e,t){var n=Object.keys(e);if(Object.getOwnPropertySymbols){var r=Object.getOwnPropertySymbols(e);t&&(r=r.filter(function(t){return Object.getOwnPropertyDescriptor(e,t).enumerable})),n.push.apply(n,r)}return n}function fa(e){for(var t=1;t<arguments.length;t++){var n=null!=arguments[t]?arguments[t]:{};t%2?pa(Object(n),!0).forEach(function(t){f()(e,t,n[t])}):Object.getOwnPropertyDescriptors?Object.defineProperties(e,Object.getOwnPropertyDescriptors(n)):pa(Object(n)).forEach(function(t){Object.defineProperty(e,t,Object.getOwnPropertyDescriptor(n,t))})}return e}var ha={playerId:"",playerInstanceUniqId:null,playbackMethod:"none",videoTagStatus:"idle",pendingVideoTagStatus:{type:null,value:null},currentVideoTime:0,currentVideoTimeFragment:0,currentVideoBufferedTime:0,currentVideoDuration:0,playerMode:"desktop",playerVisibility:0,playerPlaceholderVisibility:0,playerSettings:{muted:!0,volume:.5,speed:1,quality:"Auto",selectedSettingsCategory:"",fullscreen:{pendingFullscreenRequest:"",isFullscreenOn:!1}},loader:{showBlackScreen:!1},playerSize:"",errorMessage:"",loadingPlayer:!1};function ya(e,t){var n=Object.keys(e);if(Object.getOwnPropertySymbols){var r=Object.getOwnPropertySymbols(e);t&&(r=r.filter(function(t){return Object.getOwnPropertyDescriptor(e,t).enumerable})),n.push.apply(n,r)}return n}function ga(e){for(var t=1;t<arguments.length;t++){var n=null!=arguments[t]?arguments[t]:{};t%2?ya(Object(n),!0).forEach(function(t){f()(e,t,n[t])}):Object.getOwnPropertyDescriptors?Object.defineProperties(e,Object.getOwnPropertyDescriptors(n)):ya(Object(n)).forEach(function(t){Object.defineProperty(e,t,Object.getOwnPropertyDescriptor(n,t))})}return e}var va={showVoltaxLogo:!0,brandingLogoSrc:"",brandingLogoUrl:"",brandingColor:null};function ma(e,t){var n=Object.keys(e);if(Object.getOwnPropertySymbols){var r=Object.getOwnPropertySymbols(e);t&&(r=r.filter(function(t){return Object.getOwnPropertyDescriptor(e,t).enumerable})),n.push.apply(n,r)}return n}function ba(e){for(var t=1;t<arguments.length;t++){var n=null!=arguments[t]?arguments[t]:{};t%2?ma(Object(n),!0).forEach(function(t){f()(e,t,n[t])}):Object.getOwnPropertyDescriptors?Object.defineProperties(e,Object.getOwnPropertyDescriptors(n)):ma(Object(n)).forEach(function(t){Object.defineProperty(e,t,Object.getOwnPropertyDescriptor(n,t))})}return e}var Oa={orientation:"right",canClose:!0,anchorData:{anchorEnabled:!1,anchorDisabledByUser:!1,anchorStatus:"inactive"},closableAd:!0,continueStreaming:!1,anchoringAppearance:"below",stickyBelowClassName:"",width:"",closeAfter:10,margins:{top:10,bottom:10,left:10,right:10}};function _a(e,t){var n=Object.keys(e);if(Object.getOwnPropertySymbols){var r=Object.getOwnPropertySymbols(e);t&&(r=r.filter(function(t){return Object.getOwnPropertyDescriptor(e,t).enumerable})),n.push.apply(n,r)}return n}function Sa(e){for(var t=1;t<arguments.length;t++){var n=null!=arguments[t]?arguments[t]:{};t%2?_a(Object(n),!0).forEach(function(t){f()(e,t,n[t])}):Object.getOwnPropertyDescriptors?Object.defineProperties(e,Object.getOwnPropertyDescriptors(n)):_a(Object(n)).forEach(function(t){Object.defineProperty(e,t,Object.getOwnPropertyDescriptor(n,t))})}return e}var Ea,wa={continuePlayingWhileWaitingForAd:!1,midrolls:{},prerollEnabled:!1,vpaidMode:"ENABLED",adRequestTimeout:1e4,adsData:{podNumber:0,slotNumber:0,adType:null,adTagUrlTemplate:null,adErrorMessage:null,adDuration:0,adCurrentTime:0,adOrder:0,adStatus:"",pendingAdStatus:{type:""},playedMidrolls:[],adImpression:0,adOpportunity:0,isVastAd:!1,adMuted:!0,adVolume:.5,currentAdTag:null,adUnit:"",loadingAd:!1}},Pa=n(32),Ta=n.n(Pa);!function(e){e.POST="post",e.GET="get",e.DELETE="delete",e.PUT="put",e.PATCH="patch",e.HEAD="head",e.OPTIONS="options"}(Ea||(Ea={}));var Aa=function(){function e(){Ai()(this,e)}return Vi()(e,null,[{key:"preformRequest",value:function(e,t){return new Promise(function(n,r){Ta()({method:e,url:t}).then(function(e){var t=e.data;n(t)}).catch(function(e){r(e)})})}},{key:"preformGet",value:function(e){return this.preformRequest(Ea.GET,e)}}]),e}();f()(Aa,"HTTP_STATUS_CODES",{OK:200,UNAUTHORIZED:401,INTERNAL_SERVER_ERROR:500,BAD_REQUEST:400,NOT_FOUND:404,CONFLICT:409});var Ca=function(){function e(){Ai()(this,e)}return Vi()(e,null,[{key:"getSemanticPlaylistUrl",value:function(e,t,n){if(n&&!Un(n.semantic_url))return n.semantic_url;var r=function(e){for(var t="",n=0,r=0;r<e.length;r+=1)n=e.charCodeAt(r)+2,t+=String.fromCharCode(n);return encodeURIComponent(encodeURIComponent(t))}(e.split("?")[0]),i="".concat(function(){try{return"https://semantic-matching.minutemediaservices.com/semantic-feed"}catch(w){return"https://semantic-matching.minutemediaservices.com/semantic-feed"}}(),"/").concat(r),o="?";return Un(t.minimumDateFactor)||(i="".concat(i).concat(o,"minimum_date_factor=").concat(t.minimumDateFactor),o="&"),Un(t.tags)||(i="".concat(i).concat(o,"tags=").concat(t.tags),o="&"),Un(t.scopedKeywords)||(i="".concat(i).concat(o,"scoped_keywords=").concat(t.scopedKeywords),o="&"),Un(t.scannedElement)||Un(t.scannedElementType)||(i="".concat(i).concat(o,"article_container=").concat(function(e,t){switch(t){case"id":return"".concat("#").concat(e);case"className":return e.split(" ").map(function(e){return"".concat(".").concat(e)}).join("");default:return"".concat("").concat(e)}}(t.scannedElement,t.scannedElementType)),o="&"),Un(t.scanImagesOnPage)||(i="".concat(i).concat(o,"scan_images=").concat(String(t.scanImagesOnPage))),i}},{key:"getSpecificPlaylistUrl",value:function(e,t){return t&&!Un(t.playlist_url)?t.playlist_url:"".concat("https://vms-videos.minutemediaservices.com","/").concat(e,"/").concat(e,".json")}}]),e}(),Ra=function(e,t){var n=e.findIndex(function(e){return e.type===t});return n>=0?e[n].file:""},Da=function(){function e(){Ai()(this,e)}return Vi()(e,null,[{key:"getSemanticPlaylist",value:function(e,t){var n=window.location.href,r=Ca.getSemanticPlaylistUrl(n,e,t);return Aa.preformGet(r)}},{key:"getSpecificPlaylist",value:function(e,t){var n=Ca.getSpecificPlaylistUrl(e,t);return Aa.preformGet(n)}}]),e}();f()(Da,"getPromotedVideos",function(){var e=so()(oo.a.mark(function e(t){var n;return oo.a.wrap(function(e){for(;;)switch(e.prev=e.next){case 0:return n=t.map(function(e){return Da.getSpecificPlaylist(e).then(function(e){return e.data}).catch(function(){return[]})}),e.abrupt("return",new Promise(function(e){Promise.all(n).then(function(t){var n=t.reduce(function(e,t){return e.concat(t)},[]);n.length>0&&e(n)})}));case 2:case"end":return e.stop()}},e)}));return function(t){return e.apply(this,arguments)}}());var Ma=function(e,t){return function(n){n({type:"[CORE] load video request success",payload:e.data.map(function(e,n){return{mediaId:e.payload_id,tags:e.tags,sources:e.sources,duration:e.duration,thumbnail:e.image,title:t?e.title:"",description:e.description,creator:e.creator,provider:e.video_provider,externalId:e.external_id,index:n}})})}},Ia=function(e){return function(t){t({type:"[CORE] load video request error",payload:e})}},ka=function(e,t,n){return function(){var r=so()(oo.a.mark(function r(i){var o;return oo.a.wrap(function(r){for(;;)switch(r.prev=r.next){case 0:return i({type:"[CORE] load video request"}),r.prev=1,r.next=4,Da.getSpecificPlaylist(e,n);case 4:o=r.sent,Ma(o,t)(i),r.next=11;break;case 8:r.prev=8,r.t0=r.catch(1),Ia(Xn.GENERAL_ERROR)(i);case 11:case"end":return r.stop()}},r,null,[[1,8]])}));return function(e){return r.apply(this,arguments)}}()},Na=function(e,t,n){return function(){var r=so()(oo.a.mark(function r(i){var o,a;return oo.a.wrap(function(r){for(;;)switch(r.prev=r.next){case 0:if(i({type:"[CORE] load video request"}),o=[],r.prev=2,!(Array.isArray(e.promotedVideos)&&e.promotedVideos.length>0)){r.next=7;break}return r.next=6,Da.getPromotedVideos(e.promotedVideos);case 6:o=r.sent;case 7:return r.next=9,Da.getSemanticPlaylist(e,n);case 9:(a=r.sent).data=o.concat(a.data),Ma(a,t)(i),r.next=17;break;case 14:r.prev=14,r.t0=r.catch(2),o.length>0?Ma({data:o},t)(i):Ia(Xn.GENERAL_ERROR)(i);case 17:case"end":return r.stop()}},r,null,[[2,14]])}));return function(e){return r.apply(this,arguments)}}()},La=function(e,t){return function(n){n({type:"[CORE] set current video",payload:{index:e,videoData:t}})}};function xa(e,t){var n=Object.keys(e);if(Object.getOwnPropertySymbols){var r=Object.getOwnPropertySymbols(e);t&&(r=r.filter(function(t){return Object.getOwnPropertyDescriptor(e,t).enumerable})),n.push.apply(n,r)}return n}function Va(e){for(var t=1;t<arguments.length;t++){var n=null!=arguments[t]?arguments[t]:{};t%2?xa(Object(n),!0).forEach(function(t){f()(e,t,n[t])}):Object.getOwnPropertyDescriptors?Object.defineProperties(e,Object.getOwnPropertyDescriptors(n)):xa(Object(n)).forEach(function(t){Object.defineProperty(e,t,Object.getOwnPropertyDescriptor(n,t))})}return e}var ja={activeVideoIndex:0,mediaType:"semantic",mediaId:"",loadingMedia:!1,mediaLoadingError:"",mediaRequest:{type:null,value:""},videoList:[],videoData:{mediaId:"",tags:[],sources:[],duration:0,thumbnail:"",title:"",showTitle:!0,description:"",creator:"",provider:"",externalId:"",index:0}};function Ua(e,t){var n=Object.keys(e);if(Object.getOwnPropertySymbols){var r=Object.getOwnPropertySymbols(e);t&&(r=r.filter(function(t){return Object.getOwnPropertyDescriptor(e,t).enumerable})),n.push.apply(n,r)}return n}function Fa(e){for(var t=1;t<arguments.length;t++){var n=null!=arguments[t]?arguments[t]:{};t%2?Ua(Object(n),!0).forEach(function(t){f()(e,t,n[t])}):Object.getOwnPropertyDescriptors?Object.defineProperties(e,Object.getOwnPropertyDescriptors(n)):Ua(Object(n)).forEach(function(t){Object.defineProperty(e,t,Object.getOwnPropertyDescriptor(n,t))})}return e}var Ba={promotedVideos:[],scannedElement:"",tags:"",scopedKeywords:"",minimumDateFactor:"",scannedElementType:null,scanImagesOnPage:!1};function Ha(e,t){var n=Object.keys(e);if(Object.getOwnPropertySymbols){var r=Object.getOwnPropertySymbols(e);t&&(r=r.filter(function(t){return Object.getOwnPropertyDescriptor(e,t).enumerable})),n.push.apply(n,r)}return n}function qa(e){for(var t=1;t<arguments.length;t++){var n=null!=arguments[t]?arguments[t]:{};t%2?Ha(Object(n),!0).forEach(function(t){f()(e,t,n[t])}):Object.getOwnPropertyDescriptors?Object.defineProperties(e,Object.getOwnPropertyDescriptors(n)):Ha(Object(n)).forEach(function(t){Object.defineProperty(e,t,Object.getOwnPropertyDescriptor(n,t))})}return e}var Wa={userInteractionType:""};function za(e,t){var n=Object.keys(e);if(Object.getOwnPropertySymbols){var r=Object.getOwnPropertySymbols(e);t&&(r=r.filter(function(t){return Object.getOwnPropertyDescriptor(e,t).enumerable})),n.push.apply(n,r)}return n}function Ga(e){for(var t=1;t<arguments.length;t++){var n=null!=arguments[t]?arguments[t]:{};t%2?za(Object(n),!0).forEach(function(t){f()(e,t,n[t])}):Object.getOwnPropertyDescriptors?Object.defineProperties(e,Object.getOwnPropertyDescriptors(n)):za(Object(n)).forEach(function(t){Object.defineProperty(e,t,Object.getOwnPropertyDescriptor(n,t))})}return e}var $a={splitViewRatio:null};function Ka(e,t){var n=Object.keys(e);if(Object.getOwnPropertySymbols){var r=Object.getOwnPropertySymbols(e);t&&(r=r.filter(function(t){return Object.getOwnPropertyDescriptor(e,t).enumerable})),n.push.apply(n,r)}return n}function Ya(e){for(var t=1;t<arguments.length;t++){var n=null!=arguments[t]?arguments[t]:{};t%2?Ka(Object(n),!0).forEach(function(t){f()(e,t,n[t])}):Object.getOwnPropertyDescriptors?Object.defineProperties(e,Object.getOwnPropertyDescriptors(n)):Ka(Object(n)).forEach(function(t){Object.defineProperty(e,t,Object.getOwnPropertyDescriptor(n,t))})}return e}var Za={nextVideo:"none",showUpNext:!1,showSkippableContent:!1},Xa=function(e){return"none"===e?"none":"up_next"===e?"upNext":"skippable_content"===e?"skippableContent":"none"},Ja=function(e){for(var t=Object.keys(e),n={},r=0;r<t.length;r++){var i=t[r];"function"===typeof e[i]&&(n[i]=e[i])}var o,a=Object.keys(n);try{!function(e){Object.keys(e).forEach(function(t){var n=e[t];if("undefined"===typeof n(void 0,{type:yt.INIT}))throw new Error('Reducer "'+t+"\" returned undefined during initialization. If the state passed to the reducer is undefined, you must explicitly return the initial state. The initial state may not be undefined. If you don't want to set a value for this reducer, you can use null instead of undefined.");if("undefined"===typeof n(void 0,{type:yt.PROBE_UNKNOWN_ACTION()}))throw new Error('Reducer "'+t+"\" returned undefined when probed with a random type. Don't try to handle "+yt.INIT+' or other actions in "redux/*" namespace. They are considered private. Instead, you must return the current state for any unknown actions, unless it is undefined, in which case you must return the initial state, regardless of the action type. The initial state may not be undefined, but can be null.')})}(n)}catch(s){o=s}return function(e,t){if(void 0===e&&(e={}),o)throw o;for(var r=!1,i={},s=0;s<a.length;s++){var u=a[s],c=n[u],l=e[u],d=c(l,t);if("undefined"===typeof d){var p=mt(u,t);throw new Error(p)}i[u]=d,r=r||d!==l}return(r=r||a.length!==Object.keys(e).length)?i:e}}({dependenciesLoadingStatus:function(){var e=arguments.length>0&&void 0!==arguments[0]?arguments[0]:da,t=arguments.length>1?arguments[1]:void 0;switch(t.type){case"[CORE] update hls status":return la(la({},e),{},{loadingHLSStatus:t.payload});case"[CORE] update ima status":return la(la({},e),{},{loadingImaStatus:t.payload});default:return e}},playerData:function(){var e=arguments.length>0&&void 0!==arguments[0]?arguments[0]:ha,t=arguments.length>1?arguments[1]:void 0;switch(t.type){case"[CORE] initiate store":var n=t.payload;return fa({},function(e,t,n){var r=t.playback_method,i=t.player_id;return fa(fa({},e),{},{playbackMethod:Un(r)?e.playbackMethod:r,playerId:Un(i)?e.playerId:i,playerInstanceUniqId:n,playerMode:Fn()?"mobile":"desktop"})}(e,n.initiateParams,n.playerInstanceUniqId));case"[CORE] reset player data time params":return fa(fa({},e),{},{currentVideoTimeFragment:0,currentVideoBufferedTime:0,currentVideoDuration:0,currentVideoTime:0});case"[COMMON] set mute video":return fa(fa({},e),{},{playerSettings:fa(fa({},e.playerSettings),{},{muted:t.payload})});case"[COMMON] set volume":return fa(fa({},e),{},{playerSettings:fa(fa({},e.playerSettings),{},{volume:t.payload})});case"[COMMON] change selected settings category":return fa(fa({},e),{},{playerSettings:fa(fa({},e.playerSettings),{},{selectedSettingsCategory:t.payload})});case"[COMMON] change settings speed":return fa(fa({},e),{},{playerSettings:fa(fa({},e.playerSettings),{},{speed:t.payload})});case"[COMMON] change settings quality":return fa(fa({},e),{},{playerSettings:fa(fa({},e.playerSettings),{},{quality:t.payload})});case"[COMMON] set fullscreen":return fa(fa({},e),{},{playerSettings:fa(fa({},e.playerSettings),{},{fullscreen:fa(fa({},e.playerSettings.fullscreen),{},{isFullscreenOn:t.payload,pendingFullscreenRequest:""})})});case"[COMMON] set fullscreen request":return fa(fa({},e),{},{playerSettings:fa(fa({},e.playerSettings),{},{fullscreen:fa(fa({},e.playerSettings.fullscreen),{},{pendingFullscreenRequest:t.payload})})});case"[COMMON] set pending video status":var r=t.payload.pendingStatusObject;return fa(fa({},e),{},{pendingVideoTagStatus:fa({},r)});case"[COMMON] set player mode":return fa(fa({},e),{},{playerMode:t.payload});case"[CORE] update video current fragment position":return fa(fa({},e),{},{currentVideoTimeFragment:t.payload});case"[CORE] update video current position":return fa(fa({},e),{},{currentVideoTime:t.payload});case"[CORE] update video current buffered time":return fa(fa({},e),{},{currentVideoBufferedTime:t.payload});case"[CORE] update video current duration":return fa(fa({},e),{},{currentVideoDuration:t.payload});case"[CORE] change video tag status":return fa(fa({},e),{},{videoTagStatus:t.payload});case"[CORE] update player visibility":return fa(fa({},e),{},{playerVisibility:t.payload});case"[CORE] update placeholder visibility":return fa(fa({},e),{},{playerPlaceholderVisibility:t.payload});case"[CORE] change loading player status":return fa(fa({},e),{},{loadingPlayer:t.payload});case"[COMMON] show black screen with loader":return fa(fa({},e),{},{loader:fa(fa({},e.loader),{},{showBlackScreen:t.payload})});case"[CORE] set player size":return fa(fa({},e),{},{playerSize:t.payload});case"[COMMON] set error message":return fa(fa({},e),{},{errorMessage:t.payload});default:return e}},brandingData:function(){var e=arguments.length>0&&void 0!==arguments[0]?arguments[0]:va,t=arguments.length>1?arguments[1]:void 0;switch(t.type){case"[CORE] initiate store":return ga({},function(e,t){var n=t.powered_by_strip,r=t.brand_logo,i=t.brand_logo_click_url,o=t.brand_color;return ga(ga({},e),{},{showVoltaxLogo:Un(n)?e.showVoltaxLogo:n,brandingLogoSrc:Un(r)?e.brandingLogoSrc:r,brandingLogoUrl:Un(i)?e.brandingLogoUrl:i,brandingColor:Un(o)?e.brandingColor:o})}(e,t.payload.initiateParams));default:return e}},anchorOptions:function(){var e=arguments.length>0&&void 0!==arguments[0]?arguments[0]:Oa,t=arguments.length>1?arguments[1]:void 0;switch(t.type){case"[CORE] initiate store":return ba({},function(e,t){var n=t.anchor_options;if(!Un(n)){var r=n.anchoring_appearance,i=n.can_close,o=n.closable_ad,a=n.close_after,s=n.continue_streaming,u=n.orientation,c=n.margins,l=n.sticky_below_class_name,d=n.width,p=Un(c)?e.margins:{top:Number.isInteger(c.top)?c.top:e.margins.top,bottom:Number.isInteger(c.bottom)?c.bottom:e.margins.bottom,left:Number.isInteger(c.left)?c.left:e.margins.left,right:Number.isInteger(c.right)?c.right:e.margins.right};return ba(ba({},e),{},{anchoringAppearance:r||e.anchoringAppearance,canClose:Un(i)?e.canClose:i,orientation:Un(u)?e.orientation:u,closableAd:Un(o)?e.closableAd:o,closeAfter:Un(a)?e.closeAfter:a,continueStreaming:Un(s)?e.continueStreaming:s,stickyBelowClassName:Un(l)?e.stickyBelowClassName:l,width:Un(d)?e.width:d,margins:p,anchorData:ba(ba({},e.anchorData),{},{anchorEnabled:!0})})}return e}(e,t.payload.initiateParams));case"[COMMON] set anchor enable":return ba(ba({},e),{},{anchorData:ba(ba({},e.anchorData),{},{anchorEnabled:t.payload})});case"[ANCHOR] update is anchor status":return ba(ba({},e),{},{anchorData:ba(ba({},e.anchorData),{},{anchorStatus:t.payload})});case"[COMMON] set anchor disabled by user":return ba(ba({},e),{},{anchorData:ba(ba({},e.anchorData),{},{anchorDisabledByUser:t.payload})});default:return e}},monetization:function(){var e=arguments.length>0&&void 0!==arguments[0]?arguments[0]:wa,t=arguments.length>1?arguments[1]:void 0;switch(t.type){case"[CORE] initiate store":return Sa({},function(e,t){var n=t.monetization;if(Un(n))return e;var r=n.ad_tag,i=n.ad_type,o=n.vpaid_mode,a=n.ad_request_timeout,s=n.continue_content_play_while_waiting_for_ad,u=n.midrolls,c=u&&u.on&&u.on.sort(Wn),l=Un(s)?e.continuePlayingWhileWaitingForAd:s,d=c?c.indexOf(0):-1,p=-1!==d&&!l;return p&&(c=c.splice(d,1)),Sa(Sa({},e),{},{midrolls:Sa(Sa({},e.midrolls),{},{every:u&&u.every,on:c}),prerollEnabled:p,adRequestTimeout:Un(a)?e.adRequestTimeout:parseInt(a,10),vpaidMode:Un(o)?e.vpaidMode:o,continuePlayingWhileWaitingForAd:l,adsData:Sa(Sa({},e.adsData),{},{adType:Un(i)?e.adsData.adType:i,adTagUrlTemplate:Un(r)?e.adsData.adTagUrlTemplate:r})})}(e,t.payload.initiateParams));case"[COMMON] set new ad tag url template":return Sa(Sa({},e),{},{adsData:Sa(Sa({},e.adsData),{},{adTagUrlTemplate:t.payload})});case"[MONETIZATION] change ad status":return Sa(Sa({},e),{},{adsData:Sa(Sa({},e.adsData),{},{adStatus:t.payload,adErrorMessage:null})});case"[MONETIZATION] change ad tag":var n=t.payload,r=n.adUnit,i=n.adTag;return Sa(Sa({},e),{},{adsData:Sa(Sa({},e.adsData),{},{currentAdTag:i,adUnit:r})});case"[MONETIZATION] change pending ad status":return Sa(Sa({},e),{},{adsData:Sa(Sa({},e.adsData),{},{pendingAdStatus:t.payload})});case"[MONETIZATION] change ad error":return Sa(Sa({},e),{},{adsData:Sa(Sa({},e.adsData),{},{adStatus:"error",adErrorMessage:t.payload})});case"[MONETIZATION] increase ad impression counter":var o=e.adsData.adImpression;return Sa(Sa({},e),{},{adsData:Sa(Sa({},e.adsData),{},{adImpression:o+1})});case"[MONETIZATION] increase ad Opportunity counter":var a=e.adsData.adOpportunity;return Sa(Sa({},e),{},{adsData:Sa(Sa({},e.adsData),{},{adOpportunity:a+1})});case"[MONETIZATION] add played midroll number":var s=e.adsData.playedMidrolls,u=In()(s);return u.push(t.payload),Sa(Sa({},e),{},{adsData:Sa(Sa({},e.adsData),{},{adOrder:t.payload,playedMidrolls:u})});case"[MONETIZATION] clear played midrolls":return Sa(Sa({},e),{},{adsData:Sa(Sa({},e.adsData),{},{playedMidrolls:[]})});case"[MONETIZATION] clear ad data":return Sa(Sa({},e),{},{adsData:Sa(Sa({},e.adsData),{},{adOrder:0,currentAdTag:null,adDuration:0,adUnit:""})});case"[MONETIZATION] change ad duration":return Sa(Sa({},e),{},{adsData:Sa(Sa({},e.adsData),{},{adDuration:t.payload})});case"[MONETIZATION] update is vast ad":return Sa(Sa({},e),{},{adsData:Sa(Sa({},e.adsData),{},{isVastAd:t.payload})});case"[MONETIZATION] change ad current time":return Sa(Sa({},e),{},{adsData:Sa(Sa({},e.adsData),{},{adCurrentTime:t.payload})});case"[MONETIZATION] update ad muted":return Sa(Sa({},e),{},{adsData:Sa(Sa({},e.adsData),{},{adMuted:t.payload})});case"[MONETIZATION] change ad volume":return Sa(Sa({},e),{},{adsData:Sa(Sa({},e.adsData),{},{adVolume:t.payload})});case"[MONETIZATION] change pod info":var c=t.payload,l=c.podNumber,d=c.slotNumber;return Sa(Sa({},e),{},{adsData:Sa(Sa({},e.adsData),{},{podNumber:l,slotNumber:d})});case"[MONETIZATION] change loading ad status":return Sa(Sa({},e),{},{adsData:Sa(Sa({},e.adsData),{},{loadingAd:t.payload})});default:return e}},mediaData:function(){var e=arguments.length>0&&void 0!==arguments[0]?arguments[0]:ja,t=arguments.length>1?arguments[1]:void 0;switch(t.type){case"[CORE] initiate store":return Va({},function(e,t){var n=t.content_type,r=t.media_id,i=t.display_title;return Va(Va({},e),{},{mediaType:Un(n)?e.mediaType:n,mediaId:Un(r)?e.mediaId:r,videoData:Va(Va({},e.videoData),{},{showTitle:!!Un(i)||i})})}(e,t.payload.initiateParams));case"[CORE] load video request":return Va(Va({},e),{},{loadingMedia:!0});case"[CORE] load video request success":return Va(Va({},e),{},{loadingMedia:!1,videoList:t.payload});case"[CORE] set current video":var n=t.payload,r=n.index,i=n.videoData;return Va(Va({},e),{},{activeVideoIndex:r,videoData:i});case"[CORE] load video request error":return Va(Va({},e),{},{loadingMedia:!1,mediaLoadingError:t.payload});case"[COMMON] media request":var o=t.payload.mediaRequestObject;return Va(Va({},e),{},{mediaRequest:Va({},o)});default:return e}},semanticOptions:function(){var e=arguments.length>0&&void 0!==arguments[0]?arguments[0]:Ba,t=arguments.length>1?arguments[1]:void 0;switch(t.type){case"[CORE] initiate store":return Fa({},function(e,t){var n=t.semantic_options;if(Un(n))return e;var r=n.minimum_date_factor,i=n.promoted_videos,o=n.scan_images_on_page,a=n.scanned_element,s=n.scanned_element_type,u=n.scoped_keywords,c=n.tags;return Fa(Fa({},e),{},{minimumDateFactor:Un(r)?e.minimumDateFactor:r,promotedVideos:Un(i)?e.promotedVideos:i,scanImagesOnPage:Un(o)?e.scanImagesOnPage:o,scannedElement:Un(a)?e.scannedElement:a,scannedElementType:Un(s)?e.scannedElementType:s,scopedKeywords:Un(u)?e.scopedKeywords:u,tags:Un(c)?e.tags:c})}(e,t.payload.initiateParams));default:return e}},userInteraction:function(){var e=arguments.length>0&&void 0!==arguments[0]?arguments[0]:Wa,t=arguments.length>1?arguments[1]:void 0;switch(t.type){case"[USER INTERACTION] change user interaction":return qa(qa({},e),{},{userInteractionType:t.payload});default:return e}},splitView:function(){var e=arguments.length>0&&void 0!==arguments[0]?arguments[0]:$a,t=arguments.length>1?arguments[1]:void 0;switch(t.type){case"[CORE] initiate store":return Ga({},function(e,t){var n=t.anchor_options;if(!Un(n)){var r=n.split_view,i=n.split_view_ratio;return Ga(Ga({},e),{},{splitViewRatio:Un(r)||!r||Un(i)?e.splitViewRatio:i})}return e}(e,t.payload.initiateParams));default:return e}},discovery:function(){var e=arguments.length>0&&void 0!==arguments[0]?arguments[0]:Za,t=arguments.length>1?arguments[1]:void 0;switch(t.type){case"[CORE] initiate store":return Ya({},function(e,t){var n=t.next_video;return Un(n)?e:Ya(Ya({},e),{},{nextVideo:Xa(n)})}(e,t.payload.initiateParams));case"[DISCOVERY] show up next":return Ya(Ya({},e),{},{showUpNext:t.payload});case"[DISCOVERY] show skippable content":return Ya(Ya({},e),{},{showSkippableContent:t.payload});default:return e}}}),Qa=[],es=!1,ts=function e(){return function(t){return function(n){if(es)return Qa.push(n),null;es=!0;var r=t(n);return es=!1,Qa.length>0&&e()(t)(Qa.shift()),r}}},ns=function(e){var t=[];if(function(e){return!Un(e)&&!Un(e.enable_redux_debugging)&&e.enable_redux_debugging}(e)){var n=window&&window.__REDUX_DEVTOOLS_EXTENSION__&&window.__REDUX_DEVTOOLS_EXTENSION__();"function"===typeof n&&t.push(n)}var r=Et.apply(void 0,[wt(ua,ts)].concat(t));return vt(Ja,r)},rs=function(){function e(t){Ai()(this,e),f()(this,"playerVisibilitySubscriber",void 0),f()(this,"videoTagStatusSubscriber",void 0),f()(this,"shouldPlayIfLazyplay",!0),f()(this,"shouldPlayIfAutoplayWhenViewable",!0),f()(this,"videoPausedByObserver",!1),this.store=t,this.playerVisibilitySubscriber=null,this.videoTagStatusSubscriber=null,this.playAccordingToPlaybackMethod()}return Vi()(e,[{key:"lazyplayHandler",value:function(e){hn.playerVisibility(e)>=.5&&(this.playVideo(),this.shouldPlayIfLazyplay=!1)}},{key:"autoplayWhenViewableHandler",value:function(e){hn.playerVisibility(e)>=.5?this.playVideo():this.pauseVideo()}},{key:"onPlayerVisibilityChanged",value:function(e){var t=hn.playbackMethod(e);"lazyplay"===t&&this.shouldPlayIfLazyplay&&this.lazyplayHandler(e),"autoplay_when_viewable"===t&&this.shouldPlayIfAutoplayWhenViewable&&this.autoplayWhenViewableHandler(e)}},{key:"onVideoTagStatusChanged",value:function(e){var t=hn.videoTagStatus(e);"paused"!==t||this.videoPausedByObserver||(this.shouldPlayIfAutoplayWhenViewable=!1),"playing"===t&&(this.shouldPlayIfAutoplayWhenViewable=!0,this.videoPausedByObserver=!1)}},{key:"initiatePlayerVisibilitySubscriber",value:function(){this.playerVisibilitySubscriber=new ji(this.store,e.getPlayerVisibilityDependencies,this.onPlayerVisibilityChanged.bind(this))}},{key:"initiateVideoTagStatusSubscriber",value:function(){this.videoTagStatusSubscriber=new ji(this.store,e.getVideoTagStatusDependencies,this.onVideoTagStatusChanged.bind(this))}},{key:"playVideo",value:function(){var e=this.store,t=e.dispatch,n=e.getState;"idle"===hn.videoTagStatus(n())?on("play")(t):on("resume")(t)}},{key:"pauseVideo",value:function(){var e=this.store,t=e.dispatch,n=e.getState;"paused"!==hn.videoTagStatus(n())&&(this.videoPausedByObserver=!0,on("pause")(t))}},{key:"playAccordingToPlaybackMethod",value:function(){var e=this.store,t=e.dispatch,n=(0,e.getState)();switch(hn.playbackMethod(n)){case"autoplay":this.playVideo();break;case"lazyplay":this.initiatePlayerVisibilitySubscriber();break;case"autoplay_when_viewable":this.initiatePlayerVisibilitySubscriber(),this.initiateVideoTagStatusSubscriber();break;case"none":an(!1)(t)}}}],[{key:"getPlayerVisibilityDependencies",value:function(e){return[hn.playerVisibility(e)]}},{key:"getVideoTagStatusDependencies",value:function(e){return[hn.videoTagStatus(e)]}}]),e}(),is=function(){function e(t,n,r,i){var o=this;Ai()(this,e),f()(this,"videoStatusSubscriber",void 0),f()(this,"videoListSubscriber",void 0),f()(this,"mediaRequestSubscriber",void 0),f()(this,"playerVisibilitySubscriber",void 0),f()(this,"playbackMethodManager",void 0),f()(this,"store",void 0),f()(this,"loadContent",function(e,t,n,r){o.loadMedia(t,n,r).then(function(){o.playbackMethodManager=new rs(e)})}),f()(this,"loadMedia",function(e,t,n){var r=o.store,i=r.dispatch,a=r.getState,s=Dn.showTitle(a());if("semantic"===e){var u=pn.semanticOptions(a());return Na(u,s,n)(i)}return ka(t,s,n)(i)}),this.store=t,this.videoStatusSubscriber=new ji(t,e.getVideoStatusDependencies,this.onVideoStatusChanged.bind(this)),this.videoListSubscriber=new ji(t,e.getVideoListDependencies,this.onVideoListChanged.bind(this)),this.mediaRequestSubscriber=new ji(t,e.getMediaRequestDependencies,this.onMediaRequestChanged.bind(this)),this.playerVisibilitySubscriber=null,this.loadContent(t,r,n,i)}return Vi()(e,null,[{key:"createInstance",value:function(t,n,r,i){return new e(t,n,r,i)}}]),Vi()(e,[{key:"playNextVideo",value:function(e){var t=this.store.dispatch,n=Cn.videoList(e),r=Cn.activeVideoIndex(e)+1;n.length>1&&r>=n.length&&(r=0),r<n.length&&(!function(e){e({type:"[CORE] reset player data time params"})}(t),La(r,n[r])(t),on("play")(t))}},{key:"playPreviousVideo",value:function(e){var t=this.store.dispatch,n=Cn.videoList(e),r=Cn.activeVideoIndex(e);if(r>0){var i=r-1;La(i,n[i])(t),on("play")(t)}}},{key:"onVideoStatusChanged",value:function(e){"complete"===hn.videoTagStatus(e)&&this.playNextVideo(e)}},{key:"onVideoListChanged",value:function(e){var t=this.store.dispatch,n=Cn.videoList(e);!jn(n)&&n.length>0&&La(0,n[0])(t)}},{key:"onMediaRequestChanged",value:function(e){var t=Cn.mediaRequest(e);switch(t.type){case"playNewVideo":this.loadMedia("specific",t.value);break;case"playNextVideo":this.playNextVideo(e);break;case"playPreviousVideo":this.playPreviousVideo(e)}}}],[{key:"getVideoStatusDependencies",value:function(e){return[hn.videoTagStatus(e)]}},{key:"getVideoListDependencies",value:function(e){return[Cn.videoList(e)]}},{key:"getMediaRequestDependencies",value:function(e){return[Cn.mediaRequest(e)]}}]),e}(),os=function e(t){var n=this;Ai()(this,e),f()(this,"store",void 0),f()(this,"onDependencyFailure",function(e,t){console.log("onDependencyFailure",e,t);var r=n.store,i=r.dispatch,o=r.getState;switch(e){case"ima":"blocked"!==Fi.loadingImaStatus(o())&&Qn("error")(i);break;case"hls":er("error")(i)}}),f()(this,"onDependencyReady",function(e){var t=n.store.dispatch;switch(e){case"ima":Qn("success")(t);break;case"hls":er("success")(t)}}),this.store=t},as=function(e){return function(t){t({type:"[COMMON] set fullscreen",payload:e})}},ss=function(){function e(t,n){var r=this;Ai()(this,e),f()(this,"store",void 0),f()(this,"videoTag",void 0),f()(this,"pendingFullscreenSubscriber",void 0),f()(this,"adStatusSubscriber",void 0),f()(this,"playerUniqId",void 0),f()(this,"onAdStatusChanged",function(e){var t=_i.adStatus(e),n=r.videoTag.webkitDisplayingFullscreen;"playing"===t&&Bn()&&n&&r.exitFullscreen(r.videoTag)}),f()(this,"isPlayerInFullscreen",function(){var e=document,t=Bn()?En(r.playerUniqId):bn(r.playerUniqId);return Un(e.fullscreenElement)?!Un(e.webkitFullscreenElement)&&0===e.webkitFullscreenElement.id.localeCompare(t):0===e.fullscreenElement.id.localeCompare(t)}),f()(this,"changePlayerWidth",function(e){r.videoTag.style.width=e?"100%":"auto"}),f()(this,"onFullscreenChanged",function(){var e=r.store.dispatch,t=r.isPlayerInFullscreen();r.changePlayerWidth(t),as(t)(e)}),f()(this,"onFullscreenChangedIos",function(){var e=r.store.dispatch,t=r.videoTag.webkitDisplayingFullscreen;t||on("resume")(e),r.changePlayerWidth(t),as(t)(e)}),f()(this,"onPendingFullscreenRequestChanged",function(e){var t=gn.pendingFullscreenRequest(e);"enter"===t?r.enterFullscreen(r.videoTag):"exit"===t&&r.exitFullscreen(r.videoTag)}),f()(this,"getFullScreenElement",function(e,t){var n=document.getElementById(bn(r.playerUniqId));return Bn()?t:e?document:n}),f()(this,"enterFullscreen",function(e){var t=r.getFullScreenElement(!1,e);Bn()?t.webkitEnterFullscreen():document.webkitExitFullscreen?t.webkitRequestFullscreen():document.webkitCancelFullScreen?t.webkitRequestFullScreen():document.mozCancelFullScreen?t.mozRequestFullScreen():document.msExitFullscreen&&t.msRequestFullscreen()}),f()(this,"exitFullscreen",function(e){var t=r.getFullScreenElement(!0,e);document.webkitExitFullscreen||Bn()?t.webkitExitFullscreen():document.webkitCancelFullScreen?t.webkitCancelFullScreen():document.mozCancelFullScreen?t.mozCancelFullScreen():document.msExitFullscreen&&t.msExitFullscreen()}),this.store=t,this.videoTag=document.getElementById(En(n)),this.playerUniqId=n,document.addEventListener("fullscreenchange",this.onFullscreenChanged.bind(this)),document.addEventListener("webkitfullscreenchange",this.onFullscreenChanged.bind(this)),Bn()&&(this.videoTag.addEventListener("webkitendfullscreen",this.onFullscreenChangedIos.bind(this)),this.videoTag.addEventListener("webkitbeginfullscreen",this.onFullscreenChangedIos.bind(this))),this.pendingFullscreenSubscriber=new ji(t,e.getPendingFullscreenDependencies,this.onPendingFullscreenRequestChanged.bind(this)),this.adStatusSubscriber=new ji(t,e.getAdStatusDependencies,this.onAdStatusChanged.bind(this))}return Vi()(e,null,[{key:"createInstance",value:function(t,n){return new e(t,n)}}]),Vi()(e,null,[{key:"getPendingFullscreenDependencies",value:function(e){return[gn.pendingFullscreenRequest(e)]}},{key:"getAdStatusDependencies",value:function(e){return[_i.adStatus(e)]}}]),e}();function us(e,t){var n=Object.keys(e);if(Object.getOwnPropertySymbols){var r=Object.getOwnPropertySymbols(e);t&&(r=r.filter(function(t){return Object.getOwnPropertyDescriptor(e,t).enumerable})),n.push.apply(n,r)}return n}function cs(e){for(var t=1;t<arguments.length;t++){var n=null!=arguments[t]?arguments[t]:{};t%2?us(Object(n),!0).forEach(function(t){f()(e,t,n[t])}):Object.getOwnPropertyDescriptors?Object.defineProperties(e,Object.getOwnPropertyDescriptors(n)):us(Object(n)).forEach(function(t){Object.defineProperty(e,t,Object.getOwnPropertyDescriptor(n,t))})}return e}var ls,ds=function(e){return function(e){return e&&window.monti.playerConfigs&&window.monti.playerConfigs[e]}(e)?function(e){return window.monti.playerConfigs[e]}(e):window.monti.playerConfigs?window.monti.playerConfigs&&window.monti.playerConfigs[Object.keys(window.monti.playerConfigs)[0]]:null},ps=function e(t){var n=this;Ai()(this,e),f()(this,"videoTag",void 0),f()(this,"isBufferError",void 0),f()(this,"hls",void 0),f()(this,"hlsSetup",function(e,t,r,i){n.initiateHls(e),n.loadHlsSource(e,t,r,i)}),f()(this,"detachMedia",function(){Un(n.hls)||(n.hls.detachMedia(),n.hls.destroy(),n.hls=null)}),f()(this,"initiateHls",function(e){n.hls=new e,n.hls.attachMedia(n.videoTag)}),f()(this,"loadHlsSource",function(e,t,r,i){n.hls.on(e.Events.MEDIA_ATTACHED,function(){n.hls.loadSource(t)}),n.hls.on(e.Events.ERROR,function(t,o){n.mapHlsToErrors(e,o,i),t.details===e.ErrorDetails.BUFFER_STALLED_ERROR&&(r(!0),n.isBufferError=!0)}),n.hls.on(e.Events.FRAG_BUFFERED,function(){n.isBufferError&&(r(!1),n.isBufferError=!1)})}),f()(this,"mapHlsToErrors",function(e,t,r){if(t.fatal)switch(t.type){case e.ErrorTypes.NETWORK_ERROR:r(Xn.GENERAL_ERROR),n.hls.startLoad();break;case e.ErrorTypes.MEDIA_ERROR:r(Xn.GENERAL_ERROR),n.hls.recoverMediaError();break;default:r(Xn.GENERAL_ERROR),n.hls.destroy()}}),this.hls=void 0,this.videoTag=t,this.isBufferError=!1},fs=function e(){var t=this;Ai()(this,e),f()(this,"videoStreaming",void 0),f()(this,"hlsLibrarySetup",function(e,n,r,i){Un(t.videoStreaming)||t.videoStreaming.detachMedia(),t.videoStreaming=new ps(e),t.videoStreaming.hlsSetup(ls,n,r,i)})};f()(fs,"shouldLoadVideoStreamingSrcDirectly",function(e,t,n){return"no-need"===n&&!(""===e.canPlayType("application/vnd.apple.mpegurl"))}),f()(fs,"shouldUseHlsLibrary",function(e,t){return"success"===t&&(ls=void 0!==window.Hls?Hls:mmHls).isSupported()}),f()(fs,"isValidHlsUrl",function(e){return!Un(e)&&!e.includes(".mp4")}),f()(fs,"suitableVideoSource",function(e,t,n){return fs.isValidHlsUrl(t)?fs.shouldUseHlsLibrary(t,n)?"m3u8 with hls":fs.shouldLoadVideoStreamingSrcDirectly(e,t,n)?"m3u8 directly":"loading"!==n?"mp4":"":"mp4"}),f()(fs,"loadHlsVideoDirectly",function(e,t){e.setAttribute("src",t),e.load()});var hs=function(e){return function(t){t({type:"[MONETIZATION] change pending ad status",payload:{type:e}})}},ys="video/mp4",gs="application/vnd.apple.mpegurl",vs=function(){function e(t,n){var r=this;Ai()(this,e),f()(this,"store",void 0),f()(this,"videoTag",void 0),f()(this,"prerollEnabled",void 0),f()(this,"pendingVideoStatusSubscriber",void 0),f()(this,"videoStreamingManager",void 0),f()(this,"videoDataSubscriber",void 0),f()(this,"hlsLoadingStatusSubscriber",void 0),f()(this,"newVideoDataLoaded",void 0),f()(this,"onHlsLoadingStatusChanged",function(e){"success"===Fi.loadingHLSStatus(e)&&(r.newVideoDataLoaded=!0,r.onPendingVideoStatusChanged(e))}),f()(this,"onPendingVideoStatusChanged",function(e){var t=hn.pendingVideoTagStatus(e),n=Dn.sources(e),i=Fi.loadingHLSStatus(e),o="blocked"===Fi.loadingImaStatus(e);r.handlePendingVideoStatus(t,n,i,o)}),f()(this,"onVideoDataChanged",function(){r.newVideoDataLoaded=!0}),f()(this,"sendPrerollPlayRequest",function(){var e=r.store.dispatch;hs("playPreroll")(e)}),f()(this,"handlePlayRequest",function(e,t,n){var i=r.store.dispatch;if(e&&e.length>0){if(r.newVideoDataLoaded&&(r.loadVideoSource(r.videoTag,e,t),r.newVideoDataLoaded=!1,r.prerollEnabled&&!n))return void r.sendPrerollPlayRequest();r.videoTag.play().catch(function(e){return console.error("Error playing the video: ",e)})}else dn(Xn.VIDEO_ERROR)(i)}),f()(this,"handlePendingVideoStatus",function(e,t,n,i){switch(e.type){case"play":r.handlePlayRequest(t,n,i);break;case"resume":r.videoTag.play().catch(function(e){return console.error("Error resuming the video: ",e)});break;case"pause":r.videoTag.pause();break;case"replay":r.videoTag.currentTime=0,r.videoTag.play().catch(function(e){return console.error("Error replaying the video: ",e)});break;case"seekTo":r.videoTag.pause(),r.videoTag.currentTime=e.value}}),f()(this,"loadMp4Source",function(e,t,n){var r=Ra(t,ys);n.setAttribute("src",r),n.load()}),f()(this,"loadVideoSource",function(e,t,n){var i=r.store.dispatch,o=Ra(t,gs);switch(fs.suitableVideoSource(e,o,n)){case"mp4":r.loadMp4Source(n,t,e);break;case"m3u8 with hls":r.videoStreamingManager.hlsLibrarySetup(e,o,function(e){return un(e)(i)},function(e){return dn(e)(i)});break;case"m3u8 directly":fs.loadHlsVideoDirectly(e,o)}}),this.store=t;var i=t.getState;this.videoStreamingManager=new fs,this.videoTag=document.getElementById(En(n)),this.prerollEnabled=bi.prerollEnabled(i()),this.pendingVideoStatusSubscriber=new ji(t,e.getPendingVideoStatusDependencies,this.onPendingVideoStatusChanged.bind(this)),this.videoDataSubscriber=new ji(t,e.getVideoDataDependencies,this.onVideoDataChanged.bind(this)),this.hlsLoadingStatusSubscriber=new ji(t,e.getHLSLoadingStatusDependencies,this.onHlsLoadingStatusChanged.bind(this))}return Vi()(e,null,[{key:"createInstance",value:function(t,n){return new e(t,n)}}]),Vi()(e,null,[{key:"getHLSLoadingStatusDependencies",value:function(e){return[Fi.loadingHLSStatus(e)]}},{key:"getPendingVideoStatusDependencies",value:function(e){return[hn.pendingVideoTagStatus(e)]}},{key:"getVideoDataDependencies",value:function(e){return[Cn.videoData(e)]}}]),e}();function ms(e,t){var n=Object.keys(e);if(Object.getOwnPropertySymbols){var r=Object.getOwnPropertySymbols(e);t&&(r=r.filter(function(t){return Object.getOwnPropertyDescriptor(e,t).enumerable})),n.push.apply(n,r)}return n}function bs(e){for(var t=1;t<arguments.length;t++){var n=null!=arguments[t]?arguments[t]:{};t%2?ms(Object(n),!0).forEach(function(t){f()(e,t,n[t])}):Object.getOwnPropertyDescriptors?Object.defineProperties(e,Object.getOwnPropertyDescriptors(n)):ms(Object(n)).forEach(function(t){Object.defineProperty(e,t,Object.getOwnPropertyDescriptor(n,t))})}return e}var Os={READY_EVENT:"ready",PLAY_EVENT:"play",PAUSE_EVENT:"pause",TIME_EVENT:"time",SEEK_EVENT:"seek",COMPLETE_EVENT:"complete",VOLUME_EVENT:"volume",MUTE_EVENT:"mute"},_s=Object.values(Os),Ss={FULLSCREEN_EVENT:"fullscreen",ANCHOR_STATUS_EVENT:"anchorStatusChanged",ANCHOR_CLOSED_EVENT:"anchorClosed"},Es={AD_PLAY_EVENT:"adPlay",AD_PAUSE_EVENT:"adPause",AD_RESUME_EVENT:"adResume",AD_COMPLETE_EVENT:"adComplete",AD_TIME_EVENT:"adTime",AD_MUTE_EVENT:"adMute",AD_SKIPPED_EVENT:"adSkipped",AD_ERROR_EVENT:"adError",AD_BLOCK_EVENT:"adBlock",AD_REQUEST_EVENT:"adRequest",AD_OPPORTUNITY_EVENT:"adOpportunity",AD_IMPRESSION_EVENT:"adImpression"},ws=Object.values(Es),Ps=Object.values(bs(bs(bs({},Os),Es),Ss)),Ts=function(){function e(t,n){var r=this;Ai()(this,e),f()(this,"eventsCallbacksHandler",void 0),f()(this,"store",void 0),f()(this,"videoStatusSubscriber",void 0),f()(this,"videoMuteSubscriber",void 0),f()(this,"videoVolumeSubscriber",void 0),f()(this,"videoTimeFragmentSubscriber",void 0),f()(this,"videoListStoreSubscriber",void 0),f()(this,"previousVideoTagStatus",void 0),f()(this,"startSeekTime",0),f()(this,"canHandleReady",function(e,t,n){if(t===Os.READY_EVENT){var r=Cn.videoList(e);if(Array.isArray(r)&&r.length>0)return n(),!0}return!1}),f()(this,"canBeHandled",function(e,t){var n=r.store.getState;return r.canHandleReady(n(),e,t)}),f()(this,"reportSeekEnd",function(e){var t={position:hn.currentVideoTimeFragment(e),offset:r.startSeekTime};r.eventsCallbacksHandler.onEvent(Os.SEEK_EVENT,t)}),f()(this,"onMuteStateChanged",function(e){var t=gn.muted(e);r.eventsCallbacksHandler.onEvent(Os.MUTE_EVENT,{state:t})}),f()(this,"onVolumeChanged",function(e){var t=gn.muted(e),n=gn.volume(e);r.eventsCallbacksHandler.onEvent(Os.VOLUME_EVENT,{level:t?0:n})}),f()(this,"onVideoTimeFragmentChanged",function(e){var t=hn.currentVideoTimeFragment(e),n=hn.currentVideoDuration(e);r.eventsCallbacksHandler.onEvent(Os.TIME_EVENT,{duration:n,position:t})}),f()(this,"onVideoListChanged",function(){r.eventsCallbacksHandler.onEvent(Os.READY_EVENT)}),this.store=t,this.eventsCallbacksHandler=n,this.videoStatusSubscriber=new ji(t,e.getVideoStatusDependencies,this.onVideoStatusChanged.bind(this)),this.videoMuteSubscriber=new ji(t,e.getVideoMuteDependencies,this.onMuteStateChanged.bind(this)),this.videoVolumeSubscriber=new ji(t,e.getVolumeDependencies,this.onVolumeChanged.bind(this)),this.videoTimeFragmentSubscriber=new ji(t,e.getVideoTimeDependencies,this.onVideoTimeFragmentChanged.bind(this)),this.videoListStoreSubscriber=new ji(t,e.getVideoListDependencies,this.onVideoListChanged.bind(this)),this.previousVideoTagStatus=hn.videoTagStatus(t.getState())}return Vi()(e,[{key:"onVideoStatusChanged",value:function(e){var t=hn.videoTagStatus(e);switch("seeking"===this.previousVideoTagStatus&&this.reportSeekEnd(e),t){case"paused":this.eventsCallbacksHandler.onEvent(Os.PAUSE_EVENT);break;case"seeking":this.startSeekTime=hn.currentVideoTimeFragment(e);break;case"complete":this.eventsCallbacksHandler.onEvent(Os.COMPLETE_EVENT);break;case"playing":this.eventsCallbacksHandler.onEvent(Os.PLAY_EVENT)}this.previousVideoTagStatus=t}}],[{key:"getVideoStatusDependencies",value:function(e){return[hn.videoTagStatus(e)]}}]),e}();f()(Ts,"getVideoMuteDependencies",function(e){return[gn.muted(e)]}),f()(Ts,"getVolumeDependencies",function(e){return[gn.volume(e)]}),f()(Ts,"getVideoTimeDependencies",function(e){return[hn.currentVideoTimeFragment(e)]}),f()(Ts,"getVideoListDependencies",function(e){return[Cn.videoList(e)]}),f()(Ts,"isContentEvent",function(e){return _s.some(function(t){return t===e})});var As=function e(t,n){var r=this;Ai()(this,e),f()(this,"eventsCallbacksHandler",void 0),f()(this,"store",void 0),f()(this,"fullscreenSubscriber",void 0),f()(this,"anchorStatusSubscriber",void 0),f()(this,"anchorDisabledByUserSubscriber",void 0),f()(this,"onFullscreenChanged",function(e){var t=gn.isFullscreenOn(e);r.eventsCallbacksHandler.onEvent(Ss.FULLSCREEN_EVENT,{state:t})}),f()(this,"onAnchorStatusChanged",function(e){var t="active"===Pr(e)?"activated":"deactivated";r.eventsCallbacksHandler.onEvent(Ss.ANCHOR_STATUS_EVENT,{state:t})}),f()(this,"onAnchorDisabledByUser",function(e){if(wr(e)){var t=hn.currentVideoTimeFragment(e);r.eventsCallbacksHandler.onEvent(Ss.ANCHOR_CLOSED_EVENT,{position:t})}}),this.store=t,this.eventsCallbacksHandler=n,this.fullscreenSubscriber=new ji(t,e.getFullscreenDependencies,this.onFullscreenChanged.bind(this)),this.anchorStatusSubscriber=new ji(t,e.getAnchorStatusDependencies,this.onAnchorStatusChanged.bind(this)),this.anchorDisabledByUserSubscriber=new ji(t,e.getAnchorDisabledByUserDependencies,this.onAnchorDisabledByUser.bind(this))};f()(As,"getFullscreenDependencies",function(e){return[gn.isFullscreenOn(e)]}),f()(As,"getAnchorStatusDependencies",function(e){return[Pr(e)]}),f()(As,"getAnchorDisabledByUserDependencies",function(e){return[wr(e)]});var Cs=function(){function e(t,n){var r=this;Ai()(this,e),f()(this,"store",void 0),f()(this,"eventsCallbacksHandler",void 0),f()(this,"adStatusSubscriber",void 0),f()(this,"adImpressionSubscriber",void 0),f()(this,"adOpportunitySubscriber",void 0),f()(this,"adTimeSubscriber",void 0),f()(this,"adMuteSubscriber",void 0),f()(this,"adProviderLoadingStatusSubscriber",void 0),f()(this,"previousAdStatus",void 0),f()(this,"canBeHandled",function(e,t){var n=r.store.getState;switch(Fi.loadingImaStatus(n())){case"loading":return!1;case"success":case"error":return!0;case"blocked":return t(),!0;case"":default:return!1}}),f()(this,"onAdStatusChanged",function(e){var t=_i.adStatus(e),n=_i.currentAdTag(e);switch(t){case"requested":r.eventsCallbacksHandler.onEvent(Es.AD_REQUEST_EVENT,{tag:n});break;case"paused":r.eventsCallbacksHandler.onEvent(Es.AD_PAUSE_EVENT,{tag:n});break;case"completed":r.eventsCallbacksHandler.onEvent(Es.AD_COMPLETE_EVENT,{tag:n});break;case"skipped":r.eventsCallbacksHandler.onEvent(Es.AD_SKIPPED_EVENT,{tag:n});break;case"playing":"paused"===r.previousAdStatus?r.eventsCallbacksHandler.onEvent(Es.AD_RESUME_EVENT,{tag:n}):r.eventsCallbacksHandler.onEvent(Es.AD_PLAY_EVENT,{tag:n});break;case"error":var i=_i.adErrorMessage(e);r.eventsCallbacksHandler.onEvent(Es.AD_ERROR_EVENT,{tag:n,message:i})}r.previousAdStatus=t}),f()(this,"onAtTimeChanged",function(e){var t=_i.adCurrentTime(e),n=_i.currentAdTag(e),i=_i.adDuration(e);r.eventsCallbacksHandler.onEvent(Es.AD_TIME_EVENT,{position:t,tag:n,duration:i})}),f()(this,"onAdMuteChanged",function(e){var t=_i.adMuted(e);r.eventsCallbacksHandler.onEvent(Es.AD_MUTE_EVENT,{state:t})}),f()(this,"onAdProviderLoadingChanged",function(e){"blocked"===Fi.loadingImaStatus(e)&&r.eventsCallbacksHandler.onEvent(Es.AD_BLOCK_EVENT)}),f()(this,"onAdImpressionChanged",function(e){var t=_i.currentAdTag(e);r.eventsCallbacksHandler.onEvent(Es.AD_IMPRESSION_EVENT,{tag:t})}),f()(this,"onAdOpportunityChanged",function(e){var t=_i.currentAdTag(e);r.eventsCallbacksHandler.onEvent(Es.AD_OPPORTUNITY_EVENT,{tag:t})}),this.store=t,this.eventsCallbacksHandler=n,this.previousAdStatus=_i.adStatus(t.getState()),this.adStatusSubscriber=new ji(t,e.getAdStatusDependencies,this.onAdStatusChanged.bind(this)),this.adTimeSubscriber=new ji(t,e.getAdTimeDependencies,this.onAtTimeChanged.bind(this)),this.adMuteSubscriber=new ji(t,e.getAdMuteDependencies,this.onAdMuteChanged.bind(this)),this.adImpressionSubscriber=new ji(t,e.getAdImpressionDependencies,this.onAdImpressionChanged.bind(this)),this.adOpportunitySubscriber=new ji(t,e.getAdOpportunitySubscriberDependencies,this.onAdOpportunityChanged.bind(this)),this.adProviderLoadingStatusSubscriber=new ji(t,e.getAdProviderLoadingDependencies,this.onAdProviderLoadingChanged.bind(this))}return Vi()(e,null,[{key:"getAdStatusDependencies",value:function(e){return[_i.adStatus(e)]}},{key:"getAdTimeDependencies",value:function(e){return[_i.adCurrentTime(e)]}},{key:"getAdMuteDependencies",value:function(e){return[_i.adMuted(e)]}},{key:"getAdProviderLoadingDependencies",value:function(e){return[Fi.loadingImaStatus(e)]}}]),e}();f()(Cs,"isAdEvent",function(e){return ws.some(function(t){return t===e})}),f()(Cs,"getAdImpressionDependencies",function(e){return[_i.adImpression(e)]}),f()(Cs,"getAdOpportunitySubscriberDependencies",function(e){return[_i.adOpportunity(e)]});var Rs=function e(t){var n=this;Ai()(this,e),f()(this,"contentEvents",void 0),f()(this,"generalEvents",void 0),f()(this,"adEvents",void 0),f()(this,"subscribers",{}),f()(this,"onRegisterToEvent",function(e,t,r){n.isValidEvent(e)&&(Ts.isContentEvent(e)&&n.contentEvents.canBeHandled(e,t)||Cs.isAdEvent(e)&&n.adEvents.canBeHandled(e,t())||n.getEventSubscribersList(e).push({callback:t,once:r}))}),f()(this,"isValidEvent",function(e){return Ps.some(function(t){return t===e})}),f()(this,"getEventSubscribersList",function(e){return Array.isArray(n.subscribers[e])||(n.subscribers[e]=[]),n.subscribers[e]}),f()(this,"filterOutOnceCallbacks",function(e,t){n.subscribers[e]=t.filter(function(e){return!e.once})}),f()(this,"onEvent",function(e,t){var r=n.getEventSubscribersList(e);r.forEach(function(e){(0,e.callback)(t)}),n.filterOutOnceCallbacks(e,r)}),this.contentEvents=new Ts(t,this),this.generalEvents=new As(t,this),this.adEvents=new Cs(t,this)},Ds=function(){function e(t){Ai()(this,e),f()(this,"eventsHandler",void 0),this.eventsHandler=new Rs(t)}return Vi()(e,[{key:"on",value:function(e,t){this.eventsHandler.onRegisterToEvent(e,t,!1)}},{key:"once",value:function(e,t){this.eventsHandler.onRegisterToEvent(e,t,!0)}}]),e}();function Ms(e,t){var n=Object.keys(e);if(Object.getOwnPropertySymbols){var r=Object.getOwnPropertySymbols(e);t&&(r=r.filter(function(t){return Object.getOwnPropertyDescriptor(e,t).enumerable})),n.push.apply(n,r)}return n}function Is(e){for(var t=1;t<arguments.length;t++){var n=null!=arguments[t]?arguments[t]:{};t%2?Ms(Object(n),!0).forEach(function(t){f()(e,t,n[t])}):Object.getOwnPropertyDescriptors?Object.defineProperties(e,Object.getOwnPropertyDescriptors(n)):Ms(Object(n)).forEach(function(t){Object.defineProperty(e,t,Object.getOwnPropertyDescriptor(n,t))})}return e}var ks=function(){var e=window.monti.dataset;return jn(e)?(e={players:{},preact:Is(Is({},r),i),store:{},plugins:{}},window.monti.dataset=e,e):e},Ns=function(e){var t=function(){var e=(new Date).getTime(),t=performance&&performance.now&&1e3*performance.now()||0;return"xxxxxxxx-xxxx-4xxx-yxxx-xxxxxxxxxxxx".replace(/[xy]/g,function(n){var r=16*Math.random();return e>0?(r=(e+r)%16|0,e=Math.floor(e/16)):(r=(t+r)%16|0,t=Math.floor(t/16)),("x"===n?r:3&r|8).toString(16)})}(),n=function(e,t){var n=ns(e.dev_config),r=ks(),i=n.dispatch;return r.store[t]=n,function(e,t){return function(n){n({type:"[CORE] initiate store",payload:{initiateParams:e,playerInstanceUniqId:t}})}}(e,t)(i),n}(e,t);return function(e,t,n){B(b(Pi,{playerId:t,store:n,playerPosition:e}),e)}(e.player_pos,t,n),oa.getInstance().loadInternalPlugins(n,t,e),ss.createInstance(n,t),vs.createInstance(n,t),is.createInstance(n,e.media_id,e.content_type,e.dev_config),function(e){var t=e.dispatch;if(er(Ci.getInstance().getHLSLoadingStatus())(t),Qn(Ci.getInstance().getIMALoadingStatus())(t),!Ci.getInstance().isDependenciesReady()){var n=new os(e);Ci.getInstance().addDependenciesCallback(n)}}(n),function(e,t){ks().players[t]=new Ds(e)}(n,t),t},Ls=function(e){return console.log("player initiation start",e),new Promise(function(t,n){try{var r=function(e){var t=e.player_pos||document.currentScript.parentElement,n=e.media_id||e.content_id;return cs(cs({},e),{},{player_pos:t,media_id:n})}(function(e){var t=e.player_id,n=ds(t);return null===n?e:cs(cs({},e),n)}(e)),i=Ns(r);!function(e){var t=new CustomEvent("montiConfigLoaded",{detail:{playerKey:e}});window.dispatchEvent(t)}(i),t(i)}catch(o){console.error("Player initiation error",o),n(o)}})},xs=function(){return{initiate:Ls}};window.monti=xs,Ci.getInstance().loadExternalDependencies()}]); window.monti().initiate(Object.assign({player_pos: document.currentScript.parentElement}, {"is_conflicting_with_other_jw_players":false,"programmatic_play_with_sound_on_desktop":false,"referrer_id":"af93e181-b289-0560-a2bf-808e93bb05bc","width":"100","comscore_publisher_id":"18120612","monetization":{"ad_type":"static_tag","continue_content_play_while_waiting_for_ad":false,"strategy":"on_player_load","ad_request_timeout":"10000","midrolls":{"on":[0]},"vpaid_mode":"ENABLED","ad_tag":"https://pubads.g.doubleclick.net/gampad/ads?sz=400x300|640x480|480x270|640x360&iu=/175840252/MMPlus/smithsonianmag/Video&impl=s&gdfp_req=1&env=vp&output=vast&unviewed_position_start=1&url=##REFERRER_URL_UNESC##&description_url=##DESCRIPTION_URL_UNESC##&correlator=##CACHEBUSTER##&cust_params=mm_midroll%3D##MIDROLL_ORDER##%26video_ID%3D##VIDEO_ID##"},"sponsorship":false,"player_identifier":"mplayer","recommendation_id":null,"brand_color":"#FF9900","powered_by_strip":true,"platform":"buffy","type":"video","config_name":"MM+ | Smithsonianmag | Podding","player_id":"3v9g2u2f","playlist_id":"fSkmeWKF","playback_method":"autoplay","anchor_viewability_method":"none","player_version":"v4","playlist_type":"semantic","semantic_options":{"scan_images_on_page":true,"scanned_element":"","tags":"geogrophy,nature,animals,habitat,outdoors,science,history","minimum_date_factor":30,"scanned_element_type":"tag","scoped_keywords":"mentalfloss","promoted_videos":[]},"script_destination":"mm","publisher_contribution":"floor8","general_script_description":"","brand_logo":"","brand_logo_click_url":"","next_video":"none","uniq_key":"af93e181-b289-0560-a2bf-808e93bb05bc","content_id":"fSkmeWKF","content_type":"semantic"})); Finland has vastly improved in reading, math and science literacy over the past decade in large part because its teachers are trusted to do whatever it takes to turn young lives around. This 13-year-old, Besart Kabashi, received something akin to royal tutoring. “I took Besart on that year as my private student,” Louhivuori told me in his office, which boasted a Beatles “Yellow Submarine” poster on the wall and an electric guitar in the closet. When Besart was not studying science, geography and math, he was parked next to Louhivuori’s desk at the front of his class of 9- and 10-year- olds, cracking open books from a tall stack, slowly reading one, then another, then devouring them by the dozens. By the end of the year, the son of Kosovo war refugees had conquered his adopted country’s vowel-rich language and arrived at the realization that he could, in fact, learn. Years later, a 20-year-old Besart showed up at Kirkkojarvi’s Christmas party with a bottle of Cognac and a big grin. “You helped me,” he told his former teacher. Besart had opened his own car repair firm and a cleaning company. “No big fuss,” Louhivuori told me. “This is what we do every day, prepare kids for life.” This tale of a single rescued child hints at some of the reasons for the tiny Nordic nation’s staggering record of education success, a phenomenon that has inspired, baffled and even irked many of America’s parents and educators. Finnish schooling became an unlikely hot topic after the 2010 documentary film Waiting for “Superman” contrasted it with America’s troubled public schools. “Whatever it takes” is an attitude that drives not just Kirkkojarvi’s 30 teachers, but most of Finland’s 62,000 educators in 3,500 schools from Lapland to Turku—professionals selected from the top 10 percent of the nation’s graduates to earn a required master’s degree in education. Many schools are small enough so that teachers know every student. If one method fails, teachers consult with colleagues to try something else. They seem to relish the challenges. Nearly 30 percent of Finland’s children receive some kind of special help during their first nine years of school. The school where Louhivuori teaches served 240 first through ninth graders last year; and in contrast with Finland’s reputation for ethnic homogeneity, more than half of its 150 elementary-level students are immigrants—from Somalia, Iraq, Russia, Bangladesh, Estonia and Ethiopia, among other nations. “Children from wealthy families with lots of education can be taught by stupid teachers,” Louhivuori said, smiling. “We try to catch the weak students. It’s deep in our thinking.” Advertisement scroll for more The transformation of the Finns’ education system began some 40 years ago as the key propellent of the country’s economic recovery plan. Educators had little idea it was so successful until 2000, when the first results from the Programme for International Student Assessment (PISA), a standardized test given to 15-year-olds in more than 40 global venues, revealed Finnish youth to be the best young readers in the world. Three years later, they led in math. By 2006, Finland was first out of 57 countries (and a few cities) in science. In the 2009 PISA scores released last year, the nation came in second in science, third in reading and sixth in math among nearly half a million students worldwide. “I’m still surprised,” said Arjariita Heikkinen, principal of a Helsinki comprehensive school. “I didn’t realize we were that good.” In the United States, which has muddled along in the middle for the past decade, government officials have attempted to introduce marketplace competition into public schools. In recent years, a group of Wall Street financiers and philanthropists such as Bill Gates have put money behind private-sector ideas, such as vouchers, data-driven curriculum and charter schools, which have doubled in number in the past decade. President Obama, too, has apparently bet on compe­tition. His Race to the Top initiative invites states to compete for federal dollars using tests and other methods to measure teachers, a philosophy that would not fly in Finland. “I think, in fact, teachers would tear off their shirts,” said Timo Heikkinen, a Helsinki principal with 24 years of teaching experience. “If you only measure the statistics, you miss the human aspect.”

      The facts show that America has it all wrong in putting to much emphasis on national "data-driven" competition. These approaches take away from the unique aspects of each child.

    1. parrot imitating spring

      I think the parrot here is symbolizing El General himself. Parrot is not spring which brings joy and happiness. El General is a bad person, however, he is pretending to bring his people joy and justice from his palace.

      We can also think of the parrot at the cage as a symbol for the Haitian people who were considered slaves. Even though the parrot is not free and is caged, it is still imitating spring, by the same token, in spite of the oppression and injustice, the Haitian people are not only pretending that everything is ok, but rather that they are happy! Because being miserable may actually upset El General.

    1. O]ur image of children no longer considers them as isolated and egocentric, does not see them only engaged in action with objects, does not emphasize only the cog-nitive aspects,

      This makes me think of our role as educators and evolving beliefs that we have of children. Do we see children as passive or active contributors? What thing I know is that the image of the child I have today may change tomorrow as I believe it gets reshaped with time, experience, and reflection.

    1. This World is not Conclusion. A Species stands beyond — Invisible, as Music — But positive, as Sound —

      I think the author's first sentence has a strong personal point of view that allows the reader to know what she is thinking directly. Personally, I would be curious to know what she would say next, and what discoveries would lead her to such an opinion and conclusion.According to the author's verse, the Truth About many things is not always what it seems. What we see, hear or feel may have different meanings. There are many times when human beings may be wrong about something

    1. You neverowe me personal information about your health (mental or physical), or anything else•You are always welcome to talk to me about things that you are going through.•If I can’t help you, I may know somebody who can.•If you need extra help, or you need to miss class, or you need more time with something, just ask. I’ll work with you. I promise.

      As a student, I think we can all agree that this gives us a sense of relief and some breathing room as we are living in one of the most chaotic eras of our life. This is greatly appreciated.

    1. Author Response

      We would like to thank eLife editors and the reviewers for their time and effort in reviewing our manuscript, entitled: “Partial prion cross-seeding between fungal and mammalian amyloid signaling motifs” by Bardin et al. We considered carefully their comments and modified our preprint accordingly (new version posted here) and address the remarks and criticism of the reviewers in the response provided below.

      The editors’ summary of the review read as follows:

      Summary

      Bardin and colleagues identify and characterize a third prion system in P. anserina based on a cognate innate immunity signalosome comprised of PNT1/HELLP. The authors demonstrate that the three prion pathways operate orthogonally without cross-seeding; however, the newly identified PNT1/HELLP prion can be cross-seeded by the putatively homologous human necroptosis pathway when it is reconstituted in P. anserina, which further supports an evolutionary relationship between them. The review has identified substantive concerns, which limit the novelty of the work and would require significant new studies to address the mechanistic gaps. These concerns include prior work revealing several major tenets including prion activity for PNT1/HELLP in C. globosum and evolutionary conservation to the mammalian necroptosis pathway and the absence for robust experimental support for cross-seeding, or the absence thereof, membrane disruption as the cause of incompatibility, and for the relationship among toxicity, growth, protein state, and protein interaction. Concerns were also raised about the data presented, or absent, in terms of replicates, frequency of observations, and variability.

      It is our understanding that the editors and reviewers raise two types of concerns. One relates to the novelty of the work. The second type directly questions the experimental soundness of some of the presented results. We will briefly respond to the criticism regarding novelty and in detail to the methodological critique. We show the existence of a third PFD-based cell-death inducing system in Podospora, that human RHIM-motifs form prions in Podospora and that RHIM-prions partially cross-seed with PP-fungal prions. These results are nonetheless novel and do shed light on the biology of Podospora and the relation of fungal and mammalian amyloid signaling motifs. Regarding the second group of concerns, we think that by clarifying certain approaches and by giving experimental results in full detail, we are able to wave many of the criticisms. For the remaining points (essentially the question of the HELLP membrane interaction), we amend our preprint to point at the delineation of experimental results and interpretation explicitly. We gratefully acknowledge the editors and reviewers input as a mean to improve the quality of the preprint and realize in light of some of these comments that the manuscript lacked in clarity at place and that detailed results tables (that were summarized in the original preprint for the sake of conciseness) should indeed be included. But having said that, it is our intention to stand our ground regarding the central claims of the paper (as they appeared in the abstract of the preprint).

      Reviewer #1

      Bardin and colleagues identify and characterize a third prion system in P. anserina based on the PNT1/HELLP NLR-based signalosome based on the amyloid signaling motif PP from Chaetomium globosum. The C-terminal domain of HELLP is shown to exist in either soluble or aggregated states based on fluorescence microscopy of tagged protein in vivo, termed the [pi] state, and to form amyloid in vitro. These distinct states can be propagated independently and induce conversion of full-length HELLP upon cytoplasmic mixing, which leads to cell death. The PNT1 N-terminal domain also forms foci in vivo and can seed conversion of HELLP, also leading to cell death. The C-terminal domain of C. globosum HELLP and the RHIM regions of mammalian RIP1 and RIP3, which both contain PP motifs, can cross-seed HELLP conversion to the aggregated state but the other known P. anserina prions [Het-s] and [phi] are unable to do so.

      Support for the model proposed is generally qualitative in nature, with multiple instances of data described but not presented, including the timing of conversion to the aggregated state, revision of the aggregated state in meiotic progeny, the frequencies of conversion and co-localization, and the correlations between growth and prion phenotype. For the data presented, replicates, frequency of observations, and variability are not reported.

      It is unclear to us what is meant by “the model proposed”. It is not our understanding that we are proposing “a model” in this paper. The results that we claim are:

      -There is a third NLR/HELL protein pair involving amyloid signaling in Podospora

      -There is no cross-seeding between HELLP PFD and the two other Podospora PFDs (HET-s, HELLF)

      -RHIM can form a prion in Podospora

      -There is a partial prion cross-seeding between PP PFDs and mammalian RHIM in vivo in Podospora

      These are the statements made in the abstract of the preprint. It is our opinion that these central claims stand in face of the reviewers criticism. We shall attempt to provide whenever possible quantitative details regarding the points raised.

      Specifically:

      the timing of conversion to the aggregated state

      There are two types of experimental situations here. In certain sets of experiments, spontaneous conversion to the prion state is measured at different subculture durations (5, 11, 19 days of subculture) (as appears in Table 1). When induced conversion (cross-seeding) is assayed, the conversion process is measured at a single time point. Details of the timing of assay of the conversion are given in the material and methods section (and now given in Table 1).

      revision of the aggregated state in meiotic progeny

      Details of the progeny of a specific cross involving curing of the [π] prion are now given. Among 20 meiotic progeny containing the GFP-HELLP(214-271), 3 were cured.

      the frequencies of conversion

      Possibly the statement that the results are “generally qualitative” comes from the fact that several conversion experiments or barrage interaction results were presented in tables with a binary output (+ or -) in the original preprint. This presentation was chosen because the replicates of these experiments yielded only monotonous all-or-none results. All tested strains were either converted (+) or not (-). In all tables, the number of tested strains and the number of replicates per strain are now given (Table S1 to S6). This presentation results in quite boring tables but we think that this should eliminate this ambiguity.

      and co-localization

      For all co-localization experiments, in addition to representative micrographs, counts of independent observations for each phenotypes and of co-localizing dots are given in Tables S7 and S8.

      the correlations between growth and prion phenotype.

      As there is no toxic effect of prion itself in absence of HELL or HeLo containing proteins (published results for [Het-s] and [φ], and verified here for [π] and [Rhim]), this last remark appear to apply to RHIM/HELLP co-expression that results in growth defects. We observe that strains co-expressing RHIM and HELLP are affected in their growth when there are infected with [Rhim] prions. These results are presented in Table 2. We based the conclusion that the growth defect relates to acquisition of the prion phenotype because the growth defect occurs after contact with a prion infected strain. This increase in the number of strains with a growth defect requires presence of the corresponding PFD in the recipient strain. Finally, the same table presents as positive control a similar experiment with homotypic [π]/HELLP interactions.

      In addition, a mechanism is proposed to explain the toxicity associated with HELLP conversion to the aggregated state - membrane localization - but this model is not supported by robust data such as a marker for the membrane in the fluorescence images or a biochemical fractionation. Moreover, the absence of functional data, such as mutations that disrupt amyloid formation, leave the model with correlative observations to support it.

      We agree that we do not prove membrane association for HELLP. Considering the precedent of HET-S, it is however a plausible explanation for the documented cell-death inducing activity. We acknowledge that we do not provide experimental evidence based on biochemical fractionation or dual labeling that HELLP relocates to the membrane (this would probably require confocal microscopy). What we due claim however is that in this regard HELLP behaves analogously to HET-S, CgHELLP and HELLF. We have modified the text of the preprint to specifically make the statement that proof of membrane localization would require other approaches (in particular biochemical fractionation).

      The reviewer calls for mutations that disrupt amyloid formation and that should accordingly abolish HELLP toxicity. While this type of experiment is not lacking interest (this exact type of study has been made in the case of HET-S), we feel that at the present stage the fact that toxicity of HELLP is conditional and occurs specifically in interaction with [π] (not [π*] or other Podospora prions) is a sufficient support to legitimate the suggestion that HELLP functions analogously to HET-S, HELLF and CgHELLP by activation through amyloid templating.

      Finally, observations on the C. globosum system decrease the novelty of the observations.

      We address this comment below (response to substantive concern 1 of the reviewer #2).

      Reviewer #2

      This work reports the discovery of an amyloid-based cell death signaling pathway in the filamentous fungus, Podospora anserina. This makes the third such pathway in this fungus. As for the others, the amyloid in this case has prion-like activity, is selectively nucleated by a cognate innate immunity sensor protein, and results in activation of the membrane-disrupting activity of the protein. They show that all three pathways operate orthogonally - that is without cross-seeding. In contrast, cross-seeding did occur between this pathway and the putatively homologous human necroptosis pathway when it is reconstituted in P. anserina, which further supports an evolutionary relationship between them.

      Substantive concerns:

      1) The novelty of this finding is somewhat dampened by this group's prior demonstration of several of the major points of interest in previous papers. They had previously discovered and characterized the homologous pathway in a different fungus, and suggested an evolutionary link between fungal amyloid signalosomes and mammalian necroptosis using strong bioinformatic and structural evidence. In addition, they had shown that the two previously known amyloid signaling pathways in P. anserina operated orthogonally. Hence the major point of novelty, as reflected in the title, is the demonstration that this particular amyloid pathway can cross-seed the human necroptosis amyloids.

      We are honestly puzzled by this comment, shared indeed also by reviewer 1. At no place in the preprint do we claim that the discovery of the PP-motif is new, we build on preceding work on CgHELLP and claim novelty on distinct aspects. While argumenting on the significance of one’s work is somewhat of a vain enterprise, we shall nonetheless point the specific interest we see in these results. As part of our longstanding attention on Podospora as a model to study fungal PCD, we consider it of interest to document that this species contains three amyloid-activated HeLo/HELL-domain cell-death execution pathways. Bioinformatic surveys suggest the co-occurrence of several amyloid motifs in different fungal genomes, it is of interest we think to document this redundancy at a more functional level at least in one system. The present study is superior to the previous one on CgHELLP in the aspect that activity of the PP-motif proteins is being studied in their native context (not in a heterologous host that diverged from C. globosum tens of millions of years ago). Then, to our knowledge, RHIM-motifs have never been shown to behave as prions. There is a non-trivial relation of the concepts of amyloids and prions. The reviewer writes in a later paragraph that amyloids are inherently self-perpetuating but this does imply that all amyloids are prions (or vice versa for that matter). Showing that RHIM forms (like PP-motifs) a prion when expressed in Podospora, stresses we feel the functional similarity between the fungal and animal signaling motifs. The formation of the [Rhim] prions and their propagation in a fungal environment was not a foregone conclusion. It is our experience that not any amyloid sequence will form a prion in Podospora (Aβ, α-syn, etc..) and the reviewer is surely more than aware of the rich literature dealing with the amyloid/prion-relation in yeast models. The Podospora in vivo system might also be of use to others to study RHIM-assembly, for instance to screen for inhibitors of RHIM-assembly. As stated by the reviewer the major novelty is the demonstration of cross-seeding between fungal and human necroptosis pathways which has so far only been suggested on the basis of a sequence similarity on a minute motif of 5-10 amino acids in length. We feel that documenting cross-seeding does strengthen the hypothesis that these motifs are evolutionary related.

      2) Implications of "cross-seeding". The interspecific cross-seeding observed was modest; much lower than that for intraspecific templating between proteins of the same pathway. Specifically, it failed to induce a barrage, the puncta formed at different times, and colocalization was incomplete. More importantly, cross-seeding does not imply functional or evolutionary conservation. Consider the wide range of amyloid proteins that have been reported to cross-seed each other despite in some cases very different sequences, structures, and functions - for example the type-II diabetes peptide IAPP with the Alzheimer's peptide Aβ; the yeast prion protein Rnq1 with human Huntingtin; and the yeast prion Sup35 with human transthyretin. Although a direct comparison with the present data are not possible, these cross-seeding interactions appear comparably robust. The present demonstration of limited cross-seeding therefore seems not to add much additional support for an evolutionary relationship between necroptosis and fungal amyloid cell-death pathways.

      Cross-seeding is partial and not as efficient as in homotypic or intra-kingdom interactions. This is precisely our conclusion (see for instance line 470 to 473 of the original preprint). We point at this partial effect and state that it suggests both some level of structural similarity but also the existence of functionally important structural differences between RHIM and PP-amyloids. These results are in line with the fact that the consensus RHIM and PP-motifs while sharing some common position also markedly differ on others. The specificity of the cross interaction between [π] and [Rhim] prions is also supported by the absence of cross-reaction between [π] and the other Podospora prions (or between [Rhim] and [Het-s]). The same is true for the partial co-localization. These results serve as a functional context that will allow future structural data on the fold of the PP-motif to be meaningfully compared to the RHIM-structure. To insist on the partial nature of this cross-seeding underlying both relation and differences between PP and RHIM, we propose to modify the title of the manuscript to “Partial prion cross-seeding between fungal and mammalian amyloid signaling motifs”.

      The reviewer states : “More importantly, cross-seeding does not imply functional or evolutionary conservation”. Absolutely so. But when two amyloid forming regions show sequence similarity (not just composition bias) and both work as functional amyloid signaling motifs leading to necroptotic cell-death then cross-seeding is a further support (not proof) of evolutionary and functional conservation.

      3) Rigor of the fusion experiments. In all cases, despite having generated and validated the use of RFP- and GFP-labeled proteins, all fusion experiments to examine cell death microscopically (using Evans Blue staining) were between two GFP-expressing strains. This is frustrating because it makes it impossible to know from the images alone which of the two proteins is expressed in which cells, and in which cases of mycelia crossing paths is fusion occurring. I must therefore rely entirely on the labels provided, but they sometimes appear implausible. For example, the lower fusion event demarcated in Fig. 3C left panel would have been expected to allow GFP levels to equilibrate across the point of contact; instead there remains a sharp transition in GFP intensity between the two mycelia (third panel) indicating the cytoplasm is not being shared at the time of the image. In Fig. S8 top row, there is no apparent relationship between cell death and HELLP-GFP; moreover, cell death is seen occurring in mycelia containing either punctate or diffuse GFP-RIP3. While I appreciate that Evans Blue fluorescence may overlap with that of RFP (which should be stated) and preclude its visualization without multispectral imaging capabilities that may not be available to the authors, alternative viability stains and fluorescent proteins could in principle have been used to avoid this problem.

      Evans blue shows fluorescence that does indeed overlap with RFP fluorescence, which is the reason why we used GFP labeled proteins which is indeed less convenient to distinguish strains. But Evans blue staining allow clear and rapid identification of dead cells. Even with both strain labelled with GFP, strains can be identified based on diffuse versus dot-like fluorescence. Moreover, the fusion are observed in contact zone between the two strains under the microscope where the proportion of dead cells (stained cells) is drastically increased compared to the rest of the mycelium, the relative orientation and position of the filaments allows for strain identification. As for the concerns regarding equilibration levels of GFP or HELLP presence in heterokaryotic cells, it could be explained by the fact that necroptotic cell-death due to HELLP toxic effect, as for the others HeLo or HELL domain containing proteins (Seuring et al. 2012, Mathur et al. 2012, Daskalov et al. 2016, Daskalov et al. 2020), is associated with blocking of the septa to limit the spreading of cell-death through the entire mycelium. Fungal incompatibility is associated both with cell death and compartmentation of the mycelium.

      We thank the reviewer to bring to our attention the issues that may be encountered to clearly identify heterokaryotic cells on these images. Therefore, cell death imaging is presented in the new preprint using methylene blue allowing the use of RFP and GFP labeled proteins to identify unequivocally heterokaryotic cells.

      Minor Comments:

      1) The significance of these proteins forming "prions", as opposed to (merely) amyloids, should be articulated. This is important because prion-formation per se is irrelevant to the cell-level functions of the proteins, as nucleation of the amyloid state causes cell death and hence precludes their persistent/heritable propagation. Amyloid by nature is self-perpetuating at the molecular level and hence would seem to explain the properties of the protein. The discussion about possible exaptation of these pathways for allorecognition could be expanded or clarified in this regard.

      These are interesting points. Prion and amyloids are terms with different field of application. The term prion is only meaningful in vivo. We use it preferentially here, because for the most part we document prion propagation and only indirectly amyloid formation. We feel however that it might be premature to conclude that the prion-behaviour is totally irrelevant to the function of these proteins as signaling devices. This all depends (as for other prions) on the actual balance between toxicity and infectivity. It might well be that HELLP propagates part of the amyloid signal before it actually leads to cell death. Please note that even full length HET-S can be observed in certain growth condition in the form of dots and may thus partition between a toxic and an infectious fraction.

      2) Colocalization between two proteins does not imply that one has templated the other to form amyloid, even when both are capable of forming amyloid independently (see https://doi.org/10.1073/pnas.0611158104 ).

      We fully agree. We have corrected the labelling of the figures that document co-localization that were previously labelled as cross-seeding experiments.

      3) Statements of partial cross-seeding are supported by quantitation (Fig. 8). In contrast, the authors appear to use qualitative observations to support rather definitive statements about the "total absence of" (line 344) of cross-seeding between other pathways.

      Quantitative data are now given regarding the experiment presented line 344. It is true that the statement “total absence of” relates to the absence of detectable cross-seeding in the experimental setting that was use. Here in this specific case, no prion formation of [Het-s] was detected in a total of 18x2x3 infection attempts with [Rhim] prion donor strains (18 transformants for each [Rhim]-type in triplicate).

      4) Fig. S9. "Note that induction of [Rhim] in transformants leads to growth alteration to varying extent ranging from sublethal phenotype to more or less stunted growth." Can the authors suggest an explanation for this heterogeneity? From my limited perspective, it suggests the existence of amyloid polymorphisms (i.e. a prion strain phenomenon), which is quite unexpected given the lack of polymorphism among known functional amyloids in contrast to rampant polymorphism among pathological amyloids. Hence the phenomenon could be interpreted as suggesting that amyloid is not an evolved/functional state for the PP motif. In any case the phenomenon is interesting and merits further discussion.

      Phenotypic variability in this experiment can be explained by variation of expression levels of the transgene and prion curing. Transformation occurs through ectopic integration in these experiments (there are no autonomous plasmids available for Podospora). As a consequence in any given experiment, the transformants will display different copy number and integration sites of the transgene and hence variability in expression level. An additional cause of variety is “escape” a due to counter-selection when strain show self-incompatibility, fungal articles in which the transgene causing incompatibility is mutated or deleted will escape cell-death and resume growth. This is very typical of self-incompatible strains and has been largely documented and used as an experimental tool for mutant selection in Podospora and other filamentous fungi. This phenomenon typically leads to sector formation. Then in the specific case of experiments involving prion proteins in addition to these mechanisms leading to genetic variability, “escape” can also occur through prion curing. If a prion causes self-incompatibility, growth recovery occurs through prion curing (this has been largely studied in the case of the [Het-s]/HET-S interaction). We do not formally exclude the possibility that part of the variability may reflect prion strain formation but other explanations should probably be considered more likely, as indeed we have no evidence for strain formation for any of the wild –type functional prion motifs we have characterized so far in fungi.

      Reviewer #3

      Three distinct amyloid-based cell-death pathways in fungi have been reported. The authors of the current manuscript extend their previous work of the HELLP/SBP/PNT1 pathway in Chaetomium globosum and describe a similar system in P. anserina. It is shown that the amyloid signaling domain of PTN1 can form a prion in cells deleted of HELLP, which is otherwise activated by the prion to cause cell death. Using this artificial system, the authors test whether the related RHIM motif of the human RIP1 and RIP3 protein can also form a prion in P. anserina and whether RHIM amyloids as well as other fungal amyloid-forming motifs can cross-seed PTN1.

      The experiments are well executed and explained but I have a few suggestions:

      1) Amyloid cross seeding is usually assayed in vitro using purified protein fragments. The artificial genetic system used here is certainly clever but the expression level of different proteins needs to be measured for better comparison of cross-seeding efficiencies.

      We feel that the in vivo system presented here has important advantages, in particular is it less “artificial” than in vitro seeding in the sense that at least HELLP is in its native cellular context. Note also that the cross-seeding experiments are done with several distinct transformants which as explained above represent different expression levels of the transgene.

      2) Page 16, line 333-334 and Fig 8: How were recipient strains sampled? How random was it? How many samples?

      We thank the reviewer to bring this to our attention and to address these shortcomings, we added precisions on samples selection and numbers in results and in methods section.

      3) Jargons/abbreviations. Page 19, line 405; Page 20, line 429: What are PAMPs, MAMPs, and PCD?

      These abbreviations have been spelled out.

    1. While Mr. Turners ideas were of honorable intentions, ( so we think) , one could point out the mental status of this persons actions. I also would like to know who taught him the christian ways and who was apart of his upbringing and what their ideals were. As we know many christian's do not spare the rod; to include his enslavement, lack of social interactions, and a huge contributor may have been lack of proper nutrition with can lead to many aliments alone. Now whether his reasons for commiting the mass murders was indeed the voice of a spirit or just a story to cover his tracks , knowing that many at the time were very strong in their christian beliefs and the word of God, this does not excuse the fact that what his did was on his own terms. This story brings light to many current events and how we can study history to prevent future incidents. Thank you for the lesson and thought provoking reading material, Professor.

    1. While Scrum is structured, it is not entirely rigid.

      Being able to adapt, add meetings / remove meetings, or even change process as needed (ie: tiger team for critical fixes) is important.

      Once close to release - we added a "bug triage meeting" just to see if things were actually bugs or not, it served a purpose for a few weeks - then we killed it once it was no longer needed.

      I try to consider "what is the value I am getting out of X" - and how we get there may change over time.

      At Rangle, there was a "Rangle Flow" ---- I don't think any project every fully hit it, but it was a bit of an ideal that we strove for.

      The fact that every project wasn't run exactly the same really bothered some people, but it was something that I enjoyed.

      Different teams have different dynamics - and if something is working really well for one team, doesn't mean the same thing will work for another.

    1. 26 REPRESENTATSON: CULTURAL REPRESENTATIONS AND SIGNIFYING PRACTICESeffects. Bul the meaning depends, not on the material quality of íhe sign, butOH its symboMc fanction. l\s because a particular sound or word standsfor,symbolizes or represente a concepí that it can function, in language, as a signaad convey meaniog - or, as the construcíionists say, signify ísign-i-fy).1.5 The language of traffic lightsThe simples! exampie of this point, which is critical fbr an understanding ofhow languages funetion as represeníational sysíems, is the famous trafficlighis exampíe. A teafüc lighí is a machine which produces differentcoloured lights in sequenee. The effect of light of different wavelengths onthe eye - which is a natural and material phenomenon - produces íhesensation of differeBt colours, ISkrar these things certainly do exist in thematerial world. But ií is our cuitare which breaks íhe speetnim of light iníodifferent colours, disíiaguisaes them from one another and aítaches ñames -Red, Green, Yellow, Blue — to them, We use a way of classifying the colourspectruin ío créate colours which are different from one another. Werepresent or symbolize the different colours and cíassify thein according íodiíferest colour-concepís. This is íhe conceptual colour sysíem of ourculture. We say 'our culture' because, of courses other cultures may divide thecolour speeíram differeníly. Whaí's more, they certainly use diíferent actualwords or letters to ideníify different coiours: what we calí 'red', the French cali'rouge' and so on. This is the linguistíc code - íhe one which correlaíes certainwords (signs) wiíh certain colours (concepís), aad tfaus enables us tocommunicaíe about colours to oíher people, using 'the language of colours'.But how do we use this representational or symbolic sysíem to reguláis theíraffic? Colours do not have any 'true' or fixed meaniag in thaí sense. Reddoes noí mean 'Stop' in nature, any more than Green meansr 'Go'. In othersettings, Red may stand for, syroboíize or represent 'Blood' or 'Danger* or"ConuiíiHíism'; and Green may represent 'Ireland' or *The Countryside' or'Envkonmentalism'. Even these meanings can chasge. In íhe 'language ofelecíric plugs', Red used to mean 'the connection wiíh the positive charge'buí íhis was artóírarily and wiíhout explanation changad ío Browní Buí Lhenfor many years the producers of plugs had to attach a slip of paper teliingpeople that the code or convention had changed, otherwise how would íheyknow? Red and Green work in íhe language of traffic lighis because 'Stop' and'Go* are íhe meanings which have been assigned to them in our culture by thecode OF conventions governing íhis language, and this code is widely knownaad alraost universaíly obeyed in our culture and cultures Mee ours - thoughwe can well imagine oíher cultures which did not possess the code, in whichthis language would be a complete myster

      this example further helps me understand how powerful our associations can be as a society when thinking or naming things. we gave meaning to the colors red and green in the sense that they mean stop and go, because we associated those colors to colors of importance. it's a given now for everyone to think of those signals because we gave it importance, even though colors don't have definite purposes or definitions in itself.

    1. studying to deceive the wisdom of Zeus

      I found this statement very interesting because when we think of Zeus people often associate him as a person who has little to no weakness. Society views him as as someone who cannot be defied. This example of greek mythology shows how he is not as powerful as he may usually be portrayed.

    1. There may be no greater enemy to quality writing than the 5-paragraph essay.

      This alone is a statement each of us should have on our teaching desks. Sometimes we need this, especially when our students need structure in order to pass an exam or begin/jumpstart their writing for school (especially when we get them as high schoolers who have been trained not to write); BUT, a 5 paragraph essay isn't writing nor is it the teaching of writing. We have to think rhetorically and do better by our student writers.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Point-by-point response to reviewers

      Reviewer #1 (Evidence, reproducibility and clarity (Required)): **

      The authors constructed a virtually complete fitness landscape of the P1 extension region (4-base-paired helix) in the group I intron from Tetrahymena thermophila, using a kanamycin resistance reporter to evaluate the fold-change in fitness, which is related to self-splicing activity. This was a clever choice of system because it was known from earlier work that the P1 extension adopts two different conformations during self-splicing. The fitness of each variant was determined from the number of reads acquired from the sequencing data sets and analyzed through an extensive computational pipeline. The strength of the paper is that this machine learning approach can be used to calculate how individual variants contribute to the fitness landscape and assess the directions of epistasis across a large number of identified genotypes.

      We thank the reviewer for highlighting one of the key strengths of our manuscript, the fact that our analytical approach, using SHAP values, enables contributions of individual variants to be assessed in a genotype-specific manner. This approach provides for a sound, robust, and principled way of describing and understanding the fitness impact of one mutation in the context of (potentially many) others.

      The authors argue that machine learning more successfully models subtle effects that arise from interactions between RNA residues, and that the power to analyze deep mutational sequencing experiments can better rationalize fitness constraints arising from multiple conformational states.

      We do indeed argue that machine learning is likely to play an increasing role in making sense of deep mutational scanning data. These scans provide high-resolution information on how fitness maps onto genotype, but the molecular underpinnings of this relationship often remain obscure. It is these “hidden” underpinnings, including the effects of specific mutations on RNA/protein folding, structures, and dynamics, that machine learning approaches can help elucidate.

      The results are mostly consistent with previous studies even though the authors collected the data in a more advanced and complicated way. They are also able to rationalize complex phenotypes - for example, the observed fitness defects are more prevalent under an unfavorable growth condition (30ºC), because the lower temperature hinders conformational exchange. Although such cold sensitive effects are well known in RNA, it is gratifying that this can be captured in the fitness landscape.

      Finding temperature-related fitness effects that are consistent with impaired conformational exchange was also gratifying for us and we thank the reviewer for highlighting this finding.

      The results would be more convincing if the authors directly measure the self-splicing activity of a few key variants, such as the C2C21 mutant, to determine whether these mutations alter the self-splicing mechanism of the Tte-119(C20A) master sequence in the way that they infer from their model. In interpreting their results, they may want to consider misfolding of the intron core (coupled to base pairing of P1) and reverse self-splicing. Reversibility in the hairpin ribozyme, for example, turned out to be the key for understanding the effects of certain mutations.

      We appreciate that measurements of splicing activity for individual genotypes would complement and further strengthen our study. We will therefore aim to construct strains for a few key genotypes and assay self-splicing activity using RT-qPCR – an approach we previously used successfully to monitor splicing kinetics of self-splicing introns in yeast mitochondria (see Rudan et al. 2018 eLife 7:e35330). Specifically, we will quantify the fraction of spliced and unspliced transcripts using primers that span the exon-exon and the 3’ exon-intron junction, respectively (the 5’ intron-exon junction is genotypically diverse and would require genotype-specific primers). This will be done under non-selective (-kan) conditions, where the relative fraction of spliced and unspliced transcripts is a function of intrinsic splicing ability and not confounded by selection. We aim to include the master sequence, C2C21, G3C20 and its mirror genotype C3G20, U3 (which restores perfect complementarity in the master sequence), and G5 (inferred from the high-throughput experiment to make a strong negative contribution to fitness).

      In interpreting our results, we will consider different mechanisms of splicing failure, such as kinetic problems (slow dissociation of P1ex), misfolding of the intron core, reverse self-splicing, and the use of cryptic splice sites, which has previously been documented (see e.g. Woodson & Cech 1991 Biochemistry 30:2042-2050). We note, however that a precise mechanistic dissection of the splicing defects of individual variants is not the purpose of this manuscript and we therefore do not aim to establish genotype-specific defects in great molecular detail.

      Related to the point above, interesting conclusions regarding the relationships between base identity and epistasis that arise from metastability should be strengthened with additional examples. For example, the authors can explain why a reverse base-pairing variant (C3G20) exhibits negative epistasis but is not similar to that of the G3C20 construct. This would ideally use the data from the screen but also be validated by checking the self-splicing activity of a few individuals at low and high temperature.

      In measuring splicing activity and its link to fitness for a subset of key variants (see point #4), we will include at least one mirror example such as C3G20/G3C20. In addition, we will highlight additional examples of this mirror asymmetry based on the results from our high-throughput screen.

      They should validate the screen by showing that kanamycin resistance does indeed correlate strictly with self-splicing activity, and not some other feature such as RNA turnover. (It would also not be a bad idea to check this in the cell, which can be done by primer extension or Northern blotting.)

      This question (i.e. whether altered RNA stability rather than splicing efficiency explains differential KNT production and ultimately fitness) has previously been addressed by Guo & Cech (2002) when introducing the knt+intron reporter system. These authors found no difference in mRNA stability in constructs that displayed differential kanamycin resistance. To shore up this conclusion further, we will measure fitness (via colony counts, growth rate or more directly through competitive fitness assays) of the key variants for which we determine splicing activity (see point #4) and then correlate splicing and fitness.

      The benefit of the machine learning model is that it can extract signals that may be hard to detect otherwise. The downside is that it doesn't produce a physical model, as far as I am aware. The parameters are themselves not meaningful - except to the degree that trends in the fitness estimates can be explained after the fact. This is something that should ideally be explained more directly in the manuscript.

      The reviewer raises an interesting point, that indeed deserves further discussion/explanation. The reviewer is right that, at first sight, high-resolution fitness landscapes like ours do not directly produce a physical (structural) model of the molecule under investigation. They connect genotype and fitness, but the molecular intermediate – a biophysical structure – is not explicit. However, over the last few years, it has become apparent that deep mutational scanning experiments can – both in principle and in practice – yield information that can be leveraged to infer such a physical model. In short, covariation in fitness between residues in a protein or bases in an RNA can be used as inputs for constraint-based modelling of physical interactions. Notably, Schmiedel & Lehner (2019, Nature Genetics 51: 1177-1186) recently demonstrated that deep mutational scanning data can be used in this manner to reconstruct secondary and tertiary protein structure with high accuracy. In principle, the same approach can be used to reconstruct RNA structures. This will require more extensive, molecule-wide fitness data, but our study points towards just this future, even for data collected from structural ensembles.

      When we stated in the original manuscript that deconvolution of the fitness landscape might help to reverse engineer structures, this ability to interpolate between genotype and fitness to reveal hidden biophysical/structural relationships is what we refer to. We will revise the manuscript to make this connection more explicit.

      The authors claim that by evaluating a large number of sequences at two conditions, they can capture variants with intermediate phenotypes (Fig. 1). This is not necessarily true. If the original screen allows only the most active variants to survive on kan+ medium, then the signature of intermediate phenotypes may not be encoded in the original data, and thus not retrievable even with sophisticated algorithms, which may also be prone to overfitting. At what limit of stringency will the screen fail to yield information about intermediate fitness? How deeply must one sequence to recover this information, especially if noisy or degraded? Some discussion of these effects would be helpful.

      The capacity of any high-throughput sequencing-based DMS experiment to resolve intermediate phenotypes does indeed depend on a number of things. The reviewer highlights two of these: First, in screens where the phenotype is not binary (dead/alive) but fitness can be measured on a continuous scale, can we – and do we – capture phenotypes with intermediate fitness? What if only the fittest/most active variants survive? This is, ultimately, an empirical question, and one we can answer quite definitively: we do observe a large range of intermediate phenotypes, which – in our study – correspond to intermediate fold-change values. For each genotype, we can provide confidence limits and assess statistical significance. Table S1 provides this information. Our capacity to resolve these intermediate phenotypes is mainly based on three things. One is adequate sequencing depth, as highlighted by the reviewer. The second is the number of biological replicates (N=6) we analyse, which allows us to differentiate biological variability from noise for a large number of genotypes. This is an important aspect of DMS experiments that has often been overlooked (i.e. there are many other studies where only a single replicate is analysed and biological heterogeneity is not taken into account). With six replicates in hand, we can directly estimate variability (as done e.g. in our DESeq2 analysis) and quantify uncertainty so as to guard against overfitting. In our view, this is arguably more important than sequencing depth in deriving appropriate fitness estimates. Finally, we can resolve intermediate phenotypes because we keep the time lag between initial exposure to kanamycin and assaying genotype frequencies relatively short (overnight growth, see Methods). Our experiment is effectively a multi-genotype competition experiment, and we provide a snapshot across the genotype pool at a given time. If we had measured after several days of culture, genotypes with greater relative fitness would have spread further through the population, at the cost of less fit genotypes, many of which would likely have been eliminated. We kept measurement lag relatively short on purpose so that we could see a clear differential response to kanamycin while still being able to catch more than just a handful of the very fittest genotypes.

      In light of the above, it will be apparent that there are no simple answers to the reviewer’s questions about required sequencing depth, levels of stringency, etc. The ability to assign differential fitness across a large population of genotypes hinges on multiple interrelated considerations (sequencing depth, complexity of the final & starting pool, number of replicates). In revising the manuscript, we will highlight some of the key considerations just discussed, bearing in mind that the manuscript cannot possibly discuss all possible pitfalls and requirements of deep mutational scanning experiments in great detail.

      Lastly, the evolvability of RNA is fascinating and there is much to learn. However, the authors don't discuss the implications of their findings for molecular evolution although they throw the term around. It would be exciting if there is a trend in the fitness landscape that could help explain the trajectory of RNA evolution in nature.

      We agree with the reviewer that it would be exciting to link deep mutational scanning results more closely with observable patterns of RNA evolution. This is true both in relation to evolution of P1ex/group I introns specifically and evolution of dynamic RNA structures more generally. Regarding the latter, we note that selection against excess stability has previously been inferred for 5’ UTRs (see e.g. Gu et al. 2010 PLoS Comp Biol 6: e1000664), although our case is slightly different in that a helix still needs to form but be sufficiently unstable to enable swift dissociation. We also note that riboswitches might make for an excellent subject to study asymmetric constraint and selection against excess stability as they involve formation of competing helices (including participation of some but not all nucleotides in more than one helix), their structure/function is well understood, and many examples are known, providing opportunities for evolutionary analysis. We consider this outside the scope of the current study. We will, however, seek to analyse patterns of evolution in P1ex to establish whether they correspond in a meaningful way to the fitness trends we observe in the laboratory. To do so, we will analyse the distribution and evolutionary history of variants across orthologous introns in different Tetrahymena species/strains, with a focus on P1ex, P10 and the surrounding sequence. Fortunately for us, the 23S ribosomal RNA gene in which the intron is embedded has been used as a phylogenetic marker so that intron/exon sequence information is available for a reasonable number of species/strains (see Doerder 2018 J Eukaryot Microbiol 66:182-208). We will generate an alignment of these sequences and ask, for example, whether N2-N5 are subject to different constraints than N18-N21 mirroring our experimental findings. We have previously successfully quantified patterns of variation surrounding self-splicing introns in yeast mitochondria (Repar & Warnecke 2017 Genetics 205:1641-1648). Note here that extending this analysis beyond Tetrahymena is problematic. Specifically, the intron is absent from close relatives of Tetrahymena (Doerder 2018 J Eukaryot Microbiol 66:182-208) and P1-proximal structures of distant relatives are quite variable. In addition, we are looking at intronic regions that are not only adjacent to but also directly interact with exonic sequence. The exonic context in which the intron is embedded therefore matters but will be quite different for more distant group I introns. We therefore think that aligning and comparing distant orthologs has limited merit.

      The authors use the abbreviation DMS for deep mutational scanning; the RNA structure field uses the reagent dimethylsulfate that is also abbreviated DMS. They may want to choose a different acronym or just avoid an acronym altogether.

      We appreciate this point about false-friend acronyms. We will either find a different acronym or avoid it altogether.

      Reviewer #1 (Significance (Required)):

      As the importance of RNA structure for gene expression becomes more widely appreciated, interest in understanding the evolution of RNA structures is also increasing. Compared with the molecular evolution of proteins, evolution and fitness in RNA is far less understood, although the authors appropriately point to a number of recent studies on this topic. The main advance here is to use machine learning methods to analyze the results of a large genotypic screen, with the goal of more accurately capturing the fitness effects of sequences at varied distances from the parental sequence. The specific conclusions reached here such as the importance of metastability or the prominence of cold sensitive effects are not revolutionary, but the authors illustrate how such phenomena can be investigated more systematically and in more depth.

      We thank the reviewer for highlighting that our analytical approach showcases how deep mutational scanning data can be analysed in an unbiased and systematic manner to better understand the relationship between genotype, molecular phenotype (e.g. structure), and fitness. The reviewer also rightly points to specific results we obtain regarding temperature-related effects and metastability of P1ex/P10. However, we believe that the most important contribution of this work is a more general one, namely our proof-of-principle demonstration that deep mutational scanning data can capture multiple conformational states simultaneously, and that these states can be deconvoluted from a single fitness landscape to attribute the fitness impact of individual mutations to specific RNA conformations. To our knowledge this had not been explicitly demonstrated before and our work provides an important cornerstone for future studies looking to interpret mutational effects in either RNAs or proteins in the light of dynamic structures.

      In light of comments by reviewer #2 below, it is worth reiterating the proof-of-principle nature of this study. Many of the specific results we obtain (e.g. importance of avoiding excess stability in P1ex) are not revolutionary. Indeed, we would be worried if they were. We chose to investigate P1ex because substantial prior work exists that has furnished us with solid positive controls. This independent prior validation allows us to both have great confidence in the data we generate and demonstrate cogently that the two conformational states at the beginning and end of the splicing reaction are captured in the data.

      Finally, we believe our work, in covering a virtually complete genotype space, using multiple replicates to quantify uncertainty in fitness estimates, and using SHAP scores to interpret variant effects in genotype-specific context, sets a new high bar for this type of study and will provide valuable reference data and analytical recipes for future analyses. **

      Reviewer #2 (Evidence, reproducibility and clarity (Required)):

      The manuscript by Soo et al probes the effect of mutations on the fitness of the Tetrahymena Group I self-splicing intron. They used high-throughput sequencing to simultaneously identify the effect of every possible sequence in a 4-bp helix. The approach is sound and the conclusions are generally supported. However, the analysis seems overly complicated given the dataset. Both the analysis and the accompanying writing make it difficult to understand what seems to be a fairly clear conclusion - that the relative stabilities of two alternative RNA helices are important for splicing.

      We thank the reviewer for testifying to the validity of our approach and the soundness of our conclusions. Regarding the complexity of the analysis, the reviewer is right in that – for the conclusion that the relative stabilities of two alternative helices are important for fitness – a simpler analysis would have sufficed. However, as elaborated in response to point #11 above, our objective here is not merely to draw specific conclusions about the relative stabilities of P1ex and P10, but more general: a) to demonstrate that a single fitness landscape can be deconvoluted to implicate multiple conformations in fitness defects and b) to provide a basic but powerful recipe for doing so in an unbiased, systematic manner using machine learning.

      We will strive to make the writing clearer so that readers can follow this reasoning and appreciate our analytical choices.

      • **Major Comments** *

      The authors state that this method can identify the impact of transient conformational states. However, the two conformational states in this study are not transient - in fact they are associated with two distinct chemical steps of splicing and are quite stable. It may be that the effect of important transient states would be observed, but this study does not demonstrate that.

      We used the word “transient” to describe two alternative RNA structures formed during the life cycle of the intron. Both states (characterized by P1ex and P10 formation) are transient in as much as they disappear as splicing proceeds. In retrospect, we agree with the reviewer that this usage is too loose (given how the term is generally used in the literature) and might evoke the wrong connotations. We will therefore revise the manuscript to eliminate references to P1ex and P10 as transient states, but rather describe them as alternative conformations. Of course, the general point remains true: that deep mutational scanning data should in principle capture all fitness-relevant structural states even if these are transient (in the strict sense of the word).

      "Fitness" ends up being on an arbitrary scale, which impairs some analysis. A similar high-throughput sequencing pipeline could have been used to directly monitor splicing of every mutant, though at this point that is outside the scope of this study. Even with the arbitrary units, it would be clearer if more time were spent comparing fitness to base-pair stability on an individual basis, rather than the broad analyses. (See minor comments for details.)

      The reviewer is right in saying that a high-throughput pipeline could have been designed to monitor splicing of each genotype directly (rather than assaying fitness of the cell population that represents a particular genotype).We chose not to do so. One reason for this is that monitoring splicing directly would have necessitated design of a more complicated assay. This is because, to monitor splicing efficiency, one would have to monitor both pre-mRNA and mRNA for different genotypes. The former is straightforward (using primers that span the exon-intron junction) but the latter is not: successful splicing removes the genotype-specific information from the mRNA (that information being solely encoded in the intron). This a solvable problem in principle. One might, for example, introduce barcodes of sufficient complexity in the mRNA that can be linked back to the intron genotype, but doing so would have introduced a further source of error and complicated analysis. We therefore opted for monitoring genotypic fitness by sequencing the plasmids from which the RNAs originate. This does mean that our measurements of fitness are not coupled to a specific molecular phenotype (such as splicing efficiency) – we presume (but are not entirely sure) this is what the reviewer refers to when talking about fitness being on an “arbitrary scale”. However, fitness derived in this manner has the advantage of providing information that does not start from a mechanistic preconception. We ask how variant affects survival and reproduction of the cell without presuming specific mechanism and the results can therefore capture any mechanism, including those that we did not consider initially. The challenge then becomes to tease out possibly multiple mechanisms from unbiased data.

      We will tackle the reviewer’s final comment, regarding analysis of base-pair stability, below in response to one of the minor comments (point #20).

      \*Minor Comments** *

      The sentence in the abstract beginning "Using an in vivo report system..." is very difficult to comprehend. This is due both to the length of the sentence and the word usage. The final sentence of the abstract is similarly difficult. In general, the writing overemphasizes complexity at the cost of clarity.

      We will revise the entire manuscript to make the writing both clearer and more concise.

      Analysis of results in terms of "epistasis" obscures what could be a straightforward observation. This is the same as saying that mutants are not independent, or that their energetic costs are not additive. This follows obviously from the observation that the nucleotides being mutated are base-paired.

      Making explicit reference to “epistasis” is a considered choice. Framing results in terms of epistasis might be less familiar to readers grounded in RNA or protein biophysics/biochemistry, but is very much at the heart of thinking about the genotype-phenotype relationship from an evolutionary perspective, where global descriptions of epistasis are commonplace and usually provide the starting point for thinking about genotype-phenotype relationships, evolution and evolvability. So what seems unnecessarily obscure when seen through the lens of one field, is natural when considered in the context of another. Importantly, it is also the central approach adopted by many if not most prior deep mutational scanning studies (see e.g. Hayden et al. 2011; Pressman et al. 2019; Zhang et al. 2009; Li et al. 2016; Puchta et al. 2016; Domingo et al. 2018; Li and Zhang 2018; Weinreich et al. 2013; Lalić and Elena 2015; Bendixsen et al. 2017 as cited on page 3 of the manuscript) so we think this framing is helpful to compare our results to prior work.

      We expect that the readership will include many researchers interest in mapping genotype-phenotype-fitness relationships who will expect to see global analyses and descriptors of the type we present. We will, however, revise the manuscript to ensure that our description of the findings remains accessible to readers from other fields.

      More specifically, we also note that the fact that mutations are not independent (i.e. epistasis exists) might be trivial from the fact that P1ex is a base-paired helix. The magnitude and direction (“sign”) of epistasis, however, are not. In fact, as we describe, contrary to prior DMS on RNA helices, we find a lot of positive epistasis, reflecting, as we argue, selection against excess stability of P1ex to allow subsequent formation of P10.

      The novel information is the sensitivity of fitness to base pairing. This is best shown in an analysis like Figure 3A (see below), not broad measures of epistasis.

      Please see responses to points #11, #12, and #16 above for an elaboration of what we consider to be the main merits of this study and why providing broad measures of epistasis is a sensible choice.

      Figure 1C isn't necessary for the reader to understand the process.

      We are happy to follow editorial guidance as to whether this panel is superfluous and should be removed or is worth including.

      It is unclear what figure 2C is showing. It appears that the replicates are similar to each other, that 30 deg C and 37 deg C are also similar, but that +/- Kan are different. This probably doesn't need a figure in the main text.

      This figure does indeed capture what the reviewer describes: genotype pools in +/-kan are least similar to each other, while 30/37ºC are similar but distinct in the +kan condition and effectively indistinguishable in the -kan condition, in line with expectations. We agree with the reviewer that this information per se is something that would typically be found in a supplementary figure. However, we would advocate for retention of this panel in the main manuscript in this instance because of the way in which it was derived: using the Bray-Curtis dissimilarity index. To our knowledge, this is the first time that Bray-Curtis dissimilarity has been used to quantify, in a principled way, the similarity between genotype pools. Borrowed from the ecology literature, the index captures both richness (number of different species/genotypes in the ecosystem/genotype pool) and relative abundance to provide an integrated measure of genotype diversity. We believe that this measure will be useful for future studies and rather than relegating the figure to the supplement, we would aim to briefly highlight its methodological novelty. *

      *

      Figure 3A could be the most informative part of the manuscript. However, predicted minimum free energy should be on the x-axis as the independent variable. The expectation then is that you would see a peak in fitness at some free energy, with fitness falling off both with increased and decreased stability. Furthermore, there should be more analysis along these lines. The authors should calculate helical stability for both P1ex and P10 for every mutant and compare with fitness. Mutations which affect both could also be separated out. Figure 4C comes the closest to this but views it only in terms of GC pairs; there is no reason not to quantify the energetic effects given that predictions of stability for helices is quite good. Deviations from a model invoking only helical stabilities would indicate another factor is involved (alternative base-pairing or tertiary structure, for example).

      We agree with the reviewer that the axes in Figure 3A should be flipped and we will do so in the revised manuscript. We also agree that, when it comes to helical stability of P1ex, the simple expectation would be to see a peak at a certain stability with drop-offs either side, as intimated by Figure 4C. We further agree with the reviewer that Figure 4C is rather indirect and can be made more quantitative by considering helical stability across all genotypes directly. To this end, we will use one of the many tools available that allow prediction of helical stability from primary sequence (e.g. the enf2 function in RNAStructure, as used by Torgerson et al 2018 RNA, see point #24 below) and replace Figure 4C with a more quantitative fitness landscape based on these computations. To provide added confidence in the computations of helical stabilities from primary sequence in the context of our structure, we will also calculate helical stabilities from molecular dynamics simulations for the subset of genotypes we considered previously (Figure 4E/F) and see how inferred stabilities compare.

      There appears to be a missing verb in the legend for figure 3A, second sentence.

      We will fix this error.

      Figure S5 appears to be redundant with Figure 1.

      At first glance, Figure S5 does indeed appear redundant with Figure 1 but it is not. Figure S5 shows the relevant sequence of the group I intron and bordering exons in its native context, i.e. when embedded in the 23S ribosomal RNA gene of Tetrahymena thermophila, whereas Figure 1 shows the genotype of the mutant intron embedded in knt. The sequences are different. We will revise the legend to Figure S5 to make this clearer.

      Figure S6 is a better analysis than what appears in the main text, and could be expanded to all base pairs.

      We will expand Figure S6 to include all base pairs as suggested. We disagree that this is a better analysis compared to what appears in the main text. Rather, it provides a complementary, hypothesis-driven view whereas the analysis in the main text is more systematic and unbiased in approach. *

      *

      Reviewer #2 (Significance (Required)):

      This manuscript largely focuses on the technical approach. The shift in analytic strategy described above would increase the conceptual impact. The conclusions are consistent with and fit in with recent uses of high-throughput sequencing to study RNA systems. For example Pitt & Ferré-D'Amaré, Science (2010) and Kobari et al, NAR (2015) describe fitness landscapes of the ligase and HDV ribozymes, respectively. Torgerson et al RNA (2018) make similar measurements on the glycine riboswitch, including a treatment of relative helix stability for two mutually exclusive conformations. The overall results are of interest to researchers in the field of noncoding RNA.

      We thank the reviewer for highlighting the paper by Torgerson et al, of which – embarrassingly – we were not aware. We will make reference to this paper in a revised manuscript and highlight that riboswitches might be a good model system to further explore asymmetric constraint and selection against excess stability in an evolutionary context (also see our response to point #9 above).

      As highlighted earlier, we think the main conceptual impact of our work lies not in the description of helical stabilities. Rather, it lies in a) providing a rigorous proof-of-principle that deep mutational scanning can capture multiple conformational states simultaneously, and b) that, using an unbiased machine learning approach, these states can be deconvoluted from a single fitness landscape to attribute the fitness impact of individual mutations to specific RNA conformations. A shift in analytical strategy to “cut to the chase” and narrowly focus on helical stability would be misguided in this context, as we seek to provide not only insights into the data at hand but also lay out a sound and general recipe for analysing similar datasets in the future.

  3. Sep 2020
    1. There will always be times in history where a movement can be polluted by outside issues. I think of this as similar to the visions seen by Joseph Smith. The second Great awakening was a moment in time where we can look back and see some positive things but then realize that there may have been a false profit that skewed the message. The same could be said for Nat Turner. I think this is an example of mental illness and the grandiose ideas that can accompany certain diagnosis. It is unfortunate that things like this can cast a shadow onto the good.

    2. It's unfortunate that so many men, women, and children were murdered during this rebellion. However, it is quite common for all living things to become casualties of war when there is an act of "war". I don't agree fully with Nat Turner murdering so many individuals. Nevertheless, he may have seen his rebellion as an act of God because of the way he was treated from birth. Sometimes you have to put yourself in another's shoes to understand why they say what they say and to understand their actions.

      Murder is condemned in the Bible but Nat felt God called upon him to rid the world of it's evils which so happened to be the many he killed. I think if the shoe were on the other foot and it had been us in present day in his shoes we may have done the same thing. The lengths an individual will go to for freedom can come in many forms when you have been mistreated and beaten and ripped of your dignity. Just as we experience psychological events now that cause trauma. We have to acknowledged the trauma he endured and his ancestors endured which led to his breaking point along with many other's who participated in the rebellion.

      Again, I'm not saying murder is okay and was the answer but I cannot make judgement on the situation when I did not live during his time, nor do I know what it is like to be stripped of your freedom and dignity. I cannot say my actions would have been of anything less than his and the others which is sad to say but truthful. All he had was his faith in God and he felt God chose him to lead and make a statement of his rebellion.

    3. As I was reading Nat Turner’s confession, I found myself horrified and deeply moved. I could not stop reading his statement, even though it was terrifying to read. What I found the most troubling is that Nat uses verses from the Bible and saying he heard from God to justify his violent behavior. Nowadays, I am afraid if someone did as Nat had done, we might label them as psychotic. While any murder is significant, I think it must be addressed that there were over fifty men, women, and children killed by Turner and his followers. This was not one or two lives that were murdered but over fifty lives. This was a massive massacre. Turner’s reputation of being able to hear from God aided in his credibility and made others more willing to follow his lead. When he talks with the attorney, Thomas Ruffin Gray, he openly admits that God made him do it (the murders). He was not doing what he himself wanted to do but what God wanted him to do. What a terrifying thought to justify one’s actions by claiming they did it because God had told them to. Another incredible thing to consider is that Nat Turner knew there would be consequences for his actions. He was a slave who was bold and brave enough to step up and take a stand against slaveholders. While most of us may not agree with the actions taken my Turner and his followers, I do not know how we can deny where their aggression stemmed from.

    1. They have improved his food, his clothing, his shelter; they have increased his security and released him partly from the bondage of bare existence.

      Humans are only at the top of the food chain because of their ability to make and manipulate technology - homo faber

    2. Consider a future device …  in which an individual stores all his books, records, and communications, and which is mechanized so that it may be consulted with exceeding speed and flexibility. It is an enlarged intimate supplement to his memory

      Sounds like IBM's Watson

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Dear reviewers,

      Thank you very much for your constructive and helpful remarks and suggestions!

      We marked the changes in the manuscript in yellow.

      Our replies to the specific points:

      Reviewer #1 In the Introduction the authors need to cite earlier work in Chlamydomonas which first showed that binding of specific proteins to the psbA 5'UTR is correlated with increased translation in the light (Danon et al. 1991).

      As suggested, we added the reference to the introduction.

      Reviewer #1 The paper could be improved by testing for protein binding to the footprint region in high vs low light. An obvious candidate is HCF173.

      We agree that HCF173 is an obvious candidate, although its interaction could be mediated via additional proteins. Alice Barkan’s group has demonstrated that in maize HCF173 binds to the same region upstream of the translation initiation region (McDermott et al., 2019) where we detected a footprint (Supplemental Figure S11A-D). Furthermore, McDermott et al showed that the binding sequence is conserved. We would like to analyze this question in more detail, but we have currently in the lab no approach available to specifically isolate psbA mRNA with its bound proteins for this analysis and therefore have to postpone the answer to this question to future studies.

      Reviewer #2: \*Important changes to make before full submission:** 1)It is becoming clear that the translation efficiency (TE) is often not a calculation of translational output from specific mRNAs but in fact is better to be described as ribosome association. There can be many reasons for increased ribosome association including ribosome stalling and increased translational engagement. It would be good for the authors to add a simple Western blot to demonstrate directly increased protein output from psbA during high light as compared to low light treatments. This figure could be added to Figure S1.*

      We want to stress that we have chosen a condition that is well known to increase psbA translation in higher plants as shown in the literature with different methods (e.g. Chotewutmontri and Barkan, 2018; Schuster et al., 2020). The protein encoded by psbA, the D1 subunit of photosystem II, has an increased turnover in high light, i.e. a higher amount of D1 has to be produced to compensate for the increased degradation of photodamaged D1 (Mulo et al., 2012; Li et al., 2018).

      Although there is a lot of evidence in the literature for good correlation of translation efficiency as determined by ribosome profiling and protein synthesis, the reviewer raised a valid concern. Ribosome pausing or even ribosome stalling could also cause increased ribosome binding and thereby increased amounts of ribosome footprints. Therefore, we analyzed ribosome pausing in selected genes including psbA and rbcL. The pattern of ribosome pausing was very similar in low and high light (new Supplemental Figure 14), which rules out any ribosome stalling at specific sites or drastic changes in ribosome pausing. To analyze if there is increased ribosome pausing, we determined the fraction of footprints at pause sites compared to the total number of footprints. We used two different pause scores as cutoffs to determine pause sites. To include as many pausing events as possible, we used a pause score of 1, i.e. everything higher than the mean ribosome density per nucleotide of the corresponding coding region (Gawronski et al., 2018). This fraction was unaltered in low and high light (new Supplemental Figure 14). With a more stringent pause score of 20 (20 times higher ribosome density than the mean), an increase of ribsome pausing in high light was detected for psbA, whereas we did not find differences between high and low light for rbcL and psaA. However, this increase in pausing at the psbA mRNA is insufficient to explain the increase in the total amounts of ribosome footprints. Additional pause scores were tested, the value for the psbA fraction with a pause score of 20 included in Supplemental Figure S14 showed the largest difference.

      Reviewer #2: \*Strongly suggested additions to the manuscript to improve its significance before publication** 1)Identifying the RNA-binding protein(s) (likey HCF173 which may be in a complex with other proteins) that interacts with the 5' UTR of psbA in a highlight dependent manner would increase the significance of this study. Finding that this protein binds to other plastid transcripts with weak Shine-Delgarno sequences would also be a nice addition to this study.*

      See comment to reviewer 1. McDermott et al. (2019) describe HCF173 as relatively specific for psbA. Therefore, we do not assume that other genes with weak Shine-Dalgarno sequences are regulated via HCF173 but via different proteins using a similar molecular mechanism to influence the mRNA secondary structure at the translation initiation region.

      Reviewer #2: \*Strongly suggested additions to the manuscript to improve its significance before publication** 2)Mutational analysis of the RBP binding site and also to change the secondary structure around the start codon based on the new structure maps to show the effects of these various changes on protein output would really provide important new findings on how important the RBP being as compared to the RNA secondary structure changes are for regulating protein output form psbA. It could also allow the demonstration of the dependence or independence of these two features on regulating translation from chloroplast mRNAs.*

      We agree with the reviewer that this would be a very interesting study. Unfortunately, it requires a larger collection of lines with mutated psbA sequences. Plastid transformation in Arabidopsis thaliana is still technically demanding and time consuming. Even in the case of Nicotiana tabacum, for which plastid transformation is well established, such a project would likely need several years. We therefore think that such a study is beyond the scope of the current manuscript.

      Reviewer #3 1.In this paper, author mentioned that DMS can modify four nucleotides under alkaline conditions. Because the chloroplast is slightly alkaline, the authors use DMS reactivity from 4 nucleotides to model RNA secondary structure. Based on Kevin Weeks' s paper, it shows that in cell-free condition, DMS has very limited ability to modify single-stranded G and U compared to A and C (Anthony M. Mustoe et al., 2019, PNAS 116: 24574. fig. 1B). In Lars B. Scharff' paper which is cited by the author, it is also mentioned that A and C is more reliable to model RNA secondary structure. The authors might need to calculate the correlation the DMS data and known RNA structure using G/U or all four nucleotides to show that DMS reactivity from G and U is also reliable to be used. Also in Fig. S3B, the reproducibility of G/U between replicates is not as good as A/C. I don' t think G and U can be used to predict RSS.

      We agree with the reviewer that DMS reactivities at G/U are less reliable than those at A/C. This was shown by Mustoe et al. (2019) and by us for chloroplast rRNAs (Gawronski et al., 2020, Plants). We included a correlation of the known 16S rRNA secondary structure and the DMS reactivities at the different nucleotides (Supplemental Figure S5A) that demonstrates that the DMS reactivities at G/U actually contain information about rRNA secondary structure. This analysis demonstrated again that the reactivities at G/U are less reliable than at A/C. Therefore, we added an analysis of the more reliable A/C for comparison with the results for all four nucleotides (Figure 1D-F, 3C-F).

      Reviewer #3 2.Is the 5'UTR the only region which has RSS change? If not, how do RSS changes in other region contribute to translation?

      Translation initiation in plastids is mainly influenced by the secondary structure of the translation initiation region, especially at the cis-elements required for the recognition of the start codon. In addition, we have analyzed different other regions, e.g. the coding regions, the coding regions without the sequences next to the start codon, the end of the coding region, and the complete 5’ UTR (Supplemental Figure S14). We added a more detailed analysis of the changes of secondary structure of the coding region of those genes we focus on (Supplemental Figure S16). This shows that the secondary structure changes of the complete coding region correlate negatively with translation efficiency (see also Supplemental Figure S14G). A similar observation was made in E. coli and explained to be caused by differences in translation initiation, which are mainly influenced by the secondary structure of the translation initiation region (Mustoe et al., 2018).

      Reviewer #3 3.In Fig. 2A and 2B, the DMS reactivities seem very similar under low light and high light. Why did the authors obtain significantly different RNA secondary structure? Are the parameter of low light and high light the same when modelling RNA structure?

      The parameters for the RNA secondary structure predictions in Figure 2 are not identical (see Figure legend). For all structure predictions, the DMS reactivities were used as constrains, but only for the high light structure the sequence of the RNA binding protein’s footprint was forced to be single-stranded. These structure predictions are included to illustrate the mRNA structures in the presence and absence of an RNA binding protein. These structures are based on the observation that the two halves of the stem loop structure have different DMS reactivities in response to high light. The sequence including the protein footprint has lower DMS reactivities in both low and high light. This is in agreement with both a double-stranded sequence as well as a protein-bound sequence. In contrast, the other half of the stem loop, the sequence including the cis-elements of the translation initiation region, has increased DMS reactivities in high light, indicating that it is single-stranded. This suggests that there is protein binding in high light preventing the formation of the inhibitory stem loop.

      Reviewer #3 4.In Fig. S12, the correlationship between HL and LL in ribo-seq and RNAseq is high, which means no significant changes upon light change. In this paper, psbA should have translation change under high light conditions. I suggest the authors to label the dot representing psbA.

      Thank you very much for this suggestion! We marked psbA in the correlation plots (Supplemental Figure 12). The changes in the transcript levels are really minor, whereas for some genes the translation efficiency changes (see Figure 4 and Supplemental Figure S13).

      Reviewer #3 5.I suggest to use plants at the same stage for DMS-MaPseq and SHAPE probing.

      The different plant material was chosen because of the different requirements during probing. In this context, we would like to point out that observing the same changes in the translation initiation region in response to high light in different developmental stages is a stronger confirmation than observing the same response at the same developmental stage. This indicates that the response is not specific for a developmental stage.

      Reviewer #3 6.In Huang's paper (Jianyan Huang et al., 2019, Cell Reports 29: 4186-4199), there are many differential express genes under high light for 0.5hr. However, in the RNAseq data here, the correlation between high light and low light conditions is very high (Fig. S12). Why? Also, it would be nice if the authors could label several DEG whose expression change under high light treatment in Fig. S12?

      Supplemental Figure S12 contains only plastid-encoded RNAs, whereas Huang et al. (2019) focused on nuclear-encoded mRNAs. We clarified the figure legend of Supplemental Figure S12 by adding “of the plastid-encoded genes”. The values for the individual genes can be seen in Supplemental Figure S13.

      Reviewer #3 7.For the MNase footprint method, is the as-SD region the only region show enrichment under high light conditions? Besides, please provide the detailed method of MNase footprint. Does it work for RNA footprinting?

      The used methods are described under “Ribosome profiling (Ribo-seq)” and “Processing of Ribo-seq and RNA-seq reads” in Material and Methods. The approach was very similar to the one used for ribosome profiling with the difference that also smaller read lengths were included in the analysis (18-40 nt instead of 28-40 nt). We did this, because many plastid RNA binding proteins have footprints that are smaller than a ribosomal footprint. The described footprint is the only one detected near the translation initiation region of psbA. Binding of HCF173 was detected by the Barkan group in the same region using a RIP-Seq Analysis combined with RNase I digestion (McDermott et al., 2019), which confirms that our approach is working. We added a reference to the method section in the results part to clarify which approach was chosen.

    1. Reviewer #1

      Thank you for inviting me to review this manuscript by Paquola and colleagues, in which the authors used a combination of high-resolution anatomical data, machine learning, spectral DCM and resting functional connectivity measures to interrogate the relationship between structural and functional gradients of organization within the mesial temporal lobe.

      The study is broken into four related sections. In the first section, the authors analysed vertices within a set of mesial temporal lobe structures using a random-forest algorithm, which identified a set of microstructural profiles across the structure. They then interrogated these profiles for evidence of an iso-to-allometric axis, which is a principle known to characterise the transition from 6-layered isocortex (in entorhinal cortex) to 3-layer allocortex (in the hippocampal formation). The authors found evidence consistent with this transition in the BigBrain data, particularly with respect to the skewness of the distribution of thickness across the layers.

      In the second section, the authors use Spectral DCM on resting state data from a group of 40 individuals. They then relate the results of the spectral DCM model to the gradients identified using structural anatomy. This section was well-motivated and conducted.

      In the third section, the authors compare the structural gradient to resting state functional connectivity with vertices within the cerebral cortex. The results here were quite compelling, showing a dissociation between the iso- and allo-cortical poles in the MTL in which the iso-cortex was correlated with fluctuations in the lateral dorsal attention and frontoparietal networks, whereas the allo-cortical pole was correlated with vertices in the default mode and medial occipital regions.

      In the final section, the authors conducted a number of checks of their analysis, including an SNR test to ensure that the temporal lobes (a notorious site for MRI signal dropout) were adequate, and a substantial replication analysis. They should be commended for these steps, and also for making their code freely available.

      Comments:

      1) Section 1: I wonder whether the manuscript might benefit from the unpacking of the random forest results. Is there an intuitive way to characterize skewness that may benefit the reader - such as a particularly uneven spread of thickness distributed across the layers? And is this finding something that we might expect, given the hypothesized gradient of iso-to-allocortex in the MTL?

      2) Section 1: Along these lines, is it fair to single out an individual measure from the random-forest regression as being the most salient? From my understanding (which might be mistaken), the weights on a particular variable in a regression need to be viewed in context of the performance of the whole model.

      3) Section 2: One minor comment is that it might be helpful for the reader if the "in" and "out" effective connectivity directions were incorporated into the matrix in Figure 2A.

      4) Section 2: I wasn't sure that I followed the logic of the experiment in which the authors split the MTL data into thirds to test for the consistency of their results. Were each of these sufficiently powered to allow for direct comparison with the main effect? Did the boundaries between these models cut across known regional areas? Perhaps a different way to achieve the same ends would be to use bootstrapping in order to provide a confidence interval around the relationship between structure and function?

      5) Section 3: Did the authors hypothesize the iso vs. allo-cortical relationship to resting state networks a priori, or was it discovered upon exploration of the data. Either is fine, in my opinion, but I think it would benefit the reader to have these results placed in the context of the known literature.

      6) Section 3: Do the authors expect that the patterns identified in the MTL will relate to subcortical gradients identified in other structures, such as the cerebellum (Guell et al., 2018), thalamus (Müller et al., 2020, and basal ganglia (Stanley et al., 2019)? See also Tian et al., 2020 for general subcortical gradients.

    1. Reviewer #2:

      General Assessment:

      The role of visual experience with faces in the formation of face-specific neural "modules" is tested in a deep convolutional neural network model of object recognition, AlexNet. A modified version of the ILSVRC-2012 training dataset was constructed by removing all images with primate faces, removing remaining categories with fewer than 640 images, and re-training the deprived network: d-Alexnet. d-Alexnet was compared to pre-trained Alexnet on classification performance, quality of fit to fMRI data, strength of face-selectivity, representational similarity, and learned receptive field properties. The authors argue that face-selectivity is significantly reduced, but not eliminated, with the deprivation, and that this reduction is consistent with an interpretation that d-Alexnet represents faces more similarly to objects than Alexnet. While this work is well-motivated and timely, there are substantial issues in the conceptual approach, the methods used, clarity of the results, and most importantly, the strength of the conclusions.

      Major Concerns:

      1) The validity of these results is uncertain due to a) insufficient reproducibility within this work and b) fragile definitions of face-selectivity.

      a) Given that small changes in weight initialization or training procedure can have a large effect on learned representations (see Mehrer et al. 2020, https://www.biorxiv.org/content/10.1101/2020.01.08.898288v1.abstract ), the authors must demonstrate that their results hold across multiple initializations of each network type. Several key results hinge on the number and identity of "face-selective" channels (Figure 2, 3c-e) and only a single instance of each model type is used. In particular, the result that 2/256 channels are "selective" in d-Alexnet compared to 4/256 in Alexnet is likely sensitive to small variations in the methods, including the choice of evaluation stimuli and the initialization of the weights. If the models were re-trained, could the ratio be 4 channels to 4 channels, 0 channels to 2 channels, or some other result? With only a single instance of each model and such a small (and potentially unstable) number of face-selective channels in each model, I am not convinced that these results support the claims made.

      SUGGESTION: Report results averaged across multiple initializations of each model to demonstrate robustness. Statistical tests should be conducted across models (as if they were individual subjects) to demonstrate the significance of any effects found.

      b) The definition of "selectivity" is potentially fragile and may not hold when tested with more standard evaluation sets. In the primate face-selectivity literature, functional localizers are used to compare face responses to non-face responses. These localizers have much stronger controls over low-level features than the stimuli used to evaluate selectivity in this work. I am especially concerned that the faces (from FITW) differ from non-face objects (from Caltech-256) in low-level properties such as image resolution, pose, background, contrast, luminance, and more. Furthermore, selectivity is typically defined in the field as a continuous quantity (e.g., t-contrast, d-prime, face-selectivity-index) and is not often assessed in a binary fashion by the number of units significantly more responsive to faces than the second-best category. Many of these continuous metrics also incorporate variance in responses as well as the mean of responses. Thus, the designation of channels as "selective" or "not-selective" in this work based on mean responses to only 2 of the 205 categories (L101) prevents the reader from understanding how the distribution of face-selectivity shifted under the deprivation, which is one of the primary claims. Instead, we only see the number of selective channels after a binary cutoff, which may be sensitive to initialize and the stimulus set used to evaluate selectivity.

      SUGGESTION: Compute selectivity using evaluation sets in which faces are better matched to non-face objects. Report the distribution of selectivity for each channel before and after deprivation.

      2) Because one model in the comparison is pre-trained and the other is trained from scratch, there is the possibility that all of the differences between the models are due to differences in the training that are independent from the content of the training images.

      a) In the regression analysis, is it the case that non-selective channels also show differences in R2? For example, if the d-Alexnet is worse on the training task (d-ImageNet) than Alexnet, we expect a general reduction in its ability to explain neural responses (see e.g. Yamins et al., 2014). The claims that face-selectivity is specifically impaired in d-Alexnet need to be supported by demonstration that non-selective channels are equally good (or poor) fits to vertices in face-selective regions. Furthermore, the authors do not demonstrate that face-selective channels are better than non-selective channels in either model type, which is useful context for understanding whether the correspondence between face-selective channels and face-selective brain regions is meaningful.

      SUGGESTION: report non-selective channel fits to the same vertices for each model type and compare to face-selective channel fits.

      b) L366: the authors write that "the d-Alexnet was initialized with values drawn from a uniform distribution". This is not standard practice; in fact, the kernel weights in the original AlexNet model were initialized from a Gaussian distribution. To make comparisons to the non-deprived model, the authors need to also retrain the non-deprived model to account for the potential confounds between their training/initialization procedure and that used in the pre-training.

      SUGGESTION: re-train the non-deprived AlexNet in-house, then compare that model to d-AlexNet.

      1. A major conceptual issue is in the definition of a "face module". Despite "face module" in the title, a working definition of "face module" is not clearly provided in the manuscript. Context clues suggest that the authors may consider any face-specific process evidence of a "face module", but the experiments performed indicate that a specific set of criteria were explored: selectivity for faces, different representations for faces and non-face objects, holistic processing, etc. Especially given that the results of this work indicate some residual face-selectivity, a clear definition of "face module" - grounded in the existing literature - is needed to evaluate the claims provided.

      SUGGESTION: clearly define what the "face module" is in the brain, then explain what the corresponding evidence for a "face module" would be in the DCNN.

      4) A number of analyses are not well-motivated or are lacking in detail

      a) The analysis of the "empirical receptive field" is lacking in detail and motivation, and the color-scale is both nonlinear and missing a label. Specific questions:

      i) How should this result be compared to data in primate face-selective regions?

      ii) Is this result a trivial consequence of the difference in number of activated units (panel D)?

      iii) What are the units of the colormap?

      iv) Why are only two channels shown for AlexNet if 4 channels are face-selective?

      v) Is the extent of the empirical receptive field quantified?

      vi) How should the reader think about empirical receptive fields in a weight-shared convolutional architecture?

      b) The evaluation of the face-inversion test is poorly motivated. The face-inversion effect indicates that human subjects are better at remembering upright faces than inverted faces. However, the analysis performed here evaluates the magnitude of the response of face-selective channels. If anything, a classification task is needed to compare to the human task, because the "face inversion effect" cited is not simply that face-selective units respond more strongly to upright than inverted faces, but that the activation of the units supports differences in classification between upright and inverted faces.

      SUGGESTION: At minimum, justify 1) why the magnitude of channel response is a good measure of the face inversion effect or 2) remove the claim that the models do/don't exhibit the behavioral effect.

    2. Nancy Kanwisher (Reviewer #1):

      Xu et al use deep nets to ask whether face selectivity, and face discrimination performance, can arise in a network that has never seen faces. By painstakingly removing all faces from the training set, and comparing Alexnet trained with and without faces, they claim to find, first, that the face-deprived network does not have deficits in face categorization or discrimination (relative to the same network trained with faces), second that the face-deprived network showed some face-selectivity, and third that face deprivation reduced face selectivity. They conclude that "domain-specificity may evolve from non-specific experience without genetic predisposition, and is further fine-tuned by domain-specific experience."

      I love the question and the general strategy behind this study, and indeed we have long discussed doing something much like this in my lab, and we presented a preliminary result of this kind at VSS years ago (https://jov.arvojournals.org/article.aspx?articleid=2433862 ). It is a great use of deep nets to ask what kinds of structures can in principle arise with different kinds of training diets. Xu et al are also to be congratulated for the huge effort they went to in curating a data set of stimuli with no faces, for which they are correct no current algorithm is adequate, requiring a huge amount of labor-intensive human effort.

      Nonetheless, despite my might enthusiasm for the question, the general logic of the study, and the major effort to create the training set, I do have a few significant concerns about the paper:

      1) The biggest problem in the paper in my view is that although regular Alexnet saw faces in the training set, it was not trained on face discrimination, and its performance on this task is very low (66%). That is above chance but very much lower than a network that is actually trained on face discrimination. In our studies, which are typical of this literature, we find that when Alexnet is trained on the VGG-Face dataset identification of novel faces is around 85% correct (top-1). So to say that the face-deprived network performed no differently from the face-experienced network on a face discrimination task, while true, is misleading, because really this reflects the fact that neither was trained on face discrimination and both do pretty badly. And perhaps more importantly, for faces humans have learned, their typical face recognition accuracy would be way higher than 66% correct. So, the face-deprived network really does very badly compared to a real face-trained network, or to humans, and does not represent a strong case of preserved face discrimination despite lack of face experience. Instead, it reflects the kind of face recognition performance one would expect from an object recognition system or a prosopagnosic patient: above chance but not very accurate. Thus, I think the behavioral data show not preservation of face perception abilities in a network trained without faces, but low performance at face discrimination, much like a network that has seen faces but not been trained to discriminate them.

      2) The claim that "face-selective channels already emerged in the d-AlexNet" is similarly overstated in my view, given that only two such units were found and the selectivity of the one we are shown (on the right in Figure 2a) is weak. Although the authors concede that the selectivity of these two units is lower than found in Alexnet trained with faces, that understates the case, as Figure 2a shows. The analysis in Figure 2b, correlating responses of face-selective channels from Alexnet to natural movies, with brain responses to the same movies, is interesting but doesn't tell us what we most need to know. Several public data sets include the magnitude of response of FFA and OFA to a set of 50-100 images, and I would find it more useful to compare those to the response of Alexnet face units to the same images.

      A small point: Only human and primate faces were removed from the dataset, but I would think other animal faces (e.g. cats and dogs) should produce some relevant training. Certainly face-selective regions in the human brain respond strongly to animal faces, as several studies have shown. This might be worth considering in the discussion when potential reasons for the emergence of face-selective channels are discussed (line 229-236).

      For the reasons above, I don't think the results of this study strongly support the conclusion that "the visual experience of faces was not necessary for an intelligent system to develop a face-selective module". At least the "face-specific module" so claimed is a far cry from the human face processing system in both neurally measured selectivity and behavioral performance.

    1. But indeed these things are nothing; if God should withdraw his hand, they would avail no more to keep you from falling

      Typically, we live life and abuse these "worldy things" given to us and we think we like to think we have everything we need but what I think Edwards is saying here is that yes we may be happy and think everything is going great but If you don't have a relationship with God, those worldly things are not going to save you. God is our gateway to heaven and if He takes his hand away, nothing is stopping us from going to hell. Edwards is basically saying if you are not living you're life for God as a christian, God will not give you his hand

    2. born again,

      The term "born again" is used a lot, both in the bible and in sermons and songs even to this day. To be born again in Christ is to have a new life driven by Him and moving past all the sins of your "old life." Considering how long ago this sermon was given, does anyone think that it may have had a different meaning at that point in time? If so, how has it matured into what we interpret it as today?

    3. How dreadful is the state of those that are daily and hourly in danger of this great wrath, and infinite misery! But this is the dismal case of every soul in this congregation, that has not been born again, however moral and strict, sober and religious they may otherwise be. Oh that you would consider it, whether you be young or old. There is reason to think, that there are many in this congregation now hearing this discourse, that will actually be the subjects of this very misery to all eternity. We know not who they are, or in what seats they sit, or what thoughts they now have: it may be they are now at ease, and hear all these things without much disturbance, and are now flattering themselves that they are not the persons, promising themselves that they shall escape. If we knew that there was one person, and but one, in the whole congregation that was to be the subject of this misery, what an awful thing would it be to think of! If we knew who it was, what an awful sight would it be to see such a person! How might all the rest of the congregation lift up a lamentable and bitter cry over him! But alas! instead of one, how many is it likely will remember this discourse in hell? And it would be a wonder if some that are now present, should not be in hell in a very short time, before this year is out. And it would be no wonder if some person that now sits here in some seat of this meeting house in health, and quiet and secure, should be there before tomorrow morning. Those of you that finally continue in a natural condition, that shall keep out of hell longest, will be there in a little time! your damnation don’t slumber; it will come swiftly, and in all probability very suddenly upon many of you. You have reason to wonder, that you are not already in hell. ‘Tis doubtless the case of some that heretofore you have seen and known, that never deserved hell more than you, and that heretofore appeared as likely to have been now alive as you: their case is past all hope; they are crying in extreme misery and perfect despair; but here you are in the land of the living, and in the house of God, and have an opportunity to obtain salvation. What would not those poor damned, hopeless souls give for one day’s such opportunity as you now enjoy!

      Jonathan Edwards is preaching to his congregation in a very vivid manner how they need to reflected on their lives and ways of living. He is trying to explain to them that giving yourself to God is the only way into salvation. Jonathan Edwards explains that if you are not born again and repent for your sins you will be going to hell. He explains that God's forgiveness of sins is the only reason they are not in hell at this moment. He explained that turning to God now and not later needs to be done before it is to late.

    4. How dreadful is the state of those that are daily and hourly in danger of this great wrath, and infinite misery! But this is the dismal case of every soul in this congregation, that has not been born again, however moral and strict, sober and religious they may otherwise be. Oh that you would consider it, whether you be young or old. There is reason to think, that there are many in this congregation now hearing this discourse, that will actually be the subjects of this very misery to all eternity. We know not who they are, or in what seats they sit, or what thoughts they now have: it may be they are now at ease, and hear all these things without much disturbance, and are now flattering themselves that they are not the persons, promising themselves that they shall escape. If we knew that there was one person, and but one, in the whole congregation that was to be the subject of this misery, what an awful thing would it be to think of! If we knew who it was, what an awful sight would it be to see such a person! How might all the rest of the congregation lift up a lamentable and bitter cry over him! But alas! instead of one, how many is it likely will remember this discourse in hell? And it would be a wonder if some that are now present, should not be in hell in a very short time, before this year is out. And it would be no wonder if some person that now sits here in some seat of this meeting house in health, and quiet and secure, should be there before tomorrow morning. Those of you that finally continue in a natural condition, that shall keep out of hell longest, will be there in a little time! your damnation don’t slumber; it will come swiftly, and in all probability very suddenly upon many of you. You have reason to wonder, that you are not already in hell. ‘Tis doubtless the case of some that heretofore you have seen and known, that never deserved hell more than you, and that heretofore appeared as likely to have been now alive as you: their case is past all hope; they are crying in extreme misery and perfect despair; but here you are in the land of the living, and in the house of God, and have an opportunity to obtain salvation. What would not those poor damned, hopeless souls give for one day’s such opportunity as you now enjoy!

      This is such a strong statement towards the congregation. Through this passage, the congregation could probably get a glimpse and feel it in their bones of the regret and eternal despair one might have to endure for eternity if they don't wake up from their slumbers and live a righteous life as God commands. Even the last sentence of those that have already been damned who would long for even a short moment and opportunity that the current people that are alive are currently enjoying really plants in fear of hell. Yet he goes on how many people still would be judged to hell.

    5. That world of misery, that lake of burning brimstone is extended abroad under you. There is the dreadful pit of the glowing flames of the wrath of God; there is hell’s wide gaping mouth open; and you have nothing to stand upon, nor anything to take hold of: there is nothing between you and hell but the air; ’tis only the power and mere pleasure of God that holds you up. You probably are not sensible of this; you find you are kept out of hell, but don’t see the hand of God in it, but look at other things, as the good state of your bodily constitution, your care of your own life, and the means you use for your own preservation. But indeed these things are nothing; if God should withdraw his hand, they would avail no more to keep you from falling, than the thin air to hold up a person that is suspended in it…. The God that holds you over the pit of hell, much as one holds a spider, or some loathsome insect, over the fire, abhors you, and is dreadfully provoked; his wrath towards you burns like fire; he looks upon you as worthy of nothing else, but to be cast into the fire; he is of purer eyes than to bear to have you in his sight; you are ten thousand times so abominable in his eyes as the most hateful venomous serpent is in ours. You have offended him infinitely more than ever a stubborn rebel did his prince: and yet ’tis nothing but his hand that holds you from falling into the fire every moment; ’tis to be ascribed to nothing else, that you did not go to hell the last night; that you was suffered to awake again in this world, after you closed your eyes to sleep: and there is no other reason to be given why you have not dropped into hell since you arose in the morning, but that God’s hand has held you up; there is no other reason to be given why you han’t gone to hell since you have sat here in the house of God, provoking his pure eyes by your sinful wicked manner of attending his solemn worship: yea, there is nothing else that is to be given as a reason why you don’t this very moment drop down into hell. O sinner! Consider the fearful danger you are in: ’tis a great furnace of wrath, a wide and bottomless pit, full of the fire of wrath, that you are held over in the hand of that God, whose wrath is provoked and incensed as much against you as against many of the damned in hell; you hang by a slender thread, with the flames of divine wrath flashing about it, and ready every moment to singe it, and burn it asunder; and you have no interest in any mediator, and nothing to lay hold of to save yourself, nothing to keep off the flames of wrath, nothing of your own, nothing that you ever have done, nothing that you can do, to induce God to spare you one moment… Consider this, you that are here present, that yet remain in an unregenerate state. That God will execute the fierceness of his anger, implies that he will inflict wrath without any pity… you will be a vessel of wrath fitted to destruction; and there will be no other use of this vessel but only to be filled full of wrath: God will be so far from pitying you when you cry to him, that ’tis said he will only laugh and mock (Proverbs 1:25-32)… How dreadful is the state of those that are daily and hourly in danger of this great wrath, and infinite misery! But this is the dismal case of every soul in this congregation, that has not been born again, however moral and strict, sober and religious they may otherwise be. Oh that you would consider it, whether you be young or old. There is reason to think, that there are many in this congregation now hearing this discourse, that will actually be the subjects of this very misery to all eternity. We know not who they are, or in what seats they sit, or what thoughts they now have: it may be they are now at ease, and hear all these things without much disturbance, and are now flattering themselves that they are not the persons, promising themselves that they shall escape. If we knew that there was one person, and but one, in the whole congregation that was to be the subject of this misery, what an awful thing would it be to think of! If we knew who it was, what an awful sight would it be to see such a person! How might all the rest of the congregation lift up a lamentable and bitter cry over him! But alas! instead of one, how many is it likely will remember this discourse in hell? And it would be a wonder if some that are now present, should not be in hell in a very short time, before this year is out. And it would be no wonder if some person that now sits here in some seat of this meeting house in health, and quiet and secure, should be there before tomorrow morning. Those of you that finally continue in a natural condition, that shall keep out of hell longest, will be there in a little time! your damnation don’t slumber; it will come swiftly, and in all probability very suddenly upon many of you. You have reason to wonder, that you are not already in hell. ‘Tis doubtless the case of some that heretofore you have seen and known, that never deserved hell more than you, and that heretofore appeared as likely to have been now alive as you: their case is past all hope; they are crying in extreme misery and perfect despair; but here you are in the land of the living, and in the house of God, and have an opportunity to obtain salvation. What would not those poor damned, hopeless souls give for one day’s such opportunity as you now enjoy! And now you have an extraordinary opportunity, a day wherein Christ has flung the door of mercy wide open, and stands in the door calling and crying with a loud voice to poor sinners; a day wherein many are flocking to him, and pressing into the kingdom of God; many are daily coming from the east, west, north and south; many that were very lately in the same miserable condition that you are in, are in now an happy state, with their hearts filled with love to him that has loved them and washed them from their sins in his own blood, and rejoicing in hope of the glory of God. How awful is it to be left behind at such a day! To see so many others feasting, while you are pining and perishing! To see so many rejoicing and singing for joy of heart, while you have cause to mourn for sorrow of heart, and howl for vexation of spirit! How can you rest one moment in such a condition? Are not your souls as precious as the souls of the people at Suffield,7 where they are flocking from day to day to Christ? … And you children that are unconverted, don’t you know that you are going down to hell, to bear the dreadful wrath of that God that is now angry with you every day, and every night? Will you be content to be the children of the devil, when so many other children in the land are converted, and are become the holy and happy children of the King of kings? And let everyone that is yet out of Christ, and hanging over the pit of hell, whether they be old men and women, or middle aged, or young people, or little children, now hearken to the loud calls of God’s Word and providence. This acceptable year of the Lord, that is a day of such great favor to some, will doubtless be a day of as remarkable vengeance to others… Therefore let everyone that is out of Christ, now awake and fly from the wrath to come. The wrath of almighty God is now undoubtedly hanging over great part of this congregation: let everyone fly out of Sodom. Haste and escape for your lives, look not behind you, escape to the mountain, lest you be consumed [Genesis 19:17].

      While I agree with the overall message, the actual delivery is much different than what we would encounter today. In today's society, we are encouraged to be politically correct and avoid offending others; sometimes, that is not the most effective. When matters are sugar-coated, there is room for people to find some margin to justify their wrong-doings. For example, how many times after you've done something wrong, i.e., frivolously spent money, told a small lie, etc. and later found yourself trying to justify it? Edwards is leaving little room for justification and explicitly details what will happen if people do not live by God's Word. Though fear was the prevailing tactic, the goal was to have as many conversions to Christianity as possible in a time where many were desensitized to the church and beginning to lean on their own understanding. A majority of the congregation was in tears during the sermon; this can be counted as a victory for Edwards. Their reactions show that members felt convicted, which in turn, may compel them to form or strengthen their relationship with God so that they may have salvation.

    6. And you children that are unconverted, don’t you know that you are going down to hell, to bear the dreadful wrath of that God that is now angry with you every day, and every night? Will you be content to be the children of the devil, when so many other children in the land are converted, and are become the holy and happy children of the King of kings?

      I understand what Johnathan Edwards was attempting to do with this sermon. He was sharing the hard truths about the wrath of God so that people would leave their life a sin. However, I do not agree with this statement he made towards children. Maybe it's just me, but I don't think children should be "scared" into believing in God. We are all born sinners and it is up to the parents to teach their children how to live according to their beliefs and religions. Furthermore, a lot of people didn't practice Christianity then as there are different religions and belief systems as it is today. So if there were people present at the revival who didn't believe in God or practiced Christianity, then a speech like this could possibly scare them away from a relationship with God. I believe a sermon of this manner is for Christians who may have fell off and needed to be reminded of what could happen if they didn't correct their sinful ways. Overall, it was a good sermon that can be preached today.

    7. he looks upon you as worthy of nothing else, but to be cast into the fire

      ……. All saints are sinners.... According to Oscar Wilde, “The only difference between the saint and the sinner is that every saint has a past, and every sinner has a future.” Because of this, I think Jonathan Edwards Great Awakening Revival and the sermons delivered by George Whitefield are too judgmental. Even the so-called man of God is found in a circle of sinners sometimes, and they committed an atrocity, yet people look at them as a man of God. The sermon seems intimidating, and many people may end up committing suicide instead of going to hell and cast into a fire. God knows we are all sinners, and God still gives us abundant grace to changes from our iniquity and walk in his way!

    8. We know not who they are, or in what seats they sit, or what thoughts they now have: it may be they are now at ease, and hear all these things without much disturbance, and are now flattering themselves that they are not the persons, promising themselves that they shall escape. If we knew that there was one person, and but one, in the whole congregation that was to be the subject of this misery, what an awful thing would it be to think of! If we knew who it was, what an awful sight would it be to see such a person!

      Planting seeds of doubt in their personal salvation, after terrorizing them with his description of the pits of hell was brilliant on his part. I can imagine them all looking at each other as he delivered this part of the sermon wondering which one of them was going to hell.

    1. Author Response

      We would like to thank the three reviewers for their efforts and the constructive feedback. Below, we describe how we will address the reviewers’ comments in an updated manuscript.

      Summary:

      All of the reviewers expressed concerns about the advance that the work described in the paper represents. These issues were a focus of the consultation among the reviewers. The main concern is that the work needs to go beyond demonstrating that some ganglion cells exhibit nonlinear integration for naturalistic inputs - as that point is quite well established in the literature. The comparison between natural stimuli and gratings could help in this regard, but several issues confound that comparison (e.g. differences in dynamics of the two types of stimuli). These concerns are detailed in the individual reviews below.

      Reviewer #1:

      This paper investigates how retinal ganglion cells integrate inputs across space, with a focus on natural images. Nonlinear spatial integration is a well-studied property of ganglion cells, but it has been largely characterized using grating stimuli. A few studies have extended this to look at spatial integration in the context of natural images, but we certainly lack a comprehensive treatment of that issue. The current paper has a number of strengths - notably using a number of complementary stimuli and analysis tools to study a large population of ganglion cells and linking properties of responses to artificial stimuli with those to natural stimuli. It also has a few weaknesses (some detailed carefully in the paper) - such as the inability to identify ganglion cell types (aside from a few), and to pinpoint specific circuit mechanisms. These are limitations of the techniques used. This is not a request as much as setting the context of the contribution of the paper. Generally the paper was in good shape, and the data supported the conclusions well. I do think there are a number of issues that could be strengthened. Those are listed below in rough order of importance.

      Statistical correlations in natural scenes:

      A number of analyses in the paper rely on estimating the spatial contrast from an image and comparing the dependence of various measures of the cells' responses on spatial contrast. A danger in this analysis is that spatial contrast is likely correlated with many other statistical properties of the image, so attributing a given response property to spatial contrast has some potential confounds. This issue should be discussed as a possible caveat, unless the authors can rule it out. The paper, accurately, describes the results in terms of correlations (and not causal relationships), but some discussion of the complexity of natural image statistics would be helpful.

      Spatial contrast is defined in our work via the variance of pixel intensity inside the receptive field. Indeed, spatial contrast may reflect different aspects of visual scenes, such as object boundaries, textures, or gradients in light intensity. Differences in the effects of these image features on a ganglion cell’s response will not be captured by our analysis. However, the goal of relating spatial contrast to spike count was primarily to analyze whether the spatial structure of light intensity inside the receptive field was related to the response of a given ganglion cell (beyond the mean illumination), and the pixel intensity variance provides a simple, straightforward measure of this spatial structure. To clarify this aspect and better relate it to the complexity of natural images, we will add a corresponding paragraph in the Discussion.

      Comparison of grating and natural scene spatial scale:

      The section starting around line 233 was confusing for several reasons. First, this section starts by measuring the spatial scale associated with the grating responses, and then comparing that to LN model performance for natural inputs. It's not clear why the spatial scale is the relevant aspect of the responses to gratings. Indeed, the next paragraph provides a measure of the relative sensitivity of the nonlinear and linear response components (via a comparison of F1 and F2 responses). It would be helpful to include some initial text to motivate the different measures of the grating responses and to anticipate that you will look at both spatial scale and sensitivity.

      A related issue that bears more directly on the scientific conclusions comes up later in the blurring experiments. The issue is whether it is valid to directly compare the apparent spatial scale of nonlinear responses to images (estimated via blurring) with that of the grating responses. Natural images should have much higher power at low spatial frequencies, and this may strongly impact the spatial scale identified with the blurring experiments.

      We agree that the writing may not have been entirely clear, and we will reorganize the material to discuss the extracted spatial scale and nonlinearity index in parallel as suggested. Regarding the difference in spatial scales from reversing gratings and blurred natural images: yes, it is also our interpretation that the power at low spatial frequencies plays a key role. Our main point here was to assess whether and to what degree the typical analyses of spatial nonlinearity as measured from reversing gratings translate to natural images despite the differences in spatial and temporal structure of the two stimulus classes. In a revised manuscript, we will make sure to earlier clarify the role of low spatial frequencies.

      Clustering of orientation-selective cells:

      An interesting suggestion in the paper is that the orientation-selective cells can be divided into two groups that differ in their spatial integration properties. Do these groups represent different orientations, as suggested in the text? That seems a simple piece of information to add. Related to this, I would suggest moving Figure S4 into the main text.

      We do not have information about the absolute preferred orientations of the orientation-selective (OS) cells, as we did not keep track of retinal orientation when placing the retinas on the multielectrode array. At this point, we can therefore only rely on indirect analyses of relative preferred orientations between pairs of OS cells in the same retina. These indicate that pairs of two nonlinear OS cells tend to have aligned preferred orientation (and similarly for pairs of linear OFF OS cells), but pairs of a linear and a nonlinear OFF cell tend to have divergent preferred orientations. This is shown in Fig. S4C. For a revised manuscript, we will consider integrating Fig. S4 into the main text, as suggested.

      Presentation of checkerboard stimuli and results:

      The checkerboard analysis, particularly how it isolates properties of spatial integration, could get introduced more thoroughly for a reader unfamiliar with it. A related issue is how well the chosen isoresponse contour captures structure in the full distribution of responses. In some cases that looks pretty good, but in others it is less clear. Could you add a supplementary figure or something similar that characterizes how consistent the isoresponse contours are for different response levels?

      These are good suggestions, and we will aim at clarifying the analysis as proposed and add information about the consistency of iso-response contours for different response levels. In the present analysis, the iso-response contours are used just for illustration, whereas the quantification of rectification and integration of preferred contrast are extracted from specific points in the stimulus-response space, which we found to work robustly for a population analysis without being strongly effected by threshold or saturation effects of the cells. We will explain this more clearly in a revised manuscript.

      Drift in responses over time:

      Some of the rasters - e.g. the bottom left in Figure 1C - show considerable drift over time. It is important that this drift not be interpreted as a failure of the LN model and hence indicative of nonlinear spatial integration. Can you test for drift like this across cells, and exclude any that seem potentially problematic? More generally, some assurance that the variability in the responses for a given generator signal value is real variability across images is needed.

      The presentation of all 300 natural images over ten trials takes about 50 minutes and some drift over this period seems unavoidable. To minimize systematic effects of experimental drift on the measured average responses for different images, we applied randomization within trials, which assured that all images were presented once in random order in each trial before the next trial started. In addition, to quantify the real variability over images of the average response for a given generator signal, we applied a goodness-of-fit measure (CCnorm) that takes into account variability over trials.

      We now also tested directly for the drift mentioned by the reviewer, but observed sizeable effects in only a small subset of cells that were included in the analysis. In most cases, drift corresponded to a global scaling that approximately affected responses to all images proportionally. This is reflected in a high correlation over images between the average responses of the first five and last five trials; 94% of analyzed cells had a correlation coefficient of at least 0.7. Such global scaling of responses does not affect the analysis of differences in average responses. In a revised manuscript, we will provide analyses of drift effects and exclude cells that contain drift effects that appear to deviate from global response scaling.

      Reviewer #2:

      Summary:

      Understanding how retinal ganglion cells respond to natural stimuli is a central but daunting question, which retinal neurophysiologists have begun to tackle recently. Here Karamanlis and Gollisch perform large-scale multi-electrode recordings in the mouse retina and demonstrate that the responses of many ganglion cells cannot be predicted by standard linear-nonlinear models (L-LN). They go on to test a variety of clever artificial stimuli that emphasize and allow for the quantification of the non-linear aspects of RGCs responses and convincingly demonstrate that non-linear processing is associated with sensitivity to fine spatial contrasts (subunits) and local rectification. While these aspects of RGC receptive fields have been previously described, demonstrating their applicability to natural vision is a significant advancement.

      Major Comments:

      My first main concern is with the way the paper is written. It does not highlight the significant advancements but rather emphasizes what is already known from other studies. For example, many of the conclusions of non-linear spatial integration & signal rectification arising in bipolar cells have been well described previously. By contrast, novel aspects like the sensitivity of reversal gratings being unrelated to LN model performance for natural scenes should be explained more in detail. The authors should more clearly state the major advancements that are being made here beyond what has already been shown previously (e.g. Turner and Rieke, 2016)

      It is possible that our efforts to provide context by relating our results to established findings in retinal signal integration overshadowed the novel aspects of our work. As suggested, we will aim at pointing out these aspects more clearly. For example, compared to the work of Turner and Rieke (2016), we a) focused on a different species with more diversity in accessible RGC types, b) generalized the connection of spatial integration and natural scene encoding to a wider range of cell types (e.g. including also spatially linear and nonlinear ON-OFF cells as well as cells that are inversely sensitive to spatial contrast), and c) developed methods to assess and quantitatively characterize subunit nonlinearities with multielectrode recordings of many cells in parallel, without the need for intracellular recordings or knowledge of the receptive field location.

      Second, the authors never include non-linear subunits in their model to demonstrate improved performance. Testing models with filters that incorporate rectification and convexity as experimentally determined will enable them to show their utility more convincingly. Without this, the reader is left with the conclusion that there are RGCs that exhibit non-linear or linear spatial integration (already known) and that non-linear integrators cause LN models to perform poorly with natural images (Turner and Rieke, 2016).

      The aim of the present work was to assess how well models with linear receptive fields account for responses to natural images in various cells of the mouse retina and whether the models’ shortcomings can be related to the cells’ spatial stimulus integration characteristics. While we agree that models with nonlinear subunits could help support the conclusions, fitting such models to recorded data is – we believe – beyond the scope of the current manuscript. The many parameters of nonlinear subunit models, such as the number, shape, and layout of subunits or their nonlinearity and weight, all likely vary considerably across the diverse population of cells in our recordings. To avoid extensive parameter fitting, simplified models with ad hoc selection of subunit layouts and nonlinearities could help assess whether spatial nonlinearities are important, as in the work by Turner and Rieke (2016). Instead, as an alternative, we chose to analyze the importance of spatial nonlinearities via the effect of spatial contrast in images with similar mean intensity in the receptive field (e.g. Fig. 2). For our data, an advantage of this approach is that it is directly applicable to cell types with diverse spatial integration characteristics, such as the cells that are inversely sensitive to spatial contrast, which wouldn’t be captured by a standard subunit model with rectifying subunit nonlinearities. In future work, however, we plan to analyze subunit models that can account for the diversity of observed response patterns.

      Third, I'm not sure how 'natural' their natural images are, given static images are flashed over the cell intermittently. While such stimuli might simulate some sort of saccadic eye movements, whether this is relevant for mouse vision is not clear. Would linear models be more predictive for responses to natural movies? Some discussion on this issue would be helpful.

      Rather than aiming for fully natural movie-like stimuli, we used flashed images in our work to focus on aspects of spatial integration. This indeed entails a simplification of the temporal structure of natural stimuli, which was intended, but it preserves natural spatial structure, such as the occurrence of objects, boundaries, textures, and intensity gradients, as well as continuously decreasing power for higher spatial frequencies. Nonlinear spatial integration in the presence of this natural spatial structure will likely also shape responses under natural movies. To clarify this approach, we will re-evaluate our wording regarding the application of natural stimuli in our work and discuss the simplification compared to natural movies, as suggested.

      Reviewer #3:

      The manuscript by Karamanlis and Gollisch examines the responses of mouse retinal ganglion cells (RGCs) to natural stimuli. The primary conclusion of the manuscript is that spatial integration of stimuli within the receptive field is nonlinear. This nonlinear integration is consistent with "local signal rectification". This results in a set of RGCs that are sensitive to spatial contrast within the RF. The Authors also note the presence of cells that are suppressed by contrast and cells that prefer uniform stimulation of the RF. To reach these conclusions the authors use multi-electrode array recordings from isolated mouse retina. Spatial RFs are estimated using white noise stimuli, which are then used to generate a null-model for linear spatial summation. They compare predictions of this null-model to the responses of the same RGCs to briefly flashed natural images. The authors find some RGCs that are consistent with this null model and many that are not consistent. The authors correlate deviations from linear spatial summation to deviations revealed by contrast reversing gratings. They also used a mixed-contrast, flashed-checkerboard paradigm to map the contrast tuning and rectification of RF subunits. Finally, the authors show that some of these results track with functionally distinct RGC types such as direction-selective and "IRS" RGCs.

      The data and analyses presented in this manuscript are high quality. However, I think the study is largely consistent with many previous studies that demonstrate nonlinear spatial integration among RGCs in the mammalian (including mouse) retina. I think the Authors view the use of natural stimuli as a major departure from previous work, but I'm not convinced of this for two reasons. First, I don't see a compelling reason to think that results using contrast reversing gratings or other 'textured stimuli' (e.g. Schwartz et al Nat Neuro 2012) would fail to generalize to flashed natural scenes. Second, the implicit claim here is that a 200ms flashed natural scene interleaved with an 800ms gray screen is a natural stimulus. I think this assumes a lot about the space-time separability of the RF mechanisms, and these assumptions are not well justified.

      Major Concerns:

      1) I think the introduction of the manuscript is building a straw man argument, suggesting that many (or most) scientists think the retina is predominantly linear. A pubmed search of 'retinal ganglion cell' and 'nonlinear' produced more than 300 studies. Specifying subunit nonlinearity produces 28 studies. The discovery of subunit nonlinearities is roughly 50 years old and many manuscripts demonstrate Y-like receptive fields are more common across RGC types than X-like receptive fields.

      The goal of our work was not to show that receptive fields of mouse retinal ganglion cell are (often) spatially nonlinear, but to test whether these nonlinearities matter for natural images. It is conceivable that spatial nonlinearities as measured with typical artificial stimuli such as spatial gratings or spatiotemporal white noise are not (as) relevant for natural images because the simultaneous occurrence of strong positive and negative contrast inside a receptive field is much rarer in natural images. Indeed, in our work we find that traditional measurements of spatial nonlinearities with reversing gratings do not provide a robust quantitative prediction of whether spatial nonlinearities matter under natural images for a given ganglion cell. As laid out in the Introduction, there is surprisingly little research yet on how spatial nonlinearities affect the encoding of natural images, and in a revised version of the manuscript, we will aim at clarifying that this is the focus of our work here.

      2) The authors seem to be arguing that the spatial nonlinearities engaged by the contrast reversing gratings are not the same as those engaged by their natural scenes (Figure 3). However, I think the authors are assuming too much that the spatial and temporal components of the RFs are separable. The flashed natural scenes are interleaved with relatively long gray screens. The contrast reverse granting are reversed in a square-wave fashion with no interleaved gray screen. These distinct spatiotemporal dynamics in the stimuli seem likely to explain the difference. This would also seem likely to explain why the flashed checkerboards in Figure 4 produced results more correlated to flashed scenes in Figure 1. In summary, I don't see a strong reason to think the authors are observing anything other than subunit rectification of the sort described by Hochstein and Shapley in the 1970s and followed up in many subsequent studies.

      We do not think that spatial nonlinearities as observed with reversing gratings or with natural stimuli are related to different mechanisms. The point of our analysis was rather to assess whether typical assessments of spatial nonlinearities with reversing gratings allow quantitative predictions about the relevance of spatial nonlinearities under flashed natural images, and we find that this is often not the case. We believe that this is largely due to the differences in spatial structure, in particular, the prevalence of high-contrast edges in the gratings. Yet, indeed, differences in temporal stimulus structure might also contribute. We actually tested flash-like presentations of gratings in some of our recordings, and results were quite similar to those obtained with contrast-reversing gratings and led to the same conclusions. We will describe this in the revised manuscript for clarification.

      3) It is not clear to this reviewer that flashed natural images interleaved by a gray screen is qualitative more natural than white noise, sinusoidal gratings, or square-wave gratings.

      The spatial structure of natural images is the focus of the present work. It is in this aspect that flashed photographs are more natural than typical artificial stimuli like spatiotemporal white noise or gratings. In particular, natural images contain a broad spectrum of spatial frequencies with relatively more power at smaller frequencies, and they combine occasional edges with intensity gradients and textures. Gratings, for example, are characterized by high power at large spatial frequencies, that is, high spatial contrast, which is well suited for triggering effects of spatial nonlinearities but occurs much more rarely in natural images. Thus, understanding whether spatial nonlinearities are important in a natural setting requires considering stimuli that match the natural spatial structure. It seems likely that nonlinear spatial integration observed under flashed presentation of natural images remains relevant when stimuli are supplemented with natural temporal structure, even though the latter may likely trigger additional effects that shape the responses (e.g. adaptation or nonlinear temporal integration).

      4) The null-model constructed by the authors in Figure 1 assumes the RF follows a specific functional form (e.g. Gaussian). However, many studies show that individual RFs frequently exhibit strong deviations from a Gaussian RF. To what extent are the deviations from the null model produced by deviations from linear summation or just linear mechanisms that deviate from the specific parametric form imposed by the model?

      Measuring the detailed structure of receptive fields (RFs) with high precision from time-limited experiments is a challenge, and using a fitted (elliptical) Gaussian profile is a standard procedure for limiting the effect of noise in the RF structure. We also tried using the pixel-wise spatial profile obtained from the reverse-correlation analysis as a spatial filter, but results were similar, yet often more noisy. We therefore settled on the standard procedure of using a Gaussian fit to the RF. Deviations from the Gaussian profile can indeed contribute to deviations of the model. Yet, for natural images, which have most of their power in low spatial frequencies, these deviations are likely to be small. Furthermore, our subsequent analyses show that the Gaussian RF model provides a useful baseline because it allows us to extract the relation between model deviations and image structure. In addition, the results from the model analysis were supported by the findings under presentation of blurred natural images, which did not require any assumptions about the underlying RF model. In a revised manuscript, we will point out that relying on Gaussian RFs is a choice that we make and that deviations of the receptive field structure may contribute to decreased model performance, but that the subsequent analyses support the usefulness of the applied Gaussian RF model.

      5) It was unclear how the authors rule out the contribution of differences in (nonlinear) temporal integration to the effects in this study. In general, RGC RFs are not space-time separable, and it seems that the analyses in the manuscript assume they are.

      Our choice of using flashed images as stimuli with no temporal structure beyond onset and offset and assessing responses via elicited spike counts was motivated by focusing on spatial stimulus integration and minimizing effects of temporal processing. Nonetheless, our extraction of receptive fields from measurements under spatiotemporal white-noise stimulation uses a space-time separation of the spike-triggered average. Thus, the lack of space-time separability of ganglion cell receptive fields can contribute to the putative underestimation of surround components, which we have discussed in the manuscript. In a revised manuscript, we will add an explicit reference to the issue of space-time separability.

      6) This study overlaps significantly with Cao, Merwine and Grzywacs (2011), 'Dependence of retinal Ganglion cell's responses on local textures of natural scenes', Journal of Vision. This article is not cited here, but in my view, the major conclusions are similar.

      Thank you for pointing us to this paper, which is indeed relevant for our work. Both the Cao et al. paper and our manuscript evaluate the effect of spatial contrast in natural images by relating spatial contrast to response deviations from a linear-RF model, albeit with different methods. An important difference, apart from the different species, is that our work then focuses on relating the identified effects of spatial contrast to functional characterizations of the specific nonlinear operations inside the receptive field (e.g. rectification). Furthermore, we also focus on the diversity of spatial-integration properties between cells and cell types, including the description of spatially linear cells and cells that are inversely sensitive to spatial contrast. In a revised manuscript, we will add a comparison to the methods and results from Cao et al.

      7) In my experience, the strength of subunit rectification can be labile during ex vivo experiments. What controls have the author's performed to ensure the effect they are studying remain stable over the duration of their recordings?

      Experimental rundown could, of course, affect subunit rectification as well as other response aspects, such as overall sensitivity. However, we observed that responses for different repeats of the same natural images were typically quite stable over the course of the hour-long stimulus. As also discussed in the response to Reviewer 1, we now analyzed how responses to late trials deviated from responses to early trials and found that only a small subset of cells displayed sizeable drift. Furthermore, those cases were mostly affected by a global drift in response size, keeping the relative responses for different images approximately constant. (For 94% of cells, the correlation of images was larger than 0.7 between average responses for the first five and for the last five trials; approximately on the level of estimated random trial-by-trial variability.) This indicates that the features of stimulus integration did not change substantially over the course of the experiment. In addition, nonlinearities as assessed with our flashed checkerboards were strongly correlated to nonlinearities under natural images, despite the fact that these stimuli were applied 1-2 hours apart. Thus, the strength of subunit rectification appears to be sufficiently stable to allow comparison over different stimuli.

    2. Reviewer #1:

      This paper investigates how retinal ganglion cells integrate inputs across space, with a focus on natural images. Nonlinear spatial integration is a well-studied property of ganglion cells, but it has been largely characterized using grating stimuli. A few studies have extended this to look at spatial integration in the context of natural images, but we certainly lack a comprehensive treatment of that issue. The current paper has a number of strengths - notably using a number of complementary stimuli and analysis tools to study a large population of ganglion cells and linking properties of responses to artificial stimuli with those to natural stimuli. It also has a few weaknesses (some detailed carefully in the paper) - such as the inability to identify ganglion cell types (aside from a few), and to pinpoint specific circuit mechanisms. These are limitations of the techniques used. This is not a request as much as setting the context of the contribution of the paper. Generally the paper was in good shape, and the data supported the conclusions well. I do think there are a number of issues that could be strengthened. Those are listed below in rough order of importance.

      Statistical correlations in natural scenes:

      A number of analyses in the paper rely on estimating the spatial contrast from an image and comparing the dependence of various measures of the cells' responses on spatial contrast. A danger in this analysis is that spatial contrast is likely correlated with many other statistical properties of the image, so attributing a given response property to spatial contrast has some potential confounds. This issue should be discussed as a possible caveat, unless the authors can rule it out. The paper, accurately, describes the results in terms of correlations (and not causal relationships), but some discussion of the complexity of natural image statistics would be helpful.

      Comparison of grating and natural scene spatial scale:

      The section starting around line 233 was confusing for several reasons. First, this section starts by measuring the spatial scale associated with the grating responses, and then comparing that to LN model performance for natural inputs. It's not clear why the spatial scale is the relevant aspect of the responses to gratings. Indeed, the next paragraph provides a measure of the relative sensitivity of the nonlinear and linear response components (via a comparison of F1 and F2 responses). It would be helpful to include some initial text to motivate the different measures of the grating responses and to anticipate that you will look at both spatial scale and sensitivity. A related issue that bears more directly on the scientific conclusions comes up later in the blurring experiments. The issue is whether it is valid to directly compare the apparent spatial scale of nonlinear responses to images (estimated via blurring) with that of the grating responses. Natural images should have much higher power at low spatial frequencies, and this may strongly impact the spatial scale identified with the blurring experiments.

      Clustering of orientation-selective cells:

      An interesting suggestion in the paper is that the orientation-selective cells can be divided into two groups that differ in their spatial integration properties. Do these groups represent different orientations, as suggested in the text? That seems a simple piece of information to add. Related to this, I would suggest moving Figure S4 into the main text.

      Presentation of checkerboard stimuli and results:

      The checkerboard analysis, particularly how it isolates properties of spatial integration, could get introduced more thoroughly for a reader unfamiliar with it. A related issue is how well the chosen isoresponse contour captures structure in the full distribution of responses. In some cases that looks pretty good, but in others it is less clear. Could you add a supplementary figure or something similar that characterizes how consistent the isoresponse contours are for different response levels?

      Drift in responses over time:

      Some of the rasters - e.g. the bottom left in Figure 1C - show considerable drift over time. It is important that this drift not be interpreted as a failure of the LN model and hence indicative of nonlinear spatial integration. Can you test for drift like this across cells, and exclude any that seem potentially problematic? More generally, some assurance that the variability in the responses for a given generator signal value is real variability across images is needed.

    1. ugly, or “bad” landscape, disgust also aids in the creation of a hierarchy, or scale of values, whereby different kinds of landscapes may be judged according to their proximity to, or distance from, either extreme. But once we begin to speak of landscapes as being ideal, or “good,” or as flawed, or “bad,” we have entered into the realm of moral judgement.

      Respond: I feel like Landscape Architects have a very different outlook on good and flawed landscapes compared to everyone else. The most clean cut lawns with a few crape myrtles seems perfect for most people in the south , but I think if you would suggest that to a landscape architect they would role their eyes. Landscape Architects find the beauty in things not everyone else would too. So can we really measure what a good landscape is if it is so relative?

    1. Yet the focus on negative effects of media consumption offers an incomplete picture. These accounts do not appropriately value the skills and knowledge young people are gaining through their involvement with new media, and, as a consequence, they may mislead us about the roles teachers and parents should play in helping children learn and grow

      Screen time has always been a point of contention in my family, but I think it's because we often think of it as "messing around" in an unproductive way. When you think of screen time as using media and programs as ways of creating, learning or engaging, than it becomes a bit more complex

    1. ‘‘Enhancement,’’ however, only captures some of thephenomena of interest here. In many cases, assessmentand detection technology such as brain scans may be used,which do not alter the person being scanned. In othercases, instead of enhancing some cognitive trait, ‘‘di-minishment’’ might be desired—for example, reducingone’s memory consolidation or temporarily reducingone’s empathy (cases we will discuss below).

      this is really cool to think about because it's stuff you would see in a sci-fi movie but its actually becoming our reality slowly but surely

    Annotators

    1. Good Brother Brooke, I often look, to hear of your return: But none can tell, if you be well, nor where you do sojourn: Which makes me fear, that I shall hear your health appairéd* is: impaired And oft I dread, that you are dead, or something goeth amiss. Yet when I think, you cannot shrink, 10 but must with Master be: I have good hope, when you have scope, you will repair to me. And so the fear, and deep despair, that I of you then had I drive away: and wish that day wherein we may be glad. Glad for to see, but else for me: will be no joy at all: For on my side, no luck will bide, 20 nor happy chance befall. As you shall know, for I will show, you more when we do speak, Than will I write, or yet recite, within this Paper weak. And so I end, and you commend, to him that guides the skies: Who grant you health, and send you wealth, no less than shall suffice.

      Very concerned for her brother well being

    1. he latest debate in the 2020 presidential race has exposed the limits of how far Democrats are willing to go on voting rights. It began with a question to Sen. Bernie Sanders (I-VT), from a volunteer with the American Civil Liberties Union at an Iowa town hall in April: Should people in prison be allowed to vote? Sanders said yes, and then doubled down on his answer. At a CNN town hall a couple weeks later, Sanders was asked if the Boston marathon bomber should be allowed to vote — and, again, said yes. In a USA Today op-ed, he defended his position, arguing that “the right to vote is an inalienable and universal principle that applies to all American citizens 18 years and older. Period.” Since Sanders was first asked, other Democratic candidates have been questioned about their stances. Most other candidates have yet to say that prisoners should be given the right to vote, instead defending the right to vote only for nonviolent offenders or people who completed their sentences. Some appear undecided. Only two states — Maine and Vermont, where Sanders is from — currently let all people vote while they’re in prison. Other states apply restrictions based on whether someone is in prison, on probation, on parole, or has completed a sentence. (They don’t typically make a distinction on whether a person’s crime was violent or not.) (function() { var l = function() { new pym.Parent( 'vox-felony-disenfranchisement-laws-by-state-3__graphic', 'https://apps.voxmedia.com/at/vox-felony-disenfranchisement-laws-by-state-3/'); }; if(typeof(pym) === 'undefined') { var h = document.getElementsByTagName('head')[0], s = document.createElement('script'); s.type = 'text/javascript'; s.src = 'https://pym.nprapps.org/pym.v1.min.js'; s.onload = l; h.appendChild(s); } else { l(); } })(); As of 2016, 6.1 million people were prevented from voting due to a felony conviction, and about 1.3 million were in state or federal prison, the Sentencing Project, an advocacy group, found. Since black Americans are more likely to go to prison, these laws have a disproportionate impact on black voters, in part reflecting their roots in the Jim Crow era: More than 20 percent of black voters were disenfranchised in Florida, Kentucky, Tennessee, and Virginia in 2016. There appears to be some support for giving people convicted of felonies their voting rights back. Last fall, Florida voted to let most people with felony records vote once they complete their sentences — giving the right to vote back to, potentially, more than 1 million people (although that’s now in question as Republican lawmakers place new restrictions on who can vote). What Sanders is calling for, though, goes much further, enfranchising literally hundreds of thousands or millions of people across the country — in a way that could especially benefit black voters. For some Democrats, who have paid more attention to voting rights in recent years, and for activists with the ACLU who are aiming to get candidates on the record on this topic, it’s a logical next step. But the discussion has shown there are limits in how far even some Democrats — let alone the public — are willing to go in expanding voting rights. The polls so far show that giving people in prison the right to vote is unpopular among the majority of voters and Democrats. And in a Democratic primary where so much of the attention, even beyond policy specifics, is going to finding the candidate who can beat President Donald Trump, that unpopularity is drawing concerns about whether a politically risky issue like this one should be discussed at all. Modern felony disenfranchisement laws have some roots in Jim Crow Felony disenfranchisement laws slotted into the push after the Civil War, particularly in the South, to limit civil rights gains following the end of slavery and ratification of constitutional amendments — the 13th, 14th, and 15th — protecting minority rights. The resistance to civil rights gains also included the Jim Crow laws behind legally enforced racial segregation and other limits on black voting power. It’s been a decades-long project for civil rights activists to undo all of these laws. After the civil right movement, Democrats have taken up the banner to protect minority voting rights. Passage of the Voting Rights Act of 1965 was fairly bipartisan, but since then Republicans in particular have moved to curtail access to the polls through voter ID laws, cuts to early voting, and purges of the voter rolls. Democrats have fought back against Republicans on these issues, but the Democratic efforts haven’t included much advocacy on prisoner disenfranchisement laws. Preventing people with criminal records from voting in the US goes back to the colonial era and the concept of “civil death” — the notion that some bad actions effectively left a person dead in terms of civic engagement. But there’s also a uniquely American and racist twist to this story, rooted in Jim Crow. After the South lost the Civil War, state lawmakers in Florida, for example, enacted laws — the Black Codes — to constrain black rights. They created crimes, such as disobedience and “disrespect to the employer,” that could be enforced in a way that would target and criminalize black people in particular, according to a 2016 report by the Brennan Center for Justice, an advocacy group. Then, when Florida was forced to write voting rights protections for men of all races into its state constitution, lawmakers added an exception that would exempt victims of the Black Codes: Article XIV, Section 2, imposed a lifetime voting ban for people with felony convictions. Section 4 of this same suffrage article directed the legislature to “enact the necessary laws to exclude from ... the right of suffrage, all persons convicted of bribery, perjury, larceny, or of infamous crime” — the same crimes the legislature had recently recognized and expanded through the Black Code. Brennan went on: “Shortly after the 1868 constitution was approved, a moderate Republican leader boasted that he had kept Florida from becoming ‘niggerized.’” Since then, Florida has changed its constitution and laws, Brennan noted, and the felony disenfranchisement law was reformed again after the report, in the 2018 elections. But the roots of its post–Civil War disenfranchisement laws linger. Florida was not alone. Journalists and historians have documented similar efforts in Virginia and other Southern states. And of course, the federal government had to enact the (now-weakened) Voting Rights Act of 1965 to shield black voters from state-level discrimination, as well as other civil rights laws to prohibit other forms of systemic racism. But the criminal justice system remains one path toward disenfranchising voters, with a criminal or felony record often costing people various legal rights and protections even after they get out of jail or prison. And this system is rife with racial disparities, as the Washington Post’s Radley Balko explained in his thorough breakdown of the research. “We use our criminal justice system to label people of color ‘criminals’ and then engage in all the practices we supposedly left behind,” Michelle Alexander argued in her influential (and at times criticized) book The New Jim Crow. “Today it is perfectly legal to discriminate against criminals in nearly all the ways that it was once legal to discriminate against African Americans.” Still, felony disenfranchisement laws have survived legal challenges. Courts, including the US Supreme Court, have generally upheld such voting restrictions under the US Constitution’s 14th Amendment, which suggests that the government may abridge the right to vote due to “participation in rebellion, or other crime.” Without the courts, the only real hope for these efforts is to turn influential politicians and public opinion around on the issue — which is what Sanders seems to be trying to do and what some activists are encouraging. This might have to trickle down to the state level too, because there’s some scholarly debate about whether Congress even has the power to end felony disenfranchisement at the federal level. Where Democrats stand on felony disenfranchisement With the debate about voting from prison, Democrats now have a chance to expand the broader debate about voting rights. But, besides Sanders, most other candidates haven’t committed to full voting rights for people in prison. Sanders has been very explicit in his case: He argues that voting is a right that should never be taken away from anyone in a democracy. And that means people, no matter how terrible they prove to be, should keep their right to vote. “Even if Trump’s former campaign manager and personal lawyer end up in jail, they should still be able to vote — regardless of who they cast their vote for,” he wrote in USA Today. He later added, “In my view, the crooks on Wall Street who caused the great recession of 2008 that hurt millions of Americans are not ‘good’ people. But they have the right to vote, and it should never be taken away.” Some journalists, pundits, and activists have sided with Sanders. Writing in New York magazine, Zak Cheney-Rice argued that people aren’t imprisoned just because of bad decisions or mistakes, but also due to systemic factors that led them on a wrong path. Denying these people the right to vote robs them of the opportunity to express how society has failed them, how society continues to fail them through torturous and unconstitutional prison environments, and how society should and can be corrected, he argued. “A society that expels from its conception of humanity so many people who are sick, or in pain, or who make mistakes based upon which their entire lives are suddenly deprived of the opportunity for redemption, is an immoral society,” Cheney-Rice wrote. “But most Americans will not see that unless prisoners have a voice in that society. Giving them the vote is not the whole answer, nor is it the only one. But it is an essential beginning.” He pointed out that, beyond Maine and Vermont, several countries let people vote from prison to varying degrees, including France, Israel, Japan, and Sweden. But so far, other Democratic candidates have mostly distanced themselves, to varying degrees, from Sanders’s proposal. South Bend, Indiana, Mayor Pete Buttigieg spoke in stark terms, arguing, “I do believe that when you are out, when you have served your sentence, then part of being restored to society is that you are part of the political life of this nation again — and one of the things that needs to be restored is your right to vote.” He added, “But part of the punishment when you’re convicted of a crime and you’re incarcerated is you lose certain rights, you lose your freedom. And I think during that period it does not make sense to have an exception for the right to vote.” Former Rep. Beto O’Rourke (D-TX), meanwhile, suggested that maybe there should be an exception for nonviolent offenders: “I would think especially for nonviolent offenders that we rethink removing the right to vote and allow everyone, or as many as possible, to participate in our democracy. For violent criminals, it’s much harder for me to reach that conclusion.” Other candidates suggested they’re undecided. Sen. Elizabeth Warren (D-MA), for example, said, “Once someone pays their debt to society, they’re out there expected to pay taxes, they’re expected to abide by the law, they’re expected to support themselves and their families. I think that means they’ve got a right to vote. While they’re still incarcerated, I think it’s a different question. And I think that’s something that we could have more conversation about.” Sen. Kamala Harris (D-CA) similarly said, “I think we should have that conversation.” It’s a philosophical question: Can someone at some point do something so terrible that he loses his right to vote? For Sanders, the answer is no. For others, the answer is yes, though just how terrible the act has to be before that right is lost, and how long the right is lost for, varies from candidate to candidate. Sanders’s stance is very unpopular One reason Sanders’s Democratic opponents may be reluctant to support his idea: politics. The idea of letting people in prison vote is very unpopular. A recent poll from the Hill and Harris X found that 69 percent of registered voters — and 61 percent of Democrats — said people who are incarcerated for a felony shouldn’t be allowed to vote. Another poll by YouGov found that 65 percent of Americans disagree with Sanders’s statement that all prisoners, including “terrible people” like the Boston Marathon bomber, should be allowed to vote. There is support for letting people vote after they complete their sentences. YouGov found that 65 percent of Americans agree that people convicted of a nonviolent felony should be allowed to vote after they have completed their sentences. And in Florida, voters approved an initiative, with nearly 65 percent in favor, letting people convicted of felonies vote once they’ve completed their sentences, with exceptions for those convicted of murder or felony sex offenses. But with the poll numbers on prisoners’ voting rights, it’s not hard to guess why a bunch of Democratic candidates might be cautious about supporting the idea. This has come up with some other issues in the Democratic primaries, like reparations. While some Democrats may truly believe that reparations are good policy, they’re still widely viewed as politically toxic. Sanders himself previously took this approach when asked about reparations, calling the idea “very divisive” in 2016. But in other instances, and seemingly with prisoner voting rights, Sanders has stuck his neck out in support of political causes. He is, after all, a self-described socialist willing to take on the establishment. His entire 2016 campaign against Hillary Clinton was widely considered a long shot, but he launched it anyway largely to move the party to the left on issues like college and health care. To Sanders’s credit, this worked. Today, Democrats are tripping over themselves in voicing their support for Medicare-for-all or at least some sort of expansion of public health insurance. It’s hard to see that happening, or the broader conversation about single-payer health care in general, without Sanders putting the issue at the front of his 2016 bid for the White House. For activists, this is what they want to see. As the ACLU explained, “If we can raise the volume on key issues like criminal justice reform, immigration, voting rights and reproductive freedom with presidential candidates before the 2020 primaries, we can make sure civil rights and civil liberties are front and center.” For many Democrats, though, this isn’t the time for stands purely based on principle. An overwhelming focus of the 2020 Democratic primaries is to find a candidate who can beat Trump. The notion of “electability” is one of the reasons that former Vice President Joe Biden is leading in the polls. So taking up a cause that is very unpopular and could help Democrats lose the 2020 election is a nonstarter for many, even those who may in theory support giving people in prison the right to vote nationwide. There may be some political incentives for Democrats to embrace Sanders’s views on prisoner voting rights, though. The research indicates that letting people convicted of felonies vote could disproportionately benefit Democrats. That’s made Republicans more resistant to the idea — Trump and Vice President Mike Pence criticized Sanders’s comments — but it could make Democrats more receptive, too. But, at least for now, most of the public, Democrats, and the presidential candidates are not on board. Content by Vox NEXT 360p 720p HD 1080p HD Auto (360p) About Connatix V60548 About Connatix V60548 Visit Advertiser website GO TO PAGE Skip 1/1 Vox’s guide to where 2020 Democrats stand on policy Health care 16 The metapolitics of Medicare-for-all Bernie Sanders’s Medicare-for-all plan, explained The Sanders-Warren dispute about how to pay for Medicare-for-all, explained Elizabeth Warren’s plan to pay for Medicare-for-all, explained Elizabeth Warren’s new Medicare-for-all plan starts out with a public option Joe Biden’s health care plan, explained Kamala Harris’s Medicare-for-all plan, explained Pete Buttigieg’s Medicare-for-all-who-want-it plan, explained Where 2020 Democrats agree and disagree on Medicare-for-all How the Democratic presidential candidates would combat the opioid epidemic Elizabeth Warren’s $100 billion plan to fight the opioid epidemic, explained Kamala Harris’s plan to reduce prescription drug costs, explained America’s first-ever public option, explained by Gov. Jay Inslee Elizabeth Warren’s ambitious new bill to lower generic drug prices, explained What 2020 Democrats would do about maternal mortality rates Democrats’ confused, and confusing, Medicare-for-all debate Show More Criminal justice 12 Bernie Sanders’s criminal justice reform plan, explained Elizabeth Warren’s criminal justice reform plan, explained Kamala Harris’s criminal justice reform plan, explained Cory Booker is a genuinely distinctive Democrat on one big issue: criminal justice Cory Booker has a plan to reform the criminal justice system — without Congress The controversial 1994 crime law that Joe Biden helped write, explained Amy Klobuchar’s record as a “tough on crime” prosecutor, explained Joe Biden’s long record supporting the war on drugs and mass incarceration, explained Kamala Harris just introduced a bill to decriminalize marijuana Amy Klobuchar has a plan to reverse the war on drugs — and doesn’t need Congress to do it Kamala Harris wants public defenders to get paid as much as prosecutors Thousands of rape kits are currently untested. Kamala Harris has a plan to change that. Show More Taxes and economics 12 Bernie Sanders’s wealth tax proposal, explained Elizabeth Warren’s proposed tax on enormous fortunes, explained Bernie Sanders’s new plan to supercharge the estate tax, explained Elizabeth Warren’s latest big idea is “economic patriotism” Bernie Sanders wants to tax companies that pay their CEOs way more than their workers Elizabeth Warren’s plan to expand Social Security, explained The big divide among 2020 Democrats over trade — and why it matters Presidential hopefuls are promising workers a $15 minimum wage Elizabeth Warren’s vision for changing America’s trade policy, explained Elizabeth Warren’s plan to make farming great again, explained Amy Klobuchar’s $1 trillion infrastructure plan, explained Michael Bennet’s plan to prevent and end recessions, explained Show More Immigration 6 The 2020 Democratic immigration debate, explained Bernie Sanders’s immigration plan puts the rights of workers into focus Elizabeth Warren’s immigration proposal goes much further than a pathway to citizenship Julián Castro wants to radically restrict immigration enforcement Beto O’Rourke’s immigration plan would go even further on executive power than Trump Elizabeth Warren has endorsed the most radical immigration idea in the 2020 primary Climate change 12 A guide to how 2020 Democrats plan to fight climate change Kamala Harris’s climate plan would take polluters to court Bernie Sanders’s Green New Deal, explained Pete Buttigieg wants the US to be carbon-neutral by the time he’s 68 Elizabeth Warren thinks corruption is why the US hasn’t acted on climate change Julián Castro’s Green New Deal frames climate as a civil rights issue Beto O’Rourke now has the most robust climate proposal of any 2020 presidential candidate Andrew Yang’s plan to tackle climate change, explained Jay Inslee promised serious climate policy and he is delivering Jay Inslee has a radical plan to phase out fossil fuel production in the US Kirsten Gillibrand wants the fossil fuel industry to pay for climate damages Jay Inslee is writing the climate plan the next president should adopt Show More Identity and social justice 12 The 2020 Democratic primary debate over reparations, explained Pete Buttigieg has a plan to win over women The one big policy change 2020 Democrats want to make for veterans, explained Julián Castro has an ambitious plan to fix American policing Marianne Williamson presents the 2020 Democratic primary’s first reparations plan Pete Buttigieg lays out his plan to help black Americans Julián Castro released an animal welfare plan. It’s good policy — and smart politics. Julián Castro’s indigenous communities plan is a 2020 first Elizabeth Warren has a plan to narrow the wage gap for women of color Amy Klobuchar releases plan to fight hate crimes in wake of El Paso shooting Study: Cory Booker’s baby bonds nearly close the racial wealth gap for young adults Beto O’Rourke just unveiled a comprehensive proposal to protect LGBTQ people Show More Education 8 Elizabeth Warren’s K-12 education plan, explained Elizabeth Warren’s free college plan, explained Bernie Sanders’s free college proposal just got a whole lot bigger Bernie Sanders is rolling out an education plan that cracks down on charter schools Kamala Harris’s plan to dramatically increase teacher salaries, explained Democrats’ ongoing argument about free college, explained Cory Booker’s massive overhaul of the Newark schools, explained Joe Biden’s plan to triple spending on low-income schools, explained Business, labor, and tech 12 Every 2020 frontrunner’s labor platform, explained Bernie Sanders’s plan to reshape corporate America, explained Elizabeth Warren wants to break up Google, Amazon, and Facebook Amy Klobuchar enters 2020 race ready to take on Big Tech Elizabeth Warren’s new plan to make sure Amazon (and other big companies) pays corporate tax, explained Elizabeth Warren wants CEOs to go to jail when their companies behave badly The 20-year argument between Joe Biden and Elizabeth Warren over bankruptcy, explained Bernie Sanders’s corporate employee ownership plan, explained Elizabeth Warren’s latest Wall Street enemy: private equity The big new plan to save unions endorsed by Bernie Sanders and Pete Buttigieg, explained Bernie Sanders’s ambitious plan to double union membership, explained Facial recognition tech is a problem. Here’s how the Democratic candidates plan to tackle it. Show More Family issues 6 We asked all the 2020 Democrats how they’d fix child care. Here’s what they said. Kamala Harris’s new paid family leave plan is the most generous yet Elizabeth Warren’s universal child care plan, explained Kamala Harris’s plan to close the gender wage gap, explained Kirsten Gillibrand is making paid family leave a defining issue in her 2020 run Kirsten Gillibrand’s new policy platform is about making parenting affordable Foreign policy 8 The 2020 Democrats’ foreign policy divide Democrats want to challenge Trump’s foreign policy in 2020. They’re still working out how. Democrats are increasingly critical of Israel. Not Pete Buttigieg. Bernie Sanders’s political revolution on foreign policy, explained John Delaney has a serious foreign policy plan Why Kirsten Gillibrand’s foreign policy plan is one of the strongest yet Why Joe Biden’s foreign policy experience is both a weakness and a strength in 2020 Joe Biden wants to restore the pre-Trump world order Guns 6 Here’s where every 2020 candidate stands on guns Joe Biden’s gun plan calls for universal background checks and an assault weapons ban Elizabeth Warren has a new plan to reduce gun violence by 80 percent Bernie Sanders’s record on gun control, explained Pete Buttigieg’s plan to combat domestic terrorists and pass gun control laws, explained Cory Booker’s ambitious new gun control plan, explained Abortion 4 Here’s where all the 2020 Democratic candidates stand on abortion rights Elizabeth Warren just announced her abortion platform. It’s aggressive. Kamala Harris has a plan to stop states from restricting abortion access Joe Biden’s evolution on abortion, explained Government reform and anti-corruption 8 Elizabeth Warren’s new remedy for corruption: a tax on lobbying Elizabeth Warren’s first priority as president: ending government corruption 2020 Democrats’ campaign finance pledges, explained Elizabeth Warren has a new plan to make voting easier The Democratic debate over filibuster reform, explained Elizabeth Warren says she wants to make it legal to indict presidents Kirsten Gillibrand’s plan to get more small donors into politics: give every voter $600 Elizabeth Warren’s new policy rollout targets Pentagon corruption Poverty and inequality 4 5 anti-poverty plans from 2020 Democratic presidential contenders, explained Kamala Harris’s new basic income-style bill is so frustratingly close to being great Why Andrew Yang wants to give a random Twitter follower a $12,000 basic income Elizabeth Warren’s plan to fix America’s digital divide, explained Housing 3 Bernie Sanders’s housing-for-all plan, explained Cory Booker’s plan to fix the housing crisis and make renting affordable Cory Booker and Kamala Harris’s affordable housing plans, explained Most Read <img class="c-dynamic-image " alt="A cartoon of a woman wearing a shirt that reads “super mom” sitting at a desk looking at an open laptop and a tablet on a stand." data-chorus-optimize-field="main_image" src="data:image/gif;base64,R0lGODlhAQABAIAAAAUEBAAAACwAAAAAAQABAAACAkQBADs" data-cid="site/dynamic_size_image-1601047081_1441_33898" data-cdata='{"image_id":67450083,"ratio":"standard"}'> <noscript><img alt="A cartoon of a woman wearing a shirt that reads “super mom” sitting at a desk looking at an open laptop and a tablet on a stand." src="https://cdn.vox-cdn.com/uploads/chorus_image/image/67450083/Header.0.jpg"></noscript> The hell that is remote learning, explained in a comic Here’s what one week of online school is like for my 7- and 5-year-old kids.

      I have recently heard many debates on this and some people ask " why dont people in prison vote" and my opinion on that is that they should be allowed everyone has the right to vote even with their bad actions. I dont think its right that some states allow and dont allow prisoners to vote, whether or not they commited a crime or it wasnt as severe.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reviewer #1 (Evidence, reproducibility and clarity (Required)):

      Molenaars et al., describe a protocol to extract and quantify a wide range of polar and apolar metabolites from the same C. elegans sample using methanol-chloroform based phase separation. The authors assess the method across different input amounts, in comparison to a 1-phase extraction method and through metabolic perturbations using RNAi against several metabolic enzymes. Finally, they provide a metabolomics analysis of metabolite variation across several C. elegans strains. The data are of overall high quality and presented in a clearly written manuscript.

      We really appreciate the positive words from the reviewer.

      To help assessing the value of the method to other approaches, several controls are suggested below:

      1.Fig.1: Metabolite abundance in the polar phase should be compared to 1-phase extraction methods (analogous to Fig. 2I, which compares metabolites in the apolar phase to 1-phase extraction)

      We acknowledge the apparent asymmetry in the text; comparing our two-phase method to a single phase lipidomics method indeed suggests a similar comparison for metabolomics. However, our established polar metabolomics method has always been based on this exact two-phase extraction. The current method exclusively asks whether it is possible to integrate our dedicated lipidomics platform into our established two-phase polar metabolomics method, by utilizing the apolar phase that is usually discarded. This way, the method enables comprehensive metabolomics/lipidomics screening while limiting the need of culturing twice the amount of material.

      Our manuscript does not necessarily ask the more fundamental question of the advantages of a one-phase vs two-phase extraction for polar metabolites. Interestingly, the one-phase vs two-phase metabolomics methods have been compared previously and the authors show here that the two-phase method achieved broader metabolite coverage, satisfactory extraction reproducibility, acceptable recovery and safety (DOI: 10.1038/srep38885). This is most probably due to the cHILIC column being sensitive for contamination and therefore excluding lipids from your samples is beneficial for measuring polar metabolites. We hence believe that developing a single phase polar method would appear superfluous for the purpose of this study.

      2.Are polar metabolites also detected in the apolar phase? Can the less hydrophobic lipids missing from the apolar phase detected in the polar phase?

      This is an interesting question that mostly relates to the lyso-lipids that are not detected in the lipid phase of our two-phase extraction. The first point to make is that sample solvents that are used at the final stage of extraction are not compatible between methods. In other words, the solvent we normally use for the lipids phase (xxx) cannot be injected on the cHILIC column. So, in a practical sense, we would not be able to measure these compounds, even if they would technically be dissolved in the other layer. However, we tried a few different alternative approaches to get more information on this point:

      We have attempted to integrate the lyso-lipids in the cHILIC measurements, in the polar layer, using the polar sample solvents. This was unsuccessful; no reproducible peaks, not even the internal standards, were measured. We will include a note on these results in our manuscript. We have, albeit for a different sample matrix, attempted to dissolve both layers of the two-phase extraction in the cHILIC sample solvents. While we cannot guarantee this for all metabolites, it appears that most polar metabolites are exclusively found in the polar layer. We were not able to integrate even a single peak from any of the sugar, amino acids, nucleotides, etc in the apolar layer dissolved in polar solvents. We have reconstituted both the polar and apolar layer of our two-phase extraction in 50:50 methanol:chloroform and analyzed them on the lipidomics platform. We did find some of the lipid internal standards partition to the polar phase, especially LPG (and to a lesser extent LPE and LPA) compared to for instance PE, SM, PG and PC that all end up in the apolar phase. We will include these data in the revised manuscript as a supplemental figure as it demonstrates that the lyso-lipids are poorly measured in the two-phase extraction. This is also why in the text we advise to use the dedicated one-phase extraction when interested primarily in these species.

      3.Fig.3l-n: The authors claim that extracting metabolites from the polar and apolar phases of the same sample leads to better cross-correlation than if metabolites are extracted from different samples using methods optimized for the respective metabolite classes. To provide experimental evidence, metabolite abundance should be compared directly when metabolites are extracted from the same or from different samples using suitable methods.

      We agree with this point. We will amend the text to not overstate these advantages.

      Reviewer #1 (Significance (Required)):

      The methodological and conceptual advancement of the present study is rather incremental. The authors essentially use the classical chloroform/methanol/water phase separation protocols developed by Bligh & Dyer and Folch, which have been used extensively for lipid extraction for many decades now. However, the effort to carefully measure the metabolites contained in the aqueous phase is laudable. For method validation, the authors use well-understood perturbations that yield predictable results. Overall, I consider the study more appropriate for a publication as a methods protocol, which could be of interest to the metabolomics community, rather than as a research paper.

      We agree; our goal was indeed to create and share a method, we will make sure to emphasize this in our cover letter.

      While the extraction method we use is not novel per se and based on classical extraction procedures, it is important to underscore that we are only now able to use these extractions in combination with high-resolution mass spectrometry. This opens new opportunities for basic discovery. The efficiency we achieve by using both phases of the two-phase procedure makes our method highly attractive for hypothesis generation, especially in sample sets where limited amounts of material are available.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)):

      The authors provide a detailed description of a method to analyse both polar as well as lipophilic metabolites from the same nematode sample. This provides significant advantages over methods using individual samples. Moreover and by using internal standards they establish an extremely good correlation of individual metabolites. This paper is of immediate importance for the worms community and beyond.

      We are very grateful to receive this positive response from the reviewer and for highlighting the advantages of our described method also beyond the worm community.

      **Major comments:**

      none **Minor comments:**

      The correction process using internal standards could be described a bit more detailed.

      In our revised manuscript, we will describe the internal standard use and corrections in more detail in the text. In summary: internal standards are selected for specific metabolites based on their Pearson correlation and %CV. Subsequently, metabolite peak areas were divided by the area of the appropriate internal standard. This corrects for any loss of sample during sample prep, for instance during the isolation of the two layers.

      Jenni Watts has written a nice Worm Book chapter on lipids which may be cited in addition to reference 17, since it covers many of the metabolites and related enzymes contained in this manuscript

      We will include a reference to this Worm book chapter reviewing fat regulation in C. elegans in our paper, thank you for the suggestion.

      Reviewer #2 (Significance (Required)):

      see above

      Reviewer #3 (Evidence, reproducibility and clarity (Required)):

      The manuscript is well written and consider. However, there is room for further improvements:

      We thank the reviewer for the positive response and for the suggestions raised.

      1) Author need to write exactly how many metabolites not just >, semi-quantitative analysis of >100 polar (metabolomics) and >1000 apolar (lipidomics) metabolites in C. elegans, for example they did with other papers in Table 1

      We understand that this might appear vague. The notation was a compromise, based on the following considerations:

      1. The maximum number of reported metabolites can be different to the number of analyzed metabolites in a specific experiment or even a specific sample. For instance, our method is perfectly capable of measuring creatine metabolism –we have standards for these metabolites and they can be reliably measured–, however we have not yet been able to detect these metabolites in elegans. Some mutants also lose abundance of a certain metabolite to the point of it not being reliably measurable, which means they are filtered out in the bioinformatics.
      2. Since the initial draft of our manuscript we have been able, and will continue to be able, to add new metabolites to our analysis, as we perform a full scan over the range of m/z 50-1200. Because of this, we felt it more accurate to state that we can measure >100 metabolites, instead of a specific number.

        2) Authors also need to clarify on number of samples in the result section while describing the statistical analysis.

      We understand this point raised by the reviewer and will specify not only the number of samples, but also that they are indeed biological replicates. This will be included in the figure legends.

      Reviewer #3 (Significance (Required)):

      This might be interesting paper for the research community who work with C.elegans (metabolism or in general)

      Thank you, we are in fact utilizing this double extraction for other non-worm samples such as mice an human tissues and we believe this could also benefit the research community beyond the model organism C. elegans.

      The authors must deposit the raw data and make it available for the public, so they could also benefit from this good work.

      It is our full intention to share our data in a convenient and standardized way through for instance the MetaboLights database (https://www.ebi.ac.uk/metabolights/). We agree and changes will be implemented as suggested.

      Reviewer #4 (Evidence, reproducibility and clarity (Required)):

      **Summary:** The authors present a method for extraction of both lipid and polar metabolites from the model organism C. elegans. This extraction method is based on the well-established Blyth and Dyer method, with a slight modification to retain and utilize both the organic and non-polar fractions for LCMS analysis. They applied and tested this method against a monophasic extraction utilizing the same solvent system. They report that there is a loss of metabolites in the non-polar fraction to the polar fraction (of more polar metabolites) and small differences between the monophasic and biphasic extractions. They also expanded on the linearity of the extraction efficiency by increasing the number of worms. Further they applied the single extraction method to both knockdown mutants of C. elegans and Recombinant Inbred Lines derived from N2 and the natural isolate CB4856 to determine whether this method would still be able to differentiate the metabolome between the genetically different C. elegans populations.

      We thank the reviewer for their comments and suggestions.

      **Major comments:**

      *Are the key conclusions convincing?*

      As a whole the conclusions are convincing and valid.

      We appreciate that the reviewer considers our work convincing and valid.

      *Should the authors qualify some of their claims as preliminary or speculative, or remove them altogether?*

      The use of the adjective "robust" is, to an extent, erroneous. As defined, a robust method implies that the method is capable of withstanding small (deliberate or not) changes or variations. In this case the robustness of the method was not assessed and not clear how replication was carried out.

      We have in fact performed analysis on both biological replicates and repeated injections of pooled samples to determine robustness. We will clarify the biological replicates in the text and will place the pooled QC samples in the main text with additional explanation and relevant statistics such as % coefficient of variance (%CV) between them. For clarity, we plotted %CV of all polar as well as apolar metabolites. For polar metabolites 97% of the metabolites had a %CV lower than 30. For apolar metabolites 86% of the metabolites had a %CV lower than 30.

      *Would additional experiments be essential to support the claims of the paper? Request additional experiments only where necessary for the paper as it is, and do not ask authors to open new lines of experimentation.*

      Reproducibility would need to be assessed/quantified to establish how robust the method is. Even though linearity with an increase in the number of worms is a good indication, it does not satisfactorily establish the robustness of the method. The use of replicates to assess the agreement between measurements (i.e. bland-Altman plots), linearity as well as coefficients of variation (included in the sup material but not clear in the body of the manuscript) would characterize the methods best. The isolation of each variance originating from instrumental (pooled quality controls), biological (biological replication) and sample preparation (multiple extractions from the same biological source) is critical.

      We have these data and will elaborate on this in our revised manuscript. We will discuss the quality control samples more prominently in the main body of the manuscript, and show one or more figures that specifically address both analytical and biological variance (see rebuttal figure 2). In summary, we assessed this variance using (a) a repeated injection of a pooled QC sample, and (b) biological replicates prepared individually. Especially the latter condition, in which we assess biological variance is representative for the actual method application. The %CV under these conditions is ≤20% for the majority of metabolites, which is why we consider our method robust.

      *Are the suggested experiments realistic in terms of time and resources? It would help if you could add an estimated cost and time investment for substantial experiments.*

      The suggested experiments are in-fact just further analysis with the already collected data. There would be no need for further experiments, however it is not clear whether pooled QCs/or reference materials were used and the number of replicates per experimental design.

      All the data are available. These analyses will be included in the revision.

      *Are the data and the methods presented in such a way that they can be reproduced?*

      The methods are very well described. My only comment is to address how the replicates were grown/created and how many per strain/group. If the replicate measurements were done on the same samples (repeated injections), I believe that would weaken the findings (if not invalidate them altogether), however if these were biological replicates from independent starting populations the findings are valid and convincing.

      We performed bona fide biological replicates. We will explicitly mention this in the paper together with the other descriptions of our validation protocols.

      *Are the experiments adequately replicated and statistical analysis adequate?*

      As per my above comments.

      **Minor comments:**

      *Specific experimental issues that are easily addressable.*

      It is not clear how the sample preparation process was carried out (randomization, run order, QCs etc). As per the guidelines widely accepted from –Broadhurst, D., Goodacre, R., Reinke, S.N. et al. Guidelines and considerations for the use of system suitability and quality control samples in mass spectrometry assays applied in untargeted clinical metabolomic studies. Metabolomics 14, 72 (2018). https://doi.org/10.1007/s11306-018-1367-3.

      We will provide details on the analysis itself in a table. In summary: Samples were measured in a random order, with blanks and QC samples throughout the run.

      *Are prior studies referenced appropriately?*

      A major reference that has applied this extraction method before in the same model organism is missing:

      Castro, C., Sar, F., Shaw, W.R. et al. A metabolomic strategy defines the regulation of lipid content and global metabolism by Δ9 desaturases in Caenorhabditis elegans. BMC Genomics 13, 36 (2012). https://doi.org/10.1186/1471-2164-13-36

      We will include this paper in our references. We would like to note though that this method requires not just an LC system to analyze lipids, but also GC with additional derivatization steps. Our method achieves comprehensive lipidomics using a single technique and no additional derivatization.

      Further a recent publication that goes beyond the work described by the authors using similar approach: MPLEx: a Robust and Universal Protocol for Single-Sample Integrative Proteomic, Metabolomic, and Lipidomic Analyses. Ernesto S. Nakayasu, Carrie D. Nicora, Amy C. Sims, Kristin E. Burnum-Johnson, Young-Mo Kim, Jennifer E. Kyle, Melissa M. Matzke, Anil K. Shukla, Rosalie K. Chu, Athena A. Schepmoes, Jon M. Jacobs, Ralph S. Baric, Bobbie-Jo Webb-Robertson, Richard D. Smith, Thomas O. Metz mSystems May 2016, 1 (3) e00043-16; DOI: 10.1128/mSystems.00043-16

      We will also include this paper, reporting 51 polar metabolites and 84 lipid species, in our references. While we recognize that they also make use of both phases and the protein pellet, we think our method is much more practical in several key ways:

      Our metabolomics platform provides twice as many species and our lipids platform exceeds their analytical capabilities 10 fold. This means a far better coverage of differences within metabolite and lipid classes, allowing for far more intricate patterns to be detected. We show this for instance in our plots comparing carbon chain length to degree of saturation (Fig 4 and S2 in original manuscript); a comparison that is only possible with the data density that our method offers. The MPLEx metabolomics method also requires the use of a GC system and derivatization steps, while our method does not, making it much more user friendly and requiring only a single analytical system.

      *Are the text and figures clear and accurate?*

      Yes *Do you have suggestions that would help the authors improve the presentation of their data and conclusions? *

      The figures, overall are of exceptional quality.

      As per current scientific consensus, Box plots should also be overlaid with the actual datapoints (which was aptly done for the bar charts and other plots).

      The supplementary data even though comprehensive is hard to understand. A "readme" file detailing what data each file contains would improve readability and comply with FAIR principles.

      We agree that a readme file would make the supplemental data more understandable. We will provide such a file. For the box plots we will show the actual data points in our revised manuscript.

      Reviewer #4 (Significance (Required)):

      Even though the approach is not novel and has long been used in Natural Products Chemistry and in other organisms, it's highly significant to set an extraction method standard for the field of C. elegans metabolomics (including myself doing metabolomics and natural products chemistry with LCMS and NMR). However, this manuscript does not cover the technical aspects of the method with sufficient depth to hallmark this method as the standard for the field. Further information is needed to fill the missing gaps (as highlighted by the authors). Ratios between solvent and biological material amounts, reproducibility, recovery rates (even though buried in the supplementary files) and metabolite coverage are still missing.

      As a side note, the disparity between the monophasic and biphasic extractions could be overcome by a sequential extraction of the same sample, with no incurred cost on performance (and removing the much-dreaded pipetting uncertainty near the line between solvents). The second aspect of the manuscript, which initially was a welcoming idea (and important), became >50% of the manuscript creating a disconnect between the information set by the abstract and introduction and the results/conclusion. The work is extremely relevant in both sections of the manuscript, but the technical aspect is still lacking details and/or analysis.

      Strongly suggested: explicit compliance with the minimum reporting standards as per the Metabolomics Standards Initiative (MSI) and deposition of the data to a metabolomics repository (i.e. Metabolights or Metabolomics Workbench). These are internationally accepted requirements for metabolomics publications.

      We are aware that the extraction itself is an analytical chemistry staple. However, it is precisely in this fact that we find novelty. It should be noted that both of the other papers mentioned by the reviewers that have attempted to integrate lipidomics and metabolomics have had to resort to labor intensive (as well as possibly expensive and destructive) derivatization steps and a separate analysis on GC. Our method does not have these requirements. It is indeed a single and very common extraction, after which each dried phase is reconstituted and immediately injected. But this simplicity is not a concession, as our metabolome coverage is easily more comprehensive than the other mentioned methods. We therefore feel that this simplicity should not discount our currently presented method, but be considered an additional advantage.

      Sequential extractions may be an option to consider. However, we feel like they are less user friendly and unneeded. Because we use internal standards, it is never an issue to pipet slightly more or less of any particular sample; making it easy to avoid the line between solvents.

      We will explicitly clarify where we already comply with the standards (such as the analysis of biological replicates and repeated injection of a QC sample) and are confident we can add figures and further information such as deposition of our data to comply with the rest.

      REFEREES CROSS-COMMENTING

      Completely agree with reviewer #1 comments, they are on point and I completely missed it. Relevant and should be addressed.

      Reviewers #2 points out work worth acknowledging, the internal standard work was quite thorough and well designed.

      Reviewer #3 and my comments overlap nicely, the need for further description of samples/replication and deposition of data in a metabolomics repository.

      Further work is required to make this a good publication and standard for the field, without this extra work addressing the reviewers comments I feel this work could be to certain degree misleading and/or incomplete putting in cause its publication potential.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      We thank the reviewers for their feedback and encouragement. We have now fully revised the manuscript to address all comments. Our specific responses are provided below and we have highlighted changes in the text. The major additions are:

      • analysis of simulated time-courses with lower temporal resolution
      • analysis of ex vivo PER2::LUCIFERASE SCN recordings
      • analysis of simulated time-courses with Poisson distributions of noise
      • plotted summary statistics for several figures
      • mathematical formula and explanation in the Methods Overall, these revisions have strengthened our findings and improved the manuscript, particularly in demonstrating that the issues with the chi-square periodogram are not specific to sampling interval or data type.

      Reviewer #1 (Evidence, reproducibility and clarity (Required)):

      **Summary:**

      Tackenberg & Hughey investigate the reliability of a popular period estimation algorithm, the chi-square periodogram. They find a bias in the estimation, and through careful investigation identify the cause. This is a well executed and well presented study.

      **Comments:**

      In Figs 2+3 the authors show that the discontinuity in periodogram coincides with the number of complete cycles, K. However, in Fig 2C there are several other positions where K abruptly changes, but little effect on the chi-squared statistic is observed. Can the authors offer an explanation as to why the magnitude of the discontinuities differ?

      We have taken a closer look at how each component of the chi-square statistic calculation changes at points where K decreases, and have found that discontinuities do always occur at these points. In addition to the obvious effect of the K * N term on the sudden decreases, we found that the sum of squares of the column means alone (the primary component of the numerator) also changes abruptly at each transition point of K. As a result, the discontinuity magnitude is likely roughly proportional to the amplitude of the chi-square statistic at that point.

      An important claim is that the discontinuity is observed in multiple software implementations. However, the plots of Supplementary Fig 1C,D are presented too small to evaluate this claim.

      In Supplemental Fig. 1C-D, the critical information is the shape of the periodogram and the presence of a discontinuity, so we believe the plot sizes are appropriate.

      It may be of interest to apply the algorithms to a single-cell experimental data set which are qualitatively different (e.g., oscillation shape, damping).

      We have created a new supplemental figure (Supplemental Fig. 8) by applying the strategy and visualization used in Fig. 6 to SCN PER2::LUC recordings instead of wheel-running data, and have updated the text accordingly.

      Reviewer #1 (Significance (Required)):

      It has been previously shown that the chi-square periodogram algorithm has performance shortcomings for the analysis of circadian data (e.g. Zielinski et al., 2004). However, this study demonstrates exactly why, giving more conclusive evidence to support the conclusion that it should be avoided. This will be useful to many in the mammalian circadian community. It should be noted however that other algorithms are already favoured by other ciock communities (e.g. plant), even if a rigorous understanding of the biases were lacking.

      The methods developed here will be valuable for future comparisons of circadian algorithms. Of particular importance will be comparing algorithms for analysis of single-cell rhythms or non-stationary rhythms.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)):

      Chi-squared periodograms (CSP) are routinely used in circadian biology. In particular, this test has been used to determine circadian period in behavioral data (e.g. actigraphy) in mammals, flies and other species. This paper suggests that CSP, in some circumstances (e.g. where there are discontinuities), that CSP could be improved by changing the algorithm. They propose different steps to do this (e.g. using their greedy CSP code) and/or by using alternative tests such as Lomb-Scargle.

      The authors use simulated data to demonstrate their findings, and whilst I can see the benefits of this, it would be useful to benchmark the algorithms on actual real world circadian data (e.g. actograms from mouse or fly experiments). Although these types of data may not be publicly available, it would be highly likely to be available from multiple labs in the circadian field. In particular, fly datasets will be abundant in many clock labs. This would aid the utility of the papers findings for the field.

      Fig. 6 is entirely based on real-world circadian data (mouse wheel-running activity), as is the newly added Supplemental Fig. 8.

      Reviewer #2 (Significance (Required)):

      The paper is helpful for the circadian field when dealing with datasets that may contain discontinuities.

      It appears that the paper will be primarily useful for behavioral data, rather than, for example, transcriptomic time courses, since these tend to be much shorter and less sample intensive. Thus, it would be useful for circadian (and other) researchers analysing activity data in particular.

      My expertise is in circadian rhythms, both behavioural and molecular (e.g. sequencing) level analyses. Thus, I would be a possible end-user for the algorithms in this paper.

      Reviewer #3 (Evidence, reproducibility and clarity (Required)):

      **Summary:**

      The authors identify a serious flaw in a popular method called Chi-squared periodogram (CSP) for period estimation in circadian rhythms. They systematically get to the source of the problem -- a discontinuity in the test statistic. This flaw leads to a bias in the period estimate. They present two modifications to the CSP, one of which they prefer. Nevertheless, they show that other more flexible methods such as Lomb-Scargle Periodogram work well without this discontinuity (bias) issue.

      **Major Comments:**

      1.One thing the authors do not include is timeseries lengths of non-integer days. Would it not be an interesting suggestion to choose a non-integer length time course, which is not a multiple of the periods of interest, and still continue using CSP as is ? This is also rather counter-intuitive.

      Figs. 3A and 6 and newly added Supplemental Fig. 8 use non-integer (24-h) days.

      2.I suppose the authors use a sampling resolution of 6min with wheel-running activity in mind. But it would be worth it in the interest of completeness to also consider a lower resolution. There is nothing in this study that ties it to the specific application, is it not?

      Although a sampling resolution of 6 minutes is not specific to wheel-running activity, we have added an analysis identical to that of Fig. 5 but with a resolution of 20 minutes (Supplemental Fig. 5). Additionally, the PER2::LUC SCN recordings analyzed in Supplemental Fig. 8 have a sampling resolution of 20 minutes.

      3.The authors discuss only the mean absolute error in the text but isn't the direction (sign) of the error also of interest. As far as I can see in Fig 5, conservative CSP overestimates and greedy CSP generally underestimates periods.

      We discuss both the error (references to Fig. 5A) and absolute error (references to Fig. 5B) in the text. We feel the interpretation suggested by the reviewer may be too reliant on the results of 3-day simulations, as the apparent underestimation by greedy appears far less substantial in simulations of 6 and 12 days.

      **Minor Comments:**

      1.I would like to see the formulae for the ratio of variances and p-values to be clear about how the authors computed the CSP. They describe it in words already, but I think some mathematics is warranted here.

      We have added the formula for the standard chi-square periodogram to the Methods section.

      2.It is nice to the see the raw data in the plots. But I would like to see the plot of the summary statistics (mean and variance/st. dev) for each of scatter plots to judge the size of bias. It is not easy to do this with the Excel sheet.

      We have overlaid a black circle representing the median and a vertical black line representing the 5th-95th percentile range onto Fig. 5 and Supplemental Figs. 3-7.

      Reviewer #3 (Significance (Required)):

      The authors present a sobering perspective on the chi-squared periodogram, which is still very popular among empirical biologists. They plainly show using artificial data that it is better to avoid the CSP when possible, although they suggest improvements to the CSP. The authors provide an R package to perform the analysis.

      There have been previous work that have highlighted other limitations of the CSP. This might be considered one more nail in the coffin of the CSP.

      I think this paper would be interest to both computational biologists and wet-lab biologists, but I think it ought to have a greater influence on the latter as the former already resort to more sophisticated approaches.

      My expertise is in Computational and Theoretical biology.

    1. from the beginning of the file

      Perhaps change "file" to "disk" as suggested by fat16.h. This part was very confusing.

      Also, there was no mentioning in the instructions that the root directory entries may not be exactly located as described in the picture, so perhaps change "78*512" to something like "depending on bpb".

      I'm not sure if these choices were intended to make sure that we carefully looked at the code documentations instead of just the instructions, but I think these parts should be adjusted so that other students aren't confused.

    1. For them, the notion of the paradigm neatly encapsulates the idea that truth and knowledge are relative, and depend upon the larger system of assumptions and relations from which they emerge.

      I think that it's very valuable for human kind to consider knowledge and truth as relative. Considering language itself limits our communication, what we believe to be truth could potentially limit our understandings of the world. All of this philosophical talk reminds me of Plato's Allegory of the Cave in which those who live in the cave know nothing but the cave. We, as well, may rely too heavily on what we know in the world.

    1. “enlarge knowledge by observation and experiment … so that nature being known, it may be mastered, managed, and used in the services of humane life.”

      The concept of a second creation and the Edenic recovery has a long history. Cicero in De natura deorum (45 B.C.) conceived of a second nature that humans create by channeling the rivers to suit their needs, by sowing and fertilizing the soil of the plains and the mountains to bear fruit and wheat, and by planting trees to shade their gardens and parks. Medieval Catholic and later Protestant theologians believed that Christians possessed a divine creative spark that would enable them to design tools and machines capable of transforming the land into a new Garden of Eden.

      Hughes, T. P. (2004). How to Think about Technology and Culture. In 944899466 737787191 T. Hughes (Ed.), Human Built World (pp. 17-27). Chicago, IL: University of Chicago Press.

      The chosen passage by Merchant points to the visions and views of Bacon specific to his revelation of the sciences role in nature. The involvement and exploitation of science in relation to the manipulation of nature is reinforced in Bacon's and some philosophers' frame of mind during this time. This is important to note because of the 'new organon' and that being resolved as scientific methods combined with mechanical methods to obtain a unified knowledge of material power and dominion over nature.

      This establishment of human dominion and the mechanical arts (teché) are what is described during this time as man operating nature to create something new. This is not far fetched from what we view design as today, the main difference being our acknowledging to our part in the manipulation of the land and the goal to not achieve dominion but balance. (in modern day landscape architecture practices) Bacon's objective in offering the significance of science and mechanical tools, point to achieving the "mastering or management of nature to obtain services for human life"; disagrees with these modern day views/practices.

      Hughes discusses the managing and human egocentrism as well, indicating the manipulation of water typologies such as rivers for the channelization of water, or tending the land for soil suitable for our chosen species of growth. Bacon seems to give reason for his bound of nature for our own use and advantage, in that in order to search the depths and beginnings of the Earth there must be a dissection of nature. From Merchant's critique of science as a manipulation method, we can begin to pull direct connections from Bacon's look at exploration into the remoter nature and its relation to to current day transgressions still in place. An example could be tree deforestation and the destruction and manipulation of nature to achieve a human-use or function.

    1. when light-wing'd toysOf feather'd Cupid seal with wanton dullnessMy speculative and officed instruments,

      Here in the use of Cupid we see that call back to the classics. Later on in the play I believe Othello refers to Desdemona as like a Cherub, another little angel baby from the classics. I think this sort of alludes to that sort of idealistic Love that may be associated with the classics. I think Desdemona and Othello did have an almost archetypal love story befitting that capital "L" Love we have talked about, but it was eventually corrupted.

    1. Some books have been attacked merely for being “controversial,” suggesting that for some people the purpose of education is not the investigation of ideas but rather the indoctrination of a certain set of beliefs and standards.

      This is a great statement right here. It is stating the true meaning of education and how it should be in society today and yet we have people around the world who think that just because something doesn't align with their ideas and may have children questioning their beliefs (like how regular adult conversation should have the right to) it is not right and should be kept in the dark from students. And yet, these ideas are found by students anyway, just in resources other than school and these resources can sadly steer students away from correct information (although schools can do that as well).

    2. ensuring students the freedom to choose to read any text and opposing “efforts of individuals or groups to limit the freedom of choice of others.”

      What do we think about this statement? I definitely agree that something like this is important, but I'm wondering what responsibility we, as teachers, have to filter out ideas in our classrooms given that some students may have difficulty with some of the ideas presented in these texts.

    1. Author Response

      Summary:

      As you will see the reviewers agreed that the premise behind this manuscript is important and timely both in the context of basic auditory science and for informing technology. However, they raised largely consistent concerns about the generalizability of your observations to other auditory stimuli and to more naturalistic listening conditions.

      We appreciate the reviewers’ positive assessment underpinning the significance and timeliness of our present research endeavours. We assume generalizability of our findings to more naturalistic listening conditions because the proposed model framework successfully explained the outcomes of experiments that were conducted under listening conditions differing in reverberation and source stimuli. Those differences, however, only occurred across but not within experiments and thus were not considered in the model explicitly. The set of experiments and relevant cues was chosen such that the investigation of decision strategies for the combination or selection of cues in the context of perceptual externalization could be conducted on a limited but still divers set of cues. The proposed framework allows to easily extend the set of cues. For example, in another work (see Li et al., in press), we successfully modelled the impact of situational changes of the amount of reverberation on externalization perception by extending the framework to reverberation-related cues. This further strengthens our assumption that our findings can be generalized. Nevertheless, we understand that more direct evidence for this generalizability would further increase the confidence in the conclusions we draw.

      Reviewer #1:

      I agree with the authors that the question at the basis of this work is timely and important both from the point of view of understanding auditory perception and for informing technology. However I am not convinced that the findings here will necessarily generalize to other stimuli/listening situations.

      I think the biggest limiting factor here is that the primary data on which the modelling is based are drawn from many different studies which used different stimuli, different tasks, different presentation environments and different equipment). I can see how testing the model on existing data is an important first step, but I would think that a critical next step is to form a set of (contrasting) predictions to be tested on a single stimulus set, within a single group of participants, as a way of confirming model validity. In this experiment I would also avoid using static non-reverberant environments since we know that these factors greatly affect spatial perception.

      We do not follow the reasoning why the above mentioned diversity of experimental paradigms is a limitation. On the contrary, in our opinion, the diversity of the considered experiments demonstrates robustness of our findings for a variety of experimental procedures. We agree that an additional validation experiment would further strengthen our study, but we question its necessity and still believe that the present modelling work is extensive and compelling enough to warrant publication.

      Other comments:

      1) The title greatly overstates the main findings, it would be toned down.

      In the title, we aimed at describing the research topic in general terms accessible to a broad readership. We take your comment as an advice to state the main findings instead.

      2) Intro, line 30-33 this statement is misleading. As written it appears to claim temporal aspects of auditory perception are based on short term regularity, whilst spatial perception is based on long term effects. This is not correct see e,g Ulanovsky 2004.

      Agreed. We will remove the sentence or rephrase it in more general terms because the misleading distinction is actually irrelevant to our study.

      3) As a reader not highly familiar with the auditory spatial processing literature I found the results section very dense and hard to follow. If you are targeting a general audience it is important to clarify concepts, avoid using abbreviations where possible etc.

      Thank you for your advice. We will aim to increase the level of abstraction within the results section.

      4) When discussing the various decision strategies which you tested, consider explaining how they might be implemented by the auditory system, at which stage of processing etc.

      Our study approached the problem from an algorithmic point of view and did not touch upon the more detailed level of neural implementation. While the cue processing has a clear neurophysiological basis in the subcortical layers of the auditory system, we will include some speculation about the involved cortical networks in a revised version of the manuscript.

      5) It is very difficult to evaluate your results without more information about the stimuli and studies from which they were taken. Whilst you do provide references, I think the paper would be much clearer if you provide a more complete description of the stimuli (even in table form; paradigms etc).

      We appreciate your advice and will provide more details about the simulated experiments in a table.

      Reviewer #2:

      The current study compares four decision rules, factoring in seven potential acoustic cues, for predicting perceived sound externalization for single-source binaural sound with stationary interaural cues. Test stimuli included a harmonic vowel complex, noise and speech. Results show that monaural and binaural cues shape externalization. However, how listeners weighted these cues varied across the tested conditions. The authors consider the fact that some of these cues covary acoustically, by additionally testing their model on subsets of two of these cues only. No single externalization cue emerged as a clear predictor for perceived externalization. However, overall, a static cue weighting strategy tended to outperform dynamic cue weighting for predicting externalization.

      Major concerns dampen enthusiasm for the current work.

      1) It is unclear what neural mechanism is being tested. A premise of the current approach is that perceived sound externalization is primarily driven by acoustic cues. However, we know this not to be true. Context matters. As pointed out by the authors (l370-372), when listening to sounds processed with head related transfer functions (HRTFs) over headphones, listeners can externalize sound better when the context of the test room matches the room where HRTFs were recorded (Werner and Klein 2014).

      Sound externalization is an auditory percept and as such primarily driven by acoustic cues. How those cues are used for perceptual inference is certainly context dependent. From the present study, we conclude that the auditory system evaluates deviations from a small set of expected acoustic cues in a fixed weighted (and not selective) manner. We further explain that these expectations, which are represented as templates in the model, must be adaptive to the context. This is well in line with your example of room divergence (Werner and Klein, 2004): listeners are thought to establish expectations about reverberation-related acoustic cues and evaluate incoming sensory information against those expectations with a fixed weighting between cues. If expectations are not met (i.e., acoustic cues deviate from their templates), perceptual externalization degrades.

      2) Most external sounds are neither anechoic nor stationary. Therefore, any neural decision metric on externalization must have been shaped by lifelong experience with dynamic, reverberant cues for interpreting externalization. The current work mostly models stationary single source sound that was either anechoic or mildly reverberant, providing pristine spatial cues. I do not follow the author's point that this would not matter (l498-502): "While the constant reverberation and visual information may or may not have stabilized auditory externalization, they certainly did not prevent the tested signal modifications to be effective within the tested condition. In our study, we thus assumed that such differences in experimental procedures do not modulate our effects of interest." That is an untested assumption.

      Others showed that the type of spectral manipulations we considered remain effective also if reverberation is present (e.g. Hassager et al., 2013) and if listeners are exposed to dynamic cues by moving their heads or the sound source (Brimijoin et al., 2013). We used the above-mentioned argument in order to motivate why we ignored certain differences across studies in the first place and the high explanatory power obtained with the proposed model framework suggests that this simplification was adequate. We agree that the above-mentioned sentence can be easily misunderstood and we will modify it by including the explanation stated here.

      3) Many of the current test stimuli are perceived as ambiguous - providing 50% externalization ratings - and thus do not provide a sensitive test of brain mechanisms of sound externalization.

      The field mostly agrees that auditory externalization is not a binary phenomenon but a matter of degree – we very recently published a review article that discusses this issue in detail (Best, et al., 2020). Hence, the experimental outcomes, denoted as externalization scores, ranging from 0 to 1 indicate the degree of externalization that is considered to mediate perceived egocentric distance. The externalization scores do not indicate the level of perceptual ambiguity.

      We will include this explanation in the manuscript in order to prevent further misunderstanding.

      4) Reverberation enhances perceived externalization, but this cannot be predicted by any of the tested decision metrics which only consider stationary monaural or binaural cues.

      True, there are also other cues potentially affecting the degree of auditory externalization. Reverberation-related acoustic cues are one of them. The main purpose of our study was to identify the basic functional mechanisms that integrates or selects between various cues – the purpose was not the identification of all possible cues that may affect auditory externalization. Thus, we chose a set of experiments that can be narrowed down a priori, particularly allowing to ignore reverberation-related cues.

      For the effect of reverberation-related cues, we point interested readers to another modelling study (Li et al., in press) that we conducted in parallel, in which we applied the here proposed framework also to reverberation-related cues and obtained good predictions.

      On balance, this reviewer is unconvinced that the current work will generalize to realistic dynamic and reverberant conditions.

      We agree with the reviewer that our study does not address dynamic and variable reverberant conditions. It was by-design limited to static conditions with fixed reverberation because we had no reason to believe that the targeted decision strategies applied to combine or select cues would be fundamentally different in more complex conditions.

      S. Werner and F. Klein, "Influence of Context Dependent Quality Parameters on the Perception of Externalization and Direction of an Auditory Event," presented at the AES 55th International Conference: Spatial Audio (2014 Aug.), conference paper 6-4.

      Reviewer #3:

      The manuscript "Decision making in auditory externalization perception" aims to identify cues that create/hinder an auditory externalization percept by using a template-based modeling approach. The approach as well as the findings are very interesting, and the study is thoroughly conducted. However, the manuscript adds little new knowledge to the field. Furthermore, a critical discussion is missing. The authors use a template-based model, but do not discuss the possible problems with such an approach. Particularly as each condition uses another model fit. This potentially allows the model to use cues that the auditory system cannot or does not consider. Nevertheless, the approach can still teach us which cues are potentially important for auditory externalization.

      1) The title seems inappropriate as the main work seems to be on the identification and combination of cues for externalization but not on the decision making.

      In combination with Reviewer #1’s first comment, we understand that the title could have been more specific. We will change the title accordingly.

      2) The model needs a more detailed explanation in the introduction. Otherwise the result section is not understandable without consulting the methods section.

      We will carefully re-evaluate which methodological details are necessary to understand the results section on a more abstract level.

      3) Add a Discussion on template-based models and fitting conditions. The risk of mathematical inspired models is that features are exploited that the auditory system cannot access. A more sophisticated front-end than a gammatone filterbank might reduce this risk. Alternatively, the use of physiologically inspired front-ends as in Scheidiger et al. (2018) might be interesting to consider. Nevertheless, I acknowledge that some of the features used in this study are backed by physiological and psychoacoustical studies.

      We agree with the concern behind the use of efficient functional approximations of the auditory periphery. Interestingly, however, we are very confident that this particular approximation does not provide spurious cues, especially in the context of monaural spectral shapes, because we did cross-validate the effectiveness of those cues with a physiologically more accurate model (Zilany et al., 2014) in previous work (Baumgartner et al., 2016).

      We will incorporate a corresponding explanation in the manuscript.

      4) It is known that the monaural spectral shape is important for externalization, for example from the studies that you have used. Thus, I partly question the novelty of the findings.

      We partly agree. It has also been suggested that interaural spectral cues are important for externalization perception. Further, it is also known that other cues contribute (e.g., reverberation-related cues as already discussed in response to the comments of Reviewer #2). Now, which cues contribute to which degree and how are they integrated? This is the main research question behind our study, with the ultimate goal to better understand the mechanisms of cue integration in the context of a perceptual inference task.

      5) I am not too familiar with template based models but I wonder if there is a problem if you use your models to fit and test with the same datasets?

      Cross-validation (i.e., using separate data sets for fitting/training, validating, and testing) is particularly important for complex models that allow overfitting. Such models can often be very closely fit to comparably small sets of data and thus the goodness of fit is not discriminative between those models. Here, in contrast, we compared the goodness of fit for models that contained a rather small and equal number of model parameters and this goodness of fit did strongly differ across models and was therefore informative for model selection in itself. If we separated the data sets, we would need to jointly assess the differences in initial model fits (to training data) together with the differences in predictive power (for testing data).

      References:

      Baumgartner, R., Majdak, P., & Laback, B. (2016). Modeling the effects of sensorineural hearing loss on sound localization in the median plane. Trends in Hearing, 20, 2331216516662003.

      Best, V., Baumgartner, R., Lavandier, M., Majdak, P., & Kopčo, N. (2020). Sound Externalization: A Review of Recent Research. Trends in Hearing, 24, 2331216520948390.

      Brimijoin, W. O., Boyd, A. W., & Akeroyd, M. A. (2013). The contribution of head movement to the externalization and internalization of sounds. PloS one, 8(12), e83068.

      Li, S., Baumgartner, R., & Peissig, J. (in press). Modeling perceived externalization of a static, lateral sound image. Acta Acustica.

      Zilany, M. S., Bruce, I. C., & Carney, L. H. (2014). Updated parameters and expanded simulation options for a model of the auditory periphery. The Journal of the Acoustical Society of America, 135(1), 283-286.

    1. Millions of Americans were shocked and alarmed when presidential hopeful, and leading Republican presidential candidate, Donald Trump, not only announced his intent to build a wall along the United States-Mexican border to keep out “criminals and rapists,” but also demanded a ban on Muslim immigrants, even Syrian refugees, from entering the United States.16

      I think that it is racism, also he is afraid from Islam as he sees that is most of Muslims may cause danger, because of this stereotype that we discussed before that Muslims can be terrorists I think

    1. but between instructional design issues and the theories of human learning.

      I think this is a great field of study because we know so much about the psychology of humans that we're able to create proper ways of learning that will be successful. We see the issues in the design of learning and teaching and we can find the best solution based off of unique situation of each person. I think this is great for people who may have felt like a minority such as people who are dyslexic, deaf, have learning disabilities or even young children. There are experts who are meeting the needs of everyone to help us get the most out of learning.

    1. Federal Title IV grants and loans accounted for 71 percent of revenue at for-profit colleges

      When I read "for profit" institutions I immediately think of ITT Tech and how it came under fire for questionable practices--as may of their students fell under crippling debt.

      I think a question we should be asking is whether or not these "for profit"institutions should exist--these institutions' goal is to make revenue and would therefore have little incentive to provide anything else other than the programs they offer. They are however, able to offer flexibility that perhaps a "normal" (non-profit) 2-tear/4-year can't offer (night classes/or online classes) to people who work in the day; there may be some "non-profits" who can also offer this, but it is often at a very limited basis. After doing a quick google search, it seems as though many of these "for profit" schools are focused on trades, offering programs in automotive, nursing, etc.(there is also K-12 "for profit" education"). What would happen if these "for profit" institutions that are backed by private corporations and investors were instead backed by federal/state funding? Of course, that'd be a whole other discussion/debate and possible policy brief--but just a thought! Also it can be argued that even "non-profit" colleges/universities can be seen as "for profit" as they are often run as businesses (offer services, advertisement etc) and there is a reliance on tuition etc. to help pay for facilities, professors, etc. Key factors that differentiate these institutions from the "for-profits" is that they offer a space to create networks/socialize and at times produce knowledge/research that is shared with the world.

    1. now if it is uncertain whether god gave it, we rightly ask whether it was well given. Then if we find that (a) it was well given, we also find that it was given by him from whom all goods are given to the soul; or if we find that (b) it was not well given, then we realize it was not given by him Whom it is blasphemous to blame.[2] on the other hand, if it is certain that god gave it, then, no matter how it was given, we must recognize that it should neither (a) not have been given, nor (b) have been given otherwise than it was given. for it was given by him Whose deed cannot be faulted in any way

      This concept is interesting because it is a paradox. If it was given by God, then free will must simply be good because God is good. However, does that make sinning good? If sinning isn't good, does that mean that God made a mistake? According to Christian belief, anything that God gives cannot be bad and God does not make mistakes. If God didn't give free will, then who did? There is no answer to this because no one is considered as powerful as God is and no one would be able to give humans the ability to make their own choices. I'm not sure what the answer to this question is, but I believe that God designed us fully and gave us free will. I think that free will is a good thing because it gives us the ability to make our own choices and learn from our mistakes. Because of this a lot of good can come from making the wrong choices. While this doesn't always happen when one makes a mistake, it is a potential positive aspect. So, while sins/mistakes aren't always good, there may be silver linings.

    1. Author Response

      Reviewer #1:

      This manuscript provides evidence that drug administration during a reconsolidation window does not necessarily prevent memory recall, as has been shown by many groups. The authors attempted to replicate several published experiments and despite demonstrating that the drugs had other effects on the animals' behavior and physiology (e.g. weight gain), no effects on memory were observed.

      The paper is nicely prepared.

      We sincerely thank the reviewer for these kind words and the support to publish our replication efforts.

      Reviewer #2:

      General assessment:

      In this study, Luyten et al. aimed to replicate post-retrieval amnesia of auditory fear memories reported numerous times in the literature. They used a variety of behavioural approaches combined with systemic pharmacological treatments (propranolol, rapamycin, anisomycin, cycloheximide) after reactivation of fear memories. Interestingly, none of the treatments induced a significant decrease of freezing responses during subsequent retrieval tests. Authors strengthened their null results by using Bayesian statistics, confirming the absence of drug-induced amnesia.

      Overall, the study is really interesting. Experiments and analyses are very well designed and bring some important findings to the debated topic of post-retrieval amnesia and its clinical relevance.

      We are grateful that the reviewer appreciates our work and recognizes the general importance of our null findings. We genuinely thank them for the time that they took to evaluate our paper in detail and hope to provide some clarifications in our responses below.

      I have nevertheless several comments for the authors to consider.

      -Despite being very detailed, the authors should clarify and uniformize their Methods section and Supplemental information (e.g. number of CS, contexts used...) to improve the understanding of the different approaches. Similarly, methods for the reinstatement protocol (Exp 2) are missing.

      We understand that the information in the main text is quite dense, but we explicitly chose to focus on the central message here, i.e., that we applied standard procedures that should have allowed us to detect amnestic effects in consideration of most of the published literature. In addition, the crucial overview of the number of training and test trials, as well as the context that was used for each session is depicted in Fig. 1-3, immediately above the results of the respective experiments.

      In the Supplement, we provide a more extensive (and repetitive) report of the experimental procedures. The idea is that the reader can find the most important information in the main text, and all additional details in the Supplement (or in our preregistrations on the Open Science Framework: https://osf.io/j5dgx ). For example, in the main text, it is mentioned that reinstatement in Experiment 2 consisted of two US presentations in context A, one day before the final test (see p. 6 and Fig. 1C). The Supplement (p. 1) adds that the reinstatement session started with 300 s of acclimation, followed by the first US and 180 s later by the second US, and that the rat was removed from the context 120 s after last US onset. For all phases of Experiment 2, the US was a 0.7-mA, 1-s shock.

      • In exp 5, tests 1 and 2 are supposed to have 12 CS each. However, only 8 dots are represented on the graph. Did the authors average some freezing values after the initial 4 first CS presentations?

      Thank you for noticing this. We did not average freezing values, but just did not measure freezing on all trials, as we were not specifically interested in the concrete freezing levels on each trial, but rather in the overall extinction curve. As mentioned in the legend of Fig. 2, freezing during CS5-7-9-11 was not measured (and hence also not shown). In other words, the 8 dots on the graph represent CS1-2-3-4-6-8-10-12.

      -There is an obvious difference in baseline freezing response before the test in Exp 7 (Figure 5A-B). Discussion of these differences is an important point and was thoroughly discussed by the authors in the Supplement.

      Thank you for pointing this out.

      -Ln 384-387: "... additional Bayesian analyses were carried out that collectively suggested substantial evidence for the absence of an amnestic effect". Despite the "substantial effect" given by the meta-analysis, I am a bit confused by the meaning of an "anecdotal evidence against drug < control" reported in half of the experiments. How do the authors interpret these results?

      In short, Bayesian analyses provide evidence that is categorized starting from ‘no evidence’, to ‘anecdotal’, ‘substantial’, ‘strong’, etc. depending on the obtained Bayes factor. Grouping studies with anecdotal and substantial evidence in a meta-analysis can result in overall substantial evidence, which is what we observed here.

      Addressing this remark in more detail, we want to point out that the use of frequentist analyses (ANOVAs and t-tests) allowed us to conclude that we could not replicate the amnestic effects of previously published studies – we did not obtain a statistically significant amnestic effect although we had sufficient power to detect the effect sizes that had been previously reported. However, those analyses do not permit us to make inferences about the evidence against an amnestic effect. Bayesian analyses, on the other hand, do allow us to quantify the obtained evidence against an amnestic effect (i.e., the null hypothesis) for each single experiment or by combining the results of several studies. When a single study suggests only anecdotal evidence against an amnestic effect, this implies that we cannot conclude based on that study alone that we have proper evidence for the absence of an effect. Rather, we can only conclude that we have no evidence for the presence of an amnestic effect and weak (‘anecdotal’) evidence for its absence. However, a collective analysis of our studies does lead to the conclusion of substantial evidence for the absence of an amnestic effect overall.

      -The effect of cycloheximide on memory consolidation is indeed unexpected. Even if beyond the scope of the current study, what is the authors' hypothesis to explain that cycloheximide in their conditions induced a pro-mnesic effects on the consolidation of fear memories but altered the consolidation of extinction?

      As indicated by the reviewer, this is beyond the scope of the current study. We have no additional data on this effect and can only guess at its meaning. Also note that the effect was rather small and disappeared quickly during the test under extinction.

      One purely speculative hypothesis is that the injection with cycloheximide was more arousing than the vehicle injection, either due to sensations caused by the substance during injection or due to the rapidly emerging malaise it induced (or a combination of both), which we have documented in the Supplement (p. 5).

      In line with work by McGaugh, Roozendaal and colleagues, such arousal around the time of training could, in theory, enhance consolidation of a fearful memory, and thus explain greater fear memory during test (see e.g., Roozendaal & McGaugh (2011), https://doi.org/10.1037/a0026187 ). Then again, a similar argument could be made for improved consolidation of the extinction memory (de Quervain et al. (2019), https://doi.org/10.1007/s00213-018-5116-0 ), which we did not observe. One could suggest that – assuming that we have observed ‘true’ effects here – the arousal component had the upper hand during the consolidation of the fear memory, while the protein synthesis inhibition overruled such effects during consolidation of the extinction memory. As this is all highly speculative, we prefer to not add this to the Discussion.

      -Cycloheximide seemed to induced post reconsolidation amnesia of fear memory after extinction training (Exp 8, Fig 3G) but not after single CS reactivation. Can the authors please develop this point? Is it possible that several presentations of the CS is required to destabilise the initial memory trace?

      First of all, it is important to emphasize that cycloheximide-treated rats in Experiment 8 (Fig. 3G) froze more during the CSs of Test 2 than control animals, arguing against a drug-induced reconsolidation blockade of the initial fear memory. Furthermore, the obvious within-session extinction during Test 1 in Experiment 8 suggests that it did not function as a typical reactivation-without-extinction session (Merlo et al. (2014), https://doi.org/10.1523/JNEUROSCI.4001-13.2014 ).

      In light of the current literature, reactivation with a single CS is by far the most common way to destabilize a memory trace that was formed with one or three CS-US pairings. As mentioned in our paper, this should provide an appropriate degree of prediction error for the memory to become malleable (p. 12).

      Theoretically, it is indeed possible that more than one (e.g., two) CS presentations could allow for destabilization of the memory trace, although others who have used reactivation sessions with more than one CS presentation did not find the amnestic effects that they did observe with a single CS (Merlo et al. (2014); Sevenster et al. (2014), https://doi.org/10.1101/lm.035493.114 ).

      Reviewer #3:

      Luyten et al's study examines the phenomenon of drug-induced post-retrieval amnesia for auditory fear memories in rats, and report that after several experiments using Propranolol, Rapamycin, Anisomycin or Cycloheximide that they essentially observe no disruption of reconsolidation, (i.e., no amnesia). This is a well-executed, written and meticulous study examining an important phenomenon. The author's lack of observing amnesia using these "reconsolidation blockers" highlights an important fact that systemic administration of these drugs at the time of memory retrieval may not robustly influence reconsolidation processes despite what the existing literature may collectively indicate. The author's data clearly indicate this point and it is important the scientific community be made aware of these difficulties in blocking reconsolidation using systemic administration of these drugs.

      We are thankful for these generous comments and value the reviewer’s thorough and thoughtful assessment of our work. We also appreciate the reviewer’s position that it is important to get this message across to the scientific community.

      This group has previously published similar studies disputing similar phenomena. First highlighting a lack of amnesia following the reconsolidation-extinction paradigm and then more recently demonstrating a lack of amnesia attempting to block the reconsolidation of context fear memories. This is now their third installment focusing on Cued fear memories. Certainly, these findings are important, but arguably the novelty of such findings may be diminished a bit.

      We appreciate that the reviewer is well aware of some of our other work in this domain that supports a more general and widespread reproducibility crisis in this field.

      Regarding the novelty, one key point to stress here, which is also articulated in the paper (p. 3, 13), is that the current rodent findings (which we could not replicate) are the ones that provide the most direct basis for the clinical translations that have been proposed (e.g., by giving patients a propranolol pill after retrieval of a traumatic or phobic memory, see e.g., https://kindtclinics.com/en/ or Kindt & van Emmerik (2016), https://doi.org/10.1177/2045125316644541 ), and are therefore critical in their own right, not only because of their fundamental scientific relevance, but certainly also in light of their clinical reach.

      In one of the "control" experiments where the experimenters administer anisomycin immediately post training, they observe a paradoxical result - they observe memory strengthening instead of the expected blockade of consolidation and amnesia. This result highlights a number of things to consider when we interpret these overall results. For one protein synthesis inhibitors(PSIs) are toxic and when administered systemically usually result in inducing the animals to have diarrhea and generally just makes them sick. This of course will make the animals stressed and agitated and result in increasing their stress and likely amygdala activity. All of this could likely be the reason why the animals exhibited memory strengthening or no impairment in consolidation even with a PSI on board. See PMCID: PMC7147976. Figure 6. In this study, they could rescue the impairment of PSI on consolidation by increasing BLA principal neuron firing. Thus an important take away is something like this could easily be happening in the reconsolidation experiments - that there is no blockade because the animals are stressed either due to PSI on board or because some issues with experimenter/animal interactions, etc lead to higher BLA neural activity and rescue of the reconsolidation process.

      We agree that (systemic) protein synthesis inhibitors can induce signs of sickness in the animals (particularly in the first hours after injection) and have provided a detailed description of our relevant observations in the Supplement (p. 4-5). The reviewer is completely correct in stating that this may cause some amygdala activation which could interfere with the amnestic effects that we expected to see, as described in the paper by Shrestha, Ayata et al. (2020), and in line with our reply to Reviewer #2’s first comment regarding our cycloheximide experiment. Yet, effective induction of amnesia with these drugs has repeatedly been reported in the literature.

      Nevertheless, although relevant, the current remark has relatively little implications for our findings. In the large majority of our experiments, we did not use these toxic protein synthesis inhibitors (PSIs) (such as cycloheximide and anisomycin), but drugs that have generally been administered systemically throughout the literature (with successful amnestic effects). Furthermore, in the experiments where we did administer systemic cycloheximide or anisomycin, we observed no differences compared to vehicle-treated rats in contextual freezing (e.g., 9% on average in Experiment 7) immediately prior to the crucial test tones (Test 1, 24h after injection) – which argues against high levels of stress or agitation. Moreover, a blinded experimenter could not tell the difference between PSI-treated versus vehicle-treated animals while handling the animals for the test session, and observed no behavioral abnormalities, nor signs of pain or distress, as mentioned in the Supplement. We acknowledge that these experimenter observations may not entirely reflect what is happening in the animals’ amygdala, but they at least go against the notion that PSI-treated animals would be too sick to be tested properly.

      I don't think the authors go far enough articulating the important differences between systemic and intra-cranial administration of these drugs. Time is a potential factor. Immediate administration of the drug at high concentration in the target brain region (BLA) versus many minutes until the drug gets to the target region with uncertain concentration levels that may not mirror levels reached with intracranial administration. It's unfortunate the authors were not able to include intra-BLA administration of these drugs in this study. I do not necessarily expect them to do such experiments, since they have already done so much and it is not clear the laboratory has the appropriate expertise to conduct such experiments, but this comparison would be helpful.

      We fully agree that our results do not provide any information about the replicability of intracranial administration of drugs to induce post-retrieval amnesia of cued fear memories. We had already clearly acknowledged this in the first version of the paper (p. 11), but have now added an extra section to the Discussion (p. 13) to highlight this point in the new version posted on BioRxiv (Version 2). Notwithstanding the expertise of our laboratory to carry out intracranial infusions, we agree with the reviewer that such experiments are beyond the scope of this article.

      It is, however, noteworthy that the drugs that we used in 6 experiments did not necessarily rely on intracranial administration in prior successful studies. Rapamycin, for example, has generally been used systemically (not intracranially). Propranolol has been used either systemically or intracranially in rodents and always systemically in human subjects (healthy and patients). Bearing in mind the timing issue that was raised by the reviewer, we moreover included an experiment with pre-reactivation administration of propranolol (Experiment 4), where the drug was injected 5-8 minutes before the rats heard the reactivation tone.

      I think it is important that the authors make some statement of training conditions on cannulated versus cannulated rats. For example, every animal in Nader's 2000 study was bilaterally cannulated targeting the BLA. In contrast every animal in this study underwent no such surgery. I think this is relevant. In my experience non cannulated animals are a bit smarter than cannulated animals and the training conditions across these two differing groups may not equate to the same level of learning. And of course, differences in learning levels can lead to differences in the ability of the retrieved memory to destabilize.

      Thank you for pointing this out. We are aware that there may be differences between operated and non-operated animals and already briefly discussed this matter in the Supplement (p. 4). We have now also added this issue to the Discussion in the new section (p. 13) where we emphasize the differences between systemic and intracranial drug administration in relation to the previous comment.

      That being said, the comment regarding (non-)cannulated rats only really applies to Experiment 7 where we tested the effects of systemic anisomycin or cycloheximide. Prior cued fear conditioning studies indeed used intracranial administration of these drugs. The argument does not hold for Experiments 1-6, as systemic propranolol and rapamycin have repeatedly been reported to have amnestic effects in non-operated rats, with procedures identical to or closely resembling ours.

      The authors mention possibly examining markers of memory destabilization. GluR1 phosphorylation, Glur2 surface levels, protein degradation/ubiquitination have all been used to assess if destabilization has occurred. I do not fully agree with their reasons for not performing such experiments. They could examine some or one of these phenomena across differing training conditions between retrieval, no-retrieval animals. This likely could be informative. However, the authors may not possess the necessary expertise to conduct such experiments, so I'm not stating these experiments need to be completed, but certainly the study could be strengthened with such data.

      We agree that including yet more control experiments, using different experimental approaches could further strengthen the study. Nevertheless, the main conclusion of our paper – i.e., reconsolidation blockade using systemic administration of several drugs is considerably more difficult to reproduce than what the literature collectively indicates – is strongly and sufficiently supported by the data that we already report here. Overall, we believe that our conclusion does not require such additional controls. Moreover, even though the comparisons suggested by the reviewer could indeed be scientifically interesting, it is still unclear whether such experiments would provide sufficiently clear cut-offs as to which experimental condition would then allow for adequate memory destabilization and interference.

      Experiment 3E - Propranolol without reactivation. I don't see any data for this on the graphs. Am I missing something?

      Our apologies for the confusion. The legend shown next to Fig. 1F applies to all panels of Fig. 1, but only Experiment 1 (shown in Fig. 1A-B) contained a no-reactivation group as an additional control. Experiment 3 (shown in Fig. 1E-F) did not. We have moved the legend to the bottom of Fig. 1 to clarify this.

      The authors should probably cite this paper too, PMID: 21688892. The authors in this study find no evidence that propranolol inhibits cued fear memory reconsolidation.

      Thank you for bringing this to our attention. We were aware of this paper, but it had slipped through the cracks. We have cited it in the new version of the paper (p. 11).

    1. When adults assume attitudes that are in any way dismissive, judgmental, or all-knowing, we may silence all but the most outspoken of children and risk that even those brave voices fall on deaf ears.

      This is something important to remember because it changes the way a child perceives their own learning and capabilities. I think sometimes where this comes out is me treating children too casually I spend a lot of time with (my own child is a great example) instead of valuing their ideas as valid and at least exploring questions. While this is hard to do every time - the awareness helps us to better shape the moments we spend with children.

    1. Researchers who engage in CES often decrease their legitimacy within the academy since the positivist tradition, which they are challenging, is quite powerful. Thus, in many ways, they join the ranks of the “marginalized.” In short, issues of power and privilege are multilayered. Second, we need to understand, to the best of our ability, how systems of power shape the understanding and actions of individuals, including our own. Third, we need to be open in our communications and unafraid to ask questions that take us close to the central nervous system of racial difference, while also understanding why our questions may go unanswered. Open and frank conversations about race in our society are few and far between, leaving most of us woefully unprepared for how to productively and sensitively engage in such conversations. Fourth, we need to distinguish between individuals and institutions. While many urban universities have been prime movers in gentrifying their surrounding communities, many of the faculty who teach in those places have strongly opposed such actions. Creating spaces for those academics to come together to share experiences, lessons learned, and suggestions for moving forward, as URBAN has done, provides some comfort and support. Fifth, and on a proactive note, researchers need to be mindful of the privileges that often do accrue by virtue of working in a university and, if we are white, the privileges that come from our racial standing. Acting as empowerment agents, we can leverage this privilege in our work with community and youth partners. Finally, we need to accept and live with the knowledge that some tensions will never be resolved. However, if these tensions push us to further interrogate our roles, our work, our status, and our place in the larger fight for social justice, they may ultimately strengthen our collaborative work, enhancing our ability to effect positive social change

      I think this entire conclusion is incredibly strong and overall provides good discussion and analysis based upon the metonyms presented.

    1. When we buy new clothes not to keep ourselves warm but to look "well-dressed" we are not providing for any impor- tant need. We would not be sacrificing anything significant if we were to continue to wear our old clothes, and give the money to famine relief. By doing so, we would be preventing another person from starv- ing. It follows from what I have said earlier that we ought to give money away, rather than spend it on clothes which we do not need to keep us warm.

      I think the author does not take into account human behavior when making this argument, and he basically defines human necessities as food, shelter, water. He neglects to consider how gaining power and resources to increase fitness is woven into our genetic makeup. Social dominance is a primary characteristic of how humans function in societies, and quality of clothes are often an indication of high social status. I think that the author has faith in human selflessness, but I believe that inherent selfishness will prevent the idea of everyone living at a point of marginal utility from ever becoming a reality. Singer assumes that the majority of the human population has attained an elevated level of moral reasoning that, to be frank, very few people reach. I think that in general, people act in ways that are beneficial or mutually beneficial in terms of elevating status (social status, wealth, etc). I think it is difficult for people to discern a direct material benefit from helping others that may never be able to return the favor. Because of this, we are less likely to help.

    1. The strangeness of the past enables us to step back and look at our society and ourselves from a new perspective

      This quote is totally one of the key thoughts and philosophy of History its self. 'Strangeness' has a really interesting connotation to it, when somethings strange or different often times I want to know more about it. Just to see if it really is as strange as I thought? Because what's strange to you or me might be the "normal' for someone else. So if we view History's past it may seem strange because we are looking through present perspective. But if we alter the way we think just a little bit you can understand way that was normal at the time and even maybe start seeing similarities of past and present.

    1. Something is activated in us, perhaps even actualized, as we move.

      Is this suggesting that "we" evolve and find new solutions as we develop?

      I do think that this is maybe a bit of a romanticism of "turns", sometimes turns are brutal and, though Rogoff may not like it, technocratic or hard to adjust to. It seems as if Rogoff is suggesting we acquiesce to these easily.

    1. “Now it’s cool.”

      Pronouns, like other grammar tools, are very important. We've been using them for so long that they have become a serious part in our conversations about people other than ourselves. I wouldn't necessarily say that they've just suddenly become cool. I would say our interest has recently increased towards the subject when it comes to using the correct pronoun, as it shows our understanding of the identity of the person we are speaking about. Because someone's identity is important, their pronoun should be just as important. I think looking at pronouns as simply just a "part of speech" as Baron says is only looking at the basic layer of what a pronoun means. Messing up someone's pronoun can spark some conflicts, depending on the individual mentioned.

      But when you look at "they" (singular) versus they (plural), their doesn't seem to be an event where conflict would arise. I may have used they in reference to a singular being before, but I don't think there has been a time where it's crossed my mind to contemplate if what i'm saying is weird. Then again, I can't really think of many clear examples where I've used they as singular. I typically use he or she, since I tend to know the correct pronoun for the identity of the person i'm referring too. I guess myself, like others, may not see the distinction between the two as such an important topic, so we overlook it. But, since we've discussed how important semicolons and oxford commas are, maybe I'll start paying attention a little more.

    2. that this is a perfectly respectable option — and so unconscious that even those whocondemn it invoke it without noticing

      I think this kind of argument is the strongest I have heard in support of the singular "they". While people may not view that as "technically correct" while editing written work, it can often go unnoticed verbally. If someone left trash at the table, I feel like most people would say "someone left their trash." and not say something like "someone left his or her trash." And as we have discussed, grammar rules change (like the oxford comma). Who is to say that they/their is "incorrect"?

  4. lifeitself.us lifeitself.us
    1. s conditions of the residency: You will need to agree that Life Itself is not liable for any damage to you or your property.You are expected to participate in the community and care for the home ( eg: cooking, cleaning). Each home may have additional fees (eg: contribution of communal meals).Life Itself provides bedcover, sheets, pillow cover and towel.When leaving your residency we ask you to not leave any trace unless agreed, and put things back where you found them; to not colonise the space nor information (books, dvd’s etc.), and keep information, materials, equipment and spaces available as you found them. We will not pick you up at train stations or airport, that means that you have to come by your own means.Hubs can not take animals.Residencies are for individuals and we don’t offer it to partners. If you want to come with a partner please contact us and we can discuss this.Payment is by bank transfer or Paypal within two weeks of receipt of your acceptance to the residency (if this is a problem this can be discussed).You are responsible for obtaining any relevant travel permissions including visas. (Life Itself may be able to provide you with a letter of support).

      should be somewhere else I think

    1. Reviewer #2:

      In the manuscript by Galstyn et al on "Proofreading through spatial gradients", the authors proposed and studied a new kinetic proofreading (KP) model/scheme based on having a spatial gradient of the substrate (both "correct" and "wrong" ones) and the diffusive transport of the substrate-bound enzyme molecules to a spatially localized production site. The authors did an excellent job in explaining their new model and its connection and difference w.r.t. the classical Hopfield-Ninos KP mechanism. The key insight is that with spatial inhomogeneity, e.g., in the presence of a persistent spatial gradient for the enzyme or the substrate, one can consider spatial location as a state-variable. By having the substrate and product (or production site) at different spatial locations, these spatial degrees of freedom of the enzyme, i.e., enzymes at different physical location, can be considered as the intermediate states that are necessary for kinetic proofreading - each intermediate state contributes a certain probability for error-correction. In the original Hopfield-Ninos KP scheme, the intermediate state is provided by additional enzyme(s), whereas in this new KP scheme, it depends on having a spatial gradient, which the authors argue is more tunable. I like the theory for its simplicity and elegance. I have only a few mostly technical questions/comments.

      My main concern for this study, however, is about how relevant this mechanism is for realistic biological systems. The original Hopfield-Ninos KP mechanism was motivated by specific and important biological problems (puzzles), namely the unusually high fidelity in biochemical synthesis process (in comparison with its equilibrium value). In this MS, the theory is developed without a specific biological system or specific biological question in mind. It is true that spatial gradient exists across biological systems and the authors also showed that typical kinetic rates may fall in the functional range of this new gradient-dependent KP mechanism. But, what is the function of the original system that such a kinetic proofreading process can help improve? Is it biochemical synthesis? Do the authors envision "correct" and "wrong" biomolecules being produced at the production site (x=L) like in the original setting of Hopfield-Ninos? Or is it signaling like in the T-cell signaling case? If so, do the authors envision that both the correct signaling molecule and the incorrect signaling molecule have a spatial gradient and they can both be carried by the same enzyme to their functional sites? I am not asking for a detailed comparison with a specific system, but I think a known but unsolved biological phenomenon that may be explained by this new mechanism would really help motivate a biologist audience. Furthermore, a connection to a specific biological system could also lead to testable predictions that would ultimately verify (or falsify) the existence of this mechanism.

      Questions related to the model/theory:

      1) In this study, there is a production r for the enzymatic reaction at x=L where the enzyme is active. However, the effect of this reaction, which change ES-->E+P, is not considered in the model equations (1-3). Is it because r is considered to be small? If so, smaller than what? Since speed is directly related to r, how does the value of r affect the speed and the speed-accuracy trade-off?

      2) The nonmonotonic dependence of fidelity on the diffusion time for finite gradient as shown in Fig. 3c is intriguing. What determines the optimal diffusion constant (or diffusion time) when the fidelity is maximum for a given gradient length scale?

      3) The study of trade-off among energy dissipation, speed, and fidelity is quite nice and adds to a growing list of study on performance trade-off's in nonequilibrium systems. For example, a similar energy-speed-accuracy (ESA) trade-off was studied systematically in the context of adaptation in bacterial chemotaxis (Lan et al, Nature Physics 8, 422-428, 2012) and chemosensory adaptation in eukaryotic cells (Lan and Tu, J R Soc Interface 10 (87), 2013). In particular, the exponential dependence of the fidelity on power consumption (energy dissipation) shown in Fig. 4 in this MS agrees well with results in these earlier studies (see Fig. 3c and Eq. 5 in Lan et al, 2012; Fig. 4 in Lan&Tu, 2103). It would be informative to discuss the trade-off found here for the gradient-dependent KP scheme in comparison with similar trade-off relations in other systems.

      4) The power dissipation P is computed by Eq.8 in this MS. Where does Eq. 8 come from? What's the physical meaning of P? The standard way to compute energy dissipation is by computing the entropy production rate S', which is well defined. Then by assuming the internal energy does not change with time in steady state, we equate energy dissipation with kT*S'. The form of entropy production rate is known and can be found in text book (such as those from T. Hill) and papers (e.g., those from H. Qian and collaborators; and from U. Seifert and collaborators), and the formula given in Eq. 8 does not seem to be consistent with the known form of entropy production. In particular, for a given reaction with forward flux J+ and backward flux J-, the entropy production rate is: (J+-J-)ln(J+/J-), which can be easily shown to be positive definite and only =0 when detailed balance J+=J- is satisfied.

      Overall, the MS provided a new gradient-dependent scheme for error correction in chemical systems. The study of trade-off among energy dissipation, speed, and fidelity (accuracy) in this new mechanism is also valuable for the general study of cost-performance relation in non-equilibrium systems. My main concern is the lack of examples of specific biological systems where this gradient-dependent error correction mechanism could be at work to enhance the specific biological functions of these systems.

    1. Author Response

      We thank the editors for considering our manuscript for publication in eLife and the reviewers for their work. However, we would like to discuss several of their comments.

      The key issue seems to be a lack of novelty of our work, which is not correct in our opinion.

      We would like to quickly reiterate why we think that our findings are novel and have very broad implications.

      The importance of polygenic adaptation is becoming increasingly clear. Unfortunately, it is widely assumed that polygenic adaptation is very difficult, if not impossible, to study in natural populations, because the associated allele frequency shifts are too small to be experimentally characterized (Pritchard et al., 2010). Hence, typically the collective response of many loci are considered, which frequently results in wrong results due to population stratification (Berg et al., 2019; Sohail et al., 2019).

      Therefore, we have used experimental evolution to characterize polygenic adaptation. Experimental evolution is widely recognized as a powerful tool because of the possibility to replicate experiments. Here, we expand the power of experimental evolution by an hitherto unrecognized aspect: the impact of linkage disequilibrium - we demonstrate that two founder populations with different levels of linkage disequilibrium (LD) result in entirely different selection responses. The consequence of different LD structures is shown by our observation that the same population (i.e. identical LD structure) evolving in two different environments shows the same selection response, but a different population with different LD structure in the same environment shows different selection responses.

      This result has important implications for all studies of polygenic adaptation in natural populations because LD is not accounted for in studies of polygenic adaptation, but like in our study, haplotype blocks with multiple loci could result in a strongly selected allele. Hence, LD will determine the likelihood of this to occur. Furthermore, accounting for linkage provides the opportunity to study polygenic adaptation also in natural populations - a substantial change to the current testing paradigms.

      The second key result of our study is that we demonstrate that selection in hot and cold environments does not fit the simple model of polygenic adaptation, where the same set of loci is responding in different directions, when opposing selection regimes are applied. As pointed out by reviewer #2, this is particularly important as it shows that current models of polygenic adaptation are not well-suited to understand adaptation imposed by contrasting ecological factors. We show that there is almost no overlap between the haplotype blocks selected in the hot and cold environment. Most importantly, this is not a matter of power as we show that the blocks responding in one selection regime are not changing their frequency in the opposite direction in the other selection regime. We anticipate that this insight will have a profound impact on theoretical models of polygenic adaptation. Furthermore, as we studied temperature adaptation, our results will have also important consequences for the battery of ongoing studies aiming to link selection signatures to response to climate change.

      In brief, we think that very minor clarifications in our manuscript can solve the technical issues identified by the reviewers and will provide a clearer picture about the general implications of our findings.

      A detailed response to the comments of the reviewers is given below.

      Reviewer #1:

      Otte et al. used an evolve and re-sequence strategy to explore "the genetic architecture of adaptive phenotypes". The authors previously found different genetic architectures across different founder populations evolving in a common hot environment. The authors chose one of these founder populations for replicated experimental evolution (5 replicate populations) in a cold environment for 50 generations. The authors were surprised to discover the same number of loci evolve under strong selection between the hot-evolved and cold-evolved replicate populations, though the 20-ish loci are largely non-overlapping. The distribution of selection coefficients was also similar. They interpret this commonality as evidence that the founder population history has a larger effect on adaptive architecture than the selection regime.

      The study demonstrates a comprehensive effort to discover the number of genome regions and distribution of selection coefficients that emerge from a highly controlled experimental evolution project. The experienced team applies a sophisticated toolkit to this powerful experimental design - a toolkit that grows ever more sophisticated with each new experimental run that they perform. However, the authors set me up to learn why such different adaptive architectures emerge from different founder populations. Ultimately, the researchers acknowledge that they "cannot pinpoint the cause for the differences in the inferred adaptive architecture..."

      Here, the reviewer correctly identified one of the main new questions that arose from the new experiment we performed in this study. In a large part of the discussion and the associated analyses we are providing answers to this question, i.e. possible alternative explanations for the different observed architectures in the Portugal vs. the Florida population. We can indeed not pinpoint "the" cause for the differences that the reviewer seems to request here as a definite answer, but we favour one of the explanations that has not yet been discussed in literature previously (LD).

      Some results simply recapitulated the previous Portugal E&R study and other results recapitulated a D. melanogaster E&R study.

      This statement about "some results" is ignoring the main new experiment of this study, which is the Portugal population evolving in a cold temperature. For this, we carried out a new selection experiment in a new environment, which finds different selection targets than the previously published experiments. This new experiment therefore does not recapitulate the previous results. We then compare this new experiment to a previous one, and this comparison raises a set of new questions that we address in this manuscript. Only for the purpose of making that comparison, we indeed "simply recapitulated" "some results" of the previous study. The statement is therefore misleading in the way it is put here. Furthermore, the D. melanogaster study is also not recapitulated: in that study, it was not possible to identify selected haplotypes. The D. melanogaster study was therefore unable to determine how many selection targets were shared between the hot and cold selection regimes. The identification of selected haplotypes was a major improvement in this study, which made it possible only now to determine how many targets are shared and to evaluate whether selection targets behave as predicted by the trait optimum model.

      I did not find the "common adaptive architecture" across different selection regimes to be a particularly compelling discovery of sufficiently broad interest.

      This is a very subjective opinion and it would be good if the reviewer had explained why this is no interesting discovery to her/him. We feel that this statement simply reflects that the reviewer does not fully appreciate the complexity of polygenic adaptation. We would like to point out again, that this result has important implications for the interpretation of selection signatures in natural populations.

      Other concerns and questions can be found below:

      Major concerns:

      1) Pg. 4: It is my understanding that the power of multiple populations from a single founder evolving in parallel allows for more rigorous identification of loci targeted by selection. I found it surprising to discover that if a lack of replication emerges from an experimental evolution study, this outcome is interpreted as "genetic redundancy." First, genetic redundancy has a precise definition in genetics that muddles the author's meaning. And second this interpretation seems rather post-hoc.

      This statement shows that the reviewer is disregarding the work of Barghi et al (2019, PLoS Biology) and the definition of redundancy in the context of polygenic adaptation as discussed by Laruson et al. (2020) or Barghi et al 2020 (Nature Reviews Genetics). In any case, this is a semantic issue and should not be considered as a major issue with our manuscript.

      2) To "shed more light on the different selection responses" is a weak motivation. The introduction sets me up to understand why selection responses are so different but no major insights into the "why" emerge from the cold-adaptation experiment.

      We modestly disagree - we clearly discuss different explanations of “why” and favor one of them (LD)

      3) More explanation of figure 1 in the main text is needed. Does each point correspond to a SNP that consistently changes across all five populations? Or is this the union?

      The reviewer does not seem to be familiar with the statistical analyses that have been used in our study in the same way as it is common practice in the field. Despite the common use of this test, we still provided a detailed explanation in M&M and explicitly mentioned the test in the figure legend. But this can easily be detailed even further and should not be a major issue with this manuscript.

      4) Line 210: How did the researchers define "stress" and determine that the degree of stress is equivalent across two temperature regimes? The absence of these data undermine the potency of the comparison.

      It is not clear why the reviewer requires a more elaborate definition of temperature stress - the concept of extreme temperatures imposing stress is well established and we cite the relevant literature for Drosophila in the text. Furthermore, it is not apparent why the reviewer requests the degree of stress to be equivalent between the two temperature regimes.

      5) How can the authors be sure that the only difference between the hot and cold populations was temperature? Was competition/population size/etc held constant? Might the lack of overlap between hot and cold adapted loci stem from one such regime selecting for a different phenotype? (i.e., not temperature tolerance)

      As clearly stated in M&M, the culture conditions were the same with the exception of temperature.

      6) Line 237: The authors assert that most alleles show a temperature-specific response - a discovery with precedent in the literature, including from this team of researchers. The authors attribute the absence of common loci between temperature regimes to the high number of generations (50) compared to the number across seasons cited in Bergland et al. The researcher could easily look for common targets at earlier time points of experimental evolution to test this idea.

      This is an interesting suggestion, but the reviewer fails to explain why the analysis of early generations should be more informative than the analysis of later generations. Several studies have already documented the opposite.

      7) Line 292-293: This section reads as disingenuous - the researchers could have explored overlap between Portugal and Florida founders using only the selected loci coordinates and look for non-random overlap using simulations/resampling tests.

      The reviewer seems to assume that we could easily apply the same test for overlap that we used for the hot vs. cold comparison within the Portugal population to the Portugal hot vs. Florida hot comparison. But this is not feasible, and we clearly explain why the comparison of selected haplotype blocks between different founder populations is not helpful (low LD results in different haplotype blocks - even with the same target)

      8) Discussion: The speculation about why such different architectures emerged across Portugal and Florida was diluted by the absence of initial fitness estimation upon subjection to a cold environment (which would have offered evidence for different initial "optima" across founder populations) as well as the change in fitness from generation 0 to generation 50.

      It is not apparent why the reviewer requests a fitness estimate at the cold environment. Our analysis only included a single population in the cold environment. Hence, the only informative comparison is the one in the hot environment which has been done for both populations and is referenced in the manuscript.

      9) The simulations and corresponding discussion would make for an interesting review/opinion piece but not as new results for this manuscript.

      Unlike the reviewer, we think that a good discussion puts the results into perspective with different hypotheses on how to explain it and link this to the current literature.

      Minor Comments:

      1) Pg. 3. The recurrent citation of Barghi et al. in the Introduction undermined the reader's impression that fundamental questions are being addressed in this article.

      Maybe it escaped the reviewer’s attention that we cited three different Barghi et al. papers and only one reports experimental data (cited only once), while the others are required to describe the theoretical framework, including the concept of "redundancy" which the reviewer misunderstood. New fundamental questions in this current manuscript are addressed using the Portugal population, which was selected in a cold temperature regime (not hot-evolved Florida, which was the topic of Barghi et al. 2019).

      2) Lines 33-39: The argument that parallel signatures of selection across distinct natural populations are insufficient to address the polygenic basis of adaptive phenotypes, and so comparatively more contrived E&R studies are required, was unconvincing.

      Unfortunately, the reviewer does not provide support for this strong statement. In fact, we find the statement of “contrived E&R studies” not as objective as we would have liked to see in a scientific discourse.

      3) Line 158: Confusing. Should "among" actually be "within"?

      The reviewer is not right - the correct wording is "among" not within: multiple different haplotypes can carry the actual target of selection, and they can differ by additional variants which themselves are not selected for. Multiple haplotypes with the selection target are also experiencing more pronounced frequency changes than expected under neutrality. The correlation of their allele frequency trajectories depends, however, on the extent that hitchhiking SNPs are shared among these haplotypes. To account for this, we used a less stringent correlation cutoff.

      4) Line 486: I believe that the authors would be hard-pressed to find in the literature a paper declaring that "single population...[is] sufficient to understand the genetic basis of adaptive traits".

      In fact, many selection tests are targeting only a single population and most studies only apply them to a single population.

      Reviewer #2:

      This reviewer mainly asks us to discuss some of his/her ideas - this can be done, but since reviewer#1 felt already that there is too much discussion in our manuscript this is a bit of a mixed message.

      Overall Review: This is another commendable study from the Schloterer lab that features next generation genome-wide sequencing of multiple evolving populations. It compares results obtained with two different selection regimes, one hot and one cold, and two different founding populations of Drosophila simulans, one from Portugal and one from Florida. The results reveal a lack of consistency among selection regimes and founding populations. Temperature-dependent adaptation is shown to be "local" or "contingent," rather than globally consistent. My chief recommendations concern the experimental and theoretical contexts within which this study should be interpreted.

      Major points:

      1) I do not require any additional data collection or statistical revision. My comments are organized in terms of experimental paradigm (A) and theoretical significance (B).

      A.

      2) The typical paradigm for experimental evolution in this and many other labs is the use of hybrid populations created from isofemale lines. This method for founding experimental populations can be expected to generate some degree of random "historicity" as the isofemale lines approach fixation of specific genotypes with high stochasticity. Then there are further stochastic and historical effects which arise when such lines are hybridized. The strengths and limitations of this paradigm should be addressed. Most importantly, such stochastic historical effects might be the source of the discrepancy between the replicate lines derived from Portugal and Florida.

      We would like to emphasize that we were using freshly established isofemale lines kept in the laboratory for at most 10 generations, as stated in the M&M section.

      3) As the authors themselves point out, there is a comparative difficulty arising from the different scales of replication used for the Florida versus Portugal experiments.

      The reviewer is correct, and since we were aware of this, we performed statistical tests to account for this.

      A further question for large-scale experimentation is whether a larger and uniform level of replication might produce more similar results, such as 20 evolving populations from each source. Or indeed, three sets of ten evolving populations from three distinct founders from the two sources, with a total of 60 evolving experimental lineages. The authors should discuss whether they believe that their findings would hold up with such an expanded experimental protocol.

      This is an interesting thought of its own, but we feel that it does not contribute much to our current study.

      4) The authors themselves point out at one point that their experiments might have benefitted from some phenotypic characterization of the presumed temperature adaptation. That raises the more general question of how the field of experimental evolution can progress with some labs just doing phenotypes and other labs just doing genome-wide sequencing. Surely this and other studies would be strengthened by combining the two types of assay. Furthermore, genomic evolution might be usefully analyzed in terms of the degree to which specific genomic changes can be associated with specific phenotypic changes, as that is the foundation for adaptation itself.

      We would like to draw the attention to the fact that we performed a laboratory natural selection experiment, for which the environmental factor is known, but not the actually selected phenotype - hence the phenotyping is not as trivial as implied by the reviewer.

      B.

      5) This is yet another study that finds difficulties with the invocation of noroptimal selection along a one-dimensional functional gradient. Such models have been long-standing favorites of evolutionary theorists, such as Kimura and Lande. But that preference may arise more from the ease with which these models can be formulated and analyzed by theoreticians. Actual evolving populations don't seem to embody the precepts of such theory, whether the issue is the maintenance of genetic variation (see the work of Turelli, for example) or the evolution of closely studied populations, as illustrated by this study. An alternative point of view that the authors should discuss is that such models are indeed NOT usually correct.

      It is very interesting that this reviewer feels that our data demonstrate that the prevailing model of polygenic adaptation is wrong, but our manuscript is still considered to be of insufficient novelty.

      6) There are alternative theoretical frameworks that address the maintenance of genetic variation and the response to selection. Among these are schemes of protected polymorphism arising from overdominance, epistasis, and frequency-dependent selection. If the thrust of the preceding point 4 is accepted, then it would be theoretically salient for the authors to suggest what type of underlying population genetic machinery would best account for their findings, in place of the noroptimal selection-mutation balance model.

      We thank the reviewer for these interesting suggestions. However, their predictions are not at all trivial to test. For this reason, generations of population geneticists tried to test them, so we feel that this task is well beyond the scope of this manuscript.

      Reviewer #3:

      In their manuscript 'The adaptive architecture is shaped by population ancestry and not by selection regime,' Otte and colleagues use an evolve and resequence strategy to examine the response of a Portugal population of D. simulans responds to cold temperature. The authors identify putative targets of selection and compare the number of targets, their location, and the distribution of selection coefficients to previous work on the same population exposed to hot temperatures as well as a different population exposed to hot temperatures. The topic is of general interest, the work is sound and the writing is clear and concise.

      1) It is not clear what the novel contribution of this manuscript is. The title indicates that the key finding is that population of origin mediates response to selection rather than the selection regime. However, the authors fail to provide compelling data to support that. The data are from 1 population under two selection regimes and a second population under one of those regimes. There simply aren't enough comparisons to infer that population ancestry plays a bigger role than selection regime in adaptive evolution.

      We disagree with the reviewer and would like to repeat the logic of our experiment:

      Comparison 1: contrast of different populations in the same environment -> different architecture

      Comparison 2: contrast of the same population in different environments -> same architecture

      With this simple design it is possible to reach the conclusion that the architecture is affected by population history more than by selection regime and no more populations are needed to reach this conclusion. This insight has not been reported before.

      2) The authors also seem to argue that a contribution of this paper is that it illustrates that temperature adaptation is not a single trait. This was the major finding of a 2014 paper from the same group in D. melanogaster- a single founder population was exposed to hot and cold temperatures and the authors found almost no overlap between the putatively selected variants in the two different temperature regimes.

      We would like to point out that the analysis of Tobler et al. (2014) is on the basis of individual SNPs, which is difficult to interpret because of the many segregating inversions in D. melanogaster. All the complications of these data and the implications for the interpretation can be found in the discussion of Tobler et al. (2014). In the current study, we are identifying selected haplotype blocks, which is mandatory to compare the architectures and selection responses.

      3) Beyond the limited impact of the current work, there are some additional specific issues. The authors note that it was 'remarkable' that the distribution of selection coefficients and the number of inferred selection targets between the hot and cold experiments was 'highly similar.' What is the null expectation? Where does the null come from?

      This is a minor semantic issue. Naturally, there is no null model for the number of selection targets, but if two populations selected for the same trait provide different architectures, different selection regimes should be even more likely to generate different architectures.

      4) The discussion is somewhat unsatisfying and largely speculative. The 'different trait optima' section reads as straw man; this could be reframed to better guide the reader.

      Naturally, the discussion intends to put the results in a broader context. It would have been helpful to read how s/he envisions a reframing that would improve the manuscript.

      There is little support for the 'differences in adaptive variation' hypothesis.

      It would have been helpful to read which kind of support the reviewer would have expected beyond the evidence we have already provided.

      The section on LD was interesting, but the simulation findings should reside in the results section.

      This could be easily moved, but we feel that it is well-placed in the discussion as we use the simulations to compensate for the lack of literature on this field (again demonstrating the novelty of our manuscript).

      References:

      Barghi, N., R. Tobler, V. Nolte, A. M. Jakšić, F. Mallard, K. A. Otte, M. Dolezal, T. Taus, R. Kofler, & C. Schlötterer (2019). Genetic redundancy fuels polygenic adaptation in Drosophila. PLOS Biology 17: e3000128.

      Barghi, N., J. Hermisson, & C. Schlötterer (2020). Polygenic adaptation: a unifying framework to understand positive selection. Nature Reviews Genetics . Berg, J.J., Harpak, A., Sinnott-Armstrong, N., Joergensen, A.M., Mostafavi, H., Field, Y., Boyle, E.A., Zhang, X., Racimo, F., Pritchard, J.K., et al. (2019). Reduced signal for polygenic adaptation of height in UK Biobank. Elife 8.

      Bergland, A. O., E. L. Behrman, K. R. O’Brien, P. S. Schmidt, & D. A. Petrov (2014). Genomic Evidence of Rapid and Stable Adaptive Oscillations over Seasonal Time Scales in Drosophila. PLoS Genetics 10, e1004775.

      Láruson, Á. J., S. Yeaman, & K. E. Lotterhos (2020). The Importance of Genetic Redundancy in Evolution. Trends in Ecology and Evolution 35: 809–822. Pritchard, J.K., Pickrell, J.K., and Coop, G. (2010). The genetics of human adaptation: hard sweeps, soft sweeps, and polygenic adaptation. Current biology : CB 20, R208-215.

      Sohail, M., Maier, R.M., Ganna, A., Bloemendal, A., Martin, A.R., Turchin, M.C., Chiang, C.W., Hirschhorn, J., Daly, M.J., Patterson, N., et al. (2019). Polygenic adaptation on height is overestimated due to uncorrected stratification in genome-wide association studies. Elife 8.

    1. Children have a right to pretend being dead and think about what it means

      This right really stood out to me as my children do talk a lot about death and, initially, I recognised feelings of discomfort within me when they did. I am continuing to learn how important it is for children to have the right to discuss or express topics which may sometimes be 'taboo' or just difficult, through words and play. I love that this is inside the charter. We read through the charter in class today!

    1. We have to limit fortunes. Our present plan is that we will allow no one man to own more that $50,000,000. We think that with that limit we will be able to carry out the balance of the program. It may be necessary that we limit it to less than $50,000,000. It may be necessary, in working out of the plans that no man’s fortune would be more than $10,000,000 or $15,000,000. But be that as it may, it will still be more than any one man, or any one man and his children and their children, will be able to spend in their lifetimes; and it is not necessary or reasonable to have wealth piled up beyond that point where we cannot prevent poverty among the masses.

      Huey P. Long's vision of wealth distribution was a bold proposition for his time. Especially after the onset of the great depression. I understand how he feels that wealth should be spread throughout the working classes however I feel he walks a fine line when regulating how someone can earn or spend their money. He refers often to the Deceleration of independence when mentioning the pursuit of happiness but how can one person limit another persons ability to earn money and still live by those words? Other forms of regulating such as higher taxes or creating laws to prevent monopolizing the market I think are a more reasonable approach than putting a cap on how much you can earn. Especially in a country which allows its people simple liberties such as earning a living with no government resistance.

    2. Now, we have organized a society, and we call it “Share Our Wealth Society,” a society with the motto “Every Man a King.” Every man a king, so there would be no such thing as a man or woman who did not have the necessities of life, who would not be dependent upon the whims and caprices and ipsi dixit [unproved assertion] of the financial barons for a living. What do we propose by this society? We propose to limit the wealth of big men in the country. There is an average of $15,000 in wealth to every family in America. That is right here today. We do not propose to divide it up equally. We do not propose a division of wealth, but we propose to limit poverty that we will allow to be inflicted upon any man’s family. We will not say we are going to try to guarantee any equality, or $15,000 to a family. No; but we do say that one third of the average is low enough for any one family to hold, that there should be a guarantee of a family wealth of around $5,000; enough for a home, an automobile, a radio, and the ordinary conveniences, and the opportunity to educate their children; a fair share of the income of this land thereafter to that family so there will be no such thing as merely the select to have those things, and so there will be no such thing as a family living in poverty and distress. We have to limit fortunes. Our present plan is that we will allow no one man to own more that $50,000,000. We think that with that limit we will be able to carry out the balance of the program. It may be necessary that we limit it to less than $50,000,000. It may be necessary, in working out of the plans that no man’s fortune would be more than $10,000,000 or $15,000,000. But be that as it may, it will still be more than any one man, or any one man and his children and their children, will be able to spend in their lifetimes; and it is not necessary or reasonable to have wealth piled up beyond that point where we cannot prevent poverty among the masses.

      Provides a response to the proposed issues mentioned in previous paragraph. Agrees that every man should be a king and not long for basic human needs. Proposes made fortunes made should be capped to allows equal playing field for generations to come. This appeals to his listeners and may establish support.

    3. We have to limit fortunes. Our present plan is that we will allow no one man to own more that $50,000,000. We think that with that limit we will be able to carry out the balance of the program. It may be necessary that we limit it to less than $50,000,000. It may be necessary, in working out of the plans that no man’s fortune would be more than $10,000,000 or $15,000,000. But be that as it may, it will still be more than any one man, or any one man and his children and their children, will be able to spend in their lifetimes; and it is not necessary or reasonable to have wealth piled up beyond that point where we cannot prevent poverty among the masses.

      I think Huey P. Long's heart was in the right place to try and eliminate poverty after the Great Depression. The "Every Man a King" plan seemed like a Robin Hood plan to take from the wealthy and give to the poor. No doubt every American deserves the right to life, liberty, and pursuit of happiness as described in the Declaration of Independence but that shouldn't be at the detriment of the more wealthy Americans. By allowing there to be a cap on the accumulated wealth of Americans only hurts the country as a whole. The American Dream would die with this type of Economic plan. Socialism and welfare could still be accomplished without limiting the success of other Americans.

    4. We have to limit fortunes. Our present plan is that we will allow no one man to own more that $50,000,000. We think that with that limit we will be able to carry out the balance of the program. It may be necessary that we limit it to less than $50,000,000. It may be necessary, in working out of the plans that no man’s fortune would be more than $10,000,000 or $15,000,000. But be that as it may, it will still be more than any one man, or any one man and his children and their children, will be able to spend in their lifetimes; and it is not necessary or reasonable to have wealth piled up beyond that point where we cannot prevent poverty among the masses.

      Long proposes to limit fortunes, he alluded to people hoarding, people having too much in stark contract with the rest living in poverty. Long said this not reasonable and it is a complete waste. Long's idea is to spread the wealth around. The rich has a tendency to amass more riches, while the poor gets deeper into poverty

    5. We have a marvelous love for this Government of ours; in fact, it is almost a religion, and it is well that it should be, because we have a splendid form of government and we have a splendid set of laws. We have everything here that we need, except that we have neglected the fundamentals upon which the American Government was principally predicated.

      Huey wants the government to be treated equally and everyone should get a share in the same pot. Even though he may sound bias, as putting his government thoughts ahead of what others think, he still wants equal rights for everyone. Even in present day, people are not created equal. Things are not shared equally, the rich gets richer and the poor gets poorer.

    6. Here is the whole sum and substance of the share-our-wealth movement: Every family to be furnished by the Government a homestead allowance, free of debt, of not less than one-third the average family wealth of the country, which means, at the lowest, that every family shall have the reasonable comforts of life up to a value of from $5,000 to $6,000. No person to have a fortune of more than 100 to 300 times the average family fortune, which means that the limit to fortunes is between $1,500,000 and $5,000,000, with annual capital levy taxes imposed on all above $1,000,000. The yearly income of every family shall be not less than one-third of the average family income, which means that, according to the estimates of the statisticians of the United States Government and Wall Street, no family’s annual income would be less than from $2,000 to $2,500. No yearly income shall be allowed to any person larger than from 100 to 300 times the size of the average family income, which means; that no person would be allowed to earn in any year more than from $600,000 to $1,800,000, all to be subject to present income-tax laws. To limit or regulate the hours of work to such an extent as to prevent overproduction; the most modern and efficient machinery would be encouraged, so that as much would be produced as possible so as to satisfy all demands of the people, but to also allow the maximum time to the workers for recreation, convenience, education, and luxuries of life. An old-age pension to the persons of 60. To balance agricultural production with what can be consumed according to the laws of God, which includes the preserving and storage of surplus commodities to be paid for and held by the Government for the emergencies when such are needed. … To pay the veterans of our wars what we owe them and to care for their disabled. Education and training for all children to be equal in opportunity in all schools, colleges, universities, and other institutions for training in the professions and vocations of life; to be regulated on the capacity of children to learn, and not on the ability of parents to pay the costs. Training for life’s work to be as much universal and thorough for all walks in life as has been the training in the arts of killing. The raising of revenue and taxes for the support of this program to come from the reduction of swollen fortunes from the top, as well as for the support of public works to give employment whenever there may be any slackening necessary in private enterprise.

      Huey Long had many good ideas. I liked his idea of a pension for people to retire at 60. This would be hard to achieve, with growing populations. I did like his idea of taking care of veterans and their disabled. I feel that this needs to be improved upon even today. I am a firm believer in education and access to it and liked Long's ideas for universal education of children and professional and vocational training access later. I think some of these ideas are great, but many do not like paying more in to provide for others.

    7. We have a marvelous love for this Government of ours; in fact, it is almost a religion, and it is well that it should be, because we have a splendid form of government and we have a splendid set of laws. We have everything here that we need, except that we have neglected the fundamentals upon which the American Government was principally predicated.

      Huey P. Long think that everyone should be treated equal regardless of their background. Whether you are poor, rich or in the middle. He think that the wealth should be spreaded to all types of people in all walks of life. If you are poor the the fortunate should share with you. That is not how the system work in america. If you are born into a family of riches and good fortune then yes you are a heir to their fortune. If you are born into poverty then yes you inherit poverty but you will be taught how to survive being less fortunate. Your family will teach you how to be independent as you get older. The rich just doesn't give away their fortune. They may give to the less fortunate through some type of organization. If you are born to the king and queen then yes you will inherit their fortune. If it is more than one siblings to the king and queen they are also included in the fortune. Money just don't grow on trees.

    8. We have to limit fortunes. Our present plan is that we will allow no one man to own more that $50,000,000. We think that with that limit we will be able to carry out the balance of the program. It may be necessary that we limit it to less than $50,000,000. It may be necessary, in working out of the plans that no man’s fortune would be more than $10,000,000 or $15,000,000. But be that as it may, it will still be more than any one man, or any one man and his children and their children, will be able to spend in their lifetimes; and it is not necessary or reasonable to have wealth piled up beyond that point where we cannot prevent poverty among the masses. …

      My over all take from reading both pieces is everyone should be equal and have some type of balance and structure. Why should one have so much, and the other so little.Why is it the more money you have the power it gives you.To treat others as if they are beneath you.Would if we all at the same opportunities as the next man. Look how are veterans are being treated after serving this country. I do believe if you work hard and were able to enjoy the fruits of your labor, but when you pass money does not go with you, especially if that money can help with children being hungry,people living on the streets, I don't feel a balance would benefit us as a society. I know myself I buy frivolous things all the time,and when asked if I want to donate to some charity sometime I will but majority I won't, this was a real eye opener, I don't feel we should all have the same things but it should be fair.

    9. We have to limit fortunes. Our present plan is that we will allow no one man to own more that $50,000,000. We think that with that limit we will be able to carry out the balance of the program. It may be necessary that we limit it to less than $50,000,000. It may be necessary, in working out of the plans that no man’s fortune would be more than $10,000,000 or $15,000,000. But be that as it may, it will still be more than any one man, or any one man and his children and their children, will be able to spend in their lifetimes; and it is not necessary or reasonable to have wealth piled up beyond that point where we cannot prevent poverty among the masses.

      The thing about “limiting” fortunes is that there is always going to be a loophole. Offshore accounts or something similar to that or them putting assets in other people’s names like their newborn children or some relative. To me it does not seem achievable.

    10. I now ask those who read this circular to help us at once in this work of giving life and happiness to our people — not a starvation dole upon which someone may live in misery from week to week. Before this miserable system of wreckage has destroyed the life germ of respect and culture in our American people let us save what was here, merely by having none too poor and none too rich. The theory of the Share Our Wealth Society is to have enough for all, but not to have one with so much that less than enough remains for the balance of the people.

      Reading this made me think about the current situation we are facing today. I understand that billionaires earned their money, but to have that much money is outrageous. I also understand that it is their money, and they can use it however they want but, I do not think that this is fair. They do not get taxed as we do. For instance, the CEO of Amazon is worth $185 billion. He and other billionaires could literally donate 1% of their wealth, and cover the very needed PPE’s, education, etc. A lot of billionaires have the power to eradicate homelessness and other problems in America, but I believe that they are selfish and greedy. As stated previously, it is their money and they could do anything desired however, there should be no room for an individual to accumulate that much wealth. With this whole COVID-19 issue, many businesses shut down except the big corporations. These corporations made billions from a pandemic, which is insane. A lot of people lost their livelihood and jobs yet these corporations made bank from it, which shows the uneven wealth distribution.

      Regarding the past, I can see where Huey Long is coming from. The wealth distribution at that time seemed to be unfairly distributed. He wants the non-wealthy individuals to obtain the same opportunities rich people could get such as education. The only part I do not agree with Huey Long is the having a complete balance of middle class. There would be no room for progression and development. Everybody would be paid the same regardless of what education level and status. What I got from this was a cashier could make the same as a doctor. I think the balance of poor and rich is necessary but, I do not agree with super wealthy individuals (billionaires).

    11. We have to limit fortunes. Our present plan is that we will allow no one man to own more that $50,000,000. We think that with that limit we will be able to carry out the balance of the program. It may be necessary that we limit it to less than $50,000,000. It may be necessary, in working out of the plans that no man’s fortune would be more than $10,000,000 or $15,000,000. But be that as it may, it will still be more than any one man, or any one man and his children and their children, will be able to spend in their lifetimes; and it is not necessary or reasonable to have wealth piled up beyond that point where we cannot prevent poverty among the masses.

      On paper, this is an excellent concept and something that I think everyone would love to see. Why does any one person need that much money? Why does this concept not work? Why isn't this the standard? If everyone could just sit at home watching TV and having money dropped off, why would anyone work? One major reason is that without incentive, no one would work and there would be no wealth to redistribute. You also gain more than just money from accomplishing something yourself. You build values and morals. You create self worth. Without that, who are you?

    12. It is impossible for the United States to preserve itself as a republic or as a democracy when 600 families own more of this Nation’s wealth—in fact, twice as much—as all the balance of the people put together. Ninety-six percent of our people live below the poverty line, while 4 percent own 87 percent of the wealth. America can have enough for all to live in comfort and still permit millionaires to own more than they can ever spend and to have more than they can ever use; but America cannot allow the multimillionaires and the billionaires, a mere handful of them, to own everything unless we are willing to inflict starvation upon 125,000,000 people.

      Huey Long makes some valid and strong points that still hold true till this day. For example, although we are a Constitutional republic, currently, one percent of people own thirty eight percent of our entire nation's wealth. I think Huey Long presents some socialistic ideals throughout his two speeches, but I think his overall goal was to take money from the very wealthy that earned exorbitant amounts of wealth and distribute that wealth to those that needed it most, to make our country's people stronger and make our country's distribution of wealth more just. Fast forward to present day. The pandemic has crushed many small businesses, that the American economy greatly relies on and yet other large corporations have made huge exponential financial gains because of the pandemic and increased online consumerism. Unemployment rate in the coming months may exceed eleven percent, meaning that 1 in 8 U.S. workers will not have a viable job. Instead of letting big businesses get richer with billions of dollars, or tax payers funding stimulus payments that our children and our children's children will be paying off huge national debt in years to come, why not have the elite business owners donate some of their excessive wealth for the better of other U.S. citizens. After all, it is the U.S. citizens that through consumerism made them billionaires in the first place. Mr. Long did have a good point in my opinion. These companies deserve their wealth for what they created, but I think they should give back some of it to help sustain our economy which will enable them to keep prospering in the long haul and help U.S. citizens that are in or will soon be in dire need of financial help.

    13. We have to limit fortunes. Our present plan is that we will allow no one man to own more that $50,000,000. We think that with that limit we will be able to carry out the balance of the program. It may be necessary that we limit it to less than $50,000,000. It may be necessary, in working out of the plans that no man’s fortune would be more than $10,000,000 or $15,000,000. But be that as it may, it will still be more than any one man, or any one man and his children and their children, will be able to spend in their lifetimes; and it is not necessary or reasonable to have wealth piled up beyond that point where we cannot prevent poverty among the masses.

      You have to pause for a moment to consider the impact this would have on America's middle class -- people would be free to pursue entrepreneurship in businesses about which they are passionate, people would be able to change careers without the fear of bankrupting themselves. This would create a lot of movement in the middle class and class mobility.

    14. We have to limit fortunes. Our present plan is that we will allow no one man to own more that $50,000,000. We think that with that limit we will be able to carry out the balance of the program. It may be necessary that we limit it to less than $50,000,000. It may be necessary, in working out of the plans that no man’s fortune would be more than $10,000,000 or $15,000,000. But be that as it may, it will still be more than any one man, or any one man and his children and their children, will be able to spend in their lifetimes; and it is not necessary or reasonable to have wealth piled up beyond that point where we cannot prevent poverty among the masses.

      So again, this passage sounds very socialist in nature. My question is How exactly would you go about making this a reality? It kind of makes me think of politics today. I won't lie, I like the idea Bernie Sanders proposed with regard to getting rid of all the student debt. While that would benefit me as an individual, I understand why some people were very much against it. The same question I had for him, that I have for Huey Long is: How would you make this work? For the people who had mountains of debt, but found a way to pay them off, would you give them some money back for their troubles? I think the idea of making sure everyone gets a fair chance is amazing- in theory. In reality, I don't think it's that simple.

    15. We have to limit fortunes. Our present plan is that we will allow no one man to own more that $50,000,000. We think that with that limit we will be able to carry out the balance of the program. It may be necessary that we limit it to less than $50,000,000. It may be necessary, in working out of the plans that no man’s fortune would be more than $10,000,000 or $15,000,000. But be that as it may, it will still be more than any one man, or any one man and his children and their children, will be able to spend in their lifetimes; and it is not necessary or reasonable to have wealth piled up beyond that point where we cannot prevent poverty among the masses. …

      So it's very interesting that he starts at 50 million and by the end lands 10-15 million and later even lower. When you can start limiting others money and spend their money by taxing it's easy to limit money.

    16. We have to limit fortunes. Our present plan is that we will allow no one man to own more that $50,000,000. We think that with that limit we will be able to carry out the balance of the program. It may be necessary that we limit it to less than $50,000,000. It may be necessary, in working out of the plans that no man’s fortune would be more than $10,000,000 or $15,000,000. But be that as it may, it will still be more than any one man, or any one man and his children and their children, will be able to spend in their lifetimes; and it is not necessary or reasonable to have wealth piled up beyond that point where we cannot prevent poverty among the masses.

      This is a very interesting idea from Huey Long. It could be that the reason for this is that he was born in the poor north of Louisiana before he gained education, money and fame. He proposed to make things equal for everyone and mentioned that people should not have more than what they will need to provide for themselves and their families. This according to him will prevent poverty with the entire population

    17. We have to limit fortunes. Our present plan is that we will allow no one man to own more that $50,000,000. We think that with that limit we will be able to carry out the balance of the program. It may be necessary that we limit it to less than $50,000,000. It may be necessary, in working out of the plans that no man’s fortune would be more than $10,000,000 or $15,000,000. But be that as it may, it will still be more than any one man, or any one man and his children and their children, will be able to spend in their lifetimes; and it is not necessary or reasonable to have wealth piled up beyond that point where we cannot prevent poverty among the masses.

      He believes that if ones wealth is limited to 50,000 so that there will be plenty of money to go around for everyone, and if there isn't enough to go around then ones wealth might need to be lowered. He is saying why should one have so much money just sitting there piled up while people are going without. He believes that is not helping out one another with wealth just sitting there being unused.

    18. We have to limit fortunes. Our present plan is that we will allow no one man to own more that $50,000,000. We think that with that limit we will be able to carry out the balance of the program. It may be necessary that we limit it to less than $50,000,000. It may be necessary, in working out of the plans that no man’s fortune would be more than $10,000,000 or $15,000,000. But be that as it may, it will still be more than any one man, or any one man and his children and their children, will be able to spend in their lifetimes; and it is not necessary or reasonable to have wealth piled up beyond that point where we cannot prevent poverty among the masses

      This was part of Huey P. Long's plan of sharing the wealth in America. He was suggesting a plan to limit the amount of money an individual had to have. Setting a cap would have enabled the distribution of wealth among people by taking money from the rich and distributing. He believed that the few rich people had accumulated a lot of wealth piled up while the majority of Americans were living in poverty.

    1. Reviewer #2:

      This paper reports a thorough critique of the ABCD stop-signal data set. It identifies a set of eight problems that severely limits the utility of the ABCD stopping data. In particular, the first two (which are essentially the same problem) invalidate estimates of SSRT based on the independent race model because of violations of the context independence assumption of that model. The remaining issues are more minor in the sense that while potentially problematic they either affect a very small percentage of the data and so can be dealt with by removing the affected trials or participants, or do not appear to be problematic in practice.

      The authors have provided a valuable service to the research community in systematically and thoroughly cataloguing these issues, although we think it is fair to say that a number of people (including the present reviewers) have been aware of the key design issue caused by the stop signal replacing the go signal for quite some time and have been working on solutions.

      Below we have a few suggestions for clarifications, but overall the paper is very clear and well written.

      Although the paper mentions that "new models for stopping must be developed to accommodate context dependence (Bissett et al., 2019), the latter of which we consider to be of utmost importance to advancing the stop-signal literature", it does not discuss such models and neither does it show the potentially severe consequences of context independence violations in the ABCD data set.

      All our more substantive comments relate to "Retroactive Suggestions For Issue 1". First, the authors write: "Given the above, if analyzing or disseminating existing ABCD stopping data, we would recommend caution in drawing any strong conclusions from the stopping data, and any results should be clearly presented with the limitation that the task design encourages context dependence and therefore stopping behavior (e.g., SSRT) and neuroimaging contrasts may be contaminated".

      We feel that this recommendation is too lenient and would suggest the following alternative: Unless the ABCD community conclusively shows that the design flaw does not distort conclusions based on SSRT estimates (or any other stop-signal measure), researchers should not use the ABCD data set to estimate SSRTs at all.

      Second, the authors suggest removing subjects who have severe violations as evidenced by mean stop-failure RT > mean no-stop-signal RT. We are concerned that this recommendation impacts on the representativeness of the sample. Also, this recommendation ignores the fact that violations are not an all-or-none phenomenon but are a matter of degree and can come in varying shapes and sizes.

      Third, the authors recommend that "any results be verified when only longer SSDs are used, perhaps only SSDs > 200ms". Figure 3 does not seem to support the recommended cut-off of 200ms: at 200ms accuracy is still far from asymptotic.

      In general, we feel that recommendations based on removing participants and trials are not sufficient. Such practices will affect the representativeness of the sample and will increase estimation uncertainty and hence decrease power. We believe that the only way to solve Issue 1 is by developing measurement models that can account for the dependence of the go and the stop process.

    1. In that case, we might want to think about how one clarification or another might affect our assessment.  We can specify in our assessment that we support the argument if it means what we think it means but not if it means something else.

      Not too clear. What do you mean by "one clarification or another?" Do you mean a clarification needed in a side point as opposed to a central point? And how does the next sentence follow? This last sentence in the little paragraph doesn't seem to have to do with the first. Are the three sentences three different examples of how the problem may not be too serious? In that case, you have to make that clearer.

    1. On the third day Abraham looked up and saw the place far away.

      I would imagine that on a long, excruciating journey, Abraham could have been suffering silently. Trying to make peace with sacrificing your child is a heavy weight to carry, aside from the material weight of their supplies. Additionally, if we view Abraham’s silence as obedience, I think it’s important to remember that obeying a command and trusting the one who gave it to you are different things. Abraham’s actions may have more to do with his relationship to God than his true feelings.

    1. What hap-pens in practice is evidence of this: we take delight in viewing the most accurate possible in1ages of objects which in then1s~lves cause distress when we see them (e.g. the shapes of the lowest species of 6 3,2 EARLY.HISTORY animal, and corpses)

      At first I had trouble understanding Aristotle's point here. Then, after one or two rereads I didn't think this take remained true today, mainly because I was so hung up on the idea of taking delight in imitations of objects that cause us "distress." My initial thought was that nobody would like replications or pictures of images they don't like, but the more I thought about it I've realized that our society may actually have a fascination with replications of distressing objects. The best example that came to mind was how prolific images of skulls are in our world today. While a real life skull, with the exception of being seen in museums or even class rooms for historical/educational purposes, would be offputing to many, replications of skulls have become increasingly popularized. From skulls being popular images as jewelry, to popular halloween decorations/costumes, to being used in hazard/warning signs, skull imagery can be seen everywhere, today. While this is only one example (another prominent example that comes to mind is how gruesome cartoons can be, which people like, even though the real life image wouldn't be appealing), I found it fascinating how this claim has remained so true throughout history.

    1. “moral education”

      <br>

      Analytic notes:

      The primacy of moral education in the design of the French primary school system is evidenced in the writings of Francois Guizot, the French Minister of Education who during the July Monarchy drafted the 1833 Loi that established, for the first time, a centrally-controlled system of primary schools, with a centralized curriculum and primary school teachers trained and recruited according to central government directives. The centrality of moral education as a motivation to centralize the control and expand the provision of primary schooling in France is also discussed by Weber (1976). The 1833 Loi is especially important because it was followed by the fastest expansion of primary schooling observed in French history (Grew and Harrigan 1991).

      That the Prussian primary school system focused mainly on moral and religious education was perceived to be true among those who admired and those who criticized Prussian schools. Among the admirers was Horace Mann, a U.S. education reformer who played a key role in the development of a system of common schools in Massachusetts during the 1830s and 40s. Mann devoted two of the twelve Annual Reports he wrote as Secretary of the Massachusetts Board of Education entirely to the importance of moral education. He highlighted Prussia as an example of an education system that shapes moral values. The Prussian emphasis on moral and religious education noticed by Mann continued to prevail at the beginning of the 20th century according to Thomas Alexander, a professor at the George Peabody College of Teachers who spent between 1912 and 1913 studying Prussian schools directly as the basis for his book The Prussian Elementary Schools, published in 1919.

      Source excerpts:

      In an essay discussing the perceived benefits of the 1833 Loi, Guizot (1860) writes: “The state must provide primary education to all families and give it to those who cannot afford it; and in this he does more for the moral life of peoples than he can do for their material condition. This is the true principle on this point, and it was the one adopted by my bill.” (p. 63-64) “Primary education is not a panacea which cures all the moral maladies of the people . . . ; it is a salutary or harmful power according to whether it is well or badly directed and contained within its limits or pushed out of its mission. . . . The law of June 28, 1833, has received various modifications . . .; but all its principles, all its essential dispositions, have remained upright and in force. Founded by this law, primary education is now, among us, a public institution and an acquired fact. There remains, surely, much to be done for the good government of the schools, to make it dominant in their bosom the influences of religion and order, of faith and law, which make both the dignity and the safety of a people.” (p.86)

      And continues: “If it is true that the attachment of the citizens to the fundamental laws of the state and to the sovereign who is its leader, is the most energetic power and surest safeguard of society, if it is true that there where this feeling has existed, it has produced miracles, and that its absence has brought about the greatest evils, it is the duty as well as the interest of the government to favor and direct its development. But this feeling can only arise from the concordance of public doctrines and national habits with political institutions, the nature and principles of government. . . . When men have learned from childhood to understand the fundamental laws of the country and to respect its sovereign, the sovereign and the laws become a kind of property which is dear to them, and they do not refuse the obligations that it imposes upon them: when the government has taken care to propagate, in favor of national education, in the relations of religion, morality, politics, etc., the doctrines which suit his nature and his direction, these doctrines soon acquire a power against which come the failures of liberty of mind and all seditious attempts. Thus the public mind is formed, thus a true patriotism is maintained, thus fortifying and consolidating societies and thrones.” (Guizot 1860, 86).

      Weber (1976, 329): “Official reports coupled poor education with rude, brutal ways. Where schooling did not take hold, ‘ways are coarse, characters are violent, excitable, and hotheaded, troubles and brawls are frequent.’ The school was supposed to improve manners and customs, and soothe the savage breast. The polite forms it inculcated ‘softened the savagery and harshness natural of peasants.’ Improved behavior and morality would be attributed to the effects of schooling.”

      Mann (1844, 22): “If Prussia can pervert the benign influence of education to the support of arbitrary power, we surely can employ them for the support and perpetuation of republican institutions… If a moral power over the understandings and affections of the people may be turned to evil, may it not also be employed for good?”

      Alexander (1919, v): “A careful study of the Prussian school system will convince any unbiased reader that the Prussian citizen cannot be free to do and act for himself; that the Prussian is to a large measure enslaved through the medium of his school; that his learning, instead of making him his own master, forges the chain by which he is held in servitude; that the whole scheme of Prussian elementary education is shaped with the express purpose of making ninety-five out of every hundred citizens subservient to the ruling house and to the state.”

      In a later chapter that focuses on the curriculum and teaching methods, Alexander refers to the influential ideas of Johann Friedrich Herbart, a German philosopher, psychologist and educator, author of The Moral or Ethical Revelation of the World: The Chief Aim of Education (1804), and Prussian commissioner of education. Alexander (1919, 258) writes that “With Herbart and his followers, the aim and end of instruction was the formation of moral and religious character. It was not Herbart’s intention merely to furnish the child with a definite number of concepts by the form and content of the instruction and subject matter, but rather to shape thereby the will and directly to affect the moral nature and attitude of the child.”

      In the conclusion, Alexander (1919, 540) writes: “Chief among the avowed aims of the Volksschule is the formation of moral and religious character. There is no doubt that the reason religion is made one of the chief subjects of instruction in the elementary schools is to teach the lesson of obedience to authority which is the basis of the German state.” And continues, “There are then leaders and followers. The leaders think and do; the followers merely do. The schools are organized for the express purpose of producing just these types . . . They educate the individual for the state; we [Americans] make the state for the individual. The lesson to learn here is this. The German sets definitely his national aims. Those in authority shape every resource to reach that goal. The schools were molded to meet the needs of the state.” (Alexander 1919, 538-39).

      Full citations:

      Alexander, Thomas. 1919. The Prussian elementary schools. New York: The Macmillan company.

      Grew, Raymond, and Patrick J. Harrigan. 1991. School, state, and society: the growth of elementary schooling in nineteenth-century France: a quantitative analysis. Ann Arbor: University of Michigan Press.

      Guizot, Francois. 1860. Memoires pour servir a l'histoire de mon temps, T.3. Paris: Michel Levy freres.

      Mann, Horace. 1844. Seventh Annual Report on the Board of Education. Boston.

      Weber, Eugen. 1976. Peasants into Frenchmen: The Modernization of Rural France, 1870-1914. Stanford, California: Stanford University Press.

    2. “moral education”

      <br>

      Analytic notes:

      The primacy of moral education in the design of the French primary school system is evidenced in the writings of Francois Guizot, the French Minister of Education who during the July Monarchy drafted the 1833 Loi that established, for the first time, a centrally-controlled system of primary schools, with a centralized curriculum and primary school teachers trained and recruited according to central government directives. The centrality of moral education as a motivation to centralize the control and expand the provision of primary schooling in France is also discussed by Weber (1976). The 1833 Loi is especially important because it was followed by the fastest expansion of primary schooling observed in French history (Grew and Harrigan 1991).

      That the Prussian primary school system focused mainly on moral and religious education was perceived to be true among those who admired and those who criticized Prussian schools. Among the admirers was Horace Mann, a U.S. education reformer who played a key role in the development of a system of common schools in Massachusetts during the 1830s and 40s. Mann devoted two of the twelve Annual Reports he wrote as Secretary of the Massachusetts Board of Education entirely to the importance of moral education. He highlighted Prussia as an example of an education system that shapes moral values. The Prussian emphasis on moral and religious education noticed by Mann continued to prevail at the beginning of the 20th century according to Thomas Alexander, a professor at the George Peabody College of Teachers who spent between 1912 and 1913 studying Prussian schools directly as the basis for his book The Prussian Elementary Schools, published in 1919.

      Source excerpts:

      In an essay discussing the perceived benefits of the 1833 Loi, Guizot (1860) writes: “The state must provide primary education to all families and give it to those who cannot afford it; and in this he does more for the moral life of peoples than he can do for their material condition. This is the true principle on this point, and it was the one adopted by my bill.” (p. 63-64) “Primary education is not a panacea which cures all the moral maladies of the people . . . ; it is a salutary or harmful power according to whether it is well or badly directed and contained within its limits or pushed out of its mission. . . . The law of June 28, 1833, has received various modifications . . .; but all its principles, all its essential dispositions, have remained upright and in force. Founded by this law, primary education is now, among us, a public institution and an acquired fact. There remains, surely, much to be done for the good government of the schools, to make it dominant in their bosom the influences of religion and order, of faith and law, which make both the dignity and the safety of a people.” (p.86)

      And continues: “If it is true that the attachment of the citizens to the fundamental laws of the state and to the sovereign who is its leader, is the most energetic power and surest safeguard of society, if it is true that there where this feeling has existed, it has produced miracles, and that its absence has brought about the greatest evils, it is the duty as well as the interest of the government to favor and direct its development. But this feeling can only arise from the concordance of public doctrines and national habits with political institutions, the nature and principles of government. . . . When men have learned from childhood to understand the fundamental laws of the country and to respect its sovereign, the sovereign and the laws become a kind of property which is dear to them, and they do not refuse the obligations that it imposes upon them: when the government has taken care to propagate, in favor of national education, in the relations of religion, morality, politics, etc., the doctrines which suit his nature and his direction, these doctrines soon acquire a power against which come the failures of liberty of mind and all seditious attempts. Thus the public mind is formed, thus a true patriotism is maintained, thus fortifying and consolidating societies and thrones.” (Guizot 1860, 86).

      Weber (1976, 329): “Official reports coupled poor education with rude, brutal ways. Where schooling did not take hold, ‘ways are coarse, characters are violent, excitable, and hotheaded, troubles and brawls are frequent.’ The school was supposed to improve manners and customs, and soothe the savage breast. The polite forms it inculcated ‘softened the savagery and harshness natural of peasants.’ Improved behavior and morality would be attributed to the effects of schooling.”

      Mann (1844, 22): “If Prussia can pervert the benign influence of education to the support of arbitrary power, we surely can employ them for the support and perpetuation of republican institutions… If a moral power over the understandings and affections of the people may be turned to evil, may it not also be employed for good?”

      Alexander (1919, v): “A careful study of the Prussian school system will convince any unbiased reader that the Prussian citizen cannot be free to do and act for himself; that the Prussian is to a large measure enslaved through the medium of his school; that his learning, instead of making him his own master, forges the chain by which he is held in servitude; that the whole scheme of Prussian elementary education is shaped with the express purpose of making ninety-five out of every hundred citizens subservient to the ruling house and to the state.”

      In a later chapter that focuses on the curriculum and teaching methods, Alexander refers to the influential ideas of Johann Friedrich Herbart, a German philosopher, psychologist and educator, author of The Moral or Ethical Revelation of the World: The Chief Aim of Education (1804), and Prussian commissioner of education. Alexander (1919, 258) writes that “With Herbart and his followers, the aim and end of instruction was the formation of moral and religious character. It was not Herbart’s intention merely to furnish the child with a definite number of concepts by the form and content of the instruction and subject matter, but rather to shape thereby the will and directly to affect the moral nature and attitude of the child.”

      In the conclusion, Alexander (1919, 540) writes: “Chief among the avowed aims of the Volksschule is the formation of moral and religious character. There is no doubt that the reason religion is made one of the chief subjects of instruction in the elementary schools is to teach the lesson of obedience to authority which is the basis of the German state.” And continues, “There are then leaders and followers. The leaders think and do; the followers merely do. The schools are organized for the express purpose of producing just these types . . . They educate the individual for the state; we [Americans] make the state for the individual. The lesson to learn here is this. The German sets definitely his national aims. Those in authority shape every resource to reach that goal. The schools were molded to meet the needs of the state.” (Alexander 1919, 538-39).

      Full citations:

      Alexander, Thomas. 1919. The Prussian elementary schools. New York: The Macmillan company.

      Grew, Raymond, and Patrick J. Harrigan. 1991. School, state, and society: the growth of elementary schooling in nineteenth-century France: a quantitative analysis. Ann Arbor: University of Michigan Press.

      Guizot, Francois. 1860. Memoires pour servir a l'histoire de mon temps, T.3. Paris: Michel Levy freres.

      Mann, Horace. 1844. Seventh Annual Report on the Board of Education. Boston.

      Weber, Eugen. 1976. Peasants into Frenchmen: The Modernization of Rural France, 1870-1914. Stanford, California: Stanford University Press.

    1. Reviewer #3:

      General assessment:

      In this research article, authors claim that HIP1 plays an important role in promoting the proliferative ability of prostate cancer cells by HIP1-STAT3-GDF15 signaling axis activation. HIP1 overexpression increased STAT3 signaling in response to FGF2 receptor activation and increased GDF15 transcription. The increase in GDF15 protein secretion was dependent on HIP1 and STAT3 expression and was shown to have paracrine growth-promoting effects. Although some of the information is new, the relevance and importance of this information is inconclusive and not supported from the data presented in this article.

      Major Comments:

      This paper needs a substantial amount of revision, as indicated below.

      A. Novelty:

      HIP-1 has been extensively studied in cancer including prostate cancer (Rao et al., 2002). Its role in STAT3 signaling has also been demonstrated (Hsu et al, 2015). This study is not very novel.

      B. Major comments:

      1) Figures 1A, S1: Changes in p-AMPK1α, and p-Akt are very profound in this array, however, the authors indicate that "By contrast to our validation of STAT3 phosphorylation by Western blotting, it was not possible to detect increased levels of p-AMPK1α (T174), p-Akt (S473) or p-PLC-γ1 when we attempted to validate these by blotting (Supplementary Figure S1D-F)." Why do the authors think this is happening? Did the authors use the same experimental conditions for the array and validation experiments? These apparent discrepancies need further clarification.

      2) Figure 1E: the authors show that shHIP1#2 caused a modest knockdown of HIP1, while shHIP1#1 induced a dramatic reduction in HIP1 protein level, however, both the shRNAs significantly inhibited pSTAT3 to the same extent. This indicates that total knockdown (KD) of HIP1 is not necessary to completely shut-down the activity of pSTAT3. How does this translate to the biological functions of HIP1?

      3) How come DMSO treatment blocks the phosphorylation of ERK1/2 in lane 2 of Fig 1(F)?

      4) Figure S1F: pSTAT3 western blot: the authors should indicate which band they considered positive for p-STAT3; if it's the lower band why was there no activity in lane 4?

      5) Fig 2A and 2B should be repeated in HIP1 knockout cells.

      6) What is the endogenous level of HIP1 and GDF15 in prostate cancer cell lines vs. normal prostate epithelial cells? Why was HIP1 overexpressed in LNCaP cells? Was the level of HIP1 expression low in LNCaP and PNT1A, when compared in a panel of prostate cancer cell lines? Did the authors observe any differential expression of HIP1 and GDF15 in hormone sensitive vs. hormone resistant prostate cancer cells?

      7) GDF15 is a very ambiguous biomarker of cancer as its levels are even higher in the case of mental disorders including psychosis (for reference https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5554200/ ). And from this study, it is not even clear that the GDF15 upregulation is just one of the several outcomes of the activation of this signaling axis or if it is the only consequence of this signaling axis to promote the growth of cancer cells by increasing paracrine signaling. An experiment in GDF15 knockout cells/mice can document the role of this axis in a more precise manner.

      8) It has been shown that wt p53 significantly reduces STAT3 tyrosine phosphorylation and inhibits STAT3 DNA binding activity in prostate cancer cell lines that express both constitutively active STAT3 and mutant p53 protein. The authors have claimed that the increase in STAT3 phosphorylation is due to HIP1 expression. All three of the cell lines evaluated in this paper have different p53 status and show differences in expression of activated STAT3. Is the expression of HIP1 independent of the status of p53?

      9) Figure 3: Does STAT3 silencing (siRNA/stattic) downregulate HIP1, and does this decrease STAT3 activation over time? Also, does STAT3 silencing or treatment with WP1066 inhibit HIP1-induced tumor growth in vivo?

      10) The role of GDF15 in prostate cancer is likely stage specific. It may promote early stages of tumorigenesis, but suppress the progression of advanced prostate cancers. The authors claim that HIP1 overexpression is mediated by stat3 activation, which leads to increased secretion of GDF15. Does expression of HIP1 correlate with the expression of GDF15 and does this also associate with stage-specific progression of prostate cancer?

      11) How was cellular transformation studied and confirmed? Did HIP1 cause transformation of normal prostate cells?

      12) Fig 1B: HIP1 western blot is not clear, please quantify 1C, 1D, 1E.

      13) Most of the studies are done only in one cell line which is not adequate.

      14) What is the clinical relevance of this study? The authors should study clinical samples along with multiple cell lines.

      15) Several of the Western blot figures need better quality blots; Figs 1E (FGFR), S2C (all).

    1. Bacon says we live through screens. What are these screens? They are part of our normal way of looking at the world, or rather our normal way of seeing the world without looking at it, for Bacon’s claim is that a real seer who looked at the world would notice it to be fairly violent—not violent as narrative surface but somehow violently composed underneath the surface, having violence as its essence

      Bacon's perspective on the world is illustrated through his philosophical belief of living through screens. A screen can be utilized as a divider, but also something one may look through, similar to glass. Based on environmental conditions and/or state of the glass, it can either be transparent, opaque, or cracked. Those who innocently perceive the world are divided from the rest of the corrupt world, not being able to clearly see through the glass/screen. Unlike the normal way of seeing the world, "real seers" can see through the glass/screen clearly. The perspective is based on the conditions one lived through, causing their glass to be transparent or opaque. Do you think the idea of a screened existence is accurate? Why or why not?

    2. Bacon has another term for this catastrophizing: he calls it “destroying clarity with clarity.”(8) Not just in his use of color but in the whole strategy of his compositions, he wants to make us see something we don’t yet have eyes for. He goes inside clarity to a place of deeper refreshment, where clarity is the same and yet differs from itself, which may be analogous to the place inside a word where it falls silent in its own presence

      Bacon "destroys clarity with clarity" by going into depth of the compositions. He does this by not just going through what people can see, such as the "colors", but he goes into a deeper meaning by exaggerating all the points to get his message across. I think Bacon chooses to do this because he wants people to think about the underlying message that he is trying to bring across and have people think more deeply about the meaning. How does Bacon give new perspective to people?

    1. “Hear me, illustrious children of Earth and Sky, 645 that I may speak what my spirit within my breast prompts me to speak. For now a very long space we are fighting, each in opposition to other, concerning victory and power, all our days, the Titan gods and as many of us are sprung from Kronos. 650 Now you must show against the Titans in deadly fight both mighty force and hands invincible, in gratitude for our mild loving-kindness, namely, after how many sufferings you came back again to the light, from afflictive bondage, through our counsels, from the murky gloom.”

      I think it's really interesting how each god/goddess was born with their personality traits, alongside their powers. Here, we witness that Zeus is a natural-born leader, from his radiating confidence through this speech to the instinct to lead the other gods into a fight and into victory. It seemed fit that he should take place as rulers of the heavens.

    2. length the father of gods and men addressed them: “Hear me, illustrious children of Earth and Sky, 645 that I may speak what my spirit within my breast prompts me to speak. For now a very long space we are fighting, each in opposition to other, concerning victory and power, all our days, the Titan gods and as many of us are sprung from Kronos. 650 Now you must show against the Titans in deadly fight both mighty force and hands invincible, in gratitude for our mild loving-kindness, namely, after how many sufferings you came back again to the light, from afflictive bondage, through our counsels, from the murky gloom.” Thus he spoke; and him in turn blameless Kottos addressed in answer

      I think it's pretty cool to see that these gods are in many ways like humans. Their fight for justice, for fair treatment in the face of tyranny has been seen all throughout human history. This passage actually reads as a "pep talk" or a speech to rally the troops and to build camaraderie with one another.

    1. This is a very strong case. Grant Torquemada his premises, and the conclusion follows irresistibly that torturing and burning people may be a duty and a kindness. You can hardly say he was a wicked man for living up more courageously than others to what he and they believed in common, or for acting sincerely in what he believed to be the interest of his victims. We cling, nevertheless, to our conviction that he did wrong, and atrocious wrong. And the question presses more urgently than before, where does the wrongness lie?

      Very interesting perspective -- this reminded me of Donald Trump and what people reference as the 'silent majority'. I think that where the wrongness lies can be subjective based on morals; some people are willing to overlook more controversial choices than others are which is where a divide is created

    Annotators

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reviewer #1 (Evidence, reproducibility and clarity (Required)):

      The manuscript describes two advances. First is the technical development for a protein targeting system called PInT that brings a target protein close to (~320 bp) a DNA sequence of interest. The idea is that localisation of the target protein allows one to distinguish its effects on the DNA sequence either in cis (when targeted) or in trans (when not targeted but expressed at the same level). Since targeting is conveyed by simply adding the small molecule ABA to the experiment, it is easy to compare the two situations. This is a clever idea and it is substantiated by data showing that the components of PInT do not affect triplet repeat instability or gene expression of GFP, into whose gene the PInT system is placed. Moreover, targeting is shown to enable enzymatic activity in the targeted region. Using the DNA methylase DNMT1, there are local increases in DNA methylation. Similarly, targeting the histone deacetylase HDAC5 results in local decreases in histone H3 acetylation.

      We thank the reviewer for a thoughtful and helpful review.

      What is not clear from these experiments, however, is whether the targeted proteins can interact normally with partner proteins to form functional complexes. One necessary control is to add ChIP for at least one interacting protein each for DNMT1 and for HDAC5 and show that targeting permits normal protein-protein interactions. This experiment is straightforward as specific interacting proteins are known and good antibodies to precipitate those proteins are available.

      This is a good suggestion and we plan on doing this experiment in our 59B-Y-HDAC5 and 89B-Y-DNMT1 lines with and without ABA using interacting proteins. The exact interacting protein to be used will depend on the antibodies availability and quality, which we will test. We will start with UHRF1 and HDAC3 for PYL-Dnmt1 and PYL-HDAC5, respectively.

      Overall, PInT would likely be useful for many groups studying the effects of chromatin modifiers on a DNA sequence of interest.

      The second advance is conceptual and is focused more specifically on triplet repeat expansions. The manuscript describes experiments that measure genetic instability of long CAG-CTG repeats with and without protein targeting. The results show that allele size distributions are not significantly affected by targeting either DNMT1 or HDAC5. One curious outcome that is not discussed is contraction frequency in the HDAC5 experiment. Zero contractions are reported compared to 10-20% contractions in the other two experiments. Authors need to provide an explanation.

      Lack of contractions in this experiment is likely due to the lower number of repeats in this line (59 vs 89/91). It is known that longer repeats display higher frequency of contractions, and contractions are rarely seen in short repeats (Larson et al Neurobiology of Disease 2015, Gomes-Pereira et al PLOS Genet 2007, Morales et al HMG 2020). Albeit, the threshold may be different in our HEK293-derived cells. Of note, we had a clone of 89B-Y-HDAC5 that did not express the expected amount of GFP for unknown reasons and we did not use it here. However, small pool PCRs using this line with 89 repeats showed that contractions were indeed present. Although we cannot rule out that the reason for the contractions is the unknown mutation(s), it suggests that the difference is due to the size of the expansion. We have added a comment in the methods section.

      It reads: “We have noted that cell lines with repeats that are mildly expanded (e.g., 59 CAGs) have fewer contractions than longer ones. This is consistent with several studies in the context of DM1 and HD [82], albeit the size threshold for seeing more contractions may be shorter in HEK293-derived cells than in mice.”

      The major issue with this set of experiments is that there is no positive control where instability is shown to be clearly manipulated. A knockdown of FAN1 would be the most likely avenue to pursue for identifying a positive control. This is straightforward to perform since successful FAN1 knockdowns have been described in the literature.

      We agree that a positive control to show that the model behaves as expected is necessary. We will add the experiments proposed by the reviewer in the revised version of the manuscript.

      The manuscript also looks at effects on gene expression measured by GFP fluorescence intensity. The potential significance is to see if disease-causing genes with expanded triplet repeats can be silenced by targeting chromatin-modifying enzymes. In the examples tested here, the answer seems to be no. Expression of DNMT1 or HDAC5 reduce fluorescence even in the absence of targeting. Upon targeting, there is a small further decrease, but the expanded triplet repeat resists this further decrease. Domain analysis of HDAC5 indicates that protein-protein interactions, not deacetylase activity, are important for silencing. The key interaction may be with HDAC3, since small molecule inhibition of HDAC3 relieved repeat length-dependent silencing by HDAC5. It was very curious that targeting HDAC3 actually increased expression, instead of silencing. The explanation for this observation was inadequate.

      We have added the following paragraph to the discussion to address this.

      It reads: “We found that targeting of PYL-HDAC3 increases gene expression slightly, independently of repeat size and in the presence of an inhibitor of its catalytic activity. Although this appears counterintuitive, several studies suggest that this is not unexpected. Specifically, HDAC3 has an essential role in gene expression during mouse development that is independent of its catalytic activity [73]. Moreover, HDAC3 binds more readily to genes that are highly expressed in both human and yeast cells [74,75]. The mechanism or function of HDACs binding to highly expressed genes are currently unknown.”

      The claim on page 16 final paragraph that the manuscript 'settled a central question for both HDAC5 and DNMT1 and their involvement in CAG/CTG repeat instability' is not supported by the data. Most of the results are negative so it is premature to claim the question is 'settled'.

      We have rephrased all the conclusions about this in the text, emphasizing that we find no evidence of a role in cis, rather than stating that there is no role in cis.

      Overall, with appropriate modifications described here, these experiments would be of interest with regards to potential therapies of triplet repeat expansion diseases, where silencing the expanded gene is the goal.

      **Minor concerns**

      P 4, last line. 59 bp should read 59 repeats - This is now fixed.

      P 5, line 2. 38 bp of what? This is now amended. It reads: “The CAG/CTG repeats affect splicing of the reporter in a length-dependent manner, with longer repeats leading to more robust insertion of an alternative CAG exon that includes 38 nucleotides downstream of the CAG, creating a frameshift [30].”

      P 10, first paragraph. DNA methylation levels rise from ~10% to ~20% with DNMT1 targeting. Is there a good precedent in the literature that the magnitude of this increase can be expected to be biologically meaningful?

      To our knowledge, it is the first time that DNMT1 is used for targeted epigenome editing. This is therefore the first evidence that targeting DNMT1 leads to silencing of a reporter construct. Nevertheless, this reviewer’s comment stands: is an increase in DNA methylation of 10 to 20% biologically relevant? The answer to this is yes, changes in 10-20% are known to have functional impact on gene expression in various settings (for example see the recent study in developing oocytes by Li et al Nature 2018). Furthermore, there is evidence that DNMT1 has weak de novo activity (Li et al Nature 2018, Wang et al Nat Genet 2020), consistent with a small increase in CpG methylation upon targeting. We now acknowledge in the discussion that one reason for the lack of effect upon targeting may be that the changes in CpG methylation are not dramatic enough. We also point out more clearly that changes of 10 to 20% are correlated with changes in repeat instability (Dion et al HMG 2008). We have amended the text to reflect this.

      The results now reads “To do so, we performed bisulfite sequencing after targeting PYL-DNMT1 for 30 days. This led to changes of 10 to 20% in the levels of CpG methylation, a modest increase(Fig. 3C), which is in line with the weak de novo methyltransferase activity of DNMT1 (for example see [39,40]). Similar changes in levels of CpG methylation in Dnmt1 heterozygous ovaries and testes were seen to correlate with changes in repeat instability in vivo [31].”

      The discussion now states: “It should be pointed out that there remains the possibility that DNMT1 targeting did not lead to large enough changes in CpG methylation to affect repeat instability.”

      P12 first paragraph. Text describing Fig 5 is confusing. First, GFP expression is referred to in terms of fold decrease, but subsequently in percent. Second, the ABA-induced silencing looks to reduce expression from about 0.6 to 0.5 of control. I presume this is where the claim of 16% comes from but it was not clear. Indeed, this is what we mean.

      We now state: “In 16B-Y-DNMT1 cells, ABA treatment decreased GFP expression by 2.2-fold compared to DMSO treatment alone. Surprisingly, ABA-induced silencing was 1.8 fold compared to DMSO alone, or 16% less efficient in 89B-Y-DNMT1 than in 16B-Y-DNMT1 cells.”

      P 15 paragraph 2. Where does the P value of 0.78 come from? Fig 7B shows no corresponding value. The P-value in figure 7B has now been corrected.

      Reviewer #1 (Significance (Required)):

      See above.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)):

      **Summary:**

      We still do not know whether epigenetics contributes to repeat instability and/or transcriptional activity in unstable CAG/CTG repeat associated pathologies. The aim of this manuscript is to examine whether induced binding of DNMT1 (CpG methylation) or HDAC5 (histone H3 acetylation) modulates CAG/CTG repeat instability and/or gene silencing upon expansion. For this the authors developed a highly sophisticated reporter system (PlnT) that allows to recruit a specific chromatin modifying enzyme (DNMT1/ HDAC5) to a GFP reporter near a CAG/CTG expansion, in the course of transcription (Dox-inducible promoter). This is to determine whether the CTGs, when lengthened and transcribed, become unstable or impede gene activity via epigenetic modifications.

      We appreciate the reviewer highlighting the importance of the question that we address here and the usefulness of PInT.

      **Findings:**

      1.Binding of DNMT1 to the reporter results in a modest increase (~10%) in local DNA methylation, with no change in repeat instability.

      3.Targeting HDAC5 to the reporter results in local reduction in histone H3 acetylation, with no effect on repeat stability.

      4.DNMT1/HDAC5 binding reduces GFP intensity differentially, in normal but not expanded alleles.

      5.The N-terminal domain of HDAC5, when mutated, abolishes the reduction in GFP expression levels.

      6.RGFP966 abolishes the allele-specific effect of HDAC5, resulting in a general decrease in GFP expression regardless of repeat tract size

      7.CTG expanded alleles abolish the reduction in GFP repression by HDAC5 via HDAC3 activity

      **Conclusions:**

      Based on the results using the PlnT reporter assay, the authors claim that:

      1.HDAC5 and DNMT1 do not affect repeat instability in cis

      2.Expanded CAG/CTGs reduce the efficiency of gene silencing by targeting DNMT1/HDAC5 to the locus

      3.Gene silencing that is mediated by HDAC5 recruitment can be abolished by inhibition of HDAC3 activity

      Unfortunately, none of the claims in this manuscript are convincing.

      We note that in the comments below the reviewer does not include a reason why he/she does not find the claims convincing. We therefore cannot address this criticism.

      **General Comments:**

      The major drawback of the PlnT experimental approach is that it ignores the importance of the flanking regions and the genomic organization of the endogenous locus. This is a major concern as it makes the conclusions irrelevant to the related loci. In the case of myotonic dystrophy type 1, for example, the reporter should reside within a CpG island, should be positioned immediately next to CTCF binding site(s), and should be transcribed bi-directionally.

      HDAC3 and DNMT1 were found to have effects on repeat instability both at reporters, which do not harbour flanking sequences from disease loci, and indeed at endogenous loci in vivo (Dion et al HMG 2008, Debacker et al PLoS Biol 2012, Suelves et al Sci Rep 2017, Williams et al PNAS 2020). This highlights the fact that cis elements from disease loci are not required for chromatin modifiers to affect repeat instability.

      The reviewer is suggesting a very interesting set of experiments where specific sequences may be added to our reporter and tested for their influence on gene expression and on repeat instability. PInT is ideally suited for this and we have now added a paragraph highlighting this in the discussion. We have also highlighted that the current study aims to isolate the repeats from its cis-elements to specifically side-step potential locus-specific effects and to look for chromatin modifiers that would be useful for epigenome editing for as many loci as possible.

      Furthermore, only large expansions (at least several hundred copies) can trigger heterochromatin at the DM1 locus. None of these features are recapitulated by the PlnT reporter assay, making it difficult to draw any conclusion regarding the role of these chromatin modifying enzymes to the locus.

      This is true for DM1 but untrue for other disease loci. For example, we have shown that there are changes in the flanking chromatin marks at the SCA1 locus of a mouse model with 145 repeats (Dion et al HMG 2008), DNA methylation is also affected near a SCA7 transgene with 92 CAG repeats (Libby et al PLoS Genet 2008) and transgenes containing CAG repeats (without the flanking sequences) lead to silencing regardless of where the transgene is integrated in the genome (Saveliev et al Nature 2003). Moreover, HDAC5 had effects on repeat expansion in a cell-based shuttle system containing as few as 22 CAG repeats (Gannon et al NAR 2012), again suggesting that chromatin modifiers affect repeat instability in a wide range of repeat sizes. We have reviewed this in Dion and Wilson TiG 2009.

      In fact, the authors state in their Discussion that "targeting a chromatin modifying peptide to different loci can have very different effects"!

      This is indeed the case and the reason why we sought to control for locus-specific effects using an exogenous reporter.

      To better substantiate their conclusions the authors must set up an improved model system that takes into account the flanking regions and the 3D genomic organization of the locus (TADs). The preferable approach would be to insert a reporter cassette by homologous recombination into the differentially methylated/acetylated regions near the repeats, and compare between normal vs. expanded alleles.

      We would like to point out that we have recently published a study where we looked at 3D chromatin folding at the DM1, HD, and the GFP transgene used here. We did not find any evidence for changes in TADs that would underlie changes in repeat instability at these loci (Ruiz Buendia et al Sci Advances 2020). We therefore do not think that it would be important to further manipulate 3D genomic organization in this context.

      To be clear, we are not denying that cis elements are likely to have an effect, there is plenty of evidence supporting this. Rather, we are using a reporter assay to disentangle the potential locus-specific (or cis-element specific) effects from the trans-activating factors. In short, we focus on the trans-acting factors rather than on the cis-elements, as suggested by the reviewer.

      We believe that the addition of the following paragraph highlights the goal of our study and also bring in the idea that cis acting elements can be studied using PInT.

      It now reads:

      “We designed PInT specifically to isolate expanded repeats tracts from other potential locus-specific cis elements. This is helpful to identify factors that would affect instability and/or gene expression across several diseases. Moreover, both HDAC3 and DNMT1 were found to impact repeat instability at different loci, including at reporter genes [31,33,36,37,45]. These observations highlight that cis-acting elements from disease loci are not required by chromatin modifiers to affect repeat instability. A potential application of PInT includes cloning in specific cis elements, including CTCF binding sites and CpG islands, next to the repeat tract and evaluate their effects on instability with or without targeting. In fact, PInT can be used to clone any sequence of interest near the targeting site and can be applied for a wide array of applications, beyond the study of expanded CAG/CTG repeats.”

      My impression was that there is a lot of data but none of it makes sense.

      The focus of the manuscript is not entirely clear: it starts with monitoring the effect of epigenetics on repeat instability and gene activity, then it shifts to the mechanism by which HDAC5 functions, and ends with the allele-specific effect of HDAC5 on gene expression. I lost my train of thought.

      We have now improved the transitions in this new version of this manuscript. Specifically, at the core of this manuscript is the development of PInT, which is highly versatile and allowed us to study multiple aspects of expanded CAG/CTG repeat biology. We hope that it is now clearer.

      **Other concerns:**

      (1)the modest increase in methylation levels following DNMT1 recruitment (10%, reaching a total of 20% at the most) prevents from drawing any conclusions regarding the effect of methylation on stability or expression.

      As mentioned in the response to reviewer 1 above, although 10% to 20% of CpG methylation are associated with changes in gene expression in a variety of settings, we now point out that one reason for the lack of effect in cis is that the de novo activity of DNMT1 is too weak to produce an effect.

      (2)The effect of protein targeting on GFP levels should be better defined at the RNA/protein level. Does it act by blocking transcription? alternative splicing? or alters steady state levels?

      Although the exact mechanism remains unclear, this goes beyond the current scope of this study. All these possibilities remain possible as we pointed out in the discussion.

      (3)Fig 5: the scale is different for A vs. B and C. Also, better to compare the effect of targeting on equal sized expansions (either 91, 89 or 58 repeats).

      We have fixed the scale on the figures.

      Unfortunately, it is not possible to have the same repeat sizes for all the cell lines because by their very nature, repeats are unstable. We have added a note relating to this in the methods.

      It reads: “Notably, it is not possible to obtain several stable lines with the exact same repeat size as they are, by their nature, highly unstable. This is why we have lines with different repeat sizes. Furthermore, the sizes can change over time and upon thawing.”

      (4)Add asterix for significance in all figures.

      This has now been done.

      (5)Figure 6: show raw data rather than normalized.

      We have now added representative flow cytometry profiles for each construct as a new supplementary figure (S5).

      (6)Figure 7: there is a notable difference in GFP expression levels in untreated wild type control (16 CAG repeats) between A vs. B. Why?

      Fig. 7a shows PYL targeting only, whereas 7b shows the GFP expression upon PYL-HDAC5 targeting. The values for PYL-HDAC5 targeting are lower because targeting it, unlike targeting PYL alone, silences the reporter.

      (7)Avoid redundancy. No need to show schematic representations so many times.

      We believe that the schematics make it clearer for the reader.

      Reviewer #2 (Significance (Required)):

      REFEREES CROSS-COMMENTING

      I totally agree with the Reviewer #1 that the PinT targeting system is a potent experimental tool to study the function of specific chromatin binding proteins. However, the significance of the flanking regions is discounted.

      We hope it is now clear that we are not discounting the potential significance of flanking regions and that rather we have designed the system to avoid their potentially complicating effects.

      The fact that the recruitment of HDAC5 has resulted in a significant reduction in acetylated histones provides evidence for that "the targeted proteins can interact normally with partner proteins to form functional complexes". Still, I agree with that the activity of DNMT1 needs to be better established, considering the minor increase in DNA methylation levels.

      We will be using ChIP against interacting proteins of DNMT1 and HDAC5 to address this issue.

      The request for a positive control for repeat instability is totally correct.

      We will be adding this in the revised manuscript.

      It is difficult to discuss the missing effect of HDAC5 on contractions or the unexpected effect of HDAC3 on gene silencing bearing in mind the limits of the experimental system.

      There is no expectation for the effect of HDAC5 on contractions as this has not been studied in any system yet. However, we believe that there is no contractions not because of HDAC5 per se but rather because of the shorter repeat size this line has (see comment to reviewer 1 above). We have now addressed the “unexpected effect” of HDAC3 by citing a number of studies finding a similar evolutionary conserved effect (see comment to Reviewer 1 above).

      I also agree with the statement that "this manuscript settled a central question for both HDAC5 and DNMT1 and their involvement in CAG/CTG repeat instability", is not supported by the data.

      We have now rephrased our conclusions. In this particular case, we changed ‘settled’ to ‘addressed’. We have also rephrased this in the results headings.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reviewer #1

      Summary

      The authors present well written work on the evolution of proteome size and complexity, and the corresponding changes in chaperone proteins. Interestingly, they find chaperone copy numbers increase linearly with proteome size, despite the increasing 'complexity' of, in particular, post-LECA genomes. They suggest that to address the rise in complexity, organisms express chaperones at higher levels and an expanding network of co-chaperones has evolved across the tree of life.

      Major comments

      Comment-1. Summary reads strangely relative to the rest of the manuscript, and lists facts in a way that makes the purpose of the study confusing. I think most readers will dislike the characterisation of evolution as a progress from simple to complex, and the authors' might want to avoid this language throughout the manuscript- bacteria and archaea have also been evolving over this period of times, and have not become more 'complex'? Similarly the authors should reconsider their figure legend titles. As a specific example, 'in the course of evolution' should become 'across the tree of life'.

      Response

      Thank you for these crucial suggestions. We agree with the reviewer, and with Reviewer 2 (see below) that bacteria and archaea have also been evolving since their emergence, so basically, we (humans) and the simplest archaea have the same evolutionary origin. However, we all agree that the simplest archaea/bacteria are far more similar to LUCA than we are. That said, we accept the criticism that putting our analysis in the context of evolutionary time is an over-interpretation given that we have not examined the protein/proteome phylogeny (in relation to proteome complexity; for chaperones we have). We have thus reformulated the figures and text, to a comparison across the Tree of life, rather than a time-dependent evolutionary process. Specifically: as a first step, we revised the Figures to rename the X-axis as “Order of divergence”, rather than “Divergence time (million years)” in the previous version. In the revised main text we emphasized the fact that the branch lengths of the Tree of Life represent the relative order of divergence of the different clades, rather than time. All instances of ‘in the course of evolution’ has been replaced by ‘across the Tree of Life’.

      Secondly, we revised the main text to emphasize on prokaryote vs. eukaryote comparison, rather than comparing organisms that diverged at different time-points. Within bacterial and archaeal domains, proteomes do not seem to expand against the order of divergence (as the reviewer argued, bacteria and archaea have not become more complex, also see Comment-5).

      Thirdly, the word ‘complexity’ has been omitted from the manuscript. The section “The expansion of proteome complexity” now reads as “Proteome expansion by de novo innovations”. In the previous version, increasing complexity in fact implied a torrent of de novo innovations that impose a larger burden on the chaperone machinery. Instead of ‘complexity’, the latter is clearly stated in the revised manuscript.

      In the spirit of these changes, the title of the revised manuscript, figure legend titles, and related section titles have been edited as follows.

      Submitted version

      Revised version

      Paper title. On the evolution of chaperones and co-chaperones and the exponential expansion of proteome complexity

      On the evolution of chaperones and co-chaperones and the expansion of proteomes across the Tree of Life

      Section title. A Tree of Life analysis of the expansion of proteome complexity and chaperones

      A Tree of Life analysis of the expansion of proteomes and chaperones

      Section title. The expansion of proteome size

      The expansion of proteome size across the Tree of Life

      Section title. The expansion of proteome complexity

      Proteome expansion by de novo innovations

      Figure 1 legend title. Expansion of proteome size

      Expansion of proteome size across the Tree of Life

      Figure 2 legend title. Expansion of proteome complexity

      Expansion of proteomes by de novo innovations

      Further, changes have been made in the Summary and in the main text to exclude any impression that proteomes/organisms have become more complex with time. Rather we emphasized prokaryote versus eukaryote comparison.

      Comment-2. I think the manuscript would be improved if the authors significantly shortened the discussion of genome size evolution- this is fairly well understood, and could be covered briefly, especially as the main focus of the manuscript is on the evolution of chaperone and co-chaperone repertoire. They could also make clearer quantitative links between protein complexity and the evolution of chaperones and co-chaperones- perhaps this should be in the discussion? The authors might also consider referencing 'The evolution of genome complexity', which could be relevant to this manuscript and might make the work of broader interest.

      Response

      We thank the reviewer for this suggestion. The main focus of our paper is indeed the evolution of chaperones and co-chaperones but within the context of the expansion of proteomes. Having this focus in place, the discussion on proteome size evolution (section: The expansion of proteome size across the Tree of Life) has been revised and shortened to emphasize more on prokaryote versus eukaryotic comparison.

      The suggestion to provide “clearer quantitative links between protein complexity and the evolution of chaperones and co-chaperones” is indeed very useful and we authors sincerely thank the reviewer. To address this suggestion we revised Figure 4 to quantitatively compare the expansion of proteomes and that of chaperones, under one roof. This Figure compares proteome parameters that supposedly demands more chaperone action in all three domains of life and simultaneously summarizes the expansion of the chaperone machinery lacking de novo innovations.

      The first paragraph of the Discussion section has been revised accordingly that walks the reader through the revised Figure 4 and finally introduces to the dichotomy it implies.

      We did not understand the last comment “The authors might also consider referencing 'The evolution of genome complexity', which could be relevant to this manuscript and might make the work of broader interest.” We’d be glad to address it upon further clarification.

      Comment-3. The authors state 'protein trees were generated and compared with ToL to account for gene loss and transfer events'. The methodology for this procedure is not given in the manuscript. The authors should back up this point, and make it clear this is why they reconstruct the trees. Currently it is not convincing to me that the authors have found HGT given the considerable phylogenetic uncertainty in the basal events in the tree of life. I also expect the tree of a single protein to be potentially lack information due to the short sequence considered and possible lack of power. The authors need to consider whether the data is really of high enough quality to assess this.

      Response

      Thank you for this suggestion. For the various chaperone families, we manually compared the protein trees with the Tree of Life. This is clearly stated in the revised Methods section (see Page 25, Lines 31-32). We agree, however, that the identifying HGT, and in general, trees of single domains that are highly diverged, are tricky. We did our best to address these caveats. Specifically:

      We re-evaluated our work in the light of a recent study (PMID: 32316034). This paper discussed the phylogenetic uncertainties associated with molecular dating and re-evaluated the assignment of several protein families to LUCA. A careful analysis revealed that the reviewer is indeed right, meaning many of the HGT events shown in the previous version Figure 3B was indistinguishable from the phylogenetic uncertainties.

      Accordingly, we revised the section “The core-chaperones emerged in early-diverging prokaryotes”. We removed the previous version Figure 3B, along with all instances of HGT events mentioned in the main text, except one (archaea to Firmicute HGT of HSP60, which is well-supported by the data and was also detected previously). Dating the emergence of chaperone families was also re-evaluated. Though the major conclusions were not altered, we discussed the phylogenetic uncertainties associated with our work and the overall confidence of each dating analysis. We believe these discussions would be very useful to the readers.

      Finally, we note that most of our key assignments (points of emergence, and major HGT events) are in agreement with previous works. Specifically: the emergence of HSP20 and HSP60 to LUCA (Sousa et al., 2016; Weiss et al., 2016) and HSP60 being horizontally transferred from archaea to Firmicute (Techtmann and Robb, 2010) and HSP20 being horizontally transferred between bacterial clades and between bacteria and archaea (Kriehuber et al., 2010).

      Comment-4. Methods- the authors could consider taking an alternative source of LUCA proteins, rather than those found in 'Nanoarchaeota and Aquificae': it's possible these are not representative of LUCA, and it seems a somewhat arbitrary choice- the authors could consider using one of the available curated sets, such as that generated by Ranea et al. (2006).

      Response

      The reviewer is right that a more robust LUCA set could be used. However, given that the revised manuscript focuses on comparison across the ToL, and foremost on prokaryote versus eukaryote comparison, we don’t think that refining this set is important. Foremost, this set was used for one purpose only, for determining changes in domain length. And, the set of 38 X-groups used for this analysis are in fact, the ones present in all organisms across the ToL. Hence, we kept the original analysis, while mentioning that these 38 X-groups are conserved across the ToL, and removed the argument for LUCA assignment. See Page 5, Line 22.

      Comment-5. The patterns observed might only hold because of differences in the taxa that diverged pre and post LECA? The authors might consider subgroup analyses to ensure this is not the case. The authors could also consider using methods that take phylogeny into account.

      Response

      The reviewer is right that within prokaryotic domains proteomes do not seem to expand. For example, excluding a few early-diverging prokaryotes and parasites, proteome size in bacteria and archaea varies within 2000-3000 proteins per proteome. Only when pre-LECA and post-LECA organisms are compared, significant differences are observed. We thank the reviewer for this suggestion. We revised the main text to focus on prokaryote versus eukaryote comparison. This re-focusing does not change any of our major conclusions, but rather puts our analysis in the right context (see Comment 1).

      Minor comments

      Comment-6. 'Life's habitability has also expanded from its 10 specific niche of emergence-likely deep-sea hydrothermal vents, to highly variable and extreme 11 ranges of temperature, pressure, exposure to high UV-light, dehydration and free oxygen.' This is not really correct, as bacteria and archaea are found worldwide, and in the most extreme environments.

      Response

      Thank you for this suggestion. We removed the above-mentioned sentence.

      Comment-7. 'We reconciled the topology of our tree'- on first read this was not clear, I did not realise the authors were only building trees for subsets of the data- time tree is the best source for the overall topology. The phrase 'manually curated and adjusted' is used in the methods. This language is much too vague, and not a clear explanation of the steps taken.

      Response

      We apology for this confusion. The overall topology of our Tree of Life is indeed taken for TimeTree. We edited the text in Page 4, Line 4 to clarify this issue.

      The obtained tree topology was manually curated and adjusted to depict eukaryotes stemming from Asgard archaea and Alphaproteobacteria, by an endosymbiosis event. This is clearly mentioned in the Methods section (see Page 22, Lines 24-28).





























      Reviewer #2

      Summary

      Rebeaud and colleagues analyze evolution of chaperones compared to the evolution of whole proteome complexity across the entire tree of life. Their principal conclusions are well captured in the following quote from the Discussion:

      "Comparison of the expansion of proteome complexity versus that of core-chaperones presents a dichotomy-a linear expansion of core-chaperones supported an exponential expansion of proteome complexity. We propose that this dichotomy was reconciled by two features that comprise the hallmark of chaperones: the generalist nature of core-chaperones, and their ability to act in a cooperative mode alongside co-chaperones as an integrated network. Indeed, in contrast to core chaperones, there exist a consistent trend of evolutionary expansion of co-chaperones."

      Major comments

      Comment-1. The general theme of the evolution of proteome management is of obvious interest. Unfortunately, the entire analysis is shaky and fails to convincingly ascertain the authors' conclusions. There are many issues. Throughout the manuscript, the authors discuss 'expansion' of the proteome in bacteria, archaea and eukaryotes, creating the impression of a consistent evolutionary trend. No such trend actually exists if one considers the means or medians of proteome sizes within each of the three domains of life (there is a transition to greater complexity in eukaryotes). The maximum complexity, certainly, increases with time which can be attributed to the 'drunkard's walk' effect. This hardly qualifies as 'expansion'.

      Response

      The reviewer is right that within prokaryotes proteomes do not seem to significantly expand. Reviewer-1 raised a similar concern that prokaryotes and eukaryotes have been evolving for the same period of time and have not expanded significantly. We understand the misconception instated by the earlier version and we thank the reviewers for pointing it out. Accordingly, we revised the main text to clarify these issues, as described in the following.

      Firstly, the main text was revised to emphasize on prokaryote versus eukaryote comparison. The reviewer agrees that compared to prokaryotes, “there is a transition to greater complexity in eukaryotes”. This re-focusing does not change any of our major conclusions, but rather provides a systematic comparison that is adequately supported by data.

      Secondly, we revised the Figures to rename the X-axis as “Order of divergence”, rather than “Divergence time (million years)” in the previous version. We emphasized the fact that the X-axis actually represent the relative order of divergence of the different clades, rather than absolute dates. This emphasis certainly does not create the impression of a consistent evolutionary trend. Instead, combined with the revised main text, it depicts that only when pre-LECA and post-LECA organisms are compared, clear trends of proteome expansion is observed.

      Comment-2. The authors further claim a 'linear' expansion of the chaperone set and 'exponential' expansion of the total proteome size. These are precise mathematical terms and, as such, require fitting to the respective functions. No such thing in this manuscript. Even apart from that shortcoming, the explanation of both 'linear' and 'exponential' are quite confusing. Thus, when explaining the 'linearity' of chaperone evolution, the authors refer to the lack of major innovation among the chaperones. This is correct in itself but has nothing to do with linearity. Apart from the aforementioned conceptual problems, the estimation of the 'exponential' growth of the proteome are naive, inconsistent and inaccurate.

      Response

      Our uses of ‘linear expansion’ versus ‘exponential expansion’ may have been confusing although we have defined quite clearly what we mean by that (i.e., that it is not the mathematical sense). The statement regarding “the lack of major innovation among the chaperones” was made in this context/definition and was consistent with it.

      Nonetheless, to avoid confusion, we revised the main text by excluding the ‘linear expansion’ and ‘exponential expansion’ terms. We simply stated that a torrent of de novo innovations has occurred during the expansion of proteomes from prokaryotes to eukaryotes. In contrast, the evolutionary history of core-chaperones lacks such major innovations. Accordingly, the title of the revised manuscript, figure legend titles, and related section titles have been edited as follows.

      Submitted version

      Revised version

      Paper title. On the evolution of chaperones and co-chaperones and the exponential expansion of proteome complexity

      On the evolution of chaperones and co-chaperones and the expansion of proteomes across the Tree of Life

      Section title. A Tree of Life analysis of the expansion of proteome complexity and chaperones

      A Tree of Life analysis of the expansion of proteomes and chaperones

      Section title. The expansion of proteome complexity

      Proteome expansion by de novo innovations

      Figure 1 legend title. Expansion of proteome size

      Expansion of proteome size across the Tree of Life

      Figure 2 legend title. Expansion of proteome complexity

      Expansion of proteomes by de novo innovations

      Comment-3. As the base point for the expansion estimates for archaea and eukaryotes, the authors take parasitic forms. Even leaving aside the highly dubious claims that these organisms belong to the clades that diverged first from the respective ancestors, parasites are not an appropriate choice for such estimates because they certainly are products of reductive evolution. For bacteria, inconsistently, the authors choose a free-living form from a dubious ancient clade, and not even the one with the smallest genome. All taken together, this robs the expansion estimates of any substantial meaning.

      Response

      This point is overall valid. Although we adamantly reject the insinuation of “dubious claims that these organisms belong to the clades that diverged first from the respective ancestors” – firstly, we did not make any claims to this end, but took the ToL constructed by others (Hedges et al., 2015); second, that these claims are dubious need to backup by counter-evidence/data and with all due respect, neither were provided by the reviewer. However, what is of concern is that in a symbiont/parasite chaperones of the host may have a key role, and thus the comparison to free-living organisms could be misleading. To address this concern we excluded the obligatory endosymbiont Nanoarchaeum equitans and the parasitic organisms from the expansion estimates and such discussions are now limited to free-living organisms only. Further, as described in response to Comment-1, the revised manuscript focuses on prokaryote versus eukaryote comparison.

      Note that phylogenetic analysis often assigns parasitic and symbiotic organisms that have experienced reductive evolution as the earliest diverging clades of their corresponding kingdoms of life. Examples include Nanoarchaeum equitans, an obligate symbiont, assigned as the earliest diverging archaea (Hedges et al., 2015; Huber et al., 2002; Waters et al., 2003), and parasitic Excavate assigned as one of the earliest diverging eukaryotes (Burki et al., 2020; Simpson et al., 2002). In accordance with these studies, these parasitic and symbiotic organisms were included in our analysis. We acknowledged this fact in the Methods section (see Page 22, Lines 9-16).

      Comment-4. The authors do make a salient and I think essentially correct observation: chaperones typically comprise about 0.3% of the proteins in any organism. As such, this presents no dichotomy in evolutionary trends to be explained. Surely, as examined and discussed in the paper, eukaryotes also show significant increases in the size and domain content of the encoded proteins, suggesting the possibility that might need more chaperones. However, if this is the explanandum, rather than the number of proteins in the proteome as such, it should be clearly stated. Furthermore, it is quite natural to assume that this increase in protein complexity without a commensurate increase in the chaperone diversity, is enabled by higher expression of the chaperones as suggested in the Discussion of this paper. I doubt there is any big surprise here and even much need for an extended discussion let alone a special publication.

      Response

      As emphasized, and shown, eukaryotes have not only larger proteomes in terms of the number of proteins or protein size. They have a higher content of proteins that are prone to misfolding. This is shown explicitly, in Figure 2 (namely, multidomain proteins, repeat, beta-rich proteins, etc’) and is reiterated in a summary figure (suggested by Reviewer 1). Further, in response to Reviewer-3’s suggestion, we showed that eukaryotes feature much higher proportions of aggregation-prone proteins per proteome than prokaryotes (Figure 2E).

      To further clarify, we revised Figure 4 to quantitatively compare the expansion of proteomes and that of chaperones, under one roof. This Figure compares proteome parameters that supposedly demands more chaperone action in all three domains of life and simultaneously summarizes the expansion of the chaperone machinery lacking de novo innovations.

      In addition, the first paragraph of this Discussions section is revised to state that from prokaryotes to eukaryotes, proteomes have expanded by duplication-divergence as well as by innovations (de novo emergence of new folds). Thus, it’s not about the size only (a challenge that a proportion expansion of chaperone genes would resolve, i.e., the 0.3%) but about proteome composition changing in a way that demands more and more chaperone action.

      We also agree with the assertion that “it is quite natural to assume that this increase in protein complexity without a commensurate increase in the chaperone diversity, is enabled by higher expression of the chaperones”. However, we belong to a group of scientists for whom natural assumptions are insufficient, and think that supporting evidence is of importance.

      Reviewer’s significance statement

      As such, in the opinion of this reviewer, there is no substantial advance over the existing knowledge in this paper. Should the authors wish to revise, they would need to develop robust methodology to measure proteome expansion. That would involve starting from reconstructed ancestors rather than any extant forms (let alone parasites). I doubt that such analysis, non-trivial in itself, reveals an strong, consistent trends other than the well known increase in complexity in eukaryotes.

      Response

      We agree that to assert evolutionary, time-dependent trends one needs to analyze phylogenies and reconstructed ancestors, but still think that a comparison of proteome and chaperone contents along the Tree of Life is meaningful. We thus respectfully, yet adamantly disagree with “no substantial advance over the existing knowledge”. We strongly believe, as does Reviewer-3, that the results and the model presented in this paper are “fascinating to consider and… will stimulate a good deal of important discussion…”.

      Reviewer #3

      Summary

      The manuscript by Rebeaud et al describes phylogenetic analyses of proteome and chaperone complexity. The authors analyzed species across the tree of life to predict the proteome and chaperone properties of ancestors spanning to the last universal common ancestor. Their analyses indicate that many proteome properties increased in complexity over evolutionary time including: average protein length, the number of multi-domain proteins, the size of the proteome, the number of repeat proteins, and the number of beta-superfold proteins that are known to be difficult to fold. Their analyses also indicate an expansion in chaperone families that corresponds to the increase in proteome complexity. Based on their analyses, the authors propose a model where early life relied on a limited number of chaperones (Hsp20 and Hsp60) and that as proteome complexity evolved, so did chaperone complexity. Core chaperones including Hsp90, Hsp70, and Hsp100 evolved relatively early, and later chaperone evolution was driven by the appearance and alterations of co-chaperones and auxiliary factors as well as by increases in the protein abundance of chaperones.

      Major concerns

      Comment-1. This work is appropriately based on phylogenetic inferences, but as such, the limitations and uncertainties of phylogenetic inferences need to be discussed. This in no way takes away from the work, quite the opposite, it would make it richer by encouraging broader interpretations where justified and clear understanding of where support for the model is strongest. Posterior probabilities need to be discussed and the range of properties that a likely ancestor might have based on the data should be discussed. How this impacts the conclusions and models should be discussed. Throughout the manuscript, the authors present most-likely ancestral models (as I understood it), what are the next most likely models? How much power is there to distinguish one model from another? It would be very helpful to have a section describing the limitations and uncertainties of the phylogenetic analyses and how these relate to the main findings and conclusions.

      Response

      We thank the reviewer for this suggestion. Reviewer-1 raised a similar suggestion (see Comment-3). The phylogenetic analysis in our paper included dating the emergence of core- and co-chaperone families, and attempt to infer major their HGT events, foremost in relation to the origin of eukaryotic chaperones. To highlight the uncertainties of phylogenetic inferences we re-evaluated our work in the light of a recent study (PMID: 32316034) that carefully analyzed the uncertainties associated with the assignment of several protein families to LUCA.

      Ideally, for a protein family to be assigned to LUCA, there must be a single split of bacterial and archaeal domains at the root of the protein tree with strong bootstrap support, and the inter-domain branches would be longer than the intra-domain branches (PMID: 32316034). In the revised main text we discussed that only the HSP60 protein tree satisfies this criterion. HSP20 protein tree depicts a clear single split of bacterial and archaeal domains at the root, albeit with weak bootstrap support, and inter-domain branch lengths are smaller than intra-domain branch-lengths. We discussed that this is indeed the case of phylogenetic uncertainty, which means the sequence of this small, single-domain chaperone lacks the information to make reliable inference at the basal events in the ToL.

      In addition, the HGT events discussed in the previous version appear to be indistinguishable from phylogenetic uncertainties and we removed all instances of HGT events mentioned in the main text as well as Figure 3B. Only one HGT event – HSP60 being horizontally transferred from archaea to Firmicute, which is well-supported by the data is kept in the revised main text. We believe these discussions would be very useful to the readers.

      Finally, we note that most of our key assignments (points of emergence, and major HGT events) are in agreement with previous works. Specifically: the emergence of HSP20 and HSP60 to LUCA (Sousa et al., 2016; Weiss et al., 2016) and HSP60 being horizontally transferred from archaea to Firmicute (Techtmann and Robb, 2010) and HSP20 being horizontally transferred between bacterial clades and between bacteria and archaea (Kriehuber et al., 2010).

      Comment-2. General features that impact foldability, including contact order, should be discussed and what features can be searched for in genomes that relate to these - e.g. beta-rich proteins.

      Response

      Thanks for this valuable idea! Contact order, and other predictors of problematic folding are highly relevant but their analysis is structure-based and hence inapplicable on the proteome (sequence) scale. We did, hwoever, estimate the proportion of aggregation-prone proteins in the proteome. These proteins were identified by CamSol method that assigns poorly soluble regions from sequence data. Indeed, some of these predicted ‘poorly soluble segments’ refer to the hydrophobic core of the respective folded state instead of ‘true’ aggregation hotspots. With this unavoidable potential caveat, it appears that compared to prokaryotes, aggregation-prone proteins in the proteome have become nearly 6-fold more frequent in Chordates.

      Following changes were made to accommodate this new analysis:

      Figure 2 is revised to include a new panel (panel-E) that shows the expansion of aggregation-prone proteins in the proteome across the Tree of Life. The same result is summarized in the summary Figure 4.

      A new paragraph entitled “Proteins predicted as aggregation-prone became ~6-fold more frequent in the proteome” is added to the Results section, which describes the principle and the main results (see Page 7, Lines 14-28).

      The methodology is included in the Methods section, in a paragraph entitled “Predicted proportion of aggregation-prone proteins in the proteome”, see Page 24 Lines 17-27. For each representative organism, the percent of aggregation-prone proteins in proteome data are provided as Data S10.

      This analysis is also included in the revised Abstract: “Proteins prone to misfolding and aggregation, such as repeat and beta-rich proteins, proliferated ~600-fold, and accordingly, proteins predicted as aggregation-prone became 6-fold more frequent in mammalian compared to bacterial proteomes.” See Page 2, Lines 7-9.

      Comment-3. "Core" chaperones needs to be defined.

      Response

      Thank you for this suggestion. We restructured Page 3 Lines 19-23 in the Introduction to clearly explain this aspect. The current text is quoted below.

      “Chaperones can be broadly divided into core- and co-chaperones. Core-chaperones can function on their own, and include ATPases HSP60, HSP70, HSP100, and HSP90 and the ATP-independent HSP20. The basal protein holding, unfolding, and refolding activities of the core-chaperones are facilitated and modulated by a range of co-chaperones such as J-domain proteins (Caplan, 2003; Duncan et al., 2015; Schopf et al., 2017).”

      Minor concerns and thoughts

      Comment-4. This manuscript stimulated me to think about the dynamics between chaperone evolution and proteome evolution. The ability to tolerate proteins that need chaperones seems linked to major evolutionary innovations. Once you have these innovations though, you are addicted to the chaperones - and an expansion of the number of sub-optimal proteins. These ideas seem like they would be valuable to include in the discussion of this work. More generally, it would be wonderful to have a discussion of future directions that this work may spark.

      Response

      This is indeed a fascinating question or set of questions, that we have also become intrigued about following this work, We introduced a short section, though more of an ‘appetizer’ than a detailed discussion, as we know almost nothing about the co-evolution of new proteins and chaperones.

      Reviewer’s significance statement

      This manuscript provides a fascinating glimpse back in time of a fundamental interplay - between chaperone evolution/addiction and proteome evolution. I am not an expert in phylogenetic analyses so I cannot judge the details of the analyses. As an expert in molecular evolution and chaperones, I found the approach and model fascinating to consider and I believe it will stimulate a good deal of important discussion in these fields. I have one major concern that I feel ought to be addressed in the manuscript and a number of points that I would encourage the authors to consider. I am sure that these can be readily addressed and I look forward to seeing this work published and the further discussion and ideas that it may stimulate.

      Response

      Thank you!

    1. “moral education”

      <br>

      Analytic notes:

      The primacy of moral education in the design of the French primary school system is evidenced in the writings of Francois Guizot, the French Minister of Education who during the July Monarchy drafted the 1833 Loi that established, for the first time, a centrally-controlled system of primary schools, with a centralized curriculum and primary school teachers trained and recruited according to central government directives. The centrality of moral education as a motivation to centralize the control and expand the provision of primary schooling in France is also discussed by Weber (1976). The 1833 Loi is especially important because it was followed by the fastest expansion of primary schooling observed in French history (Grew and Harrigan 1991).

      That the Prussian primary school system focused mainly on moral and religious education was perceived to be true among those who admired and those who criticized Prussian schools. Among the admirers was Horace Mann, a U.S. education reformer who played a key role in the development of a system of common schools in Massachusetts during the 1830s and 40s. Mann devoted two of the twelve Annual Reports he wrote as Secretary of the Massachusetts Board of Education entirely to the importance of moral education. He highlighted Prussia as an example of an education system that shapes moral values. The Prussian emphasis on moral and religious education noticed by Mann continued to prevail at the beginning of the 20th century according to Thomas Alexander, a professor at the George Peabody College of Teachers who spent between 1912 and 1913 studying Prussian schools directly as the basis for his book The Prussian Elementary Schools, published in 1919.

      Source excerpts:

      In an essay discussing the perceived benefits of the 1833 Loi, Guizot (1860) writes: “The state must provide primary education to all families and give it to those who cannot afford it; and in this he does more for the moral life of peoples than he can do for their material condition. This is the true principle on this point, and it was the one adopted by my bill.” (p. 63-64) “Primary education is not a panacea which cures all the moral maladies of the people . . . ; it is a salutary or harmful power according to whether it is well or badly directed and contained within its limits or pushed out of its mission. . . . The law of June 28, 1833, has received various modifications . . .; but all its principles, all its essential dispositions, have remained upright and in force. Founded by this law, primary education is now, among us, a public institution and an acquired fact. There remains, surely, much to be done for the good government of the schools, to make it dominant in their bosom the influences of religion and order, of faith and law, which make both the dignity and the safety of a people.” (p.86)

      And continues: “If it is true that the attachment of the citizens to the fundamental laws of the state and to the sovereign who is its leader, is the most energetic power and surest safeguard of society, if it is true that there where this feeling has existed, it has produced miracles, and that its absence has brought about the greatest evils, it is the duty as well as the interest of the government to favor and direct its development. But this feeling can only arise from the concordance of public doctrines and national habits with political institutions, the nature and principles of government. . . . When men have learned from childhood to understand the fundamental laws of the country and to respect its sovereign, the sovereign and the laws become a kind of property which is dear to them, and they do not refuse the obligations that it imposes upon them: when the government has taken care to propagate, in favor of national education, in the relations of religion, morality, politics, etc., the doctrines which suit his nature and his direction, these doctrines soon acquire a power against which come the failures of liberty of mind and all seditious attempts. Thus the public mind is formed, thus a true patriotism is maintained, thus fortifying and consolidating societies and thrones.” (Guizot 1860, 86).

      Weber (1976, 329): “Official reports coupled poor education with rude, brutal ways. Where schooling did not take hold, ‘ways are coarse, characters are violent, excitable, and hotheaded, troubles and brawls are frequent.’ The school was supposed to improve manners and customs, and soothe the savage breast. The polite forms it inculcated ‘softened the savagery and harshness natural of peasants.’ Improved behavior and morality would be attributed to the effects of schooling.”

      Mann (1844, 22): “If Prussia can pervert the benign influence of education to the support of arbitrary power, we surely can employ them for the support and perpetuation of republican institutions… If a moral power over the understandings and affections of the people may be turned to evil, may it not also be employed for good?”

      Alexander (1919, v): “A careful study of the Prussian school system will convince any unbiased reader that the Prussian citizen cannot be free to do and act for himself; that the Prussian is to a large measure enslaved through the medium of his school; that his learning, instead of making him his own master, forges the chain by which he is held in servitude; that the whole scheme of Prussian elementary education is shaped with the express purpose of making ninety-five out of every hundred citizens subservient to the ruling house and to the state.”

      In a later chapter that focuses on the curriculum and teaching methods, Alexander refers to the influential ideas of Johann Friedrich Herbart, a German philosopher, psychologist and educator, author of The Moral or Ethical Revelation of the World: The Chief Aim of Education (1804), and Prussian commissioner of education. Alexander (1919, 258) writes that “With Herbart and his followers, the aim and end of instruction was the formation of moral and religious character. It was not Herbart’s intention merely to furnish the child with a definite number of concepts by the form and content of the instruction and subject matter, but rather to shape thereby the will and directly to affect the moral nature and attitude of the child.”

      In the conclusion, Alexander (1919, 540) writes: “Chief among the avowed aims of the Volksschule is the formation of moral and religious character. There is no doubt that the reason religion is made one of the chief subjects of instruction in the elementary schools is to teach the lesson of obedience to authority which is the basis of the German state.” And continues, “There are then leaders and followers. The leaders think and do; the followers merely do. The schools are organized for the express purpose of producing just these types . . . They educate the individual for the state; we [Americans] make the state for the individual. The lesson to learn here is this. The German sets definitely his national aims. Those in authority shape every resource to reach that goal. The schools were molded to meet the needs of the state.” (Alexander 1919, 538-39).

      Full citations:

      Alexander, Thomas. 1919. The Prussian elementary schools. New York: The Macmillan company.

      Grew, Raymond, and Patrick J. Harrigan. 1991. School, state, and society: the growth of elementary schooling in nineteenth-century France: a quantitative analysis. Ann Arbor: University of Michigan Press.

      Guizot, Francois. 1860. Memoires pour servir a l'histoire de mon temps, T.3. Paris: Michel Levy freres.

      Mann, Horace. 1844. Seventh Annual Report on the Board of Education. Boston.

      Weber, Eugen. 1976. Peasants into Frenchmen: The Modernization of Rural France, 1870-1914. Stanford, California: Stanford University Press.

    1. Reviewer #2:

      The paper compares musicians' behavior and ERP responses to those of non-musicians with the following statement in the abstract:

      "these better performances could be due to an improved ability to process sensory information, as opposed to an improved ability to learn sequence statistics. Unfortunately, these very different explanations make similar predictions on the performances averaged over multiple trials. To solve this controversy, we developed a Bayesian model and recorded electroencephalography (EEG) to study trial-by-trial responses."

      The authors claim:

      "This higher performance is explained in the Bayesian model by parameters governing SL, as opposed to parameters governing sensory information processing. " This is correct - but meaningless - the experiment does not challenge sensory noise since the 3 sounds used are so distinct that sensory noise is zero in the two groups. Given that basic design - this phrasing is not only too strong, it is in proper.

      My understanding is that are two actual observations in the paper:

      1) Musicians' learning of second order markov statistics is better than that of non-musicians based on parameter fitting of a Bayesian model of their behavior in answering explicit questions regarding which sound (of 3 very distinct options) should come next.

      2) ERP measures - specifically P300 of musicians, is more sensitive to this statistics as evident by its magnitude with respect to predictability/surprise of the sound based on serial statistics. These claims are interesting BUT - I am not convinced by the claim of specificity. I think the data (and previous studies) suggest that musicians do better with sound related judgments - with all respects.

      I am not convinced that the model adds information since it explains the data as a good as single accuracy numbers (or did I miss something?). So I am not convinced that this trial by trial analysis adds information.

      With respect to the specific model parameters:

      Sensory noise is zero - the sounds are quite distinct. This is not an observation - this is how the experiment was designed. The authors admit that (indeed - any study that focused on sensory discrimination found an advantage in musicians) - but then state specificity, particularly in the abstract.

      Regarding rate of decay - I wonder if this is relevant to overall performance when asked only up to 2nd order serial statistics. It may be sufficient for the task. The relevance of this parameter should be clarified.

      Thus the lack of group difference in these parameters probably tells about the experiment rather than the groups.

      Similarly, musicians' ERP responses are larger. But the early difference is not addressed at all. Is the earlier response sensitive to simpler stat - but in a similar way in both populations? Can't be - since they have a different magnitude. The authors base their analysis on (MEG analysis) in their 2019 paper. I tried to do the exact comparison, and wasn't sure about the mapping to components - please clarify the exact similarity.

      Thus - overall - I am not sure that the model analysis provides new conceptual insights.

    2. Preprint Review

      This preprint was reviewed using eLife’s Preprint Review service, which provides public peer reviews of manuscripts posted on bioRxiv for the benefit of the authors, readers, potential readers, and others interested in our assessment of the work. This review applies only to version 1 of the manuscript.

      Summary:

      This work constitutes an innovative and timely combination of modelling, behaviour and EEG to understand potential differences in SL abilities between musicians and non-musicians. However, as detailed below, we have many concerns regarding the modelling, experimental design and interpretation of the results.

      Our major concerns are summarized here (and further elaborated in the individual reviews below):

      1) Modelling: please report the accuracy of the model and whether this differs between groups.

      2) You should analyse the interaction in Fig. 1B and report whether or not it is significant.

      3) Relatedly, there appears to be an inconsistency between the behavioural results and the modelling. In the behavioural data you report a main effects of musicianship and of sequence complexity. Modelling of this data suggests that whilst the K for musicians is higher than non musicians it is substantially above 1 for both. If anything this should predict larger differences between groups in larger K than smaller K which is different from what is seen behaviourally. A similar inconsistency is present between the behavioural results and the results in figure 4 (see below). This requires careful consideration.

      4) Can you do more to convince the reader that the model is performing well? Is the fit good, how does it vary across participants? Does rate of memory decay affect performance at all? Can you show good versus poor performers within the same group - do parameters also vary there?

      5) It is important that you address the issues related to participants being aware of the stimulus construction. Are there any consequences of the fact that participants were aware of the probabilistic nature of the sequences and the differences between the two sequence types? This seems to be an important divergence from other SL studies which could impact on the behavioural and neural effects observed and should, therefore, be discussed.

      6) The EEG data are recorded whilst participants are performing the behavioural prediction task. Though probe trials occurred rarely, it is conceivable that participants were making an active judgement for each sequence item. There is therefore a concern that the measured EEG data would reflect this aspect (active task performance) rather than automatic SL. This makes conclusions about "neural statistical learning" (e.g. as in the title) difficult to make.

      7) In the results section the authors consider various differences between the musician and non-musician groups that could lead to differences in performance. One aspect that does not seem to be considered is that of attention, or task engagement. Is it possible that the musician participants were simply more engaged/less bored by the task? The EEG data (figure 3) are consistent with this interpretation showing overall substantially larger responses in the musicians relative to the non musicians.

      8) In general, we think the model has been constructed with due care and attention and we like the separation of parameters related to statistical learning (model order and selection noise) and more general aspects of perception and cognition (sensory noise and memory decay). We think the difficulties arise in the relationship between the model and the experiment. Specifically, the sensory noise model parameter reveals very little in the analysis of this data because the sounds were so readily distinguishable, which appears to have been a deliberate choice in the experimental design, somewhat confusingly. The present stimulus set is therefore not suitable for distinguishing differences in sensory processing vs. SL between groups. We suggest that the authors could simply remove this parameter from the analysis and the paper would be clearer as a result. This would involve re-modelling and you will also have to reshape the way the experiment is motivated.

      9) We have some questions about how the EEG data are analysed. In particular, the large amplitude difference between groups should be quantified, discussed and interpreted. We would also like to see stronger justification and discussion of why these differences are not affecting the main conclusions. We note that the authors provide R2 results in supp materials but we feel that a better approach may involve normalizing the responses before modelling. Higher SNR in the musician group may lead to stronger correlations. One way around this is to normalize the data (e.g. based on the P1 response) before computing the correlations.

      10) You should perform the appropriate statistical analysis to support the claims associated with Figure 4. You seek to conclude that the two groups have similar responses to surprise in simple statistical contexts (K=0) with divergence occurring for more complex statistical structure. However, you do not provide statistics to support this claim. It is not enough to show no significant difference between groups for K=0, but significant differences for K=1, 2. You need to demonstrate an interaction between group and model order. Additionally, it was also not quite clear how modelling was performed here. We understand that you take surprise values from the model fitted to each participant but with the order fixed at 0, 1 or 2. This may mean that the other parameters might no longer be optimal in the context of the new fixed K values, depending on how different these were from the fitted values for each participant, which might plausibly differ for the musicians and non-musicians. To address this, Can you supplement the existing analysis with an analysis in which the K parameters are fixed at 0, 1 and 2, and the other parameters are re-optimised in the context of these fixed parameter values. Please also provide information about how well each individual data were fit, and whether there was a significant difference between musicians and non musicians. In general, we think the authors should present the result in figure 4 more cautiously and also flesh out the interpretation in more detail in relation to the literature along with a consideration of other potential interpretations. A small related point is that the term hierarchy is strongly related to this interpretation and we would prefer a more neutral term such as 'model order'.

      11) The paper would benefit from a careful discussion of exactly what information, on top of that revealed with behaviour, is added by EEG and the significance of this in the context of the existing literature on expectation related ERP components.

    1. cultural forms that continue to resonate powerfully as part of what Raymond Williams calls a "selective tradition" (115).14

      Williams says that the selective tradition chooses cultural work-art/literature- to highlight and obscure based on the dominant ideology. Work that maintains the dominant ideology-capitalism- is generally highlighted and canonized, while work that is truly subversive is hidden and obscured. This is a somewhat unconscious process. So when we think about why we study Marlowe, and why he has been canonized we have to consider that the reason the culture keeps selecting him may be because he maintains the dominant ideological structure. This reminds me of Bartel and all of those critics from our first readings claiming that Marlowe is truly subversive. While he may have been for his own time, perhaps he isn't for ours and instead upholds our current culture of capitalist globalization.

    1. generate 20 to 30 assumptions, true or false, that you may be making about it. Then pick several of these assumptions and use them as thought starters and idea triggers to generate new ideas.

      I find this useful because a lot of times we make assumptions that may not be true--yet we think of them as fixed. that's what an assumption is. So to find new ideas, you gotta question what you think is "fixed" Always go to the consumer, for example, don't assume anything about the consumer.

    1. Do patients and surrogates have the moral right to insist on life-sustaining treatment even after permanent loss of consciousness? I tend to think not, even though stopping treatment would offend many people on religious or moral grounds. (Note that we already permit physicians to declare death by whole-brain criteria even when family members object.) But in order to limit distress to patients and surrogates who won’t accept the higher-brain criteria of personhood, it may be more compassionate not to mandate withdrawal of feeding tubes as a strict policy, but rather to educate people about the nature of PVS and the futility of treatment.

      This is a really interesting topic and raises some further questions for me, such as the role of insurance and how realistically possible it is for someone to afford this?

    Annotators

    1. ”

      Booker T Washington's gradualistic perspective on how newly freed slaves were to adapt to life seems to be appropriate for the times considering how turbulent they were, but it also seems to enable and continue the story and the image of Blacks as less than or average compared to their fellow citizens. I can see why he may have believed in this approach to integration of former slaves into society, but I think it may have set a dangerous precedent also in delaying the atonement and reckoning of the stain of slavery on our country's history by minimizing the fact that we enslaved humans. Frankly, I think its dehumanizing.

    2. Our greatest danger is that in the great leap from slavery to freedom we may overlook the fact that the masses of us are to live by the productions of our hands, and fail to keep in mind that we shall prosper in proportion as we learn to dignify and glorify common labour and put brains and skill into the common occupations of life; shall prosper in proportion as we learn to draw the line between the superficial and the substantial, the ornamental gewgaws [sic] of life and the useful.

      Washington and DuBois were newly freed slaves who took upon this burden of carrying and trying to mentally free other African Americans. Unfortunately, these two men were only viewed as property. Though these two leaders had different proposals as to how African Americans could escape their current situation. The two men were not going to give up until their black community "made it out". During Booker T. Washington's childhood he experienced slavery first hand, this is when he began to realize the importance of education. He later attended Hampton Institute where he soon felt the effects of segregation in the educational system between black and whites. This experience resulted in him becoming an educator himself. He then advocated that African American stood up and fought for change, which included their rights to vote in order to gain some type of security for themselves and the generations to come. W.E.B. DuBois had a completely different upbringing as he was free and not have to experience the unforeseen circumstances of those in the southern states. DuBois later became the first African American to receive his doctorate from Harvard University. The biggest disagree between these two leaders is that DuBois did not think that uneducated blacks needed to vote, which I think is outrageous.That is honestly the largest thing that bothered me throughout this learning. Even though there were plenty of differences there was one thing that they agreed on which was violence against blacks including lynching. This was a great read and refresher about these two phenomenal African American leaders.

    3. Our greatest danger is that in the great leap from slavery to freedom we may overlook the fact that the masses of us are to live by the productions of our hands, and fail to keep in mind that we shall prosper in proportion as we learn to dignify and glorify common labour and put brains and skill into the common occupations of life

      I really like this part of Mr. Washington's speech. I think it speaks volumes by drawing attention to the fact that yes, many's history was rooted in slavery, yet the skills that they possessed as a result are valuable and should be exalted instead of looked down upon. Hard labor is honest, needed, and valued work but during this time it was exceptional to have a dignified leader bring attention to it, and it's importance.

    1. Just what is relevant and what is not is a matter of judgment of the system-builder, but we think of such things as states of war or peace, degrees of hostility or friendliness, alliance or enmity, arms bud­gets, geographic extent, friendly or hostile communications, and so on

      So some people see a scenario as relevant/irrelevant, but for others it might be a matter of life and death. For example, 2001 Afghan invasion by America may be seen as relevant by America's strategic policy-makers but it cost thousands of innocent civilian life.

    1. Here the direct application of an automatic approach to the act makes it clear that not only is this not the old craft of painting, but it is perhaps bordering on ritual itself, which happens to use paint as one of its materials. (The European Surrealists may have used automatism as an ingredient, but we can hardly say they really practiced it wholeheartedly. In fact, only the writers among them—and only in a few instances—enjoyed any success in this way. In retrospect, most of the Surrealist painters appear to have derived from a psychology book or from each other: the empty vistas, the basic naturalism, the sexual fantasies, the bleak surfaces so characteristic of this period have impressed most American artists as a collection of unconvincing cliches. Hardly automatic, at that. And, more than the others associated with the Surrealists, such real talents as Picasso, K.lee, and Miro belong to the stricter discipline of Cubism; perhaps this is why their work appears to us, paradoxically, more free. Surrealism attracted Pollock as an attitude rather than as a collection of artistic examples.)

      When I think of surreal artwork I think of visions, not only dreams, but maybe a vision we have while looking at the clouds. We envision a transformation and it feels like a message from our unconscious. Or a guided meditation, I've worked with Shamans and done meditation with spiritual gurus and masters, and the visions you can have while practicing these I guess you could say ritualistic practices are profound. After they happen you wonder what they meant, the vision or the video type imagery comes to you and you just observe it, and then after when you come back to yourself you wonder what it meant and attach meaning to it. I find my own surreal art ideas in these practices. I really relate to what Kaprow is saying here, how Pollock's work was an attitude, and a ritual, not just a abstraction to be interpreted. Do you think Pollocks ritualistic practice of drip painting came from his unconscious or a higher source, and that unknowingly Pollack's work was was made with intention from this source?

    1. Nancy Lee sometimes forgot she was colored herself. She liked her classmates and her school.

      As a reader, these two sentences caught me off guard. This is in large part because of the time period this story takes place. Racism and segregation are very, heavily present, and many people may think this part is small and simple; however, to say that Nancy forgot she was colored, gives the audience a huge understanding on good she had it. Compared to other African-Americans during this era, to like being at school was huge, but most colored students couldn't go to the same school as whites, so that alone sets this story into a new perspective for me. Overall, Nancy was a fortunate student in a time, such as we are in now: uncertainty.

    1. Thus, Confucius meditated upon water; and the Confucian Xunzi later attempted to systematize the relationship between water’s various forms and people’s moral qualities. This assumption of a correspondence between the principles which inform both water and human conduct was not limited to the Confucians; it was generally assumed in all early philosophical texts. Nor was the imagery the provenance of any particular school. For example, water which moves forward without force, giving life to everything, is described in Xunzi as ‘wuwei’ (without action) or (doing nothing) a term that is particularly associated with Daoism.

      CONTEXT: Shuen-fu Lin addresses "the sage", the person with the highest spiritual attainment who was first emulated and thought of in the Wei-Jin movement, following the Han Dynasty. The sage allows the innate tendencies and has all five of the human emotions addressed in the passage, but "...does not act, complies, and does not implement. He eliminates what leads things astray and gets rid of what confuses them." The sage is addressed as exhibiting qualities of both the Daoist way of life and the Confucianist way. The sage is like the image of water that is an unattainable, sage-like, presence and moral conduct, desired by both Daoist and Confucianist beliefs. "Gentlemen" look at water in awe, gazing upon the perfection of its inaction and lack of effort in attaining its intellect, beauty, and respect. The water has of "ziran", or perhaps, is "ziran" that humans are able to express communion with nature and nonpurposive action. This word is also described as spontaneously existing and being "so oneself" -nothing acting behind them. Water does not decide or dwell for too long, it just exists in movement and in detachment which I think human beings desire greatly.

      Cai, Zongqi. Chinese Aesthetics: The Ordering of Literature, the Arts, and the Universe in the Six Dynasties. Honolulu: University of Hawaii Press, 2004.

      RELATE: In 'The Experience of Nature' by Rachel and Stephen Kaplan, human action and thought is addressed as influenced by our setting/environment whether the setting require immediate responsive action or the response take place in a slower, observational method varies. The authors write, "People are particularly aware of information that is visual, that concerns what they see. That does not mean that people interpret the information in visual terms exclusively; rather, visual stimuli are effective in conjuring associated information. The sight of water provides information about potential opportunities which may or may not be visual in themselves" (Kaplan, 4). Reverie from observation that allows self reflection, thought free from distraction, and intuitive action is typically included in our broader categorization of landscape qualities when we discuss as landscape architects. Human reaction to landscape is so much bigger than the texture, color, or even kinesthetic feeling within the place and can be thought of as artwork in addition- prompting development of thought even subconsciously within the the one experiencing.

      Kaplan, Rachel, and Stephen Kaplan. The Experience of Nature: A Psychological Perspective. Cambridge: Cambridge University Press, 1989.

    1. For if a person is imagined lying back with outstretch arms and feet within a circle whose center is at the navel, the fingers and toes will trace the circumference of this circle as they move about. But to whatever extent a circular scheme may be present in the body, a square design may also be discerned there. For if we measure from the soles of the feet to the crown of the head, and this measurement is compared with that of the outstretched hands, one discovers that this breadth equals the height, just as in areas which have been squared off by use of the set square.

      This particular section is interesting because shape is something we often see as being separate to the human body, but Vitruvius is encouraging his audience to see shape as something which in fact the human body operates within. Our limbs can fit within squares and circles and I think Vitruvius must have been fascinated by the way the body had a composition in the same that architecture did. I know others above have commented on the fact that Vitruvius does not seem to take account of the fact that the human body can have many imperfections, and this is a really important point to take further.

  5. learn-us-east-1-prod-fleet01-beaker-xythos.content.blackboardcdn.com learn-us-east-1-prod-fleet01-beaker-xythos.content.blackboardcdn.com
    1. Thus, we argue that enhancingpeople’s happiness levels may indeed be a wor-thy scientific goal, especially after their basicphysical and security needs are met.

      I wonder is there any research on whether happiness is achievable if some of your basic needs aren't met? If not, does that mean individuals who may be homeless, in poverty or alone aren't able to achieve happiness? What about people who live in less modernized places who don't view what we view as necessities? Makes me think that the way we separate our needs from our wants is completely subjective.

    1. Do you think the world is going to be a better place next year? In the next decade? Can we end hunger, achieve gender equality, halt climate change, all in the next 15 years?

      I personally believe the wild will be a better place in the future though not any time soon. In todays present situation we as a society are still struggling with a number of issues. We are still facing pollution that is killing our aquatic life, social and racial issues, and even a pandemic! The governments world may say we can, but they need to take the right actions to insure so. Hopefully in the upcoming years we can dissolve a number of these problems thus making thew world a better place for future generations.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reviewer #1 (Evidence, reproducibility and clarity (Required)): **Summary:** This interesting study by Putker et al. showed that circadian rhythmicity persists in several typical circadian assay systems lacking Cry, including Cry knockout mouse behavior and gene expression in Cry knockout fibroblasts. They further demonstrated weak but significant circadian rhythmicity in Cry- and Per- knockout cells. Cry- (and potentially Per-)-independent oscillations are temperature compensated, and CKId/e still has a role in the period regulation of Cry-independent oscillations. **Major comments:** 1) The authors propose that the essential role of mammalian Cryptochrome is to bring the robust oscillation. As the authors analyze in many parts, the robustness of oscillation can be validated by the (relative) amplitude and phase/period variation, both of which should be affected significantly by the method for cell synchronization. Unfortunately, the method for synchronization is not adequately written in this version of supplementary information. This reviewer has no objection to the "iterative refinement of the synchronization protocol" but at least the correspondence between which methods were used in which experiments needs to be clearly explained. The detailed method may be found in the thesis of Dr. Wong, but the methods used in this manuscript need to be detailed within this manuscript.

      We thank the reviewer for recognising the importance of different synchronisation protocols. In experiments where bioluminescent CKO rhythms were observed, different synchronisation protocols resulted in similar results when comparing WT with CKO cells. The different synchronisation methods used in each experiment are now specified in the supplementary methods.

      2) The authors revealed that CKO mice have apparent behavioral rhythmicity under the condition of LL>DD. This is an intriguing finding. However, it should be carefully evaluated whether this rhythmicity (16 hr cycle) is the direct consequence of circadian rhythmicity observed in CKO and CPKO cells (24 hr cycle) because the period length is much different. Is it possible to induce the 16 hr periodicity in CKO mice behavior by 16 hr-L:16 hr-D cycle? Would it be a plausible another possibility that the 16 hr rhythmicity is the mice version of internal desynchronization or another type of methamphetamine-induced-oscillation/food-entrainable-oscillattion?

      The reviewer makes an excellent suggestion. As described in the manuscript text (page 13), CKO mice have already been shown to entrain to restricted feeding cycles (Iijima et al., 2005) and we therefore assessed whether CKO rhythms would entrain to a 16h day as suggested. Whilst CKO (but not WT) mice showed 16h behavioural rhythms during entrainment, they were arrhythmic under constant darkness thereafter (Revised Figure S2A). CKO cellular rhythms show reduced robustness under constant conditions ex vivo, and our other work has revealed that CRY-deficiency renders cells much more susceptible to stress (Wong et al, 2020, BioRxiv). The parsimonious explanation, therefore, is that whilst the cellular timing mechanism remains functional when CRY is absent, the amplitude of cellular clock outputs is severely attenuated (as we showed previously in Hoyle et al., Sci Trans Med, 2017) in a fashion that impairs the fidelity of intercellular synchronisation under most conditions in vivo, as well as the molecular mechanisms of entrainment to light-dark cycles.

      With respect to the apparent discrepancy between mean periods of CKO cultured cells (~21h), SCN (~19h) and mice (~17h). This is also observed in WT cells (~26h), SCN (~25h) and mice (~24h), simply with a smaller effect size and longer intrinsic period.

      We believe this difference in effect size can adequately be explained by differences in oscillator coupling, combined with the reduced robustness of CKO timekeeping. In Figure 1F we show that the range of rhythmic periods expressed by cultured CKO fibroblasts (14-30h) is much greater than for their WT counterparts (range of 22-26h), or that which is observed when cellular oscillators are coupled in CKO SCN (19h). Thus period of CKO oscillations is demonstrably more plastic (less robust) than WT, and with a cell-intrinsic tendency towards shorter period which is revealed more clearly when oscillators are coupled.

      In vivo there is more oscillator coupling in the intact SCN than in an isolated slice, from which communication with the caudal and rostral hypothalamus has been removed. Thus it seems plausible that increased coupling in vivo, combined with positive feedback via behavioural cycles of feeding and locomotor activity, resonate with a common frequency which is shorter than in isolated tissue.

      Critically, for both WT and CKO mice/SCN, the circadian period lies within the range of periods observed in isolated fibroblasts. To communicate this rather nuanced point we have inserted the following text into the supplementary discussion:

      “Circadian timekeeping is a cellular phenomenon. Co-ordinated ~24h rhythms in behaviour and physiology are observed in multi-cellular mammals under non-stressed conditions when individual cellular rhythms are synchronised and amplified by appropriate extrinsic and intrinsic timing cues. In light of short period (~16.5h) locomotor rhythms observed in CKO mice after transition from constant light to constant dark, but failure to entrain to 12h:12h light:dark cycles, it seemed plausible that either CKO mice might entrain to an short 8h:8h light:dark (16h day) or else have a general deficiency to entrainment by light:dark cycles. The data in Figure S2 supports the latter possibility, in that neither WT nor CKO mice stably entrained to 16h cycles whereas WT but not CKO mice entrained to 24h days. The bioluminescence oscillations observed in CKO cells conform to the long-established definition of a circadian rhythm (temperature-compensated ~24h period of oscillation with appropriate phase-response to relevant environmental stimuli). Whereas the locomotor rhythms observed in CKO mice under quite specific environmental conditions correlates with both the cellular and SCN data to suggest the persistence of capacity to maintain behavioural rhythms close to the circadian range, but which is masked under most circumstances. We suggest that in vivo the (pathophysiological) stress of CRY-deficiency is epistatic to the expression of daily rhythms in locomotor activity following standard entrainment by light:dark cycles and thus, whilst not arrhythmic, also cannot be described as circadian in the strictest sense.”

      3) The authors proposed that CKId/e at least in part is the component of cytoscillator (Fig. 5D), and turnover control of PER (likely to be controlled by CKId/e) may be an interaction point between cytoscillator and canonical circadian TTFL (Fig. 4). Strictly speaking, this model is not directly supported by the experimental setting of the current manuscript. The contribution of CKId/e is evaluated in the presence of PER by monitoring the canonical TTFL output (i.e. PER2::LUC); thus it is not clear whether the kinase determines the period of cytoscillator. It would be valuable to ask whether the PF and CHIR have the period-lengthening effect on the Nrd1:LUC in the CPKO cell.

      Another excellent suggestion, thanks. The experiment, showing similar results in CKO and CPKO cells, was performed and is now reported in Revised Figure S5D. The text was amended as follows: “We found that inhibition of CK1d/e and GSK3-α/β had the same effect on circadian period in CKO cells, CPKO cells, and WT controls (Figure 5A, B, S5A, B, D).”

      Moreover, our data are further supported by findings in RBCs, where CK1 inhibition affects circadian period in a similar manner as in WT and CKO cells (Beale et al, JBR 2019).

      **Minor comments:**

      4) The authors argue that the CKO cells' rhythmicity is entrained by the temperature cycle (Fig. 2C). Because the data of CKO cell only shows one peak after the release of constant temperature phase, it is difficult to conclude whether the cell is entrained or just respond to the final temperature shift.

      We agree with the reviewer and have replaced the original figure with another recording that includes an extra circadian cycle in free-running conditions (Revised Figure 2C).

      5) It would be useful for readers to provide information on the known phenotype of TIMELESS knockout flies; TIM is widely accepted as an essential component of the circadian clock in flies; are there any studies showing the presence of circadian rhythmicity in Tim-knockout flies (even if it is an oscillation seen in limited conditions, such as the neonatal SCN rhythm in mammalian Cry knockout)?

      The reviewer is correct that TIM is widely accepted as an essential component of the circadian clock in flies. Using more sensitive modern techniques however, ~50% of classic Tim01 mutant flies exhibit significant behavioural rhythms in the circadian range under constant darkness, as reported:

      https://opus.bibliothek.uni-wuerzburg.de/frontdoor/index/index/year/2015/docId/11914

      For this reason we employed a full gene knockout of the Timeless gene (Lamaze et al., Sci Rep, 2017), where the majority of flies are behaviourally arrhythmic under constant conditions following standard entrainment by light cycles and therefore represents a more appropriate model for CRY-deficient cells.

      We have revised the legend of Figure S2 to include the following:

      “N.B. The generation of Timout flies is reported in Lamaze et al, Sci Rep, 2017. Similar to CRY-deficient mice, whole gene Timeless knockout flies are characterised as being behaviourally arrhythmic under constant darkness following entrainment by light:dark cycles: https://opus.bibliothek.uni-wuerzburg.de/frontdoor/index/index/year/2015/docId/11914”

      5) Figure 3C shows that the amount of PER2::LUC mRNA changes ~2 fold between time = 0 hr and 24 hr in the CKO cell. This amplitude is similar to that observed in WT cell although the peak phase is different. Does the PER2::LUC mRNA level show the oscillation in CKO cells?

      No, we think we have shown convincingly this is not the case. We argue the data in figure 3C show that: (a) there is no circadian variation in mRNA PER2::LUC expression (mRNA levels increase but no trough is observed) and (b) that the temporal relationship between protein and mRNA as observed in WT is broken; i.e. the CRY-independent circadian variation in protein levels cannot be “driven by” changes in transcript levels. Similar results were obtained using transcriptional reporters Per2:LUC and Cry1:LUC (Figure S3E and F). Moreover, our findings are also in line with previous reports, such as Nangle et al. (2014, eLife) and Ode et al. (Mol Cell, 2017).

      6) Figure 3D: the authors discuss the amplitude and variation (whether the signal is noisier or not) of reporter luciferase expression between different cell lines. However, a huge difference in the luciferase signal can be observed even in the detrended bioluminescence plot. This reviewer concerns that some of the phenotypes of CKO and CPKO MEF reflect the lower transfection efficiency of the reporter gene, not the nature of circadian oscillators of these cell lines.

      As reported in the methods, these are stable cell lines rather than transiently transfected cells. The detrended luciferase data presented here do not actually reflect raw levels of luciferase protein expression, but rather reflect the amount of deviation from the 24 hour average. To make it easier to compare expression levels of Per2:LUC and Nr1d1:LUC between the different cell lines we have added figure S3H, presenting the average raw bioluminescence levels over 24 hours (after 24 hours of recovery from media change; ie from 24-48 hours). Using these data one can appreciate that expression levels of the Per2 reporter are never lower in CRY KO cells when compared to WT. We hope these data can take away the reviewer’s concerns about expression levels causing the differences observed.

      Reviewer #1 (Significance (Required)): Although Cryptochrome (Cry) has been considered a central component of the mammalian circadian clock, several studies have shown that circadian rhythms are maintained in the absence of Cry, including in the neonate SCN and red blood cells. Thus, although the need for Cry as a circadian oscillator has been debated, its essential role as a circadian oscillator remains established, at least in the cell-autonomous clock driven by the TTFL. This study provides additional evidence that the circadian rhythmicity can persist in the absence of Cry. More general context, the presence of a non-TTFL circadian oscillator has been one of the major topics in the field of circadian clocks except for the cyanobacteria. In mammals, the authors’ and other groups lead the finding of circadian oscillation in the absence of canonical TTFL by showing the redox cycle in red blood cells (O’Neil, Nature 2011). The presence of circadian oscillation in the absence of Bmal1 is also reported recently(Ray, Science 2020). Bmal1(-CLOCK), CRY, and PER compose the core mechanism of canonical circadian TTFL; thus, this manuscript put another layer of evidence for the non-TTFL circadian oscillation in mammals. Overall, the manuscript reports several surprising results that will receive considerable attention from the circadian community. This reviewer has expertise in the field of mammalian circadian clocks, including genomics, biochemistry, and mice's behavior analysis.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)): In the canonical model of the mammalian circadian system, transcription factors, BMAL1/CLOCK, drive transcription of Cry and Per genes and CRY and PER proteins repress the BMAL1/CLOCK activity to close the feedback loop in a circadian cycle. The dominant opinion was that CRY1 and CRY2 are essential repressors of the mammalian circadian system. However, this was challenged by persistent bioluminescence rhythms observed in SCN slices derived from Cry-null mice (Maywood et al., 2011 PNAS) and then by persistent behavior rhythms shown by the Cry1 and Cry2 double knockout mice if they are synchronized under constant light prior to free running in the dark (Ono et al., 2013 PLOS One). In the manuscript, the authors first confirmed behavioral and molecular rhythms in the Cry1/Cry2- deficient mice and then provided evidence to suggest the rhythms of Per2:LUC and Nr1d1:LUC in CKOs are generated from the cytoplasmic oscillator instead of the well-studied transcription and translation feedback loop: Constant Per2 transcription driven by BMAL1/CLOCK plus rhythmic degradation of the PER protein result in a rhythmic PER2 level in the absence of both Cry1 and Cry2, which suggests a connection between the classic transcription- and translation-based negative feedback loops and non-canonical oscillators. **Major points:** Line 38-39, "Challenging this interpretation, however, we find evidence for persistent circadian rhythms in mouse behavior and cellular PER2 levels when CRY is absent." The rhythmic behavioral phenotype of cry1 and cry2 double knockout mice was first documented by Ono et al., 2013 PLOS ONE, in which eight cry1 and cry2 double knockout mice after synchronization in the light displayed circadian periods with different lengths and qualities. The paper reported two period lengths from the Cry mutant mice: "An eye-fitted regression line revealed that the mean shorter period was 22.86+/-0.4 h (n= 8) and the mean longer period was 24.66+/-0.2 h (n =9). The difference of two periods was statistically significant (p, 0.01).", either of which is quite different from the ~16.5 hr period in Figure 1B of the manuscript. A brief discussion on the period difference between studies will be helpful for readers to understand. Period information from the individual mouse should be calculated and shown since big period variations exist among CKO mice (Ono et al., 2013 PLOS One).

      Thanks for this suggestion. The mice used by Ono et al were raised from birth in constant light, whereas we used mice that were weaned and raised in normal LD cycles before being subject to constant light then constant dark as adults. Instead of the somewhat subjective fitting of regression lines by eye performed by Ono et al, our analysis was performed using the periodogram analysis routine of ClockLab 6.0 with a significance threshold for rhythmicity of p=0.0001. We have now repeated this experiment with 10 adult CKO mice (male and female), and found no evidence for two period lengths in that the second most significant period was consistently double that of the first. As the reviewer suggests, there is a much broader distribution of CKO mouse periods compared with WT, as we also found in cultured cells and SCN. These new data are now reported in revised Figure S1B & C. We have also included a statement about how our study differs from Ono et al in the supplementary discussion.

      The behavioral phenotype of Cry-null mice and luminescence from their SCNs are robustly rhythmic while fibroblasts derived from these mice only produce rhythms with very low amplitudes compared with those in WT, which may reflect the difference between the SCN’s rhythm and peripheral clocks. The behavioral phenotype is supposed to be controlled mainly by SCN. However, most molecular analyses in the work were done with MEF and lung fibroblasts. These tissues may not be the best representative of the behavioral phenotype of the CKO mice.

      Behavioural rhythms of CKO mice are significantly less robust than WT, with mean amplitude less than 50% of WT controls (Figures 1A & B, revised S1B. Furthermore, as reported, 40% of CKO SCN slices exhibited PER2::LUC rhythms, compared with 100% of WT SCN slices (as also observed by Maywood et al., PNAS, 2013), and therefore are also less robust by the definition used in this manuscript.

      As now discussed in the revised supplementary discussion:

      “Circadian timekeeping is a cellular phenomenon. Co-ordinated ~24h rhythms in behaviour and physiology are observed in multi-cellular mammals under non-stressed conditions when individual cellular rhythms are synchronised and amplified by appropriate extrinsic and intrinsic timing cues.”

      The objective of this study was to understand the fundamental determinants that allow mammalian cells to generate a circadian rhythm, which we find does not include an essential role for CRY genes/proteins. Thus the cell is the appropriate level of biological abstraction at which to investigate the phenomenon, whereas the SCN and behavioural recordings simply serve to illustrate the competence of CRY-independent timing mechanisms to co-ordinate biological rhythms at higher levels of biological scale which are manifest under some conditions. To reiterate, the behavioural data supports the cellular observations, not the converse.

      Stronger evidence is needed to fully exclude the possibility that in CKO cells, the rhythm is not generated by PERs' compensation for the loss of Crys to repress BMAL1 and CLOCK. Since the rhythms of Per:LUC or Nr1d1:LUC (Figures 3D and S3E) are much weaker than those in WT, molecular analyses might not be sensitive enough to reflect the changes across a circadian cycle in the CKOs if the TTFL still occurs. CLOCKΔ19 mutant mice have a ~4 hr longer period than WT (Antoch et al., 1997 Cell; King et al., 1997 Cell). CLOCKΔ19; CKO cells or mice should be very helpful to address the question. Periods of Per:LUC and Nr1d1:LUC from the CLOCKΔ19; CKO should be similar to those in the CKO alone if the transcription feedback does not contribute to their oscillations.

      We agree this would be an interesting experiment, however the data in this manuscript and Wong et al. (BioRxiv, 2020), whilst not disputing the existence of the TTFL, strongly suggest that it fulfils a different function to that which is currently accepted and is not the mechanism that ultimately confers circadian periodicity upon mammalian cells. CLOCKΔ19 is an antimorphic gain-of-function mutation with many pleiotropic effects. Therefore, if the TTFL is not the basis of circadian timekeeping in mammalian cells, it follows that the CLOCKΔ19 mutation may not elicit its effects on circadian rhythms through delaying the timing of transcriptional activation, as was proposed. As such, whether or not CLOCKΔ19 alters circadian period of CKO cells/mice would not allow the two models to be distinguished in the way that the reviewer envisions.

      Secondly, we cannot detect any interaction between PER2 and BMAL1 in the absence of CRY using an extremely sensitive assay.

      Thirdly, very strong biochemical evidence suggests that PER has no repressive function in the absence of CRY (Chiou et al., 2016; Kume et al., 1999; Ode et al., 2017; Sato et al., 2006).

      Finally, in several figures particularly 3C and 4A, we show that PER2 peaks at the same time CKO and WT cells, but in CKO cells this is not accompanied by a coincident peak in the mRNA. Thus, even if PER were able to repress BMAL1/CLOCK without CRY, rhythms in PER2 protein level could not be explained by some residual PER/BMAL1-dependent TTFL mechanism.

      To address the reviewer’s concern however, we have employed mouse red blood cells which offer unambiguous insight into the causal determinants of circadian timing, as we can be absolutely confident that there is no transcriptional contribution to cellular timekeeping. Briefly, we took fibroblasts and RBCs from WT, short period Tau/Tau and long period Afh/Afh mutant mice. The basis of the circadian phenotype of these mutations is quite well established as occurring through the post-translational regulation of PER and CRY proteins respectively, and result in short and long period PER2::LUC rhythms compared with WT fibroblasts. RBCs do not express PER or CRY proteins, and commensurately no genotype-dependent differences of RBC circadian period were observed (Beale et al, 2020, in submission). In contrast, RBC circadian rhythms are sensitive to pharmacological inhibition of casein kinase 1 (Beale et al., JBR, 2019).

      Lines 51-52, "PER/CRY-mediated negative feedback is dispensable for mammalian circadian timekeeping" and lines 310-311, "We found that transcriptional feedback in the canonical TTFL clock model is dispensable for cell-autonomous circadian timekeeping in animal and cellular models." The authors have not excluded the possibility that the rhythmic behaviors of the CKO mice are derived from the PERs' compensation for the role of Crys in the feedback loop of the circadian clock in the SCN. In the fibroblasts, only two genes, Per2 and Nr1d1, have been studied in the work, which cannot be simply expanded to the thousands of circadian controlled genes. Also amplitudes of PER2:LUC and NR1D1:LUC in the CKOs are much lower than those in WT and no evidence has been provided to show that their weak rhythms are biologically relevant.

      The definition of a circadian rhythm (Pittendrigh, 1960) does not mention biological relevance or stipulate any lower threshold for amplitude. As now stated in the revised text (page 6):

      “PER2::LUC rhythms in CKO cells were temperature compensated (Figure 2A, B) and entrained to 12h:12h 32°C:37°C temperature cycles in the same phase as WT controls (Figures 2C), and thus conform to the classic definition of a circadian rhythm (Pittendrigh, 1960) – which does not stipulate any lower threshold for amplitude or robustness.”

      We make no claims about biological relevance or amplitude in this manuscript, which are addressed in our related manuscript (Wong et al., BioRxiv, 2020). In this related manuscript, we explicitly address whether CRY is necessary for mammalian cells to maintain a circadian rhythm in the abundance of clock-controlled proteins and find that it is not. Indeed, twice as many rhythmically abundant proteins are observed in CKO cells than WT controls, which suggests that, if anything, CRY functions to suppress rhythms in protein abundance rather than to generate them.

      We observe circadian rhythms in the activity of two different bioluminescent reporters, which have already been extensively characterised. The mouse and SCN data in figure 1 are correlative, and simply show that previous published observations are reproducible. PER2::LUC oscillations are not accompanied by Per2 mRNA oscillations. This, together with the absence of a BMAL1-PER2::LUC complex strongly argues against a model where PER2 oscillations are driven by residual (PER2-driven) transcriptional oscillations.

      We therefore concede the reviewer’s point that we “cannot exclude rhythmic behaviors of the CKO mice are derived from the PERs' compensation for the role of Crys in the feedback loop of the circadian clock in the SCN”. The reviewer will agree however, that there exists very strong biochemical evidence suggests that PER has no repressive function in the absence of CRY (Chiou et al., 2016; Kume et al., 1999; Ode et al., 2017; Sato et al., 2006); that there exists no experimental evidence to suggest that PERs can fulfil this function in the absence of CRY in any mammalian cellular context; and finally that our observations are not consistent with the canonical model for the generation of circadian rhythms in mammals.

      We have therefore amended the text to focus on CRY specifically, as follows:

      “PER/CRY-mediated negative feedback is dispensable for mammalian circadian timekeeping”

      Page 12. “We found that CRY-mediated transcriptional feedback in the canonical TTFL clock model is dispensable for cell-autonomous circadian timekeeping in cellular models. Whilst we cannot exclude the possibility that in the SCN, but not fibroblasts, PER alone may be competent to effect transcriptional feedback repression in the absence of CRY, we are not aware of any evidence that would render this possibility biochemically feasible.”

      **Minor points:** Lines 66-67, "...(Dunlap, 1999; Reppert and Weaver, 2002; Takahashi, 2016)." to "... (reviewed in Dunlap, 1999; Reppert and Weaver, 2002; Takahashi, 2016)."

      Thanks, changed as requested.

      Line 70, "...((Liu et al., 2008..." to "...(Liu et al., 2008..."

      Thanks, changed as requested.

      Lines 174-175, "Considering recent reports that transcriptional feedback repression is not absolutely required for circadian rhythms in the activity of FRQ...". Larrondo et al., 2015 paper says "however, in such ∆fwd-1 cells, the amount of FRQ still oscillated, the result of cyclic transcription of frq and reinitiation of FRQ synthesis." The point of the paper is "we unveiled an unexpected uncoupling between negative element half-life and circadian period determination." instead of "...transcriptional feedback repression is not absolutely required for circadian rhythms in the activity of FRQ,"

      This is a good point which, following discussion with Profs Dunlap and Larrondo, we have revised into “no obligate relationship between clock protein turnover and circadian regulation of its activity” – a more accurate summary of their findings.

      Lines 249-252, "CKO cells exhibit no rhythm in Per2 mRNA (Figure 3C, D), nor do they show a rhythm in global translational rate (Figure S4A, B), nor did we observe any interaction between BMAL1 and S6K/eIF4 as occurs in WT cells (Lipton et al, 2015) (Figure S4C)." In figures 3D and S3E, in CKO and CPKO cells the Per2:LUC data without fitting look better than that of Nr1d1:LUC. But the Nr1d1:LUC rhythm became clear after fitting the raw data. So to better visualize the low amplitude rhythm, if any, of Per2:LUC and compare with Nr1d1:LUC, fitted the Per2:LUC data in CKOs and CPKOs in Figure 3D and S3E should be shown as what has been done to Nr1d1:LUC.

      Thanks, these data can be found in Figure S3F. The detrended Per2:Luc CKO and CPKO bioluminescence traces were better fit by the null hypothesis (straight line) than a damped sine wave (p>0.05) and so were not significantly rhythmic by the criteria used in this manuscript.

      Lines 258-259, "much less than the half-life of luciferase expressed in fibroblasts under a constitutive promoter" In figure S4D, the y-axis of the PER2::LUC is ~800 while the y-axis of the SV40::LUC is ~600000. The over-expressed LUC by the SV40 promoter might saturate the degradation system in the cell so the comparison is not fair. A weaker promoter with the level similar to Per2 should be used to make the comparison.

      Thank you for this suggestion. In our experience, the SV40 promoter is actually a rather weak promoter compared with CMV, and faithfully facilitates the constitutive (non-rhythmic) expression of heterologous proteins such as Luciferase (Feeney et al., JBR, 2016). It has been shown previously that constitutive over-expression of heterologous proteins such as GFP or even CRY1 does not affect circadian rhythms in fibroblast cells (e.g. Chen et al., Mol Cell, 2009). To address the reviewer’s reasonable concern however, multiple stable SV40:Luc fibroblast lines were generated by puromycin selection, grown to confluence in 96-well plates, then treated with 25 μg/mL CHX at the beginning of the recording. Random genomic integration of SV40:Luc leads to a broad range of different levels of luciferase expression, evident from the broad range of initial luciferase activities. For each line the decline in luciferase activity was fit with a simple one-phase exponential decay curve (R2≥0.98) to derive the half-life of luciferase in each cell line. There was no significant relationship between the level of luciferase expression and luciferase stability (straight line vs. horizontal line fit p-value = 0.82). Therefore constitutive expression of SV40:Luc in fibroblasts does affect the cellular protein degradation machinery within the range of expression used for our half-life measurements. These new data are reported in Revised Figure S3H.

      Line 430, "sigma" to "Sigma".

      Changed

      In figure S2, the classification of rhythms in Drosophila is not clear since even the "Robustly rhythmic" ones have high background noise. Detrending or fitting the data might be able to improve the quality of the rhythms prior to classification.

      These are noisy data as they come from freely behaving flies. The mean data was shown in Figure S3A and individual examples in S3B, and look very similar to previous bioluminescence fly recordings of XLG-LUC flies in papers from the Stanewsky lab who have published extensively using this model. The classifications arose from double-blinded analysis of the bioluminescence traces by several individuals, but we agree that this was not clearly communicated in our original submission. In Revised figure S2 we now present the mean bioluminescence traces, with and without damped sine wave vs. straight line fitting, as suggested, which is more consistent with the mammalian cellular data presented elsewhere.

      In figure S3B, the original blots for Per2 including Input and IP should be shown.

      The original blots for BMAL1 are shown in figure S3I. PER2::LUC levels were assessed by measuring bioluminescence levels present on the anti-bmal1-beads, as described in the figure 3B legend.

      Supplemental information Line 44, "...(reviewed in (Lakin-Thomas,..." to "...(reviewed in Lakin-Thomas,..."

      Changed

      Line 188, "Period CDS", the full name of CDS should be provided the first time it appearances.

      Changed to “coding sequence”.

      Reviewer #2 (Significance (Required)): The work suggests a link between the TTFL and non-canonical oscillators, which should be interesting to the circadian field.

      Reviewer #3 (Evidence, reproducibility and clarity (Required)): **Summary:** The paper "CRYPTOCHROMES confer robustness, not rhythmicity, to circadian timekeeping" by Putker et al. answers the question of whether or not the rhythmic abundance of clock proteins is a prerequisite for circadian timekeeping. They addressed this by monitoring PER2::LUC rhythms in WT and CRY KO (CKO) cells. CRY forms a complex with PER, which in turn represses the ability of CLOCK/BMAL1 to drive the expression of clock-controlled genes, including PER and CRY. Consistent with previous observations, the authors found residual PER2::LUC rhythms in CKO SCN slices, fibroblasts and in a functional analogue KO of CRY in Drosophila, even in the absence of rhythmic Per2 transcription due to the loss of CRY as a negative regulator of the oscillation. They have shown that these rhythms, in the absence of CRY, follow the formal definition of circadian rhythms. They attributed these residual PER2::LUC rhythms to the maintenance of oscillation in PER2::LUC stability independent of CRY, by testing the decay kinetics of luciferase activity when translation is inhibited. Moreover, they implicated the kinases CK1d/e and GSK3 to be involved in regulating PER2::LUC post-translational rhythms through kinase inhibitor studies. They concluded that CRY is not necessary for maintaining PER2::LUC rhythms, but plays an important role in reinforcing high-amplitude rhythms when coupled to a proposed "ctyoscillator" likely composed of CK1d/e and GSK3. **Major comments:** The authors have shown sufficient data that under different testing conditions (mice locomotor activity, SCN preps or fibroblasts), behavioral rhythms and PER2::LUC rhythms are still observed in the CRY KO (CKO) cells, contrary to a previous study (Liu et al., 2007). They also indicated limitations to some of the.experimental work. However, there are some parts of the paper that need clarification to support their conclusions. 1.In Fig. 1A, the x-axes of the actograms for WT and CKO are different. While they mentioned this in the figure legend, and described the axis transformation in Fig. S1A, they need a justification statement about why they did this in the results.

      Thanks, we have included the following sentence in the results section as requested:

      “Figure 1 representative actograms are plotted as a function of endogenous tau (**t) to allow the periodic organisation of rest-activity cycles to be readily discerned; 24h-plotted actograms are shown in Figure S1A and S2A”

      2.In an attempt to show conservation of their proposed role for CRY, they tested the model system Drosophila melanogaster where TIMELESS serves as the functional analogue of CRY. While they showed in the figures and described in the text that rhythms still persisted with lower relative amplitude in the TIMELESS-deficient flies, they did not describe any period differences between WT and mutant. Showing the period quantification in Supp. Fig. S2 using the robustly rhythmic datasets, and describing this data in the text, will strengthen their claim.

      These analyses are now reported in revised Figure S2 as requested. As described in our response to reviewer 2, the “robustly rhythmic” flies were scored as such through double-blinded analysis by several individuals. We hope the reviewer will appreciate our concern that exclusion of the majority of TIMELESS-deficient flies that were not robustly rhythmic might skew their apparent period by unconscious bias towards favouring traces that most clearly resemble robustly rhythmic WT controls. To avoid any potential bias we therefore included all flies of both genotypes in the analysis of circadian period for the revised figure, as suggested by our other reviewers.

      In Fig. S2B, there is no clear distinction between the representative datasets shown for poorly rhythmic and arrhythmic, i.e. they all appear arrhythmic, without an indicated statistical test. The authors could present better representative data to better reflect the categories.

      As described above, we now show the grouped mean with and without fitting for all flies of both genotypes. The statistical test for rhythmicity and analysis of circadian period is now the same as was performed for the cellular data presented elsewhere.

      3.In Fig. 2A, the authors note the lack of rhythmicity in the CKO fibroblasts in the 1st three days at 37oC. How are the conditions here different from fibroblasts in Fig. 1E, where rhythms are seen during the 1st three days in CKO fibroblasts?

      As discussed in the manuscript, PER2::LUC rhythms in CKO cells and SCN are observed stochastically between recordings i.e. if one dish in a recording showed rhythms, all dishes showed rhythms and vice versa. The media change that occurred after 3 days in Fig 2A, in this case, was sufficient to initiate clear rhythms of PER2::LUC in all experimental replicates. In other experiments, media change did not have this effect. Herculean efforts by multiple lab members over many years, including the PI, have been unable to delineate the basis of this variability – which is discussed at length in the thesis of Dr. David Wong https://www.repository.cam.ac.uk/handle/1810/300610. As such, we clearly state in the discussion:

      “We were unable to identify all of the variables that contribute to the apparent stochasticity of CKO PER2::LUC oscillations, and so cannot distinguish whether this variability arises from reduced fidelity of PER2::LUC as a circadian reporter or impaired timing function in CKO cells. In consequence, we restricted our study to those recordings in which clear bioluminescence rhythms were observed, enabling the interrogation of TTFL-independent cellular timekeeping.”

      1. The authors claimed in the results section- "in contrast and as expected, Per2 mRNA in WT cells varied in phase with co-recorded PER2::LUC oscillations." but Fig. 3C does not show this expected lag between mRNA and protein levels. This needs to be explained

      No lag is expected in vitro. A lag between PER protein levels and Per mRNA does occur in vivo and is very likely to attributable to daily rhythms in feeding (Crosby et al, Cell, 2019), where increased insulin signalling elicits an increase in PER protein production 4-6h after E-box and GRE-stimulated increase in Per transcription.

      When luciferin is saturating intracellularly, PER2::LUC activity correlates most closely with the amount of PER2::LUC protein that was translated during the preceding 1-2h, rather than the total amount of PER2, due to the enzymatic inactivation of the luciferase protein (Feeney et al, JBR, 2016). Consistent with many previous observations, under constant conditions, the rate of nascent PER protein synthesis is largely determined by the level of Per2 mRNA, and thus more similar phases are observed between protein and mRNA in vitro than in vivo.

      We have inserted an additional citation of Feeney et al at this point in the text to make this clear.

      5.In Figs. 5A-B, the PER2::LUC periods in the CKO untreated cells seem to vary significantly between A, B, and C. While this could be due to the high variability in the rhythms that were previously described by the authors, the average periods here seem to be longer than the one reported in Fig. 1F. Are there specific condition differences?

      There are no specific condition differences. As reported in Figure S1B, D & E, the range of CKO cellular periods is simply much broader than for WT cells. Over several dozen experiments the average period was significantly shorter, but the period variance is an equally striking feature of rhythms in these cells which we take as evidence for their lack of robustness.

      *Would additional experiments be essential to support the claims of the paper?*

      1. There is sufficient experimental data to support the major claims; however some suggested experiments are listed below.

        a. If CKO exhibits residual rhythms in PER::LUC, it would be interesting to know how CRY overexpression influences PER2::LUC rhythms, or point to previous reference papers which may have already shown such effects. The prediction would be PER2::LUC levels will still be rhythmic when CRY is overexpressed. What would be the extent of "robustness" conferred by CRY on PER2::LUC rhythms based on CRY KO and overexpression studies?

      These experiments have largely already been performed (see Chen et al., Mol Cell; Nangle et al., eLife, 2014; Fan et al., Curr Biol, 2007; Edwards et al., PNAS, 2016) and are cited in this manuscript. As suggested, PER2 rhythms remain intact under CRY1 over-expression, though are clearly perturbed, but their robustness was not investigated in any detail. We hope to be able to address this important question in our subsequent work

      The authors found that CK1d/e and GSK3 contribute to CRY-independent PER2 oscillations by showing that addition of kinase inhibitors affect the PER2::LUC period lengths in WT and CKO in the same manner. It would be interesting to know if a) PER2::LUC stability and b) PER2 phosphorylation status, is affected in WT and CKO in the presence of the inhibitors, or point to previous reference papers which may already have shown such effects.

      As the reviewer points out, PER2 stability is already reported to be regulated via phosphorylation by GSK3 and CK1. We have made explicit reference to this in the revised manuscript as follows:

      “In contemporary models of the mammalian cellular clockwork CRY proteins are essential for rhythmic PER protein production, however, the stability and activity of PER proteins are also regulated post-translationally (Lee et al., 2009; Philpott et al., 2020; Iitaka et al, 2005).”

      *Are the data and the methods presented in such a way that they can be reproduced?*

      1. The protocol for the inhibitor treatments are not in the main or supplemental methods.

      In the main text methods, section luciferase recordings we state: “For pharmacological perturbation experiments (unless stated otherwise in the text) cells were changed into drug-containing air medium from the start of the recording. Mock-treatments were carried out with DMSO or ethanol as appropriate.”

      *Are the experiments adequately replicated and statistical analysis adequate?*

      1. All experiments had the sufficient number of technical and biological replicates to make valid statistical analyses. For Fig. S2, the authors used RAIN to assess rhythmicity in WT and mutant flies, but it is not clear whether the different categories (rhythmic, poorly rhythmic, and arrhythmic) were based on amplitude differences alone, or a combination of amplitude and p-values as determined by RAIN.

      As reported above, we have revised the analysis of the fly data to be consistent with the cellular data reported elsewhere in the manuscript.

      **Minor comments:** *1. Are prior studies referenced appropriately?* Authors may wish to include Fan et al., 2007, Current Biology which demonstrated that cycling of CRY1, CRY2, and BMAL1 is not necessary for circadian-clock function in fibroblasts.

      Apologies for the omission of citation to this excellent paper. Now referenced in the introduction.

      *2. Are the text and figures clear and accurate?* Figures were clear and illustrated well. See minor comments on text below:

      1. Other minor comments

      Main Text: p3, line 62; p12, line l32: It doesn't seem necessary or appropriate to cite the dictionary for the definition of robust.

      Thanks for this suggestion. During preparation of the manuscript we found that there was some disagreement between authors as to the meaning of robustness in a circadian context. We therefore feel it most necessary to define clearly what we mean by the use of this word to avoid any potential ambiguity.

      p4, line l87: "~20 h" rhythms instead of "~20h-hour" p3, line 70; p5, line 121; p14, line 380; p16, line 416 and p18, line 458: Close parentheses have been doubled in parenthetical references. p14, line 363: "crassa" instead of "Crassa" p17, line 430: "Sigma" instead of "sigma" p18, lines 464 and 483; p20, line 521: put a space between numerical values and units, to be consistent with other entries p19, line 488: "luciferase" instead of Luciferase p20, line 512: "Cell Signaling" instead of "cell signalling" p20, line 526: "single" instead of "Single"

      We thank the reviewer for his/her thoroughness, all of the above have been changed.

      Main figures: Fig. 2 p37, line 921: close parenthesis was doubled on "red"

      This was actually correct.

      Fig. 4 p41, line 989: "0.1 mM" instead of "0.1 mM" for consistency throughout text Supplementary text: line 171: "30 mM HEPES" instead of "30mM HEPES" line 184: "Cell Signaling" instead of "cell signalling" Supplementary figures: Fig. S2A "Drosophila melanogaster" instead of "Drosophila Melanogaster"

      All of the above have been changed.

      Reviewer #3 (Significance (Required)): This paper revisits the previously proposed idea that rhythmic expression of central TTFL components is not essential for circadian timekeeping to persist. However, this paper does not add a significant advance in the understanding of the underlying reasons behind sustained clock protein rhythmicity like PER in the absence of CRY, since such mechanisms in functional analogs have been shown in other systems, like Neurospora (Larrondo et al., 2015). However, this paper does clarify some issues in the field, such as discrepancies between behavioral and cellular rhythms observed in CKO mice, leading future researchers to examine closely the conditions of their CKO rhythmic assays before making conclusions pertaining to rhythmicity. The identification of the kinases as components of the proposed cytosolic oscillator (cytoscillator) needs further validation, but this is perhaps beyond the scope of the paper. The data provides incremental evidence for the existence of a cytoscillator, but opens up opportunities to identify other players, like phosphatases, to establish the connection between the central TTFL and the proposed cytoscillator.

    1. For the current generation, games may represent the bestway of tapping that sense of engagement with learning

      I wrote a facebook post about this last year that I think is relevant here.

      "It occurs to me that one of my core beliefs as a teacher is in the value of games and game like activities for learning.

      Some recent insights: I watched a student struggle with exchanging different values of money and after asking him a few questions found out that board games were not big at home. I might be about to give him my spare monopoly board if his mom is okay with it, and ask if she'll play with him as his homework: games build numeracy.

      Today I had to cover for someone and we played Swap! which is like uno but with some twists. It was a social skills class, so this was a pretty appropriate activity. Not only did were the kids good sports about it, the game requires everyone to pay attention to everyone else's moves in order to succeed, and it was fun to watch them really try to do that.

      The Payday game has helped kids understand additive inverses and adding positive and negative integers. We're still figuring out how to expand the metaphor to subtraction but we can add a die or a coin and do that too.

      We swapped out the traditional dice in shut the box for a d4 and a d12 and changed the rules so that you can do any operation you want with the two numbers you roll. Kids are excited to play.

      Kids who refuse other class activities will come up and play a math game, and will even try to learn the concept built into the game if it helps them win the game.

      (Additionally) When my class at BAMS invented the game we called Duels, we made the rules work so that everybody had to have the right answer because you never knew who was being called on. This led to kids explaining things to each other and working together. (Ask me about the rules of Duels sometime. It's an ideal game if you are popsicle stick user)."

    1. Reviewer #1:

      This paper describes the impact of outliers in normative cortical thickness (CT) measurements when examining those suffering from autism spectrum disorder (ASD). The authors used the ABIDE sample and binned subjects by age, and assessed outliers as a function of a "w-score" which they estimated across CT parcellations across the entire cortex. They then demonstrate that cortical thickness differences that can ascribed to ASD can essentially be attributed to a small number of outliers within the sample. They also demonstrate that this w-score may be sensitive to clinical variables as well.

      Overall, it is unclear to me what the exact goal of the work is: To describe the anatomy of ASD better? To subtype? Or is there another "take-home" message of this paper? I would imagine that the case-control differences in most neurodevelopmental disorders with high heterogeneity and high variability would demonstrate a similar kind of trend. And thus, at the end of the day, I am not sure how much this technique advanced our understanding of ASD.

      Issues and Questions:

      1) It is unclear from the methods how the authors deal with motion and image quality. Recent work by Pardoe and Bedford demonstrate the importance of dealing with this issue, particularly in the context of the ABIDE sample. This would likely have a significant impact on any of the results. It's unclear if the use of the Euler index at the extremes of the distribution of the dataset being used is sufficient. How did the authors come up with their Euler number cut-off?

      2) The W-score could use a much better explanation. It is not clear to me as to what it is and how this should be interpreted. The lack of information regarding the number of age-bins used also makes interpreting these findings confusing in my mind.

      3) The authors report that, "The median number of brain regions per subject with a significant p-value was 1 (out of 308), indicating that the w-score provides a robust measure of atypicality." I guess this could be true, but given the variation in normative ageing and development, I suspect this would also be true of a large number of TD children. That being the case, would it be worth doing a permutation test to determine the threshold of how man "atypical" areas one could expect by chance?

      4) The authors note "Unfortunately, despite a significant female subgroup, the age-wise binning greatly reduced the number of bins with enough data-points in the female group." I understand that this could indeed be a problem. However, I think it would be good for the authors to provide more details. Potentially a histogram to demonstrate the issue. My feeling is that with sex difference with respect to ASD, the more information that could be provided the better. Overall, it is unclear to me as to how useful a sex-specific analysis may be in this particular context given the sample sizes available in ABIDE.

      5) Results, page 8: "Because we also had computed w-scores from our normative age-modelling approach, we identified specific 'statistical outlier' patients for each individual region with w-scores > 2 standard deviations from typical norms and excluded them from the case-control analysis."

      I'm not sure I agree with the premise of this statement. First, it is hard to know without seeing all of the data, but based on Fig 1, it seems that there are ASD individuals that fall on both sides of this distribution. So if there are effect sizes that can be gleaned, this would be in spite of the variability. Second, it would be paramount to determine how many people are outliers-by-region. This, in and of itself, would be useful information. If a significant proportion of individuals can be identified as outliers, this suggests that variability is the norm rather than an exception. I'm skeptical as to whether you get interesting information from removing these individuals from analyses.

      6) Result, page 9: "While the normative modelling approach can be sensitive to different pathology." I don't think you're capturing anything interesting about pathology with this method, especially as it pertains to CT values.

      7) Result, page 9-10: I'm still confused by this notion of atypicality. Presumably this suggests that 5-10% of all ASDs are more than 2SDs from a normative distribution. But is this at both tails of the distribution? There are significant interpretational issues with this. thus, it is imperative on the authors to do a better job of describing these distributions.

      8) Part of the rationale of this paper is that using the w-score is far more robust than using simple CT values. I'm sure that residualized CT values could have been used for any of these analyses. If that were to be done how would this change the results?

      Minor comments and suggestions on presentation:

      1) While this paper has some merits, I found it hard to read. There is not a clear delineation between the methods and the results, and some methodological considerations are written into the results section and vice-versa.

      2) In the introduction, the authors use the word "deviance" to describe what appears more to me like age-related variation and heterogeneity in ASD. Deviance may be too strong a term and easily mis-interpretable. I would suggest replacing it with something a bit more like variation. Also, the work at the institution of the main author (for example by Baron-Cohen and authors) really champions the use of terms like "neurotypical" rather normally developing. I think, in general, the authors may want to take their cues from this type of language.

      3) This passage in the Introduction need of references. The work by Hong (in Boris Bernhardt's group), Bedford (in Mallar Chakravarty's group), Schuetze (in Signe Bray's group), and Meng-Chuan Lai all come to mind.

      "Even within mesoscopic levels of analysis such as examining brain endophenotypes, heterogeneity is the rule rather than the exception (Ecker, 2017). At the level of structural brain variation, neuroimaging studies have identified various neuroanatomical features that might help identify individuals with autism or reveal elements of a common underlying biology (Ecker, 2017). However, the vast neuroimaging literature is also considerably inconsistent, with reports of hypo- or hyper-connectivity, cortical thinning versus increased grey or white matter, brain overgrowth, arrested growth, etc., leaving stunted progress towards understanding mechanisms driving cortical pathophysiology in ASD."

      4) I found the Discussion missed the mark. It was mostly written as a rehash of the results, with no real biological interpretation. There is not a sufficient examination of the relationship of these findings to other important papers (Kundrakpham, Bedford, Hong, Ecker, Hyde, Lange, etc...).

      5) Figure 3 - The colour bars should be labelled.

    1. Just because something is available instantly to vision does not mean that it is available instantly to consciousness. Or, in slightly more general terms: access is not synonymous with learning. What turns access into learning is time and strategic patience.

      I think that this is really applicable to multi-tasking, even with the mundane, because we typically want to keep as many senses busy when possible (watching Netflix while exercising, eating while studying, etc.). We may be viewing something but not necessarily taking it in, as we technically cannot multitask but only switch between tasks. So in this way, it enforces the idea that multitasking doesn't allow for deep thinking or absorption. It's focus and time that allows you to actually gain something from a task, so the 'access' they talk about that may occur during multitasking is truly ineffective in the long-run. It's worth questioning why we allow ourselves to be indulged in habits that prove to be distracting and harmful to our focus.

  6. classroom.google.com classroom.google.com
    1. page 22 "Early anthropologists of language, like Sapir and Whorf , took this insight to its logical extreme when they argued that we are all, as it were locked into our cultural perspectives or 'mind-sets' and that language is the best clue we have to that conceptual universe. This observation, when applied to all human cultures, lies at the root of what, today, we may think of cultural or linguistic relativism."

    1. The use of the phrase‘especially a woman’in the earlier mentioned Supreme Court rul-ing is case and point; not only is it patronizing but it implies an imperative of modesty forwomen. The purpose is to suggest that women deserve extra protection, but by linking ofprotections to gender presentation, it creates a scenario where a court may blame a victimif it deems she has not appropriately performed femininity. In other words, recognition ofthe right to bodily integrity is made contingent upon one’s conformity to social norms,particularly with regards to gender

      This is a very powerful idea. I think by default, society as a whole tends to have a lot of sympathy for women who had been sexually abused, until we find out they had been drinking or dancing or wearing skintight clothing or even wearing limited clothing. We don't get to pick and choose when its not okay for someone to be sexually abused; it is NEVER okay to be sexually abused.

    1. According to numerous research studies, when adults hear a statement twice, they are more likely to think it is true compared with when they have heard it only once. Multiple theoretical explanations exist for this illusory-truth effect. However, none of the current theories fully explains how or why people begin to use repetition as a cue for truth. In this preregistered study, we investigated those developmental origins in twenty-four 5-year-olds, twenty-four 10-year-olds, and 32 adults. If the link between repetition and truth is learned implicitly, then even 5-year-olds should show the effect. Alternatively, realizing this connection may require metacognition and intentional reflection, skills acquired later in development. Repetition increased truth judgments for all three age groups, and prior knowledge did not protect participants from the effects of repetition. These results suggest that the illusory-truth effect is a universal effect learned at a young age.
    1. Perchance he for whom this bell1 tolls may be so ill as that he knows not it tolls for him; and perchance I may think myself so much better than I am, as that they who are about me and see my state may have caused it to toll for me, and I know not that.

      Disasters may come silently, and we may not be prepared at all, but we must face it and find a way to solve it. Just like the COVID-19 pandemic this year, in January and February, no one could have imagined that the pandemic would become so severe in the next six months.

    2. when one man dies, one chapter is not torn out of the book, but translated into a better language; and every chapter must be so translated. God employs several translators; some pieces are translated by age, some by sickness, some by war, some by justice;

      I don't believe in Catholicism, but it is obvious that such as Buddhism, Islam, Catholicism, or religious ideas are closely related to our spiritual world no matter how they are used, and can even affect our survival during a pandemic. In our world, there are too many things we cannot explain with science and logic, there are too many things we can’t stop, like the author said, diseases, wars, and so on. Faced with these disasters, we may feel helpless and insignificant. Your religious faith could be your strongest backing. If God really exists who love us unconditionally and accept us, Whether you are guilty or not. People will feel very at ease in their hearts and have the courage to face the hardships of life, and even to face death. I don't think there is heaven or hell after death, but religion can teach those who believe it not to fear death and live with confidence and happiness. Imagine if you live in the era of the Black Death, your friends and relatives around you are dying every day, perhaps only the church bells can give you some consolation. Make you believe that, no matter what, you are not alone and the pain will always pass. This might not be a way to make life happier now.

    1. Equally though, some types of pornography, for some viewers, can be hugely empowering. It may reflect our identities and experiences, help us explore our sexuality, help us exercise sexual agency and bodily autonomy,

      I think pornography also has its pros, such as empowering both men and women. It helps us understand things that we like or dislike. It helps people explore their identities.

    1. I think in the United States where we have organic solidarity in the sense we are very complex and heterogeneous, individuals' moral preferences should not play any major role in determining criminal punishment. It is, in my opinion, unfair to allow for one person's moral views impact the punishment when myself or another may have a completely different moral viewpoint on the issue.

      I agree, the United States as a whole may be considered "organic" by Durkheim's conception of solidarity. However, within the United States, there are countless communities of "mechanical solidarity," such as small towns, local governments, schools, etc.. Regarding criminal justice or (perhaps more fitting) criminal injustice, there are federal standards which apply to the entire nation, which for some smaller communities may be too forgiving or too restricting (in this sense, federal laws may protect people from possibly harsher local laws). I understand your concern around the few creating policy for the many (and I completely agree!), but state and local governments (which are more "mechanical") possess power in creating local policies and in implementing policies.

    1. It seems that only the third angle of representation need be aperson: we can represent stones with dabs of paint or letters or sounds, but we can represent things only to people.

      I do not think this is necessarily true. Take a religious sacrament for example. A person may perform a ritual or wear a certain article of clothing as a symbol, or representation, of a feeling they have towards deity. Deity is not a person, yet it is the someone/something in which something/someone is being represented. I do not think this distinction really impacts the author's argument, but rather begs the question as to why the author felt it necessary to make this statement at all when it could be challenged and in no way really supports his overall point.

    1. Reviewer #3

      Jaron and collaborators provide a large-scale comparative work on the genomic impact of asexuality in animals. By analysing 26 published genomes with a unique bioinformatic pipeline, they conclude that none of the expected features due to the transition to asexuality is replicated across a majority of the species. Their findings call into question the generality of the theoretical expectations, and suggest that the genomic impacts of asexuality may be more complicated than previously thought.

      The major strengths of this work is (i) the comparison among various modes and origins of asexuality across 18 independent transitions; and (ii) the development of a bioinformatic pipeline directly based on raw reads, which limits the biases associated with genome assembly. Moreover, I would like to acknowledge the effort made by the authors to provide on public servers detailed methods which allow the analyses to be reproduced. That being said, I also have a series of concerns, listed below:

      1) Theoretical expectations.

      As far as I understand, the aim of this work is to test whether 4 classical predictions associated with the transition to asexuality and 5 additional features observed in individual asexual lineages hold at a large phylogenetic scale. However, I think that these predictions are poorly presented, and so they may be hardly understood by non-expert readers. Some of them are briefly mentioned in a descriptive way in the Introduction (L56 - 61), and with a little more details in the Boxes 1 and 2. However, the evolutive reasons why one should expect these features to occur (and under which assumptions) is not clearly stated anywhere in the Introduction (but only briefly in the Results & Discussion). I think it is important that the authors provide clear-cut quantitative expectations for each genomic feature analysed and under each asexuality origin and mode (Box 1 and 2). Also highlighting the assumptions behind these expectations will help for a better interpretation of the observed patterns.

      2) Mutation accumulation & positive selection.

      A subtlety which is not sufficiently emphasized to my mind is that the different modes of asexuality encompass reproduction with or without recombination (Box 2), which can lead to very different genetic outcomes. For example, it has been shown that the Muller's ratchet (the accumulation of deleterious mutations in asexual populations) can be stopped by small amounts of recombination in large-sized populations (Charlesworth et al. 1993; 10.1017/S0016672300031086). Similarly a new recessive beneficial mutation can only segregate at a heterozygous state in a clonal lineage (unless a second mutation hits the same locus); whereas in the presence of recombination, these mutations will rapidly fix in the population by the formation of homozygous mutants (Haldane's Sieve, Haldane 1927; 10.1017/S0305004100015644). Therefore, depending on whether recombination occurs or not during asexual reproduction, the expectations may be quite different; and so they could deviate from the "classical predictions". In this regard, I would like to see the authors adjust their conclusions. Moreover, it is also not very clear whether the species analysed here are 100% asexuals or if they sometimes go through transitory sexual phases, which could reset some of the genomic effects of asexuality.

      3) Transposable elements.

      I found the predictions regarding the amount of TEs expected under asexuality quite ambiguous. From one side, TEs are expected not to spread because they cannot colonize new genomes (Hickey 1982); but on the other side TEs can be viewed as any deleterious mutation that will accumulate in asexual genome due to the Muller's ratchet. The argument provided by the authors to justify the expectation of low TE load in asexual lineages is that "Only asexual lineages without active TEs, or with efficient TE suppression mechanisms, would be able to persist over evolutionary timescales". But this argument should then equally be applied to any other type of deleterious mutations, and so we won't be able to see Muller's ratchet in the first place. Therefore, not observing the expected pattern for TEs in the genomic data is not so surprising as the expectation itself does not seem to be very robust. I would like the authors to better acknowledge this issue, which actually goes into their general idea that the genomic consequences of asexuality are not so simple.

      4) Heterozygosity.

      Due to the absence of recombination, asexual populations are expected to maintain a high level of diversity at each single locus (heterozygosity), but a low number of different haplotypes. However, as presented by the authors in the Box 2, there are different modes of parthenogenesis with different outcomes regarding heterozygosity: (1) preservation at all loci; (2) reduction or loss at all loci; (3) reduction depending on the chromosomal position relative to the centromere (distal or proximal). Therefore, the authors could benefit from their genome-based dataset to explore in more detail the distribution of heterozygosity along the chromosomes, and further test whether it fits with the above predictions. If the differing quality of the genome assemblies is an issue, the authors could at least provide the variance of the heterozygosity across the genome. The mode #3 (i.e. central fusions and terminal fusions) would be particularly interesting as one would then be able to compare, within the same genome, regions with large excess vs. deficit of heterozygosity and assess their evolutive impacts.

      Moreover, the authors should put more emphasis on the fact that using a single genome per species is a limitation to test the subtle effects of asexuality on heterozygosity (and also on "mutation accumulation & positive selection"). These effects are better detected using population-based methods (i.e. with many individuals, but not necessarily many loci). For example, the FIS value of a given locus is negative when its heterozygosity is higher than expected under random mating, and positive when the reverse is true (Wright 1951; 10.1111/j.1469-1809.1949.tb02451.x).

      5) Absence of sexual lineages.

      A second limit of this work is the absence of sexual lineages to use as references in order to control for lineage-specific effects. I do not agree with the authors when they say that "the theoretical predictions pertaining to mutation accumulation, positive selection, gene family expansions, and gene loss are always relative to sexual species [...] and cannot be independently quantified in asexuals." I think that this is true for all the genomic features analysed, because the transition to asexuality is going to affect the genome of asexual lineages relative to their sexual ancestors. This is actually acknowledged at the end of the Conclusion by the authors.

      To give an example, the authors say that "Species with an intraspecific origin of asexuality show low heterozygosity levels (0.03% - 0.83%), while all of the asexual species with a known hybrid origin display high heterozygosity levels (1.73% - 8.5%)". Interpreting these low vs. high heterozygosity values is difficult without having sexual references, because the level of genetic diversity is also heavily influenced by the long term life history strategies of each species (e.g. Romiguier et al. 2014; 10.1038/nature13685).

      I understand that the genome of related sexual species are not available, which precludes direct comparisons with the asexual species. However, I think that the results could be strengthened if the authors provided for each genomic feature that they tested some estimates from related sexual species. Actually, they partially do so along the Result & Discussion section for the palindromes, transposable elements and horizontal gene transfers. I think that these expectations for sexual species (and others) could be added to Table 1 to facilitate the comparisons.

      6) Regarding statistics, I acknowledge that the number of species analysed is relatively low (n=26), which may preclude getting any significant results if the effects are weak. However, the authors should then clearly state in the text (and not only in the reporting form) that their analyses are descriptive. Also, their position regarding this issue is not entirely clear as they still performed a statistical test for the effect of asexuality mode / origin on TE load (Figure 2 - supplement 1). Therefore, I would like to see the same statistical test performed on heterozygosity (Figure 2).

      7) As you used 31 individuals from 26 asexual species, I was wondering whether you make profit of the multi-sample species. For example, were the kmer-based analyses congruent between individuals of the same species?

    2. Reviewer #2

      This paper is interesting because it is studying, through a comparative genomic approach, how asexuality affects genome evolution in animal lineages while focusing on the same features. Such an extensive comparison can, in principle, distinguish the common consequences of asexuality, in contrast to previous studies that focused on few asexual species (or only one). It is interesting that the authors did not find a universal genomic feature of "asexual" species. This is a potentially important contribution to the field of the evolution of reproductive systems.

      However, I am concerned about limitations and potential biases in many of the specific genomic features analysed, and resultant difficulties in drawing any general conclusions from these analyses. For example, the heterozygosity analyses need to be more clearly explained and the potential limits of the methods used discussed further. The use of kmer spectra analyses as opposed to genome assemblies is understandable, but these are biases here that were not discussed. I am also concerned about the impact of low read quality and low coverage genomic data, and whether issues with genome assembly affect the conclusions. There are also issues about conclusions related to species of hybrid origin as there are numerous "unknown" cases and cytological data is lacking for many of the studied animal groups (therefore the authors should be cautious on the evidence of reproduction mode).

      Ideally, all the genomes of the asexual animal clades studied should have been sequenced and assembled using the same method which would make this comparative study much stronger. We realize this may not yet be practical, but the absence of such data must temper the conclusions. It is nevertheless the first article including and comparing many distinct parthenogenetic animal clades and the main result that no common universal genomic feature of parthenogenesis is, with caveats, interesting.

      Major Issues and Questions:

      1) The authors choose to refer to asexuality when describing thelytokous parthenogenesis. Asexuality is a very general term that can be confusing: fission, vegetative reproduction could also be considered asexuality. I suggest using parthenogenesis throughout the manuscript for the different animal clades studied here. Moreover, in thelytokous parthenogenesis meiosis can still occur to form the gametes, it is therefore not correct to write that "gamete production via meiosis... no longer take place" (lines 57-58). Fertilization by sperm indeed does not seem to take place (except during hybridogenesis, a special form of parthenogenesis).

      2) The cellular mechanisms of asexuality in many asexual lineages are known through only a few, old cytological studies and could be inaccurate or incomplete (for example Triantaphyllou paper of 1981 of Meloidogyne nematodes or Hsu, 1956 for bdelloid rotifers). The authors should therefore mention in the introduction the lack of detailed and accurate cellular and genetic studies to describe the mode of reproduction because it may change the final conclusion.

      For example, for bdelloid rotifers the literature is scarce. However the authors refer in Supp Table 1 to two articles that did not contain any cytological data on oogenesis in bdelloid rotifers to indicate that A. vaga and A. ricciae use apomixis as reproductive mode. Welch and Meselson studied the karyotypes of bdelloid rotifers, including A. vaga, and did not conclude anything about absence or presence of chromosome homology and therefore nothing can be said about their reproduction mode. In the article of Welch and Meselson the nuclear DNA content of bdelloid species is measured but without any link with the reproduction mode. The only paper referring to apomixis in bdelloids is from Hsu (1956) but it is old and new cytological data with modern technology should be obtained.

      3) In the section on Heterozygosity, the authors compute heterozygosity from kmer spectra analysis from reads to "avoid biases from variable genome assembly qualities" (page 16). But such kmer analysis can be biased by the quality and coverage of sequencing reads. While such analyses are a legitimate tool for heterozygosity measurements, this argument (the bias of genome quality) is not convincing and the authors should describe the potential limits of using kmer spectra analyses.

      4) The authors state that heterozygosity levels “should decay over time for most forms of meiotic asexuality". This is incorrect, as this is not expected with "central fusion" or with "central fusion automixis equivalent" where there is no cytokinesis at meiosis I.

      5) I do not fully agree with the authors’ statement that: "In spite of the prediction that the cellular mechanism of asexuality should affect heterozygosity, it appears to have no detectable effect on heterozygosity levels once we control for the effect of hybrid origins (Figure 2)." (page 17)

      The scaling on Figure 2 is emphasizing high values, while low values are not clearly separated. By zooming in on the smaller heterozygosity % values we may observe a bigger difference between the "asexuality mechanisms". I do not see how asexuality mechanism was controlled for, and if you look closely at intra group heterozygosity, variability is sometimes high.

      It is expected that hybrid origin leads to higher heterozygosity levels but saying that asexuality mechanism is not important is surprising: on Figure 2 the orange (central fusion) is always higher than yellow (gamete duplication). Also, the variability found within rotifers could be an argument against a strong importance of asexuality origin on heterozygosity levels: the four bdelloid species likely share the same origin but their allelic heterozygosity levels appears to range from almost 0 to almost 6% (Fig 2 and 3, however the heterozygosity data on Rotaria should be confirmed, see below).

      The authors’ main idea (i.e. asexuality origin is key) seems mostly true when using homoeolog heterozygosity and/or composite heterozygosity which is not what most readers will usually think as "heterozygosity". This should be made clear by the authors mostly because this kind of heterozygosity does not necessarily undergo the same mechanism as the one described in Box 2 for allelic heterozygosity. If homoeolog heterozygosity is sometimes not distinguishable from allelic heterozygosity, then it would be nice to have another box showing the mechanisms and evolution pattern for such cases (like a true tetraploid, in which all copies exist).

      The heterozygosity between homoeologs is always high in this study while it appears low between alleles, but since the heterozygosity between homeologs can only be measured when there is a hybrid origin, the only heterozygosity that can be compared between ALL the asexual groups is the one between alleles.

      Both in the results and the conclusion the authors should not over interpret the results on heterozygosity. The variation in allelic heterozygosity could be small (although not in all asexuals studied) also due to the age of the asexual lineages. This is not mentioned here in the result/discussion section.

      6) Regarding the section on Heterozygosity structure in polyploids.

      There is inconsistency in many of the numbers. For example, A. vaga heterozygosity is estimated at 1.42% in Figure 1, but then appears to show up around 2% in Figure 2, and then becomes 2.4% on page 20. It is unclear is this is an error or the result of different methods.

      It is also unclear how homologs were distinguished from homeologs. How are 21 bp k-mers considered homologous? In the method section. the authors describe extracting unique k-mer pairs differing by one SNP, so does this mean that no more than one SNP was allowed to define heterozygous homologous regions? Does this mean that homologues (and certainly homoeologs) differing by more than 5% would not be retrieved by this method. If so, then It is not surprising that for A. vaga is classified as a diploid.

      The result for A. ricciae is surprising and I am still not convinced by the octoploid hypothesis. In Fig S2. there is a first peak at 71x coverage that still could be mostly contaminants. It would be helpful to check the GC distribution of k-mers in the first haploid peak of A. ricciae to check whether there are contaminants. The karyotypes of 12 chromosomes indeed do not fit the octoploid hypothesis. I am also surprised by the 5.5% divergence calculated for A. ricciae, this value should be checked when eliminating potential contaminants (if any). In general, these kind of ambiguities will not be resolved without long-read sequencing technology to improve the genome assemblies of asexual lineages.

      7) Regarding the section on palindromes and gene conversion.

      The authors screened all the published genomes for palindromes, including small blocks, to provide a more robust unbiased view. However, the result will be unbiased and robust if all the genomes compared were assembled using the same sequencing data (quality, coverage) and assembly program. While palindromes appear not to play a major role in the genome evolution of parthenogenetic animals since only few palindromes were detected among all lineages, mitotic (and meiotic) gene conversion is likely to take place in parthenogens and should indeed be studied among all the clades.

      8) Regarding the section on transposable elements.

      The authors are aware that the approach used may underestimate the TEs present in low copy numbers, therefore the comparison might underestimate the TE numbers in certain asexual groups.

      9) Regarding the section on horizontal gene transfer.

      For the HGTc analysis, annotated genes were compared to the UniRef90 database to identify non-metazoan genes and HGT candidates were confirmed if they were on a scaffold containing at least one gene of metazoan origin. While this method is indeed interesting, it is also biased by the annotation quality and the length of the scaffolds which vary strongly between studies.

      10) Regarding the use of GenomeScope2.0.

      When homologues are very divergent (as observed in bdelloid rotifers) GenomeScope probably considers these distinct haplotypes as errors, making it difficult to model the haploid genome size and giving a high peak of errors in the GenomeScope profile. Moreover, due to the very divergent copies in A. vaga, GenomeScope indeed provides a diploid genome (instead of tetraploid).

      For A. vaga, the heterozygosity estimated par GenomeScope2.0. on our new sequencing dataset is 2% (as shown in this paper). This % corresponds to the heterozygosity between k-mers but does not provide any information on the heterogeneity in heterozygosity measurements along the genome. A limitation of GenomeScope2.0. (which the authors should mention here) is that it is assuming that the entire genome is following the same theoretical k-mer distribution.

    1. This manuscript is in revision at eLife

      The decision letter after peer review, sent to the authors on June 12, 2020, follows.

      Summary

      All three reviewers agree that the research question under study, the requirement of the cross-talk between two important developmental signaling pathways - retinoic acid and the NO - for amphioxus pharynx development, is in principle interesting and could be suitable for publication in eLife.

      However, at present there are major open concerns especially on the lack of statistical analyses, quality of data presentation and inconsistencies with previously published work, that need to be addressed. Although it is the current policy of eLife to avoid additional experiments in revisions as much as possible, this is unfortunately likely impossible to fulfil with the current manuscript in order to bring it to a level that matches the standards of eLife. However, we think that in many cases an improvement of analyses and data presentation will likely already significantly improve the manuscript.

      1) The presented study is a follow-up on a previous paper by the same lab (Annona et al 2017 ; DOI:10.1038/s41598-017-08157-w). When comparing the work of this previous study with the current manuscript two major discrepancies are apparent:

      In Annona et al the two drugs were used to inhibit NOS production: L-NAME and TRIM, while only one inhibitor was used in the present study. Furthermore, there appear to be discrepancies concerning the developmental time windows during which chemical disruption of NO signaling is effective described in the two publications. This needs to be clarified.

      The timing of NosA,B,C expression, the suggested regulation of NosA and B by retinoic acid (RA) and the detected presumptive RARE regulatory elements in the genome don't match. More specifically, NosA,B,C expression at 24 hours (or around this time point) was investigated by Annona et al, 2017. Based on these data, NosA is not expressed during development, whereas NosB and NosC are expressed. In the submitted manuscript, the authors show that NosA and NosB are upregulated upon RA treatment, whereas NosC shows no changes in expression. They therefore suggest that RA regulates NosA and NosB transcription. Since only NosB is expressed during the relevant timepoints at early development, the transcription of this gene could be under the regulation of RA. However, when the authors look into the retinoic acid response elements (RARE) in the genomic region of NosB, they only find a DR3, which is not the typical RARE. They find DR1 and DR5 (apart from DR3's), which are more typical RARE's, in the genomic region of NosA, but as mentioned this gene is not expressed during development. This makes the hypothesis of a direct regulation of NosA and NosB by RA during normal development unconvincing. Can the author dissolve these apparent discrepancies?

      2) The authors study the open chomatin structure at 8, 15, 36 and 60 hours, thus time points, which do not overlap with the drug treatment period (24-30 hours). They need to analyze the genome architecture at this time period.

      3) The previous work by Annona et al 2017 et al shows that a major peak at NO levels occurs later than the chosen treatment window. How do NO levels during the time window of the experiment compare with other studies, i.e. is there evidence these are relevant levels? This is particularly noteworthy, as there is no control experiment showing that TRIM incubation affects NO levels or NO signaling during the incubation period (e.g. DAF-FM-DA staining or by NO quantification). It is therefore not possible to estimate the specificity of the resulting phenotypes.

      We thus request from the authors to provide ISH patterns of all the Nos genes, as well as NO localisation from at least 2 timepoints (e.g. start and end of window) of the TRIM application window.

      4) One overarching critique is that the general description of the figures and hence also the phenotypes are of poor quality. An improvement of this point will already majorly improve the entire manuscript.

      Fig.1A: Indicate developmental stages (N2, N4, T1, T2, T3, L0) together with the hours-post-fertilization (hpf) to facilitate the understanding of the treatment period with respect to the development of amphioxus.

      Fig.1B: Outline pharyngeal region e.g. with thin, dashed white lines in longitudinal and cross-sections and indicate relevant anatomical structures (club-shaped gland, endostyle, gill slits) e.g. with an arrow. Is the endostyle positioned more ventrally in TRIM treated larva?

      Figure 1C: why are Cyp26.3, Rdh11/12.18 and Crabp shown in triplicates?

      Fig.1B: The 'digital sectioning' method using confocal imaging and reconstruction of nuclear stainings is not suited to characterize the phenotype. Due to the loss of signal in deeper regions, morphological structures (e.g. differences in pharyngeal and gill slit morphology, endostyl, club-shaped glands) are impossible to recognize.

      Fig.3B: the heads of these amphioxus should be annotated to indicate key structures for non-amphioxus specialists. Ideally the images should be higher magnification and resolution as well, as the morphology is currently not very clear.

      Fig.3A and B: Furthermore, the morphological differences between 'altered', 'partially recovered' and 'recovered' is unclear. Fig.3B does not help understanding changes as the pictures are too small to recognize any morphological details without staining, and no structures are indicated. It is also unclear how animals scored as 'altered', 'partially recovered' and 'recovered' differ in their morphological structures. And does 'recovered' mean that these embryos show an initial phenotype that then 'recovers' during development, or do they show a completely normal development?

      5) Missing statistics/statistical information: Lines 85-89 (Fig.1): Where is the evidence that there is reduction in pharynx length? Where is the evidence for a smaller first gill slit? Measurements with a decent sample size and a basic statistical test must be provided.

      The description of ISH pictures in Fig.2A lacks any quantification and thus any information on the penetrance of the respective phenotypes are (as in Fig 3C). The lack of any 'negative control genes' (the large set of genes that, based on the RNASeq dataset, should not be affected) make it difficult to judge how specific changes in AP axis and RA pathway genes are.

      How did the authors obtain the qRT-PCR calculations? They need to clarify how they obtained the Fold changes shown in the histograms .e.g. by showing the maths behind the result when marking the cells in the excel sheet. The raw data for rpl32 is missing for Crabp in Figure 2B. The qPCR results in Fig.2B-E lack significance tests.

      6) The RNA-Seq study needs improvements: The PCA (Fig.S1C) shows no concordance among control samples or treated samples. Also, the histogram shows a clustering of replicates, and NOT of 'treated' and 'control' samples. This casts doubts on the quality and validity of the RNASeq dataset. These doubts are not removed by the current validation experiments, as these experiments tested only significantly upregulated genes by RNA-Seq, while downregulated and non-significant genes as 'controls' are missing. These additional controls are necessary to assess the validity of the RNA-Seq data.

      7) More information about the details of the ATACseq and ChIPseq data used, as well as the general RA responsive elements prediction is required.

      For example, in what amphioxus samples (and treatments if any) are these ATACseq and ChIPseq signals seen? There is some detail provided in the Methods section, but something is odd here and perhaps needs some further explanation. Since the two relevant Nos genes are supposedly not active during development then why do they have ATACseq and ChIPseq signals from embryo and larval samples? Why should these two Nos genes have apparently active regulatory elements focused on RAREs when the genes are not normally expressed under the control of RA, but only become active when exogenous RA is applied? We may well have missed something in the logic here, but this merely shows that the current level of explanation is insufficient.

      The analysis of RA responsive elements lacks statistical analysis and depth. It is left unclear how many RAREs would be expected by chance on a 52kb resp. 25kb locus. In addition, the authors include all ATAC-Seq peaks from stages ranging between 8h and 60hpf, while the window of RA responsiveness has been tightly restricted to the 24h-30hpf window. Also, as NosC expression levels stay constant upon RA incubation, it would be crucial to know if the NosC locus lacks any open RARE sites (as would be expected).

      The authors use NHR-SCAN tool to predict putative direct repeats binding sites in the genomic sequence of NosA and NosB. Which consensus sequence does the program follow? It appears that it does not follow the consensus sequence for typical RARE ((A/G)G(G/T)TCA), since the sequence for DR1 deviate from this sequence? DR1, DR2 and DR5 are the commonly described binding RARE's for the RAR/RXR heterodimers. Further, DR8 has been described as retinoic acid dependent regulation of gene transcription through RAR/RXR (Moutier et al., 2012). The authors need to provide clarification which are the most commonly used RARE's of the DR's detected.

      Please also mention if RAREs fall within an intron in the genomic regions of the Nos genes, since the transcriptional regulation through RARE is often associated to introns.

      8) Information on the concentration dependency of compounds used in the rescue experiment is lacking. Please explain why the BMS009 concentration used here (10exp-6 M) is 10x higher than the highest concentration used in the original publication on amphioxus pharynx development (Escriva et al., Development 2002).

      9) A summary drawing of the regulatory loop between NO and RA would be informative, also indicating the known target genes (from this study).

    1. This manuscript is in revision at eLife

      The decision letter after peer review, sent to the authors on May 25, 2020, follows.

      Summary

      This work addresses the key question how the herpesvirus HSV-1 reactivates from latency in neurons and shows that neuronal excitability plays a major role for controlling latency and reactivation. How hyperexcitability might influence the behavior of a latent, neurotrophic virus was previously unknown, and the authors show that neuronal hyperexcitability induces HSV reactivation in a DLK/JNK-dependent manner. In additon, the authors identify the cytokine IL-1b as a stimulus that triggers HSV reactivation in neurons, dependent on neuronal excitability, which is also a novel finding and of great interest for the field.

      Essential Revisions

      The reviewers all agree that your work about the potential link between IL1b, neuronal hyperexcitability, and HSV-1 reactivation is very interesting. However, we think that the three experiments listed below would be needed to substantiate the conclusion regarding the link between these three elements.

      1) To make sure that the results obtained with the inhibitors are not off-target effects, experiments with KO cells or siRNA knockdowns of DLK/JNK would strengthen the manuscript. Can you please specify in the manuscript the specific targets of the three inhibitors that were used - if they have discrete mechanisms of action, off-target effects may actually not be a problem. However, KO or knockdown experiments would validate the inhibitor results by an independent method and should be doable in these cultures.

      2) To substantiate the very interesting finding with IL1b, an experiment with a neutralizing IL1b antibody should be performed to unequivocally show that IL1b induces reactivation (this would exclude that impurities in the cytokine batch such as LPS activate the cells).

      3) To unequivocally show that IL1b induces reactivation through increasing neuronal hyperexcitability, calcium flux, which is induced by neuronal hyperexcitability, should be measured. A simple method to do this would be the use of Fura-2 AM or similar dyes. An advantage of this approach is that it could be measured what percentage of neurons are excited upon IL1b treatment and this could be correlated with the percentage of neurons that reactivate. This could also be performed in the presence of IL1b neutralizing antibodies to confirm that this cytokine induces neuronal hyperexcitability and HSV-1 reactivation.

      These three additional experiments would make the report more robust and elegantly correlate hyperexcitability of neurons with HSV-1 reactivation.

    1. It’s true that studies have found that readers given text on a screen do worse on recall and comprehension tests than readers given the same text on paper.

      Like I have previously said I find that I understand something so much more having it physically in my hands. But I never knew that studies have backed this up. I think this may be a problem we face in the future as digital books are becoming more and more common while many times physical books are not chosen.

    2. The Internet may cause our minds to wander off, and yet a quick look at the history of books suggests that we have been wandering off all along.

      This section of the reading strikes me as rather interesting. A lot of times we hear from people, especially the older generation that technology is such a nuisance. In reality, I don't think we as humans have ever been able to fully devote our focus on one thing or another, regardless of technology or not. So while the Internet is definitely much more prominent these days, and offers so much to do, the concept of getting distracted is not technology's fault on its own.

    1. But it is at the strategic level where the effects of this erosion of military ethics may be the most dangerous. To take one important example, Wong and Gerras were frequently told that the readiness assessments of partner forces in Iraq and Afghanistan were an example of ethical deception. These critically important assessments rated the ability of Iraqi and Afghan forces to fight on their own, without U.S. assistance. Yet these ratings usually depended more on the U.S. rotational unit deployment cycle than on the actual capabilities of those partner forces. In other words, partner units received low ratings when a new U.S. unit arrived, better ratings over time, and high ratings right before that unit left – only to plummet once again when a new unit arrived. This rollercoaster annual cycle would almost seem comical were it not for the fact that U.S. strategy in both Iraq and Afghanistan rested heavily on turning over the battlefield to these very same local national forces.

      Personally, I think this article is pretty absurd, there findings are no where near method based. They could not have possibly analyzed the fullest extent of research on the strategic or operational level. The tactical level explanation I thought was pretty standard which is typical coming from intellects. On this operational, but more so strategic interpretation, when I look at it they point to the U.S. military as carving out weak assessments for their allies and adversaries. I mean, I am sorry but the Afghan and Iraqi forces are just objectively horrible at their military tactics. If you read the book "Armies of Sand" by Kenneth Pollack we see that the Arab militaries are just inferior and that is nothing against them but they just do not have a superior command structure to the United States military. We are not in an ethical dilemma as most realist would state, I am more on the American Exceptionalism argument of this debate so this study is subpar and lacking.

    1. Thespecies that we rely on for food and shelter are a tiny proportion of total biodiversity, and most humans live in— and rely on — areas of only moderate biodiversity, not the Amazon or the Congo Basin

      But we also need to think about the porpotion of biodiveristy that depends on our tiny proportion of species that we rely on for food and shelter While we may not actively use areas of high biodiverity such as the amazon or congo for consturctuing high rise buildings and homes, we are instead still having a huge impact on the env through deforestation and industrialized agriultracal processes.

    1. I think we could freshen up the way we express central beliefs borne of experience about adolescent literacy with some selective appropriation. Such an orientation might play strongly with the general public and allow literacy scholars and practitioners to have a louder voice on literacy policy issues; it might also empower our literacy policy advisories while allowing us to lean deeper into the constructed and highly political science of reading. Given the ongoing and impressive advances in the life sciences, their productive and challenging impact on the social sciences and humanities, and their probable if belated impact on education theory, research, and practice, biological and ecological idioms and narratives may be an interesting and useful way to reframe adolescent literacy development.

      Topic: The author focuses on the relation between science and adolescent literacy. The influences that science has brought can advance the and contribute towards literacy, and education as a whole. Science had accomplished many achievements and I think the author wants to achieve the same thing for literacy. The author suggests a goal for science research to enhance and pave the way for reading in order to reframe its development.

    1. The view that literacy always involves social and cultural elements[

      I think this is important to understand when we consider varying levels of literacy among different groups of people. For example, if we were living in the mid-20th century, literacy discrepancies would be very great between states which have a long history of public education such as Massachusetts and others such as Tennessee which were only then fully adopting public education. These kind of discrepancies may seem bad to us today, but we must always consider the cultural context, Tennessee being an agricultural state primarily while New England was steeped in an educational tradition dating back to the Puritans with an economy of the kind necessitating such emphasis on education.

    1. Reviewer #2:

      In this work cognitive assessment after isoflurane anaesthesia shows that several cognitive domains are impaired in speed of response and accuracy but dynamics of recovery are not the same for all domains. Specifically, tests related to executive functions recovered faster than others, against the authors' expectations.

      These results are important as they help to understand the dynamics of recovery of the cognitive systems after being challenged pharmacologically. The dynamics of a complex system (the brain) coming back to functioning in full is assessed both cognitively and neurally.

      I think this paper requires some clarifications, some more analyses and further discussion. One important result is the assessment of the dynamics of cognitive recovery after unconsciousness and its parallels with local and global complexity measures. As I was reading the paper I thought there would be a combined analyses to address the dependencies between complexity measured before, in unconsciousness and ROC to the behavioural outcomes. How does the level of complexity before even getting sedated or the complexity reached during unconsciousness influences the degree or speed of recovery? Please let me know if this sounds too post-hoc for you since it feels like an important and meaningful question to pose to the data for me.

      Am I correct in interpreting that you have calculated the LZC over the global topography? It would be important to clarify this point, differentiate from the other variant, and reflect that in the theoretical interpretation to avoid misunderstanding and subsequent unnecessary criticism. Two different variants of LZ complexity have been described: one that quantifies local, channel-wise complexity (LZS/LZSUM) and one that quantifies the complexity of the global topography of the scalp over time (LZC). These two variants appear to occasionally track different aspects of consciousness (Comsa 2018, thesis and Schartner et al., 2017). Specifically from Comsa's thesis "To compute the Lempel-Ziv complexity of EEG data, the concatenation of a signal consisting of channel values over time can be performed either channel-by-channel or observation-by-observation, where an observation consists of the values of all channels at a single point in time. The interpretation of the two complexity flavours is slightly different: the former case reflects the local, temporal signal diversity in individual channel values over time, whereas the latter captures the spatial diversity of the global landscape of neural activity. In some of the above studies, a different flavour appears to have worked best in different contexts: for example, the spatial variant in anaesthesia (Schartner et al., 2015), and the temporal variant in psychedelic states (Schartner et al., 2017). These different interpretations have not been thoroughly explored so far and it is not clear which variant best fits with the original theoretical framework that indicates neural information diversity as a key element for the emergence of consciousness".

      It would be a good idea to ask the question of no differences between cognitive scores before isoflurane and after several hours (three hours?), and compare to the control group in a statistically robust manner. If the aim is to claim full return-to-normal then a test to trust the no-difference would offer the answer. Please consider a statistical model that allows you to test the "return to normal" of cognitive capacities appropriately, maybe a Bayesian framework like the NLMM used but including some measure of the trust in the no-differences. It may be that the authors consider the CI values enough, in that case please express the results in terms of strength of these?

      I think a rerun of the stats asking for the effect size or bayes factor or any other parameter that would allow for an impression of the strength of the effect would go a long way in interpreting the results. Currently there seems to be a reliance on the p value (in the text), that does not reflect the strength of an effect.

      Further to this, supplementary material with the single subject dynamics of recovery would paint a true picture of the variance and variability of the results. We have gained great insight about the differential impact of sedatives in the last few years in the transition of consciousness. Here a couple of examples:

      https://www.pnas.org/content/110/12/E1142 https://www.sciencedirect.com/science/article/pii/S1053811920301142#bib68 and even one of our own https://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1004669

      In particular you might want to take a look at a recent reanalysis of our data of mild sedation by Bola and collaborators (https://www.biorxiv.org/content/10.1101/444281v2.full ) where they analyse the eeg using measures of diversity and complexity that are particularly relevant for the interpretation of your results.

      In the discussion there is the need for a section where the theoretical justification for the use of PE and LCZ. How is this better or complementary to power, connectivity and other measures used in EEG to discuss consciousness and sedation needs to be addressed so the readers get a more contextualised picture of why using these measures may shield better results, why they may be better for interpretation of the loss, maintenance and recovery of consciousness.

    1. Reviewer #2:

      Sherman et al seek to understand the basis of human time perception using a combination of psychophysics, computational modeling, and fMRI. This work builds on previously published work by the same group (Roseboom, Nature Communications 2019) showing that integrated changes in the state of (a) deep image classification network(s) during the presentation of movies predicted aspects of human timing reports. In that study, similar to what is shown in the current manuscript, timing biases were found in human behavior for different movie scene types, for example, city, natural scenes, or offices. Interestingly, similar biases were found in the timing estimates produced by their integrated deep network state change procedure. They interpret these findings as evidence that estimates of duration are derived from changes in the state of perceptual networks, in this case presumably those involved in visual perception. I find this previous work to be an important contribution toward understanding how the brain constructs information about a fundamental dimension of the environment for which there are no obvious sensors.

      In the current study, the authors repeat many of the steps contained in the previous publication, but in the context of humans estimating the duration of silent movies while positioned in an MRI scanner. They compute BOLD signals during movie viewing using a set of techniques I am not intimately familiar with because I do not use MR to assess brain activity in my own research, but which seem standard from what I can tell. They then treat the voxel by voxel BOLD measures similarly to the manner they did nodes in the deep network, and show that estimates derived from visual cortices may correlate with human biases and effects of scene type, but not those estimates derived from voxels in auditory or somatosensory cortices. While I have some technical questions, I find the work to be overall well reasoned and clearly presented. My major issue with the paper has to do with the fact that given their previous publication already showed that human behavior exhibits timing biases that correlate with the rate of change in visual scenes, and what we know about the localization of modality specific sensory function in cortex, it would be worrying if they could not derive time estimates from a measure of neural activity in visual cortex. It seems that the core hypothesis they are testing has to do with whether one can extract a measure of change in visual scenes from BOLD signals recorded in the visual cortex. Finding that one can indeed do so doesn't seem particularly surprising and thus represents a relatively incremental advance relative to what was known before. In terms of novelty, what we are left with then is the observation that the use of different metrics on BOLD changes per voxel to estimate elapsed time differ with respect to their ability to reproduce timing biases by scene type. However, clarification is needed regarding how they compute these metrics to fully assess the importance of these differences.

      The authors state that they compute Euclidian distance between voxel activations from TR to TR. However, it looks like they are computing the L1 norm of the differences, or the manhattan/city block distances. Which is it?

      Why should the sum of signed differences provide a different result? Is it that in the distance measurement, noise is accumulated in the measure over voxels whereas in the signed difference this noise is canceled out by averaging? Some amount of intuition would be helpful.

      Writing level comments:

      4) Regarding the framing and discussion of the experiments, I am not sure why the authors see their results as incompatible with and not complementary to some of the existing proposals for time encoding in the brain. For example, the impact of sensory change on responses in perceptual networks might very well have an influence on dynamics of downstream neural populations, potentially through neuromodulators, so I don't see the obvious incompatibility. This is not to say that the authors are not addressing an important problem, namely why does sensory change bias timing reports.

      For example, I think this statement is a bit inaccurate and unnecessary:

      "...This end-to-end account of time perception represents a significant advance over homuncular accounts that depend on "clocks" in the brain. "

      5) I wouldn't say their work represents an "end to end" account of time perception, and certainly not an end to end account of the behavior they are studying. What happens in more naturalistic situations where people are moving, and taking in other sensory modalities? How does this time perception information get transformed into the behavioral report of individuals, for example? The authors don't need to over-reach for the work to be interesting. The authors would also seem to be implying that the previously cited studies assume a specialized clock somewhere, where in fact Tsao et al and Soares et al at least are explicitly saying the opposite, and from my perspective the field views the idea of explicit "clocks" as a bit antiquated, and rather that timing is an emergent property of the functions that neural circuits are optimized to perform... an idea that seems compatible with the authors' work.

    1. Reviewer #3:

      This is the largest study of DNA methylation differences in the blood of controls and patients with psychosis, performed in a sample of 4,483 participants. As is predictable, the authors found significant differences in measures of blood cell proportions and smoking exposure in patients with psychosis compared with controls, and in patients with schizophrenia with clozapine treatment compared with other patients. They also detected differentially methylated positions in such comparisons. The authors have employed an appropriate methodology to search for schizophrenia- and psychosis- associated methylation changes, and the manuscript is interesting and well-written. However, I think a more extensive analysis may increase our insight about DNA methylation differences in schizophrenia, and is therefore necessary.

      1) An important question is whether the methylation differences are pre-existing the disorder or a consequence, an epiphenomenon of the disorder. The fact that the authors detect a higher number of DMPs when they exclude individuals with first episode psychosis from their analysis could suggest that the methylation differences are not present before the onset of the disorder. However, the authors have the resources and the ability to better answer this question. For example:

      1a) I think they should report in a separate section the results in the two samples of FEP individuals compared with age-matched controls. Can they identify any FEP-specific DMP?

      1b) Also, I think they could try to integrate their data with other blood methylation datasets, to see whether the DMPs associated with psychosis/schizophrenia have been associated with environmental risk factors associated with schizophrenia. For example, the authors could check the overlap of the DMPs with blood methylation changes associated with gestational age (PMID: 32114984; this work contains references to other studies that may be useful too). Data on methylation and cannabis or other environmental factors, if available, may be useful too.

      1c) The authors could also explore, in patients and controls, the relationship between age and methylation of the DMPs. An increase of the differences between patients and controls in older ages would suggest that the methylation differences are related to factors that are secondary to the disorders, while the presence of methylation differences at younger ages could suggest the opposite. Analyzing the interaction between methylation and age on case-control status could be an alternative way to answer this question.

      2) Sex is an important biological variable that the authors could analyze more extensively, considering that being male is a risk factor for schizophrenia, and is associated with a different epigenetic regulation. The authors have already the statistics to analyze whether the psychosis/schizophrenia-associated DMPs are also associated with sex. Moreover, they could analyze the interaction between methylation and sex on case-control status and/or perform analyses stratified by sex.

      3) The authors did not find association of schizophrenia with age acceleration. However, a recent study has performed a comprehensive analysis of 14 epigenetic clocks categorized according to what they were trained to predict: chronological age, mortality, mitotic divisions, or telomere length. I think it is relevant that the authors try to validate and perhaps extend the findings of Higgis-Chen and coll. ("Schizophrenia and Epigenetic Aging Biomarkers: Increased Mortality, Reduced Cancer Risk, and Unique Clozapine Effects", PMID: 32199607).

      4) Adjustment: I have not found any clear information about ethnicity/race. I assume the samples were mainly composed by white Caucasians. Did the authors perform any adjustment for ethnicity/race or population stratification? Also, were principal components of negative control probes included as covariates?

      5) Replication: was there any replication at the level of DMP in the data from Montano et al.? Also, if many DMPs are under genetic control, we should expect an overlap between DMPs in blood and brain of patients with schizophrenia. Have the authors analyzed such overlap?

      6) I think the authors should be more cautious in interpreting the clozapine data. They write: "Studies have also shown that higher neutrophil counts in schizophrenia patients correlate with a greater burden of positive symptoms (Núñez et al., 2019) suggesting that variations in the number of neutrophils is a potential marker of disease severity(Steiner et al., 2019). Our sub-analysis of treatment-resistant schizophrenia, which is associated with a higher number of positive symptoms (Bachmann et al., 2017), found that the increase in granulocytes was primary driven by those with the more severe phenotype, supporting this hypothesis." Actually, the fact that TRS cases are characterized by a significantly higher proportion of granulocytes could be related a "recruitment bias": because clozapine administration is associated with a risk of agranulocytosis, clozapine is usually not prescribed to patients with low number of granulocytes. I think this possibility needs to be mentioned, unless the authors can exclude it.

    1. The challenge was to think of behavioural implications of moving to a new, more shorter distance rule. Here is a short summary of points made, and questions generated that we do not have the research evidence for yet (perhaps a study on these would prove useful?)Issues raised:People may not accurately perceive distances (especially under different conditions)—if they underestimate, 2m has a buffer than 1m would notThe change from 2m to 1m could undermine compliance and rule-adherence (because the rule has changed)—especially if there are more changes made.1m is close to a (regular) socially-appropriate distance taking into consideration personal boundaries—as such, it could signal that everything is back to normal (but also, the distance varies depending on how close the contact is)The rule might be perceived as a 'normal' vs. 'not normal' conditionMedia discussion on this appears to be mostly based on the physical sciences—how far droplets can travel, and infection rates
    1. Black Joy & Accountability: As a future teacher, fighting for injustice may appear like a tall and overwhelming order. However, I am humbled and inspired to take part in the effort to create a better world. And I agree that there is joy to be gleaned from this effort. Analogously, teachers may be underpaid and undervalued and overworked, so I think one must find joy in the vocation until the educational survival complex is dismantled. So in the meantime, we must hold ourselves to a "level of accountability that focuses on justice, love, healing, and restoring humanity" (122).

    Annotators

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reviewer 1

      __*Review 1 Summary:

      __In this manuscript, Borah et al showed that Heh2, a component of INM, can be co-purified with a specific subset of nucleoporins. They also found that disrupting interactions between Heh2 and NPC causes NPC clustering. Lastly, they showed that the knockout of Nup133, which does not physically interact with Heh2, causes the dissociation of Heh2 from NPCs. These findings led the authors to propose that Heh2 acts as a sensor of NPC assembly state. *

      __Reviewer 1 major comment 1:__ The authors claimed that Heh2 acts as a sensor of NPC assembly state, as evidenced by their finding that Heh2 fails to bind with NPCs in nup133 Δ cells (Fig2, Fig 5). However, there is a possibility that the association between Heh2 and NPCs is merely affected by the clustering of the NPCs (as the authors discussed) but not related to the structural integrity of NPC.

      • *

      Our Response: We agree that this is a possibility, however, we ask the reviewer to also consider that we artificially cluster NPCs using the anchor away system (Figure 3C) and this does not affect Heh2’s association with NPCs. Thus, clustering per se is insufficient to disrupt Heh2 binding to NPCs. We will also make changes in the text to make this point.

      • *

      Reviewer 1 major comment 2: In addition, their data showing that the Heh2-NPCs association is not easily disrupted by knocking out the individual components of the IRC (Fig. 5A and 5D), also disfavor the idea that Heh2 could sense NPC assembly state.

      Our Response: There are three considerations here. The first is that as this is the first evidence of any kind of “NPC assembly state” sensor, it is difficult to make any assumptions as to what specifically such a sensor would be monitoring. i.e. perhaps sensing only the ORC is what is functionally important. Second, for obvious reasons, we only tested non-essential IRC nups so by definition there is inherent functional redundancy that maintains NPC function and thus there may be no need to “sense” anything in the absence of these IRC nups. Further (and last), the IRC is essential for NPC assembly. Thus, without an IRC there is no NPC assembly state to sense.

      Reviewer 1 major comment 3: Since some nup knockout strains, other than nup133 Δ, are also known to show the NPC clustering (ex. nup159 (Gorsch JCB 1995) and nup120 (Aitchison JCB 1995; Heath JCB 1995)), it will be worth trying to monitor the localization of Heh2 and its interaction with nucleoporins (by Heh2-TAP) using these strains. While Nup159 is a member of the cytoplasmic complex, Nup120 is an ORC nucleoporin. Thus, biochemical and phenotypical analysis using these mutant cells will be useful to clarify if the striking phenotypes the authors found are specific to nup133 knockout strain (or ORC Nup knockouts) or could be commonly observed in the strains that show NPC clustering. Another interesting point is that Nup159 shows strong interaction with Heh2, even in nup133Δ cells. As the authors mentioned, Nup159-Heh2 interaction may not be sufficient for Heh2-NPC association, but it could be important for NPC clustering.

      Our Response: These are excellent points and we agree that there is a need to more thoroughly explore how NPC clustering driven by abrogating the function of other nups impacts Heh2’s association with NPCs. Thus, in a revised manuscript, we would examine Heh2’s association with NPCs in several additional genetic backgrounds where NPCs cluster.

      Reviewer 1 major comment 4: Figure 4C: Is it known that rapamycin treatment in this strain did not affect the protein levels of nucleoporins? Otherwise, the authors should confirm this by western blotting (at least some of them).

      Our Response: This is a good point and we will directly address this with Western blotting of some nups.

      Reviewer 1 major comment 5: Figure 5: The authors mentioned (line 256-257) that "in all cases the punctate, NPC-like distribution of Heh2-GFP was retained (Fig 5D)". However, nup107 KO strain seems to show more diminished punctate staining as compared with other strains. To clarify this, the authors should express mCherry tagged Nup as in Fig. 2 or Fig. 3.

      Our Response: Yes, we agree and in fact this observation is consistent with the fact that there is an ER-pool of Heh2 observed in this strain and we observe loss of nup interactions in the affinity purification. We will include a more thorough quantification of this in a revised manuscript and more directly address this in the text.

      **Minor comments:**

      Reviewer 1 minor comment 1: Figure 4A and 4B: The authors should show Scatter plot as in Fig. 2 and Fig. 3.

      • *

      We will include this in a revised manuscript.

      Reviewer 1 minor comment 2: Figure 5C: Explanations of the arrowheads is missing in the figure legend.

      Thank you for pointing this out, it will be fixed in a revised manuscript.

      Reviewer 1 minor comment 3: Figure 6: Is there any information as to where Heh2 (316-663) is localized in the cell?

      As this truncation lacks INM targeting sequences, it is found throughout the cortical ER. The determinants of Heh2 targeting (including truncations) has been extensively evaluated in King et al. 2006, Meinema et al., 2011 and Rempel et al. 2020. We will make this clearer in the revised manuscript.

      Reviewer 1 minor comment 4: Figure 6B: Nucleoporins should be marked with color circles as in Fig. 1 and Fig. 5.

      This will be done.

      Reviewer 2

      Borah et al. present a biochemical and cell biological examination of the inner nuclear membrane (INM) protein Heh2 and its putative interactions with the nuclear pore complex (NPC). The potential conceptual advance of this study is that Heh2 interacts with the NPC, while mutations believed to trigger NPC mis-assembly are shown to abolish interaction with Heh2, leading to the hypothesis that Heh2 is a sensor for NPC assembly states within the (INM). The conclusions would undoubtably be of broad interest to the nucleocytoplasmic transport field, but the evidence provided thus far is insufficient to build confidence and consequently this manuscript is premature for publication.

      Our Response: We thank the reviewer for recognizing the potential for a significant conceptual advance for the field but object to the notion that the work is “premature for publication”. This is a highly subjective statement that does not seem to meet the mission or purpose of the Review Commons platform. While it is possible that some of the conclusions drawn in our manuscript might not be fully supported by the data in its current form, there is a substantial body of work here that is certainly publishable.

      Reviewer 2 major comment 1: The TAP-tag Heh1/Heh2 pulldowns are the most significant experiment presented, and on face value provide compelling evidence that Heh2 interacts with the NPC. It is stated that mass spectroscopy (MS) was used to confirm the identities of the labeled bands yet there is no methods section, nor any MS data reported in the manuscript. Given the large number of unspecified proteins observed in these gels, and the single-step pulldown methodology used, knowledge of the contaminants present may aid in elucidating how Heh2 pulls down NPC components. Consequently, within the supplementary materials, the authors must indicate which regions of the gel were excised for MS analysis and provide a table listing all of the proteins that were detected for each sample, including the number of unique/expected peptides observed. Our Response: This was a major oversight on our part and a revised manuscript will contain all relevant details with regards to the MS analysis including a more detailed description of the excised bands and the quantification of spectra derived from these bands.

      Reviewer 2 major comment 2a: The representative micrographs provided across Figures 2, 3, 4, 5 and 6 are very noisy. Particularly in the case of the mCherry labeled nucleoporins, this is both unusual and unfortunate given this is used to infer colocalization of Heh2 with the NPC.

      Our Response: These micrographs are not unusual and are in fact of respectable quality. We agree that the apparent “noise” is unfortunate, but this is simply a reality of the yeast system. We remind the reviewer that there are only ~100 to ~200 NPCs per budding yeast nucleus, which is an order of magnitude smaller than a typical mammalian cell nucleus. Further, the copy number of yeast nups per NPC is half of the mammalian cell NPC. Further, budding yeast are spherical with a cell wall that is extremely effective at scattering light; they are also highly autofluorescent (particularly in the red channel). Lastly, unlike in mammalian cells, budding yeast NPCs are mobile on the nuclear envelope. Thus, co-localization is challenging (particularly with the long exposures required to obtain good images). This is why clustering of NPCs driven by nup133**∆ cells has provided one of the key assays in the field to assess whether a given protein associates with NPCs at the level of light microscopy.

      Reviewer 2 major comment 2b: As a result it is unclear whether this experiment can be used to differentiate between NPC colocalization vs. nuclear envelope colocalization.

      Our Response: The reviewer is correct. Co-localization between Heh2-GFP and any Nup-mCherry is insufficient to assess NPC association in WT cells. In fact, as we point out in Figure 3B, at best one can expect a correlation of r = 0.48 for two well established nups. Thus, to further support the conclusion that Heh2 associates with NPCs, we established the Nsp1-FRB NPC clustering assay (Figure 3).

      Reviewer 2 major comment 2c: The authors should include negative controls for an alternative NE membrane protein that doesn't bind the NPC, which would be expected to exhibit a reduced level of colocalization with NPC proteins when compared to Heh2. For example, Heh1 would be a suitable, given the clear-cut negative pulldown data and its prior usage as a negative control in Figure 4.

      • *

      Our Response: This is included in Figure 3D.

      Reviewer 2 major comment 3a. Figure 2. The rim staining for the Nup82-mCherry in the WT background is unusually punctate, bringing into question the viability of the cells imaged.

      Our Response: As the middle cell in the panel is undergoing cell division, these cells are clearly viable. All our imaging is performed on mid-log phase cultures.

      • *

      Reviewer 2 major comment 3b. Why has ScNup82, a cytoplasmic filament component, been selected for colocalization experiments when Heh2 is proposed to interact with the inner ring complex?

      Our Response: The resolution of a conventional light microscope is, at best, 200 nm in x, y. As NPCs are 100 nm in diameter, even two NPCs side-by-side cannot be resolved. The IRC is tens of nm away from the cytoplasmic filaments thus any nup is relevant for a co-localization analysis with a light microscope.

      Reviewer 2 major comment 3c: Additionally, the experiments shown in panels A and C are not directly comparable, ScNup82 is an asymmetric cytoplasmic nucleoporin, while SpNup107 is located in the Y-shaped Nup84 nucleoporin complex and present on both faces of the NPC. This experiment should be repeated with scNup84 to match panel C, additionally a viability dot spot assay and western blot analysis of the labeled proteins should be conducted.

      Our response: These are in fact directly comparable within the limits of resolution of light microscopy as described above. Viability assays are not required here as both nups are essential and perturbation to their function would lead to inviability.

      Reviewer 2 major comment 4: Figure 3, the authors use yeast strains where proteins are tagged with FRB and FKBP12 domains, which dimerize upon the addition of rapamycin inducing NPC clusters. The authors then observe the effect this has on Heh2 NPC colocalization. However, Rapamycin may also have an effect independent from the induced dimerization event. Negative controls should be performed in strains lacking the FRB and FKBP12 tagged proteins to demonstrate that Rapamycin doesn't modify Heh2 localization independently of NPC clustering.

      Our response: This is a good point and important control that we performed in prior studies, see Colombi et al., JCB, 2013. We will be more explicit in describing that this control has been done.

      Reviewer 2 major comment 5: Figure 4. The authors provide a qualitative description of the colocalization presented, while in all other instances they calculate a Pearson correlation coefficient. This is significant because Heh2 appears to be evenly distributed within the NE of the DMSO control (panel B). Given the presented hypothesis isn't colocalization expected with Nup192? As a minimum, a Pearson correlation coefficient analysis should be conducted and added to Figure 4.

      Our response: This will be included in a revised manuscript.

      Reviewer 2 major comment 6: Figure 4. Pom152-mCherry localizes at both the NE and strongly within the cytoplasm, which is unexpected given typical rim staining phenotypes observed previously for both Pom152-YFP and Pom152-GFP strains (Katta, ..., Jaspersen et al., Genetics (2015) & Upla, ..., Fernandez-Martinez et al., Structure (2017), respectively). Given the unusually weak rim staining observed throughout, viability assays of the strains listed in Table S1 and protein expression analysis of the tagged nucleoporins via western blot is necessary.

      Our response: This is not localization in the cytoplasm but is in fact autofluorescence from the yeast vacuole. We regret we were not more explicit in describing this and we will make the manuscript more accessible for the non yeast expert. In order to perform the Western blot analysis for all strains requested by the reviewer would require a battery of antibodies to the endogenous proteins to directly assess how tagging influences nup levels, which we do not have (nor does anyone else that we are aware of). This is also not standard practice in the field as it is an onerous and unnecessary burden.

      Reviewer 2 major comment 7:* Figure 5A. The TAP-tagged pulldowns from ∆Pom152 and ∆Nup133 strains appear to be from a different round of experiments than the previous deletion strains presented. Interestingly, there appears to be an additional band at approximately 250 kDa in both cases that is not present in any other experiments. This band could be a contaminant observed due to different experimental conditions, or a protein that exclusively binds to Heh2 in the ∆Pom152 and ∆Nup133 background. Either way the authors should identify this protein with MS to address this ambiguity.

      *

      Our response: We will include negative controls for these specific experiments to show that this is a non specific band.

      Reviewer 2 major comment 8: Figure 6B. Please label the nucleoporin bands in the TAP-tagged pulldowns.

      Our response: This will be done.

      Reviewer 2 major comment 9: Figure 6D. Please specify Heh2-GFP clustering in the y-axis.

      Our response: As this represents both Heh2-GFP and heh2-1-570-GFP, we will keep it as is to avoid confusion.

      Reviewer 2 major comment 10: *Under the results section titled 'Heh2 binds to specific nups in evolutionarily distant yeasts', the authors state that spHeh2 co-purifies with "several specific species". The meaning is unclear, this sentence should be rephrased and the specific species clearly described. **

      *

      Our response: Ok.

      Reviewer 2 major comment 11: Under the results section titled 'Heh2 fails to interact with NPCs lacking Nup133', the authors refer to a Pearson correlation coefficient of -0.03 as a clear anticorrelation. Instead state there was no correlation.

      Our response: Ok.

      Reviewer 2 major comment 12: In the discussion, the authors state that "clustering itself may sterically preclude an interaction with Heh2". The text should be expanded to explain this in more detail, it is not clear from the presented data why this would occur.

      Our response: Ok.

      Reviewer 2 comment on significance: the manuscript is premature for publication.

      Our Response: Such a statement has no relevance to this form of review as a decision as to whether a study is premature for publication should be made by journal editors, not reviewers. We would argue quite strongly that we have definitively shown that Heh2 binds to NPCs, that it does so in multiple evolutionarily distant yeasts and that this binding is functionally relevant. For example, we can specifically disrupt the association of Heh2 with NPCs with a specific domain deletion and observe a loss of function phenotype (e.g. NPC clustering). What all three reviewers agree on is that the concept of a “NPC assembly state sensor” needs additional data to be fully supported, although we note that this reviewer did not provide any suggestions for how we might achieve this goal. We further note that we added the qualifier “may” into the title of the work. Thus, we will therefore perform additional experiments as outlined in comments to Reviewer 1 to support this conclusion in order to introduce this as a new concept in the field.

      Reviewer Comment from Cross Commenting: It seems to me that all reviewers agree that the manuscript is premature for publication. The data thus far do not support the conclusion that Heh2 may be an NPC assembly sensor nor does it provide any mechanistic insight. Reading the comments of the other two reviewers makes me more negative, as it is care that the paper also lacks scientific rigor. The manuscript is a great starting point for a rigorous dissection but I do not see this paper to be a candidate for a broad impact journal.

      Our Response: The statement that this manuscript is premature for publication is an opinion and does not seem to reflect the sentiment of the other reviewers. It is also confounding that this reviewer suggests that this work lacks rigor. With the exception of the omission of the MS analysis (our fault), the data are of high quality and rigorously quantified. Our assertion of rigor and data quality is based on our collective team’s many decades-long history of publishing and reviewing papers at the highest levels in this field. Questions as to the quality of the data as stated by this reviewer (and only this reviewer) in fact address limitations of light microscopy and the yeast system more generally in this one respect.


      Reviewer 3

      Reviewer 3 Summary part a*: This is quite an interesting manuscript that explores the relationship between an INM protein, Heh2, and NPCs. It represents an extension of earlier work performed by this group in which it was shown that the HEH2 gene shares genetic interactions with the genes encoding various nucleoporins. Heh2 belongs to an intriguing family of conserved proteins that includes its orthologue, Heh1, as well as human MAN1 (LEMD3) and LEMD2, among others. Each of these proteins contains two transmembrane domains with the N- and C-terminal regions extending in to the nucleoplasm. The two TM domains are separated by a short lumenal loop.

      In this study, the authors show that a population of Heh2 is associated with Nups of the NPC inner ring complex. This was demonstrated initially in pulldown experiments. The authors go on to show that when NPCs are caused to aggregate, by physical tethering employing an FKBP/FRP system in combination with Rapamycin, Heh2, but not Heh1, colocalizes with the NPC clusters. *

      • *

      Our Response: Thank you to the reviewer for recognizing the value of this work.

      • *

      Reviewer 3 Summary_b. Although not stated explicitly in the manuscript, this would imply that there is a population of Heh2 that resides in the NPC membrane domain, with the remainder in the INM. As an idle question, is there any evidence for a similar localization of MAN1 or LEMD2 in mammals? I am guessing probably not.

      Our Response: We regret this was not made more clear but the idea that there is a pool of Heh2 at the POM and a pool at the INM is an important conclusion of the work and was stated in the results - we’ll re-emphasize in the revised discussion. As to whether MAN1 or LEMD2 has a similar NPC association, we hypothesize that MAN1 but not LEMD2 will indeed interact with NPCs in mammalian cells. This is based on considering that we show that both the budding and fission yeast orthologues of MAN1 share this association so unless it was lost in evolution, this is a likely outcome of future studies.

      Reviewer 3 Significance statement a: The complications arise when the authors show that an alternative method of NPC aggregation (although they did this first), involving Nup133 deletion, results in failure of Heh2 to co-aggregate. In other words, Nup133 is required for the association of Heh2 with NPCs. The issue here is that there is no evidence for an interaction between Heh2 and Nup133, and furthermore that loss of Nup133 (a Y complex component of the outer ring complex) leaves the inner ring complex intact.

      • *

      Our Response: We tested the nup133Δ background first as this is the standard approach for assessing NPC-association of a given protein so we felt this would be logical for a reader in the field. Further, while the disruption of Heh2’s binding by loss of Nup133 may be a complication, we prefer to see it as an opportunity for discovery. As described in our manuscript, we have chosen to interpret this result in the context of a new biological function/concept with Heh2 being a novel “NPC assembly state” sensor. While one could argue that we have not fully met this bar yet, we will perform additional experiments as outlined in our response to reviewer 1 to help support this compelling conclusion.

      • *

      Reviewer 3 Signfiicance statement b: What is clear, however, is that Heh2 seems to be required to inhibit NPC aggregation since Heh2 deficient cells exhibit NPC clusters. The association between Heh2 and IRC Nups resides in the C-terminal nucleoplasmic winged helix domain. The N-terminal domain, in contrast confers INM localization.

      • *

      Our Response: We agree.__*


      Reviewer 3 Signfiicance statement c I must admit, I am in two minds about this manuscript. The data clearly show that Heh2 is associated with IRC components and I agree with the authors that this protein may well have a role in NPC assembly quality control perhaps in the guise of a chaperone. However, I find it hard to come up with a convincing model for the effects of Nup133. On the one hand, one could make an argument that the data presented here is too preliminary and fails to provide a complete story. On the other hand, it does provide an intriguing foundation for future studies and I do feel positively disposed towards it. In short, I have no fundamental complaints about the science, I am just uncertain as to whether the study is ready for publication.

      Our Response: This statement nicely articulates the challenge with this manuscript as there are some solid findings (that Heh2 binds specifically to NPCs etc.) but also a provocative finding (that loss of Nup133 breaks Heh2’s interaction with NPCs despite not physically interacting). Thus, there is a decision to be made about whether there is value in introducing a novel concept to the field once additional data is provided in a revised manuscript.

      Reviewer 3 Cross commenting: I have no fundamental disagreements with either of the other two reviewers. The comment from Reviewer#2 summarises this quite neatly. While I have fewer concerns about the quality of the data as presented, I think we all agree that at best the study is preliminary. What the authors need to do is to construct a coherent model that will account for the observations described here and then to design experiments that will test this model. I'm not suggesting that they must have a complete story, but they do need to go beyond what is in the current manuscript.

      • *

      Our Response: We appreciate that the reviewer does not have any questions about the quality of our data, but we argue that we have in fact presented the most coherent interpretation of the data as it currently stands. As described above, we intend to attempt to solidify this model by performing experiments suggested by reviewer 1.



      Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting. Reply to the Reviewers I thank the Referees for their...Referee #1__

      1. The authors should provide more information when... Responses__

      The typical domed appearance of a hydrocephalus-harboring skull is apparent as early as P4, as shown in a new side-by-side comparison of pups at that age (Fig. 1A). Though this is not stated in the MS

      1. Figure 6: Why has only... Response: We expanded the comparisonMinor comments:__

      2. The text contains several... Response: We added... Referee #2__

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      This is quite an interesting manuscript that explores the relationship between an INM protein, Heh2, and NPCs. It represents an extension of earlier work performed by this group in which it was shown that the HEH2 gene shares genetic interactions with the genes encoding various nucleoporins. Heh2 belongs to an intriguing family of conserved proteins that includes its orthologue, Heh1, as well as human MAN1 (LEMD3) and LEMD2, among others. Each of these proteins contains two transmembrane domains with the N- and C-terminal regions extending in to the nucleoplasm. The two TM domains are separated by a short lumenal loop.

      In this study, the authors show that a population of Heh2 is associated with Nups of the NPC inner ring complex. This was demonstrated initially in pulldown experiments. The authors go on to show that when NPCs are caused to aggregate, by physical tethering employing an FKBP/FRP system in combination with Rapamycin, Heh2, but not Heh1, colocalizes with the NPC clusters. Although not stated explicitly in the manuscript, this would imply that there is a population of Heh2 that resides in the NPC membrane domain, with the remainder in the INM. As an idle question, is there any evidence for a similar localization of MAN1 or LEMD2 in mammals? I am guessing probably not.

      Significance

      The complications arise when the authors show that an alternative method of NPC aggregation (although they did this first), involving Nup133 deletion, results in failure of Heh2 to co-aggregate. In other words, Nup133 is required for the association of Heh2 with NPCs. The issue here is that there is no evidence for an interaction between Heh2 and Nup133, and furthermore that loss of Nup133 (a Y complex component of the outer ring complex) leaves the inner ring complex intact. What is clear, however, is that Heh2 seems to be required to inhibit NPC aggregation since Heh2 deficient cells exhibit NPC clusters. The association between Heh2 and IRC Nups resides in the C-terminal nucleoplasmic winged helix domain. The N-terminal domain, in contrast confers INM localization.

      I must admit, I am in two minds about this manuscript. The data clearly show that Heh2 is associated with IRC components and I agree with the authors that this protein may well have a role in NPC assembly quality control perhaps in the guise of a chaperone. However, I find it hard to come up with a convincing model for the effects of Nup133. On the one hand, one could make an argument that the data presented here is too preliminary and fails to provide a complete story. On the other hand, it does provide an intriguing foundation for future studies and I do feel positively disposed towards it. In short, I have no fundamental complaints about the science, I am just uncertain as to whether the study is ready for publication.

      REFEREES CROSS COMMENTING

      I have no fundamental disagreements with either of the other two reviewers. The comment from Reviewer#2 summarises this quite neatly. While I have fewer concerns about the quality of the data as presented, I think we all agree that at best the study is preliminary. What the authors need to do is to construct a coherent model that will account for the observations described here and then to design experiments that will test this model. I'm not suggesting that they must have a complete story, but they do need to go beyond what is in the current manuscript.

    1. The Genesis stories provide two ethical alternatives, dominion and stewardship-both of which are anthropocentric. They do not explicitly acknowledge anthropocentric ethics, such as ecocentrism in which humanity is only one of a number of equal parts-an ecocentric ethic, nor is biocentrism a possibility, in which value is grounded in life itself, rather than being centered in humanity. But another form from of ethics is the partnership ethic I propose that posits nature and humanity as equal, interacting, mutually responsive partners. This ethic combines human actions and nature's actions in a dynamic relationship with each other. Here nature is not created specifically for human use, nor are women and animals seen as helpmates for "man." Rather, human life and biotic life exist in mutual support, reciprocity, and partnership with each other. Gardens could exemplify places in which the practice of gardening is a caretaking of the soul and the life it generates.

      There are two narratives about the origin, fall and reinvention of the Eden Garden, called Recovery Narratives. These two narratives have strongly influenced the relationship between human beings and nature. I think it's important to mention that both the Christian Narrative and the Environmentalist narrative seek to recover the lost, paradise, the Garden of Eden. However, the conceptions of what the garden (enclosure) is, and what you want to recover (relative to its extent) differs from one narrative to another. The Gilgamesh story we read the previous week may be related to the change of conception of ''recovering the lost.''

      Rooted in Genesis l, the Christian Narrative is the most influential rooted in Western culture. Is a traditional biblical narrative of the Fall from the Garden of the Eden, the guilt is charged to women and men is the agent to transform and savior with intention to redeem and recovered the garden by recreating the Eden in Earth with the possibility to exercise power and control over everything around them. Is the narrative that supports exploitation of nature to benefit human being and their cause, gender inequity.

      The environmentalist narrative follows what it is written in Genesis ll, God creates the man from dust, then The Eden Garden is made, followed by 4 rivers and trees for food, woman becomes partner of man. The landscape of this narrative is more abundant, fertile, rich. Human beings, animals and nature coexists in harmony and abundance. The Eden landscape is river based, spring-fed, everything to maintain abundance. The decline of the Eden is slow, and the way how male and female intend to recover it has an ecological vision. Nature is a victim of exploitation but also the main benefactor of the recovery of Eden.

      In summary Genesis l as ethical model is defined by human dominion, and Genesis ll as ethical model it's about stewardship.

      In this case Gilgamesh's story is a good example for relating the objective of the Christian Narrative as an ethical model. Or the human dominion over nature. Where the main benefactor is the human being, and the exploitation of the earth and what is obtained from it is merely for the satisfaction of ''humanity'' and ''civilization.'' Eden on earth is depicted in the ''walled kingdom of Gilgamesh'' and the ''clearing and appropriation of the forest'' which possesses the benefits given by nature, water, food, shelter, light, wealth.

      Andrew, George. The Epic of Gilgamesh, Penguin Group. 1999

    1. On page 4, the section that begins with "The mother of the Puetro Rican child..."particulary stood out to me as an adoptee myself. I found that my parents did this, reading all they could about Chinese adoptees, and reaching out to other parents. They tried to find the most information they could about the subject and flooded my sister and I with different articles, resources, Asian media, etc. as we grew older.

      This was intriguing to me because I think in this "Getting Ready" stage we have to understand that even when we try to find information about a certain group of people, not everyone in the group has the same experiences.

      Being someone who has experienced this from the point of view of the child in the situation given in this reading, I think although it is important to educate yourself on different minority/marginalized groups of people, there also must be an understanding that not all experiences are the same. As the person in the group, there also must be an understanding that there is good intent though.

      In my experience, I didn't relate fully with everything my parents would share on adoption or Chinese culture, and often felt a bit of "imposter syndrome," feeling as though I did not know enough to be considered a "true Asian," but also wondering if I indeed did fit in more with the white kids around me. My parents and those around me went through the getting ready and reaching out stages, but without fully understanding how my experiences with Asian culture or adoptee culture may be different from those they were reading about, sharing with me, or asking me about.

      I think that Harro makes good points about educating and seeking out exposure, however I think we need to think about this through an intersectional lens, and through the understanding not all people in a specific marginalized group have the same exposure/experiences.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reviewer #1 (Evidence, reproducibility and clarity (Required)): The manuscript by Huh et al. reports that oxidative stress causes fragmentation of a specific tyrosine pre-tRNA, leading to two parallel outcomes. First, the fragmentation depletes the mature tRNA, causing translational repression of genes that are disproportionally rich in tyrosine codon. These genes are enriched for those involved in electron transport chain, cell cycle and growth. Second, the fragmentation generates tRNA fragments (tRFs) that bind to two known RNA binding proteins. Finally, the authors identify a nuclease that is needed for efficient formation of tyrosine tRFs. Comment 1: Th­­­­e authors should include a short diagram indicating the various known steps of pre-tRNA fragmentation (perhaps as a supplement) for general readers.

      Response: We thank the reviewer for their suggestion. Pre-tRNA fragmentation is still an unknown field but an initial introduction is best seen from pre-tRNA processing where there is a cleavage event for pre-tRNAs with an intron. This is a complex subject but a recent review from Hopper and Nostramo has done an excellent job in in describing the current field in yeast and vertebrate species (Hopper and Nostramo, Front. Genet., 2019). We have added this citation and new text in the manuscript about pre-tRNA processing for general readers to follow up on. We feel that a supplementary figure might be a bit too brief in describing the knowns and unknowns of pre-tRNA processing and fragmentation.

      Comment 2: I find the enrichment for mitochondrial electron transport chain (ETC) curious. The ETC includes several oxidoreductases, which may be rich in tyrosine as it is a common amino acid used in electron transfer. The depletion of the tyrosine tRNA from among many tRNAs under oxidative stress may not be incidental but related to an attempt by the cell to decrease oxygen consumption to avoid further oxidative damage. The authors could further mine their data to corroborate this hypothesis. For example, are the ETC genes among the targets of the RNA binding proteins targeted by tyrosine tRFs? This could potentially connect the effects of mature tRNA depletion and tRFs.

      Response: We thank the reviewer for this very interesting comment and insight, which had not occurred to us. The relationship between this response and oxidoreductase regulation could be a factor in both the tRNA and tRF modulations seen in our cells. Interestingly, we find that many oxidoreductases genes (such as the NDUF family) are bound by hnRNPA1 by CLIP. In new data, we have done stability experiments with the tRF (new Fig 7E-F) to show the regulon of hnRNPA1 is modulated with overexpression and LNA against the tRF, revealing that this tRNA fragmentation response modulates expression of certain oxidoreductase genes. However, we do not see clear and significant differences for ETC genes in particular. As hnRNPA1 is known to act as both a promoter and destabilizer of genes depending on context, it is likely that further and more detailed work will be needed to parse this hypothesis out in future studies.

      Comment 3: In figure 4A, the authors should provide the tyrosine codon content of the overlap genes and show how much it differs from a randomly selected sample.

      Response: We have identified an error in our manuscript where the overlap actually identifies 109 proteins rather than the 102 reported in the original manuscript. We apologize for this oversight. As for the overlap proteins, we plotted the downstream proteins detected in the proteome by mass spectrometry based off on Tyr-codon content. As explained in the text, the targets we tested were chosen for having higher than median levels of Tyr-codon, as seen in the histogram, and for showing some of the greatest reduction after Tyr tRNA-GUA depletion (Fig S4A). The other proteins found in the overlap will fall in a similar pattern along the histogram.

      Comment 4: Fig.6F, lower panel: the model should show pre-tRNA, as opposed to mature tRNA, because it is the former that is fragmented.

      Response: We apologize for the confusion. The model in Fig 7F was supposed to denote the pre-tRNA with the trailer and leader sequences intact initially, then lost with processing to mature tRNA. To make it clearer, we have now labeled the first species as “Pre-tRNA.”

      Reviewer #1 (Significance (Required)): This study is comprehensive and novel, and includes several orthogonal and complementary approaches to provide convincing evidence for the conclusions. The main discovery is significant because it presents an important advance in post-transcriptional control of gene expression. The process of tRF formation was previously thought not to affect the levels of mature tRNA. This study changes that understanding by describing for the first time the depletion of a specific mature tRNA as its precursor form is fragmented to generate tRFs. Finally, the authors identify DIS3L2 as a nuclease involved in fragmentation. This is also an important finding as the only other suspected nuclease, albeit with contradictory evidence, is angiogenin. Collectively, the findings of this study would be of interest to a broad group of scientists. I only have a few minor comments and suggestions (see above).

      Response: We thank the reviewer for their very positive and insightful comments and feedback.

      REFEREES CROSS-COMMENTING I have the following comments on other reviewers' critiques. Regarding the concern that the disappearance of the pre-tRNA could be a transcriptional response (reviewer 2), I think that the appearance of tRFs makes this scenario unlikely. If pre-tRNA levels decreased due to transcriptional repression, wouldn't one expect that both tRNA and the tRF levels diminish concomitantly? Reviewer 3 raises the issue of cross hybridization in Northern blots. The authors indicate that they "could not detect the other tyrosyl tRNA (tRNA Tyr AUA) in MCF10A cells by northern blot..." (page 6). Also, they gel extracted tRFs and sequenced them (figure S6B), directly identifying the fragments. I think these findings mitigate the concern of cross hybridization and clearly identify the nature of tRFs. Finally, I think that the codon-dependent reporter experiment (figure 5D) addresses many issues surrounding codon dependent vs indirect effects. In that experiment, the authors mutate 5 tyrosine codons of a reporter gene and demonstrate that the encoded protein is less susceptible to repression in response to oxidative stress.

      Response: We thank the reviewer for their tremendous insights. We are in agreement regarding the three points in the cross-comments.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)): This very interesting study from Sohail Tavazoie's lab describes the consequences of oxidative stress on the tRNA pool in human epithelial cell lines. As previously described, the authors observed that tRNA fragments were generated upon exposure of cells to ROS. In addition, the authors made the novel observation that specific mature tRNAs were also depleted under these conditions. In particular, the authors focused on tyrosyl tRNA-GUA, which was decreased ~50% after 24 hours of ROS exposure, an effect attributable to a decrease in the pre-tRNA pool. Depletion of tyrosyl tRNA resulted in reduced translation of specific mRNAs that are enriched in tyr codons and likely contributed to the anti-proliferative effects of ROS exposure. In addition, the authors demonstrated that the tRFs produced from tyr tRNA-GUA can interact with specific RNA binding proteins (SSB and hnRNPA1). The major contribution of this paper is the novel finding that stress-induced tRNA fragmentation can result in a measurable reduction of specific mature tRNAs, leading to a selective reduction in translation of mRNAs that are enriched for the corresponding codons. Previously, studies of tRNA fragmentation largely focused on the functions of the tRFs themselves and it was generally believed that the mature tRNA pool was not impacted sufficiently to reduce translation. The findings reported here therefore add a new dimension to our understanding of the cellular consequences of stress-induced tRNA cleavage. Overall, the data are of high quality, the experiments are convincing, and the conclusions are well supported. I have the following suggestions that would further strengthen the study and bolster the conclusions. Comment 1: The authors have not formally demonstrated that the reduction in pre-tRNA in H2O2-treated cells is a consequence of pre-tRNA cleavage. It is possible that reduced transcription contributes to this effect. Pulse-chase experiments with nucleotides such as EU would provide a tractable approach to demonstrate that a labelled pool of pre-tRNA is rapidly depleted upon H2O2 treatment, which would further support their model. Since the response occurs rapidly (within 1 hour), it would be feasible to monitor the rate of pre-tRNA depletion during this time period in control vs. H2O2-treated cells.

      Response: We thank the reviewer for their suggestion and agree that testing for a transcriptional effect using a pulse-chase experiment would further support these findings. We are grateful to both reviewer 1 and reviewer 2 in the cross-comments for recognizing that the tRNA repression response we see is too rapid to be a transcriptional response and that the fact that this tRNA depletion response occurs concomitantly with the tRF generation supports our model that this is a pre-tRNA fragmentation response. It would be of interest for future studies to also examine the impact of cellular stress on tRNA transcription.

      Comment 2: To what extent is the growth arrest that results from H2O2 treatment attributable to tyr tRNA-GUA depletion (Fig. 3A)? Since the reduction in tRNA levels is only partial (~50%), it should be feasible to restore tRNA levels by overexpression (strategy used in Fig. 3E, S3B) and determine whether this measurably rescues growth in H2O2-treated cells.

      Response: We thank the reviewer for their suggestion. Originally, we had also thought of this experiment and attempted to test this hypothesis. Upon experimentation, we ran into technical challenges that prevented us from drawing any conclusions. The problems were that we were unable to develop a cell line that stably overexpressed the Tyr tRNA-GUA and had to settle for a transient overexpression that only lasted for a couple of days (Fig S3B). For transient transfection, we used Lipofectamine 3000 (Invitrogen) that has associated cell toxicities and requires a control RNA transfection in lipofectamine. In addition, H2O2 in itself is a stress. The simultaneous occurrence of these two stresses led to a combination of cell death and cell growth for the control and experimental group. Given the high variability, we were unable to draw any conclusions on cell growth with this combination. We hope to identify a way to stably overexpress Tyr tRNA-GUA in the future to address this hypothesis.

      Comment 3: Knockdown of YARS/tyr tRNA-GUA resulted in reduced expression of EPCAM, SCD, and USP3 at both the protein and mRNA levels (Fig. 4C-D, S4C). In contrast, H2O2-exposure reduced the abundance of these proteins without affecting mRNA levels (Fig. 5A-B, S5A). The authors should comment on this apparent discrepancy. Perhaps translational stalling induces No-Go decay, but it is unclear why this response would not also be triggered by ROS.

      Response: We would like to clarify that out of the three genes in Fig. S5A, only EPCAM mRNA levels were significantly reduced with H2O2-exposure while no changes were observed in the mRNA levels of USP3 or SCD. It is difficult to ascertain the reason for EPCAM mRNA reduction but one hypothesis is due to timing and steady state levels. Levels of mRNAs seen with knockdown of YARS or tRNA represent steady state levels where mRNA decay and transcriptional changes can be easily seen. Following H2O2, the data is collected at 24 hours, which may be before mRNA effects can be fully appreciated. We have edited the text to clarify the uncertainty involved. We agree with the reviewer’s insightful comment and find these differences to be interesting and will consider them in future studies to better understand the interplay between translation and mRNA levels in the context of tRNA depletion.

      Comment 4: In addition to the analyses of ribosome profiling in Fig. 5E-F, it might also be helpful to show a metagene analysis of ribosome occupancy centered upon UAC/UAU codons (for an example, see Figure 2 of Schuller et al., Mol Cell, 2017). This has previously been used as an effective way to visualize ribosome stalling at specific codons. Additionally, do the authors see a global correlation between tyrosine codon density and reduced translational efficiency in tRNA knockdown cells?

      Response: We thank the reviewer for their important suggestion. We have expanded the analysis to look at codon usage scatterplots across all codons for shTyr and shControl replicates (Fig S5D). The 5 most changed codons are labeled with UAC, a codon for the tyrosine amino acid, being the most affected (red arrow). Consistent with our model, a tyrosine codon, when at the ribosome A-site, is most affected with depletion of the corresponding tRNA. The text has also been edited to reflect our new analysis providing further evidence that ribosomal stalling could occur upon depletion of this tRNA. The gray outline around the regression line represents the 95% confidence interval.

      Fig S5D

      As seen in Fig 5F, a significant overlap was noted for genes with the lowest translational efficiency and tyrosine enrichment. We did further analysis to test if a direct and linear relationship exists between tyrosine codon density and reduced translational efficiency on the global scale (i.e. does more stalling occur with more tyrosine codons on a global scale). We again see that a reduced translational efficiency is significantly correlated with tyrosine codon enrichment (above median parameters) in the tRNA knockdown ribosome profiling data. However, our analysis on a direct relationship between codon density and translational efficiency is inconclusive. This analysis is limited given the sequencing depth and number of experimental replicates available and we lack the statistical power to draw strong conclusions. To prevent overstating our claims, we have omitted any conclusions regarding this second analysis.

      Comment 5: MINOR: On pg. 4, the authors state that tRF-tyrGUA is the most highly induced tRF, but Fig. S1B appears to show stronger induction of tRF-LeuTAA.

      Response: The reviewer is correct in that the data from Fig S1B shows Leu-tRFs with higher induction. Our text was meant to suggest we focused on tRF-TyrGUA due to higher band intensity seen on northern blot validation. We have edited the text in the manuscript to clarify this.

      Reviewer #2 (Significance (Required)): The major advance provided by this work is the demonstration that stress-induced tRNA cleavage can reduce the abundance of the mature tRNA pool sufficiently to impact translation. Moreover, the effect on mature tRNAs is selective, resulting in the reduced translation of a specific set of mRNAs under these conditions. These findings reveal previously unknown consequences of oxidative stress on gene expression and will be of interest to scientists working on cellular stress responses and post-transcriptional regulation.

      Response: We thank the reviewer for the kind comments and feedback.

      REFEREES CROSS-COMMENTING Regarding the concern that the disappearance of the pre-tRNA could be a transcriptional response (reviewer 2), I think that the appearance of tRFs makes this scenario unlikely. If pre-tRNA levels decreased due to transcriptional repression, wouldn't one expect that both tRNA and the tRF levels diminish concomitantly? Here is what I was thinking: The generation of tRFs does not generally result in reduction in levels of the mature tRNAs. So you can imagine a scenario where oxidative stress causes tRF generation from the mature tyr tRNA (which does not impact its steady-state levels), as is the case for other tRNAs. At the same time, decreased transcription would reduce the pre-tRNA pool, leading to a delayed reduction in mature tRNA, as observed. However, looking back at the data, I see that after only 5 min of H2O2 treatment, the authors observed reduced pre-tRNA and increased tRFs (Fig. 2A). This seems very fast for a transcriptional response, which would presumably require some kind of signal transduction. In addition, when you consider the amount of tRFs produced in Fig. S2C, it is hard to imagine that this would not impact the mature tRNA pool if they were derived from there. So I agree that the transcriptional scenario seems unlikely. Nevertheless, I think that looking at pre-tRNA degradation directly with the pulse-chase strategy would strengthen their story, so I would like to give the authors this suggestion. However, I am fine with listing this as an optional experiment which would enhance the paper but should not be essential for publication.

      Response: We thank the reviewer for these insightful comments. As mentioned above, five minutes is likely too rapid for a transcriptional response to be the main effect of H2O2 on Tyr-tRNA GUA. Moreover, the concomitant appearance of the tRF at this time-point makes tRNA fragmentation the most parsimonious and likely explanation rather than transcriptional repression, which would not cause a tRNA fragment to occur concurrently. Moreover, extraction and sequencing of the tRF shows it likely derives from the pre-tRNA as a 5’ leader sequence is present. We appreciate the reviewer’s suggestion and scholarly willingness to reassess their own hypothesis.

      Reviewer #3 (Evidence, reproducibility and clarity (Required)): The major findings in this manuscript are: 1.) Oxidative stress in human cells causes a decrease in tyrosine tRNA levels and accumulation of tyrosine tRNA fragments; 2.) The depletion of tyrosyl-tRNA synthetase or tyrosine tRNAs in human cells results in altered translation of certain genes and reduced cell growth and 3.) hnRNPA1 and SSB/La can bind tyrosine tRNA fragments. There is also preliminary evidence that the DIS3L2 endonuclease contributes to the appearance of tyrosine tRNA fragments upon oxidative stress. Based upon these results, the Authors conclude that tyrosine tRNA depletion is part of a conserved stress-response pathway to regulate translation in a codon-based manner. **Major comments:** Comment 1: There is a considerable amount of data in this paper and the experiments are performed in a generally rigorous manner. Sufficient details are provided for reproducing the findings and all results have been provided to appropriate databases (RNA-Seq and ribosome profiling).

      Response: We thank the reviewer for the positive comments and feedback.

      Comment 2: The manuscript uses a probe against the 5' half of Tyrosine tRNA for Northern blotting. However, tRNA probes can be prone to cross-hybridization, especially with some tRNA isoacceptors being similar in sequence. Thus, the blots in Figure 2 and Supplemental Figures should be probed with an oligonucleotide against the 3' half of tRNA-Tyr. This will confirm the pre- and mature tRNA-Tyr bands detected with the 5' probe. Moreover, this will determine whether 3' tRNA-Tyr fragments accumulate.

      Response: We agree that the reviewer is correct in suggesting that the 3’ tRNA-Tyr might also accumulate. However, we disagree that any accumulation of the 3’ tRF might be relevant in our particular model for multiple reasons. As supported by reviewer 1’s cross-comments, cross-hybridization between isoacceptors (GUA vs AUA) would be unlikely as Tyr-AUA could not even be detected by the initial 5’ tRF probe. Additionally, the sequences for Tyr-GUA are different with no nucleotide alignment from Tyr-AUA. Furthermore, the extraction and sequencing of the 5’ tRF (Fig S6B) confirms the 5’ leader sequence unique to the pre-tRNA (also noted by reviewer 1). While the 3’ half of many Tyr-GUA are similar, we find selective binding of our RNA binding proteins only to the 5’ tRF. The 3’ tRF may play some role in binding to other proteins in cell regulatory pathways but such experiments would be outside the scope of this study.

      Comment 3: The analysis of the proteomic and ribosome profiling experiments seem rather limited, or based upon what was presented in this manuscript. If additional analyses were performed, then they should be included as well, even if they yielded negative results. For example, the manuscript identifies 102 proteins that decrease after tRNA-Tyr depletion and YARS-depletion with a certain threshold of Tyr codon content. We realize the Authors were trying to find potential genes that are modulated under all three conditions. However, this does not provide information whether there is a relationship between a certain codon such as Tyr and protein abundance if only binning into two categories representing below and above a certain codon content. The Authors should plot the abundance change of each detected protein versus each codon and determine the correlation coefficient. This analysis is important for substantiating the conclusion of a codon-based system of specifically modulating transcripts enriched for certain codons. Otherwise, how could changes in tRNA-Tyr levels modulate codon-dependent gene expression if two different transcripts with the same Tyr codon content exhibit differences in translation? Moreover, this analysis should be performed with all the other codons as well.

      Response: We have identified an error in our manuscript where the overlap identified 109 proteins and not 102 as reported previously. We apologize for this oversight. While the reviewer is correct in that identifying codon dependent changes for all 3500+ proteins detected would offer greater insight, our study was specifically focused on tyrosine as we observed this tRNA to become depleted and our experimental system modulated this specific tRNA. As for the second point on Tyr tRNA level effects on translation, we felt that the most rigorous course would be to assess causality rather than an association for this tRNA and its codon in regulating a target gene. The only way to do this is to perform mutagenesis and reporter studies. Our codon dependent reporter clearly shows a direct effect on translation in a tyrosine-codon dependent manner. As for translational regulation for two different transcripts with the same Tyr codon content, it is unclear the molecular mechanisms that could dictate these differences. The reviewer has already brought up possibilities in the next comment regarding Tyr codons in 5’ or 3’ ends or consecutive Tyr codons. These are all interesting hypotheses that others in the field have devoted entire publications to try and understand how and why codon interactions and localizations impact translation (see Gamble et al., Cell 2016, Kunec and Osterreider, Cell Reports 2016, Gobet et al., PNAS 2020). While these further analyses would be interesting, our current experimental data would be insufficient to properly address these questions. We have focused on a specific tRNA, its fragment, and demonstrated direct effects of the tRNA on the codon-dependent translation of a specific growth-regulating target gene and the tRNA fragment on the modulation of the activity of the RNA binding protein it binds to with respect to its regulon. We believe that these findings individually reveal causal roles for this tRNA and tRF in downstream gene regulation and collectively reveal a previously unappreciated post-transcriptional response. We hope the reviewer agrees with us regarding the already deep extent of the studies and that further such analyses beyond this tRNA are outside the scope and focus of this current study.

      Comment 4: The Authors should provide the specific parameters used to calculate the median abundance of Tyr codons in a protein and the list of proteins containing higher than median abundance of Tyr codon content. Moreover, the complete list of 102 candidate genes should also be provided. This will allow one to determine what percentage of these Tyr-enriched proteins exhibited a decrease in levels. Moreover, is there anything special about these Tyr codon-enriched transcripts where they are affected at the level of translation but not the other Tyr-codon enriched transcripts? For example, are these transcripts enriched at the 5' or 3' ends for Tyr codons? Do these transcripts exhibit multiple consecutive Tyr codons? This deeper analysis would enrich the findings in this manuscript.

      Response: For the proteins identified in the mass spectrometry and overlap listed in Fig 4A, Tyr codon abundance was calculated by dividing the number of Tyr amino acids present by the total number of amino acids for each protein. For genes with different isoforms possible, the principal isoform, using ENSEMBL, was used for calculations. We are also happy to provide the entire list of proteins. Additionally, please see above response to comment 3. We wish to emphasize that the goal of identification of these proteins was to identify downstream targets of this response for functional studies, which we have done. We have identified downstream genes that become modulated by this response and that regulate cell growth, consistent with the phenotype of the tRNA. We then demonstrated a direct causal tRNA-dependent codon-based response with a specific target gene using mutagenesis.

      While we agree that the additional analysis the reviewer is requesting to determine what constitutes heightened translational sensitivity to this response is interesting, we believe this is a challenging question for future studies. It is possible that enrichment at 5’ or 3’ or concentration of tyrosine codons could cause increased sensitivity. Ideally, one would have information on a larger set of proteins so that such challenging questions could be better statistically bolstered. Ultimately, the requested experiments that go beyond our current work would require further analyses and experiments to allow firm conclusions to be drawn. As the other reviewers state and this reviewer agrees, we have uncovered the initial discovery regarding this tRNA fragmentation response and provided mechanistic characterization. Future studies, which are beyond the scope of the current work will undoubtedly further characterize features of this response.

      Comment 5: The ribosome profiling results are condensed into two panels of Figure 5E and 5F. We recommend the ribosome profiling experiment be expanded into its own figure with more extensive analysis and comparison beyond just looking at tRNA-Tyr. This could reveal insight into other codons that are impacted coordinately with Tyr codons and perhaps strengthen their conclusion. As an example of a more thorough analysis of ribosome profiling and proteomics, we point the Authors to this recent paper: Lyu et al. 2020 PLoS Genetics, https://journals.plos.org/plosgenetics/article?id=10.1371/journal.pgen.1008836

      Response: We thank the reviewer for their suggestion. We have expanded the analysis to look at codon usage scatterplots across all codons for shTyr and shControl replicates (Fig S5D). The 5 most changed codons are labeled with UAC, a codon for the tyrosine amino acid, being the most affected (red arrow). Consistent with our model, a tyrosine codon, when at the ribosome A-site, is most affected with depletion of the corresponding tRNA. The text has also been edited to reflect our new analysis providing further evidence that ribosomal stalling might occur with depletion of a given tRNA. The gray outline around the regression line represents the 95% confidence interval.

      Fig S5D

      Comment 6: Moreover, one would expect that the mRNAs encoding USP3, EPCAM and SCD would exhibit increased ribosome occupancy. Thus, the authors should at least provide relative ribosome occupancy information on these transcripts to provide evidence that the decrease in protein levels is indeed linked to ribosome pausing or stalling.

      Response: We would like to emphasize that resolution of ribosomal profiling data at the codon level for specific genes requires a high number of reads and replicates to draw accurate conclusions. There is an inherent level of stochasticity when mapping RPFs to specific genes and as a result, our analysis revolved around Tyr-enriched vs Tyr-low populations as this analysis was appropriate for our sequencing depth and number of replicates. To be able to conclusively make claims regarding ribosome pausing or stalling for specific genes, we would likely need further experimentation than can be currently done. However, we are currently conducting the requested bioinformatic analysis and have promising preliminary transcript-level data supporting our model.

      Comment 7: The results with hnRNPA1 and SSB/La are extremely preliminary and simply show binding of tRNA fragments but no biological relevance. We realize that the Authors attempted to see if Tyr-tRNA fragments impacted RNA Pol III RNA but found no effect. A potential experiment would be to perform HITS-CLIP on H2O2-treated cells to see if stress-induced tRNA fragments bind to SSB/La or hnRNPA1. In this case, at least the Authors would link the oxidative stress results found in Figure 1 and 2 with La/SSB and hnRNPA1.

      Response: We agree with the reviewer that a tRF function was not established in the manuscript. As a result, we have recently completed experiments looking at mRNA stability of the hnRNPA1 regulon in the context of overexpressing the tRF as well as using LNA to inhibit this Tyr-tRF (Fig 7E-F). Our data shows, in an hnRNPA1-dependent manner, that its regulon can be functionally regulated by Tyr-tRF. With tRF overexpression and RNAi-mediated depletion of hnRNPA1, a right shift in transcript stability is seen. Importantly, when we do the converse experiment with tRF inhibition in the same RNAi-mediated reduction of hnRNPA1, we see a left shift. These complementary experiments provide data that the Tyr-tRF has a functional role when bound to hnRNPA1 by modulating the regulon of hnRNPA1 and expand the scope of this manuscript and extend the pathway defined downstream of this tRNA fragmentation event.

      Fig 7E-F

      Comment 8: The manuscript concludes that "Tyrosyl tRNA-GUA fragments are generated in a DIS3L2-dependent manner" based upon data in Supplemental Figure S7. However, there is still a substantial amount of tyrosine tRNA fragments in both worms and human cells depleted of DIS3L2. Thus, DIS3L could play a role in the formation of Tyrosine tRNA fragments but it is too strong a claim to say that tRNA fragments are "dependent" upon DIS3L2. We suggest that the Authors soften their conclusions.

      Response: While there are certainly tRFs still apparent with DIS3L2 depletion (Fig S7F-I), we note significant impairment of tRF induction with DIS3L2 knockdown/knockout with multiple different methods in C. elegans and human cells. This data supports our conclusion that tRF generation is dependent on DIS3L2 as this ribonuclease is necessary to elicit the full Tyr-tRF response. We do not make claims that Tyr-tRFs are solely or completely dependent on DIS3L2. There must be other RNases involved given the data highlighted by the reviewer. To this point, we have added clarifying text that DIS3L2 depletion does not completely eliminate the tRF induction.

      Comment 9: Moreover, what is the level of DIS3L2 depletion in the worm and human cell lines? The Authors should provide the immunoblot of DIS3L2 that was described in the Materials and Methods.

      Response: An immunoblot of DIS3L2 depletion in human cells has now been added as a supplementary figure (Fig S7I). Depletion in C. elegans was confirmed through sequencing of a mutation, as is standard in the field. The wild-type PCR product is 1nt longer (859 bp) than the mutant product (858 bp) with CTC to TAG nonsynonymous mutation preceding a single nucleotide deletion.

      Wild-type disl-2: GTTGAAGCCGCAGGGC[CTC]ACTCAGACAGCTACAGG

      disl-2 (syb1033): GTTGAAGCCGCAGGGC[TAG]-CTCAGACAGCTACAGG

      Fig S7I

      Comment 10: The key conclusions of "a tRNA-regulated growth suppressive oxidative stress response pathway" and an "underlying adaptive codon-based gene regulatory logic inherent to the genetic code" are overstated. This is because of the major caveat that knockdown of tyrosine-tRNA or tyrosyl-tRNA synthetase are likely to trigger numerous indirect effects. While the authors validate that three proteins are expressed at lower levels under all three conditions (H2O2, tRNA-Tyr and YARS), they might overlap in some manner but not necessarily define a coordinated response. Thus, a glaring gap in this paper is a clear, mechanistic link between H2O2-induced changes in translation versus the changes in expression when either tRNA-Tyr or YARS is depleted. Thus, it is too preliminary to conclude that tRNA depletion is part of a "pathway" and "regulatory logic" when it could all be pleiotropic effects. At the very least, the authors should discuss the possibility of indirect effects to provide a more nuanced discussion of the results obtained using two different cell systems and oxidative stress.

      Response: We thank the reviewer for the feedback. While we agree that indirect effects may exist, we do not make any claims that our pathway is the only one required to have translation effects. The text for Fig 4A already acknowledges the pleiotropic effects of tRNA depletion. Our data shows that H2O2 stress leads to a depletion of Tyr tRNA-GUA and that depletion of this tRNA through multiple complementary methods has a codon-dependent effect on protein expression. We hope the reviewer agrees that the reduction of a specific target gene in a tyrosine codon-dependent manner (demonstrated by mutagenesis) and the binding of the tRF directly to an RBP and the modulation of the regulon of this RBP by this tRF (demonstrated by gain- and loss-of-function studies) demonstrates a direct role of this response on specific downstream target genes rather than pleiotropy. This is in keeping with the cross-comments of reviewer 1, where Fig 5D shows a direct Tyr codon link between H2O2 and downstream effects. As a result, we feel that our conclusions of a pathway (not the only pathway) are valid. However, the conclusion of a “regulatory logic” might not be interpreted in the same way by all readers and we have thus changed the text to reflect a more nuanced position.

      **Minor comments:** Comment 11: Tyrosyl-tRNAs refers to the aminoacylated form of tRNA. We recommend that all instances of tyrosyl-tRNA be changed to tyrosine tRNA or tRNA-Tyr which is more generic and provides no indication as to the aminoacylation status of a tRNA.

      Response: We thank the reviewer for their correction. We have changed all instances of “tyrosyl” to “tyrosine” in the text.

      Comment 12: In Figure 5C, the promoter is drawn as T7, which is a bacteriophage promoter. While the plasmid used in this manuscript (psiCHECK2) does contain a T7 promoter, mammalian gene expression is driven from the SV40 promoter. Thus, the relevant label in Figure 5C should be "SV40 promoter". Moreover, additional details should be provided on how the construct was made (such as sequence information etc.).

      Response: We thank the reviewer for their correction. We have changed the promoter text in the figure. In the methods for the construct, we have included which USP3 was used and would be happy to include further information if requested.

      Comment 13: Please provide original blots for each of the replicates in: Figure 4C, n=4 Figure 4A, n=9 Figure 4D, n=3 Figure 5D, n=3

      Response: There appears to be an unintentional mislabeling of the requested blots by the reviewer. The original blots for Fig 4C, Fig 5A, Fig 5D, and Fig 6D have been made available in a separate file for reviewers.

      Reviewer #3 (Significance (Required)): This manuscript provides evidence that specific tRNAs are depleted upon oxidative stress as part a conserved stress-response pathway in humans (and worms) to regulate translation in a codon-based manner. Unfortunately, the manuscript attempts to tie together results from different conditions and systems without providing any definitive links that suggest a "pathway" involved in the oxidative stress response. The findings in this paper provide a useful starting point but fall short of being a major advance due to the lack of a clear mechanism. However, there are intriguing results in this manuscript based upon the cell lines depleted of tRNA-Tyr or tyrosine synthetase that could interest researchers in the field of tRNA biology.

      Response: We thank the reviewer for the positive comments regarding our demonstration of a conserved stress response, acknowledging the intriguing nature of our findings that will be a starting point for future studies and that our work will be of interest to researchers in the field of tRNA biology. We hope that the very positive comments of reviewer 1 and 2, the cross-comments of reviewer 1 in response to reviewer 3’s comments regarding the specificity of this response, and our inclusion for reviewer 3 of additional data on the function of the tRF in regulating the activity of the hnRNPA1 RNA binding protein defining a post-transcriptional pathway and additional corroborating requested codon-level computational analyses provide compelling support that that our findings indeed represent a major advance for the field.

    1. Disabled people are also frequently excluded from dominant sexual scripts in two ways. They are commonly desexualized, in the sense that we tend to think of dis-abled people as not having sexual needs, experiencing sex-ual attraction, or having sex.

      I agree with this statement even if it maybe seem like disable people may not be talked about in sexual examples ,they still often have sexual desires and needs like other people. This argument shows how you can not exclude people just because you may not think of them as interested in sexual desire based on appearance and mentality’s.

    1. Author Response

      Reviewer #1:

      This study was designed to determine whether there is a relationship among cranial suture closure patterns, the molecular causes for suture patency/closure, and phylogeny. The authors use correlative data to test causal hypotheses related to brain size, suture closure patterns, and diet and search for the genetic underpinnings of the relationships they identify using reference genomes. There are many ideas put forward and methods used that are not clearly explained in the body of the work or in the supplementary material. This made it difficult to provide a clear evaluation of the work. Even checking original sources on which they base their approach, I found some disconnect between original sources and ideas laid out here. I see some interesting ideas in the study but a lack of solid reasoning behind the hypotheses proposed, confusion about the data and/or ideas summarized from the literature (the confusion could be on my part, but it rests with the authors to explain this more fully), and lack of detail regarding methods used to support their conclusions.

      We take good note of this confusion and we will explain everything in more detail in a revised version of the manuscript.

      1) The entire study rests on the authors scoring of sutures as patent or closed but no information is given other than a suture was considered closed if it was not visible ( 'obliterated"), and a suture was considered open if visible. These are problematic definitions for distinguishing patent from closed sutures if we accept the authors' definition of sutures as growth and stress diffusion sites. A suture can be visible but still be "closed" as evidenced by bony connections or bridges linking the bones that border the suture. In the case of bridging, the suture would be visible, so would be scored as "open" according to the authors' criterion, but functionally, the suture is closed.

      Visual examination of sutures (e.g., from photos or in situ) is a common procedure in macroevolutionary studies of suture patency, where raw data is not always available for histological inspection (e.g., invasive procedures or CT are not permitted). In this regard, we follow previous literature. We would like to note that only photographic materials were available for most specimens during this project, because of the current exceptional circumstances (museums lockdown).

      Also, in some mammals (e.g., the laboratory mouse) most cranial sutures do not close in typically developing individuals.

      In this study we used specimens hosted in museum collections, which come from the wild or zoos. We did not use data from laboratory animals grown in controlled environments, which may indeed affect their suture patency (e.g., by feeding on pellets).

      2) Age estimates are not provided for the specimens used in analysis. In many mammalian species, suture closure occurs in a somewhat predictable fashion - this, coupled with tooth formation/eruption patterns is one of the ways that forensic scientists aged skeletal remains prior to the advent of modern technologies. The order of suture closure is not necessarily similar across vertebrates, or even across mammals. This means that, without known or estimated ages for each skull included in analysis, age becomes an unrecognized source of variation that will affect analytical outcome.

      Unfortunately, the exact age for museum specimens is often not available. For this reason, we focused on adult specimens, where suture patency tends to remain constant. We also excluded individuals with signs of senescence. To accommodate age and other source of intraspecific variation in adults, we collected information for as many individuals as possible, often more than 10 and sometimes up to 100. Thus, we coded suture patency as a frequency rather than as open/closed for each species.

      We only dichotomized suture patency as open/closed for the second part of the study. Here we used a sensible threshold to avoid ambiguity and be conservative. As a result, species with frequency of suture patency between 75% and 25% were excluded. This also means that if only 4 individuals were examined (small sample size was unavoidable for some rare species) and at least one showed a discrepancy, that species was excluded from the analysis. However, because suture patency is a very conserved trait, only a few taxa had to be excluded at the end.

      In any case, we will emphasize more this fact in the revised version.

      3) The authors' impact statement: "brain growth and skull ossification sequence cause suture closure in mammals evolution without common genetic factors causing premature suture closure diseases in humans" is hard to digest as brain growth is not considered by the authors but instead brain size. From a developmental perspective, brain size or even some form of the encephalization quotient (EQ) is not what is commonly proposed to drive suture closure/patency (or degree of patency). Instead it is the dynamics of brain growth that is proposed as a stimulus for the initiation of mineralization of cranial bones. As bones increase in size, new bone is added at the leading edge of opposing bones that line the suture, while the stem cells in the center of the suture remain to add to the mesenchymal cell population of the suture, keeping the suture patent. In short, the dynamics of brain growth (including any signaling emanating from the brain, dura, bones, or even the suture itself) contributes to suture patency. Because sutures tend to close later in life (after childhood in humans), normal suture closure appears to be associated with the termination of brain growth. Making the jump in their study from estimates of EQ (in some way estimated here) to dynamics of brain growth as a cause requires several steps and knowledge on timing and rate of growth that is not considered by the authors.

      We agree with the reviewer. A developmentally focused study on suture formation and closure dynamics must consider brain growth. However, this information is not available for most species selected for this study. Note that species selection depended on the availability of referenced genomes and multiple sequence alignments (some of which are rare, endangered species). Because we were comparing macroevolutionary dynamics in adults we decided to use brain size as a feasible proxy for brain influence (either due to growth or signalling). We aim to fill this gap in future research projects. In the meantime, we will revise the wording of the article to make sure that there are no misleading statements about brain growth influence.

      4) The authors assume a suture closure pattern across the skull that starts at the anterior (rostrally) and move posteriorly (caudally) and builds this into their model. This seems to be based on a work by Koyabu et al. (2014), but that study is about the appearance of ossification centers for bones (not suture formation or closure) and the study actually clumps the frontal and parietal into the same group in their final analysis so why this supports and anterior to posterior direction of suture closure is not clear.

      Note that we did not “assume” any closure pattern; we interpreted the published evidence on how the skull ossifies in mammals to make a plausible hypothesis. We also tested other 11 plausible hypotheses. It could have happened that such hypothesis was worse than the others, but we found that the best supported hypothesis includes an anterior-posterior relation of suture closure. We will try to explain the construction of our model and hypothesis testing better in the revised version.

      5) The authors conclusion: (Lines 289-292 does not follow from their analyses.) Brain growth was not analyzed. I am uncertain what they mean by suture self-regulation as I don't think their detection of genetic variants in common across a diverse set of species means that those are controlling suture patency/closure.

      The proposed idea of suture self-regulation refers to the fact that one suture closure may affect another suture closure (as theoretical models previously suggested), and it is not necessarily related to the genetic variants identified here. As explained before, we will revise any reference to brain growth.

      Reviewer #2:

      -Authors tested 4 hypotheses (page 5, lines 78-84), but rejected or questioned them later on (which is a fair approach to be realistic and point out possible weaknesses or methodological limitations, nevertheless, I find there are more questions or suggestions rather than actual answers).

      We have tried to offer an open and clear set of hypotheses, tested them with the available data, and discussed the results fairly. As it is often the case in science, research may bring more questions than answers; we do not see this as a weakness. Our answers are also contextualized within the limitations that we described in the methods. We believe this is the correct way of doing science: even if this forces us to reject all our hypotheses, negative results are also results. Since our object of study is not very well known, we hope this study can fuel more research.

      -Lots of repeating text

      -Frequent missing references for major statements, unclear formulations

      We will double-check our manuscript. However, the reviewer offers no details about what is repeated or missing.

      -Few contradicting or unclear information, for instance, "high conservation..enabled us to categorize phenotype as either open or closed" / "suture patency ranging from 0-1, only above 75% and below 25% was counted as open or closed" / authors involved species were >2 samples were available but excluded any ambiguous case (small number of samples per species?)

      As explained before, thresholding at 25/75 % was used to binarize species as having a suture open or closed. This binarization is only used for the convergent amino acid substation analysis. We excluded ambiguous cases (i.e., a suture half closed) prior to data collection. We will explain it better in the revised version to avoid confusion.

      -"Phylogenetic path analysis showed almost no effect of diet on the brain size; low to medium (what does that mean then?) effect of brain on suture closure and medium to high effect of 1 suture affecting the other sutures in AP direction" (in many species this is described-the timeline of suture closure)

      Not sure about what the reviewer means; we will revise these sentences to make them clearer to readers.

      -I am not able to evaluate if the assessment of diet hardness as an equivalent to mechanical forces in the skull is correct and hope other reviewers will be able to do that-in fact, also to evaluate the phylogenetic path analysis performed in this manuscript. Authors took information on % of nektar/soft-plants and invertebrates/hard food (seeds etc) that given species consumes and multiplied by an index but not an actual modeling or assessment of the forces... To a laymen it looks like, for instance, cow chewing all day long relatively soft grass, building very strong muscles will at the end develop much more force/tension within the skull than an animal cracking one nut.

      As the reviewer correctly points out, chewing grass all day long is harder than cracking one nut (cracking nuts “all day long” would be another issue). In any case, we have weighed each food item compared to others (e.g., grass is weighed as twice as hard as meat) and there is consensus that feeding on seeds and scavenging is one of the most biomechanically demanding feeding strategies. In addition, we would like to note that we critically discussed the caveats of diet hardness as a proxy for the effect of feeding biomechanics on sutures, and we did not blindly assume this as a hard truth.

      -Lots of attention is given to the three identified genes with convergent amino acid substitution despite the fact that none of these genes have ever been related to any aspect of craniofacial biology, nor to the suture pathological conditions.

      We discussed the three genes that our analysis revealed. We cannot discuss genes for which we found no support. For these three genes, we offered plausible scenarios for how they could be associated to craniosynostosis; it is for future studies to explore these scenarios and validate experimentally or clinically these genes. The fact that they are not currently known as part of pathological conditions does not preclude that we need to discuss them in the manuscript. Every year, new genetic variants are discovered to be associated with craniosynostosis. The lack of correspondence between these genes and pathology is in fact one of the findings of this study: the few genes that show convergent mutations are not associated to pathology. We agree that absence of evidence is not evidence of absence. However, we also think that this is a result to be discussed in this manuscript and for the readers to ponder.

    1. Likewise, Americans with a lot of trust in national news organizations have an easier time separating factual from opinion statements than those with less trust.

      In the first chapter of the textbook for the year, we read about why we have statistics, and a big reason for that was because we "can't always trust our gut". I think that this snippet is interesting because I would think that the less you trusted news outlets, the more vigilant and unbiased you would be in disseminating fact and opinion. However, this data seems to project to me that those who don't trust national news outlets say so because they don't trust a particular outlet(s), which may skew their decision-making.

    1. The general life of society cannot extend its sway without juridical life extending its sway at the same time and indirect relation. We can thus be certain of finding reflected in law all the essential varieties of social solidarity.The objection may be raised, it is true, that social relations can fix themselves without assuming a juridical for

      I think this is a factual statment as regardless of how the general population feels or acts with in society no major social/societal groth will truly be seen until the ruling goverment implements these changes into law.

    1. We can teach them about the influence of their votes on such issues as educational funding, employment, civil rights, andthe overall political climate. Asa result, they may beencouraged to understand their valueswithout being swayed bycampaignplatforms, one-sided messages, or biased media coverage.

      The tone throughout the piece seems to bounce around between different roles for faculty -- as one responsible for imparting knowledge or otherwise changing students, to mentor or guide supporting student's path towards self-discovery. In the first model, faculty have power and responsibility. In the second model, students hold power and responsibility. Which model is more aligned with your thinking for this work? Which do you think would be more accessible to faculty and more valuable for students?

    1. ce. On the other hand, there is no such thing as "Native American litera- ture," though it may yet, someday, come into be

      I think we definitely have to search harder for Native American Literature than World Lit, British Lit or American Lit, but I wouldn't go so far as to say it doesn't exist (maybe it only exists under American Lit, and not it's own)

    1. his term includes teaching practices thatBOX 6.1Literacy: Then and NowColonists were literate enough if they could sign their name, or even an X, ondeeds. When immigrants arrived in large numbers in the 1800s, educators urgedschools to deliver “recitation literacy” to the foreign children who filled the school-rooms. That literacy was the ability to hold a book and reel off memorized portionsof basic American texts such as the opening paragraph of the Declaration of Inde-pendence, a part of the Gettysburg address, or some Bryant or Longfellow. Withthe coming of World War I, and the prospect of large numbers of men handlingnew equipment in foreign countries, Army testers redefined reading. Suddenly, tothe dismay of men used to reading familiar passages, passing the army readingtest meant being able to make sense, on the spot, of never-before-seen text. Cur-rently, that kind of “extraction literacy,” revolutionary in 1914, looks meager. Find-ing out who, what, when, where or how simply does not yield the inferences,questions, or ideas we now think of as defining full or “higher literacy.” The ideaof a classroom where young women, poor and minority students, and learningdisabled students all read (not recite) and write about (not copy) Shakespeare orSteinbeck is a radical and hopeful departure from the long-running conception ofliteracy as serviceable skills for the many and generative, reflective reading andwriting for the few (Wolf, 1988:1).How People Learn: Brain, Mind, Experience, and School: Expanded EditionCopyright National Academy of Sciences. All rights reserved.How People Learn: Brain, Mind, Experience, and School: Expanded EditionCopyright National Academy of Sciences. All rights reserved.

      Why is the word "culturally" used? Why not "life" relevant? Since most of a child's experience may not be consider culture but real world experience with families, friends and neighbors. The above diagram seems to point toward the importance of community that might be very diverse instead of some monolithic cultural experience.

  7. Aug 2020
    1. “Joaquin’s Dilemma”

      Understanding the link between racial identity and school-related behaviors

      by Pedro Antonio Noguera Cambridge, Massachusetts

      Introduction

      When I am asked to speak or write about the relationship between racial identity and academic performance, I often tell the story of my eldest son, Joaquin. Joaquin did extremely well throughout most of his early schooling. He was an excellent athlete (participating in soccer, basketball, and wrestling), played piano and percussion, and did very well in his classes. My wife and I never heard any complaints about him. In fact, we heard nothing but praise about his behavior from teachers, who referred to him as “courteous,” “respectful,” and “a leader among his peers.” Then suddenly, in the tenth grade, Joaquin’s grades took a nosedive. He failed math and science, and for the first time he started getting into trouble at school. At home he was often angry and irritable for no particular reason.

      My wife and I were left asking ourselves, "What's going on with our son? What’s behind this sudden change in behavior?" Despite my disappointment and growing frustration, I tried not to allow his behavior to drive us apart. I started spending more time with him and I started listening more intently to what he had to tell me about school and his friends. As I did, several things became very clear to me. One was that all of the friends he had grown up with in our neighborhood in South Berkeley (one of the poorest areas of the city) were dropping out of school. These were mostly Black, working-class kids who didn't have a lot of support at home or at school and were experiencing academic failure. Even though Joaquin came from a middle-class home with two supportive parents, most of his reference group-that is, the students he was closest to and identified with --- did not. The other thing that was changing for Joaquin was his sense of how he had to present himself when he was out on the streets and in school. As he grew older, Joaquin felt the need to project the image of a tough and angry young Black man. He believed that in order to be respected he had to carry yourself in a manner that was intimidating and even menacing. To behave differently –- too nice, gentle, kind, or sincere -- meant that he would be vulnerable and preyed upon. I learned that for Joaquin, part of his new persona also involved placing less value on academics, and greater emphasis on being cool and hanging out with the right people.

      By eleventh grade, Joaquin gradually started working out of these behaviors, and by twelfth grade, he seemed to snap out of his angry state. He became closer to his family, his grades improved, he rejoined the soccer team, he resumed playing piano, and he even started producing music. As I reflected on the two years of anger and self-destructiveness that he went through I came to the conclusion that Joaquin was trying desperately to figure out what it meant to be a young Black man. As I reflect on that period I realize that like many Black male adolescents, Joaquin was trapped by stereotypes, and they were pulling him down. During this difficult period it was very hard for me to help him through this process of identity formation. While he was in the midst of it the only thing I could do was talk to him, listen to him, and try to let him know what it was like for me when I went through adolescence.

      As a high school student, I had coped with the isolation that came from being one of the few students of color in my advanced classes by working extra hard to prove that I could do as well as or better than my White peers. However, outside of the classroom I also worked hard to prove to my less studious friends that I was cool or “down” as we would say. For me this meant playing basketball, hanging out, fighting when necessary, and acting like “one of the guys.” I felt forced to adopt a split personality: I behaved one way in class, another way with my friends, and yet another way at home.

      The Emerging Awareness of Race

      Adolescence is typically a period when young people become more detached from their parents and attempt to establish an independent identity. For racial minorities, adolescence is also a period when young people begin to solidify their understanding of their racial identities. For many, understanding the significance of race means recognizing that membership within a racial category requires certain social and political commitments. Adolescence is often a difficult and painful period for many young people. However for young people struggling to figure out the meaning and significance of their racial identities, the experience can be even more difficult.

      Awareness of race and the significance of racial difference often begin in early childhood. We know from psychological research that the development of racial identity is very context-dependent, especially in the early years. Children who attend racially diverse schools or reside in racially diverse communities are much more likely to become aware of race at an earlier age than children in more homogenous (1) settings. In the latter context, race is often not a defining issue nor is it a primary basis for identity formation. When children see their race as the norm they are less likely to perceive characteristics associated with it (i.e. physical appearance) as markers of inferiority.

      In contrast, children who grow up in more integrated settings become aware of physical differences fairly early. Interacting with children from other racial and ethnic backgrounds in a society that has historically treated race as a means of distinguishing groups and individuals often forces young people to develop racial identities early. However, prior to adolescence they still do not usually understand the political and social significance associated with differences in appearance. For young children, being a person with different skin color may be no more significant than being thin or heavy, tall or short. Differences in skin color, hair texture, and facial features are simply seen as being among the many differences that all children have. In environments where racist and ethnocentric behavior is common, children may learn fairly early that racist speech is hurtful.(2) They may know that calling someone a nigger is worse than calling them stupid, but they may not necessarily understand the meaning of such words or know why their use inflicts hurt upon others.

      Four years ago I was conducting research with colleagues at an elementary school in East Oakland. We were interested in understanding how the practice of separating children on the basis of the language differences affected their social relationships and perceptions of students from other groups. As is true in many parts of California, East Oakland was experiencing a major demographic change as large numbers of Mexican and Central American immigrants were moving into communities that had previously been predominantly African Americans. As is often the case, schools in East Oakland serve as the place where children from these groups encounter one another, and at several of the high schools there had been a significant increase in inter-racial conflict. (3)

      In the elementary school where we did our research we found that most of the Black and Latino students had very little interaction with each other. Although they attended the same school, the students had been placed in separate classes, ostensibly for the purpose of serving their language needs. From our interviews with students we learned that even very young children viewed peers from the other racial group with suspicion and animosity, even though they could not explain why. Interestingly, when we asked the students why they thought they had been placed in separate classrooms, most thought it was to prevent them from fighting. We also found that the younger Mexican students (between ages five and eight) saw themselves as White, and the Black students also referred to the Mexican students as White. However, as the children entered early adolescence (age nine or ten), the Mexican youth began to realize that they were not considered White outside of this setting, and they began to understand for the first time that being Mexican meant something very different than being White.

      Depending on the context, it is not uncommon for minority children to express a desire to reject group membership based on skin color especially during early adolescence. As they start to realize that in this society to be Black or Brown means to be seen as “less than” -- whether it be less smart, less capable, or less attractive -- they will often express a desire to be associated with the dominant and more powerful group. This tendency was evident among some of the younger Mexican students in our study. However, as they grew older, the political reality of life in East Oakland served to reinforce their understanding that they were definitely not White. As one student told us “White kids go to nice schools with swimming pools and grass, not a ghetto school like we go to.”

      In adolescence, awareness of race and its implications for individual identity become even more salient. For many young men and women of color, racial identity development is affected by some of the same factors that influence individual identity development in general. According to Erikson and other theorists of child development, as children enter adolescence, they become extremely conscious of their peers and seek out acceptance from their reference group.(4) As they become increasingly aware of themselves as social beings their perception of self tends to be highly dependent on acceptance and affirmation by others. For some adolescents, identification with and attachment to peer groups sometimes takes on so much importance that it can override other attachments to family, parents, and teachers.

      For adolescents in racially integrated schools, racial and ethnic identity also frequently take on new significance with respect to friendship groups and dating. It is not uncommon in integrated settings for pre-adolescent children to interact and form friendships easily across racial boundaries -- if their parents or other adults allow them to do so.(5) However, as young people enter adolescence, such transgressions of racial boundaries can become more problematic. As they become increasingly aware of the significance associated with group differences, they generally become more concerned with how their peers will react to their participation in interracial relationships and they may begin to self-segregate. As they get older, young people also become more aware of the politics associated with race. They become more cognizant of racial hierarchies and prejudice, even if they cannot articulate the political significance of race. They can feel its significance, but they often cannot explain what it all means.

      For the past three years I have been working closely with fifteen racially integrated school districts in the Minority Student Achievement Network (MSAN). At the racially integrated high schools in MSAN, students often become much more aware that racial group membership comes with certain political commitments and social expectations. In these schools, high-achieving students of color (like my son Joaquin) are sometimes unwilling to enroll in advanced placement courses or engage in activities that have traditionally been associated with White students because they fear becoming estranged from their friends. If they appear to engage in behavior that violates racial norms, they may be seen as rejecting membership in their racial group and run the risk of being regarded as a race traitor. For this reason, I have urged the districts in MSAN not to rely upon the initiative of students to break down racial barriers but to put the onus on school leaders to take steps that will make this border crossing easier and more likely. (6)

      Theories of the identity/achievement connection

      For educators, understanding the process through which young people come to see themselves as belonging to particular racial categories is important because it has tremendous bearing upon the so-called “achievement gap.” Throughout the United States, schools are characterized by increasing racial segregation (7) and widespread racial disparities in academic achievement. (8) Blatant inequities in funding, quality, and organization are also characteristic of the American educational system. Despite overwhelming evidence of a strong correlation between race and academic performance, there is considerable confusion among researchers about how and why such a correlation exists.

      The scholars whose work has had the greatest influence on these issues are John Ogbu and Signithia Fordham, both of whom have argued that Black students from all socioeconomic backgrounds develop “oppositional identities” that lead them to view schooling as a form of forced assimilation to White cultural values. (9) Ogbu and Fordham argue that Black students and other “non-voluntary minorities” (e.g., Chicanos, Puerto Ricans, Native Americans and others whose groups that have been dominated by White European culture) come to equate academic success with "acting White." For these researchers, such perceptions lead to the de-valuation of academic pursuits and the adoption of self-defeating behaviors that inhibit possibilities for academic success. In this framework, the few students who aspire to achieve academically must pay a heavy price for success. Black students who perform at high levels may be ostracized by their peers as traitors and “sell outs” and may be forced to choose between maintaining ties with their peers or achieving success in school. (10) This would explain why middle class minority student like my son Joaquin would under-perform academically despite their social and economic advantages.

      My own research challenges Ogbu and Fordham’s “acting white” thesis. While carrying out research among high school students in Northern California, I discovered that some high achieving minority students are ostracized by their peers, but others (like me) learn how to succeed in both worlds by adopting multiple identities. Still others actively and deliberately challenge racial stereotypes and seek to re-define their racial identities by showing that it is possible to do well in school and be proud of who they are.

      Claude Steele’s work on the effects of racial stereotypes on academic performance helps to provide a compelling explanation for the identity-achievement paradox. Through his research on student attitudes toward testing, Steele (twin brother of the more conservative Shelby) has shown that students are highly susceptible to prevailing stereotypes related to intellectual ability. (11) According to Steele, when “stereotypes threats” are operative, they lower the confidence of vulnerable students and negatively affect their performance on standardized tests. Steele writes: "Ironically, their susceptibility to this threat derives not from internal doubts about their ability but from their identification with the domain and the resulting concern they have about being stereotyped in it.” (12) According to Steele, the debilitating effects of stereotypes can extend beyond particular episodes of testing, and can have an effect on overall academic performance.

      Race in the School Context

      Stereotypes and Expectations As Steele’s research illustrates, in the United States we have very deeply embedded stereotypes that connect racial identity to academic ability, and children become aware of these stereotypes as they grow up in the school context. Simply put, there are often strong assumptions made in schools that if you’re White you’ll do better in school than if you’re Black; or, if you’re Asian you’ll do better at school than if you’re Latino. These kinds of stereotypes affect both teachers’ expectations of students and students’ expectations of themselves.

      One of the groups most affected by these stereotypes is Asian-Americans. There is a perception in many schools that Asians are “naturally” academically gifted – especially in math. This stereotype is based on the following notions: 1) that Asians are inherently smart (either for genetic or cultural reasons); 2) that they have a strong work ethic; 3) that they are passive and deferential toward authority, and; 4) that unlike other minorities they don't complain about discrimination. These perceptions make up what is often called the “model minority” stereotype. (13)

      One of my former students, Julian Ledesma, now a researcher at the Office of the President of the University of California, has been doing research on the model minority stereotype at a high school in Oakland, California. He started his work by interviewing various teachers and students about who they believed were “the smartest kids." In nearly every case, those he asked reported that the Asians were the “smartest” students. Even Asian students who were doing poorly in school reported that Asians were the smartest. The surprising thing about their responses to this question is that the average grade point average for Asians at the school was a 1.8.

      One reason for the gross misconception at this school is that Asians were over-represented in the honors courses and among students with the highest ranks in their class. Yet, these successful students were not representative of Asians as a whole at the school. Overall, Asian students were dropping out in high numbers and not doing very well academically. The school where Julian did his research also had a considerable gang problem among Asians. Yet, because the stereotype is so powerful, students and teachers at the school were more likely to regard the majority of Asian students as the exceptions, and the smaller numbers who were successful as the norm.

      The stereotypical images we hold toward groups are powerful in influencing what people see and expect of students. Unless educators consciously try to undermine and work against these kinds of stereotypes, they often act upon them unconsciously. Our assumptions related to race are so deeply entrenched that it is virtually impossible for us not to hold them unless we take conscious and deliberate action.

      Sorting practices and “normal” racial separation Beyond these stereotypes, there are also the sorting practices that go on in schools that send important messages to students about the meaning of racial categories. For example, in many schools students the remedial classes are disproportionately Black and Brown, and students often draw conclusions about the relationship between race and academic ability based on these patterns. They might say to themselves, “Well, I guess the kids in these ‘slow’ classes are less smart than those other kids who are in the honors classes.” They also notice that the students who are most likely to be punished, suspended and expelled, also are more likely to be the darker students.

      In addition to reinforcing stereotypes, grouping practices, which teachers and administrators often say are not based on race but on ability or behavior, often have the effect of reinforcing racial separation. Unless the adults in a school are conscious of how this separation influences their own perceptions and that of students, over time this separation may be regarded as normal. For example, Black students may assume that because there are no Black students in advanced or honors courses that they cannot excel academically. Of course, Black students can distinguish themselves in sports because there are numerous examples of Black individuals that do. Similarly, White students may assume that they should not seek academic assistance from tutorial programs, especially if those programs primarily serve Black or Brown students. When the norms associated with race take on a static and determining quality they can be very difficult to undermine.

      Students who receive a lot of support and encouragement at home may be more likely to cross over and work against these separations. But, as my wife and I found for a time with Joaquin, middle class African-American parents who try to encourage their kids to excel in school often find this can’t be done because the peer pressures against crossing these boundaries are too great.

      The racial separation we see in schools might be also be seen as an element of the “hidden curriculum,” an unspoken set of rules that “teaches” certain students what they can and cannot do because of who they are. There are aspects of this hidden curriculum that are not being taught by the adults. It may well be that students are the ones teaching it to each other. No adult goes onto the playground and says, "I don't want the boys and girls to play together." The girls and boys do that themselves, and it's a rare child who crosses over. Why? Because those who violate gender norms are often ostracized by their peers. The girls who play with the boys become known as the tomboys, and the boys who play with the girls become known as the sissies. Although the children are sanctioning each other without instruction from adults, they are also engaging in behavior that has been learned from adults -- not explicitly, but implicitly. Adults can reinforce narrow gender roles by promoting certain activities such as physical sports for boys and other things such as dance for girls.

      With respect to race, children receive messages all the time about beauty standards. Who are the favored students, and what are their characteristics? Who are the people who get into trouble a lot, and what are their characteristics? Much of the time preferential (or non-preferential) treatment is very much related to race.

      In many schools there may not be many explicit messages about race, but students receive implicit messages about race all of the time that informs what they think it means to be a member of a particular racial group. When they see Black students over represented on the basketball team but under represented in advanced placement courses, or Latino students over represented among those who’ve gotten into trouble, but under represented among those receiving awards, they get a clear sense about the meaning of race. The hidden curriculum related to race presents racial patterns as normal and effectively reinforces racial stereotypes. When it is operative it can completely undermine efforts to raise student achievement because students may believe that altering racial patterns simply is not possible.

      Too often, educators assume because of the choices Black students make about who to socialize with, which classes to take, etc. that they are anti-intellectual. (14) However, the vast majority of Black students I meet express a strong desire to do well in school. The younger students don’t arrive at school with an anti-intellectual orientation. To the degree that such an orientation develops, it develops in school, and from their seeing these patterns and racial hierarchies as permanent. Because a great deal of this behavior plays out in schools, educators can do something about it.

      What can educators can do?

      Understanding and debunking racial stereotypes, breaking down racial separations, and challenging the hidden curriculum are challenges not just for teachers, but for principals, administrators and entire school communities. In addition, there are a number of things educators can do to support their students’ positive racial identity development.

      First, educators can make sure that students are not segregating themselves -- sitting in racially defined groups in the classroom. For teachers, this can be as simple as mixing students and assigning them seats. Or, if work groups are created students can be assigned to groups in ways that ensure that students of different backgrounds have an opportunity to work together. This approach to race-mixing is often far more effective than holding an abstract conversation about tolerance or diversity. By working together, friendships are more likely to form naturally, and as students gain familiarity with one another, they may be more willing to break racial norms. If teachers let students choose, they will more than likely choose those whom they perceive to be “their own kind.”

      Second, educators can encourage students to pursue things that are not traditionally associated with members of their group. If students of color are encouraged by adults to join the debating team or the science club, play music in the band, or to enroll in advanced courses, it will be possible for greater numbers to challenge racial norms. Extracurricular activities in particular can serve a very important role in this regard and give young people a chance to get to know each other in situations that are not racially loaded. As is true for work groups, in the course of playing soccer or writing for the newspaper students can become friends. Research on extracurricular activities has shown that sports, music, theater and other activities can play an important role in building connections among young people and breaking down the very insidious links between racial identity and academic achievement. (15)

      Third, teachers can find ways to incorporate information related to the history and culture of students into the curriculum. This is important in helping students to understand what it means to be who they are; an essential aspect of the identity formation process for adolescents. Literature – novels and short stories -- can be very effective in this regard because it can help students to identify and empathize with children who may be from different backgrounds. Field trips and out-of-class experiences that provide students with opportunities to learn about the experiences of others can also help in expanding their horizons.

      Finally, an effective teacher who is able to inspire students by getting to know them can actually do a great deal to overcome anti-academic tendencies. They can do this by getting students to believe in themselves, by getting them to learn how to work hard and persist, and by getting them to dream, plan for the future and set goals. Over and over again, when you talk to students who have been successful, they speak about the role that significant adults have played at various points in their lives. (16) They talk about how these adults helped them recognize their own potential, and how they opened doors that they previously did not know existed.

      I believe there are many young people who are crying out for supportive relationships with caring adults. Differences in race, gender, or sexual orientation need not limit a teacher’s ability to make a connection with a young person. In my own work with students and schools I have generally found kids to be the least prejudiced of all people. They tend to respond well to caring adults regardless of what they look like. However, they can also tell if the adults who work with them are sincere, and those acting out of guilt and faked concern, can generally be detected.

      Today, most social scientists recognize race as a social rather than as a biological construct. It is seen as a political category created largely for the purpose of justifying exploitation and oppression. (17) For many adults and kids, especially those of mixed heritage, the categories often do not even correspond to who they think they are. Rather than being a source of strength, the acquisition of racial identities may be a tremendous burden.

      For many years to come, race will undoubtedly continue to be a significant source of demarcation within the US population. For many of us it will continue to shape where we live, pray, go to school, and socialize. We cannot simply wish away the existence of race or racism but we can take steps to lessen the ways in which the categories trap and confine us. As educators who should be committed to helping young people realize their intellectual potential as they make their way toward adulthood, we have a responsibility to help them find ways to expand identities related to race so that they can experience the fullest possibility of all that they may become.

      Published in In Motion Magazine December 1, 2002

    1. Stars are obviously a case of appearance

      I agree with the idea that stars are a case of appearance because we really only know of them what is being presented to us. Many people may think they know a star based on the character they played on a TV show or based off of one interview they've seen. We constantly hear on news platforms when a celebrity does something bad in the public eye, or when they are wearing the wrong thing. In my opinion, us ordinary followers get presented the bad in celebrities more than the good, & it paints a picture of them in our minds despite the fact that we really don't know them as a person, yet we are convinced that we are. Similarly, with actual appearance, we often are believed to think that a celebrity looks a certain way when, in fact, they got something done to enhance features on themselves which we are taught to be normal (just to clarify it is totally okay for someone to do anything they want to their bodies! its theirs for a reason) but it makes many followers wonder why they don't have the same feature. We only see the outside of celebs, & what the media portrays them as.

    2. I agree with the idea that stars are a case of appearance because we really only know of them what is being presented to us. Many people may think they know a star based on the character they played on a TV show or based off of one interview they've seen. We constantly hear on news platforms when a celebrity does something bad in the public eye, or when they are wearing the wrong thing. In my opinion, us ordinary followers get presented the bad in celebrities more than the good, & it paints a picture of them in our minds despite the fact that we really don't know them as a person, yet we are convinced that we are. Similarly, with actual appearance, we often are believed to think that a celebrity looks a certain way when, in fact, they got something done to enhance features on themselves which we are taught to be normal (just to clarify it is totally okay for someone to do anything they want to their bodies! its theirs for a reason) but it makes many followers wonder why they don't have the same feature. We only see the outside of celebs, & what the media portrays them as.

    1. There is a new culture emerging, badly needed as we face questions that may have old origins but that remain at the very core of our pursuit of knowledge. The choices we make now, as we shape our curricula and create academic departments and divisions, will shape the minds of future generations and of intellectual cooperation.

      I think that students should be encouraged to take courses in the humanities even if they're not a requirement because they'll be able to learn how to think critically which may also aid them in their science courses. I also think that the sciences and the humanities should be considered equally important; and not that one is higher or lower than the other.

    1. I think that's a salient point. Prescriptivists follow consistent rules; while, descriptivists allow variation, adaption, when necessary. Because both are not mutually exclusive--I do think prescriptivism makes it easier to communicate. Albeit a linguistic might argue that sets of patterns for how words to form phrases of clauses (whether spoken or in writing) is surely important because to put simply, we do not live in a Shakespearan era--and as the world evolves, society should demand evolution in the English language. How people use language has certainly changed. We are now using slang phrases--freely and abbreviation of words--constantly. Some may argue (whether this trend is good or bad; while others, might argue that "change is inevitable" and that certain words and/or phrases are "no longer in use." I think prescriptivism in grammar is important and should be required widely. However, most importantly, there is enough room for 'You and me' (descriptivism) and 'you' and I" (prescriptivism), without people being rebuked for misusing 'I' and 'me'. Finally, as languages become, according to the test, "[...] a form of cultural capital" and that "stigmatized forms are...used by social groups" begs the question that the article posed ("who's right?") and is grammar declining? Are grammar rules arbitrary and should we be confined to follow them? Or, are we destroying the English language with such thinking?

    1. Our lessons, units, and courses should be logically inferred from the results sought, not derived from the methods, books, and activities with which we are most comfortable.

      I like that this is the result of backward design, as it puts a focus back on student learning and pushes teachers to think about what is best for delivering content versus what they may be used to doing for a unit. -AG

    1. They need to acquire more languageand culture in order to be ready for more situations

      Language and culture not only helps us as communicators, but also prepares us varies situations we may encounter. It's amazing to think how these two create such a major impact on our lives and shapes into the person we are today.

      This is a great example of why a social constructive classroom is important to have. Allowing students to be open about their experiences helps surrounding students add to their knowledge and culture. By learning from others, we can be more equipped situations we may encounter.

      Even as an educator this is important!

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Response to the References

      Reviewer #1 (Evidence, reproducibility and clarity (Required)):

      In this manuscript Yan et al describe a method to perform imaging based pooled CRISPR screens based on photoactivation followed by selection and sorting of the cells with the desired phenotypes.

      They establish a system in mammalian RPE-1 cells where they integrate a photo-activatable mCherry, identify the cells of interest under the microscope based on a phenotype, automatically activate the mCherry fluorescence in these cells and then sort the desired populations by FACS. They demonstrate the reliability of their enrichment method and finally use this approach to look for factors that regulate nuclear size by a targeted pooled CRISPR screen.

      **Major points:**

      1.This year Hassle et al described a very very similar approach that they name: Visual Cell Sorting . In this case, they use a photoconvertible fluorescent protein (green-to-red conversion) to select cells with a certain visual cellular phenotype and enrich those by FACS. The Hassle et al 2020 MSB paper is only mentioned together with the other methods in the introduction in one sentence (ref #19 in this manuscript):

      " Recently, several in situ sequencing15,16 and cell isolation methods17-20 were developed which allow microscopes to be used for screening. However, these methods contain non-high throughput steps that limit their scalability."

      I think the current citation of the Hassle et al paper, is not really fair. The idea and the execution of the two approaches are almost exactly the same. Here, the authors concentrate on a CRISPR based application, but obviously the applications of the method are not limited to that. The authors should discuss how these similar ideas can be used in several different applications.

      We agree with the reviewer that we need to describe more about the Hasle et al. paper (now ref #20 in the revised manuscript) and expand our description of other applications that could be performed with the method. For this purpose, we have made the following changes:

      We have modified the relevant paragraph in the Introduction.

      p.3 the second paragraph

      Recently, an imaging based method named “visual cell sorting” was described that uses the photo-convertible fluorescent protein Dendra2 to enrich phenotypes optically, enabling pooled genetic screens and transcription profiling(Hasle, N.; Cooke, A.; Srivatsan, S.; Huang, H.; Stephany, J. J.; Krieger, Z.; Jackson, D.; Tang, W.; Pendyala, S.; Monnat, R. J., Jr.; Trapnell, C.; Hatch, E. M.; Fowler, D. M. 2020). Here, we developed an analogous approach to execute an imaging-based pooled CRISPR screen using optical enrichment by automated photo-activation of the photo-activatable fluorescent protein, PA-mCherry.

      We have also added the following paragraph in the Discussion.

      p.14 line 1

      In our study, optical enrichment was utilized for pooled CRISPR screens on phenotypes identifiable through microscopy. However, optical enrichment can be used for other purposes, as demonstrated previously(Hasle, N.; Cooke, A.; Srivatsan, S.; Huang, H.; Stephany, J. J.; Krieger, Z.; Jackson, D.; Tang, W.; Pendyala, S.; Monnat, R. J., Jr.; Trapnell, C.; Hatch, E. M.; Fowler, D. M. 2020). In a recent study by Hasle et al.(Hasle, N.; Cooke, A.; Srivatsan, S.; Huang, H.; Stephany, J. J.; Krieger, Z.; Jackson, D.; Tang, W.; Pendyala, S.; Monnat, R. J., Jr.; Trapnell, C.; Hatch, E. M.; Fowler, D. M. 2020), the process of separating cells by FACS after optical enrichment was termed “visual cell sorting”. This method was used to evaluate hundreds of nuclear localization sequence variants in a pooled format and to identify transcriptional regulatory pathways associated with paclitaxel resistance using single cell sequencing(Hasle, N.; Cooke, A.; Srivatsan, S.; Huang, H.; Stephany, J. J.; Krieger, Z.; Jackson, D.; Tang, W.; Pendyala, S.; Monnat, R. J., Jr.; Trapnell, C.; Hatch, E. M.; Fowler, D. M. 2020), demonstrating the broad applicability and power of this approach beyond CRISPR screening.

      1. While I understand that the authors mean conversion from the dark state to fluorescent state when they describe their photo-activatable mCherry, I think the term "photo-activation" can be confusing for the general reader since typically photo-conversion refers to a change in color. I would here suggest stick to the term photo-activation.

      We thank the reviewer for pointing this out and to avoid future confusion, we restricted the usage of photo-conversion to specifically indicate conversion of fluorescence from one color into another: e.g. when talking about the published visual cell sorting paper in which Dendra2 is used as a photo-convertible fluorescent protein. We use photo-activation in reference to the activation of PA-mCherry in our work.

      1. For validation of the hits coming from the nuclear size screen: Did the authors have any controls making sure that the right targets were down-regulated? This might be obvious for some of the targets (e.g. CPC proteins that are known to induce division errors display the nuclear fragmentation that the authors also observe) but especially for the ones that are less known or unknown to induce any nuclear size change, it will be important to demonstrate the specificity of the targets.

      For validating hits coming from the nuclear size screen, we have verified the successful transduction of corresponding sgRNA constructs by FACS analysis, but have not confirmed the knockdown. Before final journal publication, we propose to perform rt-qPCR on our 15 gene hits before and after knockdown to measure the percentage of knockdown separately.

      In addition, it is not clear from the figure legends and the material and methods if these phenotypes are verified by 3-4 gRNAs they use in the validation. Are the histograms representative of a single experiment with one gRNA or a combination of gRNAs in different experiments? Methods of replication of the data presented in Fig4 is unclear.

      We apologize for the confusion. These phenotypes were verified with pools of 3-4 sgRNAs and the histograms are representative of a single replicate infected with a mixed 3-4 sgRNA pool. We have modified the legend to Figure 5 (original Fig. 4) and the method section to explain this point.

      Minor points:

      1. Related to major point #3: I could not find much experimental info on how the hits from the screen were verified in materials and methods.

      The description of the experiment and information about the selected sgRNAs has been added in the Method section as follows:

      p.23

      Verification of hits from nuclear size screen

      For each hit in the nuclear size screen, the two sgRNAs with the highest phenotypic score in the screen and the two sgRNAs with the highest score predicted by the CRISPRi-v2 algorithm24 were selected and pooled to generate a mixed sgRNA pool of 3-4 sgRNAs (detailed information in Supplementary file 8). Cells (hTERT-RPE1 dCas9-KRAB-BFP PA-mCherry H2B-mGFP) were transduced with pooled sgRNAs targeting each gene and puromycin selected for 2 days to prepare for imaging. Cells were then seeded into 96-well glass bottom imaging dishes. Images were collected the next day and nuclear size was measured using the Auto-PhotoConverter µManager plugin. To focus on cells with successful transduction, BFP was co-expressed on the sgRNA construct and only cells with BFP intensity above a threshold value were included in nuclear size measurements. This BFP threshold was established by comparing the average BFP intensity of cells with and without sgRNA transduction (Fig.S3a).

      We agree with this important point and have changed the figure legend of Fig. 5c (original Fig. 4c) to just describe the plot:

      c, The ratios between median level of nuclear size measured from microscopy and H2B-mGFP fluorescence or FSC signal measured from FACS after knockdown, were plotted separately. TACC3, confirmed to be a control gene, was used for comparison (Grey bar).

      The typo has been corrected.

      Reviewer #1 (Significance (Required)):

      I think the idea of performing pooled screens coupled to microscopy is exciting and this approach has definitely more potential than the Craft-ID approach that the authors also discuss in their manuscript. In addition, the approach that is described in this manuscript is convincing and although the fact that the analysis part will require more work (to adapt the software to recognise different types of phenotypic readouts) in the future to make it accessible to the scientific community, the authors present sufficient evidence that the system can be robust. They also present some clever ideas such as to calculate enrichments with different photo-activation times (2sec vs 100ms) followed by separation of these populations by FACS.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)):

      In this manuscript, Yan et al. present optical enrichment, a method for conducing pooled optical screens. Optical enrichment works by combining microscopy to mark cells of interest using the PA-mCherry photo-activatable fluorescent protein with FACS to recover them. The method is similar to other methods (Photostick, Visual Cell Sorting), and provides an alternative to in situ sequencing/FISH methods. The authors use optical enrichment to conduct a pooled optical CRISPRi screen for nuclear size. They identify and exhaustively validate hits, showing that optical enrichment works for its intended purpose. The development of a uManager protocol and discussion of the number of sgRNA's required for a genetic screen using optical enrichment were welcome. The authors' reported throughput of 1.5 million cells per eight hour experiment is impressive; and the demonstrated use of low cell number input for next generation sequencing appears promising. Overall, the manuscript is well written, the methods clear and the claims supported by the data presented.

      **General comments**

      -I found the analysis and scoring methods to be lacking, both in terms of the clarity of description and in terms of what was actually done. The authors might consider using established methods (eg https://www.biorxiv.org/content/10.1101/819649v1.full). In any case, they should revise the text to clarify what was done and address the other concerns raised below.

      -Relatedly, details regarding how to perform the experiments described are lacking. It is not clear from the text, figures, "Online Methods" section, and Supplementary Files whether all imaging is performed before activation, or whether each field of view is subject to an individual round of imaging followed by activation. It is also unclear whether cells in 96 well plates are sorted as 96 separate tubes or pooled into a single tube prior to sorting. Furthermore, at a minimum, the following details are requested for each optical enrichment "run". These details are critical considerations for those who seek to use optical enrichment in their own laboratories:

      Seeding density

      Time elapsed (in hours) between cell plating and optical enrichment

      The number of fields of view examined

      The median number of cells per field of view; the proportion of each plate's surface area that is imaged and photo-converted

      The total time taken (in hours) to perform imaging and photoconversion

      The gating protocol used for sorting by FACS (preferably including a figure with example gates for one or two experiments). The gating protocol is described for the genetic screen but not for the control experiments.

      We agree with the reviewer and apologize for the confusion that arose from our description. We also thank the reviewer for suggesting using established methods. However, MAUDE, an analysis for sorting-based CRISPR screen with multiple expression bins, might not be suitable for our study since 1) the distribution of mCherry fluorescence intensity is a reflection of photo-activation efficiency and not sgRNA effect 2) only one sorting bin is collected for each experimental condition. Our analysis is adapted from an existing method from the Weissman lab (https://github.com/mhorlbeck/ScreenProcessing).

      We agree with the reviewer regarding clarifying other points and rewrote the following part in the Method section:

      p. 20

      mIFP proof-of-principle screen, Nuclear size screen, FSC screen and H2B-mGFP screen

      For the mIFP proof-of-principle screen, mIFP positive cells (hTERT-RPE1 dCas9-KRAB-BFP PA-mCherry H2B-mGFP mIFP-NLS) and mIFP negative cells (hTERT-RPE1 dCas9-KRAB-BFP PA-mCherry H2B-mGFP) were stably transduced with the “mIFP sgRNA library” (CRISPRa library with 860 elements, see Supplementary file 5) and the “control sgRNA library” (CRISPRa library with 6100 elements, see Supplementary file 6) separately. For the nuclear size screen, FSC screen and H2B-mGFP screen, cells (hTERT-RPE1 dCas9-KRAB-BFP PA-mCherry H2B-mGFP) were stably transduced with the “nuclear size library” (CRISPRi library with 6190 elements, see Supplementary file 7). To guarantee that cells receive no more than one sgRNA per cell, BFP was expressed on the same sgRNA construct and cells were analyzed by FACS the day after transduction. The experiment only continued when 10-15% of the cells were BFP positive. These cells were further enriched by puromycin selection (a puromycin resistance gene was expressed from the sgRNA construct) for 3 days to prepare for imaging. For FSC and H2B-mGFP screens, cells were then subjected to FACS sorting. Cells before FACS (unsorted sample for FSC and H2B-mGFP screens) and top 10% cells based on either FSC signal (high FSC sample) or GFP fluorescence signal (high GFP sample) were separately collected and prepared for high throughput sequencing. For mIFP proof-of-principle screen and nuclear size screen, cells were then seeded into 96-well glass bottom imaging dishes (Matriplate, Brooks) and imaged starting from the morning of the next day (around 15 hr after plating). A series of densities ranging from 0.5E4 cells/well to 2.5E4 cells/well with 0.5E4 cells/well interval were selected and seeded. The imaging dish with cells around 70% confluency was selected to be screened on the imaging day. For mIFP proof-of-principle screen, a single imaging plate was performed for each replicate while 4 imaging plates per replicate were imaged for the nuclear size screen. When executing multiple imaging runs, 2 consecutive runs could be imaged on the same day (day run and night run). 64 (8x8, day run) or 81 (9x9, night run) fields of view were selected for each imaging well and each field of view was subjected to an individual round of imaging directly followed by photo-activation. Around 200-250 cells were present in each given field of view and 60% to 80% surface area of each well was covered. Either mIFP positive cells or cells passing the nuclear size filter were identified and photo-activated automatically using the Auto-PhotoConverter µManager plugin. The total time to perform imaging and photo-activation of a single 96-well imaging dish with around 1.5 million cells was around 8 hr. The night run generally took longer, since more fields of view were included than in the day run. Cells were then harvested by trypsinization and pooled into a single tube for isolation by FACS. Sorting gates were pre-defined using samples with different photo-activation times (e.g. 0s, 200ms, 2s) and detailed gating strategies are described in Supplementary file 1. Sorted samples were used to prepare sequencing samples.

      -The authors use PA-mCherry. There are a variety of other photo-activatable fluorophores available, and it would be good for them to comment on why they chose PA-mCherry. Also, since the method is supposed to be used for generic pooled optical screens, it would be good for the authors to comment on what colors remain available for imaging cellular structures.

      To address these, we have added the following sentences:

      p. 4 line 16

      A photo-activatable fluorescent protein was chosen over a photo-convertible fluorescent protein to increase the number of channels available for imaging. PA-mCherry was chosen to leave the better performing green channel open for labeling of other cellular features. Moreover, non-activated PA-mCherry has low background fluorescence in the mCherry channel (Fig. S1b), and it can be activated to different intensities when photo-activated for various amounts of time.

      p. **14 line 10

      Phenotypes of interest should be identifiable under the microscope and generally require fluorescent labeling. Commonly used fluorescence microscopes use four channels for fluorescent imaging with little spectral overlap: blue, green, red and far red. In our study, the red channel was occupied by cell labeling with PA-mCherry and the blue channel was used to estimate sgRNA transduction efficiency. Since sgRNA transduction efficiency can be measured by other approaches, the blue channel could be used together with the remaining two channels to label cellular structures. Combining bright field imaging with deep learning can be used to reconstruct the localization of fluorescent labels(Ounkomol, C.; Seshamani, S.; Maleckar, M. M.; Collman, F.; Johnson, G. R. 2018), making it possible to use bright field imaging to further expand the phenotypes that can be studied with our technique.

      -In general, the figures are hard to read, with most space being dedicated to beautiful but complex schematics/workflows. Points and fonts should be bigger, and the authors should consider revising the schematics to take up less space.

      We thank the reviewer for this remark and revised all figures accordingly. Points and fonts were enlarged, and schematics were simplified or removed.

      -There is extensive use of editorialzing adverbs. Adverbs such as "highly" (abstract and page 15), "easily" (pages 4 and 11), "completely" (page 11), and "only" (page 12) are unnecessary at best and unsupported by the data at worst (e.g. cells are not "completely" separable with 100 ms photo-conversion, see page 11 and Figure 1C). Please remove "completely" from page 11 and consider removing other adverbs as well.

      We agree with the reviewer and the following adverbs have been removed: “highly” in abstract and page 15; “easily” on pages 4 and 11; “completely” on page 11 and three “only” on page 12.

      -Apologies if I missed it, but I couldn't find a data availability statement. Sequencing reads from the experiments should be deposited in SRA or GEO and made available upon publication.

      We apologize that we missed this, and the sequencing data has been deposited to GEO (GSE156623) which will be made available before final publication. The following part has been added to address this.

      p. 24

      DATA AND SOFTWARE AVAILABILITY

      The raw and processed data for the high throughput sequencing results have been deposited in NCBI GEO database with the accession number (GSE156623). The plugin Auto-PhotoConverter developed for open source microscope control software μManager(Edelstein, A. D.; Tsuchida, M. A.; Amodaj, N.; Pinkard, H.; Vale, R. D.; Stuurman, N. 2014) has been deposited on github (https://github.com/nicost/mnfinder).

      **Specific comments**

      Pages 5/6 - The authors present experiments that show that optical enrichment is highly specific for desired cells. But, they should consider presenting precision (fraction of called positives that are true positive) and recall (fraction of all true positives that are called positive) instead. I think these relate more directly to a pooled optical screen than specificity.

      We apologize for our poor terminology. Our original definition of “specificity” is the same as “precision” suggested by the reviewer. To avoid future confusion, we have changed all relevant occurrences of “specificity” into “precision”. The following sentence was modified to clarify the definition:

      p. 5 line 15

      To evaluate the precision (the fraction of called positives that are true positives) of this assay, all cells were collected and analyzed by FACS after image analysis and photo-activation (Fig. 2d and 2e). We calculated precision as the fraction of photo-activated cells (mCherry positive cells) that are true positives (mIFP-mCherry double positive cells) (Fig. 2f).

      Measuring recall is complicated because the microscope is unable to visit all locations in the imaging plate, hence recall will depend on the fraction of cells actually “seen” by the microscope. For the screening strategy employed in the nuclear size screen, recall is not as important as precision, since lower recall rates are compensated for by screening larger cell numbers. We therefore did not attempt to measure recall directly.

      Page 6 - Related to the above point, the authors state "These results indicate the assay yields reliable hit identification regardless of the percentage of hits in the library." This statement seems too strong given that the authors looked at specificity experimentally with a mixture of ~1% mIFP positive cells. In fact, hits might be much less than 1% of the total population of cells, and specificity would certainly fall from the 80% measured at 1% of the total population. The authors should do a bit more to fairly discuss their ability to find rare hits.

      We agree with the reviewer and have changed the following description:

      p. 5 line 20

      The precision varied with the initial percentage of mIFP positive cells and ranged from 80% to ~100% (initial percentage of mIFP positive cells ranging between 2.3% and 43.7%) (Fig. 2f). Precision is expected to fall below 80% with initial percentage of mIFP positive cells less than 2.3%. However, these results indicate that optical enrichment can be used to identify hits with high precision even at relatively low hit rates.

      Pages 6/7 - The authors perform a validation experiment using two different sgRNA libraries, infecting mIFP- and mIFP+ cells separately. Then, they demix these populations via optical enrichment, sequence and compute a phenotype score for sgRNAs or groups of sgRNAs. The way the experiment is described and visualized is extremely confusing. If I understood correctly (and I am not sure that I did), the bottom right panel of Figure 2b shows that if sgRNAs are (randomly?) paired AND two replicates are combined then optical enrichment nearly perfectly separates all (combined, paired) sgRNAs in the two libraries. The authors should rewrite this section, especially clarifying what is meant by "1 sgRNA/group and 2 sgRNA/group," and consider changing Figure 2b (perhaps just show the lower right panel?).

      We apologize for our confusing description. To avoid the confusion, we rewrote the paragraph describing the experiment and added a schematic (Fig. 3a) to better describe this experiment. We also simplified the result by just presenting the lower right panel of original Fig. 2b (current Fig. 3b) and moved the other data into supplementary figures (Fig. S2).

      p. 6 line 4

      mIFP negative cells and mIFP positive cells were separately infected with two different CRISPRa sgRNA libraries (6100 sgRNAs for mIFP negative cells; 860 sgRNAs for mIFP positive cells) at a low multiplicity of infection (MOI) to guarantee a single sgRNA per cell. Note that in these experiments, the sgRNAs only function as barcodes to be read out by sequencing, but do not cause phenotypic changes as the cells do not express corresponding CRISPR reagents. These two populations were then mixed at a ratio of 9:1 mIFP negative cells: mIFP positive cells. We again used mIFP expression as our phenotype of interest (outlined in Fig. 3a). Two biological replicates were performed and at least 200-fold coverage of each sgRNA library was guaranteed throughout the screen, including library infection, puromycin selection, imaging/photo-activation and FACS.

      Page 8 - Related to Supplementary Figure 3, why are there not clear BFP+ and BFP- populations but instead one continuous population? How was the gating determined (e.g. how was the boundary between red and gray picked)? Here, and generally, flow plots and histograms of flow plots should indicate the number of cells. If replicates were performed, they should be included.

      We have clarified our description. There are no clear BFP+ and BFP- populations but instead one continuous population due to the background expression of BFP from the dCas9 construct: dCas9-KRAB-BFP (which is now clearly indicated in the manuscript). On top of the dCas9-KRAB-BFP, another BFP is encoded on the sgRNA construct, which leads to a higher BFP expression level.

      There was no gating in the experiment, the grey dots in the figure represents wild type cells without viral transduction while the red dots (partially covered by the grey dots) were cells infected with the two negative control sgRNAs. We mistakenly wrote the legend of original Fig. S3 (current Fig. S3a) that these were FACS data; however, the data were acquired by imaging. We apologize for the confusion and thank the reviewer for detecting the issue. We completely rewrote the legend to Fig. S3a (original Fig. S3) to clarify.

      We now include the number of cells analyzed and the number of replicates for the other flow plots and histograms in the manuscript.

      Page 8 - "Nuclear sizes...". The authors should say in the main text what size metric was used.

      To address the reviewer’s point, we have included the following sentence:

      p. 8 line 23

      We defined nuclear size as the 2D area in square microns measured by H2B-mGFP using an epifluorescence microscope, as determined by automated image analysis (Fig. 4a and Supplementary file 2).

      Page 9 - I am a little confused about the statistical analysis of the screen. In Supplementary File 1, the authors state that p-values were "calculated based on comparison between the distribution of all the phenotypic scores of sgRNAs targeting to the gene/assigning in the group and the one of negative control sgRNAs in the libraries." I presume this means that all phenotypic scores (across replicates) of all sgRNAs targeting each gene were included in a Mann Whitney U test with a single randomized set of phenotypic scores. If that's right, it seems like an odd way to get p-values. Better would be a randomization test, where a null distribution of phenotypic scores for each gene is built by randomizing sgRNA-level scores many times. Then the actual phenotypic score is compared to the randomized null distribution, yielding a p-value. In any case, the authors must clarify what they did in the main text and Supplementary File 1.

      Page 9 - It does not appear that the p-values presented in Figure 3c have been adjusted for multiple hypothesis testing. This should be done.

      Page 9 - "A value of the top 0.1 percentile of control groups was used as a cutoff for hits." Why? This seems arbitrary. It seems like appropriate false-discovery rate control would enable a more rigorous method for choosing a cutoff.

      Page 9 - The same comments regarding analysis and scoring of the optical enrichment screen applies to the FSC and GFP screens.

      We clarified the description of the statistical analysis of the screen (see new/changed text below). Mann-Whitney p-values for the two replicates were calculated independently. The Mann-Whitney U test was not performed against a randomized set of phenotypic scores, but using the phenotypic scores of the 22 control non-targeting sgRNAs that were part of the library. Because there are only 22 control sgRNAs (adding more control sgRNAs would increase the size of the library, and reduce the number of genes that can be screened within a given amount of time), the statistical significance of testing genes against these controls is not expected to be very high, and using direct approaches such as multiple hypothesis testing are not expected to yield hits. Instead, we calculated a score combining the severity (phenotypic score) and the trustworthiness (Mann-Whitney p value) of the phenotype (a method previously developed in the Weissman lab at UCSF: https://github.com/mhorlbeck/ScreenProcessing24). We thank the reviewer for suggesting using false discovery rate control as a better method for choosing a cutoff. We modified our original analysis and now determine the threshold of our score based on a calculated empirical false discovery rate (eFDR). We used this approach to maximize the number of true hits and relied on a repeat of the screen and follow-up testing of hits to narrow down true hits. We added the following part in the method section and added an analysis example to the supplementary files (Supplementary file 9)."

      p. 22

      Bioinformatic analysis of the screen

      Analysis was based on the ScreenProcessing pipeline developed in the Weissman lab (https://github.com/mhorlbeck/ScreenProcessing)**(Horlbeck, M. A.; Gilbert, L. A.; Villalta, J. E.; Adamson, B.; Pak, R. A.; Chen, Y.; Fields, A. P.; Park, C. Y.; Corn, J. E.; Kampmann, M.; Weissman, J. S. 2016). The phenotypic score (ε) of each sgRNA was quantified as previously defined(Kampmann, M.; Bassik, M. C.; Weissman, J. S. 2013)** (Supplementary file 9). For the mIFP proof-of-principle screen, phenotypic score of each group was the average score of two sgRNAs assigned to the group and averaged between two replicates except otherwise described. For the nuclear size screen, FSC screen and H2B-mGFP screen, genes were scored based on the average phenotypic scores of the sgRNAs targeting them. For the nuclear size screen, phenotypic scores were further averaged between 4 runs for each replicate. For the nuclear size screen, FSC screen and H2B-mGFP screen, sgRNAs were first clustered by transcription start site (TSS) and scored by the Mann-Whitney U test against 22 non-targeting control sgRNAs included in the library. Since only 22 control sgRNAs were included, significance of hits was assessed by comparison with simulated negative controls that were generated by random assignment of all sgRNAs in the library and phenotypic scores of these simulated negative controls were scored in the same way as phenotypic scores for genes. A score η that includes the phenotypic score and its significance was calculated for each gene and simulated negative control. The optimal cut-off for score η was determined by calculating an empirical false discovery rate (eFDR) at multiple values of η as the number of simulated negative controls with score η higher than the cut-off (false positives) divided by the sum of genes and simulated negative controls with score η higher than the cut-off (all positives). The cut-off score η resulting in an eFDR of 0.1% was used to call hits for further analysis (Supplementary file 9). An example analysis is described in detail in Supplementary file 9 and raw counts and phenotypic scores for all four screens are listed in Supplementary file 10 and 11.

      Page 9 - "These data suggest that a direct measurement utilizing a microscope can provide significant improvement in hit yield even for phenotypes that could be indirectly screened with other approaches." I think this conclusion is too strong. It rests on the assumption that the FSC/GFP phenotypes should have the same set of hits as the microscope phenotype (larger nuclear area). This may not be the case. For example, genes whose inactivation increases GFP expression would be hits in the former, but not latter case. The authors should moderate this statement.

      We agree with the reviewer and have changed the sentence into:

      p. 10 line 17

      These data suggest that a direct measurement utilizing a microscope can provide different information and reveal hits that are inaccessible using other screening approaches.

      Page 11 - "This is significantly faster than the in situ methods." The authors should provide a citation and an actual comparison to the speed of in situ methods.

      We agree with the reviewer and have modified the sentence with a citation:

      p. 12 line 20

      This is significantly faster than in situ methods which process millions of cells over a period of a few days(Feldman, D.; Singh, A.; Schmid-Burgk, J. L.; Carlson, R. J.; Mezger, A.; Garrity, A. J.; Zhang, F.; Blainey, P. C. 2019).

      Page 12 - I think the authors could say a bit more about the possibility of low hit rate screens. How low do they think it is feasible to go? What hit rates are expected based on existing arrayed optical screens?

      We have added more description in the discussion section:

      p. 13 the second paragraph

      Optical enrichment screening also is possible for phenotypic screens with relatively low hit rates (defined as the fraction of all genes screened that are true hits). The ability to detect hits at low hit rates in our method depends on multiple factors, including: 1) the penetrance of the phenotype; 2) cellular fitness effect of the phenotype; 3) detection and photo-activation accuracy of the phenotype; 4) limitations imposed by FACS recovery and sequencing sample preparations of low cell numbers. The first three factors vary with the phenotype of interest. We optimized the genomic DNA preparation protocol (Methods), and are now able to process sequencing samples from a few thousand cells, enabling screens of low hit rate phenotypes. In our nuclear size screen, more than 1.5 millions cells were analyzed during each run with 2000-4000 cells recovered after FACS sorting. The hit rate of this screen was 2.76%, similar to optical CRISPR screens performed in an arrayed format(de Groot, R.; Luthi, J.; Lindsay, H.; Holtackers, R.; Pelkmans, L. 2018)**, demonstrating the possibility to apply our approach to investigate phenotypes with low hit rates.

      Page 14 - It is weird that the discussion includes a fairly important couple of paragraphs that seem to belong in the results (e.g. the text surrounding Figure 4b and c). Obviously, I don't want to prescribe stylistic changes, but I suggest the authors consider moving this description of the experiments/analyses to the results.

      The relevant description has been moved to the results.

      Page 14 - The authors validate their hits individually, and observe that expression of hit sgRNAs does increase nuclear size in some cells. But, many/most cells remain control-like in these validation experiments. The authors should comment on why this is the case (e.g. inefficient knockdown, cell cycle effects, etc).

      To address this point, we have added the following sentences in legend of Fig. 5:

      The cell population is heterogeneous due to inefficient knockdown, incomplete puromycin selection, and penetrance of the phenotype. A BFP was expressed from the same sgRNA construct. Only cells with high BFP intensity, indicating successfully sgRNA transduction, were included for data analysis as described in Methods.

      Page 14 - It would be nice to formally compare the control and sgRNA distributions in each panel of 4a and Supplementary Figure 5 (e.g. with a Komolgorov-Smirnov test, etc). That would allow a more precise statement to be substituted for "14 out of 15 hits (the exception was TACC3) were confirmed to be real hits, with cells exhibiting larger nuclei after knock down (Fig. 4a and Fig. S5)," which is not quantitative.

      We applied the Kolmogorov-Smirnov test and the corresponding sentence was changed into:

      p. 10 last line

      *14 out of 15 hits were confirmed to be real hits (Kolmogorov-Smirnov test two tailed p-value

      Figure 2a - I am not sure it is necessary to show the entire workflow again. The first and possibly last panels are the informative ones here.

      Figure 3a - Same comment as above - these workflow panels take up a lot of real estate and I suggest simplifying them if possible.

      The figures were simplified to just show the example images.

      Figure 3c - At least on my PDF/screen, the "scrambled control" points appear very light gray and are impossible to find. They should be an easier to spot color.

      We agree with the reviewer and changed the color.

      Figure 4b - "Most cells developed a larger cellular size and higher H2B-mGFP level after knock down." I think it would be more accurate to say that the median cell size/GFP level increased, or that some cells developed larger sizes/median GFP levels.

      We agree with the reviewer’s point; “most” has been changed to “some”.

      Figure 4c - I don't understand "Normalized FITC/nuclear size." Do the bars show the mean/median of a population (if so, why not show a dot plot or box plot or violin plot)? Also, what is FITC (I presume it's GFP levels)?

      Figure 4c - "Most cells maintained a constant ratio between nuclear size and DNA content..." I'm not sure where DNA content came from. Are the authors assuming that their H2B-mGFP is a proxy for DNA content? Or was some other measurement made? If the former, is there a citable reason why this is a good assumption?

      The bars represent the ratio of the median level of H2B-mGFP intensity (the axis is now labeled with "GFP" rather than "FITC", the colloquial name for the channel used on the FACS machine) measured by FACS and the median nuclear size of the same population of cells measured by microscopy. We plan to perform additional experiments to measure DNA content using a DNA dye in the same cell by microscopy so that we will be able to correlate these on a cell by cell basis. Data will be added before final publication.

      Reviewer #2 (Significance (Required)):

      I don't generally comment on significance in reviews. Since ReviewCommons is specifically asking, I'll say that this manuscript describes optical enrichment, a method that is an extension of previous work and is substantially similar to a previously published method, Visual Cell Sorting. However, given the timing, it is obvious that these authors have been working independently on optical enrichment. Since the application is distinct, and optical enrichment incorporates some nice features like software to make it easier to execute, it is clearly of independent value.

      Reviewer #3 (Evidence, reproducibility and clarity (Required)):

      This study reports a rapid and high-throughput CRISPR-based phenotypic screen approach consisting of selecting cells with phenotypes of interest, label them by photo-conversion and isolating them by FACS. The idea of the method is interesting (has been around) in principle. The key advantage is that is relatively simple, accessible to many groups as it does not require robotics. However, the manuscript is so badly written and hard to follow, that it makes it difficult to judge the technology, to really understand how the experiments were done and whether the results are interpreted correctly. Strictly speaking, it is unclear whether and how good scientific practices GSP have been followed, as the description of the experiments is sometimes lacking totally. Consequently, it is impossible to seriously evaluate this study and judge whether the technology described is really promising. It is probably less sensitive than arrayed screens, in all likelihood can miss hits that affect growth, cannot capture as many phenotypic classes as one would like from high-content screens and the computational and experimental workflow is more complicated. It is puzzling that the authors don't even compare the results with arrayed screens which are of course the current gold-standard.

      We do not in any way claim that the presented method replaces arrayed screens. However, most current sgRNA libraries are pooled libraries, and the few available arrayed sgRNA libraries are expensive and difficult to maintain, hence our methods to screen pooled sgRNA libraries are timely and useful. Comparisons with arrayed screens are unwarranted as no claims are made with respect to arrayed screens.

      We have clarified the manuscript in many places, and hope it is now readable and better understandable by more readers with diverse backgrounds.

      **Specific points:**

      The specificity test (Fig 1) does not make sense how it is described. If the authors spike a certain percentage of cells that can be photoconverted, when analysing the outcome, there will be three classes: mIFP positive, mIFP/mCherry positive and negative. How can they calculate specificity if they do not know whether they converted all mIFP cells? Also the formula used is questionable or is her an error? Furthermore, it is totally unclear how many cells were used and how they were scanned. If they took 90 negative cells and 10 mIFP cells, getting them all back is easy. If they start with 10e9 cells, the specificity should be quantified. Furthermore, the phenotype they pick is an easy and convenient one. Much more challenging is to apply it on a multi-parametric phenotype. Again, this is now the gold standard.

      We used the term specificity inadvertently and should have used precision, as also pointed out by Referee 2. This has been corrected in the current manuscript. We picked the mIFP phenotype as this was a proof of principle screen to clarify the performance of our screening approach and needed a phenotype that can be measured both by microscopy and FACS. We demonstrate that multi-parametric read-outs are possible, but do not think that the first demonstration of new technology needs such an application.

      In their first sgRNA assay, it is not possible to have a clear idea of what groups they are talking about. Do they mean they get phenotypic signatures which they group? How? They need to describe what they do. Here, only ~3500 genes are scanned (the 6843 is both populations and you only select from the mIFP neg population) and it took them 8hrs. This means for the genome it would require ~60h which is indeed fast. However, this experiment is not clearly described. They cannot select the negative population since there is no fluorescent marker (except false positive which are around 1.7%). So I assume they just randomly pick cells (they should really explain much better what they do!). Why go through the hassle? If these sequences are supposed to be a negative population, just pick them in the computer. Also, they cannot calculate an enrichment compared to the negative population, since two different libraries were infected. Again, I can't follow.

      We improved the description of this experiment. To clarify, we used mIFP in a proof of concept screen to validate whether sgRNAs infecting mIFP positive cells can be distinguished from those infecting mIFP negative cells No phenotypic signature other than the mIFP signal is used (as described in the text). As customary in pooled screens, a primary comparison was made between the positive (optically selected) cells and the complete population. To improve the clarity of this screen, we further described the concept of pooled sgRNA screens, which may have made this section harder to follow.

      I find their results about calculating scores based only on true negatives surprising. The average phenotypic score is improved from 3 to 5, which is enormous. This suggests that the phenotypes induced in the mIFP population are extremely common. These results are hard to interpret given the poor description of the experiment. It is possible that it is the same dataset as in 1, but in that case, the false negatives must be rare since the negatives can be selected by absence of both mCherry and mIFP.

      There are no phenotypes induced in the mIFP population (as now explicitly explained in the text). The mIFP population is isolated using optical enrichment, and we test our ability to discriminate the sgRNAs present in the enriched population. It is unsurprising that comparing to the negatively selected population (which is not possible in most other pooled screens) is significantly better than comparing against the total population (as customary in pooled screens).

      In the nuclear size screen, 6000 sgRNAs were screened. To array so many sequences would require 20 plates. They required ~40h for imaging one replicate. This is slow, imagine the time with a 60x lens.

      There are no arrayed screens performed in our study.

      Reviewer #3 (Significance (Required)):

      Overall, there is no sufficient evidence in this manuscript to convince this reviewer that this method is valid and truly powerful. I cannot support publication in its present form.

    1. But I wondered: Though agency may be good for you, does seeing yourself as a strong protagonist come at a cost to the other characters in your story? Are there implications for empathy if we see other people as bit players instead of protagonists in their own right?

      I think that people can balance agency and becoming a strong protagonist without it affecting other "characters" in their story. I'm not sure it's necessarily absolute.

    1. We don’t have to turn away from the mainstays of Victorian literature to study empire and racialization, although it may be useful to set these works in new constellations.

      I think a change of framing would be perfect for "undisciplining Victorian study." We can change what we take from these works when we view them not as "classics" but as the works produced by the rulers of an empire, or a higher, oppressive class.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      We would like to express our upmost gratitude to the three anonymous reviewers for their constructive and insightful comments on our manuscript. We broadly agree with all comments made and have uploaded a preliminary revised version with changes highlighted in bold. We now deal with each of the reviewer comments in turn.

      Reviewer #1

      L50-52: Can you predict where the unmapped read came from? Could viral infections be the source as in land plants?

      Having done a crude examination of unmapped reads, we couldn't find compelling evidence of them being of viral origin. The unmapped fraction in fact was in the same region as seen for other sRNA libraries in our lab which we found to occur for a number of reasons such as sequencing errors, incomplete assembly, differences between the sequenced lines and the reference line. Those all result in unmapped reads, which is also cause by since we employed a stringent mapping (0 mismatches).

      L67-68, which is the explanation?

      Thank you for querying this. After much closer inspection of the papers cited by Casas-Mollano et al. as evidence of the 23nt peak the evidence for the 23nt doesn't seem that strong and may even be a mistake on their part. Nonetheless, it is far from a critical piece of information for this paper and we have thus decided to remove this sentence.

      Fig 1D the reference to the A,C,G,U 5' should be re-positioned within Figure 1D panel space.

      Thanks, this has been addressed.

      Figure 3: it could be a supplementary figure based on the relevance given in the manuscript to this point.

      We agree, and have moved Fig3 to Supplement.

      *P5, line 107: while commenting on strand bias there seems to be a mistake in strong bias definition, it should be x 0.8, not "strong bias (0.2

      Thank you for pointing this out, we have now corrected this error. We have duly corrected it in the text.

      P5, line 110: marked changes regarding locus size are not as striking in my opinion, in particular log size 6 and following, which is not marked in the graph (the cut off between 6 and 8). Maybe this curve should be split into two distribution graphs based on some important features (as repetitiveness?) that might allow a better definition of cut-offs.

      Thank you for pointing this out. You are correct that the changes in the density distribution are not as striking for locus size. A great deal of deliberation on our part went into deciding what to do about this. In the end, we decided that for the size classes there was benefit in having several different classes with the understanding that having additional potentially redundant cut-offs would not adversely effect the analysis. In doing this, we were partially driven by the albeit subtle changes in the curve, but also by the desire to have size classes that were biologically relevant and informative. For example, a locus 3000nt captures the long tail. However, we neglected to fully explain these subtleties in our decision-making, something we have now rectified through some added explanation in the text. These choices were validated by the way size classes are differentially associated with different locus clusters in Figure 8.

      Fig 5: the legend has the C subfigure twice, the second should be D.

      Thank you for highlighting this. It has now been corrected.

      Table 1: I believe the data would be better presented in a plot, potentially something similar to the plot in Figure 1 A and B. The numbers are already presented in the supplementary spreadsheet.

      Thanks for pointing this out. We agree with this suggestion and have replaced Table 1 with a Figure (Fig 5) which is indeed a better way to present those results.

      Fig 6A: The boxplots regarding Stability of the clusters should be better described. What exactly does the y-axis in each "small plot" represent?

      Thank you for pointing this out, we understand that this isn't clear at the moment. Briefly, for this analysis we performed the clustering multiple times each time with a random sample of the loci (with replacement) of the same size as the original dataset. We then calculated the proportion of loci that retained their original clustering. We have clarified this in the figure legend and also elaborated on the approach in the methods section to ensure that it is better described.

      P6, line 142: analyses of stability and variance shows 7 as the optimal k, while gap statistics and NMI suggested 6 as the optimal. It is not clear why 6 was preferred. The MCA section in Methods is unclear regarding this point too.

      Thank you for querying this. The process of choosing the appropriate value of k is a complicated one and we appreciate that the explanation could be clearer. After your comment, we re-visited our decision-making process and were reassured that a k value of 6 rather than 7 was indeed appropriate. The stability plots in Fig. 6A start with k=2 and it can be clearly seen for k=6 that stability is comparatively high for dimensions 7-10. Indeed, k values of 2,3 and 6 seem to be the only feasible values. k=7 is fairly unstable for all dimensions from 1-8. We have done some rewording of the methods to hopefully make this clearer.

      Fig S2-S5: please check legends, they are identical, although they should cover examples of loci in LC2 through LC5. These figures are not cited in the text, only S1 and S2.

      Thanks for pointing this out. This is now corrected and we have referenced all figures in the main text.

      Fig 9: I suggest using different colors in density plots to ease interpretation. LC tracks could share a color and Gene, TEs, DNA meth, and All loci should have a different color each.

      A good suggestion - this has been replotted with different colours.

      Supplementary Files S1: The full-annotated locus map should be provided as a spreadsheet file or as a text (.csv) file, not as a pdf file.

      Thanks for pointing this out. We originally submitted this file as a gff format. We are not sure why this got converted. We will make sure this is going to be in appropriate format in the final form, especially having suffered from the pains of pdf tables ourselves in the past.

      I may be misunderstanding Fig. 6E, but it looks strange that the observed sum-of-squares is smooth, but the expected is not. Is it possible that the in-figure reference is inverted?

      Indeed, the colours were inverted. Thanks a lot for that spot, we have now swapped them around.

      Reviewer #2

      I am concerned that the methodology used does not adequately distinguish small RNA loci that are attributable to random RNA degradation products from loci that are truly fit the DCL / AGO paradigm. I think this is critical to maximize the utility of the annotations for the community. This issue was not directly addressed in the current version of the manuscript. There is cause for concern: 64% of the annotations overlap with protein-coding genes (lines 116-117), 55% with exons (line 118), and 41% of loci show strong strand bias (lines 123-124). These are all associations expected for breakdown products of mRNAs. Furthermore, only 11% of the loci were found to be dependent on CrDCL3 (line 123). Small RNA sequencing data from the other 2 DCL mutants are not yet available (line 211). One way that has been effective in angiosperms is to track the proportion of "DCL-sized" RNAs within all RNAs from each locus. Loci comprised of random degradation products will be single-stranded, generally touching exons, and have a very wide size distribution. In contrast, loci where the small RNAs are truly created by a DCL protein will have a very narrow size distribution. In any event, I think a strong effort to identify and flag small RNA loci that are less likely to be DCL / AGO silencing RNAs, and more likely to be degradation products, would be an important change to this study.

      Thank you for this very insightful comment which has helped us to reflect on the methodological approach. While it is likely that there are some RNA breakdown products picked-up in the sRNA sequencing, we do not think that the locus-map as a whole is undermined by this. For example 54% of loci have a predominance for 21-nt sRNAs and 18% for 20-nt sRNAs, so the majority of sRNA loci do have a predominance for a specific RNA size.

      However, your point does raise a very valid concern with implications for the interpretation of LC4. Although we posit some explanations for these loci (e.g. DCL-mediated sRNA production without an accessory protein to provide PAZ domain-like sRNA measurement), given the very strong strand bias and association with genic regions we do agree that there is a risk that these loci predominantly represent degradation fragments. Therefore, we have now reworded how we discuss LC4 in the discussion to reflect this. This also reveals a key advantage of the clustering approach in that should LC4 indead represent degradation products, they have been successfully grouped together into a seperate cluster such that they don't undermine the insights gained from the other locus clusters.

      One of the key results likely to be used by others is the final GFF3 file (Sup File S1). The Description fields in this file are extremely verbose. Do these load well on a genome browser? I suggest it might be good to store most of the information currently in the Description field in a separate flat file, and limit the GFF3 descriptions to key information (locus name, the LC group).

      Thank you for pointing this out. In a pursuit to share as many details as possible, we appreciate that this can be too verbose, as righlfully noticed here. In order to not compromise detail too much, we have created a second, toned down, version as csv which now includes essential details such as name, position and LC. As for the gff, we kept all details in since it loads quickly in a genome browser, but also into other tools such R in which those feature can be used as efficient filters.

      Sup Table S1 would be much more useful for future researchers if it had a column with the direct accession numbers for the raw sequencing libraries.

      We have included another table which includes direct accession number for ENA as well as numerous other meta data in Sup Table S6 i.e. "Supp_Table_S6_library_ENA_accession"

      Figures showing genome browser snapshots are too small; the text is mostly illegible on screen and when printed. This includes Figure 4 and Figures S1-S5.

      The snapshots have been improved to ensure better readability.

      Lines 67-68: This is unclear to me. Did the authors do Northerns? Please clarify / re-write.

      Thank you for querying this. After much closer inspection of the papers cited by Casas-Mollano et al. as evidence of the 23nt peak the evidence for the 23nt doesn't seem that strong and may even be a mistake on their part. Nonetheless, it is far from a critical piece of information for this paper and we have thus decided to remove this sentence.

      Figure 2B: X-axis label, perhaps change to "number of reads in library" for clarity.

      We agree and have changed it accordingly

      Figure 4 caption: The acronym "CRSL" should be defined.

      CRSL is now been duly defined in the manuscript

      Line 387: Reference #29 (line 509): There is not enough information here to find the data.

      We have used the appropriate bibtex code to reference this Zenodo share (https://zenodo.org/record/3862405/export/hx). The current cite format does somehow omit some information. We hope this will be fixed by the publisher but we have also provided the full DOI address in the “additional information” section just in-case. We will keep an eye on how it comes out.

      Style suggestion on title: What is "secret" about the genome? I didn't really understand that first part of the title. Perhaps consider revision to make it more factual and less literary. Just "A small RNA locus map for Chlamydomonas reinhardtii"?

      Thank you for this suggestion, we have adapted the title to make it more descriptive.

      Reviewer #3

      …the evolutionary implications are not clear. The authors state in the abstract that "These results are consistent with the idea that there was diversification in sRNA mechanisms after the evolutionary divergence of algae from higher plant lineages." Although in the end this may prove to be correct, the only species compared are Arabidopsis thaliana (as representative of land plants) and Chlamydomonas reinhardtii (as representative of green algae). With this very limited information it is not possible to infer the sRNA loci (much less sRNA mechanisms) in an ancestral species. It remains formally possible that an ancestral progenitor species had a greater diversity of sRNA loci that were subsequently lost in a selective manner in specific lineages. Moreover, the diversity of sRNA loci may not correlate strictly with the diversity of the RNAi machinery since, at least some loci, do not appear to be associated with RNAi components such as Dicer or Argonaute.

      Thank you for these insightful comments. As we followed a very similar methodological approach to that used to produce the Arabidopsis sRNA locus map published in Hardcastle et al. (2018), we wanted to take the opportunity to compare the results and build upon the ongoing discussion concerning the evolution of sRNA mechanisms in Chlamydomonas (e.g. Valli et al. 2016). Your point about the possibility of an ancestral progenitor with greater diversity that was then lost is very valid. You are also of course correct about the limitations to what can be concluded from this study and the limited comparisons that can be made. We see our approach as a useful tool for hypothesis generation which can be complemented by more in-depth exploration in the future. With this in mind, and taking on board your comments, we have elaborated on our discussion of the evolutionary implications of our study, which we hope now gives a more balanced account.

      I may have missed it but I could not find a table listing the specific sRNA loci assigned to each of the locus classes. It would be very useful to provide the class annotation of each sRNA locus in order to facilitate future analyses of sRNA biogenesis and function.

      That information was indeed missing, thanks for bringing it up. We have now included this in the gff file (column LC) as well as in another cleaner table (Supp_Table_S7_loci_class_annotation).

      Figures S2 to S5 have the same legend but they correspond to different loci. It would be useful to provide for each locus class, as supplementary figures, two examples of typical sRNA loci.

      Thanks for pointing this out, this was an error on our part, the captions have now been corrected. Unfortunately, due to the ongoing pandemic-related restrictions we were unable to run to get a genome browser session to run to this point to create more loci figures.

      If information is available, the paper would be strengthened by some locus class validation based on features not used to generate the classification.

      Thank you for this suggestion. In fact, not all annotation features were used predictively in the MCA and clustering process, and so these "supplementary" annotations as outlined in supplementary table S3 can provide some cross-validation. With that in mind, we have now included an additional heatmap as a supplementary figure which shows associations for some of these supplementary annotations as well as corresponding explanations in the text. Further validation is provided by the chromosome tracks in figure 9 showing the distinct genomic distributions of each locus cluster despite chromosomal location not being a factor in the clustering.

      Pg 5, line 108. I think you mean "strong bias (0.2 > x > 0.8)."

      Thank you for pointing this out, we have now corrected this error.

      Pg 7, Table 1. Some of the annotation features are obvious but some abbreviations may need clarification using footnotes.

      Table 1 has been replaced by the new Fig 5, annotation/abbreviations should now be more obvious.

      Pg 8, lines 156-157. This sentence is not clear. Additionally, the legends to Figures S2-S5 do not refer to LC2 paragon (CSRL003890).

      Thank you for pointing this out. We have now moved the reference to the paragons to earlier in the section where we introduce the six clusters. We hope this is now clearer.

    1. “Most Americans don’t know very much about Reconstruction, and in many cases what they may think they know is wrong,”

      This stood out to me immediately as I thought back to a question that was posed to us in my previous history class, "Do you think History was written by the winners?"Often times we are quick to only skim the surface of what happened throughout history. There is so much fake news on the internet that we can get confused on what to believe and what not to believe. It is important to fact check our sources, continue to learn, and have an open mind.

  8. media.carnegie.org media.carnegie.org
    1. t is obvious that if today’s youngsters cannotread with understanding, think about and analyze what they’ve read, and then write clearly and effectively about what they’ve learned and what they think, then they may never be able to do justiceto their talents and their potential

      As educators, particularly in the English field, we have to think about the broader context of what we are teaching our students. We are not only preparing our students to be better writers, but to be better citizens and better prepare them to think critically and communicate effectively. It is interesting to think about how this perspective can change our approaches to teaching writing.

    1. it on Anti-Semitism and Hate Remarks by Sacha Baron Cohen, Recipient of ADL's International Leadership Award November 21, 2019 <img src="https://www.adl.org/sites/default/files/styles/cropped_img_md/public/2019-11/never-is-now-2019-sacha-baron-cohen-award-800w-543h.jpg?h=6b028cc2&amp;itok=CZMBCXlF" alt="Sacha Baron Cohen gives award speech"/> <!--/*--><![CDATA[/* ><!--*/ .resp-container { position: relative; overflow: hidden; padding-top: 56.25%; } .resp-iframe { position: absolute; top: 0; left: 0; width: 100%; height: 100%; border: 0; } /*--><!]]>*/ Thank you, Jonathan, for your very kind words.  Thank you, ADL, for this recognition and your work in fighting racism, hate and bigotry.  And to be clear, when I say “racism, hate and bigotry” I’m not referring to the names of Stephen Miller’s Labradoodles. Now, I realize that some of you may be thinking, what the hell is a comedian doing speaking at a conference like this!  I certainly am.  I’ve spent most of the past two decades in character.  In fact, this is the first time that I have ever stood up and given a speech as my least popular character, Sacha Baron Cohen.  And I have to confess, it is terrifying. I realize that my presence here may also be unexpected for another reason.  At times, some critics have said my comedy risks reinforcing old stereotypes. The truth is, I’ve been passionate about challenging bigotry and intolerance throughout my life.  As a teenager in the UK, I marched against the fascist National Front and to abolish Apartheid.  As an undergraduate, I traveled around America and wrote my thesis about the civil rights movement, with the help of the archives of the ADL.  And as a comedian, I’ve tried to use my characters to get people to let down their guard and reveal what they actually believe, including their own prejudice. Now, I’m not going to claim that everything I’ve done has been for a higher purpose.  Yes, some of my comedy, OK probably half my comedy, has been absolutely juvenile and the other half completely puerile.  I admit, there was nothing particularly enlightening about me—as Borat from Kazakhstan, the first fake news journalist—running through a conference of mortgage brokers when I was completely naked.  But when Borat was able to get an entire bar in Arizona to sing “Throw the Jew down the well,” it did reveal people’s indifference to anti-Semitism.  When—as Bruno, the gay fashion reporter from Austria—I started kissing a man in a cage fight in Arkansas, nearly starting a riot, it showed the violent potential of homophobia.  And when—disguised as an ultra-woke developer—I proposed building a mosque in one rural community, prompting a resident to proudly admit, “I am racist, against Muslims”—it showed the acceptance of Islamophobia.    That’s why I appreciate the opportunity to be here with you.  Today around the world, demagogues appeal to our worst instincts.  Conspiracy theories once confined to the fringe are going mainstream.  It’s as if the Age of Reason—the era of evidential argument—is ending, and now knowledge is delegitimized and scientific consensus is dismissed.  Democracy, which depends on shared truths, is in retreat, and autocracy, which depends on shared lies, is on the march.  Hate crimes are surging, as are murderous attacks on religious and ethnic minorities. What do all these dangerous trends have in common?  I’m just a comedian and an actor, not a scholar.  But one thing is pretty clear to me.  All this hate and violence is being facilitated by a handful of internet companies that amount to the greatest propaganda machine in history. The greatest propaganda machine in history. Think about it.  Facebook, YouTube and Google, Twitter and others—they reach billions of people.  The algorithms these platforms depend on deliberately amplify the type of content that keeps users engaged—stories that appeal to our baser instincts and that trigger outrage and fear.  It’s why YouTube recommended videos by the conspiracist Alex Jones billions of times.  It’s why fake news outperforms real news, because studies show that lies spread faster than truth.  And it’s no surprise that the greatest propaganda machine in history has spread the oldest conspiracy theory in history—the lie that Jews are somehow dangerous.  As one headline put it, “Just Think What Goebbels Could Have Done with Facebook.” On the internet, everything can appear equally legitimate.  Breitbart resembles the BBC.  The fictitious Protocols of the Elders of Zion look as valid as an ADL report.  And the rantings of a lunatic seem as credible as the findings of a Nobel Prize winner.  We have lost, it seems, a shared sense of the basic facts upon which democracy depends. When I, as the wanna-be-gansta Ali G, asked the astronaut Buzz Aldrin “what woz it like to walk on de sun?” the joke worked, because we, the audience, shared the same facts.  If you believe the moon landing was a hoax, the joke was not funny. When Borat got that bar in Arizona to agree that “Jews control everybody’s money and never give it back,” the joke worked because the audience shared the fact that the depiction of Jews as miserly is a conspiracy theory originating in the Middle Ages. But when, thanks to social media, conspiracies take hold, it’s easier for hate groups to recruit, easier for foreign intelligence agencies to interfere in our elections, and easier for a country like Myanmar to commit genocide against the Rohingya. It’s actually quite shocking how easy it is to turn conspiracy thinking into violence.  In my last show Who is America?, I found an educated, normal guy who had held down a good job, but who, on social media, repeated many of the conspiracy theories that President Trump, using Twitter, has spread more than 1,700 times to his 67 million followers.  The President even tweeted that he was considering designating Antifa—anti-fascists who march against the far right—as a terror organization.   So, disguised as an Israel anti-terrorism expert, Colonel Erran Morad, I told my interviewee that, at the Women’s March in San Francisco, Antifa were plotting to put hormones into babies’ diapers in order to “make them transgender.”  And he believed it. I instructed him to plant small devices on three innocent people at the march and explained that when he pushed a button, he’d trigger an explosion that would kill them all.  They weren’t real explosives, of course, but he thought they were.  I wanted to see—would he actually do it? The answer was yes.  He pushed the button and thought he had actually killed three human beings.  Voltaire was right, “those who can make you believe absurdities, can make you commit atrocities.”  And social media lets authoritarians push absurdities to billions of people. In their defense, these social media companies have taken some steps to reduce hate and conspiracies on their platforms, but these steps have been mostly superficial. I’m speaking up today because I believe that our pluralistic democracies are on a precipice and that the next twelve months, and the role of social media, could be determinant.  British voters will go to the polls while online conspiracists promote the despicable theory of “great replacement” that white Christians are being deliberately replaced by Muslim immigrants.  Americans will vote for president while trolls and bots perpetuate the disgusting lie of a “Hispanic invasion.”  And after years of YouTube videos calling climate change a “hoax,” the United States is on track, a year from now, to formally withdraw from the Paris Accords.  A sewer of bigotry and vile conspiracy theories that threatens democracy and our planet—this cannot possibly be what the creators of the internet had in mind. I believe it’s time for a fundamental rethink of social media and how it spreads hate, conspiracies and lies.  Last month, however, Mark Zuckerberg of Facebook delivered a major speech that, not surprisingly, warned against new laws and regulations on companies like his.  Well, some of these arguments are simply absurd.  Let’s count the ways. First, Zuckerberg tried to portray this whole issue as “choices…around free expression.”  That is ludicrous.  This is not about limiting anyone’s free speech.  This is about giving people, including some of the most reprehensible people on earth, the biggest platform in history to reach a third of the planet.  Freedom of speech is not freedom of reach.  Sadly, there will always be racists, misogynists, anti-Semites and child abusers.  But I think we could all agree that we should not be giving bigots and pedophiles a free platform to amplify their views and target their victims. Second, Zuckerberg claimed that new limits on what’s posted on social media would be to “pull back on free expression.”  This is utter nonsense.  The First Amendment says that “Congress shall make no law” abridging freedom of speech, however, this does not apply to private businesses like Facebook.  We’re not asking these companies to determine the boundaries of free speech across society.  We just want them to be responsible on their platforms. If a neo-Nazi comes goose-stepping into a restaurant and starts threatening other customers and saying he wants kill Jews, would the owner of the restaurant be required to serve him an elegant eight-course meal?  Of course not!  The restaurant owner has every legal right and a moral obligation to kick the Nazi out, and so do these internet companies. Third, Zuckerberg seemed to equate regulation of companies like his to the actions of “the most repressive societies.”  Incredible.  This, from one of the six people who decide what information so much of the world sees.  Zuckerberg at Facebook, Sundar Pichai at Google, at its parent company Alphabet, Larry Page and Sergey Brin, Brin’s ex-sister-in-law, Susan Wojcicki at YouTube and Jack Dorsey at Twitter.  The Silicon Six—all billionaires, all Americans—who care more about boosting their share price than about protecting democracy.  This is ideological imperialism—six unelected individuals in Silicon Valley imposing their vision on the rest of the world, unaccountable to any government and acting like they’re above the reach of law.  It’s like we’re living in the Roman Empire, and Mark Zuckerberg is Caesar.  At least that would explain his haircut. Here’s an idea.  Instead of letting the Silicon Six decide the fate of the world, let our elected representatives, voted for by the people, of every democracy in the world, have at least some say. Fourth, Zuckerberg speaks of welcoming a “diversity of ideas,” and last year he gave us an example.  He said that he found posts denying the Holocaust “deeply offensive,” but he didn’t think Facebook should take them down “because I think there are things that different people get wrong.”  At this very moment, there are still Holocaust deniers on Facebook, and Google still takes you to the most repulsive Holocaust denial sites with a simple click.  One of the heads of Google once told me, incredibly, that these sites just show “both sides” of the issue.  This is madness. To quote Edward R. Murrow, one “cannot accept that there are, on every story, two equal and logical sides to an argument.”  We have millions of pieces of evidence for the Holocaust—it is an historical fact.  And denying it is not some random opinion.  Those who deny the Holocaust aim to encourage another one. Still, Zuckerberg says that “people should decide what is credible, not tech companies.”  But at a time when two-thirds of millennials say they haven’t even heard of Auschwitz, how are they supposed to know what’s “credible?”  How are they supposed to know that the lie is a lie? There is such a thing as objective truth.  Facts do exist.  And if these internet companies really want to make a difference, they should hire enough monitors to actually monitor, work closely with groups like the ADL, insist on facts and purge these lies and conspiracies from their platforms. Fifth, when discussing the difficulty of removing content, Zuckerberg asked “where do you draw the line?”  Yes, drawing the line can be difficult.  But here’s what he’s really saying: removing more of these lies and conspiracies is just too expensive. These are the richest companies in the world, and they have the best engineers in the world.  They could fix these problems if they wanted to.  Twitter could deploy an algorithm to remove more white supremacist hate speech, but they reportedly haven’t because it would eject some very prominent politicians from their platform.  Maybe that’s not a bad thing!  The truth is, these companies won’t fundamentally change because their entire business model relies on generating more engagement, and nothing generates more engagement than lies, fear and outrage.    It’s time to finally call these companies what they really are—the largest publishers in history.  And here’s an idea for them: abide by basic standards and practices just like newspapers, magazines and TV news do every day.  We have standards and practices in television and the movies; there are certain things we cannot say or do.  In England, I was told that Ali G could not curse when he appeared before 9pm.  Here in the U.S., the Motion Picture Association of America regulates and rates what we see.  I’ve had scenes in my movies cut or reduced to abide by those standards.  If there are standards and practices for what cinemas and television channels can show, then surely companies that publish material to billions of people should have to abide by basic standards and practices too. Take the issue of political ads.  Fortunately, Twitter finally banned them, and Google is making changes, too.  But if you pay them, Facebook will run any “political” ad you want, even if it’s a lie.  And they’ll even help you micro-target those lies to their users for maximum effect.  Under this twisted logic, if Facebook were around in the 1930s, it would have allowed Hitler to post 30-second ads on his “solution” to the “Jewish problem.”  So here’s a good standard and practice: Facebook, start fact-checking political ads before you run them, stop micro-targeted lies immediately, and when the ads are false, give back the money and don’t publish them. Here’s another good practice: slow down.  Every single post doesn’t need to be published immediately.  Oscar Wilde once said that “we live in an age when unnecessary things are our only necessities.”  But is having every thought or video posted instantly online, even if it is racist or criminal or murderous, really a necessity?  Of course not! The shooter who massacred Muslims in New Zealand live streamed his atrocity on Facebook where it then spread across the internet and was viewed likely millions of times.  It was a snuff film, brought to you by social media.  Why can’t we have more of a delay so this trauma-inducing filth can be caught and stopped before it’s posted in the first place? Finally, Zuckerberg said that social media companies should “live up to their responsibilities,” but he’s totally silent about what should happen when they don’t.  By now it’s pretty clear, they cannot be trusted to regulate themselves.  As with the Industrial Revolution, it’s time for regulation and legislation to curb the greed of these high-tech robber barons.  In every other industry, a company can be held liable when their product is defective.  When engines explode or seatbelts malfunction, car companies recall tens of thousands of vehicles, at a cost of billions of dollars.  It only seems fair to say to Facebook, YouTube and Twitter: your product is defective, you are obliged to fix it, no matter how much it costs and no matter how many moderators you need to employ. In every other industry, you can be sued for the harm you cause.  Publishers can be sued for libel, people can be sued for defamation.  I’ve been sued many times!  I’m being sued right now by someone whose name I won’t mention because he might sue me again!  But social media companies are largely protected from liability for the content their users post—no matter how indecent it is—by Section 230 of, get ready for it, the Communications Decency Act.  Absurd! Fortunately, Internet companies can now be held responsible for pedophiles who use their sites to target children.  I say, let’s also hold these companies responsible for those who use their sites to advocate for the mass murder of children because of their race or religion.  And maybe fines are not enough.  Maybe it’s time to tell Mark Zuckerberg and the CEOs of these companies: you already allowed one foreign power to interfere in our elections, you already facilitated one genocide in Myanmar, do it again and you go to jail. In the end, it all comes down to what kind of world we want.  In his speech, Zuckerberg said that one of his main goals is to “uphold as wide a definition of freedom of expression as possible.”  Yet our freedoms are not only an end in themselves, they’re also the means to another end—as you say here in the U.S., the right to life, liberty and the pursuit of happiness.  But today these rights are threatened by hate, conspiracies and lies. Allow me to leave you with a suggestion for a different aim for society.  The ultimate aim of society should be to make sure that people are not targeted, not harassed and not murdered because of who they are, where they come from, who they love or how they pray If we make that our aim—if we prioritize truth over lies, tolerance over prejudice, empathy over indifference and experts over ignoramuses—then maybe, just maybe, we can stop the greatest propaganda machine in history, we can save democracy, we can still have a place for free speech and free expression, and, most importantly, my jokes will still work. Thank you all very much. Antisemitism in the US Cyberhate Extremism, Terrorism & Bigotry

      hi

    1. Author Response

      Summary:

      The bacterial ribosome from E. coli has traditionally been a reference model in structural biology. Basic studies in translation and the mode of action and resistance to antibiotics, have greatly benefited from the mechanistic framework derived from structural studies of this cellular machinery. Recently, electron cryo-microscopy has surpassed the resolution limits X-ray crystallography studies of bacterial ribosomes historically reported. In the present manuscript, Watson et al present a landmark work where these limits are pushed even further, reporting a ribosome cryo-EM reconstruction with an overall resolution of 2Å, and even better than that in the best areas of the map. The achieved resolution is impressive and one thus expects major findings, methodological highlights and comparisons with previous structures. However, these could be better developed. Instead, the usage of map-to-model Fourier shell correlation (already known in the field) is stressed to estimate the resolution, but it is not clear what the advantage is here as the values are the same when estimated from half map FSCs. Therefore, it is suggested that the discussion about the model-to-map FSC is toned down considerably in (or even removed), while adding in more information about the new findings in the map, along the lines of the comments below.

      We thank the reviewers for their interest in this work, and for their helpful comments on the first version of the manuscript. We provide responses to the individual points below.

      Reviewer #1:

      This paper describes a 2A cryo-EM reconstruction of the E.coli 70S ribosome. This structure represents the highest resolution ribosome structure, by any method, available thus far and highlights interesting modifications that were not possible to see in previous structures. I'll let the ribosome experts comment on the relevance of these and focus my review on the cryo-EM technical parts. The paper is clearly written and the figures are informative and beautiful.

      The first author is particularly gratified that the figures were well received.

      Major comments:

      1) The authors make a big deal out of resolution assessment by model-to-map FSCs. It is unclear to me why they do this. First of all, model-to-map FSC is not a new resolution measure: it is in widespread use already. Second, it is unclear why the authors are so forceful in stating that it is better than the half-map FSC. They say "While map-to-model FSC carries intrinsic bias from the model's dependence on the map, in a high resolution context it does provide additional information about the overall confidence with which to interpret the model, not captured in half-map FSCs." What additional information does it provide? I would say it only provides true additional information if the atomic model comes from another experiment! In the way it is used here: by refining the model inside the very same map, there is a danger of increasing model-to-map FSC values through overfitting of the model (see also below). This danger is not recognized enough in the text (it is only hinted at in the sentence above), and overfitting is not measured explicitly for this case. Yes, half-map FSC measures self-consistency, but in practical terms (when done right!), this doesn't matter for the resolution estimate. The same is true for model-to-map FSCs: when done right they convey the right information, but the danger of self-consistency (through overfitting) also exists here. As the paper is mainly about the high-resolution ribosome structure, and no proper evaluation of the relative merits of half-map FSC versus model-to-map FSC is performed, I would suggest that the authors remove (or at least tone down considerably) their statements about resolution assessment from the manuscript.

      All three reviewers commented on our emphasis on using the map-to-model FSC criterion. We thank the reviewers for pointing out our motivation to discuss FSC metrics was not clear. We agree with the reviewers that the map-to-model FSC metric has been available for some time. However, in the ribosome field, the half-map FSC is still very commonly used as the sole resolution-dependent metric, including in recent literature that we cited (Nürenberg-Goloub, 2020; Tesina, 2020; Stojković, 2020; Pichkur, 2020; Halfon, 2019), as well as in a newer publication (Loveland, 2020, Nature, https://doi.org/10.1038/s41586-020-2447-x ). We mention some of the shortcomings of half-map FSC, which the third reviewer alludes to in their comment on “intense debate” in the field. While it is acknowledged as best practice to examine both maps and models, many visitors to the PDB likely will download only the model. Therefore we find it prudent to communicate confidence in the model resolution and not just the half-maps, particularly in this resolution regime. Again, this is not common in recent ribosome literature, which we will clarify in the Discussion. We will make changes throughout the manuscript to streamline and clarify our discussion of the two metrics, including an additional comparison to a newly released ribosome structure, as detailed below.

      When we discuss “additional information provided by map-to-model FSC,” we recognize that there may be semantic issues with the word “information” as map-to-model FSC depends on the same information content of the maps. However, the map-to-model FSC provides new information about the model quality to the reader. While half-map FSC tells us something about the best model one might achieve, new practical information lies in the authors’ handling of the model, which will vary among individuals (as discussed further below). Furthermore, model refinement procedures leverage well-defined chemical properties (i.e. bond lengths, angles, dihedrals, and steric restraints) that the map “knows” nothing about, which has value for keeping the realism in check. This is also why we originally included the sentence, “Sub-Ångstrom differences in nominal resolution as reported by half-map FSCs have significant bearing on chemical interactions at face value but may lack usefulness if map correlation with the final structural model is not to a similar resolution.” We will rewrite portions of this section for clarity.

      Comparisons to other recent high-resolution cryo-EM ribosome structures show discrepancies in the reported half-map FSC and map-to-model FSC calculated by us (see beginning of section “High-resolution structural features of the 50S ribosomal subunit”), with the map-to-model FSC values being to lower resolution. These structures report half-map FSCs only, which we could not replicate because of unavailability of half-maps, but we describe our calculation of map-to-model FSC with their deposited maps. We did not explicitly highlight the comparisons with their reported half-map FSC resolutions in the original manuscript, and we will include further discussion to more clearly communicate our point. We will also include another comparison to the newly released structure by Pichkur et al. (Pichkur, 2020) which has become available during the review process and is the closest to our map resolution. The map-to-model FSC with their model and map yields 2.29 Å resolution, while a simple rigid-body fit of our model into their map without further adjustment yields 2.07 Å. This difference highlights the practical insufficiency of focusing only on half-map FSC and the value of our model as a reference for future work.

      2) To test for the presence of overfitting their atomic models in the maps, the authors should shake-up the atomic models and refine them in the first independently refined half-map. The FSC of that model versus that half-map (FSC_work) should be compared with the FSC of that very same model versus the second half-map (FSC_test). Deviations between the two would be an indicating of overfitting. If that were to be observed, the weights on the stereochemical restraints should be tightened until the overfitting disappears. The same weighting scheme should then be used for the final model refinement against the sum of the half-maps.

      In lieu of what the reviewers have suggested, we think the additional map-to-model comparison of our model rigid-body docked into the 2.1 Å 50S map by Pichkur et al. provides reasonable evidence that our model suffers from minimal overfitting. Without any additional refinement of our model into their map, the map-to-model FSC resolution is 2.07 Å. We will include the new comparison in the revised manuscript.

      For model refinement, we used default parameters for phenix.real_space_refine, which internally optimizes weights for hundreds of different “chunks” during the refinement. This “black box” aspect does not give us facile control over the weighting scheme. However, we also note that the final model is not “fresh” out of Phenix; rather, the macromolecules have been meticulously reviewed and adjusted manually in Coot, with blurred maps to aid in accurate modeling for areas that are not as well connected/resolved. RSR in Coot was also required to “stitch” sections of the model together, since the models were refined in multiple focus-refined maps. Further, we think that for models that are ⅔ RNA, manually optimizing the Ramachandran restraints is unlikely to provide much new insight into RSR of this structure.

      3) Figure 1 -supplement 7: if radiation damage breaks the ribose rings, they should still be OK during early movie frames. This could be investigated by performing per-frame (or per-few-frames) reconstructions. The radiation damage argument would be a lot stronger if the density is present in early frames, yet disappears in the later ones. There will be a balance between dose-resolution and achievable spatial-resolution to see this of course. But it may be worth investigating.

      This is a great suggestion, and we have now carried out this analysis. We have performed the early-frame reconstruction and now have an alternative hypothesis that may make more sense. We will include the alternative hypothesis that we are likely seeing disorder due to conformational flexibility in the RNA backbone, rather than radiation damage, which seems unlikely given the features in the early-frame map. We will also update Figure 1–figure supplement 7 with new panels to aid this discussion.

      Reviewer #2:

      The manuscript by Watson et al. presents the structural analysis of a bacterial ribosome at high resolution. The achieved resolution is impressive and one thus expects major findings, methodological highlights and comparisons with previous structures. However, these are missing or not well developed. Instead, the usage of map-to-model Fourier shell correlation (already known in the field) is stressed to estimate the resolution, but it is not clear what this actually brings here as the values are the same when estimated from half map FSCs. The structure visualizes chemical modifications of ribosomal RNA and amino acids and water molecules, which together are interesting and important. However, here one would expect a comparison with structures of previously analyzed bacterial ribosomes, e.g. E. coli and T. thermophilus, e.g. from the same group and from the work by Fischer et al., Nature 2015: how far are the sites conserved? How do the maps compare? Are the same features seen? It is surprising to see that the main chemical modifications are not discussed and shown (only summarized in the Suppl. Data). Pseudo-uridines are mentioned, but how were these identified? It should be mentioned here that due to their isomeric nature these can be discussed only from their typical hydrogen bond pattern. The paper discusses new sites with chemical modifications, but this could benefit from a more thorough discussion of existing biochemical data or from including new biochemical characterization. The structural role of these modifications is not much described. The side chain of IAS119 has no density, hence one should be careful in interpreting an isomerization of this residue, not sure whether the data allow the conclusions to be made. Similar for the mSAsp89 residue for which the density is uncertain, hence it is not clear whether the conclusions stay on a safe ground.

      We thank the reviewer for their interest in this work. We addressed our emphasis on the map-to-model FSC in response to reviewer #1.

      For the majority of rRNA modifications, we included the supplementary figure as a reference for comparison to the published 4YBB and 4Y4O maps and models. These modifications have been extensively described in the structural biology literature, including in the recent cryo-EM study of the 50S ribosomal subunit (Stojković, 2020) and warrant no detailed comment by us at this time. Instead, we focused on new features that were not previously observed, such as hypomodifications and new modifications. The new modifications are the isoAsp observed in uS11 and the thioamide modification in uL16.

      IAS119 modeling in uS11: We thoroughly analyzed Asn or isoAsp modeled at this residue, and will provide additional evidence that isoAsp is correctly modeled at residue 119. In the original maps, although the side chain density is weak, the backbone density is unequivocal. There is clear density for the extra methylene group (marked with an asterisk in Fig. 4A). We have now calculated a map of the 30S subunit using the first three frames in the image stacks corresponding to a ~3 electron/Å2 dose. In this map, the side chain of isoAsp is more clearly visible (we will include a new figure panel with this density in the supplement). In addition to visual inspection, PHENIX provides a quantitative measure of the fit that also rules out Asn at this position. As we noted in the Methods, “Initial real-space refinement of the 30S subunit against the focused-refined map using PHENIX resulted in a single chiral volume inversion involving the backbone of N119 in ribosomal protein uS11, indicating that the L-amino acid was being forced into a D-amino acid chirality, as reported by phenix.real_space_refine.” Of the 10,564 chiral centers in the 30S subunit, only that for N119 stands out, having an energy residual nearly 2 orders of magnitude larger than the next highest deviation. This stereochemical problem was resolved by modeling isoAsp at this position. We will add these refinement details to the Methods.

      Furthermore, as we noted in the manuscript, isoAsp has been identified in E. coli uS11 by biochemical means (see David, 1999). We examined the phylogenetic conservation of the neighboring sequences in uS11, finding that the N is nearly universal in bacteria and organelles, and D is nearly universal in archaea and eukaryotes (Figure 4 and original Figure 4–figure supplement 1). Finally, even in lower-resolution maps of the archaeal and eukaryotic ribosomes, we find that isoAsp better fits the density, visually with respect to the backbone, and quantitatively based on correlations between RSR models and the density (original Figure 4–figure supplement 2). We therefore think we have been careful in interpreting the isoAsp in uS11, structurally, phylogenetically, and in light of available biochemical evidence. We also provided an in-depth analysis of the neighboring 16S/18S rRNA residues that are in intimate contact with the isoAsp119 region of uS11. See Figure 4B and Supplementary Table 2 and accompanying description.

      mSAsp89: Density for mSAsp89 has been seen previously in the X-ray crystal structure of the 70S ribosome (Noeske, 2015). Here, we also see density for mSAsp89 at lower contour levels. See Figure 1–figure supplement 5. We should have noted in the legend of this panel that we used a lower contour level for mSAsp89 and m7G527, to reveal the modifications. This will be added. Notably, at higher contours that still enclose the standard nucleobase and amino acid side chains, we do not see clear density for the mSAsp89 and m7G527 modifications, in Figure 1–figure supplement 6. In the section of the manuscript covering hypomodifications in RNA, we will clarify this point.

      Pseudouridines: We will clarify how pseudouridines are inferred in the main text. These can be inferred if a solvent molecule or other polar atom is within hydrogen-bonding distance of the N3 in pseudouridine (would be C5 in uridine). We will update Figure 1–figure supplement 5 to better show solvent molecules within hydrogen bonding distance of pseudouridine N3 atoms.

      From a methodological point of view it would be interesting to discuss in more detail how this high resolution structure was obtained, what the specific aspects of high-resolution data collection were and which were the important parameters to refine the structure. Also, how were the thousands of water molecules validated? Regarding the discussion on electrostatic potentials, in contrast to what might be intuitive, the contribution of electron scattering is actually stronger at medium resolution, i.e. its effect does not need high resolution per se. The discussion on radiation damage is a hypothesis at this stage and should be done more carefully including processing of the data using less electron dose (see detailed points below). Taken together, this work describes some interesting findings, but some remain unclear in the discussion because for some no biochemical data are available yet. However, this analysis provides useful hints to design future experiments. Also, there are no developments of tools in this paper in contrast to what is stated.

      We will add some additional information to the Discussion and Methods. In terms of the water molecules, we have not gone through these one by one at this point. We actually do not claim to have introduced new tools, but we note that our water modeling spurred the incorporation of phenix.douse into the latest PHENIX releases. This will be more clearly stated, and we will acknowledge Pavel Afonine for helping us as he developed this functionality. (He indicated we should cite Liebschner, 2019.) Solvent modeling is ripe for future development, as we note in the Discussion.

      Although scattering is stronger at medium resolution, it is not absent at < 2 Å. See the recent atomic-resolution structures of ferritin for examples. In fact, we have now examined the 2.1 Å map deposited by Pichkur et al. (Pichkur, 2020), in which the thioamide is barely visible. The thioamide in the 2.2 Å map deposited by Stojković (Stojković, 2020) is not obviously visible. We will add panels showing this in the revised manuscript.

      We have now used the early frames to address the question of ribose damage and the carboxylate of IAS119 in uS11, as noted above.

      Reviewer #3:

      The bacterial ribosome from E.coli has traditionally been a reference model in structural biology. Basic studies in translation and the mode of action and resistance to antibiotics, have greatly benefited from the mechanistic framework derived from structural studies of this cellular machinery. Recently, electron cryo-microscopy has surpassed the resolution limits X-ray crystallography studies of bacterial ribosomes historically reported. In the present manuscript, Watson et al present a landmark work where these limits are pushed even further, reporting a ribosome cryoEM reconstruction with features compatible with a resolution in the range of overall 2Å and below that resolution in the best areas of the map. With this level of detail, a chemical interpretation of many and fundamental aspects of translation and antibiotic interaction can be discerned in physicochemical terms, greatly improving our understanding of this key component of bacterial cells. The manuscript is well presented with clear evidence supporting the author's claims and interpretations. Specially remarkable is the detailed and accurate handling of the reference list.

      We thank the reviewer for their interest in our work. In the revision, we will keep the references mostly as-is, but will add a few based on the revisions we need to make.

      Mayor concern:

      There is an intense debate within the cryoEM community regarding which is the best way to estimate the resolution of a cryoEM reconstruction. In this manuscript, the authors claim map-to-model FSC values could "in a high resolution context [...] provide additional information about the overall confidence with which to interpret the model, not captured in half-map FSCs." Regardless of the opinion of this reviewer about this specific point, if a map-to-model FSC is to be used as a claim of "high-resolution" a convincing overfitting test proving the absence of overfitting in the refined model should be presented. Otherwise, map-to-model FSC values may be artificially high due to unrealistic deformation of the model. The authors thus, should prove their refined model is not overfitted.

      This was a concern of all the reviewers, which we addressed above. We think the comparisons to other recent structures, especially the 2.1 Å 50S map by Pichkur et al., makes the case for using the map-to-model FSC criterion.

    1. Background The COVID-19 pandemic has unprecedented consequences on population health, with governments worldwide issuing public health directives which have major impacts on normal living. In the absence of a vaccine, a key way to control the pandemic is through behavioural change: people adhering to transmission-reducing behaviours (TRBs), such as physical distancing, regular hand washing, and wearing face covering, especially when physical distancing is difficult. The application of behavioural science is central to understanding factors that influence adherence to TRBs. Non-adherence may be explained by theories of how people think about the illness (the common-sense model of self-regulation) and/or how they think about the TRBs (social cognition theory and protection motivation theory). In addition, outbreaks of infectious diseases and the measures employed to curb them are likely to have detrimental effects on people’s mental and general health. Therefore, in representative repeated surveys we will apply behavioural theories to model adherence to TRBs, explain variations in adherence, and the effects on mental and general health in the Scottish population from June to November 2020, following the initial outbreak of the COVID-19 pandemic. Methods Repeated 20-minute structured telephone surveys will be conducted with nationally representative random samples of 500 adults from throughout Scotland. The first 6 weeks the survey will be conducted weekly, thereafter fortnightly, for a total of 14 waves (total n=7000). Ipsos MORI will recruit participants through random digit dialling. The core survey will measure adherence to TRBs, mental and general health, and explanatory variables from the theories. Further questions will be added, enabling more detailed measurement of constructs in the core survey, additional themes, and questions that align with the evolving pandemic. Discussion This study will provide insights into the link between (changes in) adherence to TRBs and explanatory factors, and their effects on mental and general health, including event-related changes (e.g., when government directives change). Governments and other decision-makers may use these findings to tailor public health promotion, target specific population groups, and develop behaviourally informed interventions over the duration of the COVID-19 pandemic (along with any subsequent equivalent events) to protect health and limit the spread of COVID-19.
    1. Religion and science are two major sources of knowledge. Some accounts suggest that religious belief inhibits people from trusting scientific information, and encourages conflict between religion and science. We draw from theories of human motivation to challenge this claim, instead suggesting that religious people perceive less conflict between science and religion than non-religious people, that religious—but not non-religious—people use both science and religion when they explain phenomena, and that religious people rely on science more than non-religious people think they do. Five studies support our account. A pilot study uses a large representative sample of Americans to show that religious people perceive less conflict between science and religion than non-religious people. Studies 1-2 show that religious people view religion and science as equally and moderately instrumental for explaining extraordinary events (Study 1) and life’s “big questions” (Study 2), whereas non-religious people view science as highly instrumental and religion as not at all so. Study 3 finds that non-religious people mischaracterize religious people as more reliant on religion and less reliant on science than they really are, and also suggests that religious people view science and religion as orthogonal whereas non-religious people view them as hydraulic. Study 4 applies these findings to the COVID-19 pandemic, showing that faith-based strategies of avoiding infection do not inhibit adoption of science-based strategies. Religious people may be more open to science than many non-religious people think.
    1. To talk about what happens in classrooms, let alone in children’s heads, as moving forward or backward in specifiable degrees, is not only simplistic because it fails to capture much of what is going on, but also destructive because it may change what is going on for the worse. 

      I think each class has different types of students,for example some children are quiet,but some children are active and playful,but all of them are still in their developmental age, so we just need advice and education,everything will be fine

    1. Thus we have a basic distinction between fantasy and science fiction

      Here, one cannot help but think about the fact that we as humans do not, and likely will not ever, know what is truly science and what is supernatural. The argument that we must separate the two because "bringing experiences [of both] is to destroy one or the other, is not made because the universe cannot handle both— it is because we are humans are incapable of handling both, and of realizing that there is no line that separates the two. The supernatural, in many ways, may just be the parts of science that we have not figured out yet, and separating them is easier for us as people to handle.

    1. Asking them to assign themselves grades, would challenge the dominant power of teacher as the almighty transmitter of knowledge which is consumed by students and scribed into a grade.

      I think students are very much aware of this power. That is often why we under-grade ourselves when given the option to self grade. Even though we know we put in the effort and time we still feel as though we don't have the authority to give ourselves that A. In our minds we may be thinking “only a teacher could be truly unbiased and determine if this is A work or not”. That is why also having classmates grade you as well is good. They may confirm what the teacher thinks of your work. If your group members are giving you A’s as well, perhaps that boosts your confidence when you self-grade the next time.

    1. How do we experience border-crossing? Alter-natively, what does it feel like to exist as a border – as, for example,unwelcome migrants and minority groups are forced to do?

      I think this question is particularly interesting question to pose as the answer would look different for the person you ask (even currently) from those from different periods of time. Meaning if we went way back into monarchism—those individuals would likely say the stone wall around their kingdom (potentially). Currently, there isn't necessaryily a need for a physical border wall (unless you are certain people) because there, arguably, aren't really any borders in modern civilization. Most countries allow people to travel to their country and there isn't a physical border separating them rather a sort of marker. Another interesting concept this begins to dip into, is the idea of ideologies. Even though there is a "border" separating different countries—is there a border separating ideologies that may be similar even though they exist in different countries.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reviewer1

      Reviewer #1 (Evidence, reproducibility and clarity (Required)):

      The manuscript is clearly written and the figures appropriate and informative. Some descriptions of data analyses are a little dense but reflect what would appear long hard efforts on the part of the authors to identify and control for possible sources of misinterpretation due to sensitivities of parameters in their fitness model. The authors efforts to retest interactions under non-competition conditions allay fears of most concerns that I would have. One problem though that I could not see explicitly addressed was that of potential effects of interactions between methotrexate and the other conditions and how this is controlled for. Specifically, I could be argued that the fact that a particular PPI is observed under a specific condition could have more to do with a synthetic effect of treatment of cells with a drug plus methotrexate. Is this controlled for and how? I raise this because in a chemical genetic screen for fitness it was shown that methotrexate is particularly promiscuous for drug-drug interactions (Hillenmeyer ME ,et al. Science 2008). I tried to think of how this works but couldn't come up with anything immediately. I'd appreciate if the authors would take a crack at resolving this issue. Otherwise I have no further concerns about the manuscript.

      We thank the reviewer for the kind comments. We agree with the reviewer’s point that methotrexate could be interacting with drugs or other perturbagens, similar to how the chosen nitrogen source, carbon source, or other growth conditions may interact with a drug. However, the methotrexate concentration is held constant across all conditions, as is the rest of the media components such as the nitrogen and carbon source (with the exception of the raffinose perturbation). Any interactions with methotrexate, or other media components, is undetectable without systematically varying all components for all stressors. Therefore, we use the typical experimental design of measuring molecular variation from a reference, holding invariant media components (such as methotrexate, glucose, or vitamins) fixed between conditions. This is a general practice, and we describe that every condition contains methotrexate on page 3, line 10.

      The library was grown under mild methotrexate selection in 9 environments for 12-18 generations in serial batch culture, diluting 1:8 every ~3 generations, with a bottleneck population size greater than 2 x 109 cells (Table S1).

      We also list the full details of each environment in Table S1.

      Reviewer #1 (Significance (Required)):

      Lui et al expand on previous work from the Levy group to explore a massive in vivo protein interactome in the yeast S. cerevisiae. They achieve this by performing screens cross 9 growth conditions, which, with replication, results in a total of 44 million measurements. Interpreting their results based on a fitness model for pooled growth under methotrexate selection, they make the key observation that there is a vastly expanded pool of protein-protein interactions (PPI) that are found under only one or two condition compared to a more limited set of PPI that are found under a broad set of conditions (mutable versus immutable interactors). The authors show that this dichotomy suggests some important features of proteins and their PPIs that raise important questions about functionality and evolution of PPIs. Among these are that mutable PPIs are enriched for cross-compartmental, high disorder and higher rates of evolution and subcellular localization of proteins to chromatin, suggesting roles in gene regulation that are associated with cellular responses to new conditions. At the same time these interactions are not enriched for changes in abundance. These results are in contrast to those of immutable PPIs, which seem to form a core background noise, more determined by changes in abundance than what the authors interpret must be post-translational processes that may drive, for instance, changes in subcellular localization resulting in appearance of PPIs under specific conditions. The authors are also able to address a couple of key issues about protein interactomes, including the controversial Party-date Hub hypothesis of Vidal, in which they could now affirm support for this hypothesis based on their results and notably negative correlation of PPIs to protein abundance for mutable PPIs. Finally, they also addressed the problem of predicting the upper limit of PPIs in yeast, showing the remarkable results that it may be no more than about 2 times the number of proteins expressed by yeast. Such an upper limit is profoundly important to modelling cellular network complexity and, if it holds up, could define a general upper limit on organismal complexity.

      This manuscript is a very important contribution to understanding dynamics of molecular networks in living cells and should be published with high priority.

      Reviewer 2

      Reviewer #2 (Evidence, reproducibility and clarity (Required)):

      Report on Liu et al. "A large accessory protein interactome is rewired across environments"

      Liu et al. use a mDHFR-based, pooled barcode sequencing / competitive growth / mild methotrexate selection method to investigate changes of PPI abundance of 1.6 million protein pairs across different 9 growth conditions. Because most PPI screens aim to identify novel PPIs in standard growth conditions, the currently known yeast PPI network may be incomplete. The key concept is to define immutable" PPIs that are found in all conditions and "mutable" PPIs that are present in only some conditions.

      The assay identified 13764 PPIs across the 9 conditions, using optimized fitness cut offs. Steady PPI i.e. across all environments, were identified in membrane compartments and cell division. Processes associated with the chromosome, transcription, protein translation, RNA processing and ribosome regulation were found to change between conditions. Mutable PPIs are form modules as topological analyses reveals.

      Interestingly, a correlation on intrinsic disorder and PPI mutability was found and postulated as more flexible in the conformational context, while at the same time they are formed by less abundant proteins.

      I appreciate the trick to use homodimerization as an abundance proxy to predict interaction between heterodimers (of proteins that homodimerize). This "mass-action kinetics model" explains the strength of 230 out of 1212 tested heterodimers.

      A validation experiment of the glucose transporter network was performed and 90 "randomly chosen" PPIs that were present in the SD environment were tested in NaCl (osmotic stress) and Raffinose (low glucose) conditions through recording optical density growth trajectories. Hxt5 PPIs stayed similar in the tested conditions, supported by the current knowledge that Hxt5 is highly expressed in stationary phase and under salt stress. In Raffinose, Hxt7, previously reported to increase the mRNA expression, lost most PPIs indicating that other factors might influence Hxt7 PPIs.

      **Points for consideration:**

      *) A clear definition of mutable and immutable is missing, or could not be found e.g. at page 4 second paragraph.

      We thank the reviewer for pointing this out. We have now added better definition of mutable and immutable on line 19 page 4:

      We partitioned PPIs by the number of environments in which they were identified and defined PPIs at opposite ends of this spectrum as “mutable” PPIs (identified in only 1-3 environments) and “immutable” (identified in 8-9 environments).

      *) Approximately half of the PPIs have been identified in one environment. Many of those mutable PPIs were detected in the 16{degree sign}C condition. Is there an explanation for the predominance of this specific environment? What are these PPIs about?

      The reviewer is correct that ~40% of the PPIs identified in only one environment were found in the 16 ℃ environment. One reason for this could be technical: the positive predictive value (PPV) is the lowest amongst the conditions (16 ℃: 31.6%, mean: 57%, Table SM6). It must be noted, however, that PPVs are calculated using reference data that has generally been collected in standard growth conditions. So, it might be expected that the most divergent environment from standard growth conditions (resulting in the most differences in PPIs) would result in a lower PPV in our study even if the true frequency of false positives was equivalent across environments. We have attempted to be transparent about the quality of the data in each environment by reporting PPVs and other metrics in Table SM6. However, we suspect that the large number of PPIs unique to 16 ℃ is due in part to the fact that it causes the largest changes in the protein interactome, and believe that it should be included, even at the risk of lowering the overall quality of the data. The main reason for this is that this data is likely to contain valuable information about how the cell copes with this stress. For example, we find, but do not highlight in the manuscript, that 16 ℃-specific PPIs contain two major hubs (DID4: 285 PPIs involved in endocytosis and vacuolar trafficking, and DED1: 102 PPIs involved in translation), both of which are reported to be associated with cold adaptation in yeast (Hilliker et al., 2011; Isasa et al., 2015).

      To assess whether the potentially higher false-positive rate in 16 ℃ could be impacting our conclusions related to PPI network organization and features of immutable and mutable PPIs, we repeated these analyses leaving out the 16 ℃ data and found that our main conclusions did not change. This new analysis is now presented in Figure S8 and described on page 5, line 10.

      Finally, we used a pair of more conservative PPI calling procedures that either identified PPIs with a low rate of false positives across all environments (FPR

      We have also added references to other panels in Figure S8 throughout the manuscript, where appropriate.

      *) 50 % overall retest validation rate is fair and reflects a value comparable to other large-scale approaches. However what is the actual variation, e.g. between mutable PPIs and immutable or between condition. e.g. at 16{degree sign}C.

      We validated 502 PPIs present in the SD environment and an additional 36 PPIs in the NaCl environment. As the reviewer suggests, we do indeed observe differences in the validation rate across mutability bins. This data is reported in Figures 3B and S6B, and we use this information to provide a confidence score for each PPI on page 5, line 4.

      To better estimate how the number of PPIs changes with PPI mutability, we used these optical density assays to model the validation rate as a function of the mean PPiSeq fitness and the number of environments in which a PPI is detected. This accurate model (Spearman's r =0.98 between predicted and observed, see Methods) provided confidence scores (predicted validation rates) for each PPI (Table S5) and allowed us to adjust the true positive PPI estimate in each mutability bin. Using this more conservative estimate, we still found a preponderance of mutable PPIs (Figure S6E).

      The validation rate in NaCl is similar to SD (39%, 14/36), suggesting that validation rates do not vary excessively across environments. Because validation experiments are time consuming (we performed 6 growth experiments per PPI), performing a similar scale of validations in all environments as in SD would be resource intensive. Insead, we report a number of metrics (true positive rate, false positive rate, positive predictive value) in Table SM6 using large positive and random reference sets. We believe these metrics are sufficient for readers to compare the quality of data across environments.

      *) What is the R correlation cutoff for PPIs explained in the mass equilibrium model vs. not explained?

      We do not use an R correlation cutoff to assess if a PPI is explained by the mass-action equilibrium model. We instead rely on ordinary least-squares regression as detailed in the methods on page 68, line 13.

      ...we used ordinary least-squares linear regression in R to fit a model of the geometric mean of the homodimer signals multiplied by a free constant and plus a free intercept. Significantly explained heterodimer PPIs were judged by a significant coefficient (FDR 0.05, single-test). This criteria was used to identify PPIs for which protein expression does or does not appear to play as significant of a role as other post-translational mechanisms.

      The first criterion identifies a quantitative fit to the model of variation being related. The second criterion is used to filter out PPIs for which the relationship appears to be explained by more than just the homodimer signals. This approach is more stringent, but we believe this is the most appropriate statistical test to assess fit to this linear model.

      *) 90 "randomly chosen" PPIs for validation. It needs to be demonstrated that these interaction are a random subset otherwise is could also mean cherry picked interactions.

      We selected 90 of the 284 glucose transport-related PPIs for validation using the “sample” function in R (replace = FALSE). We have now included text that describes this on page 63, line 3 in the supplementary methods:

      Diploids (PPIs) on each plate were randomly picked using the “sample” function in R (replace = FALSE) from PPIs that meet specific requirements.

      *) Figure 4 provides interesting correlations with the goal to reveal properties of mutable and less mutable PPIs. PPIs detected in the PPIseq screen can partially be correlated to co-expression (4A) as well as co-localization. Does it make sense to correlate the co-expression across number of conditions? Are the expression correlation condition specific. In this graph it could be that expression correlation stems from condition 1 and 2 and the interaction takes place in 4 and 5 still leading to the same conclusion ... Is the picture of the co-expression correlation similar when you simply look at individual environments like in S4A?

      We use co-expression mutual rank scores from the COXPRESdb v7.3 database (Obayashi et al., 2019). These mutual rank scores are derived from a broad set of 3593 environmental perturbations that are not limited to the environments we tested here. By using this data, we are asking if co-expression in general is correlated with mutability and report that it is in Figure 4A. We thank the reviewer for pointing out that this was not clear and have now added text to clarify that the co-expression analysis is derived from external data on page 6, line 7.

      We first asked whether co-expression is indeed a predictor of PPI mutability and found that it is: co-expression mutual rank (which is inversely proportional to co-expression across thousands of microarray experiments) declined with PPI mutability (Figures 4A and S11) (Obayashi and Kinoshita, 2009; Obayashi et al., 2019).

      The new figure S11 examines how the co-expression mutual rank changes with PPI mutability for PPIs identified in each environment, as the reviewer suggested. For each environment, we find the same general pattern as in Figure 4A (which considers PPIs from all environments).

      *) Figure 4C: Interesting, how dependent are the various categories?

      It is well known that many of these categories are correlated (e.g. mRNA expression level and protein abundance, and deletion fitness effect and genetic interaction degree). However, we believe it is most valuable to report the correlation of each category with PPI mutability independently in Figures 4C and S12, since similar correlations with related categories provide more confidence in our conclusions.

      *) Figure 4 F: When binned in the number of environments in which the PPI was found, the distribution peaks at 6 environments and decreases with higher and lower number of environments. The description /explanation in the text clearly says something else.

      We reported on page 7, line 15:

      We next used logistic regression to determine what features may underlie a good or poor fit to the model (Figure S14C) and found that PPI mutability was the best predictor, with more mutable PPIs being less frequently explained (Figure 4F). Unexpectedly, mean protein abundance was the second best predictor, with high abundance predicting a poor fit to the model, particularly for less mutable PPIs (Figure S14D and S14E).

      As the reviewer notes, Figure 4F shows that the percent of heterodimers explained by the model does appear to decrease for PPIs observed in the most environments. We suspect that the reviewer is correct that something more complicated is going on. One possibility is that extraordinarily stable PPIs (stable in all conditions) would have less quantitative variation in protein or PPI abundance across environments. If this is true, it would be statistically difficult to fit the mass action kinetics model for these PPIs (lower signal relative to noise), thereby resulting in the observed dip.

      A second possibility is that multiple correlated factors are associated with contributing positively or negatively to a good fit, and the simplicity of Figure 4F or a Pearson correlation does not capture this interplay. This second possibility is why we used multivariate logistic regression (Figure S14C) to dissect the major contributing factors. In the text quote above, we report that high abundance is anti-correlated with a good fit to the model (S14D, S14E). Figure 4C shows that immutable PPIs tend to be formed from highly abundant proteins. One possible explanation is that highly abundant proteins saturate the binding sites of their binding partners, breaking from the assumptions of mass action kinetics model. We have now changed the word “limit” to “saturate” on page 7, line 22 to make this concept more explicit.

      Taken together, these data suggest that mutable PPIs are subject to more post-translational regulation across environments and that high basal protein abundance may saturate the binding sites of their partners, limiting the ability of gene expression changes to regulate PPIs.

      A third possibility is that the dip is simply due to noise. Given the complexity of the possible explanations and our uncertainty about which is more likely, we chose to leave this description out of the main text and focus on the major finding: that PPIs detected in more environments are generally associated with a better fit to the mass action kinetics model.

      *) Figure 6: I apologize, but for my taste this is not a final figure 6 for this study. Investigation of different environments increases the PPI network in yeast, yes, yet it is very well known that a saturation is reached after testing of several conditions, different methods and even screening repetition (sampling). It does not represent an important outcome. Move to suppl or remove.

      We included Figure 6 to summarize and illustrate the path forward from this study. This is an explicit reference to impactful computational analyses done using earlier generations of data to assess the completeness of single-condition interaction networks (Hart et al., 2006; Sambourg and Thierry-Mieg, 2010). Here, we are extending PPI measurement of millions-scale networks across multiple environments, and are using this figure to extend these concepts to multi-condition screens. We agree that the property of saturation in sampling is well known, but it is surprising that we can quantitatively estimate convergence of this expanded condition-specific PPI set using only 9 conditions. Thus, we agree with Reviewer 1 that these are “remarkable results” and that the “upper limit is profoundly important to modelling cellular network complexity and, if it holds up, could define a general upper limit on organismal complexity.” We think this is an important advance of the paper, and this figure is useful to stimulate discussion and guide future work.

      Reviewer #2 (Significance (Required)):

      Liu et al. increase the current PPI network in yeast and offer a substantial dataset of novel PPIs seen in specific environments only. This resource can be used to further investigate the biological meaning of the PPI changes. The data set is compared to previous DHFR providing some sort of quality benchmarking. Mutable interactions are characterized well. Clearly a next step could be to start some "orthogonal" validation, i.e. beyond yeast growth under methotrexate treatment.

      The reviewer makes a great point that we also discuss on page 9, line 33:

      While we used reconstruction of C-terminal-attached mDHFR fragments as a reporter for PPI abundance, similar massively parallel assays could be constructed with different PCA reporters or tagging configurations to validate our observations and overcome false negatives that are specific to our reporter. Indeed, the recent development of “swap tag” libraries, where new markers can be inserted C- or N-terminal to most genes (Weill et al., 2018; Yofe et al., 2016), in combination with our iSeq double barcoder collection (Liu et al., 2019), makes extension of our approach eminently feasible.

      Reviewer 3

      Reviewer #3 (Evidence, reproducibility and clarity (Required)):

      **Summary**

      The manuscript "A large accessory protein interactome is rewired across environments" by Liu et al. scales up a previously-described method (PPiSeq) to test a matrix of ~1.6 million protein pairs of direct protein-protein interactions in each of 9 different growth environments.

      While the study found a small fraction of immutable PPIs that are relatively stable across environments, the vast majority were 'mutable' across environments. Surprisingly, PPIs detected only in one environment made up more than 60% of the map. In addition to a false positive fraction that can yield apparently-mutable interactions, retest experiments demonstrate (not surprisingly) that environment-specificity can sometimes be attributed to false-negatives. The study authors predict that the whole subnetwork within the space tested will contain 11K true interactions.

      Much of environment-specific rewiring seemed to take place in an 'accessory module', which surrounds the core module made of mostly immutable PPIs. A number of interesting network clustering and functional enrichment analyses are performed to characterize the network overall and 'mutable' interactions in particular. The study report other global properties such as expression level, protein abundance and genetic interaction degree that differ between mutable and immutable PPIs. One of the interesting findings was evidence that many environmentally mutable PPI changes are regulated post-translationally. Finally, authors provide a case study about network rewiring related to glucose transport.

      **Major issues**

      -The results section should more prominently describe the dimensions of the matrix screen, both in terms of the set of protein pairs attempted and the set actually screened (I think this was 1741 x 1113 after filtering?). More importantly, the study should acknowledge in the introduction that this was NOT a random sample of protein pairs, but rather focused on pairs for which interaction had been previously observed in the baseline condition. This major bias has a potentially substantial impact on many of the downstream analyses. For example, any gene which was not expressed under the conditions of the original Tarrasov et al. study on which the screening space was based will not have been tested here. Thus, the study has systematically excluded interactions involving proteins with environment-dependent expression, except where they happened to be expressed in the single Tarrasov et al. environment. Heightened connectivity within the 'core module' may result from this bias, and if Tarrasov et al had screened in hydrogen peroxide (H2O2) instead of SD media, perhaps the network would have exhibited a code module in H2O2 decorated by less-densely connected accessory modules observed in other environments. The paper should clearly indicate which downstream analyses have special caveats in light of this design bias.

      We have now added text the matrix dimensions of our study on page 3, line 3:

      To generate a large PPiSeq library, all strains from the protein interactome (mDHFR-PCA) collection that were found to contain a protein likely to participate in at least one PPI (1742 X 1130 protein pairs), (Tarassov et al., 2008) were barcoded in duplicate using the double barcoder iSeq collection (Liu et al., 2019), and mated together in a single pool (Figure 1A). Double barcode sequencing revealed that the PPiSeq library contained 1.79 million protein pairs and 6.05 million double barcodes (92.3% and 78.1% of theoretical, respectively, 1741 X 1113 protein pairs), with each protein pair represented by an average of 3.4 unique double barcodes (Figure S1).

      We agree with the reviewer that our selection of proteins from a previously identified set can introduce bias in our conclusions. Our research question was focused on how PPIs change across environments, and thus we chose to maximize our power to detect PPI changes by selecting a set of protein pairs that are enriched for PPIs. We have now added a discussion of the potential caveats of this choice to the discussion on page 9, line 4:

      Results presented here and elsewhere (Huttlin et al., 2020) suggest that PPIs discovered under a single condition or cell type are a small subset of the full protein interactome emergent from a genome. We sampled nine diverse environments and found approximately 3-fold more interactions than in a single environment. However, the discovery of new PPIs began to saturate, indicating that most condition-specific PPIs can be captured in a limited number of conditions. Testing in many more conditions and with PPI assays orthogonal to PPiSeq will undoubtedly identify new PPIs, however a more important outcome could be the identification of coordinated network changes across conditions. Using a test set of ~1.6 million (of ~18 million) protein pairs across nine environments, we find that specific parts of the protein interactome are relatively stable (core modules) while others frequently change across environments (accessory modules). However, two important caveats of our study must be recognized before extrapolating these results to the entire protein interactome across all environment space. First, we tested for interactions between a biased set of proteins that have previously been found to participate in at least one PPI as measured by mDHFR-PCA under standard growth conditions (Tarassov et al., 2008). Thus, proteins that are not expressed under standard growth conditions are excluded from our study, as are PPIs that are not detectable by mDHFR-PCA or PPiSeq. It is possible that a comprehensive screen using multiple orthogonal PPI assays would alter our observations related to the relative dynamics of different regions of the protein interactome and the features of mutable and immutable PPIs. Second, we tested a limited number of environmental perturbations under similar growth conditions (batch liquid growth). It is possible that more extreme environmental shifts (e.g. growth as a colony, anaerobic growth, pseudohyphal growth) would introduce new accessory modules or alter the mutability of the PPIs we detect. Nevertheless, results presented here provide a new mechanistic view of how the cell changes in response to environmental challenges, building on the previous work that describes coordinated responses in the transcriptome (Brauer et al., 2007; Gasch et al., 2000) and proteome (Breker et al., 2013; Chong et al., 2015).

      -Related to the previous issue, a quick look at the proteins tested (if I understood them correctly) showed that they were enriched for genes encoding the elongator holoenzyme complex, DNA-directed RNA polymerase I complex, membrane docking and actin binding proteins, among other functional enrichments. Genes related to DNA damage (endonuclease activity and transposition), were depleted. It was unclear whether the functional enrichment analyses described in the paper reported enrichments relative to what would be expected given the bias inherent to the tested space?

      We did two functional enrichment analyses in this study: network density within Gene Ontology terms (related to Figure 2) and gene ontology enrichment of network communities (related to Figure 3). For both analyses, we performed comparisons to proteins included in PPiSeq library. This is described in the Supplementary Materials on page 63, line 35:

      To estimate GO term enrichment in our PPI network, we constructed 1000 random networks by replacing each bait or prey protein that was involved in a PPI with a randomly chosen protein from all proteins in our screen. This randomization preserves the degree distribution of the network.

      And on page 66, line 38:

      The set of proteins used for enrichment comparison are proteins that are involved in at least one PPI as determined by PPiSeq.

      -Re: data quality. To the study's great credit, they incorporated positive and random reference sets (PRS and RRS) into the screen. However, the results from this were concerning: Table SM6 shows that assay stringency was set such that between 1 and 3 out of 67 RRS pairs were detected. This specificity would be fine for an assay intended for retest or validate previous hits, where the prior probability of a true interaction is high, but in large-scale screening the prior probability of true interactions that are detectable by PCA is much lower, and a higher specificity is needed to avoid being overwhelmed by false positives. Consider this back of the envelope calculation: Let's say that the prior probability of true interaction is 1% as the authors' suggest (pg 49, section 6.5), and if PCA can optimistically detect 30% of these pairs, then the number of true interactions we might expect to see in an RRS of size 67 is 1% * 30% * 67 = 0.2 . This back of the envelope calculation suggests that a stringency allowing 1 hit in RRS will yield 80% [ (1 - 0.2) / 1 ] false positives, and a stringency allowing 3 hits in RRS will yield 93% [ (3 - 0.2) / 3] false positives. How do the authors reconcile these back of the envelope calculations from their PRS and RRS results with their estimates of precision?

      We thank the reviewer for bringing up with this issue. We included positive and random reference sets (PRS:70 protein pairs, RRS:67 protein pairs) to benchmark our PPI calling (Yu et al., 2008). The PRS reference lists PPIs that have been validated by multiple independent studies and is therefore likely to represent true PPIs that are present in some subset of the environments we tested. For the PRS set, we found a rate of detection that is comparable to other studies (PPiSeq in SD: 28%, Y2H and yellow fluorescent protein-PCA: ~20%) (Yu et al., 2008). The RRS reference, developed ten years ago, is randomly chosen protein pairs for which there was no evidence of a PPI in the literature at the time (mostly in standard growth conditions). Given the relatively high rate of false negatives in PPI assays, this set may in fact contain some true PPIs that have yet to be discovered. We could detect PPIs for four RRS protein pairs in our study, when looking across all 9 environments. Three of these (Grs1_Pet10, Rck2_Csh1, and YDR492W_Rpd3) could be detected in multiple environments (9, 7, and 3, respectively), suggesting that their detection was not a statistical or experimental artifact of our bar-seq assay (see table below derived from Table S4). The remaining PPI detected in the RRS, was only detected in SD (standard growth conditions) but with a relatively high fitness (0.35), again suggesting its detection was not a statistical or experimental artifact. While we do acknowledge it is possible that these are indeed false positives due to erroneous interactions of chimeric DHFR-tagged versions of these proteins, the small size of the RRS combined with the fact that some of the protein pairs could be true PPIs, did not give us confidence that this rate (4 of 70) is representative of our true false positive rate. To determine a false positive rate that is less subject to biases stemming from sampling of small numbers, we instead generated 50 new, larger random reference sets, by sampling for each set ~ 60,000 protein pairs without a reported PPI in BioGRID. Using these new reference sets, we found that the putative false positive rate of our assay is generally lower than 0.3% across conditions for each of the 50 reference sets. We therefore used this more statistically robust measure of the false positive rate to estimate positive predictive values (PPV = 62%, TPR = 41% in SD). We detail these statistical methods in Section 6 of the supplementary methods and report all statistical metrics in Table SM6.

      PPI

      Environment_number

      SD

      H2O2

      Hydroxyurea

      Doxorubicin

      Forskolin

      Raffinose

      NaCl

      16℃

      FK506

      Rck2_Csh1

      7

      0.35

      0.35

      0

      0.20

      0.54

      0.74

      0

      0.17

      0.59

      Grs1_Pet10

      9

      0.44

      0.39

      0.34

      0.25

      0.65

      1.19

      0.2

      0.16

      0.95

      YDR492W_Rpd3

      3

      0

      0.18

      0

      0

      0

      0

      0

      0.17

      0.61

      Mrps35_Bub3

      1

      0.35

      0

      0

      0

      0

      0

      0

      0

      0

      Positive_control

      9

      1

      0.8

      0.73

      0.62

      1.4

      2.44

      0.4

      0.28

      1.8

      Table. Mean fitness in each environment

      -Methods for estimating precision and recall were not sufficiently well described to assess. Precision vs recall plots would be helpful to better understand this tradeoff as score thresholds were evaluated.

      We describe in detail our approach to calling PPIs in section 6.6 of the supplementary methods, including Table SM6, and Figures SM3, SM4, SM6, and now Figure SM5. We identified positive PPIs using a dynamic threshold that considers the mean fitness and p-value in each environment. For each dynamic threshold, we estimated the precision and recall based on the reference sets (described supplementary methods in section 6.5). We then chose the threshold with the maximal Matthews correlation coefficient (MCC) to obtain the best balance between precision and recall. We have now added an additional plot (Figure SM5) that shows the precision and recall for the chosen dynamic threshold in each environment.

      -Within the tested space, the Tarassov et al map and the current map could each be compared against a common 'bronze standard' (e.g. literature curated interactions), at least for the SD map, to have an idea about how the quality of the current map compares to that of the previous PCA map. Each could also be compared with the most recent large-scale Y2H study (Yu et al).

      We thank the reviewer for this suggestion. We have now added a figure panel (Figure S4) that compares PPiSeq in SD (2 replicates) to mDHFR PCA (Tarassov et al., 2008), Y2H (Yu et al., 2008), and our newly constructed ‘bronze standard’ high-confidence positive reference set (PRS, supplementary method section 6.4).

      • Experimental validation of the network was done by conventional PCA. However, it should be noted that this is a form of technical replication of the DHFR-based PCA assay, and not a truly independent validation. Other large-scale yeast interaction studies (e.g., Yu et al, Science 2008) have assessed a random subset of observed PPIs using an orthogonal approach, calibrated using PRS and RRS sets examined via the same orthogonal method, from which overall performance of the dataset could be determined.

      We appreciate the reviewer’s perspective, since orthogonal validation experiments have been a critical tool to establish assay performance following early Y2H work. We know from careful work done previously that modern orthogonal assays have a low cross validation rate ((Yu et al., 2008) and that they tend to be enriched for PPIs in different cellular compartments (Jensen and Bork, 2008), indicating that high false negative rates are the likely explanation. High false negative rates have been confirmed here and elsewhere using positive reference sets (e.g. Y2H 80%, PCA 80%, PPiSeq 74% using the PRS in (Yu et al., 2008)). Therefore, the expectation is that PPiSeq, as with other assays, will have a low rate of validation using an orthogonal assay -- although we would not know if this rate is 10%, 30% or somewhere in between without performing the work. However, the exact number -- whether it be 10% or 30% -- has no practical impact on the main conclusions of this study (focused on network dynamics rather than network enumeration). Neither does that number speak to the confidence in our PPI calls, since a lower number may simply be due to less overlap in the sets of PPIs that are callable by PPiSeq and another assay. Our method uses bar-seq to extend an established mDHFR-PCA assay (Tarassov et al., 2008). The validations we performed were aimed at confirming that our sequencing, barcode counting, fitness estimation, and PPI calling protocols were not introducing excessive noise relative to mDHFR-PCA that resulted in a high number of PPI miscalls. Confirming this, we do indeed find a high rate of validation by lower throughput PCA (50-90%, Figure 3B). Finally, we do include independent tests of the quality of our data by comparing it to positive and random reference sets from literature curated data. We find that our assay performs extremely well (PPV > 61%, TPR > 41%) relative to other high-throughput assays.

      -The Venn diagram in Figure 1G was not very informative in terms of assessing the quality of data. It looks like there is a relatively little overlap between PPIs identified in standard conditions (SD media) in the current study and those of the previous study using a very similar method. Is there any way to know how much of this disagreement can be attributed to each screen being sub-saturation (e.g. by comparing replica screens) and what fraction to systematic assay or environment differences?

      We have now added a figure panel (Figure S4) that compares PPiSeq in SD (2 replicates) to mDHFR-PCA (Tarassov et al., 2008), Y2H (Yu et al., 2008), and our newly constructed ‘bronze standard’ high-confidence positive reference sets (PRS, supplementary methods section 6.4). We find that SD replicates have an overlap coefficient of 79% with each other, ~45% with mDHFR-PCA, ~45% the ‘bronze standard’ PRS, and ~13% with Y2H. Overlap coefficients between the SD replicates and mDHFR-PCA are much higher than those found between orthologous methods ((Yu et al., 2008), indicating that these two assays are identifying a similar set of PPIs. We do note that PPiSeq and mDHFR-PCA do screen for PPIs under different growth conditions (batch liquid growth vs. colonies on agar), so some fraction of the disagreement is due to environmental differences. PPIs that overlap between the two PPiSeq SD replicates are more likely to be found in mDHFR-PCA, PRS, and Y2H, indicating that PPIs identified in a single SD replicate are more likely to be false positives. However, we do find (a lower rate of) overlaps between PPIs identified in only one SD replicate and other methods, suggesting that a single PPiSeq replicate is not finding all discoverable PPIs.

      -In Figure S5C, the environment-specificity rate of PPIs might be inflated due to the fact that authors only test for the absence of SD hits in other conditions, and the SD condition is the only condition that has been sampled twice during the screening. What would be the environment-specific verification rate if sample hits from each environment were tested in all environments? This seems important, as robustly detecting environment-specific PPIs is one of the key points of the study.

      We use PPIs found in the SD environment to determine the environment-specificity because this provides the most conservative (highest) estimate of the number of PPIs found in other environments that were not detectable by our bar-seq assay. To identify PPIs in the SD environment, we pooled fitness estimates across the two replicates (~ 4 fitness estimates per replicate, ~ 8 total). The higher number of replicates results in a reduced rate of false positives (an erroneous fitness estimate has less impact on a PPI call), meaning that we are more confident that PPIs identified in SD are true positives. Because false positives in one environment (but not other environments) are likely to erroneously contribute to the environment-specificity rate, choosing the environment with the lowest rate of false positives (SD) should result in the lowest environment-specificity rate (highest estimate of PPIs found in other environments that were not detectable by our bar-seq assay).

      **Minor issues**

      -Re: "An interaction between the proteins reconstitutes mDHFR, providing resistance to the drug methotrexate and a growth advantage that is proportional to the PPI abundance" (pg 2). It may be more accurate to say "monotonically related" than "proportional" here. Fig 2 from the cited Freschi et al ref does suggests linearity with colony size over a wide range of inferred complex abundances, but non-linear at low complex abundance. Also note that Freschi measured colony area which is not linear with exponential growth rate nor with cell count.

      We agree with the reviewer and have changed “proportional” to “monotonically related” on page 2, line 41.

      -Re: "Using putatively positive and negative reference sets, we empirically determined a statistical threshold for each environment with the best balance of precision and recall (positive predictive value (PPV) > 61% in SD media, Methods, section 6)." (pg 3). Should state the recall at this PPV.

      We agree with the reviewer and have added the recall (41%) in the main text (line 26, page3).

      Using putatively positive and negative reference sets, we empirically determined a statistical threshold for each environment with the best balance of precision and recall (positive predictive value (PPV) > 61% and true positive rate > 41% in SD media, Methods, section 6).

      -Authors could discuss the extent to which related methods (e.g. PMID: 28650476, PMID: 27107012, PMID: 29165646, PMID: 30217970) would be potentially suitable for screening in different environments.

      We have now added a reference to a barcode-based Y2H study that examined interactions between yeast proteins to the introduction on page 2, line 2:

      Yet, little is known about how PPI networks reorganize on a global scale or what drives these changes. One challenge is that commonly-used high-throughput PPI screening technologies are geared toward PPI identification (Gavin et al., 2002; Ito et al., 2001; Tarassov et al., 2008; Uetz et al., 2000; Yu et al., 2008, Yachie et al., 2016), not a quantitative analysis of relative PPI abundance that is necessary to determine if changes in the PPI network are occurring. The murine dihydrofolate reductase (mDHFR)‐based protein-fragment complementation assay (PCA) provides a viable path to characterize PPI abundance changes because it is a sensitive test for PPIs in the native cellular context and at native protein expression levels (Freschi et al., 2013; Remy and Michnick, 1999; Tarassov et al., 2008).

      We have excluded the references to other barcode-based Y2H studies that reviewer mentions because they test heterologous proteins within yeast, and the effect of perturbations to yeast on these proteins would be difficult to interpret in the context of our questions. The yeast protein Y2H study, although a wonderful approach and paper, would also not be an appropriate method to examine how PPI networks change across environments because protein fusions are not expressed under their endogenous promoters and must be transported to, in many cases, a non-native compartment (cell nucleus) to be detected. Rather than explicitly discuss the caveats of this particular approach, we have instead chosen to discuss why we use PCA.

      • the term "mutable" is certainly appropriate according to the dictionary definition of changeable. The authors may wish to consider though, that in a molecular biology context the term evokes changeability by mutation (a very interesting but distinct topic). Maybe another term (environment-dependent interactions or ePPIs?) would be clearer. Of course this is the authors' call.

      We thank the reviewer for this suggestion, and have admittedly struggled with the terminology. For clarity of presentation, we strived to have a single word that describes the property of a PPI that is at the core of this manuscript -- how frequently a PPI is found across environments. However, the most descriptive words come with preloaded meanings in PPI research (e.g. transient, stable, dynamic), as does “mutable” with another research field. We are, quite frankly, open to suggestions from the reviewers or editors for a more appropriate word that does not raise similar objections.

      -Some discussion is warranted about the phenomenon that a PPI that is unchanged in abundance could appear to change because of statistical significance thresholds that differ between screens. This would be a difficult question for any such study, and I don't think the authors need to solve it, but just to discuss.

      We agree with the reviewer that significance thresholds could be impacting our interpretations and discuss this idea at length on page 4, line 23 of the Results. This section has been modified to include an additional analysis (excluding 16 ℃ data) in response to another reviewer’s comment:

      Immutable PPIs were likely to have been previously reported by colony-based mDHFR-PCA or other methods, while the PPIs found in the fewest environments were not. One possible explanation for this observation is that previous PPI assays, which largely tested in standard laboratory growth conditions, and variations thereof, are biased toward identification of the least mutable PPIs. That is, since immutable PPIs are found in nearly all environments, they are more readily observed in just one. However, another possible explanation is that, in our assay, mutable PPIs are more likely to be false positives in environment(s) in which they are identified or false negatives in environments in which they are not identified. To investigate this second possibility, we first asked whether PPIs present in very few environments have lower fitnesses, as this might indicate that they are closer to our limit of detection. We found no such pattern: mean fitnesses were roughly consistent across PPIs found in 1 to 6 conditions, although they were elevated in PPIs found in 7-9 conditions (Figure S6A). To directly test the false-positive rate stemming from pooled growth and barcode sequencing, we validated randomly selected PPIs within each mutability bin by comparing their optical density growth trajectories against controls (Figures 3B). We found that mutable PPIs did indeed have lower validation rates in the environment in which they were identified, yet putative false positives were limited to ~50%, and, within a bin, do not differ between PPIs that have been previously identified and those that have been newly discovered by our assay (Figure S65B). We also note mutable PPIs might be more sensitive to environmental differences between our large pooled PPiSeq assays and clonal 96-well validation assays, indicating that differences in validation rates might be overstated. To test the false-negative rate, we assayed PPIs identified in only SD by PPiSeq across all other environments by optical density growth and found that PPIs can be assigned to additional environments (Figure S6C). However, the number of additional environments in which a PPI was detected was generally low (2.5 on average), and the interaction signal in other environments was generally weaker than in SD (Figure S6D). To better estimate how the number of PPIs changes with PPI mutability, we used these optical density assays to model the validation rate as a function of the mean PPiSeq fitness and the number of environments in which a PPI is detected. This accurate model (Spearman's r =0.98 between predicted and observed, see Methods) provided confidence scores (predicted validation rates) for each PPI (Table S5) and allowed us to adjust the true positive PPI estimate in each mutability bin. Using this more conservative estimate, we still found a preponderance of mutable PPIs (Figure S6E). Finally, we used a pair of more conservative PPI calling procedures that either identified PPIs with a low rate of false positives across all environments (FPR

      We later examine major conclusions of our study using more conservative calling procedures, and find that they are consistent. On page 6, line 14:

      Both the co-expression and co-localization patterns were also apparent in our higher confidence PPI sets (Figures S7B, and S7C, S8B, S8C ), indicating that they are not caused by different false positive rates between the mutability bins.

      And on page 6, line 19:

      We binned proteins by their PPI degree, and, within each bin, determined the correlation between the mutability score and another gene feature (Figure 4C and S12A, Table S8) (Costanzo et al., 2016; Finn et al., 2014; Gavin et al., 2006; Holstege et al., 1998; Krogan et al., 2006; Levy and Siegal, 2008; Myers et al., 2006; Newman et al., 2006; Östlund et al., 2010; Rice et al., 2000; Stark et al., 2011; Wapinski et al., 2007; Ward et al., 2004; Yang, 2007; Yu et al., 2008). These correlations were also calculated using our higher confidence PPI sets, confirming results from the full data set (Figures S7D and, S7E, S8D, S8E). We found that mutable hubs (> 15 PPIs) have more genetic interactions, in agreement with predictions from co-expression data (Bertin et al., 2007; Han et al., 2004), and that their deletion tends to cause larger fitness defects.

      -More discussion would be helpful about the idea that immutability may to some extent favor interactions that PCA is better able to detect (possibly including membrane proteins?)

      We agree with the reviewer and now added a discussion of this potential caveats to the discussion on page 9, line 4:

      Results presented here and elsewhere (Huttlin et al., 2020) suggest that PPIs discovered under a single condition or cell type are a small subset of the full protein interactome emergent from a genome. We sampled nine diverse environments and found approximately 3-fold more interactions than in a single environment. However, the discovery of new PPIs began to saturate, indicating that most condition-specific PPIs can be captured in a limited number of conditions. Testing in many more conditions and with PPI assays orthogonal to PPiSeq will undoubtedly identify new PPIs, however a more important outcome could be the identification of coordinated network changes across conditions. Using a test set of ~1.6 million (of ~18 million) protein pairs across nine environments, we find that specific parts of the protein interactome are relatively stable (core modules) while others frequently change across environments (accessory modules). However, two important caveats of our study must be recognized before extrapolating these results to the entire protein interactome across all environment space. First, we tested for interactions between a biased set of proteins that have previously been found to participate in at least one PPI as measured by mDHFR-PCA under standard growth conditions (Tarassov et al., 2008). Thus, proteins that are not expressed under standard growth conditions are excluded from our study, as are PPIs that are not detectable by mDHFR-PCA or PPiSeq. It is possible that a comprehensive screen using multiple orthogonal PPI assays would alter our observations related to the relative dynamics of different regions of the protein interactome and the features of mutable and immutable PPIs. Second, we tested a limited number of environmental perturbations under similar growth conditions (batch liquid growth). It is possible that more extreme environmental shifts (e.g. growth as a colony, anaerobic growth, pseudohyphal growth) would introduce new accessory modules or alter the mutability of the PPIs we detect. Nevertheless, results presented here provide a new mechanistic view of how the cell changes in response to environmental challenges, building on the previous work that describes coordinated responses in the transcriptome (Brauer et al., 2007; Gasch et al., 2000) and proteome (Breker et al., 2013; Chong et al., 2015).

      -Re: "As might be expected, we also found that mutable hubs, but not non-hubs, are more likely to participate in multiple protein complexes than less mutable proteins." (pg 6) This is a cool result. To what extent was this result driven by members of one or two complexes? If so, it would worth noting them.

      We thank the reviewer for this question. We have now included Figue S13, which shows the number and size of protein complexes that underlie the finding that mutable hubs are more likely to participate in multiple protein complexes. We find that proteins in our screen that participate in multiple complexes are distributed over a wide range of complexes, indicating that this observation is not driven by one or two complexes. On page 6, line 34:

      As might be expected, we also found that mutable hubs, but not non-hubs, are more likely to participate in multiple protein complexes than less mutable proteins (Figures S13A-C) (Costanzo et al., 2016).

      -Re: "Borrowing a species richness estimator from ecology (Jari Oksanen et al., 2019), we estimate that there are ~10,840 true interactions within our search space across all environments, ~3-fold more than are detected in SD (note difference to Figure 3, which counts observed PPIs)." (pg 8) Should note that this only allows estimation of the number of interactions that are detectable by PCA methods. Previous work (Braun et al, 2019) showed that every known protein interaction assay (including PCA approaches) can only detect a fraction of bona fide interactions.

      We agree with the reviewer and have modified the discussion to make this point explicit on page 9, line 4:

      Results presented here and elsewhere (Huttlin et al., 2020) suggest that PPIs discovered under a single condition or cell type are a small subset of the full protein interactome emergent from a genome. We sampled nine diverse environments and found approximately 3-fold more interactions than in a single environment. However, the discovery of new PPIs began to saturate, indicating that most condition-specific PPIs can be captured in a limited number of conditions. Testing in many more conditions and with PPI assays orthogonal to PPiSeq will undoubtedly identify new PPIs, however a more important outcome could be the identification of coordinated network changes across conditions.

      We continue in this paragraph to discuss the implications:

      Using a test set of ~1.6 million (of ~18 million) protein pairs across nine environments, we find that specific parts of the protein interactome are relatively stable (core modules) while others frequently change across environments (accessory modules). However, two important caveats of our study must be recognized before extrapolating these results to the entire protein interactome across all environment space. First, we tested for interactions between a biased set of proteins that have previously been found to participate in at least one PPI as measured by mDHFR-PCA under standard growth conditions (Tarassov et al., 2008). Thus, proteins that are not expressed under standard growth conditions are excluded from our study, as are PPIs that are not detectable by mDHFR-PCA or PPiSeq. It is possible that a comprehensive screen using multiple orthogonal PPI assays would alter our observations related to the relative dynamics of different regions of the protein interactome and the features of mutable and immutable PPIs.

      -Re: "This analysis shows that the number of PPIs present across all environments is much larger than the number observed in a single condition, but that it is feasible to discover most of these new PPIs by sampling a limited number of conditions." (pg 8). The main point is surely correct, but it is worth noting that extrapolation to the number of true interactions depends on the nine chosen environments being representative of all environments. The situation could change under more extreme, e.g., anaerobic, conditions.

      We agree with the reviewer and make this point explicit, continuing from the paragraph quoted above on page 9, line 22:

      Second, we tested a limited number of environmental perturbations under similar growth conditions (batch liquid growth). It is possible that more extreme environmental shifts (e.g. growth as a colony, anaerobic growth, pseudohyphal growth) would introduce new accessory modules or alter the mutability of the PPIs we detect. Nevertheless, results presented here provide a new mechanistic view of how the cell changes in response to environmental challenges, building on the previous work that describes coordinated responses in the transcriptome (Brauer et al., 2007; Gasch et al., 2000) and proteome (Breker et al., 2013; Chong et al., 2015).

      -It stands to reason that proteins expressed in all conditions will yield less mutable interactions, if 'mutability' is primarily due to expression change at the transcriptional level. They should at least discuss that measuring mRNA levels could resolve questions about this. Could use Waern et al G3 2013 data (H202, SD, HU, NaCl) to predict the dynamic interactome purely by node removal, and see how conclusions would change

      We agree with the reviewer that mRNA abundance could potentially be used as a proxy for protein abundance and have added this point on page 10, line 28:

      Here we use homodimer abundance as a proxy for protein abundance. However, genome-wide mRNA abundance measures could be used as a proxy for protein abundance or protein abundance could be measured directly in the same pool (Levy et al., 2014) by, for example, attaching a full length mDHFR to each gene using “swap tag” libraries mentioned above (Weill et al., 2018; Yofe et al., 2016).

      However, using mRNA abundance as a proxy for protein abundance in this study has several important caveats that would make interpretation difficult. First, mRNA and protein abundance correlate, but not perfectly (R2 = 0.45) (Lahtvee et al., 2017), and our findings suggest that post-translational regulation may be important to driving PPI changes. Second, mRNA abundance measures are for a single time point, while our PPI measures coarse grain over a growth cycle (lag, exponential growth, diauxic shift, saturation). Although we may be able to take multiple mRNA measures across the cycle, time delays between changes in mRNA and protein levels, combined with the fact that we do not know when a PPI is occurring or most prominent over the cycle, would pose a significant challenge to making any claims that PPI changes are driven by changes in protein abundance. We instead chose to focus on a subset of proteins (homodimers) where abundance measures can be coarse grained in the same way as PPI measures. In the above quote, we point to a potential method by which this can be done for all proteins. We also point to how a continuous culturing design could be used to better determine how protein (or mRNA proxy) abundance impacts PPI abundance on page 10, line 6:

      Finally, our assays were performed across cycles of batch growth meaning that changes in PPI abundance across a growth cycle (e.g. lag, exponential growth, saturation) are coarse grained into one measurement. While this method potentially increases our chance of discovering a diverse set of PPIs, it might have an unpredictable impact on the relationship between fitness and PPI abundance (Li et al., 2018). To overcome these issues, strains containing natural or synthetic PPIs with known abundances and intracellular localizations could be spiked into cell pools to calibrate the relationship between fitness and PPI abundance in each environment. In addition, continuous culturing systems may be useful for refining precision of growth-based assays such as ours.

      -The analysis showing that many interactions are likely due to post-translational modifications is very interesting, but caveats should be discussed. Where heterodimers do not fit the expression-level dependence model, some cases of non-fitting may simply be due to measurement error or non-linearity in the relationship between abundance and fitness.

      We show the measurement error in Figures 1, S2, S3. While we agree with the reviewer that measurement error is a general caveat for all results reported, we do not feel that it is necessary to point to that fact in this particular case, which uses a logistic regression to report that PPI mutability was the best predictor of fit to the expression-level dependence model. We discuss the non-linearity caveat on page 9, line 41:

      Our assay detected subtle fitness differences across environments (Fig S5B and S5C), which we used as a rough estimate for changes in relative PPI abundance. While it would be tempting to use fitness as a direct readout of absolute PPI abundance within a cell, non-linearities between fitness and PPI abundance may be common and PPI dependent. For example, the relative contribution of a reconstructed mDHFR molecule to fitness might diminish at high PPI abundances (saturation effects) and fitness differences between PPIs may be caused, in part, by differences in how accessible a reconstructed mDHFR molecule is to substrate. In addition, environmental shifts might impact cell growth rate, initiate a stress response, or result in other unpredictable cell effects that impact the selective pressure of methotrexate and thereby fitness (Figure S2 and S3).

      -Line numbers would have been helpful to note more specific minor comments

      We are sorry for this inconvenience. We have added line numbers in our revised manuscript.

      -Sequence data should be shared via the Short-Read Archive.

      The raw sequencing data have been uploaded to the Short-Read Archive. We mentioned it in the Data and Software Availability section on page 68, line 41.

      Raw barcode sequencing data are available from the NIH Sequence Read Archive as accession PRJNA630095 (https://trace.ncbi.nlm.nih.gov/Traces/study/?acc=SRP259652).

      Reviewer #3 (Significance (Required)):

      Knowledge of protein-protein interactions (PPIs) provides a key window on biological mechanism, and unbiased screens have informed global principles underlying cellular organization. Several genome-scale screens for direct (binary) interactions between yeast proteins have been carried out, and while each has provided a wealth of new hypotheses, each has been sub-saturation. Therefore, even given multiple genome-scale screens our knowledge of yeast interactions remains incomplete. Different assays are better suited to find different interactions, and it is now clear that every assay evaluated thus far is only capable (even in a saturated screen) of detecting a minority of true interactions. More relevant to the current study, no binary interaction screen has been carried out at the scale of millions of protein pairs outside of a single 'baseline' condition.

      The study by Liu et al is notable from a technology perspective in that it is one of several recombinant-barcode approaches have been developed to multiplex pairwise combinations of two barcoded libraries. Although other methods have been demonstrated at the scale of 1M protein pairs, this is the first study using such a technology at the scale of >1M pairs across multiple environments.

      A limitation is that this study is not genome-scale, and the search space is biased towards proteins for which interactions were previously observed in a particular environment. This is perhaps understandable, as it made the study more tractable, but this does add caveats to many of the conclusions drawn. These would be acceptable if clearly described and discussed. There were also questions about data quality and assessment that would need to be addressed.

      Assuming issues can be addressed, this is a timely study on an important topic, and will be of broad interest given the importance of protein interactions and the status of S. cerevisiae as a key testbed for systems biology.

      *Reviewers' expertise:* Interaction assays, next-generation sequencing, computational genomics. Less able to assess evolutionary biology aspects.

      References

      Brauer, M.J., Huttenhower, C., Airoldi, E.M., Rosenstein, R., Matese, J.C., Gresham, D., Boer, V.M., Troyanskaya, O.G., and Botstein, D. (2007). Coordination of Growth Rate, Cell Cycle, Stress Response, and Metabolic Activity in Yeast. Mol. Biol. Cell 19, 352–367.

      Breker, M., Gymrek, M., and Schuldiner, M. (2013). A novel single-cell screening platform reveals proteome plasticity during yeast stress responses. J. Cell Biol. 200, 839–850.

      Chong, Y.T., Koh, J.L.Y., Friesen, H., Kaluarachchi Duffy, S., Cox, M.J., Moses, A., Moffat, J., Boone, C., and Andrews, B.J. (2015). Yeast Proteome Dynamics from Single Cell Imaging and Automated Analysis. Cell 161, 1413–1424.

      Gasch, A.P., Spellman, P.T., Kao, C.M., Carmel-Harel, O., Eisen, M.B., Storz, G., Botstein, D., and Brown, P.O. (2000). Genomic Expression Programs in the Response of Yeast Cells to Environmental Changes. Mol. Biol. Cell 11, 4241–4257.

      Hart, G.T., Ramani, A.K., and Marcotte, E.M. (2006). How complete are current yeast and human protein-interaction networks? Genome Biol. 7, 120.

      Hilliker, A., Gao, Z., Jankowsky, E., and Parker, R. (2011). The DEAD-box protein Ded1 modulates translation by the formation and resolution of an eIF4F-mRNA complex. Mol. Cell 43, 962–972.

      Isasa, M., Suñer, C., Díaz, M., Puig-Sàrries, P., Zuin, A., Bichmann, A., Gygi, S.P., Rebollo, E., and Crosas, B. (2015). Cold Temperature Induces the Reprogramming of Proteolytic Pathways in Yeast. J. Biol. Chem. jbc.M115.698662.

      Jensen, L.J., and Bork, P. (2008). Not Comparable, But Complementary. Science 322, 56–57.

      Lahtvee, P.-J., Sánchez, B.J., Smialowska, A., Kasvandik, S., Elsemman, I.E., Gatto, F., and Nielsen, J. (2017). Absolute Quantification of Protein and mRNA Abundances Demonstrate Variability in Gene-Specific Translation Efficiency in Yeast. Cell Syst. 4, 495-504.e5.

      Obayashi, T., Kagaya, Y., Aoki, Y., Tadaka, S., and Kinoshita, K. (2019). COXPRESdb v7: a gene coexpression database for 11 animal species supported by 23 coexpression platforms for technical evaluation and evolutionary inference. Nucleic Acids Res. 47, D55–D62.

      Sambourg, L., and Thierry-Mieg, N. (2010). New insights into protein-protein interaction data lead to increased estimates of the S. cerevisiae interactome size. BMC Bioinformatics 11, 605.

      Tarassov, K., Messier, V., Landry, C.R., Radinovic, S., Molina, M.M.S., Shames, I., Malitskaya, Y., Vogel, J., Bussey, H., and Michnick, S.W. (2008). An in Vivo Map of the Yeast Protein Interactome. Science 320, 1465–1470.

      Yu, H., Braun, P., Yıldırım, M.A., Lemmens, I., Venkatesan, K., Sahalie, J., Hirozane-Kishikawa, T., Gebreab, F., Li, N., Simonis, N., et al. (2008). High-Quality Binary Protein Interaction Map of the Yeast Interactome Network. Science 322, 104–110.

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      Summary

      The manuscript "A large accessory protein interactome is rewired across environments" by Liu et al. scales up a previously-described method (PPiSeq) to test a matrix of ~1.6 million protein pairs of direct protein-protein interactions in each of 9 different growth environments.

      While the study found a small fraction of immutable PPIs that are relatively stable across environments, the vast majority were 'mutable' across environments. Surprisingly, PPIs detected only in one environment made up more than 60% of the map. In addition to a false positive fraction that can yield apparently-mutable interactions, retest experiments demonstrate (not surprisingly) that environment-specificity can sometimes be attributed to false-negatives. The study authors predict that the whole subnetwork within the space tested will contain 11K true interactions.

      Much of environment-specific rewiring seemed to take place in an 'accessory module', which surrounds the core module made of mostly immutable PPIs. A number of interesting network clustering and functional enrichment analyses are performed to characterize the network overall and 'mutable' interactions in particular. The study report other global properties such as expression level, protein abundance and genetic interaction degree that differ between mutable and immutable PPIs. One of the interesting findings was evidence that many environmentally mutable PPI changes are regulated post-translationally. Finally, authors provide a case study about network rewiring related to glucose transport.

      Major issues

      -The results section should more prominently describe the dimensions of the matrix screen, both in terms of the set of protein pairs attempted and the set actually screened (I think this was 1741 x 1113 after filtering?). More importantly, the study should acknowledge in the introduction that this was NOT a random sample of protein pairs, but rather focused on pairs for which interaction had been previously observed in the baseline condition. This major bias has a potentially substantial impact on many of the downstream analyses. For example, any gene which was not expressed under the conditions of the original Tarrasov et al. study on which the screening space was based will not have been tested here. Thus, the study has systematically excluded interactions involving proteins with environment-dependent expression, except where they happened to be expressed in the single Tarrasov et al. environment. Heightened connectivity within the 'core module' may result from this bias, and if Tarrasov et al had screened in hydrogen peroxide (H2O2) instead of SD media, perhaps the network would have exhibited a code module in H2O2 decorated by less-densely connected accessory modules observed in other environments. The paper should clearly indicate which downstream analyses have special caveats in light of this design bias.

      -Related to the previous issue, a quick look at the proteins tested (if I understood them correctly) showed that they were enriched for genes encoding the elongator holoenzyme complex, DNA-directed RNA polymerase I complex, membrane docking and actin binding proteins, among other functional enrichments. Genes related to DNA damage (endonuclease activity and transposition), were depleted. It was unclear whether the functional enrichment analyses described in the paper reported enrichments relative to what would be expected given the bias inherent to the tested space?

      -Re: data quality. To the study's great credit, they incorporated positive and random reference sets (PRS and RRS) into the screen. However, the results from this were concerning: Table SM6 shows that assay stringency was set such that between 1 and 3 out of 67 RRS pairs were detected. This specificity would be fine for an assay intended for retest or validate previous hits, where the prior probability of a true interaction is high, but in large-scale screening the prior probability of true interactions that are detectable by PCA is much lower, and a higher specificity is needed to avoid being overwhelmed by false positives. Consider this back of the envelope calculation: Let's say that the prior probability of true interaction is 1% as the authors' suggest (pg 49, section 6.5), and if PCA can optimistically detect 30% of these pairs, then the number of true interactions we might expect to see in an RRS of size 67 is 1% 30% 67 = 0.2 . This back of the envelope calculation suggests that a stringency allowing 1 hit in RRS will yield 80% [ (1 - 0.2) / 1 ] false positives, and a stringency allowing 3 hits in RRS will yield 93% [ (3 - 0.2) / 3] false positives. How do the authors reconcile these back of the envelope calculations from their PRS and RRS results with their estimates of precision?

      -Methods for estimating precision and recall were not sufficiently well described to assess. Precision vs recall plots would be helpful to better understand this tradeoff as score thresholds were evaluated.

      -Within the tested space, the Tarassov et al map and the current map could each be compared against a common 'bronze standard' (e.g. literature curated interactions), at least for the SD map, to have an idea about how the quality of the current map compares to that of the previous PCA map. Each could also be compared with the most recent large-scale Y2H study (Yu et al).

      • Experimental validation of the network was done by conventional PCA. However, it should be noted that this is a form of technical replication of the DHFR-based PCA assay, and not a truly independent validation. Other large-scale yeast interaction studies (e.g., Yu et al, Science 2008) have assessed a random subset of observed PPIs using an orthogonal approach, calibrated using PRS and RRS sets examined via the same orthogonal method, from which overall performance of the dataset could be determined.

      -The Venn diagram in Figure 1G was not very informative in terms of assessing the quality of data. It looks like there is a relatively little overlap between PPIs identified in standard conditions (SD media) in the current study and those of the previous study using a very similar method. Is there any way to know how much of this disagreement can be attributed to each screen being sub-saturation (e.g. by comparing replica screens) and what fraction to systematic assay or environment differences?

      -In Figure S5C, the environment-specificity rate of PPIs might be inflated due to the fact that authors only test for the absence of SD hits in other conditions, and the SD condition is the only condition that has been sampled twice during the screening. What would be the environment-specific verification rate if sample hits from each environment were tested in all environments? This seems important, as robustly detecting environment-specific PPIs is one of the key points of the study.

      Minor issues

      -Re: "An interaction between the proteins reconstitutes mDHFR, providing resistance to the drug methotrexate and a growth advantage that is proportional to the PPI abundance" (pg 2). It may be more accurate to say "monotonically related" than "proportional" here. Fig 2 from the cited Freschi et al ref does suggests linearity with colony size over a wide range of inferred complex abundances, but non-linear at low complex abundance. Also note that Freschi measured colony area which is not linear with exponential growth rate nor with cell count. -Re: "Using putatively positive and negative reference sets, we empirically determined astatistical threshold for each environment with the best balance of precision and recall (positive predictive value (PPV) > 61% in SD media, Methods, section 6)." (pg 3). Should state the recall at this PPV.

      -Authors could discuss the extent to which related methods (e.g. PMID: 28650476, PMID: 27107012, PMID: 29165646, PMID: 30217970) would be potentially suitable for screening in different environments.

      • the term "mutable" is certainly appropriate according to the dictionary definition of changeable. The authors may wish to consider though, that in a molecular biology context the term evokes changeability by mutation (a very interesting but distinct topic). Maybe another term (environment-dependent interactions or ePPIs?) would be clearer. Of course this is the authors' call.

      -Some discussion is warranted about the phenomenon that a PPI that is unchanged in abundance could appear to change because of statistical significance thresholds that differ between screens. This would be a difficult question for any such study, and I don't think the authors need to solve it, but just to discuss.

      -More discussion would be helpful about the idea that immutability may to some extent favor interactions that PCA is better able to detect (possibly including membrane proteins?)

      -Re: "As might be expected, we also found that mutable hubs, but not non-hubs, are more likely to participate in multiple protein complexes than less mutable proteins." (pg 6) This is a cool result. To what extent was this result driven by members of one or two complexes? If so, it would worth noting them.

      -Re: "Borrowing a species richness estimator from ecology (Jari Oksanen et al., 2019), we estimate that there are ~10,840 true interactions within our search space across all environments, ~3-fold more than are detected in SD (note difference to Figure 3, which counts observed PPIs)." (pg 8) Should note that this only allows estimation of the number of interactions that are detectable by PCA methods. Previous work (Braun et al, 2019) showed that every known protein interaction assay (including PCA approaches) can only detect a fraction of bona fide interactions.

      -Re: "This analysis shows that the number of PPIs present across all environments is much larger than the number observed in a single condition, but that it is feasible to discover most of these new PPIs by sampling a limited number of conditions." (pg 8). The main point is surely correct, but it is worth noting that extrapolation to the number of true interactions depends on the nine chosen environments being representative of all environments. The situation could change under more extreme, e.g., anaerobic, conditions.

      -It stands to reason that proteins expressed in all conditions will yield less mutable interactions, if 'mutability' is primarily due to expression change at the transcriptional level. They should at least discuss that measuring mRNA levels could resolve questions about this. Could use Waern et al G3 2013 data (H202, SD, HU, NaCl) to predict the dynamic interactome purely by node removal, and see how conclusions would change

      -The analysis showing that many interactions are likely due to post-translational modifications is very interesting, but caveats should be discussed. Where heterodimers do not fit the expression-level dependence model, some cases of non-fitting may simply be due to measurement error or non-linearity in the relationship between abundance and fitness.

      -Line numbers would have been helpful to note more specific minor comments

      -Sequence data should be shared via the Short-Read Archive.

      Significance

      Knowledge of protein-protein interactions (PPIs) provides a key window on biological mechanism, and unbiased screens have informed global principles underlying cellular organization. Several genome-scale screens for direct (binary) interactions between yeast proteins have been carried out, and while each has provided a wealth of new hypotheses, each has been sub-saturation. Therefore, even given multiple genome-scale screens our knowledge of yeast interactions remains incomplete. Different assays are better suited to find different interactions, and it is now clear that every assay evaluated thus far is only capable (even in a saturated screen) of detecting a minority of true interactions. More relevant to the current study, no binary interaction screen has been carried out at the scale of millions of protein pairs outside of a single 'baseline' condition.

      The study by Liu et al is notable from a technology perspective in that it is one of several recombinant-barcode approaches have been developed to multiplex pairwise combinations of two barcoded libraries. Although other methods have been demonstrated at the scale of 1M protein pairs, this is the first study using such a technology at the scale of >1M pairs across multiple environments.

      A limitation is that this study is not genome-scale, and the search space is biased towards proteins for which interactions were previously observed in a particular environment. This is perhaps understandable, as it made the study more tractable, but this does add caveats to many of the conclusions drawn. These would be acceptable if clearly described and discussed. There were also questions about data quality and assessment that would need to be addressed.

      Assuming issues can be addressed, this is a timely study on an important topic, and will be of broad interest given the importance of protein interactions and the status of S. cerevisiae as a key testbed for systems biology.

      Reviewers' expertise: Interaction assays, next-generation sequencing, computational genomics. Less able to assess evolutionary biology aspects.

    1. Figure 4.

      Posted on behalf of Xiaofan Wei and Hongquan Zhang by JCB:

      Thanks for the comments. We were also confused about the conflicting results which may be caused by the different tagged constructs or different concentration of plasmids used for the transfection. However, we cannot repeat the observation that Smurf1 has obvious effects on Talin-head degradation even though we performed the experiments at many different conditions and using several cell lines. Although Dr. Huang et al. found that Smurf1 induced slightly reduced levels of Talin-H as shown in Nat Cell Biol. 2009 May;11(5):624-30, Fig. S6a, we tend to think that Talin-head is not a direct target of Smurf1. If Talin-head is a genuine target of Smurf1, it should be degraded to the same extent as Kindlin-2 is degraded by Smurf1. Thus, it needs further investigation to elucidate the mechanism of Talin-head degradation.

    1. But they’re also a call to action — a reminder that we should all put our ideas out into the world, no matter how zany they may be.

      This can be very much a wake up call for creators, like a lot of us plan to be. If you think your idea is too weird to work, just look as this guy. He might give you a new sense of motivation in pursuing and embracing the weird