6,070 Matching Annotations
  1. Feb 2021
    1. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      In this manuscript, the authors define the functional importance of ATF6b in the hippocampus. They show that ATF6b is highly expressed in the hippocampus relative to other tissues. They demonstrate that deletion or depletion of ATF6b in cultured hippocampal neurons enhances ER stress induced death. Similarly, Atf6b-/- mice show increased sensitivity to kainate induced neuronal death. These results reveal an important role for ATF6b in regulating hippocampal survival in response to pathologic insults. To define a molecular basis for this protection, the authors utilized RNAseq to identify the lectin chaperone calreticulin (Crt) as a gene whose expression is basally reduced in cultured hippocampal neurons where Atf6b is deleted. They show the re-overexpression of Atf6b (or Atf6a) both restore Crt levels in these neurons, underscoring the importance of Atf6 in regulating basal Crt levels. They go on to demonstrate that loss of Atf6b impairs ER stress-dependent increases in Crt, while minimally impacting other Atf6 target genes, again highlighting the importance of Atf6b for Crtregulation. Importantly, overexpression of Crt rescues the increased ER stress-induced toxicity observed in Atf6b knockout neurons, indicating that a primary mechanism by which Atf6b regulates neuronal survival in response to ER stress is through increased Crt expression. Consistent with this, mimicking the 50% reduction in Crt observed in Atf6b knockout neurons using Crt+/- mice showed similar sensitivity to kainate induced neuronal death. Collectively, these results describe an Atf6-Crt axis that is important for regulating neuronal survival in response to pathologic insults.

      Overall the experiments are interesting and provide new insights into the importance of Atf6b in neuronal survival. Notably, the evidence showing that loss of Atf6b increases hippocampal neuron sensitivity to ER stress and kainate induced toxicity are compelling. Any results describing the biological function of Atf6b are interesting, considering how little we know about this ER stress sensing protein. That being said, I have some concerns about the work described that require addressing before publication. Notably, I think more work needs to be done to define the molecular basis for the specific dependence of Crt expression on ATF6b in hippocampal neurons. Further, the authors need to do more experiments to demonstrate the specific importance of ATF6b signaling in the context of ER stress and in vivo neuronal death. I outline these various concerns below:

      Comment #1. The authors show that overexpression of either Atf6a or Atf6b both increase Crt expression in Atf6b knockout cells. While it is clear that deletion of Atf6a does not basally reduce Crt levels, the overexpression experiment does lead to a question as to how Atf6b can specifically be involved in regulating Crt expression. In the discussion, the authors seem to propose that homo- and hetero-dimerization of ATf6a and Atf6b are required for the basal expression of Crt and that Atf6b serves as a 'booster' of ER chaperone expression. They explicitly state that "Atf6a and Atf6b are required to induce CRT expression". However, it remains unclear to me why in this case would Atf6a deletion not impair Crt expression? The authors address this by invoking a mechanism whereby hippocampal neurons are more reliant on Atf6b for Crt expression, but this doesn't really make sense to me. Ultimately, this point underscores the lack of clear mechanistic basis to explain how Atf6b selectively regulates Crt in the hippocampus. This needs to be better resolved through more experimentation. For example, a ChIP experiment monitoring the binding of ATF6b and ATF6a to the Crt promoter in hippocampal and control cells would go a long way towards addressing this issue.

      Comment #2. The importance of ATF6b for protecting against insults needs to be better described. For example, the authors should show that overexpression of ATF6b protects against ER stress induced neuronal toxicity in cell culture and in vivo kainate induced neuronal toxicity. Similarly, the authors should evaluate how overexpression of ATF6a protects against these insults to better define the specific dependence of hippocampal neurons on ATF6b. The authors do show that overexpression of ATF6b can rescue the reduced Crt observed in Atf6b-deleted neurons, but the protection should similarly be demonstrated.

      Comment #3. Similar to #2, the authors should show that the potential for ATF6b (and ATF6a) overexpression to protect against different insults is impaired in Crt+/- neurons. The authors demonstrate that Crt-depletion increases sensitivity to toxic insults. This would go a long way to demonstrate the importance of the proposed ATF6b-CRT signaling axis in regulating neuronal survival in response to pathologic insults.

      Comment #4. When reporting the RNAseq data, the authors should use the q-value (i.e., FDR) instead of the p-value. This will likely affect the number of genes reported in Table 1, but it is the appropriate statistical test for this type of data.

      Significance

      This manuscript provides new context for understanding the functional relationship between Atf6a and the less-studied Atf6b in regulating neuronal survival. As with other studies focused on the relationship between these two ATF6 isoforms, this study demonstrates that these transcriptional programs integrate to coordinate a tissue-specific response to ER stress. Intriguingly, these studies indicate that ATF6b has a specific role in regulating the ER lectin chaperone CRT and that this ATF6b-CRT axis uniquely regulates neuronal survival in response to ER stress. While additional experiments are required to support this claim, the work described herein is a nice addition to our evolving understanding of the importance of ATF6b in regulating ER and cellular physiology during pathologic insults.

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      Summary

      Unfolded Protein Response (UPR) refers to homeostatic signaling pathways that play protective roles in various cell types. This work by Nguyen et al focuses on the UPR-mediator ATF6. In mammals, there are two isoforms of ATF6, alpha and beta. Nguyen et al show that the expression of the ATF6beta isoform is higher in hippocampal neurons whereas the ATF6alpha isoform is more evenly distributed across various neuronal subtypes. By performing gene expression profiling in mouse brain samples, they identify the ER chaperone calreticulin (CRT) as being significantly downregulated in ATF6beta null mutants. They further validate this observation by comparing hippocampi from ATF6alpha and ATF6beta null mice, where CRT is lowered in the latter but not the former. They identify and mutate putative ER stress response elements (ERSE) in the CRT promoter region to show that expression of CRT can be regulated by both ATF6alpha and beta. They demonstrate that treatment of hippocampal neurons with ER stress inducing chemicals leads to induction of CRT, which is suppressed in ATF6beta mutants. Such treatment also leads to cell death, which is exacerbated in ATF6beta mutants but rescued by ectopic expression of CRT. They also extend these observations to cell death induced by treatment with the glutamate receptor agonist, kainate, which was also exacerbated in ATF6beta mutants, but was rescued by counter treatment with ER stress inhibitors. Together, their data suggest a protective role for ATF6beta in hippocampal neurons in the context of ER stress.

      Major comments

      The primary advantage of this work is that much of it was done in vivo in mice, providing immediate context for the role of ATF6β under physiological conditions. They identify a specific region of the brain that requires ATF6beta. On the other hand, the ATF6-CRT signaling axis reported here had been established previously, and therefore, this study brings limited conceptual advances regarding the signaling mechanism itself (see Significance section below).

      Overall, the authors' data support their primary claim that ATF6β has a neuroprotective role in the context of ER stress. The data presented are clear and convincing, and their methods appear rigorous. The manuscript could be further improved if the authors could provide sufficient rationale for some of their experiments, which are discussed below.

      1. The post-translational processing of ATF6beta must be demonstrated in hippocampal neurons and not in HEK293T cells in Figure 1E. The authors conclude on Page 6, line 18 that "these results suggest that ATF6beta functions in neurons" but it is not obvious how expression in HEK293T cells contributes to this conclusion in any way.
      2. The hippocampal neurons are affected by the loss of ATF6β, even though the mice are not exposed to tunicamycin. Could the authors present evidence that there is physiological ER stress in hippocampal neurons? If not, why is ATF6beta required.
      3. In Figure 3, is there a specific reason why the authors do not mutate the ERSEs in the mouse CRT reporter, pCC1 and instead opt to analyze the huCRT reporter? Given that all the other observations in the manuscript are in mouse calreticulin, it is important to show that the ERSEs in the mouse calreticulin promoter are also regulated in an ATF6beta-dependent manner. Similar to the huCRT reporter, it is also crucial to examine if ATF6beta can regulate the mouse CRT promoter. This would provide an explanation for why calreticulin expression is not completely abolished in ATF6beta mutants.
      4. In Figure 5A and B, the density of Tubulin staining varies from panel to panel, and is much lower in ATF6beta mutants treated with Tg/Tm. Presumably this is because of cell death but this should be clarified in the main text. Additionally, it is unclear if the EthD-1 staining is nuclear localized. It would help if single channel images for Hoechst and EthD-1 were provided to visualize this.
      5. The literature reports that BAPTA-AM treatment itself could cause ER stress (e.g. PMID: 12531184). Here, the authors report the opposite effect. How could the authors reconcile the difference? The effects of BAPTA-AM and 2-APB must individually be examined in Figure 6C and not just in combination with Tm.
      6. The authors allude to "impairment of Ca2+ homeostasis in ATF6beta mutants" in Page 13 Line 2, but do not show any direct evidence in support of it. While treatment with BAPTA-AM and 2-APB is a start in that direction, it certainly does not demonstrate that under homeostatic conditions in vivo or in vitro there is any change in calcium flux in ATF6beta hippocampal neurons. To make the case that there is indeed perturbation of Ca2+ in ATF6beta mutant hippocampal neurons, the authors need to examine calcium flux and measure calcium indicators and how they are affected when ER stress is induced in these mutant cells.
      7. The effect of 2-APB and salubrinal alone on hippocampal neurons need to be examined in Figure 9B-D to eliminate the possibility that these drugs are not enhancing cell survival under normal conditions in a parallel manner.
      8. The rationale for the examination of Fos, Fosb and Bdnf is poorly described (page 14, line 13) and the conclusions from this line of experimentation are rather weak. The results from Figure 9 to some extent serve to confirm in vivo the data seen in Figure 6C but by no means provide a mechanism for why ATF6beta mutants have perturbed calcium homeostasis (page 14, line 22).

      Minor comments

      1. Page 8, line 3: Their rationale for why ATF6beta 5'UTR sequences are seen in their RNA seq data is not clearly explained. This must be rewritten for clarity.
      2. Page 8, line 5, the authors write that besides Atf6β , CRT was the only UPR-regulated gene downregulated in Atf6β mutant mice. The authors need to state how they defined "UPR-regulated genes". There must be a list, which the authors do not cite.
      3. Page 9, line 10: A reference is required for ERSEs.
      4. Page 10, line 6: The authors say "ATF6beta specifically induces CRT promoter activity". This is a confusing statement because "induction" is in response to stress, but the context here is homeostatic regulation since there is ostensibly no stress being induced. This distinction should be made and corrected here and throughout the manuscript.
      5. Page 10, line 16: The use of "latter" here is confusing and it would help to restructure this sentence for clarity.
      6. Figure 9A is missing Y-axis labels.

      Significance

      The authors summarize their major findings of the study (at the beginning of the Discussion) as ATF6β being required for CRT induction in the hippocampus, and that this ATF6β -CRT axis is important for the survival of hippocampal neurons. The idea that ATF6 induces CRT had been previously shown by others (PMID 9837962), and therefore, this is not the major new discovery of this study. In addition, the ATF6-calreticulin axis having a cell protective role had been reported in other biological contexts (e.g. PMID: 32905769), so that concept is also not a novel concept presented in this work. Similarly, the role of UPR in glutamate receptor agonist-induced neuronal cell death had been shown previously (the authors cite Kitao e tal., 2001; Sokka et al., 2007; Kezuka et al., 2016), so this link is not the major novel discovery revealed by this study. Instead, this study reports that ATF6β KO mice have specific phenotypes in hippocampal neurons, which had not been reported previously. Furthermore, this manuscript reports detailed information regarding Atf6β's downstream target genes in this tissue. In summary, this study's finding that ATF6 regulates CRT is confirmatory, rather than bringing new conceptual advances. The merit of this study is in the identification of the hippocampus as the organ that specifically requires ATF6beta. While the findings here may not appeal to a broader audience interested in UPR signaling mechanisms, it may draw interest from those who study hippocampal neuron physiology.

      For the editor's reference, this reviewer's field of expertise is in UPR signaling mechanisms in animal models

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      Nguyen and colleagues provide evidence that ATF6-beta selectively induces calreticulin expression in mouse hippocampal neurons to protect these neurons from ER stress-inducing toxins. This is a well-written and well-organized report that provides functional information about ATF6-beta, a poorly studied homolog of the ATF6-alpha Unfolded Protein Response regulator. The report suggests that ATF6-beta has a previously unknown and important function in helping brain neurons survive ER stress by regulating calreticulin.

      The study shows that addition of BAPTA, 2-APB, or salubrinal significantly improves neuronal survival in ATF6-/- explants and mice brains in response to ER toxins. But, prior study (PMID: 15705855) used salubrinal at much higher concentration 75uM with little effect at the 5uM dose used in the current study. Evidence should be provided that these drugs are specifically inhibiting ER stress or off-target mechanisms should be discussed in their experimental models.

      Minor comments:

      Fig 1 any male vs female mice differences in ATF6b expression?

      Fig 2C. Please show molecular weight markers on blots

      Fig 2C. what are the doublet bands on calnexin?

      Fig 3. what are the ERSE sequences? several different binding sites are reported in literature.

      p8. What is meant by 5' Atf6b lacks 10 and 11?

      Discussion: Please clarify if anti-ATF6-beta antibodies were available for these studies.

      Discussion: It is puzzling that ATF6a induces calreticulin more potently than ATF6b, but the calreticulin defect is selectively dependent on ATF6b. Could authors speculate on this paradox? It would be interesting to expand on differences between ATF6a and ATF6b function and phenotypes in Discussion in mouse and in people.

      Significance

      ATF6-beta is homolog of ATF6-alpha and assumed to function like ATF6-alpha. This report describes a selective function of ATF6-beta in inducing calreticulin in mouse neurons during ER stress. This suggests ATF6-beta has some different functions than ATF6-alpha in the mouse hippocampal neurons.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      RESPONSE TO REVIEWERS

      We thank Review Commons and its three reviewers. Reviewers 2 and 3 provide detailed comments, which we address individually. Reviewer 1, however, gives a general critique of how we have approached asking how genome architecture affects the extent of evolution and the details of evolutionary trajectories. Our interpretation of their comments is that our approach and the one that they advocate represent two philosophically different, but complementary, views about how to study evolution in the laboratory. We begin by discussing this difference and then proceed to a point by point response to the three reviews.

      Reviewer 1

      Philosophical differences with Reviewer 1

      We interpret Reviewer 1’s comments as endorsing a formal, quantitative study of evolution that aims to explain the factors that control the rate at which fitness increases during experimental evolution. This approach derives from classical population genetics and aims to use a mixture of theory and experiment to uncover general principles that would allow rates of evolution and evolutionary trajectories, expressed as population fitness over time, to be predicted from quantitative parameters, such population sizes, mutation rates, distributions of the fitness effects of mutations (including their degree of dominance in diploids), and global descriptions of either general (e.g. diminishing returns) or allele-specific epistasis.

      This approach aims to predict how the average fitness trajectory should be affected by variations in these parameters and describe the variation, at the level of fitness, in the outcomes in a set of parallel experiments. This is an important approach and have previously used it to investigate how the strength of selection influences the advantage of mutators (Thompson, Desai, & Murray, 2006) and to produce and test theory that predicts how mutation rate and population size control the rate of evolution (Desai, Fisher, & Murray, 2007). Like every approach to evolution, this one has limitations: 1) if it doesn’t identify mutations or investigate phenotype other than fitness, it cannot reveal the biological and biochemical basis of adaptation or report on how variations in population genetic parameters (population size, haploids versus diploids, etc.) influence which genes acquire adaptive mutations, and 2) if the details of experiments (e.g. whether populations are clonal or contain standing variation, or which phenotypes are being selected for) have strong effects on the population genetic parameters, these must be measured before theoretical or empirical relationships could be used to predict the mean and variance of fitness trajectories produced by a given selection. A variety of evidence suggests that the second limitation is real. Examples include the absence of a universal finding that diploid populations evolve more slowly than haploids (discussed on Lines 437-442), even within the same experimental organism, and the finding that diminishing returns epistasis applies well to domesticated yeast evolving in a variety of laboratory environments (e. g. papers from the Desai lab, starting with (Kryazhimskiy, Rice, Jerison, & Desai, 2014) but not to the evolutionary repair experiments that we have conducted (Fumasoni & Murray, 2020; Hsieh, Makrantoni, Robertson, Marston, & Murray, 2020; Laan, Koschwanez, & Murray, 2015).

      The second approach to experimental evolution, which we, as molecular geneticists and cell biologists, predominantly take, is to follow the molecular and cell biological details of how organisms adapt to selective pressure. We subject organisms to defined selective forces, identify candidate causative mutations, test them by reconstructing the evolved mutations, individually and in combination, and perform additional experiments to ask how these mutations are increasing fitness. Because these experiments are performed on model organisms and often address phenotypes that have been studied by classical and molecular genetics, we can often say a good deal about the cell biological and biochemical mechanisms that increase fitness and this work can complement and extend what we know from classical and molecular genetics.

      The current manuscript and its predecessor are examples of finding causative mutations and asking how they improve fitness, with the first paper (Fumasoni & Murray, 2020) demonstrating how mutations in three functional modules could overcome most of the fitness cost of removing an important but non-essential protein and the current paper asking how alterations in genome architecture and dynamics (diploidy and eliminating double-strand break-dependent recombination) affect the extent to which populations increase in fitness and which genes and functional modules acquire mutations as they do so.

      By definition, such experiments are anecdotal: they report on how particular genotypes and genome architectures respond to particular selection pressures. Any individual set of experiments can produce conclusions about the effects of variables, such a population size, mutation rate, and genome architecture, on the mutations that increased fitness in response to the specific selection, but they can do more than lead to speculation and inference about what would happen in other experiments: speculation from the results of a single project and inferences from the combined results of multiple projects. Our interpretation is that the evolutionary repair experiments that we have performed, which have perturbed budding, DNA replication, and the linkage between sister chromatids do indeed lead to a common set of inferences: most of the selected mutations reduce or eliminate the function of genes, the interactions between the selected mutations are primarily additive, and the mutations cluster in a few functional modules.

      We believe that the population and molecular genetic approaches to experimental evolution are complementary and that a full understanding of evolution will require combining both of them. We think this will be especially true as we try to use the findings from laboratory studies to improve our understanding of evolution outside the lab, which takes place over longer periods, in more temporally and spatially variable environments, and is subject to variation in multiple population genetic and biological parameters.

      Reviewer #1 (Evidence, reproducibility and clarity (Required)): In their previous work the authors examined adaptation in response to replication stress in haploid yeast, via experimental evolution of batch cultures followed by sequencing. Here they extend this approach to include diploid and recombination-deficient strains to explore the role of genome architecture in evolution under replication stress. On the whole, a common set of functional modules are found to evolve under all genetic architectures. The authors discuss the molecular details of adaptation and use their findings to speculate on the determinants of adaptation rate.

      **SECTION A - Evidence, reproducibility and clarity** Experimental evolution can reveal adaptive pathways, but there are some challenges when applying this approach to compare genetic backgrounds or environments. They key challenge is that adaptation potentially depends on both the rate of mutation and the nature of selection. Distinct adaptation patterns between groups could therefore reflect differential mutation, selection, or both. The authors allude to this dichotomy but have very limited data to address it. The closest effort is engineering putatively-adaptive variants into all genetic background including those where they did not arise; the fact that such variants remain beneficial suggests they did not arise in certain backgrounds because of a lower mutation rate, but this is a difficult issue to tackle quantitatively.

      We agree, wholeheartedly, that adaptation depends on the combination of mutation rates and the nature of selection and our goal was to ask how the molecular nature of adaptation depends on genome architecture when three different architectures are subjected to the same selection: constitutive replication stress caused by removing an important component of replisome. We used a haploid strain as a baseline and compared it to two other strains chosen to influence either the effect of mutations (a diploid, where fully recessive mutations that were beneficial in the haploid would become neutral) or the rate of mutations (a recombination-defective strain that would be unable to use ectopic recombination to amplify segments of the genome). In both cases, we expected to see effects that are closer to qualitative than quantitative: the absence of fully recessive mutations in evolved diploids and absence of segmental amplification in the recombination-deficient haploid. We see both effects and they then allow us to ask two other questions: 1) does influencing the effect of a class of mutation (diploids) or preventing a class of mutation (recombination defect) have a major effect on the rate of evolution, and 2) do these differences affect which modules adaptive mutations occur in. As far as we can tell, the answer is no to both questions. We use “as far as we can tell” because our experiments do have limitations. First, the recombination-defective strain has a higher point mutation rate making it impossible to tell how much this elevation, rather than any other factor, accounts for it showing a greater fitness increase than the recombination-proficient haploid. Unfortunately, to our knowledge, it’s impossible to abolish recombination without affecting mutation rates. Second, we only experimentally tested a subset of the inferred causative mutations meaning that for many genes, our assertion that they are adaptive is a statistical inference and their assignment to a particular functional module is based on prior literature rather than our own experiments. In response to this criticism, we have now rephrased some of our sentences (see below).

      From mutation accumulation experiments, where the influence of selection is minimized, there is evidence that genetic architecture affects the rate and spectrum of spontaneous mutations. In this experiment, the allele used to eliminate recombination, rad52, will also increase the mutation rate generally. The diploid strain is also likely to have a distinct mutational profile--as a null expectation diploids should have twice the mutation rate of haploids. Recent evidence indicates the mutation rate difference between haploid and diploid yeast might be less than two-fold, but that there are additional differences in the mutation spectrum, including rates of structural change. The context for this study is therefore three genetic architectures likely to differ in multiple dimensions of their mutation profiles, but mutation rates are not measured directly.

      The reviewer is correct that we did not explicitly measure mutation rates, although the frequency of synonymous mutations (Figure 3-S1B) is a proxy for the point mutation rate as long as the majority of these mutations are assumed to be neutral. By this measure, the mutation rates for ctf4∆ haploids and ct4∆/ctf4∆ diploids, expressed per haploid genome, are close to each other (1.94 for haploids and 1.37 for diploids) but different enough to return p = 0.044 by Welch’s test, whereas the mutation rate for the recombination-deficient, ctf4∆ rad52∆ haploid is 4 to 5-fold higher (7.03). In contrast, we can infer that the ctf4∆ rad52∆ strain has much lower rates of segmental aneuploidy produced by recombination: we see only one such event in this strain in contrast to 16 in the ctf4∆ haploid and 44 in the ctf4∆/ctf4∆ diploid (Supplementary table 4), even though the amplification of the cohesin loader gene, SCC2, confers similar benefits in all three strains.

      The nature of selection on haploids and diploids is expected to differ because of dominance, but ploidy-specific selection is also possible. The authors discuss how recessive beneficial alleles may be less available to diploids, though this can be offset by relatively rapid loss of heterozygosity. However, diploids should also incur more mutations, all else being equal. The rate of beneficial mutation, as opposed to the rate of mutation generally, will depend on the mutational "target size" of fitness, and the authors findings recapitulate other literature (particularly regarding "compensatory" adaptation) that points to faster adaptation in genotypes with lower starting fitness.

      We agree with the reviewer and tried to make the point that which mutations are fixed is primarily determined by the product of the rate at which they occur and the benefit which they confer (lines 193-196). Evidence in budding yeast suggests that in diploid cells, removing one copy of most genes fails to produce a measurable fitness benefit (Deutschbauer et al., 2005), suggesting that losing one copy of many genesis purely recessive. If this was always the case, it would be very hard for such heterozygous, loss-of-function mutations to contribute to evolution in diploids: a mutation that inactivates one copy of a gene would have to rise to high enough frequency by genetic drift that homozygosis of this mutation mitotic recombination would have a significant probability. Instead we find that heterozygous mutations in some genes (inactivation of RAD9, what are likely to be hypomorphic mutations in SLD5) but not others (inactivation of IXR1) confer benefits in diploids that allow their frequency to rise much more rapidly by selection than they would by drift, allowing them to reach frequencies at which mitotic recombination becomes probable.

      There is ample literature on the above topics, particularly discussions of the evolutionary advantages of haploidy versus diploidy. While adaptation to replication stress provides a novel starting point for this investigation, much of the manuscript is devoted to long-standing questions that are not specific to replication stress. Unfortunately, the data the authors collected is not sufficient to shed light on these questions, because mutation and selection cannot be effectively distinguished. The Discussion states that "We find that the genes that acquire adaptive mutations, the frequency at which they are mutated, and the frequency at which these mutations are selected all differ between architectures but that mutations that confer strong benefits always lie in the same three modules" (line 379), but it is not clear that these statements are all supported by the data.

      The reviewer makes two points: we fail to make a significant contribution to long-standing questions about the evolutionary genetics of adaptation and the we make statements that are not supported by our data. On the first we disagree: unlike much of the previous work which compares the effects of mutation rates and population sizes on the rates of evolution, we sequence genomes, identify putative causative mutations, verify that they increase fitness, and test, by reconstruction, how their contribution to fitness is affected by fully characterized genome architectures. We know of no comparable work and we believe that this is a useful contribution to understanding evolution. In addition, some of the literature, for example the discussion of haploidy versus diploidy, has failed to reach a universal conclusion. On the second point, we realized that the statement that the reviewer quotes is stronger than it should be since we do not show “that mutations that confer strong benefits always lie in the same three modules”. What we do show is that mutations in all three modules are found in all three genome architectures (Figure 5), and that combining one mutation from each module (using mutations in genes that are found in that architecture) can reproduce the observed fitness increase in each architecture (Figure 6 B), but the reviewer is correct that we have not demonstrated that every clone from every population has an adaptive mutation in all three modules. We have therefore modified the quoted sentence as follows (altered wording underlined)

      "We find that the genes that acquire adaptive mutations, the frequency at which they are mutated, and the frequency at which these mutations are selected all differ between architectures but that mutations conferring strong benefits can occur in all three modules in each architecture" (Lines 405-408)

      Focusing on the more novel aspect of their experiment-the presence of replication stress-would arguably be a better approach. On this topic the authors have some interesting observations and speculation, but clear predictions are lacking. The introduction section could be redesigned to explicitly state why genome architecture might affect adaptation in response to replication stress in particular, rather than (or in addition to) adaptation generally. If there were no differences in mutation, does the nature of Ctf4 lead to predictions that the molecular basis of compensatory adaptation should differ among genome architectures? Without such predictions it will be difficult for readers to know whether the observation that different genome architectures follow similar adaptive paths is surprising or not.

      We believe that following this suggestion would diminish the paper. We set out to ask how genome architecture affected adaptation to the strong fitness defect produced by removing an important component of an essential process, DNA replication. We chose replication stress as an example of cell biological damage that cells would have to repair with the hope that the results would give general clues about evolutionary repair, rather than hoping that the experiment would inform us about how replication stress altered the types of mutation (e. g. point mutations versus segmental amplification) that were selected As we point out at the beginning of our response, we recognize that the result of any one such experiment must be anecdotal and any attempt to generalize must be described as speculation if it refers only to this one experiment, or inference if it refers to this experiment and other published work. In those cases where we discuss the effect of genome architecture on evolutionary trajectories, we can draw conclusions that apply to our own experiments, but can only speculate on adaptation to different selections. In others, where we see commonalities between our experiments and previous work on evolutionary repair (cite Review), we can make inferences about evolution to adapt to removing important proteins and speculate about other forms of selection. We have revised the discussion to make it clear where we conclude, where we speculate, and where we infer. We suspect that our finding that genome architecture has a larger effect on which genes acquire adaptive mutations than it does on which modules these mutations alter will generalize to other evolutionary repair experiments and may be true even more broadly.

      We deliberately did not make predictions about the effect of genome architecture on the rate at which population fitness increased or the mechanism of adaptation to replication stress because we believed that our ignorance and the diverging results of previous experiments was sufficient to make both exercises worthless. After the fact, we interpret our results to suggest that mutations that reduce the activity of components, such as Sld5, that are stably associated with replication forks should be semi-dominant, but we were not nearly smart enough to make such a specific prediction before the experiment began!

      **Minor comments:** Shifts in ploidy from diploid to haploid are less common than the reverse change, so the observation of such a shift (Fig. 1) should be discussed in more detail.

      We now mention that haploids becoming diploids is more common than the reverse transformation and point out that genome sequencing reveals that these strains are true haploids rather than aneuploids.

      “One diploid population (EVO14) gave rise to a population with a haploid genome content, suggesting a possible haploidization event during evolution. Sequencing revealed no aneuploidies as a potential explanation of this phenomenon. While diploidization has been recurrently observed during experimental evolution with budding yeast (Aleeza C. Gerstein & Otto, 2011; Aleeza C Gerstein, Chun, Grant, & Otto, 2006; Harari, Ram, Rappoport, Hadany, & Kupiec, 2018; Venkataram et al., 2016), reports of spontaneous haploidization events have been instead scarce. Given the difficulties introduced by the change of ploidy over the 1000 generations, we have excluded EVO14 from all our analyses.” (Lines 122-128)

      We believe that the most likely mechanism is that the strain sporulated to produce haploids that were fitter than their diploid parent, but because this event occurred in only one out of eight populations and the proposed explanation is pure speculation we have not included in the revised manuscript.

      Line 88 typo 'stains'.

      Fixed. Thank you.

      Reviewer #1 (Significance (Required)): **SECTION B - Significance** The novel aspect of this study is the combination of replication stress and genome architecture, but here the significance is limited by a lack of clear predictions on how these factors might interact. On the other hand, much of the manuscript is devoted to why adaptation might vary among genome architectures in general, but this long-standing and important question is not particularly well resolved by this experimental approach, which can't disentangle mutation and selection.

      Our belief is that quantitatively predicting how selection will change fitness is nearly impossible because we lack the detailed knowledge of population genetic parameters that apply to our experiments. Prediction is even harder if the goal is to identify which genes will fix adaptive mutations and understand how these mutations alter cellular phenotypes to increase fitness. Thus our approach is almost entirely empirical: we do experiments that alter interesting variables, collect data, and do our best to interpret them and suggest how the conclusions of individual experiments might generalize.

      The authors highlight the dichotomy when discussing the evolution of ploidy: "We suggest that... genome architecture affects two aspects of the mutations that produce adaptation: the frequency at which they occur and the selective advantage they confer" (line 399), but presenting this as a novel inference does not appropriately acknowledge prior research and discussion of these ideas; several relevant papers are cited by the authors in other contexts. It may be possible to recast these findings as a test of the role of genome architecture in adaptation generally, but the authors should clarify the limitations of experimental evolution and more fully consider the theory and data outlined in previous research. In particular, few studies can claim to directly compare mutation rates between genome architectures, and it is not obvious that the present study is an example of such.

      We have the disadvantage that the reviewer doesn’t identify the literature we fail to cite. To us the argument the reviewer quotes is self-evident. As we mention above, our goal was not to test either general or detailed predictions and the level at which we analyzed our experiment, especially demonstrating that mutations were causal and reconstructing them individually and in combination, is missing from previous work. Finally measuring mutation rates is supremely difficult: you either need good ways of following all possible forms of mutation, quantitatively and without selection, or you resort to selecting mutations with a particular phenotype and molecularly characterizing them, knowing that these assays may well give different ratios of the rates of different types of mutation at different loci. We do make and report one measure of mutation rate, the rate of synonymous mutation in protein coding genes, which we discuss above.

      Reviewer expertise: Evoutionary genetics; experimental evolution; mutation.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)): **Summary** This manuscript investigates the effect of an organism's genotype (or, as the authors call it, an organism's 'genome architecture') on evolutionary trajectories. For this, the authors use Saccharomyces cerevisiae strains that experience some form of replication stress due to specific gene deletions, and that further differ in ploidy and/or the type of gene(s) deleted. They find the same three functional modules (DNA replication, DNA damage checkpoint, sister chromatid cohesion) are affected across the 3 different genotypes tested; although the specific genes that are mutated varies. **Major comments** This is a solid and exceptionally eloquent paper, comprising a large body of work that is in general well presented. That said, I do have some suggestions and questions. At several points in the manuscript, the authors should perhaps be more careful in their wording and avoid to overgeneralize data without providing additional evidence for these claims.

      We thank the reviewer for their constructive review and address their request for more careful wording below.

      • Some key points of the study are not entirely clear to me; possibly because the study builds upon a previous study that was recently published in eLife. Anyhow, I think it would be useful to clarify the following points a bit more:

        • Why exactly was ctf4∆ chosen as a model for replication stress? What is the evidence that ctf4∆ is a good model for replication stress? Without including some evidence for this, it is unclear how well the findings in this study really can be generalized to replication stress (which is what the authors do now).

      We described the reasons for choosing CTF4 deletion to mimic DNA replication stress in our previous eLife paper, to which we refer at. Nevertheless, the reviewer is right in asking us not to assume that the reader will have read our previous work. Briefly: DNA replication stress is a term that is loosely defined as the combination of the defects in DNA metabolism and the cellular response to these defects in cells whose replication has been substantially perturbed (Macheret & Halazonetis, 2015). Established methods in the field to induce DNA replication stress consist of either pharmacological treatments or genetic perturbation. Pharmacological treatments include hydroxyurea, which target the ribonucleotide reductase and hence stalls forks as a result of dNTP depletion (Crabbé et al., 2010), or aphidicolin, which directly inhibits polymerases α, ε and δ (Vesela, Chroma, Turi, & Mistrik, 2017b; Wilhelm et al., 2019). For genetic perturbation, the conditional depletion of replicative polymerases (Zheng, Zhang, Wu, Mieczkowski, & Petes, 2016) is frequently used. These methods are incompatible with experimental evolution, as cells can mutate the targets of replication inhibitors or alter the expression of genes that have been reduced in expression or activity. Removing an important but non-essential component of the replication machinery avoids these problems. We chose CTF4 deletion as a manipulation that affected the coordination of events at the replication fork: in the absence of Ctf4, the polα-primase complex is no longer physically bound to the replicative helicase, and thus the polymerase’s abundance at the replisome decreases (Tanaka et al., 2009). This manipulation achieves the same effects as polymerase depletion and replisome stalling, producing a constitutive DNA replication stress that can only be overcome by mutations in other genes. Multiple studies have shown that ctf4**D cells display replication intermediates commonly associated to DNA replication stress, such as the accumulation of ssDNA gaps and reversed forks (Abe et al., 2018; Fumasoni, Zwicky, Vanoli, Lopes, & Branzei, 2015), fork stalling (Fumasoni & Murray, 2020), checkpoint activation (Poli et al., 2012; Tanaka et al., 2009) and altered chromosome metabolism (Kouprina et al., 1992).

      We now justify our choice of deleting CTF4 at line 74:

      “DNA replication stress is often induced with drugs or by reducing the level of DNA polymerases (Crabbé et al., 2010; Vesela, Chroma, Turi, & Mistrik, 2017a; Wilhelm et al., 2019; Zheng et al., 2016). To avoid evolving drug resistance or increased polymerase expression, which would rapidly overcome DNA replication stress,** we deleted the CTF4 gene, which encodes a non-essential subunit of the DNA replication machinery (the replisome) (Kouprina NYu, Pashina, Nikolaishwili, Tsouladze, & Larionov, 1988). Ctf4 is a homo-trimer that functions as a structural hub within the replisome (Villa et al., 2016; Yuan et al., 2019) by binding to the replicative DNA helicase, primase (the enzyme that makes the RNA primers that initiate DNA replication), and other accessory factors (Gambus et al., 2009; Samora et al., 2016; Simon et al., 2014; Villa et al., 2016). In the absence of Ctf4, the Pol**a-primase and other lagging strand processing factors are poorly recruited to the replisome (Samora et al., 2016; Tanaka et al., 2009; Villa et al., 2016), causing several characteristic features of DNA replication stress, such as accumulation of single strand DNA (ssDNA) gaps (Abe et al., 2018; Fumasoni et al., 2015), reversed and stalled forks (Fumasoni & Murray, 2020; Fumasoni et al., 2015), cell cycle checkpoint activation (Poli et al., 2012; Tanaka et al., 2009) and altered chromosome metabolism (Hanna, Kroll, Lundblad, & Spencer, 2001; Kouprina et al., 1992). As a consequence of these defects, ctf4**D cells have substantially reduced reproductive fitness (Fumasoni & Murray, 2020).**”

      Would the authors expect to see similar routes of adaptation if a 'genomic architecture' with a less severe/other replication defect would have been used? I realize the last question is perhaps difficult to address without actually doing the experiment (which I am not suggesting the authors should do); I just want to point out that perhaps some data should not be over-generalized.

      We share the reviewer’s interest in asking whether different forms of DNA replication stress would lead to the same results described, and we plan to rigorously investigate this question in a separate paper. We note that the careful comparison between different forms of DNA replication stress has never been made and that authors studying this phenomenon often rely on a single perturbation to induce DNA replication stress (Crabbé et al., 2010; Wilhelm et al., 2019; Zheng et al., 2016). We agree that such a comparison will be useful, but we believe (as indicated by the reviewer) it will require an amount of work that goes beyond the scope of our study. To avoid over-generalization, we are using now using “a form of DNA replication stress” in lines 33, 244, 401, 414 and 461, to make it clear that our conclusions (as opposed to inferences and speculations) are restricted to the response to a single example of replication stress.

      Likewise, why was RAD52 selected as the gene to delete to affect homologous recombination? I understand that it is a key gene, but on the flipside, absence of RAD52 affects multiple cellular pathways and (as the authors also observe in their populations) also results in increased mutation rates which might confound some of the results.

      We aimed to observe the largest deficiency in DNA recombination possible and therefore chose to delete RAD52 because of its many roles in different forms of homologous recombination (Pâques & Haber, 1999) . The choice of other genes, such as RAD51, would have inhibited canonical double strand break (DSB) repair, but allowed other mechanisms that can rescue stalled replication forks (Ait Saada, Lambert, & Carr, 2018), such as break induced replication (BIR) or single strand annealing (SSA) (Ira & Haber, 2002).

      Our position regarding the inevitable increase in mutations rates obtained while working with genome maintenance process has been instead elaborated in response to reviewer #1 above.

      A sentence describing our choice to delete RAD52 has now been included at line 86:

      “…as well as from haploids impaired in homologous recombination due to the deletion of RAD52 (Figure 1A), which encodes a conserved enzyme required for pairing homologous DNA sequences during recombination (Pâques & Haber, 1999). Because Rad52 is involved in different forms of homologous recombination, it’s absence produces the most severe recombination defects and thus allows us to achieve the largest recombination defect achievable with a single gene deletion (Symington, 2002)..”

      Related to the first comment, it is also unclear to me how well the system chosen by the authors is representative of the replication stress experienced by tumor cells (as briefly touched upon in the final section of the discussion). Are some of the homologs key oncogenes that drive carcinogenesis?

      We should have been clearer. Our goal was to argue that the lesions and responses produced by replication stress in tumor cells, such as stalled replication forks and checkpoint activation, were similar to those seen in yeast cells lacking Ctf4. We did not mean to imply removing Ctf4 from yeast cells had the same effects on cell proliferation and survival as inactivating tumor suppressors and activating proto-oncogenes have in mammalian cells. Despite the difference between direct (removing Ctf4) and indirect effects on DNA replication (tumor cells), the replication intermediates (ssDNA, stalled and reversed forks), the cell cycle defects (G2/M delay), the genetic instability (increased mutagenesis and chromosome loss) and chromosome dynamics (late replication zones and chromosome bridges) generated by the absence of Ctf4 are similar to those observed in oncogene-induced DNA replication stress in mammalian cells (Kotsantis, Petermann, & Boulton, 2018). We therefore believe our experiments reveal evolutionary responses to a constitutive DNA replication stress that resembles the replication stress seen in cancer cells. Nevertheless, we agree that the comparison with cancer evolution remains speculative and we therefore avoided mentioning cancer in the title our paper or our conclusions, and only discuss it in a speculative section of the discussion.

      We have modified this section of the discussion as follows (line 554):

      “While generated through a different mechanism (unrestrained proliferation, rather than replisome perturbation), oncogene induced DNA replication stress produces cellular consequences (Kotsantis et al., 2018) which are remarkably similar to those seen in the absence of Ctf4, such as the accumulation of ssDNA, stalled and reversed forks (Abe et al., 2018; Fumasoni & Murray, 2020; Fumasoni et al., 2015), genetic instability (Fumasoni et al., 2015; Hanna et al., 2001; Kouprina et al., 1992) and DNA damage response activation (Poli et al., 2012; Tanaka et al., 2009). Based on these similarities we speculate that evolutionary adaptation to DNA replication stress could reduce its negative effects on cellular fitness and thus assist tumor evolution.”

      The authors should consider rephrasing some sentences regarding the occurrence of adaptive mutations. Sentences such as 'which genes are mutated depends on the selective advantage' (p1; lines 15-16); 'genome architecture controls the frequency at which mutations occur' (p15), "genome architecture controls which genes are mutated" (p1, line 20) makes it sound like the initial occurrence of mutations is not random, whereas in reality, the mutational landscape is the result of the combined effect of occurrence and fitness effect of the mutations, with the later rather than the former likely being the main driver behind the observed patterns.

      We thank the reviewer for asking for more precision in the above sentences, whose proposed changes we now list:

      “Mutations in individual genes are selected at different frequencies in different architectures, but the benefits these mutations confer are similar in all three architectures, and combinations of these mutations reproduce the fitness gains of evolved populations.” (Lines 13-15)

      “Genome architecture influences the distribution of adaptive mutants” (Line 277)

      "genome architecture influences the frequency at which mutations occur, the fitness benefit they confer, and the extent of overall adaptation." (Lines 462-463)

      Some important methodological information is missing or unclear in the manuscript:

      The authors should provide more details on how they decided which clones to select for sequencing. Did they select the biggest colonies; were colonies picked randomly, ...

      This following sentence is now reported in the materials and methods section (Line 603)

      “To capture the within-population genetic variability we selected the clones displaying the largest divergence of phenotypes in terms of resistance to genotoxic agents (methyl-methanesulfonate, hydroxyurea and camptothecin).”

      What is the population size during the evolution experiment?

      We now added the following sentence at line 599:

      “In this regime, the effective population size is calculated as N0 x g where N0 is the size of the population bottleneck at transfer and g is the number of generations achieved during a batch growth cycle and corresponds to approximately to 107 cells.”

      Sequencing of populations and clones: coverage should be mentioned

      The following sentence has now been added at line 616:

      “Clones and populations were sequenced at approximately the following depths: 25-30X for haploid clones, 50-60X for diploid clones, 50-60X for haploid populations and 120-130X for diploid populations.”

      Identification of mutations (p19, line 573): Is this really how the authors defined whether a variant is a mutation? Based on the definition given here, DNA mutations that lead to a synonymous mutation in the protein are not considered as mutations?

      We apologize for this typo. We do identify and consider synonymous mutations as evidenced by Figure 3-S1B. Now the sentence at line 626 correctly reports:

      “A variant that occurs between the ancestor and an evolved strain is labeled as a mutation if it either (1) causes a substitution in a coding sequence or (2) occurs in a regulatory region, defined as the 500 bp upstream and downstream of the coding sequence.”

      Perhaps the information can be found elsewhere, but the source data excel files for mutations is incomplete and should at the very least contain information on the type of mutation (eg. T->A), as well as the location of this mutation in the respective gene.

      Perhaps the reviewer is referring to Supplementary table 2, where we list the number of times a gene has been mutated in different populations (and thus summaries different types of mutations affecting the same gene). The information they request is reported in Supplementary table 1 for all the variants detected in populations and clones sequencing.

      **Minor comments** • While the author already cite several significant papers relevant for their manuscript, some other studies could also be included:

      We thank the reviewer for highlighting these references, which are now cited at line 28

      From the text in the abstract, it is unclear what the three genomic architectures (line 13) exactly are, the authors should consider spelling this out.

      In repose o the reviewer request for clarity we now propose the following change in line 13:

      “We asked how these trajectories depend on a population’s genome architecture by comparing the adaptation of haploids to that diploids and recombination deficient haploids.” (Lines 9-11)

      Can the authors speculate on why a homozygous ctf4D/ctf4D rad52D/rad52D would be lethal, and a haploid not?

      See below

      The authors note that a diploid ctf4D/ctf4D strain is less fit than its haploid counterpart. Why do the authors think this is the case?

      In response to the two previous questions, we now propose the following speculations that we include in the text (Line 97):

      “Diploid cells require twice as many forks as haploids and Ctf4-deficient diploids are thus more likely to have forks that cause severe cell-cycle delays or cell lethality. We speculate that this increased probability explains the more prominent fitness defect displayed by diploid cells. Interestingly, homologs of Ctf4 are absent in prokaryotes, where the primase is physically linked to the replicative helicase (Lu, Ratnakar, Mohanty, & Bastia, 1996) and Ctf4 is essential in the cells of eukaryotes with larger genomes such as chickens (Abe et al., 2018) and humans (Yoshizawa-Sugata & Masai, 2009). Rad52 is likely involved in rescuing stalled replication forks by recombination-dependent mechanisms (Fumasoni et al., 2015; Yeeles, Poli, Marians, & Pasero, 2013). We speculate that the absence of Rad52 increases the duration of these stalls and leads some of them to become double-stranded breaks resulting in cell lethality and explaining the decreased fitness of ctf4D rad52D haploid double mutants. In diploids ctf4D rad52D cells, which have twice as many chromosomes, the number of irreparably stalled fork may be sufficient to kill most of the cells in a population, thus explaining the unviability of the strain.”

      The authors passage their cells for 100 cycles and assume that this corresponds to around 1000 generations for each population. However, the fitness differences between the different starting strains (see also Figure 1B) are likely to cause considerable differences in number of generations between the different strains. Do the authors have more precise measurements of number of generations per population? If not, perhaps it should be noted that some lineages may have undergone more doublings than others, and perhaps also discuss if and how this could influence the results?

      In a batch culture regime, where populations are allowed to reach saturation after each dilution, the number of generations at each passage are dictated by the dilution factor (Van den Bergh, Swings, Fauvart, & Michiels, 2018). A dilution of 1:1000 from a saturated culture will allow for approximately 10 generations before populations reach a new saturated phase. As long as saturation is allowed to occur, this number is independent of the fitness of the cultured strains: Slower-dividing strains will simply employ more time to reach saturation after each dilution. At the beginning of the experiment, we had to dilute the ctf4D rad52**D strains being passaged every 48hrs instead of 24hrs. After generation 50, ctf4D rad52**D strains reached saturation within 24hrs and were then diluted daily. The total count considers the number of passages a culture has undergone, and not the number of days of culture, and thus should guarantee approximately the same number of generations in all three genome architectures.

      Panel A of figure 1A is somewhat confusing; as this seems to indicate that the ctf4∆ was introduced after strains were made, for example, haploid recombination deficient (which is not how these strains were constructed). Perhaps a better way of representing would be to have the indication of DNA replication stress pictured inside the yeast cells.

      We have modified Figure 1A to better represent the way the strains were constructed. For space reasons we have not represented a perturbed fork within each cell, but rather above all of them.

      Legend to Figure 1: is fitness expressed relative to haploid or diploid WT cells for the diploid strains?

      We apologize for having missed this detail in the figure legends. Throughout the figures, haploid and diploid cells were competed against reference strains with the same ploidy. We now add this sentence in Figure 1 and in the materials and methods (line 686).

      Figure 3: to improve readability of this figure, the authors could consider placing the legend of the different symbols (#, *,..) in the figure as well and not just in the figure legend.

      We now include the symbols legend in Figure 3.

      Figure 5 shows Indels, but if I am correct, these mutations are not discussed in the text; nor is it mentioned what the authors used as a cut-off to determine indels (the authors use the term 'small indels' without defining it)? For example, the data shown in Figure 3 and Figure 4 only includes SNPs and not indels (correct?) - but the indels should also be taken into account when investigating which modules are hit.

      Gapped alignments of the relatively long 150 paired-end reads in our data set permits the identification of small indels ranging in size from 1–55 bp using VarScan pileup2indels tool (Koboldt et al., 2012). All small indels (and the respective sequence affected) are listed together with SNPs in Supplementary table 1. Figure 3A, Figure 4 and Figure 5B are representation of ‘gene mutations’ which include both SNPs and small InDels. Large chromosomal Insertion and deletions, not detectable by short read gap alignment are instead identified using the VarScan pileup2copynumber tool (Koboldt et al., 2012), and are represented as amplifications or deletions in Figure 3B and 5C.

      The following sentence has been added to the material and methods at line 629:

      “Gapped alignments of the 150 paired-end reads in our data set permits the identification of small indels ranging in size from 1–55 bp using VarScan pileup2indels tool (Koboldt et al., 2012). All small indels (and the respective sequence affected) are listed together with SNPs in Supplementary table 1.”

      The following definition has been added in Figure legends 3A, 4 and 5A and B.

      “Gene mutations (SNPs and small InDels 1-55bp)”

      Figure 5 mentions: # gene mutations. So these are only the mutations in genes, and not in their up- or downstream regulatory regions?

      We use a broader definition of a gene, not restricted to the open reading frame, and including its regulatory regions. The following definition has been added to figure 5’s legend.

      “Frequency of SNPs and small InDels (1-55bp) affecting genes (Open reading frames and associated regulatory regions).”

      Figure 3-S1: labels of C panels are missing.

      Labels are now included in Figure 3-S1

      Figure 3-S1, panel B: why did the authors focus on synonymous mutations?

      The panel B is commented upon in line 186 and contrasted with panel A to argue that the increased number of mutations detected in ctf4∆ rad52∆ strains is due to a higher mutation rate(which is expected to increase synonymous mutations) instead of an higher number of adaptive mutations (which are less likely to be synonymous) being selected.

      Reviewer #2 (Significance (Required)): This is a solid and clearly written study, comprising a large body of work that is generally well presented and that will be of interest to scientists active in the field of (experimental) evolution and replication. However, many aspects studied in this manuscript have already been studied and reported before; including the recent eLife paper by the same group, as well as studies by other labs that have investigated how genome architecture / genotype affects evolutionary trajectories, the effect of ploidy on evolution, .... Because of this, I do feel that the authors should put their findings more in the context of existing literature context, including a general description of which results are truly novel, which confirm previous findings and which results seem to go against previous reports. This is already so at some points in the text, but I feel this could be done even more.

      We now rephrase the following paragraphs in our discussion to better highlight the main conclusions in contrast to the existing literature:

      “Engineering one mutation in each module into an ancestral strain lacking Ctf4 is enough to produce the evolved fitness increase in all three genomic architectures. Furthermore, engineering mutations in individual genes confer benefits in all three architectures (Fig. 6A) ,even in those where the mutations in these genes was rare, and combining these mutations recapitulated the evolved fitness increase in all three architectures (Fig. 6B). Altogether our results demonstrate the existence of a common pathway for yeast cells to adapt to a form of constitutive DNA replication stress.” (Lines 409-414)

      “Our results thus go against the trend of slower adaptation in diploids as compared to haploids reported by the majority other studies (A. C. Gerstein, Cleathero, Mandegar, & Otto, 2011; Marad, Buskirk, & Lang, 2018; Zeyl, Vanderford, & Carter, 2003). This effect is not limited to populations experiencing DNA replication stress (Figure 2A) but is also present in control wild-type populations (Figure 2B). Our results support the idea that the details of genotypes, selections, and experimental protocols can determine the effect of ploidy on adaptation.” (Lines 437-442)

      “Our results therefore agree with previous reports observing declining adaptability across strains with different initial fitness but largely fail to observe diminishing return epistasis as a potential justification of this phenomenon. Our experiments and two previous evolutionary repair experiments (Hsieh et al., 2020; Laan et al., 2015) both show interactions that are approximately additive between different selected mutations. The reasons for this difference are currently unknown.” (Lines 450-455)

      Additionally, I think the authors should be more careful not to over-generalize their findings, which come from only a few specific genetic manipulations that might not be representative for general replication stress. For example (p15), can the authors really claim that they have unraveled general principles of adaptation to constitutive DNA replication stress? Perhaps a better motivation of the choice of ctf4 as a model mutation for DNA replication stress could also help (see also my earlier comments). A similar comment applies to the molecular mechanisms affecting adaptation in diploid cells - what evidence do the authors have that their findings are not specific to the one specific type of diploid strain they used in their study? Adding a bit more background information or nuance for some of the claims would help tackle this issue.

      We now followed the suggestions made previously by the reviewer to justify our experimental choices better and to use a language that avoids over-generalizations.

      Field of expertise of this reviewer: genetics, evolution, genomics

      Reviewer #3 (Evidence, reproducibility and clarity (Required)): **Summary:** Here the authors carry out an evolution experiment, propagating replicate populations of the budding yeast with the CTF 4 gene deleted in three different genetic backgrounds: haploid , diploid and recombination deficient (RAD52 deletion). The authors find that the rate of evolution depends on the initial fitness of the different genetic backgrounds which is consistent with a repeated finding of evolution experiments: that beneficial mutations tend to have a smaller fitness effect in high fitness genetic backgrounds. Curiously even though the targets of selection tended to be specific to each of the three different genetic backgrounds, genetic reconstruction experiments showed beneficial mutations convert a fitness increase in all genetics backgrounds. The authors go on to provide a plausible explanation for why each of the three genetic backgrounds are predisposed to certain types of beneficial mutations. Overall, these results provide important context and caveats for an emerging consensus that genetic background determines the rate of evolution, a comprehensive molecular breakdown of adaptation to DNA replication stress and a mechanistic explanation for why different beneficial mutations are favoured in diploids, haploids and recombination deficient strains. This is a well-executed study that is beautifully presented and easy to follow. This will be of great interest to those in the experimental evolution community and the data an excellent resource.

      We thank reviewer #3 for emphasizing that reconstructed mutations are beneficial even in architectures where they were not ultimately detected at the end of the experiment. We have now highlighted this point in our conclusions as a response to the reviewer’s #1 and #2 request for more clarity regarding our novel findings.

      “We find that the genes that acquire adaptive mutations, the frequency at which they are mutated, and the frequency at which these mutations are selected all differ between architectures but that mutations that confer strong benefits can occur in all three modules in each architecture. Engineering one mutation in each module into an ancestral strain lacking Ctf4 is enough to produce the evolved fitness increase in all three genomic architectures. Furthermore, reconstruction of a panel of mutations into all three architectures proved they are adaptive even in architectures where the affected genes were not found significantly mutated by the end of the experiment. Altogether our results demonstrate the existence of a common pathway for yeast cells to adapt to a form of constitutive DNA replication stress.” (Lines 405-414)

      **Major comments:**

      • Are the key conclusions convincing? Yes, the convergent evolution analysis, fitness assays, and genetic reconstructions are sufficient to characterise the genetic causes of adaptation in this experiment, and are of the highest standard. The authors do particularly well to fully recover the fitness increases that evolved with their genetic reconstructions, which imparts a completeness to their understanding of what happened in their evolution experiment.
      • Should the authors qualify some of their claims as preliminary or speculative, or remove them altogether? No, in nearly all cases the authors make reasonable claims. One exception is on L419 in the discussion, where the authors speculate why some mutations do not follow diminishing returns epistasis, but this idea does not really have any basis (no citation or reasons to suggest that DNA repair genes are less connected with other genes in the genome). If the authors cannot support this statement, it should be removed, and instead write that is currently unknown why some individual mutations do not follow the pattern of diminishing returns.

      On reflection, we agree with the reviewer and now state,

      “Our results confirm previous reports observing declining adaptability across strains with different initial fitness but largely fail to observe diminishing return epistasis as a potential justification of this phenomenon. Our experiments and two previous evolutionary repair experiments (Hsieh et al., 2020; Laan et al., 2015) both show interactions that are approximately additive between different selected mutations. The reasons for this difference are currently unknown.

      A hypothesis, which would need experimental validation, could be that the different mutations have different degrees of epistatic interactions with the rest of the genome. Ixr1, whose mutation follows diminishing return epistasis, is a transcription factor that could in principle affect the expression of many other genes implicated in different cellular modules. Sld5, Scc2 and Rad9 instead, whose mutations have the same effect across different genome architectures, having more mechanistic roles in genome maintenance may have strong epistatic interactions only with a restricted number of cellular modules implicated with DNA metabolism.

      • Would additional experiments be essential to support the claims of the paper? No.
        • Are the data and the methods presented in such a way that they can be reproduced? Yes, but some more details are needed for the convergent evolution analysis, see minor comments.
        • Are the experiments adequately replicated and statistical analysis adequate? Yes, but some more statistic reporting in the main text or figure legends would be helpful, for example. L159: Please report the statistical test, test statistic and p value in the text or in the figure legend. Currently significance is indicated, but the methods do not specify the test.

      We apologize for the lack of clarity in the main text. The test used for all fitness analysis was only reported in the materials and methods as follow:

      “The P-values reported in figures are the result of t-tests assuming unequal variances (Welch’s test)”

      We now include the test and the associated p-value in line 184, and write the above sentence in all the relevant figures.

      This should also be done for the GO analysis shown in figure 3A.

      We thank reviewer #3 pointing out this omission. We now include the following section:

      “Gene ontology (GO) enrichment analysis:

      The list of genes with putatively selected mutations (Figure 3A) or homozygous mutations in diploids (Figure 4) were input as ‘multiple proteins’ in the STRING database, which reports on the network of interactions between the input genes (https://string-db.org). The GO term enrichment analysis provided by STRING are reported in Supplementary Table 3 and Supplementary Table 6 respectively. Briefly, the strength of the enrichment is calculated as Log10(O/E), where O is the number of ‘observed’ genes in the provided list (of length N) which belong to the GO-term, and E is the number of ‘expected’ genes we would expect to find matching the GO-term providing a list of the same length N made of randomly picked genes. P-values are computed using a Hypergeometric test and corrected for multiple testing using the Benjamini-Hochberg procedure. The resulting P-values are represented as ‘False discovery rate’ in the supplementary tables and describe the significance of the GO terms enrichment (Franceschini et al., 2013).”

      **Minor comments:**

      • Specific experimental issues that are easily addressable. Not a new experiment, but extra details are required. The authors carried out both clone and whole population sequencing. For their convergent evolution analysis, what is the criteria for a mutation to be included- ie, does it need to be fixed, have attained a certain frequency? This is important- if the criteria were low (say 5%), it would be important to know whether gene A had fixed in 4 populations, while gene B had attained a frequency of 10% in 5 populations. As it stands both would be described as examples of convergent evolution. This can be handled by providing these details in the methods.

      For the population sequencing we disregarded variants found at less than 25% and 35% of the reads in haploid and diploid populations respectively as we observed they were largely the product of alignment errors. All the variants found at frequencies higher than the thresholds indicated were used for the parallel evolution analysis. The frequency at which each individual variant was detected in each population is reported in Supplementary table 1, while the average frequency at which a gene has been found mutated across different populations is reported in Supplementary table 2. The reason why we didn’t solely focus on fixed mutations for our convergent evolution analysis was that from previous work we knew of the existence of clonal interference which kept the frequency of verified adaptive mutations that coexisted in the same population (e.g. ixr1 and sld5) well below 90% (Fumasoni & Murray, 2020).

      For clarity we now add the following sentence in the material and methods:

      “Variants found in less than 25% and 35% of the reads in haploid and diploid populations respectively were discarded, since many of these corresponded to misalignment of repeated regions. For clone sequencing, only variants found in more than 75% of the reads in haploids and 35% of the reads in diploids (to account for heterozygosity) were considered mutations. The frequency of the reads associated with all the variants detected are reported in Supplementary table 1”

      • Are prior studies referenced appropriately? I note that the authors use the term declining adaptability where as other papers use the term diminishing returns epistasis- I am sure the authors have good reasons for their choice of nomenclature but I think it would be helpful for their readers to connect this work to other work by mentioning that declining adaptability is also referred to as diminishing returns.

      We use both terms (for instance in line 446 and line 448) with a different meaning : By ‘declining adaptability’ we refer the phenomenon where more fit strains display lower adaptation rates than less fit ones. By ‘diminishing returns epistasis’ we refer to a possible explanation of such a phenomenon, where adaptive mutations have different fitness effects due to their ‘global’ epistatic interactions with other alleles. It has to be noted that ‘diminishing returns epistasis’ is not the only proposed explanation of the phenomenon of declining adaptability (Couce & Tenaillon, 2015). In our case, we do find evidence of declining adaptability but very limited evidence for diminishing return epistasis (only 1 mutation in 5 has a different fitness effect in different architectures).

      A reference the authors have missed: L419, as well as citing the Desai Lab bioxive paper, they should cite another theory paper that obtained similar conclusions. Lyons, D.M., et al. https://doi.org/10.1038/s41559-020-01286-y.

      We thank the reviewer for the suggested reference, which is now cited at line 450.

      • Are the text and figures clear and accurate? This paper is beautifully written and easy to follow, a lot of thought has gone into the figures which are aesthetically pleasing and easy to navigate.

        • Do you have suggestions that would help the authors improve the presentation of their data and conclusions? No.

        **Typos**

        L32 "do" should be "to" L95 analyzed L219 are the authors referring to ref 15 here? I think so, but please specify

      We thank the reviewer for carefully finding the typos, which are now all corrected.

      Reviewer #3 (Significance (Required)):

      • Describe the nature and significance of the advance (e.g. conceptual, technical, clinical) for the field. This paper is an important conceptual result and an immediate advance for basic research. The authors have done an outstanding job of showing the potential for the clinical translation of this research, especially regarding cancer biology.
      • Place the work in the context of the existing literature (provide references, where appropriate). This study follows up on and builds upon an earlier paper by these same authors published in E-life in 2020. Conceptually this work is most closely related to work in Michael Desai's, Sergey Kryazhimskiy's, Tim Coopers and Chris Marx's labs work looking at diminishing returns epistasis in yeast, and studies contrasting evolution of haploids and diploids led by Greg Lang's and Sarah Otto's labs.
      • State what audience might be interested in and influenced by the reported findings. This work will be of great interest to the Experimental evolution and molecular evolution communities and also of interest to those who study cancer genomics and DNA replication and repair.
      • Define your field of expertise with a few keywords to help the authors contextualize your point of view. Indicate if there are any parts of the paper that you do not have sufficient expertise to evaluate. Microbial experimental evolution.

      REFERENCES CITED IN THE REVIEW RESPONSE

      Abe, T., Kawasumi, R., Giannattasio, M., Dusi, S., Yoshimoto, Y., Miyata, K., … Branzei, D. (2018). AND-1 fork protection function prevents fork resection and is essential for proliferation. Nature Communications, 9(1), 3091. https://doi.org/10.1038/s41467-018-05586-7

      Ait Saada, A., Lambert, S. A. E., & Carr, A. M. (2018, November 1). Preserving replication fork integrity and competence via the homologous recombination pathway. DNA Repair. Elsevier B.V. https://doi.org/10.1016/j.dnarep.2018.08.017

      Couce, A., & Tenaillon, O. A. (2015). The rule of declining adaptability in microbial evolution experiments. Frontiers in Genetics, 6(MAR), 99. https://doi.org/10.3389/fgene.2015.00099

      Crabbé, L., Thomas, A., Pantesco, V., De Vos, J., Pasero, P., & Lengronne, A. (2010). Analysis of replication profiles reveals key role of RFC-Ctf18 in yeast replication stress response. Nature Structural & Molecular Biology, 17(11), 1391–1397. https://doi.org/10.1038/nsmb.1932

      Desai, M. M., Fisher, D. S., & Murray, A. W. (2007). The speed of evolution and maintenance of variation in asexual populations. Current Biology : CB, 17(5), 385–394. https://doi.org/10.1016/j.cub.2007.01.072

      Deutschbauer, A. M., Jaramillo, D. F., Proctor, M., Kumm, J., Hillenmeyer, M. E., Davis, R. W., … Giaever, G. (2005). Mechanisms of Haploinsufficiency Revealed by Genome-Wide Profiling in Yeast. Genetics, 169(4), 1915–1925. https://doi.org/10.1534/GENETICS.104.036871

      Franceschini, A., Szklarczyk, D., Frankild, S., Kuhn, M., Simonovic, M., Roth, A., … Jensen, L. J. (2013). STRING v9.1: Protein-protein interaction networks, with increased coverage and integration. Nucleic Acids Research, 41(D1), D808. https://doi.org/10.1093/nar/gks1094

      Fumasoni, M., & Murray, A. W. (2020). The evolutionary plasticity of chromosome metabolism allows adaptation to constitutive DNA replication stress. ELife, 9. https://doi.org/10.7554/eLife.51963

      Fumasoni, M., Zwicky, K., Vanoli, F., Lopes, M., & Branzei, D. (2015). Error-Free DNA Damage Tolerance and Sister Chromatid Proximity during DNA Replication Rely on the Polα/Primase/Ctf4 Complex. Molecular Cell, 57(5), 812–823. https://doi.org/10.1016/j.molcel.2014.12.038

      Gambus, A., van Deursen, F., Polychronopoulos, D., Foltman, M., Jones, R. C., Edmondson, R. D., … Labib, K. (2009). A key role for Ctf4 in coupling the MCM2-7 helicase to DNA polymerase alpha within the eukaryotic replisome. EMBO J., 28(19), 2992–3004. https://doi.org/10.1038/emboj.2009.226

      Gerstein, A. C., Cleathero, L. A., Mandegar, M. A., & Otto, S. P. (2011). Haploids adapt faster than diploids across a range of environments. Journal of Evolutionary Biology, 24(3), 531–540. https://doi.org/10.1111/j.1420-9101.2010.02188.x

      Gerstein, Aleeza C., & Otto, S. P. (2011). Cryptic fitness advantage: Diploids invade haploid populations despite lacking any apparent advantage as measured by standard fitness assays. PLoS ONE, 6(12), 26599. https://doi.org/10.1371/journal.pone.0026599

      Gerstein, Aleeza C, Chun, H.-J. E., Grant, A., & Otto, S. P. (2006). Genomic Convergence toward Diploidy in Saccharomyces cerevisiae. PLoS Genetics, 2(9), e145. https://doi.org/10.1371/journal.pgen.0020145

      Hanna, J. S., Kroll, E. S., Lundblad, V., & Spencer, F. a. (2001). Saccharomyces cerevisiae CTF18 and CTF4 are required for sister chromatid cohesion. Mol Cell Biol., 21(9), 3144–3158. https://doi.org/10.1128/MCB.21.9.3144-3158.2001

      Harari, Y., Ram, Y., Rappoport, N., Hadany, L., & Kupiec, M. (2018). Spontaneous Changes in Ploidy Are Common in Yeast. Current Biology, 28(6), 825-835.e4. https://doi.org/10.1016/j.cub.2018.01.062

      Hsieh, Y. Y. P., Makrantoni, V., Robertson, D., Marston, A. L., & Murray, A. W. (2020). Evolutionary repair: Changes in multiple functional modules allow meiotic cohesin to support mitosis. PLoS Biology, 18(3), e3000635. https://doi.org/10.1371/journal.pbio.3000635

      Ira, G., & Haber, J. E. (2002). Characterization of RAD51-independent break-induced replication that acts preferentially with short homologous sequences. Molecular and Cellular Biology, 22(18), 6384–6392. Retrieved from http://www.ncbi.nlm.nih.gov/pubmed/12192038

      Koboldt, D. C., Zhang, Q., Larson, D. E., Shen, D., McLellan, M. D., Lin, L., … Wilson, R. K. (2012). VarScan 2: somatic mutation and copy number alteration discovery in cancer by exome sequencing. Genome Research, 22(3), 568–576. https://doi.org/10.1101/gr.129684.111

      Kotsantis, P., Petermann, E., & Boulton, S. J. (2018, May 1). Mechanisms of oncogene-induced replication stress: Jigsaw falling into place. Cancer Discovery. American Association for Cancer Research Inc. https://doi.org/10.1158/2159-8290.CD-17-1461

      Kouprina, N., Kroll, E., Bannikov, V., Bliskovsky, V., Gizatullin, R., Kirillov, A., … et al. (1992). CTF4 (CHL15) mutants exhibit defective DNA metabolism in the yeast Saccharomyces cerevisiae. Mol Cell Biol., 12(12), 5736–5747. Retrieved from http://www.ncbi.nlm.nih.gov/pubmed/1341195

      Kouprina NYu, Pashina, O. B., Nikolaishwili, N. T., Tsouladze, A. M., & Larionov, V. L. (1988). Genetic control of chromosome stability in the yeast Saccharomyces cerevisiae. Yeast (Chichester, England), 4(4), 257–269. https://doi.org/10.1002/yea.320040404

      Kryazhimskiy, S., Rice, D. P., Jerison, E. R., & Desai, M. M. (2014). Microbial evolution. Global epistasis makes adaptation predictable despite sequence-level stochasticity. Science (New York, N.Y.), 344(6191), 1519–1522. https://doi.org/10.1126/science.1250939

      Laan, L., Koschwanez, J. H., & Murray, A. W. (2015). Evolutionary adaptation after crippling cell polarization follows reproducible trajectories. ELife, 4, e09638. https://doi.org/10.7554/eLife.09638

      Lu, Y. B., Ratnakar, P. V, Mohanty, B. K., & Bastia, D. (1996). Direct physical interaction between DnaG primase and DnaB helicase of Escherichia coli is necessary for optimal synthesis of primer RNA. Proc. Natl. Acad. Sci. USA, 93(23), 12902–12907. https://doi.org/10.1073/pnas.93.23.12902

      Macheret, M., & Halazonetis, T. D. (2015). DNA replication stress as a hallmark of cancer. Annu. Rev. Pathol. Mech. Dis., 10, 425–448. https://doi.org/10.1146/annurev-pathol-012414-040424

      Marad, D. A., Buskirk, S. W., & Lang, G. I. (2018). Altered access to beneficial mutations slows adaptation and biases fixed mutations in diploids. Nature Ecology & Evolution, 2(5), 882–889. https://doi.org/10.1038/s41559-018-0503-9

      Pâques, F., & Haber, J. E. (1999). Multiple pathways of recombination induced by double-strand breaks in Saccharomyces cerevisiae. Microbiology and Molecular Biology Reviews : MMBR, 63(2), 349–404. https://doi.org/

      Poli, J., Tsaponina, O., Crabbé, L., Keszthelyi, A., Pantesco, V., Chabes, A., … Rothstein, R. (2012). dNTP pools determine fork progression and origin usage under replication stress. EMBO J., 31(4), 883–894. https://doi.org/10.1038/emboj.2011.470

      Samora, C. P., Saksouk, J., Goswami, P., Wade, B. O., Singleton, M. R., Bates, P. A., … Masai, H. (2016). Ctf4 Links DNA Replication with Sister Chromatid Cohesion Establishment by Recruiting the Chl1 Helicase to the Replisome. Molecular Cell, 63(3), 371–384. https://doi.org/10.1016/j.molcel.2016.05.036

      Simon, A. C., Zhou, J. C., Perera, R. L., van Deursen, F., Evrin, C., Ivanova, M. E., … Pellegrini, L. (2014). A Ctf4 trimer couples the CMG helicase to DNA polymerase alpha in the eukaryotic replisome. Nature, 510(7504), 293–297. https://doi.org/10.1038/nature13234

      Symington, L. S. (2002). Role of RAD52 Epistasis Group Genes in Homologous Recombination and Double-Strand Break Repair. Microbiology and Molecular Biology Reviews, 66(4), 630–670. https://doi.org/10.1128/mmbr.66.4.630-670.2002

      Tanaka, H., Katou, Y., Yagura, M., Saitoh, K., Itoh, T., Araki, H., … Shirahige, K. (2009). Ctf4 coordinates the progression of helicase and DNA polymerase alpha. Genes to Cells, 14(7), 807–820. https://doi.org/10.1111/j.1365-2443.2009.01310.x

      Thompson, D. A., Desai, M. M., & Murray, A. W. (2006). Ploidy controls the success of mutators and nature of mutations during budding yeast evolution. Current Biology : CB, 16(16), 1581–1590. https://doi.org/10.1016/j.cub.2006.06.070

      Van den Bergh, B., Swings, T., Fauvart, M., & Michiels, J. (2018). Experimental Design, Population Dynamics, and Diversity in Microbial Experimental Evolution. Microbiol Mol Biol Rev., 82(3), e00008-18. https://doi.org/10.1128/MMBR.00008-18

      Venkataram, S., Dunn, B., Li, Y., Agarwala, A., Chang, J., Ebel, E. R., … Petrov, D. A. (2016). Development of a Comprehensive Genotype-to-Fitness Map of Adaptation-Driving Mutations in Yeast. Cell, 166(6), 1585-1596.e22. https://doi.org/10.1016/J.CELL.2016.08.002

      Vesela, E., Chroma, K., Turi, Z., & Mistrik, M. (2017a). Common Chemical Inductors of Replication Stress: Focus on Cell‐Based Studies. Biomolecules, 7(1), 19. https://doi.org/10.3390/biom7010019

      Vesela, E., Chroma, K., Turi, Z., & Mistrik, M. (2017b, February 21). Common chemical inductors of replication stress: Focus on cell-based studies. Biomolecules. MDPI AG. https://doi.org/10.3390/biom7010019

      Villa, F., Simon, A. C., Ortiz Bazan, M. A., Kilkenny, M. L., Wirthensohn, D., Wightman, M., … Dutta, A. (2016). Ctf4 Is a Hub in the Eukaryotic Replisome that Links Multiple CIP-Box Proteins to the CMG Helicase. Molecular Cell, 63(3), 385–396. https://doi.org/10.1016/j.molcel.2016.06.009

      Wilhelm, T., Olziersky, A. M., Harry, D., De Sousa, F., Vassal, H., Eskat, A., & Meraldi, P. (2019). Mild replication stress causes chromosome mis-segregation via premature centriole disengagement. Nature Communications, 10(1), 1–14. https://doi.org/10.1038/s41467-019-11584-0

      Yeeles, J. T., Poli, J., Marians, K. J., & Pasero, P. (2013). Rescuing stalled or damaged replication forks. Cold Spring Harbor Perspectives in Biology, 5(5), a012815. https://doi.org/10.1101/cshperspect.a012815

      Yoshizawa-Sugata, N., & Masai, H. (2009). Roles of human AND-1 in chromosome transactions in S phase. J Biol Chem., 284(31), 20718–20728. https://doi.org/10.1074/jbc.M806711200

      Yuan, Z., Georgescu, R., Santos, R. de L. A., Zhang, D., Bai, L., Yao, N. Y., … Li, H. (2019). Ctf4 organizes sister replisomes and Pol α into a replication factory. ELife, 8, e47405. https://doi.org/10.7554/eLife.47405

      Zeyl, C., Vanderford, T., & Carter, M. (2003). An Evolutionary Advantage of Haploidy in Large Yeast Populations. Science, 299(5606), 555–558. https://doi.org/10.1126/SCIENCE.1078417

      Zheng, D.-Q., Zhang, K., Wu, X.-C., Mieczkowski, P. A., & Petes, T. D. (2016). Global analysis of genomic instability caused by DNA replication stress in Saccharomyces cerevisiae. Proc Natl Acad Sci U S A., 113(50), E8114–E8121. https://doi.org/10.1073/pnas.1618129113

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #4

      This reviewer did not leave any comments

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      Summary:

      Here the authors carry out an evolution experiment, propagating replicate populations of the budding yeast with the CTF 4 gene deleted in three different genetic backgrounds: haploid , diploid and recombination deficient (RAD52 deletion). The authors find that the rate of evolution depends on the initial fitness of the different genetic backgrounds which is consistent with a repeated finding of evolution experiments: that beneficial mutations tend to have a smaller fitness effect in high fitness genetic backgrounds. Curiously even though the targets of selection tended to be specific to each of the three different genetic backgrounds, genetic reconstruction experiments showed beneficial mutations convert a fitness increase in all genetics backgrounds. The authors go on to provide a plausible explanation for why each of the three genetic backgrounds are predisposed to certain types of beneficial mutations. Overall, these results provide important context and caveats for an emerging consensus that genetic background determines the rate of evolution, a comprehensive molecular breakdown of adaptation to DNA replication stress and a mechanistic explanation for why different beneficial mutations are favoured in diploids, haploids and recombination deficient strains. This is a well-executed study that is beautifully presented and easy to follow. This will be of great interest to those in the experimental evolution community and the data an excellent resource.

      Major comments:

      • Are the key conclusions convincing? Yes, the convergent evolution analysis, fitness assays, and genetic reconstructions are sufficient to characterise the genetic causes of adaptation in this experiment, and are of the highest standard. The authors do particularly well to fully recover the fitness increases that evolved with their genetic reconstructions, which imparts a completeness to their understanding of what happened in their evolution experiment.
      • Should the authors qualify some of their claims as preliminary or speculative, or remove them altogether? No, in nearly all cases the authors make reasonable claims. One exception is on L419 in the discussion, where the authors speculate why some mutations do not follow diminishing returns epistasis, but this idea does not really have any basis (no citation or reasons to suggest that DNA repair genes are less connected with other genes in the genome). If the authors cannot support this statement, it should be removed, and instead write that is currently unknown why some individual mutations do not follow the pattern of diminishing returns.
      • Would additional experiments be essential to support the claims of the paper? No.
      • Are the data and the methods presented in such a way that they can be reproduced? Yes, but some more details are needed for the convergent evolution analysis, see minor comments.
      • Are the experiments adequately replicated and statistical analysis adequate? Yes, but some more statistic reporting in the main text or figure legends would be helpful, for example. L159: Please report the statistical test, test statistic and p value in the text or in the figure legend. Currently significance is indicated, but the methods do not specify the test. This should also be done for the GO analysis shown in figure 3A.

      Minor comments:

      • Specific experimental issues that are easily addressable. Not a new experiment, but extra details are required. The authors carried out both clone and whole population sequencing. For their convergent evolution analysis, what is the criteria for a mutation to be included- ie, does it need to be fixed, have attained a certain frequency? This is important- if the criteria were low (say 5%), it would be important to know whether gene A had fixed in 4 populations, while gene B had attained a frequency of 10% in 5 populations. As it stands both would be described as examples of convergent evolution. This can be handled by providing these details in the methods.
      • Are prior studies referenced appropriately? I note that the authors use the term declining adaptability where as other papers use the term diminishing returns epistasis- I am sure the authors have good reasons for their choice of nomenclature but I think it would be helpful for their readers to connect this work to other work by mentioning that declining adaptability is also referred to as diminishing returns.

      A reference the authors have missed: L419, as well as citing the Desai Lab bioxive paper, they should cite another theory paper that obtained similar conclusions. Lyons, D.M., et al. https://doi.org/10.1038/s41559-020-01286-y. .

      • Are the text and figures clear and accurate? This paper is beautifully written and easy to follow, a lot of thought has gone into the figures which are aesthetically pleasing and easy to navigate.
      • Do you have suggestions that would help the authors improve the presentation of their data and conclusions? No.

      Typos

      L32 "do" should be "to" L95 analyzed<br> L219 are the authors referring to ref 15 here? I think so, but please specify

      Significance

      • Describe the nature and significance of the advance (e.g. conceptual, technical, clinical) for the field. This paper is an important conceptual result and an immediate advance for basic research. The authors have done an outstanding job of showing the potential for the clinical translation of this research, especially regarding cancer biology.
        • Place the work in the context of the existing literature (provide references, where appropriate). This study follows up on and builds upon an earlier paper by these same authors published in E-life in 2020. Conceptually this work is most closely related to work in Michael Desai's, Sergey Kryazhimskiy's, Tim Coopers and Chris Marx's labs work looking at diminishing returns epistasis in yeast, and studies contrasting evolution of haploids and diploids led by Greg Lang's and Sarah Otto's labs.
        • State what audience might be interested in and influenced by the reported findings. This work will be of great interest to the Experimental evolution and molecular evolution communities and also of interest to those who study cancer genomics and DNA replication and repair.
        • Define your field of expertise with a few keywords to help the authors contextualize your point of view. Indicate if there are any parts of the paper that you do not have sufficient expertise to evaluate. Microbial experimental evolution.
    4. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      Summary

      This manuscript investigates the effect of an organism's genotype (or, as the authors call it, an organism's 'genome architecture') on evolutionary trajectories. For this, the authors use Saccharomyces cerevisiae strains that experience some form of replication stress due to specific gene deletions, and that further differ in ploidy and/or the type of gene(s) deleted. They find the same three functional modules (DNA replication, DNA damage checkpoint, sister chromatid cohesion) are affected across the 3 different genotypes tested; although the specific genes that are mutated varies.

      Major comments

      This is a solid and exceptionally eloquent paper, comprising a large body of work that is in general well presented. That said, I do have some suggestions and questions. At several points in the manuscript, the authors should perhaps be more careful in their wording and avoid to overgeneralize data without providing additional evidence for these claims.

      • Some key points of the study are not entirely clear to me; possibly because the study builds upon a previous study that was recently published in eLife. Anyhow, I think it would be useful to clarify the following points a bit more:

      • Why exactly was ctf4∆ chosen as a model for replication stress? What is the evidence that ctf4∆ is a good model for replication stress? Without including some evidence for this, it is unclear how well the findings in this study really can be generalized to replication stress (which is what the authors do now). Would the authors expect to see similar routes of adaptation if a 'genomic architecture' with a less severe/other replication defect would have been used? I realize the last question is perhaps difficult to address without actually doing the experiment (which I am not suggesting the authors should do); I just want to point out that perhaps some data should not be over-generalized.

      • Likewise, why was RAD52 selected as the gene to delete to affect homologous recombination? I understand that it is a key gene, but on the flipside, absence of RAD52 affects multiple cellular pathways and (as the authors also observe in their populations) also results in increased mutation rates which might confound some of the results.

      • Related to the first comment, it is also unclear to me how well the system chosen by the authors is representative of the replication stress experienced by tumor cells (as briefly touched upon in the final section of the discussion). Are some of the homologs key oncogenes that drive carcinogenesis?

      • The authors should consider rephrasing some sentences regarding the occurrence of adaptive mutations. Sentences such as 'which genes are mutated depends on the selective advantage' (p1; lines 15-16); 'genome architecture controls the frequency at which mutations occur' (p15), "genome architecture controls which genes are mutated" (p1, line 20) makes it sound like the initial occurrence of mutations is not random, whereas in reality, the mutational landscape is the result of the combined effect of occurrence and fitness effect of the mutations, with the later rather than the former likely being the main driver behind the observed patterns.
      • Some important methodological information is missing or unclear in the manuscript:

      • The authors should provide more details on how they decided which clones to select for sequencing. Did they select the biggest colonies; were colonies picked randomly, ...

      • What is the population size during the evolution experiment?

      • Sequencing of populations and clones: coverage should be mentioned

      • Identification of mutations (p19, line 573): Is this really how the authors defined whether a variant is a mutation? Based on the definition given here, DNA mutations that lead to a synonymous mutation in the protein are not considered as mutations?

      • Perhaps the information can be found elsewhere, but the source data excel files for mutations is incomplete and should at the very least contain information on the type of mutation (eg. T->A), as well as the location of this mutation in the respective gene.

      Minor comments

      • While the author already cite several significant papers relevant for their manuscript, some other studies could also be included:

      • From the text in the abstract, it is unclear what the three genomic architectures (line 13) exactly are, the authors should consider spelling this out.

      • Can the authors speculate on why a homozygous ctf4/ctf4 rad52/rad52 would be lethal, and a haploid not?

      • The authors note that a diploid ctf4/ctf4 strain is less fit than its haploid counterpart. Why do the authors think this is the case?

      • The authors passage their cells for 100 cycles and assume that this corresponds to around 1000 generations for each population. However, the fitness differences between the different starting strains (see also Figure 1B) are likely to cause considerable differences in number of generations between the different strains. Do the authors have more precise measurements of number of generations per population? If not, perhaps it should be noted that some lineages may have undergone more doublings than others, and perhaps also discuss if and how this could influence the results?

      • Panel A of figure 1A is somewhat confusing; as this seems to indicate that the ctf4∆ was introduced after strains were made, for example, haploid recombination deficient (which is not how these strains were constructed). Perhaps a better way of representing would be to have the indication of DNA replication stress pictured inside the yeast cells.

      • Legend to Figure 1: is fitness expressed relative to haploid or diploid WT cells for the diploid strains?

      • Figure 3: to improve readability of this figure, the authors could consider placing the legend of the different symbols (#, *,..) in the figure as well and not just in the figure legend.

      • Figure 5 shows Indels, but if I am correct, these mutations are not discussed in the text; nor is it mentioned what the authors used as a cut-off to determine indels (the authors use the term 'small indels' without defining it)? For example, the data shown in Figure 3 and Figure 4 only includes SNPs and not indels (correct?) - but the indels should also be taken into account when investigating which modules are hit.

      • Figure 5 mentions: # gene mutations. So these are only the mutations in genes, and not in their up- or downstream regulatory regions?

      • Figure 3-S1: labels of C panels are missing.

      • Figure 3-S1, panel B: why did the authors focus on synonymous mutations?

      Significance

      This is a solid and clearly written study, comprising a large body of work that is generally well presented and that will be of interest to scientists active in the field of (experimental) evolution and replication.

      However, many aspects studied in this manuscript have already been studied and reported before; including the recent eLife paper by the same group, as well as studies by other labs that have investigated how genome architecture / genotype affects evolutionary trajectories, the effect of ploidy on evolution, .... Because of this, I do feel that the authors should put their findings more in the context of existing literature context, including a general description of which results are truly novel, which confirm previous findings and which results seem to go against previous reports. This is already so at some points in the text, but I feel this could be done even more.

      Additionally, I think the authors should be more careful not to over-generalize their findings, which come from only a few specific genetic manipulations that might not be representative for general replication stress. For example (p15), can the authors really claim that they have unraveled general principles of adaptation to constitutive DNA replication stress? Perhaps a better motivation of the choice of ctf4 as a model mutation for DNA replication stress could also help (see also my earlier comments). A similar comment applies to the molecular mechanisms affecting adaptation in diploid cells - what evidence do the authors have that their findings are not specific to the one specific type of diploid strain they used in their study? Adding a bit more background information or nuance for some of the claims would help tackle this issue.

      Field of expertise of this reviewer: genetics, evolution, genomics

    5. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      In their previous work the authors examined adaptation in response to replication stress in haploid yeast, via experimental evolution of batch cultures followed by sequencing. Here they extend this approach to include diploid and recombination-deficient strains to explore the role of genome architecture in evolution under replication stress. On the whole, a common set of functional modules are found to evolve under all genetic architectures. The authors discuss the molecular details of adaptation and use their findings to speculate on the determinants of adaptation rate.

      SECTION A - Evidence, reproducibility and clarity

      Experimental evolution can reveal adaptive pathways, but there are some challenges when applying this approach to compare genetic backgrounds or environments. They key challenge is that adaptation potentially depends on both the rate of mutation and the nature of selection. Distinct adaptation patterns between groups could therefore reflect differential mutation, selection, or both. The authors allude to this dichotomy but have very limited data to address it. The closest effort is engineering putatively-adaptive variants into all genetic background including those where they did not arise; the fact that such variants remain beneficial suggests they did not arise in certain backgrounds because of a lower mutation rate, but this is a difficult issue to tackle quantitatively.

      From mutation accumulation experiments, where the influence of selection is minimized, there is evidence that genetic architecture affects the rate and spectrum of spontaneous mutations. In this experiment, the allele used to eliminate recombination, rad52, will also increase the mutation rate generally. The diploid strain is also likely to have a distinct mutational profile--as a null expectation diploids should have twice the mutation rate of haploids. Recent evidence indicates the mutation rate difference between haploid and diploid yeast might be less than two-fold, but that there are additional differences in the mutation spectrum, including rates of structural change. The context for this study is therefore three genetic architectures likely to differ in multiple dimensions of their mutation profiles, but mutation rates are not measured directly.

      The nature of selection on haploids and diploids is expected to differ because of dominance, but ploidy-specific selection is also possible. The authors discuss how recessive beneficial alleles may be less available to diploids, though this can be offset by relatively rapid loss of heterozygosity. However, diploids should also incur more mutations, all else being equal. The rate of beneficial mutation, as opposed to the rate of mutation generally, will depend on the mutational "target size" of fitness, and the authors findings recapitulate other literature (particularly regarding "compensatory" adaptation) that points to faster adaptation in genotypes with lower starting fitness.

      There is ample literature on the above topics, particularly discussions of the evolutionary advantages of haploidy versus diploidy. While adaptation to replication stress provides a novel starting point for this investigation, much of the manuscript is devoted to long-standing questions that are not specific to replication stress. Unfortunately, the data the authors collected is not sufficient to shed light on these questions, because mutation and selection cannot be effectively distinguished. The Discussion states that "We find that the genes that acquire adaptive mutations, the frequency at which they are mutated, and the frequency at which these mutations are selected all differ between architectures but that mutations that confer strong benefits always lie in the same three modules" (line 379), but it is not clear that these statements are all supported by the data.

      Focusing on the more novel aspect of their experiment-the presence of replication stress-would arguably be a better approach. On this topic the authors have some interesting observations and speculation, but clear predictions are lacking. The introduction section could be redesigned to explicitly state why genome architecture might affect adaptation in response to replication stress in particular, rather than (or in addition to) adaptation generally. If there were no differences in mutation, does the nature of Ctf4 lead to predictions that the molecular basis of compensatory adaptation should differ among genome architectures? Without such predictions it will be difficult for readers to know whether the observation that different genome architectures follow similar adaptive paths is surprising or not.

      Minor comments:

      Shifts in ploidy from diploid to haploid are less common than the reverse change, so the observation of such a shift (Fig. 1) should be discussed in more detail.

      Line 88 typo 'stains'.

      Significance

      SECTION B - Significance

      The novel aspect of this study is the combination of replication stress and genome architecture, but here the significance is limited by a lack of clear predictions on how these factors might interact. On the other hand, much of the manuscript is devoted to why adaptation might vary among genome architectures in general, but this long-standing and important question is not particularly well resolved by this experimental approach, which can't disentangle mutation and selection.

      The authors highlight the dichotomy when discussing the evolution of ploidy: "We suggest that... genome architecture affects two aspects of the mutations that produce adaptation: the frequency at which they occur and the selective advantage they confer" (line 399), but presenting this as a novel inference does not appropriately acknowledge prior research and discussion of these ideas; several relevant papers are cited by the authors in other contexts. It may be possible to recast these findings as a test of the role of genome architecture in adaptation generally, but the authors should clarify the limitations of experimental evolution and more fully consider the theory and data outlined in previous research. In particular, few studies can claim to directly compare mutation rates between genome architectures, and it is not obvious that the present study is an example of such.

      Reviewer expertise: Evoutionary genetics; experimental evolution; mutation.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Response to Reviewers

      We thank the reviewers for their careful reading of our manuscript and their valuable suggestions and comments. To address the reviewers’ concerns and improve our manuscript, we will complete the additional experiments and further revise the text as described below.


      Reviewer #1 (Evidence, reproducibility and clarity (Required)):

      **Summary:**

      Provide a short summary of the findings and key conclusions (including methodology and model system(s) where appropriate). Please place your comments about significance in section 2. The authors present an in vivo analysis of pdzd8 (CG10362) and a synthetic ER-mitochondria tether in the regulation of locomotor activity, lifespan, and mitochondrial turnover of Drosophila melanogaster, using basic bioinformatics, RNAi, SPLICS, imaging and microscopies observations (i. e. TEM, SIM), fly lines, and a representative AD fly disease model, etc. The research methodologies were detailed in good order. The model system employed was suitable to address the research topic. The manuscript was written in a clear language and statistical analysis were correctly applied.

      **Major comments:**

      *-Are the key conclusions convincing?*

      Yes. The results/conclusions are logical and provide an overview of Pdzd8 in the regulation of mitochondrial quality control and neuronal homeostasis.

      *-Would additional experiments be essential to support the claims of the paper? Request additional experiments only where necessary for the paper as it is, and do not ask authors to open new lines of experimentation.*

      No. Experiments were generally well performed, and all the data support the conclusions.

      *-Are the suggested experiments realistic in terms of time and resources? It would help if you could add an estimated cost and time investment for substantial experiments.*

      No suggested experiments needed.

      *-Are the data and the methods presented in such a way that they can be reproduced?*

      Yes. The authors have followed proper experimental design and methods have been described in sufficient detail.

      *-Are the experiments adequately replicated and statistical analysis adequate?*

      Yes, they are.

      **Minor comments:**

      *-Specific experimental issues that are easily addressable.*

      No comment.

      *-Are prior studies referenced appropriately?*

      Yes. The relevant literatures have been cited appropriately.

      *-Are the text and figures clear and accurate?*

      1.Please pay attention to the correct spelling of the described protein name (Pdzd8) and gene name (should be in 'italic') throughout the manuscript, i. e. line 36, 98, and 556, etc.

      As this is the first published characterization of the fly homolog of the mammalian Pdzd8 We have decided to name the fly protein pdzd8, using the lower case “p” to distinguish it from the mammalian protein. We have checked and corrected our use of italics for the gene name as noted in track changes.

      2.In figure 1C and its figure legend, please state what the numbers "201" and "195" stand for.

      We have added the text “numbers on bars indicate number of mitochondria analysed” to the figure legend.

      3.Your data needs to be converted the lowercase letter "x" to math symbol "×" when representing times sign, i. e. line 523, 5x, etc.

      Corrected

      *-Do you have suggestions that would help the authors improve the presentation of their data and conclusions?*

      No comment.

      Reviewer #1 (Significance (Required)):

      *-Describe the nature and significance of the advance (e.g. conceptual, technical, clinical) for the field.*

      Discoveries from this study include 1) characterization of the tethering protein Pdzd8 in Drosophila melanogaster, and 2) shed light on a possible way on how to enhance mitochondrial quality control and to help promote healthy aging of neurons by manipulating MERCs.

      *-Place the work in the context of the existing literature (provide references, where appropriate).*

      With this manuscript, the authors present a straightforward but sound piece of scientific research, with the intent to illustrate the consequences of neuronal depletion of pdzd8 in Drosophila melanogaster. Since Pdzd8 plays specific functions in ER-mitochondrial tethering complexes and dysregulations of MERCs are damaging to neurons, this protein represents a good potential target. In this context the characterization of Pdzd8 should represent an interesting starting point. To this purpose, the gene was knockdown and the tether construct was recombinantly produced. The fly lines were then subjected to analysis both at the organismal and at the cellular level.

      *-State what audience might be interested in and influenced by the reported findings.* Audience might include those who are in the field of neuroscience and pharmaceutical, and benefit from an awareness of this research.

      *-Define your field of expertise with a few keywords to help the authors contextualize your point of view. Indicate if there are any parts of the paper that you do not have sufficient expertise to evaluate.*

      Key words in my field of expertise: Ageing, neurodegenerative diseases, Alzheimer's disease, mitophagy, NAD+, neuroprotection. My group is investigating the molecular mechanisms of ageing and age-related neurodegeneration (especially AD) using cross-species model systems, ranging from human brain samples, iPSCs, C. elegans, Drosophila melanogaster, and mice, therefore I have sufficient expertise to evaluate this paper.

      **Referees Cross-commenting**

      To this reviewer the key novelty of this paper was the study of the regulation of the mitochondrial-ER contact sites (MERCs) in life and health. The data indicate that MERCs mediated by the tethering protein pdzd8 play a critical role in the regulation of mitochondrial homeostasis, neuronal function, and lifespan. In a transitional perspective, this reviewer would ask to check whether this mechanism conserves in rodents or not (e.g. to to memory in the AD mice and to run lifespan in mitochondrial toxin condition). This may be to much. But will depend on the standard of the journal. We thank the reviewer for their input, evaluation and interest. We too are keen to know whether this mechanism is conserved and hope to investigate this in our ongoing work including characterizing a mouse mutant, but the current work already represents a substantial investment of resources and a worthy study in its own right as the first description of the in vivo role of pdzd8, so we feel it is beyond the scope of the current work.

      Reviewer #2

      (Evidence, reproducibility and clarity (Required)):

      Hewitt et al. describe and characterize for the first time the ortholog of pdzd8 in Drosophila melanogaster. In accordance with pdzd8's previously described function as a member of mitochondrial-ER contact sites (MERCs) the authors show reduced MERCs upon RNAi mediated depletion of pdzd8 via TEM, SIM and a split-GFP based contact site sensor. Pdzd8 depletion results in the increased life span as well as improved locomotor activity in aging flies while increase of MERCs with a synthetic tether accelerates the age-related declines in survival and locomotion. Moreover, pdzd8 depleted flies are more resistant against mitochondrial toxins. The authors correlate these protective effects of pdzd8 knockdown with an increase in mitophagy using a mitophagy sensor and describe a rescue of locomotor defects in an Alzheimer disease fly model by pdzd8 depletion.

      **Major comments:**

      1.The authors quantify the number of MERCs in thin sections of TEM (Fig 1B and C). It would add to the paper if the authors would show a representative reconstruction of the quantified somata, as a 3D reconstruction would visualize ER-Mito contacts more reliable than thin sections.

      We agree that the 3D reconstruction of TEM images would provide a satisfying addition to the current analyses, however such advanced techniques are not readily available. The current samples used to collect these data cannot be used to generate 3D reconstructions. To counter this, we have used three independent methods to analyse the changes in MERCs, all of which show a decrease in MERCs in the flies with less pdzd8 supporting that these observations are reproducible and robust.

      2.The authors quantify MERCs in pdzd8 KD also by SIM (Fig1F, G). However, they quantify the number of MERCs in epidermal cells while they also show SIM images of larval neurons (Fig S1D). For consistency and to support their claim of MERC reduction in neurons, we ask the authors to include the quantification based on larval neurons especially as the authors show that pdzd8 is predominantly expressed in the CNS.

      Unfortunately, the soma of larval neurons have extremely limited cytosol (see fig. S1D) which creates very challenging conditions to discern the spatial separation of ER and mitochondria by light microscopy. While co-localisation of organelle markers in such cells has been reported in the literature, we are extremely concerned that the lack of space within the cytosol renders such analysis unreliable. However, we will attempt to quantify the extent of co-localisation of the ER and mitochondria in these cells. In contrast, epidermal cells are much larger providing greater spatial separation of ER and mitochondria. Notably, we complement the co-localisation analysis of epidermal cells with two additional approaches, TEM analysis and the SPLICS reporter construct, to demonstrate pdzd8-RNAi results in decreased MERCs specifically in neurons.

      3.The authors describe a decreased NMJ volume in Fig 4G. It would improve and complete the functional characterization of pdzd8 in flies if the authors can provide further data whether pdzd8 KD causes a general synaptic defect. Can the authors show morphological synaptic defects in the existing TEM data of the adult brain or provide additional ERG recordings, which would elucidate the functional consequences of pdzd8 depletion in the CNS?

      Our TEM data are not suitable for us to properly analyse defects in synaptic morphology as our images centered around the cell bodies where the organelle morphology was easiest to distinguish and there are very few synapses. While it is not surprising that the knockdown of pdzd8 has some detrimental effects, we chose to focus our efforts on trying to determine the cause of the protective effect on locomotor activity in aged flies rather than to exhaustively characterise the myriad phenomena which may be impacted as a knock-on effect of the disrupted cell biology that we have demonstrated. We hope to further explore the detrimental functional consequences of pdzd8 depletion on such phenomena as neurotransmission in future work.

      1. Hewitt et al. suggest a beneficial effect of increased turnover of mitochondria for healthy aging. To convince readers we would like to ask the following:

      a) This claim is based on their observation of increased mitophagy in pdzd8 depleted flies using one reporter (Fig 5). Can the authors support their data with an alternative method as this is one of the key claims of the manuscript?

      The mitoQC tool is well established in the field and we have found it to perform better but consistent with mito-Keima (Lee et al. 2018 JCB doi: 10.1083/jcb.201801044). We would be happy to consider other assays if the reviewer can suggest an unbiased and established alternative.

      b) An increased turnover of Mitochondria would also suggest that there are more "young" mitochondria present in the pdzd8 KD neurons. Can the authors experimentally address that?

      We understand the reviewer’s point here but due to the continual fission and fusion, as well as piecemeal turnover of mitochondria (see Vincow et al. 2019 Autophagy doi: 10.1080/15548627.2019.1586258), the concept of ‘young’ versus ‘old’ mitochondria is misplaced. The mitochondrial network essentially exists as a milieu of components which are produced and degraded at different rates.

      c)Furthermore, we would like to ask the authors to use also the MERC tether as control in the mitophagy assay. This would allow further conclusions about the role of the mitophagy, its protective effect during aging and the role of MERCs in this process.

      We remind the reviewer that this MERC tether is constructed from an RFP with N- and C-terminal tethering peptides. The presence of this RFP prevents the proper analysis of the mitoQC mCherry signal. However, given the dramatic phenotypes we think that it is unlikely that a decrease in mitophagy alone can explain the detrimental effects of increased tethering.

      1. In Fig6 A,B the authors should include also the pdzd8 KD to support their claim that the rescue of climbing defects correlates with an reduction of MERCs.

      We thank the reviewer for this suggestion and we will perform this experiment.

      Moreover, it would be beneficial for their final conclusion, if the authors could show that increases mitophagy in the background of Ab42 expressing flies.

      We thank the reviewer for this suggestion and we will perform this experiment.

      **Minor comments:**

      1.Can the authors add to the figure legend of Fig 1F how the ER and Mitochondria were labeled?

      We have added the constructs to the figure legend (full genotypes for all figures are given in Table S2).

      2.Error bars should be added in the quantification of MERCs in Fig1C.

      The MERCs are quantified in three brains per genotype but as there were variable numbers of sections suitable for imaging from each brain the total values are combined to give a single percentage.

      3.A reference to Supplementary Fig S1D is missing in the main text.

      This figure is referenced in line 135

      4.Can the authors label the individual genotypes in Fig S3C and 4F?

      Figure labels and legends have been modified to clarify this.

      5.Can the author specify which brain region they imaged in Fig 5C?

      The regions imaged and quantified were chosen for their clear organelle morphology rather than targeting a specific brain region. All images were from the protocerebrum and the methods and figure legends have been updated to note this.

      6.Are the ATP levels normalized to ADP in Fig S3D? Can the authors specify in the figure and figure legend to what ATP was normalized?

      Figure labels and legends have been modified to clarify the ATP levels are normalised to total protein quantification of the samples.

      7.Please sort the supplementary figures in accordance to their reference order in the text.

      We thank the reviewer for checking this. This figure order will be rechecked in the final version as addressing reviewer comments is likely to lead to further changes.

      Reviewer #2 (Significance (Required)):

      The authors present here novel insights about the functional role of a new member of the MERCs, pdzd8, using RNAi mediated depletion and Drosophila melanogaster as a model system. As MERCs receive more attention especially in the context of their potential role in neurological diseases, the author's manuscript will be of high interest to the scientific community. The in vivo model combined with multiple different technical approaches add to the significance of the paper. There are some controls and additional experiments that are required to support the author's main claims and complete the functional characterization of pdzd8 (see major comments).

      Field of expertise: neuroscience, fly genetics, neurodegeneration.

      Reviewer #3

      (Evidence, reproducibility and clarity (Required)):

      This manuscript entitled "Decreasing pdzd8-mediated mitochondrial-ER contacts in neurons improves fitness by increasing mitophagy" by Hewitt and collaborators describes the role of the Drosophila ortholog of PDZD8 in ER-mitochondria contacts in neurons and the physiological consequence of pdzd8 loss. The authors show that ER-mitochondria contacts are reduced in fly neurons expressing a pdzd8-RNAi construct. Decreasing pdzd8 expression in neurons was accompanied by a slowed age-associated decline in locomotor activity, and an increased lifespan. In presence of mitochondrial toxins, neurons deficient for pdzd8 were protected. Finally, the authors showed that pdzd8 silencing increased mitophagy in aged neurons, and protected against neurodegeneration in a model of Alzheimer's disease.

      **Major points:**

      1)There are important controls that are missing. RNAi expression often affects off-target genes which could unfortunately modify the observed phenotypes. The authors should verify that a) the phenotypes observed by RNAi-mediated pdzd8 silencing can be rescued by the expression of an RNAi-insensitive pdzd8 construct (the authors should verify the rescue of the most crucial phenotypes described in the manuscript); b) the RNAi-LacZ-line that they use as control in the paper does not behave differently from a WT line, which could be induced by an off-target effect of the RNAi-LacZ (again with the most crucial phenotypes).

      While the Drosophila community is fortunate to have a plethora of readily available tools for interrogating the function of nearly all genes in the genome – tools which form the foundation of most work in Drosophila labs worldwide – the availability is not limitless. In this instance, the transgenic RNAi line generated as a resource for the community comprises a 500 bp hairpin, computed to be the most selective target for that gene. Being a 500 bp sequence it is unrealistic to be able to establish an RNAi-resistant variant that still faithfully functions as normal. Nevertheless, although imperfect we show in Figure S3B that pdzd8-RNAi rescues the climbing defect produced by overexpressing pdzd8, providing evidence the construct is specifically acting on this sequence.

      Similarly, the availability of ‘control’ RNAi reagents is generous but still limited. This LacZ-RNAi line is one of a few well-established controls that has provided a cornerstone reference for a wealth of studies. Nevertheless, we will provide experimental data that aged climbing of nSyb>LacZ-RNAi is highly comparable to several other well-established control genotypes.

      2) Did the author analyzed their EM data in a blinded-way to minimize subjective bias? This type of analysis is complicated by the manual annotation of ultrastructures, which is by nature subjective. For instance, this reviewer would have annotated the two mitochondria in the middle of Fig 1B, right as "Mitochondria with ER contact", as there is a membrane tube present at the interface of these two organelles.

      The EM data were analysed blinded to the genotypes. This is noted in the methods section.

      3) There is a controversy in the field on the role of PDZD8: some papers show its involvement in ER-mitochondria contacts, others in ER-lysosome contacts. The authors should discuss this point in more details. Moreover, the authors should localize the protein in Drosophila neurons; is the protein associated with mitochondria or endo/lysosomes?

      We recognize that there is some debate in the field over the localization and role of PDZD8. However, since there is currently no antibody against the Drosophila protein and the sequence is sufficiently divergent such that antibodies against the mammalian protein will not recognize the fly protein, we are not well-positioned to determine the localization of Drosophila pdzd8. Consequently, we will expand our discussion to reflect the differing views.

      We can offer instead to quantify the localization of mouse PDZD8 in our newly generated NIH-3T3 Pdzd8-Halo knock in line to help resolve the controversy regarding the location(s) and function(s) of mammalian Pdzd8.

      4) The authors should specify in more details how the different quantifications were performed. For instance Fig 1G: how many samples were quantified (i.e. how many flies, and how many neurons); what is compared? Fields-of-view, neurons, flies...?

      Further details have been added to the figure legends 1G (now H), 4I, 5 and Fig S2.

      **Minor point:**

      1)Could the authors show the SIM images Fig1F together with the binarized images.

      These images have been added to Figure 1 and the legend and text updated accordingly.

      2) It is surprising to see that data otherwise similar are represented with so many different types of graph (For instance Fig 5, bar graph, box-plot, violin plot). Why individual data points are not always present on the graphs?

      The graphs will be redrawn using more consistent representations once the data for the revisions has been gathered.

      3) The way that data are presented is sometimes odd: for instance, line 101, the authors wrote "To establish that MERCs were decreased...". This would imply that they knew the result before performing the experiment. And later, line 103 "Accordingly...".

      These sentences have been rephrased “To determine whether MERCs were decreased..” and “These results showed the…”

      Reviewer #3 (Significance (Required)):

      This study about the role of pdzd8 is timely. The functional description of inter-organelle contacts is a hot topic in cell biology. There are several recent reports describing the identification of pdzd8 role in inter-organelle contact formation. This manuscript provides data on the role of pdzd8 in a whole organism and expands our understanding of this protein.

      My expertise: inter-organelle contacts (human cells)

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      This manuscript entitled "Decreasing pdzd8-mediated mitochondrial-ER contacts in neurons improves fitness by increasing mitophagy" by Hewitt and collaborators describes the role of the Drosophila ortholog of PDZD8 in ER-mitochondria contacts in neurons and the physiological consequence of pdzd8 loss. The authors show that ER-mitochondria contacts are reduced in fly neurons expressing a pdzd8-RNAi construct. Decreasing pdzd8 expression in neurons was accompanied by a slowed age-associated decline in locomotor activity, and an increased lifespan. In presence of mitochondrial toxins, neurons deficient for pdzd8 were protected. Finally, the authors showed that pdzd8 silencing increased mitophagy in aged neurons, and protected against neurodegeneration in a model of Alzheimer's disease.

      Major points:

      1)There are important controls that are missing. RNAi expression often affects off-target genes which could unfortunately modify the observed phenotypes. The authors should verify that a) the phenotypes observed by RNAi-mediated pdzd8 silencing can be rescued by the expression of an RNAi-insensitive pdzd8 construct (the authors should verify the rescue of the most crucial phenotypes described in the manuscript); b) the RNAi-LacZ-line that they use as control in the paper does not behave differently from a WT line, which could be induced by an off-target effect of the RNAi-LacZ (again with the most crucial phenotypes).

      2)Did the author analyzed their EM data in a blinded-way to minimize subjective bias? This type of analysis is complicated by the manual annotation of ultrastructures, which is by nature subjective. For instance, this reviewer would have annotated the two mitochondria in the middle of Fig 1B, right as "Mitochondria with ER contact", as there is a membrane tube present at the interface of these two organelles.

      3)There is a controversy in the field on the role of PDZD8: some papers show its involvement in ER-mitochondria contacts, others in ER-lysosome contacts. The authors should discuss this point in more details. Moreover, the authors should localize the protein in Drosophila neurons; is the protein associated with mitochondria or endo/lysosomes?

      4)The authors should specify in more details how the different quantifications were performed. For instance Fig 1G: how many samples were quantified (i.e. how many flies, and how many neurons); what is compared? Fields-of-view, neurons, flies...?

      Minor point:

      1)Could the authors show the SIM images Fig1F together with the binarized images.

      2)It is surprising to see that data otherwise similar are represented with so many different types of graph (For instance Fig 5, bar graph, box-plot, violin plot). Why individual data points are not always present on the graphs?

      3)The way that data are presented is sometimes odd: for instance, line 101, the authors wrote "To establish that MERCs were decreased...". This would imply that they knew the result before performing the experiment. And later, line 103 "Accordingly...".

      Significance

      This study about the role of pdzd8 is timely. The functional description of inter-organelle contacts is a hot topic in cell biology. There are several recent reports describing the identification of pdzd8 role in inter-organelle contact formation. This manuscript provides data on the role of pdzd8 in a whole organism and expands our understanding of this protein.

      My expertise: inter-organelle contacts (human cells)

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      Hewitt et al. describe and characterize for the first time the ortholog of pdzd8 in Drosophila melanogaster. In accordance with pdzd8's previously described function as a member of mitochondrial-ER contact sites (MERCs) the authors show reduced MERCs upon RNAi mediated depletion of pdzd8 via TEM, SIM and a split-GFP based contact site sensor. Pdzd8 depletion results in the increased life span as well as improved locomotor activity in aging flies while increase of MERCs with a synthetic tether accelerates the age-related declines in survival and locomotion. Moreover, pdzd8 depleted flies are more resistant against mitochondrial toxins. The authors correlate these protective effects of pdzd8 knockdown with an increase in mitophagy using a mitophagy sensor and describe a rescue of locomotor defects in an Alzheimer disease fly model by pdzd8 depletion.

      Major comments:

      1.The authors quantify the number of MERCs in thin sections of TEM (Fig 1B and C). It would add to the paper if the authors would show a representative reconstruction of the quantified somata, as a 3D reconstruction would visualize ER-Mito contacts more reliable than thin sections.

      2.The authors quantify MERCs in pdzd8 KD also by SIM (Fig1F, G). However, they quantify the number of MERCs in epidermal cells while they also show SIM images of larval neurons (Fig S1D). For consistency and to support their claim of MERC reduction in neurons, we ask the authors to include the quantification based on larval neurons especially as the authors show that pdzd8 is predominantly expressed in the CNS.

      3.The authors describe a decreased NMJ volume in Fig 4G. It would improve and complete the functional characterization of pdzd8 in flies if the authors can provide further data whether pdzd8 KD causes a general synaptic defect. Can the authors show morphological synaptic defects in the existing TEM data of the adult brain or provide additional ERG recordings, which would elucidate the functional consequences of pdzd8 depletion in the CNS?

      4.Hewitt et al. suggest a beneficial effect of increased turnover of mitochondria for healthy aging. To convince readers we would like to ask the following:

      a)This claim is based on their observation of increased mitophagy in pdzd8 depleted flies using one reporter (Fig 5). Can the authors support their data with an alternative method as this is one of the key claims of the manuscript?

      b)An increased turnover of Mitochondria would also suggest that there are more "young" mitochondria present in the pdzd8 KD neurons. Can the authors experimentally address that?

      c)Furthermore, we would like to ask the authors to use also the MERC tether as control in the mitophagy assay. This would allow further conclusions about the role of the mitophagy, its protective effect during aging and the role of MERCs in this process.

      5.In Fig6 A,B the authors should include also the pdzd8 KD to support their claim that the rescue of climbing defects correlates with an reduction of MERCs. Moreover, it would be beneficial for their final conclusion, if the authors could show that increases mitophagy in the background of Ab42 expressing flies.

      Minor comments:

      1.Can the authors add to the figure legend of Fig 1F how the ER and Mitochondria were labeled?

      2.Error bars should be added in the quantification of MERCs in Fig1C.

      3.A reference to Supplementary Fig S1D is missing in the main text.

      4.Can the authors label the individual genotypes in Fig S3C and 4F?

      5.Can the author specify which brain region they imaged in Fig 5C?

      6.Are the ATP levels normalized to ADP in Fig S3D? Can the authors specify in the figure and figure legend to what ATP was normalized?

      7.Please sort the supplementary figures in accordance to their reference order in the text.

      Significance

      The authors present here novel insights about the functional role of a new member of the MERCs, pdzd8, using RNAi mediated depletion and Drosophila melanogaster as a model system. As MERCs receive more attention especially in the context of their potential role in neurological diseases, the author's manuscript will be of high interest to the scientific community. The in vivo model combined with multiple different technical approaches add to the significance of the paper. There are some controls and additional experiments that are required to support the author's main claims and complete the functional characterization of pdzd8 (see major comments).

      Field of expertise: neuroscience, fly genetics, neurodegeneration.

    4. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      Summary:

      Provide a short summary of the findings and key conclusions (including methodology and model system(s) where appropriate). Please place your comments about significance in section 2. The authors present an in vivo analysis of pdzd8 (CG10362) and a synthetic ER-mitochondria tether in the regulation of locomotor activity, lifespan, and mitochondrial turnover of Drosophila melanogaster, using basic bioinformatics, RNAi, SPLICS, imaging and microscopies observations (i. e. TEM, SIM), fly lines, and a representative AD fly disease model, etc. The research methodologies were detailed in good order. The model system employed was suitable to address the research topic. The manuscript was written in a clear language and statistical analysis were correctly applied.

      Major comments:

      -Are the key conclusions convincing?

      Yes. The results/conclusions are logical and provide an overview of Pdzd8 in the regulation of mitochondrial quality control and neuronal homeostasis.

      -Would additional experiments be essential to support the claims of the paper? Request additional experiments only where necessary for the paper as it is, and do not ask authors to open new lines of experimentation.

      No. Experiments were generally well performed, and all the data support the conclusions.

      -Are the suggested experiments realistic in terms of time and resources? It would help if you could add an estimated cost and time investment for substantial experiments.

      No suggested experiments needed.

      -Are the data and the methods presented in such a way that they can be reproduced?

      Yes. The authors have followed proper experimental design and methods have been described in sufficient detail.

      -Are the experiments adequately replicated and statistical analysis adequate?

      Yes, they are.

      Minor comments:

      -Specific experimental issues that are easily addressable.

      No comment.

      -Are prior studies referenced appropriately?

      Yes. The relevant literatures have been cited appropriately.

      -Are the text and figures clear and accurate?

      1.Please pay attention to the correct spelling of the described protein name (Pdzd8) and gene name (should be in 'italic') throughout the manuscript, i. e. line 36, 98, and 556, etc.

      2.In figure 1C and its figure legend, please state what the numbers "201" and "195" stand for.

      3.Your data needs to be converted the lowercase letter "x" to math symbol "×" when representing times sign, i. e. line 523, 5x, etc.

      -Do you have suggestions that would help the authors improve the presentation of their data and conclusions?

      No comment.

      Significance

      -Describe the nature and significance of the advance (e.g. conceptual, technical, clinical) for the field.

      Discoveries from this study include 1) characterization of the tethering protein Pdzd8 in Drosophila melanogaster, and 2) shed light on a possible way on how to enhance mitochondrial quality control and to help promote healthy aging of neurons by manipulating MERCs.

      -Place the work in the context of the existing literature (provide references, where appropriate).

      With this manuscript, the authors present a straightforward but sound piece of scientific research, with the intent to illustrate the consequences of neuronal depletion of pdzd8 in Drosophila melanogaster. Since Pdzd8 plays specific functions in ER-mitochondrial tethering complexes and dysregulations of MERCs are damaging to neurons, this protein represents a good potential target. In this context the characterization of Pdzd8 should represent an interesting starting point. To this purpose, the gene was knockdown and the tether construct was recombinantly produced. The fly lines were then subjected to analysis both at the organismal and at the cellular level.

      -State what audience might be interested in and influenced by the reported findings. Audience might include those who are in the field of neuroscience and pharmaceutical, and benefit from an awareness of this research.

      -Define your field of expertise with a few keywords to help the authors contextualize your point of view. Indicate if there are any parts of the paper that you do not have sufficient expertise to evaluate.

      Key words in my field of expertise: Ageing, neurodegenerative diseases, Alzheimer's disease, mitophagy, NAD+, neuroprotection. My group is investigating the molecular mechanisms of ageing and age-related neurodegeneration (especially AD) using cross-species model systems, ranging from human brain samples, iPSCs, C. elegans, Drosophila melanogaster, and mice, therefore I have sufficient expertise to evaluate this paper.

      Referees Cross-commenting

      To this reviewer the key novelty of this paper was the study of the regulation of the mitochondrial-ER contact sites (MERCs) in life and health. The data indicate that MERCs mediated by the tethering protein pdzd8 play a critical role in the regulation of mitochondrial homeostasis, neuronal function, and lifespan. In a transitional perspective, this reviewer would ask to check whether this mechanism conserves in rodents or not (e.g. to to memory in the AD mice and to run lifespan in mitochondrial toxin condition). This may be to much. But will depend on the standard of the journal.

    1. Reviewer #3:

      General assessment:

      The authors arrive at a plausible model of DNA replication kinetics that reasonably fits six types of plots from fiber-combing data on Xenopus cell-free extracts, for normal and challenged cases. However, although the mechanisms postulated and the parameters inferred all seem reasonable, they rely on untested hypotheses and a single type of data (combing). To truly convince, the authors need further experiments to test specific hypothesized mechanisms. Techniques such as Repli-Seq or perhaps FORK-seq (recently developed by one of the authors here) might give direct information on the variation of initiation efficiency across the genome.

      Substantive Concerns:

      1) The authors refer to each case (MM1-5) as a unique model, but each has more complexity and defines a class of models. For example, in fitting MM1, the simplest of all the cases (and with, by far, the worst fit), the fork velocity was fixed at 0.5 kb/min. And yet the real fork velocity is described as having v ~ 0.5 kb/min. Shouldn't this also be a parameter in the fit?

      2) Under replication stress, forks can stall, giving an effectively two populations of forks, as proposed by the authors in an earlier work (Ciardo et al., Genes 2019; cf. Fig. 1). Strangely, that paper is not referred to or discussed in this manuscript. Why not?

      3) Continuous vs. discrete potential origins: The density was fixed to be random at 1 potential origin per 2.3 kb (or 1 kb in part of the paper). How robust are findings to these assumed densities? In general, there does not seem to be a huge difference between the two cases, for the type of data explored. Perhaps it is not worth looking at the discrete case here?

      4) The definition of goodness of the fit (GoF) should be made more explicitly. How is the norm calculated? There is an implicit sum - the elements should be defined explicitly. Also, the ensemble average < yexp > is not defined. More broadly, it is not clear why we need a custom GoF statistic when it would seem that standard ones (chi square, or - ln likelihood) could serve equally well. Note that those statistics (when proper normalization is used) can also work for global fits where each local fit is to a quantity with different units.

  2. Jan 2021
    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Overall:

      We thank the reviewers for their thoughtful comments and suggestions on how to improve the manuscript. We also thank the reviewers for describing the study as “highly significant,” “rigorous and reliable as described and can be reproduced by others,” and as “relevant to investigators working in the field of rickettsial diseases and to a broader audience studying mechanisms of intracellular parasitism and host responses.”

      In this revised manuscript we have addressed all the minor points raised by the reviewers. In regard to additional experiments, all three reviewers suggested that we perform histology of skin lesions, and in a revised manuscript we propose to thoroughly address this by performing histology at multiple time points in infected wild type and in interferon receptor-deficient mice. We will also attempt to use immunohistochemistry to identify the infected cell types in the skin and in internal organs. We will compare these findings to histology of human eschars. We feel that the reviewer comments support our contention that a manuscript containing these proposed additional experiments will be of strong significance in the field.

      Reviewer #1 (Evidence, reproducibility and clarity (Required)):

      “Rickettsial eschars are hallmarks of less severe spotted fever diseases. The underlying mechanisms involved in the formation of the eschar caused by pathogenic rickettsiae remains unknown. The authors of this manuscript studied this interesting research question by using Ifnar-/-Ifngr-/- mice and Sca2 or OmpB mutant of R. parkeri. R. parkeri probably is the best rickettsial species to study rickettsial eschar due to the clinical features of R. parkeri rickettsioses and the biosafety level required to work with it. The data presented in the manuscript are very promising. The conclusions are supported by the presented results. For the first time, this study recapitulated human eschar-like skin lesion observed in patients with R. parkeri rickettsioses in the mouse models. More interestingly, mice inoculated with Sca2 mutant of R. parkeri i.d. had less disseminated rickettsiae in tissues, which helps us to understand the mechanisms by which pathogenic rickettsiae cause systemic infection after the arthropod bite.”

      **Minor comments: **

      “1) Figure 2D, it looks likely the lethality of mice i.d. infection with R. parkeri is not dose dependent. For example, mice inoculated with 10^4 showed greater lethality compared to 10^7. The authors might want to explain it in the Discussion.”

      The reviewer is correct in observing that the lethality between different doses of R. parkeri in Ifnar-/-Ifngr-/-mice after intradermal infection is not dose dependent with the current number of mice used per group. We do not understand the reason for this, and more broadly we don’t understand the mechanism of lethality. We speculate that there could be a bottleneck; however, answering this question will require future investigations into the mechanisms of lethality that are beyond the scope of this study. To address the reviewer’s point, we now include this statement: “Degrees of lethality between different doses in Ifnar-/-Ifngr-/- mice were not significantly different from one another, and the cause of lethality in this model remains unclear.”

      “2) Line 202, innate immunity in vitro might need to be revised.”

      We agree that the previous description was vague. We changed the description to be more specific and it now reads: “…Sca2 does not significantly enhance the ability of R. parkeri to evade interferon-stimulated genes or inflammasomes in vitro.

      “3) It is unclear what is the unit of the inoculum in animal experiments, PFU?”

      Yes, it is PFU. We have now indicated this in the figure legends.

      “4) Line 36, in the study of "Reference 16", C3H/HeN mice, not B6 mice, were used.”

      We thank the reviewer for noticing this error and we have changed the text to C3H/HeN.

      “5) The conclusion on eschar will be greatly strengthened if histological analysis is included, particularly whether dermis necrosis is present or not.”

      In the revised manuscript we will perform histology on eschars in wild type and Ifnar-/-Ifngr-/- mice over time. We will also use immunohistochemistry to analyze the infected cell types and will compare this to data on human eschars. We agree that this will greatly strengthen our conclusions regarding the similarities between the mouse and human eschars.

      “6) Line 357, it is not clear what "spinfection" means.”

      We have changed this to “infection” for clarity.

      “Reviewer #1 (Significance (Required)): Several approaches employed in the study are new to the field of animal models of the rickettsioses. For example, fluorescent dextran was used to investigating the vascular damage in skin at the inoculation site; body temperature for mice infected with R. parkeri. Overall, the study is highly significant since it has answered the important questions in the research area of spotted fever rickettsioses and employed appropriate approaches. No major concerns were noticed.”

      We thank the reviewer for appreciating the significance of this work.

      **Referees cross commenting** I agree with other reviewers' comments. Thanks for the invite.”

      Reviewer #2 (Evidence, reproducibility and clarity (Required)):

      “The manuscript utilizes a new model of spotted fever rickettsiosis. Using this model, the authors have determined that knockout of the sca2 or ompB gene attenuates Rickettsia parkeri, and vaccination with the attenuated rickettsiae provides protection against virulent challenge. However, the model is far less than ideal as it has eliminated important effectors of immunity.”

      We thank the reviewer for their comments and we hope to thoroughly address their concerns. In regard to the effects of interferons on long-lasting immunity to R. parkeri, we note to the reviewer that we observed that immunized Ifnar-/-Ifngr-/- mice were completely and robustly protected from rechallenge. No lethality and no loss of body weight or temperature was observed after a rechallenge dose of 10x the LD-50. These data reveal that interferons are dispensable for long-lasting immunity to R. parkeri in inbred mice and are not important effectors of adaptive immunity to R. parkeri. This is thus the first model that can be used to investigate the factors required for adaptive immunity to R. parkeri in mice.

      If the reviewer’s comment is not referring to long-lasting adaptive immunity to R. parkeri but is instead referring to the general concept of using immunocompromised mice as models, we note that immunocompromised mice are used as models for a variety of pathogens, including many Rickettsia species (reviewed in Osterloh, Med Microbiol Immunol 2017), and Ifnar-/-Ifngr-/- mice specifically are used as models for Zika and Dengue virus infections. Unlike many other immunocompromised mice, Ifnar-/-Ifngr-/- mice do not require maintenance on antibiotics and they have no noticeable differences to wild type mice in regard to breeding or growth.

      “Manuscript also fails to recognize that there is a Amblyomma maculatum tick transmitted model of Rickettsia parkeri infection that causes an eschar and disseminated pathology”

      In the previous version of the manuscript in lines 266-269 we cited and acknowledged the reported tick transmission model in non-human primates (Banajee et al., 2015). As also noted by Reviewer 3, our model with needle inoculation is significantly less time consuming and expensive than a tick transmission model. Moreover, needle inoculation makes it feasible to precisely measure the number of bacteria that are administered, which is not true with ticks. Lastly, the tick model was described in non-human primates, which are significantly more expensive than inbred mice and are not amenable to genetic manipulation. Thus, our model provides many significant advantages over the tick model in non-human primates, including cost, time, availability of genetic mutants, and reproducibility.

      “The model that they have used is inadequately characterized. The cutaneous lesion was not evaluated histologically to determine if it features the actual characteristics of an eschar.”

      We thank the reviewer for the suggestion and as a part of our revision plan, we propose to thoroughly analyze the lesion histologically.

      “Although bacteria were found in the liver and spleen, in which macrophages are significant target, there was no evaluation of the vital organs including lung and brain nor demonstration of the target cells or pathologic lesions.”

      In previous work from our lab (Engström et al., 2019), we found that lungs of wild type mice contained similar number of infectious R. parkeri as the spleen and liver after intravenous infection. Thus, in order to be able to process more samples quickly, we did not include lungs in the experiments described here. In unreported data, we also found that organs including the brain, kidneys, and heart had no/little recoverable PFUs. As a part of our revision plan, we propose to perform immunohistochemistry in the spleen, liver, lung, and skin to identify the infected cell types. Identifying the infected cell types will reveal if the same cell types are infected in our mouse model as in humans.

      “Unfortunately, the assay of vascular permeability was applied only to the inoculation site and not to the disseminated visceral organs such as lung and brain.”

      We have performed the vascular permeability assay using internal organs alongside the skin; however, little/no fluorescence was observed in any sample. We were unable to distinguish differences between control groups or between control and experimental groups in organs from mice that were treated and untreated with the fluorescent dextran. Thus, we were unfortunately not able to apply the described vascular damage assay to organs other than the skin. We now indicate this in the revised text.

      Reviewer #2 (Significance (Required)):

      “The authors all have misrepresented the eschar as a critically important lesion whereas the patients usually do not even know i's presence until they began to develop systemic symptoms and it is a detected by a physician examining the patient.”

      We did not intend to suggest that the eschar is either more or less critically important than other features of rickettsial disease. We simply described the eschar as a “hallmark feature” of eschar-associated rickettsiosis. Additionally, as the reviewer notes, patients report systemic symptoms, and our model elicits systemic disease by R. parkeri in mice. Thus, the model we describe recapitulates both an eschar and disseminated disease and is the first mouse model for R. parkeri that exhibits both of the disease manifestations mentioned by the reviewer.

      “On line 30 the authors state that mice are the natural reservoir of Rickettsia parkeri. The references cited describe the failure of acquisition by feeding ticks, meaning that it is not a true reservoir. The reference describing animals with antibodies merely indicates exposure to a spotted fever group Rickettsia not sufficient evidence of a role as a reservoir.”

      We thank the reviewer for making this important distinction and we have altered the text to read: “…small rodents including mice have been found as seropositive for R. parkeri in the wild.”

      “In response to the request for my expertise, I have contributed a large amount of data to understanding mechanisms of immunity to rickettsiae and have developed several useful animal models of Rickettsial diseases. I also have expertise on clinical aspects of spotted fever group rickettsioses, including the eschar.”

      **Referees cross commenting**

      “This is not the first Mouse model of rickettsiosis to contain an eschar. There is a model of Rickettsia parkeri transmitted by Amblyomma maculatum ticks in which eschars occur.”

      As noted above by us and also by Reviewer 3, we cited and discussed the tick transmission model in non-human primates (Banajee et al., 2015) in the Discussion. We also note to the reviewer the many advantages of our i.d. infection model, including how it will make these experiments more widely accessible, more reproducible, less expensive, faster, and enable the infection of mice with various genetic modifications.

      Reviewer #3 (Evidence, reproducibility and clarity (Required)):

      “This manuscript reports novel observations pertinent to development in inbred mice of an eschar lesion and generalized lethal infection following intradermal infection with Rickettsia parkeri, the mice are deficient in two types of interferon receptors. This is a new observation for the murine system and expands the existing repertoire of model infections for tick-borne rickettsiae. This study also reports that Sca2-mediated actin-based motility is required for R. parkeri dissemination and provides indirect evidence that OmpB protein is involved in eschar formation, thus corroborating previous knowledge about these major surface exposed antigens of rickettsiae and host cell interactions and host responses to these organisms.”

      “The study is rigorous and reliable as described and can be reproduced by others given availability of adequate funding, access to similar facilities, strains of mice and rickettsial mutants, and technical personnel with similar skills and training. There are no ethical or technical concerns.”

      We thank the reviewer for their thoughtful comments and for appreciating the advantages of this model.

      “The main limitation of the manuscript is due to the fact that histological and immunohistochemical analysis of the eschar was not performed; therefore, it is not clear if pathological processes and features of this lesion formation are the same or related to the human pathology.”

      We thank the reviewer for this suggestion. As a part of the revision plan, we propose to perform histological and immunohistochemical analysis of the eschar and will compare these findings to reported data from humans. We will also identify the cell types infected in the skin and internal organs in wild type and Ifnar-/-Ifngr-/- mice.

      “Similarly, in an attempt to generalize (as the authors try very hard), it is not clear how these observations will be relevant to rickettsial pathogens which are responsible for more severe forms of rickettsioses (such as R. rickettsii and R. prowazekii) but are not known to cause eschar formation as a part of their clinical manifestations.”

      Our findings with Sca2 are in agreement with findings on R. rickettsii Sca2 in guinea pigs (Kleba et al., 2010), which showed that Sca2 was required for eliciting fever and an antibody response. Our work also expands on these findings by showing that sca2 mutants immunize against rechallenge and by finding reduced bacterial burdens in internal organs after intradermal infection with sca2 mutant bacteria. Thus, we believe that studying R. parkeri genes in Ifnar-/-Ifngr-/- mice can serve as a model to better understand conserved virulence genes in diverse rickettsial pathogens.

      Beyond virulence genes, we note that our model also recapitulates systemic disease including dissemination to internal organs. Thus, it provides a platform to study disease manifestations beyond the eschar that may be relevant to other rickettsial pathogens including R. rickettsii and R. prowazekii.

      Some other virulent rickettsial pathogens cause limited/no disease in WT C57Bl/6 mice, including R. akari, R. conorii, R. typhi, and O. tsutsugamushi (reviewed in Osterloh, Med Microbiol Immunol 2017). Thus, Ifnar-/-Ifngr-/- mice may potentially serve as models for these pathogens. We now include this point in the Discussion.

      “The other deficiency is due to a limited description of the Sca2 and OmpB mutants used in this study. It was necessary to locate and review previous publications by this group in order to understand the experiments conducted here and their interpretation. It would be useful to the readers if this information (a better more complete description of the mutants and their properties) is summarized in this manuscript.”

      We have now provided a more complete description of the mutants in the Introduction and Results.

      Reviewer #3 (Significance (Required)):

      *“The study is relevant to investigators working in the field of rickettsial diseases and to a broader audience studying mechanisms of intracellular parasitism and host responses.

      The study argues that difference(s) in dermal IFN signaling mechanism(s) distinguish human and murine susceptibility to R. parkeri infection. This is a very useful speculation; however, a better and deeper discussion would be helpful to demonstrate the relevance of these observations and their connection(s) to events occurring during the course of human infections. Regrettably, there are almost no citations of classic or current literature addressing these aspects of rickettsial pathogenesis and the role of IFN-dependent mechanisms beyond self-citations. Overall, the discussion includes four relatively short paragraphs, each addressing different directions of possible research, which indicates ample possible utility of this murine model; however, a more coherent and convincing discussion is desirable.”*

      We thank the reviewer for the suggestion, and we have now expanded the Discussion to address the role for IFN-dependent mechanisms in humans and mice during rickettsial infections, including classic and current literature citations.

      **Referees cross commenting**

      “I agree with the Reviewer #2 that per se this is not the first murine model reproducing eschar upon A. maculatum transmission; however, this is the first model that allows to monitor eschar formation using needle inoculation. This model can be widely used; while many labs maybe limited by their facility setup and can't afford/conduct tick transmission experiments. The authors acknowledged existing of the tick transmission model and discuss inclusion of this option in their future experiments.”

      We thank the reviewer for recognizing the many advantages of this model.

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      This manuscript reports novel observations pertinent to development in inbred mice of an eschar lesion and generalized lethal infection following intradermal infection with Rickettsia parkeri, the mice are deficient in two types of interferon receptors. This is a new observation for the murine system and expands the existing repertoire of model infections for tick-borne rickettsiae. This study also reports that Sca2-mediated actin-based motility is required for R. parkeri dissemination, and provides indirect evidence that OmpB protein is involved in eschar formation, thus corroborating previous knowledge about these major surface exposed antigens of rickettsiae and host cell interactions and host responses to these organisms.

      The study is rigorous and reliable as described, and can be reproduced by others given availability of adequate funding, access to similar facilities, strains of mice and rickettsial mutants, and technical personnel with similar skills and training. There are no ethical or technical concerns.

      The main limitation of the manuscript is due to the fact that histological and immunohistochemical analysis of the eschar was not performed; therefore, it is not clear if pathological processes and features of this lesion formation are the same or related to the human pathology. Similarly, in an attempt to generalize (as the authors try very hard), it is not clear how these observations will be relevant to rickettsial pathogens which are responsible for more severe forms of rickettsioses (such as R. rickettsii and R. prowazekii) but are not known to cause eschar formation as a part of their clinical manifestations.

      The other deficiency is due to a limited description of the Sca2 and OmpB mutants used in this study. It was necessary to locate and review previous publications by this group in order to understand the experiments conducted here and their interpretation. It would be useful to the readers if this information (a better more complete description of the mutants and their properties) is summarized in this manuscript.

      Significance

      The study is relevant to investigators working in the field of rickettsial diseases, and to a broader audience studying mechanisms of intracellular parasitism and host responses.

      The study argues that difference(s) in dermal IFN signaling mechanism(s) distinguish human and murine susceptibility to R. parkeri infection. This is a very useful speculation; however, a better and deeper discussion would be helpful to demonstrate the relevance of these observations and their connection(s) to events occurring during the course of human infections. Regrettably, there are almost no citations of classic or current literature addressing these aspects of rickettsial pathogenesis and the role of IFN-dependent mechanisms beyond self-citations. Overall the discussion includes four relatively short paragraphs, each addressing different directions of possible research, which indicates ample possible utility of this murine model; however, a more coherent and convincing discussion is desirable.

      Referees cross commenting

      I agree with the Reviewer #2 that per se this is not the first murine model reproducing eschar upon A. maculatum transmission; however, this is the first model that allows to monitor eschar formation using needle inoculation. This model can be widely used; while many labs maybe limited by their facility setup and can't afford/conduct tick transmission experiments. The authors acknowledged existing of the tick transmission model and discuss inclusion of this option in their future experiments.

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      The manuscript utilizes a new model of spotted fever rickettsiosis. Using this model, the authors have determined that knockout of the sca2 or ompB gene attenuates Rickettsia parkeri, and vaccination with the attenuated rickettsiae provides protection against virulent challenge. However, the model is far less than ideal as it has eliminated important effectors of immunity. Manuscript also fails to recognize that there is a Amblyomma maculatum tick transmitted model of Rickettsia parkeri infection that causes an eschar and disseminated pathology. The model that they have used is inadequately characterized. The cutaneous lesion was not evaluated histologically to determine if it features the actual characteristics of an eschar. Although bacteria were found in the liver and spleen, in which macrophages are significant target, there was no evaluation of the vital organs including lung and brain nor demonstration of the target cells or pathologic lesions. Unfortunately the assay of vascular permeability was applied only to the inoculation site and not to the disseminated visceral organs such as lung and brain.

      Significance

      The authors all have misrepresented the eschar as a critically important lesion whereas the patients usually do not even know i's presence until they began to develop systemic symptoms and it is a detected by a physician examining the patient.

      On line 30 the authors state that mice are the natural reservoir of Rickettsia parkeri. The references cited describe the failure of acquisition by feeding ticks, meaning that it is not a true reservoir. The reference describing animals with antibodies merely indicates exposure to a spotted fever group Rickettsia not sufficient evidence of a role as a reservoir.

      In response to the request for my expertise, I have contributed a large amount of data to understanding mechanisms of immunity to rickettsiae and have developed several useful animal models of Rickettsial diseases. I also have expertise on clinical aspects of spotted fever group rickettsioses, including the eschar.

      Referees cross commenting

      This is not the first Mouse model of rickettsiosis to contain an eschar.There is a model of Rickettsia parkeri transmitted by Amblyomma maculatum ticks in which eschars occur.

    4. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      Rickettsial eschars are hallmarks of less severe spotted fever diseases. The underlying mechanisms involved in the formation of the eschar caused by pathogenic rickettsiae remains unknown. The authors of this manuscript studied this interesting research question by using Ifnar-/-Ifngr-/- mice and Sca 2 or OmpB mutant of R. parkeri. R. parkeri probably is the best rickettsial species to study rickettsial eschar due to the clinical features of R. parkeri rickettsioses and the biosafety level required to work with it. The data presented in the manuscript are very promising. The conclusions are supported by the presented results. For the first time, this study recapitulated human eschar-like skin lesion observed in patients with R. parkeri rickettsioses in the mouse models. More interestingly, mice inoculated with Sca2 mutant of R. parkeri i.d. had less disseminated rickettsiae in tissues, which helps us to understand the mechanisms by which pathogenic rickettsiae cause systemic infection after the arthropod bite.

      Minor comments:

      1)Figure 2D, it looks likely the lethality of mice i.d. infection with R. parkeri is not dose-dependent. For example, mice inoculated with 10^4 showed greater lethality compared to 10^7. The authors might want to explain it in the "Discussion".

      2)Line 202, innate immunity in vitro might need to be revised.

      3)It is unclear what is the unit of the inoculum in animal experiments, PFU?

      4)Line 36, in the study of "Reference 16", C3H/HeN mice, not B6 mice, were used.

      5)The conclusion on eschar will be greatly strengthened if histological analysis is included, particularly whether dermis necrosis is present or not.

      6)Line 357, it is not clear what "spinfection" means.

      Significance

      Several approaches employed in the study are new to the field of animal models of the rickettsioses. For example, fluorescent dextran was used to investigating the vascular damage in skin at the inoculation site; body temperature for mice infected with R. parkeri. Overall, the study is highly significant since it has answered the important questions in the research area of spotted fever rickettsioses and employed appropriate approaches. No major concerns was noticed.

      Referees cross commenting

      I agree with other reviewers' comments. Thanks for the invite.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      We would like to thank the reviewers for taking the time to carefully evaluate our manuscript. The paper will be significantly improved by their suggestions, and we are grateful for their perspectives.

      To address the reviewers’ concerns, we will complete additional control experiments and revise the manuscript as detailed below.

      Reviewer #1 (Evidence, reproducibility and clarity (Required)):

      In the present work Stumpff, Reinholdt and co-workers investigate the mechanism by which micronuclei contribute to tumorigenesis. Micronuclei are classic markers of genomic instability widely used in the diagnosis of cancer, but whether they work as drivers of the process has recently attracted significant attention due to their link with chromothripsis. Here, the Stumpff/Reinhold labs have explored an interesting model to test some ideas about the role of micronuclei as drivers of tumorigenesis, based on Kif18A/p53 double KO mice. They confirm the formation of micronuclei in these animals, but find no substantial increase in survival and tumor incidence relative to p53 KO animals, despite higher incidence of micronuclei in Kif18A/p53 KO tumors. They conclude that, per se, micronuclei do not have the capacity to form tumors, regardless of p53 status. This was surprising, given the well-established role of p53 in preventing the proliferation of micronucleated cells. To shed light into this apparent paradox, they compared micronuclei from Kif18A KO cells with micronuclei generated by a number of other experimental conditions that promote formation of anaphase lagging chromosomes or generates acentric fragments. They found that micronuclei derived from Kif18A are intrinsically different from micronuclei generated by those other means and essentially showed increased accumulation of lamin B, were more resistant to rupture and preserved the capacity to expand as cells exited mitosis. Of note, they find a correlation between chromosome proximity to the poles/main chromosome mass and the different features that characterize micronuclei from Kif18A KO cells, compared with the other experimental conditions in which late lagging chromosomes are more frequent. Overall, I find this study extremely interesting, well designed and executed in a rigorous way that characterizes the consistent solid work from these laboratories over the years. I have just few minor points that I recommend to be addressed prior to publication. 1-Abstract and main text lines 70 and 100: the authors indicate that Kif18A mutant mice produce micronuclei due to unaligned chromosomes. This is correct, but at the same time misleading. The authors should clarify that although micronuclei derive from compromised congression, I was convinced from previous works (Fonseca et al., JCB, 2019) that it was their asynchronous segregation in anaphase that led to micronuclei formation. As is, a less familiar reader may conceive that misaligned chromosomes directly result in micronuclei, for example by being detached from the main chromosome mass.

      We thank the reviewer for raising this point. We agree that micronuclei form in the absence of KIF18A due to chromosome alignment defects, which reduces interchromosomal compaction and leads to asynchronous arrival of chromosomes at spindle poles during anaphase. As the reviewer suggests, micronuclei form around chromosomes that travel longer distances and arrive late to the poles. We have revised the manuscript to clarify this (Lines 12-13, 72-73, 102).

      2-Page 2, line 59: "cells entering cell division...become fragmented". It is not the cells, but the chromosomes that fragment. Please correct.

      We have revised this wording to indicate it is the chromosomes within micronuclei which fragment (Line 60-63).

      3-Page 4, line 149: "reduced survival in the Kif18A null, p53 mice". P53 what? KO, WT? Please clarify.

      We have revised this wording as suggested, to read: “reduced survival in the Kif18agcd2/gcd2, p53-/- mice,” (Line 158).

      4-Page 5, line 212: the authors refer that micronuclei were scored for absence of lamin A/C, but previously they scored it as "continuous/discontinuous". Please clarify.

      Thank you for raising this question. When we scored lamin A/C, we noted cases where lamin A/C signal was incompletely present (not fully co-localizing with the micronuclear area, as indicated by DAPI). In these infrequent cases, micronuclei were identified as having “discontinuous” lamin A/C signal and were binned with those micronuclei lacking lamin A/C, for purposes of creating a binary readout of the micronuclear envelope: either 1) “intact” (having full, completely continuous lamin A/C signatures) or 2) “ruptured” (lacking a complete micronuclear signal of lamin A/C). We will update the text and the methods to more clearly reflect this categorization (Lines 221-225; 603-607).

      5-Page 6, line 243: "Kif18A is not required for micronuclear envelope rupture". Shouldn't it be micronuclear envelope "integrity"?

      We apologize for the confusion here. The experiment performed was designed to distinguish whether micronuclear envelopes are more stable in KIF18A KO cells or if KIF18A itself is somehow required for the rupture of all micronuclear envelopes to occur. Since nocodazole-induced micronuclei were able to rupture in KIF18A KO cells at similar frequencies to those seen in control cells, the data indicate that KIF18A is not required for the process of micronuclear envelope rupture. We modified the text to improve clarity (lines 252-253).

      6-One of the most interesting results of the paper is the correlation between envelope formation in micronuclei with their respective position relative to the poles/midzone. Could the authors try to investigate causality? For instance, the authors refer to works from other labs in which MT bundles and a midzone Aurora B activity gradient might play a role in the different features associated with micronuclei envelope formation, depending on their origin. Could the authors manipulate this gradient and investigate whether it changes the outcome in terms of nuclear envelope assembly properties on micronuclei? Are there any detectable features in midzone MT organization in Kif18A KO cells that would justify the observed differences?

      We agree that this result is very interesting. However, we feel the proposed experiments would repeat previous work and are somewhat outside the purview of the present study. Elegant experiments to address Aurora’s role in preventing micronucleus formation have already been performed using genetic approaches in Drosophila neuroblasts and small molecule inhibitors in mammalian cells and Drosophila S2 cells (PMIDs: 24925910, 25877868, and 29986897). Interpreting effects of Aurora B inhibition are complicated by the many critical roles Aurora B plays in ensuring proper and faithful chromosome segregation. Thus, experiments to precisely test Aurora’s effect on micronuclear envelope stability require addition of Aurora B inhibitors on a cell-by-cell basis, administered within a narrow window of minutes during anaphase. It would require significant effort to obtain enough cells from different experimental conditions to make a meaningful comparison.

      The suggestion to investigate detectable differences or features in midzone MT organization in KIF18A KO cells is also appreciated. We have not observed gross differences in midzone microtubules in KIF18A KO cells, but we will quantitatively evaluate this and add these results to the revised manuscript.

      Reviewer #1 (Significance (Required)):

      Kif18A plays a key role in chromosome alignment, without apparently affecting kinetochore-microtubule attachments in non-transformed cells. Because they cannot establish a proper metaphase plate Kif18A KO cells enter anaphase with highly asynchronous segregation due to non-uniform chromosome distribution along the spindle axis. Consequently, some "delayed" chromosomes form micronuclei, in cell culture and in vivo. Interestingly, prior art has failed to detect any increased signs of genomic instability in Kif18A KO cells and mice, and, contrary to what would be expected based on current trends, these mice do now show any signs of increased incidence of tumors, in fact they even show some protective effect to induced colitis-associated colorectal cancer. Noteworthy, all previous experimental works pointing to a role of micronuclei as key intermediates of genomic instability in cancer relied on models in which the tumor suppressor protein p53 had been inactivated. In the present work, the authors explore the relationship between micronuclei formation and p53 inactivation by investigating tumor formation in Kif18A/p53 double KO animals (1 or 2 alleles of p53 inactivated).The reported results are timely and will attract the interest of a broad readership, while decisively contributing to shed light into an ongoing debate. I am therefore all in favor for the publication of this work in any journal affiliated with review commons, pending some minor revisions.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)):

      Sepaniac and colleagues use in vivo and in vitro approaches to examine why micronuclei generated by lack of KIF18A activity do not promote tumorigenesis. The authors conclude that micronuclei in KIF18A depleted cells form stable micronuclear envelopes, which may be a result from lagging chromosomes being closer to the spindle pole when the micronuclear envelope forms. The authors further conclude that the stability of the micronuclei arising from lack of KIF18A can explain why Kif18a mutant mice do not develop tumors. These results also suggest that the consequences of micronuclei and their possible contribution to tumorigenesis depend on the context of their genesis. While the mouse model data and characterization of the stability of micronuclei generated by different insults support the conclusions, the lagging chromosome positioning data could be improved. Moreover, a number of other issues should be addressed prior to publication.

      **Major issues:**

      1.Line 153-155. The authors conclude that the slight reduction in overall survival is "due to a reduced ability of Kif18a mutants to cope with rapid tumorigenesis," but it is unclear why this would be the case. There is also an increase in micronucleated cells in thymic lymphomas from Kif18a/p53 homozygous mice (Fig. 2B)-could this not contribute? In Fig. 3C, the authors show that micronuclear rupture is similar in both Kif18a WT and mutant mice, so it seems possible that the increase in the frequency of micronuclei (Fig. 2B) coupled with a similar frequency of micronuclear rupture (Fig. 3C) could lead to the reduced survival. Then, in the discussion, the authors downplay this finding by saying (line 371) "loss of Kif18a had modest or no effect on survival of Trp53 homozygotes and heterozygotes." Why then speculate earlier in the text that loss of Kif18a reduces the ability to cope with tumorigenesis?

      We thank the reviewer for pointing out this issue. Our goal here was to try and explain why the Kif18a/p53 mutant homozygotes display a small but significant reduction in survival compared to p53 mutants, while the Kif18a mutation does not impact survival of p53 heterozygotes, which could be considered a more sensitive model for detecting decreased survival. Kif18a homozygous mutants do display a small reduction in survival shortly after birth compared to heterozygote and wild type littermates (PMID: 25824710). Thus, we can’t exclude the possibility that incompletely penetrant, postnatal lethality might be coincident with reduced fitness in surviving mutants, thus naming them more sensitive to loss of p53 loss of function. We have removed this statement form the revised text.

      However, the reviewer’s point that the combination of increased micronuclei in Kif18a/p53 homozygous mutants combined with a similar rupture rate seen in p53 mutants could also underlie or at least contribute to reduced survival is a good one. We have softened our conclusion in the Results section regarding the reduced survival of double homozygous mice (lines 158-164). We also agree that the way in which this point is addressed in the results and discussion sound contradictory. Thus, we have edited the language in the Discussion to improve consistency (lines 393-399).

      2.Related to the point above, the authors show in figure 3 that the micronuclei found in healthy tissues display infrequent membrane rupture (panel B). However, micronuclear membrane rupture in tumor tissues is much more frequent (panel C). How do the authors explain this? Do they hypothesize that the micronuclei in the tumors originate by mechanisms other than the misalignment caused by lack of KIF18A? Does KIF18A depletion cause aneuploidy due to segregation of two sisters to the same pole? If so, one could expect the tumors to be aneuploid (is this the case?) and aneuploidy has been shown by numerous groups to cause genomic instability. Such genomic instability could then explain the difference in membrane rupture.

      We agree that this is an interesting question. We plan to investigate several possible contributors to increased rupture in tumor cells in a separate study. As outlined in the Discussion (lines 443-458), we hypothesize that rupture could increase in tumor tissue due to changes in lamin expression or cytoskeletal forces in these cells. However, as the reviewer notes, differences in aneuploidy could also potentially explain the differences in membrane rupture observed in healthy (non-tumorous) and thymic lymphoma tissues. For example, an increase in chromosome number could lead to lagging chromosomes being positioned closer to the midzone in Kif18a mutant cells or, as the reviewer suggests, the micronuclei could occur in aneuploid tumors due mitotic defects other than misalignment. This may be difficult to determine unequivocally in primary cell or tissue samples. However, we do have a limited quantity of primary thymic lymphoma-derived cells and we will use these to initially investigate aneuploidy in the two genotypes. The results of these studies will be added to the final revised manuscript. In addition, we will incorporate a discussion of how aneuploidy may increase rupture frequency in tumors into the revised manuscript.

      3.The authors conclude that lagging chromosomes in KIF18A KO cells are found closer to the main chromatin mass. The Stumpff lab showed in a 2019 JCB paper that KIF18 KO cells have a chromosome alignment defect and as a result during anaphase the chromosomes can be scattered rather than forming the tight, uniform mass that is observed in WT cells. The scattering of kinetochores resulting from this phenotype could affect the value of "Avg Chromosomes Distances" in Fig 7B and the normalized distance in the KIF18A KO cells. Therefore, live-cell imaging experiments would be helpful to resolve this and possibly strengthen this conclusion. RPE1 cells with fluorescently tagged CENP-A and centrin could be used to ensure that the lagging chromosomes will not rejoin the main nucleus. Moreover, these cells could be used for correlative live-fixed cell experiments in which fixed cell analysis following micronucleus formation could be used to show that chromosomes that lag farther away from the spindle pole are more likely to have defective micronuclear envelopes.

      The reviewer’s concern that the unalignment phenotype, characteristic of KIF18A KO cells, may impact the value of average chromosome distances used to set a threshold for chromosomes meeting our definition of lagging is valid. To address this, we analyzed the standard deviations for chromosome-to-pole distances within half spindles of KIF18A KO and nocodazole-washout treated anaphase cells as a way to compare chromosome scattering in these two conditions. This analysis revealed no significant difference between the standard deviations of chromosome positions in the two groups, suggesting that scattering is similar in nocodazole treated and KIF18A KO cells. We have included these data in the manuscript (Line 351-356, and additional data added to Figure S2C).

      In order to further strengthen this conclusion, we are certainly willing to attempt the live cell imaging experiments suggested by the reviewer. We would like to point out that the frequency of micronucleus formation in the KIF18A KO cells is relatively low compared to the frequency seen after other experimental treatments (~7% of divisions result in a micronucleus). Thus, a large number of individual cells would need to be imaged with relatively high temporal resolution to make conclusions about the effects of chromosome position on micronuclear envelope formation (such analyses are not possible with the live data sets we currently have, where cells were imaged every 2 minutes). This difficulty led us to perform these measurements in synchronized and fixed cells to begin with.

      4.Based on the Fonseca et al. 2019 JCB paper (video 2), micronuclei from KIF18A KO do not exclusively arise from lagging chromosomes. Instead, chromosomes can also escape the main chromatin mass after segregation and subsequently be excluded from the main nucleus. It would be important to know what fraction of the micronuclei in KIF18A KO cells arise via lagging chromosomes. Since Aurora B and/or bundled microtubules at the spindle midzone are believed to prevent proper nuclear envelope formation, chromosomes that properly segregate but later become separated from the main nucleus would be more likely to form proper micronuclear envelopes than those arising from lagging chromosomes. The correlative microscopy experiment suggested in the previous point could allow differentiation between these two routes to micronucleus formation.

      The reviewer is correct that we did occasionally see chromosomes escape the main chromatin mass after segregation in the Fonseca et al., 2019 study referenced. We did not quantify the frequency of these events in that study, but they were rare. To address this quantitatively, we have measured the incidence of micronuclear formation around lagging chromosomes and chromosomes that escape the main chromatin mass after segregation in videos of KIF18A KO cells. We find that when micronuclei form in these cells, they form around lagging chromosomes 98% (46 out of 47 events) of the time. These data were derived from 4 live cell imaging experiments. This information has been added to the Results section (line 328-330).

      **Minor issues:**

      1.Some parts of the manuscript are excessively wordy and some sentences are unclear or convoluted (e.g., lines 148-153 and 238-239).

      Thank you for this feedback. We have revised the text in these two locations to improve clarity (lines 159-162 and 247-248 in the revised manuscript).

      2.Lines 59-61. This sentence is formulated incorrectly. First of all, the subject of the sentence is "cells" and the verb is "can become fragmented." However, the authors mean that the DNA in the micronucleus can become fragmented (not the cells). Moreover, the way the sentence is currently formulated seems to suggested that the fragmentation occurs during cell division. However, this is not the case. Please, revise the text to make it more accurate.

      We appreciate this point and have revised this text to reflect more precise language to describe this model. It is certainly the micronucleated chromatin which may become fragmented, and this fragmentation occurs as a result of replication stress, including replication fork collapse, after an existing micronucleated cell enters a subsequent round of S or G2 phase (PMIDs: 22258507, 26017310).

      3.Lines 114-115. Please, provide references in support of this statement.

      The statement in question: “This arrest was at least partially dependent on p53, consistent with other reports of cell cycle arrest following micronucleation,” shares the same references as the sentence that follows it (Sablina 1998, Thompson and Compton, 2010; Fonseca et al., 2019). We have updated the references to appear after the first statement to make this clear.

      4.Line 153. The authors refer to Fig. 1C, but I think they mean Fig. 1B.

      Thank you, we have updated the text to read Fig 1B.

      5.Line 324. the authors find that RPE1 KIF18A KO cells have lagging chromosomes in ana/telophase 9% of the time, then say that this shows that lagging chromosomes are rare in KIF18A KO cells. However, this is a large increase compared to normal RPE1 cells, which only have 1-2% frequency of lagging chromosomes. So, they should revise the text here to say that the rates of lagging chromosomes from KIF18A KO are lower compared to the rates induced by nocodazole washout.

      This is an important distinction. We have removed this confusing statement from the revised text (lines 336-338).

      6.Line 383. The references listed here should be moved earlier and specifically after the statement summarizing the results of the studies instead of being listed after the authors' conclusion/interpretation of the data. The same issue was noted in other parts of the manuscript.

      We have corrected this error (Lines 402-408). Before final submission, we will further amend the style of the manuscript throughout to cite relevant papers after the statement summarizing the results of those studies, rather than after our interpretation of the studies.

      7.Figure 1A. In the text, the authors say they cross a Kif18a heterozygous mutant mouse with a p53 heterozygous mutant mouse, but the two mice in this figure are already heterozygous for both. Please, revise the text or depict the previous additional cross necessary to obtain the double heterozygous.

      We thank the reviewer for catching this discrepancy. We have revised the text to describe the crosses necessary to obtain the double heterozygous mice shown in the figure (lines 121-123). The gcd2 mutation in Kif18a was named due to the “germ cell depleted” phenotype it causes. These homozygous mice are therefore infertile (Czechanski et al., 2015). For this reason, heterozygous mice for each gene were crossed to achieve the necessary homozygous progeny.

      8.Figure 3A. Arrows or dotted circles outlining the micronuclei in the insets of the middle and bottom rows would be helpful since the DAPI signal in the micronuclei is low and somewhat difficult to see.

      We have updated these figures as suggested to more clearly indicate the micronuclear area.

      9.Figure 3B. Error bars should be added to the graph. Moreover, the authors noted that the differences are not significant. However, this seems surprising, given that in some cases there is a three- to five-fold difference between certain pairs. Indeed, a chi-square test using the numbers from table S1 indicated p values We appreciate this feedback on the statistical tests and comparisons among these data. The main point of these analyses is to demonstrate that tissues other than blood form micronuclei in vivo in the absence of Kif18a function and that the majority of these micronuclear envelopes are completely surrounded by Lamin A/C. The data presented in Figure 3B were obtained by counting several tissue types from a single mouse of each genotype. Thus, we do not believe that error bars are appropriate in this context. To avoid confusion, we have also removed the statistical bars which had indicated no significant differences in rupture frequency among the genotypes in each sampled tissue, as these are also probably inappropriate.

      We understand the reviewer’s point that some pairwise comparisons of the data in Table S1 indicate that they are significantly different. We originally used a Chi-square test to compare the data from all three genotypes for each tissue. Because these data did not rise to the threshold of significance necessary to reject the null hypothesis across all three genotypes within each individual tissue type, we did not think performing pairwise comparisons between only two of those genotypes was appropriate (Whitlock and Schluter, The Analysis of Biological Data, 2009). Specifically, analyses of rupture frequency for spleen, liver, and thymus tissue gave p-values above 0.05 (spleen, p = 0.35; liver, p = 0.056; thymus, p = 0.052). Thus, we did not proceed with pairwise comparisons. In contrast, the analyses of p53 effects on micronucleus levels in peripheral blood in Fig 1D utilized samples from 8 individual mice for each genotype, and are therefore more amenable to statistical comparisons. If the reviewer believes any of the details of this approach are incorrect, we are happy to revise the analyses.

      10.Figure 5G. When referring to this figure (lines 292-294), the authors talk about correlation. However, the points in this graph seem to be scattered a bit randomly.

      To address this concern, we performed a Pearson’s correlation test on the data in Figure 5G. As suspected by the reviewer, this analysis did not indicate a significant correlation, and we have removed this plot from the manuscript.

      11.Figure 6B-D. The Y-axis titles of the three graphs are a bit confusing. Please, consider revising.

      We have updated the Y-axis titles for these graphs to more accurately represent what is displayed on each plot.

      12.In Figure 7 and the text, the authors use the terms "late-lagging" and "lagging" chromosomes interchangeably, which is somewhat confusing in this context because lagging chromosome distance from the main chromosome mass is thought to contribute to defective assembly of micronuclear envelopes. It is not clear whether the authors intend to indicate, with this term, that the lagging chromosome is farther away from the main chromosome mass or that the lagging chromosome is in a "late" anaphase cell. Because this is confusing, I suggest just using the term "lagging chromosome" consistently. It could be useful to include representative images of lagging chromosomes located at different distances from the main chromosome mass. And certainly, the authors should include an example of a lagging chromosome in the KIF18A KO cells.

      We agree with the reviewer’s concern regarding confusion of these terms. We have updated the text to use the term “lagging chromosome” consistently, as the reviewer suggests. We have also updated Figure 7A to include a representative image of a lagging chromosome in a KIF18A KO cell.

      13.Figure S2A. The example in the bottom right image looks more like a chromosome bridge than a lagging chromosomes. Kinetochore staining is necessary to unequivocally identify lagging chromosomes.

      We agree with the reviewer that kinetochore staining is necessary to precisely identify lagging chromosomes. We had used these images to quickly and crudely assess the presence and frequency of potentially lagging chromosomes, observed in late-anaphase cells by eye, and for subsequent experiments where lagging chromosomes were measured, repeated these experiments with proper staining of poles and kinetochores to make precise, quantifiable assessments. Reviewer #2 (Significance (Required)):

      Based on the previous knowledge on the factors that cause abnormal assembly of the micronuclear membrane, the results presented in this study were somewhat predictable. However, these findings will add to the knowledge of how micronuclei form and the potential factors that lead to micronuclear membrane rupture. Previous studies investigating micronucleus behavior have focused on micronuclei arising via merotelic kinetochore mis-attachments. These mis-attachments lead to formation of micronuclei close to the spindle midzone. In the present study, instead, the micronuclei arising from lack of KIF18A activity form farther away from the spindle midzone. The results presented here suggest that the positioning of these micronuclei farther away from the midzone enables assembly of a more stable micronuclear membrane that will be less likely to rupture during the following cell cycle. A recent study showed that the microtubule bundles in the spindle midzone interfere with micronuclear membrane assembly. Based on this, it is not surprising that micronuclei forming away from the spindle midzone (like those resulting from lack of KIF18A activity) assemble more normal membranes. Although somewhat expected, this study provides the actual data in support of this phenomenon. This study will be of interest to cell biologists interested in cell division and genomic instability. My research has focused on cell division, aneuploidy, and chromosomal instability for nearly thirty years. Therefore, I believe I am fully qualified to evaluate this manuscript.

      **Referees cross-commenting**

      My areas of expertise do not include nuclear membrane structure and function. Therefore, I encourage the authors to consider the comments of reviewer #3 for issues related to reliable quantification of micronuclear membrane rupture.

      Reviewer #3 (Evidence, reproducibility and clarity (Required)):

      **Summary** Sepaniac et al demonstrate that loss of KIF18a, a motor protein required for proper chromosome congression and chromatin compaction during mitosis, is insufficient to drive tumor development in mice although it does increase the frequency of micronuclei (MN), nuclear compartments that form around broken or missegregated chromosomes, in both normal and tumor tissue. MN are thought to increase genome instability and metastasis by undergoing DNA damage and activating innate immune signaling after irreparable nuclear membrane rupture. The authors use a non-transformed human cell line, hTERT-RPE-1, with KIF18a knocked out to demonstrate that MN formed as a result of KIF18a loss have more stable nuclear membranes than MN generated by other methods. They go on to correlate this increased stability with increased chromosome proximity to the main chromatin mass during nuclear envelope assembly and increased chromatin decompaction by a combination of fixed and live cell imaging.

      **Major Comments**

      1.This study relies heavily on the use of lamin A loss or discontinuity to identify ruptured micronuclei. Although the authors validate this marker against "leakage" of the soluble nuclear protein mCherry-NLS, there are several lines of evidence suggesting that lamin A loss or disruption is not a reliable reporter. In figure S3C, the top two panels of intact MN in the KIF18KO appear ruptured based on the gH2AX labeling, yet have significant levels of lamin A and are labeled as intact. In figure 4D, the rate of MN rupture after nocodazole release (60% ruptured in 2 hours) is much faster than that reported in other papers (40-60% in 16-18 hours, Liu et al; 60% in 16 hours; Hatch et al). In addition, images in Hatch et al, 2013 show lamin A localizing to both intact and ruptured MN and anecdotal information in the field suggests that lamin A localization is not a reliable reporter.

      These discrepancies may be due to how the authors' define "mCherry-NLS leakage", which needs to be defined in the methods as previous studies have demonstrated that MN frequently have delayed or reduced nuclear import even though the membrane is intact. Regardless, the authors need to provide compelling independent evidence that lamin A loss and disruption faithfully recognize ruptured MN by either validating this marker against additional rupture reporters, such as Lap2, LBR, or emerin accumulation, or by repeating key experiments in cells expressing mCherry-NLS.

      Our decision to use lamin A/C as a reporter was based on its use as a marker for micronuclear envelope presence in prior studies (Hatch, 2013; Liu, 2018). We were unaware of anecdotal information in the field that suggests that lamin A localization may not be a reliable reporter.

      However, we think we understand the reviewer’s point to be that although it is clear from prior studies that gaps in the nuclear lamina are a known predictor of micronuclear rupture, these gaps can persist for some time before rupture has actually occurred. We agree that this is an important distinction and thank the reviewer for raising these questions.

      As the reviewer notes, we performed control experiments to address this issue and validate the use of lamin A/C as a marker of micronuclear envelope rupture. Our approach involved correlating lamin staining with the localization of mCherry-NLS signal to the micronucleus (Figure S1). We found that these signals correlated well. As the reviewer points out, this analysis in fixed cells could be misleading in cases where nuclear import is reduced, but the micronuclear envelope is intact. If this were a significant contributor, we may have expected to see greater instances of micronuclei that exhibit continuous lamin A/C signal but lack nuclear localization of mCherry-NLS. However, we found this combination was rare among the KIF18A and RPE1 nocodazole washout treated cells (2%, or 1 of 46 micronuclei had continuous lamin A/C while lacking mCherry-NLS). We admit that this assumption may be oversimplified though.

      The reviewer’s point about the timing of nocodazole treatment and washout something we have definitely considered. We note that prior studies have used differing time points after nocodazole treatment and release. For Hatch et al., 2013: U2OS cells were treated for 6 hours with nocodazole and then subjected to mitotic shakeoff, 48% of micronuclei were ruptured after 6 hours and ~60% were ruptured after 16 hours. Similarly, in Liu et al., 2018 60% of micronuclei were ruptured 16 hours post mitotic shake off and nocodazole release. While these results suggest that rupture increases with time after mitosis, it isn’t clear how early rupture may occur. In other words, does it take several hours in G2 before nearly half of micronuclei rupture or do many of these rupture shortly after cell division?

      We note that other explanations could also potentially contribute to the differences in rupture rates reported in our study compared to those in previous publications. For example, we used a short nocodazole treatment (2 hrs) compared to the longer treatments (6 hrs) used in previous studies. We did this originally in order to produce a similar percentage of micronucleated cells as is seen in KIF18A KO cell populations. However, the difference in nocadozole treatment length could potentially influence the types and frequencies of kinetochore microtubule attachments formed. For example, if centrosomes stay closer together in mitotic cells after short nocodazole treatments, this could increase the number of abnormal attachments (e.g. PMID: 22130796). Such an effect would be expected to increase the frequency of lagging chromosomes and/or potentially produce more lagging chromosomes within the anaphase midzone.

      The best way to address this issue would be to repeat our analyses of mcherry-NLS in live cells to track the formation and rupture of micronuclei. We did attempt these live imaging experiments previously and have found this experiment challenging due to: 1) the low frequency of micronuclear formation in KIF18A KO cell population; 2) a low transfection/expression efficiency for the mCherry-NLS plasmid in RPE1 cells, and 3) photobleaching of the mCherry-NLS plasmid. For these reasons, we transitioned into fixed cell experiments for the mCherry-NLS reporter. However, we propose to troubleshoot this assay and attempt to obtain the data necessary to determine when rupture is occurring. In addition, we will use additional markers to investigate micronuclear envelope stability, as the reviewer has suggested.

      Regardless of the outcome of these experiments, we have measured a clear difference between the lamin deposition within micronuclear envelopes of KIF18A KO cells compared to those formed following other insults. Lamin recruitment is well established as a predictor of nuclear envelope stability. If necessary, we could alter the text to indicate that the presence of lamin A/C and B within micronuclear envelopes of KIF18A KO cells are indicative of nuclear envelope stability, and that this is distinct from the lamin profiles of micronuclei in cells subjected to nocodazole-washout.

      2.Micronuclei in tumor sections and other dense tissues can appear very similar to other types of chromatin, including blebs from adjacent nuclei and dead cells. To verify that the quantified structures are bona fide micronuclei, the authors need to include a marker for the cell boundary. This is especially critical in the lamin a stained tumor sections with heterogenous lamin A protein expression.

      We appreciate the point this reviewer raises and we carefully considered accurate identification of micronuclei in tissues. Three optical sections were collected from each sample. During analyses, we scrolled through the ~2-micron thick sections to exclude chromatin bodies connected to an out-of-plane nucleus or nuclear bleb. We have a limited number of sectioned and preserved thymic lymphoma tissues remaining. We will use these samples to reassess micronuclear frequency in the presence of a cell boundary marker.

      3.Figure 4 compares MN rupture frequency between cells treated with different inducers of micronuclei - KIF18A KO, nocodazole release, and irradiation. These treatments have different effects on the cell cycle: KIF18A causes minor delays, nocodazole arrests cells in mitosis, and g-IR likely causes delays in S and G2. Since MN rupture frequency increases with the duration of interphase, the authors need to assess rupture frequency at similar time points after mitosis for all three conditions. One way to accomplish this would be to repeat this experiment and analyze cells collected by mitotic cells by shake-off prior to fixation and labeling.

      We appreciate this point regarding differences in mitotic timing. Since micronuclear rupture frequency increases with time in interphase, we would expect the MN in KIF18A KO cells to exhibit the highest level of rupture if cell cycle timing were the primary variable affecting stability in our experiments. KIF18A KO cells are asynchronously dividing, and the micronuclei examined in populations of those cells could have been generated at any time. We do not have the same type of temporal control of these events as we do with drug treatment. In contrast, the vast majority of the MN in nocodazole washout cells would not have been in interphase for more than 1.5 hours in our experiments, yet showed increased lamin A/C defects. RPE1 cells treated with MAD2 siRNA knockdown, which do not experience mitotic delays (PMID: 9606211; 15239953), also showed greater frequencies of micronuclear envelopes which lacked lamin A/C compared to those arising in KIF18A KO cells.

      To further address this question, we could attempt a mitotic shake-off assay, however, we believe that the formation of micronuclei, as a percentage in the population of KIF18A KO cells, will be limiting in these experiments.

      As an alternative, we propose to use live cell imaging to follow micronuclear formation and rupture, as described above in reference to point 1.

      **Minor Comments**

      1.In figure 6A, it is unclear when the videos start and how micronuclei are selected for analysis. Do the micronuclei have to be continuously visible from the time they missegregate? Do the videos all start at the same time point during mitosis or is it contingent on when the MN appears separated from the main nucleus? One concern is that a consistent delay in micronucleus appearance in the nocodazole treated cells could artificially decrease the amount of MN expansion observed.

      We thank the reviewer for these questions. The individual micronuclei did not need to be continuously visible from the time that they missegregated, though the majority were. When a micronucleus was not sufficiently in the plane of focus for an accurate area measurement, the individual measurement at that time point was not collected. In cases where one or more frames which were not measurable, a micronucleus was only included in the final data set if it was 1) the only micronucleus present in the daughter cell or 2) easily identifiable to be the same micronucleus. Measurements were taken until the micronuclear area reached an equilibrium for several frames. Final fold change in area was established by dividing final area measurements by initial measurements.

      The initial measurement for each micronucleus taken from the videos all start at the same relative point during mitosis, which is just after chromosome segregation has occurred.

      2.In figure 7A, it is difficult to identify the "lagging" chromosome in the top panel. It would be helpful to label the chromosome that becomes the MN, or ideally, to include a video or still images to demonstrate how micronuclei form in the KIF18A KO cells.

      We have updated the images in Figure 7A to include an example of a lagging chromosome in a KIF18A KO cell. We will also include a more explicit reference to our previous study (Fonseca et al., 2019), which described how micronuclei form around lagging chromosomes in KIF18A KO RPE1 cells.

      3.The two image panels in figure 7A are imaged at significantly different times during anaphase (early anaphase on bottom versus late anaphase/telophase on top). A better comparison would be between two cells at the same time point in anaphase.

      We have updated the images in Figure 7A to compare cells at similar stages of anaphase. In our quantification of lagging chromosomes, we also accounted for anaphase-timing differences by normalizing all measurements within each half-spindle.

      Reviewer #3 (Significance (Required)):

      In this study, the authors identify chromatin decondensation in micronuclei as a new predictor of membrane stability. Although these results are correlative, if their micronucleus rupture results can be validated as described in major comment 1, this study would advance our understanding of the micronucleus rupture mechanism by linking mitotic spindle location, chromatin decondensation, and lamin B1 protein recruitment. This would provide needed support to a current model in the field that micronucleus stability is largely determined during nuclear envelope assembly. In addition, if KIF18a loss generates stable micronuclei at high frequency, it will become a critical system for testing MN rupture hypotheses in the field. Thus, this work would be of significant interest to cell biologists working on nuclear envelope structure and function, chromosome organization, and mitosis. I include myself in this group as a cell biologist studying nuclear envelope structure and function with an expertise in membrane dynamics. The authors also find that mice mutant for KIF18a have increased micronucleation in normal tissues but not increased tumor initiation. They hypothesize that this is due to the low rupture frequency of KIF18a-induced MN, however their data cannot reject the null hypothesis that the small increase in MN they see in KIF18a mutant mice would be insufficient to induce tumorigenesis even if rupture frequency was high. Thus the significance of their finding that micronucleation is not sufficient for cancer progression is unclear. However, the thorough analysis of micronucleation and rupture in several healthy tissues as well as a tumor model in KIF18 mutant mice would be of interest to both pathologists and cancer researchers focused on mechanisms of genome instability. These types of experiments are critical to determine how micronuclei contribute to cancer progression and the quantifications presented in this paper are truly impressive.

      We appreciate this reviewer’s enthusiasm for our work and acknowledge that we cannot definitively conclude that micronuclear envelope stability explains why Kif18a mutant mice do not form tumors. However, it is interesting to note that the micronuclear loads measured using a peripheral erythrocyte assay are similar in Kif18agcd2/gcd2 mutant mice (0.6% micronucleated erythrocytes, of total erythrocytes) and ATMtm1 Awb/tm1 Awb mutant mice (0.6% of micronucleated erythrocytes, of total) (Fonseca et al., 2019). Yet, the tumor frequency in these two models is dramatically different: Kif18agcd2/gcd2 mutant mice do not spontaneously form tumors – while the majority of ATMtm1 Awb/tm1 Awb mutant mice do develop thymic lymphoma tumors between 2 and 4 months (Barlow, 1996). It is not clear how much micronuclei contribute to tumorigenesis in the ATM mutant model, but this comparison does suggest that the increase in MN seen in Kif18a mutants may be physiologically relevant. We have added this information to the revised text (lines 125-130).

      **Referees cross-commenting**

      I agree with the concerns raised by the other 2 reviewers, especially their comments about the need to clarify the mechanism of chromosome lagging versus chromosome congression and compaction. I think that all of these suggestions, though, are contingent on them being able to reproduce their micronucleus rupture results with a better marker of nucleus integrity. I strongly believe that additional validation of lamin A as a micronucleus rupture marker will demonstrate that it is unreliable, based both on our own observations in RPE-1 cells and the images they show

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      Summary

      Sepaniac et al demonstrate that loss of KIF18a, a motor protein required for proper chromosome congression and chromatin compaction during mitosis, is insufficient to drive tumor development in mice although it does increase the frequency of micronuclei (MN), nuclear compartments that form around broken or missegregated chromosomes, in both normal and tumor tissue. MN are thought to increase genome instability and metastasis by undergoing DNA damage and activating innate immune signaling after irreparable nuclear membrane rupture. The authors use a non-transformed human cell line, hTERT-RPE-1, with KIF18a knocked out to demonstrate that MN formed as a result of KIF18a loss have more stable nuclear membranes than MN generated by other methods. They go on to correlate this increased stability with increased chromosome proximity to the main chromatin mass during nuclear envelope assembly and increased chromatin decompaction by a combination of fixed and live cell imaging.

      Major Comments

      1.This study relies heavily on the use of lamin A loss or discontinuity to identify ruptured micronuclei. Although the authors validate this marker against "leakage" of the soluble nuclear protein mCherry-NLS, there are several lines of evidence suggesting that lamin A loss or disruption is not a reliable reporter. In figure S3C, the top two panels of intact MN in the KIF18KO appear ruptured based on the gH2AX labeling, yet have significant levels of lamin A and are labeled as intact. In figure 4D, the rate of MN rupture after nocodazole release (60% ruptured in 2 hours) is much faster than that reported in other papers (40-60% in 16-18 hours, Liu et al; 60% in 16 hours; Hatch et al). In addition, images in Hatch et al, 2013 show lamin A localizing to both intact and ruptured MN and anecdotal information in the field suggests that lamin A localization is not a reliable reporter.

      These discrepancies may be due to how the authors' define "mCherry-NLS leakage", which needs to be defined in the methods as previous studies have demonstrated that MN frequently have delayed or reduced nuclear import even though the membrane is intact. Regardless, the authors need to provide compelling independent evidence that lamin A loss and disruption faithfully recognize ruptured MN by either validating this marker against additional rupture reporters, such as Lap2, LBR, or emerin accumulation, or by repeating key experiments in cells expressing mCherry-NLS.

      2.Micronuclei in tumor sections and other dense tissues can appear very similar to other types of chromatin, including blebs from adjacent nuclei and dead cells. To verify that the quantified structures are bona fide micronuclei, the authors need to include a marker for the cell boundary. This is especially critical in the lamin a stained tumor sections with heterogenous lamin A protein expression.

      3.Figure 4 compares MN rupture frequency between cells treated with different inducers of micronuclei - KIF18A KO, nocodazole release, and irradiation. These treatments have different effects on the cell cycle: KIF18A causes minor delays, nocodazole arrests cells in mitosis, and g-IR likely causes delays in S and G2. Since MN rupture frequency increases with the duration of interphase, the authors need to assess rupture frequency at similar time points after mitosis for all three conditions. One way to accomplish this would be to repeat this experiment and analyze cells collected by mitotic cells by shake-off prior to fixation and labeling.

      Minor Comments

      1.In figure 6A, it is unclear when the videos start and how micronuclei are selected for analysis. Do the micronuclei have to be continuously visible from the time they missegregate? Do the videos all start at the same time point during mitosis or is it contingent on when the MN appears separated from the main nucleus? One concern is that a consistent delay in micronucleus appearance in the nocodazole treated cells could artificially decrease the amount of MN expansion observed.

      2.In figure 7A, it is difficult to identify the "lagging" chromosome in the top panel. It would be helpful to label the chromosome that becomes the MN, or ideally, to include a video or still images to demonstrate how micronuclei form in the KIF18A KO cells.

      3.The two image panels in figure 7A are imaged at significantly different times during anaphase (early anaphase on bottom versus late anaphase/telophase on top). A better comparison would be between two cells at the same time point in anaphase.

      Significance

      In this study, the authors identify chromatin decondensation in micronuclei as a new predictor of membrane stability. Although these results are correlative, if their micronucleus rupture results can be validated as described in major comment 1, this study would advance our understanding of the micronucleus rupture mechanism by linking mitotic spindle location, chromatin decondensation, and lamin B1 protein recruitment. This would provide needed support to a current model in the field that micronucleus stability is largely determined during nuclear envelope assembly. In addition, if KIF18a loss generates stable micronuclei at high frequency, it will become a critical system for testing MN rupture hypotheses in the field. Thus, this work would be of significant interest to cell biologists working on nuclear envelope structure and function, chromosome organization, and mitosis. I include myself in this group as a cell biologist studying nuclear envelope structure and function with an expertise in membrane dynamics.

      The authors also find that mice mutant for KIF18a have increased micronucleation in normal tissues but not increased tumor initiation. They hypothesize that this is due to the low rupture frequency of KIF18a-induced MN, however their data cannot reject the null hypothesis that the small increase in MN they see in KIF18a mutant mice would be insufficient to induce tumorigenesis even if rupture frequency was high. Thus the significance of their finding that micronucleation is not sufficient for cancer progression is unclear. However, the thorough analysis of micronucleation and rupture in several healthy tissues as well as a tumor model in KIF18 mutant mice would be of interest to both pathologists and cancer researchers focused on mechanisms of genome instability. These types of experiments are critical to determine how micronuclei contribute to cancer progression and the quantifications presented in this paper are truly impressive.

      Referees cross-commenting

      I agree with the concerns raised by the other 2 reviewers, especially their comments about the need to clarify the mechanism of chromosome lagging versus chromosome congression and compaction.

      I think that all of these suggestions, though, are contingent on them being able to reproduce their micronucleus rupture results with a better marker of nucleus integrity. I strongly believe that additional validation of lamin A as a micronucleus rupture marker will demonstrate that it is unreliable, based both on our own observations in RPE-1 cells and the images they show

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      Sepaniac and colleagues use in vivo and in vitro approaches to examine why micronuclei generated by lack of KIF18A activity do not promote tumorigenesis. The authors conclude that micronuclei in KIF18A depleted cells form stable micronuclear envelopes, which may be a result from lagging chromosomes being closer to the spindle pole when the micronuclear envelope forms. The authors further conclude that the stability of the micronuclei arising from lack of KIF18A can explain why Kif18a mutant mice do not develop tumors. These results also suggest that the consequences of micronuclei and their possible contribution to tumorigenesis depend on the context of their genesis. While the mouse model data and characterization of the stability of micronuclei generated by different insults support the conclusions, the lagging chromosome positioning data could be improved. Moreover, a number of other issues should be addressed prior to publication.

      Major issues:

      1.Line 153-155. The authors conclude that the slight reduction in overall survival is "due to a reduced ability of Kif18a mutants to cope with rapid tumorigenesis," but it is unclear why this would be the case. There is also an increase in micronucleated cells in thymic lymphomas from Kif18a/p53 homozygous mice (Fig. 2B)-could this not contribute? In Fig. 3C, the authors show that micronuclear rupture is similar in both Kif18a WT and mutant mice, so it seems possible that the increase in the frequency of micronuclei (Fig. 2B) coupled with a similar frequency of micronuclear rupture (Fig. 3C) could lead to the reduced survival. Then, in the discussion, the authors downplay this finding by saying (line 371) "loss of Kif18a had modest or no effect on survival of Trp53 homozygotes and heterozygotes." Why then speculate earlier in the text that loss of Kif18a reduces the ability to cope with tumorigenesis?

      2.Related to the point above, the authors show in figure 3 that the micronuclei found in healthy tissues display infrequent membrane rupture (panel B). However, micronuclear membrane rupture in tumor tissues is much more frequent (panel C). How do the authors explain this? Do they hypothesize that the micronuclei in the tumors originate by mechanisms other than the misalignment caused by lack of KIF18A? Does KIF18A depletion cause aneuploidy due to segregation of two sisters to the same pole? If so, one could expect the tumors to be aneuploid (is this the case?) and aneuploidy has been shown by numerous groups to cause genomic instability. Such genomic instability could then explain the difference in membrane rupture.

      3.The authors conclude that lagging chromosomes in KIF18A KO cells are found closer to the main chromatin mass. The Stumpff lab showed in a 2019 JCB paper that KIF18 KO cells have a chromosome alignment defect and as a result during anaphase the chromosomes can be scattered rather than forming the tight, uniform mass that is observed in WT cells. The scattering of kinetochores resulting from this phenotype could affect the value of "Avg Chromosomes Distances" in Fig 7B and the normalized distance in the KIF18A KO cells. Therefore, live-cell imaging experiments would be helpful to resolve this and possibly strengthen this conclusion. RPE1 cells with fluorescently tagged CENP-A and centrin could be used to ensure that the lagging chromosomes will not rejoin the main nucleus. Moreover, these cells could be used for correlative live-fixed cell experiments in which fixed cell analysis following micronucleus formation could be used to show that chromosomes that lag farther away from the spindle pole are more likely to have defective micronuclear envelopes.

      4.Based on the Fonseca et al. 2019 JCB paper (video 2), micronuclei from KIF18A KO do not exclusively arise from lagging chromosomes. Instead, chromosomes can also escape the main chromatin mass after segregation and subsequently be excluded from the main nucleus. It would be important to know what fraction of the micronuclei in KIF18A KO cells arise via lagging chromosomes. Since Aurora B and/or bundled microtubules at the spindle midzone are believed to prevent proper nuclear envelope formation, chromosomes that properly segregate but later become separated from the main nucleus would be more likely to form proper micronuclear envelopes than those arising from lagging chromosomes. The correlative microscopy experiment suggested in the previous point could allow differentiation between these two routes to micronucleus formation.

      Minor issues:

      1.Some parts of the manuscript are excessively wordy and some sentences are unclear or convoluted (e.g., lines 148-153 and 238-239).

      2.Lines 59-61. This sentence is formulated incorrectly. First of all, the subject of the sentence is "cells" and the verb is "can become fragmented." However, the authors mean that the DNA in the micronucleus can become fragmented (not the cells). Moreover, the way the sentence is currently formulated seems to suggested that the fragmentation occurs during cell division. However, this is not the case. Please, revise the text to make it more accurate.

      3.Lines 114-115. Please, provide references in support of this statement.

      4.Line 153. The authors refer to Fig. 1C, but I think they mean Fig. 1B.

      5.Line 324. the authors find that RPE1 KIF18A KO cells have lagging chromosomes in ana/telophase 9% of the time, then say that this shows that lagging chromosomes are rare in KIF18A KO cells. However, this is a large increase compared to normal RPE1 cells, which only have 1-2% frequency of lagging chromosomes. So, they should revise the text here to say that the rates of lagging chromosomes from KIF18A KO are lower compared to the rates induced by nocodazole washout.

      6.Line 383. The references listed here should be moved earlier and specifically after the statement summarizing the results of the studies instead of being listed after the authors' conclusion/interpretation of the data. The same issue was noted in other parts of the manuscript.

      7.Figure 1A. In the text, the authors say they cross a Kif18a heterozygous mutant mouse with a p53 heterozygous mutant mouse, but the two mice in this figure are already heterozygous for both. Please, revise the text or depict the previous additional cross necessary to obtain the double heterozygous.

      8.Figure 3A. Arrows or dotted circles outlining the micronuclei in the insets of the middle and bottom rows would be helpful since the DAPI signal in the micronuclei is low and somewhat difficult to see.

      9.Figure 3B. Error bars should be added to the graph. Moreover, the authors noted that the differences are not significant. However, this seems surprising, given that in some cases there is a three- to five-fold difference between certain pairs. Indeed, a chi-square test using the numbers from table S1 indicated p values <0.05 for several pairwise comparisons.

      10.Figure 5G. When referring to this figure (lines 292-294), the authors talk about correlation. However, the points in this graph seem to be scattered a bit randomly.

      11.Figure 6B-D. The Y-axis titles of the three graphs are a bit confusing. Please, consider revising.

      12.In Figure 7 and the text, the authors use the terms "late-lagging" and "lagging" chromosomes interchangeably, which is somewhat confusing in this context because lagging chromosome distance from the main chromosome mass is thought to contribute to defective assembly of micronuclear envelopes. It is not clear whether the authors intend to indicate, with this term, that the lagging chromosome is farther away from the main chromosome mass or that the lagging chromosome is in a "late" anaphase cell. Because this is confusing, I suggest just using the term "lagging chromosome" consistently. It could be useful to include representative images of lagging chromosomes located at different distances from the main chromosome mass. And certainly, the authors should include an example of a lagging chromosome in the KIF18A KO cells.

      13.Figure S2A. The example in the bottom right image looks more like a chromosome bridge than a lagging chromosomes. Kinetochore staining is necessary to unequivocally identify lagging chromosomes.

      Significance

      Based on the previous knowledge on the factors that cause abnormal assembly of the micronuclear membrane, the results presented in this study were somewhat predictable. However, these findings will add to the knowledge of how micronuclei form and the potential factors that lead to micronuclear membrane rupture. Previous studies investigating micronucleus behavior have focused on micronuclei arising via merotelic kinetochore mis-attachments. These mis-attachments lead to formation of micronuclei close to the spindle midzone. In the present study, instead, the micronuclei arising from lack of KIF18A activity form farther away from the spindle midzone. The results presented here suggest that the positioning of these micronuclei farther away from the midzone enables assembly of a more stable micronuclear membrane that will be less likely to rupture during the following cell cycle. A recent study showed that the microtubule bundles in the spindle midzone interfere with micronuclear membrane assembly. Based on this, it is not surprising that micronuclei forming away from the spindle midzone (like those resulting from lack of KIF18A activity) assemble more normal membranes. Although somewhat expected, this study provides the actual data in support of this phenomenon. This study will be of interest to cell biologists interested in cell division and genomic instability. My research has focused on cell division, aneuploidy, and chromosomal instability for nearly thirty years. Therefore, I believe I am fully qualified to evaluate this manuscript.

      Referees cross-commenting

      My areas of expertise do not include nuclear membrane structure and function. Therefore, I encourage the authors to consider the comments of reviewer #3 for issues related to reliable quantification of micronuclear membrane rupture.

    4. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      In the present work Stumpff, Reinholdt and co-workers investigate the mechanism by which micronuclei contribute to tumorigenesis. Micronuclei are classic markers of genomic instability widely used in the diagnosis of cancer, but whether they work as drivers of the process has recently attracted significant attention due to their link with chromothripsis. Here, the Stumpff/Reinhold labs have explored an interesting model to test some ideas about the role of micronuclei as drivers of tumorigenesis, based on Kif18A/p53 double KO mice. They confirm the formation of micronuclei in these animals, but find no substantial increase in survival and tumor incidence relative to p53 KO animals, despite higher incidence of micronuclei in Kif18A/p53 KO tumors. They conclude that, per se, micronuclei do not have the capacity to form tumors, regardless of p53 status. This was surprising, given the well-established role of p53 in preventing the proliferation of micronucleated cells. To shed light into this apparent paradox, they compared micronuclei from Kif18A KO cells with micronuclei generated by a number of other experimental conditions that promote formation of anaphase lagging chromosomes or generates acentric fragments. They found that micronuclei derived from Kif18A are intrinsically different from micronuclei generated by those other means and essentially showed increased accumulation of lamin B, were more resistant to rupture and preserved the capacity to expand as cells exited mitosis. Of note, they find a correlation between chromosome proximity to the poles/main chromosome mass and the different features that characterize micronuclei from Kif18A KO cells, compared with the other experimental conditions in which late lagging chromosomes are more frequent. Overall, I find this study extremely interesting, well designed and executed in a rigorous way that characterizes the consistent solid work from these laboratories over the years. I have just few minor points that I recommend to be addressed prior to publication.

      1-Abstract and main text lines 70 and 100: the authors indicate that Kif18A mutant mice produce micronuclei due to unaligned chromosomes. This is correct, but at the same time misleading. The authors should clarify that although micronuclei derive from compromised congression, I was convinced from previous works (Fonseca et al., JCB, 2019) that it was their asynchronous segregation in anaphase that led to micronuclei formation. As is, a less familiar reader may conceive that misaligned chromosomes directly result in micronuclei, for example by being detached from the main chromosome mass.

      2-Page 2, line 59: "cells entering cell division...become fragmented". It is not the cells, but the chromosomes that fragment. Please correct.

      3-Page 4, line 149: "reduced survival in the Kif18A null, p53 mice". P53 what? KO, WT? Please clarify.

      4-Page 5, line 212: the authors refer that micronuclei were scored for absence of lamin A/C, but previously they scored it as "continuous/discontinuous". Please clarify.

      5-Page 6, line 243: "Kif18A is not required for micronuclear envelope rupture". Shouldn't it be micronuclear envelope "integrity"?

      6-One of the most interesting results of the paper is the correlation between envelope formation in micronuclei with their respective position relative to the poles/midzone. Could the authors try to investigate causality? For instance, the authors refer to works from other labs in which MT bundles and a midzone Aurora B activity gradient might play a role in the different features associated with micronuclei envelope formation, depending on their origin. Could the authors manipulate this gradient and investigate whether it changes the outcome in terms of nuclear envelope assembly properties on micronuclei? Are there any detectable features in midzone MT organization in Kif18A KO cells that would justify the observed differences?

      Significance

      Kif18A plays a key role in chromosome alignment, without apparently affecting kinetochore-microtubule attachments in non-transformed cells. Because they cannot establish a proper metaphase plate Kif18A KO cells enter anaphase with highly asynchronous segregation due to non-uniform chromosome distribution along the spindle axis. Consequently, some "delayed" chromosomes form micronuclei, in cell culture and in vivo. Interestingly, prior art has failed to detect any increased signs of genomic instability in Kif18A KO cells and mice, and, contrary to what would be expected based on current trends, these mice do now show any signs of increased incidence of tumors, in fact they even show some protective effect to induced colitis-associated colorectal cancer. Noteworthy, all previous experimental works pointing to a role of micronuclei as key intermediates of genomic instability in cancer relied on models in which the tumor suppressor protein p53 had been inactivated. In the present work, the authors explore the relationship between micronuclei formation and p53 inactivation by investigating tumor formation in Kif18A/p53 double KO animals (1 or 2 alleles of p53 inactivated).The reported results are timely and will attract the interest of a broad readership, while decisively contributing to shed light into an ongoing debate. I am therefore all in favor for the publication of this work in any journal affiliated with review commons, pending some minor revisions.

  3. Dec 2020
    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      We thank the reviewers for their constructive suggestions, which have substantially improved this work. We have comprehensively revised the manuscript, and detail individual responses below:

      Reviewer #1 (Evidence, reproducibility and clarity (Required)):

      The study by Forbes et al describes and characterizes a 2nd generation peptide-based inhibitor of the MYB:CBP interaction, termed CRYBMIM, which they use to study MYB:cofactor interactions in leukemia cells. The CRYBMIM has improved properties relative to the MYBMIM peptide, and display more potency in biochemical and cell-based assays. Using a combination of epigenomics and biochemical screens, the authors define a list of candidate MYB cofactors whose functional significance as AML dependencies is supported by analysis of the DepMap database. Using genomewide profiling of TF and CBP occupancy, the authors provide evidence that CRYBMIM treatment reprograms the interactome of MYB in a manner that disproportionately changes specific cis-elements over others. Stated differently, the overall occupancy pattern of many TFs/cofactors shows gains and losses at specific cis elements, resulting in a complex modulation of MYB function and changes in transcription in leukemia cells. Overall, this is a strong, well-written study, with clear experimental results and relatively straightforward conclusions. The therapeutic potential of modulating MYB in cancer is enormous, and hence I believe this study will attract a broad interest in the cancer field and will likely be highly cited. I list below a few control experiments that would clarify the specificity of CRYBMIM. 1) Does CRYBMIM bind to other KIX domains, such as of MED15. It would be important to evaluate the specificity of this peptide for whether it binds to other KIX domains.

      Response: We analyzed all known human KIX domain sequences, and found that the most similar one to CBP/P300 is MED15 (38% identity), as shown in revised Supp. Fig. 2D. The sequence similarity of the remaining human KIX domains is substantially lower. To determine the specificity of CRYBMIM in binding the CBP/P300 versus MED15, we exposed human AML cell extracts to biotinylated CRYBMIM immobilized on streptavidin beads versus beads alone. Whereas CRYBMIM binds efficiently to CBP/P300, it does not exhibit any measurable binding to MED15 (even though MED15 is highly expressed), as shown in revised Supp. Fig. 2E, and reproduced for convenience below. While this does not exclude the possibility that CRYBMIM binds to other proteins, the biochemical specificity observed here, combined with the genetic requirement of CBP for cellular effects of CRYBMIM as shown by a genome-wide CRISPR screen (Fig. 1B and below), indicate that CRYBMIM is a specific ligand of CBP/P300. The manuscript has been revised on page 6 and 4-5 accordingly.

      2) Similarly, it would be useful to perform a mass spec analysis to all nuclear factors that associate with streptavidin-immobilized CRYBMIM. This again would be help the reader to understand the specificity of this peptide.

      Response: We agree with the reviewer that macromolecular ligands like CRYBMIM may interact with cellular proteins in complex ways. To define specific effects, we utilized four orthogonal strategies, explained below.

      First, we purified the CBP-containing nuclear complex using immunoprecipitation and determined its composition by mass spectrometry proteomics. This analysis revealed 833 proteins that are specifically associated with CBP (revised Table S6). Although technically feasible, the fact that CBP is associated with hundreds of proteins would make the experiment suggested by the reviewer difficult to interpret, because it would be a major challenge to distinguish proteins bound directly by the peptide versus proteins purified indirectly by virtue of the fact that CRYBMIM binds to CBP/P300, which in turn binds to many other proteins. While we recently developed improved methods for cross-linking mass spectrometry proteomics that permit the identification of direct protein-protein interactions (Ser, Cifani, Kentsis 2019, https://doi.org/10.1021/acs.jproteome.9b00085), we believe that these experiments are beyond the scope of the current manuscript, which already includes 40 new figure panels as part of this revision.

      In lieu of this experiment, we purified the CBP-containing nuclear complex after treatment with CRYBMIM or control using immunoprecipitation and determined its composition by targeting Western blotting. This analysis revealed RUNX1, LYL1 and SATB1 are specifically associated with CBP (revised Fig. 14B), among which RUNX1 is specifically remodeled in the MYB:CBP/P300 complex upon CRYBMIM binding. This transcriptional factor recruitment and remodeling support the idea of CRYBMIM’s specificity for the MYB:CBP/P300 complex.

      Second, to define the specificity of CRYBMIM, we used glycine mutants of CRYBMIM and its parent MYBMIM, CG3 and TG3, respectively, in which residues that form key salt bridge and hydrophobic interactions with KIX are replaced with glycines, but otherwise retain all other features of the active probes. Both CG3 and TG3 exhibit significantly reduced effects on the viability of AML cell lines, consistent with the specific effects of CRYBMIM (Fig. 3D).

      To confirm that this is due to CBP binding, we purified cellular CBP/P300 by binding to biotinylated CRYBMIM, and observed that it can be efficiently competed by excess of free CRYBMIM, but not TAT (Fig. 2E).

      Finally, to establish definitively that cellular CBP is responsible for CRYBMIM effects, we generated isogenic cell lines that are either deficient or proficient for CBP using CRISPR genome editing. This experiment demonstrated that CBP deficiency confers significant resistance to CRYBMIM, indicating that CBP is required for CRYBMIM-mediated effects (revised Figure 4), and reproduced below. We revised the manuscript on pages 21, 8, 6 and 9 accordingly.

      3) The major limitation of this study which modestly lessens my enthusiasm of this work is that the mechanistic model of MYB-sequestered TFs proposed here is based on a face-value interpretation of IP-MS data coupled with ChIP-seq data. Normally, I would expect such a mechanism to be supported with some additional focused biochemical experiments of specific interactions, to complement all of the omics approaches. For example, can the authors evaluate and/or validate further how MYB physically interacts with LYL1, CEBPA, SPI1, or RUNX1. Are these interactions direct or indirect? Which domains of these proteins are involved? Does CRYBMIM treatment modulate the ability of these proteins to associate with one another in a co-IP? Do these interactions occur in normal hematopoietic cells? A claim is made throughout this study that these are aberrant TF complexes, but I believe more evidence is required to support this claim.

      Response: We appreciate the reviewer’s comment and totally agree with this point. To examine how MYB aberrantly assembles transcription factors in AML, we performed MYB co-immunoprecipitation (co-IP) in a panel of seven genetically diverse AML cell lines with varying susceptibility to CRYBMIM, chosen to represent the common and refractory forms of human AML. Here, we confirmed co-assembly of CBP/P300, LYL1, E2A, LMO2 in all AML cell lines tested, and cell type-specific co-assembly of SATB1 and CEBPA, as shown in revised Fig. 8A, which are in agreement with the IP-MS and ChIP-seq results. We further corroborated these findings by co-IP studies of CBP/P300, as shown in the revised Fig. 8B. We performed similar co-IP experiments in normal hematopoietic progenitor cells, and found most of the co-assembled factors in AML cells were not observed in normal cells except for CBP/P300 and LYL1, as shown in the revised Figure 9E. Combined with the apparently aberrant expression of E2A and SATB1 in AML cells but not normal blood cells, this leads us to conclude that MYB assembles aberrant transcription factor complexes in AML cells. These complexes can be remodeled by peptidomimetic inhibitors, leading to their redistribution on chromatin, suppression of oncogenic gene expression and induction of cellular differentiation. We confirmed this mechanism by direct biochemical experiments in AML cells, demonstrating disassembly and remodeling of CBP/P300 complexes, as shown in the revised Figure 14. At least some of these interactions are direct, given the known direct binding between MYB and CEBPA (Oelgeschläger, Nuchprayoon, Lüscher, Friedman 1996, https://doi.org/10.1128/mcb.16.9.4717). We revised the manuscript text on pages 13, 15 and 21 accordingly.

      Reviewer #1 (Significance (Required)):

      Overall, this is a strong, well-written study, with clear experimental results and relatively straightforward conclusions. The therapeutic potential of modulating MYB in cancer is enormous, and hence I believe this study will attract a broad interest in the cancer field and will likely be highly cited.

      Response: We appreciate this sentiment and completely agree with the reviewer. The phenomenon reported in this work represents the first of its kind demonstration of the aberrant organization of transcription factor control complexes in cancer, and its pharmacologic modulation. We believe that this concept will serve as a transformative paradigm for understanding oncogenic gene control and the development of effective therapies for its definitive treatment.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)):

      This manuscript reports the generation of a new and improved peptide mimetic inhibitor of the interaction between MYB and CBP/P300. The original MYBMIM inhibitor of this interaction, reported recently by the same laboratory, was modified by addition and substitution of peptide sequences from CREB, thus improving the affinity of the resulting CRYBMIM peptide to CBP/P300. The improved inhibitor profile results in increased anti-AML efficacy of CRYBMIM over MYBMIM. The authors go on to examine the mechanism underlying the anti-AML activity of CRYBMIM by integrating gene expression analysis, chromatin immunoprecipitation sequencing and mass spectrometric protein complex identification in human AML cells. I have some minor questions the authors may wish to comment on:

      1) The relocation of MYB, along with CBP/P300, to genes controlling myeloid differentiation (clusters 4 and 9) upon CRYBMIM treatment is reminiscent of the increased binding of MYB to myeloid pro-differentiation genes in AML cells following RUVBL2 silencing, recently reported in Armenteros-Monterroso et al. 2019 Leukemia 33:2817. Do the authors know if there is any overlap between genes in either of the clusters and the list reported in the latter study?

      Response: We thank the reviewer for making this suggestion. We also observe both RUVBL2 and RUVBL1 in the protein complex specifically associated with MYB (Fig. 7A and B). We compared the gene expression changes induced by CRYBMIM with those reported by Armenteros-Monterroso et al in 2019 (https://doi.org/10.1038/s41375-019-0495-8), and found that 37% of upregulated genes by RUVBL2 silencing were shared with genes induced by CRYBMIM treatment. In addition, upregulated genes in cluster 4 and 9 included myeloid differentiation-related genes, such as JUN, FOS and FOSB, which were also induced RUVBL2 silencing. We revised the manuscript to reflect this association on page 12.

      2) Could the authors comment on a possible mechanism to explain the co-localization of MYB and CBP/P300 to the loci in clusters 4 and 9 following CRYBMIM treatment? Is it possible that CBP/P300 is recruited by other transcription factors to these loci, independently of binding to MYB? Or is the binding of CBP/P300 to MYB at these loci somehow more resistant to disruption by CRYBMIM?

      Response: The reviewer has focused on an interesting point. At least for cluster 9, these genes exhibit gain of CBP/P300 in association with RUNX1 (Figure 12A), which we confirm by direct biochemical studies of MYB and CBP/P300 complexes immunoprecipitated from AML cells (revised Figure 14B-C). These experiments show that CRYBMIM treatment disrupts the MYB:CBP/P300 complexes, leading to the increased assembly of CBP/P300 with RUNX1. These findings are consistent with a dynamic competition mechanism that governs availability of CBP/P300 to transcriptional co-activation, in which distinct transcription factors compete for limiting amounts of CBP/P300. This possible mechanism is discussed in the revised manuscript (page 18-19 and 21).

      3) In the first paragraph of page 9, the text states: "Previously, we found that MYBMIM can suppress MYB:CBP/P300-dependent gene expression, leading to AML cell apoptosis that required MYB-mediated suppression of BCL2 (Ramaswamy et al., 2018)." I think this is a typo, since in this study, MYBMIM treatment results in loss of MYB binding to the BCL2 gene and consequent reduction in BCL2 expression. Do the authors mean 'MYBMIM-mediated suppression of BCl2' or 'loss of MYB-mediated activation of BCL2'?

      Response: We thank the reviewer and have corrected this typographic error in the text.

      4) The authors explain the failure of excess CREBMIM to displace CBP/P300 from immobilised CREBMIM (Figure 1E-F) by the nature of the CREB:CBP/P300 interaction. Does this imply that CREBMIM is unable to disrupt the interaction between CREB and CBP/P300 in living cells and that the CBP/P300 purified from native MV4;11 lysates by immobilised CREBMIM was from a pool not associated with CREB?

      Response: We thank the reviewer for making this point. Indeed, we reproducibly observe that CRYBMIM binding to CBP can be competed with excess free CRYBMIM, but CREBMIM binding cannot be competed by excess CREBMIM. This may be due to the different stabilities of the CBP complexes that are available for binding in cells. Alternatively, it is also possible that CREB binding to CBP, as reflected by CREBMIM, has a relatively slow dissociation rate, as compared to MYB, as reflected by CRYBMIM. We have begun to purify cellular CBP complexes (revised Fig 8. and response to comment 2 for Reviewer 1), and aim to define their determinants in future studies, as enabled by the introduction of CRYBMIM, CREBMIM and MLLMIM probes in the current work.

      Reviewer #2 (Significance (Required)):

      Based on this integrative analysis, the authors propose a convincing hypothesis, involving the assembly of aberrant transcription factor complexes and sequestration of P300/CBP from genes involved in normal myeloid development, for the oncogenic activity of MYB in AML. As well as the obvious therapeutic potential of the CRYBMIM inhibitor itself, the data reported here reveal multiple avenues for future investigation into novel anti-AML therapeutic strategies. This is an innovative and important study.

      This study will be of interest to scientists and clinicians involved in leukaemia research as well as cancer biology in general.

      My field of expertise: leukaemia biology, leukaemia models, aberrant transcription factor activity in leukaemia

      Response: We appreciate and agree with this assessment.

      Reviewer #3 (Evidence, reproducibility and clarity (Required)):

      This manuscript describes an improved MYB-mimetic peptide (cf the group's earlier work published in Nature Communications, 2018) and its effects on AML cell lines. It also describes - and this constitutes the majority of the paper - the dynamics of chromatin occupancy by MYB and other associated transcription factors upon disruption of the MYB-CBP/P300 interaction. The authors suggest this represents a shift from an oncogenic program to a myeloid differentiation program. \*Major comments:***

      Regarding the improved affinity, and biological activity, of CRYBMIM:

      1.Improved affinity of CRYBMIM cf MYBMIM: clearly, it is improved, but not by a lot. By MST the increased affinity is about 3x. In terms of effects on AML cell viability: there is no direct comparison, and this should be included. In the group's previous paper there is no direct estimate for MYBMIM but it looks like the IC50 is between 10 and 20 micromolar so the effect is again around 2.5 fold. Also, the effects of the amino acid substitutions in CG3 are also very small (2.4x) given that 3 critical residues are altered. This is quite concerning.

      Response: As pointed out by the reviewer, CRYBMIM exhibits several fold increase in binding affinity, as measured using purified proteins in vitro. Similar increase in cellular potency is observed after short-term treatment of AML cells, as shown in revised Figure 3C, and reproduced below. However, increasing the duration of treatment to several days leads to substantial improvement in apparent cellular potency (Figure 3G). For example, while MYBMIM induces approximately 100-fold reduction in cell viability of MV411 cells, CRYBMIM induces more than 1,000-fold reduction. Similarly, whereas MYBMIM exhibited relatively modest effects on OCIAML3 and SKM1 cells, CRYBMIM induces more than 1,000-fold reduction in cell viability. As we show in the revised manuscript, this appears to be due to the combination of increased biochemical affinity and specific proteolysis of MYB, which cooperate to induce extensive remodeling of MYB transcriptional complexes and gene expression (revised Figure 11). In all, this exemplifies how pharmacologic modulators of protein interactions can achieve significantly improved biological potency from relatively modest affinity effects, a concept that recently has been successfully used to develop a variety of PROTACs that leverage this “event-driven” as opposed to occupancy-driven pharmacology. The manuscript has been revised on page 8 and 18 to clarify this point.

      2.Does CRYBMIM really "spare" normal hematopoietic cells? Not according to Fig 2E, where there is only a 2-fold difference in IC50.

      Response: To better define the relative toxicity of CRYBMIM and MYBMIM, we examined their effects on the growth and survival of normal hematopoietic progenitor cells as compared to AML cells using colony forming assays in methylcellulose under more physiologic conditions in the presence of human hematopoietic cytokines (revised Figure 3E, and reproduced below). While CRYBMIM significantly reduced the clonogenic capacity, growth and survival of MV411 AML cells, there were no significant effects on the total clonogenic activity of normal CD34+ human umbilical cord blood progenitor cells under these conditions. At the highest dose, CRYBMIM induced modest reduction in CFU-MG colony formation, and modest increase in BFU-E colony formation of normal hematopoietic progenitor cells. We revised the manuscript to indicate that CRYBMIM “relatively spares” normal blood progenitor cells on page 8.

      Response: We appreciate the attention to this issue. In the original manuscript, we showed dose-response curves of cord blood progenitor cells cultured in suspension supplemented with fetal bovine serum, a system that is known to induce in appropriate hematopoietic cell differentiation (https://doi.org/10.1016/j.molmed.2017.07.003). In the revised manuscript, we show results of colony formation assays of hematopoietic progenitor cells cultured in serum-free, semi-solid conditions supplemented with human hematopoietic cytokines (revised Figure 3E and 3F). This is a more physiologic system which more faithfully maintains normal hematopoietic cell differentiation, as compared to the cellular differentiation induced by fetal bovine serum-containing media lacking hematopoietic growth factors, as used in the experiments in our original manuscript. To establish a positive control, in addition to treating AML cells under the same condition, we used doxorubicin, which is part of current treatment of patients with AML, and which in our experiments, exhibits significant and pronounced reduction in the clonogenic capacity, growth and survival of normal blood progenitor cells (revised Figure S3B). The manuscript has been revised on page 8 accordingly.

      1. Fig 2F doesn't include any lines that express very low or undetectable levels of MYB. Some of these should be included to further examine specificity.

      Response: We have now tested CRYBMIM against a large panel of non-hematopoietic tumor and non-tumor cell lines, with varying degrees of MYB expression. Some of those cells exhibit high level of MYB gene expression and MYB genetic dependency, which is at least in part correlated with susceptibility to CRYBMIM. (revised Figure S4, and reproduced below). The manuscript has been revised on page 8 accordingly.

      Effects on gene expression and MYB binding:

      Data on MYB target gene expression and apoptosis/differentiation, and the conclusions drawn per se are sound, but:

      5.Fig S3 seems to show that MYB protein is lost on treatment with CRYBMIM. This isn't even mentioned in the text but raises a whole range of major questions eg why is this the case? Is this what is responsible for the loss of MYB-p300 interaction and/or biological effects on AML cells? Is this what is responsible for the effects on MYB target gene expression in Fig 3 and MYB binding to chromatin in Fig 4? This must be addressed.

      Response: We have revised the manuscript to include this discussion, and performed additional experiments to define this phenomenon. We confirmed rapid reduction in MYB protein levels upon CRYBMIM treatment on the time-scale of one to four hours in diverse AML cell lines (revised Figure 11), with the rate of MYB protein loss correlating to the cellular susceptibility to CRYBMIM (revised Figure 11, and reproduced below). The manuscript has been revised on page 18 accordingly.

      This is consistent with the specific proteolysis of MYB induced by the peptidomimetic remodeling of the MYB:CBP/P300 complex. We confirmed this by combined treatment with the proteosomal/protease inhibitor MG132 (revised Figure 11C, and reproduced below). This effect was specific because overexpression of BCL2, which blocks MYBMIM-induced apoptosis (Ramaswamy et al, Kentsis, https://doi.org/10.1038/s41467-017-02618-6), was unable to rescue CRYBMIM-induced proteolysis of MYB, arguing that MYB proteolysis is a specific effect of CRYBMIM rather than a non-specific consequence of apoptosis. The manuscript has been revised on page 18 accordingly.

      6.Fig 4 and the accompanying text are a bit hard to follow, but if I understood them correctly, I am surprised that the "gained MYB peaks" don't include the MYB binding motif itself? This at least deserves some comment. Also, there doesn't seem to have been any attempt to integrate the ChIP-Seq data with the expression data of Fig 3. This would provide clearer insights into the identities and types of MYB-regulated genes that are directly affected by suppression of CBP/p300 binding to MYB.

      Response: We thank the reviewer for this suggestion. The revised manuscript now includes a comprehensive and integrated analysis of chromatin and gene expression dynamics (revised Figures 13A and 13B). In contrast to the model in which blockade of MYB:CBP/P300 induces loss of gene expression and loss of transcription factor and CBP/P300 chromatin occupancy, we also observed a large number of genes with increased expression and gain of CBP/P300 occupancy (revised Figure 13A-B, and reproduced below). This includes numerous genes that control hematopoietic differentiation, such as FOS, JUN, and ATF3. As a representative example, in the case of FOS, we observed that CRYBMIM-induced accumulation of CBP/P300 was associated with increased binding of RUNX1, and eviction of CEBPA and LYL1 (revised Figure 13C). Thus, the absence of “gained MYB peaks” is due to the redistribution of CBP/P300 with alternative transcription factors, such as RUNX1. In all, these results support the model in which the core regulatory circuitry of AML cells is organized aberrantly by MYB and its associated co-factors including LYL1, CEBPA, E2A, SATB1 and LMO2, which co-operate in the induction and maintenance of oncogenic gene expression, as co-opted by distinct oncogenes in biologically diverse subtypes of AML (revised Figure 14). This involves apparent sequestration of CBP/P300 from genes controlling myeloid cell differentiation. Thus, oncogenic gene expression is associated with the assembly of aberrantly organized MYB transcriptional co-activator complexes, and their dynamic remodeling by selective blockade of protein interactions can induce AML cell differentiation. The manuscript has been revised on page 20-21 accordingly.

      7.The MS studies on MYB-interacting proteins seem very interesting and novel. I am not an expert on MS, though, so I'd suggest this section be reviewed by someone who is. Moreover, I was unable to see the actual data from this study because the material I was provided with didn't include Table S4 and S5.

      Response: We appreciate this point. For this reason, we have deposited all of our mass spectrometry data to be openly available via PRIDE (accession number PXD019708), and also openly provide all of the analyzed data via Zenodo (https://doi.org/10.5281/zenodo.4321824), as additionally provided in the Supplementary Material for this manuscript.

      \Should the authors qualify some of their claims as preliminary or speculative, or remove them altogether?* 8.Claims regarding biological activity, specificity and improvements cf MYBMIM should be moderated given the small size of these effects as mentioned above (points 1 and 3).*

      Response: As explained in detail in response to comments 1-3 above (page 12-14 of this response), we have substantially revised the manuscript to incorporate both new experimental results and additional explanations (pages 6-8).

      9.I found the description of the studies related to Figs 5 and 6 somewhat difficult to follow and convoluted. While changes in MYB and CBP/p300 chromatin occupancy clearly occur on M CRYBMIM treatment, it is not clear that the complexes seen on genes prior to treatment represent "aberrant" complexes. These may just be characteristic of undifferentiated (myeloid) cells. The authors appear to argue that because some of the candidate co-factors show "apparently aberrant expression in AML cells" based on comparison of (presumably mRNA) expression data with normal cells, the presence of these factors in the complexes make them "aberrant" (moreover, the "aberrancy score" of Fig 5 C is not defined anywhere, as far as I can see). This inference is drawing a rather long bow, given that the AML-specific factors may not actually be absent from the complexes in normal cells. So this conclusion should be moderated if a more direct MS comparison cannot be provided (for which I understand the technical difficulties).

      Response: We have now measured protein abundance levels of key transcription factors assembled with MYB in AML cells in various normal human hematopoietic cells (revised Figure 9, and reproduced below). We found that most transcription factors that are assembled with MYB in diverse AML cell lines could be detected in one or more normal human blood cells, albeit with variable abundance, with the exception of CEBPA and SATB1 that were measurably expressed exclusively in AML cells (revised Figure 9A). Using unsupervised clustering and principal component analysis, we defined the combinations of transcription factors that are associated with aberrant functions of MYB:CBP/P300, as defined by their susceptibility to peptidomimetic remodeling (revised Figure 9B-D). In addition, we directly examined the physical assembly of MYB with key transcription factors in normal hematopoietic cells using co-immunoprecipitation studies (revised Figure 9E). In agreement with the physical association of MYB seen in AML cell lines, we observed association with CBP/P300 and LYL1 in normal hematopoietic cells. However, we did not observe physical association with E2A and SATB1 in normal cells, which indicates aberrant association of these in AML cell lines. This leads us to propose that these complexes are aberrantly assembled, at least in part due to the inappropriate transcription factor co-expression. The manuscript has been revised on page 15 accordingly.

      \Would additional experiments be essential to support the claims of the paper?*

      Response: As explained in detail in response to comment 5 above (page 16 of this response), we have carried out extensive studies of the specific proteolysis of MYB. We conclude that MYB transcription complexes are regulated both by MYB:CBP/P300 binding and by specific factor proteolysis, and can be induced by its peptidomimetic blockade in AML cells. Such “event-driven” pharmacology is emerging as a powerful tool to modulate protein function in cells, and studies reported in our work should enable its translation into improved therapies for patients, and improved probes for basic science.

      11.Provision of a positive control for the experiment of Fig S2.

      Response: As explained in detail in response to comment 2 above (page 13-14 of this response), we precisely defined the effects of CRYBMIM and MYBMIM on the clonogenic capacity, growth and survival of normal hematopoietic progenitor cells in serum-free, methylcellulose media supplemented with human hematopoietic cytokines. These experiments showed relatively modest effects (9.3 ± 3.8% reduction) of CRYBMIM on normal cells (Figure 3E), as compared to substantial inhibition (54 ± 2.4 % reduction) of the growth and survival of AML cells (Figures 3E). For comparison, doxorubicin led to more than 98 % reduction in clonogenic capacity (revised Figure S3B).

      12.\Are the data and the methods presented in such a way that they can be reproduced?**

      -Mostly yes

      Response: The revised manuscript includes a complete description of all methods, including a detailed supplement, listing technical details, with all analyzed data available openly via Zenodo (https://doi.org/10.5281/zenodo.4321824).

      13.\Are the experiments adequately replicated and statistical analysis adequate?**

      -Mostly yes

      Response: All experiments were performed in at least three replicates, with all quantitative comparisons performed using appropriate statistical tests, as explained in the manuscript.

      **Minor comments:**

      *Specific experimental issues that are easily addressable.*

      -These are mostly indicated above.

      In addition:

      14.Why is BCL2 expression down-regulated by MYBMIM but not CRYMYB?

      Response: We made the same observation, and attribute this difference to the fact that BCL2 expression is regulated by several transcription factors, including CEBPA, which is affected by CRYBMIM but not MYBMIM. Similar to MYBMIM treatment, MYB occupancy at the BCL2 enhancer was reduced upon CRYBMIM treatment. However, new binding sites of other factors, such as CBP/P300 and RUNX1, appeared simultaneously, suggesting that redistribution of transcription factors following CRYBMIM treatment can affect transcriptional regulation of BCL2 expression (revised Figure S9 and shown below).

      *Are prior studies referenced appropriately?

      -Yes *Are the text and figures clear and accurate?*

      15.Generally, although some details are missing eg what aberrancy score in Fig 5C means.

      Response: Thank you for pointing this out. We have revised this figure to clarify this score, which is defined as the ratio of gene expression in AML cells relative to normal hematopoietic progenitor cells (revised Figure 7C).

      16.\Do you have suggestions that would help the authors improve the presentation of their data and conclusions?**

      -The title of this manuscript could and I think should be changed. The term "therapeutic", is not appropriate because no therapeutic agents are described in the m/s nor is any form of AML, even experimentally, treated. Also "CBP" should be replaced with CBP/P300, especially since most evidence suggests that P300 is the likely more important partner of MYB (eg Zhao et al 2011

      Response: We agree and have revised the title to clarify the significance of this work: “Convergent organization of aberrant MYB complexes controls oncogenic gene expression in acute myeloid leukemia.” We have revised the manuscript to indicate CBP/P300.

      17.-It would be worth discussing the core observation that disruption of the MYB-CBP/P300 interaction actually results in changes in MYB DNA binding. That this would occur is not at all obvious, because CBP/p300 doesn't interact with MYB's DNA binding domain nor does it have intrinsic DNA binding activity.

      Response: We thank the reviewer for this comment, and agree that remodeling of the MYB complex must affect the binding of MYB and other cofactors to DNA, at least in part mediated by potential acetylation by CBP/P300 (page 24).

      Reviewer #3 (Significance (Required)):

      **The Nature and Significance of the Advance**

      1) The major significance of this work lies in the chromatin occupancy and MYB complex studies. There are a number of very interesting findings including the apparent redistribution of MYB and/or CBP/P300 upon treatment with CRYBMIM. These suggest a series of changes in factors associated with particular gene sets involved in myeloid differentiation, although as mentioned above particular target genes are not specifically identified. However the pathways corresponding to these are listed in Table S6.

      Response: We have revised the manuscript to include the target genes in revised Supplemental Table 4 as well as DESeq2 tables (deposited in Zenodo, https://doi.org/10.5281/zenodo.4321824).

      2) The new peptide design (CRYBMIM) is interesting but its differences in binding and biological effects of MYBMIM are mostly incremental. See above.

      Response: We respectfully disagree and would like to explain how this work is significant both for conceptual and technical reasons. First, while the biochemical affinity of CRYBMIM is quantitatively increased compared with MYBMIM, this quantitatively increased affinity translates into qualitatively improved biological potency, as a result of “event-driven” pharmacology that characterizes pharmacologic protein interaction modulators (please also see response to Reviewer 3, comment 1, page 6 of this response). MYBMIM suppresses the growth and survival mostly of MLL-rearranged leukemias, whereas CRYBMIM does so for the vast majority (10 out of 11) of studied subtypes of AML. This now enables its therapeutic translation, as we are currently pursuing in collaboration with Novartis. Second, its improved biological activity led to the discovery of the previously unknown and unanticipated CBP/P300 sequestration mechanism of oncogenic gene control. We use this discovery to develop a precise model of aberrant gene control in AML that for the first time unifies previously disparate observations into a general mechanism. This is highly significant because it provides shared molecular dependencies for most subtypes of AML, a long-standing conundrum in cancer biology.

      *Place the work in the context of the existing literature (provide references, where appropriate).*

      -This m/s builds on and extends the report from the same group in Nature Communications (2018), which described the earlier peptide MYBMIM, some effects on MYB target genes and on AML cells. It and the previous paper also draw on the findings regarding the role of the MYB-CBP/P300 interaction in myeloid leukemogenesis (Pattabirman et al 2014) and on previous genome-wide studies of MYB target genes (Zhoa et al 2011; Zuber et al 2011).

      *State what audience might be interested in and influenced by the reported findings.*

      -This m/s will likely be of interest to scientists interested in MYB per se, in AML, in cancer genomics and transcriptional regulation.

      *Define your field of expertise with a few keywords to help the authors contextualize your point of view. Indicate if there are any parts of the paper that you do not have sufficient expertise to evaluate.* -My expertise: AML, experimental hematology, transcription, MYB, cancer genomics

      3) As mentioned above, I feel that additional expertise is required to review the MS studies.

      Response: We have deposited all raw data in PRIDE (accession number PXD019708) and all processed data in Zenodo (https://doi.org/10.5281/zenodo.4321824), making it available for the community for further analysis.

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      Summary

      This manuscript describes an improved MYB-mimetic peptide (cf the group's earlier work published in Nature Communications, 2018) and its effects on AML cell lines. It also describes - and this constitutes the majority of the paper - the dynamics of chromatin occupancy by MYB and other associated transcription factors upon disruption of the MYB-CBP/P300 interaction. The authors suggest this represents a shift from an oncogenic program to a myeloid differentiation program.

      Major comments:

      Regarding the improved affinity, and biological activity, of CRYBMIM:

      1.Improved affinity of CRYBMIM cf MYBMIM: clearly, it is improved, but not by a lot. By MST the increased affinity is about 3x. In terms of effects on AML cell viability: there is no direct comparison, and this should be included. In the group's previous paper there is no direct estimate for MYBMIM but it looks like the IC50 is between 10 and 20 micromolar so the fecct is again around 2.5 fold. Also, the effects of the amino acid substitutions in CG3 are also very small (2.4x) given that 3 critical residues are altered. This is quite concerning.

      2.Does CRYBMIM really "spare" normal hematopoietic cells? Not according to Fig 2E, where there is only a 2-fold difference in IC50.

      3.Fig 2E and Supp Fig S2 appear to be contradictory. The latter shows no effect of 20micromolar CRYBMIM on colony formation by normal CD34+ cells, in complete contrast to killing with IC50 of 12.8 micromolar in Fig 2E. There is no +ve control for Fig S2 ie does the peptide work under colony assay conditions? This MUST be addressed.

      4.Fig 2F doesn't include any lines that express very low or undetectable levels of MYB. Some of these should be included to further examine specificity.2

      Effects on gene expression and MYB binding:

      Data on MYB target gene expression and apoptosis/differentiation, and the conclusions drawn per se are sound, but:

      5.Fig S3 seems to show that MYB protein is lost on treatment with CRYBMIM. This isn't even mentioned in the text but raises a whole range of major questions eg why is this the case? Is this what is responsible for the loss of MYB-p300 interaction and/or biological effects on AML cells? Is this what is responsible for the effects on MYB target gene expression in Fig 3 and MYB binding to chromatin in Fig 4? This must be addressed.

      6.Fig 4 and the accompanying text are a bit hard to follow, but if I understood them correctly, I am surprised that the "gained MYB peaks" don't include the MYB binding motif itself? This at least deserves some comment. Also, there doesn't seem to have been any attempt to integrate the ChIP-Seq data with the expression data of Fig 3. This would provide clearer insights into the identities and types of MYB-regulated genes that are directly affected by suppression of CBP/p300 binding to MYB.

      7.The MS studies on MYB-interacting proteins seem very interesting and novel. I am not an expert on MS, though, so I'd suggest this section be reviewed by someone who is. Moreover, I was unable to see the actual data from this study because the material I was provided with didn't include Table S4 and S5.

      Should the authors qualify some of their claims as preliminary or speculative, or remove them altogether?

      8.Claims regarding biological activity, specificity and improvements cf MYBMIM should be moderated given the small size of these effects as mentioned above (points 1 and 3).

      9.I found the description of the studies related to Figs 5 and 6 somewhat difficult to follow and convoluted. While changes in MYB and CBP/p300 chromatin occupancy clearly occur on M CRYBMIM treatment, it is not clear that the complexes seen on genes prior to treatment represent "aberrant" complexes. These may just be characteristic of undifferentiated (myeloid) cells. The authors appear to argue that because some of the candidate co-factors show "apparently aberrant expression in AML cells" based on comparison of (presumably mRNA) expression data with normal cells, the presence of these factors in the complexes make them "aberrant" (moreover, the "aberrancy score" of Fig 5 C is not defined anywhere, as far as I can see). This inference is drawing a rather long bow, given that the AML-specific factors may not actually be absent from the complexes in normal cells. So this conclusion should be moderated if a more direct MS comparison cannot be provided (for which I understand the technical difficulties).

      Would additional experiments be essential to support the claims of the paper?

      1. Address the issue of the apparent loss of MYB protein upon CRYBMIM treatment. If this is occurring, the whole premise of the subsequent work is undermined.

      12.Provision of a positive control for the experiment of Fig S2.

      Are the data and the methods presented in such a way that they can be reproduced?

      -Mostly yes

      Are the experiments adequately replicated and statistical analysis adequate?

      -Mostly yes

      Minor comments:

      Specific experimental issues that are easily addressable. -These are mostly indicated above.

      In addition: oWhy is BCL2 expression down-regulated by MYBMIM but not CRYMYB?

      *Are prior studies referenced appropriately?

      -Yes

      Are the text and figures clear and accurate?

      -Generally, although some details are missing eg what aberrancy score in Fig 5C means.

      Do you have suggestions that would help the authors improve the presentation of their data and conclusions?

      -The title of this manuscript could and I think should be changed. The term "therapeutic", is not appropriate because no therapeutic agents are described in the m/s nor is any form of AML, even experimentally, treated. Also "CBP" should be replaced with CBP/P300, especially since most evidence suggests that P300 is the likely more important partner of MYB (eg Zhao et al 2011

      -It would be worth discussing the core observation that disruption of the MYB-CBP/P300 interaction actually results in changes in MYB DNA binding. That this would occur is not at all obvious, because CBP/p300 doesn't interact with MYB's DNA binding domain nor does it have intrinsic DNA binding activity.

      Significance

      The Nature and Significance of the Advance

      -The major significance of this work lies in the chromatin occupancy and MYB complex studies. There are a number of very interesting findings including the apparent redistribution of MYB and/or CBP/P300 upon treatment with CRYBMIM. These suggest a series of changes in factors associated with particular gene sets involved in myeloid differentiation, although as mentioned above particular target genes are not specifically identified. However the pathways corresponding to these are listed in Table S6.

      -The new peptide design (CRYBMIM) is interesting but its differences in binding and biological effects cf MYBMIM are mostly incremental. See above.

      Place the work in the context of the existing literature (provide references, where appropriate).

      -This m/s builds on and extends the report from the same group in Nature Communications (2018), which described the earlier peptide MYBMIM, some effects on MYB target genes and on AML cells. It and the previous paper also draw on the findings regarding the role of the MYB-CBP/P300 interaction in myeloid leukemogenesis (Pattabirman et al 2014) and on previous genome-wide studies of MYB target genes (Zhoa et al 2011; Zuber et al 2011).

      State what audience might be interested in and influenced by the reported findings.

      -This m/s will likely be of interest to scientists interested in MYB per se, in AML, in cancer genomics and transcriptional regulation.

      Define your field of expertise with a few keywords to help the authors contextualize your point of view. Indicate if there are any parts of the paper that you do not have sufficient expertise to evaluate.

      -My expertise: AML, experimental hematology, transcription, MYB, cancer genomics

      -As mentioned above, I feel that additional expertise is required to review the MS studies.

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      This manuscript reports the generation of a new and improved peptide mimetic inhibitor of the interaction between MYB and CBP/P300. The original MYBMIM inhibitor of this interaction, reported recently by the same laboratory, was modified by addition and substitution of peptide sequences from CREB, thus improving the affinity of the resulting CRYBMIM peptide to CBP/P300. The improved inhibitor profile results in increased anti-AML efficacy of CRYBMIM over MYBMIM. The authors go on to examine the mechanism underlying the anti-AML activity of CRYBMIM by integrating gene expression analysis, chromatin immunoprecipitation sequencing and mass spectrometric protein complex identification in human AML cells.

      I have some minor questions the authors may wish to comment on:

      1) The relocation of MYB, along with CBP/P300, to genes controlling myeloid differentiation (clusters 4 and 9) upon CRYBMIM treatment is reminiscent of the increased binding of MYB to myeloid pro-differentiation genes in AML cells following RUVBL2 silencing, recently reported in Armenteros-Monterroso et al. 2019 Leukemia 33:2817. Do the authors know if there is any overlap between genes in either of the clusters and the list reported in the latter study?

      2) Could the authors comment on a possible mechanism to explain the co-localization of MYB and CBP/P300 to the loci in clusters 4 and 9 following CRYBMIM treatment? Is it possible that CBP/P300 is recruited by other transcription factors to these loci, independently of binding to MYB? Or is the binding of CBP/P300 to MYB at these loci somehow more resistant to disruption by CRYBMIM?

      3) In the first paragraph of page 9, the text states: "Previously, we found that MYBMIM can suppress MYB:CBP/P300-dependent gene expression, leading to AML cell apoptosis that required MYB-mediated suppression of BCL2 (Ramaswamy et al., 2018)." I think this is a typo, since in this study, MYBMIM treatment results in loss of MYB binding to the BCL2 gene and consequent reduction in BCL2 expression. Do the authors mean 'MYBMIM-mediated suppression of BCl2' or 'loss of MYB-mediated activation of BCL2'?

      4) The authors explain the failure of excess CREBMIM to displace CBP/P300 from immobilised CREBMIM (Figure 1E-F) by the nature of the CREB:CBP/P300 interaction. Does this imply that CREBMIM is unable to disrupt the interaction between CREB and CBP/P300 in living cells and that the CBP/P300 purified from native MV4;11 lysates by immobilised CREBMIM was from a pool not associated with CREB?

      Significance

      Based on this integrative analysis, the authors propose a convincing hypothesis, involving the assembly of aberrant transcription factor complexes and sequestration of P300/CBP from genes involved in normal myeloid development, for the oncogenic activity of MYB in AML. As well as the obvious therapeutic potential of the CRYBMIM inhibitor itself, the data reported here reveal multiple avenues for future investigation into novel anti-AML therapeutic strategies. This is an innovative and important study.

      This study will be of interest to scientists and clinicians involved in leukaemia research as well as cancer biology in general.

      My field of expertise: leukaemia biology, leukaemia models, aberrant transcription factor activity in leukaemia

    4. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      The study by Forbes et al describes and characterizes a 2nd generation peptide-based inhibitor of the MYB:CBP interaction, termed CRYBMIM, which they use to study MYB:cofactor interactions in leukemia cells. The CRYBMIM has improved properties relative to the MYBMIM peptide, and display more potency in biochemical and cell-based assays. Using a combination of epigenomics and biochemical screens, the authors define a list of candidate MYB cofactors whose functional significance as AML dependencies is supported by analysis of the DepMap database. Using genomewide profiling of TF and CBP occupancy, the authors provide evidence that CRYBMIM treatment reprograms the interactome of MYB in a manner that disproportionately changes specific cis-elements over others. Stated differently, the overall occupancy pattern of many TFs/cofactors shows gains and losses at specific cis elements, resulting in a complex modulation of MYB function and changes in transcription in leukemia cells.

      Overall, this is a strong, well-written study, with clear experimental results and relatively straightforward conclusions. The therapeutic potential of modulating MYB in cancer is enormous, and hence I believe this study will attract a broad interest in the cancer field and will likely be highly cited. I list below a few control experiments that would clarify the specificity of CRYBMIM.

      1) Does CRYBMIM bind to other KIX domains, such as of MED15. It would be important to evaluate the specificity of this peptide for whether it binds to other KIX domains.

      2) Similarly, it would be useful to perform a mass spec analysis to all nuclear factors that associate with streptavidin-immobilized CRYBMIM. This again would be help the reader to understand the specificity of this peptide.

      The major limitation of this study which modestly lessens my enthusiasm of this work is that the mechanistic model of MYB-sequestered TFs proposed here is based on a face-value interpretation of IP-MS data coupled with ChIP-seq data. Normally, I would expect such a mechanism to be supported with some additional focused biochemical experiments of specific interactions, to complement all of the omics approaches. For example, can the authors evaluate and/or validate further how MYB physically interacts with LYL1, CEBPA, SPI1, or RUNX1. Are these interactions direct or indirect? Which domains of these proteins are involved? Does CRYBMIM treatment modulate the ability of these proteins to associate with one another in a co-IP? Do these interactions occur in normal hematopoietic cells? A claim is made throughout this study that these are aberrant TF complexes, but I believe more evidence is required to support this claim.

      Significance

      Overall, this is a strong, well-written study, with clear experimental results and relatively straightforward conclusions. The therapeutic potential of modulating MYB in cancer is enormous, and hence I believe this study will attract a broad interest in the cancer field and will likely be highly cited.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reviewer #1 The authors study allostery with a beautiful genotype-phenotype experiment to study the fitness landscape of an allosteric lac repressor protein. The authors make a mutational library using error prone pcr and measure the impact on antibiotic resistance protein expression at varying levels of ligand, IPTG, expression. After measuring the impact of mutations authors fill-in the missing data using a neural net model. This type of dose response is not standard in the field, but the richness of their data and the discovery of the "band pass" phenomena prove its worth here splendidly. Using this mixed experimental/predicted data the authors explore how each mutation alters the different parameters of a hill equation fit of a dose response curve. Using higher order mutational space the authors look at how mutations can qualitatively switch phenotypes to inverted or band-stop dose-response curves. To validate and further explore a band-stop novel phenotype, the authors focused on a triple mutant and made all combinations of the 3 mutations. The authors find that only one mutation alone alters the dose-response and only in combination does a band-stop behavior present itself. Overall this paper is a fantastic data heavy dive into the allosteric fitness landscape of protein. Overall, the data presented in this paper is thoroughly collected and analyzed making the conclusions well-based. We do not think additional experiments nor substantial changes are needed apart from including basic experimental details and more biophysical rationale/speculation as discussed in further detail below.

      The authors do a genotype-phenotype experiment that requires extensive deep sequencing experiments. However, right now quite a bit of basic statistics on the sequencing is missing. Baseline library quality is somewhat shown in supplementary fig 2 but the figure is hard to interpret. It would be good to have a table that states how many of all possible mutations at different mutation depths (single, double, etc) there are. Similarly, sequencing statistics are missing- it would be useful to know how many reads were acquired and how much sequencing depth that corresponds to. This is particularly important for barcode assignment to phenotype in the long-read sequencing. In addition, a synonymous mutation comparison is mentioned but in my reading that data is not presented in the supplemental figures section.

      We thank the reviewer for this succinct summary of the manuscript and the results. We appreciate the reviewer identifying data of interest that were not included in the original manuscript. We agree that this information is necessary to consider the results. Specific changes are summarized in the comments below.

      The paper is very much written from an "old school" allostery perspective with static end point structures that are mutually exclusive - eg. p5l10 "relative ligand-binding affinity between the two conformations" - however, an ensemble of conformations is likely needed to explain their data. This is especially true for the bandpass and inverted phenotypes they observe. The work by Hilser et al is of particular importance in this area. We would invite the authors to speculate more freely about the molecular origins of their findings.

      We agree with the suggestions to adopt a modern allosteric perspective. We have changed the language throughout the manuscript to align with the ensemble model of allostery. We continue to frame results using the Monad-Wyman-Changeaux model, which reliably predicts LacI activity from biophysical parameters and is not exclusive of more modern models of allostery.

      **Minor** There are a number of small modifications. In general this paper is very technical and could use with some explanation and discussion for relevance to make the manuscript more approachable for a broader audience. P1L23: Ligand binding at one site causes a conformational change that affects the activity of another > not necessarily true - and related to using more "modern" statistical mechanical language for describing allostery.

      We agree with the reviewer’s comment. We have addressed this comment by adopting language in line with more modern view of allostery, for example:

      “With allosteric regulation, ligand binding at one site on a biomolecule changes the activity of another, often distal, site. Switching between active and inactive states provides a sense-and-response function that defines the allosteric phenotype.”

      P2L20: The core experiment of this paper is a selection using a mutational library. In the main body the authors mention the library was created using mutagenic pcr but leave it at that. More details on what sort of mutagenic pcr was used in the main body would be useful. According to the methods error prone pcr was used. Why use er-pcr vs deep point mutational libraries? Presumably to sample higher order phenotype? Rationale should be included. Were there preliminary experiments that helped calibrate the mutation level?

      We agree that justifying the decision to use error-prone PCR for library construction would be helpful. To explain this decision, we have added to the main text to explain this decision and to reflect on the consequences.

      “We used error-prone PCR across the full lacI CDS to investigate the effects of higher-order substitutions spread across the entire LacI sequence and structure.”

      And

      Novel phenotypes emerged at mutational distances greater than one amino acid substitution, highlighting the value in sampling a broader genotype space with higher-order mutations. Furthermore, the untargeted, random mutagenesis approach used here was critical for finding these novel phenotypes, as the genotypes required for these novel phenotypes were unpredictable.”

      P2L20: Baseline library statistics would be great in a table for coverage, diversity, etc especially as this was done by error prone pcr vs a more saturated library generation method. This is present in sup fig2 but it's a bit complicated.

      To more clearly convey the diversity within the library, we have included a heatmap of amino acid substitution counts found within the library (Supplementary Fig. 4). Additionally, we have added Supplementary Table 1, which lists the distribution of mutational distances of LacI variants found within the library, and the corresponding coverage of all possible mutations for each mutational distance.

      P2L26: How were FACS gates drawn? This is in support fig17 - should be pointed to here.

      We agree that a better description of the FACS process would be helpful. To address this we have included Supplementary Fig. 2, showing flow cytometry measurements of the library before and after FACS. Additionally, we have extended the description of the FACS process:

      “The initial library had a bimodal distribution of G__­0, as indicated by flow cytometry results, with a mode at low fluorescence (near G__­0 of wildtype LacI), and mode at higher gene expression. To generate a library in which most of the LacI variants could function as allosteric repressors, we used fluorescence activated cell sorting (FACS) to select the portion of the library with low fluorescence in the absence of ligand, gating at the bifurcation of the two modes (Sony SH800S Cell Sorter, Supplementary Fig. 2).”

      __

      P3L4: Where is the figure/data for the synonymous SNP mutations? This should be in the supplement.

      We agree this data is necessary to support the claim that LacI function was not impacted by synonymous mutations. We have included a new Supplementary Fig. 9, which shows the distribution of Hill equation parameters for LacI variants that code for the wild-type amino acid sequence, but with non-identical coding DNA sequences. Additionally, we included the results of a statistical analysis in the main text, this analysis compared all synonymous sequences in the library:

      “__We compared the distributions of the resulting Hill equation parameters between two sets of variants: 39 variants with exactly the wild-type coding DNA sequence for LacI (but with different DNA barcodes) and 310 variants with synonymous nucleotide changes (i.e. the wild-type amino acid sequence, but a non-wild-type DNA coding sequence). Using the Kolmogorov-Smirnov test, we found no significant differences between the two sets (p-values of 0.71, 0.40, 0.28, and 0.17 for G0, G∞, EC50, and n respectively, Supplementary Fig. 9).” __

      P3L20: The authors use a ML learning deep neural network to predict variant that were not covered in the screen. However, the library generation method is using error prone pcr meaning there could multiple mutations resulting in the same amino acid change. The models performance was determined by looking at withheld data however error prone pcr could result in multiple nonsynomymous mutations of the same amino acid. For testing were mutations truly withheld or was there overlap? Because several mutations are being represented by different codon combinations. Was the withheld data for the machine learning withholding specific substitutions?

      We thank the reviewer for identifying the need to clarify this critical data analysis. Data was held-out at the amino acid level, and so no overlap between the training and testing datasets occurred. We have clarified the description of the method in the main text:

      “We calculated RMSE using only held-out data not used in the model training, and the split between held-out data and training data was chosen so that all variants with a specific amino acid sequence appear in only one of the two sets.”


      In addition, higher order protein interactions are complicated and idiosyncratic. I am surprised how well the neural net performs on higher order substitutions. P4L4: Authors find mutations at the dimer/tetramer interfaces but don't mention whether polymerization is required. is dimerization required for dna binding? Tetramerization?

      We agree with the reviewer that, overall, a description of LacI structure and function would improve messaging the reported results. As such, we have added Supplementary Table 2, which defines the structural features discussed throughout the manuscript. Additionally, we have strived to describe the relevant structural and functional role of specific amino acids that are discussed in the text. Finally, we have also added a paragraph to the main text that summarizes the structure and function of LacI.

      “The LacI protein has 360 amino acids arranged into three structural domains__22–24__. The first 62 N-terminal amino acids form the DNA-binding domain, comprising a helix-turn-helix DNA-binding motif and a hinge that connects the DNA-binding motif and the core domain. The core domain, comprising amino acid positions 63-324, is divided into two structural subdomains: the N-terminal core and the C-terminal core. The full core domain forms the ligand-binding pocket, core-pivot region, and dimer interface. The tetramerization domain comprises the final 30 amino acids and includes a flexible linker and an 18 amino acid α-helix (Fig. 3, Supplementary Table 2). Naturally, LacI functions as a dimer of dimers: Two LacI monomers form a symmetric dimer that further assembles into a tetramer (a dimer of dimers).”

      P4L8: Substitutions near the dimer interface both impact g0 and ec50, which authors say is consistent with a change in the allosteric constant. Can authors explain their thinking more in the paper to make it easier to follow? Are the any mutations in this area that only impact g0 or ec50 alone? Why may these specific residues modify dimerization?

      We agree that a more in-depth discussion on the possible mechanisms behind these phenotypic changes would improve the manuscript. We have added discussion throughout the subsection “Effects of amino acid substitutions on LacI phenotype,” we believe this added discussion improve the manuscript and clarify the relationship between the observed allosteric phenotypes and the molecular mechanisms behind them. W

      Overall, we have made a number of changes in the manuscript that we hope will address these concerns.

      P4L8: The authors discuss the allosteric constant extensively within the paper but do not explain it. It would be helpful to have an explanation of this to improve readability. This explanation should include the statistical mechanical basis of it and some speculation about the ways it manifests biophysically.

      The allosteric constant is a critical concept, and we agree that it must be defined and discussed clearly throughout the manuscript. We have greatly expanded the discussion of the effects of single amino acid substitutions, and in the process we give examples of biochemical changes in the protein, and how they may affect the allosteric constant. We think this added text improves the manuscript and helps clarify the allosteric constant and the biomolecular processes that affect it.

      P4L1-16: Authors see mutations in the dimerization region that impact either G0 and Gsaturated in combination with Ec50 but not g0 and gsaturated together. Maybe we do not fully understand the hill equation but why are there no mutations that impact both g0 and gsaturated seen in support fig 13c? Why would mutations in the same region potentially impacting dimerization impact either g0 or gsaturated? What might be the mechanism behind divergent responses?

      It is important to recognize that the dimer interface does not just support the formation of dimers. There are many points of contact along the dimer interface that change when LacI switches between the active and inactive states. So, the dimer interface also helps regulate the balance between the active and inactive states. Our results show that different substitutions near the dimer interface can push this balance either toward the active or inactive states to varying degrees. We’ve added text throughout the description of single-substitutions effects to give specific examples and added a new paragraph at the end of that section to provide additional discussion and context. With regard to the more specific question of changes to both G0 and Ginf, the models indicate that simultaneous changes to those Hill Equation parameters requires an unusual combination of biophysical changes. To clarify this point, we added a short paragraph to the text:

      “None of the single amino substitutions measured in the library simultaneously decrease __G∞ and increase G0 (Supplementary Fig. 20c). This is not surprising, since substitutions that shift the biophysics to favor the active state tend to decrease G∞ while those that favor the inactive state tend to increase G0, and the biophysical models2,14,15 indicate that only a combination of parameter changes can cause both modifications to the dose-response. The library did, however, contain several multi-substitution variants with simultaneously decrease __G∞ and increase G0. These inverted variants, and their associated substitutions are discussed below.”


      P4L29: for interpretability it would be good to explain what log-additive effect means in the context of allostery.

      We agree that this information would be useful to the reader and have added additional text to explain log-additivity. We thank the reviewer for pointing out this oversight.

      “Combining multiple substitutions in a single protein almost always has a log-additive effect on EC50. That is, the proportional effects of two individual amino acid substitutions on the EC50 can be multiplied together. For example, if substitution A results in a 3-fold change, and substitution B results in a 2-fold change, the double substitution, AB, behaving log-additively, results in a 6-fold change__.”__

      P4L34-P5L19: This section is wonderful. Really cool results and interesting structural overlap! P5L34 Helix 9 of the protein is mentioned but it's functional relevance is not. This is common throughout the paper - it would be useful for there to be an overview somewhere to help the reader contextualize the results with known structural role of these elements.

      We agree with the reviewer that this information would help to contextualize the results. We have made a number of changes to address this. First, we have added Supplementary Table 2, which describes the structural features of LacI. Second, we have added a paragraph overviewing the structure and function of LacI. Third, we have expanded the section “the effects of individual amino acid substitutions on the function of LacI” to discuss the structural or biochemical impact of specific substitutions. We thank the reviewer for this suggestion.

      P5L39: The authors identified a triple mutant with the band-stop phenotype then made all combination of the triple mutant. Of particular interest is R195H/G265D which is nearly the same as the triple mutant. It would be nice if the positions of each of these mutations and have some discussion to begin to rationalize this phenotype, even if to point out how far apart they are and that there is no easy structural rationale!

      We appreciate the reviewer highlighting this area of interest. We have added structural information to Fig. 6, which indicates to position of the amino acid substitutions that result in the band-stop phenotype, as well as a small discussion in the main text:

      “To further investigate the band-stop phenotype, we chose a strong band-stop LacI variant with only three amino acid substitutions (R195H/G265D/A337D). These three positions are distributed distally on the periphery of the C-terminal core domain, and the role that each of these substitutions plays in the emergence of the band-stop phenotype is unclear.”

      P6L9: There should be more discussion of the significance of this work directly compared to what is known. For instance, negative cooperativity is mentioned as an explanation for bi-phasic dose response but this idea is not explained. Why would the relevant free energy changes be more entropic? Another example is the reverse-TetR phenotype observed by Hillen et al.

      We agree that more discussion is necessary to frame the results reported in the manuscript. To address this, we have added additional discussion throughout the manuscript that relates the results to the current understanding of allostery. Also, in the Conclusion, we added specific examples that lead us to link the ideas of bi-phasic dose response, negative cooperativity, and entropy/disorder. We believe these additions have improved the manuscript and we thank the reviewer for this suggestion.

      P6L28: The authors mention that phenotypes exist with genotypes that are discoverable with genotype-phenotype landscapes. This study due to the constraints of error prone pcr were somewhat limited. How big is the phenotypic landscape? Is it worth doing a more systematic study? What is the optimal experimental design: Single mutations, doubles, random - where is there the most information. How far can you drift before your machine learning model breaks down? How robust would it be to indels?

      The reviewer raises some excellent questions here, some of which are appropriate subjects for future work. The optimal experimental design depends on the objective: If the goal is to understand every possible mutation, a systematic site-saturation approach would be more appropriate. However, the landscape of a natural protein is limited by its wild-type DNA coding sequence, and so some substitutions are inaccessible (due to the arrangement of the codon table). The approach we took allowed to us characterize most of the accessible amino acid substitutions, while also allowing us to identify novel functions that would not have been identified with other approaches. We have added a little to the main text to discuss this (below). With regard to the DNN model, in the manuscript (SI Fig. 14), we show how the predictive accuracy degrades with mutational distance from the wild-type. It is possible that the type of DNN that we used could handle indels, since it effectively encodes each variant as a set of step-wise changes from the wild-type. But as with all machine-learning methods, it would require training with a dataset that included indels.

      “Novel phenotypes emerged at mutational distances greater than one amino acid substitution, highlighting the value in sampling a broader genotype space with higher-order mutations. Furthermore, the untargeted, random mutagenesis approach used here was critical for finding these novel phenotypes, as the genotypes required for these novel phenotypes were unpredictable.”

      Figures: Sup figs 3-7: The comparison of library-based results and single mutants is a great example of how to validate genotype-phenotype experiments!

      Thank you.

      Supp fig 5.: Missing figure number.

      We appreciate the reviewer catching this error and have attempted to properly label all figures and tables in this revision. Thank you.

      Supp fig7: G0 appears to have very poor fit between library vs single mutant version. Why might this be? R^2 would likely be better to report here as opposed to RMSE as RMSE is sensitize to the magnitude of the data such that you cannot directly compare RMSE of say 'n' to G0.

      We agree that these are important discussion points and have addressed this concern with an expanded discussion in the main text, as well as the addition of coefficient of correlation (R^2) in the caption for Figure 2 (previously supplementary figure 7). We believe these additions contribute meaningfully to the manuscript, and they address the concerns of the reviewer. The additional text reads:

      “We compared the Hill equation parameters from the library-scale measurement to those same parameters determined from flow cytometry measurements for each of the chemically synthesized LacI variants (Fig. 2). This served as a check of the new library-scale method’s overall ability to measure dose-response curves with quantitative accuracy. The accuracy for each Hill equation parameter in the library-scale measurement was: 4-fold for G0, 1.5-fold for G∞, 1.8-fold for EC50, and ± 0.28 for n. For G0, G∞, and EC50, we calculated the accuracy as: __, where __ is the root-mean-square difference between the logarithm of each parameter from the library-scale and cytometry measurements. For n, we calculated the accuracy simply as the root-mean-square difference between the library-scale and cytometry results. The accuracy for the gene expression levels (G0 and G∞) was better at higher gene expression levels (typical for G∞) than at low gene expression levels (typical for G0), which is expected based on the non-linearity of the fitness impact of tetracycline (Supplementary Figs. 10-11). Measurements of the Hill coefficient, n, had high relative uncertainties for both barcode-sequencing and flow cytometry, and so the parameter n was not used in any quantitative analysis.”

      Sup fig13c: it is somewhat surprising that mutations only appear to effect g0 and not gsaturated. This implies that basal and saturated activity are not coupled. Is this expected? Why or why not?

      This comment is partially addressed with a response above (P4L1-16). Coupled gene expression increases do occur, especially with substitutions at the start codon that result in fewer copies of LacI in the cell. In this instance, both G0 and G∞ are increased. Otherwise, changes to multiple biophysical parameters are required to increase both G0 and G∞.

      Reviewer #1 (Significance (Required)): Allostery is hard to comprehend because it involves many interacting residues propagating information across a protein. The Monod-Wyman-Changeux (MWC) and Koshland, Nemethy, and Filmer (KNF) models have been a long standing framework to explain much of allostery, however recent formulations have focused on the role of the conformational ensemble and a grounding in statistical mechanics. This manuscript focuses on the functional impact of mutations and therefore contribution of the amino acids to regulation. The authors unbiased approach of combining a dose-response curve and mutational library generation let them fit every mutant to a hill equation. This approach let the authors identify the allosteric phenotype of all measured mutations! The authors found inverted phenotypes which happen in homologs of this protein but most interesting is the strange and idiosyncratic 'Band-stop' phenotype. The band-stop phenotype is bi-phasic that will hopefully be followed up with further studies to explain the mechanism. This manuscript is a fascinating exploration of the adaptability of allosteric landscapes with just a handful of mutations. Genotype-phenotype experiments allow sampling immense mutational space to study complex phenotypes such as allostery. However, a challenge with these experiments is that allostery and other complicated phenomena come from immense fitness landscapes altering different parameters of the hill equation. The authors approach of using a simple error prone pcr library combined with many ligand concentrations allowed them to sample a very large space somewhat sparsely. However, they were able to predict this data by training and using a neural net model. I think this is a clever way to fill in the gaps that are inherent to somewhat sparse sampling from error prone pcr. The experimental design of the dose response is especially elegant and a great model for how to do these experiments. With some small improvements for readability, this manuscript will surely find broad interest to the genotype-phenotype, protein science, allostery, structural biology, and biophysics fields. We were prompted to do this by Review Commons and are posting our submitted review here: Willow Coyote-Maestas has relevant expertise in high throughput screening, protein engineering, genotype-phenotype experiments, protein allostery, dating mining, and machine learning. James Fraser has expertise in structural biology, genotype-phenotype experiments, protein allostery, protein dynamics, protein evolution, etc.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)): The authors use deep mutational scanning to infer the dose-response curves of ~60,000 variants of the LacI repressor and so provide an unprecedently systematic dataset of how mutations affect an allosteric protein. Overall this is an interesting dataset that highlights the potential of mutational scanning for rapidly identifying diverse variants of proteins with desired or unexpected activities for synthetic biology/bioengineering. The relatively common inverted phenotypes and their sequence diversity is interesting, as is the identification of several hundred genotypes with non-sigmoidal band-stop dose-response curves and their enrichment in specific protein regions. A weakness of the study is that some of the parameter estimates seem to have high uncertainty and this is not clearly presented or the impact on the conclusions analysed. A second shortcoming is that there is little mechanistic insight beyond the enrichments of mutations with different effects in different regions of the protein. But as a first overview of the diversity of mutational effects on the dose-response curve of an allosteric protein, this is an important dataset and analysis. **Comments** **Data quality and reproducibility** "The flow cytometry results confirmed both the qualitative and quantitative accuracy of the new method (Supplementary Figs. 3-7)"

      • There need to be quantitative measures of accuracy in the text here for the different parameters.

      We believe this comment is addressed along with the following two comments.

      • Sup fig 7 panels should be main text panels - they are vital for understanding the data quality In particular, the G0 parameter estimates from the library appear to have a lower bound ie they provide no information below a cytometry Go of ~10^4. This is an important caveat and needs to be highlighted in the main text. The Hill parameter (n) estimate for wt (dark gray) replicate barcodes is extremely variable - why is this?

      • In general there is not a clear enough presentation of the uncertainty and biases in the parameter estimations which seem to be rather different for the 4 parameters. Only the EC50 parameter seems to correlate very well with the independent measurements.

      We thank the reviewer for identifying a need for more information on the accuracy of this method. So, we have moved Supplementary Fig. 7 to the main text (Fig 2 in the revised manuscript) and have added coefficients of correlation to each Hill equation parameter in that figure caption. Furthermore, we have added new data (Supplementary Fig. 11), which shows the uncertainty associated with different gene expression levels. Finally, we have added a discussion on the accuracy of this method for each parameter of the Hill equation to the main text. Estimation of the Hill coefficient (n) from data is often highly uncertain and variable, because that parameter estimate can be highly sensitive to random measurement errors at a single point on the curve. The estimate for the wild type appears to be highly variable because the plot contains 53 replicate measurements. So, the plotted variability represents approximately 2 standard deviations. The spread of wild-type results in the plot is consistent with the stated RMSE for the Hill coefficient. Furthermore, the Hill coefficient is not used in any of the additional quantitative analysis in our manuscript, partially because of its relatively high measurement uncertainty, but also because, based on the biophysical models, it is not as informative of the underlying biophysical changes.

      “We compared the Hill equation parameters from the library-scale measurement to those same parameters determined from flow cytometry measurements for each of the chemically synthesized LacI variants (Fig. 2). This served as a check of the new library-scale method’s overall ability to measure dose-response curves with quantitative accuracy. The accuracy for each Hill equation parameter in the library-scale measurement was: 4-fold for G0, 1.5-fold for G∞, 1.8-fold for EC50, and ± 0.28 for n. For G0, G∞, and EC50, we calculated the accuracy as: "exp" ["RMSE" ("ln" ("x" ))], where "RMSE" ("ln" ("x" )) is the root-mean-square difference between the logarithm of each parameter from the library-scale and cytometry measurements. For n, we calculated the accuracy simply as the root-mean-square difference between the library-scale and cytometry results. The accuracy for the gene expression levels (G0 and G∞) was better at higher gene expression levels (typical for G∞) than at low gene expression levels (typical for G0), which is expected based on the non-linearity of the fitness impact of tetracycline (Supplementary Figs. 10-11). Measurements of the Hill coefficient, n, had high relative uncertainties for both barcode-sequencing and flow cytometry, and so the parameter n was not used in any quantitative analysis.”

      • The genotypes in the mutagenesis library contain a mean of 4.4 aa substitutions and the authors us a neural network to estimate 3 of the Hill equation parameters (with uncertainties) for the 1991/2110 of the single aa mutations. It would be useful to have an independent experimental evaluation of the reliability of these inferred single aa mutational effects by performing facs on a panel of single aa mutants (using single aa mutants in sup fig 3-7, if there are any, or newly constructed mutants).

      We agree that the predictive performance of the DNN requires experimental validation. We evaluated the performance by withholding data from 20% of the library, including nearly 200 variants with single amino acid substitutions, and then compared the predicted effect of those substitutions to the measured effect. The results of this test are reported in Supplementary Fig. 14. Additionally, we have adjusted the main text to more clearly explain the evaluation process.

      “To evaluate the accuracy of the model predictions, we used the root-mean-square error (RMSE) for the model predictions compared with the measurement results. We calculated RMSE using only held-out data not used in the model training, and the split between held-out data and training data was chosen so that all variants with a specific amino acid sequence appear in only one of the two sets.” __ __

      • fig3/"Combining multiple substitutions in a single protein almost always has a log-additive effect on EC50." How additive are the other 2 parameters? this analysis should also be presented in fig 3. If they are not as additive is it simply because of lower accuracy of the measurements? If the mutational effects are largely additive, then a simple linear model (rather than the DNN) could be used to estimate the single mutant effects from the multiple mutant genotypes.

      We agree with the reviewer that exploring the log-additivity of the Hill equation parameters is informative, and have included Supplementary Figure 21, which displays this information. Furthermore, we expanded the discussion of log-additivity on all three parameters in the main text:

      “Combining multiple substitutions in a single protein almost always has a log-additive effect on EC50. That is, the proportional effects of two individual amino acid substitutions on the EC50 can be multiplied together. For example, if substitution A results in a 3-fold change, and substitution B results in a 2-fold change, the double substitution, AB, behaving log-additively, results in a 6-fold change. Only 0.57% (12 of 2101) of double amino acid substitutions in the measured data have EC50 values that differ from the log-additive effects of the single substitutions by more than 2.5-fold (Fig. 4). This result, combined with the wide distribution of residues that affect EC50, reinforces the view that allostery is a distributed biophysical phenomenon controlled by a free energy balance with additive contributions from many residues and interactions, a mechanism proposed previously1,39 and supported by other recent studies17, rather than a process driven by the propagation of local, contiguous structural rearrangements along a defined pathway.

      A similar analysis of log-additivity for G0 and G∞ is complicated by the more limited range of measured values for those parameters, the smaller number of substitutions that cause large shifts in G0 or G∞, and the higher relative measurement uncertainty at low G(L). However, the effects of multiple substitutions on G0 and G∞ are also consistent with log-additivity for almost every measured double substitution variant (Supplementary Fig. 21).”

      **Presentation/clarity of text and figures**

      • The main text implies that the DNN is trained to predict 3 parameters of the Hill equation but not the Hill coefficient (n). This should be clarified / justified in the main text.

      We agree that the decision to exclude the parameter ‘n’ requires explanation in the main text. To address this, we have added to the main text:

      “Measurements of the Hill coefficient, n, had high relative uncertainties for both barcode-sequencing and flow cytometry, and so the parameter n was not used in any quantitative analysis.”

      and

      “We trained the model to predict the Hill equation parameters G0, G∞, and EC50 (Supplementary Fig. 13), the three Hill equation parameters that were determined with relatively low uncertainty by the library-scale measurement.”

      • The DNN needs to be better explained and justified in the main text for a general audience. How do simpler additive models perform for phenotypic prediction / parameter inference?

      We agree with the reviewer that the DNN needs to be justified in the main text. As part of the revision plan, we propose to compare the predictive performance of the DNN to an additive model.

      • Ref 14. analyses a much smaller set of mutants in the same protein but using an explicit biophysical model. It would be helpful to have a more extensive comparison with the approach and conclusions to this previous study.

      Throughout the manuscript, we frame the results and discussion in terms of the referenced biophysical model. Using the model, we describe the biophysical effects that a substitution may have on LacI, based on observed changes to function associated with that substitution. We also comment briefly on the limitations of this model when applied to the extensive dataset presented here.

      “Most of the non-silent substitutions discussed above are more likely to affect the allosteric constant than either the ligand or operator affinities. Within the biophysical model, those affinities are specific to either the active or inactive state of LacI, i.e. they are defined conditionally, assuming that the protein is in the appropriate state. So, almost by definition, substitutions that affect the ligand-binding or operator-binding affinities (as defined in the models) must be at positions that are close to the ligand-binding site or within the DNA-binding domain. Substitutions that modify the ability of the LacI protein to access either the active state or inactive state, by definition, affect the allosteric constant. This includes, for example, substitutions that disrupt dimer formation (dissociated monomers are in the inactive state), substitutions that lock the dimer rigidly into either the active or inactive state, or substitutions that more subtly affect the balance between the active and inactive states. Thus, because there are many more positions far from the ligand- and DNA- binding regions than close to those regions, there are many more opportunities for substitutions to affect the allosteric constant than the other biophysical parameters. Note that this analysis assumes that substitutions don’t perturb the LacI structure too much, so that the active and inactive states remain somehow similar to the wild-type states. Our results suggest that this is not always the case: consider, for example, the substitutions at positions __K84 and M98 discussed above and the substitutions resulting in the inverted and band-stop phenotypes discussed below.”__

      • Enrichments need statistical tests to know how unexpected that results are e.g. p5 line 12 "67% of strongly inverted variants have substitutions near the ligand-binding pocket"

      We agree that this information is necessary to interpret the results. We have included p-values (previously reported only in the Methods section) throughout the main text of the manuscript.

      The publication by Poelwijk et al. was considered extensively when planning this work, and failing to cite that manuscript would have been tremendously unjust. We have included it, as well as a few additional references that have identified and discussed inverted LacI variants. We sincerely thank the reviewer for identifying this oversight.

      • What mechanisms do the authors envisage that could produce the band-stop dose response curves? There is likely previous theoretical work that could be cited here. In general there is little discussion of the biophysical mechanisms that could underlie the various mutational effects.

      We agree with the reviewer, that discussing the biophysical mechanisms that underlie many of the reported mutations is important to understand the results. We have expanded the subsection “Effects of amino acid substitutions on LacI phenotype” to include discussion on several of the key substitutions (or groups of substitutions) and their potential biophysical effects. Additionally, we consider mechanism that may underlie the band-stop sensor, and propose one model that could explain the band-stop phenotype:

      “In particular, the biphasic dose-response of the band-stop variants suggests negative cooperativity: that is, successive ligand binding steps have reduced ligand binding affinity. Negative cooperativity has been shown to be required for biphasic dose-response curves__42,43. The biphasic dose-response and apparent negative cooperativity are also reminiscent of systems where protein disorder and dynamics have been shown to play an important role in allosteric function1, including catabolite activator protein (CAP)44,45 and the Doc/Phd toxin-antitoxin system46. This suggests that entropic changes may also be important for the band-stop phenotype. A potential mechanism is that band-stop LacI variants have two distinct inactive states: an inactive monomeric state and an inactive dimeric state. In the absence of ligand, inactive monomers may dominate the population. Then, at intermediate ligand concentrations, ligand binding stabilizes dimerization of LacI into an active state which can bind to the DNA operator and repress transcription. When a second ligand binds to the dimer, it returns to an inactive dimeric state, similar to wildtype LacI. This mechanism, and other possible mechanisms, do not match the MWC model of allostery or its extensions2,13–15__ and require a more comprehensive study and understanding of the ensemble of states in which these band-stop LacI variants exist.”

      • "This result, combined with the wide distribution of residues that affect EC50, suggests that LacI allostery is controlled by a free energy balance with additive contributions from many residues and interactions." 'additive contributions and interactions' covers all possible models of vastly different complexity i.e. this sentence is rather meaningless.

      We have attempted to contextualize this statement by adding additional discussion and references. We hope these additions give more meaning to this section.

      “__This result, combined with the wide distribution of residues that affect EC50, reinforces the view that allostery is a distributed biophysical phenomenon controlled by a free energy balance with additive contributions from many residues and interactions, a mechanism proposed previously1,39 and supported by other recent studies17, rather than a process driven by the propagation of local, contiguous structural rearrangements along a defined pathway.”__

      • fig 4 c and d compress a lot of information into one figure and I found this figure confusing. It may be clearer to have multiple panels with each panel presenting one aspect. It is also not clear to me what the small circular nodes exactly represent, especially when you have one smaller node connected to two polygonal nodes, and why they don't have the same colour scale as the polygonal nodes.

      We agree with the reviewer that figure 4 (or Figure 5 in the revised manuscript) contains a lot of information. The purpose of this figure is to convey the structural and genetic diversity among the sets of inverted variants and band-stop variants. We designed this figure to convey this point at two levels: a brief overview, where the diversity is apparent by quickly considering the figure, and at a more informative level, with some quantitative data and structurally relevant points highlighted. We have modified the caption slightly, in an effort to improve clarity.

      • line 25 - 'causes a conformational change' -> 'energetic change' (allostery does not always involve conformational change

      We thank the reviewer for this comment and have adopted a more modern language describe allostery throughout the manuscript.

      • sup fig 5 legend misses '5'

      We thank the reviewer for pointing this out, we have attempted to number all figures and tables more carefully.

      • sup fig 7. pls add correlation coefficients to these plots (and move to main text figures).

      We agree that this information is of interest and have included this data as main text Figure 2. In addition, we have included coefficients of correlation in the caption of this figure.

      • Reference 21 is just a title and pubmed link

      We thank the reviewer for identifying this error, we have corrected this in the references.

      • "fitness per hour" -> growth rate

      To ensure that this connection is clearly established, when we introduce fitness for the first time, we clarify that it relates to growth rate:

      “Consequently, in the presence of tetracycline, the LacI dose-response modulates cellular fitness (i.e. growth rate) based on the concentration of the input ligand isopropyl-β-D-thiogalactoside (IPTG).”

      Also, we define ‘fitness’ in the Methods section:

      “The experimental approach for this work was designed to maintain bacterial cultures in exponential growth phase for the full duration of the measurements. So, in all analysis, the Malthusian definition of fitness was used, i.e. fitness is the exponential growth rate__58__.”

      • page 6 line 28 - "discoverable only via large-scale landscape measurements" - directed evolution approaches can also discover such genotypes (see e.g. Poelwijk /Tans paper). Please re-phrase.

      We agree with the reviewer and have adjusted the main text accordingly.

      “__Overall, our findings suggest that a surprising diversity of useful and potentially novel allosteric phenotypes exist with genotypes that are readily discoverable via large-scale landscape measurements.”__

      • pls define jargon the first time it is used e.g. band-stop and band-pass

      We agree that all unconventional terms should be explicitly defined when used, and we have attempted to define the band-pass and band-stop dose-response curves more clearly in the main text:

      “These include examples of LacI variants with band-stop dose-response curves (i.e. variants with high-low-high gene expression; e.g. Fig. 1e, Supplementary Fig. 7), and LacI variants with band-pass dose-response curves (i.e. variants with low-high-low gene expression; e.g. Supplementary Fig. 8).”

      **Methods/data availability/ experimental and analysis reproducibility:** The way that growth rate is calculated on page 17 equation 1- This section is confusing. Please be explicit about how you accounted for the lag phase, what the lag phase was, and total population growth during this time. In addition, please report the growth curves from the wells of the four plates, the final OD600 of the pooled samples, and exact timings of when the samples were removed from 37 degree incubation in a table. These are critical for calculating growth rate in individual clones downstream.

      We thank the reviewer for identifying the need to clarify this section of text. The ‘lag’ in this section referred to a delay before tetracycline began impacting the growth rate of cells. To address this, we have changed ‘lag’ in this context to ‘delay.’ Furthermore, we have attempted to clarify precisely the cause of this delay, and how we accounted for it in calculating growth rates:

      For samples grown with tetracycline, the tetracycline was only added to the culture media for Growth Plates 2‑4. Because of the mode of action of tetracycline (inhibition of translation), there was a delay in its effect on cell fitness: Immediately after diluting cells into Growth Plate 2 (the first plate with tetracycline), the cells still had a normal level of proteins needed for growth and proliferation and they continued to grow at nearly the same rate as without tetracycline. Over time, as the level of proteins required for cell growth decreased due to tetracycline, the growth rate of the cells decreased. Accordingly, the analysis accounts for the variation in cell fitness (growth rate) as a function of time after the cells were exposed to tetracycline. With the assumption that the fitness is approximately proportional to the number of proteins needed for growth, the fitness as a function of time is taken to approach the new value with an exponential decay:

      (3)

      where μitet is the steady-state fitness with tetracycline, and α is a transition rate. The transition rate was kept fixed at α = log(5), determined from a small-scale calibration measurement. Note that at the tetracycline concentration used during the library-scale measurement (20 µg/mL), μitet was greater than zero even at the lowest G(L) levels (Supplementary Fig. 10). From Eq. (3), the number of cells in each Growth Plate for samples grown with tetracycline is:

      • What were the upper and lower bounds of the measurements? (LacI deletion vs Tet deletion / autofluoresence phenotype - true 100% and true 0% activity). Knowing and reporting these bounds will also allow easier comparison between datasets in the future.

      We agree that knowing the limitations of the measurement are important for contextualizing the results. To address this point, we have included Supplementary Fig. 11, which shows the uncertainty of the measurement across gene expression levels.

      Please clarify whether there was only 1 biological replicate (because the plates were pooled before sequencing)? Or if there were replicates present an analysis of reproducibility.

      We thank the reviewer for pointing out the ambiguity in the original manuscript. The library-scale measurement reported here was completed once, the 24 growth conditions were spread across 96 wells, so each condition occupied 4 wells. The 4 wells were combined prior to DNA extraction. We have clarified this process in the methods by removing ‘duplicate’:

      “Growth Plate 2 contained the same IPTG gradient as Growth Plate 1 with the addition of tetracycline (20 µg/mL) to alternating rows in the plate, resulting in 24 chemical environments, with each environment spread across 4 wells.”

      Despite there being only a single library-scale measurement, the accuracy and reliability of the results are supported by many distinct biological replicates within the library (i.e. LacI variants with the same amino acid sequence but with different barcodes, see new Supplementary Fig. 9), as well as over 100 orthogonal dose-response curve measurements completed with flow cytometry (Figure 2). We believe these support the reproducibility of the work and we have included statistical analysis on the accuracy of the library-scale measurement results.

      “To test the accuracy of the new method for library-scale dose-response curve measurements, we independently verified the results for over 100 LacI variants from the library. For each verification measurement, we chemically synthesized the coding DNA sequence for a single variant and inserted it into a plasmid where LacI regulates the expression of a fluorescent protein. We transformed the plasmid into E. coli and measured the resulting dose-response curve with flow cytometry (e.g. Fig. 1e). We compared the Hill equation parameters from the library-scale measurement to those same parameters determined from flow cytometry measurements for each of the chemically synthesized LacI variants (Fig. 2). This served as a check of the new library-scale method’s overall ability to measure dose-response curves with quantitative accuracy. The accuracy for each Hill equation parameter in the library-scale measurement was: 4-fold for G0, 1.5-fold for G∞, 1.8-fold for EC50, and ± 0.28 for n. For G0, G∞, and EC50, we calculated the accuracy as: "exp" ["RMSE" ("ln" ("x" ))], where "RMSE" ("ln" ("x" )) is the root-mean-square difference between the logarithm of each parameter from the library-scale and cytometry measurements. For n, we calculated the accuracy simply as the root-mean-square difference between the library-scale and cytometry results (Supplementary Fig. 7).”

      • Please provide supplementary tables of the data (in addition to the raw sequencing files). Both a table summarising the growth rates, inferred parameter values and uncertainties for genotypes and a second table with the barcode sequence counts across timepoints and associated experimental data.

      We agree that access to this information is critical. Due to the size of the associated data, we have made this data available for download in a public repository. We direct readers to the repository information in the “Data Availability” statement:

      “The raw sequence data for long-read and short-read DNA sequencing have been deposited in the NCBI Sequence Read Archive and are available under the project accession number PRJNA643436. Plasmid sequences have been deposited in the NCBI Genbank under accession codes MT702633, and MT702634, for pTY1 and pVER, respectively.

      The processed data table containing comprehensive data and information for each LacI variant in the library is publicly available via the NIST Science Data Portal, with the identifier ark:/88434/mds2-2259 (https://data.nist.gov/od/id/mds2-2259 or https://doi.org/10.18434/M32259). The data table includes the DNA barcode sequences, the barcode read counts, the time points used for the libarary-scale measurement, fitness estimates for each barcoded variant across the 24 chemical environments, the results of both Bayesian inference models (including posterior medians, covariances, and 0.05, 0.25, 0.75, and 0.95 posterior quantiles), the LacI CDS and amino acid sequence for each barcoded variant (as determined by long-read sequencing), the number of LacI CDS reads in the long-read sequencing dataset for each barcoded variant, and the number of unintended mutations in other regions of the plasmid (from the long-read sequencing data).

      Code Availability

      All custom data analysis code is available at https://github.com/djross22/nist_lacI_landscape_analysis.”

      Reviewer #2 (Significance (Required)): The authors present an unprecedently systematic dataset of how mutations affect an allosteric protein. This illustrates the potential of mutational scanning for rapidly identifying diverse variants of allosteric proteins / regulators with desired or unexpected activities for synthetic biology/bioengineering. Previous studies have identified inverted dose-response curve for a lacI phenotypes https://www.cell.com/fulltext/S0092-8674(11)00710-0 but using directed evolution i.e. they were not comprehensive in nature. The audience of this study would be protein engineers, the allostery field, synthetic biologists and the mutation scanning community and evolutionary biologists interested in fitness landscapes. My relevant expertise is in deep mutational scanning and genotype-phenotype landscapes, including work on allosteric proteins and computational methods. Reviewer #3 (Evidence, reproducibility and clarity (Required)): In this interesting manuscript the authors developed in ingenious high throughput screening approach which utilizes DNA barcoding to select variants of LacI proteins with different allosteric profiles for IPTG control using E. coli fitness (growth rate) in a range of antibiotic concentrations as a readout thus providing a genotype-phenotype map for this enzyme. The authors used library of 10^5-10^ variants of LacI expressed from a plasmid and screened for distinct IPTG activation profiles under different conditions including several antibiotic stressors. As a result they identified various patterns of activation including normal (sigmoidal increase), inverted (decrease) and unusual stop-band where the dependence of growth on [IPTG] is non-monotonic. The study is well-conceived, well executed and provides statistically significant results. The key advance provided by this work is that it allows to identify specific mutations in LacI connected with one of three allosteric profiles. The paper is clearly written all protocols are explained and it can be reproduced in a lab that possesses proper expertise in genetics. Reviewer #3 (Significance (Required)): The significance of this work is that it discovered libraries of LacI variants which give rise to distinct profiles of allosteric control of activation of specific genes (in this case antibiotic resistance) by the Lac mechanism. The barcoding technology allowed to identify specific mutations which are (presumably) causal of changes in the way how allosteric activation of LacI by IPTG works. As such it provides a rich highly resolved dataset of LacI variants for further exploration and analysis. Alongside with these strengths several weaknesses should also be noted:

      1. First and foremost the paper does not provide any molecular-level biophysical insights into the impact of various types of mutations on molecular properties of LacI. Do the mutations change binding affinity to IPTG? Binding side? Communication dynamics? Stability? The diagrams of connectivity for the stop-band mutations (Fig.4) do not provide much help as they do not tell much which molecular properties of LacI are affected by mutations and why certain mutations have specific effect on allostery. A molecular level exploration would make this paper much stronger.

      We address this comment with comment (2), below.

      1. In the same vein a theoretical MD study would be quite illuminating in answering the key unanswered question of this work: Why do mutations have various and pronounced effects of allosteric regulation by LacI?. I think publication of this work should not be conditioned on such study but again adding would make the work much stronger.

      We appreciate the reviewer’s comments and agree that investigating the molecular mechanisms driving the phenotypic changes identified in this work is a compelling proposition. Throughout the manuscript, we identify positions and specific amino acid substitutions that affect the measurable function of LacI, and occasionally discuss the biophysical effects that may underly these changes. We have expanded the discussion to include possible molecular-level effects.

      The dataset reported here identifies many potential candidates for molecular-level study, either computationally or experimentally. However, this manuscript is scoped to report a large-scale method to measure the genotype-phenotype landscape of an allosteric protein, and a limited investigation into the emergence of novel phenotypes that are identified in the landscape.

      1. Lastly a recent study PNAS v.116 pp.11265-74 (2019) explored a library of variants of E. coli Adenylate Kinase and showed the relationship between allosteric effects due to substrate inhibition and stability of the protein. Perhaps a similar relationship can explored in this case of LacI.

      We thank the reviewer for highlighting this publication. We agree with the reviewer that similar effects may play a role in the activity of LacI. Establishing such a relationship would require additional experimentation, and, we think, is outside the scope of the submitted manuscript. Although, we hope follow-up studies using this dataset will investigate this phenomenon and other related mechanisms, that may underlie the band-stop phenotype and other observed effects.

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      In this interesting manuscript the authors developed in ingenious high throughput screening approach which utilizes DNA barcoding to select variants of LacI proteins with different allosteric profiles for IPTG control using E. coli fitness (growth rate) in a range of antibiotic concentrations as a readout thus providing a genotype-phenotype map for this enzyme. The authors used library of 10^5-10^ variants of LacI expressed from a plasmid and screened for distinct IPTG activation profiles under different conditions including several antibiotic stressors. As a result they identified various patterns of activation including normal (sigmoidal increase), inverted (decrease) and unusual stop-band where the dependence of growth on [IPTG] is non-monotonic. The study is well-conceived, well executed and provides statistically significant results. The key advance provided by this work is that it allows to identify specific mutations in LacI connected with one of three allosteric profiles. The paper is clearly written all protocols are explained and it can be reproduced in a lab that possesses proper expertise in genetics.

      Significance

      The significance of this work is that it discovered libraries of LacI variants which give rise to distinct profiles of allosteric control of activation of specific genes (in this case antibiotic resistance) by the Lac mechanism. The barcoding technology allowed to identify specific mutations which are (presumably) causal of changes in the way how allosteric activation of LacI by IPTG works. As such it provides a rich highly resolved dataset of LacI variants for further exploration and analysis.

      Alongside with these strengths several weaknesses should also be noted:

      1. First and foremost the paper does not provide any molecular-level biophysical insights into the impact of various types of mutations on molecular properties of LacI. Do the mutations change binding affinity to IPTG? Binding side? Communication dynamics? Stability? The diagrams of connectivity for the stop-band mutations (Fig.4) do not provide much help as they do not tell much which molecular properties of LacI are affected by mutations and why certain mutations have specific effect on allostery. A molecular level exploration would make this paper much stronger.
      2. In the same vein a theoretical MD study would be quite illuminating in answering the key unanswered question of this work: Why do mutations have various and pronounced effects of allosteric regulation by LacI?. I think publication of this work should not be conditioned on sucgh study but again adding would make the work much stronger.
      3. Lastly a recent study PNAS v.116 pp.11265-74 (2019) explored a library of variants of E. coli Adenylate Kinase and showed the relationship between allosteric effects due to substrate inhibition and stability of the protein. Perhaps a similar relationship can explored in this case of LacI.
    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      The authors use deep mutational scanning to infer the dose-response curves of ~60,000 variants of the LacI repressor and so provide an unprecedently systematic dataset of how mutations affect an allosteric protein. Overall this is an interesting dataset that highlights the potential of mutational scanning for rapidly identifying diverse variants of proteins with desired or unexpected activities for synthetic biology/bioengineering. The relatively common inverted phenotypes and their sequence diversity is interesting, as is the identification of several hundred genotypes with non-sigmoidal band-stop dose-response curves and their enrichment in specific protein regions. A weakness of the study is that some of the parameter estimates seem to have high uncertainty and this is not clearly presented or the impact on the conclusions analysed. A second shortcoming is that there is little mechanistic insight beyond the enrichments of mutations with different effects in different regions of the protein. But as a first overview of the diversity of mutational effects on the dose-response curve of an allosteric protein, this is an important dataset and analysis.

      Comments

      Data quality and reproducibility

      "The flow cytometry results confirmed both the qualitative and quantitative accuracy of the new method (Supplementary Figs. 3-7)"

      • There need to be quantitative measures of accuracy in the text here for the different parameters.
      • Sup fig 7 panels should be main text panels - they are vital for understanding the data quality In particular, the G0 parameter estimates from the library appear to have a lower bound ie they provide no information below a cytometry Go of ~10^4. This is an important caveat and needs to be highlighted in the main text. The Hill parameter (n) estimate for wt (dark gray) replicate barcodes is extremely variable - why is this?
      • In general there is not a clear enough presentation of the uncertainty and biases in the parameter estimations which seem to be rather different for the 4 parameters. Only the EC50 parameter seems to correlate very well with the independent measurements.
      • The genotypes in the mutagenesis library contain a mean of 4.4 aa substitutions and the authors us a neural network to estimate 3 of the Hill equation parameters (with uncertainties) for the 1991/2110 of the single aa mutations. It would be useful to have an independent experimental evaluation of the reliability of these inferred single aa mutational effects by performing facs on a panel of single aa mutants (using single aa mutants in sup fig 3-7, if there are any, or newly constructed mutants).
      • fig3/"Combining multiple substitutions in a single protein almost always has a log-additive effect on EC50." How additive are the other 2 parameters? this analysis should also be presented in fig 3. If they are not as additive is it simply because of lower accuracy of the measurements? If the mutational effects are largely additive, then a simple linear model (rather than the DNN) could be used to estimate the single mutant effects from the multiple mutant genotypes.

      Presentation/clarity of text and figures

      • The main text implies that the DNN is trained to predict 3 parameters of the Hill equation but not the Hill coefficient (n). This should be clarified / justified in the main text.
      • The DNN needs to be better explained and justified in the main text for a general audience. How do simpler additive models perform for phenotypic prediction / parameter inference?
      • Ref 14. analyses a much smaller set of mutants in the same protein but using an explicit biophysical model. It would be helpful to have a more extensive comparison with the approach and conclusions o this previous study.
      • Enrichments need statistical tests to know how unexpected that results are e.g. p5 line 12 "67% of strongly inverted variants have substitutions near the ligand-binding pocket"
      • missing citation: Poelwijk et al 2011 https://www.cell.com/fulltext/S0092-8674(11)00710-0 previously reported an inverted dose-response curve for a lacI mutant.
      • What mechanisms do the authors envisage that could produce the band-stop dose response curves? There is likely previous theoretical work that could be cited here. In general there is little discussion of the biophysical mechanisms that could underlie the various mutational effects.
      • "This result, combined with the wide distribution of residues that affect EC50, suggests that LacI allostery is controlled by a free energy balance with additive contributions from many residues and interactions." 'additive contributions and interactions' covers all possible models of vastly different complexity i.e. this sentence is rather meaningless.
      • fig 4 c and d compress a lot of information into one figure and I found this figure confusing. It may be clearer to have multiple panels with each panel presenting one aspect. It is also not clear to me what the small circular nodes exactly represent, especially when you have one smaller node connected to two polygonal nodes, and why they don't have the same colour scale as the polygonal nodes.
      • line 25 - 'causes a conformational change' -> 'energetic change' (allostery does not always involve conformational change
      • sup fig 5 legend misses '5'
      • sup fig 7. pls add correlation coefficients to these plots (and move to main text figures).
      • Reference 21 is just a title and pubmed link
      • "fitness per hour" -> growth rate
      • page 6 line 28 - "discoverable only via large-scale landscape measurements" - directed evolution approaches can also discover such genotypes (see e.g. Poelwijk /Tans paper). Please re-phrase.
      • pls define jargon the first time it is used e.g. band-stop and band-pass

      Methods/data availability/ experimental and analysis reproducibility:

      • The way that growth rate is calculated on page 17 equation 1- This section is confusing. Please be explicit about how you accounted for the lag phase, what the lag phase was, and total population growth during this time. In addition, please report the growth curves from the wells of the four plates, the final OD600 of the pooled samples, and exact timings of when the samples were removed from 37 degree incubation in a table. These are critical for calculating growth rate in individual clones downstream.
      • What were the upper and lower bounds of the measurements? (LacI deletion vs Tet deletion / autofluoresence phenotype - true 100% and true 0% activity). Knowing and reporting these bounds will also allow easier comparison between datasets in the future.
      • Please clarify whether there was only 1 biological replicate (because the plates were pooled before sequencing)? Or if there were replicates present an analysis of reproducibility.
      • Please provide supplementary tables of the data (in addition to the raw sequencing files). Both a table summarising the growth rates, inferred parameter values and uncertainties for genotypes and a second table with the barcode sequence counts across timepoints and associated experimental data.

      Significance

      The authors present an unprecedently systematic dataset of how mutations affect an allosteric protein. This illustrates the potential of mutational scanning for rapidly identifying diverse variants of allosteric proteins / regulators with desired or unexpected activities for synthetic biology/bioengineering.

      Previous studies have identified inverted dose-response curve for a lacI phenotypes https://www.cell.com/fulltext/S0092-8674(11)00710-0 but using directed evolution i.e. they were not comprehensive in nature.

      The audience of this study would be protein engineers, the allostery field, synthetic biologists and the mutation scanning community and evolutionary biologists interested in fitness landscapes.

      My relevant expertise is in deep mutational scanning and genotype-phenotype landscapes, including work on allosteric proteins and computational methods.

    4. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      The authors study allostery with a beautiful genotype-phenotype experiment to study the fitness landscape of an allosteric lac repressor protein. The authors make a mutational library using error prone pcr and measure the impact on antibiotic resistance protein expression at varying levels of ligand, IPTG, expression. After measuring the impact of mutations authors fill-in the missing data using a neural net model. This type of dose response is not standard in the field, but the richness of their data and the discovery of the "band pass" phenomena prove its worth here splendidly.

      Using this mixed experimental/predicted data the authors explore how each mutation alters the different parameters of a hill equation fit of a dose response curve. Using higher order mutational space the authors look at how mutations can qualitatively switch phenotypes to inverted or band-stop dose-response curves. To validate and further explore a band-stop novel phenotype, the authors focused on a triple mutant and made all combinations of the 3 mutations. The authors find that only one mutation alone alters the dose-response and only in combination does a band-stop behavior present itself. Overall this paper is a fantastic data heavy dive into the allosteric fitness landscape of protein.

      Major

      Overall, the data presented in this paper is thoroughly collected and analyzed making the conclusions well-based. We do not think additional experiments nor substantial changes are needed apart from including basic experimental details and more biophysical rationale/speculation as discussed in further detail below.

      The authors do a genotype-phenotype experiment that requires extensive deep sequencing experiments. However, right now quite a bit of basic statistics on the sequencing is missing. Baseline library quality is somewhat shown in supplementary fig 2 but the figure is hard to interpret. It would be good to have a table that states how many of all possible mutations at different mutation depths (single, double, etc) there are. Similarly, sequencing statistics are missing- it would be useful to know how many reads were acquired and how much sequencing depth that corresponds to. This is particularly important for barcode assignment to phenotype in the long-read sequencing. In addition, a synonymous mutation comparison is mentioned but in my reading that data is not presented in the supplemental figures section.

      The paper is very much written from an "old school" allostery perspective with static end point structures that are mutually exclusive - eg. p5l10 "relative ligand-binding affinity between the two conformations" - however, an ensemble of conformations is likely needed to explain their data. This is especially true for the bandpass and inverted phenotypes they observe. The work by Hilser et al is of particular importance in this area. We would invite the authors to speculate more freely about the molecular origins of their findings.

      Minor

      There are a number of small modifications. In general this paper is very technical and could use with some explanation and discussion for relevance to make the manuscript more approachable for a broader audience.

      P1L23: Ligand binding at one site causes a conformational changes that affects the activity of another > not necessarily true - and related to using more "modern" statistical mechanical language for describing allostery.

      P2L20: The core experiment of this paper is a selection using a mutational library. In the main body the authors mention the library was created using mutagenic pcr but leave it at that. More details on what sort of mutagenic pcr was used in the main body would be useful. According to the methods error prone pcr was used. Why use er-pcr vs deep point mutational libraries? Presumably to sample higher order phenotype? Rationale should be included. Were there preliminary experiments that helped calibrate the mutation level?

      P2L20: Baseline library statistics would be great in a table for coverage, diversity, etc especially as this was done by error prone pcr vs a more saturated library generation method. This is present in sup fig2 but it's a bit complicated.

      P2L26: How were FACS gates drawn? This is in support fig17 - should be pointed to here.

      P3L4: Where is the figure/data for the synonymous SNP mutations? This should be in the supplement.

      P3L20: The authors use a ML learning deep neural network to predict variant that were not covered in the screen. However, the library generation method is using error prone pcr meaning there could multiple mutations resulting in the same amino acid change. The models performance was determined by looking at withheld data however error prone pcr could result in multiple nonsynomymous mutations of the same amino acid. For testing were mutations truly withheld or was there overlap? Because several mutations are being represented by different codon combinations. Was the withheld data for the machine learning withholding specific substitutions?

      In addition, higher order protein interactions are complicated and idiosyncratic. I am surprised how well the neural net performs on higher order substitutions.

      P4L4: Authors find mutations at the dimer/tetramer interfaces but don't mention whether polymerization is required. is dimerization required for dna binding? Tetramerization?

      P4L8: Substitutions near the dimer interface both impact g0 and ec50, which authors say is consistent with a change in the allosteric constant. Can authors explain their thinking more in the paper to make it easier to follow? Are the any mutations in this area that only impact g0 or ec50 alone? Why may these specific residues modify dimerization?

      P4L8: The authors discuss the allosteric constant extensively within the paper but do not explain it. It would be helpful to have an explanation of this to improve readability. This explanation should include the statistical mechanical basis of it and some speculation about the ways it manifests biophysically.

      P4L1-16: Authors see mutations in the dimerization region that impact either G0 and Gsaturated in combination with Ec50 but not g0 and gsaturated together. Maybe we do not fully understand the hill equation but why are there no mutations that impact both g0 and gsaturated seen in support fig 13c? Why would mutations in the same region potentially impacting dimerization impact either g0 or gsaturated? What might be the mechanism behind divergent responses?

      P4L29: for interpretability it would be good to explain what log-additive effect means in the context of allostery.

      P4L34-P5L19: This section is wonderful. Really cool results and interesting structural overlap!

      P5L34 Helix 9 of the protein is mentioned but it's functional relevance is not. This is common throughout the paper - it would be useful for there to be an overview somewhere to help the reader contextualize the results with known structural role of these elements.

      P5L39: The authors identified a triple mutant with the band-stop phenotype then made all combination of the triple mutant. Of particular interest is R195H/G265D which is nearly the same as the triple mutant. It would be nice if the positions of each of these mutations and have some discussion to begin to rationalize this phenotype, even if to point out how far apart they are and that there is no easy structural rationale!

      P6L9: There should be more discussion of the significance of this work directly compared to what is known. For instance negative cooperativity is mentioned as an explanation for bi-phasic dose response but this idea is not explained. Why would the relevant free energy changes be more entropic? Another example is the reverse-TetR phenotype observed by Hillen et al.

      P6L28: The authors mention that phenotypes exist with genotypes that are discoverable with genotype-phenotype landscapes. This study due to the constraints of error prone pcr were somewhat limited. How big is the phenotypic landscape? Is it worth doing a more systematic study? What is the optimal experimental design: Single mutations, doubles, random - where is there the most information. How far can you drift before your machine learning model breaks down? How robust would it be to indels?

      Figures:

      Sup figs 3-7: The comparison of library-based results and single mutants is a great example of how to validate genotype-phenotype experiments!

      Supp fig 5.: Missing figure number.

      Supp fig7: G0 appears to have very poor fit between library vs single mutant version. Why might this be? R^2 would likely be better to report here as opposed to RMSE as RMSE is sensitize to the magnitude of the data such that you cannot directly compare RMSE of say 'n' to G0.

      Sup fig13c: it is somewhat surprising that mutations only appear to effect g0 and not gsaturated. This implies that basal and saturated activity are not coupled. Is this expected? Why or why not?

      Significance

      Allostery is hard to comprehend because it involves many interacting residues propagating information across a protein. The Monod-Wyman-Changeux (MWC) and Koshland, Nemethy, and Filmer (KNF) models have been a long standing framework to explain much of allostery, however recent formulations have focused on the role of the conformational ensemble and a grounding in statistical mechanics. This manuscript focuses on the functional impact of mutations and therefore contribution of the amino acids to regulation. The authors unbiased approach of combining a dose-response curve and mutational library generation let them fit every mutant to a hill equation. This approach let the authors identify the allosteric phenotype of all measured mutations! The authors found inverted phenotypes which happen in homologs of this protein but most interesting is the strange and idiosyncratic 'Band-stop' phenotype. The band-stop phenotype is bi-phasic that will hopefully be followed up with further studies to explain the mechanism. This manuscript is a fascinating exploration of the adaptability of allosteric landscapes with just a handful of mutations.

      Genotype-phenotype experiments allow sampling immense mutational space to study complex phenotypes such as allostery. However, a challenge with these experiments is that allostery and other complicated phenomena come from immense fitness landscapes altering different parameters of the hill equation. The authors approach of using a simple error prone pcr library combined with many ligand concentrations allowed them to sample a very large space somewhat sparsely. However, they were able to predict this data by training and using a neural net model. I think this is a clever way to fill in the gaps that are inherent to somewhat sparse sampling from error prone pcr. The experimental design of the dose response is especially elegant and a great model for how to do these experiments.

      With some small improvements for readability, this manuscript will surely find broad interest to the genotype-phenotype, protein science, allostery, structural biology, and biophysics fields.

      We were prompted to do this by Review Commons and are posting our submitted review here:

      Willow Coyote-Maestas has relevant expertise in high throughput screening, protein engineering, genotype-phenotype experiments, protein allostery, dating mining, and machine learning.

      James Fraser has expertise in structural biology, genotype-phenotype experiments, protein allostery, protein dynamics, protein evolution, etc.

      Referees cross-commenting

      Seems like our biggest issues are: better uncertainty estimates of the parameters and more biophysical/mechanistic explanation/speculation. The uncertainty estimates might be tricky with the deep learning approach. The more biophysical speculation will require some re-writing around an ensemble rather than a static structure perspective.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      *Reviewer #1 (Evidence, reproducibility and clarity (Required)):**

      This study addresses the role IL-13 in promoting lung damage following migration of the helminth N. brasiliensis larvae from the circulatory system to the lung. The work clearly shows using IL13-/- mice that Nb elicited IL-13 immunity at days 2-6 post-infection reduces pathology. The authors demonstrate an association with reduced eosinophils but no effect on neutrophil numbers.

      Proteomic analysis identifies a number of molecules known to be involved in protecting against type 2 pathologies such as relm-a and SP-D.

      The authors then identify a clear requirement for IL-13 in driving relm-a expression.

      Finally, the authors present a whole lung RNA transcript profile which largely supports their proteomic observations.

      Taken together the work presents a sound case for IL-13 being an important player in protecting against initial lung pathology.

      **Major requests:**

      The paper is really very interesting and important. To an extent it questions existing dogma of IL-13 being a driver of lung inflammation.

      Addressing the following could hopefully be achieved using archived samples or with an acceptable amount of extra experimental work.

      Figure 1: D2 and D6 Lung IL-13 concentrations (ELISA) in WT mice would set the scene for the papers story*

      We agree that showing IL-13 concentrations in the lung would nicely set the stage for the role of IL-13 during __Nippostrongylus__ infection. In the current paper, we showed IL-13 mRNA levels in Figure 3 but in a revised version, we will include D2 and D6 mRNA data in Figure 1. We attempted to quantify IL-13 protein levels in the BAL fluid of infected WT mice on D2 and D6 post-infection. However, IL-13 in the BAL was below the levels of detection for our ELISA assay. Therefore, we would need to measure IL-13 protein in total lung homogenates but we do not have material archived at present. If the editor feels this is a critical piece of data we will perform repeat experiments.

      Figure 2: The authors should add evidence that function/activity of neutrophils/eosinophils is changed/not changed: e.g. granzyme, MBP, EPO release in BAL and/or lung.

      As supported by referee 3, we feel that measuring functional readouts of neutrophils and eosinophils, while interesting, is currently outside of the scope of the paper. Further, with respect to eosinophils, we see a major reduction in total eosinophil numbers in IL-13-deficient mice which would likely result in a reduction in the level of functional molecules such as MBP. Thus, these readouts in the BAL may not be a reliable indicator of cellular function and results difficult to interpret in light of altered cell numbers.

      Additionally, some data showing changes in epithelial stress related cytokines such as IL-23 and IL-33 would be informative (IHC and /or ELISA).

      The reviewer makes a good suggestion that would complement our proteomics/pathway analysis. As described in our comment below regarding Foxa2 pathways, we do have additional data showing epithelial cell defects in the absence of IL-13 and will add this to a revised manuscript. While we do see a trend for a reduction in IL-33 mRNA in infected IL-13-deficient mice, it is difficult to correlate this with functional protein. If requested, we can perform additional analyses to measure IL-23 and/or IL-33 protein levels in archived BAL fluid or by IHC of lung sections.

      *The following will require a new experiment:

      The authors present a strong case for RELMa being associated with/driven by IL-13 responses. The following I feel would prove that IL-13 driven RELMa is important in reducing lung pathology. Can enhanced lung pathology or cell responses associated with pathology be reduced/altered by dosing Nb infected IL13-/- mice with recombinant relma or by restimulating BAL cells (for example) from IL-13-/- mice. This team is well placed to comment on the potential for such an in vivo experiment to be feasible.

      Or could the authors could also test the ability for other candidate molecules to reduce lung pathology? Would for example i/n dosing of IL-13-/- mice with AMCase, BRP39 or SP-D protect against pathology? It would be expected to be the case for SP-D.*

      Our previous study has shown that RELM-__a plays an important yet highly complex role during lung repair (see Sutherland et al. 2018: https://doi.org/10.1371/journal.ppat.1007423____). The suggested experiments would advance our understanding of the function of RELM-a and other effector molecules during type 2 immunity and repair. However, it is unlikely that the impact of IL-13 will be due to a single effector molecule (as supported by Reviewer 3) and thus these types of experiments would shift the focus of the paper from the impact of IL-13 to understanding specific function of type 2 effectors. Since our study deals more broadly with the function of IL-13 rather than the downstream effectors, we hope that this will open up further investigation of these specific molecules to the wider community to take forward.__

      *Reviewer #1 (Significance (Required)):

      The manuscript places IL-13 as an important initiator of early protection from acute lung damage. This is important as it is to an extent a non-canonical role for this cytokine. This is also important as IL-13 can be manipulated therapeutically. To maximise potential application of such drugs requires detailed understanding of the various contextual roles of IL-13. This study provides such evidence.

      The authors identify a range of target mediators.

      This is an important body of work that is useful for understanding how acute lung damage can be regulated.

      This work will be of interest to Type 2 immunologists, any researcher with an interest in pulmonary inflammation as well as mucosal immunity.

      I make these suggestions/comments based on my own background in Type 2 immunity, lung inflammation and parasitic helminth infection and immunity.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)):

      In this manuscript, Chenery et al report that IL-13 plays a critical role in protecting mice from lung damage caused by the infection of a nematode, Nippostrongylus Brasiliensis, in WT or IL-13 knockout mice (IL-13 eGFP knock-in mice, Neill et al., Nature 2010). Phenotypically, they demonstrated that IL-13 genetic deficiency resulted in more severe lung injuries and haemorrhaging following the larvae migratory infections. Through the proteomic and transcriptomic profiling, they identified gene-expression changes involved in the cellular stress responses, e.g. up-regulating the expression of epithelial-derived type 2 molecules, controlled by IL-13. They also found that type 2 effector molecules including RELM-alpha and surfactant protein D were compromised in IL-13 knockout mice. Thus, they proposed that IL-13 has tissue-protective functions during lung injury and regulates epithelial cell responses during type 2 immunity in this acute setting. Overall, the manuscript was clearly written and a number of findings were interesting and expected compared to the published knowledge. However, this work could be improved and more impactful by further performing the following suggested experiments.

      Major points:

      1. It may not be accurate to claim that "IL-13 played a critical role in limiting tissue injury ... in the lung following infection" since IL-13 participates in both repelling worms and activating tissue reparative responses. It is very hard to distinguish these two kinds of responses with the current experimental settings because the much higher worm burden led to more direct lung damage in IL-13-/- mice than WT counterparts.*

      The reviewer raises an important point that we will need to clarify in a revised manuscript. Based on several studies, the role of IL-13 in mediating __Nippostrongylus expulsion occurs in the small intestine, after the parasites have already cleared the lung tissue. The number of worms in the lung do not differ at the time points we are investigating. We have qRT-PCR data measuring Nippostrongylus__-specific actin levels, which we and others have previously shown to accurately reflect worm numbers. We can therefore demonstrate that the differences in lung damage do not reflect a difference in the number of larvae in the lungs of IL-13 KO mice compared to WT mice. These data will be incorporated into the manuscript to better clarify this point.

      1. It would be more informative if the authors could perform the RNA-seq analysis on the IL-13-responsive cell type such as airway epithelial cells (goblet cell) by comparing WT vs IL13-/- in the context of lung damage caused by Nitrostrongylus Brasiliensis infection.*

      RNA-sequencing of specific cells would indeed be an excellent experiment that would reveal more IL-13-depedendent processes in our model. However, this would be a considerable undertaking at this stage (as reviewer 3 has pointed out). Nonetheless, our extended analysis of the Foxa2 pathway as requested below has highlighted a number of genes regulated by IL-13, which are known to be involved in epithelial cell function.

      We agree with the reviewer that showing additional validation data to support the Foxa2 defect in IL-13-deficient mice would strengthen our paper’s overall message. We have additional qRT-PCR data of IL-13-dependent genes regulated by Foxa2 (__Clca1, Muc5ac, Ccl11, and Foxa3__) that clearly support this epithelial cell-specific defect that we can readily incorporate into the revised paper.

      *Reviewer #2 (Significance (Required)):

      Overall, the manuscript was clearly written and a number of findings were interesting and expected compared to the published knowledge.

      **Referees cross-commenting**

      To Reviewer #1's Review: fair and constructive

      To Reviewer #3's Review: agree in general.*

      * Reviewer #3 (Evidence, reproducibility and clarity (Required)):

      In this study, Allen, Sutherland and colleagues utilize IL-13 deficient mice to investigate the function of IL-13 in the early response to lung tissue damage induced by helminth infection. They demonstrate that IL-13 deficiency has significant effects on the acute tissue response to helminth infection (at day 2 and 6 post-infection). Particularly, IL-13 deficiency results in increased lung hemorrhaging, and more pronounced lung tissue damage evidenced by increased gaps in the alveolar architecture. They perform proteomic and transcriptomic profiling of the lungs to determine IL-13-induced pathways and demonstrate many protein and gene expression changes in the absence of IL-13. These include dysregulated collagens, reduced epithelial-derived proteins RELMalpha and surfactant protein D, downregulated pathways related to cellular stress, and increased genes associated with the Foxa2 pathway.

      Overall, the key conclusions are convincing, and the study design, methods and data analysis are clear, rigorous and thorough.

      **Minor Comments:**

      1. The authors concluded that lung epithelial cells are more sensitive to IL-13 than IL-4, but the intranasal injection of both proteins showed a similar induction of RELMα - investigation into this difference would be useful. Alternatively, providing an explanation for these different findings could be helpful.*

      Our suggestion that epithelial cells are likely to be more sensitive to IL-13 was based both on our data and the existing literature. We would agree that we do not have definitive evidence for this. Indeed, because the type 2 receptor can respond to both IL-4 and IL-13 this issue is difficult to easily resolve experimentally. We will expand on this in a revised manuscript, making our explanations clearer whilst acknowledging the alternative explanations.

      This is a good suggestion and we have additional flow cytometry data looking at hematopoietic cell expression of RELM-__a from these experiments that we can incorporate into the revised manuscript. We have found that airway macrophages were another source of RELM-a__ in the lung and mirrored the airway epithelial cell responses to both intraperitoneal and intranasal delivery of IL-4 and IL-13.

      We agree that a comparison of IL-13Ra1 versus IL-13 deficiency should be included in the discussion of our manuscript. These authors found epithelial-specific defects in IL-13Ra1-deficient mice such as Clca1 (aka Clca3), RELM-__a, and chitinase-like proteins even under homeostatic conditions, which is highly consistent with our data. This study also found that IL-13Ra1 deficiency led to increased bleomycin-induced pathology and together with our data, offers further insight into the IL-13/IL-13Ra__1 axis during lung injury. We will add these points to our discussion and will attempt to directly compare their gene expression data set with our data to find more overlapping genes between the two mouse strains and disease models.

      This is indeed a very important point we will address in a revised discussion. IL-4R__a-deficient mice did show increased bleeding in the Chen et al. study that was not seen in the IL-13Ra__1 KO suggesting IL-4 alone is sufficient to limit bleeding. This is in contrast to our study where we found increased bleeding in IL-13 KO mice independent of IL-4. However, a major difference between the studies is the background strain of mice used, which was BALB/c in the Chen et al. study versus C57BL/6 mice we used in our study. In addition to differences in IL-4 and IL-13 levels between the strains, we have unpublished observations of major differences in vascular integrity with BALB/c much more prone to bleeding, which is an active area of investigation in the lab. Although we have yet to unravel these differences mechanistically, they could explain differential requirements for IL-4 versus IL-13 to limit bleeding between the two strains.

      Our apologies, we will fix the reference duplication.

      *Reviewer #3 (Significance (Required)):

      This study addresses the specific function of IL-13 in acute helminth infection of the lung, which has not previously been studied, as most studies investigate the combined function of IL-4 and IL-13 through IL-4 receptor KO or Stat6 KO mice.

      It is a thorough, well-conducted and well-organized study with high quality data using 'omics' strategies to profile IL-13-induced genes and proteins. Their data identifies intriguing pathways that are dependent on IL-13, opening new avenues to explore for IL-13-mediated protective roles in acute lung tissue damage. Therefore this study provides conceptual and technical advances. Additionally, since targeting IL-4 and IL-13 are in clinical trials or employed therapeutically for pulmonary disorders, the findings from these studies are clinically relevant. It would however have been useful to validate some of these pathways and demonstrate epithelial-specific outcomes for IL-13-induced tissue protection.

      Previous studies using IL4RKO have shown that IL-4 and IL-13 are necessary to protect from acute tissue damage in helminth infection (Chen, Nature medicine - referred to by authors). Other studies have investigated IL-13 in fibrosis and granulomatous inflammation (papers referenced by authors, and Ramalingam Nature Immunology 2009). Last, one study shows that IL-13Ra1 signaling is important for protection in bleomycin-induced lung injury, findings using a different transgenic mouse, which are relevant for this study and may be useful to discuss (Karo-Atar, Mucosal Immunology 2016).

      As stated above - the data in this manuscript identify intriguing pathways that are dependent on IL-13, opening new, exciting avenues to explore for IL-13-mediated protective roles in acute lung tissue damage. Their data is also unique as it combines proteomics and transcriptomics, and identities previously unappreciated IL-13 regulated pathways such as cellular stress and Foxa2, which would be interesting to investigate further.

      **Referees cross-commenting**

      To Reviewer 1: The suggested data for Figure 1 (IL-13 concentrations) could be useful, but suggested experiments for Figure 2 could be outside the main focus of the paper.

      For the main suggested experiment: treatment of IL-13-/- with RELMalpha, this could be useful, One caveat is that RELMalpha might not be the only effector molecule downstream of IL-13 so the authors may not get a definitive answer. An alternative (although not as RELMalpha-specific) would be to treat IL13KO mice with FcIL-4 or FcIL-13 - the latter that drives RELMalpha, and look at whether FcIL-13 is more protective than FcIL-4.*

      We agree that rescue experiments could provide insights into the relative protective effects of IL-4 versus IL-13. However, it might be challenging to interpret the results in part because of the difficulty in establishing physiologically relevant doses and timing and the fact that IL-4 will also signal through the type 2 receptor. These difficulties are reflected in the interpretation of our current data as discussed above (pt. 1 reviewer 3). Although we have found IL-4 and IL-13 delivery experiments valuable and have used them in many of our papers, we have always been cautious in our interpretation, as we typically use these at super-physiological doses. However, this is an experiment we would consider if the editors felt it essential to the story.

      To Reviewer 2: I agree with points 1 and 3 - especially with point 3, which would give more in-depth understanding into the functional outcomes of the IL-13 -> FoxA2 pathway identified. For point 2, RNA-seq of epithelial cells would be informative, but may be beyond the scope of the project.

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      In this study, Allen, Sutherland and colleagues utilize IL-13 deficient mice to investigate the function of IL-13 in the early response to lung tissue damage induced by helminth infection. They demonstrate that IL-13 deficiency has significant effects on the acute tissue response to helminth infection (at day 2 and 6 post-infection). Particularly, IL-13 deficiency results in increased lung hemorrhaging, and more pronounced lung tissue damage evidenced by increased gaps in the alveolar architecture. They perform proteomic and transcriptomic profiling of the lungs to determine IL-13-induced pathways and demonstrate many protein and gene expression changes in the absence of IL-13. These include dysregulated collagens, reduced epithelial-derived proteins RELMalpha and surfactant protein D, downregulated pathways related to cellular stress, and increased genes associated with the Foxa2 pathway.

      Overall, the key conclusions are convincing, and the study design, methods and data analysis are clear, rigorous and thorough.

      Minor Comments:

      1. The authors concluded that lung epithelial cells are more sensitive to IL-13 than IL-4, but the intranasal injection of both proteins showed a similar induction of RELMα - investigation into this difference would be useful. Alternatively, providing an explanation for these different findings could be helpful.
      2. Providing data by immunofluorescence or flow cytometry of non-epithelial expression of RELMalpha following intranasal versus intraperitoneal injection of IL-4 versus IL-13 would be useful.
      3. Discussion of IL-13Ra1 deficient mice would be useful, in particular the study by Karo-Atar and Munitz in Mucosal Immunology 2016, showing that IL13Ra1 is protective against bleomycin-induced pulmonary injury (PMID: 26153764). Comparing their data with the gene expression datasets from this study would be useful (acknowledging the caveat that IL-4 effects through the type 2 receptor would also be abrogated in these IL13Ra1 mice).
      4. The authors reference Chen et al. Nature Medicine 2012, but do not discuss the finding in this paper that neither IL-4-/- nor IL13Ra1-/- have increased lung hemorrhage. This might be a mouse strain issue and worthwhile discussing.
      5. Reference 32 and 36 (Sutherland PLoS pathogens) are duplicates

      Significance

      This study addresses the specific function of IL-13 in acute helminth infection of the lung, which has not previously been studied, as most studies investigate the combined function of IL-4 and IL-13 through IL-4 receptor KO or Stat6 KO mice.

      It is a thorough, well-conducted and well-organized study with high quality data using 'omics' strategies to profile IL-13-induced genes and proteins. Their data identifies intriguing pathways that are dependent on IL-13, opening new avenues to explore for IL-13-mediated protective roles in acute lung tissue damage. Therefore this study provides conceptual and technical advances. Additionally, since targeting IL-4 and IL-13 are in clinical trials or employed therapeutically for pulmonary disorders, the findings from these studies are clinically relevant. It would however have been useful to validate some of these pathways and demonstrate epithelial-specific outcomes for IL-13-induced tissue protection.

      Previous studies using IL4RKO have shown that IL-4 and IL-13 are necessary to protect from acute tissue damage in helminth infection (Chen, Nature medicine - referred to by authors). Other studies have investigated IL-13 in fibrosis and granulomatous inflammation (papers referenced by authors, and Ramalingam Nature Immunology 2009). Last, one study shows that IL-13Ra1 signaling is important for protection in bleomycin-induced lung injury, findings using a different transgenic mouse, which are relevant for this study and may be useful to discuss (Karo-Atar, Mucosal Immunology 2016).

      As stated above - the data in this manuscript identify intriguing pathways that are dependent on IL-13, opening new, exciting avenues to explore for IL-13-mediated protective roles in acute lung tissue damage. Their data is also unique as it combines proteomics and transcriptomics, and identities previously unappreciated IL-13 regulated pathways such as cellular stress and Foxa2, which would be interesting to investigate further.

      Referees cross-commenting

      To Reviewer 1: The suggested data for Figure 1 (IL-13 concentrations) could be useful, but suggested experiments for Figure 2 could be outside the main focus of the paper.

      For the main suggested experiment: treatment of IL-13-/- with RELMalpha, this could be useful, One caveat is that RELMalpha might not be the only effector molecule downstream of IL-13 so the authors may not get a definitive answer. An alternative (although not as RELMalpha-specific) would be to treat IL13KO mice with FcIL-4 or FcIL-13 - the latter that drives RELMalpha, and look at whether FcIL-13 is more protective than FcIL-4.

      To Reviewer 2: I agree with points 1 and 3 - especially with point 3, which would give more in-depth understanding into the functional outcomes of the IL-13 -> FoxA2 pathway identified. For point 2, RNA-seq of epithelial cells would be informative, but may be beyond the scope of the project.

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      In this manuscript, Chenery et al report that IL-13 plays a critical role in protecting mice from lung damage caused by the infection of a nematode, Nippostrongylus Brasiliensis, in WT or IL-13 knockout mice (IL-13 eGFP knock-in mice, Neill et al., Nature 2010). Phenotypically, they demonstrated that IL-13 genetic deficiency resulted in more severe lung injuries and haemorrhaging following the larvae migratory infections. Through the proteomic and transcriptomic profiling, they identified gene-expression changes involved in the cellular stress responses, e.g. up-regulating the expression of epithelial-derived type 2 molecules, controlled by IL-13. They also found that type 2 effector molecules including RELM-alpha and surfactant protein D were compromised in IL-13 knockout mice. Thus, they proposed that IL-13 has tissue-protective functions during lung injury and regulates epithelial cell responses during type 2 immunity in this acute setting. Overall, the manuscript was clearly written and a number of findings were interesting and expected compared to the published knowledge. However, this work could be improved and more impactful by further performing the following suggested experiments.

      Major points:

      1. It may not be accurate to claim that "IL-13 played a critical role in limiting tissue injury ... in the lung following infection" since IL-13 participates in both repelling worms and activating tissue reparative responses. It is very hard to distinguish these two kinds of responses with the current experimental settings because the much higher worm burden led to more direct lung damage in IL-13-/- mice than WT counterparts.
      2. It would be more informative if the authors could perform the RNA-seq analysis on the IL-13-responsive cell type such as airway epithelial cells (goblet cell) by comparing WT vs IL13-/- in the context of lung damage caused by Nitrostrongylus Brasiliensis infection.
      3. Figure 6C, the transcriptional profiling of mouse lungs revealed that the Foxa2 pathway was significantly up-regulated in the IL-13-/- infected mice. This is an important finding because this pathway plays a critical role in the process of alveolarization and inhibiting goblet cell hyperplasia. In order to validate this finding, some components in this pathway could be further examined.

      Significance

      Overall, the manuscript was clearly written and a number of findings were interesting and expected compared to the published knowledge.

      Referees cross-commenting

      To Reviewer #1's Review: fair and constructive

      To Reviewer #3's Review: agree in general.

    4. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      This study addresses the role IL-13 in promoting lung damage following migration of the helminth N. brasiliensis larvae from the circulatory system to the lung. The work clearly shows using IL13-/- mice that Nb elicited IL-13 immunity at days 2-6 post-infection reduces pathology. The authors demonstrate an association with reduced eosinophils but no effect on neutrophil numbers.

      Proteomic analysis identifies a number of molecules known to be involved in protecting against type 2 pathologies such as relm-a and SP-D.

      The authors then identify a clear requirement for IL-13 in driving relm-a expression.

      Finally, the authors present a whole lung RNA transcript profile which largely supports their proteomic observations.

      Taken together the work presents a sound case for IL-13 being an important player in protecting against initial lung pathology.

      Major requests:

      The paper is really very interesting and important. To an extent it questions existing dogma of IL-13 being a driver of lung inflammation.

      Addressing the following could hopefully be achieved using archived samples or with an acceptable amount of extra experimental work.

      Figure 1: D2 and D6 Lung IL-13 concentrations (ELISA) in WT mice would set the scene for the papers story

      Figure 2: The authors should add evidence that function/activity of neutrophils/eosinophils is changed/not changed: e.g. granzyme, MBP, EPO release in BAL and/or lung. Additionally, some data showing changes in epithelial stress related cytokines such as IL-23 and IL-33 would be informative (IHC and /or ELISA).

      The following will require a new experiment:

      The authors present a strong case for RELMa being associated with/driven by IL-13 responses. The following I feel would prove that IL-13 driven RELMa is important in reducing lung pathology. Can enhanced lung pathology or cell responses associated with pathology be reduced/altered by dosing Nb infected IL13-/- mice with recombinant relma or by restimulating BAL cells (for example) from IL-13-/- mice. This team is well placed to comment on the potential for such an in vivo experiment to be feasible.

      Or could the authors could also test the ability for other candidate molecules to reduce lung pathology? Would for example i/n dosing of IL-13-/- mice with AMCase, BRP39 or SP-D protect against pathology? It would be expected to be the case for SP-D.

      Significance

      The manuscript places IL-13 as an important initiator of early protection from acute lung damage. This is important as it is to an extent a non-canonical role for this cytokine. This is also important as IL-13 can be manipulated therapeutically. To maximise potential application of such drugs requires detailed understanding of the various contextual roles of IL-13. This study provides such evidence.

      The authors identify a range of target mediators.

      This is an important body of work that is useful for understanding how acute lung damage can be regulated.

      This work will be of interest to Type 2 immunologists, any researcher with an interest in pulmonary inflammation as well as mucosal immunity.

      I make these suggestions/comments based on my own background in Type 2 immunity, lung inflammation and parasitic helminth infection and immunity.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      We thank the reviewers for carefully reading our manuscript. We found their comments to be incredibly thoughtful and constructive and greatly appreciate their feedback. We are confident that addressing the reviewers’ concerns will strengthen our manuscript.

      Reviewer #1 (Evidence, reproducibility and clarity (Required)):

      In this manuscript entitled 'Combinatorial patterns of graded RhoA activation and uniform F-actin depletion promote tissue curvature' by Denk-Lobnig et al. the authors study the organisation of junctional F-actin during the process of mesoderm invagination during gastrulation in the model Drosophila. Following on from previous work by the same lab that identified and analysed a multicellular myosin II gradient across the mesoderm important for apical constriction and tissue bending, the authors now turn their attention to actin. Using imaging of live and fixed samples, they identify a patterning of F-actin intensity/density at apical junctions that they show is dynamically changing going into mesoderm invagination and is set up by the upstream transcription factors driving this process, Twist and Snail. They go on to show, using genetic perturbations, that both actin and the previously described myosin gradient are downstream of regulation and activation by RhoA, that in turn is controlled by a balance of RhoGEF2 activation and RhoGAP C-GAP inactivation. The authors conclude that the intricate expression patterns of all involved players, that all slightly vary from one another, is what drives the wild-type distinctive cell shape changes in particular rows of cells of the presumptive mesoderm and surrounding epidermis.

      This is a very interesting study analysing complex and large-scale cell and tissue shape changes in the early embryo. Much has been learned over the last decade and more about many of the molecular players and their particular behaviours that drive the process, but how all upstream regulators work together to achieve a coordinated tissue-scale behaviours is still not very well understood, and this study add important insights into this.

      The experiments seem well executed and support the conclusion drawn, but I have a few comments and questions that I feel the authors should address to strengthen their argument.

      We thank the reviewer for their interest in the paper and their helpful comments.

      **General points:**

      1. The authors state early on that they chose to focus on junctional rather than apical medial F-actin, but it is unclear to me really what the rationale behind that is. In much of the authors earlier work, they study the very dynamic behaviour of the apical-medial actomyosin that drives the apical cell area reduction in mesodermal cells required for folding. They have previously analysed F-actin in the constricting cells, but have only focused on the most constricting central cell rows (Coravos, J. S., & Martin, A. C. (2016). Developmental Cell, 1-14). The role of junctional F-actin compared to the apical-medial network on which the myosin works to drive constriction is much less clear, it could stabilize overall cell shape or modulate physical malleability or compliance of cells, or it could more actively be involved in implementing the 'ratchet' that needs to engage to stabilise a shrunken apical surface. I would appreciate more explanation or guidance on why the authors chose not to investigate apical-medial F-actin across the whole mesoderm and adjacent ectoderm, but rather focused in junctional F-actin, especially explaining better throughout what they think the role of the junctional F-actin they measure is.

      We focused on the junctional/lateral F-actin pool because this is where tissue-wide patterns in intensity variation are observed, especially when looking across the mesoderm-ectoderm boundary. Indeed, when we compare the apical-medial F-actin of marginal mesoderm cells to ectoderm cells in cross sections, we find no apparent difference, whereas there is a striking difference in junctional/lateral F-actin density (Fig. 1B, C; Supplemental Fig. 1A, D). We provide some preliminary en face views of the medial-apical surface in our response to Point 2, and we will obtain higher resolution images from live and fixed embryos to better show the network organization. We agree with the reviewer that this requires added justification. Therefore, we will: 1) Provide higher resolution images of apical-medial F-actin comparing different regions of mesoderm and ectoderm, and 2) revise the text to better justify why we chose junctional/lateral F-actin to focus our tissue-level analysis and to elaborate more on what we think the role of junctional/lateral F-actin in this process may be.

      Comparing the F-actin labeling in the above previous paper to the stainings/live images shown here, they look quite different. This is most likely due to the authors here not showing the whole apical area but focusing on junctional, i.e. below the most apical region. It is not completely clear to me from the paper at what level along the apical-basal axis the authors are analysing the junctional F-actin. Supplemental Figure 2 seems to suggest about half-way down the cell, which would be below junctional levels. Could the authors indicate this more clearly, please? Overall, I would appreciate if the authors could supply some more high-resolution images of F-actin from fixed samples (which I assume will give the better resolution) of how F-actin actually looks in the different cells with differing levels. Is there for instance a visible change to F-actin organisation? And could this help explain the observed changes in intensity and their function?

      We apologize for the confusion, we were referring to ‘junctions’ as the lateral contacts between cells, as opposed to the adherens junctions at the apical surface. We have modified the text to use the term ‘lateral’ rather than ‘junctional’ F-actin, so as to avoid this confusion. The difference in cortical F-actin staining is not restricted to a particular apical-basal position, but extends along the length of the lateral domain (Fig. 1B, C). As far as we can tell the actin is bundled and underlies the entire cell circumference. We will: 1) better define the apical-basal position within the cell that we are showing, and 2) show high-resolution en face images of F-actin at different apical-basal positions, across different cell positions, in live and fixed embryos to better justify our focus on lateral F-actin (similar orientation, but higher resolution/quality than preliminary live data below).

      Along the same lines of thought as in point 2): Dehapiot et al. (Dehapiot, B., ... & Lecuit, T. (2020). Assembly of a persistent apical actin network by the formin Frl/Fmnl tunes epithelial cell deformability. Nature Cell Biology, 1-21) have recently shown for the process of germband extension and amnioserosa contraction that two pools of F-actin can be observed, a persistent pool not dependent on Rho[GTP] and a Rho-[GTP] dependent one. Could the authors comment on what they think might occur in the mesoderm, are similar pools present here as well?

      1. As the authoirs state themselves, Rho does not only affect actin via diaphanous, but of course also myosin via Rock. So it would be good to refelect this more in the interpretation and discussion of data, as the causal timeline could be complex.

      We thank the reviewer for reminding us to address this point and to discuss this excellent recent paper. We have not observed a persistent medial actin network in mesoderm cells or ectoderm cells at this stage (i.e. prior to germband extension). It was previously shown in mesoderm cells that pulsed myosin contractions condense the medio-apical F-actin network, but that this is often followed by F-actin network remodeling and that total F-actin levels decrease during apical constriction (Mason et al., 2013). Furthermore, Rho-kinase inhibition in mesoderm cells significantly disrupts this network, but does not inhibit the rapid assembly and disassembly of apical F-actin cables, which could reflect elevated actin turnover (Mason et al., 2013; Jodoin et al., 2015). To address the reviewer’s points, we 1) now include a paragraph in the Discussion to discuss the Dehapiot et al. paper (Comment 3) and the possible roles of various pools of F-actin and Rock/myosin shape the tissue (Comment 4) (lines 404-408), and 2) will image the apical surface of mesoderm and ectoderm at this stage and also germband extension (as a positive control) in order to determine whether there is a persistent network.

      **More specific comments to experiments and figures:**

      1. Reduction of junction function by alpha-catenin-RNAi: how strong is the reduction in catenin? Could they label a-catenin in fixed embryos? The authors conclude the original pre-constriction patterning of F-actin intensity is not dependent on intact junctions, but they show that the increase in F-actin in the mesodermal cells concomitant with apical constriction is in fact impaired in the RNAi. Thus, the authors can also not conclude whether the continued accumulation of myosin and its persistence depend on intact junctions. The initial set-up of the myosin gradient in terms of intensity distribution is unaffected, but clearly dynamics, subcellular pattern, interconnectivity etc. of myosin are affected and thus may well depend on some mechanical feed-back. I find this section of the manuscript slightly overstated and feel the conclusion should be more cautious.

      We thank the reviewer for pointing this out; we completely agree that we should have been more precise with our language. Our main conclusion was that myosin accumulation in a gradient does not require ‘sustained mechanical connectivity’. We felt it was important, given our model of transcriptional patterning, to show that some patterns did not result from mechanics or even apical constriction. Alpha-catenin knock-down provides the cleanest and most severe disruption of adhesion that we can accomplish at this developmental stage. We showed that alpha-catenin-RNAi resulted in: a) almost no intercellular connectivity in myosin structures (Yevick et al., 2019), and b) no apical constriction (this study, Fig. 3B).

      We: 1) revised the text in this section, clarifying that we are only referring to the gradient and that other myosin properties clearly do depend on mechanics, 2) will include data better showing the extent of the alpha-catenin knockdown and its effects on junctions and actomyosin.

      Figure 1 versus Figure 2: Why do the Utrophin-ABD virtual cross-sections look so fuzzy and bad in comparison to phalloidin labelled F-actin in the virtual cross-section in Fig. 1B and C? The labelling shown in 2B and D does not even look very junctional...

      We apologize that we did not explain the difference in visualization methods more clearly. For live images (Figure 2), we used a projection of cross-sections, which includes 20 µm length along the anterior-posterior (AP) axis. This projection method is less dependent on the specific AP position of the cross-section and the specific cells being shown. We did this because the projection helps to visualize the tissue pattern in live images where fluorescence images are noisier than fixed images, which exhibit cleaner labeling (Fig. 1). To address this point, we plan to: 1) Edit the text to make the method of visualization clearer, and 2) fix snail and twist mutant embryos and also provide thin cross-sections analogous to Fig. 1.

      Figure 5 C and D: the control gradients for myosin shown in C and D are completely different, for C the half-way height cell row is deduced as 5 whereas the (in theory identical) control measure in D has row 3 at halfway height! Why is this? Putting all curves together in the same panel would suggest that that C control curve is very similar to RhoGEF2-OE! This can't be right.

      The reason for the different width of the gradients in these controls is the Sqh::GFP copy number. All of our experiments perturbing Rho were carefully controlled so as to ensure the same copy number of the fluorescent marker that we were visualizing. For technical reasons, we were only able to get 1 copy of the Sqh::GFP into the RhoGEF2-OE background. Having two copies of the Sqh::GFP appears to have a slightly activating effect; in fact, the reviewer might have noticed that ventral furrows with 2 copies Sqh::GFP (and a wider gradient) have lower curvature, consistent with our main conclusion (Fig. 7 C). The effects of fluorescently tagged markers were a concern for us and so we were careful to show that the effects of changing RhoA activity on tissue curvature occur regardless of the fluorescent marker (i.e., Sqh::GFP or Utr::GFP, Fig. 7 and Sup. Fig. 7).

      Still in Figure 5: Panels C and D again, but for apical area: are the control and C-GAP-RNAi or RhoGEF2-OE curves significantly different? What statistics were used on this?

      We thank the reviewer for this point. We did not include statistical comparisons of the gradient width originally, because we felt that it does not completely capture the difference between the two curves and that presenting the curves instead lets readers examine the intricacies of the data as a whole. However, to address the reviewer’s point, we will add statistical comparisons for apical area as well as myosin and actin patterns.

      Supplemental Figure 1: Panels in D: I appreciate this control, but would really also like to see the same control at a stage when folding has commenced and stretched cells are present at the margin of the mesoderm. How homogenous does the GAP43 label look in those?

      We will add a more apical projection (with quantification) of this embryo, in which folding has already commenced, to the revised manuscript, so its stage is clearer.

      Supplemental Figure 5: Panel 5 B: the authors conclude that the myosin gradient under RhoGEF2 RNAi is not smaller, but looking at the curves it in fact looks wilder. They also mention that the overall level of myosin in this condition is lower than the control...

      We will include quantification of absolute levels in Supplemental Figure 5 to compare overall levels. We will also statistically compare RhoGEF2 RNAi and control gradients and update our conclusions accordingly.

      Following on from the above, a comment of Figure 7: - The authors use RhoGEF2 RNAi stating that it affects the actin pattern, but the myosin pattern also seems affected. In line 318 the authors state that they use this condition to look at how junctional actin density affects curvature. I find this phrase misleading as It might lead the readers to think that RHoGEF2 RNAi only affects junctional F-actin, although it also affects myosin patterning.

      We thank the reviewer for catching this, that’s a good point. We have revised the text in lines 317-326 to more accurately describe the effect of RhoGEF2-RNAi on actin and myosin patterning, and to connect this to the effect on curvature.

      • Line 311: confusingly, the authors state that an increase in the actomyosin gradient affects curvature. But it is only the myosin gradient that is increased, while the junctional actin gradient is flatter than the control in both C-GAP RNAi and RhoGEF2 OE (the distinction is even made by authors line 243). Could this be clarified?

      We thank the reviewer for pointing out this imprecision on our part and have revised Line 311 to more precisely describe the individual effects on myosin and F-actin pattern changes upon RhoA perturbation.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)):

      Mesoderm invagination during Drosophila gastrulation has been a paradigm for how regionally restricted gene expression locally activates Rho signalling and for how subsequently activated acto-myosin drives cell shape changes which in turn lead to a change in tissue morphology. Despite the numerous studies on this subject and a good understanding of the overall process, several important aspects have remained elusive so far. Among these is the dynamics of cortical and junctional F-actin and its contribution to the shape changes of cells and tissue. Previous studies have focused on MyoII, the „active" component of the actin cytoskeleton. The dynamics of the „passive" counterpart, namely actin filaments, has been neglected, although it is clear that Rho signalling controls both branches.

      We thank the reviewer for the tough questions. The reviewer raises important points that, even if not all feasible to address experimentally, can be addressed by being more precise with our language__ and conclusions.__

      1. Although I clearly acknowledge the efforts taken by the authors to define a function of cortical (junctional) F-actin in apical constriction and furrow formation, several central aspects of the study are not sufficiently resolved and conclusive. Rho signalling controls MyoII via Rok and F-actin via forming/dia, among other less defined targets. The role of MyoII and cortical contraction could be conclusively sorted out, since inhibition of Rok affects the MyoII branch but not the other branches. A similar approach, i. e. a specific inhibition/depletion without affecting the other branch, has not been taken yet for the F-actin branch. The authors have not resolved this issue. When analysing the mutants, the authors cannot distinguish the effect of Rho signalling on the MyoII and F-actin branch. For this reason the changes in F-actin distribution in the mutants are linked to changes in Myo activity and thus a function cannot be assigned to F-actin. In order to derive a specific role of F-actin distribution for furrow formation, the authors need to find experimental ways to affect F-actin levels without affecting MyoII, for example by analysing mutants for dia or other formins.

      The reviewer’s assertion that Rok and Diaphanous only affect myosin and actin, respectively, is oversimplified. For example, in mammals, Rok regulates the Lim-Kinase/Cofilin pathway and thus F-actin (Geneste et al., JCB, 2002). The ‘F-actin branch’ of the RhoA pathway has been examined in multiple previous studies of mesoderm invagination (Fox and Peifer, 2007; Homem et al., 2008; Mason et al., 2013). We did not include diaphanous mutants in this tissue-level study because diaphanous mutants and actin drugs: a) affect RhoA signaling (Munjal et al., 2015; Coravos et al., 2016; Michaux et al., 2018), b) disrupt adherens junctions and tissue integrity (Homem et al, 2008; Mason et al., 2013), and c) have a preponderance of cellularization defects (Afshar et al., 2000). However, we agree with the reviewer that this could potentially be interesting, and so we 1) will look at the tissue-level pattern in Diaphanous-depleted embryos, 2) will analyze tissue-level actomyosin patterns in Rok inhibitor-injected embryos, and 3) have added a section to the Discussion (lines 418-432) explaining past work in this area and why we did not provide data on diaphanous mutants. A caveat of the proposed experiments is that actin and myosin ‘branches’ may be too interconnected to be conclusively separated.

      The authors employ a discontinuous spatial axis by the cell number. Although there are good arguments to understand and treat the cells as units, there are also good arguments for using a scale with absolute distance. I have doubts that the graded distributions presented by the authors are a result of this scaling with cell units. When looking at panel B of Fig 1 or Fig. 2A,B, for example, a sharp step like distribution is visible at the boundary between mesoderm and ectoderm anlage. In contrast a F-actin intensity distribution is graded after quantification. The graded distribution appears not to be a consequence of averaging because an even sharper step is very obvious in a projection along the embryonic axis as shown in panel B and D of Fig. 2, for example. The difference of a sharp step in the images and graded distribution after quantification with a spatial axis in cell number, is obvious for a-catenin in Fig. 3D and Rho signalling in Fig. 4 B. As the authors base their central conclusion (see headline) on the graded distribution, resolving the issue of spatial scale is a prerequisite of publication.

      We thank the reviewer for their point. It is an excellent idea and we have included representative plots with a continuous spatial scale in addition to our cell-based analysis (see below, each trace is average line intensity for 1 embryo). The spatially resolved analysis shows similar patterns for F-actin, myosin and RhoA pathway components as the cell-based metric and we plan to include this data as Supplemental Fig. 3 and 4 in a revised version of the manuscript.

      The authors put the spatial distribution of Rho signalling and F-actin into the center of their conclusion. They do so by affecting the pattern with mutants in twist/snail and varying upstream factors of Rho signalling. With respect to myo activation this have been done previously although possibly with less detail and it is no new insight that the width of the mesoderm anlage and corresponding Rho signalling domain has a consequence on the shape of the groove and furrow. To maintain the conclusion of the manuscript that spatially graded Rho signalling is contributes to tissue curvature, more convincing ways to change the pattern of Rho signalling are needed. Changing the balance of GEF and GAP shows the importance of Rho signalling and possibly signalling levels but not the contribution of its spatial distribution.

      A strength of our study was that we were able to stably ‘tune’ Rho signaling pattern and then follow tissue shape at later stages to determine the connection between the two. We respectfully disagree with the statement that, “with respect to myosin activation this has been done previously”. In past work, we expanded myosin activation by modifying embryonic cell fate, including changes in dorsal cell fates (Heer et al. 2017; Chanet et al., 2017). Here, we directly manipulate RhoA signaling, maintaining the width of the mesoderm anlage (see images below).

      A central conclusion of our study is that RhoA activation level determines the width of myosin activation within a normally sized mesoderm anlage, which has not been done before. The genetic approach presented in the paper was the best way we found to manipulate the spatial pattern of myosin/actin in a stable manner that lasts through invagination. It is worth noting that this approach allowed us to carefully ‘tune’ the level of RhoA activation so as to avoid elevating RhoA levels to the point that it disrupts signaling polarity within the cell (Mason et al., 2016). In our hands, optogenetic manipulation of RhoA, which requires continuous optical input, was less robust because: a) 2D tissue flow precludes delivering a consistent level of activation to given cells over the time course of invagination, b) tissue folding (i.e. 3D deformation) dramatically alters how much light is delivered to the mesoderm cells.

      To address the reviewer’s point, we: 1) edited the Discussion to explicitly state that we did not alter the pattern of RhoA activation without altering RhoA signaling levels and (lines 339-343), 2) plan to include Snail or Twist stainings showing that the width of the mesoderm anlage is not altered by changes in RhoA signaling so there is no confusion about this point, and 3) plan to include a mechanical model that compares how altering signaling levels vs. altering the spatial distribution of signaling affect fold curvature, respectively.

      Reviewer #2 (Significance (Required)):

      The question of a contribution of F-actin is addressed in this manuscript. The authors quantify F-actin in fixed and living embryos at two prominent steps in ventral furrow formation, (1) shortly prior to onset of apical constrictions and (2) when the groove has formed. They distinguish junctional and „medial" cortical F-actin. They employ a discontinuous spatial axis, the number of cells away from the ventral midline but not an absolute scale (see my notes below). The measurements are applied to wild type and mutant embryos affecting the transcriptional patterning (twist, snail), adherens junctions, and Rho signalling. The authors claim to reveal by their measurements a graded distribution of F-actin intensities with a peak at the ventral midline and a second peak at the boundary between mesoderm and ectoderm with a low point in the stretching cells of the mesectoderm. The authors further claim to reveal a graded distribution of Rho signalling components within the mesoderm anlage. Based on these data the authors conclude that graded Rho signalling and depletion of F-actin promote tissue curvature.

      Reviewer #3 (Evidence, reproducibility and clarity (Required)):

      Previous work has shown that mesoderm invagination at the ventral midline of the Drosophila embryo requires precise spatial regulation of actomyosin levels in order to fold the tissue. In this work, Denk-Lobnig and colleagues further investigate the spatial distribution of myosin and F-actin in the mesoderm and how these patterns are established. The authors identify an F-actin pattern at the apical cell junctions that emerges upon folding, with elevated levels in the cells around the ventral midline, a decrease in junctional F-actin in the marginal mesoderm, and then an increase at the mesoderm-ectoderm border. They identify Snail and Twist as regulating different aspects of establishing this F-actin pattern. Additionally, by modulating RhoA activity (downstream of Twist) the authors are able to alter the width of the actomyosin pattern without affecting the width of the mesoderm tissue, which in turn affects the curvature of the tissue fold and the post-fold lumen size.

      The authors have conducted an elegant quantitative analysis of the distribution of actin, myosin and several of their regulators across the tissue. The study makes an attempt at integrating a large amount of information into a model of tissue folding, and the concept of mechanical gradients is exciting and still underexplored. I am concerned that the interpretation of some results focuses on specific details but ignores larger scale effects (e.g. potential effects of some of the manipulations on the ectoderm, and the impact that that could have on tissue folding are largely ignored). The statistical analysis of several results should also be improved. I suggest to address the following points.

      We thank the reviewer for their interest in our work and their important suggestions.

      **MAJOR**

      1. Line 127 and Figure 1E: The authors argue that there is an anticorrelation between F-actin distribution and cell areas. However, an R-squared value of 0.1083 rather suggests little-to-no correlation. The authors should evaluate the statistical significance of that correlation.

      To indicate whether the relationship between F-actin distribution and cell areas is significant, we will report the p-value for the F-test for overall significance for our regression analysis, as well as sample size, of this data in the revised manuscript. The F-statistic for this analysis is __F = 89.2, p-value = 4.7e-20.__

      Figure 5: claims that the width of the actomyosin gradient is affected by the various perturbations should be supported with statistical analysis. For example, the half-maximal gradient position for each individual myosin trace could be calculated (instead of using the mean trace), displayed using a box plot, and tested for significance using the Mann-Whitney U test, as in Figure 7. This is slightly complicated by the fact that the control group in Figure 5C is the same as the control group in Figure 3E, which needs to be carefully considered. Also, similar calculations should be made for the F-actin data in Fig 5E-G since throughout the rest of the paper, the authors refer to the width of the "actomyosin gradient" which implicates both myosin and actin.

      We thank the reviewer for this point We will include statistical comparisons for myosin gradients in the revised manuscript. To allow for multiple comparisons using the same control, we plan to use Kruskal-Wallis testing, which is analogous to one-way ANOVA for non-parametric data, and a post-hoc test to determine which pairs have significantly different distributions.

      We will update the language in the manuscript to distinguish between actin and myosin patterns. As our main conclusion is that F-actin depletion levels are changed by RhoA in marginal mesoderm cells, we will statistically compare this between groups.

      Line 142 and Figure 2B-C: I was confused by the description of the snail phenotype: - a. the claim that in snail mutants actin levels are uniform: based on Figure 2C, I'd say that F-actin levels decrease across the mesoderm moving away from the ventral midline, and that the main issue is with the accumulation of actin in the distal end of the mesoderm. The authors should better justify the claim that F-actin levels are uniform in snail mutants (or remove it). Maybe comparing F-actin levels in the first four or five rows of the mesoderm? - b. how about the increase of F-actin in the distal mesoderm, just adjacent to the ectoderm boundary? Why is it gone in snail mutants?

      1. We agree that the intensity in all embryos appears to decrease on the sides of the embryos when imaged in this way, but it is also clear that there is no abrupt increase in F-actin density going into the ectoderm. In our experience, the edge effect is due to the distance of the side of the embryo from the coverslip rather than actual lower F-actin density. This is suggested by: a) the fact that all snail mutant embryos peak at the center of the image even though they are not all oriented with the ventral side perfectly on top, and b) all embryos exhibit an intensity decrease within the ectoderm toward the edges of the image that are further away from the coverslip (Fig. 2 C, E, F). We will: 1) modify the text to include an explanation, and 2) fix and stain snail and twist mutant cross-sections that will not exhibit this effect of imaging depth, for comparison.
      2. We show in Figure S1C that in wild-type, F-actin does not actually increase in cells at the ectoderm boundary, but merely decreases in lateral mesoderm cells. Thus, it is likely that snail mutant embryos are merely lacking patterning in the mesoderm, where snail is active.
      3. With alpha-catenin-RNAi, F-actin depletion across the mesoderm still occurs, but junctional F-actin levels are not increased around the midline. While some explanations are offered in the text, the reason for this phenotype seems important for the story. The text in lines 204-205 suggests that F-actin that would normally be localized to the apical junctions is instead being drawn into medioapical actomyosin foci. Is this idea supported by evidence that medioapical F-actin in control embryos is lower than in alpha-catenin RNAi?

      We appreciate the reviewer’s suggestion to explain this more thoroughly. We find that in alpha-catenin-RNAi and even arm (β-catenin) mutant embryos, junctional complexes (i.e., E-cadherin) are drawn into the myosin spot through continuous contractile flow (see below and Martin et al., 2010 for arm). To make this clear in the manuscript, we plan to: 1) include data showing the effects of alpha-catenin RNAi on F-actin and E-cadherin localization in fixed embryos, which is now included in Supplemental Figure S3, and 2)

      include live imaging of UtrGFP-labeled alpha-catenin RNAi embryos.

      Figure 6A: there is a correlation between cell position and the productivity of myosin pulses, which the authors attribute to the RhoA gradient. This should be more definitively demonstrated by:

      • a. Plot and calculate the correlation between RhoA levels (measured with the RhoA probe) and the change in cell area caused by a contraction pulse. Is this a significant correlation?

      • b. How does myosin persistence change when RhoA is manipulated, e.g. in RhoA overexpressing embryos or in RhoA RNAi?

      It has already been shown that there is a correlation between myosin amplitude and apical constriction amplitude (Xie et al., 2015).__ Apical myosin and Rho-kinase localization depends entirely on RhoA activity (Mason et al., 2016) and Rho-kinase co-localizes precisely with myosin in both space and time (Vasquez et al., 2014). Changing levels of the RhoA regulator C-GAP has been shown to affect myosin persistence and the productivity of apical constriction, with higher C-GAP causing less productive constriction (Mason et al., 2016). We plan to update the text to connect the observation with what has been shown in previous studies and to make statements regarding causality on the tissue-level more cautious. However, our observation further shows how cytoskeletal activity is patterned across the mesoderm, so we think it has value and that it should be included in this paper. An in depth study of the connection between RhoA regulators and myosin persistence/pulsing is beyond the scope of the present study, especially considering possible COVID-19 restrictions. Making these connections will require substantial effort in the future.__

      **MINOR**

      1. The authors should indicate if the myosin shown in Figure 1A is junctional or medioapical. If it is junctional, does medioapical myosin better match junctional F-actin and cell areas? Similarly, if they are showing medioapical myosin, how does junctional myosin compare to junctional actin? It seems to me that consistently comparing the patterns of junctional F-actin and medioapical myosin (and RhoGEF2, RhoA, and ROCK in Figure 4) could be somewhat misleading, as the pools compared localize in different subcellular compartments.

      The myosin images shown throughout the paper are medioapical myosin. Junctional myosin in mesoderm cells is lower in intensity and cannot easily be seen by live imaging. We agree that it is important for the reader to see all pools of these proteins. Therefore, we will include in a supplemental figure high resolution images of actin and myosin at both apical and subapical positions for midline mesoderm, marginal mesoderm, and ectoderm cells at the time of folding. We will also justify why the analyzed pools were chosen, respectively.

      Most of the intensity traces for myosin and F-actin are presented as normalized intensity, relative to the highest intensity in the trace. However, there are claims throughout the text about the relative levels of myosin (ex. Line 241) and F-actin (conclusions based on Fig. 2B-D) that should be supported by quantification. It seems that changes in intensity for both F-actin and myosin, in addition to shape of the gradient, would contribute to the understanding of actomyosin regulation in this tissue. However, if intensities cannot be directly compared between groups due to variation in imaging settings or staining protocols, there should be no claims made about changes in overall F-actin or myosin intensity.

      We appreciate the point made by the reviewer here. To address this point, we will provide data for absolute levels in relevant cases and be more precise in our conclusions.

      The significance of the correlation in Figure 7E should be quantified.

      We will report the p-value for the F-test for overall significance for our regression analysis of this data. The F-statistic for this analysis is F = __15.6, p-value = 0.00103.__

      Supplemental Figure 2: does the segmentation image match the second Z reslice immediately above? It does not appear so, or perhaps they are just not aligned. Having the two match would be more convincing of the segmentation technique.

      We will ensure that matching images are used for this figure.

      Reviewer #3 (Significance (Required)):

      The authors have conducted an elegant quantitative analysis of the distribution of actin, myosin and several of their regulators across the tissue. The study makes an attempt at integrating a large amount of information into a model of tissue folding, and the concept of mechanical gradients is exciting and still underexplored. I am concerned that the interpretation of some results focuses on specific details but ignores larger scale effects (e.g. potential effects of some of the manipulations on the ectoderm, and the impact that that could have on tissue folding are largely ignored). The statistical analysis of several results should also be improved.

      This is a great point. It is important to note that our conclusions required us to ‘tune’ the expression of GEF and the depletion of GAP with GAL4 drivers to get expression levels that do not dramatically affect RhoA polarity within mesoderm cells, but that alter the tissue level pattern within the mesoderm. Furthermore, we were cautious in making sure that our perturbations that elevate RhoA activation level did not lead to elevated myosin in the ectoderm (Fig. 5A and B). It is worth noting that RhoGEF2 is still full-length in all cases and has all of the normal regulatory domains that allow its activity to be restricted to the mesoderm at this stage. To more explicitly show the effect of our perturbations on ectoderm cells, we plan to include higher resolution images comparing myosin and F-actin organization/levels in the ectoderm for our manipulations of RhoA signaling.

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      Previous work has shown that mesoderm invagination at the ventral midline of the Drosophila embryo requires precise spatial regulation of actomyosin levels in order to fold the tissue. In this work, Denk-Lobnig and colleagues further investigate the spatial distribution of myosin and F-actin in the mesoderm and how these patterns are established. The authors identify an F-actin pattern at the apical cell junctions that emerges upon folding, with elevated levels in the cells around the ventral midline, a decrease in junctional F-actin in the marginal mesoderm, and then an increase at the mesoderm-ectoderm border. They identify Snail and Twist as regulating different aspects of establishing this F-actin pattern. Additionally, by modulating RhoA activity (downstream of Twist) the authors are able to alter the width of the actomyosin pattern without affecting the width of the mesoderm tissue, which in turn affects the curvature of the tissue fold and the post-fold lumen size.

      The authors have conducted an elegant quantitative analysis of the distribution of actin, myosin and several of their regulators across the tissue. The study makes an attempt at integrating a large amount of information into a model of tissue folding, and the concept of mechanical gradients is exciting and still underexplored. I am concerned that the interpretation of some results focuses on specific details but ignores larger scale effects (e.g. potential effects of some of the manipulations on the ectoderm, and the impact that that could have on tissue folding are largely ignored). The statistical analysis of several results should also be improved. I suggest to address the following points.

      MAJOR

      1. Line 127 and Figure 1E: The authors argue that there is an anticorrelation between F-actin distribution and cell areas. However, an R-squared value of 0.1083 rather suggests little-to-no correlation. The authors should evaluate the statistical significance of that correlation.
      2. Figure 5: claims that the width of the actomyosin gradient is affected by the various perturbations should be supported with statistical analysis. For example, the half-maximal gradient position for each individual myosin trace could be calculated (instead of using the mean trace), displayed using a box plot, and tested for significance using the Mann-Whitney U test, as in Figure 7. This is slightly complicated by the fact that the control group in Figure 5C is the same as the control group in Figure 3E, which needs to be carefully considered. Also, similar calculations should be made for the F-actin data in Fig 5E-G since throughout the rest of the paper, the authors refer to the width of the "actomyosin gradient" which implicates both myosin and actin.
      3. Line 142 and Figure 2B-C: I was confused by the description of the snail phenotype:
        • a. the claim that in snail mutants actin levels are uniform: based on Figure 2C, I'd say that F-actin levels decrease across the mesoderm moving away from the ventral midline, and that the main issue is with the accumulation of actin in the distal end of the mesoderm. The authors should better justify the claim that F-actin levels are uniform in snail mutants (or remove it). Maybe comparing F-actin levels in the first four or five rows of the mesoderm?
        • b. how about the increase of F-actin in the distal mesoderm, just adjacent to the ectoderm boundary? Why is it gone in snail mutants?
      4. With alpha-catenin-RNAi, F-actin depletion across the mesoderm still occurs, but junctional F-actin levels are not increased around the midline. While some explanations are offered in the text, the reason for this phenotype seems important for the story. The text in lines 204-205 suggests that F-actin that would normally be localized to the apical junctions is instead being drawn into medioapical actomyosin foci. Is this idea supported by evidence that medioapical F-actin in control embryos is lower than in alpha-catenin RNAi?
      5. Figure 6A: there is a correlation between cell position and the productivity of myosin pulses, which the authors attribute to the RhoA gradient. This should be more definitively demonstrated by:
        • a. Plot and calculate the correlation between RhoA levels (measured with the RhoA probe) and the change in cell area caused by a contraction pulse. Is this a significant correlation?
        • b. How does myosin persistence change when RhoA is manipulated, e.g. in RhoA overexpressing embryos or in RhoA RNAi?

      MINOR

      1. The authors should indicate if the myosin shown in Figure 1A is junctional or medioapical. If it is junctional, does medioapical myosin better match junctional F-actin and cell areas? Similarly, if they are showing medioapical myosin, how does junctional myosin compare to junctional actin? It seems to me that consistently comparing the patterns of junctional F-actin and medioapical myosin (and RhoGEF2, RhoA, and ROCK in Figure 4) could be somewhat misleading, as the pools compared localize in different subcellular compartments.
      2. Most of the intensity traces for myosin and F-actin are presented as normalized intensity, relative to the highest intensity in the trace. However, there are claims throughout the text about the relative levels of myosin (ex. Line 241) and F-actin (conclusions based on Fig. 2B-D) that should be supported by quantification. It seems that changes in intensity for both F-actin and myosin, in addition to shape of the gradient, would contribute to the understanding of actomyosin regulation in this tissue. However, if intensities cannot be directly compared between groups due to variation in imaging settings or staining protocols, there should be no claims made about changes in overall F-actin or myosin intensity.
      3. The significance of the correlation in Figure 7E should be quantified.
      4. Supplemental Figure 2: does the segmentation image match the second Z reslice immediately above? It does not appear so, or perhaps they are just not aligned. Having the two match would be more convincing of the segmentation technique.

      Significance

      The authors have conducted an elegant quantitative analysis of the distribution of actin, myosin and several of their regulators across the tissue. The study makes an attempt at integrating a large amount of information into a model of tissue folding, and the concept of mechanical gradients is exciting and still underexplored. I am concerned that the interpretation of some results focuses on specific details but ignores larger scale effects (e.g. potential effects of some of the manipulations on the ectoderm, and the impact that that could have on tissue folding are largely ignored). The statistical analysis of several results should also be improved.

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      Mesoderm invagination during Drosophila gastrulation has been a paradigm for how regionally restricted gene expression locally activates Rho signalling and for how subsequently activated acto-myosin drives cell shape changes which in turn lead to a change in tissue morphology. Despite the numerous studies on this subject and a good understanding of the overall process, several important aspects have remained elusive so far. Among these is the dynamics of cortical and junctional F-actin and its contribution to the shape changes of cells and tissue. Previous studies have focused on MyoII, the „active" component of the actin cytoskeleton. The dynamics of the „passive" counterpart, namely actin filaments, has been neglected, although it is clear that Rho signalling controls both branches.

      1. Although I clearly acknowledge the efforts taken by the authors to define a function of cortical (junctional) F-actin in apical constriction and furrow formation, several central aspects of the study are not sufficiently resolved and conclusive. Rho signalling controls MyoII via Rok and F-actin via forming/dia, among other less defined targets. The role of MyoII and cortical contraction could be conclusively sorted out, since inhibition of Rok affects the MyoII branch but not the other branches. A similar approach, i. e. a specific inhibition/depletion without affecting the other branch, has not been taken yet for the F-actin branch. The authors have not resolved this issue. When analysing the mutants, the authors cannot distinguish the effect of Rho signalling on the MyoII and F-actin branch. For this reason the changes in F-actin distribution in the mutants are linked to changes in Myo activity and thus a function cannot be assigned to F-actin. In order to derive a specific role of F-actin distribution for furrow formation, the authors need to find experimental ways to affect F-actin levels without affecting MyoII, for example by analysing mutants for dia or other formins.
      2. The authors employ a discontinuous spatial axis by the cell number. Although there are good arguments to understand and treat the cells as units, there are also good arguments for using a scale with absolute distance. I have doubts that the graded distributions presented by the authors are a result of this scaling with cell units. When looking at panel B of Fig 1 or Fig. 2A,B, for example, a sharp step like distribution is visible at the boundary between mesoderm and ectoderm anlage. In contrast a F-actin intensity distribution is graded after quantification. The graded distribution appears not to be a consequence of averaging because an even sharper step is very obvious in a projection along the embryonic axis as shown in panel B and D of Fig. 2, for example. The difference of a sharp step in the images and graded distribution after quantification with a spatial axis in cell number, is obvious for a-catenin in Fig. 3D and Rho signalling in Fig. 4 B. As the authors base their central conclusion (see headline) on the graded distribution, resolving the issue of spatial scale is a prerequisite of publication.
      3. The authors put the spatial distribution of Rho signalling and F-actin into the center of their conclusion. They do so by affecting the pattern with mutants in twist/snail and varying upstream factors of Rho signalling. With respect to myo activation this have been done previously although possibly with less detail and it is no new insight that the width of the mesoderm anlage and corresponding Rho signalling domain has a consequence on the shape of the groove and furrow. To maintain the conclusion of the manuscript that spatially graded Rho signalling is contributes to tissue curvature, more convincing ways to change the pattern of Rho signalling are needed. Changing the balance of GEF and GAP shows the importance of Rho signalling and possibly signalling levels but not the contribution of its spatial distribution.

      Significance

      The question of a contribution of F-actin is addressed in this manuscript. The authors quantify F-actin in fixed and living embryos at two prominent steps in ventral furrow formation, (1) shortly prior to onset of apical constrictions and (2) when the groove has formed. They distinguish junctional and „medial" cortical F-actin. They employ a discontinuous spatial axis, the number of cells away from the ventral midline but not an absolute scale (see my notes below). The measurements are applied to wild type and mutant embryos affecting the transcriptional patterning (twist, snail), adherens junctions, and Rho signalling. The authors claim to reveal by their measurements a graded distribution of F-actin intensities with a peak at the ventral midline and a second peak at the boundary between mesoderm and ectoderm with a low point in the stretching cells of the mesectoderm. The authors further claim to reveal a graded distribution of Rho signalling components within the mesoderm anlage. Based on these data the authors conclude that graded Rho signalling and depletion of F-actin promote tissue curvature.

    4. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      In this manuscript entitled 'Combinatorial patterns of graded RhoA activation and uniform F-actin depletion promote tissue curvature' by Denk-Lobnig et al. the authors study the organisation of junctional F-actin during the process of mesoderm invagination during gastrulation in the model Drosophila. Following on from previous work by the same lab that identified and analysed a multicellular myosin II gradient across the mesoderm important for apical constriction and tissue bending, the authors now turn their attention to actin. Using imaging of live and fixed samples, they identify a patterning of F-actin intensity/density at apical junctions that they show is dynamically changing going into mesoderm invagination and is set up by the upstream transcription factors driving this process, Twist and Snail. They go on to show, using genetic perturbations, that both actin and the previously described myosin gradient are downstream of regulation and activation by RhoA, that in turn is controlled by a balance of RhoGEF2 activation and RhoGAP C-GAP inactivation. The authors conclude that the intricate expression patterns of all involved players, that all slightly vary from one another, is what drives the wild-type distinctive cell shape changes in particular rows of cells of the presumptive mesoderm and surrounding epidermis.

      This is a very interesting study analysing complex and large-scale cell and tissue shape changes in the early embryo. Much has been learned over the last decade and more about many of the molecular players and their particular behaviours that drive the process, but how all upstream regulators work together to achieve a coordinated tissue-scale behaviours is still not very well understood, and this study add important insights into this.

      The experiments seem well executed and support the conclusion drawn, but I have a few comments and questions that I feel the authors should address to strengthen their argument.

      General points:

      1. The authors state early on that they chose to focus on junctional rather than apical medial F-actin, but it is unclear to me really what the rationale behind that is. In much of the authors earlier work, they study the very dynamic behaviour of the apical-medial actomyosin that drives the apical cell area reduction in mesodermal cells required for folding. They have previously analysed F-actin in the constricting cells, but have only focused on the most constricting central cell rows (Coravos, J. S., & Martin, A. C. (2016). Developmental Cell, 1-14). The role of junctional F-actin compared to the apical-medial network on which the myosin works to drive constriction is much less clear, it could stabilize overall cell shape or modulate physical malleability or compliance of cells, or it could more actively be involved in implementing the 'ratchet' that needs to engage to stabilise a shrunken apical surface. I would appreciate more explanation or guidance on why the authors chose not to investigate apical-medial F-actin across the whole mesoderm and adjacent ectoderm, but rather focused in junctional F-actin, especially explaining better throughout what they think the role of the junctional F-actin they measure is.
      2. Comparing the F-actin labeling in the above previous paper to the stainings/live images shown here, they look quite different. This is most likely due to the authors here not showing the whole apical area but focusing on junctional, i.e. below the most apical region. It is not completely clear to me from the paper at what level along the apical-basal axis the authors are analysing the junctional F-actin. Supplemental Figure 2 seems to suggest about half-way down the cell, which would be below junctional levels. Could the authors indicate this more clearly, please? Overall, I would appreciate if the authors could supply some more high-resolution images of F-actin from fixed samples (which I assume will give the better resolution) of how F-actin actually looks in the different cells with differing levels. Is there for instance a visible change to F-actin organisation? And could this help explain the observed changes in intensity and their function?
      3. Along the same lines of thought as in point 2): Dehapiot et al. (Dehapiot, B., ... & Lecuit, T. (2020). Assembly of a persistent apical actin network by the formin Frl/Fmnl tunes epithelial cell deformability. Nature Cell Biology, 1-21) have recently shown for the process of germband extension and amnioserosa contraction that two pools of F-actin can be observed, a persistent pool not dependent on Rho[GTP] and a Rho-[GTP] dependent one. Could the authors comment on what they think might occur in the mesoderm, are similar pools present here as well?
      4. As the authoirs state themselves, Rho does not only affect actin via diaphanous, but of course also myosin via Rock. So it would be good to refelect this more in the interpretation and discussion of data, as the causal timeline could be complex.

      More specific comments to experiments and figures:

      1. Reduction of junction function by alpha-catenin-RNAi: how strong is the reduction in catenin? Could they label a-catenin in fixed embryos? The authors conclude the original pre-constriction patterning of F-actin intensity is not dependent on intact junctions, but they show that the increase in F-actin in the mesodermal cells concomitant with apical constriction is in fact impaired in the RNAi. Thus, the authors can also not conclude whether the continued accumulation of myosin and its persistence depend on intact junctions. The initial set-up of the myosin gradient in terms of intensity distribution is unaffected, but clearly dynamics, subcellular pattern, interconnectivity etc. of myosin are affected and thus may well depend on some mechanical feed-back. I find this section of the manuscript slightly overstated and feel the conclusion should be more cautious.
      2. Figure 1 versus Figure 2: Why do the Utrophin-ABD virtual cross-sections look so fuzzy and bad in comparison to phalloidin labelled F-actin in the virtual cross-section in Fig. 1B and C? The labelling shown in 2B and D does not even look very junctional...
      3. Figure 5 C and D: the control gradients for myosin shown in C and D are completely different, for C the half-way height cell row is deduced as 5 whereas the (in theory identical) control measure in D has row 3 at halfway height! Why is this? Putting all curves together in the same panel would suggest that that C control curve is very similar to RhoGEF2-OE! This can't be right.
      4. Still in Figure 5: Panels C and D again, but for apical area: are the control and C-GAP-RNAi or RhoGEF2-OE curves significantly different? What statistics were used on this?
      5. Supplemental Figure 1: Panels in D: I appreciate this control, but would really also like to see the same control at a stage when folding has commenced and stretched cells are present at the margin of the mesoderm. How homogenous does the GAP43 label look in those?
      6. Supplemental Figure 5: Panel 5 B: the authors conclude that the myosin gradient under RhoGEF2 RNAi is not smaller, but looking at the curves it in fact looks wilder. They also mention that the overall level of myosin in this condition is lower than the control...
      7. Following on from the above, a comment of Figure 7:
        • The authors use RhoGEF2 RNAi stating that it affects the actin pattern, but the myosin pattern also seems affected. In line 318 the authors state that they use this condition to look at how junctional actin density affects curvature. I find this phrase misleading as It might lead the readers to think that RHoGEF2 RNAi only affects junctional F-actin, although it also affects myosin patterning.
        • Line 311: confusingly, the authors state that an increase in the actomyosin gradient affects curvature.But it is only the myosin gradient that is increased, while the junctional actin gradient is flatter than the control in both C-GAP RNAi and RhoGEF2 OE (the distinction is even made by authors line 243). Could this be clarified?

      Significance

      Morphogenesis of organs, and how these highly coordinated processes are driven by transcriptional events, local control (of for instance cytoskeletal behaviour), is a major field in developmental and cell biology. Advances over the last decade have led to a much better understanding of the role of myosin (in the form of actomyosin) in defining cell and therefore tissue shape in morphogenesis. The role and control fo actin organisation, that the myosin depends upon for its action, is much less understood. Thus this study will add an important piece of understanding of the basic control of morphogenesis.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      We thank the reviewers for their enthusiastic support for our work and their insightful comments and suggestions which we believe strengthen the manuscript. Below we detail how we propose to respond to each of the specific points raised by each reviewer.

      Reviewer #1__

      1). It is convincingly shown that adding insulator elements (cHS4) reduces crosstalk between the two PAX6 CREs tested (Fig. 3). However, it is unclear if this approach will work for other CREs. This point should be discussed, and perhaps the authors could give some troubleshooting advice (e.g. adding more insulators or trying different insulator elements?).

      We will include these suggestions in the discussion and describe some ongoing efforts to characterise another insulator element in our assay.

      2). All CREs used in proof-of-concept experiments in this work have well known activities in zebrafish embryos. A new/uncharacterized CRE has not been tested yet using this system. It is unclear from the workflow (Fig. 1B) what happens if the CRE does not drive detectable levels of EGFP/mCherry. How does one determine whether lack of reporter expression is due to technical problem (with the transgene or phiC31 integration) or that the CRE is not active in zebrafish? Perhaps adding a PCR-based genotyping step could address this potential problem?

      We will include a PCR-based genotyping assay in the description of the assay pipeline and discuss its utility in assessing successful integration events as suggested by the reviewer.

      3). Other limitations of the system should also be discussed. For example, the system appears to be useful for identifying variant CREs that result in a change (either loss or gain) of temporal or spatial activity, but it is not clear how subtle changes in expression level (either slightly increased or decreased) would be identified or quantified. Perhaps other approaches could be used in combination with this system to fully analyze mutant CRE activity. Another limitation is that this approach is only be applicable to CREs that are active in the first few days of zebrafish embryonic development.

      We will include these suggestions in the discussion and clearly address the limitations of the system

      **Minor points:**

      i) Although it is discussed in the previous work published in PLoS Genetics, it is probably worth mentioning here why the gata2 minimal promoter was chosen for the reporter system.

      The choice of the gata2 promoter in our constructs was based on previously published work from our group. We will re-iterate and reference these studies in the workflow description.

      1. ii) It would be helpful if the cSH4 element is briefly described (e.g. "insulator element") in Fig.1 legend. We will modify the figure legend according to the suggestion.

      3). It is not clear from the manuscript whether the new reagents reported here-including dual reporter vectors and transgenic attB landing site zebrafish strains-will be made available to the scientific community, or how these reagents would be distributed.

      We would include a section describing our plans for distribution of reagents and tools described in the manuscript. All the vectors would be deposited in Addgene for distribution and all the zebrafish lines would be openly shared with the scientific community.

      Reviewer #2:

      1. The dual reporter system uses EGFP and mCherry to report the activities of two different CREs in the same animal. However, EGFP and mCherry have drastically different fluorescence properties which have not been measured particularly well in vivo and especially not in zebrafish. They have different maturation times (mCherry is much quicker). Both are quite stable in vivo, but mCherry is particularly stable in cell culture and in vivo, even resisting lysosomal degradation (EGFP does not - it is acid and protease sensitive) (Katayama et al., 2008; McWilliams et al., 2016). Often, promoter activity assays in zebrafish employ short lived "destabilized" FPs, such as destabilized GFP and destabilized dsRed. With stable FPs, false positives could be reported due to the fluorescent signal remaining for a long period of time after promoter activity has ceased. Replacing the traditional FPs with destabilized versions could be one way to improve the temporal resolution of this assay. This is probably not necessary to do in the present study but might be a worthy future direction.

      We would discuss these points in the possible limitations of our assay and will also endeavour to incorporate these suggestions in future versions of our assays.

      However, no matter which pair of FPs is chosen, there will be differences in signal intensity/brightness and decay rate. Thus, the FP swap experiments should be employed for any experiment claiming a temporal (Fig. 4) or quantitative (Fig. 5) difference between CRE activation or deactivation. If the EGFP/mCherry swap experiments show the same results, the confidence in the assay will be significantly bolstered.

      We estimate the proposed experiments to take about 4 months to allow for molecular cloning of the FP swapped constructs, injection into the "landing" strain, raising to sexual maturity (2.5 mo), screening for founders, and performing the imaging. These are the only two suggested experiments I would need to feel confident in the results and to recommend publication

      We appreciate the reviewer’s suggestion but would point out that we included dye-swaps for the PAX6-CREs described in Figure 3 in this manuscript. The dye-swap experiment for SBE2WT/SBE2Mut were described in our previous work published in Plos Genetics. However, to increase the confidence of the readers in our current system we would include the other suggested dye swaps in the revised version of our manuscript.

      Reviewer #3:

      **Major comments**

      1. First, given the importance of quality landing lines for the methodology, I would like to see more clarity and emphasis on validation of the Shh-SBE2 landing pad in the main text. Based on supplemental tables 1 and 2, this reviewer is somewhat unclear on whether there is one or three lines with Shh-SBE2 based landing pads (one site is mentioned in table 1, but table 3 mentions three F0 lines, and the text is ambiguous). The authors also state that the Shh-SBE2 landing pad is a single copy integration, but the data supporting this conclusion does not appear to be included (linker mediated PCR does not rule out other integrations).

      We will provide a detailed description of the landing lines addressing all the concerns raised by the reviewer.

      It would also be useful to have more clear numbers indicating the reproducibility of the expression pattern in F1 animals. Do 100% of F1 progeny from multiple crosses show the integration show the expression pattern in image 2 A? If there is variability how much, and how many fish were examined? This reviewer also wonders whether appropriate expression of Shh-SBE2 in this landing site is enough to call it neutral. For example, perhaps position effects might be observed with a different weaker CRE in this site? Better documentation will allow for more widespread and appropriate use of the landing pad.

      We will expand the description for the part of the pipeline the reviewer is referring to, providing the details of transgene segregation.

      Similar concerns apply to the integration of test constructs. To evaluate the practicality of the approach, it would be useful to have numbers reporting the frequency of recovering F1 individuals with PhiC mediated integration of the reporter into the desired landing site. It is also important to provide better documentation of the degree of reproducibility in expression patterns between F1 progeny. Numbers of embryos imaged and fraction with the indicated expression pattern are needed for all data in the main text. At minimum, gross expression patterns should be examined in at least 10 F1 larvae. If there is variability between individuals, some image documentation of this in supplementary data would be welcome.

      We will include the suggested information in the results and provide the supplementary data as suggested by the reviewer.

      **Minor comments:**

      i) For figure 1, it may be clearer to present generation of the landing pad lines and screening of CRES using these lines in separated figure panels (B) for generation of landing pads, and (C) for CRE analysis.

      We will modify figure 1 as suggested.

      ii) Landing pads that were less effective might also be moved out of figure 2, to the supplemental material to help improve clarity and to allow for focus on the tools with the most utility

      We will modify figure 2 as suggested.

      iii) Scale bars should be included in all images,

      This will be done for all the images

      iv) In some cases, image labeling somewhat obscures the relevant features

      We will rectify this in the revised version

      v) To help evaluate consistency, in all relevant figures (4, 5, sup fig 3 ect) the number of embryos examined should be included in the legend.

      We will modify the figure legends to include this information

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      Summary:

      The manuscript by Bhatia addresses a longstanding need for rigorous methods to directly compare the effectiveness of cis-regulatory elements (CREs) during vertebrate embryogenesis. The manuscript describes a method for simultaneous quantitative assessment of the spatial and temporal activity of wild-type and mutant CREs using live imaging in zebrafish embryos. The approach takes advantage of a predefined neutral docking site, and dual-CRE reporter cassette that can be integrated into this site using PhiC31. Using this method, the authors demonstrate subtle differences in the spatial and temporal dynamics of two shh CREs that have been previously reported to have similar domains of activity, and they demonstrate changes in CRE activity in embryos harboring a disease specific mutation in the SBE2 CRE.

      Major comments

      Overall this manuscript describes a valuable tool and key conclusions regarding its need and utility convincing. However, some additional documentation of methods and key reagents, and numbers would be of value.

      First, given the importance of quality landing lines for the methodology, I would like to see more clarity and emphasis on validation of the Shh-SBE2 landing pad in the main text. Based on supplemental tables 1 and 2, this reviewer is somewhat unclear on whether there is one or three lines with Shh-SBE2 based landing pads (one site is mentioned in table 1, but table 3 mentions three F0 lines, and the text is ambiguous). The authors also state that the Shh-SBE2 landing pad is a single copy integration, but the data supporting this conclusion does not appear to be included (linker mediated PCR does not rule out other integrations). It would also be useful to have more clear numbers indicating the reproducibility of the expression pattern in F1 animals. Do 100% of F1 progeny from multiple crosses show the integration show the expression pattern in image 2 A? If there is variability how much, and how many fish were examined? This reviewer also wonders whether appropriate expression of Shh-SBE2 in this landing site is enough to call it neutral. For example, perhaps position effects might be observed with a different weaker CRE in this site? Better documentation will allow for more widespread and appropriate use of the landing pad.

      Similar concerns apply to the integration of test constructs. To evaluate the practicality of the approach, it would be useful to have numbers reporting the frequency of recovering F1 individuals with PhiC mediated integration of the reporter into the desired landing site. It is also important to provide better documentation of the degree of reproducibility in expression patterns between F1 progeny. Numbers of embryos imaged and fraction with the indicated expression pattern are needed for all data in the main text. At minimum, gross expression patterns should be examined in at least 10 F1 larvae. If there is variability between individuals, some image documentation of this in supplementary data would be welcome.

      Presumably nearly all of this data has already been collected during validation of the tools and just isn't reported clearly, so these updates would not require significant time or cost.

      Minor comments:

      With respect to clarity, while the authors do an excellent job of explaining the rational for their system, the details of execution in the manuscript can be difficult to follow at times, below are minor suggestions to help the reader follow more easily.

      For figure 1, it may be clearer to present generation of the landing pad lines and screening of CRES using these lines in separated figure panels (B) for generation of landing pads, and (C) for CRE analysis.

      Landing pads that were less effective might also be moved out of figure 2, to the supplemental material to help improve clarity and to allow for focus on the tools with the most utility

      Scale bars should be included in all images,

      In some cases, image labeling somewhat obscures the relevant features

      To help evaluate consistency, in all relevant figures (4, 5, sup fig 3 ect) the number of embryos examined should be included in the legend.

      Significance

      This manuscript is significant as if provides useful tools for direct comparison of CRE activity in stable transgenic embryos, where two CREs are integrated into a single genomic location. The method offers an advance in efficiency and rigor compared to past approaches. As a zebrafish researcher, it is easy to recognize the value of having a transgenic line with a validated neutral landing site for transgene analysis, and having a well-designed construct for detailed in vivo comparison of CRE activity.

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      This study presents a dual fluorescent protein (FP) reporter system to determine differential activities of Cis regulator elements (CREs) on transcription factor behavior in an in vivo setting. The strategy uses the PhiC31 system to ensure single copy insertion into a consistent genomic locus and is an important improvement over the authors' previous work using a similar system with random genomic integration and separated FP constructs. Because different genomic loci are more accessible than others, comparing the activities of randomly inserted CREs cannot be quantitative and requires generation and comparison of multiple lines for each CRE to validate. The bulk of this study is validation of the new specifically inserted, dual FP system including showing that including insulator sequences between the CREs of interest is necessary to prevent crosstalk. The last two figures demonstrate the utility of the system to interrogate spatial and temporal regulation of CRE variants and the quantitative expression levels of a mutant and WT CRE pair. This is an exciting tool with clear potential to uniquely compare CRE activities in vivo, and the results are clearly presented. However, given that the impact of this study is as a technical improvement over previous methods and that it is aimed to demonstrate the robustness and utility of the reporter system, additional controls are necessary to demonstrate that FP choice does not influence the temporal or quantitative readouts.

      The dual reporter system uses EGFP and mCherry to report the activities of two different CREs in the same animal. However, EGFP and mCherry have drastically different fluorescence properties which have not been measured particularly well in vivo and especially not in zebrafish. They have different maturation times (mCherry is much quicker). Both are quite stable in vivo, but mCherry is particularly stable in cell culture and in vivo, even resisting lysosomal degradation (EGFP does not - it is acid and protease sensitive) (Katayama et al., 2008; McWilliams et al., 2016). Often, promoter activity assays in zebrafish employ short lived "destabilized" FPs, such as destabilized GFP and destabilized dsRed. With stable FPs, false positives could be reported due to the fluorescent signal remaining for a long period of time after promoter activity has ceased. Replacing the traditional FPs with destabilized versions could be one way to improve the temporal resolution of this assay. This is probably not necessary to do in the present study but might be a worthy future direction. However, no matter which pair of FPs is chosen, there will be differences in signal intensity/brightness and decay rate. Thus, the FP swap experiments should be employed for any experiment claiming a temporal (Fig. 4) or quantitative (Fig. 5) difference between CRE activation or deactivation. If the EGFP/mCherry swap experiments show the same results, the confidence in the assay will be significantly bolstered.

      We estimate the proposed experiments to take about 4 months to allow for molecular cloning of the FP swapped constructs, injection into the "landing" strain, raising to sexual maturity (2.5 mo), screening for founders, and performing the imaging. These are the only two suggested experiments I would need to feel confident in the results and to recommend publication.

      Significance

      The impact of this study is as a technical improvement over previous methods and is aimed to demonstrate the robustness and utility of the reporter system.

      The manuscript is geared towards zebrafish experts with an interest in the imaging of intracellular and transcriptional processes.

      Our laboratory has expertise in zebrafish developmental genetics and live imaging of reporters.

    4. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      This is a technical manuscript that describes a new transgenic reporter system in zebrafish that is designed to simultaneously test the activity of two cis-regulatory elements (CREs) in the same living embryo. This is an extension of previous work from the authors that established methods to compare two CREs in transgenic zebrafish embryos (published in PLoS Genetics; DOI: 10.1371/journal.pgen.1005193). Here, to address the problem of position effects caused by random transgene integration, the authors have created a dual reporter transgene that can be integrated into a specific neutral site (using phiC31 recombination) in the zebrafish genome. Expression of different fluorescent proteins (EGFP and mCherry) are regulated by two CREs of interest in the zebrafish embryo, which allows visualization of the temporal and spatial activity of the CREs in real time during embryonic development. The authors propose this system could be used to directly compare wild-type and mutant CREs, and then provide several lives of evidence that establish proof-of-concept. Overall, the results are clearly presented, and the conclusions are convincing. The description of methods (including supplemental tables) is extensive, which will facilitate reproducibility. The manuscript is succinct, and describes a useful approach to characterize CREs. However, I have a few points for the authors to consider:

      Major points:

      1)It is convincingly shown that adding insulator elements (cHS4) reduces crosstalk between the two PAX6 CREs tested (Fig. 3). However, it is unclear if this approach will work for other CREs. This point should be discussed, and perhaps the authors could give some troubleshooting advice (e.g. adding more insulators or trying different insulator elements?).

      2)All CREs used in proof-of-concept experiments in this work have well known activities in zebrafish embryos. A new/uncharacterized CRE has not been tested yet using this system. It is unclear from the workflow (Fig. 1B) what happens if the CRE does not drive detectable levels of EGFP/mCherry. How does one determine whether lack of reporter expression is due to technical problem (with the transgene or phiC31 integration) or that the CRE is not active in zebrafish? Perhaps adding a PCR-based genotyping step could address this potential problem?

      3)Other limitations of the system should also be discussed. For example, the system appears to be useful for identifying variant CREs that result in a change (either loss or gain) of temporal or spatial activity, but it is not clear how subtle changes in expression level (either slightly increased or decreased) would be identified or quantified. Perhaps other approaches could be used in combination with this system to fully analyze mutant CRE activity. Another limitation is that this approach is only be applicable to CREs that are active in the first few days of zebrafish embryonic development.

      Minor points:

      1)Although it is discussed in the previous work published in PLoS Genetics, it is probably worth mentioning here why the gata2 minimal promoter was chosen for the reporter system.

      2)It would be helpful if the cSH4 element is briefly described (e.g. "insulator element") in Fig.1 legend.

      3)It is not clear from the manuscript whether the new reagents reported here-including dual reporter vectors and transgenic attB landing site zebrafish strains-will be made available to the scientific community, or how these reagents would be distributed.

      Significance

      This work introduces a new method to analyze cis-regulatory element (CRE) activity in vivo. By generating transgenic zebrafish with a neutral phiC31 landing site for reporter transgene integration, this work improves on previous methods by overcoming the problem of position effects caused by random transgene integration. This will be useful approach to characterize CREs during embryonic development, and variant CREs associated with human disease. This paper will be of interest to developmental biologists, and geneticists trying to understand CRE activity. I have expertise in zebrafish genetics, with extensive experience using Tol2 transgenesis, and some experience using phiC31 recombination. The described experimental approach here is straightforward, and will be easy to apply in labs with experience in zebrafish transgenesis, and imaging fluorescent protein expression in embryos.

  4. Nov 2020
    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reviewer__ #1 (Evidence, reproducibility and clarity (Required)):__ Septins are highly conserved small GTPase cytoskeletal proteins that function as molecular scaffolds for dynamic cell wall and plasma membrane-remodeling, as well as diffusion barriers restricting movement of membrane and cell wall-associated molecules. Recent work has started to unravel the functional connections between the septins, cell wall integrity MAPK pathway signaling, and lipid metabolism, however most studies have focused on a small sub-set of septin monomers and/or were conducted in primarily yeast-type fungi. Here the authors show in the filamentous fungus A. nidulans that the core hexamer septins are required for proper coordination of the cell wall integrity pathway, that all septins are involved in lipid metabolism. Especially sphingolipid, but not sterols and phosphoinositides, contributes to the localization and stability of core septins at the plasma membrane. The experiments are simple and clear, therefore the conclusion is convincing. Fig.8 model, I would like to see the situation of septin mutant.

      We thank the reviewer for the positive comments. In response to the request from this reviewer and a similar one from reviewer 2 for more on the effect of the loss of individual septins, we added text clarifying the roles of core hexamer, core octamer and noncore septins throughout the manuscript including in the legend to Fig 8 (li 439-444) and the discussion (li 388-402). Please see responses to reviewer 2 comments for more detail.

      Reviewer #1 (Significance (Required)):

      Since localization of cell wall synthesis proteins, lipid domains and septins are likely to depend on each other, sometimes difficult to evaluate the effect is direct or indirect. The comprehensive analyses like performed here are helpful to catch the overview in the field.

      Reviewer__ #2 (Evidence, reproducibility and clarity (Required)):__ **Summary** The study by Mela and Momany describes the function of core septins of A. nidulans and links with the requirement of the cell wall integrity pathway and the sphingolipids which, are required for membrane and cell wall stability. The study is of interest for the fungal genetics community, and the authors have conducted a substantial amount of work in a field they have substantial experience. However, one of the main weaknesses of the manuscript is the assumption whether the CWI pathway controls de septin function of if the core septins control it.

      We agree that while our data clearly indicate interactions between the septins and the CWI pathway, which component controls the other is not clear. We have modified the text to address this concern in several places as detailed in responses to the reviewer’s specific comments below.

      **Major comments** In the abstract, the authors claim that double mutant analysis suggested core septins function downstream of the final kinase of the cell wall integrity pathway. However, from the experiments showed, it is difficult to be convinced about that. The authors should make efforts do make it clear in the manuscript and the discussion. For example: -Line 25-26 (abstract): "Double mutant analysis suggested core septins function downstream of the final kinase of the cell wall integrity pathway."

      We agree that while the double mutant analysis shows interaction of septins with the CWI pathway, the evidence for them being downstream is not strong. We have revised the abstract as follows:

      Li29-30: Double mutant analysis with Δ**mpkA suggested core septins interact with the cell wall integrity pathway.”

      -Line 181-182; 219-220 (results) "Double mutant analyses suggest core septins modulate the cell wall integrity pathway downstream of the kinase cascade." This conclusion is one of the most important of the manuscript. However, this reviewer argues that it cannot be convincingly addressed if at least the phosphorylation ok the MAP kinase MpkA in the septins background is not evaluated under conditions of cell stress and sphingolipid biosynthesis inhibition. The genetic analysis alone maybe not enough to infer if septins control the CWI or the other way around. There may have compensatory effects when the CWI pathway is impaired. For example, most of the septins and mpkA double mutants seems to suppress the defect of the delta mpkA under cell wall stress. The authors should consider this idea.

      Although we discuss the epistasis experiments as one possible interpretation, we agree the genetic analysis is not enough to definitively show that the septins are upstream of the CWI pathway or the other way around. The suppression of cell wall defects by deletion of septins in a mpkA null mutant background under cell wall stress suggests a bypass of the CWI pathway for remediation of the cell wall or some other alternate regulatory node. One possible interpretation of these data could be that by inactivation of normal CWI integrity function through deletion of the final kinase, in addition to deletion of septins (possibly acting as negative regulators of CWI components), there may be a parallel node by which cell wall remediation could still occur.

      Wording throughout the abstract, results, and discussion has been modified accordingly.

      Li 29-30: Double mutant analysis with Δ**mpkA suggested core septins interact with the cell wall integrity pathway.

      Li 208-209: Double mutant analyses suggest the core septin aspB cdc3 modulates the cell wall integrity pathway in the ∆mpkA background under cell wall stress.

      Li 221-225: When challenged with low concentrations of CASP and CFW, the ∆aspBcdc3**∆mpkAslt2 and ∆aspE ∆mpkA slt2 mutants were more sensitive than ∆aspBcdc3 and ∆aspE single mutants, but suppressed the colony growth defects of ∆mpkA slt2. The novel phenotype of the double mutants shows that septins are involved in cell wall integrity and raises the possibility that they act in a bypass or parallel node for remediation of cell wall defects (Fig 4).

      Li 227-228: Fig 4. Double mutant analyses suggest core septins modulate the cell wall integrity pathway.

      Li 464-468: Double mutant analyses between septins and CWI pathway kinases also support a role for core septins in maintaining cell wall integrity under stress (Fig 4). Suppression of cell wall defects under cell wall stress by deletion of septins in an ∆mpkA slt2 background suggests a parallel node by which septins negatively regulate cell wall integrity pathway sensors or kinases could exist.

      There is no clear evidences on the manuscript that the core septins AspA, AspB, AspC, and ApsD are epithastic in A. nidulans. Therefore, the authors choice of using different Asp deletion mutants as a proxy for all the septins mutants is questionable. For example, there is no mention of why AspB was chosen for Figure 2 (chitin and β-1,3-glucan deposition), and AspA was chosen for Figure 3 (chitin synthase localization) since these experiments are correlated. The same is true for Figure S1 where AspB and AspE were used. One can wonder if some of the core septins would have a major impact in the chitin content.

      We agree with the reviewer that not all four core septins are equivalent. Previously published work from our lab shows that AspACdc11, AspBCdc3, AspCCdc12, and AspDCdc10 form octamers and that AspACdc11, AspBCdc3, and AspCCdc12 form hexamers, that both of these heteropolymers co-exist, and that the noncore septin AspE is not part of either core heteropolymer, though it appears to influence them possibly through brief interactions (Lindsay et al., 2010; Hernandez-Rodriguez et al., 2012; Hernandez-Rodriguez et al., 2014). This previous work also clearly shows that strains in which the hexameric septins have been deleted (ΔaspA, ΔaspB, and ΔaspC) have very similar phenotypes while strains in which the octamer-exclusive septin has been deleted (ΔaspD) have different phenotypes.

      In our attempt to simplify the current manuscript we discussed the four core septins as a group. In retrospect this caused us to miss important distinctions on the roles of hexamer vs octamer septins and we are grateful to the reviewer for pointing this out. We have modified language throughout the revised manuscript to specify whether results and interpretations apply to core hexamer septins, core octamer septins, the noncore septin, or individual septins. This more detailed analysis has given us several new ideas to test in future work.

      While we cannot exclude the possibility that interesting results might be produced by analyzing null alleles of each individual septin gene for all experiments, we agree with the cross-reference by Reviewer #3 that there is a very low likelihood that we would see different results by analyzing all individual septins within each subgroup (hexamer, octamer or noncore).

      To the reviewer’s questions on choice of septins for Fig 2, Fig 3, and Fig S1:

      ΔaspA, ΔaspB, and ΔaspC showed similar sensitivity to cell wall-disturbing agents in the plate-based assays in Fig 1 and are all part of the core hexamer. We have modified text including the figure legends to make it clear which septins were used in the experiments and which group they belong to.

      In a related comment about Figure 3, the reallocation of chitin synthases in the absence of septins is very interesting, but consider that all the core septin genes should be tested. Without a fully functioning cell wall, the formation of septa will be impaired. It makes their results less surprising.

      In the case of Fig 3, we were unable to recover ChsB-GFP in the ΔaspB or ΔaspC backgrounds but were able to recover it in the ΔaspA background. We have clarified as follows:

      Li184-187: To determine the localization of synthases, a chitin synthase B-GFP (chsB-GFP) strain was crossed with strains in which core hexamer septins were deleted. After repeated attempts, the only successful cross was with core hexamer deletion strain ∆aspA cdc11.

      Figure 3, Panels A and B, chitin was also labeled by Calcofluor White which clearly shows that the formation of septa was not impaired even in the septin null mutant background (this is in agreement with previous work form our lab which shows that septa still forms in individual septin null mutants). The results showed that unlike WT cells, chitin synthase is not only absent in most branch tips in the septin null mutant background, but seems to be limited primarily to longer (presumably actively growing/non-aborted) branches; these findings were surprising to us, considering other major cell wall synthesis events, such as targeting of cell wall synthases to septa during septation appeared to be unimpaired (based on the presence of fully-developed, chitin-labeled septa).

      The labeling of septa by calcofluor is now noted in the legend to Figure 3 as follows:

      Li 201: Calcofluor White labeling shows the presence of the polymer chitin at septa, main hyphal tips, branches, and …

      Why was chitin synthase B chosen to be analyzed in terms of reallocation? How many chitin synthases are in the A. nidulans genome. This rationale should be explained in the manuscript.

      We have added the following:

      Lines 173-182: A. nidulans contains six genes for chitin synthases: chsA, chsB, chsC, chsD, csmA, and csmB. Chitin synthase B localizes to sites of polarized growth in hyphal tips, as well as developing septa in vegetative hyphae and conidiophores, a pattern very similar to septin localization. Deletion of chitin synthase B shows severe defects in most filamentous fungi analyzed thus far, and repression of the chitin synthase b gene expression in chsA, chsC, and chsD double mutants exacerbated growth defects from a number of developmental states observed in each single mutant, suggesting it plays a major role in chitin synthesis at most growth stages (Fukuda et al., 2009). For these reasons, we chose chitin synthase B as a candidate to observe in septin mutant background for possible defects in localization.

      Figure 3 and Figure 4. The authors should make efforts to quantify the phonotypes they claim. They are overall very subtle, especially for Figure 3. Also, a decrease of fluorescence is a tricky observation that should be better reported by quantification.

      Line scans of aniline blue and CFW label were conducted and added as Fig S1. Quantitation was performed and added as Fig S3. See author’s response to Reviewer #3 below for details.

      Again, in Figures 5, 6, and 7, it is clear that the different septins respond differently when ergosterol or sphingolipids synthesis is impaired. It also raises the question again if there are differences in the role of septin genes. Can the authors use previous information about differences in septin function to improve the model (Figure 8)

      As described above, we have modified the manuscript throughout to clarify which phenotypes are seen for core hexamer, core octamer, and noncore septin deletions. As the reviewer notes, these are especially relevant for the sphingolipid-disrupting agents. Our model includes interaction of septins with sterol rich domains that contain both sphingolipids and ergosterol. Because it is not yet clear how subgroups of septins interact with each other and are organized at SRDs, we show all core septins in our model without distinguishing hexamers and octamers in the drawing, but we have now added text to clarify roles and outstanding questions.

      The changes are summarized in the abstract as follows:

      Li 37-40: Our data suggest that the core hexamer and octamer septins are involved in cell wall integrity signaling with the noncore septin playing a minor role; that all five septins are involved in monitoring ergosterol metabolism; that the hexamer septins are required for sphingolipid metabolism; and that septins require sphingolipids to coordinate the cell wall integrity response.

      The clarifications are reflected in the Figure 8 legend (and associated sections of the discussion) as follows:

      Li 436-441: As described in the text, our data suggest that all five septins are involved in cell wall and membrane integrity coordination. The core septins that participate in hexamers appear to be most important for sphingolipid metabolism while all septins appear to be involved in ergosterol metabolism and cell wall integrity. Because SRDs contain both sphingolipids and ergosterol and because it is not yet clear how subgroups of septins interact with each other at SRDs, we show all core septins in our model without distinguishing hexamers and octamers.

      For the above-discussed reasons, the conclusion on lines 384-388 (discussion) is not completely supported by the experiments shown in the manuscript. The authors need to make a better structured and more straightforward story emphasizing the stronger points and reducing descriptions of more speculative points.

      As discussed above, we have made changes throughout the manuscript to clarify which subgroups of septins are involved in which process and to refine our conclusions accordingly. The beginning of the discussion section has been changed as follows:

      Li 384-399: Our data show that A. nidulans septins play roles in both plasma membrane and cell wall integrity and that distinct subgroups of septins carry out these roles. Previous work has shown that the five septins of A. nidulans septins form hexamers (AspACdc11, AspBCdc3, and AspCCdc12) and octamers (AspACdc11, AspBCdc3, AspCCdc12, and AspDCdc10) and that the noncore septin AspE does not appear to be a stable member of a heteropolymer (20). The current work suggests that though all septins are involved in coordinating cell wall and membrane integrity, the roles of hexamers, octamers, and the noncore septin are somewhat different. Core hexamer septins appear to be most important for sphingolipid metabolism, all five septins appear to be involved in ergosterol metabolism, and core septins are most important for cell wall integrity pathway with the noncore septin possibly playing a minor role. As summarized in Figure 8 and discussed in more detail below, our previous and current data are consistent with a model in which: (A) All five septins assemble at sites of membrane and cell wall remodeling in a sphingolipid-dependent process; (B) All five septins recruit and/or scaffold ergosterol and the core hexamer septins recruit and/or scaffold sphingolipids and associated sensors at these sites, triggering changes in lipid metabolism; and (C) The core septins recruit and/or scaffold cell wall integrity machinery to the proper locations and trigger changes in cell wall synthesis. The noncore septin might play a minor role in this process.

      Minor comments Overall the figure caption could be shortened. They are too descriptive and contain details that are easily inferred for the images and from the materials and methods.

      Legends to the following figures have been streamlined by removing portions that belong in the methods: Figure 2, Fig 3, and Fig 6

      The authors made every effort to cove the precedent literature, but the manuscript has 115 references. The authors should evaluate if all the cited literature is extremely relevant. The manuscript would benefit for that conciseness.

      Because this manuscript addresses septins, ergosterol, sphingolipids, cell wall integrity, and multiple different pathways, there is a lot of literature underlying our approaches. Our strong preference is to cite primary literature, however we can shorten our reference list by relying on reviews if requested by the journal.

      Line 124, 493: Replace 10ˆ7, 10ˆ4 to 107, 104, etc

      “10^7” and all other scientific notation was altered to replace carrots “^7” with superscripts “7” throughout.

      The use of fludioxonil as a probe to detect cell wall impairment is perhaps out of context. This drug responds primarily to the HOG pathway and also respond to oxidative damage. So, these results could be suppressed.

      Previous work by Kojima et al., 2006 showed that in addition to the HOG pathway, cell wall integrity is required for resistance to fludioxonil treatment. C. neoformans cell wall integrity mutants bck1, mkk1, and mpk1 (Aspergillus nidulans bckA, mkkA, and mpkA homologues) all exhibit hypersensitivity to fludioxonil, and this was shown to be remediated by the addition of osmotic stabilizers, suggesting cell wall impairment was involved in the growth defect produced by this treatment. Although this drug seems to act primarily through the HOG pathway, the CWI and HOG pathways have been shown to antagonize/negatively regulate one another through a parallel pathway (SVG pathway in yeast) (Lee and Elion, 1999). It has been hypothesized that internal accumulation of glycerol by constitutive activation of the HOG pathway causes decreased cell wall integrity. Due to the apparent cross-pathway control between the HOG and CWI pathways, as well as the high level of conservation of these pathway components in filamentous fungi, we thought this treatment was rightfully dual-purposed to investigate both cell wall impairment in the septin mutants and any possible involvement of the HOG pathway. This seems to be would a reasonable drug treatment to look at cell wall impairment that is not likely to be redundant with the modes of action observed in the other Figure 1 treatments (e.g. CFW, Congo Red, and Caspofungin).

      The text clarifies this point as follows: li 110-112: Fludioxonil (FLU), a phenylpyrrol fungicide that antagonizes the group III histidine kinase in the osmosensing pathway and consequently affects cell wall integrity pathway signaling (Fig 1)(58-67).

      Line 140: "exposure" would be more appropriate than architecture. Please also consider that the difference in the cell wall reported in Figure S1 are very subtle. Are they relevant?

      The differences in the cell wall content reported in Figure S1 (Figure S2 in the revised manuscript) showed that the peak for 4-Glc was almost identical in WT and aspB null mutant, however the overall ratio of peaks switched, where 4-GlcNac content exceeded the 4-Glc content in the mutant compared to WT. By comparison, this was not the case with the septin aspE null mutant. Although this could be considered a ‘subtle’ change in chitin content, we believe this was an important unbiased analysis of the cell wall polysaccharide content and addressed some of the cell wall sensitivity phenotypes we observed, not only between WT and the septin mutants, but also between the septin null mutants which showed sensitivity to cell wall disturbing agents (i.e. aspA, aspB, and aspC) vs. those that did not show significant sensitivity (e.g. aspE). For these reasons we believe this warranted at the very least a supplemental figure for these data.

      Though our idea of cell wall architecture includes changes in polymer exposure, as pointed out by the reviewer, others might use the phrase to mean only content changes. To avoid this misunderstanding, we have replaced the word “architecture” with “organization” in Li 147-148: These data show that cell wall organization is altered in ∆aspB cdc3 and raise the possibility that it might be altered in other core hexamer septin null mutants as well.

      Line 144: explain briefly what it is about and why it was chosen instead of the total detection of chitin sugar monomers. Line 538: Cell wall extraction section. Is this a new method? There is no supporting literature.

      We chose this method because it provides an analysis of all cell wall polysaccharide components and associated linkages. Detection of chitin sugar monomers would have also been a reasonable analysis if this were the only component of the cell wall we were investigating initially. The results showed differences in cell wall chitin content, so these were the data we presented.

      This was addressed on lines 574-576: “Cell walls were isolated from a protocol based on (Bull, 1970); cell wall extraction and lyophilization were conducted as previously described in (Guest and Momany, 2000) with slight modifications listed in full procedure below.”

      The results described on lines 232-257 are marginal to the study and are not exploited by the authors to address the central question of the manuscript, which is the role of the CWI pathway, septins, and sphingolipids. This section could be suppressed or very briefly mentioned in the preceding section.

      We agree that these data did not show any additional involvement of septins in the Calcineurin and cAMP-PKA pathways, and the relevance of the TOR signaling pathway connection is still quite unclear. For this reason, these data were added as a supplemental figure. On the other hand, there are a number of important signaling pathways which have been shown to affect the Cell Wall Integrity pathway directly and indirectly (these three pathways in particular), which is part of the central question of the manuscript. Considering such extensive ‘cross-talk’ between pathways (references produced on Line 65) in filamentous fungi, we felt it necessary to inspect possible involvement of these pathways in septin function via plate-based assays and feel that this s most clearly communicated as its own brief section in the text.

      Reviewer #2 (Significance (Required)): The topic of the manuscript is highly relevant to the fungal biology field and employs a very important genetic model. The cooperation of signaling pathways in mains aspects of fungal physiology is the main significant contribution of this manuscript. Reviewer__ #3 (Evidence, reproducibility and clarity (Required)):__ **Summary:** In this work the authors use genetic analysis in Aspergillus nidulans to identify phenotypes of septin mutants that point to roles for septins in coordinating the cell wall integrity pathway with lipid metabolism in a manner involving sphingolipids. Most of the major conclusions derive from monitoring the effects of combined genetic or chemical manipulations that target specific components of the pathways of interest. Additionally, the authors monitor the subcellular localization of septins, cell-wall modifying enzymes, and components of the cell wall itself. **Major comments:** The key conclusions are convincing, with the unavoidable caveat that null mutations of this sort and chemical inhibitors of these kinds could have unanticipated effects, such as upregulation of unexpected pathways or other compensatory alterations. The authors qualify their conclusions appropriately in this regard. The methods are explained very clearly and the data are presented appropriately. In some cases results are shown as representative images illustrating altered localization of a protein or a cell wall component. The changes observed in the experimental conditions are fairly obvious, but some quantification would not be difficult and would likely make the results even more obvious. For example, the Calcofluor White staining patterns might be nicely quantified by linescans along the hyphal length, and the same is true for AspB-GFP localization upon addition of drugs.

      We thank the reviewer for the positive comments and have made the suggested changes as follows:

      Line scans of aniline blue and CFW label were conducted and added as Fig S1. Text has been modified accordingly (Li 140-147).

      Quantification of Chitin synthase-GFP localization and CFW staining and statistical analysis have now been added as Figure S3 and main text (Li 187-191) has been modified accordingly.

      I could imagine one simple experiment that might generate interesting and relevant results, but by no means would this be a critical experiment for this study. In yeast, exposure to Calcofluor triggers increased chitin deposition in the wall. It would be interesting to know how Calcofluor staining looks in WT or septin-mutant cells that have been growing the presence of Calcofluor for some time, particularly with regard to the localization of chitin deposition in these cells. Such experiments could help connect the idea of septins as sensors of membrane lipid status and also effectors of CWI signaling.

      This is a cool idea that we will pursue in future work. Thanks!

      **Minor comments:** • Body text refers to Figure 1A and 1B but the figure itself does not have panels labeled A or B.

      Figure 1 was revised to show panels A and B labeled clearly.

      • Line 885: "S3" is missing from the beginning of the title of the figure.

      “S” was added to the figure title.

      Reviewer Identity: This is Michael McMurray, PhD, Associate Professor of Cell and Developmental Biology, University of Colorado Anschutz Medical Campus

      Reviewer #3 (Significance (Required)): This is an important conceptual advance in our understanding of septin function because previous work in fungal septins mostly points toward them being important in directing or restricting the localization of other proteins that modify the cell wall or plasma membrane. This new work suggests that septins can play a sensing role, as well. As a fungal (budding yeast) septin researcher myself, I think that other fungal septin researchers would be very interested in these results, and I also think the broader septin community would appreciate it. Additionally, those studying fungal cell wall and plasma membrane biogenesis and coordination, including the Cell Wall Integrity Pathway, will be interested. REFEREES CROSS COMMENTING After reading Reviewer #1's comments, I agree that it would be appropriate to modify the wording of the authors' conclusions about where the septins lie in the CWI pathway (upstream or downstream). While they do mention that there may be other ways to interpret their results, a reader would have to search for the mention of these caveats and if the reader did not, then the strong conclusion statements might be taken as fact.

      The abstract, main text, and discussion have been modified to show that while there is evidence that the septins interact with the CWI pathway, it is not clear which component is upstream vs downstream. See response to reviewer 2 above for details.

      On the other hand, I don't think additional experiments looking at deletions of the other core septins will be worthwhile. I think that there is sufficient evidence to suspect that any single core septin deletion mutant will behave similar to another, and therefore that any one can be taken as representative. While it's possible that the authors might find something informative by looking at other mutants, I personally find the likelihood too low to justify additional experimentation along those lines.

      Based on results from previous work from our lab, there are two subgroups of core septins in A. nidulans (hexamer and octamer) and septins within subgroups appear to behave similarly. The results from the current work support this idea with the same groups of mutants behaving in very similar ways. So, the core hexamer septins, AspACdc11, AspBCdc3, and AspCCdc12 can be used to make predictions about each other, but not about the octamer-exclusive septin AspDCdc10 or the noncore septin AspE. We agree with reviewer 3 that repeating analysis on multiple septins within a subgroup is not likely to give new insight. However, we were not careful in the original version of the manuscript to distinguish between core hexamer and octamer septins. As detailed in the response to reviewer 2 above, we have modified the manuscript throughout to make clear which subgroup of septins were being examined and to put conclusions into this context.

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      Summary:

      In this work the authors use genetic analysis in Aspergillus nidulans to identify phenotypes of septin mutants that point to roles for septins in coordinating the cell wall integrity pathway with lipid metabolism in a manner involving sphingolipids. Most of the major conclusions derive from monitoring the effects of combined genetic or chemical manipulations that target specific components of the pathways of interest. Additionally, the authors monitor the subcellular localization of septins, cell-wall modifying enzymes, and components of the cell wall itself.

      Major comments:

      The key conclusions are convincing, with the unavoidable caveat that null mutations of this sort and chemical inhibitors of these kinds could have unanticipated effects, such as upregulation of unexpected pathways or other compensatory alterations. The authors qualify their conclusions appropriately in this regard.

      The methods are explained very clearly and the data are presented appropriately. In some cases results are shown as representative images illustrating altered localization of a protein or a cell wall component. The changes observed in the experimental conditions are fairly obvious, but some quantification would not be difficult and would likely make the results even more obvious. For example, the Calcofluor White staining patterns might be nicely quantified by linescans along the hyphal length, and the same is true for AspB-GFP localization upon addition of drugs.

      I could imagine one simple experiment that might generate interesting and relevant results, but by no means would this be a critical experiment for this study. In yeast, exposure to Calcofluor triggers increased chitin deposition in the wall. It would be interesting to know how Calcofluor staining looks in WT or septin-mutant cells that have been growing the presence of Calcofluor for some time, particularly with regard to the localization of chitin deposition in these cells. Such experiments could help connect the idea of septins as sensors of membrane lipid status and also effectors of CWI signaling.

      Minor comments:

      • Body text refers to Figure 1A and 1B but the figure itself does not have panels labeled A or B. • Line 885: "S3" is missing from the beginning of the title of the figure.

      Reviewer Identity: This is Michael McMurray, PhD, Associate Professor of Cell and Developmental Biology, University of Colorado Anschutz Medical Campus

      Significance

      This is an important conceptual advance in our understanding of septin function because previous work in fungal septins mostly points toward them being important in directing or restricting the localization of other proteins that modify the cell wall or plasma membrane. This new work suggests that septins can play a sensing role, as well. As a fungal (budding yeast) septin researcher myself, I think that other fungal septin researchers would be very interested in these results, and I also think the broader septin community would appreciate it. Additionally, those studying fungal cell wall and plasma membrane biogenesis and coordination, including the Cell Wall Integrity Pathway, will be interested.

      REFEREES CROSS COMMENTING

      After reading Reviewer #1's comments, I agree that it would be appropriate to modify the wording of the authors' conclusions about where the septins lie in the CWI pathway (upstream or downstream). While they do mention that there may be other ways to interpret their results, a reader would have to search for the mention of these caveats and if the reader did not, then the strong conclusion statements might be taken as fact. On the other hand, I don't think additional experiments looking at deletions of the other core septins will be worthwhile. I think that there is sufficient evidence to suspect that any single core septin deletion mutant will behave similar to another, and therefore that any one can be taken as representative. While it's possible that the authors might find something informative by looking at other mutants, I personally find the likelihood too low to justify additional experimentation along those lines.

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      Summary

      The study by Mela and Momany describes the function of core septins of A. nidulans and links with the requirement of the cell wall integrity pathway and the sphingolipids which, are required for membrane and cell wall stability. The study is of interest for the fungal genetics community, and the authors have conducted a substantial amount of work in a field they have substantial experience. However, one of the main weaknesses of the manuscript is the assumption whether the CWI pathway controls de septin function of if the core septins control it.

      Major comments

      In the abstract, the authors claim that double mutant analysis suggested core septins function downstream of the final kinase of the cell wall integrity pathway. However, from the experiments showed, it is difficult to be convinced about that. The authors should make efforts do make it clear in the manuscript and the discussion.

      For example:

      -Line 25-26 (abstract): "Double mutant analysis suggested core septins function downstream of the final kinase of the cell wall integrity pathway."

      -Line 181-182; 219-220 (results) "Double mutant analyses suggest core septins modulate the cell wall integrity pathway downstream of the kinase cascade."

      This conclusion is one of the most important of the manuscript. However, this reviewer argues that it cannot be convincingly addressed if at least the phosphorylation ok the MAP kinase MpkA in the septins background is not evaluated under conditions of cell stress and sphingolipid biosynthesis inhibition. The genetic analysis alone maybe not enough to infer if septins control the CWI or the other way around. There may have compensatory effects when the CWI pathway is impaired. For example, most of the septins and mpkA double mutants seems to suppress the defect of the delta mpkA under cell wall stress. The authors should consider this idea.

      There is no clear evidences on the manuscript that the core septins AspA, AspB, AspC , and ApsD are epithastic in A. nidulans. Therefore, the authors choice of using different Asp deletion mutants as a proxy for all the septins mutants is questionable. For example, there is no mention of why AspB was chosen for Figure 2 (chitin and β-1,3-glucan deposition), and AspA was chosen for Figure 3 (chitin synthase localization) since these experiments are correlated. The same is true for Figure S1 where AspB and AspE were used. One can wonder if some of the core septins would have a major impact in the chitin content.

      In a related comment about Figure 3, the reallocation of chitin synthases in the absence of septins is very interesting, but consider that all the core septin genes should be tested. Without a fully functioning cell wall, the formation of septa will be impaired. It makes their results less surprising.

      Why was chitin synthase B chosen to be analyzed in terms of reallocation? How many chitin synthases are in the A. nidulans genome. This rationale should be explained in the manuscript.

      Figure 3 and Figure 4. The authors should make efforts to quantify the phonotypes they claim. They are overall very subtle, especially for Figure 3. Also, a decrease of fluorescence is a tricky observation that should be better reported by quantification.

      Again, in Figures 5, 6, and 7, it is clear that the different septins respond differently when ergosterol or sphingolipids synthesis is impaired. It also raises the question again if there are differences in the role of septin genes. Can the authors use previous information about differences in septin function to improve the model (Figure 8)

      For the above-discussed reasons, the conclusion on lines 384-388 (discussion) is not completely supported by the experiments shown in the manuscript. The authors need to make a better structured and more straightforward story emphasizing the stronger points and reducing descriptions of more speculative points. Minor comments Overall the figure caption could be shortened. They are too descriptive and contain details that are easily inferred for the images and from the materials and methods.

      The authors made every effort to cove the precedent literature, but the manuscript has 115 references. The authors should evaluate if all the cited literature is extremely relevant. The manuscript would benefit for that conciseness.

      Line 124, 493: Replace 10ˆ7, 10ˆ4 to 107, 104, etc

      The use of fludioxonil as a probe to detect cell wall impairment is perhaps out of context. This drug responds primarily to the HOG pathway and also respond to oxidative damage. So, these results could be suppressed.

      Line 140: "exposure" would be more appropriate than architecture. Please also consider that the difference in the cell wall reported in Figure S1 are very subtle. Are they relevant?

      Line 144: explain briefly what it is about and why it was chosen instead of the total detection of chitin sugar monomers. Line 538: Cell wall extraction section. Is this a new method? There is no supporting literature.

      The results described on lines 232-257 are marginal to the study and are not exploited by the authors to address the central question of the manuscript, which is the role of the CWI pathway, septins, and sphingolipids. This section could be suppressed or very briefly mentioned in the preceding section.

      Significance

      The topic of the manuscript is highly relevant to the fungal biology field and employs a very important genetic model. The cooperation of signaling pathways in mains aspects of fungal physiology is the main significant contribution of this manuscript.

    4. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      Septins are highly conserved small GTPase cytoskeletal proteins that function as molecular scaffolds for dynamic cell wall and plasma membrane-remodeling, as well as diffusion barriers restricting movement of membrane and cell wall-associated molecules. Recent work has started to unravel the functional connections between the septins, cell wall integrity MAPK pathway signaling, and lipid metabolism, however most studies have focused on a small sub-set of septin monomers and/or were conducted in primarily yeast-type fungi.

      Here the authors show in the filamentous fungus A. nidulans that the core hexamer septins are required for proper coordination of the cell wall integrity pathway, that all septins are involved in lipid metabolism. Especially sphingolipid, but not sterols and phosphoinositides, contributes to the localization and stability of core septins at the plasma membrane.

      The experiments are simple and clear, therefore the conclusion is convincing. Fig.8 model, I would like to see the situation of septin mutant.

      Significance

      Since localization of cell wall synthesis proteins, lipid domains and septins are likely to depend on each other, sometimes difficult to evaluate the effect is direct or indirect. The comprehensive analyses like performed here are helpful to catch the overview in the field.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reviewer #1 (Evidence, reproducibility and clarity (Required)):

      In this study, the authors use focused-ion beam (FIB) milling coupled with cryo-electron tomography and subtomogram averaging to uncover the structure of the elusive proximal and distal centrioles, as well as different regions of the axoneme in the sperm of 3 mammalian species: pig, horse, and mouse. The in-situ tomograms of the sperm neck region beautifully illustrate the morphology of both the proximal centriole, confirming the partial degeneration of mouse sperm, and intriguingly, asymmetry in the microtubule wall of pig sperm. In distal centrioles, the authors show that in all mammalian species, microtubule doublets of the centriole wall are organized around a pair of singlet microtubules. The presented segmentation of the connecting piece is beautiful and nicely shows the connecting piece forming a nine-fold, asymmetric, chamber the centrioles. The authors further use subtomogram averaging to provide the first maps of the mammalian central pair and identify sperm-specific radial spoke-bridging barrel structures. Lastly, the authors perform further subtomogram averaging to show to the connecting site of the outer dense fibers to the microtubule doublet of the proximal principal piece and confirm the presence of the TAILS microtubule inner protein complex (Zabeo et al, 2018) in the singlet microtubules occupying the tip of sperm tails.

      The manuscript provides the clearest insight into flagellar base morphology to date, giving insight into the morphological difference between different mammalian cilia and centriole types. The manuscript is suitable for publication, once the following questions are addressed.

      We are ecstatic that the reviewer shares our enthusiasm for this work. We are particularly grateful that the reviewer appreciates the significance of the unique, and hitherto under-explored biology of the sperm centrioles and the flagellar base.

      **Major Points:**

      How many centrioles and axonemes were used in generating the averages presented in the paper? If too few samples were used, especially in centrioles undergoing dramatic remodeling or degeneration, the reality of MIPs and MAPs being present might be completely affected. For instance, In figure 1d, the authors present a cryoET map of the centriole microtubule triplet. However, centrioles are divided into several regions with different accessory elements. Here, the authors could show the presence of only part of the A-C linker. The A-C linker covers only 40% of the centriole, so does it mean that this centriole is made only of the accessories that characterize the proximal side of the centriole? In the same line, what were the boundaries governing subtomogram extraction? For example, in the distal centriole, were microtubules extracted from just before the start of the transition zone, to the end of the microtubule vaulting, more pronounced at the end of the proximal region? There are known heterogeneities in centriole, as well as flagella, ultrastructure along the proximal distal axis. If no pre-classification was performed for subtomogram longitudinal position along with the centriole and axoneme, structural features may be averaged out, and or present and not reflecting their real longitudinal localization. The classification should be applied here if it was not the case.

      These are all valid points. Because there is no easy way to target the PC/DC when cryo-FIB milling, and because there is only one of each structure in every cell, the chances of catching them in ~150-nm-thin lamellae are slim (not to mention the number of things that can and do go wrong when doing cryo-ET on lamellae). As such, the averages of the PC were generated from 3 tomograms (3 cells) and those of the DC from 2 tomograms (2 cells). We do have more tomograms with the PC/DC, but these were used for segmentation/visual inspection since we only used the best tomograms for averaging. These numbers are not entirely atypical for cryo-FIB datasets; the only other in situ centriole structures are from 5-6 centrioles (from Chlamydomonas, from Le Guennec et al 2020 doi: 10.1126/sciadv.aaz4137 and Klena et al 2020 doi: 10.15252/embj.2020106246).

      To allow readers to adjust their interpretations according to the small number of cells analysed, we explicitly stated the number of animals/cells/tomograms used to generate averages in Table S1. Furthermore, we amended the text to clarify which regions of the centrioles our averages represent. These changes are detailed below:

      (1) proximal centriole

      The lamellae used for averaging PC triplets caught mostly the proximal end of the centriole, and essentially all of the particles come from the most proximal ~ 400 nm. In a sense, this was a form of pre-classification. We now state explicitly that our structure represents only the proximal region and that proximal/distal differences may be identified in the future (see section on distal centriole below). Despite the limited particle number, we are confident in the presence of the MIPs as these are also visible in the raw data (the striations in Fig. 1a, now Fig. 1d, for instance). Page 7, Line 165 was edited accordingly as well as the legend to Fig. 1.

      (2) distal centriole

      The subtomograms used for the DC average were extracted from the region of the distal centriole closest to the base of the axoneme (i.e; the region marked “distal centriole” in Fig. 2h-i). Because the DC doublet average in Fig. 2j was generated from very few particles, we tried to be very conservative when interpreting it. Page 9, Line 216 was edited accordingly likewise the legend to Fig. 2.

      (3) axoneme

      We did attempt to average the axoneme from different regions of flagella (midpiece, proximal principal piece, distal principal piece). This is shown in Fig. 6d-l. The major difference we found was at the doublet-ODF connection. We did not find any striking differences in MIP densities, or in radial spoke densities along the proximodistal axis. As such, the averages in Fig. 5 are from the entire principal piece (but not the midpiece), which we state in the figure legend.

      Because mammalian sperm flagella are very long, it is possible that we missed more subtle differences. We now state this in the Discussion (page 20, line 491):

      **Minor Points:**

      • In line 3, motile cilia are not only used to swim, they can move liquid or mucus for instance.

      Done. Page 3, line 64

      • In line 175, the authors stated " a prominent MIP associated with protofilament A9, was also reported in centrioles isolated from CHO cells (Greenan et al. 2018) and in basal bodies from bovine respiratory epithelia (Greenan et al 2020). Actually, this MIP has been seen in many other centrioles from other species, such as Trichonympha (https://doi.org/10.1016/j.cub.2013.06.061 ), Chlamydomonas, and Paramecium ( DOI: 10.1126/sciadv.aaz4137 ). Citing these studies will reinforce the evolutionary conservation of this MIP and therefore its potential crucial role in the A microtubule.

      We thank the reviewer for pointing out these very important papers, we added them to the manuscript (page 7, lines 175-176).

      • In Line178, the authors stated: "Protofilaments A9 and A10 are proposed to be the location of the seam (Ichikawa et 2017)". High-resolution cryoEM maps confirmed it: https://doi.org/10.1016/j.cell.2019.09.030 . This publication should be cited. Moreover, authors should also refer to this paper when discussing MIPs in the microtubule doublet.

      Done (page 7, lines 178-179 and page 13, line 329).

      We also now cite Ma et al (along with Ichikawa et al 2019 doi: 10.1073/pnas.1911119116 and Khalifa et al 2020 doi: 10.7554/eLife.52760) in the Discussion when alluding to high-resolution structures as a possible means of identifying MIPs (page 19, lines 479).

      • In Line 187-189 the authors stated, "We resolved density of the A-C linker (gold) which is associated with protofilaments C9 and C10." The A-C linker interconnects the triplets of the proximal centriole (Guichard et. al. 2013, Li et. al. 2019, Klena et. al. 2020) with distinct regions binding the C-tubule, as shown by the authors in gold, as well as an A-link, making contact with the A-tubule through various protofilaments in a species-specific manner, but always on protofilament A9. The authors may have identified the A-link, labeled in green, on the outside of protofilament A8/A9 in Figure 1d.

      We thank the reviewer for pointing this out. The position of the olive green density associated with A8/A9 is indeed consistent with the A-link, and this is also now illustrated more clearly in the new version of Fig. 1e (now Fig. 1h, see below). We accordingly edited page 8, lines 187-188.

      • In figure 1e, the authors provide a 9-fold representation of the centriole based on their map. How relevant is this model ? the distance between triplet is inconsistent here, which has not been observed before. Do they use true 3D coordinates to generate this model? The A-C linker, which is only partially reconstructed, does not contact the A microtubule. Is it really the case? did the authors see that the A-link density of the A-C linker has disappeared? If these points are not clearly specified, this representation might be misleading.

      In order to avoid misleading readers, we replaced this panel with a model generated directly by plotting back the averages into their original positions and orientations in the tomogram (new Fig. 1h). This model now shows that the olive green density on A8/A9 is in the right position to form part of the A-C linker (as Reviewer 1 correctly pointed out in their previous point). We have amended the figure legend accordingly. We also described how the plotback was generated in the Materials and Methods section (page 26, line 648).

      As the reviewer points out, the distance between triplets does indeed seem inconsistent in the plotback. This is an interesting observation, but we feel it is a bit too preliminary to discuss in detail here. This can be explored in a follow-up study more focused on sperm centriole geometry.

      • The nomenclature regarding MIPs is sometimes confusing in this manuscript. For example, in lines 228-229 "We then determined the structure of DC doublets, revealing the presence of MIPs distinct from those in the PC." Does this include the gold and turquoise labeled structures in Figure 2j? These densities appear to correspond to the inner scaffold stem in the gold density presented in Figure 2j, and armA, presented in the turquoise density (Li et. al. 2011, Le Guennec et. al. 2020). The presence of this Stem here is important as it correlates with the presence of the molecular player making the inner scaffold (POC5, POC1B, CENTRIN): https://doi.org/10.1038/s41467-018-04678-8

      While we were initially very conservative with interpreting the DC doublet average (as stated above it comes from very few particles), we agree with the reviewer’s assessment that the gold and turquoise densities in Fig. 2j are consistent with the Stem and armA respectively of the inner scaffold. Because the inner scaffold contributes to centriole rigidity, it will be interesting to determine if and how it changes during remodelling of the atypical DC in mammalian sperm. Intriguingly, at least some inner scaffold components (including POC5, POC1B) reorganise into two rods in the mammalian sperm DC (Fishman et al 2018 doi: 10.1038/s41467-018-04678-8). We expanded the section on the DC average (page 9, lines 218-220):

      • The connecting piece is composed of column vaults emanating from the striated columns is compelling and beautiful segmentation data. However, it is important to note how many pig sperm proximal centrioles had immediate-short triplet side contact with the Y-shaped segmented column 9, as well as in how many mouse centrioles have the two electron-dense structures flanking the striated columns.

      Done. Material and Methods Page 25, lines 615-619.

      The resolution of the mammalian central pair is an important development brought by this work. The structural similarity between the central pair of pig and horse is convincing. However, with only 281 subtomograms being averaged for the murine central pair, corresponding to an estimated resolution of 49Å, the absence of the helical MIP of C1 with 8 nm periodicity suggests that there is simply not enough signal to capture it in the average. The same could be said for the smaller MIP displayed in Figure 4 c, panel ii. This point should be clearly stated.

      We agree with the reviewer that the quality of the mouse CPA structure is not on par with the pig and horse CPA structures. We now explicitly state this caveat in the text (pages 11, lines 276-277):

      Another piece of compelling data presented in this study is the attachment of the outer dense fibers to the axoneme of the midpiece and proximal and distal principal pieces. From the classification data presented along the flagellar length, it is clear that the only ODF contact made with the axoneme is at the proximal principle plate. However, this is far from obvious in the native top view images presented. Is it possible to include a zoomed inset of the connection between the A-tubule and ODF connection?

      We are very happy that the reviewer finds this data exciting. As Fig. 6 is quite cluttered as is, we instead tried to better annotate the cross-section views of the axoneme by tracing one doublet-ODF pair in each image (or only a doublet in the case of the distal principal piece). This shows that there is a gap between the doublet and the ODF in the midpiece, and that there is no such gap in the principal piece. We also hope that annotating one doublet-ODF pair helps the reader see that the same pattern holds true for the other doublets/ODFs. The legend to Fig. 6 was changed accordingly.

      Reviewer #1 (Significance (Required)):

      This work is of good quality and provides crucial information on the structure of centriole and axoneme in 3 different species. This work complements well the previous works.

      The audience for this type of study is large as it is of interest to researchers working on centrioles, cilium, and sperm cell architecture.

      We are pleased the reviewer appreciate the quality of our work and see the interest for broad audience.

      My expertise is cryo-tomography and centriole biology

      Reviewer #2 (Evidence, reproducibility and clarity (Required)):

      In this study, Leung et al. used state-of-the-art EM imaging techniques, including FIB cryo-milling, Volta Phase plate, cryo-electron tomography and subtomogram averaging, to study the structure of sperm flagella from three mammalian species, pig, horse and mouse. First, they described two unique centrioles in the sperm, the PC and the DC. They found the PCs are composed of a mixture of triplet and doublet MTs. In contrast, the DCs are composed mainly of doublet and singlet MTs. By using subtomogram averaging, they identified a number of accessory proteins, including many MIPs bound to the MT wall. Many are unique to the mammalian sperm. They further described the connecting piece region of the sperm enclosing the centrioles and found an asymmetric arrangement. Furthermore, the authors presented the structure of sperm axonemes from all three species. These include the DMT and the CPA. Finally, they described the tail region of the sperm and described how the DMTs transitioned to the singlet MTs.

      This is a beautiful piece of work! It is by far the most comprehensive structural study of mammalian sperm cells. These findings will serve as a valuable resource for structure and function analysis of the mammalian flagella in the future. Now the stage is set for identifying the molecular nature of the structures and densities described in this study.

      We thank the reviewer for their positive evaluation! We are very happy that they share our excitement for the work, and that they also see it as “setting the stage” for future studies at the molecular level.

      The manuscript is clearly written. The data analysis is thorough. The conclusions are solid and not overstated. I don't have any major issues for its publication. A number of minor suggestions are listed below. Most are related to the figures and figure legends.

      Figure 1d, the figure legend should mention this is the subtomogram average of PC triplet MTs from pig sperm, though this is mentioned in the text. Also, for convenience, the color codes for the MIPs should be mentioned in the figure legend.

      Done.

      Figure 2J, similarly, the figure legend should mention this is the subtomogram average of DC doublets. It also needs a description of the color codes of the identified MIPs. For the DMT, please indicate the A- and B-tubule, which are colored in light or dark blue.

      Done, except we would prefer not to enumerate the MIPs as we did not name them nor discuss them extensively in the main text as we do not want to over-interpret the MIPs at this point as the average is from relatively small number of particles. However, we did specify that the gold and turquoise densities on the luminal surface are consistent with the inner scaffold. The figure legend was edited accordingly.

      Line 228, "We then determined the structure of DC doublet by subtomogram averaging"

      Done.

      For both Fig 2 and Fig 3. the DC doublets are colored in dark and light blue, please specify which is the A- or B-tubule in the figure legends.

      Done.

      Line 273, need space between "goldenrod"

      We would prefer to keep “goldenrod” spelled as is since this is how the color is referred to in Chimera and ChimeraX.

      Figure 4. need to expand the figure legend. Panels I, ii, iii, iv, are cut-through view of the lumen of CPA microtubules C1 and C2.

      Done.

      Line 338, Interestingly, the RS1 barrel is radially distributed asymmetrically around the axoneme

      Done.

      Figure 5, need color codes for the arrowheads (light pink, pink, magenta) in panels i~n,

      Done.

      Figure 7, (a-c) please use arrowheads to indicate the location of caps in the singlet MT.

      Done.

      Reviewer #2 (Significance (Required)):

      This is a beautiful and significant work - by far the most comprehensive analysis of mammalian sperm structure

      We are thrilled the reviewer appreciate the novelty of our work.

      Reviewer #3 (Evidence, reproducibility and clarity (Required)):

      This is a very interesting study that explores the structural diversity of mammalian sperm flagella, in pig, mouse and horse, at high resolution using cryo-FIB milling and cryo-tomography. The study provides the first in situ cryo-EM structure of a mammalian centriole and describes a number of microtubule associated structures, such as MIPs and plugs at the plus-end of microtubules, that were not been reported so far. Additionally, the authors identify several asymmetries in the overall structure of the flagellum in the three species, which have implications for the understanding of the flagellar beat and waveform geometry in sperm, which are discussed by the authors. Although this study does not provide mechanistic novel information on the function of the described structures, it will undoubtedly serve as a reference for future theoretical and empirical work on the role of these structures in shaping the flagellar beat.

      With the exception of a couple of "eclectic word choices" in the Introduction (see detailed feedback in Minor Comments), the manuscript is also well written. Image acquisition and analysis are sound.

      We thank the reviewer for positively evaluating our work. We are glad that they feel our study will “serve as a reference” to inform future studies.

      However, I have some suggestions that should help the authors to strengthen their claims and present their results. The study is in principle suitable to be published, after the following points will be addressed:

      **Major comments:**

      • A major concern is that it is not clear how many animals, sperms and lamellae the authors used to acquire the data presented in the manuscript. This information needs to be provided, because it not uncommon to encounter aberrant flagella, even in a wildtype animal. The authors should state how many animals, and how many flagella per each animal were analyzed, in order to allow the reader to have an opinion on the reliability of their observations.

      • The figures are esthetically pleasing; however, the figures legends should be carefully revised to include necessary information about color codes, image annotations.

      We thank the reviewer for raising these points. We completely agree that the numbers of animals and cells are important pieces of information. As such, we now explicitly state the number of animals/cells/tomograms used for each average in Table S1. For more qualitative observations (such as the relationship between the asymmetry of the pig sperm PC and the Y-shaped segmented columns), we now state in the number of cells and animals in which we see each feature (see detailed response to Reviewer 1).

      **Minor comments:**

      • Line 26. I do not think that the word "menagerie" is properly used in this context.

      • Line 29. The same is true for the word "Bewildering" in this sentence.

      We apologise for our somewhat eclectic word choice. We see the reviewer’s point that unconventional word choice may distract readers, so we replaced these two words with ‘diverse’ and ‘an extensive’, respectively.

      • Line 286 "Our structures of the CPA are the first from any mammalian system, and our structures of the doublets are the first from any mammalian sperm, thus filling crucial gaps in the gallery of axoneme structures." Sentences like this one would fit much better in the Conclusions or at least in the Discussion.

      We thank the reviewer for this suggestion, but we would prefer to keep this sentence where it is, if possible. We think it is useful to tell the audience upfront why these structures are significant, especially since readers who aren’t deep in the field may be bogged down by all the details.

      • Line 377 "Large B-tubule MIPs have so far only been seen in human respiratory cilia (Fig. 5j) and in Trypanosoma (the ponticulus, Fig. 5n), but the morphometry of these MIPs differs from the helical MIPs in mammalian sperm." Please insert the citations for the studies about respiratory cilia and Trypanosoma flagella.

      Done.

      • In Figure 1. What do the stars shown in panel a and a' indicate?

      We indeed failed to specify what the asterisks/stars indicate. They are meant to emphasise that the electron-dense material in the lumen of the PC is continuous with the CP. We have now specified this in the text (page 10, lines 245).

      Given the complexity of the structures that compose the flagellar system of sperms, it would be helpful to add an illustration of the sperm with careful annotation of the centriole structures and the various segments of the flagellum.

      This is an excellent suggestion. To help orient readers, we added three panels to Fig. 1 (Fig. 1a-c) showing low-magnification images of whole sperm cells. We annotated different parts of the flagellum (neck, midpiece, principal piece, endpiece) so that readers can refer back to these panels in case they want to know which part of the cell the averages are from.

      • Figure 2. Explanation of the used color codes is missing. Additionally, the authors should include an explanation for the black and white arrows and for the 2 insets in i.

      Done. For the color code, please see response to Reviewer 2. For the black and white arrows, we edited the figure legend.

      • In "(j) In situ structure of the pig sperm DC with the tubulin backbone in grey and microtubule inner protein densities colored individually" ...it should be written "...sperm DC microtubule doublet..."

      Done.

      • In this figure, but also in every other figure that shows centriole, axoneme, or even microtubule averages it is important to indicate the microtubule polarity. Please add the symbol + and - to indicate microtubule polarity in the figures.

      Done. In order to avoid overcrowding, we only labelled the pig structures as the horse and the mouse structures are always shown in the same orientations as the pig.

      • Figure 3. Additional to the images in a,b, and c, the original tomographic slices (without segmentation) should be shown here, to allow the reader to visualize the structure.

      We now include three additional supplementary movies slicing through the respective tomograms.

      • Figure 7. Scale bars are missing in d-f.

      Done.

      • Scale bars are missing in most Supplementary figures.

      Done.

      • Table S1. The Information about horse and mouse centriole data is missing.

      The reviewer is correct, but this information is missing because we did not average from the horse and the mouse. For the mouse, the triplets were in various stages of degeneration, resulting in heterogeneity that precluded us from averaging. For the horse, we simply did not catch enough centrioles to generate a meaningful structure.

      Reviewer #3 (Significance (Required)):

      This study provides several novel structural insights in to the sperm flagellum structure that have implications for the understanding of the flagellar beat and waveform geometry in sperm. Although this study does not provide mechanistic novel information on the function of the described structures, it will undoubtedly serve as a reference for future theoretical and empirical work on the role of these structures in shaping the flagellar beat.

      Great to see the reviewer appreciate the novelty of our work.

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      This is a very interesting study that explores the structural diversity of mammalian sperm flagella, in pig, mouse and horse, at high resolution using cryo-FIB milling and cryo-tomography. The study provides the first in situ cryo-EM structure of a mammalian centriole and describes a number of microtubule associated structures, such as MIPs and plugs at the plus-end of microtubules, that were not been reported so far. Additionally, the authors identify several asymmetries in the overall structure of the flagellum in the three species, which have implications for the understanding of the flagellar beat and waveform geometry in sperm, which are discussed by the authors. Although this study does not provide mechanistic novel information on the function of the described structures, it will undoubtedly serve as a reference for future theoretical and empirical work on the role of these structures in shaping the flagellar beat. With the exception of a couple of "eclectic word choices" in the Introduction (see detailed feedback in Minor Comments), the manuscript is also well written. Image acquisition and analysis are sound.

      However, I have some suggestions that should help the authors to strengthen their claims and present their results. The study is in principle suitable to be published, after the following points will be addressed:

      Major comments:

      • A major concern is that it is not clear how many animals, sperms and lamellae the authors used to acquire the data presented in the manuscript. This information needs to be provided, because it not uncommon to encounter aberrant flagella, even in a wildtype animal. The authors should state how many animals, and how many flagella per each animal were analyzed, in order to allow the reader to have an opinion on the reliability of their observations.
      • The figures are esthetically pleasing; however, the figures legends should be carefully revised to include necessary information about color codes, image annotations.

      Minor comments:

      • Line 26. I do not think that the word "menagerie" is properly used in this context.
      • Line 29. The same is true for the word "Bewildering" in this sentence.
      • Line 286 "Our structures of the CPA are the first from any mammalian system, and our structures of the doublets are the first from any mammalian sperm, thus filling crucial gaps in the gallery of axoneme structures." Sentences like this one would fit much better in the Conclusions or at least in the Discussion.
      • Line 377 "Large B-tubule MIPs have so far only been seen in human respiratory cilia (Fig. 5j) and in Trypanosoma (the ponticulus, Fig. 5n), but the morphometry of these MIPs differs from the helical MIPs in mammalian sperm." Please insert the citations for the studies about respiratory cilia and Trypanosoma flagella.
      • In Figure 1. What do the stars shown in panel a and a' indicate? Given the complexity of the structures that compose the flagellar system of sperms, it would be helpful to add an illustration of the sperm with careful annotation of the centriole structures and the various segments of the flagellum.
      • Figure 2. Explanation of the used color codes is missing. Additionally, the authors should include an explanation for the black and white arrows and for the 2 insets in i.
      • In "(j) In situ structure of the pig sperm DC with the tubulin backbone in grey and microtubule inner protein densities colored individually" ...it should be written "...sperm DC microtubule doublet..."
      • In this figure, but also in every other figure that shows centriole, axoneme, or even microtubule averages it is important to indicate the microtubule polarity. Please add the symbol + and - to indicate microtubule polarity in the figures.
      • Figure 3. Additional to the images in a,b, and c, the original tomographic slices (without segmentation) should be shown here, to allow the reader to visualize the structure.
      • Figure 7. Scale bars are missing in d-f.
      • Scale bars are missing in most Supplementary figures.
      • Table S1. The Information about horse and mouse centriole data is missing.

      Significance

      This study provides several novel structural insights in to the sperm flagellum structure that have implications for the understanding of the flagellar beat and waveform geometry in sperm. Although this study does not provide mechanistic novel information on the function of the described structures, it will undoubtedly serve as a reference for future theoretical and empirical work on the role of these structures in shaping the flagellar beat.

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      In this study, Leung et al. used state-of-the-art EM imaging techniques, including FIB cryo-milling, Volta Phase plate, cryo-electron tomography and subtomogram averaging, to study the structure of sperm flagella from three mammalian species, pig, horse and mouse. First, they described two unique centrioles in the sperm, the PC and the DC. They found the PCs are composed of a mixture of triplet and doublet MTs. In contrast, the DCs are composed mainly of doublet and singlet MTs. By using subtomogram averaging, they identified a number of accessory proteins, including many MIPs bound to the MT wall. Many are unique to the mammalian sperm. They further described the connecting piece region of the sperm enclosing the centrioles and found an asymmetric arrangement. Furthermore, the authors presented the structure of sperm axonemes from all three species. These include the DMT and the CPA. Finally, they described the tail region of the sperm and described how the DMTs transitioned to the singlet MTs.

      This is a beautiful piece of work! It is by far the most comprehensive structural study of mammalian sperm cells. These findings will serve as a valuable resource for structure and function analysis of the mammalian flagella in the future. Now the stage is set for identifying the molecular nature of the structures and densities described in this study.

      The manuscript is clearly written. The data analysis is thorough. The conclusions are solid and not overstated. I don't have any major issues for its publication. A number of minor suggestions are listed below. Most are related to the figures and figure legends.

      Figure 1d, the figure legend should mention this is the subtomogram average of PC triplet MTs from pig sperm, though this is mentioned in the text. Also, for convenience, the color codes for the MIPs should be mentioned in the figure legend.

      Figure 2J, similarly, the figure legend should mention this is the subtomogram average of DC doublets. It also needs a description of the color codes of the identified MIPs. For the DMT, please indicate the A- and B-tubule, which are colored in light or dark blue.

      Line 228, "We then determined the structure of DC doublet by subtomogram averaging"

      For both Fig 2 and Fig 3. the DC doublets are colored in dark and light blue, please specify which is the A- or B-tubule in the figure legends.

      Line 273, need space between "goldenrod"

      Figure 4. need to expand the figure legend. Panels I, ii, iii, iv, are cut-through view of the lumen of CPA microtubules C1 and C2.

      Line 338, Interestingly, the RS1 barrel is radially distributed asymmetrically around the axoneme

      Figure 5, need color codes for the arrowheads (light pink, pink, magenta) in panels i~n,

      Figure 7, (a-c) please use arrowheads to indicate the location of caps in the singlet MT.

      Significance

      This is a beautiful and significant work - by far the most comprehensive analysis of mammalian sperm structure

    4. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      In this study, the authors use focused-ion beam (FIB) milling coupled with cryo-electron tomography and subtomogram averaging to uncover the structure of the elusive proximal and distal centrioles, as well as different regions of the axoneme in the sperm of 3 mammalian species: pig, horse, and mouse. The in-situ tomograms of the sperm neck region beautifully illustrate the morphology of both the proximal centriole, confirming the partial degeneration of mouse sperm, and intriguingly, asymmetry in the microtubule wall of pig sperm. In distal centrioles, the authors show that in all mammalian species, microtubule doublets of the centriole wall are organized around a pair of singlet microtubules. The presented segmentation of the connecting piece is beautiful and nicely shows the connecting piece forming a nine-fold, asymmetric, chamber the centrioles. The authors further use subtomogram averaging to provide the first maps of the mammalian central pair and identify sperm-specific radial spoke-bridging barrel structures. Lastly, the authors perform further subtomogram averaging to show to the connecting site of the outer dense fibers to the microtubule doublet of the proximal principal piece and confirm the presence of the TAILS microtubule inner protein complex (Zabeo et al, 2018) in the singlet microtubules occupying the tip of sperm tails. The manuscript provides the clearest insight into flagellar base morphology to date, giving insight into the morphological difference between different mammalian cilia and centriole types. The manuscript is suitable for publication, once the following questions are addressed.

      Major Points: How many centrioles and axonemes were used in generating the averages presented in the paper? If too few samples were used, especially in centrioles undergoing dramatic remodeling or degeneration, the reality of MIPs and MAPs being present might be completely affected. For instance, In figure 1d, the authors present a cryoET map of the centriole microtubule triplet. However, centrioles are divided into several regions with different accessory elements. Here, the authors could show the presence of only part of the A-C linker. The A-C linker covers only 40% of the centriole, so does it mean that this centriole is made only of the accessories that characterize the proximal side of the centriole? In the same line, what were the boundaries governing subtomogram extraction? For example, in the distal centriole, were microtubules extracted from just before the start of the transition zone, to the end of the microtubule vaulting, more pronounced at the end of the proximal region? There are known heterogeneities in centriole, as well as flagella, ultrastructure along the proximal distal axis. If no pre-classification was performed for subtomogram longitudinal position along with the centriole and axoneme, structural features may be averaged out, and or present and not reflecting their real longitudinal localization. The classification should be applied here if it was not the case.

      Minor Points:

      • In line 3, motile cilia are not only used to swim, they can move liquid or mucus for instance.
      • In line 175, the authors stated " a prominent MIP associated with protofilament A9, was also reported in centrioles isolated from CHO cells (Greenan et al. 2018) and in basal bodies from bovine respiratory epithelia (Greenan et al 2020). Actually, this MIP has been seen in many other centrioles from other species, such as Trichonympha (https://doi.org/10.1016/j.cub.2013.06.061 ), Chlamydomonas, and Paramecium ( DOI: 10.1126/sciadv.aaz4137 ). Citing these studies will reinforce the evolutionary conservation of this MIP and therefore its potential crucial role in the A microtubule.
      • In Line178, the authors stated: "Protofilaments A9 and A10 are proposed to be the location of the seam (Ichikawa et 2017)". High-resolution cryoEM maps confirmed it: https://doi.org/10.1016/j.cell.2019.09.030 . This publication should be cited. Moreover, authors should also refer to this paper when discussing MIPs in the microtubule doublet.
      • In Line 187-189 the authors stated, "We resolved density of the A-C linker (gold) which is associated with protofilaments C9 and C10." The A-C linker interconnects the triplets of the proximal centriole (Guichard et. al. 2013, Li et. al. 2019, Klena et. al. 2020) with distinct regions binding the C-tubule, as shown by the authors in gold, as well as an A-link, making contact with the A-tubule through various protofilaments in a species-specific manner, but always on protofilament A9. The authors may have identified the A-link, labeled in green, on the outside of protofilament A8/A9 in Figure 1d.
      • In figure 1e, the authors provide a 9-fold representation of the centriole based on their map. How relevant is this model ? the distance between triplet is inconsistent here, which has not been observed before. Do they use true 3D coordinates to generate this model? The A-C linker, which is only partially reconstructed, does not contact the A microtubule. Is it really the case? did the authors see that the A-link density of the A-C linker has disappeared? If these points are not clearly specified, this representation might be misleading.
      • The nomenclature regarding MIPs is sometimes confusing in this manuscript. For example, in lines 228-229 "We then determined the structure of DC doublets, revealing the presence of MIPs distinct from those in the PC." Does this include the gold and turquoise labeled structures in Figure 2j? These densities appear to correspond to the inner scaffold stem in the gold density presented in Figure 2j, and armA, presented in the turquoise density (Li et. al. 2011, Le Guennec et. al. 2020). The presence of this Stem here is important as it correlates with the presence of the molecular player making the inner scaffold (POC5, POC1B, CENTRIN): https://doi.org/10.1038/s41467-018-04678-8
      • The connecting piece is composed of column vaults emanating from the striated columns is compelling and beautiful segmentation data. However, it is important to note how many pig sperm proximal centrioles had immediate-short triplet side contact with the Y-shaped segmented column 9, as well as in how many mouse centrioles have the two electron-dense structures flanking the striated columns.

      The resolution of the mammalian central pair is an important development brought by this work. The structural similarity between the central pair of pig and horse is convincing. However, with only 281 subtomograms being averaged for the murine central pair, corresponding to an estimated resolution of 49Å, the absence of the helical MIP of C1 with 8 nm periodicity suggests that there is simply not enough signal to capture it in the average. The same could be said for the smaller MIP displayed in Figure 4 c, panel ii. This point should be clearly stated.

      Another piece of compelling data presented in this study is the attachment of the outer dense fibers to the axoneme of the midpiece and proximal and distal principal pieces. From the classification data presented along the flagellar length, it is clear that the only ODF contact made with the axoneme is at the proximal principle plate. However, this is far from obvious in the native top view images presented. Is it possible to include a zoomed inset of the connection between the A-tubule and ODF connection?

      Significance

      This work is of good quality and provides crucial information on the structure of centriole and axoneme in 3 different species. This work complements well the previous works. The audience for this type of study is large as it is of interest to researchers working on centrioles, cilium, and sperm cell architecture.

      My expertise is cryo-tomography and centriole biology

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reviewer #1 (Evidence, reproducibility and clarity):

      This manuscript follows on from previous work from the Rhind lab to investigate whether the load of MCMs at origins is a factor in when the origin activate (as a population average) during S phase. The authors use budding yeast and a auxin degron system to modulate the levels of an MCM subunit. This allows them to titrate down the concentration of the MCM hexamer and observe the effect. Crucially, they assay both the reduction in MCM load at origins and the subsequent replication dynamics in the same experiment. This is the power of their approach and allows them to rigorously test their hypothesis.

      **Major comments**

      1.I found the introductory paragraph discussing the Rhind lab hypothesis about the possibility of multiple MCM being loaded at origins somewhat misleading. The first paragraph of the discussion was much clear. However, I feel that the introductory paragraph should deal with the difference between the two proposals: 0-1 MCM-DH per origin (de Moura et al), vs 0-50+ MCM-DH (Yang et al). It s also important to note that Foss et al find that "In budding yeast, [MCM] complexes were present in sharp peaks comprised largely of single double-hexamers" - i.e. consistent with 0-1 MCM-DH per origin.

      To improve the balance of the introduction, I think the authors should briefly introduce the concepts behind the 0-1 MCM-DH per origin; this was defined as origin competence by Stillman and clearly described by McCune et al (2008; see figure 8) prior to the work from de Moura et al.

      Furthermore, in the discussion the authors should be more even-handed. To date there is no data to conclusively rule one way or the other in distinguishing between single vs multiple MCMs. The authors cite Lynch et al and state "overexpression of origin-activating factors in S phase causes most all origins to fire early in S phase, consistent with most origins having at least one MCM loaded". However, Lynch et al report equivalent (roughly equal) origin efficiencies, but the assay doesn't distinguish between all going up to high efficiency or all going to a lower intermediary efficiency. Given that fork factors (polymerases, etc) are likely to become limiting at some point (or checkpoints could be activated due to limited dNTP supplies) it would seem plausible that uniform origin efficiency could be a consequence of less than maximal origin firing. As part of this discussion it would be useful for the authors to include what conclusions have been reached on MCM load from in vitro systems (with chromatin substrates).

      Because the main focus of the paper is not dependent on whether MCM stoichiometry varies from 0 to 1 or 0 to many, we had relegated our discussion of absolute stoichiometry to the Discussion. However, it is clear from multiple reviewer's comments that it is something very much on readers minds. Therefore, we have now included a brief introduction to the 0-to-1 and 0-to-many scenarios in the Introduction and moved the bulk of the discussion of the data supporting the two scenarios to the Discussion.

      2.The authors are not the first to look at the consequence of reduced MCM concentrations on origin function. This was essentially the basis for the MCM screen undertaken by Bik Tye's lab that first identified the MCM genes. In addition to temperature sensitive mutants, the Tye group also examined heterozygotes (Lei et al., 1996) to show differential effect on the ability of two origins to support plasmid replication. The authors finds are entirely consistent with these early studies, particularly since ARS416 (formerly ARS1) was found to highly sensitive to reduced MCM levels and ARS1021 (formerly ARS121) was found to be insensitive to MCM levels. The authors find a signifiant reduction in MCM load at ARS416, but the MCM load at ARS1021 is unaltered by reduced MCM concentration. It would be worth the authors noting this consistency. The authors do cite the Lei study, but not in this context. The original MCM screen was published here:

      Maine, G., Sinha, P., Tye, B. (1984). Mutants of S. cerevisiae defective in the maintenance of minichromosomes Genetics 106(3), 365 - 385.

      Furthermore, at the end of the discussion the authors state that "it will be interesting to dissect the specific cis- and trans-acting factors that make origins sensitive or resistant to changes in MCM levels". The equivalent effect reported by the Tye lab has already been dissected by the Donaldson lab (Nieduszynski et al., 2006) and perhaps it would be worth briefly mentioning their findings.

      We have included both of these literature precedents in the Discussion.

      3.The authors should show the flow cytometry data for each of their cell cycle experiments, if only in supplementary figures. This is important to allow a reader (and reviewer) to judge the level of synchrony achieved when interpreting the results.

      This data is now included as Figure S1

      4.I think the authors should show the ChIP signal at some example origins, including ones sensitive and insensitive to the reduction in MCM concentration. Currently all the high resolution ChIP data (i.e. over 1400 bp, e.g. Fig 3a) is presented as meta-analyses of many origins.

      We will include this analysis in a subsequent revision.

      5.When describing the results in Fig 4a the authors focus on changes (highlighted in black boxes) that fit their expectation. However, there are other sites that should at least be mentioned that don't seem to fit the authors model, e.g. ARS517, ARS518. It would be worth discussing what fraction of the timing data can be explained by the reduced MCM load.

      We now explicitly point out that Figures 4c and 4d address this issue of the robustness of the correlation. Although there is significant variation, as the reviewer points out, the trend is seen genome wide. As it happens, both ARS517 and ARS518 do fit the model reasonably well. They have intermediate loss of MCM signal and intermediate delay in timing.

      **Minor comments**

      -These data, rather than this data (throughout).

      I suspect that the journal style and/or copy editors will make the final call. However, I will point out that although 'data' is most certainly plural in Latin, its predominate modern English usage is as a mass noun, such as water or sand or information. In general, users do not think of, or use, 'data' as a collection of discrete elements, each on being a 'datum', a contention supported by the very infrequent use of the word datum. For instance, in ChIP-seq experiment, what is a datum? Each individual read? Each individual nucleotide in each read? The quality score for each individual nucleotide in each read? Each pixel in each image from the sequencer? When one wants to refer to an individual piece of data, common usage is to refer to a data point, just as one would refer to a grain of sand. Moreover, if 'data' were plural, it would be incorrect to use it in phrases such as "there is very little data available". Would the review really suggest using "there are very few data available"?

      -the authors should clearly state in figure legends what window size has been used in analysing genomic data.

      All analyses were done using 1kb windows, as now stated in the figure legends.

      -in figure 2a the authors show pairwise comparisons between conditions, it would be nice to see the 3rd pairwise comparisons perhaps as a supplementary figure

      We have included the third comparison in Figure 2a.

      -in figure 2c it would be clearer to use the same colour for the lines and the points

      The regression lines are in the same colors as the data points they fit. x=y is shown in blue for comparison, as now noted in the figure legend.

      -the authors should avoid the use of red/green colour combinations in their figures (see: https://thenode.biologists.com/data-visualization-with-flying-colors/research/)

      All figures will be redrawn in colorblind-accessible colors in a subsequent revision.

      -in the text the authors state "ORC binding to the ACS and subsequent MCM loading is a directional process dependent on a ACS- site and a similar but inverted nearby sequence (Xu et al., 2006)". I think it would be more appropriate to cite the following study here:

      Coster, G., Diffley, J. (2017). Bidirectional eukaryotic DNA replication is established by quasi-symmetrical helicase loading Science (New York, NY) 357(6348), 314 - 318. https://dx.doi.org/10.1126/science.aan0063

      The Coster reference has been included.

      -the list of factors that influence replication timing should include Rif1, whereas it is less clear that Rpd3 acts within the unique genome (as opposed to indirectly via repetitive DNA, e.g. rDNA)

      Rif1 has been added to the list.

      -figure 4 - it might help to mark the centromere on panel a. Also, why do the ChIP peaks and annotated origins appear to line up so poorly?

      The shift between the peaks and the ACS positions was introduced during the construction of the figure. Thanks for catching it. The alignment has been corrected and the centromere annotation has been added.

      -figure 4d - would it not be better to use fraction of lost MCM signal on the x-axis as in previous figures?

      If T_rep was a linear function of MCM stoichiometry, fraction lost would work as well as amount lost. However, we find that there is a lower correlation between fraction of MCM signal lost and T_rep delay than between absolute MCM signal lost and T_rep delay, suggesting a more complicated relationship.

      -"with galactose or raffinose, to induce or repress Mcm2-7 overexpression, respectively." This is incorrect, raffinose does not repress this promoter (that requires glucose).

      Fixed.

      -the S. pombe spike in is a great addition to the over expression experiments. It's a shame that it wasn't included in the auxin experiments.

      Yes, we agree.

      -why does the data in fig 5d appear to be at much lower resolution that the previous ChIP data?

      The resolution was inadvertently reduced during the rendering of the figure. The resolution has restored.

      -in the sequencing analysis pipeline for MCM ChIP the authors use a 650 bp upper size limit; why have such a large threshold compared to the size of a nucleosome? Are the analyses and findings sensitive to this size threshold?

      Although the MNase digestion was optimized to produce mostly mononucleosomal-sized digestion, some di- and very little tri- nucleosomal fragments still remain. In order to capture as many of the MCM-protected immunoprecipitated fragments as possible, the upper limit was set at 650 bp (up to 4 nucleosomes-worth of DNA). However, there is a very minimal contribution from fragments larger than mononucleosomes, qualitatively as well as quantitatively in 1kb windows around origins. Figure 3a provides a qualitative depiction of the contribution of dinucleosomes (input, ~300bp).

      -the repliscope package was published here:

      Batrakou, D., Müller, C., Wilson, R., Nieduszynski, C. (2020). DNA copy-number measurement of genome replication dynamics by high-throughput sequencing: the sort-seq, sync-seq and MFA-seq family. Nature Protocols 15(3), 1255 - 1284. https://dx.doi.org/10.1038/s41596-019-0287-7

      The reference has been corrected.

      Reviewer #1 (Significance):

      This work builds upon a body of work from the Rhind group (and others) to determine the contribution of MCM load to replication origin activation dynamics. To my mind this is the most convincing dataset and analysis to date and goes a long way to supporting the model that the efficiency of MCM loading is a major factor in determining the mean replication time of an origin. As the authors state, they are still not able to distinguish between two different models of MCM load (single vs multiple). It would be interesting for the authors to discuss how these two models could be distinguished in the future (perhaps with single cell/molecule experiments).

      This study will be of interest to those in the fields of DNA replication and genome stability.

      My field of expertise is DNA replication and replication origin function.

      Reviewer #2 (Evidence, reproducibility and clarity):

      **Summary:**

      This is a nice study that characterizes the consequences of limiting or increasing Mcm expression on the replication program. Prior ChIP experiments in yeast have observed that not all origins exhibit the same level of Mcm enrichment and that increased mcm enrichment was correlated with origin activity. These observations led to two different models -- a) that multiple Mcm2-7 double hexamer complexes are loaded at some origins and b) a probabilistic model where the differential enrichment of Mcm2-7 reflected the fraction of cells in a population that had loaded the Mcm2-7 complex at a specific origin. While the titration experiments presented here don't provide any conclusive support for either model, they do provide some novel and relevant insights for the replication field, in part, due to the increased resolution and quantification afforded by the MNase ChIP-seq approach (and S. pombe spike in). The authors very nicely demonstrate that origins are differentially sensitive to Mcm2-7 depletion and that loss of Mcm2-7 loading results in an altered replication timing profile. The origins most impacted by loss of Mcm2-7 are 'weak' origins as described by the Fox group. Intriguingly, the authors find that the 5X overexpression of Mcm2-7 does not perturb the relative Mcm2-7 loading at individual origins, but rather instead globally represses Mcm2-7 association at all origins. They also find that overexpression of both Cdt1 and Mcm2-7 is detrimental to the cell (although no obvious replication phenotype was observed). Finally, the authors present a reasonable interpretation of their data in the context of models for replication timing which was very well articulated.

      **Major Comments:**

      From the methods it appears that different analyses were performed with different replicates?

      "Replicate #1 was used for all analyses except for V plots, for which the higher resolution Replicate #2 was used."

      Ideally all of the conclusions should be supported by all the replicates independently, or if the replicates are concordant -- they should be merged (at a similar sequencing depth) prior to doing the analyses.. Even the v-plots with merged replicates will be informative due to the greater sequencing depth.

      Though we agree that greater sequencing depth would be informative for aggregation analysis, we think that one of the main strengths of our study is the analysis of MCM quantitation and replication timing in the same population of cells. Although the experiments were performed in exactly the same way, there is always slight biological or temporal differences between the replicates, due to the complicated nature of the experimental design. This variation increases the noise between the MCM ChIP and the replication timing analyses. Therefore, were analyzed the replicates separately. However, we did do all of the analyses on both replicates and got similar results. We have now explicitly stated as much.

      The authors should provide a separate analysis for the larger nucleosomal sized fragments and smaller putative MCM double hexamer fragments with regards to the Mcm loading and relationship to ACS and orientation. They may represent an interesting intermediate with mechanistic consequences for the interpretation.

      We will include the suggested analysis in a subsequent revision.

      The authors should present the v-plots and an analysis of which side the Mcm's load for the overexpression studies. I was surprised that there was no further in-depth analysis for these two extremes. Perhaps similar conclusions will be reached, but it should at least be mentioned/presented as a supplementary figure.

      We will include the suggested analysis in a subsequent revision.

      **Minor Comments:**

      This is largely semantic, but the majority of MNase ChIP-seq signal recovered is associated with the nucleosomes and not in the NDR and as the signal in the NDR is differentially sensitive to digestion, I would suggest rephrasing the following sentence:

      "In contrast to previous genome-wide reports (Belsky et al., 2015), but in agreement with recent in-vitro cryo-EM structures (Miller et al., 2019), we also observe MCM signal in the nucleosome-depleted region (NDR) of origins. "

      to :

      "In agreement with a previous genome-wide report (belsky 2015), we found that the bulk of the MCM signal was associated with nucleosomal sized fragments; however the increased resolution afforded by our approach allowed us to also detect protected fragments in the NDR as predicted by recent in vitro cryo em structures..."

      We have modified the sentence as suggested.

      As a sanity check, please double check V-plots and presence of small fragments with the digestion conditions. In the Henikoff manuscript the bulk of sub-nucleosomal fragments were lost with the longer digestion time. Specifically, the TF footprints were more pronounced with minimal digestion. While it might be argued that the longer digestion more tightly resolved the binding site, in many cases they were completely lost with the 20 minute digestion. This is just a simple check -- I don't doubt the results as reported given the experimental conditions are very different. For example, the henikoff manuscript did not use cross linking or an antibody enrichment step.

      We double checked and confirmed that more small fragments are found in the more digested library. The reason that we see more small fragments when we digest more, in contrast to the contrary observation in the Henikoff paper is presumably because MCM has a larger footprint than a transcription factor and protects that footprint more effectively.

      Last paragraph of the "MCM associates with nucleosomes section" which reports that the Mcm2-7 complex is loaded up or downstream from the ACS independent of orientation should cite Belsky 2015 (Figure 5 and discussion) for the initial observation.

      Done.

      The authors argue that the global reduction in MCM loading associated with overexpression may be a technical artifact given that all origins exhibit a proportional reduction in mcm2-7 loading. However, this is exactly what the S. pombe spike in control is intended for. The relative difference between individual origins resulting from Mcm2-7 depletion would still be evident without the spike in. The authors do discuss different possibilities, but I would not be so keen to discard this as technical artifact.

      We, too, are reluctant to dismiss this result as a technical artifact. However, we are at a loss to offer any other explanation. We raise a handful of biological possibilities in the Discussion, but dismiss each one as failing to account for our results. We would be happy to entertain other suggestions.

      Reviewer #2 (Significance):

      This work has several advances that will be appreciated by the replication field -- including a high resolution view of Mcm2-7 loading in the context of chromatin; the impact of titrating (low and high) MCM expression on MCM loading and replication timing program; and a well reasoned discussion of how different models of MCM loading would impact origin activation and replication timing program. The work builds on prior studies in the field (eg. Belsky 2015), while some of the conclusions regarding the localization of the Mcm2-7 complex relative to the ACS and surrounding nucleosomes are confirmatory, the increased resolution provides new insight (like the enrichment of small fragments in the NDR) that could be further strengthened by additional analysis (see above).

      My expertise is DNA replication and chromatin.

      Reviewer #3 (Evidence, reproducibility and clarity (Required)):

      In this study, the authors use Auxin-mediated degradation of Mcm4 to reduce the concentration of the MCM helicase complex in yeast, and determine the effects of this reduction on both MCM-origin association (interpreted as MCM loading) by MNase-MCM-ChIPSeq and on replication origin function by Sync-Seq replication timing experiments (deep sequencing of a yeast population as it progresses through a synchronized S-phase). Complementary experiments testing the effect of induced MCM complex over-expression on MCM-origin association are also performed.

      The authors find that reducing Mcm4 levels (and thus loading-competent MCM complexes) causes yeast cells to be more sensitive to DNA replication stress. In addition, not all origins are equally susceptible to reductions in MCM levels; the origins that do lose MCM binding at reduced MCM levels show a reduction in activity and an associated delay in their replication time under those conditions. Finally, over-expression of the MCM complex has no effect on MCM-origin association or origin function, suggesting that MCM levels are not limiting for origin licensing in yeast under normal lab conditions. The strengths of the study are the well-executed experiments and very nice data that are presented. However, there are several weaknesses. The authors make conclusions that are not supported by their data; and several of the outcomes are not at all unexpected based on extensive published studies in yeast and mammalian cells, raising issues about whether this study advances and/or clarifies the current gaps in the field. While some of the relevant past studies were referenced, the authors did not place their own study in the context to published work and current models in the field, which reduced the scholarly value of their study. Because the work was not placed in context of the field, some of the rationale and conclusions were misleading.

      **Some specific major comments:**

      1,The title is misleading. The authors have clearly shown that when MCM levels are be made limiting in an engineered system, some origins are substantially less active, which means that these origin loci are replicated "passively" (i.e. by a Replication Fork (RF) emanating from a distal origin) rather than actively (i.e. by "firing" and initiating replication). Their own replication data show that. But this competition is only revealed when MCM levels are artificially/experimentally lowered. What is the evidence that competition for MCM complexes among individual origins establishes replication timing patterns in yeast? If anything, the over-expression experiment suggests the opposite--that MCM levels are not limiting and therefore do not play a substantial role in establishing the replication timing patterns that are observed in yeast. Instead those patterns appear to result primarily from the fact that MCM complex activation factors are present in limiting concentrations relative to origins.

      We agree with the reviewer's analysis and have revised the title to "The Capacity of Origins to Load MCM Establishes Replication Timing Patterns".

      2,The abstract states that "the number of MCMs loaded onto origins has been proposed to be a key determinant of when those origins initiate DNA replication during S-phase". While it is true that this lab has proposed this model in budding yeast, the current study performs no experiments that directly address this model--i.e. that i. individual origins possess a different number of MCM complexes and or ii that these differences underlie timing differences. They acknowledge this point in their Discussion--a ChIPSeq experiment is an ensemble experiment--there is no way to know that differences in MCM signals correspond to a different number of MCM complexes per origin versus a differences in the fraction of cells that contain and MCM complex at all at a given origin . But this statement in the abstract, combined with their conclusion in the same section of the paper: "Our results support a model in which the loading activity of origins, controlled by their ability to recruit ORC and compete for MCM, determines the number of helicases loaded, which in turn affects replication timing" implies that they have tested a model that they have not tested. Given how quickly readers "skim" the literature these days, a misleading abstract can do a lot of damage to a field. The results presented in this study neither support nor refute the model for the number of helicases loaded per origin, and the fact that reducing origin licensing efficiency by making the major substrate limiting reduces the number of licensed origins in a cell population is fully expected based on the current state of the field .

      Four questions are addressed in this comment. The first is whether there is variable MCM stoichiometry at origins. The second is whether that variation ranges from 0 to 1 and 0 to many. The third is if the variation is stoichiometry affects replication timing. The fourth is how this variation in stoichiometry comes about.

      Our work is based on the conclusion, supported by a substantial body of literature, that MCM loading stoichiometry varies among origins. Our data in this paper further supports this conclusion.

      As the reviewer notes, and as we had tried to make clear, the data is this paper does not address the range of the variation. Moreover, as we also tried to make clear, our hypotheses, results and conclusions are not affected by whether the range is 0 to 1 or 0 to many.

      This paper focuses on Questions 3 and 4. We have reworked the introduction to make these distinctions more clear.

      We have also corrected the abstract to refer to "the stoichiometry", instead of "the number", of MCMs.

      3,The rationale for the study as stated in the Introduction: "Although the molecular biochemistry of initiation at individual origins continues to be elucidated in great detail (Bleichert, 2019), the mechanism governing the time at which different regions of the genome replicate has remained largely elusive (Boos and Ferreira, 2019)." Is also misleading. In fact, in budding yeast (and other organisms) there have been several advances in this area particularly with respect to DNA replication origin activation. The S-phase origin activation factors are limiting for origin function, and factors such as Ctf19 at centromeres and Fkh1/2 at non-centromeric early-acting origins help to directly recruit the limiting S-phase factor, Dbf4, to origins. It is misleading to ignore this substantial progress and not make an effort to place this current study, which is important and one of the first to look directly at MCM loading control in yeast, into a relevant context with respect to what is known. What's interesting is that this S-phase model assumes/requires that most origins are, in fact, licensed and thus that differences in licensing efficiency are not a major driving of replication timing patterns in yeast. But we do not know why there are only subtle differences in MCM loading---this study may help explain that.

      We have broadened the scope of our Introduction and Discussion to address these points. However, it is not the case that "there are only subtle differences in MCM loading". MCM ChIP-seq (, and this paper) and MCM ChEC-seq both show well over ten-fold variation in MCM stoichiometry at origins. We have now explicitly made this point in the Introduction.

      4,The authors link the differential ability of MCM loading deficiencies when MCM is made limiting to differences in ORC binding categories. The "weak" origins, that presumably bind ORC weakly, were most affected by reductions in MCM. Are these origins less efficient than the other categories, DNA and chromatin-dependent (using the origin efficiency metric data from the Whitehouse lab) where MCM binding is not reduced as much? In normal cells are these early or late origins? Is the idea that the role of excess MCM is to achieve a sufficient number or "back up" origins per cell to deal with potential stress, as proposed by the Blow and Schwob labs in tissue culture cells many years ago? It seems likely that the data reported here are in fact confirmations of those early studies in mammalian cells---which is useful to know even if not unexpected.

      We will include the suggested analyses in a subsequent revision.

      Excess MCM do, as has been long appreciated and as we discuss, contribute to replication-stress tolerance. However, that is not a major point of our paper.

      5,Aren't the results that losing MCM signal corresponds to loss of origin activity peaks entirely expected? The same result would be obtained if you made a point mutation in that origin's ACS. Of course preventing an origin from being licensed will delay that region's replication time in S-phase because it now must be replicated passively. Licensing affects replication timing patterns because the MCM complex is the substrate for limiting S-phase factors, but that is far different from concluding that the number of MCMs at an origin is what controls the time in S-phase when an origin is activated.

      Yes, "the results that losing MCM signal corresponds to loss of origin activity peaks [are] entirely expected". However, this is not the important result. The key result is that the distribution of MCM at origins is not uniformly affected, which leads to our conclusions that, in wild-type cells, origin capacity dominates MCM stoichiometry and that, when MCM become limiting, origin activity (probably determined by ORC affinity) becomes critical—neither of which were expected results. In any case, the expected correlation between MCM loading and origin activity was observed as a consequence of measuring MCM stoichiometry and replication timing and is an obvious analysis to include, so we did so.

      6,The authors stated that the measured MCM abundance for the 43% of origins that are not known to be controlled by the multiple mechanisms that have been shown to control origin replication time. Is this because they think that MCM loading contributes to the timing control of only these origins? Was MCM loading not affected at any of these other origins when MCM levels were reduced? Are those 43% of origins in the "weak" binding category in terms of ORC? The rationale for eliminating so many origins from these analyses were not clear.

      We propose that the probability of origin activation is the product of the stoichiometry of MCM at the origin and the rate of MCM activation, which may be affected by trans-acting factors. For the 43% of origins for which there is no known trans-acting regulation, the correlation with stoichiometry is stronger. However, the correlation holds when looking at all origin, too. The suggestion to look at only the 57% of origins with known trans-action regulation is a good one. We will include this analysis and the other suggested analyses in a subsequent revision.

      7,Doesn't the data in Figure 4c at 0 mM auxin support the conclusion that differences in MCM ChIP signals have negligible effects on origin activation time, in contrast to the publication by Das, 2015 from this lab? Or is the point that these origins are sensitive to reductions in MCM levels and the more sensitive they are the more delayed their replication time (but again, doesn't that have to be true? If they are losing MCM signals they cannot function as origins, so they are replicated passively and, by definition, will show delayed replication timing. An origin is defined as such by a loaded MCM complex.)

      No. The reason the correlation in 4c is not a good as in our previous work is that in Das 2015 we compared origin-activation efficiency (calculated from our stochastic model in Yang 2010), instead of T_rep, which we used here. T_rep is a convolution of origin-activation time and passive-replication time, reducing to correlation. The important observation is that the correlation gets better as MCM levels are reduced.

      The correlation between MCM stoichiometry and activation efficiency may seem trivial, but just because a model is simple does not mean it is not correct. If stoichiometry was the only factor regulating origin activation, we would expect a stronger correlation. So, we conclude that there are other factors at play, quite possible the trans-acting factors that the reviewer mentions in their second point. However, if stoichiometry played no role, we would expect no correlation. So, we propose that MCM stoichiometry is "an important determinant of replication timing".

      8,I do not understand the conclusions from Figure 4d. There is an extremely small positive correlation between how much of an MCM signal is lost and delay in replication time of an origin, but this correlation is not surprising as an unlicensed origin cannot be an origin and will be replicated passively. What seems most surprising about these data is that the effect is so weak, not that it exists. There is quite a lot of scatter in this plot at 500 uM auxin, with some origins losing a given amount of signal (x) and being only slightly delayed in replication time, and others losing the same amount of signal (x) and being substantially delayed. What underlies this outcome?--Are the ones that are not substantially delayed closer to origins that have not been affected at all by MCM reductions? Why is the correlation so weak? The other regulators of origin activation time have stronger and more precise effects--for example the centromere-control can be precisely eliminated so that only the replication time of the centromere-proximal origins are delayed.

      We believe that much of the noise in Figure 4d is due, as the reviewer suggests, to passive replication of origins which lose most of their MCM signal and become inactive but happen to reside next to origins which don’t lost any MCM signal and fire early. And excellent example is ARS 510 (see Figure 4a). ARS510 loses most of its MCM signal and clearly loses its initiation peak in the T_rep plot. However, because it is next to ARS511, which does not lose much MCM signal and which remains a efficient origin, ARS510 is still replicated early. We will include this example in a subsequent revision.

      9,Multiple studies in yeast and mammalian cells indicate that MCM subunits are in excess relative to other licensing and S-phase initiation factors, so it is not unexpected that over-expressing MCM did not lead to enhanced levels of licensing. It seems much more plausible that Cdc6 or Cdt1 or both factors are present in limiting amounts for MCM loading, so I did not understand the point of over-producing MCM subunits. If the "weak" origins are the ones that are most dramatically affected by reducing MCM to "limiting" levels, isn't the question whether you can increase licensing at these origins when you over-produce a factor that is likely limiting for licensing, such as Cdt1 or Cdc6 (or both) while leaving MCM at its normal levels. The fact that MCM levels are not limiting for licensing is not surprising and, if anything, argues against these levels having a regulatory role in origin activation timing---which seems to be the opposite of what the authors want to conclude.

      Orc1-6, Cdc6 and Cdt1 are all substoichiometric to MCM. However, they all act catalytically to load MCM. So, although they may be kinetically limiting, they do not prevent most or all MCMs being loaded in wild-type cells. The fact that overexpressing MCMs (with or without Cdt1) does not allow for more MCM loading suggests that under normal conditions origins are saturated with MCMs and have little or no capacity to load more MCM, even when given plenty of time to do so. From this result, we conclude that origin capacity is a major determinant of MCM loading in wild-type cells. From our MCM-reduction experiments, we also conclude that, when MCM is limiting, origin competition affects which origins load MCMs faster. However, we agree with the reviewer's first point, that our title gave the incorrect impression that we concluded that origin competition is the primary determinant of MCM loading in wild-type cells. Thus, as suggested, we have changed the title. We have also reworked the Introduction and Discussion to more clearly explain that competition is only a determining factor when MCMs are limited.

      In summary, I think the technical aspects of the experiments were quite strong, but I do not think that the experiments answered the question that was posed by the authors.

      **Minor points:**

      Many places where "This data" should be changed to "These data". Data are plural.

      See comments on this point in the response to Reviewer #2.

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      In this study, the authors use Auxin-mediated degradation of Mcm4 to reduce the concentration of the MCM helicase complex in yeast, and determine the effects of this reduction on both MCM-origin association (interpreted as MCM loading) by MNase-MCM-ChIPSeq and on replication origin function by Sync-Seq replication timing experiments (deep sequencing of a yeast population as it progresses through a synchronized S-phase). Complementary experiments testing the effect of induced MCM complex over-expression on MCM-origin association are also performed.

      The authors find that reducing Mcm4 levels (and thus loading-competent MCM complexes) causes yeast cells to be more sensitive to DNA replication stress. In addition, not all origins are equally susceptible to reductions in MCM levels; the origins that do lose MCM binding at reduced MCM levels show a reduction in activity and an associated delay in their replication time under those conditions. Finally, over-expression of the MCM complex has no effect on MCM-origin association or origin function, suggesting that MCM levels are not limiting for origin licensing in yeast under normal lab conditions. The strengths of the study are the well-executed experiments and very nice data that are presented. However, there are several weaknesses. The authors make conclusions that are not supported by their data; and several of the outcomes are not at all unexpected based on extensive published studies in yeast and mammalian cells, raising issues about whether this study advances and/or clarifies the current gaps in the field. While some of the relevant past studies were referenced, the authors did not place their own study in the context to published work and current models in the field, which reduced the scholarly value of their study. Because the work was not placed in context of the field, some of the rationale and conclusions were misleading.

      Some specific major comments:

      1,The title is misleading. The authors have clearly shown that when MCM levels are be made limiting in an engineered system, some origins are substantially less active, which means that these origin loci are replicated "passively" (i.e. by a Replication Fork (RF) emanating from a distal origin) rather than actively (i.e. by "firing" and initiating replication). Their own replication data show that. But this competition is only revealed when MCM levels are artificially/experimentally lowered. What is the evidence that competition for MCM complexes among individual origins establishes replication timing patterns in yeast? If anything, the over-expression experiment suggests the opposite--that MCM levels are not limiting and therefore do not play a substantial role in establishing the replication timing patterns that are observed in yeast. Instead those patterns appear to result primarily from the fact that MCM complex activation factors are present in limiting concentrations relative to origins.

      2,The abstract states that "the number of MCMs loaded onto origins has been proposed to be a key determinant of when those origins initiate DNA replication during S-phase". While it is true that this lab has proposed this model in budding yeast, the current study performs no experiments that directly address this model--i.e. that i. individual origins possess a different number of MCM complexes and or ii that these differences underlie timing differences. They acknowledge this point in their Discussion--a ChIPSeq experiment is an ensemble experiment--there is no way to know that differences in MCM signals correspond to a different number of MCM complexes per origin versus a differences in the fraction of cells that contain and MCM complex at all at a given origin . But this statement in the abstract, combined with their conclusion in the same section of the paper: "Our results support a model in which the loading activity of origins, controlled by their ability to recruit ORC and compete for MCM, determines the number of helicases loaded, which in turn affects replication timing" implies that they have tested a model that they have not tested. Given how quickly readers "skim" the literature these days, a misleading abstract can do a lot of damage to a field. The results presented in this study neither support nor refute the model for the number of helicases loaded per origin, and the fact that reducing origin licensing efficiency by making the major substrate limiting reduces the number of licensed origins in a cell population is fully expected based on the current state of the field .

      3,The rationale for the study as stated in the Introduction: "Although the molecular biochemistry of initiation at individual origins continues to be elucidated in great detail (Bleichert, 2019), the mechanism governing the time at which different regions of the genome replicate has remained largely elusive (Boos and Ferreira, 2019)." Is also misleading. In fact, in budding yeast (and other organisms) there have been several advances in this area particularly with respect to DNA replication origin activation. The S-phase origin activation factors are limiting for origin function, and factors such as Ctf19 at centromeres and Fkh1/2 at non-centromeric early-acting origins help to directly recruit the limiting S-phase factor, Dbf4, to origins. It is misleading to ignore this substantial progress and not make an effort to place this current study, which is important and one of the first to look directly at MCM loading control in yeast, into a relevant context with respect to what is known. What's interesting is that this S-phase model assumes/requires that most origins are, in fact, licensed and thus that differences in licensing efficiency are not a major driving of replication timing patterns in yeast. But we do not know why there are only subtle differences in MCM loading---this study may help explain that.

      4,The authors link the differential ability of MCM loading deficiencies when MCM is made limiting to differences in ORC binding categories. The "weak" origins, that presumably bind ORC weakly, were most affected by reductions in MCM. Are these origins less efficient than the other categories, DNA and chromatin-dependent (using the origin efficiency metric data from the Whitehouse lab) where MCM binding is not reduced as much? In normal cells are these early or late origins? Is the idea that the role of excess MCM is to achieve a sufficient number or "back up" origins per cell to deal with potential stress, as proposed by the Blow and Schwob labs in tissue culture cells many years ago? It seems likely that the data reported here are in fact confirmations of those early studies in mammalian cells---which is useful to know even if not unexpected.

      5,Aren't the results that losing MCM signal corresponds to loss of origin activity peaks entirely expected? The same result would be obtained if you made a point mutation in that origin's ACS. Of course preventing an origin from being licensed will delay that region's replication time in S-phase because it now must be replicated passively. Licensing affects replication timing patterns because the MCM complex is the substrate for limiting S-phase factors, but that is far different from concluding that the number of MCMs at an origin is what controls the time in S-phase when an origin is activated.

      6,The authors stated that the measured MCM abundance for the 43% of origins that are not known to be controlled by the multiple mechanisms that have been shown to control origin replication time. Is this because they think that MCM loading contributes to the timing control of only these origins? Was MCM loading not affected at any of these other origins when MCM levels were reduced? Are those 43% of origins in the "weak"binding category in terms of ORC? The rationale for eliminating so many origins from these analyses were not clear.

      7,Doesn't the data in Figure 4c at 0 mM auxin support the conclusion that differences in MCM ChIPsignals have negligible effects on origin activation time, in contrast to the publication by Das, 2015 from this lab? Or is the point that these origins are sensitive to reductions in MCM levels and the more sensitive they are the more delayed their replication time (but again, doesn't that have to be true? If they are losing MCM signals they cannot function as origins, so they are replicated passively and, by definition, will show delayed replication timing. An origin is defined as such by a loaded MCM complex.)

      8,I do not understand the conclusions from Figure 4d. There is an extremely small positive correlation between how much of an MCM signal is lost and delay in replication time of an origin, but this correlation is not surprising as an unlicensed origin cannot be an origin and will be replicated passively. What seems most surprising about these data is that the effect is so weak, not that it exists. There is quite a lot of scatter in this plot at 500 uM auxin, with some origins losing a given amount of signal (x) and being only slightly delayed in replication time, and others losing the same amount of signal (x) and being substantially delayed. What underlies this outcome?--Are the ones that are not substantially delayed closer to origins that have not been affected at all by MCM reductions? Why is the correlation so weak? The other regulators of origin activation time have stronger and more precise effects--for example the centromere-control can be precisely eliminated so that only the replication time of the centromere-proximal origins are delayed.

      9,Multiple studies in yeast and mammalian cells indicate that MCM subunits are in excess relative to other licensing and S-phase initiation factors, so it is not unexpected that over-expressing MCM did not lead to enhanced levels of licensing. It seems much more plausible that Cdc6 or Cdt1 or both factors are present in limiting amounts for MCM loading, so I did not understand the point of over-producing MCM subunits. If the "weak" origins are the ones that are most dramatically affected by reducing MCM to "limiting" levels, isn't the question whether you can increase licensing at these origins when you over-produce a factor that is likely limiting for licensing, such as Cdt1 or Cdc6 (or both) while leaving MCM at its normal levels. The fact that MCM levels are not limiting for licensing is not surprising and, if anything, argues against these levels having a regulatory role in origin activation timing---which seems to be the opposite of what the authors want to conclude.

      In summary, I think the technical aspects of the experiments were quite strong, but I do not think that the experiments answered the question that was posed by the authors.

      Minor points:

      Many places where "This data" should be changed to "These data". Data are plural.

      Significance

      Significance: see above

      Referees Cross Commenting

      Reviewer 3. My overall conclusions about this study are that the data are extremely nice and useful to the field, but that their potential to advance the field or clarify it for 'outsiders' are limited by 1, a biased. model-centric presentation that fails to put the work in context of a lot of strong previous work. Some of the conclusions cannot event be tested by the experimental design 2, some of the data analyses, for example the parsing of origins for analyses of MCM effects versus effects on replication time seem arbitrary and were not clearly justified. 3, The correlation between reductions in MCM loading and Trep delay seemed weak, even after parsing for origins expected to experience the largest effects, which is actually kind of interesting, but was ignored in favor of the pre-determined interpretation.

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      Summary:

      This is a nice study that characterizes the consequences of limiting or increasing Mcm expression on the replication program. Prior ChIP experiments in yeast have observed that not all origins exhibit the same level of Mcm enrichment and that increased mcm enrichment was correlated with origin activity. These observations led to two different models -- a) that multiple Mcm2-7 double hexamer complexes are loaded at some origins and b) a probabilistic model where the differential enrichment of Mcm2-7 reflected the fraction of cells in a population that had loaded the Mcm2-7 complex at a specific origin. While the titration experiments presented here don't provide any conclusive support for either model, they do provide some novel and relevant insights for the replication field, in part, due to the increased resolution and quantification afforded by the MNase ChIP-seq approach (and S. pombe spike in). The authors very nicely demonstrate that origins are differentially sensitive to Mcm2-7 depletion and that loss of Mcm2-7 loading results in an altered replication timing profile. The origins most impacted by loss of Mcm2-7 are 'weak' origins as described by the Fox group. Intriguingly, the authors find that the 5X overexpression of Mcm2-7 does not perturb the relative Mcm2-7 loading at individual origins, but rather instead globally represses Mcm2-7 association at all origins. They also find that overexpression of both Cdt1 and Mcm2-7 is detrimental to the cell (although no obvious replication phenotype was observed). Finally, the authors present a reasonable interpretation of their data in the context of models for replication timing which was very well articulated.

      Major Comments:

      From the methods it appears that different analyses were performed with different replicates?

      "Replicate #1 was used for all analyses except for V plots, for which the higher resolution Replicate #2 was used."

      Ideally all of the conclusions should be supported by all the replicates independently, or if the replicates are concordant -- they should be merged (at a similar sequencing depth) prior to doing the analyses.. Even the v-plots with merged replicates will be informative due to the greater sequencing depth.

      The authors should provide a separate analysis for the larger nucleosomal sized fragments and smaller putative MCM double hexamer fragments with regards to the Mcm loading and relationship to ACS and orientation. They may represent an interesting intermediate with mechanistic consequences for the interpretation.

      The authors should present the v-plots and an analysis of which side the Mcm's load for the overexpression studies. I was surprised that there was no further in-depth analysis for these two extremes. Perhaps similar conclusions will be reached, but it should at least be mentioned/presented as a supplementary figure.

      Minor Comments:

      This is largely semantic, but the majority of MNase ChIP-seq signal recovered is associated with the nucleosomes and not in the NDR and as the signal in the NDR is differentially sensitive to digestion, I would suggest rephrasing the following sentence:

      "In contrast to previous genome-wide reports (Belsky et al., 2015), but in agreement with recent in-vitro cryo-EM structures (Miller et al., 2019), we also observe MCM signal in the nucleosome-depleted region (NDR) of origins. "

      to :

      "In agreement with a previous genome-wide report (belsky 2015), we found that the bulk of the MCM signal was associated with nucleosomal sized fragments; however the increased resolution afforded by our approach allowed us to also detect protected fragments in the NDR as predicted by recent in vitro cryo em structures..."

      As a sanity check, please double check V-plots and presence of small fragments with the digestion conditions. In the Henikoff manuscript the bulk of sub-nucleosomal fragments were lost with the longer digestion time. Specifically, the TF footprints were more pronounced with minimal digestion. While it might be argued that the longer digestion more tightly resolved the binding site, in many cases they were completely lost with the 20 minute digestion. This is just a simple check -- I don't doubt the results as reported given the experimental conditions are very different. For example, the henikoff manuscript did not use cross linking or an antibody enrichment step.

      Last paragraph of the "MCM associates with nucleosomes section" which reports that the Mcm2-7 complex is loaded up or downstream from the ACS independent of orientation should cite Belsky 2015 (Figure 5 and discussion) for the initial observation.

      The authors argue that the global reduction in MCM loading associated with overexpression may be a technical artifact given that all origins exhibit a proportional reduction in mcm2-7 loading. However, this is exactly what the S. pombe spike in control is intended for. The relative difference between individual origins resulting from Mcm2-7 depletion would still be evident without the spike in. The authors do discuss different possibilities, but I would not be so keen to discard this as technical artifact.

      Significance

      This work has several advances that will be appreciated by the replication field -- including a high resolution view of Mcm2-7 loading in the context of chromatin; the impact of titrating (low and high) MCM expression on MCM loading and replication timing program; and a well reasoned discussion of how different models of MCM loading would impact origin activation and replication timing program. The work builds on prior studies in the field (eg. Belsky 2015), while some of the conclusions regarding the localization of the Mcm2-7 complex relative to the ACS and surrounding nucleosomes are confirmatory, the increased resolution provides new insight (like the enrichment of small fragments in the NDR) that could be further strengthened by additional analysis (see above).

      My expertise is DNA replication and chromatin.

    4. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      This manuscript follows on from previous work from the Rhind lab to investigate whether the load of MCMs at origins is a factor in when the origin activate (as a population average) during S phase. The authors use budding yeast and a auxin degron system to modulate the levels of an MCM subunit. This allows them to titrate down the concentration of the MCM hexamer and observe the effect. Crucially, they assay both the reduction in MCM load at origins and the subsequent replication dynamics in the same experiment. This is the power of their approach and allows them to rigorously test their hypothesis.

      Major comments

      1.I found the introductory paragraph discussing the Rhind lab hypothesis about the possibility of multiple MCM being loaded at origins somewhat misleading. The first paragraph of the discussion was much clear. However, I feel that the introductory paragraph should deal with the difference between the two proposals: 0-1 MCM-DH per origin (de Moura et al), vs 0-50+ MCM-DH (Yang et al). It s also important to note that Foss et al find that "In budding yeast, [MCM] complexes were present in sharp peaks comprised largely of single double-hexamers" - i.e. consistent with 0-1 MCM-DH per origin.

      To improve the balance of the introduction, I think the authors should briefly introduce the concepts behind the 0-1 MCM-DH per origin; this was defined as origin competence by Stillman and clearly described by McCune et al (2008; see figure 8) prior to the work from de Moura et al. Furthermore, in the discussion the authors should be more even-handed. To date there is no data to conclusively rule one way or the other in distinguishing between single vs multiple MCMs. The authors cite Lynch et al and state "overexpression of origin-activating factors in S phase causes most all origins to fire early in S phase, consistent with most origins having at least one MCM loaded". However, Lynch et al report equivalent (roughly equal) origin efficiencies, but the assay doesn't distinguish between all going up to high efficiency or all going to a lower intermediary efficiency. Given that fork factors (polymerases, etc) are likely to become limiting at some point (or checkpoints could be activated due to limited dNTP supplies) it would seem plausible that uniform origin efficiency could be a consequence of less than maximal origin firing. As part of this discussion it would be useful for the authors to include what conclusions have been reached on MCM load from in vitro systems (with chromatin substrates).

      2.The authors are not the first to look at the consequence of reduced MCM concentrations on origin function. This was essentially the basis for the MCM screen undertaken by Bik Tye's lab that first identified the MCM genes. In addition to temperature sensitive mutants, the Tye group also examined heterozygotes (Lei et al., 1996) to show differential effect on the ability of two origins to support plasmid replication. The authors finds are entirely consistent with these early studies, particularly since ARS416 (formerly ARS1) was found to highly sensitive to reduced MCM levels and ARS1021 (formerly ARS121) was found to be insensitive to MCM levels. The authors find a signifiant reduction in MCM load at ARS416, but the MCM load at ARS1021 is unaltered by reduced MCM concentration. It would be worth the authors noting this consistency. The authors do cite the Lei study, but not in this context. The original MCM screen was published here: Maine, G., Sinha, P., Tye, B. (1984). Mutants of S. cerevisiae defective in the maintenance of minichromosomes Genetics 106(3), 365 - 385. Furthermore, at the end of the discussion the authors state that "it will be interesting to dissect the specific cis- and trans-acting factors that make origins sensitive or resistant to changes in MCM levels". The equivalent effect reported by the Tye lab has already been dissected by the Donaldson lab (Nieduszynski et al., 2006) and perhaps it would be worth briefly mentioning their findings.

      3.The authors should show the flow cytometry data for each of their cell cycle experiments, if only in supplementary figures. This is important to allow a reader (and reviewer) to judge the level of synchrony achieved when interpreting the results.

      4.I think the authors should show the ChIP signal at some example origins, including ones sensitive and insensitive to the reduction in MCM concentration. Currently all the high resolution ChIP data (i.e. over 1400 bp, e.g. Fig 3a) is presented as meta-analyses of many origins.

      5.When describing the results in Fig 4a the authors focus on changes (highlighted in black boxes) that fit their expectation. However, there are other sites that should at least be mentioned that don't seem to fit the authors model, e.g. ARS517, ARS518. It would be worth discussing what fraction of the timing data can be explained by the reduced MCM load.

      Minor comments

      -These data, rather than this data (throughout).

      -the authors should clearly state in figure legends what window size has been used in analysing genomic data.

      -in figure 2a the authors show pairwise comparisons between conditions, it would be nice to see the 3rd pairwise comparisons perhaps as a supplementary figure

      -in figure 2c it would be clearer to use the same colour for the lines and the points

      -the authors should avoid the use of red/green colour combinations in their figures (see: https://thenode.biologists.com/data-visualization-with-flying-colors/research/)

      -in the text the authors state "ORC binding to the ACS and subsequent MCM loading is a directional process dependent on a ACS- site and a similar but inverted nearby sequence (Xu et al., 2006)". I think it would be more appropriate to cite the following study here: Coster, G., Diffley, J. (2017). Bidirectional eukaryotic DNA replication is established by quasi-symmetrical helicase loading Science (New York, NY) 357(6348), 314 - 318. https://dx.doi.org/10.1126/science.aan0063

      -the list of factors that influence replication timing should include Rif1, whereas it is less clear that Rpd3 acts within the unique genome (as opposed to indirectly via repetitive DNA, e.g. rDNA)

      -figure 4 - it might help to mark the centromere on panel a. Also, why do the ChIP peaks and annotated origins appear to line up so poorly?

      -figure 4d - would it not be better to use fraction of lost MCM signal on the x-axis as in previous figures?

      -"with galactose or raffinose, to induce or repress Mcm2-7 overexpression, respectively." This is incorrect, raffinose does not repress this promoter (that requires glucose).

      -the S. pombe spike in is a great addition to the over expression experiments. It's a shame that it wasn't included in the auxin experiments.

      -why does the data in fig 5d appear to be at much lower resolution that the previous ChIP data?

      -in the sequencing analysis pipeline for MCM ChIP the authors use a 650 bp upper size limit; why have such a large threshold compared to the size of a nucleosome? Are the analyses and findings sensitive to this size threshold?

      -the repliscope package was published here:

      Batrakou, D., Müller, C., Wilson, R., Nieduszynski, C. (2020). DNA copy-number measurement of genome replication dynamics by high-throughput sequencing: the sort-seq, sync-seq and MFA-seq family. Nature Protocols 15(3), 1255 - 1284. https://dx.doi.org/10.1038/s41596-019-0287-7

      Significance

      This work builds upon a body of work from the Rhind group (and others) to determine the contribution of MCM load to replication origin activation dynamics. To my mind this is the most convincing dataset and analysis to date and goes a long way to supporting the model that the efficiency of MCM loading is a major factor in determining the mean replication time of an origin. As the authors state, they are still not able to distinguish between two different models of MCM load (single vs multiple). It would be interesting for the authors to discuss how these two models could be distinguished in the future (perhaps with single cell/molecule experiments).

      This study will be of interest to those in the fields of DNA replication and genome stability.

      My field of expertise is DNA replication and replication origin function.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      *Reviewer #1 (Evidence, reproducibility and clarity (Required)):

      The manuscript by Abrams and Nance describes how the polarity proteins PAR-6 and PKC-3/aPKC promote lumen extension of the unicellular excretory canal in C. elegans. Using tissue-specific depletion methods they find that CDC-42 and the RhoGEF EXC-5/FGD are required for luminal localization of PAR-6, which recruits the exocyst complex required for lumen extension. Interestingly, they show that the ortholog of the mammalian exocyst receptor, PAR-3, is dispensable for luminal membrane extension. Overall, this is a well-written and interesting manuscript.*

      1.Because depletion of PAR-3 in the canal causes milder defects than PAR-6 or CDC-42 the authors suggest that they cannot rule out the possibility that an alternative isoform of PAR-3 is expressed and buffering the defect. They should perform canal-specific RNAi-mediated depletion of the entire PAR-3 gene to determine if this is true.

      We agree with Reviewer 1 that it would be useful to provide additional evidence that an alternative isoform of PAR-3 lacking the ZF1 degron is not expressed. While tissue-specific RNAi could be used, we have not been successful obtaining complete knockdown in previous tissue-specific RNAi experiments. Moreover, this approach does not target any maternal PAR-3 protein that may be inherited by the excretory cell. As an alternative approach to address this point, we will analyze par-3::zf1::yfp/par-3(null) worms following excretory-cell-specific expression of zif-1, and compare to par-3::zf1::yfp/par-3::zf1::yfp siblings. We would expect the excretory cell phenotype to become more severe if additional, ‘phenotype-buffering’ forms of PAR-3 were present, or if there was incomplete degradation of PAR-3::ZF1::YFP in our previous experiments.

      2.The authors suggest that GTP-loaded (activated) CDC-42 recruits PAR-6 to the luminal membrane. It would be nice if they could use a biosensor, such as the GBD-WSP-1 reagent from Buechner's lab to confirm that EXC-5 depletion also reduces activated CDC-42, as would be expected. This should be achievable since there is strong CDC-42 signal, even in the cytoplasm.

      This is an excellent suggestion. We will utilize a CDC-42 biosensor – an integrated cdc42p::gfp::wsp-1(gbd) strain created in our lab and previously validated and characterized (Zilberman et al. 2017). We have confirmed that the biosensor is detected in the excretory canal and appears enriched at or near the lumenal membrane. We will cross the biosensor into the exc-5::zf1::mScarlet background. This will allow us to assess lumenal enrichment, and using heat shock inducible ZIF-1, determine if there is a reduction in biosensor lumenal enrichment when EXC-5::ZF1::mScarlet is acutely degraded.

      If the biosensor is difficult to measure at the canal lumen, an alternative approach would be to use an available exc-5 null allele to examine genetically if cdc-42 and exc-5 are acting in the same pathway. We could cross CDC-42exc(-) larvae into exc-5(rh232) and quantify excretory canal phenotypes. If CDC-42 and EXC-5 are indeed functioning in the same pathway we would expect no enhancement of the CDC-42exc(-) phenotype.

      3.Related to point 2, (i) does mutation of the CRIB domain of PAR-6 impair its recruitment to the luminal membrane, and (ii) does this mutant exacerbate canal defects when PAR-3 is depleted?

      (i) Our lab has previously generated and characterized a transgenic par6P::par-6(**CRIB)::gfp strain (Zilberman et al., 2017). We will examine this strain to determine if expression is detectable in the excretory canal, and if so, we will compare lumenal enrichment of PAR-6(CRIB)::GFP to control worms expressing wild-type PAR-6::GFP.

      (ii) This is a very interesting experiment, as it would help address if the mild phenotype observed in PAR-3 depleted animals is due to the remaining PAR-6 that is recruited by CDC-42. Our lab has previously shown that par6P::par-6(**CRIB)::gfp cannot rescue the embryonic lethality of a par-6 mutant, in contrast to par-6::gfp (Zilberman et al. 2017). This indicates that the CRIB domain is needed for PAR-6 function during embryogenesis and suggests that CRIB domain mutations introduced by CRISPR would almost certainly be lethal, precluding analysis of the excretory cell.

      As an alternative experiment, we would determine if PAR-3 localizes to the lumenal membrane independently of CDC-42; such a finding would imply that PAR-3 and CDC-42 likely have independent contributions to PAR-6 localization (rather than CDC-42 promoting PAR-6 localization by localizing PAR-3). To do this, we will degrade ZF1::YFP::CDC-42 in the excretory cell and examine the localization of PAR-3::mCherry compared to controls. We have all of the strains needed for this experiment.

      4.The authors hypothesize that partial recruitment of PAR-6 by CDC-42 is sufficient for luminal membrane extension to explain the mild defects caused by PAR-3 depletion. Since depletion of PAR-6 and CDC-42 alone causes milder canal truncations the authors should co-deplete these proteins (as well as PAR-3 and CDC-42) to determine if there is an additive effect.

      This is an excellent suggestion in principal. However, it is not possible to know in any given degradation experiment whether the targeted protein is completely degraded; we can only say it is no longer detectable by fluorescence. Thus, any degron allele (in the presence of ZIF-1) could behave like a strong hypomorph rather than a null. It would not be possible to interpret double degradation experiments in such a case, as a more severe phenotype in the double could simply be a result of combining two hypomorphic alleles, further reducing pathway activity even if the genes function together in the same pathway. To interpret this experiment properly, a null allele of at least one of the genes would have to be used. This is not possible since par and cdc-42 null mutants are lethal and there is also maternal contribution. As an alternative to these double depletion experiments, we will deplete PAR-6::ZF1::YFP or PAR-3::ZF1::YFP in exc-5 null mutant larvae, as unlike cdc-42, exc-5 is not an essential gene.

      5.In figure 2, the authors show that depletion of PKC-3 causes more severe canal truncations than PAR-6. Since these proteins function in the same complex what do they think is the reason for this difference? This point could be discussed more in the manuscript.

      As described in the previous point, incomplete degradation could produce modestly different phenotypes even for genes that act in the same pathway. Therefore, it is not possible to determine whether PAR-6 and PKC-3 have different roles using this approach. We will add text to the discussion bringing up this point.

      6.Related to point 5, more experiments with PKC-3 should be done to determine if, for example, localization of SEC-10 is similarly affected as ablation of PAR-3, PAR-6 and CDC-42.

      We agree, and will address this point by acutely degrading ZF1::GFP::PKC-3 and examining transgenic SEC-10::mCherry, as we have done for other par genes.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)): The manuscript by Abrams & Nance describes a precise investigation of the role of PAR proteins in the recruitment of the exocyst during and after the extension of the C. elegans excretory canal. State-of-the-art genetic techniques are used to acutely deplete proteins only in the targeted cell, and examine the localization of endogenously expressed markers. Experiments are well described and carefully quantified, with systematic statistical analysis. The manuscript is easy to follow and the bibliography is very good. Most conclusions are well supported.

      1) I am not entirely convinced by the presence of CDC-42 at the lumenal membrane (Fig3G); it seems to be more sub-lumenal that really lumenal. It peaks well before PAR-6 (Fig3H) which itself seem slightly less apical that PAR-3 (Fig3F). Could you use super-resolution microscopy (compatible with endogenous expression levels) to more precisely localize CDC-42? Similar point for PAR-3 and PAR-6 which do not seem to colocalize completely - a longitudinal line scan along the lumenal membrane might provide the answer even without super-resolution; this could help explain why these two proteins do not have the same function. These suggestions are easy to do provided the authors can have access to super-resolution (Airyscan to name it; although other methods will be perfectly acceptable I believe it is the most simple one).

      We agree that the CDC-42 localization peak does not precisely match the PAR-6 peak. As the reviewer notes, resolving the subcellular localization of these two proteins will not be feasible using standard confocal microscopy. We will image the ZF1::YFP::CDC-42; PAR-6:mKate strain using a Zeiss LSM 880 with Airyscan to determine if their subcellular localization patterns are distinct.

      To examine PAR-3 and PAR-6 colocalization at the lumen, we will acquire additional confocal images of the PAR-6-ZF1-YFP; PAR-3-mCherry strain and examine colocalization of the clusters along the lumenal membrane. As a positive control for two proteins that should co-localize, we will image ZF1::GFP::PKC-3; PAR-6-mKate; these two proteins bind directly and co-localize in nearly all cells in which they have been examined.

      2) The same group has described a CDC-42 biosensor to detect its active form. It could be used here to precisely pinpoint where active CDC-42 is required: in the cytoplasm? At the lumenal membrane? colocalizing with what other protein? This will require the expression of a transgene under an excretory cell specific promotor and a simple injection strategy while helping to strengthen the description of the CDC-42 role.

      See Reviewer 1 point #2.

      3) As the authors certainly know, there is a PAR-6 mutation which prevents its binding to CDC-42. They could express this construct in the excretory canal a simple extrachromosomal array should be sufficient) to validate the direct interaction between these proteins in this cell.

      See Reviewer 1 point #3.

      4) What is the lethality of ZIF-1-mediated depletion of the various factors under the exc promoter? Can homozygous strains be maintained? Authors just have to add a sentence in the Mat&Met section.

      All of the strains with excretory cell-specific degradation we have examined are viable when grown on NGM plates. We will add this point to the materials and methods.

      Provided that the authors have access to an Airyscan, all the questions asked here can be answered in two months (one month for constructs, one month for injection and data analysis) at a very minor cost.

      Reviewer #3 (Evidence, reproducibility and clarity (Required)):

      Strengths of this manuscript include the use of endogenously tagged proteins (rather than over-expressed transgenes) for high resolution imaging and a cell-type specific acute depletion strategy that avoids complicating pleiotropies and allows tests of molecular epistasis. While some results were fairly expected based on prior studies of Cdc42, PAR proteins, and the exocyst in other tissues or systems, differences in the requirements for par-6 and pkc-3 vs. par-3 strongly suggest that the former genes play more important roles in exocyst recruitment. I was also excited to see a connection made between EXC-5 and PKC-3 localization.

      1.Lumen formation vs. lumen extension. The abstract and introduction use these two terms almost interchangeably, but they are not the same and more care should be taken to avoid the former term. The data here do not demonstrate any roles for par or other genes in lumen formation, but do demonstrate roles in lumen extension and organization/shaping.

      We agree and will correct wording to indicate that lumen extension is affected.

      2.Related to the above, mutant phenotypes here are surprisingly mild and variable. The authors discuss possible reasons for the particularly mild phenotype of par-3 mutants, but don't specifically address the mild phenotypes of the others. Clearly quite a bit of polarization and apical membrane addition occurs in ALL of the mutants. Is this because those early steps use other/redundant molecular players, or is depletion too late or incomplete to reveal an early role?

      We agree with Reviewer 3 and will bring up these points in the discussion. Degradation of proteins strongly predicted to function together (RAL-1 and SEC-5; PAR-6 and PKC-3) produce similar although not identical phenotypes; as discussed above we consider it likely that these differences reflect minor differences in degradation efficiency below our ability to detect by fluorescence. As Reviewer 3 points out, the excretory-specific driver we use to express ZIF-1 may not be active at the very earliest stages of lumen formation, and degradation could take 45 minutes or more after the promoter becomes active (Armenti et al, 2014). Thus, we agree that phenotypes could be more severe if it were possible to completely deplete each tagged protein prior to the onset of lumen formation. However, this caveat does not change the interpretations of our experiments since all proteins are degraded with the same driver. We have avoided mentioning that the phenotypes we observe reflect the ‘null’ phenotype for these reasons. We will emphasize these points in the discussion.

      The authors introduce a new reagent, "excP" (the promoter for T28H11.8), which they use to drive canal cell expression of ZIF-1 for their degron experiments. Please provide more information about when in embryogenesis this promoter becomes active, how that compares to when the par genes, sec-5, ral-1 and cdc-42 are first expressed, and what canal length is at that time. It would also be helpful to show the timeframe for degron-based depletion using this reagent (Figure 1C shows only depletion at L4, days later).

      Publicly available single cell RNA seq data (https://pubmed.ncbi.nlm.nih.gov/31488706/ and https://cello.shinyapps.io/celegans_explorer/) suggest that canal expression of the endogenous T28H11.8 gene doesn't really ramp up until the 580-650 minute timepoint, which is several hours after par gene canal expression (270-390 minutes) and the initiation of canal lumen formation (bean stage, 400-450 minutes). These data suggest that excP might come on too late to test requirements in lumen formation and early stages of extension. This caveat should be at least mentioned.

      See point #2 above. We agree that providing more information on expression from the T28H11.8 promoter would be important for interpreting the severity of phenotypes. We will raise this point in the discussion, and include existing published expression data and a more detailed analysis of the excP::mCherry transgene.

      3.There are two major aspects to the mutant phenotypes observed here: short lumens and cystic lumens. A short lumen makes sense intuitively, but the cysts could use a little more explanation. (What are cysts? What is thought to be the basis of their formation?). It is intriguing that cysts in sec-5 vs. ral-1 mutants (Figure 1) and par-6 vs. pkc-3 mutants (Figure 4) seem to have a very different size and overall appearance. Are these consistent differences, and if so, what could be the explanation for them?

      This is an interesting point. Since it is not practical to perform time-lapse imaging to watch canal cysts form, we analyzed only L1 and L4 larvae. We believe from our imaging that these are discontinuous regions of the lumen. One explanation for the expansion and dilation of the cystic lumens by L4 stage could be that the canal lumen has been expanded by fluid buildup resulting from a defect in canal function in osmoregulation, but we have not tested this directly. The reviewer also raises an interesting point regarding different appearances of cysts in SEC-5 and RAL-1 depleted larvae compared to PAR-6 and PKC-3. It is possible that these differences arise because SEC-5 and RAL-1 might direct whether vesicles will fuse at all, whereas PAR proteins direct where they will fuse in the cell (i.e. there could be fusion at basal surfaces, or just reduced apical fusion). We will bring up these points in the discussion.

      4.The authors did not test if PKC-3, like PAR-6, is required to recruit exocyst to the canal cell apical membrane, but their prior studies in the embryo suggested that it is (Armenti et al 2014). They also did not test if EXC-5 is required to recruit PAR-6 and the exocyst (along with PKC-3), or if CDC-42 is required to recruit PKC-3 (along with PAR-6). There seems to be an assumption that PAR-6 and PKC-3 are regulated and function in a common manner (as is often the case), but that has not been demonstrated here specifically. The basis for this assumption and alternatives to the linear model should be acknowledged.

      As discussed above (Reviewer 1 point #6), we will directly test whether PKC-3 is required to recruit SEC-10::mCherry to the lumenal membrane. We agree with Reviewer 3 that we have not shown that PAR-6 and PKC-3 always function similarly, although this is expected based on their similar phenotypes and co-dependent functions in other cells. We will mention this caveat in the discussion.

      5.EXC-5 is presumed to act upstream of CDC-42 based on shared phenotypes and the known Rho GEF activity of its mammalian homologs. However, direct evidence for this is currently lacking. In future, the authors might test if depleting EXC-5 affects CDC-42 activation/GTP-loading by using CDC-42 biosensors that have been reported in the literature (e.g. Lazetic et al 2018).

      See Reviewer 1 point #2.

      \*Minor comments:** Figure 1, Figure 4, Figure S3, Figure S4 Blue color/CFP indicates the apical/luminal membrane or the apical region of the canal cytoplasm, not the actual lumen as the labels suggest. The lumen is a hollow cavity on the opposite side of the plasma membrane from these markers, and it is shown as white in the Figure 1A upper right cartoon.*

      Thank you for pointing this out. We will correct the figure labelling.

      Figure 2, Figure S2 I'm not confident in the statistical analysis used here (Fisher's Exact test on two bins, 50% canal length), given that four length bins (not two) were defined. I recommend consulting a statistician.

      Our rationale for using two bins for the statistical analysis was because control larvae nearly all have a similar canal length (L1 stage: 99% of larvae have canal length that is 51-75% of body length; L4 stage: 98% of larvae have canal length that is 76-100% of body length), making it straightforward to ask if mutants are shorter. We chose not to make more granular phenotypic comparisons, as we cannot rule out that subtle differences in degradation efficiency, rather than differences in biological function, underlie any differences in canal length of the degron mutants. We will consult with a statistician to determine if this is an acceptable way to statistically compare controls and mutants.

      p.3 "Born during late embryogenesis..." Actually, the canal cell is born at ~270 minutes after first cleavage, which is in the first half of embryogenesis, not what I would call "late".

      We agree and will correct the wording.

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      Summary:

      The C. elegans excretory canal cell is a classic model for studying single cell tubulogenesis, where a cell establishes an intracellular apical domain that extends to form a lumen. Prior studies in this system have identified a set of gene products that localize to the growing apical domain and/or are important for its organization and size, but the molecular pathways through which these various gene products act remain poorly understood. Here, Abrams and Nance are able to connect the dots among several of these to flesh out a pathway for apical membrane addition. Specifically, they demonstrate that CDC-42 is needed to recruit PAR-6, and that PAR-6 is needed to recruit the exocyst to the apical membrane and to promote proper apical membrane growth and organization. EXC-5, a candidate GEF for CDC-42, also appears to act in this pathway.

      Strengths of this manuscript include the use of endogenously tagged proteins (rather than over-expressed transgenes) for high resolution imaging and a cell-type specific acute depletion strategy that avoids complicating pleiotropies and allows tests of molecular epistasis. While some results were fairly expected based on prior studies of Cdc42, PAR proteins, and the exocyst in other tissues or systems, differences in the requirements for par-6 and pkc-3 vs. par-3 strongly suggest that the former genes play more important roles in exocyst recruitment. I was also excited to see a connection made between EXC-5 and PKC-3 localization.

      Major comments:

      1.Lumen formation vs. lumen extension. The abstract and introduction use these two terms almost interchangeably, but they are not the same and more care should be taken to avoid the former term. The data here do not demonstrate any roles for par or other genes in lumen formation, but do demonstrate roles in lumen extension and organization/shaping.

      2.Related to the above, mutant phenotypes here are surprisingly mild and variable. The authors discuss possible reasons for the particularly mild phenotype of par-3 mutants, but don't specifically address the mild phenotypes of the others. Clearly quite a bit of polarization and apical membrane addition occurs in ALL of the mutants. Is this because those early steps use other/redundant molecular players, or is depletion too late or incomplete to reveal an early role?

      The authors introduce a new reagent, "excP" (the promoter for T28H11.8), which they use to drive canal cell expression of ZIF-1 for their degron experiments. Please provide more information about when in embryogenesis this promoter becomes active, how that compares to when the par genes, sec-5, ral-1 and cdc-42 are first expressed, and what canal length is at that time. It would also be helpful to show the timeframe for degron-based depletion using this reagent (Figure 1C shows only depletion at L4, days later).

      Publicly available single cell RNA seq data (https://pubmed.ncbi.nlm.nih.gov/31488706/ and https://cello.shinyapps.io/celegans_explorer/) suggest that canal expression of the endogenous T28H11.8 gene doesn't really ramp up until the 580-650 minute timepoint, which is several hours after par gene canal expression (270-390 minutes) and the initiation of canal lumen formation (bean stage, 400-450 minutes). These data suggest that excP might come on too late to test requirements in lumen formation and early stages of extension. This caveat should be at least mentioned.

      3.There are two major aspects to the mutant phenotypes observed here: short lumens and cystic lumens. A short lumen makes sense intuitively, but the cysts could use a little more explanation. (What are cysts? What is thought to be the basis of their formation?). It is intriguing that cysts in sec-5 vs. ral-1 mutants (Figure 1) and par-6 vs. pkc-3 mutants (Figure 4) seem to have a very different size and overall appearance. Are these consistent differences, and if so, what could be the explanation for them?

      4.The authors did not test if PKC-3, like PAR-6, is required to recruit exocyst to the canal cell apical membrane, but their prior studies in the embryo suggested that it is (Armenti et al 2014). They also did not test if EXC-5 is required to recruit PAR-6 and the exocyst (along with PKC-3), or if CDC-42 is required to recruit PKC-3 (along with PAR-6). There seems to be an assumption that PAR-6 and PKC-3 are regulated and function in a common manner (as is often the case), but that has not been demonstrated here specifically. The basis for this assumption and alternatives to the linear model should be acknowledged.

      5.EXC-5 is presumed to act upstream of CDC-42 based on shared phenotypes and the known Rho GEF activity of its mammalian homologs. However, direct evidence for this is currently lacking. In future, the authors might test if depleting EXC-5 affects CDC-42 activation/GTP-loading by using CDC-42 biosensors that have been reported in the literature (e.g. Lazetic et al 2018).

      Minor comments:

      Figure 1, Figure 4, Figure S3, Figure S4 Blue color/CFP indicates the apical/luminal membrane or the apical region of the canal cytoplasm, not the actual lumen as the labels suggest. The lumen is a hollow cavity on the opposite side of the plasma membrane from these markers, and it is shown as white in the Figure 1A upper right cartoon.

      Figure 2, Figure S2 I'm not confident in the statistical analysis used here (Fisher's Exact test on two bins, <50% and >50% canal length), given that four length bins (not two) were defined. I recommend consulting a statistician.

      p.3 "Born during late embryogenesis..." Actually, the canal cell is born at ~270 minutes after first cleavage, which is in the first half of embryogenesis, not what I would call "late".

      Significance

      Polarized plasma membrane addition is critical for the development of epithelial tissues, so understanding the mechanisms that control this is of broad interest to many cell and developmental biologists. This study will be of particularly high interest to researchers working on PAR proteins, the exocyst, or single cell tube development.

      The results here add to the existing body of evidence for PAR-dependent recruitment of exocyst to expanding apical/luminal surfaces (e.g. Bryant et al 2010; Jones et al 2011, 2014; Armenti et al 2014) and to evidence for key functional distinctions between PAR-6 & PKC-3 vs. PAR-3 (e.g. Achilleos et al 2010; Jones et al 2014). The results here are more robust than in those prior studies and more clearly illustrate directionality due to the authors' acute depletion strategy, which avoids major tissue disruptions that could secondarily affect protein localization.

      expertise keywords: C. elegans, epithelia, tubulogenesis

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      The manuscript by Abrams & Nance describes a precise investigation of the role of PAR proteins in the recruitment of the exocyst during and after the extension of the C. elegans excretory canal. State-of-the-art genetic techniques are used to acutely deplete proteins only in the targeted cell, and examine the localization of endogenously expressed markers. Experiments are well described and carefully quantified, with systematic statistical analysis. The manuscript is easy to follow and the bibliography is very good. Most conclusions are well supported.

      I only have a few minor questions or remarks:

      1) I am not entirely convinced by the presence of CDC-42 at the lumenal membrane (Fig3G); it seems to be more sub-lumenal that really lumenal. It peaks well before PAR-6 (Fig3H) which itself seem slightly less apical that PAR-3 (Fig3F). Could you use super-resolution microscopy (compatible with endogenous expression levels) to more precisely localize CDC-42? Similar point for PAR-3 and PAR-6 which do not seem to colocalize completely - a longitudinal line scan along the lumenal membrane might provide the answer even without super-resolution; this could help explain why these two proteins do not have the same function. These suggestions are easy to do provided the authors can have access to super-resolution (Airyscan to name it; although other methods will be perfectly acceptable I believe it is the most simple one).

      2) The same group has described a CDC-42 biosensor to detect its active form. It could be used here to precisely pinpoint where active CDC-42 is required: in the cytoplasm? At the lumenal membrane? colocalizing with what other protein? This will require the expression of a transgene under an excretory cell specific promotor and a simple injection strategy while helping to strengthen the description of the CDC-42 role.

      3) As the authors certainly know, there is a PAR-6 mutation which prevents its binding to CDC-42. They could express this construct in the excretory canal a simple extrachromosomal array should be sufficient) to validate the direct interaction between these proteins in this cell.

      4) What is the lethality of ZIF-1-mediated depletion of the various factors under the exc promoter? Can homozygous strains be maintained? Authors just have to add a sentence in the Mat&Met section.

      Provided that the authors have access to an Airyscan, all the questions asked here can be answered in two months (one month for constructs, one month for injection and data analysis) at a very minor cost.

      Significance

      The reviewer has an expertise in cell polarity and membrane trafficking, using C. elegans as a model.

      The manuscript by Abrams & Nance describes a precise investigation of the role of PAR proteins in the recruitment of the exocyst during and after the extension of the C. elegans excretory canal. The interactions between these factors have already been examined in a number of models and contexts. In particular it follows a previous study from the same group (Armenti et al, Dev Biol, 2014) which established that the exocyst and RAL-1 controls polarized secretion in this model, and that PAR proteins are required for the polarized localization of the exocyst, but using the early embryo. This new manuscript is entirely focused on the excretory canal and 1) confirms the previous results, and 2) significantly extends them by precisely dissecting the role of CDC-42 and the apical PAR proteins. It will be of interest to researchers investigating the links between polarity and membrane trafficking with the description of a molecular cascade required for membrane trafficking in the context of a single-cell tube.

    4. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      The manuscript by Abrams and Nance describes how the polarity proteins PAR-6 and PKC-3/aPKC promote lumen extension of the unicellular excretory canal in C. elegans. Using tissue-specific depletion methods they find that CDC-42 and the RhoGEF EXC-5/FGD are required for luminal localization of PAR-6, which recruits the exocyst complex required for lumen extension. Interestingly, they show that the ortholog of the mammalian exocyst receptor, PAR-3, is dispensable for luminal membrane extension. Overall, this is a well-written and interesting manuscript.

      Major comments

      1.Because depletion of PAR-3 in the canal causes milder defects than PAR-6 or CDC-42 the authors suggest that they cannot rule out the possibility that an alternative isoform of PAR-3 is expressed and buffering the defect. They should perform canal-specific RNAi-mediated depletion of the entire PAR-3 gene to determine if this is true.

      2.The authors suggest that GTP-loaded (activated) CDC-42 recruits PAR-6 to the luminal membrane. It would be nice if they could use a biosensor, such as the GBD-WSP-1 reagent from Buechner's lab to confirm that EXC-5 depletion also reduces activated CDC-42, as would be expected. This should be achievable since there is strong CDC-42 signal, even in the cytoplasm.

      3.Related to point 2, (i) does mutation of the CRIB domain of PAR-6 impair its recruitment to the luminal membrane, and (ii) does this mutant exacerbate canal defects when PAR-3 is depleted?

      4.The authors hypothesize that partial recruitment of PAR-6 by CDC-42 is sufficient for luminal membrane extension to explain the mild defects caused by PAR-3 depletion. Since depletion of PAR-6 and CDC-42 alone causes milder canal truncations the authors should co-deplete these proteins (as well as PAR-3 and CDC-42) to determine if there is an additive effect.

      5.In figure 2, the authors show that depletion of PKC-3 causes more severe canal truncations than PAR-6. Since these proteins function in the same complex what do they think is the reason for this difference? This point could be discussed more in the manuscript.

      6.Related to point 5, more experiments with PKC-3 should be done to determine if, for example, localization of SEC-10 is similarly affected as ablation of PAR-3, PAR-6 and CDC-42.

      Significance

      This manuscript builds off their previous work on the role of the exocyst in excretory canal extension and in our view represents an important advance that is relevant to biological tube development across phyla. Therefore, this work should be of interest to biologists studying tubulogenesis in many different model systems.

      My areas of expertise include model organism genetics, biological tube development, and biochemistry.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      We are grateful to Review Commons for the opportunity to get valuable comments on our manuscript “Trim39 regulates neuronal apoptosis by acting as a SUMO-targeted E3 ubiquitin-ligase for the transcription factor NFATc3”. We would like to acknowledge the very nice and constructive reviews that our manuscript received. We found all of the reviewer comments well founded and we are taking them into careful consideration in preparing the revised version. We are currently performing additional experiments to address the questions raised by the reviewers. We are not yet able to provide a revised version of the manuscript, but you will find below our response to the reviewers and our plan of revision. It is difficult to anticipate exactly how much time we will need to get the requested results and to prepare a complete revised version, as it will depend on whether we can work normally and whether we encounter technical problems. However, it should be possible within a few months.

      Reviewer #1

      **Summary:**

      Desagher and co-workers investigate the regulation of the NFAT family member NFATc3, a transcription factor in neurons with a pro-apoptotic role. They identify TRIM39 as a ubiquitin E3 ligase regulating NFATc3. They demonstrate that TRIM39 can bind and ubiquitinate NFATc3 in vitro and in cells. They identify a critical SUMO interaction motif in TRIM39, that is required for its interaction with NFATc3 and for its ability to ubiquitinate NFATc3. Moreover, mutating sumoylation sites in NFATc3 reduces the interaction with TRIM39 and reduces its ubiquitination. Silencing TRIM39 increases the protein levels of NFATc3 and its transcriptional activity, leading to apoptosis of neurons. TRIM17 modulates the TRIM39-NFATc3 axis. Combined, TRIM39 appears to be a SUMO-targeted ubiquitin ligase (STUbL) for NFATc3 in neurons.

      **Major points:**

      1.This manuscript containing two stories: the rather exciting story that TRIM39 is a STUbL for NFATc3 (as mentioned in the title) and the second less exciting story: TRIM17 modulates the regulation of NFATc3 by TRIM39. These stories are now mixed in a confusing manner, disrupting the flow of the first story. It would be better to focus the current manuscript on the first story and strengthen it further and develop the second story in a second manuscript.

      We understand that the reviewer is more interested in the part of our manuscript related to the characterization of Trim39 as a STUbL due to his/her field of expertise. However, the two other reviewers are also interested in the other parts of our work. Notably the third reviewer would like us to highlight the physiological importance of our findings. Indeed, the main goal of this article is to describe the mechanisms regulating the stability of the transcription factor NFATc3. Trim17 plays a role in this regulation by inhibiting Trim39. It is particularly important for understanding the impact of these mechanisms on neuronal apoptosis as Trim17 is induced in these conditions. As we want to reach a wide audience, we prefer not to focus our manuscript on the identification of a new STUbL. However, we agree with the reviewer that it would be very interesting to strengthen this part of our work and we are grateful for his/her suggestions.

      2.Whereas the cellular experiments to indicate that TRIM39 acts as a STUbL are properly carried out, the observed effects are not necessarily direct. Direct evidence that TRIM39 is indeed a STUbL for sumoylated NFATc3 needs to be obtained in vitro, using purified recombinant proteins. Does TRIM39 indeed preferentially ubiquitinate sumoylated NFATc3? Is ubiquitination reduced for non-sumoylated NFATc3? Is ubiquitination of sumoylated NFATc3 dependent on SIM3 of TRIM39? Do other SIMs in TRIM39 contribute?

      We agree with the reviewer that additional in vitro experiments using purified recombinant proteins would strengthen the characterization of Trim39 as a STUbL. In order to answer the specific questions of the reviewer, we propose to perform in vitro ubiquitination using different forms of GST-Trim39 (WT/mSIM3/mSIM1&2) following in vitro SUMOylation (or not) of NFATc3 produced by TnT (wheat germ) and purified by immunoprecipitation. Preliminary results using WT Trim39 show that indeed the in vitro ubiquitination of NFATc3 is improved by prior in vitro SUMOylation. We have to confirm these results and to test the SIM mutants of Trim39 in the same conditions.

      3.Rule out potential roles for other STUbLs by including control knockdowns of RNF4 and RNF111 and verify the sumoylation of NFATc3 and ubiquitination of wildtype and sumoylation-mutant NFATc3.

      Our data show that silencing of Trim39 deeply decreases the ubiquitination level of NFATc3 in Neuro2A cells, indicating that Trim39 plays a major role in this process. We agree that this does not exclude the possible involvement of other STUbLs in NFATc3 ubiquitination in this model but their potential contribution would be limited. This point will be better addressed in the discussion.

      4.Figure 6B: use SUMO inhibitor ML-792 to demonstrate that ubiquitination of wildtype NFATc3 by TRIM39 is dependent on sumoylation.

      We thank the reviewer for suggesting this experiments that can easily improve the strength of our demonstration. Our preliminary results indeed indicate that in vivo ubiquitination of NFATc3 by Trim39 is strongly decreased following treatment with the SUMO inhibitor ML-792. We have to confirm these results.

      **Minor points:**

      5.Figure 1A and B: demonstrate by immunoprecipitation and Western that the endogenous counterparts indeed interact.

      We are currently setting the conditions to immunoprecipitate endogenous NFATc3 and Trim39 in order to demonstrate that they indeed interact.

      6.Figure 1C and 1E: Quantify the PLA results properly and perform statistics.

      We will perform these quantification and statistical analysis as requested.

      7.Figure 2B: Correct unequal loading of samples.

      We agree with the reviewer (as with reviewer #2) that the blots showing the total lysates of this experiment are confusing. As mentioned in the legend, some material has been lost during the TCA precipitation resulting in unequal loading. However, these experiments have been performed a very long time ago and we do not have the protein extracts anymore. We are currently trying to produce efficient shRNA-expressing lentiviruses to reproduce this experiment and provide a better figure.

      8.Figure 6B: proper statistics are needed here from at least three independent experiments.

      The reviewer is right. Statistics are needed to reinforce the significance of these results. We have quantified three independent experiments and made graphs and statistics that will be presented in the revised version of the manuscript. They better support our conclusion.

      Reviewer #1 (Significance (Required)):

      Humans have over 600 different ubiquitin E3s. Currently, RNF4 and RNF111 are the only known human SUMO-Targeted Ubiquitin Ligases (STUbLs). Here, the authors present evidence that the ubiquitin E3 ligase TRIM39 is a STUbL for sumoylated NFATc3. Identification of a new STUbL is an exciting finding for the ubiquitin and SUMO field and for the field of ubiquitin-like signal transduction in general, but needs to be strengthened as outlined above. My field of expertise is SUMO and ubiquitin signal transduction.

      Reviewer #2

      In this manuscript, the authors analyze the effect of TRIM39, a ubiquitin E3 ligase, on NFATc3, a transcription factor that regulates apoptosis in the nervous system. The authors show that TRIM39 can promote the ubiquitination of NFATc3 and regulate its half-life. Furthermore, ubiquitination depends on the SUMOylation state of NFATc3, which suggests that TRIM39 could be a new example of SUMOylation-dependent ubiquitin ligase or STUbL. **In addition, the authors show that TRIM17 interferes with TRIM39 ubiquitination, representing a new regulatory level for NFATc3 degradation. This has consequences on the regulation of apoptosis in cells derived from the nervous system.

      The authors show well-controlled, sound results for the most part. The manuscript is well written, and argumentation is convincing. Given the fact that only 2 STUbLs were previously characterized in mammals, the results are relevant and represent an advance in the field. Overall, this is a nice piece of work. Here are some comments.

      **Major comments**

      -In Fig. 2B, the levels of material loaded are uneven, which difficult the interpretation.

      We agree with the reviewer (as with reviewer #1) that the blots showing the total lysates of this experiment are confusing. As mentioned in the legend, some material has been lost during the TCA precipitation, resulting in unequal loading. In the other experiments, we have the same problem or the background is too high. We are currently trying to produce efficient shRNA-expressing lentiviruses to reproduce this experiment and provide a better figure.

      However, it seems that the control shRNA also has an effect on NFATc3 ubiquitination, which should not be the case.

      It is true that, in the present figure, the ubiquitination signal is decreased in cells transduced with the control shRNA. However, this is likely due to reduced expression of transfected NFATc3 following lentiviral infection, as it can be seen on the western blot of total lysates.

      Also, by reducing ubiquitination by TRIM39, shouldn't you expect an increase in the levels of NFATc3, if this ubiquitination was driving degradation? The authors do not specify whether those cells were treated or not with proteasomal inhibitor.

      We agree that an increase in the protein level of NFATc3 is expected following silencing of Trim39. However, in the assay presented in Figure 2B, NFATc3 is transfected and the part of overexpressed NFATc3 that is ubiquitinated by endogenous Trim39 is certainly low. Therefore, silencing of Trim39 cannot have a visible impact on the total protein level of NFATc3.

      Indeed, cells were treated with proteasome inhibitor. It is mentioned in the legend of Figure 2A. To avoid repeating it in the legend of Figure 2B, we just wrote that, after 24h transfection, cells were treated as in A, with includes MG-132 treatment for 6h.

      Same applies in Figure 4B, where no reduction in NFATc3 are seen after including TRIM39 in the reaction (beyond the fact that it looks reduced because the presence of ubiquitinated forms).

      In Figure 4B, the reaction of ubiquitination is performed in an acellular medium with purified recombinant proteins. Although NFATc3 is produced by in vitro transcription/translation in wheat germ extract, it is purified by immunoprecipitation before in vitro ubiquitination. Therefore, the reaction does not contain any proteasome and NFATc3 should not be degraded following its ubiquitination by TRIM39.

      -After the experiments in vitro shown in Fig. 2C, the authors conclude that the NFATc3 is a direct substrate of TRIM39. I think the authors used the right approach by using bacterially produced GST-TRIM39 for the ubiquitination reaction. However NFATc3 is produced by an in vitro transcription-translation system, which could in principle provide other contaminant proteins to the reaction. Did the authors try to use bacterially produced NFATc3? This might be difficult in the case of big proteins, in which case the authors could add some caution note in the text. Same applies in Figure 4B.

      The reviewer is right. It would have been preferable to use NFATc3 produced in bacteria. Indeed, we started with this approach. However, it was very difficult to get NFATc3 expressed in bacteria, and when we succeeded, most of the protein was degraded. We tried different protease inhibitor cocktails and we used a strain of bacteria (BL21-CodonPlus(DE3)-RP) that is mutated on the genes coding for the proteases Lon and OmpT and is further engineered to express tRNAs that are often limiting when expressing mammalian proteins. Unfortunately, this did not improve our production enough.

      We agree that, in principle, in vitro transcription-translation (TnT) systems can include contaminant proteins. However, we used wheat germ extract to produce NFATc3 by TnT. Moreover, we immunopurified NFATc3 from the TnT reaction prior to the ubiquitination reaction. The probability that proteins modifying NFATc3 are expressed in plants and are co-purified with NFATc3 is low. Nevertheless, we will discuss this point in the result section of the revised version of the manuscript, when describing results of Figure 2B and 4B.

      -In Fig. 6B, higher levels of ubiquitination in the different SUMOylation mutants are shown. Is this effect consistent? How this can be explained?

      We are grateful to the reviewer for pointing out this inconsistency in our manuscript. It will be corrected. Indeed, the values indicated in red in Figure 6B are confusing and are certainly not consistent. We calculated them by normalizing the intensity of the ubiquitination signal by the intensity of NFATc3 in total lysates, which seems to have introduced a bias. Variations in NFATc3 levels are probably responsible for the artificially higher levels of ubiquitination for different SUMOylation mutants after normalization. When quantifying three independent experiments, as requested by reviewer #1, we realized that results are much more consistent without normalization. Therefore, in the revised version of manuscript, we will add a graph showing the average and standard deviation of three independent experiments quantified without normalization. We will also replace the experiment currently presented in Figure 6B by another one in which the levels of NFATc3 show lower variations in the total lysates.

      In addition, variations in the levels of NFATc3 are shown in the total lysate, despite the use of proteasomal inhibitors. How the author explain this effect?

      These variations in NFATc3 levels in the total lysates may be due to differential protein precipitation by TCA. That is why, in more recent experiments, we collected a portion of the homogenous cell suspension before lysis in the guanidinium buffer, to assess the expression level of transfected proteins (as presented in Figures 4A and 7E).

      It is true that treatment with proteasome inhibitor should attenuate differences in protein level due to different ubiquitination levels. However, cells are transfected for 24h and then treated with MG-132 for 6h before lysis. Proteasome inhibition cannot compensate for what occurred in the cells during the 24h transfection. It is added essentially to accumulate poly-ubiquitinated forms of NFATc3.

      Somehow, this is contradictory with the general message of SUMOylation-dependent ubiquitination.

      The reduced levels of SUMOylation mutants in total lysates may appear to be contradictory with SUMOylation-dependent ubiquitination. However, as mentioned above, this could be due to differential protein precipitation by TCA or to different transfection efficiencies. In contrast, the half-life measurement of WT and EallA mutant, that does not rely on initial expression levels, clearly shows a stabilization of the SUMOylation mutant. Moreover, the average of the three ubiquitination experiments is really convincing. Therefore, we believe that the data that will be presented in the revised manuscript will strongly support our hypothesis.

      -In Fig. 7E, not clear to me what the big bands above 130 KDa is after the nickel beads. Do they correspond to monoUb NFATc3 or to the unmodified protein that is sticky to the beads? Do the authors have side-by-side gels of the initial lysate next to the nickel beads eluates to show the increase in molecular weight?

      The big bands above 130 kD among nickel bead-purified proteins in Figure 7A are unlikely to be unmodified NFATc3 sticking to the beads. Indeed, in the control condition, in which NFATc3 is overexpressed in the absence of His-ubiquitin, these bands are not visible. Therefore, they might be mono-ubiquitinated forms of NFATc3, or degradation products of poly-ubiquitinated NFATc3. We will correct the figure to clarify this point. Unfortunately, we do not have a gel with nickel bead eluates and total lysates side by side for this experiment.

      -Quantifications in some pictures (i.e. Figures 5A, 5B, 6B, 7) is shown in red above or below the bands. Not clear whether the quantifications shown correspond to that single experiment or is the average of several experiments. In the first case, the number would not be very valuable. Authors could add quantification graphs with standard deviations or error bars to the experiments if they want to make the point of changes (significant or not) in the levels. Alternatively, indicate in the Figure legends whether the numbers correspond to the average of several experiments.

      These quantifications correspond to the representative experiments shown in the different figures. We will clarify this point in the Figure legends of the revised manuscript. We added these quantifications to normalize the amount of co-precipitated proteins by the amount of the precipitated partner (Fig 5A, 5B, 7B, 7C, 7D) which is not always precipitated with the same efficiency in the different conditions. We think that it should help the reader to assess the degree of interaction. We also added quantifications to Figure 7E to normalize the ubiquitination signal by the amount of NFATc3 expressed in the total lysate. However, we did not want to overload the figures by adding too many graphs.

      For Figure 6B, where TCA precipitation of total lysates created an inconsistency, we will provide a graph with the average and standard deviation of three independent experiments, as requested by reviewer #1.

      -In Fig. 8, the quantification of apoptotic nuclei has been done just based on the morphology after DAPI staining. Could you use an apoptosis marker (i.e. cleaved caspase Abs) to label the apoptotic cells?

      We have been using primary cultures of cerebellar granule neurons (CGN) as an in vitro model of neuronal apoptosis for many years. Nuclear condensation, visualized after DAPI staining, is very characteristic in these neurons and allows a reliable assessment of neuronal apoptosis. In a previous study (Desagher et al. JBC 2005), we have shown that the kinetics of apoptosis in CGN is the same whether we measure cytochrome c release, active caspase 3 or nuclear condensation (Fig 1b). We therefore believe that the counting of apoptotic nuclei is sufficient to support our conclusions, notably for transfection experiments in Figure 8A which would require a lot of work to be repeated with active caspase 3 staining. However, if we can produce efficient shRNA-expressing lentiviruses, we will reproduce the experiment presented in Figure 8B and we will perform a western blot using anti-active caspase 3 to confirm our conclusion.

      **Minor comments**

      -In Figs. 1 and 5, the red channel should be put in black and white, as it is much easier to see the signal. Not relevant to have DAPI alone in B&W (it does not hurt either), as it is well visible in the merge picture. Also, quantification of the PLA positive dots should be shown in Fig. 1.

      We thank the reviewer for these suggestions. We will modify the figures and we will quantify the PLA dots in Figure 1 as requested.

      -In Fig. 3C, is the difference in TRIM17 expression between empty plasmid and NFATc3 plasmid significant? If so, indicate it in the graph. The same in panels D, E, indicate all significant differences. Same in other Figures.

      No, the difference in Trim17 expression is not statistically significant between NFATc3 and empty plasmid although it clearly increases. However, we agree with the reviewer that more significant differences could be shown in the figures, particularly in Figure 3. Nonetheless, we will try not to overload the figures and will restrict ourselves to comparisons that make sense.

      -It would be nice to show a scheme on the location of SIMs in TRIM39 in relation to the other feature of the protein.

      We are grateful to the reviewer for this suggestion. We will be happy to add a scheme of Trim39 showing its different domains and the location of its SIMs in the revised Figure 7.

      -In Fig. 2 legend, "Note that in the presence of ubiquitin the unmodified form of WT GST-Trim39 is lower due to high Trim39 ubiquitination." Please change to "...in the presence of ubiquitin the levels of the unmodified form..."

      -In Fig. 7 legend, the phrases "The intensity of the bands ... " are not clear. Please rephrase.

      -In Fig. 8 legend, "\** * PWe thank the reviewer for pointing out typographical errors and awkward sentences in our manuscript. Changes will be made as requested.

      Reviewer #2 (Significance (Required)):

      In this manuscript, the authors analyze the effect of TRIM39, a ubiquitin E3 ligase, on NFATc3, a transcription factor that regulates apoptosis in the nervous system. The authors show that TRIM39 can promote the ubiquitination of NFATc3 and regulate its half-life. Furthermore, ubiquitination depends on the SUMOylation state of NFATc3, which suggests that TRIM39 could be a new example of SUMOylation-dependent ubiquitin ligase or STUbL. In addition, the authors show that TRIM17 interferes with TRIM39 ubiquitination, representing a new regulatory level for NFATc3 degradation. This has consequences on the regulation of apoptosis in cells derived from the nervous system.

      The authors show well-controlled, sound results for the most part. The manuscript is well written, and argumentation is convincing. Given the fact that only 2 STUbLs were previously characterized in mammals, the results are relevant and represent an advance in the field. Overall, this is a nice piece of work.

      Audience: researchers interested on proteostasis in general and on nervous system regulation

      My expertise: postranslational modifications

      Reviewer #3

      **Summary:**

      In this study, Shrivastava et al. elucidated the previously unknown function of TRIM39 in regulating protein stability of NFATc3, the predominant member of the NFAT family of transcription factor in neurons, where it plays a pro-apoptotic role. NFATs have been shown to be regulated by multiple mechanisms, including at the level of protein stability. In this study, the authors identify TRIM39 as the E3 ligase for NFATc3. Interestingly, TRIM39 recognizes the SUMOylated form of NFATc3 and the interaction facilitates its ubiquitylation and subsequent proteasomal degradation. They further showed that binding of TRIM39 to NFATc3 can also be regulated by TRIM17. Like TRIM39, TRIM17 is a ring-finger containing protein previously shown by this group that it binds NFATc3 but the interaction resulted in an up- rather than down-regulation of NFATc3. In this study, they offer insight to the paradox that overexpression of TRIM17 binding to TRIM39 is to inhibit TRIM39-mediated ubiquitylation of NFATc3. Furthermore, they showed activation of NFATc3 transcriptionally activates TRIM17 expression, thus forming a feedback loop between NFATc3 and TRIM17. Hence, an TRIM17-TRIM39-NFATc3 signaling axis for modulating the protein stability for promoting the activity of NFATc3 in regulating apoptosis in the cerebellar granule neurons induced by KCl deprivation is proposed

      The key conclusions are convincing. The data in general are of good quality and with many of the key interactions vigorously documented **by conducting reciprocal interaction analysis. For knockdown expeRIMents, two shRNA independent sequences were used. However, some issues remain to be addressed:

      **Major comments:**

      1.Figure 1D - the authors should demonstrate that the depletion of TRIM39 expression by shRNA in Neuro2A by Western blotting

      We agree with the reviewer that it would be better to provide this control. Unfortunately, we have never been able to observe a convincing decrease in the protein level of Trim39, following knockdown, by Western blotting in Neuro2A cells. This is surprising because the decrease is clearly visible by immunofluorescence in Neuro2A cells, and by western blotting in neurons (see Figure 8C). It is possible that Neuro2A cells, but not neurons, express a protein that is non-specifically recognized by our best anti-Trim39 antibody in western blots and that migrates at the same size as Trim39, thus preventing the investigator to detect the depletion of Trim39. We will test additional anti-Trim39 antibodies to address this question.

      2.Figure 3 - the author should show overexpression of TRIM39 resulted in reduction of basal level of endogenous NFATc3 due to its effect on protein stability by using CHX or other pulse chase method.

      This is an important point and we have performed many experiments using cycloheximide to measure the half-life of NFATc3 in the presence or the absence of overexpressed Trim39. The results were neither consistent nor reproducible. This is certainly due to the fact that the half-life of endogenous NFATc3 is longer than that of overexpressed Trim39 and that cycloheximide inhibits the expression of both proteins. Therefore, we will perform pulse-chase experiments after metabolic labelling of cells with [35S]-Met. We are currently setting up the conditions to immunoprecipitate endogenous NFATc3 to be able to perform these experiments.

      3.Figure 3 - Does overexpression or knockdown of TRIM39 has an effect on affecting levels of NFATc3 mRNAs?

      The reviewer is right. It is important to control that overexpression and knockdown of Trim39 do not modify the mRNA level of NFATc3. Therefore, we are currently measuring NFATc3 mRNA levels in all the experiments used to make the graphs of Figure 3. These results will be added to the revised version of the manuscript as supplemental data. First results show no significant change of NFATc3 mRNA levels in these experiments.

      4.Figure 6A - the authors should confirm the multiple bands that are slower migrating are SUMO form of NFATc9 by demonstrating the presence of SUMO in these forms of NFATc3, or alternatively, perform His-SUMO pull-down and probe for NFATc3.

      The reactions shown in Figure 6B have been performed in vitro, with purified recombinant proteins and with NFATc3 produced by in vitro transcription/translation. The wheat germ extract used to produce NFATc3 is unlikely to provide the material needed for post-translation modification of a mammalian protein. However, we agree that it would be better to confirm that slower migrating bands are indeed SUMOylated forms of NFATc3. We may hybridize the membranes with an anti-SUMO antibody but it would give a smear as the enzymes added to the reaction mix are themselves SUMOylated. Therefore, we will show an experiment in which the reaction mix has been incubated with and without SUMO. The results show no slower migrating bands in the absence of SUMO although all conditions were otherwise identical. This will be added to the revised Figure 6.

      5.Figure 7C - the quantification for mSIM1 does not seem to agree with the band intensity.

      Yes, we agree with the reviewer that the quantification (122%) does not seem to reflect the amount of SUMO-chains bound to GST-Trim39 mSIM1. This is due to the normalization of the SUMO signals by the intensity of GST-Trim39 bands. Indeed, it is difficult to control exactly how much recombinant protein is used. GST-Trim39 mSIM1 was slightly less abundant than the other GST-Trim39 proteins in this experiment, explaining why less SUMO-chains were eluted in this condition. The normalization is mentioned in the legend of Figure 7C.

      6.TRIM17 reduces TRIM39/NFATc3 interaction and inhibits TRIM39 E3 activity, which results in stabilization of NFATc3. NFATc3 in turn transcriptionally induces TRIM17 expression, thus forming a feedback loop between NFATc3 and TRIM17. It will be good if the authors can discuss the possibility of the existence of this feedback mechanism in physiological context? Is the protein level of NFATc3 level, which should be low abundance at the resting state, elevated by KCI deprivation? If so, can the authors discuss the possible signalling event(s) that that lead to activation of NFATc3 upon KCI deprivation? For instance, does KCL deprivation cause de-SUMOylation of NFATc3?

      We thank the reviewer for these suggestions. Our preliminary results suggest that the protein level of NFATc3 is increased in neurons following KCl deprivation. We are currently performing additional experiments to confirm this result. If proved, this increase may be due to the transcriptional induction of Trim17 that should result in the stabilization of NFATc3 through the inhibition of Trim39. It may also be due to a possible deSUMOylation of NFATc3 following apoptosis induction, as suggested by the reviewer. To address the latter point, we are currently setting up PLA using anti-NFATc3 and anti-SUMO antibodies to assess the SUMOylation level of endogenous NFATc3 in neurons. If they are of good quality, we will add these data to Figure 8 and we will discuss the possible existence of feedback loops in neuronal apoptosis, as suggested by the reviewer.

      **Minor comments:**

      1.Line 294 - it should be "SUMOylation" instead of "SUMO".

      We thank the reviewer for pointing out this typographical error that will be corrected.

      2.Figure 8 - to include TRIM39/NFATc3 double knockdown to show the effect on increased neuronal apoptosis in the cells with TRIM39 knocked down was due to elevation of NFATc3 rather than other target(s) of TRIM39.

      We agree that it would be interesting to test whether the increase on neuronal apoptosis following Trim39 silencing is mainly due to its effect on NFATc3. We will therefore perform double silencing of Trim39 and NFATc3 in neurons in order to address this point.

      3.The discussion may be shortened and revised to highlight the physiological importance of the findings linked to cerebellar granule neurons survival.

      As suggested by the reviewer, we will modify the discussion to better highlight the physiological implications of our data, particularly by discussing the results of the additional experiments we will conduct in neurons.

      Reviewer #3 (Significance (Required)):

      Prior to this study, the mechanism by which protein stability of NFATc3, the pre-dominant member of the NFAT family of transcription factor in neurons, is regulated remains poorly understood. Shrivastava et al. have unravelled the interplay between ubiquitylation and SUMOylation involving TRIM39 and TRIM17 to have an important role in regulating protein stability of NFATc3. The work is interesting and bears significance towards understanding how apoptosis could be finely controlled in cerebellar granule neurons. Furthermore, the study has also expanded the understanding of the role and regulation of the TRIM family of proteins. The senior author is an expert in this field and over the years, her group has contributed many key discoveries on the function of TRIM family of E3 ubiquitin ligases and their critical ubiquitylation substrates in neuronal survival and its relevance to neuronal biology and diseases.

      The referee's field of expertise in in the field of mitochondrial apoptosis signalling. The referee extensively involved in studying how protein stability of regulators in apoptosis signalling are regulated by the ubiquitin-proteasome system (UPS) and how does the regulation play a role in physiology and diseases.

      Key words: apoptosis, ubiquitylation, cell signaling, liver diseases

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      Summary:

      In this study, Shrivastava et al. elucidated the previously unknown function of TRIM39 in regulating protein stability of NFATc3, the predominant member of the NFAT family of transcription factor in neurons, where it plays a pro-apoptotic role. NFATs have been shown to be regulated by multiple mechanisms, including at the level of protein stability. In this study, the authors identify TRIM39 as the E3 ligase for NFATc3. Interestingly, TRIM39 recognizes the SUMOylated form of NFATc3 and the interaction facilitates its ubiquitylation and subsequent proteasomal degradation. They further showed that binding of TRIM39 to NFATc3 can also be regulated by TRIM17. Like TRIM39, TRIM17 is a ring-finger containing protein previously shown by this group that it binds NFATc3 but the interaction resulted in an up- rather than down-regulation of NFATc3. In this study, they offer insight to the paradox that overexpression of TRIM17 binding to TRIM39 is to inhibit TRIM39-mediated ubiquitylation of NFATc3. Furthermore, they showed activation of NFATc3 transcriptionally activates TRIM17 expression, thus forming a feedback loop between NFATc3 and TRIM17. Hence, an TRIM17-TRIM39-NFATc3 signaling axis for modulating the protein stability for promoting the activity of NFATc3 in regulating apoptosis in the cerebellar granule neurons induced by KCl deprivation is proposed.

      The key conclusions are convincing. The data in general are of good quality and with many of the key interactions vigorously documented by conducting reciprocal interaction analysis. For knockdown expeRIMents, two shRNA independent sequences were used. However, some issues remain to be addressed:

      Major comments:

      1.Figure 1D - the authors should demonstrate that the depletion of TRIM39 expression by shRNA in Neuro2A by Western blotting

      2.Figure 3 - the author should show overexpression of TRIM39 resulted in reduction of basal level of endogenous NFATc3 due to its effect on protein stability by using CHX or other pulse chase method.

      3.Figure 3 - Does overexpression or knockdown of TRIM39 has an effect on affecting levels of NFATc3 mRNAs?

      4.Figure 6A - the authors should confirm the multiple bands that are slower migrating are SUMO form of NFATc9 by demonstrating the presence of SUMO in these forms of NFATc3, or alternatively, perform His-SUMO pull-down and probe for NFATc3.

      5.Figure 7C - the quantification for mSIM1 does not seem to agree with the band intensity.

      6.TRIM17 reduces TRIM39/NFATc3 interaction and inhibits TRIM39 E3 activity, which results in stabilization of NFATc3. NFATc3 in turn transcriptionally induces TRIM17 expression, thus forming a feedback loop between NFATc3 and TRIM17. It will be good if the authors can discuss the possibility of the existence of this feedback mechanism in physiological context? Is the protein level of NFATc3 level, which should be low abundance at the resting state, elevated by KCI deprivation? If so, can the authors discuss the possible signalling event(s) that that lead to activation of NFATc3 upon KCI deprivation? For instance, does KCL deprivation cause de-SUMOylation of NFATc3?

      Minor comments:

      1.Line 294 - it should be "SUMOylation" instead of "SUMO".

      2.Figure 8 - to include TRIM39/NFATc3 double knockdown to show the effect on increased neuronal apoptosis in the cells with TRIM39 knocked down was due to elevation of NFATc3 rather than other target(s) of TRIM39.

      3.The discussion may be shortened and revised to highlight the physiological importance of the findings linked to cerebellar granule neurons survival.

      Significance

      Prior to this study, the mechanism by which protein stability of NFATc3, the pre-dominant member of the NFAT family of transcription factor in neurons, is regulated remains poorly understood. Shrivastava et al. have unravelled the interplay between ubiquitylation and SUMOylation involving TRIM39 and TRIM17 to have an important role in regulating protein stability of NFATc3. The work is interesting and bears significance towards understanding how apoptosis could be finely controlled in cerebellar granule neurons. Furthermore, the study has also expanded the understanding of the role and regulation of the TRIM family of proteins. The senior author is an expert in this field and over the years, her group has contributed many key discoveries on the function of TRIM family of E3 ubiquitin ligases and their critical ubiquitylation substrates in neuronal survival and its relevance to neuronal biology and diseases.

      The referee's field of expertise in in the field of mitochondrial apoptosis signalling. The referee extensively involved in studying how protein stability of regulators in apoptosis signalling are regulated by the ubiquitin-proteasome system (UPS) and how does the regulation play a role in physiology and diseases.

      Key words: apoptosis, ubiquitylation, cell signaling, liver diseases

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      In this manuscript, the authors analyze the effect of TRIM39, a ubiquitin E3 ligase, on NFATc3, a transcription factor that regulates apoptosis in the nervous system. The authors show that TRIM39 can promote the ubiquitination of NFATc3 and regulate its half-life. Furthermore, ubiquitination depends on the SUMOylation state of NFATc3, which suggests that TRIM39 could be a new example of SUMOylation-dependent ubiquitin ligase or STUbL. In addition, the authors show that TRIM17 interferes with TRIM39 ubiquitination, representing a new regulatory level for NFATc3 degradation. This has consequences on the regulation of apoptosis in cells derived from the nervous system. The authors show well-controlled, sound results for the most part. The manuscript is well written, and argumentation is convincing. Given the fact that only 2 STUbLs were previously characterized in mammals, the results are relevant and represent an advance in the field. Overall, this is a nice piece of work. Here are some comments.

      Major comments

      -In Fig. 2B, the levels of material loaded are uneven, which difficult the interpretation. However, it seems that the control shRNA also has an effect on NFATc3 ubiquitination, which should not be the case. Also, by reducing ubiquitination by TRIM39, shouldn't you expect an increase in the levels of NFATc3, if this ubiquitination was driving degradation? The authors do not specify whether those cells were treated or not with proteasomal inhibitor. Same applies in Figure 4B, where no reduction in NFATc3 are seen after including TRIM39 in the reaction (beyond the fact that it looks reduced because the presence of ubiquitinated forms).

      -After the experiments in vitro shown in Fig. 2C, the authors conclude that the NFATc3 is a direct substrate of TRIM39. I think the authors used the right approach by using bacterially produced GST-TRIM39 for the ubiquitination reaction. However NFATc3 is produced by an in vitro transcription-translation system, which could in principle provide other contaminant proteins to the reaction. Did the authors try to use bacterially produced NFATc3? This might be difficult in the case of big proteins, in which case the authors could add some caution note in the text. Same applies in Figure 4B.

      -In Fig. 6B, higher levels of ubiquitination in the different SUMOylation mutants are shown. Is this effect consistent? How this can be explained? In addition, variations in the levels of NFATc3 are shown in the total lysate, despite the use of proteasomal inhibitors. How the author explain this effect? Somehow, this is contradictory with the general message of SUMOylation-dependent ubiquitination.

      -In Fig. 7E, not clear to me what the big bands above 130 KDa is after the nickel beads. Do they correspond to monoUb NFATc3 or to the unmodified protein that is sticky to the beads? Do the authors have side-by-side gels of the initial lysate next to the nickel beads eluates to show the increase in molecular weight?

      -Quantifications in some pictures (i.e. Figures 5A, 5B, 6B, 7) is shown in red above or below the bands. Not clear whether the quantifications shown correspond to that single experiment or is the average of several experiments. In the first case, the number would not be very valuable. Authors could add quantification graphs with standard deviations or error bars to the experiments if they want to make the point of changes (significant or not) in the levels. Alternatively, indicate in the Figure legends whether the numbers correspond to the average of several experiments.

      -In Fig. 8, the quantification of apoptotic nuclei has been done just based on the morphology after DAPI staining. Could you use an apoptosis marker (i.e. cleaved caspase Abs) to label the apoptotic cells?

      Minor comments

      -In Figs. 1 and 5, the red channel should be put in black and white, as it is much easier to see the signal. Not relevant to have DAPI alone in B&W (it does not hurt either), as it is well visible in the merge picture. Also, quantification of the PLA positive dots should be shown in Fig. 1.

      -In Fig. 3C, is the difference in TRIM17 expression between empty plasmid and NFATc3 plasmid significant? If so, indicate it in the graph. The same in panels D, E, indicate all significant differences. Same in other Figures.

      -It would be nice to show a scheme on the location of SIMs in TRIM39 in relation to the other feature of the protein.

      -In Fig. 2 legend, "Note that in the presence of ubiquitin the unmodified form of WT GST-Trim39 is lower due to high Trim39 ubiquitination." Please change to "...in the presence of ubiquitin the levels of the unmodified form..."

      -In Fig. 7 legend, the phrases "The intensity of the bands ... " are not clear. Please rephrase.

      -In Fig. 8 legend, " P<0.001". Change to "* P<0.001".

      Significance

      In this manuscript, the authors analyze the effect of TRIM39, a ubiquitin E3 ligase, on NFATc3, a transcription factor that regulates apoptosis in the nervous system. The authors show that TRIM39 can promote the ubiquitination of NFATc3 and regulate its half-life. Furthermore, ubiquitination depends on the SUMOylation state of NFATc3, which suggests that TRIM39 could be a new example of SUMOylation-dependent ubiquitin ligase or STUbL. In addition, the authors show that TRIM17 interferes with TRIM39 ubiquitination, representing a new regulatory level for NFATc3 degradation. This has consequences on the regulation of apoptosis in cells derived from the nervous system.

      The authors show well-controlled, sound results for the most part. The manuscript is well written, and argumentation is convincing. Given the fact that only 2 STUbLs were previously characterized in mammals, the results are relevant and represent an advance in the field. Overall, this is a nice piece of work.

      Audience: researchers interested on proteostasis in general and on nervous system regulation

      My expertise: postranslational modifications

    4. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      Summary:

      Desagher and co-workers investigate the regulation of the NFAT family member NFATc3, a transcription factor in neurons with a pro-apoptotic role. They identify TRIM39 as a ubiquitin E3 ligase regulating NFATc3. They demonstrate that TRIM39 can bind and ubiquitinate NFATc3 in vitro and in cells. They identify a critical SUMO interaction motif in TRIM39, that is required for its interaction with NFATc3 and for its ability to ubiquitinate NFATc3. Moreover, mutating sumoylation sites in NFATc3 reduces the interaction with TRIM39 and reduces its ubiquitination. Silencing TRIM39 increases the protein levels of NFATc3 and its transcriptional activity, leading to apoptosis of neurons. TRIM17 modulates the TRIM39-NFATc3 axis. Combined, TRIM39 appears to be a SUMO-targeted ubiquitin ligase (STUbL) for NFATc3 in neurons.

      Major points:

      1.This manuscript containing two stories: the rather exciting story that TRIM39 is a STUbL for NFATc3 (as mentioned in the title) and the second less exciting story: TRIM17 modulates the regulation of NFATc3 by TRIM39. These stories are now mixed in a confusing manner, disrupting the flow of the first story. It would be better to focus the current manuscript on the first story and strengthen it further and develop the second story in a second manuscript.

      2.Whereas the cellular experiments to indicate that TRIM39 acts as a STUbL are properly carried out, the observed effects are not necessarily direct. Direct evidence that TRIM39 is indeed a STUbL for sumoylated NFATc3 needs to be obtained in vitro, using purified recombinant proteins. Does TRIM39 indeed preferentially ubiquitinate sumoylated NFATc3? Is ubiquitination reduced for non-sumoylated NFATc3? Is ubiquitination of sumoylated NFATc3 dependent on SIM3 of TRIM39? Do other SIMs in TRIM39 contribute?

      3.Rule out potential roles for other STUbLs by including control knockdowns of RNF4 and RNF111 and verify the sumoylation of NFATc3 and ubiquitination of wildtype and sumoylation-mutant NFATc3.

      4.Figure 6B: use SUMO inhibitor ML-792 to demonstrate that ubiquitination of wildtype NFATc3 by TRIM39 is dependent on sumoylation.

      Minor points:

      5.Figure 1A and B: demonstrate by immunoprecipitation and Western that the endogenous counterparts indeed interact.

      6.Figure 1C and 1E: Quantify the PLA results properly and perform statistics.

      7.Figure 2B: Correct unequal loading of samples.

      8.Figure 6B: proper statistics are needed here from at least three independent experiments.

      Significance

      Humans have over 600 different ubiquitin E3s. Currently, RNF4 and RNF111 are the only known human SUMO-Targeted Ubiquitin Ligases (STUbLs). Here, the authors present evidence that the ubiquitin E3 ligase TRIM39 is a STUbL for sumoylated NFATc3. Identification of a new STUbL is an exciting finding for the ubiquitin and SUMO field and for the field of ubiquitin-like signal transduction in general, but needs to be strengthened as outlined above. My field of expertise is SUMO and ubiquitin signal transduction.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reviewer #1 (Evidence, reproducibility and clarity):

      **A. Summary:**

      In this modeling study, the authors devised a multicellular model to investigate how circadian clocks in different parts (organs) of plants coordinate their timing. The model uses a plausible mechanism to explain how having a different sensitivity to light leads to different phase and period of circadian clock, which is observed in different plant organs. The model allows for entrainment in Light-Dark (LD) cycles and then a release in always-light (LL) environments. The model disentangles numerous factors that have confounded previous experiments. In one instance, the authors assigned different light sensitivities to the different organs (e.g., root tip, hypocotyl, etc.) which unambiguously show that this one element alone - spatially differing sensitivity to light - is sufficient for recapitulating experimentally observed differences in periods and phases between plant organs. The model also recapitulates the spatial waves of gene expression within and between organs that experimentalists reported. At the sub-tissue level, the model-produced waves have similar patterns as the experimentally observed waves. This confirmation further validates the model. By having the cells share clock mRNA, from any clock component genes, showed the same, experimentally observed spatial dynamics. The main conclusion of the study is that regional differences (e.g., between different organs) in light senilities, when combined with cell-to-cell sharing of clock-gene mRNAs, enables a robust, yet flexible, circadian timing under noisy environmental cycles.

      Thank you for your assessment of our work. We plan to make the following revisions based on your feedback.

      **B. Specific points:**

      1.Lines 125-127: "To simulate the variability observed in single cell clock rhythms, we multiplied the level of each mRNA and protein by a time scaling parameter that was randomly selected from a normal distribution." - Why not add a white (Gaussian) noise term to these equations? How does multiplying by a random variable (for rescaling time) different from my proposal? Some explanation should be given in the text here.

      We opted for a time scaling approach as this generates between-cell period differences but avoids within-cell period differences. This is consistent with single cell experiments (S1 Fig; Gould et al., 2018, eLife). We will provide an explanation of this in the text.

      2.Does the spatial network model simplify calculations by assuming separations of timescales (e.g., for equilibration in concentrations of mRNAs that diffuse between cells)? If so, it would be good to spell these out in the beginning of the Results section (where the model is described).

      We agree that a more detailed discussion of the model assumptions would be beneficial and we will provide this in the text.

      3.Lines 161-162: "....in a phase only model by local...." should be "....in a phase model only by local...."

      Thank you for your correction.

      4.Lines 188-190: The authors observed that qualitatively similar/indistinguishable behaviors arose regardless of which elements are varied (e.g., global versus local cell-cell coupling, setting light input to be equal in all regions of the seedling, etc.). Then they claim here that "...these results show that the assumptions of local cell-to-cell coupling and differential light sensitivity between regions are the key aspects of our model that allow a match to experimental data." - I don't see how this follows from the observation almost any of the variations lead to the same behaviors in this section (spatial waves). Show the reasoning in the text here.

      We observed spatial waves with different local coupling regimes (4 v. 8 nearest neighbours). However, we did not observe spatial waves with global coupling (S10 Fig). This led us to conclude that local coupling is a key aspect. In addition, we do not observe waves when setting the light input to be equal in all regions of the seedling (S11 Fig). This confirms that local differences in light sensitivity are also required in our simulations to generate spatial waves. We will clarify these points with revisions to the text.

      5.Pgs. 9-10: Section on "Cell-to-cell coupling maintains global coordination under noisy light-dark cycles": The simulation results rigorously support the authors' main conclusion here, which is that local cell-to-cell coupling allows for global coordination under noisy LD cycles. But I'm missing an intuitive explanation (or just any explanation) for why this is. At the end of this section, the authors should provide some intuition or qualitative explanation for the observations that they produced using their model in this section.

      We will revise the text to provide an intuitive explanation of these results. The coupling decreases the within-region phase differences. Despite the between-regions phase differences persisting, this effect is sufficient to improve the overall global synchrony.

      6.Lines 261-262: Replace the present tenses with past tenses.

      Thank you for your correction.

      7.Is the main idea that cell-to-cell coupling allows for averaging of fluctuations, between organs or cells within the same organ, while allowing for coordination of the average quantities? Is this responsible for both the flexibility and robustness observed under noisy environmental cycles?

      The cell-to-cell-coupling allows for the averaging of fluctuations between cells and the regional flexibility arises from the different light sensitivities in each region. What was interesting to us was that under light-dark cycles the regional flexibility was not lost due to either the noise in the light or the averaging effect of the cell-to-cell coupling. We will revise the text to emphasize these points. Thank you for your prompts.

      8.Line 304: Is it really true that the mammalian circadian rhythm is centralized? Don't some parts of our bodies have different circadian clock (e.g., slight differences in phase) than some other parts of our bodies?

      There are indeed some small phase differences between parts of our bodies because the mammalian system, like the plant system, is imperfectly coupled. However, the mammalian system is considered more centralized because the suprachiasmatic nucleus in the brain receives the key entraining signal of light and then coordinates rhythms across the body (Bell-Pedersen et al., 2005, Nat Rev Gen; Brown & Azzi, 2013, Circadian Clocks). We will expand on these interesting points by adding a paragraph to the discussion.

      Reviewer #1 (Significance):

      **Overall assessment:**

      I enthusiastically recommend this work for publication after the authors address my comments below (please see "Specific points").

      The model's main strength is that the authors could vary each ingredient separately - light sensitivity of each cell/organ, which gene's mRNA diffuses between cells, cellular noise, local versus global cell-cell coupling, etc. Afterwards, the authors could determine which of these variations produces which experimentally observed behaviors. Another strength of the model is that it can reproduce not just one, but numerous, experimentally observed behaviors that are important for understanding circadian clocks in plants. Thus, the model is grounded in experimental truth and produces experimentally observed results. Crucially, since the authors could vary every single element in the model independently of the other elements, the authors are able to provide plausible explanations for why the experiments produced the results that they did (experimentally, a number of confounding factors prevented one from pinpointing to which element produced which observation).

      Another strength of the model is also extendable, by other researchers to investigate other plant physiologies in the future (e.g., circadian clock's influence on cell division). The authors highlight these future uses in the discussion section. Therefore, I believe that this work will be valuable to plant biologists, non-plant biologists who are interested in circadian clocks, and systems biologists in general.

      The manuscript is also well written and relatively easy to follow, even for non-plant biologists like myself.

      Thank you for the positive feedback - we are pleased that you find the manuscript of broad interest to a range of readers.

      Comment on Reviewer #2:

      I agree with his/her major criticism #3 (ELF4 long-distance movement). I find this to be a reasonable request. Fulfilling it would increase the paper's impact.

      Please see our response to reviewer #2.

      Comment on Reviewer #3:

      The reviewer's point (1) asks for a reasonable request.

      Regarding his/her point (2): This is also reasonable. I'd recommend his/her suggestion (a). In the end, I'd be interested to see how the authors respond to this (what function they choose to let adjacent cells be subjected to some correlated light-input intensity. I'd be happy with something simple such as + noise, where is a deterministic term that, for example, decreases exponentially as one moves away from some central cell. Basically, I'd let the authors decide how to implement this and accept their current implementation - no correlation in light-intensity between adjacent cells - as an extreme scenario, as this reviewer points out.

      Please see our response to reviewer #3.

      Reviewer #2 (Evidence, reproducibility and clarity):

      **Summary:**

      The manuscript presents an improved model of the circadian clock network that accounts for tissue-specific clock behavior, spatial differences in light sensitivity, and local coupling achieved through intercellular sharing of mRNA. In contrast to whole-plant or "phase-only" models, the authors' approach enables them to address the mechanism behind coupling and how the clock maintains regional synchrony in a noisy environment. Using 34 parameters to describe clock activity and applying the properties mentioned above, the authors demonstrate that their model can recapitulate the spatial waves in circadian gene expression observed and can simulate how the plant maintains local synchrony with regional differences in rhythms under noisy LD cycles. Spatial models that incorporate cell-type-specific sensitivities to environmental inputs and local coupling mechanisms will be most accurate for simulating clock activity under natural environments.

      Thank you for your assessment of our work. We plan to make the following revisions based on your feedback.

      *We have the following **major criticisms** as follows*

      1) When assigning light sensitivities in different regions of the plant, the authors assign a higher sensitivity value to the root tip (L=1.03) than they do to the other part of the root (L=0.90). We are curious why the root tip would have higher light sensitivity than the rest of the root. Is this based on experimental data (if so, please cite in this section or methods)? It seems that these L values were assigned simply to make sure they recapitulated the period differences observed in Fig. 2A. Are these values based on PhyB expression in those organs? Or perhaps based on cell density in those locations?

      We assign the light sensitivity to match observed experimental period differences across the plant (Fig 2A,B). This is based on previous experiments demonstrating that experimental period differences are dependent on light input through the light sensing gene PHYB (Greenwood et al., 2019, PLoS Bio; Nimmo et al., 2020, Physiologia Plantarum). For example, in WT seedlings, the root tip oscillates faster than the root, but this difference is lost in the phyb-9 mutant (Greenwood et al., 2019). Thus, we assume the root tip to be more sensitive to light than the roots.

      Further supporting this assumption, there is evidence that expression of phytochromes and cryptochromes are increased in the root tip relative to the root (e.g., Somers & Quail, 1995, Plant J; Bognar et al., 1999, PNAS; Toth et al., 2001, Plant Physiol), as the reviewer proposes. However, further experiments would be needed to verify that these differences in expression are what lead to the differences in clock timing. We will add a discussion of these experiments to the text.

      2) In the discussion of the test where they set the "light inputs to be equal" in all regions to simulate the phyb-9 mutant, could the authors please clarify whether that means they set the L light sensitivity value equal in all regions?

      This is indeed what we mean, we will rephrase the text for clarity.

      a. If they are referring to setting the L value equal to all regions, we suggest that this discussion be moved to the section about different light sensitivities instead of the local sharing of mRNA section.

      Thank you for your suggestion, we agree and will move this discussion.

      b. Additionally, is it possible to set the light sensitivity to zero for all parts of the plant? We think this would be more suitable to simulate the phyb-9 mutant phenotype.

      We thank the reviewer for this suggestion. We will include a simulation with light sensitivity set to zero in the revised manuscript, in addition to the existing simulations with light sensitivity set to 1.

      3) Based on the recent Chen et al. (2020) paper showing ELF4 long-distance movement, we think it would be of great interest for the authors to model ELF4 protein synthesis/translation as the coupling factor, in addition to the modeling using CCA1/LHY mRNA sharing. We understand you may be saving this analysis for a future modeling paper, but this addition to the paper could increase the impact of this paper.

      Thank you for the suggestion to improve our manuscript. We agree it will be of interest to model ELF4 protein as the local coupling factor. In the revision, we will simulate each clock protein (including ELF4) as the local coupling factor and compare.

      In addition, we will also modify the coupling mechanism to simulate the long-distance transport of ELF4 proposed by Chen et al., 2020. Our preliminary simulations show that we can couple shoot rhythms to those in the root tip, but that this long range coupling can not on its own generate the spatial structure observed in experiments. We agree with the reviewers that this analysis and an associated discussion will further increase the impact of the paper.

      4) This model is able to simulate circadian rhythms under 12:12 LD cycles, which represents two days of the year-the equinoxes. We are curious if the model can simulate rhythms under short days and long days as well. We understand this analysis may be outside the scope of this paper and may require changing the values of the 34 parameters used but think it could be a useful addition here or in future work.

      We agree it would be interesting to observe the behavior of the model under different day lengths. We will include simulations under short and long days in the revision.

      *And **minor criticisms** as follows*

      1) In the first paragraph of the results section, it would be helpful for the authors to reference Table S1 when they mention the 34 parameters used to model oscillator function

      We agree and we will implement this helpful suggestion.

      2) In the first paragraph of the section titled "Local flexibility persists under idealized and noisy LD cycles", it would be helpful for the authors to reference S12 Fig after the last sentence that starts "However, ELF4/LUX appeared more synchronized..."

      We agree and we will implement this helpful suggestion.

      3) In the first paragraph of the section titled "Cell-to-cell coupling maintains global communication under noisy light-dark cycles", the authors refer to a "Table 1" but I think they mean to refer to Table S1"

      Thank you, we will implement this helpful suggestion.

      4) In Fig. 1, panel C is described as demonstrating the cell-to-cell coupling through the "level of CCA1/LHY". This phrasing is vague and we think could be improved to the "mRNA level of CCA1/LHY".

      We agree and will implement this helpful suggestion.

      Reviewer #2 (Significance (Required)):

      This work would be broadly interesting to other researchers studying cell-to-cell signaling and coupling of circadian rhythms in plants and other species where spatial waves of gene expression have been observed (i.e., mice and humans). Additionally, the computational modeling aspect of this work was easily interpretable for someone outside this expertise. Our expertise lies in plant circadian biology.

      We thank the reviewer for recognising the broad appeal of our work.

      Reviewer #3 (Evidence, reproducibility and clarity):

      **Summary:**

      The authors start by taking a previously published model of the plant circadian clock and implement five changes: 1) updating the network topology to reflect some recent experimental findings, 2) make a spatial model loosely based on a seedling template 3) introduce coupling between cells based on shared levels of CCA1/LHY 4) randomly rescale time in each cell to induce inter-cell differences in period, 5) include a light sensitivity that depends on the region considered.

      For a certain configuration of light sensitivities/intensities, the different periods of oscillations in each seedling region roughly match that of experiments. With a sufficiently high coupling between cells, the system can also generate spatial waves, which are also observed in the experimental system.

      With pulsed light inputs the spatial pattern is still produced. The authors then investigate the robustness to environmental noise by generating stochastic light signals and show that the global synchrony, as measured with a synchronisation index, increases with cell-to-cell coupling strength. The paper is overall well-written, and the background and details of the analysis are well presented.

      Thank you for your assessment of our work. We plan to make the following revisions based on your feedback.

      **Major comments:**

      For the first part of paper, the output of the model is certainly the focus. There is virtually no discussion of the inferred parameters and how much confidence the authors have in their values.

      Thank you for this point. We will add discussion of the inferred parameters to the initial part of the results.

      My main issue with the paper is about the section with noisy light signals, which is included in the title and is ultimately one of the main themes of the article.

      Specifically, on line 224:

      "This decrease in cell-to-cell variation revealed an underlying spatial structure (Fig 4D, middle and right, and S13 Fig), comparable to that observed under idealized LD cycles (Fig 4B, middle and right, and S12 Fig)."

      Firstly, I don't feel these conclusions match with the data presented. Comparing figure 4D middle and right with figure 4B middle and right shows a clear and pronounced loss in spatial structure. In its current form, this statement has to change, but I believe there are at least two other major issues with this figure:

      We agree there are some differences in the spatial structure between idealized (Fig 4B) and noisy (Fig 4D) LD cycles. Preliminary simulations suggest that this is due to the way the noisy LD cycles are programmed.

      In the current implementation of noisy LD cycles, the maximum intensity of L, L**max, differs between each region, such that relative differences in light sensitivity between regions are maintained. This means that some phase differences between regions are maintained. However, as the reviewer correctly points out in point 1 below, due to the noise fluctuations, the average level of light is lower than under idealized LD cycles, and with considerable day-to-day variation. We believe this is why the spatial structure differs.

      Preliminary simulations suggest that if we normalize the mean light intensity such that the mean is equal between the two conditions (as the reviewer suggests in point 1 below), the spatial structure appears similar. We will present this analysis in the revision.

      1) The figure is clearly designed to invite a comparison between the noise-free light cycles on the left with the noisy cycles on the right. However, due to how the noisy light is simulated, the variance of light signal increases AND the average intensity of light decreases by 50%. When comparing the left and the right, we therefore don't know whether the changes are due to differences in the average signal or differences from the stochasticity. I think the authors should simulate a noisy light signal with the same mean intensity level as the deterministic signal.

      As discussed above, we agree that the average intensity of the light decreases due to the noise, and this complicates interpretation. We will simulate idealized and noisy light cycles with the same mean light level upon revision.

      2) The noise model for the light doesn't seem realistic. On line 484 is says:

      "We made the simplifying assumption that each cell is exposed to an independent noisy LD cycle due to their unique positions in the environment. LD cycles were input to the molecular model through the parameter L".

      In fact, this could be considered as an incredibly complex signal, because for 800 cells it means drawing 800 random light signals. The implication is that two adjacent cells receive statistically independent light signals. Depending on chance, one cell might receive tropical levels of light while its neighbour experiences a cloudy day. This affects the interpretation and conclusions from figures 4 and 5. I propose two different ways of improving the simulation of the noisy light signal:

      a) In one extreme case, all cells receive the same noisy light signal, and the other extreme, they all receive independent signals. You could consider a mixture model of light signals, where each cell receives \lambda L_global(t) + (1-\lambda) L_individual(t), where L_global(t) is a global light signal that is shared by all cells and L_individual(t) is a light signal unique to an individual cell. The mixing parameter \lambda controls how similar the light signal is between cells

      b) Clearly the light signal will differ depending on the region, but there will be some spatial correlation. You could also consider methods of simulating light such that neighbouring cells receive correlated signals, although this might be difficult.

      Thank you for your proposals. We agree that our current implementation of noisy LD cycles represents an extreme scenario. Given that there is no environmental data at sufficient resolution to reliably evaluate which implementation is most realistic, we will explore different approaches based on your suggestions and present them in our revision.

      Assuming that the problem with the mean signal is corrected, do you expect the average spatial pattern to be the same between figure 4 B and D with no coupling (J=0) (although an increase in the variance between cells)? Perhaps not (owing to nonlinearities in the system), but it would be interesting to comment.

      We agree that the decreased light intensity complicates interpretation of the spatial structure. Although in the current implementation relative light differences between regions are maintained, the spatial structure is altered because the mean intensities are lower. Preliminary simulations with the mean intensity fixed do result in spatial patterns more similar to that seen in Fig 4B, but with increased variance. Comprehensive simulations will be included in the revised manuscript.

      The different periods in the different regions of the seedling are caused by differences in light sensitivity, which the authors claim is justified from refs 12-15. An alternative hypothesis is the that biochemical parameters such as degradation rates are different between regions. This is briefly alluded to in the introduction, but I think it would be interesting to discuss further. What would be the pros and cons of the two different mechanisms?

      We agree that an alternative hypothesis is that biochemical parameters such as degradation rates may differ between regions. Experimental evidence, however, more supports the light sensitivity hypothesis. This is because, for example, mutations in light signalling remove the spatial differences between regions. We agree though that this is an important point, and will add a paragraph to the discussion discussing the pros and cons of the two different mechanisms.

      I understand that the authors used a pre-existing model, but I must say that I find the way that light is incorporated into the model a bit confusing.

      On line 345 it says:

      "L(t) represents the input light signal (L = 0, lights off; L > 0, lights on) and D(t) denotes a corresponding darkness input signal (D = 1, lights off; D = 0, lights on)."

      Surely the only thing that matters biophysically is the number of photons hitting the plant? Could you explain why the model needs to have a separate "darkness signal" compared to just a single light signal?

      A darkness signal has been introduced in many circadian clock models because degradation rates of the clock genes can depend upon the light or dark condition. We agree with the reviewer that we should explain this clearer in the text.

      In the model, the light intensity changes depending on the region. It might make more sense for interpretability if instead there is an additional light-sensitivity coefficient that depends on the region, because at the moment I'm not sure what units L(t) is supposed to take.

      Thank you for your suggestion. We will try to implement this approach.

      **Minor comments**

      Could you more explicitly describe a possible molecular mechanism through which the coupling acts?

      Thank you for your suggestion. We will more explicitly discuss likely transport mechanisms in the text.

      In Figure 1C it looks like different genes are coupling to different genes, so you may need to rearrange it.

      In our model, the level of CCA1/LHY is shared. Thus, CCA1/LHY from one cell can be considered to repress the expression of other interacting genes in the neighbour cell.

      Line 103: "We found that regional differences persist even under LD cycles, but cell to-cell minimized differences between neighbor cells." Missing word.

      Thank you for your correction.

      Line 124: "The coupling strength was set to 2 (Methods)." This is meaningless in isolation, so it would be better to briefly explain what the coupling parameter is before mentioning its value.

      Thank you for your suggestion, we will describe the coupling function in more detail.

      Through the text, I think De Caluwe should be corrected to De Caluwé

      Thank you for your correction.

      Typo line 493

      Thank you for your correction.

      Code and data are not made available.

      Model code will be made available from our project GitLab page: https://gitlab.com/slcu/teamJL/greenwood_tokuda_etal_2020

      Output of analysis of experimental data and simulations will also be made available on the GitLab page.

      Reviewer #3 (Significance (Required)):

      The authors motivate the paper by highlighting that their proposed model improves on phase-based models in that it describes underlying molecular mechanisms.

      From an experimental side, it's interesting that a model is developed and directly compared with measured spatio-temporal waves of gene expression. From a theoretical side, the authors address questions relating to oscillations, multi-scale modelling and noise robustness that also generalise to other systems. I therefore expect that both experimental and theoretical audiences will be interested in the results.

      There are many possible additions and modifications that could be made to the model, and so the model and analysis could provide a platform for future research. However, I can't comment on whether there are similar pre-existing models of the plant circadian clock that contain both a molecular description of the circadian clock as well as a spatial scale.

      We appreciate the reviewer’s view that the work is interesting to both experimental and theoretical audiences.

      Comments on Review #1:

      The time is rescaled in each cell, meaning that each cell has a unique period, but the dynamics remain deterministic and hence the peak-to-peak times will be exactly the same for each cell. I imagine this isn't completely consistent with single-cell data (if available), where peak-to-peak times are very likely to be variable due to noisy gene expression. In a future paper it would be interesting to analyse the system using stochastic differential equations.

      Please see our response to reviewer #1.

      Comments on Review #2:

      I agree on the following two points:

      1) It would add value to discuss whether the different ranking of light sensitivities by organ matches any available experimental data.

      Please see our response to reviewer #2.

      2) As the Reviewers point out, there are many possibilities for testing the robustness of the system to light clues, including varying the length of the day. Although outside of the scope of this paper, I wonder if it's possible to find data from a light sensor measuring light intensity across an entire year? Plugging such data into the model and measuring how the amplitude and period changes would be really interesting, in my opinion.

      Thank you for your suggestion. We also see this as an interesting future direction.

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      Summary:

      The authors start by taking a previously published model of the plant circadian clock and implement five changes: 1) updating the network topology to reflect some recent experimental findings, 2) make a spatial model loosely based on a seedling template 3) introduce coupling between cells based on shared levels of CCA1/LHY 4) randomly rescale time in each cell to induce inter-cell differences in period, 5) include a light sensitivity that depends on the region considered.

      For a certain configuration of light sensitivities/intensities, the different periods of oscillations in each seedling region roughly match that of experiments. With a sufficiently high coupling between cells, the system can also generate spatial waves, which are also observed in the experimental system.

      With pulsed light inputs the spatial pattern is still produced. The authors then investigate the robustness to environmental noise by generating stochastic light signals and show that the global synchrony, as measured with a synchronisation index, increases with cell-to-cell coupling strength. The paper is overall well-written, and the background and details of the analysis are well presented.

      Major comments:

      For the first part of paper, the output of the model is certainly the focus. There is virtually no discussion of the inferred parameters and how much confidence the authors have in their values.

      My main issue with the paper is about the section with noisy light signals, which is included in the title and is ultimately one of the main themes of the article.

      Specifically, on line 224:

      "This decrease in cell-to-cell variation revealed an underlying spatial structure (Fig 4D, middle and right, and S13 Fig), comparable to that observed under idealized LD cycles (Fig 4B, middle and right, and S12 Fig)."

      Firstly, I don't feel these conclusions match with the data presented. Comparing figure 4D middle and right with figure 4B middle and right shows a clear and pronounced loss in spatial structure. In its current form, this statement has to change, but I believe there are at least two other major issues with this figure:

      1) The figure is clearly designed to invite a comparison between the noise-free light cycles on the left with the noisy cycles on the right. However, due to how the noisy light is simulated, the variance of light signal increases AND the average intensity of light decreases by 50%. When comparing the left and the right, we therefore don't know whether the changes are due to differences in the average signal or differences from the stochasticity. I think the authors should simulate a noisy light signal with the same mean intensity level as the deterministic signal. . 2) The noise model for the light doesn't seem realistic. On line 484 is says:

      "We made the simplifying assumption that each cell is exposed to an independent noisy LD cycle due to their unique positions in the environment. LD cycles were input to the molecular model through the parameter L".

      In fact, this could be considered as an incredibly complex signal, because for 800 cells it means drawing 800 random light signals. The implication is that two adjacent cells receive statistically independent light signals. Depending on chance, one cell might receive tropical levels of light while its neighbour experiences a cloudy day. This affects the interpretation and conclusions from figures 4 and 5. I propose two different ways of improving the simulation of the noisy light signal:

      a) In one extreme case, all cells receive the same noisy light signal, and the other extreme, they all receive independent signals. You could consider a mixture model of light signals, where each cell receives \lambda L_global(t) + (1-\lambda) L_individual(t), where L_global(t) is a global light signal that is shared by all cells and L_individual(t) is a light signal unique to an individual cell. The mixing parameter \lambda controls how similar the light signal is between cells

      b) Clearly the light signal will differ depending on the region, but there will be some spatial correlation. You could also consider methods of simulating light such that neighbouring cells receive correlated signals, although this might be difficult.

      Assuming that the problem with the mean signal is corrected, do you expect the average spatial pattern to be the same between figure 4 B and D with no coupling (J=0) (although an increase in the variance between cells)? Perhaps not (owing to nonlinearities in the system), but it would be interesting to comment.

      The different periods in the different regions of the seedling are caused by differences in light sensitivity, which the authors claim is justified from refs 12-15. An alternative hypothesis is the that biochemical parameters such as degradation rates are different between regions. This is briefly alluded to in the introduction, but I think it would be interesting to discuss further. What would be the pros and cons of the two different mechanisms?

      I understand that the authors used a pre-existing model, but I must say that I find the way that light is incorporated into the model a bit confusing.

      On line 345 it says: "L(t) represents the input light signal (L = 0, lights off; L > 0, lights on) and D(t) denotes a corresponding darkness input signal (D = 1, lights off; D = 0, lights on)."

      Surely the only thing that matters biophysically is the number of photons hitting the plant? Could you explain why the model needs to have a separate "darkness signal" compared to just a single light signal?

      In the model, the light intensity changes depending on the region. It might make more sense for interpretability if instead there is an additional light-sensitivity coefficient that depends on the region, because at the moment I'm not sure what units L(t) is supposed to take.

      Minor comments

      Could you more explicitly describe a possible molecular mechanism through which the coupling acts?

      In Figure 1C it looks like different genes are coupling to different genes, so you may need to rearrange it.

      Line 103: "We found that regional differences persist even under LD cycles, but cell to-cell minimized differences between neighbor cells." Missing word.

      Line 124: "The coupling strength was set to 2 (Methods)." This is meaningless in isolation, so it would be better to briefly explain what the coupling parameter is before mentioning its value.

      Through the text, I think De Caluwe should be corrected to De Caluwé

      Typo line 493

      Code and data are not made available.

      Significance

      The authors motivate the paper by highlighting that their proposed model improves on phase-based models in that it describes underlying molecular mechanisms.

      From an experimental side, it's interesting that a model is developed and directly compared with measured spatio-temporal waves of gene expression. From a theoretical side, the authors address questions relating to oscillations, multi-scale modelling and noise robustness that also generalise to other systems. I therefore expect that both experimental and theoretical audiences will be interested in the results.

      There are many possible additions and modifications that could be made to the model, and so the model and analysis could provide a platform for future research. However, I can't comment on whether there are similar pre-existing models of the plant circadian clock that contain both a molecular description of the circadian clock as well as a spatial scale.

      REFEREE'S CROSS-COMMENTING

      Comments on Review #1:

      The time is rescaled in each cell, meaning that each cell has a unique period, but the dynamics remain deterministic and hence the peak-to-peak times will be exactly the same for each cell. I imagine this isn't completely consistent with single-cell data (if available), where peak-to-peak times are very likely to be variable due to noisy gene expression. In a future paper it would be interesting to analyse the system using stochastic differential equations.

      Comments on Review #2:

      I agree on the following two points:

      1) It would add value to discuss whether the different ranking of light sensitivities by organ matches any available experimental data.

      2) As the Reviewers point out, there are many possibilities for testing the robustness of the system to light clues, including varying the length of the day. Although outside of the scope of this paper, I wonder if it's possible to find data from a light sensor measuring light intensity across an entire year? Plugging such data into the model and measuring how the amplitude and period changes would be really interesting, in my opinion.

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      Summary:

      The manuscript presents an improved model of the circadian clock network that accounts for tissue-specific clock behavior, spatial differences in light sensitivity, and local coupling achieved through intercellular sharing of mRNA. In contrast to whole-plant or "phase-only" models, the authors' approach enables them to address the mechanism behind coupling and how the clock maintains regional synchrony in a noisy environment. Using 34 parameters to describe clock activity and applying the properties mentioned above, the authors demonstrate that their model can recapitulate the spatial waves in circadian gene expression observed and can simulate how the plant maintains local synchrony with regional differences in rhythms under noisy LD cycles. Spatial models that incorporate cell-type-specific sensitivities to environmental inputs and local coupling mechanisms will be most accurate for simulating clock activity under natural environments.

      We have the following major criticisms as follows

      1) When assigning light sensitivities in different regions of the plant, the authors assign a higher sensitivity value to the root tip (L=1.03) than they do to the other part of the root (L=0.90). We are curious why the root tip would have higher light sensitivity than the rest of the root. Is this based on experimental data (if so, please cite in this section or methods)? It seems that these L values were assigned simply to make sure they recapitulated the period differences observed in Fig. 2A. Are these values based on PhyB expression in those organs? Or perhaps based on cell density in those locations?

      2) In the discussion of the test where they set the "light inputs to be equal" in all regions to simulate the phyb-9 mutant, could the authors please clarify whether that means they set the L light sensitivity value equal in all regions? a. If they are referring to setting the L value equal to all regions, we suggest that this discussion be moved to the section about different light sensitivities instead of the local sharing of mRNA section. b. Additionally, is it possible to set the light sensitivity to zero for all parts of the plant? We think this would be more suitable to simulate the phyb-9 mutant phenotype.

      3) Based on the recent Chen et al. (2020) paper showing ELF4 long-distance movement, we think it would be of great interest for the authors to model ELF4 protein synthesis/translation as the coupling factor, in addition to the modeling using CCA1/LHY mRNA sharing. We understand you may be saving this analysis for a future modeling paper, but this addition to the paper could increase the impact of this paper.

      4) This model is able to simulate circadian rhythms under 12:12 LD cycles, which represents two days of the year-the equinoxes. We are curious if the model can simulate rhythms under short days and long days as well. We understand this analysis may be outside the scope of this paper and may require changing the values of the 34 parameters used but think it could be a useful addition here or in future work.

      And minor criticisms as follows

      1) In the first paragraph of the results section, it would be helpful for the authors to reference Table S1 when they mention the 34 parameters used to model oscillator function

      2) In the first paragraph of the section titled "Local flexibility persists under idealized and noisy LD cycles", it would be helpful for the authors to reference S12 Fig after the last sentence that starts "However, ELF4/LUX appeared more synchronized..."

      3) In the first paragraph of the section titled "Cell-to-cell coupling maintains global communication under noisy light-dark cycles", the authors refer to a "Table 1" but I think they mean to refer to Table S1"

      4) In Fig. 1, panel C is described as demonstrating the cell-to-cell coupling through the "level of CCA1/LHY". This phrasing is vague and we think could be improved to the "mRNA level of CCA1/LHY".

      Significance

      This work would be broadly interesting to other researchers studying cell-to-cell signaling and coupling of circadian rhythms in plants and other species where spatial waves of gene expression have been observed (i.e., mice and humans). Additionally, the computational modeling aspect of this work was easily interpretable for someone outside this expertise. Our expertise lies in plant circadian biology.

    4. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      A. Summary:

      In this modeling study, the authors devised a multicellular model to investigate how circadian clocks in different parts (organs) of plants coordinate their timing. The model uses a plausible mechanism to explain how having a different sensitivity to light leads to different phase and period of circadian clock, which is observed in different plant organs. The model allows for entrainment in Light-Dark (LD) cycles and then a release in always-light (LL) environments. The model disentangles numerous factors that have confounded previous experiments. In one instance, the authors assigned different light sensitivities to the different organs (e.g., root tip, hypocotyl, etc.) which unambiguously show that this one element alone - spatially differing sensitivity to light - is sufficient for recapitulating experimentally observed differences in periods and phases between plant organs. The model also recapitulates the spatial waves of gene expression within and between organs that experimentalists reported. At the sub-tissue level, the model-produced waves have similar patterns as the experimentally observed waves. This confirmation further validates the model. By having the cells share clock mRNA, from any clock component genes, showed the same, experimentally observed spatial dynamics. The main conclusion of the study is that regional differences (e.g., between different organs) in light senilities, when combined with cell-to-cell sharing of clock-gene mRNAs, enables a robust, yet flexible, circadian timing under noisy environmental cycles.

      B. Specific points:

      1.Lines 125-127: "To simulate the variability observed in single cell clock rhythms, we multiplied the level of each mRNA and protein by a time scaling parameter that was randomly selected from a normal distribution." - Why not add a white (Gaussian) noise term to these equations? How does multiplying by a random variable (for rescaling time) different from my proposal? Some explanation should be given in the text here.

      2.Does the spatial network model simplify calculations by assuming separations of timescales (e.g., for equilibration in concentrations of mRNAs that diffuse between cells)? If so, it would be good to spell these out in the beginning of the Results section (where the model is described).

      3.Lines 161-162: "....in a phase only model by local...." should be "....in a phase model only by local...."

      4.Lines 188-190: The authors observed that qualitatively similar/indistinguishable behaviors arose regardless of which elements are varied (e.g., global versus local cell-cell coupling, setting light input to be equal in all regions of the seedling, etc.). Then they claim here that "...these results show that the assumptions of local cell-to-cell coupling and differential light sensitivity between regions are the key aspects of our model that allow a match to experimental data." - I don't see how this follows from the observation almost any of the variations lead to the same behaviors in this section (spatial waves). Show the reasoning in the text here.

      5.Pgs. 9 -10: Section on "Cell-to-cell coupling maintains global coordination under noisy light-dark cycles": The simulation results rigorously support the authors' main conclusion here, which is that local cell-to-cell coupling allows for global coordination under noisy LD cycles. But I'm missing an intuitive explanation (or just any explanation) for why this is. At the end of this section, the authors should provide some intuition or qualitative explanation for the observations that they produced using their model in this section.

      6.Lines 261-262: Replace the present tenses with past tenses.

      7.Is the main idea that cell-to-cell coupling allows for averaging of fluctuations, between organs or cells within the same organ, while allowing for coordination of the average quantities? Is this responsible for both the flexibility and robustness observed under noisy environmental cycles?

      8.Line 304: Is it really true that the mammalian circadian rhythm is centralized? Don't some parts of our bodies have different circadian clock (e.g., slight differences in phase) than some other parts of our bodies?

      Significance

      Overall assessment:

      I enthusiastically recommend this work for publication after the authors address my comments below (please see "Specific points").

      The model's main strength is that the authors could vary each ingredient separately - light sensitivity of each cell/organ, which gene's mRNA diffuses between cells, cellular noise, local versus global cell-cell coupling, etc. Afterwards, the authors could determine which of these variations produces which experimentally observed behaviors. Another strength of the model is that it can reproduce not just one, but numerous, experimentally observed behaviors that are important for understanding circadian clocks in plants. Thus, the model is grounded in experimental truth and produces experimentally observed results. Crucially, since the authors could vary every single element in the model independently of the other elements, the authors are able to provide plausible explanations for why the experiments produced the results that they did (experimentally, a number of confounding factors prevented one from pinpointing to which element produced which observation).

      Another strength of the model is also extendable, by other researchers to investigate other plant physiologies in the future (e.g., circadian clock's influence on cell division). The authors highlight these future uses in the discussion section. Therefore, I believe that this work will be valuable to plant biologists, non-plant biologists who are interested in circadian clocks, and systems biologists in general.

      The manuscript is also well written and relatively easy to follow, even for non-plant biologists like myself.

      REFEREE'S CROSS-COMMENTING

      Comment on Reviewer #2:

      I agree with his/her major criticism #3 (ELF4 long-distance movement). I find this to be a reasonable request. Fulfilling it would increase the paper's impact.

      Comment on Reviewer #3:

      The reviewer's point (1) asks for a reasonable request. Regarding his/her point (2): This is also reasonable. I'd recommend his/her suggestion (a). In the end, I'd be interested to see how the authors respond to this (what function they choose to let adjacent cells be subjected to some correlated light-input intensity. I'd be happy with something simple such as < intensity > + noise, where <intensity> is a deterministic term that, for example, decreases exponentially as one moves away from some central cell. Basically, I'd let the authors decide how to implement this and accept their current implementation - no correlation in light-intensity between adjacent cells - as an extreme scenario, as this reviewer points out.

    1. Reviewer #3:

      I found the question, approach and analysis provide a clever framework for understanding how vigilance changes over time. I believe this work will contribute greatly to the literature. However, I have one main concern in the interpretation of the patterns of results and the a priori assumptions that are made, but never explicitly discussed or justified.

      The introduction makes it clear that the authors acknowledge that there may be multiple sources of interference contributing to declining vigilance over time: the encoding of sensory information, appropriate responses to the stimuli, or a combination of both. In the introduction, it would help if the authors review how infrequent targets affect response patterns.

      In addition, it would help if the theoretical approach and assumptions of the authors were explicitly stated. On p. 23, lines 481-483: The connectivity analysis between the frontal and occipital areas as a way to get at the effect of vigilance is useful, but some consideration of the theoretical justification for this analysis should be added here. The a priori assumption surrounding this analysis should be acknowledged and discussed in the interpretation of the pattern of results (e.g., p. 32, line 658). Based on the analysis between frontal and occipital areas, we have to assume it's the sensory processing alone, but this does not preclude other influences. For instance, effects could also occur on response patterns. These considerations should be added as caveats to the interpretation and to avoid the impression of a confirmation bias.

    2. Reviewer #2:

      In the manuscript "Neural signatures of vigilance decrements predict behavioural errors before they occur", Karimi-Rouzbahani and colleagues present a study which used a multiple-object monitoring task in combination with magnetoencephalography (MEG) recordings in humans to investigate the neural coding and decoding-based connectivity of vigilance decrements. They found that increasing the rarity of targets led to weaker decoding accuracy for the crucial feature (distance to an object), and weaker decoding was also found for misses compared to correct responses. They also report a drop in decoding-based connectivity between frontal and occipital/parietal regions of interest for misses, and they could predict upcoming performance errors early during a trial based on accumulative decoding accuracy for the relevant target feature.

      This is an interesting study with a quite complex paradigm and a very interesting analysis approach. However, the logic of the approach and the results are rather difficult to unpack, and I am not convinced that it is always correct. My main issues are: Firstly, it is not clear what role eye fixations play here. Participants could freely scan the display, so the retinotopic representations would change depending on where the participants fixate, but at the same time the authors claim that eye position did not matter. Secondly, the display of the results is very dense, and it is not always clear whether decoding for a specific variable was above chance or not. The authors often focused on relative differences, making it difficult to fully understand the meaning of the full pattern of results. Thirdly, the connectivity analysis appears to be a correlation of decoding results between two regions of interest. The more parsimonious interpretation here is that information might have been represented across all channels at this time. Lastly, while this is methodologically interesting work, there is no convincing case made for what exactly the contribution of this study is for theories of vigilance. It seems that the findings can be reduced to that a lack of decodability of relevant target features from brain activity predicts that participants will miss the target. I have outlined my specific comments below.

      1) Methods, Page 11: The authors state that "We did not perform eye-blink artefact removal because it has been shown that blink artefacts are successfully ignored by multivariate classifiers as long as they are not systematically different between decoded conditions (Grootswagers et al., 2017)." I actually doubt that this is really true. Firstly, the cited paper makes a theoretical argument rather than showing this empirically. Secondly, even if this were true, the frequency of eye-related artefacts seems to be of crucial importance for a paradigm that involves moving stimuli (and no fixation). There could indeed be systematic differences between conditions that are then picked up by the classifier (i.e. if more eye-blinks are related to tiredness and in turn decreased vigilance). The authors should show that their results replicate if standard artefact removal is performed on the data.

      2) Relatedly, on page 16 the authors claim that "If the prediction from the MEG decoding was stronger than that of the eye tracking, it would mean that there was information in the neural signal over and above any artefact associated with eye movement." In my view, this statement is problematic: Firstly, such a result might only mean that prediction from MEG decoding is stronger than decoding from eye-movements, but not relate to "artefacts" in general, to which blinks would also count. Secondly, given that the signal underlying both analyses is entirely different (and the number of features), it is not valid to directly compare the results between these analyses.

      3) Results: The Bayes-factor plots in the decoding results figures are so cramped that it is very difficult to actually see the individual dots and to unpack all of this (e.g., Fig 3). I'm wondering whether this complexity could be somehow reduced, maybe by dividing the panels into separate figures? The two top panels in Figure 3B should also include the chance level as in A. It looks like the accuracy is very low for unattended trials, which is only true in comparison to attended trials, but (as also shown in Supplementary Figure 1) it was clearly also encoded in unattended trials, which is very important for interpreting the results.

      4) The section on informational brain connectivity already contains a fair bit of interpretation and discussion in relation to the literature (e.g., "Weaker connectivity between occipital and frontal areas could have led to the behavioural misses observed in this study [...]"). This should be avoided.

      5) Relatedly, if I understand the informational brain connectivity analysis correctly, the authors only show that frontal and occipital/parietal patterns of decoding results are correlated? This means, if one "region" allows for decoding the distance to the object, the other one does too. However, this alone does not equal connectivity. It could simply mean that patterns across the entire brain allow for decoding the same information. For example, it would not be surprising to find that both ROIs correlate more strongly for correct trials (i.e. the brain has obviously represented the relevant information) than for errors (i.e. the brain has failed to represent the information), without this necessarily being related to connectivity at all. The information might simply be spread-out across all channels. The authors show no evidence that only these two (arbitrarily selected) "regions" encode the information while others do not. In my view, to show evidence for meaningful connectivity, a) the spread of information should be limited to small sub-regions, and b) the decoding results in one "region" should predict the results in another region in time (as for DCM).

      6) Predicting miss trials: The implicit assumption here is that there is "less representation" for miss trials compared to correct trials (e.g., of distance to object). But even for miss trials, the representation is significantly above chance. However, maybe the lower accuracy for the miss trials resulted from on average more trials in which the target was not represented at all rather than a weaker representation across all trials. This would call into questions the interpretation of a decline in coding. In other words, on a single trial, a representation might only be present (but could result in a miss for other reasons) or not present (which would be the case for many miss trials), and the lower averages for misses would then be the result of more trials in which the information was completely absent.

      7) Having said that, I am wondering whether the results of the subsequent analysis (predicting misses and correct responses before they occur) might be in conflict with my more pessimistic interpretation. If I understand this correctly, here the classifier predicts Distance to Object for each individual trial, and Fig 6B shows that while there is a clear difference between the correct and miss trials, the latter can still be predicted above chance level but never exceed the threshold? If this is true for all single trials, this would indeed speak for a weak but "unused" representation on miss trials. But for this the authors need to show how many of the miss trials per participant had a chance-level accuracy (i.e. might be truly unrepresented), and how many were above chance but did not exceed the threshold (i.e. might have been "less represented").

      8) In general, it is not clear to me how the brain decoding results were impacted by participants freely looking around on the screen. I am not convinced that decoding from the strongly reduced feature space of eye movements necessarily gives an answer. More detailed analyses of fixations and fixation duration on targets and distractors might indeed be strongly related to behaviour. What is decodable at a given time might just be driven by what participants are looking at.

      9) Discussion: The authors discuss their connectivity results in relation to previous studies on connectivity changes in mind wandering. However, given that the connectivity analysis here is questionable, I'm not sure these results can be meaningfully related.

      10) Overall, even if the issues above are addressed, the study only demonstrates that with less attention to the target, there is less evidence of representations of the relevant features of targets in the brain. The authors also find the expected decrements for rare targets and when participants do not actively monitor the targets. While this is interesting, in particular to directly show this in neural representations, I am not sure whether this is also a conceptually novel contribution to the field. It seems that these general effects are quite well-known from previous work (although demonstrated with different methods)? I am not sure how these findings actually contribute to "theories of vigilance", as claimed by the authors.

    3. Reviewer #1:

      Karimi-Rouzbahani and colleagues investigate vigilance and sustained monitoring, using a complex and intriguing task in which participants attend to multiple colored dots moving towards the center and occasionally make. They use computationally sophisticated multivariate analyses of MEG data to disentangle attentional factors in this task. The authors demonstrate that they can decode spatial location of the dot (left vs. right) as well as the spatial distance from the critical deflection location, and relate the multivariate decoding ability to features of the task. In addition, they develop methods that can predict errors by accumulating information from distance-based classifiers in the time window preceding behavioral responses. While I was intrigued by this paper, I had numerous questions about the details of their multivariate pattern analyses and the conclusions that they drew from them.

      1) One key finding was that while classifying the direction of the dots was modulated by attention, it was insensitive to many features that were captured by a classifier trained to decode the distance from the deflection. In some ways, I find this very surprising because both are spatial features that seem hard to separate. In addition, the procedures to decode direction vs distance were very different. Therefore, I wonder if there would still be a lack of an effect if the procedure used to train the direction classifier was more analogous or matched?

      2) The distance classifier was trained using only correct trials. Then in the testing stage, it was generalized to either correct or miss trials. While I understand the rationale for using correct trials, I wonder if decoding of error prediction is an artifact of the training sample, reflecting the fact that misses were not included in the training set?

      3) By accumulating classifiers across time, it looks like classifier prediction improves closer to deflection. However, this could also be due to the fact that the total amount of information provided to the classifier increased. I understand the rationale that additional information improves classification, but I wonder if that is because classifiers are relatively poor at distinguishing adjacent distances? Alternatively, perhaps there is a way to control for the total amount of information at different timepoints (e.g., by using a trailing window lag rather than accumulation), or contrast the classifier that derives from accumulating information with the classifier trained moment-by-moment?

      4) The relationship between the vigilance decrement and error prediction. Is vigilance decrement driving the error prediction? That is, if errors increase later on, and the signal goes down, then maybe the classifier is worse. Alternatively, maybe the classifier predictions do not necessarily monotonically decrease throughout the experiment. I wonder if the classifier is equally successful at predicting errors early and late?

      5) When decoding of distance, one thing I found intriguing is that active decoding declines from early to late, even though performance does not decline (or even slightly improves from early to late). This discrepancy seems hard to explain. Is this decline in classification driven by differences in the total signal from early to late?

      6) I noted that classifier performance was extremely high almost immediately after trial onset. Does the classifier perform at chance before the trial onset, or does this reflect sustained but not stimulus-specific information?

    4. Preprint Review

      This preprint was reviewed using eLife’s Preprint Review service, which provides public peer reviews of manuscripts posted on bioRxiv for the benefit of the authors, readers, potential readers, and others interested in our assessment of the work. This review applies only to version 4 of the manuscript.

      This manuscript is under revision at eLife.

      Summary:

      Karimi-Rouzbahani and colleagues investigate vigilance and sustained monitoring, using a multiple-object monitoring task in combination with magnetoencephalography (MEG) recordings in humans to investigate the neural coding and decoding-based connectivity of vigilance decrements. Using computationally sophisticated multivariate analyses of the MEG data, they found that increasing the rarity of targets led to weaker decoding accuracy for the crucial feature (distance to an object), and weaker decoding was also found for misses compared to correct responses.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reviewer #1 (Evidence, reproducibility and clarity (Required)):

      The authors generated and analyzed a great amount of single-cell RNA FISH data over time on circadian genes (Nr1d1, Cry1, Bmal1), and performed model selection/fitting to explain the observed mRNA distributions. They decomposed the mRNA variability into distinct sources, and showed that intrinsic noise (transcription burst) dominates the variance. Therefore, looking at transcript counts may not be feasible to estimate single-cell circadian phase. However, the study is quite descriptive and ends up being a bit dissatisfying, so if the authors could improve this aspect by perhaps analyzing a mechanism on cell-specific burst size (F5), gene-specific dependence on cell size (beta), or the positive/negative gene-pair correlations (rho), it would help quite a bit in this regard. The model selection/fitting itself was not really sufficient to compensate for this, as it stands .

      We thank the reviewer for appreciating the new smFISH data, the analyses performed, and the consequences regarding phase inference from single cell snapshots.

      The reviewer suggests “perhaps analyzing a mechanism on cell-specific burst size (F5), gene-specific dependence on cell size (beta), or the positive/negative gene-pair correlations (rho)”, and we have thus added a new Results paragraph (lines 281-316) and two new Supp Figures 13 and 14 to directly address this point.

      Specifically, we have added a dynamic, stochastic model of the circadian clock in order to add mechanistic insight into the parameters of the preferred model M4. Concerning \rho, in the initial manuscript we suggested that the correlations of cell-specific burst sizes (described by the parameter \rho) in the preferred model M4 could result from the underlying network topology. To substantiate this claim, we have now added an analysis of a stochastic model of the clock that includes gene-gene interaction amongst the core-clock genes. The core-clock network involves variables (such as protein levels), parameters (such as mRNA/ protein half-lives) and additional genes (such as Clock) that are not directly measurable in our experiments; and thus offering a detailed mechanistic mathematical model for our data is therefore not realistic. We therefore developed a simplified mathematical model for the three measured genes to explore the underlying mechanisms that could control the parameter \rho, as the referee suggests. As a starting point, we used the circadian clock gene network topology for Nr1d1, Cry1 and Bmal1 as modelled in Relógio et al. (Relógio et al., 2011) (see new Supplementary Material). To keep the model close to the inference framework, we used oscillatory functions for the burst frequency while the transcription rate (and hence the burst size) for each gene is affected by the protein levels of the other genes in the network. Using stochastic simulations we show that, for particular configurations of feedback where the negative repression of Nr1d1 by CRY1 is high, the network can generate positive mRNA correlation between Bmal1/Cry1 mRNA and negative correlation between Nr1d1/Cry1mRNA, as observed in our data (Figure 2C). Furthermore, using the same inference framework as for our data on the simulated mRNA distributions, the obtained \rho is positive for Bmal1/Cry1 and negative for Nr1d1/Cry1, which was also found for our data (Figure 3C). Even though the model is clearly a simplified representation of the clock, these simulations give credence to the scenario that the \rho parameter obtained from the data is a signature of the underlying network topology.

      While the emphasis of the paper is certainly on parameter inference of the single-cell RNA FISH data, we believe the addition of this dynamic model provides more mechanistic insight into the results of the model fitting and hence significantly more depth to the article.

      \*Specific comments:** *

      1.It is hard to distinguish the RNA FISH signals (Figure 1A, 2B). It is probably technically challenging as the mRNAs are of low abundance. I think it may help if they adjust the contrast for the cytoplasm stain or just delineate the cell boundaries.

      Thank you for pointing this out, and we agree that our rendering of the FISH images was not optimal and have now significantly improved it (see new Figure 1A and 2B). Considering the other reviewers’ comments related to the images, we have now 1) added the cell contours as requested; 2) use red/green for the smFISH signal in the pairs of genes; 3) we have improved the contrast to make it easier to distinguish the RNA FISH signals.

      2.In Figure 2C, the authors showed gene-pair correlations with cells of all sizes. Could the authors do a size-dependent extrinsic-noise filtering (Padovan-Merhar, Dev. Cell, 2015; Hansen et al., 2018, Cell Systems) to better dissect the correlations?

      We used negative binomial distributions to directly model the number of mRNA in the cells, which is a natural choice given that the raw smFISH are integer counts. The model incorporates cell size dependencies in a unified framework, which predicts the joint distribution of raw counts, which is why we showed raw counts in the main figure. That being said, as the referee suggests, it can be useful for exploratory purposes to see the relationship between the measured genes while regressing out the contribution of cell area, and we have now added this analysis as Supp Figure 9. On line 156-161 we write:

      “To also estimate the correlation between genes while accounting for cell area, we regressed out the area for each gene and recalculated the correlation coefficients [37,38]. Since all genes are positively correlated with area (Fig. 2A), this processing shifted the correlations for both pairs of genes. Specifically, the correlation coefficients for the area-filtered mRNA counts decreased but remained positive for Bmal1/Cry1 and became more negative for Nr1d1/Cry1(Supp Figure 9).”

      3.For fitting model M3, as the authors pointed out, there are many local minima. Is the fitting score truly sufficient to eliminate the possibility for partial synchrony especially considering that the authors didn't show how effective the Dex treatment was to synchronize the circadian phase?

      Thank you for this comment. In fact, we didn't mean to fully eliminate the possibility of imperfect synchronization, but have tried our best to address it both experimentally and with modeling.

      Experimentally, in addition to the Dex treatment, we also compared with a condition in which we entrained the cells using temperature cycles, which is a standard in the field to achieve the best synchronization. We obtained a fold change of 2.1, which was in the range of previous studies (Saini, et al, 2012) and was slightly higher than with Dex synchronisation (1.6). Given that the improvement was not high and that it was important for us to study the system under free-running conditions and not in an entrained state (i.e. phase locking, which distorts the free dynamics and noise characteristics of the oscillator), we used the Dex protocol.

      Model 3 was used as a computational approach to correct for the individual phases. In addition to the difficult optimisation landscape, the challenge with model M3 also resides in the difficulty of estimating an individual phase for each cell, as the two mRNA counts measured in each cell do not contain sufficient phase information. This could potentially be resolved by either measuring more genes simultaneously, but is, however, beyond the scope of the present manuscript. We have added discussion on this to the text on lines 244-248:

      “Thus, it was apparently difficult to use model M3 to correct the individual phase for each cell, likely due to the fact that the two mRNA counts measured in each cell do not contain sufficient phase information, and that the global optimisation problem contains many local minima. This could potentially be improved by measuring more genes simultaneously.”

      We have also added a new Results section (lines 305-316) and Supp Figure 14 to show that imperfect synchrony alone cannot explain the correlation structure observed in our data. Indeed, if two genes have a similarly phased oscillation, the expression of the two genes will be positively correlated (as shown in the new Supp Figure 14). Similarly, when the oscillations are in anti-phase, negative correlations will be found. Given that Nr1d1 and Cry1 are closer in phase than Bmal1 and Cry1, one would expect that the correlation between Nr1d1 and Cry1 (once accounting for area) would be more positive than for Bmal1 and Cry1, which was not found in the data (area-corrected correlations shown in Supp Figure 9). It therefore seems unlikely that the observed correlations could be caused by imperfect synchrony alone. Together with our simulations of the gene network (described above), we therefore argue that gene-gene interactions are a more plausible mechanistic explanation of the correlations observed in our measured bivariate mRNA distributions.

      4.Regarding model M4, the authors added a cell-specific noise term without specifying the contributing factors. Typically adding degrees of freedom should improve fitting and make it easier for a model to fit, why not in this case? Can the authors provide some explanations/mechanisms.

      We believe there has been a misunderstanding regarding model M4. By adding parameters, model M4 is indeed easier to fit. There is even a problem of overfitting whereby the burst frequency becomes unrealistically high and the model effectively fits a Poisson distribution to each individual cell. To avoid this, we lock the burst frequency values to the posterior mean values from model M2. After describing model M4, we write (lines 260-265):

      “When all parameters are free, we noticed that the burst frequency can become unrealistically high due to a tendency to overfit to individual cells, and we therefore locked the burst frequency to the posterior mean values from model M2. The PSIS-LOO scores overall favoured model M4 (Fig. 3B), and the predicted joint probability density shows good similarity to the observed data (Fig. 3D) (all time points shown in Supp figure 11).”

      Regarding the above comment in the reviewer’s summary on contributing factors of model M4 we added a simple dynamical model that attempts to explain at least one possible mechanism of generating correlations in cell-specific bursting parameters (see above).

      5.The authors should include the number (range) of cells analyzed in the figure legends.

      We have now added the number of cells used at each time point to the legend of Figure 1D. To respond to Reviewer #2 we have also added details on the number of smFISH replicates used at each time point. The number of cells for each replicate is shown in Supp Figures 2-5.

      Reviewer #1 (Significance (Required)):

      Overall, we felt conflicted about the manuscript. On one hand, the authors generated and analyzed a great amount of single-cell RNA FISH data over time on circadian genes. On the other hand, the manuscript was a bit dissatisfying/descriptive. If the authors could provide and analyze some sort of mechanisms on cell-specific burst size (F5), gene-specific dependence on cell size (beta), or the positive/negative gene-pair correlations (rho) it should help improve the manuscript.

      We thank the review for the suggestion to expand on the mechanistic interpretation, which we have followed. In addition, we would like to emphasise that a similar smFISH analysis of the core circadian oscillator has never been done, and we believe our data represents a significant contribution to the field. Moreover, our quite generic probabilistic inference framework for smFISH using mixture models to describe intrinsic (transcriptional bursting) and extrinsic fluctuations is also novel and the code provided (written using the Stan probabilistic programming language) might find a wide applicability.

      Concerning the mechanistic description, as described above, we added a stochastic, dynamic model of gene expression and propose that gene-gene interactions within the core-clock network topology represent a plausible mechanism for generating correlated burst parameters between genes, which are a feature of the preferred model M4 found during inference. We additionally added an explanatory figure to argue that, given the phase relationship between genes, imperfect synchronisation alone cannot explain the observed correlations that we observe between the pairs of genes. Together, this analysis provides more mechanistic insight into the underlying factors controlling the gene-gene relationships in our measured bivariate mRNA distributions.

      \*Referees cross-commenting** *

      I agree with Reviewer #3 regarding expanding the discussion to include the Shah & Tyagi and Raj et al citations on buffering. However caution should be exercised regarding ref 26 as it is quite controversial and subsequent analyses came to different conclusions (PMID: 30359620 and 30243562). The general consensus is that nuclear buffering of transcript noise (proposed in ref 26) is not a general phenomenon (ref 27 is specific to the calcium response pathway). In fact, the presence and evolution of specific pathways to buffer transcriptional noise, such as protein-protein mechanisms (Shah & Tyagi) or extended half-life proteins (Raj et al. and others), argues that transcript fluctuations are not probably buffered in general.

      Following the suggestion of Reviewer #3, we have expanded the Discussion to include the references cited (Shah & Tyagi, Raj and others).

      Previous work from our lab is also nuancing the conclusions from references 26 and 27. Specifically, buffering effects are expected to be highly gene-specific (3’UTR), and in fact we have not seen those with our unstable construct during live-cell imaging (Suter et al., 2011; Zoller et al., 2015). We have also added text in order to explicitly state that subsequent papers have nuanced the general claims in references 26 and 27. In the text we write (lines 335-342):

      “One explanation for the low intrinsic fluctuation in these studies is that transcriptional fluctuations are filtered by nuclear retention, though other reports suggest that Fano factors (variance/mean, a measure of overdispersion compared to the Poisson distribution) can be even larger in the cytoplasm than in the nucleus [38]. In the cells used here, the strong signature of transcriptional bursting and high intrinsic noise is consistent with live imaging of a Bmal1transcriptional reporter in the same cell line under similar growth conditions, where intrinsic noise was estimated to be 4-times larger than extrinsic noise [23].”.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)):

      \*Summary:** *

      The authors study experimentally and computationally the dynamic transcription of circadian clock genes over time in individual cells with single molecule RNA-FISH with the aim to understand how different noise sources contribute to single cell transcription variability and basic functions of circadian clocks. The authors integrate experiments with computational modeling to understand biology.

      \*Major comments:** *

      This study has some major limitations that need to be addressed to test the model usefulness, to understand noise sources and to gain biological insights into circadian clocks.

      We thank this reviewer for the constructive feedback which enabled us to significantly strengthen the revised manuscript.

      The limitations are on the experiments, the computational implementation of the modeling and the integration of experiments with models.

      Although the experimental datasets contain several hundred cells per time point for multiple time points, only a single replica experiment is presented. From the presented data it is not clear how reproducible these temporal patterns are and if indeed differences between timepoints can be resolved if multiple biological replica experiments have been analyzed. To address this point at least three biological experiments needs to be presented and analyzed for each of the genes. Plotting the SEM on the means in figure 1B is misleading because several hundred cells have been measured which automatically makes the error small. The SEM just describes how well we can determine the mean from a distribution. Instead a mean and std from the biological replicas need to be plotted to show how experimental variability in experiments is resulting in the described expression pattern. This is similar to RNA-seq data or RT-PCR from multiple replica.

      We certainly agree that demonstrating reproducibility is important. Note that our smFISH data is from three independent cell culture dishes and microscopy slides, which included independent cell synchronization. This was described in the Methods but we agree that the data presentation was not showing the individual replicas, which we have now added. In Figure 1B, we now show the mean of each replicate for each time point. While the reviewer suggested displaying the mean and standard deviation across replicates, we show all data points at each time point to make it even more transparent. The mRNA distribution of each replicate is also shown in Supp Figures 2-5, together with individual quantification of mean, coefficient of variation and number of cells.

      In addition, to further demonstrate the reproducibility of the temporal patterns we have performed an additional independent experiment on four time points. This experiment shows that the oscillatory patterns for Nr1d1 and Cry1are clearly significant and reproducible (new Supp Figure 7). The combination of the replicates shown for the main experiment (Supp Figures 2-5) and the new replicate experiment (Supp Figure 7) shows that the oscillatory temporal patterns for the mean mRNA levels are robust and reproducible, and in fact similar as those found in bulk analyses (Ukai-Tadenuma et al., 2011; Hughes et al., 2009), which is expected.

      It is also not clear how good the cell segmentation works and how does cell segmentation influence the analysis. In figure 1A show the segmentation of the cell boundary together with the membrane stain.

      Thanks to this and other reviewers’ comments, we have now significantly improved the presentation of the FISH images. We have now 1) added the cell contours as requested; 2) used red/green for the smFISH signal in the pairs of genes; 3) we have improved the contrast to make it easier to distinguish the RNA FISH signals.

      We have also added Supp Figure 1 to show that the cell segmentation we used is reliable. In fact, as we had described, we used the sum Z-stack projections of the red channel (Wu et al., 2018), which we found provides the most accurate cell segmentation. We now show in Supp Figure 1 that the obtained segmentation shows convincing agreement with the cell autofluorescence .

      The authors use the RNA mean and RNA-FISH distributions and combine this data to build and compare different models. How do you know that the given data fulfils the central limit so that a model describing the mean is an adequate approach? To test this point, the authors should show through subsampling from the data and the model that indeed their data sets have enough cells to fulfil the central limit theorem.

      This comment reflects a misunderstanding of our approach, which we now try to better explain. In our inference framework we use a negative binomial (NB) distribution (and mixtures of NBs) to model the full distribution of mRNA counts, and our approach is therefore not based exclusively on the mean of the distribution. The estimation of model parameters and comparison of models is performed using the PSIS-LOO optimisation procedure (see below). The mixture model of NB binomials makes a few assumptions which we had clearly stated. In fact it captures both bursty transcription (in the limit of short bursts as is biologically plausible, which yields the NB distribution), and cell-to-cell variability (extrinsic noise) captured by the mixture. The suitability of the NB to model bursty transcription is established (Raj et al., 2006), and it is parameterized by a mean and a dispersion coefficient, such that the CV of the distribution is the inverse of the burst frequency (Zoller et al., 2015). Therefore the mean is indeed an important parameter of the model, but we do not see the relationship with the CLT. The used probabilistic inference (PSIS-LOO: Pareto-Smoothed Importance Sampling Leave-One-Out, Vehtari et al. 2017, see below) is established and state-of-the-art for selecting models of the appropriate complexity and we are not aware of a similar previous quantitative model for smFISH analysis.

      We have now added significantly more explanations both on the general approach as well as the methodological details in a fully-revised Methods section to avoid further misunderstanding.

      A strength of the manuscript is that several competing and biologically meaningful models have been generated. However, the manuscript lacks rigor in terms of how fitting and model selection is performed. It is not clear how good the models fit the data. To address this point, the authors should visually compare the model fits to the data and plot their fit errors as a function of model complexity.

      We fully agree that comparing different models using a model selection approach is a powerful methodology, in fact it is arguably the most systematic way to approach modeling problems in quantitative biology. Model selection is an active research area and there have been significant developments recently. Here, we used a state-of-the-art and established Bayesian approach (PSIS-LOO: Pareto-Smoothed Importance Sampling Leave-One-Out, Vehtari et al. 2017), which is certainly rigorous and more objective than visual comparison. The PSIS-LOO is conceptually similar to other approaches of model performance such as AIC or WAIC, and the entire field of model selection aims at establishing rigorous methods to assess the tradeoff between fit errors and model complexity. In PSIS-LOO, this is done by using pareto-smoothed importance sampling to estimate the expected log pointwise predictive density for a new dataset using leave-one-out cross-validation. The PSIS-LOO is the currently recommended metric for measuring model performance in Bayesian analysis (Vehtari et al., 2017) and is considered superior to other approaches such as computations of Bayes factors since it is less sensitive to model priors (Gelman et al. 2013). The performance of the models as measured with PSIS-LOO is shown in Figure 3B. As already mentioned, we have added further details as to how the fitting and model selection is performed in a revised Methods section. We agree that visual comparison is useful to gain intuition and this is why we showed the bivariate distributions in Figure 3D and in Supp Figure 11.

      Regarding the comment on “fit error”, note also that we probabilistically model the full mRNA distribution for each gene. In each cell, there is a likelihood score that measures the likelihood of observing the measured mRNA count given the modelled probability distribution. As our approach is based on this likelihood, the notion of “fitting error” needs to be replaced by the log likelihood (‘fitting error’ is mathematically equivalent to a log-likelihood when the noise model is Gaussian, which is not the case here).

      Another limitation is that the models have not been validated for example by using them to make predictions. One type of prediction could be to fit the model to one biological replica and then predict the other replica (cross validation). Another prediction would be to take the distribution fitted to the experimental data and then compare the model mean to the experimental mean.

      Thank you for this comment. As explained above, we used the state-of-the-art PSIS-LOO to measure the predictive performance of the models, which approximates the result of leave-one-out cross-validation using the full data set. To further assess the predictive capabilities of the model, we have now also added a “leave-replicate-out” cross-validation, as the reviewer suggests (new Supp Figure 12). The aim of our “leave-replicate-out” cross-validation was to test how well the predictions of each model generalise to independent cells that are not in the training set. To do this, we trained each model while omitting the data from one gene on a test slide. We then calculated the likelihood score of the test slide using the parameters from the training set, and repeated this for all slides. Similarly to the PSIS-LOO, the results of the leave-replicate-out cross-validation convincingly show that model M4 has the highest predictive performance. This is now described in the updated text on lines 265-271.

      The results from fitting and prediction should be plotted as a function of model complexity. This kind of analysis will illustrate how model complexity is supported by the data.

      As already mentioned, we used state-of-the-art algorithms to analyze prediction vs. complexity. With the above addition, we now have two methods of calculating the predictive performance of each model: the approximate leave-one-out score as measured with PSIS-LOO and the leave-replicate-out cross-validation. For each model, the PSIS-LOO score is plotted in Figure 3B and the leave-replicate-out cross-validation score is shown in Supp Figure 12.

      In the method section on models, a biological motivation must be presented to justify the different model assumption.

      Thank you for pointing out that the biological justification of the models needed to be expanded. In addition to the improved justifications already provided in the Results section, we have now updated the Methods section such that a biological motivation is included for each model.

      How do the models that fit the distributions describe the mean?

      As explained above, the inference is performed on the entire distributions, using a family of distributions (mixtures of NBs) which are parameterized in a biologically relevant manner (transcriptional bursting + extrinsic noise). The mean and variance of the distribution are now described on lines 585-586 in addition to Figure 3A.

      It is necessary to list model parameters for each of the models, their description, their parameter values, their parameter uncertainty and units of each parameter.

      Thank you, this has now been added as Supplementary Tables 2-5.

      It is not clear to me how the joint probability in figures 2,4, S2 and S4 have been used to fit the model.

      Again, the joint distributions are modeled using mixtures of NBs and the inference is performed on the entire dataset at once using a log-likelihood approach. This uses all the data at once, and it is embedded in a Bayesian model selection method. The way that the joint probability is used is now clarified in the revised Methods section and in the Results section (lines 208-214):

      “For both models M1 and M2, the likelihood of observing the data given the parameters of the model is evaluated using the model-specific NB distribution and the mRNA counts for both genes in each cell. This is performed for both Bmal1/Cry1 and Nr1d1/Cry1 pairs across all time points, and this likelihood is combined with model priors to define the posterior parameter distribution for each model (Methods). We applied Hamiltonian Monte Carlo sampling within the STAN probabilistic programming language to sample the posterior distribution and infer model parameters 40.”

      How do the models make sense in the context of the fact that human genes exist as a diploids?

      This is a good point, although note though that the 3T3 cells are from mice and not humans. 3T3 cells are tetraploid, and it turns out that under the justified assumption that the bursts are short (Zoller et al., 2015; Suter et al., 2011), the number of alleles rescales the burst frequency, i.e. the effective (observed) burst frequency equals the number of alleles times the burst frequency per allele, but it does not change the shape of the distributions. On line 580-582 we have now written: “Since 3T3 cells are tetraploid, and, again assuming that the bursts are short, the inferred burst frequency for tetraploid cells will be approximately four times that of a single allele.”

      The variance decomposition is shortly described but no results are presented to show how this is done. This should be better explained.

      The variance decomposition we used is not a new result; in fact, we used the analytical results of Bowsher, C. G. & Swain, P. S. “Identifying sources of variation and the flow of information in biochemical networks” (PNAS, 2012). The mathematical proofs of the formula we use are contained within that reference; however, we have re-written this section to make it clearer to the reader (lines 688-718).

      \*Minor comments:** *

      In figure 3A, it is not clear to me what these different plots relate to the models. It is also not clear what are equations that describe each model.

      The Methods section has now been improved to show the full data-generating mechanism for each model, and each model has its own section title to make it easier to find. We have also improved the legend for Figure 3 to make the relationship to each model clearer.

      The legends in figure 3 are not very informative. More details need to be presented to understand this figure.

      Thank you for pointing this out, and we have now re-written the figure legend for Figure 3 to make the figure clearer.

      Reviewer #2 (Significance (Required)):

      This is an interesting and important topic with the potential to have general implication of how to model periodic single cell gene expression data and eventually better understand circadian clocks. This study will expand on other modeling studies of circadian clocks and has the potential to advance the field (PMCID: PMC7229691). I personally have done similar analysis and experiments in another system and biological context which has demonstrated the power of this approach if implemented rigorously. I am not an expert in circadian clocks in human cells.

      We thank the reviewer for appreciating the implications for the circadian and single cell gene expression community. Note that to our knowledge, modeling smFISH counts using mixtures of negative binomials combined with Bayesian model selection has not been done. It is both highly relevant biologically (combines intrinsic and extrinsic fluctuations in a rigorous way), general and its applicability extends far beyond the circadian oscillator. Therefore, this approach for quantitative smFISH data analysis also fills an important methodological gap.

      \*Referees Cross commenting** *

      Reviewer #1:

      I agree with the assessment that model fitting and model selection was not sufficient. But I disagreed that the data is enough. Although many cells and time points are analyzed, there is no evidence of how reproducible each mRNA distribution can be measured at each time point. I think reproducibility is key and will also help with the model fitting and identification.

      Regarding the point on reproducibility, we have made the following four changes:

      1. We have added an independent 4 time-point experiment to show that the oscillatory patterns of the distributions are reproducible (Supp Figure 7).
      2. In Figure 1 we now also show the mean of each replicate for the main experiment (Figure 1B).
      3. We also show the mRNA distributions of each replicate in Supp Figures 2-5.
      4. We have added the “leave-replicate-out” cross-validation to show that that the model performance of the preferred model generalises to independent slides that were not included in training (Supp Figure 12). In responding to Reviewer #1 regarding the modeling, we have now also added a simplified dynamical model of circadian clock expression to add mechanistic insight into our proposed models. Overall, we have significantly expanded the description of the model selection approaches to help readers who are less familiar with Bayesian model selection methods.

      Reviewer #3:

      Regarding the red background, my understanding is that this comes from the probe hybridization. This is maybe because the probe concentration has not been optimized or the number of probes per gene is low and the signal to noise is not so good.Or it could be auto fluorescent background. In this case a different fluorophore needs to be used to avoid this problem.

      Thank you for those comments, and we agree with all reviewers that the presentation of the images needed to be improved. It turned out that in Figure 1, we had shown the cell mask in red so it is clearly not related to probe concentration or autofluorescence. We have now removed the cell mask channel from the main images which allows highlighting better the smFISH signals. All smFISH images for Figures 1 and 2 have been much improved, and we’ve added a new Supp Figure 1 to show the performance of our cell segmentation.

      Reviewer #3 (Evidence, reproducibility and clarity (Required)):

      In this paper Nicholas et al image mRNAs encoding the key controllers of circadian rhythms, Rev-erba, Cry and Bmal1 in single cells over time. It was shown earlier that single cells exhibit circadian rhythms using reporter genes. A large number of studies have shown that transcription is an inherently stochastic process, which raises a question as to how single cells are able to achieve their rhythms on the face of this noise. Their results show that the number of mRNAs for the three genes exhibit the expected periodicity, but this periodicity is associated with significant cell-to-cell variation. They also explore to what extent this variability derives from stochastic transcription vs other sources of variation that are extrinsic to the genes. The results are interesting and experimental and modeling results are important (however this reviewer is not able to judge the veracity of mathematics that underlay the models).

      We thank this reviewer for appreciating the importance of our work.

      \*Some of the concerns that arose are listed below:** *

      1.The images show an annoying red background. If the red is HCS cell mask, it should be removed, and RNA presented on grey scale. This will make a better presentation. The red hue also appears in fig 2 b but here it is one of the RNA. I suggest in Fig 2 one RNA can be presented in green and the other in red, while the nuclei in blue.

      Thank you for this comment. We had indeed shown the cell mask in the red channel and now removed it. Together with the other suggestions and comments from the reviewers, we implemented the following changes: 1) added the cell contours as requested; 2) use red/green for the smFISH signal in the pairs of genes; 3) we have improved the contrast to make it easier to distinguish the RNA FISH signals. The presentation of the images is now much improved.

      2.This paper and a few others talk about the cell size contributing to the cell-to-cell variability in mRNA numbers. Where does it come from physically? One can imagine based on the cell cycle stage there could be more than two copies of then gene in a cell, which will yield more RNAs, but they say that their cells don't have much cell cycle variability. Perhaps a clearer discussion is called for rather than just being polite to other investigators.

      The referee is right that several studies observed empirically that larger cells show more mRNA molecules in smFISH experiments (Padovan et al., 2015; Kempe et al., 2015). In Padovan et al. (2015), the authors found that transcriptional burst size changes with cell volume and burst frequency with cell cycle. The main theory for transcription scaling with cell volume is to maintain transcript concentration. Using cell fusion experiments, they showed that cellular size can directly and globally affect gene expression by modulating transcription. Furthermore, they proposed that the mechanism underlying the global regulation integrates both DNA content and cellular volume to produce the appropriate amount of RNA for a cell of a given size, which is consistent with a model whereby a factor limiting for transcription is sequestered to the DNA. We used these results to propose a model whereby burst size scales with area, and we found an increase in predictive performance (compare M2 with M1 in Figure 3B). While our model selection supported the inclusion of cell area, the variance decomposition showed that the fraction of variance due to cell area ranged from 4.2% for Nr1d1 to 17.6% for Bmal1. We have now expanded the introduction to discuss this in more depth (lines 73-80) as requested.

      3.References 26 and 27 are cited for 10-80% of variance due to gene extrinsic sources. These references actually deny that there is a significant transcriptional noise in most genes. Again, stronger discussion is called for.

      As mentioned in the reply to Reviewer 1, previous work from our lab is also nuancing the conclusions from references 26 and 27. Specifically, buffering effects are expected to be highly gene-specific (3’UTR), and in fact we have not seen those with our unstable construct during live-cell imaging (Suter et al., 2011; Zoller et al., 2015). We have also added text in order to explicitly state that subsequent papers have nuanced the general claims in references 26 and 27. In the text we write (lines 335-342):

      “One explanation for the low intrinsic fluctuation in these studies is that transcriptional fluctuations are filtered by nuclear retention, though other reports suggest that Fano factors (variance/mean, a measure of overdispersion compared to the Poisson distribution) can be even larger in the cytoplasm than in the nucleus [38]. In the cells used here, the strong signature of transcriptional bursting and high intrinsic noise is consistent with live imaging of a Bmal1transcriptional reporter in the same cell line under similar growth conditions, where intrinsic noise was estimated to be 4-times larger than extrinsic noise [23].”.

      4.The results raise a very important question, whether and to what extent the transcriptional noise propagates to the next step of gene regulation and are there buffering mechanisms in the cell. For example, Raj et al, Variability in gene expression underlies incomplete penetrance, Nature 2010, show that alternative pathways serve to buffer the impact of gene expression noise. Similarly, Shah and Tyagi, Barriers to transmission of transcriptional noise in a c-fos c-jun pathway, Mol Syst Biol, 2013, show that variability in mRNA is buffered at protein level and the level of protein-protein complexes. Furthermore, they show that to the extent those vary, the chromatin intrinsically buffers against the fluctuations in numbers of transcription factors. Mention of these and other studies will enrich the paper.

      We have modified the Discussion section and now discuss these papers (and a few more). We thank the reviewer for the suggestions, which will help the reader to have a broader overview of noise buffering in gene expression and indeed enrich the paper.

      Reviewer #3 (Significance (Required)):

      Significance is high. Quality is high.

      \*Referees Cross-Commenting** *

      I agree with the comments made by other reviewers particularly about references 26 and 27. The major conclusions of reference 26 were questioned by Hansen et al 2018. At the bottom of page 7 the authors are qualifying their results in the light of references 26 and 27. Perhaps now there is less of a need to do so.

      As mentioned above, we have added the following sentence citing the Hansen paper to make it clear to the reader that key conclusions of the references 26 and 27 are disputed (lines 335-342):

      “One explanation for the low intrinsic fluctuation in these studies is that transcriptional fluctuations are filtered by nuclear retention, though other reports suggest that Fano factors (variance/mean, a measure of overdispersion compared to the Poisson distribution) can be even larger in the cytoplasm than in the nucleus [38].

      References

      Gelman A, Carlin JB, Stern HS, Dunson DB, Vehtari A, Rubin DB. 2013. Bayesian Data Analysis, 3rd edn. CRC Press, London.

      Hughes ME, DiTacchio L, Hayes KR, Vollmers C, Pulivarthy S, Baggs JE, Panda S, Hogenesch JB. 2009. Harmonics of circadian gene transcription in mammals. PLoS Genet 5. doi:10.1371/journal.pgen.1000442

      Kempe H, Schwabe A, Cremazy F, Verschure PJ, Bruggeman FJ. 2015. The volumes and transcript counts of single cells reveal concentration homeostasis and capture biological noise. Mol Biol Cell 26:797–804. doi:10.1091/mbc.E14-08-1296

      Padovan-Merhar O, Nair GP, Biaesch AG, Mayer A, Scarfone S, Foley SW, Wu AR, Churchman LS, Singh A, Raj A. 2015. Single Mammalian Cells Compensate for Differences in Cellular Volume and DNA Copy Number through Independent Global Transcriptional Mechanisms. Mol Cell 58:339–352. doi:10.1016/j.molcel.2015.03.005

      Raj A, Peskin CS, Tranchina D, Vargas DY, Tyagi S. 2006. Stochastic mRNA synthesis in mammalian cells. PLoS Biol4:e309. doi:10.1371/journal.pbio.0040309

      Relógio A, Westermark PO, Wallach T, Schellenberg K, Kramer A, Herzel H. 2011. Tuning the mammalian circadian clock: Robust synergy of two loops. PLoS Comput Biol 7:1–18. doi:10.1371/journal.pcbi.1002309

      Saini C, Morf J, Stratmann M, Gos P, Schibler U. 2012. Simulated body temperature rhythms reveal the phase-shifting behavior and plasticity of mammalian circadian oscillators. Genes Dev 26:567–580. doi:10.1101/gad.183251.111

      Suter DM, Molina N, Gatfield D, Schneider K, Schibler U, Naef F. 2011. Mammalian Genes Are Transcribed with Widely Different Bursting Kinetics. Science (80- ) 332:472–474. doi:10.1126/science.1198817

      Ukai-Tadenuma M, Yamada RG, Xu H, Ripperger JA, Liu AC, Ueda HR. 2011. Delay in feedback repression by cryptochrome 1 Is required for circadian clock function. Cell 144:268–281. doi:10.1016/j.cell.2010.12.019

      Vehtari A, Gelman A, Gabry J. 2017. Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC. Stat Comput 27:1413–1432. doi:10.1007/s11222-016-9696-4

      Wu C, Simonetti M, Rossell C, Mignardi M, Mirzazadeh R, Annaratone L, Marchiò C, Sapino A, Bienko M, Crosetto N, Nilsson M. 2018. RollFISH achieves robust quantification of single-molecule RNA biomarkers in paraffin-embedded tumor tissue samples. Commun Biol 1:1–8. doi:10.1038/s42003-018-0218-0

      Zoller B, Nicolas D, Molina N, Naef F. 2015. Structure of silent transcription intervals and noise characteristics of mammalian genes. Mol Syst Biol 11:823. doi:10.15252/msb.20156257

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      In this paper Nicholas et al image mRNAs encoding the key controllers of circadian rhythms, Rev-erba, Cry and Bmal1 in single cells over time. It was shown earlier that single cells exhibit circadian rhythms using reporter genes. A large number of studies have shown that transcription is an inherently stochastic process, which raises a question as to how single cells are able to achieve their rhythms on the face of this noise. Their results show that the number of mRNAs for the three genes exhibit the expected periodicity, but this periodicity is associated with significant cell-to-cell variation. They also explore to what extent this variability derives from stochastic transcription vs other sources of variation that are extrinsic to the genes. The results are interesting and experimental and modeling results are important (however this reviewer is not able to judge the veracity of mathematics that underlay the models).

      Some of the concerns that arose are listed below:

      1.The images show an annoying red background. If the red is HCS cell mask, it should be removed, and RNA presented on grey scale. This will make a better presentation. The red hue also appears in fig 2 b but here it is one of the RNA. I suggest in Fig 2 one RNA can be presented in green and the other in red, while the nuclei in blue.

      2.This paper and a few others talk about the cell size contributing to the cell-to-cell variability in mRNA numbers. Where does it come from physically? One can imagine based on the cell cycle stage there could be more than two copies of then gene in a cell, which will yield more RNAs, but they say that their cells don't have much cell cycle variability. Perhaps a clearer discussion is called for rather than just being polite to other investigators.

      3.References 26 and 27 are cited for 10-80% of variance due to gene extrinsic sources. These references actually deny that there is a significant transcriptional noise in most genes. Again, stronger discussion is called for.

      4.The results raise a very important question, whether and to what extent the transcriptional noise propagates to the next step of gene regulation and are there buffering mechanisms in the cell. For example, Raj et al, Variability in gene expression underlies incomplete penetrance, Nature 2010, show that alternative pathways serve to buffer the impact of gene expression noise. Similarly, Shah and Tyagi, Barriers to transmission of transcriptional noise in a c-fos c-jun pathway, Mol Syst Biol, 2013, show that variability in mRNA is buffered at protein level and the level of protein-protein complexes. Furthermore, they show that to the extent those vary, the chromatin intrinsically buffers against the fluctuations in numbers of transcription factors. Mention of these and other studies will enrich the paper.

      Significance

      Significance is high. Quality is high.

      Referees Cross-Commenting

      I agree with the comments made by other reviewers particularly about references 26 and 27. The major conclusions of reference 26 were questioned by Hansen et al 2018. At the bottom of page 7 the authors are qualifying their results in the light of references 26 and 27. Perhaps now there is less of a need to do so.

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      Summary: The authors study experimentally and computationally the dynamic transcription of circadian clock genes over time in individual cells with single molecule RNA-FISH with the aim to understand how different noise sources contribute to single cell transcription variability and basic functions of circadian clocks. The authors integrate experiments with computational modeling to understand biology.

      Major comments:

      This study has some major limitations that need to be addressed to test the model usefulness, to understand noise sources and to gain biological insights into circadian clocks.

      The limitations are on the experiments, the computational implementation of the modeling and the integration of experiments with models.

      Although the experimental datasets contain several hundred cells per time point for multiple time points, only a single replica experiment is presented. From the presented data it is not clear how reproducible these temporal patterns are and if indeed differences between timepoints can be resolved if multiple biological replica experiments have been analyzed. To address this point at least three biological experiments needs to be presented and analyzed for each of the genes. Plotting the SEM on the means in figure 1B is misleading because several hundred cells have been measured which automatically makes the error small. The SEM just describes how well we can determine the mean from a distribution. Instead a mean and std from the biological replicas need to be plotted to show how experimental variability in experiments is resulting in the described expression pattern. This is similar to RNA-seq data or RT-PCR from multiple replica.

      It is also not clear how good the cell segmentation works and how does cell segmentation influence the analysis. In figure 1A show the segmentation of the cell boundary together with the membrane stain.

      The authors use the RNA mean and RNA-FISH distributions and combine this data to build and compare different models. How do you know that the given data fulfils the central limit so that a model describing the mean is an adequate approach? To test this point, the authors should show through subsampling from the data and the model that indeed their data sets have enough cells to fulfil the central limit theorem.

      A strength of the manuscript is that several competing and biologically meaningful models have been generated. However, the manuscript lacks rigor in terms of how fitting and model selection is performed. It is not clear how good the models fit the data. To address this point, the authors should visually compare the model fits to the data and plot their fit errors as a function of model complexity.

      Another limitation is that the models have not been validated for example by using them to make predictions. One type of prediction could be to fit the model to one biological replica and then predict the other replica (cross validation). Another prediction would be to take the distribution fitted to the experimental data and then compare the model mean to the experimental mean.

      The results from fitting and prediction should be plotted as a function of model complexity. This kind of analysis will illustrate how model complexity is supported by the data.

      In the method section on models, a biological motivation must be presented to justify the different model assumption.

      How do the models that fit the distributions describe the mean?

      It is necessary to list model parameters for each of the models, their description, their parameter values, their parameter uncertainty and units of each parameter.

      It is not clear to me how the joint probability in figures 2,4, S2 and S4 have been used to fit the model.

      How do the models make sense in the context of the fact that human genes exist as a diploids?

      The variance decomposition is shortly described but no results are presented to show how this is done. This should be better explained.

      Minor comments:

      In figure 3A, it is not clear to me what these different plots relate to the models. It is also not clear what are equations that describe each model.

      The legends in figure 3 are not very informative. More details need to be presented to understand this figure.

      Significance

      This is an interesting and important topic with the potential to have general implication of how to model periodic single cell gene expression data and eventually better understand circadian clocks. This study will expand on other modeling studies of circadian clocks and has the potential to advance the field (PMCID: PMC7229691). I personally have done similar analysis and experiments in another system and biological context which has demonstrated the power of this approach if implemented rigorously. I am not an expert in circadian clocks in human cells.

      Referees Cross commenting

      Reviewer #1: I agree with the assessment that model fitting and model selection was not sufficient. But I disagreed that the data is enough. Although many cells and time points are analyzed, there is no evidence of how reproducible each mRNA distribution can be measured at each time point. I think reproducibility is key and will also help with the model fitting and identification.

      Reviewer #3: Regarding the red background, my understanding is that this comes from the probe hybridization. This is maybe because the probe concentration has not been optimized or the number of probes per gene is low and the signal to noise is not so good. Or it could be auto fluorescent background. In this case a different fluorophore needs to be used to avoid this problem.

    4. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      The authors generated and analyzed a great amount of single-cell RNA FISH data over time on circadian genes (Nr1d1, Cry1, Bmal1), and performed model selection/fitting to explain the observed mRNA distributions. They decomposed the mRNA variability into distinct sources, and showed that intrinsic noise (transcription burst) dominates the variance. Therefore, looking at transcript counts may not be feasible to estimate single-cell circadian phase. However, the study is quite descriptive and ends up being a bit dissatisfying, so if the authors could improve this aspect by perhaps analyzing a mechanism on cell-specific burst size (F5), gene-specific dependence on cell size (beta), or the positive/negative gene-pair correlations (rho), it would help quite a bit in this regard. The model selection/fitting itself was not really sufficient to compensate for this, as it stands .

      Specific comments:

      1.It is hard to distinguish the RNA FISH signals (Figure 1A, 2B). It is probably technically challenging as the mRNAs are of low abundance. I think it may help if they adjust the contrast for the cytoplasm stain or just delineate the cell boundaries.

      2.In Figure 2C, the authors showed gene-pair correlations with cells of all sizes. Could the authors do a size-dependent extrinsic-noise filtering (Padovan-Merhar, Dev. Cell, 2015; Hansen et al., 2018, Cell Systems) to better dissect the correlations?

      3.For fitting model M3, as the authors pointed out, there are many local minima. Is the fitting score truly sufficient to eliminate the possibility for partial synchrony especially considering that the authors didn't show how effective the Dex treatment was to synchronize the circadian phase?

      4.Regarding model M4, the authors added a cell-specific noise term without specifying the contributing factors. Typically adding degrees of freedom should improve fitting and make it easier for a model to fit, why not in this case? Can the authors provide some explanations/mechanisms.

      5.The authors should include the number (range) of cells analyzed in the figure legends.

      Significance

      Overall, we felt conflicted about the manuscript. On one hand, the authors generated and analyzed a great amount of single-cell RNA FISH data over time on circadian genes. On the other hand, the manuscript was a bit dissatisfying/descriptive. If the authors could provide and analyze some sort of mechanisms on cell-specific burst size (F5), gene-specific dependence on cell size (beta), or the positive/negative gene-pair correlations (rho) it should help improve the manuscript.

      Referees cross-commenting

      I agree with Reviewer #3 regarding expanding the discussion to include the Shah & Tyagi and Raj et al citations on buffering. However caution should be exercised regarding ref 26 as it is quite controversial and subsequent analyses came to different conclusions (PMID: 30359620 and 30243562). The general consensus is that nuclear buffering of transcript noise (proposed in ref 26) is not a general phenomenon (ref 27 is specific to the calcium response pathway). In fact, the presence and evolution of specific pathways to buffer transcriptional noise, such as protein-protein mechanisms (Shah & Tyagi) or extended half-life proteins (Raj et al. and others), argues that transcript fluctuations are not probably buffered in general.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reviewer #1 (Evidence, reproducibility and clarity (Required)): **Summary:** In this study, the authors investigate the role of hedgehog signaling and lipid metabolism in the neural stem cell niche of the Drosophila larvae. They demonstrate that Hedgehog localizes to lipid droplets in glial cells and show that Hh is necessary but not sufficient for elaboration of glial membranes and normal rates of glial proliferation during development. In addition, they provide an extensive set of results in support of a model that FGF signaling functions upstream of lipid metabolism and hh in glial cells as well as a parallel ROS mediated pathway in glial cells to promote neuroblast proliferation. In general, the results provide strong support for the conclusions. Specifically, the approaches are sound, the images clearly demonstrate the phenotypes described, and the effects are quantified and tested for statistical significance. **Major comments:** 1.Since Hh RNAi decreases the glial compartment (which slows NB proliferation) and increases the frequency of pH3+ NBs, it is unclear why it would decrease the number of EdU+ NBs (Fig. S3C). 2.If overexpression of htl[ACT] slows the NB cell cycle (as evidenced by reduced pH3 and EdU positive cells), it unclear why it does not reduce the number of NBs (Fig. 4L). 3.What is the justification for presenting the EdU quantifications as an EdU index in which the experimental values are normalized to the average number of positive cells in the control? In many cases, the comparison is to the same w[1118] line so it does not control for a specific genetic backgrounds and yet this method may be obscuring experimental variation present between datasets. Likewise, why is glial number presented as a fold-change but NB number is presented as raw counts (e.g. 2D vs S3E)? **Minor comments:** On the top of P.14, "Figure S7A-C" should probably be "Figure S6A-C" Reviewer #1 (Significance (Required)): The cell autonomous regulation of growth and proliferation of neuroblasts in the larval brain have been well-studied, but much less is known about the non-cell autonomous signals. This paper significantly moves forward knowledge in this area by describing multiple steps of a molecular mechanism for glial regulation of the neuroblast cell cycle. These findings would be of interest not only to the study of Drosophila neuroblasts, but also to the broader adult stem cell field. My expertise is in Drosophila stem cell biology and genetics. Reviewer #2 (Evidence, reproducibility and clarity (Required)): **Summary:** The study by Dong et al., investigates the role of Hedgehog in the glial niche during larval neurogenesis in Drosophila. The authors describe the expression of Hh in cortex glia and its association with lipid droplets. They show that Hh expression in cortex glia is required for cortex glial proliferation, cell autonomously, and for maintenance of the normal cell cycle in neuroblasts. They go on to use a well characterised Drosophila glioma model, activation of FGF signalling, to investigate the requirement for Hh during cortex glial overgrowth. They show that FGF-activated cortex glial overproliferation requires Hh for modulation of neuroblast cell cycle, although Hh does not regulate cortex glial proliferation in this context. Finally, they show that inhibition of lipid modification of Hh rescues the neuroblast proliferation cell cycle defect caused by FGF activation in cortex glia. **Major comments:** 1.From the data in presented in Fig. 2H-K and Fig. S3C, I am very confused about role of Hh in the non-cell autonomous regulation of neuroblast cell cycle. Both RNAi and overexpression of Hh with Repo-Gal4 cause a reduction in the neuroblast EdU index (Fig. 2H-K and S3C). The authors conclude this section on p.7 saying "Together, our data suggests that high levels of glial Hh expression restricts NB cell cycle progression." This statement is not consistent with data. What is the normal physiological role of Hh if both decreased and increased levels of cortex glial Hh expression reduce neuroblast cell cycle? The discussion of p.15 does not clarify this issue. The model in Fig.7J relates to the role of Hh in the context of cortex glial FGF activation and does not illustrate the normal physiological role of Hh in the regulation of neuroblast cell cycle. 2.P.8 "Analysis of the total glial cell number indicates overexpression of htlACT, but not InRwt or EgfrACT, led to an increase in the number of cortex glial cells (Figure 4E-G, I-K)." This statement is confusing as Repo staining was used to quantify total glial numbers (including perineural, sub-perineural and cortex glia) but these data are then taken to represent and increase specifically in cortex glia. This should be clarified. 3.It should be mentioned on p.8 that the data in Fig.4A-K reproduce the findings of Avet-Rochex et al., 2012 and Read et al., 2009. 4.Figure 6F. Presumably due to the increase in glia cell number and dramatic increase in glial cell volume, any gene that is specific to, or enriched in, cortex glia will have increased expression levels in RepoGal4>htlACT larval CNS. Can the authors provide evidence that the increase in the expression of these genes is specific to FGF transcriptional regulation and not just a relative increase in the levels of these genes due to an increase in cortex glia as proportion of total CNS volume? Is there any evidence that Hh, fasn1 and lsd2 are direct transcriptional targets of FGF signalling in glia? 5.FGF signalling has been shown to be necessary and sufficient for cortex glial proliferation. So does knockdown of Htl, or expression of dominant negative Htl, cause a reduction in Hh, fasn1 and lsd2 expression in cortex glia? If so, does how does reduction of cortex glial numbers independent of FGF signalling, using for example knockdown of String or expression of Decapo, affect the expression of Hh, fasn1 and lsd2 in cortex glia? 6.Can the authors speculate on why and how increased levels of Hh in cortex glia, in the context of FGF activation, inhibit neuroblast cell cycle? Is this a physiological mechanism to limit neuroblast proliferation in the face of increased gliogenesis, or is it simply an indirect result of 'spillover' of excess Hh from cortex glia onto neuroblasts (which are autonomously regulated by Hh and so sensitive to this ligand) by due to increased cortex glia cells? **Minor comments:** -Figure 1C' some lipid droplets are extremely large, is this consistent with previous literature? -Including a profile plot of relative fluorescence intensity in Figure 1C',F',H' to illustrate colocalization of lipidTOX and Hh, would be helpful. -Figure S3A,B quantify Hh protein level and CNS size phenotypes with Hh RNAi. -p.6 include data showing overexpression of Hh does not cause glial overgrowth. -Top of p.14 should be FigS6A-C. -Include quantification of glial overgrowth and lipid droplet phenotypes with HtlACT plus catalase and SOD1 overexpression (Fig. S6D-K). Reviewer #2 (Significance (Required)): The is a novel and very interesting study, well written and the data are very clearly presented. It builds on and adds to the emerging literature on the glial niche and its role in neural stem cell regulation. It will be of great interest to Drosophila neurobiologists but also to the broader field of neural stem cell biology. My expertise is Drosophila neurobiology.

      Dear editor

      Below is our response to the reviewer’s comments and our experimental plan in addressing these concerns.

      Reviewer #1

      Major comments:

      1.Since Hh RNAi decreases the glial compartment (which slows NB proliferation) and increases the frequency of pH3+ NBs, it is unclear why it would decrease the number of EdU+ NBs (Fig. S3C).

      Our experimental data suggests that accompanying glial niche disruption and downregulation of glia-derived signals, NBs are stalled in M phase (we detected an increase in the percentage of pH3+ NBs). As a consequence, less NBs are in G1 and S phase. Therefore, when we conducted a 15-min EdU incorporation, we observed a reduction in EdU incorporation. This NB phenotype (increase in pH3 index and decrease in EdU index) was also observed by Speder and Brand, 2018, when they induced glial niche impairment by inhibiting the PI3K signaling pathway (discussed in P7 of this ms).

      To address whether glial-Hh knockdown reduces the ability of NBs to produce progeny, we plan to carry out two experiments:

      • We will assess the total number of neurons in the CB by assessing Elav+ neurons.

      • We will conduct two EdU pulse-chase experiments. First, we will assess the total number of EdU+ neurons produced within a 4-hr time window (neurons marked with Elav); and the secondly, we will mark the NB lineage (with either nerfin-1-GFP or pros-GFP) and quantify the number of EdU+ neurons produced per lineage during a 4-hr time window.

      Together, these experiments should allow us to assess the consequence of glial-Hh knockdown on NB proliferation.

      If overexpression of htl[ACT] slows the NB cell cycle (as evidenced by reduced pH3 and EdU positive cells), it unclear why it does not reduce the number of NBs (Fig. 4L).

      The number of NBs in the larval CNS is specified at the beginning of post-embryonic neurogenesis, when quiescent NBs re-enter the cell cycle (reviewed by Homem and Knoblich, 2012). Once NBs re-enter the cell cycle, the number of NBs remain constant. NBs undergo asymmetric division to produce one daughter NB and a GMC, which divides once to generate two neurons. With each round of NB-division, the number of NBs remain constant. Therefore, changes in NB cell cycle speed does not alter the overall NB number, only the number of neurons produced.

      To clarify this, we will add a schematic depicting NB asymmetric division to Figure 1.

      3.What is the justification for presenting the EdU quantifications as an EdU index in which the experimental values are normalized to the average number of positive cells in the control?

      EdU index is calculated as number of EdU+ NBs normalised to control EdU+ NBs. The number of EdU+ NBs reflects the NBs that progress through S phase in a 15-min time relative to the control. A similar method was used in Kanai et al., 2018. This method would not be valid only if NB number varied between control and experimental data sets, however, the number of NBs in all our genetic manipulations are not significantly altered relative to their control. We present the quantification of some key manipulations in Reviewer_Figure 1A, B.

      As regards to why we normalise to control in each of these experiments, this is because in-vitro EdU incorporation rely on Click-IT chemistry, which is inherently variable due to incubation conditions. To overcome this, we always incubate control and experimental brains in the same tube and imaged them with the same confocal setting, and each experiment is normalised to its control done in parallel. We have now included Table 1 which includes all the raw data from these experiments (Table 1)

      In the revised manuscript, we will clarify our methodology in greater detail in the Methods section, and we are happy to include Table 1in the supplementary data.

      In many cases, the comparison is to the same w [1118] line so it does not control for a specific genetic backgrounds and yet this method may be obscuring experimental variation present between datasets.

      We have used three different controls in our experiments, namely GAL4 or lexA >w1118, or UAS-mcherryRNAi, or UAS-luc. We detect no significant difference in terms of raw EdU+ NB numbers between the controls used in our experiments, as demonstrated below (Reviewer_Figure 1C). In our revised manuscript, we will include a sentence “As UAS-mcherryRNAi or UAS-luc are indistinguishable from the > w1118 control, we have used GAL4 driver > w1118 as control in place of UAS-luc in our results”.

      Reviewer_Figure 1. Total NB number and Edu+ NB number quantification

      1. A) Hh knockdown or overexpression in glia does not significantly alter NB number compared to control.
      2. B) htlACT overexpression in glia does not significantly alter NB number compared to control.
      3. C) EdU+ NB number is not significantly different within the controls GAL4 or lexA > w1118, or UAS-mcherryRNAi, or UAS-luc. P-value was obtained performing student t-test in A, B and One-way ANOVA in C.

      Likewise, why is glial number presented as a fold-change but NB number is presented as raw counts (e.g. 2D vs S3E)?

      Glial number quantification was carried out using Fiji 3D object counter and a plug-in called “DeadEasy Larval Glia” (Forero et al., 2012), where the threshold of detection is dependent on the brightness of Repo staining in each experiment, this data is presented as fold-change, as control and experiment stained in the same tube are compared to each other. We represented this data as fold-change to allow easy comparison between experiments. The raw data is presented in Table 2. NB number is counted manually and is therefore presented as raw counts.

      **Minor comments:**

      On the top of P.14, "Figure S7A-C" should probably be "Figure S6A-C"

      We will correct this.

      Reviewer #1 (Significance (Required)):

      The cell autonomous regulation of growth and proliferation of neuroblasts in the larval brain have been well-studied, but much less is known about the non-cell autonomous signals. This paper significantly moves forward knowledge in this area by describing multiple steps of a molecular mechanism for glial regulation of the neuroblast cell cycle. These findings would be of interest not only to the study of Drosophila neuroblasts, but also to the broader adult stem cell field.

      My expertise is in Drosophila stem cell biology and genetics.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)):

      **Major comments:**

      1.From the data in presented in Fig. 2H-K and Fig. S3C, I am very confused about role of Hh in the non-cell autonomous regulation of neuroblast cell cycle. Both RNAi and overexpression of Hh with Repo-Gal4 cause a reduction in the neuroblast EdU index (Fig. 2H-K and S3C). The authors conclude this section on p.7 saying "Together, our data suggests that high levels of glial Hh expression restricts NB cell cycle progression." This statement is not consistent with data. What is the normal physiological role of Hh if both decreased and increased levels of cortex glial Hh expression reduce neuroblast cell cycle? The discussion of p.15 does not clarify this issue. The model in Fig.7J relates to the role of Hh in the context of cortex glial FGF activation and does not illustrate the normal physiological role of Hh in the regulation of neuroblast cell cycle.

      With repo-GAL4>hhRNAi, the cortex glial niche enwrapping NBs is dramatically disrupted, which indirectly alters NB cell cycle progression, indicated by an increase in pH3 index and a decrease in EdU index. From these two pieces of data, it is likely that NBs are stuck in M phase, thus resulting in less NBs in G1 and S phase that are capable to incorporate EdU within a 15-min incubation time window. We will firm up this data with experiments proposed to address concerns of Reviewer 1, Point 1.

      Both RNAi and overexpression of Hh with repo-GAL4 causes a reduction in NB EdU index is seemingly contradictory. However, it is consistent with a previous report from Speder and Brand, 2018, where it was shown that that glial niche impairment induced by the PI3K pathway inhibition also causes a similar NB phenotype (an increase in pH3 index and a decrease in EdU incorporation). Furthermore, with repo-GAL4>htlDN, which caused a similar glia niche impairment (data not shown), we observed a similar phenotype (an increase in pH3 index and a slight decrease in EdU incorporation). Therefore, we concluded that the NB cell cycle progression defects is due to a general cortex glial niche disruption rather than a direct effect of Hh inhibition on NBs. We are happy to include the repo-GAL4>htlDN data in the supplementary data if required.

      With regards to the physiological role of Hh, we can only conclude from the data at hand that Hh is required for the development of cortex glial niche, which is required to maintain NB activities. In terms of how glial niche impairment impedes NB cell cycle progression, we observed that without a proper niche chamber, NBs cluster together instead of residing in separate niches (Figure 2F-G). Therefore, it is possible that the localization of other cell types (i.e. GMCs and neurons) are also altered as a result of NB clustering, which can potentially affect the NB cell cycle. While these questions will be interesting to explore in the future, they are beyond the scope of this current study.

      In contrast, we robustly showed Hh signals, when overexpressed in glial niche, were capable of making contact with NBs (Figure 7C-C’) and triggering a slow-down of NB S-phase progression. Therefore, it is fair to conclude that “high levels of glial Hh expression restricts NB cell cycle progression”.

      In the revised manuscript, we will discuss these findings in greater detail.

      2.P.8 "Analysis of the total glial cell number indicates overexpression of htlACT, but not InRwt or EgfrACT, led to an increase in the number of cortex glial cells (Figure 4E-G, I-K)." This statement is confusing as Repo staining was used to quantify total glial numbers (including perineural, sub-perineural and cortex glia) but these data are then taken to represent and increase specifically in cortex glia. This should be clarified.

      We thank the reviewer for picking this up. Our intention was to quantify the number of cortex glia cells in glial-specific htlACT, InRwt and EgfrACT manipulations. However, two reported cortex glial antibodies (PntP2 from Avet-Rochex et al., 2012 and SoxN described in Read, 2018), showed unspecific labelling of other cell types (Reviewer_Figure 2, arrows, neurons and NBs). As an alternative, we quantified the total glial cell number (Repo+) in htlACT, InRwt or EgfrACT overexpressed using a cortex glial driver (NP2222-GAL4). We expect that the alterations in glial cell number would be primarily attributed to cortex glial-specific gene manipulation. We agree that we should say that “overexpression of htlACT, but not InRwt or EgfrACT, led to an increase in the number of glial cell”.

      In the revised manuscript, we will clarify this in the results section.

      Reviewer_Figure 2: PntP2 staining in the larval CNS.

      A-B) Representative images showing that PntP2 antibody stains cortex glial cells (marked by NP2222-GAL4>mGFP, yellow arrows), NBs (white arrows) and neurons (blue arrows). B) is the zoomed in image of A). Scale bar = 50 mm.

      It should be mentioned on p.8 that the data in Fig.4A-K reproduce the findings of Avet-Rochex et al., 2012 and Read et al., 2009.

      We will correct this.

      4.Figure 6F. Presumably due to the increase in glia cell number and dramatic increase in glial cell volume, any gene that is specific to, or enriched in, cortex glia will have increased expression levels in RepoGal4>htlACT larval CNS. Can the authors provide evidence that the increase in the expression of these genes is specific to FGF transcriptional regulation and not just a relative increase in the levels of these genes due to an increase in cortex glia as proportion of total CNS volume? Is there any evidence that Hh, fasn1 and lsd2 are direct transcriptional targets of FGF signalling in glia?

      We agree that FGF activation causes a dramatic increase in glial cell number, thus will cause a relative increase in the level of hh, fasn1 and lsd2s. However, with RT-qPCR, the same amounts of total RNA (1μg) were extracted from control vs repo-GAL4> htlACT and reverse transcribed into cDNA for qPCR. Therefore, the mRNA level described in Figure 6 F are already normalized to the total amount of genetic material.

      In the literature, it is not reported that hh, fasn1 and lsd2 are direct transcriptional targets of FGF signalling. However, lipid metabolism rewiring is well known as a hallmark of glioblastoma. For example, high levels of FASN has been linked with high grade glioblastoma (Grube et al., 2014). Furthermore, FGF signalling has also been shown to modulate lipid metabolism and alter the transcription of the Lsd-2 homologue called Plin2 in a mouse model (Ye et al., 2016).

      To figure out whether hh, fasn1 and lsd2 are direct transcriptional targets of FGF signalling. we will have to first find out which TFs are altered in the glia upon altered FGF signalling via cortex glia specific RNA-seq, and then conduct DamID to identify their target genes. This would be interesting to follow-up but is however beyond the scope this current study.

      We will add a section on this in the discussion section of the revised ms.

      FGF signalling has been shown to be necessary and sufficient for cortex glial proliferation. So does knockdown of Htl, or expression of dominant negative Htl, cause a reduction in Hh, fasn1 and lsd2 expression in cortex glia?

      In response to glial htlDN overexpression, we observed a significant reduction in total glial number and overall Hh expression. However, RT-qPCR showed that mRNA levels of hh, fasn1 or lsd-2 were not altered upon htlDNoverexpression (Reviewer_Figure 3).

      This data will be included in the supplementary data in the revised ms.

      Reviewer_Figure 3. Glial htlDN overexpression doesn’t alter the expression of hh, fasn1 and lsd2. The mRNA levels of hh, fasn1 and lsd2 are normalized to the reference gene rpl32.

      Continued: If so, how does reduction of cortex glial numbers independent of FGF signalling, using for example knockdown of String or expression of Decapo, affect the expression of Hh, fasn1 and lsd2 in cortex glia?

      To address this question, we plan to assess the expression levels of hh, fasn1 and lsd-2 using glia specific expression of an inhibitor of the PI3K (delta p60), which has been shown by Speder and Brand, 2018 to cause a reduction in cortex glial number. We will also ascertain whether Decapo overexpression causes cortex glial niche impairment. If so, we will also assess the expression levels of hh, fasn1 and lsd-2 in this setting.

      6.Can the authors speculate on why and how increased levels of Hh in cortex glia, in the context of FGF activation, inhibit neuroblast cell cycle? Is this a physiological mechanism to limit neuroblast proliferation in the face of increased gliogenesis, or is it simply an indirect result of 'spillover' of excess Hh from cortex glia onto neuroblasts (which are autonomously regulated by Hh and so sensitive to this ligand) by due to increased cortex glia cells?

      We favour the model that excess Hh in the glia compartment “spills over” to reduce NB proliferation, which are autonomously regulated by Hh and therefore are sensitive to this ligand. We can add this to the discussion.

      **Minor comments:**

      -Figure 1C' some lipid droplets are extremely large, is this consistent with previous literature?

      These large lipid droplets are caused by lipid droplet fusion due to the use of detergent in this experiment. When we perform antibody staining together with lipid droplet staining, PBST detergent is required for antibody staining to work. However, this created the artefact of large lipid droplets, due to lipid droplet fusion. This has previously been reported by Bailey et al., 2015, and we have explained this in P19 of the Method section.

      -Including a profile plot of relative fluorescence intensity in Figure 1C',F',H' to illustrate colocalization of lipidTOX and Hh, would be helpful.

      We will include this in the revised ms.

      -Figure S3A,B quantify Hh protein level and CNS size phenotypes with Hh RNAi.

      We will include this in the revised ms.

      -p.6 include data showing overexpression of Hh does not cause glial overgrowth.

      We will include this in the revised ms.

      -Top of p.14 should be FigS6A-C.

      We will correct this.

      -Include quantification of glial overgrowth and lipid droplet phenotypes with HtlACT plus catalase and SOD1 overexpression (Fig. S6D-K).

      We will include this in the revised ms.

      Reviewer #2 (Significance (Required)):

      The is a novel and very interesting study, well written and the data are very clearly presented. It builds on and adds to the emerging literature on the glial niche and its role in neural stem cell regulation. It will be of great interest to Drosophila neurobiologists but also to the broader field of neural stem cell biology.

      My expertise is Drosophila neurobiology.








      Table 1. EdU+ NB numbers for each genotype described in each Figure

      Figure

      Genotype

      EdU incubation time

      Average EdU+ NB number

      SEM

      Number of samples

      Figure 2J

      repo-GAL4>w1118

      15 min

      66.63

      1.79

      16

      Figure 2J

      repo-GAL4>UAS-hh

      15 min

      57.35

      1.35

      20

      Figure 2K

      NP2222-GAL4>w1118

      15 min

      67.91

      1.44

      11

      Figure 2K

      NP2222-GAL4>UAS-hh

      15 min

      60.79

      0.79

      14

      Figure 2P

      dnab-GAL4>w1118

      15 min

      70.5

      1.44

      12

      Figure 2P

      dnab-GAL4>ciACT

      15 min

      60.1

      1.48

      10

      Figure S3C

      repo-GAL4>dcr2; mcherryRi

      10 min

      57.42

      0.63

      12

      Figure S3C

      repo-GAL4>dcr2; hhRi43255

      10 min

      48.56

      2.65

      9

      Figure 3K

      NP2222-GAL4>w1118

      The same dataset as Figure 2K

      Figure 3K

      NP2222-GAL4>UAS-hh

      Figure 3K

      NP2222-GAL4>UAS-hh; mcherryRi

      15 min

      57.44

      1.41

      16

      Figure 3K

      NP2222-GAL4>UAS-hh; lsdRi34617

      15 min

      63.36

      1.34

      14

      Figure 3K

      NP2222-GAL4>UAS-hh; mcherryRi

      15 min

      58.83

      2.61

      6

      Figure 3K

      NP2222-GAL4>UAS-hh; lsdRi32846

      15 min

      64.5

      1.2

      14

      Figure 5E

      repo-GAL4>w1118

      15 min

      71.6

      1.28

      15

      Figure 5E

      repo-GAL4>UAS-htlACT

      15 min

      56

      1.59

      14

      Figure 5E

      NP2222-GAL4>w1118

      15 min

      70.2

      1.58

      10

      Figure 5E

      NP2222-GAL4>UAS-htlACT

      15 min

      54.75

      1.24

      16

      Figure 6G

      NP2222-GAL4>w1118

      The same dataset as Figure 5E

      Figure 6G

      NP2222-GAL4>UAS-htlACT

      Figure 6G

      NP2222-GAL4>UAS-htlACT;mcherryRi

      15 min

      60

      1.24

      7

      Figure 6G

      NP2222-GAL4>UAS-htlACT;hhRi43255

      15 min

      67.17

      1.13

      12

      Figure 6G

      NP2222-GAL4>UAS-htlACT;mcherryRi

      15 min

      59.29

      1.79

      14

      Figure 6G

      NP2222-GAL4>UAS-htlACT;hhRi25794

      15 min

      68.55

      1.68

      11

      Figure 6H

      dnab-GAL4>mcherryRi

      10 min

      49.13

      1.6

      8

      Figure 6H

      dnab-GAL4>ciRi2125-R2

      10 min

      56.54

      1.27

      13

      Figure 6H

      repo-lexA>w1118

      15 min

      68.5

      1.1

      10

      Figure 6H

      repo-lexA>lexAop-htlACT

      15 min

      55.7

      2.15

      10

      Figure 6H

      repo-lexA>lexAop-htlACT; GFPRi

      15 min

      52

      1.58

      30

      Figure 6H

      repo-lexA>lexAop-htlACT; ciRiHMJ23860

      15 min

      62.4

      1.79

      15

      Figure 6H

      repo-lexA>lexAop-htlACT; GFPRi

      15 min

      56.33

      1.49

      12

      Figure 6H

      repo-lexA>lexAop-htlACT; ciRi2125-R2

      15 min

      62.86

      1.81

      7

      Figure 6J

      NP2222-GAL4>w1118

      The same dataset as Figure 5E

      Figure 6J

      NP2222-GAL4>UAS-htlACT

      Figure 6J

      NP2222-GAL4>UAS-htlACT;mcherryRi

      15 min

      58.64

      0.99

      14

      Figure 6J

      NP2222-GAL4>UAS-htlACT;fasn1Ri3523R2

      15 min

      65

      2.41

      9

      Figure 6J

      NP2222-GAL4>UAS-htlACT;mcherryRi

      The same dataset as Figure 6G control of NP2222-GAL4>UAS-htlACT;hhRi25794

      Figure 6J

      NP2222-GAL4>UAS-htlACT;lsd2Rikk102269

      15 min

      68.13

      1.08

      8

      Figure S5H

      NP2222-GAL4>mcherryRi

      15 min

      66.4

      1.71

      10

      Figure S5H

      NP2222-GAL4>fasn1Ri3523R6

      15 min

      65.5

      1.38

      10

      Figure S5H

      NP2222-GAL4>mcherryRi

      15 min

      66.4

      1.13

      15

      Figure S5H

      NP2222-GAL4>lsd2Rikk102269

      15 min

      64.2

      0.94

      10

      Figure S5H

      NP2222-GAL4>UAS-luc

      15 min

      65

      1.07

      10

      Figure S5H

      NP2222-GAL4>UAS-lsd2

      15 min

      64.9

      1.51

      10

      Figure S5I

      NP2222-GAL4>w1118

      The same dataset as Figure 5E

      Figure S5I

      NP2222-GAL4>UAS-htlACT

      Figure S5I

      NP2222-GAL4>UAS-htlACT;mcherryRi

      15 min

      57.93

      0.9

      14

      Figure S5I

      NP2222-GAL4>UAS-htlACT;fasn1Ri3523R6

      15 min

      63.79

      1.25

      14

      Figure S5I

      NP2222-GAL4>UAS-htlACT;mcherryRi

      15 min

      50.25

      2.52

      8

      Figure S5I

      NP2222-GAL4>UAS-htlACT;lsd2Ri32846

      15 min

      59.3

      1.2

      10

      Figure 7B

      NP2222-GAL4>mcherryRi

      15 min

      65

      0.93

      10

      Figure 7B

      NP2222-GAL4>raspRi11495R2

      15 min

      65.13

      1.29

      15

      Figure 7B

      NP2222-GAL4>w1118

      The same dataset as Figure 5E

      Figure 7B

      NP2222-GAL4>UAS-htlACT

      Figure 7B

      NP2222-GAL4>UAS-htlACT;mcherryRi

      15 min

      58.33

      1.06

      18

      Figure 7B

      NP2222-GAL4>UAS-htlACT;raspRi11495R1

      15 min

      63.95

      1.05

      21

      Figure 7B

      NP2222-GAL4>UAS-htlACT;mcherryRi

      15 min

      59.04

      1.019

      26

      Figure 7B

      NP2222-GAL4>UAS-htlACT;raspRi11495R2

      15 min

      63.07

      0.92

      29

      Figure 7D

      NP2222-GAL4>w1118

      15 min

      69.46

      1.02

      13

      Figure 7D

      NP2222-GAL4>UAS-hh.N.EGFP

      15 min

      52.25

      1.9

      12

      Figure 7F

      repo-GAL4>UAS-hh.N.EGFP;mcherryRi

      15 min

      54.4

      1.18

      15

      Figure 7D

      repo-GAL4>UAS-hh.N.EGFP;fasn1Ri3523R2

      15 min

      65.69

      1.43

      13

      Figure S6L

      NP2222-GAL4>UAS-htlACT; UAS-LacZ

      15 min

      59.17

      1.18

      12

      Figure S6L

      NP2222-GAL4>UAS-htlACT; UAS-Cat.A

      15 min

      64

      1.31

      12

      Figure S6L

      NP2222-GAL4>UAS-htlACT; UAS-LacZ

      15 min

      53.6

      2.32

      10

      Figure S6L

      NP2222-GAL4>UAS-htlACT; UAS-Sod.1

      15 min

      62.7

      1.76

      10

      Table 2. Raw data on glial number

      Figure

      Genotype

      Average Repo+glial number

      SEM

      Number of samples

      Figure 2D

      repo-GAL4>dcr2; mcherryRi

      843

      44.29

      7

      Figure 2D

      repo-GAL4>dcr2; hhRi43255

      666.5

      46.77

      8

      Figure 4K

      NP2222-GAL4>w1118

      1165

      20.55

      10

      Figure 4K

      NP2222-GAL4>htlACT

      2325

      107.5

      10

      Figure 4K

      NP2222-GAL4>InRwt

      1189

      85.92

      10

      Figure 4K

      wrapper-GAL4>w1118

      1305

      51.78

      7

      Figure 4K

      wrapper-GAL4>EgfrACT

      1192

      38.16

      12

      Reference:

      Avet-Rochex, A., Kaul, A.K., Gatt, A.P., McNeill, H., and Bateman, J.M. (2012). Concerted control of gliogenesis by InR/TOR and FGF signalling in the Drosophila post-embryonic brain. Development 139, 2763-2772.

      Bailey, A.P., Koster, G., Guillermier, C., Hirst, E.M., MacRae, J.I., Lechene, C.P., Postle, A.D., and Gould, A.P. (2015). Antioxidant Role for Lipid Droplets in a Stem Cell Niche of Drosophila. Cell 163, 340-353.

      Forero, M.G., Kato, K., and Hidalgo, A. (2012). Automatic cell counting in vivo in the larval nervous system of Drosophila. J Microsc 246, 202-212.

      Grube, S., Dunisch, P., Freitag, D., Klausnitzer, M., Sakr, Y., Walter, J., Kalff, R., and Ewald, C. (2014). Overexpression of fatty acid synthase in human gliomas correlates with the WHO tumor grade and inhibition with Orlistat reduces cell viability and triggers apoptosis. J Neurooncol 118, 277-287.

      Homem, C.C., and Knoblich, J.A. (2012). Drosophila neuroblasts: a model for stem cell biology. Development 139, 4297-4310.

      Kanai, M.I., Kim, M.J., Akiyama, T., Takemura, M., Wharton, K., O'Connor, M.B., and Nakato, H. (2018). Regulation of neuroblast proliferation by surface glia in the Drosophila larval brain. Sci Rep 8, 3730.

      Read, R.D. (2018). Pvr receptor tyrosine kinase signaling promotes post-embryonic morphogenesis, and survival of glia and neural progenitor cells in Drosophila. Development 145.

      Speder, P., and Brand, A.H. (2018). Systemic and local cues drive neural stem cell niche remodelling during neurogenesis in Drosophila. Elife 7.

      Ye, M., Lu, W., Wang, X., Wang, C., Abbruzzese, J.L., Liang, G., Li, X., and Luo, Y. (2016). FGF21-FGFR1 Coordinates Phospholipid Homeostasis, Lipid Droplet Function, and ER Stress in Obesity. Endocrinology 157, 4754-4769.

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      Summary:

      The study by Dong et al., investigates the role of Hedgehog in the glial niche during larval neurogenesis in Drosophila. The authors describe the expression of Hh in cortex glia and its association with lipid droplets. They show that Hh expression in cortex glia is required for cortex glial proliferation, cell autonomously, and for maintenance of the normal cell cycle in neuroblasts. They go on to use a well characterised Drosophila glioma model, activation of FGF signalling, to investigate the requirement for Hh during cortex glial overgrowth. They show that FGF-activated cortex glial overproliferation requires Hh for modulation of neuroblast cell cycle, although Hh does not regulate cortex glial proliferation in this context. Finally, they show that inhibition of lipid modification of Hh rescues the neuroblast proliferation cell cycle defect caused by FGF activation in cortex glia.

      Major comments:

      1.From the data in presented in Fig. 2H-K and Fig. S3C, I am very confused about role of Hh in the non-cell autonomous regulation of neuroblast cell cycle. Both RNAi and overexpression of Hh with Repo-Gal4 cause a reduction in the neuroblast EdU index (Fig. 2H-K and S3C). The authors conclude this section on p.7 saying "Together, our data suggests that high levels of glial Hh expression restricts NB cell cycle progression." This statement is not consistent with data. What is the normal physiological role of Hh if both decreased and increased levels of cortex glial Hh expression reduce neuroblast cell cycle? The discussion of p.15 does not clarify this issue. The model in Fig.7J relates to the role of Hh in the context of cortex glial FGF activation and does not illustrate the normal physiological role of Hh in the regulation of neuroblast cell cycle.

      2.P.8 "Analysis of the total glial cell number indicates overexpression of htlACT, but not InRwt or EgfrACT, led to an increase in the number of cortex glial cells (Figure 4E-G, I-K)." This statement is confusing as Repo staining was used to quantify total glial numbers (including perineural, sub-perineural and cortex glia) but these data are then taken to represent and increase specifically in cortex glia. This should be clarified.

      3.It should be mentioned on p.8 that the data in Fig.4A-K reproduce the findings of Avet-Rochex et al., 2012 and Read et al., 2009.

      4.Figure 6F. Presumably due to the increase in glia cell number and dramatic increase in glial cell volume, any gene that is specific to, or enriched in, cortex glia will have increased expression levels in RepoGal4>htlACT larval CNS. Can the authors provide evidence that the increase in the expression of these genes is specific to FGF transcriptional regulation and not just a relative increase in the levels of these genes due to an increase in cortex glia as proportion of total CNS volume? Is there any evidence that Hh, fasn1 and lsd2 are direct transcriptional targets of FGF signalling in glia?

      5.FGF signalling has been shown to be necessary and sufficient for cortex glial proliferation. So does knockdown of Htl, or expression of dominant negative Htl, cause a reduction in Hh, fasn1 and lsd2 expression in cortex glia? If so, does how does reduction of cortex glial numbers independent of FGF signalling, using for example knockdown of String or expression of Decapo, affect the expression of Hh, fasn1 and lsd2 in cortex glia?

      6.Can the authors speculate on why and how increased levels of Hh in cortex glia, in the context of FGF activation, inhibit neuroblast cell cycle? Is this a physiological mechanism to limit neuroblast proliferation in the face of increased gliogenesis, or is it simply an indirect result of 'spillover' of excess Hh from cortex glia onto neuroblasts (which are autonomously regulated by Hh and so sensitive to this ligand) by due to increased cortex glia cells?

      Minor comments:

      -Figure 1C' some lipid droplets are extremely large, is this consistent with previous literature?

      -Including a profile plot of relative fluorescence intensity in Figure 1C',F',H' to illustrate colocalization of lipidTOX and Hh, would be helpful.

      -Figure S3A,B quantify Hh protein level and CNS size phenotypes with Hh RNAi.

      -p.6 include data showing overexpression of Hh does not cause glial overgrowth.

      -Top of p.14 should be FigS6A-C.

      -Include quantification of glial overgrowth and lipid droplet phenotypes with HtlACT plus catalase and SOD1 overexpression (Fig. S6D-K).

      Significance

      The is a novel and very interesting study, well written and the data are very clearly presented. It builds on and adds to the emerging literature on the glial niche and its role in neural stem cell regulation. It will be of great interest to Drosophila neurobiologists but also to the broader field of neural stem cell biology.

      My expertise is Drosophila neurobiology.

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      Summary:

      In this study, the authors investigate the role of hedgehog signaling and lipid metabolism in the neural stem cell niche of the Drosophila larvae. They demonstrate that Hedgehog localizes to lipid droplets in glial cells and show that Hh is necessary but not sufficient for elaboration of glial membranes and normal rates of glial proliferation during development. In addition, they provide an extensive set of results in support of a model that FGF signaling functions upstream of lipid metabolism and hh in glial cells as well as a parallel ROS mediated pathway in glial cells to promote neuroblast proliferation. In general, the results provide strong support for the conclusions. Specifically, the approaches are sound, the images clearly demonstrate the phenotypes described, and the effects are quantified and tested for statistical significance.

      Major comments:

      1.Since Hh RNAi decreases the glial compartment (which slows NB proliferation) and increases the frequency of pH3+ NBs, it is unclear why it would decrease the number of EdU+ NBs (Fig. S3C).

      2.If overexpression of htl[ACT] slows the NB cell cycle (as evidenced by reduced pH3 and EdU positive cells), it unclear why it does not reduce the number of NBs (Fig. 4L).

      3.What is the justification for presenting the EdU quantifications as an EdU index in which the experimental values are normalized to the average number of positive cells in the control? In many cases, the comparison is to the same w[1118] line so it does not control for a specific genetic backgrounds and yet this method may be obscuring experimental variation present between datasets. Likewise, why is glial number presented as a fold-change but NB number is presented as raw counts (e.g. 2D vs S3E)?

      Minor comments:

      On the top of P.14, "Figure S7A-C" should probably be "Figure S6A-C"

      Significance

      The cell autonomous regulation of growth and proliferation of neuroblasts in the larval brain have been well-studied, but much less is known about the non-cell autonomous signals. This paper significantly moves forward knowledge in this area by describing multiple steps of a molecular mechanism for glial regulation of the neuroblast cell cycle. These findings would be of interest not only to the study of Drosophila neuroblasts, but also to the broader adult stem cell field.

      My expertise is in Drosophila stem cell biology and genetics.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      We thank the three reviewers for providing valuable feedback on our original manuscript. A point-by-point response to all of these comments is provided below. [Note that figures are not added in-line because of text-only limitations.]

      Reviewer #1 (Evidence, reproducibility and clarity (Required)):

      The submitted manuscript entitled 'Predicting cell health phenotypes using image-based morphology profiling' (RC-2020-00394) by Way et al. presents a set of seven dyes/staining (as two separate panels) to microscopically screen cell viability. For automatic classification a training/test set of 119 CRISPR (approximately 2 sgRNAs per gene) perturbations on 3 cancer cell lines were generated (lung A549, ovarian ES2, lung HCC44). After segmentation of cell nuclei a set of morphological cell measurements were extracted from each perturbation (total 952 features). The nature of these feature spanning cell cycle and viability phenotypes, enabled the authors to define 70 different phenotype classes, which are used to model a classifier by elastic linear regression. Specific definitions (cell cycle and ROS) were partly predicted/validated in an independent existing image data set (Drug Repurposing Hub project). The data is available as web-based application/visualization and the supplementary method is well described.

      We thank the reviewer for their constructive comments and helpful feedback.

      There is one subtle point that is worth raising given this description: The images we use to measure the cell cycle and viability phenotypes (two different staining panels in the Cell Health assays) are not the same images we use to extract morphology measurements (Cell Painting assay). This lack of connection, which is based on a light wavelength limitation present in all microscopes that limits the number of stains in a single assay, prevents us from developing a method that analyzes the same cells across the three assays. This distinction will become important later in the review, and we have made specific changes in the manuscript to increase clarity.

      **Major concerns:**

      (1)The only fundamental argument of this manuscript not to apply state-of-the-art deep learning (DL) machine-learning (mentioned in McCain et al. 2018), which does not require segmentation, feature extraction, abstraction, manual gating is the 'interpretability' of the predictions. However, performance, precision, scalability (by modern GPUs) with DL should clearly outperform 'manual' regression models. All recent machine vision benchmarks in microscopy confirm this, but also clearly shows 'real world' translational applications, e.g.

      https://www.nature.com/articles/s43018-020-0085-8,

      https://www.biorxiv.org/content/10.1101/2020.07.02.183814v1.full.pdf,

      In other words, the presented methodology is not compared to DL, and is not convincing in terms of interpretability benefits.

      (We’ve copied a similar critique from __Significance sectio__n from Reviewer #1 in order to reduce redundancy) The author/co-authors have been instrumental/pioneered with their past work on cell-based image processing (CellProfiler software), but the presented methodology is simply outdated. Therefore, a revision towards a comparison and benchmarking with DL will also not help.

      Ref (DL with MIL): https://academic.oup.com/bioinformatics/article/32/12/i52/2288769

      We agree that deep learning approaches are exciting; much of our laboratory’s work focuses on their application (see https://doi.org/10.1073/pnas.2001227117, https://doi.org/10.1038/s41592-019-0612-7; https://doi.org/10.1002/cyto.a.23863, https://doi.org/10.1109/CVPR.2018.00970), and we agree that they are likely to outperform simpler regression models trained using so-called hand-engineered features. We thank the reviewer for highlighting our failure to accurately and fully describe our rationale.

      We intentionally did not use deep learning for this problem given (a) data limitations (b) the primary goal of the manuscript, which is to demonstrate feasibility.

      Data limitations. There is no mechanism to link the cells of the assays (Cell Health and Cell Painting) together, which greatly reduces the available sample size. In the two referenced manuscripts, which each propose an exciting approach, the dataset is much larger (~17,000 and ~1,000 images respectively). Our dataset is only 357 perturbations that can only be linked between assays at the perturbation level rather than a single-cell level. Therefore, a deep learning approach is likely to produce models that don’t generalize to other datasets. Furthermore, reviewer 3 commented in favor of the approach we presented: “Using elastic net regression models is well-suited to the problem due to the low number of observations.”

      Primary goal of the manuscript is to demonstrate feasibility. In addition, the primary goal of the manuscript is to add cell health annotations as functional readouts to perturbations. Our aim was to demonstrate feasibility of predicting cell health states, not to optimize performance. Optimizing performance would require collecting much more data, or developing new deep learning or data collection methods to account for the lack of matched single cell readouts.

      To make this rationale more clear and concise, we have made the following changes in the manuscript:

      In the first paragraph of page 3, we make some minor contextual updates (”To demonstrate proof of concept, we collected a small pilot dataset of 119 CRISPR knockout perturbations…”) and replaced “We used simple machine learning methods, which are relatively easy to interpret compared to deep learning” with:

      We used simple machine learning methods instead of a deep learning approach because of our limited sample size of 119 perturbations and the inability to increase the sample size by linking single cell measurements across assays.

      We have also amended the Conclusions section to emphasize our primary goal and note possible deep learning extensions as future directions. The Conclusions now reads:

      We have demonstrated feasibility that information in Cell Painting images can predict many different Cell Health indicators even when trained on a small dataset. The results motivate collecting larger datasets for training, with more perturbations and multiple cell lines. These new datasets would enable the development of more expressive models, based on deep learning, that can be applied to single cells. Including orthogonal imaging markers of CRISPR infection would also enable us to isolate cells with expected morphologies. More data and better models would improve the performance and generalizability of Cell Health models and enable annotation of new and existing large-scale Cell Painting datasets with important mechanisms of cell health and toxicity.

      (2)One aforementioned point of the methodology is cryptically/not described: Why it should be less expensive compared with other (which?) approaches (see introduction)?

      We thank the reviewer for bringing up this point. We believe that part of this confusion stems from a slight misunderstanding about how images from the three assays (two Cell Health and one Cell Painting) are collected. The Cell Health assays are two distinct panels of targeted reagents that are separately prepared as two physically distinct assays. The Cell Painting assay is already an established assay used by many labs and companies around the world to mark cell morphology in an unbiased and relatively cheap way. We are comparing the expenses between the two Cell Health assays vs. the Cell Painting assay.

      We believe that this misunderstanding likely results from our somewhat cryptic and inconsistent language when describing the Cell Health assays in the abstract and introduction. We’ve updated the third sentence of the abstract from “We developed two customized microscopy assays that use seven reagents to measure 70 specific cell health phenotypes...” to now read:

      We developed two customized microscopy assays, one using four targeted reagents and the other three targeted reagents, to collectively measure 70 specific cell health phenotypes including proliferation, apoptosis, reactive oxygen species (ROS), DNA damage, and cell cycle stage.

      For consistency, we have also updated the penultimate paragraph in the introduction to now read:

      To do this, we first developed two customized microscopy assays, which collectively report on 70 different cell health indicators via a total of seven reagents applied in two reagent panels. Collectively, we call these assays “Cell Health”.

      With these clarifications in mind, we believe that the question of comparing monetary costs is more clear. We are comparing the costs of the targeted reagents in the two Cell Health assays to the unbiased reagents in the single Cell Painting assay. We’ve also modified the last two sentences in the first paragraph of the introduction to strengthen the connection between Cell Health assays, targeted reagents, and high cost:

      Cell health is normally assessed by eye or measured by specifically targeted reagents, which are either focused on a single Cell Health parameter (ATP assays) or multiple, in combination, via FACS-based or image-based analyses, which involves a manual gating approach, complicated staining procedures, and significant reagent cost. These traditional approaches limit the ability to scale to large perturbation libraries such as candidate compounds in academic and pharmaceutical screening centers.

      (3)Generalizability and/or training data size is essential for any model-based classification, but not evaluated or validated in the current manuscript. The independent validation on a A549 cell line only data might be not sufficient/convincing.

      We separately address the two distinct points raised by the reviewer of 1) generalizability and 2) training data size:

      Generalizability We agree that any model-based classification must demonstrate generalizability. For this reason, we have taken careful consideration to assess the generalizability of all 70 models in two contexts. First, we assessed model performance in a single held out test set (15% of all data). All results we report in the main text (e.g. Figure 2) report performance on this test set. We see high performance in many (but not all) models, and we observe much better model performance compared to a negative control baseline (New Supplementary Figure S5). High performance in the test set indicates that, for some cell health indicators, the models generalize well.

      Second, we also demonstrate that these models generalize to data from an entirely different experiment using a fundamentally different perturbation (CRISPR vs. drug compounds). We demonstrate generalizability to this external validation data in four different ways: 1) Validating a relatively simple model (“Number of Live Cells”) with an orthogonal viability readout from the PRISM assay (barcoding-based cell viability; updated Figure 4); 2) Demonstrating that proteasome inhibitors, which are known to produce reactive oxygen species, are predicted to do so; 3) Demonstrating that PLK inhibitors, which are known to reduce entry to G1, show a robust dose response in the "G1 Cell Count" model; and 4) Demonstrating that aurora kinase and tubulin inhibitors are predicted to induce high DNA damage (gH2AX) in G1 cells. These two drug classes are known to cause “mitotic slippage” and double stranded DNA breaks. The fourth example was added in response to a comment by reviewer 3.

      We’ve also added a series of enrichment tests, as described in the following new text:

      We also chose to validate three additional models: ROS, G1 cell count, and Number of gH2AX spots in G1 cells. We observed that the two proteasome inhibitors (bortezomib and MG-132) in the Drug Repurposing Hub set yielded high ROS predictions (OR = 76.7; p -15) (Figure 4C). Proteasome inhibitors are known to induce ROS (Han and Park, 2010; Ling et al., 2003). As well, PLK inhibitors yielded low G1 cell counts (OR = 0.035; p = 3.9 x 10-8) (Figure 4C). The PLK inhibitor HM-214 showed an appropriate dose response (Figure 4D). PLK inhibitors block mitotic progression, thus reducing entry into the G1 cell cycle phase (Lee et al., 2014). Lastly, we observed that aurora kinase and tubulin inhibitors were enriched for high Number of gH2AX spots in G1 cells predictions (OR = 11.3; p -15) (Figure 4E). In particular, we observed a strong dose response for the aurora kinase inhibitor barasertib (AZD1152) (Figure 4F). Aurora kinase and tubulin inhibitors cause prolonged mitotic arrest, which can lead to mitotic slippage, G1 arrest, DNA damage, and senescence (Orth et al. 2011; Cheng and Crasta 2017; Tsuda et al. 2017).

      The updated methods section describing our approach to assess generalizability perform the enrichment tests now states:

      Assessing generalizability of cell health models applied to Drug Repurposing Hub data

      We used our cell health webapp (https://broad.io/cell-health-app) to identify compounds with high predictions for three models with high or intermediate performance: ROS, Number of G1 cells, and Number of gH2AX spots in G1 cells. For each model, we identified classes of compounds with consistently high scores, then tested for statistical enrichment: for proteasome inhibitors in the ROS model, PLK inhibitors in the Number of G1 cells model, and aurora kinase and tubulin inhibitors in the Number of gH2AX spots in G1 cells model. We used one-sided Fisher’s exact tests to quantify differences in expected proportions between high and low model predictions. For each case, we determined high and low predictions based on the 50% quantile threshold for each model independently.

      We acknowledge that prospectively making predictions and measuring Cell Health readouts directly in a new experiment would be more convincing, but we note that our existing assessment of generalizability in an external experiment is already unusual in machine learning publications. Additionally and unfortunately, collecting a second validation dataset for this manuscript is not currently feasible given experiments backlogged from COVID.

      1. Training data size

      We also agree that a more comprehensive analysis on training data size would be an important indicator of model limitations. Therefore, we performed a sample titration analysis in which we randomly dropped samples from the training procedure, and tracked performance of the held out test set. We add the following figure, figure legend, and results text to describe and interpret the results.

      Supplementary Figure S13: Dropping samples from training reduces test set model performance in high, mid, and low performing models. We determined model performance stratification by taking the top third, mid third, and bottom third of test set performance when using all data. We performed the sample titration analysis with 10 different random seeds and visualized the median test set performance for each model.

      We updated the results section to introduce and discuss this result:

      Lastly, we performed a sample size titration analysis in which we randomly removed a decreasing amount of samples from training. For the high and mid performing models, we observed a consistent performance drop, suggesting that increasing sample size would result in better overall performance (Supplementary Figure 13).

      Finally, the updated methods section describing our sample titration analysis now reads:

      Machine learning robustness: Investigating the impact of sample size

      We performed an analysis in which we randomly dropped an increasing amount of samples from the training set before model training. After dropping the predefined number of samples, we retrained all 70 cell health models and assessed performance on the original holdout test set. We performed this procedure ten times with ten unique random seeds to mirror a more realistic scenario of new data collection and to reduce the impact of outlier samples on model training.

      All software updates introducing this analysis can be viewed at https://github.com/broadinstitute/cell-health/pull/143

      **Minor concerns:**

      (1)Highest test performance comprises that precision is mainly driven by cell cycle/count and live status and could be probably derived from DRAQ7 (Fig. 2) and DNA granularity (Fig. 3, bottom right) and would argue for rigid feature selection across channels and features.

      We believe that clarifying the confusion between the two Cell Health assays we developed and the well-established Cell Painting assay addresses part of this concern. The DRAQ7 dye marks dead cells, and is measured in Cell Health. In other words, readouts from this reagent are what we aim to predict, not what we use for training. Indeed, DRAQ7-based phenotypes are among the top predicted models, which is a result we present in Supplementary Figure S7 - this figure uncovers which Cell Health phenotypes are more easily predicted by Cell Painting.

      The DNA granularity morphology measurements are collected from the Cell Painting assay and thus are available for training, and, as noted by the reviewer, encode a high proportion of signal in predicting the various cell health phenotypes. In our most common processing workflows for other projects, we do apply a rigid feature selection pipeline to all Cell Painting profiles before analysis, but we do not do this in this analysis since we were using a model with a sparsity-inducing penalty (elastic net).

      To directly answer the question of how channels and feature groups influence model performance, we’ve performed a systematic experiment removing different channel, compartment, and feature groups and retraining all models with the specific group dropped. We now include the following supplementary figure:

      Supplementary Figure S12: Systematically removing classes of features has little impact on most models’ performance. We retrained all 70 cell health models after dropping features associated with specific (a) feature groups, (b) channels, and (c) compartments. Each dot is one model (predictor), and the performance difference between the original model and the retrained model after dropping features is shown on the x axis. Any positive change indicates that the models got worse after dropping the feature group. (d) Individual model differences in performance after dropping features. Each dot is one class of features removed (as in a-c).

      Additionally, we updated the results section to introduce and discuss this result:

      We also performed a systematic feature removal analysis, in which we retrained cell health models after dropping features that are measured from specific groups, compartments, and channels. We observed that most models were robust to dropping entire feature classes during training (Supplementary Figure 12). This result demonstrates that many Cell Painting features are highly correlated, which might permit prediction “rescue” even if the directly implicated morphology features are not measured. Because of this, we urge caution when generating hypotheses regarding causal relationships between readouts and individual Cell Painting features.

      And we add the following to the methods section:

      Machine learning robustness: Systematically removing feature classes

      We performed an analysis in which we systematically dropped features measured in specific compartments (Nuclei, Cells, and Cytoplasm), specific channels (RNA, Mito, ER, DNA, AGP), and specific feature groups (Texture, Radial Distribution, Neighbors, Intensity, Granularity, Correlation, Area Shape) and retrained all models. We omitted one feature class and then independently optimized all 70 cell health models as described in the Machine learning framework results section above. We repeated this procedure once per feature class.

      All software updates introducing this analysis can be viewed at https://github.com/broadinstitute/cell-health/pull/143

      (2)Any H2AX and 'polynuclear' would probably fail in any cell line with this size of training data.

      Indeed we would expect certain cell health phenotype models to fail if they had few hits and a relatively low variance of output values. This hit rate is directly associated with the phenotypes that the CRISPR perturbations induce, which is why we intentionally selected them to span multiple gene pathways in an attempt to maximize morphology diversity (see Supplementary Table S1).

      We did indeed observe that the polynuclear model had few hits in the training data and relatively poor performance. We did not expect this result, given that DNA stains are captured in the Cell Health and Cell Painting assays. We suspect the poor performance in this model is likely because so few cells were classified as polynuclear in our gating strategy, making it perhaps an inconsistently measured readout.

      By contrast, some gH2AX models did have relatively good performance. In the conclusion, we note that increased training data size using more perturbations is likely to improve model performance:

      The results motivate collecting larger datasets for training, with more perturbations and multiple cell lines. These new datasets would enable the development of more expressive models, based on deep learning, that can be applied to single cells. Including orthogonal imaging markers of CRISPR infection would also enable us to isolate cells with expected morphologies. More data and better models would improve the performance and generalizability of Cell Health models and enable annotation of new and existing large-scale Cell Painting datasets with important mechanisms of cell health and toxicity.

      (3)To what refers the 'weights' of the model in Fig. 1c?

      We thank the reviewer for pointing out that we never defined this term in the Figure 1 legend. We use “weights” to refer to the coefficients from the regression model. To make this more clear, we have updated the legend to now read: “Model coefficient weights” and the text in Figure 1C to now read “model weights”.

      Reviewer #1 (Significance (Required)):

      This manuscript is not advanced in the context of latest improvements/developments of cell-based microscopic classification. Rationale in the introduction and the conclusion are not linked (interpretability, generalizability, costs). It seems to be unfinished or unformatted to this end?

      Since responding to these reviews, we believe that our primary motivation - to demonstrate proof-of-concept of predicting cell health phenotypes directly from Cell Painting data - is now much clearer, holistically. We provide below an updated introduction, which improves rationale.

      Perturbing cells with specific genetic and chemical reagents in different environmental contexts impacts cells in various ways (Kitano, 2002). For example, certain perturbations impact cell health by stalling cells in specific cell cycle stages, increasing or decreasing proliferation rate, or inducing cell death via specific pathways (Markowetz, 2010; Szalai et al., 2019). Cell health is normally assessed by eye or measured by specifically targeted reagents, which are either focused on a single Cell Health parameter (ATP assays) or multiple, in combination, via FACS-based or image-based analyses, which involves a manual gating approach, complicated staining procedures, and significant reagent cost. These traditional approaches limit the ability to scale to large perturbation libraries such as candidate compounds in academic and pharmaceutical screening centers.

      Image-based profiling assays are increasingly being used to quantitatively study the morphological impact of chemical and genetic perturbations in various cell contexts (Caicedo et al., 2016; Scheeder et al., 2018). One unbiased assay, called Cell Painting, stains for various cellular compartments and organelles using non-specific and inexpensive reagents (Gustafsdottir et al., 2013). Cell Painting has been used to identify small-molecule mechanisms of action (MOA), study the impact of overexpressing cancer mutations, and discover new bioactive mechanisms, among many other applications (Caicedo et al., 2018; Christoforow et al., 2019; Hughes et al., 2020; Pahl and Sievers, 2019; Rohban et al., 2017; Simm et al., 2018; Wawer et al., 2014). Additionally, Cell Painting can predict mammalian toxicity levels for environmental chemicals (Nyffeler et al., 2020) and some of its derived morphology measurements are readily interpreted by cell biologists and relate to cell health (Bray et al., 2016). However, no single assay enables discovery of fine-grained cell health readouts.

      We hypothesized that we could predict many cell health readouts directly from the Cell Painting data, which is already available for hundreds of thousands of perturbations. This would enable the rapid and interpretable annotation of small molecules or genetic perturbations. To do this, we first developed a customized microscopy assays, which collectively report on 70 different cell health indicators via a total of seven reagents applied in two reagent panels. Collectively, we call these assay panels “Cell Health”.

      To demonstrate proof of concept, we collected a small pilot dataset of 119 CRISPR knockout perturbations in three different cell lines using Cell Painting and Cell Health. We used the Cell Painting morphology readouts to train 70 different regression models to predict each Cell Health indicator independently. We used simple machine learning methods instead of a deep learning approach because of our limited sample size and the inability to increase it by linking single cell measurements from both assays. We predicted certain readouts, such as the number of S phase cells, with high performance, while performance on other readouts, such as DNA damage in G2 phase cells, was low. We applied and validated these models on a separate set of existing Cell Painting images acquired from 1,571 compound perturbations measured across six different doses from the Drug Repurposing Hub project (Corsello et al., 2017). We provide all predictions in an intuitive web-based application at http://broad.io/cell-health-app, so that others can extend our work and explore cell health impacts of specific compounds.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)):

      This report from Way et al describes a method of extending a very popular screening technology called Cell Painting developed by the Carpenter Lab. The authors are contending with an important issue and as such this paper potentially will be of great interest to the community. Cell Painting provides quantitative fingerprints of cell phenotypes in response to changes in the molecular or physiological status of cells. However the molecular basis or even the candidate pathways for those changes is not always clear. Here, the authors take specific markers of cell physiology, e.g., DNA damage, ROS production, cell cycle progression etc. and relate them to Cell Painting features. The authors are trying to address the issue that running many probes of cell physiology is expensive and time consuming and that identifying proxies for these assays using much simpler Cell Painting technologies would be a useful and potentially powerful approach. The overall goal is to develop some type of regression model that can link the state of cells (the "health") to Cell Painting fingerprints.

      The authors use three separate cell lines and CRISPR knockouts delivered through lentivirus that target 59 genes to establish a range of cell physiologies that they directly measure (the "Cell Health") and then relate to similar assays performed by Cell Painting. Ultimately they aim to use Cell Painting models to predict Cell Health.

      We thank the reviewer for their succinct summary of our goals and rationale for this manuscript, and for the constructive and valuable comments herein.

      **Major Issues:**

      It appears that the phenotypes that are detected at a high enough level of significance (see Fig. 2), e.g DNA damage (gH2Ax), apoptosis (Caspase 3/7), dead cells, ROS (CellROX), etc. are probably most easily detected by simply monitoring DAPI signal in these screens. To detect many of the phenotypes, the authors have presented a fairly complex method of doing much simpler assays. The authors correctly highlight in Fig. 3 that the phenotypes they are detecting go beyond pure signals from DAPI. They report power in their models from Radial Distribution across many different components of the Cell Painting feature set.

      We agree that the two assays we’re collectively calling “Cell Health” are indeed fairly complex - we use two different panels of multiplexed stains and a series of gating strategies to measure phenotypes in various cell subpopulations. However, the fundamental message in the manuscript is that we may no longer need to perform these complex assays if we get this information from the simpler Cell Painting assay.

      We agree that our machine learning approach to predict the various cell health phenotypes uses signals beyond nucleus-based stains. However, even if we are predicting just DAPI signals, this reinforces our argument that the specific stains in the Cell Health assays (which are commonly used in targeted experiments) are not necessary to measure specifically. Instead, in certain circumstances, a scientist should just use unbiased stains to capture their biology of interest, since the stains are cheaper at scale and one has access to much more information.

      It is also worth noting that the DNA damage phenotypes in specific cell subpopulations (e.g. DNA Damage in G1 cells) would not be possible to measure with high precision without EdU co-staining.

      However these appear to give outputs that won't be that useful. It is hard to tell whether this is simply because they don't have enough images or whether their signal is confounded by using cell lines where the lentivirus CRISPR knockouts are working less efficiently.

      (Reviewer 2 introduced a similar critique below, which we now move here) A fundamental issue that the authors mention but do not address is the efficiency of the CRISPR KOs. The authors should measure the efficiency of representative guides and present these data to help support the interpretation of their models.

      We definitely agree that sample size is a limitation in this manuscript. Our primary goal with this paper was to demonstrate feasibility of the approach to predict the targeted Cell Health readouts using a simpler (and more affordable/scalable) assay in Cell Painting. The promising results we observed, especially given this sample size limitation, motivates collecting a larger dataset using more perturbations.

      Potentially confounded signal by low efficiency CRISPR knockouts is also an interesting topic. We do provide Supplementary Figure S8 to describe a subtle relationship that we observed regarding CRISPR infection efficiency. We also discuss this in the results as: “We observed overall better predictivity in ES2 cells, which had the highest CRISPR infection efficiency (Supplementary Figure 8), suggesting that stronger perturbations provide better information for training and that training on additional data should provide further benefit.”

      Additionally, we made a substantial effort to maximize CRISPR efficiency by independently optimizing lentivirus volumes for each sgRNA. In general, we observed that some cell lines are easier to CRISPR, probably based on more factors beyond Cas9 expression. However, we note that CRISPR is being used simply as a perturbation to elicit a variable morphology response. In other words, the type, efficacy, and even accuracy of perturbation does not matter as long as it satisfies two constraints: 1) induces a morphology response for a sufficient number of perturbations, and 2) is consistent between the two assays (Cell Health and Cell Painting). Our setup satisfies both constraints.

      However, this experiment (and data from the experiment) can be used in other contexts in which the CRISPR efficiency is extremely important. Therefore, we added three columns to Supplementary Table 1 providing the efficiency readouts for the three cell lines. (This information was already present in GitHub, but we moved it to a more obvious location in Supplementary Table 1). Code describing this change can be viewed here: https://github.com/broadinstitute/cell-health/pull/142

      In regards to the first sentence of this concern: “However these appear to give outputs that won’t be that useful” - indeed, we fully expected that many cell health readouts would be difficult to predict. In the original submission, we included the following explanation for potential sources of low performing models: ”Performance differences might result from random technical variation, small sample sizes for training models, different number of cells in certain Cell Health subpopulations (e.g. mitosis or polynuclear cells), fewer cells collected in the viability panel (see methods), or the inability of Cell Painting reagents to capture certain phenotypes.”

      It seems misleading (or perhaps the explanation lacks clarity) to describe in the same paragraph the need to validate the model by applying it to new datasets, namely the Drug Repurposing Hub project, then describe gradients in cell health features across UMAP coordinates.

      We thank the reviewer for pointing out this source of confusion and for providing an opportunity to improve the clarity of this section. Our major revisions here are as follows: 1) Introduce the Drug Repurposing Hub as an external dataset for validation; 2) Validate a high performing and simple model (number of live cells) by comparing model readout predictions from the Drug Repurposing Hub Cell Painting profiles against orthogonal PRISM viability readouts (in compounds with slightly different doses); 3) Validate three additional models: enrichment of proteasome inhibitors in the ROS model, enrichment of PLK inhibitors in the G1 cell count model, and enrichment of tubulin-destabilizing compounds in the Number of gH2Ax spots in G1 cells model; 4) Display a global structure of Cell Health predictions in UMAP space for select models. Note that for the fourth point, we are using the UMAP gradients to observe patterns, and not to validate models.

      In order to encapsulate the updated flow, we’ve pasted below the entire Drug Repurposing Hub results/discussion section, which introduces two additional analyses and new text in response to various other reviewer comments. We feel that the updated section improves clarity and purpose.

      The updated section now reads:

      “Predictive models of cell health would be most useful if they could be trained once and successfully applied to data sets collected separately from the experiment used for training. Otherwise one could not annotate existing datasets that lack parallel Cell Health results, and Cell Health assays would have to be run alongside each new dataset. We therefore applied our trained models to a large, publicly-available Cell Painting dataset collected as part of the Drug Repurposing Hub project (Corsello et al., 2017). The data derive from A549 lung cancer cells treated with 1,571 compound perturbations measured in six doses.

      We first chose a simple, high-performing model to validate. The number of live cells model captures the number of cells that are unstained by DRAQ7. We compared model predictions to orthogonal viability readouts from a third dataset: Publicly available PRISM assay readouts, which count barcoded cells after an incubation period (Yu et al., 2016). Despite measuring perturbations with slightly different doses and being fundamentally different ways to count live cells (Figure 4A), the predictions correlated with the assay readout (Spearman's Rho = 0.35, p -3; Figure 4B).

      We also chose to validate three additional models: ROS, G1 cell count, and Number of gH2AX spots in G1 cells. We observed that the two proteasome inhibitors (bortezomib and MG-132) in the Drug Repurposing Hub set yielded high ROS predictions (OR = 76.7; p -15) (Figure 4C). Proteasome inhibitors are known to induce ROS (Han and Park, 2010; Ling et al., 2003). As well, PLK inhibitors yielded low G1 cell counts (OR = 0.035; p = 3.9 x 10-8) (Figure 4C). The PLK inhibitor HM-214 showed an appropriate dose response (Figure 4D). PLK inhibitors block mitotic progression, thus reducing entry into the G1 cell cycle phase (Lee et al., 2014). Lastly, we observed that aurora kinase and tubulin inhibitors yielded high Number of gH2AX spots in G1 cells predictions (OR = 11.3; p Figure 4E). In particular, we observed a strong dose response for the aurora kinase inhibitor barasertib (AZD1152) (Figure 4F). Aurora kinase and tubulin inhibitors cause prolonged mitotic arrest, which can lead to mitotic slippage, G1 arrest, DNA damage, and senescence (Orth et al. 2011; Cheng and Crasta 2017; Tsuda et al. 2017).

      We applied uniform manifold approximation (UMAP) to observe the underlying structure of the samples as captured by morphology data (McInnes et al., 2018). We observed that the UMAP space captures gradients in predicted G1 cell count (Supplementary Figure S14A) and in predicted ROS (Supplementary Figure S14B). We also observed similar gradients in the ground truth cell health readouts in the CRISPR Cell Painting profiles used for training cell health models (Supplementary Figure S15). Gradients in our data suggest that cell health phenotypes manifest in a continuum rather than in discrete states.

      Lastly, we observed moderate technical artifacts in the Drug Repurposing Hub profiles, indicated by high DMSO profile dispersion in the Cell Painting UMAP space (Supplementary Figure 14C). This represents an opportunity to improve model predictions with new batch effect correction tools. Additionally, it is important to note that the expected performance of each Cell Health model can only be as good as the performance observed in the original test set (see Figure 2), and that all predictions require further experimental validation.“

      Updated Figure 4:

      Figure 4: Validating Cell Health models applied to Cell Painting data from The Drug Repurposing Hub. The models were not trained using the Drug Repurposing Hub data. (a) The results of the dose alignment between the PRISM assay and the Drug Repurposing Hub data. This view indicates that there was not a one-to-one matching between perturbation doses. (b) Comparing viability estimates from the PRISM assay to the predicted number of live cells in the Drug Repurposing Hub. The PRISM assay estimates viability by measuring barcoded A549 cells after an incubation period. (c) Drug Repurposing Hub profiles stratified by G1 cell count and ROS predictions. Bortezomib and MG-132 are proteasome inhibitors and are used as positive controls in the Drug Repurposing Hub set; DMSO is a negative control. We also highlight all PLK inhibitors in the dataset. (d) HMN-214 is an example of a PLK inhibitor that shows strong dose response for G1 cell count predictions. (e) Tubulin and aurora kinase inhibitors are predicted to have high Number of gH2AX spots in G1 cells compared to other compounds and controls. (f) Barasertib (AZD1152) is an aurora kinase inhibitor that is predicted to have a strong dose response for Number of gH2AX spots in G1 cells predictions.

      Updated Supplementary Figure:

      Supplementary Figure S14: Applying a Uniform Manifold Approximation (UMAP) to Drug Repurposing Hub consensus profiles of 1,571 compounds across six doses. The models were not trained using the Drug Repurposing Hub data. (a) The point color represents the output of the Cell Health model trained to predict the number of cells in G1 phase (G1 cell count). (b) The same UMAP dimensions, but colored by the output of the Cell Health model trained to predict reactive oxygen species (ROS). (c) In the UMAP space, we highlight DMSO as a negative control, and Bortezomib and MG-132 as two positive controls (proteasome inhibitors) in the Drug Repurposing Hub set. We observe moderate batch effects in the negative control DMSO profiles, based on their spread in this visualization. The color represents the predicted number of live cells. The positive controls were acquired with a very high dose and are expected to result in a very low number of predicted live cells.

      All software updates required to update these figures can be viewed at https://github.com/broadinstitute/cell-health/pull/145

      Is it surprising that cell health phenotypes and gradients therein are present in a dataset describing cell health perturbations?

      This was not surprising to us, and we thank the reviewer for asking the question. We have now added a new Supplementary Figure to present a UMAP with ground truth cell health measurements in the CRISPR dataset (pasted below). By adding the figure, we show how Cell Health predictions are expected to show gradients in UMAP space. In fact, for any lower-dimensional embedding that is able to preserve local neighborhoods of the high-dimensional space, we should expect all linear transformations of the input data (in the high-dimensional space) to vary smoothly across the lower-dimensional embedding. However, it is still informative to observe where the specific Cell Health phenotype predictions manifest in relation to global morphology structure. We add the following sentence in the Drug Repurposing Hub paragraph juxtaposed to the other UMAP gradient observations:

      We applied uniform manifold approximation (UMAP) to observe the underlying structure of the samples as captured by morphology data (McInnes et al., 2018). We observed that the UMAP space captures gradients in predicted G1 cell count (Supplementary Figure S14A) and in predicted ROS (Supplementary Figure S14B). We also observed similar gradients in the ground truth cell health readouts in the CRISPR Cell Painting profiles used for training cell health models (Supplementary Figure S15). Gradients in our data suggest that cell health phenotypes manifest in a continuum rather than in discrete states.

      Supplementary Figure S15: Applying a Uniform Manifold Approximation (UMAP) to the Cell Painting consensus profile data of CRISPR perturbations. UMAP coordinates visualized by (a) cell line, (b) ground truth G1 cell counts, and (c) ground truth ROS counts. (d) Visualizing the distribution of ground truth ROS compared against G1 cell count. The two outlier ES2 profiles are CRISPR knockdowns of GPX4, which is known to cause high ROS.

      We have also added the option to explore the CRISPR profile Cell Health ground truth in our shiny app https://broad.io/cell-health (screenshot pasted below)

      Modifications to the software introducing these changes can be viewed at https://github.com/broadinstitute/cell-health/pull/141.

      The actual test of the model's performance is in the paragraph below, but the data associated with the Spearman correlation is hidden in Fig. S10b. The data is not convincing by eye, and the artifactually low p value suggests that proper statistical corrections were not applied.

      We have moved the Spearman correlation figure (previously Supplementary Figure S10B) into a main figure, along with a complete restructuring of the results and discussion in the Drug Repurposing Hub section.

      We appreciate the careful observations and interpretations, and confirm the statistical test performed here is sound and the p value is correct (there is no need to account for multiple testing since there is only one test being applied, a test of correlation between two variables).

      We add this rationale to the “Comparing viability predictions to an orthogonal readout” methods section:

      We performed the non-parametric Spearman correlation test because 1) the doses were not aligned between the datasets we compared, and 2) it is possible that a strong nonlinear correlation exists between readouts from two fundamentally different ways to measure viability.

      It is definitely valid to critique the scatter plot relationship to understand that the mean squared error is quite high (i.e. if two datasets had viability measurements using the two approaches, it would be wrong to assume that lower measurements in one assay automatically could be compared to lower measurements of the other assay). This level of variability would be lost if all we did was report the test statistic, which is the reason why we included the scatter plot as a figure.

      It may also be important to mention that the authors of the PRISM paper also noted high variation in their estimates (from Corsello et al https://doi.org/10.1038/s43018-019-0018-6): "At the level of individual compound dose–responses, we note that the PRISM Repurposing dataset tends to be somewhat noisier, with a higher standard error estimated from vehicle control measurements (Extended Data Fig. 5c and Extended Data Fig. 6a–c)."

      Nevertheless, we agree that the current way we report this p value is distracting and potentially misleading, depending on how the p value is interpreted. Therefore, we have updated the reporting of all p values to say that they are less than a predefined cutoff. The figure now states that p

      Fig 1A and associated methods are not sufficient information to describe the manual gating strategy and any variability found across iterations in these gates. Effort should be taken to quantify where these manual boundaries were set and why.

      We describe the manual gating strategies in much detail in the methods section “Cell Health assay: Image analysis”. However, we agree that a description of measurement variability and experimental approach requires more detail, and we agree that the manuscript would benefit from a visual example of these gates. These improvements required us to rearrange Figure 1.

      With a goal of increasing reproducibility in the cell health assay, we’ve (1) moved example images of the Cell Health assay to Figure 1A; (2) Moved the existing gating strategies drawing to Supplementary Figure 1; (3) Added real data examples of the manual gating strategy as a new Supplementary Figure 2. We show all updates below:

      Updated Figure 1:

      Figure 1. Data processing and modeling approach. (a) Example images and workflow from the Cell Health assays. We apply a series of manual gating strategies (see Methods) to isolate cell subpopulations and to generate cell health readouts for each perturbation. (top) In the “Cell Cycle” panel, in each nucleus we measure Hoechst, EdU, PH3, and gH2AX. (bottom) In the “Cell Viability” panel, we capture digital phase contrast images, measure Caspase 3/7, DRAQ7, and CellROX. (b) Example Cell Painting image across five channels, plus a merged representation across channels. The image is cropped from a larger image and shows ES2 cells. Below are the steps applied in an image-based profiling pipeline, after features have been extracted from each cell’s image. (c) Modeling approach where we fit 70 different regression models using CellProfiler features derived from Cell Painting images to predict Cell Health readouts.

      Updated Supplementary Figure S1:

      Supplementary Figure S1: Illustration of the gating strategy in the Cell Health assays. We extract 70 different readouts from the Cell Health imaging assay. The assay consists of two customized reagent panels, which use measurements from seven different targeted reagents and one channel based on digital phase contrast (DPC) imaging; shown are five toy examples to demonstrate that individual cells are isolated into subpopulations by various gating strategies to define the Cell Health readouts.

      Updated Supplementary Figure S2 (Example gating strategies):

      Supplementary Figure S2: Real data of manual gating in the Cell Health assays.

      For each cell line, we apply a series of manual gating strategies defined by various stain measurements in single cells to define cell subpopulations. (a) In the cell cycle panel, we first select cells that are useful for cell cycle analysis based on nucleus roundness and Hoechst intensity measurements. We also identify polyploid and “large not round” (polynuclear) cells. (b) We then subdivide the cells used for cell cycle to G1, G2, and S cells based on total Hoechst intensity (DNA content) and EdU incorporation signal intensity. (c) We use Hoechst and PH3 nucleus intensity to define mitotic cells. The points are colored by EdU intensity in the nucleus in both (b) and (c). (d) Example gating in the viability panel. We use DRAQ7 and CellEvent (Caspase 3/7) to distinguish alive and dead cells, and categorize early or late apoptosis. See Methods for more details about how the Cell Health measurements are made.

      We’ve also added the following to the methods section:

      Additionally, we set these gates for each cell subpopulation using a set of random wells from each cell line and experiment independently. We observed that the intensity measurements used to form the gates were consistent across wells and plates, and generally formed distinct cell subpopulation clusters. After using the random wells to set the gates, we used the Harmony microscope software to apply the gates to the remaining wells and plates.

      In general however, the need to clearly define this process further emphasizes a strength in our approach: There is great potential for inconsistencies when different humans draw gates. We aim to reduce these inconsistencies by predicting these readouts from Cell Painting images directly.

      The authors conclude that their results motivate further data acquisition and model training, and that this will improve model performance. This is only true if their lack of predictive power comes from the data volume itself, and not in larger problems of data quality, variability and the core assumptions of their method. The authors note the better predictability in ES2 cells, likely due to higher CRISPR efficiency and therefore stronger phenotypes. It is possible, as I believe the authors suggest, that the ES2 cells provide information that improves the predictive power of cells with poor infection efficiency. It is instead possible that only the ES2 cells with strong phenotypes yield predictive power, pulling the average of the dataset up. Authors could train the cell line specific datasets independently and compare relative changes in predictive performance. Otherwise, is it possible that subtle or highly complex phenotypes simply cannot be detected by this method and more data will be unlikely to improve predictability in modest perturbations.

      We thank the reviewers for raising this possibility. To explore this, we performed a cell-line holdout analysis in which we retrained (and individually reoptimized) all 70 cell health models on every combination of two cell lines and predicted readouts from the held out third cell line.

      Despite there being fewer samples in the training set in the cell line holdout test compared to the original test set (66% vs. 85%) and the fact that each model had never seen the held out cell line before, many cell health phenotypes could still be predicted. We add the following results in a new Supplementary Figure:

      Supplementary Figure S11: Results from a cell line holdout analysis. We trained and evaluated all 70 cell health models in three different scenarios using each combination of two cell lines to train, and the remaining cell line to evaluate. For example, we trained all 70 models using data from A549 and ES2 and evaluated performance in HCC44. We bin all cell health models into 14 different categories (see Supplementary Table S3 and https://github.com/broadinstitute/cell-health/6.ml-robustness for details about the categories and scores). We also provide the original test set (15% of the data, distributed evenly across all cell types) performance in the last row, as well as results after training with randomly permuted data. This cross-cell-type analysis yields worse performance overall. Nevertheless, despite the models never encountering certain cell lines, and having fewer training data points, many models still have predictive power across cell line contexts. Note that we truncated the y axis to remove extreme outliers far below -1. The raw scores are available on https://github.com/broadinstitute/cell-health.

      We’ve also performed a sample size titration analysis, which suggests that more data would indeed improve model performance. More data would also enable a deep learning approach, which is also likely to improve performance.

      Supplementary Figure S13: Dropping samples from training reduces test set model performance in high, mid, and low performing models. We determined model performance stratification by taking the top third, mid third, and bottom third of test set performance when using all data. We performed the sample titration analysis with 10 different random seeds and visualized the median test set performance for each model.

      We also update the results section to introduce and discuss this result:

      Lastly, we performed a sample size titration analysis in which we randomly removed a decreasing amount of samples from training. For the high and mid performing models, we observed a consistent performance drop, suggesting that increasing sample size would result in better overall performance (Supplementary Figure 13).

      And an updated methods describing this analysis now reads:

      Machine learning robustness: Investigating the impact of sample size

      We performed an analysis in which we randomly dropped an increasing amount of samples from the training set before model training. After dropping the predefined number of samples, we retrained all 70 cell health models and assessed performance on the original holdout test set. We performed this procedure ten times with ten unique random seeds to mirror a more realistic scenario of new data collection and to reduce the impact of outlier samples on model training.

      All software updates introducing this analysis can be viewed at https://github.com/broadinstitute/cell-health/pull/143

      Although the authors argue that the Cell Painting assay is capturing complex health phenotypes using a variety of morphological features, there is a clear overweighting of a particular few (in fact two...). It would be interesting to systematically retrain with exclusion of particular features to determine if equalizing the weight across features changes performance. These are also notably the feature groups with the fewest features-- how many individual features within these feature groups are pulling all the weight?

      We agree that an additional computational analysis including a systematic feature removal would be interesting and valuable. We’ve included this analysis as part of a new results subsection in which we assess where classification improvements are likely to come from by testing robustness of the ML models.

      Specifically, we’ve systematically removed individual features that belong to specific feature groups, channels, and compartments to determine how much their absence negatively affects model performance. The added supplementary figure is pasted below.

      Supplementary Figure S12: Systematically removing classes of features has little impact on most models’ performance. We retrained all 70 cell health models after dropping features associated with specific (a) feature groups, (b) channels, and (c) compartments. Each dot is one model (predictor), and the performance difference between the original model and the retrained model after dropping features is shown on the x axis. Any positive change indicates that the models got worse after dropping the feature group. (d) Individual model differences in performance after dropping features. Each dot is one class of features removed (as in a-c).

      We conclude that the majority of cell health models are robust to missing feature groups. Some models actually improve with a reduction in the feature space. Combined with the feature heatmap presented in Figure 3, these results tell us that a lot of the morphology signal is redundant across Cell Painting features.

      We add the following text to the results:

      We also performed a systematic feature removal analysis, in which we retrained cell health models after dropping features that are measured from specific groups, compartments, and channels. We observed that most models were robust to dropping entire feature classes during training (Supplementary Figure 12). This result demonstrates that many Cell Painting features are highly correlated, which might permit prediction “rescue” even if the directly implicated morphology features are not measured. Because of this, we urge caution when generating hypotheses regarding causal relationships between readouts and individual Cell Painting features.

      And the following to the methods:

      Machine learning robustness: Systematically removing feature classes

      We performed an analysis in which we systematically dropped features measured in specific compartments (Nuclei, Cells, and Cytoplasm), specific channels (RNA, Mito, ER, DNA, AGP), and specific feature groups (Texture, Radial Distribution, Neighbors, Intensity, Granularity, Correlation, Area Shape) and retrained all models. We omitted one feature class and then independently optimized all 70 cell health models as described in the Machine learning framework results section above. We repeated this procedure once per feature class.

      All software updates introducing this analysis can be viewed at https://github.com/broadinstitute/cell-health/pull/143

      In summary there is a very interesting concept here, but for several possible, currently undefined reasons, the authors are reporting a very weak measurement. The authors allude to these limitations, but it would be great if the authors could address these issues and provide a stronger dataset.

      We thank the reviewers for their encouraging remarks. We believe that with the added robustness analyses and with increased clarity about the motivation behind the paper, we’ve successfully demonstrated a proof of concept for the approach to predict cell health phenotypes from Cell Painting images. We believe that we’ve provided sufficient evidence to a reader to demonstrate the benefits of the prediction approach. As well, given the additional details describing the Cell Health assay reproducibility, that the paper also successfully introduces a new assay paradigm.

      Furthermore, while many of the cell health measurements are definitely weak (and unreliable), it is not fair to generalize all predictions as weak (especially given the sample size limitations).

      It is also worth noting that, under the current circumstances, separating the one dataset we have into a train/test set and validating the model in an external set is the best we could do; we do not have additional budget to run further wet lab experiments (which would also face a COVID backlog in our chemical screening group). We agree that additional datasets would benefit the field; our current data is now public, all of our future data will be public (to the extent possible), and we hope that others building on our work will make their data public too to address these questions.

      Lastly, in response to the “currently undefined reasons” comment, as well as other comments throughout, we’ve now included a new subsection in the Results/Discussion subsection to more directly answer some of the reasons why many models may have underperformed. Specifically, and as mentioned previously in this response, we perform three distinct robustness analyses: 1) Cell line holdout; 2) feature holdout; 3) sample size titration.

      Authors should include representative images of their Cell Health assay in the main figures. A full figure of all labels and examples of manual gating should be included (S1 is too limited)

      Scale bars need to be included in all images, some are missing in S1

      We thank the reviewers for this suggestion. We have since substantially updated figure 1 and supplementary figure S1. We have also added a new supplementary figure S2 as an example of the manual gating strategies, and we have updated all scale bars appropriately. We’ve attached the specific figure updates in an earlier response.

      "20x water objective in confocal mode" is not a sufficient level of detail on image acquisition parameters especially considering the lack of representative images. At the very least, NA and if appropriate pinhole size should be reported. Similarly, "9 FOV per well" is not sufficient. Pixel size and FOV area/dimensions are necessary.

      We have added these necessary details in their representative methods sections:

      We acquired all cell images using an Opera Phenix High Content Imaging Instrument (PerkinElmer) with a 20X water objective (a numerical aperture (NA) of 1.0), in confocal mode (a pinhole size of 50µm). The effective pixel size was 0.65µm/pixel. We acquired images in four channels using default excitation / emission combinations: for the blue channel (Hoechst) 405/435-480; for the green channel (Alexa 488 and CellEvent) 488/500-550; for the orange channel (Alexa 568 and CellRox Orange) 561/570-630 and for the far-red channel (Alexa 647 and DRAQ7) 640/650-760. We applied the Cell Health reagents for cell viability and for cell cycle in two separate plates.

      The legends for the different parts of Fig S10 are transposed which makes the figure quite confusing.The authors should amend or clarify the language of "guide perturbation" and "guide profile".

      Wow! We thank the reviewers for pointing out this oversight, and for their careful attention to detail. This figure is now completely different after the restructuring of the Drug Repurposing Hub results/discussion section. The legends for all figures are now correct.

      EdU is defined after it is abbreviated in methods

      We thank the reviewers for noting this. We’ve now fixed where these acronyms are abbreviated in the methods section and removed their definition in later sections where redundant:

      The authors should address the following image processing reproducibility concerns:

      Segmentation and feature extraction parameters are not included in the Supplementary Information. Either attach the CellProfiler pipeline or add a table with parameters and settings used for each module.

      CellProfiler and Harmony versions are missing.

      We thank the reviewers for pointing out these very important omissions. We have since rectified in the methods section:

      We built a CellProfiler image analysis and illumination correction pipeline (version 2.2.0) to extract these image-based features (McQuin et al., 2018). We include the CellProfiler pipelines in our github repository.

      We developed and ran two distinct image analysis pipelines in Harmony software (version 4.1; PerkinElmer) for each of the Cell Health plates.

      We also add the CellProfiler pipelines to our GitHub repository. A pull request introducing this change can be viewed here: https://github.com/broadinstitute/cell-health/pull/149

      Subpopulation definition (page 14) should be defined in a way that the algorithms (pipelines) could be reproduced, e.g.: "unusually high intensity of Hoechst max" requires a stricter definition.

      These definitions are subjective by nature. Gating decisions will be different depending on the scientist performing the image analysis. We feel that the sentence: “We excluded outlier nuclei with unusually high intensity of Hoechst max” conveys this subjectivity well. One of the strengths of the proposed approach to predict cell health phenotypes directly from the Cell Painting images is the removal of gating subjectivity.

      Why is the nucleus roundness calculated in PE Harmony and not in the CellProfiler pipeline itself?

      We used the nucleus roundness measurements as calculated in PE Harmony to define the “cells selected for cell cycle” subpopulation in the first panel of the Cell Health assay. I.e. this measurement was integral to the Cell Health assay itself. We believe that the addition of example gates (in supplementary figure 2) clears up this confusion.

      Reviewers:

      Jason Swedlow

      Melpi Platani

      Erin Diel

      Emil Rozbicki

      Reviewer #2 (Significance (Required)):

      Nature and Significance: This study aims to demonstrate how phenotypic studies using different markers can be combined and linked to deliver wider application and value.

      Relationship to Published Work: This study extends previous work from the same group and attempts a novel extension. The approach is a useful concept and potentially important.

      Audience: The method this paper proposes will be of interests to scientists involved with drug discovery and/or computational biology.

      Reviewer's Expertise: Cell Biology, Imaging, Imaging Informatics, Machine Learning, Computer Vision

      We would like to again express thanks to these reviewers for their careful read, very helpful comments, and encouraging remarks.

      Reviewer #3 (Evidence, reproducibility and clarity (Required)):

      The authors present a novel idea on predicting various cell health readouts based on a general set of markers and cell painting assay. The cell health readouts are based on more specific markers performed in different assays measuring cell proliferation and death. The authors suggest that such an approach can reduce the number of experiments needed. The paper is well written, and the figures are clear and comprehensive.

      We thank the reviewer for their helpful comments and encouragement!

      **Major comments:**

      Some of the health readouts are based on general morphology (cell and nucleus) which can be obtained based on cell painting assay. Although some of these models perform well, it is surprising that the model of nuclear roundness did not perform very well especially for HCC4 (R-square reaching zero). This is surprising as these data can be extracted from cell painting assays. Can the author elaborate on why this is the case?

      We agree that the performance of the live cell roundness and nucleus roundness models were unexpectedly low. One would expect that these shape features as measured by PerkinElmer Harmony software, would be easily predicted from CellProfiler readouts from the Cell Painting assay.

      The roundness property was used in Harmony versions,

      2*sqrt(π)*sqrt(Area-BorderArea/2.0)/BorderArea-0.1)

      where Area is object area in pixels and BorderArea is border area in pixels (we thank Joe Trask, Olavi Ollikainen, Hartwig Preckel, and Kaupo Palo at PerkinElmer for this information.)

      No single feature in the CellProfiler readouts measures roundness directly; instead, CellProfiler will measure a combination of shape features that together could synthesize the idea of “roundness”. However, given that the elastic net approach is well-suited for this type of synthesis, it remains unclear why roundess is not predicted well.

      One possible explanation is that shape features are the most different measurements across cell lines and they are measured precisely in both assays. Precise measurements coupled with our training strategy of using all three lines together, might lead to poor performance in predicting certain cell-line intrinsic features.

      We tested this shape result directly (and also generally to the other cell health features) in a “cell line holdout” analysis, which we describe in more detail in response to the next comment. In this analysis, we tested how well models generalized to cell lines not encountered in the training process. In this analysis, we trained on every combination of two cell lines and applied the trained models to the third. We observed that cell line intrinsic features, like shape, are predicted poorly if a model was not trained using the cell line.

      Using elastic net regression models is well-suited to the problem due to the low number of observations. However, there is a significant difference between the performance of different cell lines. Does the performance of the models improve if different models were trained for every cell line? Leave one out approach can be used to accommodate the scarcity of samples.

      We thank the reviewer for this important question. We also appreciate how different certain models behaved with certain cell lines. We would like to stress that the results presented here represent a small pilot study that is not meant to optimize model performance. Instead, the motivation of the manuscript is to demonstrate proof-of-concept of the approach to predict specific cell health phenotypes directly from Cell Painting images. We believe that the current results demonstrate positive proof, which warrants an expansion of data collection and an improvement of the classification methodology.

      Nevertheless, with our current data, we can answer an important question about the feasibility of signal transfer between cell lines. Therefore, we performed an additional “cell line holdout” analysis. We believe that the cell line holdout analysis tells us that signals can be transferred across contexts, but that any leading observations must be followed up with experiments performed directly in the cell line of interest. This signal transfer is diluted compared to the original test set performance, but it is also worth noting that the models presented in Supplementary Figure 11 (pasted below) were trained on only 66% of the data in the holdout cell line analysis and 85% of the data in the original analysis.

      Supplementary Figure S11: Results from a cell line holdout analysis. We trained and evaluated all 70 cell health models in three different scenarios using each combination of two cell lines to train, and the remaining cell line to evaluate. For example, we trained all 70 models using data from A549 and ES2 and evaluated performance in HCC44. We bin all cell health models into 14 different categories (see Supplementary Table S3 and https://github.com/broadinstitute/cell-health/6.ml-robustness for details about the categories and scores). We also provide the original test set (15% of the data, distributed evenly across all cell types) performance in the last row, as well as results after training with randomly permuted data. This cross-cell-type analysis yields worse performance overall. Nevertheless, despite the models never encountering certain cell lines, and having fewer training data points, many models still have predictive power across cell line contexts. Note that we truncated the y axis to remove extreme outliers far below -1. The raw scores are available on https://github.com/broadinstitute/cell-health.

      And we add the following text to the results section:

      We performed a series of analyses to determine certain parameters and options that are likely to improve models in the future. First, we performed a “cell line holdout” analysis, in which we trained models on two of three cell lines and predicted cell health readouts on the held out cell line. We observed that certain models including those based on viability, S phase, early mitotic and death phenotypes could be moderately predicted in cell lines agnostic to training (Supplementary Figure 11). Not surprisingly, shape-based phenotypes could not be predicted in holdout cell lines, which emphasizes the limitations of transferring certain cell-line specific measurements across cell lines.

      All software updates introducing this analysis can be viewed at https://github.com/broadinstitute/cell-health/pull/143

      The authors chose to validate based on the number of live cells as it is one of the best models. However, this readout can be obtained using simple viability assays. It would be more convincing to validate on a more complex phenotype that can only be attained using imaging such as #gH2AX spots.

      It is worth noting that we do also show generalizability in the Drug Repurposing Hub for two other models: ROS and G1 cell count. We show that proteasome inhibitors significantly induce high ROS and PLK inhibitors restrict entry to G1. We have also added enrichment tests demonstrating high statistical significance for these compound mechanisms.

      While we recognize that these two examples provide anecdotal evidence, they suggest the ability and power of the approach to assign phenotypes to Cell Painting images.

      Nevertheless, we thank the reviewer for bringing up this critical point and certainly appreciate the benefit of validating a gH2AX model. Therefore, we’ve added a similar analysis in which we demonstrate generalizability of the top performing gH2Ax model: Number of gH2AX spots in G1 cells. We discuss these changes in an updated section:

      We also chose to validate three additional models: ROS, G1 cell count, and Number of gH2AX spots in G1 cells. We observed that the two proteasome inhibitors (bortezomib and MG-132) in the Drug Repurposing Hub set yielded high ROS predictions (OR = 76.7; p -15) (Figure 4C). Proteasome inhibitors are known to induce ROS (Han and Park, 2010; Ling et al., 2003). As well, PLK inhibitors yielded low G1 cell counts (OR = 0.035; p = 3.9 x 10-8) (Figure 4C). The PLK inhibitor HM-214 showed an appropriate dose response (Figure 4D). PLK inhibitors block mitotic progression, thus reducing entry into the G1 cell cycle phase (Lee et al., 2014). Lastly, we observed that aurora kinase and tubulin inhibitors yielded high Number of gH2AX spots in G1 cells predictions (OR = 11.3; p Figure 4E). In particular, we observed a strong dose response for the aurora kinase inhibitor barasertib (AZD1152) (Figure 4F). Aurora kinase and tubulin inhibitors cause prolonged mitotic arrest, which can lead to mitotic slippage, G1 arrest, DNA damage, and senescence (Orth et al. 2011; Cheng and Crasta 2017; Tsuda et al. 2017).

      We also modify the abstract summarizing this result:

      For Cell Painting images from a set of 1,500+ compound perturbations across multiple doses, we validated predictions by orthogonal assay readouts, and by confirming mitotic arrest, ROS, and DNA damage phenotypes via PLK, proteasome, and aurora kinase/tubulin inhibition, respectively.

      And we add this analysis to an updated Figure 4:

      Figure 4: Validating Cell Health models applied to Cell Painting data from The Drug Repurposing Hub. The models were not trained using the Drug Repurposing Hub data. (a) The results of the dose alignment between the PRISM assay and the Drug Repurposing Hub data. This view indicates that there was not a one-to-one matching between perturbation doses. (b) Comparing viability estimates from the PRISM assay to the predicted number of live cells in the Drug Repurposing Hub. The PRISM assay estimates viability by measuring barcoded A549 cells after an incubation period. (c) Drug Repurposing Hub profiles stratified by G1 cell count and ROS predictions. Bortezomib and MG-132 are proteasome inhibitors and are used as positive controls in the Drug Repurposing Hub set; DMSO is a negative control. We also highlight all PLK inhibitors in the dataset. (d) HMN-214 is an example of a PLK inhibitor that shows strong dose response for G1 cell count predictions. (e) Tubulin and aurora kinase inhibitors are predicted to have high Number of gH2AX spots in G1 cells compared to other compounds and controls. (f) Barasertib (AZD1152) is an aurora kinase inhibitor that is predicted to have a strong dose response for Number of gH2AX spots in G1 cells predictions.

      All software updates required to update these figures can be viewed at https://github.com/broadinstitute/cell-health/pull/145

      It is also worth noting that collecting more data for this manuscript is not currently feasible given the amount of projects backlogged from COVID. We feel that given that the motivation of the project is to demonstrate feasibility of the approach, with our current training/testing machine learning framework and the application to Drug Repurposing Hub data is sufficient.

      The text would benefit from expanding the discussion to include the advantages and limitations of their approach.

      We thank the reviewer for bringing up this concern, and we agree that it is worth an increased discussion about advantages and limitations of the approach. Indeed, we’ve added a full new results/discussion subsection directly testing many of the assumptions for why some models performed well and others didn’t. The new section introduces many model limitations:

      We performed a series of analyses to determine certain parameters and options that are likely to improve models in the future. First, we performed a “cell line holdout” analysis, in which we trained models on two of three cell lines and predicted cell health readouts on the held out cell line. We observed that certain models including those based on viability, S phase, early mitotic and death phenotypes could be moderately predicted in cell lines agnostic to training (Supplementary Figure 11). Not surprisingly, shape-based phenotypes could not be predicted in holdout cell lines, which emphasizes the limitations of transferring certain cell-line specific measurements across cell lines. We also performed a systematic feature removal analysis, in which we retrained cell health models after dropping features that are measured from specific groups, compartments, and channels. We observed that many models were robust to dropping entire feature classes during training (Supplementary Figure 12). This result demonstrates that many Cell Painting features are highly correlated, which might permit prediction “rescue” even if the directly implicated morphology features are not measured. Because of this, we urge caution when generating hypotheses regarding causal relationships between phenotypes and individual Cell Painting features. Lastly, we performed a sample size titration analysis in which we randomly removed a decreasing amount of samples from training. For the high and mid performing models we observed a consistent performance drop, suggesting that increasing sample size would result in better overall performance (Supplementary Figure 13).

      **Minor comments**

      Page 8: The authors visualize the predicted G1 cell count and ROS when overlayed on a UMAP based on cell painting data from Drug Repurposing Hub. How these visualisations look like if applied to the original CRISPR training data.

      We address this comment by adding a supplementary figure showing ground truth G1 cell count and ROS readouts.

      We applied uniform manifold approximation (UMAP) to observe the underlying structure of the samples as captured by morphology data (McInnes et al., 2018). We observed that the UMAP space captures gradients in predicted G1 cell count (Supplementary Figure S14A) and in predicted ROS (Supplementary Figure S14B). We also observed similar gradients in the ground truth cell health readouts in the CRISPR Cell Painting profiles used for training cell health models (Supplementary Figure S15). Gradients in our data suggest that cell health phenotypes manifest in a continuum rather than in discrete states.

      Where Supplementary Figure 15 is pasted below:

      Supplementary Figure S15: Applying a Uniform Manifold Approximation (UMAP) to the Cell Painting consensus profile data of CRISPR perturbations. UMAP coordinates visualized by (a) cell line, (b) ground truth G1 cell counts, and (c) ground truth ROS counts. (d) Visualizing the distribution of ground truth ROS compared against G1 cell count. The two outlier ES2 profiles are CRISPR knockdowns of GPX4, which is known to cause high ROS.

      We have also added the option to explore the CRISPR profile Cell Health ground truth in our shiny app https://broad.io/cell-health (screenshot pasted below)

      Modifications to the software introducing these changes can be viewed at https://github.com/broadinstitute/cell-health/pull/141.

      The second part of the last paragraph on page 8 is confusing as it is not related to the first part using the PRISM data.

      We thank the reviewer for noting this. We agree that the clarity of this section could be improved. We have now completely reworked the final section of applying the cell health models to the Drug Repurposing Hub data.

      In particular, we’ve moved the PRISM data section as the first, most simple model to validate, and moved these results to Figure 4. We then describe validation for three other models: ROS, G1 cell count and Number of gH2Ax spots in G1 cells. And we end with the UMAP discussion, which is the original second part of the last paragraph on page 8.

      The PRISM section now reads:

      We first chose a simple, high-performing model to validate. The number of live cells model captures the number of cells that are unstained by DRAQ7. We compared model predictions to orthogonal viability readouts from a third dataset: Publicly available PRISM assay readouts, which count barcoded cells after an incubation period (Yu et al., 2016). Despite measuring perturbations with slightly different doses and being fundamentally different ways to count live cells (Figure 4A), the predictions correlated with the assay readout (Spearman's Rho = 0.35, p -3; Figure 4B).

      Reviewer #3 (Significance (Required)):

      This approach can be of wide interest as it is easy to implement, cost-effective and lead to interpretable models. It would be interesting to see if the results improve when increasing the sample size. Another aspect that can be useful to investigate in the future is whether including a separate marker that indicates infected cells only in the more detailed assays would result in better accuracies.

      We thank the reviewer for their enthusiasm and for this concluding idea. Indeed, we also feel that including a separate marker to indicate infected cells could lead to improved accuracy. We add this thought to the concluding section as a future direction. The full updated conclusion reads as follows:

      We have demonstrated feasibility that information in Cell Painting images can predict many different Cell Health indicators even when trained on a small dataset. The results motivate collecting larger datasets for training, with more perturbations and multiple cell lines. These new datasets would enable the development of more expressive models, based on deep learning, that can be applied to single cells. Including orthogonal imaging markers of CRISPR infection would also enable us to isolate cells with expected morphologies. More data and better models would improve the performance and generalizability of Cell Health models and enable annotation of new and existing large-scale Cell Painting datasets with important mechanisms of cell health and toxicity.

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      The authors present a novel idea on predicting various cell health readouts based on a general set of markers and cell painting assay. The cell health readouts are based on more specific markers performed in different assays measuring cell proliferation and death. The authors suggest that such an approach can reduce the number of experiments needed. The paper is well written, and the figures are clear and comprehensive.

      Major comments:

      Some of the health readouts are based on general morphology (cell and nucleus) which can be obtained based on cell painting assay. Although some of these models perform well, it is surprising that the model of nuclear roundness did not perform very well especially for HCC4 (R-square reaching zero). This is surprising as these data can be extracted from cell painting assays. Can the author elaborate on why this is the case?

      Using elastic net regression models is well-suited to the problem due to the low number of observations. However, there is a significant difference between the performance of different cell lines. Does the performance of the models improve if different models were trained for every cell line? Leave one out approach can be used to accommodate the scarcity of samples.

      The authors chose to validate based on the number of live cells as it is one of the best models. However, this readout can be obtained using simple viability assays. It would be more convincing to validate on a more complex phenotype that can only be attained using imaging such as #gH2AX spots.

      The text would benefit from expanding the discussion to include the advantages and limitations of their approach.

      Minor comments

      Page 8: The authors visualize the predicted G1 cell count and ROS when overlayed on a UMAP based on cell painting data from Drug Repurposing Hub. How these visualisations look like if applied to the original CRISPR training data.

      The second part of the last paragraph on page 8 is confusing as it is not related to the first part using the PRISM data.

      Significance

      This approach can be of wide interest as it is easy to implement, cost-effective and lead to interpretable models. It would be interesting to see if the results improve when increasing the sample size. Another aspect that can be useful to investigate in the future is whether including a separate marker that indicates infected cells only in the more detailed assays would result in better accuracies.

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      This report from Way et al describes a method of extending a very popular screening technology called Cell Painting developed by the Carpenter Lab. The authors are contending with an important issue and as such this paper potentially will be of great interest to the community. Cell Painting provides quantitative fingerprints of cell phenotypes in response to changes in the molecular or physiological status of cells. However the molecular basis or even the candidate pathways for those changes is not always clear. Here, the authors take specific markers of cell physiology, e.g., DNA damage, ROS production, cell cycle progression etc. and relate them to Cell Painting features. The authors are trying to address the issue that running many probes of cell physiology is expensive and time consuming and that identifying proxies for these assays using much simpler Cell Painting technologies would be a useful and potentially powerful approach. The overall goal is to develop some type of regression model that can link the state of cells (the "health") to Cell Painting fingerprints.

      The authors use three separate cell lines and CRISPR knockouts delivered through lentivirus that target 59 genes to establish a range of cell physiologies that they directly measure (the "Cell Health") and then relate to similar assays performed by Cell Painting. Ultimately they aim to use Cell Painting models to predict Cell Health.

      Major Issues:

      It appears that the phenotypes that are detected at a high enough level of significance (see Fig. 2), e.g DNA damage (gH2Ax), apoptosis (Caspase 3/7), dead cells, ROS (CellROX), etc. are probably most easily detected by simply monitoring DAPI signal in these screens. To detect many of the phenotypes, the authors have presented a fairly complex method of doing much simpler assays. The authors correctly highlight in Fig. 3 that the phenotypes they are detecting go beyond pure signals from DAPI. They report power in their models from Radial Distribution across many different components of the Cell Painting feature set. However these appear to give outputs that won't be that useful. It is hard to tell whether this is simply because they don't have enough images or whether their signal is confounded by using cell lines where the lentivirus CRISPR knockouts are working less efficiently.

      It seems misleading (or perhaps the explanation lacks clarity) to describe in the same paragraph the need to validate the model by applying it to new datasets, namely the Drug Repurposing Hub project, then describe gradients in cell health features across UMAP coordinates. Is it surprising that cell health phenotypes and gradients therein are present in a dataset describing cell health perturbations? The actual test of the model's performance is in the paragraph below, but the data associated with the Spearman correlation is hidden in Fig. S10b. The data is not convincing by eye, and the artifactually low p value suggests that proper statistical corrections were not applied.

      Fig 1A and associated methods are not sufficient information to describe the manual gating strategy and any variability found across iterations in these gates. Effort should be taken to quantify where these manual boundaries were set and why.

      A fundamental issue that the authors mention but do not address is the efficiency of the CRISPR KOs. The authors should measure the efficiency of representative guides and present these data to help support the interpretation of their models.

      The authors conclude that their results motivate further data acquisition and model training, and that this will improve model performance. This is only true if their lack of predictive power comes from the data volume itself, and not in larger problems of data quality, variability and the core assumptions of their method. The authors note the better predictability in ES2 cells, likely due to higher CRISPR efficiency and therefore stronger phenotypes. It is possible, as I believe the authors suggest, that the ES2 cells provide information that improves the predictive power of cells with poor infection efficiency. It is instead possible that only the ES2 cells with strong phenotypes yield predictive power, pulling the average of the dataset up. Authors could train the cell line specific datasets independently and compare relative changes in predictive performance. Otherwise, is it possible that subtle or highly complex phenotypes simply cannot be detected by this method and more data will be unlikely to improve predictability in modest perturbations.

      Although the authors argue that the Cell Painting assay is capturing complex health phenotypes using a variety of morphological features, there is a clear overweighting of a particular few (in fact two...). It would be interesting to systematically retrain with exclusion of particular features to determine if equalizing the weight across features changes performance. These are also notably the feature groups with the fewest features-- how many individual features within these feature groups are pulling all the weight?

      In summary there is a very interesting concept here, but for several possible, currently undefined reasons, the authors are reporting a very weak measurement. The authors allude to these limitations, but it would be great if the authors could address these issues and provide a stronger dataset.

      Minor issues: Authors should include representative images of their Cell Health assay in the main figures. A full figure of all labels and examples of manual gating should be included (S1 is too limited) Scale bars need to be included in all images, some are missing in S1

      "20x water objective in confocal mode" is not a sufficient level of detail on image acquisition parameters especially considering the lack of representative images. At the very least, NA and if appropriate pinhole size should be reported. Similarly, "9 FOV per well" is not sufficient. Pixel size and FOV area/dimensions are necessary.

      The legends for the different parts of Fig S10 are transposed which makes the figure quite confusing.The authors should amend or clarify the language of "guide perturbation" and "guide profile".

      EdU is defined after it is abbreviated in methods

      The authors should address the following image processing reproducibility concerns:

      Segmentation and feature extraction parameters are not included in the Supplementary Information. Either attach the CellProfiler pipeline or add a table with parameters and settings used for each module.

      CellProfiler and Harmony versions are missing.

      Subpopulation definition (page 14) should be defined in a way that the algorithms (pipelines) could be reproduced, e.g.: "unusually high intensity of Hoechst max" requires a stricter definition.

      Why is the nucleus roundness calculated in PE Harmony and not in the CellProfiler pipeline itself?

      Reviewers: Jason Swedlow Melpi Platani Erin Diel Emil Rozbicki

      Significance

      Nature and Significance: This study aims to demonstrate how phenotypic studies using different markers can be combined and linked to deliver wider application and value.

      Relationship to Published Work: This study extends previous work from the same group and attempts a novel extension. The approach is a useful concept and potentially important.

      Audience: The method this paper proposes will be of interests to scientists involved with drug discovery and/or computational biology.

      Reviewer's Expertise: Cell Biology, Imaging, Imaging Informatics, Machine Learning, Computer Vision

    4. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      The submitted manuscript entitled 'Predicting cell health phenotypes using image-based morphology profiling' (RC-2020-00394) by Way et al. presents a set of seven dyes/staining (as two separate panels) to microscopically screen cell viability. For automatic classification a training/test set of 119 CRISPR (approximately 2 sgRNAs per gene) perturbations on 3 cancer cell lines were generated (lung A549, ovarian ES2, lung HCC44). After segmentation of cell nuclei a set of morphological cell measurements were extracted from each perturbation (total 952 features). The nature of these feature spanning cell cycle and viability phenotypes, enabled the authors to define 70 different phenotype classes, which are used to model a classifier by elastic linear regression. Specific definitions (cell cycle and ROS) were partly predicted/validated in an independent existing image data set (Drug Repurposing Hub project). The data is available as web-based application/visualization and the supplementary method is well described.

      Major concerns:

      (1)The only fundamental argument of this manuscript not to apply state-of-the-art deep learning (DL) machine-learning (mentioned in McCain et al. 2018), which does not require segmentation, feature extraction, abstraction, manual gating is the 'interpretability' of the predictions. However, performance, precision, scalability (by modern GPUs) with DL should clearly outperform 'manual' regression models. All recent machine vision benchmarks in microscopy confirm this, but also clearly shows 'real world' translational applications, e.g.

      https://www.nature.com/articles/s43018-020-0085-8,

      https://www.biorxiv.org/content/10.1101/2020.07.02.183814v1.full.pdf,

      In other words, the presented methodology is not compared to DL, and is not convincing in terms of interpretability benefits.

      (2)One aforementioned point of the methodology is cryptically/not described: Why it should be less expensive compared with other (which?) approaches (see introduction)?

      (3)Generalizability and/or training data size is essential for any model-based classification, but not evaluated or validated in the current manuscript. The independent validation on a A549 cell line only data might be not sufficient/convincing.

      Minor concerns:

      (1)Highest test performance comprises that precision is mainly driven by cell cycle/count and live status and could be probably derived from DRAQ7 (Fig. 2) and DNA granularity (Fig. 3, bottom right) and would argue for rigid feature selection across channels and features.

      (2)Any H2AX and 'polynuclear' would probably fail in any cell line with this size of training data.

      (3)To what refers the 'weights' of the model in Fig. 1c?

      Significance

      This manuscript is not advanced in the context of latest improvements/developments of cell-based microscopic classification. Rationale in the introduction and the conclusion are not linked (interpretability, generalizability, costs). It seems to be unfinished or unformatted to this end?

      The author/co-authors have been instrumental/pioneered with their past work on cell-based image processing (CellProfiler software), but the presented methodology is simply outdated. Therefore, a revision towards a comparison and benchmarking with DL will also not help.

      Ref (DL with MIL): https://academic.oup.com/bioinformatics/article/32/12/i52/2288769

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reply to the reviewers:

      We are grateful to the referees for investing valuable time in reviewing our work, and for recognising the importance and utility. We thank them for their insightful and constructive comments that have helped us significantly improve the manuscript.

      Below, we provide a point-by-point response to all specific questions raised.

      Reviewer #1 (Evidence, reproducibility and clarity (Required)): In order to improve SARS-CoV-2 diagnostics, Reijns et al. developed a multiplexed RT-qPCR protocol that allows simultaneous detection of two viral genes, one housekeeping gene as well as an external gene as an extraction control. Compared to running parallel assays to detect genes individually, the turnaround time is much shorter and reagents are saved. Furthermore, the presented data suggest that the assay is more sensitive than commercial kits. The authors also propose the detection of the human housekeeping gene as a measure of sample quality control. In principal, this work has potential but the manuscript itself needs a better structure. **Major concerns:** The authors have used the Takara RT-qPCR kit for their study. Did the authors try other commercial kits?

      We have not assessed other commercial kits as the Takara reagent performed well, and has been easy to source. We expect that other one-step kits could be used if the need arose.

      When we initiated this work in March 2020, we selected the Takara One Step PrimeScript™ III RT-PCR Kit based on 1) the practical advantages of a one-step reaction mix, 2) published evidence of its successful use in SARS-CoV-2 detection (see below), 3) availability in sufficient quantities for testing at scale, and 4) affordability.

      (Published evidence: One of the first descriptions of an assay to detect SARS-CoV-2 [1] employed the Takara One Step PrimeScript™ III RT-PCR Kit, and this kit was later shown by others to perform as well as or better than Qiagen Quantifast Multiplex RT-PCR +R mastermix, ThermoFisher TaqPath 1-Step RT-qPCR MasterMix and ThermoFisher Taqman Fast Virus 1-step mastermix, when used to detect SARS-CoV-2 RNA from nose and throat swabs with N1, N2 or N gene assays [2].)

      Can the authors elaborate on the supply chain of the Takara kit?

      We have not had problems securing the Takara kit in sufficient quantities and in a timely fashion, and did so through the company’s Scotland and NE England representative. The managing director of Takara Bio Europe provided the following statement, as a clarification of the supply chain:

      “Takara Bio Inc. has worked on significantly increasing the production of one-step RT-qPCR reagents to cover worldwide needs for SARS-CoV-2 detection. The production of this kit is based in China under ISO13485 certification and the European stock is based in, and distributed, from Paris. Throughout this pandemic, Takara Bio Europe has supplied millions of reactions around Europe to COVID-19 testing labs, without encountering any shortages or significant shipping delays.”

      Could it cover population testing in case of shortages of other commercial kits?

      Yes, it could. The Takara kit is available in 4,000 and 20,000 reaction pack sizes and therefore could well be a useful option in case of shortages of other commercial kits. Indeed, one motivation for developing the multiplex assay was to ensure diagnostic testing resilience in the face of reagent shortages.

      For better comparison, is it possible to give information on which primers the commercial kits are based on?

      We contacted both ThermoFisher and Abbott to ask for more information on the primers and probes included in the TaqPath COVID‐19 Combo Kit (detects N, ORF1ab and S gene) and Abbott RealTime SARS‐CoV‐2 assay (detects RdRp and N gene). Unfortunately, we were informed that this information is proprietary. For clarity, we have included the following in the Materials and Methods section:

      “Primers and probes included in the TaqPath COVID-19 Combo Kit (Thermo Fisher Scientific, Cat. No. A47814) detect SARS-CoV-2 ORF1ab, N and S gene; those in the Abbott RealTime SARS-CoV-2 assay (Cat. No. 09N77-090) detect RdRp and N gene. Further details are not available, as this information is proprietary.”

      Also, explain better the primers used in this study. For example, the N1 and N2 primers are directed against different regions of the SARS-CoV-2 N gene.

      We thank the reviewer for encouraging us to better explain the primers we use for our own assays, and now provide more detailed information in a new Fig 1.

      The result section needs a better structure as the first two pages do not refer to any of the main figures. For example, in which figure or table can the reader find the data that are discussed in lines 83 to 87?

      We have now substantially re-structured the entire Results section, and include the data that was discussed in lines 83 to 87 of the original manuscript, in Fig 1D of the revised manuscript.

      Table S1, instead of current Table 1, could be moved to main figures as it contains the important finding that the multiplexed assay may be more sensitive than the commercial one.

      As suggested, we have moved Table S1 to the main display items (now Table 1), and moved the original Table 1 to the supplementary items (now Table S3).

      The authors identified some samples that scored negative in commercial assays but positive in their new assay. This is important, however, the possibility of detecting false positives should be strengthened in a "Discussion" section.

      We thank the reviewer for highlighting this, and now discuss the issue of detecting false positives in more detail in the Discussion section of the revised manuscript:

      “RT-qPCR tests are molecular tests with high intrinsic accuracy, however false positive and false negative results can occur. The use of multiplex assays that detect multiple SARS-CoV-2 targets, such as those reported here, reduces the chance of both. Off-target reactivity is one possible cause of false positives, and although some have reported high false positive rates for the E gene assay [20, 22], this does not match our experience. In two patients, our N1E-RP and N2E-RP assays detected virus, albeit weakly, whereas commercial assays did not. As multiple SARS-CoV-2 targets were positive, these are likely true positive results and not due to off-target reactivity. False positives can also occur due to lab issues such as sample mislabelling, data entry errors, reagent contamination with target nucleic acids or contamination of primary specimens. However high standards of quality control at all stages of testing, and effective mitigation strategies should quickly identify problems. Additionally, sample re-test with an independent assay and/or patient re-sampling should also be effective measures to counter false positives, particularly in low pre-test probability situations such as mass screening.”

      Figures 1 to 3 have different panels which seem to be redundant. For example, Fig 1 A and B, Fig 2 B and C, Fig 3 C and D.

      These panels did contain the same data, plotted to convey slightly different information. However, we agree that this introduces a level of redundancy. For enhanced clarity, in the revised manuscript, we have removed most of these panels altogether, or moved them to supplementary figures.

      Figure 1: Give a rational why comparing before and after extraction. This heavily depends on the extraction method and not on the detection itself. In addition, IVT RNA does not reflect the complexity of a clinical specimen. This is rather confusing and deviates from the important findings.

      As part of the validation procedure it was important for us to show that the entire workflow, including the extraction procedure, was robust for use in clinical diagnostics. In this context, comparing pre- and post-extraction RT-qPCR results for both IVT RNA and viral samples provided us with an opportunity to test extraction efficiency. However, we agree that for the purpose of this manuscript, the inclusion of these data in (the former) Fig 1 detracted from the main message. In the revised manuscript we have therefore moved the data comparing Cq values before and after extraction to a new Fig S1, and briefly state the rationale behind this in the main text and figure legend.

      It was not our intention to imply that IVT RNA in any way reflects the complexity of a clinical specimen. We include these data as part of the step-by-step validation of our assays. Firstly, we show high sensitivity using IVT RNA; secondly, we show that a similar sensitivity is achieved on viral positive controls; and thirdly, we show that our assays perform equally well to widely used commercial assays on clinical samples.

      Figure 3: Were any of the negative samples/patients tested with an undetectable housekeeping gene, re-test positively?

      None of our patient samples had undetectable levels of RPP30. We note that all NTS samples were collected by healthcare professionals and in this context such findings will likely be rare. However this may not be the case when dealing with samples obtained by self-swabbing as the reviewer highlights in a comment below.

      Did adding this housekeeping gene as a control actually improve the detection of any patient samples? If the authors want to convince the readership of this quality control, experimental evidence should be provided.

      Fig 3C and D seem to contain this information somewhat, as here, the values were normalized and the CT values for the E and N gene decreased. Nevertheless there is no real explanation of this figure provided in the Result section at all. While this figure has potential, the authors have to keep in mind that the number of cells in a swab can be affected by many biological factors, including age, sample timing, inflammation of the respiratory tract, etc. In addition, viral genomes can exist intra- as well as extracellular, in the form of free virus. So even in the absence of human cells/detectable housekeeping genomes, viral RNA can be or should be present in a sample in case of infection. This explains (probably) why a correlation between detectable housekeeping gene and viral RNA is absent (Fig 3A and B?). This entire Fig 3 just needs a better explanation. The provided text does not describe any results and should go into a "Discussion" section.

      We thank the reviewer for highlighting the need to explain Fig 3 more clearly and that a key question is whether there is a correlation between the levels of the housekeeping control and viral RNA. Prompted by this question, we reanalysed our data and now show that there is a strong and statistically significant positive correlation between Cq values for RPP30 and SARS-CoV-2 targets (see below, and new Fig 4C). This shows that there is a lower probability of detecting SARS-CoV-2 RNA in samples that contain fewer human cells. This likely implies that for samples with high RPP30 Cq values, a proportion of virus positive samples will be missed, contributing to the high false negative rates that have been reported [3-5].

      Providing additional experimentation would require systematic re-contacting and re-testing of cases, and this is beyond our current research framework. While outside the scope of the current study, we hope that our manuscript will encourage others to perform the necessary large-scale experiments. Nonetheless, with this correlation alone, we believe that RPP30 provides useful information of benefit to clinical diagnostics (also see our response to Reviewer 2), and in the revised manuscript we outline how it might be best utilised (Discussion, Table S6).

      To provide a better explanation of Figure 3 (now Fig 4), we have included the following in the Results section:

      “A statistically significant linear correlation between Cq values for each of the viral probes (E, N1, and N2) and the Cq values for the RPP30 sample quality probe (p 40; Fig 4D and Fig S4A). Theoretically, using this approach, even a strong positive sample (SARS-CoV-2 Cq value of 28.2) of good quality (RPP30 Cq value of 20.3) may have given a false negative test result (SARS-CoV-2 Cq value of 40) if it had contained the same low amount of human material as the reference sample (RPP30 Cq value of 32.1; viral Cq: 32.1-20.3+28.2=40). Conversely, normalising samples to an optimal quality sample (RPP30 Cq 20.1/20.3) gives an indication of what viral Cq values may have been if all samples had contained a similar (more optimal) amount of material (Fig 4E, Fig S4B). This highlights the possibility that a proportion of apparent SARS-CoV-2 negative samples are in fact false negatives as a result of insufficient material in the swab fluid.”

      Self-swabbing is surely a potential source of variability and false-negatives, but many publications have shown the suitability of saliva testing. This should also be discussed and would probably negate the need for such a quality control.

      We agree with the reviewer that self-swabbing will be more prone to variability. Therefore, the RPP30 control will have particular value here, lowering the associated risk of false negatives. While NTS sampling remains a major modality for testing for the foreseeable future, saliva is certainly a potential alternative strategy, one that may benefit from lower sample variability.

      We now include the reviewer’s point on this in the Discussion:

      “Testing saliva, as an alternative to NTS sampling, could also be beneficial as a modality that may have less-sample to sample variability [7]”

      Which assay works better, the N1E-RP or the N2E-RP assay? A final conclusion is missing here.

      Although we could not detect substantial differences between these two assays during our validation process, others have reported a marginally higher sensitivity of the N1 over the N2 assay [6]. We would therefore recommend the use of the N1E-RP assay for first line testing, with the N2E-RP assay available as a second line test of equivalent sensitivity in case of inconclusive initial test results. We comment on this in the revised manuscript:

      “Although we did not detect substantial differences between our two assays, others have reported higher sensitivity of the N1 over the N2 assay [19]. We therefore recommend the use of the N1E-RP assay for primary testing, and the N2E-RP assay could be employed if initial results are inconclusive.”

      Reviewer #1 (Significance (Required)): Naturally, in this pandemic, this topic is important as sensitive and affordable methods to detect SARS-CoV-2 infections are in need. This Reviewer agrees that multiplexing could be an elegant approach to fill this need.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)): In this manuscript, Reijns and colleagues describe an approach to detect the causative agent of COVID-19, the beta coronavirus SARS-CoV-2, using an inexpensive in-house multiplex RT-qPCR. Concomitantly, viral E, N and RdRP(probe P2) as well as human RPP30 and a herpesvirus nucleic acid are also detected in order to monitor both the sample quality and the sample preparation. Reijns et al. performed testing on a huge amount of samples and used the data to describe the strength and limitations of the assay. The data is sound and give a very good impression of the 4-plex PCR capabilities. I read manuscript fluently and consider as linguistically very good. However, I still have a few comments and remarks that would strengthen the manuscript:

      **Major issues:** In the first section of the results section, many primer / probe conditions are given that make the reading flow difficult. Instead of using (data not shown) it would be helpful to use a table or a graphic to illustrate the various approaches.

      We thank the reviewer for suggesting the use of graphics to explain our different approaches. To aid the reader, we now include a diagram in the new Fig 1 that shows the positions of primers and probes used in our work (A), and illustrate the various 4-plex assays (B, C).

      In general, I suggest to replace Ct by Cq, since the IVT standards are a quantification method.

      As suggested by the reviewer we now use Cq instead of Ct throughout our manuscript, following MIQE guidelines [7].

      There has already been a change away from the initial E and RdRP gene based assay because of the published sensitivity issues and the use of degenerate bases as well as the detection of unspecific nucleic acids for E gene). In particular, it has been shown that the Sarbeco-E-yields false positive results (Toptan et al. 2020 (https://doi.org/10.3390/ijms21124396), Konrad et al. 2020 (https://doi.org/10.2807/1560-7917.ES.2020.25.9.2000173)), so that many laboratories do not consider E-gene-based results for borderline samples anymore. In this manuscript, the authors should comment on why they still use the results from the E gene / RdRP and describe their experience.

      We thank the reviewer for highlighting issues with the RdRp and E gene primer/probe pairs. In the process of our work we had also become aware that the RdRp-P2 assay suffers from low sensitivity, as has now been widely reported. However, although the E gene assay also detects SARS-CoV, we were not aware of potential problems with high rates of false positives as described by Toptan et al (2020) and Konrad et al (2020). It did come to our attention that early on in the pandemic some oligonucleotide producers reported problems with contamination of primers with SARS-CoV-2 template RNA synthesised in the same facilities, and were careful to avoid these providers. In our work, we did not experience any problems with apparent false positive detection of the E gene: it was never detected in any of our negative controls, and out of 84 patients that tested negative with the commercial TaqPath assay we did not find any that were positive for E gene only when using our N1E-RP and N2E-RP assays. In this context, it is also important to emphasise that a positive diagnosis is given only when both viral targets are detected (Table S6), which is one of the strengths of our multiplex assays.

      As suggested by Reviewer 1, we now discuss the issue of false positives in more detail in the revised manuscript. We also comment on high false positive rates observed by others for the E gene assay, citing the two studies, but state that this does not match our own experience:

      “Off-target reactivity is one possible cause of false positives, and although some have reported high false positive rates for the E gene assay [20, 23], this does not match our experience.”

      In this manuscript, it should be indicated that the SARS-CoV-2 specific Probe P2 (according to Corman et al. 2020) was used. The reason for lower sensitivity due to nucleotide ambiguity and mismatch has to be explained in more detail. In addition to Corman et al. 2020 (see reference 2), Toptan et al 2020 (https://doi.org/10.3390/ijms21124396) might serve as helpful literature.

      In tables describing primers and probes, and the new Fig 1, we indicate that we used RdRp probe P2. In addition, we now also specifically state in the legend of Fig 1 that this probe only detects SARS-CoV-2 and that the primers used in the RdRp-P2 assay (as originally designed by Corman et al) contain nucleotide ambiguities and a mismatch. Finally, in the main text we explain:

      “Overall, we find RdRp detection to be at least 20-fold less sensitive than for E gene, N1 and N2 under our assay conditions; consistent with reports by others [19]. This may be due to a mismatch in the reverse primer employed in the RdRp (P2) assay, as originally designed [14].”

      With regard to the marginally positive samples that were not consistent in all assays, were the PCR products analyzed using high-resolution PAA genes and, if possible, sequenced? The sequencing approach (Sanger or NGS) offers the final characterization of the PCR products (especially for pan-genotypic primers such as E-Sarbeco). The samples declared as "inconclusive" could be further characterized in this way.

      Unfortunately, it has not been possible for us to carry out additional analyses for such (now historical) samples. Given the high prevalence of SARS-CoV-2 and the low sequence variability at primer/probe binding sites (new Table 2 and S5), inconclusive or marginally positive samples most likely reflect low viral load and/or low sample quality. Nevertheless, we now highlight the utility of further characterising such samples in the revised manuscript:

      “However, differentiating between samples with low viral loads and false positives is challenging. Analysis of such samples by Sanger sequencing of PCR products, or nanopore sequencing of RNA present could provide useful information. Further clinical evaluation and repeat sampling of the patient involved may also be a beneficial route to a secure clinical diagnosis.”

      The normalization in figure 3 should be also explained in the main text. Especially, why this approach was used for normalization.

      In the Results section we now describe the normalisation as follows:

      “A statistically significant linear correlation between Cq values for each of the viral probes (E, N1, and N2) and the Cq values for the RPP30 sample quality probe (p 40; Fig 4D and Fig S4A). Theoretically, using this approach, even a strong positive sample (SARS-CoV-2 Cq value of 28.2) of good quality (RPP30 Cq value of 20.3) may have given a false negative test result (SARS-CoV-2 Cq value of 40) if it had contained the same low amount of human material as the reference sample (RPP30 Cq value of 32.1; viral Cq: 32.1-20.3+28.2=40). Conversely, normalising samples to an optimal quality sample (RPP30 Cq 20.1/20.3) gives an indication of what viral Cq values may have been if all samples had contained a similar (more optimal) amount of material (Fig 4E, Fig S4B). This highlights the possibility that a proportion of apparent SARS-CoV-2 negative samples are in fact false negatives as a result of insufficient material in the swab fluid.”

      Nonetheless, it looks like the normalized values wills cluster much more strongly than those corresponding to the actual values. The authors should comment on this phenomenon. It appears that the higher cq values (less virus) are subject to a strong correction factor more often than high values. Are there any statistical relevant tendencies towards this phenomenon? For everyday clinical practice, does this mean that low samples Cqs (mostly) only reflect the quality of the sample, but not the viral load?

      We thank the reviewer for highlighting the stronger clustering of Cq values after normalisation, and for encouraging us to explore this further. We now show that there is a statistically significant linear correlation between RPP30 and SARS-CoV-2 Cq values (Fig 4C). This would indeed imply that a substantial proportion of the variability in SARS-CoV-2 Cq values seen in clinical practice is due to sample quality rather than different viral loads. However, outliers from the linear correlation when comparing samples from many different patients are to be expected (as seen in Fig 4C), because viral load is known to vary, with time of sampling relative to onset of symptoms one important contributing factor. In a research context, expressing viral load relative to a human control may be beneficial to differentiate between sample quality and absolute quantities of (intra/extracellular) viral RNA.

      In the revised manuscript we state:

      “Notably, the SARS-CoV-2 Cq values clustered more strongly after normalisation (Fig 4D, E; Fig S4). This reduced variability not only shows that the amount of human material present in NTS samples impacts on assay sensitivity, but also suggests that variability in viral load is not as great as implied by RT-qPCR data without normalisation.”

      Finally, it remains somewhat unclear to what extent the Cq values of the RPP30 should have an influence on the routine diagnostics. The authors discuss that a fixed cutoff value would be a possibility to sort out poor swab samples, but if a cq value is available it would also make sense to generate a kind of quality score that can display the significance of a test. It would be helpful if the authors could comment on this or other possibilities.

      We agree that it would be beneficial for routine diagnostics to derive such a measure. However, at this stage we do not have sufficient data to generate a robust quality score based on the RPP30 Cq values. Nonetheless, we believe RPP30 Cq values have immediate utility for routine diagnostics, and could help improve validity of test results going forward:

      1. Samples with undetectable RPP30 should trigger repeat sample collection, and not be given a false negative test result;
      2. Samples with high viral Cq values and/or for which only one of two viral targets are detected can be better interpreted in the context of the amount of human material as measured by RPP30 Cq;
      3. Ongoing monitoring of swab quality allows rapid identification of potential technical issues with swabbing;
      4. Normalisation of viral Cq values using RPP30 Cq values might be helpful in a research context to derive a more meaningful measure of viral loads, by removing one source of variability;
      5. Collection of such data on an ongoing basis would ultimately allow this to be translated into a quality score that could be used as part of diagnostics algorithms. In the revised manuscript we now discuss this as follows:

      “Absence of RPP30 signal (undetected or Cq >40) clearly indicates that absence of viral detection cannot be interpreted as a negative test result and that a repeat test is required (Table S6). However, utilising RPP30 Cq values when interpreting an apparent SARS-CoV-2 negative sample requires further consideration: what should the RPP30 Cq limit be for which to order a repeat test? One option would be to simply set an arbitrary cut-off, e.g. one could decide to re-test any samples with RPP30 Cq >30, or with Cq values above the 95th centile (Cq ~ 31 for our 108 samples). To determine robust cut-off limits, collection of RPP30 data for a much larger number of patient samples would be desirable. This would allow development of diagnostic algorithms that could incorporate a sample quality score based on the level of RPP30 detected. Nonetheless, RPP30 data, even as it stands, are useful for the interpretation of cases for which only one of the SARS-CoV-2 targets is (weakly) positive, with samples with high RPP30 Cq values interpreted with particular caution. In such cases, repeat testing of the same sample (with an independent assay of equal or better sensitivity) would be advisable, and repeat patient specimen collection and testing might also be considered (see Table S6 for guidance).”

      Over the past few months, more and more virus subtypes have formed through the manifestation of point mutations (and amino acid substitutions). The authors should therefore definitely comment on the current strains as to whether all primers / probes are able to detect the virus variants circulating worldwide without loss of sensitivity.

      We thank the reviewer for this suggestion and now include a table providing information on mismatches in primer and probe binding sites (see Table 2 and Table S5 of the revised manuscript). This shows that only a small proportion of 97,782 strains for which high quality genome sequencing is available have changes in primer/probe binding sites. In addition, the use of two different primer/probe sets in our multiplex assays provides a further safeguard against failure to detect strains with such changes.

      Along this line, which virus strains were used for the cultivation as described in line 131? Is sequence data available? If so, it would provide helpful information to characterize the viral strain.

      We have added strain information, accession codes for genome sequences and information on primer/probe binding for both control strains (hCoV-19/England/02/2020 and BetaCoV/Munich/ChVir984/2020) we used in our work (see Materials and Methods of the revised manuscript).

      Line 206ff: In my opinion, this section belongs more to the discussion part than to material and methods that describe the technical implementation.

      We agree and have now moved this section to the Discussion. Furthermore, we’ve made additional changes to better highlight the potential for further improvements to our assays, and SARS-CoV-2 RT-qPCR assays in general.

      Is there a loss of sensitivity compared to the single PCRs? This data is very important and useful for other users. They should therefore be included explicitly in the manuscript (supplements).

      We set out to develop multiplex PCR assays to allow more efficient and cost-effective testing. In the early stages of this process we performed small pilot experiments with positive control IVT RNA and individual primer/probe pairs that are widely used and well-established to sensitively detect SARS-CoV-2 RNA. With the exception of the RdRp primers/probe, we found all to perform well, with the ability to detect 10 copies of RNA. However, we did not perform a side-by-side comparison of uni- and multiplex PCRs, and to improve the structure and flow of the Results section, as requested by Reviewer 1, we have now removed all mention of the single PCR assays.

      Altogether, the key message of our work is that the N1E-RP and N2E-RP assays are able to detect between 1 and 3 copies of SARS-CoV-2 RNA and show equivalent performance to commercially available multiplex assays.

      **Minor issues:** Line 15 ff.: Source is missing, is this WHO-data?

      The estimated number of infections and fatalities at the time of writing of the original manuscript was based on data from the online interactive dashboard hosted by Johns Hopkins University. At the suggestion of Reviewer 3, we have removed precise numbers from the revised manuscript to make the introduction less time-dependent. Nonetheless, we now include a reference to the JHU online resource, as well as the weekly epidemiological updates from the WHO (https://www.who.int/emergencies/diseases/novel-coronavirus-2019/situation-reports) for readers interested in the latest figures.

      Fig S3: How was the digital droplet PCR carried out? A brief description should be included in the legend text.

      We purchased these samples from QCMD, an independent International External Quality Assessment & Proficiency Testing (EQA/PT) organisation. QCMD performed the digital droplet PCR, before distribution under the QCMD 2020 Coronavirus Outbreak Preparedness EQA Pilot Scheme, and provided us with details, which have now been added to the Materials and Methods section:

      “Quantification of control samples was carried out by QCMD prior to distribution within the EQA scheme, using droplet digital PCR (ddPCR) with E-gene primers and probe [13, 14] on the Biorad droplet digital PCR platform. A serial dilution of inactivated SARS-CoV-2 (strain BetaCoV/Munich/ChVir984/2020; GenBank Accession MT270112, [32]) was prepared and each dilution replicate tested 4 times using both RT-qPCR and ddPCR assays. Regression analysis was used to assess the linearity across the dilution series, and the analytical measurement range established for both assays, comparing results of each by Bland-Altman difference plot."

      In addition, we provide more details with the relevant table (new Table S3) and in the legend of the associated figure (new Fig 2) we state: “See Materials and Methods for details”.

      Figure 1a: PCR efficiencies are missing.

      We have now added PCR efficiencies to all relevant graphs.

      Line 145: MS2 appears, but without explaining the context. This should be improved here with additional information (this does not appear until line 154).

      At first mention of MS2 in the main text, we now state:

      “Internal controls were included to provide confirmation of successful nucleic acid extraction and absence of PCR inhibitors, with lysis buffer spiked with both MS2 (an RNA bacteriophage that infects Escherichia coli) and PhHV (a DNA virus that infects seals), detected by the TaqPath and N1E-RP/N2E-RP assays respectively..”

      Page 15, H20 instead of H20, reaction mix instead of Reaction mix.

      In the supplementary protocol, we have changed “H2O” to “H2O” and “Reaction mix” to “reaction mix”.

      Reviewer #2 (Significance (Required)): The novel coronavirus SARS-CoV-2 is the causative agent of the acute respiratory disease COVID-19 which has become a global concern due to its rapid spread and high death rate. While some patients have no symptoms at all, but are still able to spread the virus, others have severe symptoms, often with fatal outcome. The gold standard in SARS-CoV-2 detection is the RT-qPCR approach, however, the high cost commercial kits are available in limited amounts only. The issue of the scarcity of resources is still an highly important issue, especially in terms of the incredibly rapidly increasing number of cases worldwide. Thus, the manuscript is of significance for the field and timely. Especially, diagnostic laboratories in low-income countries that are involved in the managing the pandemic but also researchers will benefit from this manuscript and save resources.

      Reviewer #3 (Evidence, reproducibility and clarity (Required)): In this study Reijns et al developed a multiplex RT-PCR assay (alternative primer-probe sets and enzyme mixes) to detect SARS‐CoV‐2 and internal controls. The authors conclude that their assay performed equally well as established commercial kits. The authors also demonstrated that nose‐and‐throat swab samples have considerable variability in patient material content (>1,000‐fold variability). High variability is expected, but it is still important to substantiate this notion with numbers. Overall, I like the study and find it methodologically sound. Sample numbers in the tests are in most cases good. I have very few objections and hope to see the manuscript published soon.

      **SPECIFIC COMMENTS:** 1."The COVID‐19 pandemic originated in Wuhan (China) in December 2019 and at the time of writing has infected more than 13.1 million people worldwide, resulting in well over 0.57 million COVID‐19‐related deaths..." I suggest a more timeless starting of the introduction, not pointing out exact number of infections and deaths since these numbers quickly become obsolete. The reader will know the severity of the pandemic and the importance of methodological development without statement of exact numbers. This comment reflects my personal opinion and it is completely up to the authors to choose how to phrase this section.

      We agree with the reviewer that a more timeless start to the introduction makes more sense. Therefore, as suggested, we have changed this section of the manuscript, which now reads as follows:

      “The COVID-19 pandemic, caused by the novel coronavirus SARS-CoV-2 [1], originated in Wuhan (China) in December 2019 and rapidly spread across the globe, resulting in substantial mortality [2, 3] and widespread economic damage. Until a vaccine becomes available, public health strategies centred on reducing the rate of transmission are crucial to mitigating the epidemic, for which effective and affordable testing strategies to enable widespread population surveillance are essential.”

      2.Tables listing primers and probes should include the amplicon (PCR product) length for each primer-probe pair. Product length is an important consideration for fragmented RNA samples, such as for example heat-inactivated or longer-term stored samples. It should not be put on the reader to find out the amplicon lengths.

      To provide the reader with this information, the revised manuscript now includes the following:

      1. As suggested, the amplicon length for each primer pair is added to all tables that list primers and probes (PCR products: RdRp – 100 bp; E- 113 bp; N1 – 72 bp; N2 – 67 bp);
      2. A diagram in a new Fig 1 indicates the positions of all primers and probes on the SARS-CoV-2 genome along with amplicon length.
      3. A supplementary SnapGene file with primers and probes on the SARS-CoV-2 (Wuhan-Hu-1) genome to allow readers to look at further details in the context of the viral genome.

        3.Line 131: "To confirm sensitivity using total viral RNA, nucleic acids isolated from cultured SARS‐CoV‐2 were also used to make a dilution series (10^‐1 to 10^‐6)." I lack a methodological description how viral nucleic acid was quantified. It is not entirely trivial to separate viral RNA from RNA contributed from the cells used for the in vitro expansion of the virus.

      We apologise for the lack of clarity on this in our original manuscript. The purpose of this experiment was not to measure a defined number of RNA molecules, but to ensure that there was no inhibition of viral target amplification in a more complex sample by demonstrating linearity over a range of dilutions. The cultured SARS-CoV-2 positive control was provided by Prof Rory Gunson (Clinical Lead West of Scotland Specialist Virology Centre, NHS Greater Glasgow and Clyde) as inactivated supernatant from virus (strain hCoV-19/England/02/2020) propagated in cell culture. We then isolated RNA from a dilution series of this supernatant, using the methods described in our manuscript, but did not determine the precise concentration. The RT-qPCR data for this series shows a good fit and amplification efficiency, similar to what was found for the IVT RNA, and QCMD virus calibration curves (new Fig 2). The known copy number of the QCMD virus (as determined by ddPCR) allowed us to calculate that the concentration of the virus in the supernatant provided to us was between 0.7 and 2.2 x 105 copies/ml, with viral RNA detected down to between 0.7 and 3 copies with our N1E-RP and N2E-RP assays. We have substantially restructured the results section, and hope to have made the way we used the different viral controls clearer in the revised version of the manuscript.

      4.Line 150: "All positive and negative controls gave the expected results (Table S4)" I don't like the exact formulation since it is not clear for the reader what are the "expected results", including the "expected" quantitative results (Ct).

      We agree that the use of “expected results” does not provide the reader with sufficient information. We have therefore changed this to:

      “Results for controls were as anticipated (Table S4), with signal absent (undetermined) for SARS-CoV-2 and RPP30 targets for the negative controls, and Cq values for the SARS-CoV-2 RNA positive control (50 copies) similar to those obtained previously (Fig 2A).”

      In addition, we now provide more information on the precise nature of the negative and positive controls with Table S4:

      “-ve (extr), negative control with viral transport medium after RNA isolation (does not contain SARS-CoV-2 or human material; does contain PhHV);

      -ve, negative control containing water only (should not contain any RNA)

      +ve, positive control with in vitro transcribed RNA (50 copies; contains SARS-CoV-2 target RNA, does not contain human or PhHV nucleic acids)”

      Reviewer #3 (Significance (Required)): This study provides an alternative multiplex RT-PCR assay to detect SARS-CoV-2 infection. I find the results important and useful for the research and medical community.

      Rebuttal references

      1. Zhu N, Zhang D, Wang W, Li X, Yang B, Song J, et al. A Novel Coronavirus from Patients with Pneumonia in China, 2019. N Engl J Med. 2020;382(8):727-33. Epub 2020/01/25. doi: 10.1056/NEJMoa2001017. PubMed PMID: 31978945; PubMed Central PMCID: PMCPMC7092803.
      2. Brown JR, O’Sullivan D, Pereira RP, Whale AS, Busby E, Huggett J, et al. Comparison of SARS-CoV2 N gene real-time RT-PCR targets and commercially available mastermixes. 2020:2020.04.17.047118. doi: 10.1101/2020.04.17.047118 %J bioRxiv.
      3. Arevalo-Rodriguez I, Buitrago-Garcia D, Simancas-Racines D, Zambrano-Achig P, del Campo R, Ciapponi A, et al. False-negative results of initial RT-PCR assays for COVID-19: A systematic review. 2020:2020.04.16.20066787. doi: 10.1101/2020.04.16.20066787 %J medRxiv.
      4. Watson J, Whiting PF, Brush JE. Interpreting a covid-19 test result. BMJ. 2020;369:m1808. Epub 2020/05/14. doi: 10.1136/bmj.m1808. PubMed PMID: 32398230.
      5. Woloshin S, Patel N, Kesselheim AS. False Negative Tests for SARS-CoV-2 Infection - Challenges and Implications. N Engl J Med. 2020;383(6):e38. Epub 2020/06/06. doi: 10.1056/NEJMp2015897. PubMed PMID: 32502334.
      6. Vogels CBF, Brito AF, Wyllie AL, Fauver JR, Ott IM, Kalinich CC, et al. Analytical sensitivity and efficiency comparisons of SARS-CoV-2 RT-qPCR primer-probe sets. Nat Microbiol. 2020. Epub 2020/07/12. doi: 10.1038/s41564-020-0761-6. PubMed PMID: 32651556.
      7. Bustin SA, Benes V, Garson JA, Hellemans J, Huggett J, Kubista M, et al. The MIQE guidelines: minimum information for publication of quantitative real-time PCR experiments. Clin Chem. 2009;55(4):611-22. Epub 2009/02/28. doi: 10.1373/clinchem.2008.112797. PubMed PMID: 19246619.
    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      In this study Reijns et al developed a multiplex RT-PCR assay (alternative primer-probe sets and enzyme mixes) to detect SARS‐CoV‐2 and internal controls. The authors conclude that their assay performed equally well as established commercial kits. The authors also demonstrated that nose‐and‐throat swab samples have considerable variability in patient material content (>1,000‐fold variability). High variability is expected, but it is still important to substantiate this notion with numbers. Overall, I like the study and find it methodologically sound. Sample numbers in the tests are in most cases good. I have very few objections and hope to see the manuscript published soon.

      SPECIFIC COMMENTS:

      1."The COVID‐19 pandemic originated in Wuhan (China) in December 2019 and at the time of writing has infected more than 13.1 million people worldwide, resulting in well over 0.57 million COVID‐19‐related deaths..." I suggest a more timeless starting of the introduction, not pointing out exact number of infections and deaths since these numbers quickly become obsolete. The reader will know the severity of the pandemic and the importance of methodological development without statement of exact numbers. This comment reflects my personal opinion and it is completely up to the authors to choose how to phrase this section.

      2.Tables listing primers and probes should include the amplicon (PCR product) length for each primer-probe pair. Product length is an important consideration for fragmented RNA samples, such as for example heat-inactivated or longer-term stored samples. It should not be put on the reader to find out the amplicon lengths.

      3.Line 131: "To confirm sensitivity using total viral RNA, nucleic acids isolated from cultured SARS‐CoV‐2 were also used to make a dilution series (10^‐1 to 10^‐6)." I lack a methodological description how viral nucleic acid was quantified. It is not entirely trivial to separate viral RNA from RNA contributed from the cells used for the in vitro expansion of the virus.

      4.Line 150: "All positive and negative controls gave the expected results (Table S4)" I don't like the exact formulation since it is not clear for the reader what are the "expected results", including the "expected" quantitative results (Ct).

      Significance

      This study provides an alternative multiplex RT-PCR assay to detect SARS-CoV-2 infection. I find the results important and useful for the research and medical community.

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      In this manuscript, Reijns and colleagues describe an approach to detect the causative agent of COVID-19, the beta coronavirus SARS-CoV-2, using an inexpensive in-house multiplex RT-qPCR. Concomitantly, viral E, N and RdRP(probe P2) as well as human RPP30 and a herpesvirus nucleic acid are also detected in order to monitor both the sample quality and the sample preparation. Reijns et al. performed testing on a huge amount of samples and used the data to describe the strength and limitations of the assay. The data is sound and give a very good impression of the 4-plex PCR capabilities. I read manuscript fluently and consider as linguistically very good. However, I still have a few comments and remarks that would strengthen the manuscript:

      Major issues:

      In the first section of the results section, many primer / probe conditions are given that make the reading flow difficult. Instead of using (data not shown) it would be helpful to use a table or a graphic to illustrate the various approaches. In general, I suggest to replace Ct by Cq, since the IVT standards are a quantification method.

      There has already been a change away from the initial E and RdRP gene based assay because of the published sensitivity issues and the use of degenerate bases as well as the detection of unspecific nucleic acids for E gene). In particular, it has been shown that the Sarbeco-E-yields false positive results (Toptan et al. 2020 (https://doi.org/10.3390/ijms21124396), Konrad et al. 2020 (https://doi.org/10.2807/1560-7917.ES.2020.25.9.2000173)), so that many laboratories do not consider E-gene-based results for borderline samples anymore. In this manuscript, the authors should comment on why they still use the results from the E gene / RdRP and describe their experience.

      In this manuscript, it should be indicated that the SARS-CoV-2 specific Probe P2 (according to Corman et al. 2020) was used. The reason for lower sensitivity due to nucleotide ambiguity and mismatch has to be explained in more detail. In addition to Corman et al. 2020 (see reference 2), Toptan et al 2020 (https://doi.org/10.3390/ijms21124396) might serve as helpful literature. With regard to the marginally positive samples that were not consistent in all assays, were the PCR products analyzed using high-resolution PAA genes and, if possible, sequenced? The sequencing approach (Sanger or NGS) offers the final characterization of the PCR products (especially for pan-genotypic primers such as E-Sarbeco). The samples declared as "inconclusive" could be further characterized in this way.

      The normalization in figure 3 should be also explained in the main text. Especially, why this approach was used for normalization. Nonetheless, it looks like the normalized values wills cluster much more strongly than those corresponding to the actual values. The authors should comment on this phenomenon. It appears that the higher cq values (less virus) are subject to a strong correction factor more often than high values. Are there any statistical relevant tendencies towards this phenomenon? For everyday clinical practice, does this mean that low samples Cqs (mostly) only reflect the quality of the sample, but not the viral load? Finally, it remains somewhat unclear to what extent the Cq values of the RPP30 should have an influence on the routine diagnostics. The authors discuss that a fixed cutoff value would be a possibility to sort out poor swab samples, but if a cq value is available it would also make sense to generate a kind of quality score that can display the significance of a test. It would be helpful if the authors could comment on this or other possibilities.

      Over the past few months, more and more virus subtypes have formed through the manifestation of point mutations (and amino acid substitutions). The authors should therefore definitely comment on the current strains as to whether all primers / probes are able to detect the virus variants circulating worldwide without loss of sensitivity. Along this line,which virus strains were used for the cultivation as described in line 131? Is sequence data available? If so, it would provide helpful information to characterize the viral strain.

      Line 206ff: In my opinion, this section belongs more to the discussion part than to material and methods that describe the technical implementation.

      Is there a loss of sensitivity compared to the single PCRs? This data is very important and useful for other users. They should therefore be included explicitly in the manuscript (supplements).

      Minor issues:

      Line 15 ff.: Source is missing, is this WHO-data?

      Fig S3: How was the digital droplet PCR carried out? A brief description should be included in the legend text.

      Figure 1a: PCR efficiencies are missing.

      Line 145: MS2 appears, but without explaining the context. This should be improved here with additional information (this does not appear until line 154).

      Page 15, H20 instead of H20, reaction mix instead of Reaction mix.

      Significance

      The novel coronavirus SARS-CoV-2 is the causative agent of the acute respiratory disease COVID-19 which has become a global concern due to its rapid spread and high death rate. While some patients have no symptoms at all, but are still able to spread the virus, others have severe symptoms, often with fatal outcome. The gold standard in SARS-CoV-2 detection is the RT-qPCR approach, however, the high cost commercial kits are available in limited amounts only. The issue of the scarcity of resources is still an highly important issue, especially in terms of the incredibly rapidly increasing number of cases worldwide. Thus, the manuscript is of significance for the field and timely. Especially, diagnostic laboratories in low-income countries that are involved in the managing the pandemic but also researchers will benefit from this manuscript and save resources.

    4. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      In order to improve SARS-CoV-2 diagnostics, Reijns et al. developed a multiplexed RT-qPCR protocol that allows simultaneous detection of two viral genes, one housekeeping gene as well as an external gene as an extraction control. Compared to running parallel assays to detect genes individually, the turnaround time is much shorter and reagents are saved. Furthermore, the presented data suggest that the assay is more sensitive than commercial kits. The authors also propose the detection of the human housekeeping gene as a measure of sample quality control. In principal, this work has potential but the manuscript itself needs a better structure.

      Major concerns:

      The authors have used the Takara RT-qPCR kit for their study. Did the authors try other commercial kits? Can the authors elaborate on the supply chain of the Takara kit? Could it cover population testing in case of shortages of other commercial kits?

      For better comparison, is it possible to give information on which primers the commercial kits are based on? Also, explain better the primers used in this study. For example, the N1 and N2 primers are directed against different regions of the SARS-CoV-2 N gene.

      The result section needs a better structure as the first two pages do not refer to any of the main figures. For example, in which figure or table can the reader find the data that are discussed in lines 83 to 87?

      Table S1, instead of current Table 1, could be moved to main figures as it contains the important finding that the multiplexed assay may be more sensitive than the commercial one. The authors identified some samples that scored negative in commercial assays but positive in their new assay. This is important, however, the possibility of detecting false positives should be strengthened in a "Discussion" section.

      Figures 1 to 3 have different panels which seem to be redundant. For example, Fig 1 A and B, Fig 2 B and C, Fig 3 C and D.

      Figure 1: Give a rational why comparing before and after extraction. This heavily depends on the extraction method and not on the detection itself. In addition, IVT RNA does not reflect the complexity of a clinical specimen. This is rather confusing and deviates from the important findings.

      Figure 3: Were any of the negative samples/patients tested with an undetectable housekeeping gene, re-test positively? Did adding this housekeeping gene as a control actually improve the detection of any patient samples? If the authors want to convince the readership of this quality control, experimental evidence should be provided.

      Fig 3C and D seem to contain this information somewhat, as here, the values were normalized and the CT values for the E and N gene decreased. Nevertheless there is no real explanation of this figure provided in the Result section at all. While this figure has potential, the authors have to keep in mind that the number of cells in a swab can be affected by many biological factors, including age, sample timing, inflammation of the respiratory tract, etc. In addition, viral genomes can exist intra- as well as extracellular, in the form of free virus. So even in the absence of human cells/detectable housekeeping genomes, viral RNA can be or should be present in a sample in case of infection. This explains (probably) why a correlation between detectable housekeeping gene and viral RNA is absent (Fig 3A and B?). This entire Fig 3 just needs a better explanation. The provided text does not describe any results and should go into a "Discussion" section.

      Self-swabbing is surely a potential source of variability and false-negatives, but many publications have shown the suitability of saliva testing. This should also be discussed and would probably negate the need for such a quality control.

      Which assay works better, the N1E-RP or the N2E-RP assay? A final conclusion is missing here.

      Significance

      Naturally, in this pandemic, this topic is important as sensitive and affordable methods to detect SARS-CoV-2 infections are in need. This Reviewer agrees that multiplexing could be an elegant approach to fill this need.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      We thank the reviewers for their feedback and constructive comments to our work. We provide here a point-by-point response to the comments of Reviewers #1, #2 and #3 (text in grey and italic).

      Responses written in plain text correspond to Reviewer comments that have been addressed in the revised version of the manuscript provided at this stage of the review process (referred-to as “revised version I” below).

      Reponses written in bold text correspond to comments that need further experiments. The list of experiments we intend to perform to address these comments is provided in a separate document (Revision plan). The results of these additional experiments will be included in a later revised version of the manuscript referred-to as “revised version II” below.

      Reviewer #1

      The manuscript addresses an important topic, the posttranscriptional maturation of ribosomes. This topic is inherently interesting because we normally think of ribosome biogenesis as a sequential series of steps that automatically proceeds and cannot be "accelerated" in physiological conditions, but only "delayed" in the presence of genetic mutations. In short, the manuscript proposes that RIOK2 phosphorylation by the action of RSK, below the Ras/MAPK pathway promotes the synthesis of the human small ribosomal subunit.

      I honestly admit that I have some difficulties in reviewing this manuscript. The quality of the presented data is, in generally, good. However, overall I find the whole manuscript preliminary and I am not much convinced of the conclusions. Several aspects are superficially analyzed. In short, I think that most of the conclusions are not fully supported by the data because shortcuts are present. A list of all the aspects that I found wrong are listed.

      Biological issue

      1. _The authors claim that the effects of the inhibition of the maturation of ribosomes by acting on a pathway upstream of RIOk2 are limited to the 40S subunit. This is far from being a trivial point, for the following reason. RIOK2 is known to affect the maturation of 40S ribosomes. Hence, the fact that using an upstream inhibitor of the MAPK pathway such as PD does not inhibit 60S processing in reality would argue against a biologically relevant control in ribosome maturation (of the MAPK patheay). Have the authors considered this? In a way, also, given the fact that the mutants confirm a role in 18S final maturation, it is a bit complex to put all the data in a clear biological context.

      We agree that we put more emphasis on the effects on the pre-40S pathway than on the pre-60S pathway in the original manuscript but we did not claim that the effects of PD or LJH inhibitors of the MAPK pathway are restricted to the 40S subunit. We described that the effect of PD or LJH on the 32S was less severe than on the 30S, and we did mention variations of the 12S intermediate. These changes are in the same range of amplitude as the changes in the 21S and 18S-E intermediates in the small subunit pathway. The Northern blot data concerning the pre-60S pathway were placed in the supplementary material of the original manuscript, which may have left the reader with an impression of lesser emphasis. We rephrased this part in the present revised version I of the manuscript (Page 6, Line 26) and we now show the pre-40S and pre-60S intermediates on the same figures (Figures 1A and 1C).

      In addition, we will probe more exhaustively the intermediates of the pre-60S pathway in the revised version II of the manuscript as described in the revision plan. These data will be complemented with metabolic labeling experiments to provide a more dynamic analysis of the pre-rRNA processing defects resulting from inactivation of the MAPK pathway. Furthermore, as requested by Reviewer #2 (see below), we will quantify more accurately these data.

      A number of specific issues will be concisely described.

      Manuscript very well written. Data do not always support the strong conclusions. Low magnitude of the observed effects.

      In introduction the authors make a general claim that ribosome biogenesis is one of the most energetically demanding cellular activities. This statement lingers in the literature since 15 years but in reality it has never been formally proved for mammalian cells, and certainly not for HEK293 cells. The original statement, to my knowledge, can be traced by some obscure statement referred to the yeast case and then repeated as a truth. In conclusion, beside being a very banal observation, it should be referenced.

      We agree with this comment of Reviewer #1. The original statement has been proposed by Jonathan R. Warner (Warner, 1999, TiBS and references therein) and data from the Bähler group also supported this statement (Marguerat et al., 2012, Cell). However, these data were indeed referring to yeast (S. cerevisiae and S. pombe). In the present revised version I of the manuscript, we introduced the reference of a review providing quantitative data of ribosome biogenesis in human cells (Lewis & Tollervey, 2000, Science) and we modified the problematic sentence as follows:” Growing human cells produce around 7500 ribosomal subunits per minutes (Lewis and Tollervey 2000), which represents a significant expenditure of energy.” (Page 4, Line 1).

      Growth factors, energy status are not cues but are proteins or metabolites (introduction).

      We agree with this comment of Reviewer #1. We changed the text accordingly in the revised version I of the manuscript (Page 4, Line 8).

      Authors write about mTOR without making statements on mTORC1/2. This is very obsolete. Also I am not sure that the choice of Geyer et al., 1982, and subsequent papers makes much sense. At the very minimum TOP mRNA concepts and mTORC1 must be defined.

      We provide more details on the mTOR pathway in the revised version I of the manuscript according to Reviewer #1’s suggestions (Page 4, Line 13 and Page 5, Line 3).

      The authors claim that their work fills a major gap between known functions of MAPK and cytoplasmic translation. I would not be so sure about it.

      Our original sentence stated that “our work fills a major gap between currently known functions of MAPK signaling in Pol I transcription and cytoplasmic translation”. Indeed, although MAPK signaling was known to regulate Pol I transcription and cytoplasmic translation, the impact of the pathway on the post-transcriptional steps of ribosome synthesis, namely pre-ribosome assembly and maturation, has been very little investigated and remains poorly understood. Our data provides the first example of a detailed mechanism of regulation of the maturation of pre-ribosomal particles by the MAPK pathway. Reviewers #2 and #3 seem to agree with this point:

      Reviewer #2: “However, there is a lacking mechanistic connection of signaling pathways to pre-rRNA processing and maturation steps of ribosome biogenesis. The authors set out to provide a specific example of a direct target of MAPK signaling, RSK that regulates pre-rRNA maturation through the phosphorylation of a ribosome assembly factor (RIOK2), offering for the first time providing mechanistic insight into MAPK regulation of pre-rRNA maturation.

      Reviewer #3: “With these provisos, the work is technically good and will be of considerable interest to the field. The post-transcriptional regulation of ribosome synthesis is increasingly recognized a significant topic.

      Results. Authors start with a major mistake, i.e. that PMA selectively stimulates the MAPK pathway. Perhaps it stimulates, certainly it does not do it selectively.

      We agree with this comment of Reviewer #1. We removed the term “selectively” in the problematic sentence (Page 6, Line 8).

      RIOK2 phosphosites are first found by bioinformatics analysis. It should be noted that the predicted phosphosite (S483) is found only in a limited set of datasets from MS databases. The actual importance of this site would not emerge from unbiased studies. Also, there are many other phosphosites that were not analyzed in this study.

      We agree with Reviewer #1 that phosphorylation of S483 of RIOK2 has been detected in a limited number of mass spectrometry datasets, but these datasets have been reported in high impact journals (Nature Methods, Mol Cell Proteomics, Science), attesting of the quality of these studies

      As mentioned by Reviewer #1, there are several other phosphosites within RIOK2 that were not analyzed in our study. We provided the list of these phosphosites in Supplementary Table S1 of the original manuscript. Besides T481 and S483, none of the other sites belong to consensus motifs recognized by ERK or RSK at medium and high stringency. They are therefore less relevant to our study. We only analyzed phosphorylation at S483 because: (i) our mass spectrometry analysis revealed that S483 is the only phosphosite in RIOK2 whose level increases upon MAPK activation but not in the presence of the MAPK inhibitor PD184352 (Figure 2B); (ii) our in vitro kinase assay showed that the phosphorylation level of RIOK2 by RSK is residual when S483 is replaced by a non-phosphorylatable alanine (Figure 3D); (iii) our data presented in Figure 2C further show that mutation of T481 to an alanine does not prevent RIOK2 phosphorylation on RxRxxS/T motifs upon stimulation of the MAPK pathway.

      We clarified this point in the relevant part of the result section of the revised version I of the manuscript (Page 7, Lines 16 and 24, Page 8, Line 17 and Page 9, Line 5).

      Throughout the paper the authors use the word strongly, significantly, but the actual effects seem in general quite marginal.

      We agree with Reviewer #1 that some of the phenotypes described in the manuscript are modest, in particular the phenotypes resulting from the S483A mutation of RIOK2, which is not aberrant for a point mutation. We rephrased several sentences throughout the manuscript to soften the formulation in the description and interpretation of the data and in the conclusions.

      Discussion. The authors claim that they provide solid evidence on MAPK signalling to ribosome maturation. At the very best this is circumstantial evidence for the 40S maturation.

      We rephrased the sentence accordingly (Page 16, Line 5): “Our study provides evidence that MAPK signaling applies another level of coordination during ribosome biogenesis, by directly regulating pre-40S particle assembly and maturation.

      Figure 1.

      Unclear why LJH should increase P-ERK.

      A negative feedback loop has been described in the MAPK pathway whereby RSK activation partially inhibits ERK phosphorylation (Saha et al., 2012, Horm Metab Res; Dufresne et al., 2001, MCB; Schneider et al., 2011, Neurochem; Re Nett et al., 2018, EMBO Rep). Inactivation of RSK with LJH alleviates this inhibition, which results in increased phosphorylation levels of ERK.

      We added this information in the revised version of the manuscript along with the corresponding references (Page 6, Line 17).

      General lack of quantitation (sd, replicates, bars). Experiment done only on a single cell line in a single experimental setup.

      As also requested by Reviewer #2 (Major comment 1.), we applied in the revised version I of the manuscript RAMP quantifications to all Northern blot data. We included error bars corresponding to biological replicates.

      Furthermore, in order to validate the impact of the MAPK pathway on pre-ribosome assembly and maturation, we plan to perform the same experiments using PD inhibitors in different cell lines and we will provide a figure with accurate RAMP quantifications, error bars and statistical significance, in the revised version II of the manuscript (see revision plan).

      Very different effects on 21S by LJH, PMA and siRNA for RIOK2. Overall the message given by the authors is to me mysterious.

      We assume that the reviewer wanted to point out the difference between PMA, PMA+LJH and shRNA for RSK since we did not perform RNAi targeting RIOK2. We agree with this comment. We believe that this difference is likely due to experimental setups that are different between both experiments. In the experiment using inhibitors, we assessed short-term effects of RSK inhibition after acute stimulation of the MAPK pathway (starved cells stimulated with PMA), while in the experiment using shRSK, we monitored long term effects of RSK depletion in serum-growing cells in which other signaling pathways are also active. Prolonged RSK depletion is likely to induce pleiotropic cellular effects, which would interfere with ribosome biogenesis both directly and indirectly. These differences probably explain the variable effects on the 21S intermediate. However, in both experiments we do observe an accumulation of the early 30S intermediate, consistent with the phenotype observed when ERK is inactivated (PD inhibitor), therefore indicating that RSK regulates some post-transcriptional stages of ribosome biogenesis.

      To make our results clearer we have withdrawn the experiments using shRSK to avoid the risk of showing indirect effects due to the prolonged absence of RSK. Instead, we included RAMP analyses with error bars from 2 biological replicates using PD and LJH inhibitors (Figure 1B).

      Figure 2.

      Several red flags. For instance in 2C the loaded levels of RIOK2-HA loaded are clearly less than the ones of the other genotypes, hence the conclusion on P-RIOK2 is not convincing.

      Our aim in this experiment was to compare the impact of PMA treatment on the phosphorylation levels of different RIOK2 mutants (T481A, S483A, double mutant). For a given mutant, the levels of RIOK2 loaded in the two conditions (i.e. not stimulated and PMA stimulated) are very similar and we therefore assume that our conclusions are valid.

      We nevertheless plan to repeat these experiments and quantify the data for the revised version II of the manuscript.

      Staining with anti-P RIOK2 lacks controls, how can be sure that the signal is due to the phosphate? Phosphatase treatment?

      We fully agree with Reviewer #1 and we did perform an experiment showing that the phosphorylation signal disappears following treatment of the protein extracts with λ-phosphatase. We did not show these data in the original version of the manuscript because of space limitations. We added these data in the supplementary material of the revised version I of the manuscript (Supplementary Figure S2B) and amended the text accordingly (Page 7, Line 24)

      Why FBS does not lead to ERK staining in HEK293? There are plenty of growth factors in FBS that should lead to ERK phosphorylation. I do not understand this experiment.

      We agree with this comment. Addition of serum to starved cells does lead to ERK and RSK phosphorylation but with a much lesser efficiency compared to stimulation by EGF and PMA. ERK phosphorylation is barely visible on the exposure shown in Figure 2D but RSK-phosphorylation is clearly observed, although the signal is much weaker compared to EGF and PMA treatments. It is common to observe a stronger response with purified PMA and EGF (see Carrière et al., 2011, JBC ; Ray et al., 2013, Oncogene). There are indeed several growth factors in the serum, but the most abundant (Insulin, IGF1, TGF) are present at ng/ml concentration, while EGF is used at 25 µg/ml in Figure 2D. Moreover, they are not very strong activators of the Ras/MAPK pathway, and it is also possible that after 20 min of FBS treatment the phosphorylation is in the decreasing phase.

      In the present revised version I of the manuscript, we included a set of western blots from another experiment showing the same results but of better quality to make the effects more visible (Fig. 2D). We also provided quantifications of phosphorylation of RIOK2 and associated statistical analyses (Fig. 2E).

      Figure 3. In vitro phosphorylation, if I understood, it relies on a truncated version of RIOK2. Why? Is the folding of the full length protein not permissive to in vitro phosphorylation?

      We did not test phosphorylation of the full length RIOK2 protein in vitro because RIOK2 has been reported to auto-phosphorylate (Zemp I. et al., 2009, JCB) and we were concerned that this auto-phosphorylation activity of RIOK2 in addition to RSK phosphorylation may render this experiment inconclusive.

      HA-RSK3 is less?

      It was reported that RSK3 is insoluble when over-expressed (Zhao et al., 1996, JBC), which explains the lower levels of protein recovered in our soluble extract. The information was present in the legend of Figure but we transferred it to the main text of the result section in the present revised version I of the manuscript (Page 10, Line 3).

      Figure 4. Immunofluorescence is low mag, difficult to understand.

      We agree with Reviewer #1. We modified the FISH experiment figure to show cells with a higher magnification and we provided more details in the text (Page 12, Lines 20-25) to facilitate the understanding of the data.

      I really like the experiments with RIOK2 mutants, however I wonder what about protein levels after the knock-in? Given the 18S phenotype overlap between the phenotype of the RIOK2 loss of function with the S483A, testing protein level becomes of the utmost importance.

      We checked RIOK2 protein levels and observed that the mutations do not decrease the level of RIOK2. On the contrary, the mutations slightly increase RIOK2 levels. Therefore, we are pretty confident that the phenotypes resulting from expression of RIOK2 mutants do not result from defects in the global accumulation of the protein. These data have been added to Figure 4C of the revised version I of the manuscript and we amended the text accordingly (Page 12, Line 5).

      Figure 5. Low quality IFL.

      Our aim in preparing this figure was to show many cells in the different images to show that the effect of our mutation was homogenous at the level of cell populations. The drawback is that cells are small and look blurred. We improved the quality of the figure in this revised version I of the manuscript with new images from the same experiment, showing less cells with a higher magnification.

      Hard to think that histogram quantitation of nuclear versus cytoplasmic staining are reliable in the absence of fractionation, better quantitation, experiment done in other cell lines and so on.

      We provide in this revised version I of the manuscript a supplementary figure explaining the procedure we used to quantify the fluorescence data (Supplementary Fig. S7).

      Furthermore, to confirm this result using other experimental conditions and cell lines, we will transfect HEK293 and HeLa cells with plasmids expressing GFP-tagged RIOK2 WT or the S483S mutant and we will compare the kinetics of nuclear import of both proteins upon inhibition of pre-40S particle export by leptomycin B using fluorescence microscopy and GFP quantifications. Second, we will transfect HeLa cells with plasmids expressing HA-tagged RIOK2 WT or S483A and perform fractionation assays to monitor their presence in both cytoplasmic and nuclear compartments. We will include these data in the revised version II of the manuscript.

      However, very beautiful Fig. 5E perhaps the best of the paper shows also mobility shift driven by S483, thus supporting posttranslational modifications.

      We thank Reviewer #1 for this comment. We added the note on the evidence of RIOK2 post-translational modification in the result section (Page 14, Line 9).

      Fig. 6. IFL studies are really impossible to interpret.

      We improved the quality of the figure with new images from the same experiment, showing less cells with a higher magnification. NOB1 IF data and quantifications have been transferred to the supplemental material (Supplemental Fig. S4A and S4B) to clarify the figure. In addition, we provided more explanations on the principle of this experiment and expected results in the text (Page 15, Line 9).

      The effects on RIOK2 release (this figure) and 18S maturation (Fig. 5) are very clear and of great quality.

      We thank Reviewer #1 for this comment.

      Overall conclusions. The manuscript tends to overinflate the meaning of several experiments. What to me is very clear and interesting is that the the authors provide clear evidence that S483A mutants have a defect in 40S maturation. Whether this is due to MAPK signalling, is only circumstantial. I would suggest to build up on the strong findings and eliminate ambiguous data.

      We do not fully agree with this comment of Reviewer #1. If mutation S483A were simply a partial loss of function mutation, this would not be of strong interest for the subject of this manuscript. It would just indicate that S483 is important for RIOK2 function independently of its phosphorylation status. Our data show that the impact of S483 mutation on pre-rRNA processing and other phenotypes is different depending on whether the serine is converted to an alanine (phosphorylation mutant) or to an aspartic acid (phospho-mimetic mutation). These data are a strong indication that what matters is not simply the serine residue by itself but its phosphorylation status.

      Reviewer #1 (Significance (Required)):

      The paper deals with an important topic, namely whether a regulation of ribosome maturation exists, and how it is mechanistically regulated. In this context, the analysis of the ERK pathway is highly needed considered that most works deal with effects of the PI3K-mTOR pathway, and the parallel, yet important RAS-ERK pathway, is less understood.

      As a final note, we should consider that S6K downstream of mTOR, and ribosomal S6K, downstream of ERK have been considered to share some substrates.

      We introduced this information in the revised version of the manuscript (Page 19, Line 20). A related comment has been raised by Reviewer #3 (see below, Caveat #2).

      The manuscript is interesting, but several statements given by the authors are rather superficial. An example, listed in the previous section, relates to the linguistic usage of mTOR kinase, instead of detailing whether we are dealing with mTORc1 or mTORc2.

      We agree with this comment of Reviewer #1. Given that the main focus of this manuscript is the regulation by the MAPK pathway, we had chosen to put less emphasis on mTOR in the introduction. However, we added more precise information on mTOR in the present revised version I of the manuscript to address this comment (Page 4, Line 13 and Page 5, Line 3).

      A second gross mistake is the definition of PMA as a stimulator of the ERK pathway. If this is certainly true, this is historically not correct as seminal papers by the group of Parker define this drug as a stimulator of conventional PKC kinases. In short, this paper is a step back in knowledge from the perspective of the literature context.

      We are a bit confused by this comment because seminal papers from the Parker group clearly state that PMA activates the MAPK pathway via PKC (Adams and Parker, 1991, FEBS Lett.; Ways et al., 1992, JBC; Whelan et al., 1999, Cell Growth Differ.). We agree, as mentioned earlier by Reviewer #1, that PMA is not specific to MAPK, a comment that has been addressed above.

      All people interested to the crosstalk between ribosome maturation and signaling pathways will be certainly read this manuscript.

      My expertise is within the ribosome biology and signalling field.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)):

      There have been mechanistic connections of various signaling pathways to regulation ribosome biogenesis steps including rDNA transcription by RNA polymerase I and III, ribosomal protein transcription, and differential mRNA translation efficiency. However, there is a lacking mechanistic connection of signaling pathways to pre-rRNA processing and maturation steps of ribosome biogenesis. The authors set out to provide a specific example of a direct target of MAPK signaling, RSK that regulates pre-rRNA maturation through the phosphorylation of a ribosome assembly factor (RIOK2), offering for the first time providing mechanistic insight into MAPK regulation of pre-rRNA maturation.

      The authors observe slight pre-rRNA processing defects upon the use of RSK inhibitors and RSK depletion. They identified several candidate ribosome assembly and modification factors containing the canonical RSK substrate motif, including the RIOK2 kinase. Phosphorylation at this motif was verified to be specifically phosphorylated by RSK1 and 2 isoforms in cells and in an in-vitro kinase assay. The authors produced RIOK2 knock-in eHAP1 cell lines expressing non-phosphorylatable or phosphomimetic versions of RIOK2, observing slowed cellular proliferation, decreases in global translation, slight pre-rRNA processing abnormalities, but not changes in overall mature 18S rRNA levels. More specifically, the authors defined the inability of RIOK2 to be phosphorylated leads to defects in RIOK2 dissociation from the pre-40S ribosomal subunit in an in-vitro assay, and inability for it to be recycled for reuse in pre-ribosome export from the nucleus to the cytoplasm by immunofluorescence.

      Overall, the authors provide an interesting mechanism of MAPK regulation of a ribosome assembly factor RIOK2. However, they fail to provide the necessary reproducibility, controls, quantification, and consistent results between experiments to support their hypotheses.

      Major Comments:

      1. The northern blots reported throughout the manuscript are lacking proper reproducibility and quantification. First, the northern blots are lacking a loading control, which is necessary to report fold changes that are being measured across treatments. Please include a proper loading control (i.e. 7SL or U6 RNAs). Additionally, more rigorous analysis of the pre-rRNA precursor levels through ratio analysis of multiple precursors (RAMP) (Wang et al 2014) can be completed to provide a clearer depiction on which precursor(s) are accumulating. It is unclear for the Figure 1 northern blots if there were replicates completed and what the error bars represent in Figure 1B. Please report replicates, so that statistical analysis can be completed on the differences in precursor relative abundance. This need is emphasized by the small changes observed in pre-rRNA levels (less than 2 fold) between conditions.

      As mentioned above (Reviewer #1), we applied in the revised version I of the manuscript RAMP quantifications to all Northern blot data. These quantifications are shown as separate panels in the figures of the revised manuscript.

      Furthermore, we are planning to repeat the Northern blot experiments of Figure 1 to obtain biological replicates in other cell lines. We will probe the membranes to detect the 7SL RNA as a loading control in all these experiments. We will perform RAMP analyses on all these Northern blot experiments to provide more accurate quantifications of the pre-rRNA levels in the different conditions. These data will be included in the revised version II of the manuscript.

      1. The western blots reported throughout the manuscript are lacking proper reproducibility and quantification. For example, the western blots validating RSK1 and RSK2 depletion in Figure 1C lack a proper loading control. Additionally, it is unclear if there are replicates completed and there is lack of statistical analysis to determine if the changes are significant. Please include loading controls, replicates, and quantification of the western blots throughout the manuscript.

      We have included actin levels as loading controls in several figures (Figures 2D, 3A, 3C, 3E, 4C) of the revised version I of the manuscript. We also added phosphorylated Rps6 at Ser235/36 to monitor RSK activity in Figures 1A, 2D, 3A.

      We provided quantifications and associated statistical analyses of phosphorylation of RIOK2 presented in Figures 3A and 3C of the revised version I of the manuscript. We also included quantifications of the in vitro phosphorylation assays presented in Figures 3F and 3G.

      We are nevertheless planning to repeat and quantify more accurately the western blot experiments presented in Figures 2A, 2C and 3E of the revised version I of the manuscript. These data will be included in the revised version II of the manuscript.

      1. Please report the full bioinformatic analysis of the RSK substrate motif search among human AMFs including other AMFs found in this search. A sorted list format would be valuable for the reader to understand other potential RSK substrates involved in ribosome biogenesis.

      We understand the request of Reviewer #2. Providing the full list of AMFs identified in our bioinformatic screen would be valuable for the reader, mostly because it would make clearer that RSK seems to be regulating multiple stages of the pre-ribosome maturation pathway, therefore that RSK inhibition induces pleiotropic defects in ribosome synthesis. However, we are currently working on a more global study of the impact of MAPK regulation on the post-transcriptional steps of ribosome synthesis that we would like to publish in a near future.

      1. The authors report that RSK inhibition/depletion leads to accumulation of the 30S pre-rRNA, yet mutation of its target site on RIOK2 or RIOK2 depletion leads to an accumulation of the 18S-E pre-rRNA. Additionally, the phosphomimic mutation of RIOK2 leads to an accumulation of 30S, the opposite of the expected result. Please elaborate on this discrepancy in processing defects observed across experiments.

      In contrast to RIOK2 which is specifically involved in the late, cytoplasmic stages of the maturation of the pre-40S particles, RSK regulates ribosome biogenesis at multiple levels. Upon activation of the MAPK pathway, RSK activates Pol I transcription in the nucleoli and promotes translation of mRNAs encoding ribosomal proteins and AMFs. In addition, our bioinformatic screen identified several AMFs at different stages of the maturation pathway of both ribosomal subunits as potential targets of RSK. These considerations imply that RSK inhibition is expected to impact ribosome biogenesis at multiple levels (Pol I transcription, availability of RPs and AMFs, export of the pre-ribosomal particles, probably several maturation steps) whereas RIOK2 inactivation more specifically delays 18S-E processing in the cytoplasm. In terms of processing, RSK inhibition induces a significant accumulation of the 30S intermediate. This is another evidence that RSK regulates pre-rRNA processing at several stages. This phenotype might result, as recently described in yeast (Yerlikaya et al., 2016, MCB), from an inhibition of RPS6 phosphorylation which affects its early incorporation into pre-ribosomes, although this has not been demonstrated in human cells. This 30S precursor accumulation affects production of the downstream intermediates and we strongly believe that this precludes accumulation of 18S-E even if the activity of RIOK2 is affected. Given the broad implication of RSK at different stages of ribosome biogenesis, it is biologically relevant to observe that inactivation of RSK does not result in the same processing defects as inactivation of RIOK2.

      We nevertheless tried to make this point clearer in the present revised version I of the manuscript. We added in the supplementary material a diagram (Supplementary Fig. S1C) showing all the known and hypothetical targets of ERK and RSK in ribosome synthesis to provide the readers with a global view of the function of RSK in this process and refer to this figure in the introduction and results. In the introduction, we also emphasize more on the multiple aspects of the regulation of ribosome synthesis by ERK and RSK (Page 4, Line 18).

      Concerning the phospho-mimetic mutant, it does accumulate slightly the 45S and 30S intermediates contrary to the non-phosphorylatable mutant but this is not totally unexpected. RIOK2 is incorporated into pre-ribosomes in the nucleus, at a stage that remains unclear, and constitutive RIOK2 phosphorylation may interfere with this recruitment and affect processing at an earlier stage. This point has been addressed in the discussion of the revised version I of the manuscript (Page 18, Line 7).

      Are there similar results for RSK depletion/inhibition and RIOK2 release from the pre-40S and inability to import into the nucleus? If so, this could provide phenotypic consistency between these two proteins in the proposed pathway to further support the hypothesis.

      We performed the same experiments as reported in Figure 6C to try to demonstrate a cytoplasmic retention of RIOK2 after leptomycin B treatment upon ERK inhibition (PD treatment). We also performed IF and cell fractionation experiments upon PD treatment. In all cases, we failed to observe the expected result. We strongly believe that we are facing here the same problem as described above for the previous comment of Reviewer #2. ERK and thus RSK inhibition leads to accumulation of the early, nucleolar 30S intermediate, indicating that the processing pathway is significantly blocked at an early stage preceding formation of the pre-40S particles in which RIOK2 is recruited. This early blockage most likely explains why we do not see the same phenotypes. We discussed this comment in the discussion section of the revised version I of the manuscript (Page 18, Line 19).

      1. Mature levels of 18S rRNA are not altered in the RIOK2 mutant cell lines. This could be due to compensation in these mutant cell lines since RIOK2 is essential.

      We agree with Reviewer #2 that compensation mechanisms may operate to restore mature 18S rRNA levels despite RIOK2 mutation. On the other hand, although RIOK2 is indeed essential, we may expect that the point mutation of S483 only partially affects RIOK2 function and delays the maturation of pre-40S particles but not to a sufficient extent to impact the mature 18S rRNA levels. This has been observed by others (Montellese et al., 2017, NAR; Srivastava et al., 2010, MCB).

      We added this point in the discussion section of the revised version I of the manuscript (Page 19, Line 9).

      Please report the mature 18S rRNA levels upon shRNA depletion and RSK inhibitors to provide insight into if this pathway significantly alters mature 18S rRNAs as a mechanism for the altered translation and proliferation observed.

      We will probe the levels of the mature 18S and 28S rRNAs in these experiments and the results will be included in Figure 1 of the revised version II of the manuscript.

      Minor Comments:

      1. Figure 1A lower: The authors use an RSK inhibitor LJH685, that does not inhibit RSK phosphorylation S380. Therefore, another verification of RSK inhibition must be used besides RSK-pS380 abundance as for PD184352 inhibition. Please validate the usage of this RSK inhibitor in the experiments by inclusion of quantification of a direct downstream substrate of RSK, such as YB1-pS102 quantification.

      We agree with Reviewer #2. We have probed the membrane with anti-RPS6 and anti-phosho-RPS6 antibodies to show the effect of LJH treatment on RPS6 phosphorylation. These data have been added to Figure 1A in the revised version I of the manuscript and the text has been updated (Page 6, Line 16).

      1. Page 7, Lines 8-12: The authors state that RSK knockdown led to increases in the 45S, while the LJH685 treatment led to no changes in 45S levels due to differences in growth conditions. Please elaborate more on how growth conditions would alter 45S pre-rRNA levels. It would be expected that stimulation of the MAPK pathway would increase pre-rRNA transcription compared to steady state growth conditions. However, pre-rRNA processing northern blots are only measuring steady state levels of the precursors. Thus, an rDNA transcription assay would need to be completed to evaluate these differences.

      We do observe that PMA treatment of starved cells induces an increase in 45S precursor levels, consistent with an increase in transcription but we agree that northern blot experiments measure the steady-state levels of the intermediates.

      To address this comment, we propose to perform short pulse labelings with ortho-phosphate to assess synthesis of the 45S precursor independently of its processing in the different conditions. These data will be included in the revised version II of the manuscript.

      1. Figure 2C: Please quantify these results to properly evaluate the role of these two phosphorylation sites in MAPK signaling.

      We will repeat these experiments and quantify the results in the new version of Figure 2C.

      1. Please include the RIOK2 pS483 antibody generation methodology used in this study.

      We added this information in the Materials and Methods section of the revised version I of the manuscript (Page 21, Line 22).

      1. In vitro kinase assay methods: Is the recombinant RSK1 the human version of the protein? Please clarify in methods.

      Human recombinant RSK1 has been purchased from SignalChem. The information has been added in the revised version I of the manuscript (Page 30, Line 5).

      1. Figure 4B: Please include statistical analysis of the puromycin incorporation assay.

      We performed a statistical analysis of this assay out of 3 replicates. This analysis has been included in the present revised version I of the manuscript (Figure 4B).

      1. Page 13, Line 18: Please explain why RIOK2 co-IP with NOB1 is important.

      We added this explanation in the result section of the revised version I of the manuscript (Page 14, Line 3).

      1. In vitro dissociation assay: There is no control for pulldown of entire pre-40S particles and not just NOB1 protein. Thus, it is unclear if RIOK2 is dissociating from NOB1 or entire pre-40S particles. Please reference previous literature of the methodology of this experiment if applicable. Additionally, please include controls, such as western blotting of ribosomal proteins or northern blotting of rRNA in the pulldown fraction used.

      We agree with Reviewer #2. We have probed the membranes with antibodies detecting LTV1 and ribosomal protein RPS7 to show that the entire pre-40S particle is indeed pulled down. These additional data have been added in Figure 6A of the revised version I of the manuscript and the text has been amended accordingly (Page 14, Line 20).

      1. Page 16, Lines 10-12: The authors state "RSK facilitates the release of RIOK2 and other AMFs", however the only other AMF in this study was NOB1. Please reword appropriately that most likely facilitates release of RIOK2 and other AMFs in a RIOK2 dependent or independent manner if it also phosphorylates other AMFs which possess the motif.

      We agree with Reviewer #2 and we changed the text accordingly (Page 16, Line 11) but we did not introduce the hypothesis that RIOK2 may target directly other AMFs of late pre-40S particles which possess the motif because our in silico screen did not identify consensus RXRXXS/T motifs in any of these factors.

      Reviewer #2 (Significance (Required)):

      This manuscript is significant due to the lack of mechanistic connection of cellular signaling pathways to pre-rRNA processing. There have been, for the most part, no mechanistic connection of signaling pathways to pre-rRNA processing regulation and none for direct targets of MAPK signaling (Reviewed in Gaviraghi et al 2019). They provide the groundwork for analysis of MAPK signaling in regulation of an assembly factor and inclusion of their motif analysis could provide RSK signaling targets' regulation of specific steps of ribosome biogenesis that remain to be elucidated.

      Although the research delves into a specific mechanism, its audience could be far reaching as it is in the ribosome biogenesis field and MAPK signaling, which have broad implications in cancer and developmental diseases.

      Reviewer #3 (Evidence, reproducibility and clarity (Required)):

      The authors report that inhibition of MAPK signaling via RSK is associated with modest alterations in the relative abundance of human pre-rRNA species, that are most marked for 30S but also visible for 21S - although not clearly shown for 18S-E.

      RIOK2 has two closely spaced sites predicted as RSK targets, one of which was confirmed to be MAPK sensitive and shown to be an RSK substrate in vitro. Substitution of Ser483 with Ala was associated with reduced growth and 18S-E accumulation, consistent with impaired NOB1 cleavage activity. RIOK2-S483A also showed greater pre-ribosome association in vivo and consistent with this, more stable association in vitro and increase cytoplasmic residence. These effects are clear, although the data do not directly demonstrate their linkage to loss of RSK phosphorylation.

      The mutations were apparently generated directly in the genome of haploid cells, potentially raising concerns that the introduction of a deleterious mutation might have been accompanied by compensatory mutations elsewhere. However, three cells line gave similar results, mitigating this concern.

      Specific comments:

      1. To help the reader, the authors should directly discuss why they think the data on MAPK inhibition did not reveal a clearer pre-18S cleavage phenotype, as would have been expected for loss of RIOK2 activity.

      This comment is similar to major comment #4 of Reviewer #2.

      Please refer to the above response.

      1. Fig. S3: The degree of RSK depletion with the siRNAs appears very modest, as are the effects on RIOK2-P. Moreover, the double depletion is not clearly better than single depletions. These data should probably be supported by quantitation or withdrawn._

      We agree with Reviewer #3 that the effects shown in this figure are modest but we originally chose to show these data because their further supported the role of RSK in RIOK2 phosphorylation at S483 in complement to Figure 3.

      We have withdrawn this figure from the present revised version I of the manuscript.

      1. Fig. 5D: For 18S-E recovery with RIOK2, is the ratio adjusted for the increase in 18S-E abundance in the mutant - ie is recovery increased when adjusted for the increased pre-rRNA abundance?_

      In these experiments, the tagged versions of RIOK2 WT and S483A have been expressed ectopically from plasmids in cells expressing the endogenous wild-type protein. RIOK2 S483A does not behave as a dominant negative mutant in these conditions and does not induce 18S-E accumulation, as shown in the northern blot analysis of the 18S-E levels in the cell lysates (lower panel). This information is indicated in the revised version I of the manuscript (Page 13, Line 26).

      Reviewer #3 (Significance (Required)):

      Overall, the analyses on the phenotype of RIOK2-S483A, and the demonstration that this site is an RSK target, appear convincing.

      Caveats are

      1) the phenotype seen on inhibition of RSK, would not have implicated RIOK2 as the obvious candidate for the factor responsible for the observed processing defects;

      We agree with this comment, which has also been raised by Reviewer #2 (Major comment 4.). We provide several evidence in the manuscript that RSK phosphorylates RIOK2 on S483 in vivo and in vitro (Figure 3). However, as explained above in response to Reviewer #2, we cannot correlate the in vivo phenotypes resulting from RSK or RIOK2 inactivation for biological reasons. As mentioned in the introduction, RSK regulates multiple substrates at different stages of ribosome biogenesis (Translation of RPs and AMFs, Pol I transcription, pre-ribosome maturation and export), whereas RIOK2 is specifically implicated in the cytoplasmic maturation of pre-40S particles. Inactivation of RSK is therefore expected to induce pleiotropic defects in ribosome biogenesis, and in particular early defects (Reduced Pol I transcription, 30S precursor accumulation) that preclude observation of the expected phenotype linked to RIOK2 inactivation, i.e. 18S-E accumulation.

      We nevertheless tried to clarify this point as described in the response to Reviewer #2, major comment 4.

      2) the RIOK2-S483A phenotype is not demonstrated to be RSK dependent. This raises the possibility that, although RSK can phosphorylate S483, the effects of the mutation are not due to the loss of this modification.

      As mentioned by Reviewer #3, our data show that RSK can phosphorylate RIOK2 S483 in vitro and in vivo (Figure 3). We believe that Figure 4C strongly suggests that the accumulation of the 18S-E in cells expressing RIOK2 S483A mutant is due to the loss of S483 phosphorylation, since mutation of S483 to an aspartic acid (S483D), generally considered as a mutation mimicking a phosphorylated serine, does not affect 18S-E maturation. However, although our manuscript provides many lines of evidence identifying RSK as the kinase responsible for RIOK2 phosphorylation at S483, we cannot formally exclude that other AGC kinases involved in growth and proliferation, such as S6K or Akt, may also be involved redundantly or alternatively. Our data presented in Figure 3A showing that treatment of cells with the RSK inhibitors LJH decrease RIOK2 phosphorylation at S483 support a specific role of RSK.

      We developed this point in the discussion section (Page 18, from Line 25).

      With these provisos, the work is technically good and will be of considerable interest to the field. The post-transcriptional regulation of ribosome synthesis is increasingly recognized a significant topic.

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      There have been mechanistic connections of various signaling pathways to regulation ribosome biogenesis steps including rDNA transcription by RNA polymerase I and III, ribosomal protein transcription, and differential mRNA translation efficiency. However, there is a lacking mechanistic connection of signaling pathways to pre-rRNA processing and maturation steps of ribosome biogenesis. The authors set out to provide a specific example of a direct target of MAPK signaling, RSK that regulates pre-rRNA maturation through the phosphorylation of a ribosome assembly factor (RIOK2), offering for the first time providing mechanistic insight into MAPK regulation of pre-rRNA maturation.

      The authors observe slight pre-rRNA processing defects upon the use of RSK inhibitors and RSK depletion. They identified several candidate ribosome assembly and modification factors containing the canonical RSK substrate motif, including the RIOK2 kinase. Phosphorylation at this motif was verified to be specifically phosphorylated by RSK1 and 2 isoforms in cells and in an in-vitro kinase assay. The authors produced RIOK2 knock-in eHAP1 cell lines expressing non-phosphorylatable or phosphomimetic versions of RIOK2, observing slowed cellular proliferation, decreases in global translation, slight pre-rRNA processing abnormalities, but not changes in overall mature 18S rRNA levels. More specifically, the authors defined the inability of RIOK2 to be phosphorylated leads to defects in RIOK2 dissociation from the pre-40S ribosomal subunit in an in-vitro assay, and inability for it to be recycled for reuse in pre-ribosome export from the nucleus to the cytoplasm by immunofluorescence.

      Overall, the authors provide an interesting mechanism of MAPK regulation of a ribosome assembly factor RIOK2. However, they fail to provide the necessary reproducibility, controls, quantification, and consistent results between experiments to support their hypotheses.

      Major Comments:

      1.The northern blots reported throughout the manuscript are lacking proper reproducibility and quantification. First, the northern blots are lacking a loading control, which is necessary to report fold changes that are being measured across treatments. Please include a proper loading control (i.e. 7SL or U6 RNAs). Additionally, more rigorous analysis of the pre-rRNA precursor levels through ratio analysis of multiple precursors (RAMP) (Wang et al 2014) can be completed to provide a clearer depiction on which precursor(s) are accumulating. It is unclear for the Figure 1 northern blots if there were replicates completed and what the error bars represent in Figure 1B. Please report replicates, so that statistical analysis can be completed on the differences in precursor relative abundance. This need is emphasized by the small changes observed in pre-rRNA levels (less than 2 fold) between conditions.

      2.The western blots reported throughout the manuscript are lacking proper reproducibility and quantification. For example, the western blots validating RSK1 and RSK2 depletion in Figure 1C lack a proper loading control. Additionally, it is unclear if there are replicates completed and there is lack of statistical analysis to determine if the changes are significant. Please include loading controls, replicates, and quantification of the western blots throughout the manuscript.

      3.Please report the full bioinformatic analysis of the RSK substrate motif search among human AMFs including other AMFs found in this search. A sorted list format would be valuable for the reader to understand other potential RSK substrates involved in ribosome biogenesis.

      4.The authors report that RSK inhibition/depletion leads to accumulation of the 30S pre-rRNA, yet mutation of its target site on RIOK2 or RIOK2 depletion leads to an accumulation of the 18S-E pre-rRNA. Additionally, the phosphomimic mutation of RIOK2 leads to an accumulation of 30S, the opposite of the expected result. Please elaborate on this discrepancy in processing defects observed across experiments. Are there similar results for RSK depletion/inhibition and RIOK2 release from the pre-40S and inability to import into the nucleus? If so, this could provide phenotypic consistency between these two proteins in the proposed pathway to further support the hypothesis.

      5.Mature levels of 18S rRNA are not altered in the RIOK2 mutant cell lines. This could be due to compensation in these mutant cell lines since RIOK2 is essential. Please report the mature 18S rRNA levels upon shRNA depletion and RSK inhibitors to provide insight into if this pathway significantly alters mature 18S rRNAs as a mechanism for the altered translation and proliferation observed.

      Minor Comments:

      1.Figure 1A lower: The authors use an RSK inhibitor LJH685, that does not inhibit RSK phosphorylation S380. Therefore, another verification of RSK inhibition must be used besides RSK-pS380 abundance as for PD184352 inhibition. Please validate the usage of this RSK inhibitor in the experiments by inclusion of quantification of a direct downstream substrate of RSK, such as YB1-pS102 quantification.

      2.Page 7, Lines 8-12: The authors state that RSK knockdown led to increases in the 45S, while the LJH685 treatment led to no changes in 45S levels due to differences in growth conditions. Please elaborate more on how growth conditions would alter 45S pre-rRNA levels. It would be expected that stimulation of the MAPK pathway would increase pre-rRNA transcription compared to steady state growth conditions. However, pre-rRNA processing northern blots are only measuring steady state levels of the precursors. Thus, an rDNA transcription assay would need to be completed to evaluate these differences.

      3.Figure 2C: Please quantify these results to properly evaluate the role of these two phosphorylation sites in MAPK signaling.

      4.Please include the RIOK2 pS483 antibody generation methodology used in this study.

      5.In vitro kinase assay methods: Is the recombinant RSK1 the human version of the protein? Please clarify in methods.

      6.Figure 4B: Please include statistical analysis of the puromycin incorporation assay.

      7.Page 13, Line 18: Please explain why RIOK2 co-IP with NOB1 is important.

      8.In vitro dissociation assay: There is no control for pulldown of entire pre-40S particles and not just NOB1 protein. Thus, it is unclear if RIOK2 is dissociating from NOB1 or entire pre-40S particles. Please reference previous literature of the methodology of this experiment if applicable. Additionally, please include controls, such as western blotting of ribosomal proteins or northern blotting of rRNA in the pulldown fraction used.

      9.Page 16, Lines 10-12: The authors state "RSK facilitates the release of RIOK2 and other AMFs", however the only other AMF in this study was NOB1. Please reword appropriately that most likely facilitates release of RIOK2 and other AMFs in a RIOK2 dependent or independent manner if it also phosphorylates other AMFs which possess the motif.

      Significance:

      This manuscript is significant due to the lack of mechanistic connection of cellular signaling pathways to pre-rRNA processing. There have been, for the most part, no mechanistic connection of signaling pathways to pre-rRNA processing regulation and none for direct targets of MAPK signaling (Reviewed in Gaviraghi et al 2019). They provide the groundwork for analysis of MAPK signaling in regulation of an assembly factor and inclusion of their motif analysis could provide RSK signaling targets' regulation of specific steps of ribosome biogenesis that remain to be elucidated.

      Although the research delves into a specific mechanism, its audience could be far reaching as it is in the ribosome biogenesis field and MAPK signaling, which have broad implications in cancer and developmental diseases.

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      The authors report that inhibition of MAPK signaling via RSK is associated with modest alterations in the relative abundance of human pre-rRNA species, that are most marked for 30S but also visible for 21S - although not clearly shown for 18S-E.

      RIOK2 has two closely spaced sites predicted as RSK targets, one of which was confirmed to be MAPK sensitive and shown to be an RSK substrate in vitro. Substitution of Ser483 with Ala was associated with reduced growth and 18S-E accumulation, consistent with impaired NOB1 cleavage activity. RIOK2-S483A also showed greater pre-ribosome association in vivo and consistent with this, more stable association in vitro and increase cytoplasmic residence. These effects are clear, although the data do not directly demonstrate their linkage to loss of RSK phosphorylation.

      The mutations were apparently generated directly in the genome of haploid cells, potentially raising concerns that the introduction of a deleterious mutation might have been accompanied by compensatory mutations elsewhere. However, three cells line gave similar results, mitigating this concern.

      Specific comments:

      1.To help the reader, the authors should directly discuss why they think the data on MAPK inhibition did not reveal a clearer pre-18S cleavage phenotype, as would have been expected for loss of RIOK2 activity.

      2.Fig. S3: The degree of RSK depletion with the siRNAs appears very modest, as are the effects on RIOK2-P. Moreover, the double depletion is not clearly better than single depletions. These data should probably be supported by quantitation or withdrawn.

      3.Fig. 5D: For 18S-E recovery with RIOK2, is the ratio adjusted for the increase in 18S-E abundance in the mutant - ie is recovery increased when adjusted for the increased pre-rRNA abundance?

      Significance

      Overall, the analyses on the phenotype of RIOK2-S483A, and the demonstration that this site is an RSK target, appear convincing.

      Caveats are

      1)the phenotype seen on inhibition of RSK, would not have implicated RIOK2 as the obvious candidate for the factor responsible for the observed processing defects;

      2)the RIOK2-S483A phenotype is not demonstrated to be RSK dependent. This raises the possibility that, although RSK can phosphorylate S483, the effects of the mutation are not due to the loss of this modification.

      With these provisos, the work is technically good and will be of considerable interest to the field. The post-transcriptional regulation of ribosome synthesis is increasingly recognized a significant topic.

    4. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      The manuscript addresses an important topic, the posttranscriptional maturation of ribosomes. This topic is inherently interesting because we normally think of ribosome biogenesis as a sequential series of steps that automatically proceeds and cannot be "accelerated" in physiological conditions, but only "delayed" in the presence of genetic mutations. In short, the manuscript proposes that RIOK2 phosphorylation by the action of RSK, below the Ras/MAPK pathway promotes the synthesis of the human small ribosomal subunit.

      I honestly admit that I have some difficulties in reviewing this manuscript. The quality of the presented data is, in generally, good. However, overall I find the whole manuscript preliminary and I am not much convinced of the conclusions. Several aspects are superficially analyzed. In short, I think that most of the conclusions are not fully supported by the data because shortcuts are present. A list of all the aspects that I found wrong are listed.

      Biological issue

      1. The authors claim that the effects of the inhibition of the maturation of ribosomes by acting on a pathway upstream of RIOk2 are limited to the 40S subunit. This is far from being a trivial point, for the following reason. RIOK2 is known to affect the maturation of 40S ribosomes. Hence, the fact that using an upstream inhibitor of the MAPK pathway such as PD does not inhibit 60S processing in reality would argue against a biologically relevant control in ribosome maturation (of the MAPK patheay). Have the authors considered this? In a way, also, given the fact that the mutants confirm a role in 18S final maturation, it is a bit complex to put all the data in a clear biological context.

      A number of specific issues will be concisely described.

      Manuscript very well written. Data do not always support the strong conclusions. Low magnitude of the observed effects.

      In introduction the authors make a general claim that ribosome biogenesis is one of the most energetically demanding cellular activities. This statement lingers in the literature since 15 years but in reality it has never been formally proved for mammalian cells, and certainly not for HEK293 cells. The original statement, to my knowledge, can be traced by some obscure statement referred to the yeast case and then repeated as a truth. In conclusion, beside being a very banal observation, it should be referenced.

      Growth factors, energy status are not cues but are proteins or metabolites (introduction). Authors write about mTOR without making statements on mTORC1/2. This is very obsolete. Also I am not sure that the choice of Geyer et al., 1982, and subsequent papers makes much sense. At the very minimum TOP mRNA concepts and mTORC1 must be defined.

      The authors claim that heir work fills a major gap between known functions of MAPK and cytoplasmic translation. I would not be so sure about it.

      Results. Authors start with a major mistake, i.e. that PMA selectively stimulates the MAPK pathway. Perhaps it stimulates, certainly it does not do it selectively.

      RIOK2 phosphosites are first found by bioinformatics analysis. It should be noted that the predicted phosphosite (S483) is found only in a limited set of datasets from MS databases. The actual importance of this site would not emerge from unbiased studies. Also, there are many other phosphosites that were not analyzed in this study.

      Throughout the paper the authors use the word strongly, significantly, but the actual effects seem in general quite marginal.

      Discussion. The authors claim that they provide solid evidence on MAPK signalling to ribosome maturation. At the very best this is circumstantial evidence for the 40S maturation.

      Figure 1. Unclear why LJH should increase P-ERK. General lack of quantitation (sd, replicates, bars). Experiment done only on a single cell line in a single experimental setup. Very different effects on 21S by LJH,PMA and siRNA for RIOK2. Overall the message given by the authors is to me mysterious.

      Figure 2. Several red flags. For instance in 2C the loaded levels of RIOK2-HA loaded are clearly less than the ones of the other genotypes, hence the conclusion on P-RIOK2 is not convincing. Staining with anti-P RIOK2 lacks controls, how can be sure that the signal is due to the phosphate? Phosphatase treatment? Why FBS does not lead to ERK staining in HEK293? There are plenty of growth factors in FBS that should lead to ERK phosphorylation. I do not understand this experiment.

      Figure 3. In vitro phosphorylation, if I understood, it relies on a truncated version of RIOK2. Why? Is the folding of the full length protein not permissive to in vitro phosphorylation? HA-RSK3 is less?

      Figure 4. Immunofluorescence is low mag, difficult to understand. I really like the experiments with RIOK2 mutants, however I wonder what about protein levels after the knock-in? Given the 18S phenotype overlap between the phenotype of the RIOK2 loss of function with the S483A, testing protein level becomes of the utmost importance.

      Figure 5. Low quality IFL. Hard to think that histogram quantitation of nuclear versus cytoplasmic staining are reliable in the absence of fractionation, better quantitation, experiment done in other cell lines and so on. However, very beautiful Fig. 5E perhaps the best of the paper shows also mobility shift driven by S483, thus supporting posttranslational modifications.

      Fig. 6. IFL studies are really impossible to interpret. The effects on RIOK2 release (this figure) and 18S maturation (Fig. 5) are very clear and of great quality. Overall conclusions. The manuscript tends to overinflate the meaning of several experiments. What to me is very clear and interesting is that the the authors provide clear evidence that S483A mutants have a defect in 40S maturation. Whether this is due to MAPK signalling, is only circumstantial. I would suggest to build up on the strong findings and eliminate ambiguous data.

      Significance

      The paper deals with an important topic, namely whether a regulation of ribosome maturation exists, and how it is mechanistically regulated. In this context, the analysis of the ERK pathway is highly needed considered that most works deal with effects of the PI3K-mTOR pathway, and the parallel, yet important RAS-ERK pathway, is less understood. As a final note, we should consider that S6K downstream of mTOR, and ribosomal S6K, downstream of ERK have been considered to share some substrates.

      The manuscript is interesting, but several statements given by the authors are rather superficial. An example, listed in the previous section, relates to the linguistic usage of mTOR kinase, instead of detailing whether we are dealing with mTORc1 or mTORc2. A second gross mistake is the definition of PMA as a stimulator of the ERK pathway. If this is certainly true, this is historically not correct as seminal papers by the group of Parker define this drug as a stimulator of conventional PKC kinases. In short, this paper is a step back in knowledge from the perspective of the literature context.

      All people interested to the crosstalk between ribosome maturation and signaling pathways will be certainly read this manuscript.

      My expertise is within the ribosome biology and signalling field.

    1. Reviewer #3:

      This is an interesting study in which the authors compare Primacy and Recency weighting models' ability to predict momentary mood assessments during a well-established gambling task. They do so across a range of conditions:

      i) random/structured/structured-adaptive reward environments

      ii) different age groups

      iii) in healthy versus depressed participants They also perform the same task in fMRI. They find that the Primacy model wins in most cases, and relates more strongly to brain activations in fMRI.

      The paper is very clearly written and easy to read and understand. The conclusions are striking, given the greater dominance of recency-based models in the literature (e.g. Kahneman's peak-end heuristic). I do however have some major concerns with some aspects of the modelling and task design: I'm not sure if they are addressable or not. In summary, they are:

      i) the comparison of Primacy and Recency models doesn't seem fair to me, as the models also differ according to whether the E term is based on previous expectations or previous outcomes. How can the authors conclude that primacy/recency is the key feature of the winning model?

      ii) The structured and structured-adaptive versions of the task seem to me to have potential biases against the Recency model due to confounding effects: these other effects must be excluded for the conclusions to be robust.

      The following describes these and other concerns in more detail:

      Methods:

      The modelling seems to me to be problematic as a contrast between primacy and recency because the Primacy and Recency models differ in more than one respect: not just weighting of previous events (presented as the "critical difference between the two models" on p6), but also whether those events are expectations (in the Recency model) or outcomes (in the Primacy model). If the authors want to conclusively establish that Primacy is a better model than Recency then surely more models ought to be compared, at very least using a 2x2 design with primacy/recency of expectations/outcomes? This is also an issue for the fMRI analysis: it is hard to conclude much about the models from the fact that the Primacy model E beta (but not the Recency model E beta) correlates with a BOLD cluster when the Recency model E term is based on previous expectations, not previous outcomes. Likewise with the direct comparison of the models' voxel-wise correlation images.

      There also seems to be an error in Figure 1's Equation (1): presumably this just refers to the Primacy model's E term and not the Recency model's E term? Both should be shown for clarity. Also Equation (6) does not look like Equation (1) - is Equation (6) incorrect? In which case what is the R term supposed to look like in Equation (6) - is it also subject to primacy weighting or not? Also in the Discussion, the authors say the Primacy model maintained the overall exponential discounting of the E term. I might misunderstand but this seems a bit misleading because the discounting is by γ^(t-j) in one model but γ^k in the other?

      The authors also comment that the Primacy model performed better "when we did not distinguish between gambling and non-gambling trials, which was another divergence from the standard Recency model". But as I understand it, the standard Recency model was originally designed such that the certain option C was NOT the average of the two gambles, so C was required in the model (at least in the 2014 PNAS paper). Here, C is the average of the gambles, so presumably it would be identical to E in the Recency model, and therefore be extraneous in the Recency model as well as the Primacy model - did the authors do model comparison to see if it could be eliminated from the Recency model? If so, this is not another difference between the models after all. Apologies if I have misunderstood something...

      I might be misunderstanding the fitting approach here but it sounds like the leave-out sample validation is done to optimise the hyperparameters, not the parameters? In which case there is no complexity penalty to reduce overfitting in the plain MSE measure? I appreciate this is less of an issue if models have the same number of parameters...

      Results:

      The authors state that the Primacy model does best in the Random condition but this is not what is stated in Table S1, where its MSE is higher, not lower (0.006 vs 0.0008)?

      A major issue with the task structures as they stand is that the structured and structured-adaptive tasks seem to have some potential problems when it comes to assessing their impact on mood ratings:

      i) the valence of the blocks was not randomised, meaning that the results could be confounded by valence. E.g., what if negative RPE effects are longer-lasting than positive RPE effects? This seems plausible given the downward trend in mood in the random environment despite an average RPE of zero. This could also explain the pattern of mood in the other two tasks, rather than primacy?

      ii) issues of scale: if there is a non-linear relationship between cumulative RPE and mood, such that greater and greater RPEs are required to lift/decrease mood by the same amounts, then this will resemble a primacy effect? This is unlikely to be an issue in the random task but may well be a problem in the structured and certainly in the structured-adaptive tasks?

      iii) issues of individual differences in responsiveness to RPE: in the structured-adaptive task, some subjects' mood ratings may be very sensitive to RPE, and others very insensitive. One might expect that given the control algorithm has a target mood, the former group would reach this target fairly soon and then have trials without RPE, and the latter group would not reach the target despite ever increasing RPEs. In both cases the Primacy model would presumably win, due to sensitivity to outcomes in the first half or insensitivity to bigger outcomes in the second half respectively? Can these possibilities be excluded using model comparison methods?

      These issues are a concern because the plain MSE is not an ideal model comparison method, and the Streaming Prediction MSE is equivocal between the Primacy and Recency models in the Random environment - the only environment which seems unbiased towards the models (given the adolescent sample was also Structured-Adaptive).

    2. Reviewer #2:

      In this paper the authors report data from a series of online and one neuroimaging study in which participants played a simple game in which they had to select between a sure outcome and a gamble. Participants reported their current mood throughout the game and the authors compared the performance of a number of models of how the mood ratings were generated. They focus on two models, a standard model which assumes that participants' expectations assume a 50:50 gamble and an adapted model that uses average experienced outcomes as the expected value. They frame these models in terms of recency vs. past weighting and suggest that the results provide evidence in favour of a higher weight of earlier events on reported mood.

      The question of how humans combine experienced events into reported mood is topical. This paper takes an interesting approach to this issue.

      I struggled a bit to understand the logic of some of the arguments in the paper, in part because important experimental and methodological detail is missing. I list my points below. The overriding question is, I think, how certain we can be that the results reported by the authors reflect a true primacy effect, as opposed to some other process (e.g. just learning an expected value) that appears in this case to be a primacy effect.

      1) I didn't really understand where the weights from the primacy graph in Figure 1B came from. The recency weights make sense-there is a discount factor in the model that is less than 1, so there is an exponential discount of more distant past events. However, for the primacy model the expectation is calculated as the mean (apparently arithmetic mean) of previous outcomes (which suggests a flat weight across previous trials) and the discount factor remains-so how does this generate the decreasing pattern of weights? It would be really useful if the authors could spell this out.

      2) The models seem to differ in terms of whether they learn about the expected value of the gamble outcomes or whether they assume a 50:50 gamble (the recency model assumes this, the primacy model generates an average of all experienced outcomes). Might the benefit of the primacy model when explaining human behaviour simply be that people use experienced outcomes to generate their expectations rather than taking stated outcome probabilities as absolutes? In other words, it is not so much that people place more weight on earlier events, but that they learn.

      3) Linked to the above, the structured and adaptive environments seem to have something to learn (blocks with positive vs. negative RPEs), so it is perhaps not surprising that humans show evidence of learning here and a model with some learning outperforms one with none. The description of these environments isn't really sufficient at present-please explain how RPEs were manipulated (was it changing the probability of win/loss outcomes, if so, how? Or was it changing the magnitude of the options? For the adaptive design was the change deterministic? So was the outcome, and thus RPE, always positive if mood was low, or was this probabilistic and if so with what probability?). Also, did the recency model still estimate its expectations here as 50:50, even when (if) this was not the case? If so, can the authors justify this?

      4) What were participants told about the gambles (i.e. were they told they were 50:50, including in structured/adaptive environments)?

      5) Please report the estimated parameter values of the models (and tell us where the common parameters differed between models). This would help in understanding how they are behaving.

      6) In addition to changing the expectation term of the recency model, the primacy model also drops the term of for the sure outcomes (because this improves the performance of the primacy model). Does this account for the relative advantage of the primacy over the recency model? i.e. if the sure outcome term is dropped from the recency model, does the primacy model still perform better?

    3. Reviewer #1:

      Keren and co. presents a very interesting study whose goal is to determine what are the determinants of subjective mood rating. They correctly identify as the "baseline" model the model proposed by Rutledge et al. where a big determinant of mood seems to be the reward prediction error (Recency model) and they contrast it with a Primacy model, where first events (not late events) play a more important role.

      They validate the model across different behavioural datasets, involving (supposedly) healthy subjects, teenagers and depressive patients. They also have a fMRI experiment and found that the weights of the Primacy model (and not the weights of the Recency model) correlate across subjects with prefrontal activity.

      Overall I think this paper addresses an important question and presents an impressive amount of data. However, I do believe that there are some important checks to be made both concerning the computational and the fMRI analyses.

      Concerning model comparison, I would like the authors to show us whether or not their model selection criteria allows us to correctly recover the true generative model in simulated datasets. Are we sure that the model selection criteria are unbiased toward the two models?

      Equally important: can the authors provide at the group level a qualitative signature of mood data that falsify the Recency model (see Palminteri, Wyart and Koechlin. 2017). They do so in Figure S2 for one subject, but it would be important to show the same (or similar) result at the group level. This should be easier in the structured or in the structured-adaptive conditions.

      Concerning neuroimaging, if I am not missing something, the results they present in the main texte is the results of a second level ANCOVA, where the individual weights of the Primacy model are shown to correlate with activity in the prefrontal cortex. Similar analyses using the weights of Recency model do not produce significant results at the chosen threshold. This analysis is problematic for two reasons. First, absence of evidence does not imply evidence of absence. Second, to really validate the model the authors should show that the trial-by-trial correlates of expectations and prediction errors are consistent with the Primacy and not the recency model. Can the authors show that the Primacy regressors explain better trial-by-trial neural activity compared to the competing model? They could do so formally by estimating the model using the Baysian toolbox usually used to compare DCM models.

      Also concernant neuroimaging, I would be important to verify that the authors replicate Rutledge et al's results and Vinckier et al's results (vmPFC, insula, striatum...). This will tell us if the studies are really comparable and would be informative regardless of the result.

    4. Preprint Review

      This preprint was reviewed using eLife’s Preprint Review service, which provides public peer reviews of manuscripts posted on bioRxiv for the benefit of the authors, readers, potential readers, and others interested in our assessment of the work. This review applies only to version 2 of the manuscript.

      Summary:

      This is a very interesting study whose goal is to determine what drives subjective mood over time during a reward-based decision making task. The authors report data from a series of online studies and one performed with fMRI. Participants played a well-established gambling task during which they had to select between a sure outcome and a 50:50 gamble, reporting momentary mood assessments throughout the game. The authors compared the performance of a number of models of how the mood ratings were generated.

      The authors identify as their "baseline" model that proposed by Rutledge and colleagues, in which an important determinant of mood seems to be the reward prediction error: the authors call this Recency model. They contrast it with a Primacy model, where earlier events (in this case, average experienced outcomes) play a more important role. They validate the model across different behavioural conditions, involving healthy subjects, teenagers and depressive patients. The conclusion is that the data are more consistent with their Primacy model, in other words a higher weight of earlier events on reported mood. In the fMRI experiment they found that the weights of the Primacy model correlated with prefrontal activation across subjects, while this was not the case for the Recency model.

      The paper is clearly written and easy to understand. The question of how humans combine experienced events into reported mood is topical and the conclusions are striking, given the dominance of recency-based models in the literature (e.g., Kahneman's peak-end heuristic). The paper takes an interesting approach and presents an impressive amount of data.

      However, at some points the arguments seemed a considerable stretch, in part because important experimental and methodological detail is missing, and in part because the analyses do not currently consider a number of potential confounds in both the models and the task design. Ultimately, these concerns come down to whether we can be certain that the results reflect a true primacy effect, as opposed to some other process that simply appears at face value to be a primacy effect. To this end, some important checks need to be made concerning both the computational and the fMRI analyses, as detailed below. These do require substantial extra modelling work, and it is quite possible that the conclusions will not survive these control analyses.

    1. Reviewer #3:

      This is an interesting paper examining the role of electric fields as a tissue damage signal for epithelial cells in vivo. Previous work had indicated the presence of electric fields in wounded tissues. But whether these phenomena play a role in early wound detection by epithelial cells has been unclear. The authors use live imaging in zebrafish to track the behaviour of epithelial cells in response to wounds. Imaging of actin dynamics was used as a readout for directional sensing in these cells. The authors show that directional sensing depends on the local concentration of specific electrolytes and that application of external electric fields can stimulate directional migration. These major conclusions are interesting and well supported. Although this is not the first time that electric fields are suggested to play a role, the study offers valuable direct evidence, in vivo evidence, and introduces a new system in which the mechanisms can be studied further.

      Main comment:

      The study is focused on establishing whether electric fields play a role in wound sensing and does not touch on how these effects are mediated. The experiments were designed to distinguish osmotic from electric effects, establish whether the effects are global or local and assess the direct effects of electric fields on epithelial cell motion. These are significant and do not appear trivial. Nevertheless, some insight, even in the form of discussion, into how these effects might be sensed by epithelial cells seemed to be lacking. At the minimum, the authors could provide ideas based on the literature. Ideally, the study would include an analysis of cytoskeletal rearrangements and calcium dynamics in response to electric fields or alterations of electrolytes for completion. The authors introduce these key readouts of epithelial signalling, but they did not make full use of these in their functional assays. Depending on whether electric fields influence the calcium wave, different mechanistic hypotheses can be made for future studies.

    2. Reviewer #2:

      I enjoyed the manuscript. Driving cell movement and even overriding wound migrational cues with an electric field is very interesting. My principal concern is that it appears the manuscript has been written in a way to downplay the previous findings in this field. I am no expert on the effects of electric fields on wound healing and chemotaxis, but a cursory look at the literature shows that that lot has been published in this arena. It appears that most if not all of the findings in this manuscript have been seen before in other contexts.

      The zebrafish offers a great set of tools to interrogate electric fields on chemotaxis and wound healing. I am simply asking for a bit of clarity with respect to the history of electrical fields, cell chemotaxis and wound healing. The authors need to provide more context for their work in the introduction with respect to electrical fields and more clearly describe what has been done before. In addition, the authors need to make additions to the conclusion that clearly define what is novel in their findings and how it relates to previous studies of electric fields and cell chemotaxis.

    3. Reviewer #1:

      This manuscript by Kennard and Theriot reports that electrical cues guide skin cells directional migration in response to injury. The authors bring molecular tools and analysis to study environmental cues, like osmolarity and electric fields in vivo. The effects of electrical cues are most studied in vitro. The in vivo model, the vivo approaches with molecular and imaging techniques bring bioelectricity research closer to mainstream techniques. Demonstrating the direct effect of electrical effects independent of osmolarity represent a significant step in this field. The results demonstrating the effects of NaCl, but not quite a few osmolarity control are impressive.

      I have the following questions and suggestions, which I do not expect the authors to address with new experiments, because as with other pioneering research, this manuscript suggests more research questions/directions on the basis that it answers some very important questions. I believe perhaps the authors already have some results to some of those questions.

      1) Good reason for choosing laceration over transection is given. I am a bit puzzled if the EFs and osmolarity are the mechanisms, why were there such differences? The endogenous EFs and osmolarity would be expected to be the same in both the laceration and transection models. Could the laceration stretch the tissue during injury procedure, so the marked increased migration was present in the laceration model? The stretch could activate stretch activated channels, stimulate cells, and realign matrix.

      2) It is not clear what relationship can be established between GCaMP6f response and migration speed (Fig.1E, G, H). inhibition of the calcium response may help to test the relationship.

      3) The local concentration of NaCl showed remarkable inhibitory effects on cell migration, and cell volume. As we know injury may activate channels and pumps, which then facilitate the ionic fluxes, thus generate persistent ionic currents. Channel and pump inhibition experiments could quickly point to some molecular basis of the involvement of NaCl.

      4) I consider using Iso KCl is very interesting, because high K+ would significantly modulate cell membrane potential, however the effect on cell migration is very similar to those of Iso Choline Cl, iso NaGlunate, Iso Sorbitol. This would provide another side evidence for the role of wound electric fields in cell migration.

      5) 200V DC is much higher than endogenous EFs expected in such a model. Caution should be given when interpreting the results. I also wonder whether the authors attempted experiments (Fig. 4B, C) using wounded animals, perhaps the tissues after injury are not technically plausible (too fragmented) for such experiments.

      6) One assumption in the paper is the TEP and wound EFs in vivo. Glass microelectrodes may be able to verify those in space and time. If this works (the TEP and wound EFs can be mapped), the effects of various treatments can be tested and exclude other possibilities.

    4. Preprint Review

      This preprint was reviewed using eLife’s Preprint Review service, which provides public peer reviews of manuscripts posted on bioRxiv for the benefit of the authors, readers, potential readers, and others interested in our assessment of the work. This review applies only to version 1 of the manuscript.

      Summary:

      This paper examines the role of electric fields as a damage signal for epithelial cell wounding using a zebrafish tail laceration in vivo model. While electrical fields had been previously noted in vitro, whether they played a role in early wound detection by epithelial cells has been unclear. They tracked the ability of epithelial cells to sense direction by imaging actin dynamics in zebrafish epidermis. From these studies, they find that directional sensing depends on the local concentration of specific electrolytes. Additionally, external electric fields can independently stimulate directional migration.

    1. Reviewer #3:

      The goal of this manuscript “to develop predictive tools for inferring fitness trajectories in new environments” is an important goal and I appreciate the synthesis of theoretical modeling with parameter estimation from empirical mutation studies.

      Reading through the manuscript, however, I found myself repeatedly wondering whether the stated application of the methods developed here doesn't constitute something of a tautology. This could be a misreading on my end, but I'll explain: the authors state that they have the central goal of predicting whether a population adapting to one environment will lose fitness in another "non-home" environment. Yet the parameter estimation they develop and propose for estimating fitness trajectories requires fitness measurements in both the home and non-home environments. If one already has fitness measurements for both home and non-home, how much more information is added by estimating the JDFE? I understand that the authors are estimating the fitness trajectories over time, with the incorporation of population genetic parameters, but again, I was unsure of how much information was added with the JDFE particularly given large discrepancies in the Wright-Fisher models and the decreasing predictive capacity with time. The bottom row of Figure 1 provided perhaps the most convincing evidence of the usefulness of the JDFE, but the unintuitive result was not adequately explored nor explained (see comment below). Also, perhaps an exploration of how the predictions could be extended to unmeasured environments is possible (as in Kinsler et al 2020)?

      Further specific conceptual comments and suggestions:

      1) The authors demonstrate in Figure 1 that JDFEs even with similar shapes produce markedly different fitness trajectories. They argue that the correlation coefficient of the JDFE is not a reliable predictor of fitness trajectories in the home environment. I was struck by this counterintuitive result, and found myself searching for further explanation. Are the authors arguing that the practice of simply looking at the correlation coefficient in tradeoff studies in general is insufficient for predicting the fates of pleiotropic mutations? Either way, it would be helpful to the reader to elaborate on why and under which conditions the discrepancy with the correlation coefficient and fitness trajectories arises.

      2) The modeling results throughout the manuscript reveal poor predictive capabilities in Wright-Fisher simulations. For example, the results in figure 2 show substantial discrepancy between the theoretical predictions and the results of the Wright-Fisher simulations. The authors address this only briefly stating that outside of the strong selection, weak mutation model (SSWM) the pleiotropy statistics are only "statistical predictors". But the discrepancy was systematic and wide, suggesting rather little insight from the pleiotropy statistics in sequential adaptation scenarios. I could not find discussion of this discrepancy between the SSWM and Wright-Fisher modeling predictions.

    2. Reviewer #2:

      The authors present a theoretical framework for analysing pleiotropic effects in populations evolving in different environments based on the concept of a joint distribution of fitness effects (JDFE). Simple correlation measures are derived from the JDFE that allow one to predict the evolutionary outcome in the non-home environment. Analytic theory is derived in the SSWM regime and complemented by simulations covering the regime of large mutation supply. A proof-of-concept application to collateral antibiotic resistance and sensitivity in bacteria based on a published data set for knockout strains is presented. Overall, this is an important, systematic contribution to a very timely subject.

      Major Concerns:

      1) I do not quite share the authors' surprise at the outcomes shown in Figure 1. In fact there is a simple heuristic that allows one to predict the direction of the fitness change in the non-home environment in all cases: Simply look at the y-coordinate of the tail of the JDFE corresponding to the largest beneficial effects along the x-axis.

      2) Along the three rows of panels in Figure 2, there appears to be a systematic but in two cases non-monotonic variation of the slope with the mutation supply NU_b. Do the authors have a (tentative) explanation for this behavior?

    3. Reviewer #1:

      Ardell and Kryazhimskiy use bacterial TnSeq data in multiple conditions to study the structure of pleiotropy, that is the degree to which a genetic perturbation affects multiple phenotypes, and present a theoretical framework to predict and assess fitness trajectories observed in environments other than the one selection is operating in. The work is thoroughly done and has potentially interesting implications for sequential drug therapy.

      The central object of their framework is the joint distribution of fitness effects of mutations in multiple environments where the distribution is over all mutations in the genome. The dynamics in the space of fitness in multiple environments is then modeled as a random walk (described by a diffusion equation) assuming that mutations sweep separated in time (SSWM). The model and the calculations necessary to arrive at the predictions are simple and transparent. The results quantitatively predict simulation results with the range of validity of SSWM. Outside this range, the model predicts the qualitative behavior, but is quantitatively wrong.

      1) My main disappointment with the paper is the inability to quantitatively describe the dynamics outside the SSWM regime. I would expect that the effects of competing mutations or weak selection could be accounted for at least perturbatively. Alternatively, one could determine the distribution of the effects of fixed mutations in the "home" environment in simulations and use this distribution to predict the dynamics in other environments.

      2) My other substantial concern is the question whether anything can be learned about drug resistance evolution or collateral sensitivity/resistance from TnSeq experiments. While some drug resistance evolution involves loss-of-function mutations (e.g. porin losses), it often proceeds via point mutations, up-regulation, or horizontal acquisition. Furthermore, the statistical treatment here requires many mutations to sample the joint effect distribution to give reliable answers. In clinical resistance evolution, the number of mutations observed is often quite small and their effect distributions are wide. The practical relevance of this is therefore far from clear.

      3) While the similarity of this work to similar questions in quantitative genetics is discussed in the introduction, I would like to see an extended discussion to determine whether some limits of the model at hand can be described by the quantitative genetics approach.

    4. Preprint Review

      This preprint was reviewed using eLife’s Preprint Review service, which provides public peer reviews of manuscripts posted on bioRxiv for the benefit of the authors, readers, potential readers, and others interested in our assessment of the work. This review applies only to version 1 of the manuscript.

      Summary:

      The reviewers agreed that pleiotropy of mutations and the resulting adaptive trajectories across different environments are important topics that are both of theoretical and applied interest. Your theoretical framework predicts fitness trajectories observed in environments other than the one selection is operating in (home environment). These trajectories in non-Home environments are calculated via integrals over the joint fitness effect distribution weighted by the fixation probability in the home environment. However, your framework assumes strong selection and weak mutation (SSWM) and deviations from this assumption seem to have strong effects. We think that these effects need to be at least partially understood. Furthermore, application to the KO library is a useful proof-of-concept, but the practical relevance of these patterns for understanding collateral sensitivity/resistance is far from obvious. In summary, we felt that the manuscript needs to make more substantive theoretical advances and/or provide more robust actionable insights into drug resistance evolution.

    1. Reviewer #3:

      Mahfooz et al. employed FM4-64 to assay vesicle fusion of cultured mouse hippocampal synapses. They observed that the FM destaining time course deviates from a mono-exponential function during 1-Hz and 20-Hz trains. The deviation from mono-exponential kinetics was also seen during a second stimulus train applied after recovery periods of up to eight minutes. Destaining was faster after loading at low frequency (1Hz) compared to high frequency (20 Hz). The destaining time course during high-frequency stimulation was independent of the length of preceding low-frequency trains. Conversely, short high-frequency trains did not affect destaining kinetics during subsequent low-frequency stimulation. Finally, they probed destaining in Synapsin DKO cultures and found faster destaining during short high-frequency trains and long low-frequency trains. Based on these data, the authors conclude that slowly and quickly mobilized reserve vesicles are mobilized in parallel without intermixing.

      The paper addresses an interesting question - the relationship between the mobilization and the release of synaptic vesicles. Most data are solid. However, most major conclusions are not/only weakly supported by the data presented in the manuscript. A major limitation is that direct links between the FM data and a previously established 'modular' model of reserve vesicle mobilization are missing. The following points need to be addressed:

      1) The deviation from a mono-exponential destaining time course is a central observation of the study. The quantification is essentially based on comparing relative destaining during 2-min intervals. Mostly, this 'fractional destaining' is compared between the first and last two minutes of 1- or 20-Hz stimulation. This is not convincing. By eye, most destaining time courses actually look quite mono-exponential. The authors need to provide additional evidence for a deviation from mono-exponential kinetics. For instance, data could be approximated with a double-exponential function and considered double-exponential if the amplitude and time constant of the two components significantly differ from one another, and if each component contributes significantly to the overall amplitude. How large is the amplitude of the slow exponential component, and how slow is its time course? Is the overall contribution of the slow component significant? How do the amplitudes and kinetics of reserve mobilization compare to the ones of fast/reluctant release from the RRP?

      2) Correcting for rundown/bleaching in the absence of stimulation is key for concluding that the time course differs from a single exponential. According to Raja et al. (2019), rundown was corrected by subtracting a line fit to the data before stimulus onset. The authors need to record for longer periods in the absence of stimulation and subtract these data from the data obtained in the presence of stimulation. They could also compare the resulting time constant with the slow time constant during stimulation.

      According to the methods section, data were corrected for rundown. However, many time courses (Fig. 2A, C, 3A, 4...) display a decrease in fluorescence before stimulus onset. How exactly was the data corrected? Was this also done during the recovery periods? More details are needed to conclude on a potential slowing of FM destaining.

      3) The decrease in fractional destaining depends on the duration of 1-Hz stimulation (Fig. 6B, D). How specific are the results to 1-Hz stimulation for 15 minutes? The relationship between fractional destaining and stimulation frequency/duration needs to be investigated systematically.

      4) Data is mainly represented as averages of many preparations. Individual ROIs display vastly different destaining time courses (Figure 2D). How robust are the phenotypes at the level of individual preparations? I suggest plotting and fitting average data of individual preparations in addition to showing grand averages and box plots. Moreover, it would be helpful to show the data of all ROIs and the corresponding average for one representative preparation to get a sense of the variability.

      5) The authors claim that destaining during 20-Hz stimulation is largely independent of the duration of preceding 1-Hz trains (Figure 6). However, the time courses shown in figure 6C look different. Indeed, the destaining appears slower during 20-Hz stimulation following long 1-Hz trains, arguing against the modular model. The time courses/fractional destaining of the 20-Hz data shown in figure 6 should be quantified.

      6) Destaining was faster in Synapsin DKO cultures compared to WT for short 20-Hz trains (Fig. 8A), as well as long low-frequency trains (Fig. 9). The quantification of destaining during 20-Hz stimulation for 4 s, or 0.1/1-Hz trains for the first 4 min seem somewhat arbitrary. Is the difference by a factor of 1.5 between Synapsin DKO and WT also seen for other durations of short high-frequency trains depleting the RRP, or long low-frequency protocols?

      7) The authors claim that the destaining time courses are similar between Synapsin DKO and WT for longer 20-Hz trains (Fig 8B). However, the data shown in figure 8B indicate a difference. The destaining kinetics/fractional destaining should be also quantified for the 20-Hz trains for 100 s.

      8) The authors conclude that their data support a 'modular model', in which chains of synaptic vesicles are connected to release sites in parallel. Although this model is interesting, direct links between the FM data and the model are missing. For instance, direct links between vesicle chains, their replacement or length (Fig. 1) and the FM data are missing. I therefore suggest discussing the data in the context of the model at the end of the paper instead of starting the paper with a cartoon of the model. In general, the model, which is mainly based on previous data by the same group, should be less emphasized, and terms like "re-conceptualization" should be avoided.

      Additionally, the authors need to discuss other reasons that could explain a deviation from a mono-exponential time course. They claim to exclude potential contributions from long-term depression, because destaining is faster after 1-Hz compared to 20-Hz loading, but I don't find this convincing. How can they exclude contributions of other factors, such as pr depression (e.g. by presynaptic calcium channel inactivation; e.g. Xu and Wu, 2005), effects of endocytosis etc.? Could other aspects of the known Synapsin DKO phenotypes explain their data?

    2. Reviewer #2:

      This is an interesting study attempting to conceptualize the long-standing question of the mode of vesicle trafficking in presynaptic terminals. The authors used classical FM dye release experiments to support a hypothesis that rapidly and slowly releasing vesicles are mobilized in parallel without intermixing. The use of synapsin KOs effectively supports the authors' model. This modular model is also supported indirectly by the authors' recent findings of molecular links that connect a subset of vesicles in linear chains (published elsewhere). However, the scope of the model is limited by a number of caveats. The main concerns include a limited dataset measured in bulk from a highly heterogeneous synapse population, and a complex interrelationship between vesicle mobilization and FM dye de-staining kinetics. The second major limitation is measurements being performed at room temperature, which inhibits or alters a number of critical synaptic processes that are being modeled. This includes the efficiency of exo/endocytosis coupling, vesicle mobility and release site refractory period, which are stimulus- and temperature-dependent, but are not accounted for in the current model.

      Major Comments:

      1) The model lacks consideration of vesicle endocytosis efficiency. Hippocampal synapses can efficiently sustain release for at least 300APs at 35C (but not at 25C) at frequencies up to 10Hz (Fernandez-Alfonso and Ryan, 2006). Therefore a very rapid and efficient replenishment of the RRP is present at this synapse, particularly at 1Hz stimulation used in many experiments in the current study. The efficiency of endocytosis determines vesicle availability and thus release kinetics during stimulus trains; it is unclear how it is reflected in FM dye de-staining and the resulting model since the newly endocytosed and recycled vesicles are not labeled. Moreover the efficiency of exo-/endocytosis coupling is dramatically reduced at room temperatures (Fernandez-Alfonso and Ryan, 2006). It is also strongly calcium-/stimulus dependent (Leitz and Kavalali, 2011, 2014). These effects are not considered in the study, which is performed entirely at room temperature, thus greatly limiting interpretation of the results.

      2) Related to the above: authors point to lack of vesicle intermixing, a core hypothesis of the study, as being consistent with lack of vesicle mobility in previous studies. However, lack of vesicle mobility is simply an artifact of low recording temperatures (Gaffield and Betz 2007, Peng, Rotman et al. 2012); a majority of recycling synaptic vesicles are highly mobile at body temperatures (Westphal, Rizzoli et al. 2008, Kamin, Lauterbach et al. 2010, Lee, Jung et al. 2012, Park, Li et al. 2012).

      Thus intermixing might be limited or largely inhibited at room temperatures because of inefficient endocytosis or lack of vesicle mobility.

      These two considerations make it difficult to interpret the FM de-staining measurements at room temperature simply as a reflection of the mode of vesicle mobilization alone. The study would greatly benefit from more direct measurements of vesicle release, controls for endocytosis kinetics at different stimulus paradigms, and from the key measurements repeated at body temperatures.

      3) The bulk FM measurements used in the study represent an average of highly non- homogeneous population, which is not well represented by a Gaussian distribution. Indeed, the authors show a marked variability in FM de-staining among individual synapses. Extending the model to account for variability among individual synapses would greatly strengthen the conclusions.

      4) Release site refractory period (Neher, 2010) may vary among release sites and can make substantial contributions to FM release kinetics depending on stimulation frequency. This is not accounted for in the current model.

    3. Reviewer #1:

      In this manuscript, the authors show the data supporting two types of parallel reserve pool. The concept is original and interesting. However, at least for me, the manuscript is very difficult to follow because the main text and figure legend do not have sufficient explanation and sometimes it is difficult to understand what the figures tell us (what the axis means? for example). Therefore, after reading the ms several times, I cannot judge whether the data support the authors concept or not. In addition, I have the following issues, which may come from my lack of understanding as described above.

      1) Interpretation of FM data is not necessarily straightforward, because there are stained and non-stained vesicles. In addition, stained vesicles are converted into non-stained ones after exocytosis of synaptic vesicles. It will be easier to interpret the data if the authors show EPSC data or synaptopHluorin data, which only measured exocytosis, and compare the difference between FM data and others.

      2) Fig 3 is interesting because the data show the decrease of de-staining at the second stimulation by waiting a longer time, which is opposite to what people expect. However, the data may support the idea of mixing stained vesicles and non-stained vesicles with time perhaps in the same reserve pool. Figure 3 shows that dyes are completely lost after 20 Hz stimulation at the end of the protocol, which is against this idea. On the other side, Figure 2 shows residual fluorescence remaining after 20 Hz stimulation.

      3) Fig 4 is again interesting, because loading with 1 Hz stimulation may load the vesicle pool which is used for lower stimulation frequency. However, it is not known if 1 Hz stimulation triggers more exocytosis or less compared with 20 Hz stimulation. With high frequency stimulation, there may be AP failure, Ca current inactivation, less time for new vesicle recruitment. It could have been more informative to have additional data which directly shows this (see 1)

      4) Fig 7 is not really consistent with parallel vesicle pools because 1 Hz stimulation decreases the amounts of exocytosis of the following 20 Hz stimulation (compare A and B), although C shows the amounts of exocytosis are the same between A and B.

    4. Preprint Review

      This preprint was reviewed using eLife’s Preprint Review service, which provides public peer reviews of manuscripts posted on bioRxiv for the benefit of the authors, readers, potential readers, and others interested in our assessment of the work. This review applies only to version 1 of the manuscript.

      Summary:

      Overall, there was a strong enthusiasm for the topic of the study, and all the reviewers acknowledged the originality of the hypothesis being pursued. However, several technical issues and shortcomings have been raised, and as such, the present experiments fall short of compellingly supporting the conclusion of the study. These concerns have been detailed in the individual reviews below.

    1. Reviewer #3:

      This study by Haimson et al. aims at examining the diversity of dI2 interneurons and their role in coordinating activity across different regions of the spinal cord and in reporting back activity to the brain. The results show that dI2 interneurons comprise different sub-classes based on their axonal projections, soma diameter and transmitter identity. They also show that some dI2 interneurons project rostrally from the lumbar spinal cord and make putative synaptic contacts with other dI2 interneurons in the brachial spinal cord on their way to the cerebellum. Finally, it is shown that some dI2 interneurons receive putative inputs from DRG neurons and may serve to transmit movement-related feedback. An indiscriminate silencing of dI2 interneurons results in instability of locomotion. Overall, this study reports some interesting observations by showing the heterogeneity of dI2 interneurons and their potential function. I have the following concerns:

      1) 12% express Pax2 and are considered inhibitory. However, Gad is expressed in only 25% of dI2 interneurons while vGlut is expressed in 88%. These proportions suggest that there are dI2 neurons that co-express vGlut and Gad. Is this the case? Are there additional inhibitory dI2 neurons in addition to those expressing Pax2 which could explain the fact that Gad labels 25% of dI2 neurons. These points need some clarifications and discussion.

      2) Of all dI2 interneurons, 91% are small diameter and 9% are large diameter neurons - large diameter neurons are mostly apparent in the lumbar spinal cord. The small and large diameter dI2 neurons cannot be differentiated by their expression of TFs, but can be distinguished by their transmitter identity? Is the proportion of small and large diameter neurons the same along the spinal cord?

      3) Do all dI2 neurons receive putative synaptic contacts from DRG neurons? Unless I have missed it, it would be helpful to provide quantification of the number of small vs large diameter dI2 neurons with regard to the different putative synaptic contacts they receive from DRG neurons, dI2 and V1 interneurons.

      4) Lines 218-220: It is stated that DRG putative contacts are mainly targeting dorsal dI2 neurons while ventral ones receive virtually no contacts. Since large diameter VSCT dI2 neurons are located ventrally, they do not seem to receive direct sensory information. However, the authors conclude that VSCT dI2 neurons receive sensory input (lines 227-228) and also in the Discussion. There seem to be a mismatch between the results and the conclusion drawn by the authors (lines 374-377). Unless I am missing something here, this is not consistent with the conclusions of this study. Please clarify.

      5) The silencing experiments are interesting, however it is unclear which sub-class of dI2 neurons and at what level (lumbar vs brachial spinal cord or cerebellum) the observed behavioral perturbations take place. It is possible to selectively silence excitatory vs inhibitory or only VSCT neurons to provide some link between dI2 sub-classes and behavioral perturbations.

    2. Reviewer #2:

      This work addresses the possibility that developmentally-characterized di2 neurons contribute to the ventral spinocerebellar tract and regulate stepping in the chick. The work is sound considering that most information we have on spinal subtypes are for ventrally-born and local circuit interneurons (i.e. motor related), but less is known about the dorsally-born types and about long-range projecting neurons that link the spinal cord with higher integrative centers. Here, using a combination of cell-type specific manipulations, circuit tracing tools and kinematic analysis of gaits in the chick authors propose that spinal di2 interneurons contain multiple subgroups including a population that sends projection to the cerebellum. Silencing di2 neurons overall leads to impaired stepping.

      Overall, the strategy is sound and there is potential novelty, provided the weaknesses in the scientific demonstration listed below can be first addressed, experimentally and/or by additional analysis. Equally importantly also, the work suffers from a severe lack of clarity (writing, figures, results).

      I start with the scientific weaknesses:

      1) Synaptic connections rely mostly on the anatomical overlap between di2 cells and the synaptic field of their putative pre-synaptic partners. While this is indeed suggestive, it is not enough to ascertain actual synaptic connections, and even less so in a comparative manner between the different groups. Furthermore, some tracers (e.g PRVmCherry) do not seem to be under a synapse-specific promoter, so labelled elements might just as well be passing fibers. Clearer evidence of actual connections should be provided, functionally if possible or at the very least by showing clearer putative boutons onto neuronal somata/dendrites, quantifying them and quantifying differences between input cell types. Current figures (2F / 3B', C', D' / 4C, D', E', F') are not sufficiently convincing since we see only one cell and can barely detect boutons visually on some of them (not to mention that pseudo-colors keep changing, see other comment below). In addition, please consider using the term "putative" or "presumed" synapses, contacts and connections throughout the study.

      2) The loss of function and gait analysis is stronger and convincingly presented. However, unless I missed it, the strategy silences all di2 neurons but cannot discriminate the contributions of the pre-cerebellar ones. This poses problems for the interpretation of the data. Since this paper is about either subpopulations of di2, or the vSCT (see other comment about general scope of the work), it would be more robust if more specific silencing was included. It is currently assumed that one likely mechanism for the disturbed gait owes to the function of di2 as precerebellar neurons (line 385, 389) but the phenotype could also, or even entirely, be due to their proprio-spinal connectivity. This is a major caveat.

      On top of this, writing and data presentation MUST be substantially improved on multiple aspects:

      3) Please have the manuscript deeply proofread. In addition to numerous English mistakes (missing "the", "or", plural and singulars, lots of unnecessary commas, etc...) examples of confused writing include (non-exhaustive list):

      (a) Line 128: what does this phrase mean ("TF expression is redundant"...)

      (b) Line 159: I don't understand here, the Di2 ascend to the cerebellum, cross the midline to the targeted di2? To which Di2 do the authors refer to here, it sounds like they are in the cerebellum, or that the ascending Di2 redescend to the spinal cord...

      (c) The term targeted is in fact used alternatively and confusingly to refer to either "manipulated" cells, "synaptically-targeted" cells, there is also "targeted overground locomotion",....

      (d) Stage HH18 is sometimes referred to as E3. Please be consistent throughout.

      (e) When describing inputs onto di2, add "neurons" (i.e. "onto di2 neurons").

      4) I would appreciate more background on di2 neurons in the introduction and why these have been investigated. Currently, most of this is given in the first paragraph of the results (lines 91-100 and also line 103). Also, it is stated first that "the role of di2 neurons is elusive due to the lack of genetic targeting means" (line 59). This contradicts the later statement that "the progenitor pdi2 expresses [various transcription factors]", and that the "post mitotic di2 are defined by..." (line 103). Please clarify what is known and not known about di2 already in the introduction.

      5) Related to the above, it is not sufficiently clear what is investigated here. The genetic identity of ventral spinocerebellar neurons? Or the diversity of di2 neurons? In the way the introduction is written, it gives the impression that it is the former, but then functional investigations are not specific enough (since they are targeted to the overall di2 population, see dedicated comment later). Authors should revise to make clearer what is the scope of the work.

      6) Histology Figures should be made more convincing, self-explanatory, and to a higher standard.

      (a) Anatomical landmarks must be placed on all figures, e.g: the midline and minimal nuclei of the cerebellum, the deep cerebellar nuclei should be indicated in Fig S4,... Also, please give the orientation axis on all figures (especially the ones illustrating large territories, like 2B, 4A).

      (b) Add the CTB or HSV tracer on Fig. 2A and check coherence: I believe for instance that HSP is wrongly stated instead of HSV in Fig 2D and PRV is wrongly stated instead of CTB in Fig 2F (and there might be other confusions throughout).

      (c) It is extremely confusing that histology pseudo-colors are sometimes changed from one related figure to the other, for unclear reasons (e.g. 2B, 2B', 2C, also 2C and S4A...). Consistency will help the reader go through all panels and figures comparatively.

      (d) Figures must be addressed in proper order. This also applies to supplemental figures. Otherwise, it gives the impression we have missed something.

      (e) What is the rationale for plotting the overlap in area versus volume (Figure 2H, I)? If overlap with area shows a higher percentage than with volume, does it mean that the overlap is only limited to a given A/P plane? I'm really confused about this representation and its meaning.

      7) Authors should avoid relying on subjective formulations like "that reside at the lateral dorsal aspect of lamina VII". Instead, they MUST demonstrate the positioning of Di2 neurons into the different spinal laminae with some form of quantitative measurements. This is currently just an "impression" that large, precerebellar Di2 are more ventral, in lamina VII and possibly VIII but without the representation of lamina borders on figures, this information cannot be appreciated by the reader. It is all essential that these borders are depicted in Figures and neurons be quantitatively allocated to each laminae. In addition/alternatively, authors should report the average D/V position of the different subtypes and test for significant differences to make the case of different spatially-confined populations stronger.

      8) FoxD3 expression on Supplemental Figure 2B is not convincing. It is also not reported in the statistics of Fig 1E. Do we have to assume that all di2 investigated here are FoxD3-positive? If so, one would need a better illustration and quantifications should be given. Otherwise, I would suggest simply relying on the literature and removing Figure S1B which is not helping. On other panels of that supplemental Figure 2, please add arrow/arrowheads on all neurons that are or are not co-labelled so we can appreciate co-labelling.

      9) The demonstration that di2 are excitatory is essential. It is the title of a paragraph (line 102), thus I think that the corresponding data with the neurotransmitters (Vglut2, GAD) would deserve to be in the main Figures. Also, the chosen illustration only shows ONE double-labelled cell with Vglut2. Authors should be able to show a field of view that more convincingly conveys the message with more cells.

    3. Reviewer #1:

      This is a well-put-together manuscript describing carefully performed circuitry dissection and functional analysis of dl2 neurons in the chick. A genetic toolbox is used taking advantage of the electroporation technique applied to the embryos. The findings include a fairly convincing connectome for dl2 neurons and a functional phenotype that is, unfortunately, rather unsatisfying. The investigators conclude that dl2 interneurons regulate "stability" of bipedal stepping in the chick, which is fine, but the analysis misses an opportunity to more fully explore what the instability involves and thus to perhaps shed more light on the likely roles of this neuron population. The concerns/issues 3 and 4 below focus on this issue and the need for additional careful analysis of the behavior that will allow the phenotype to be more precisely described or ascribed to some aspect of stepping that might guide future studies in other models. For example, can the link between partial collapse and over-extensions be made more solid and thus argue that reduced extensor gain might be what results in the instability? What other analysis could be performed using the existing data/video to better describe the behavioral phenotype?

      Major Concerns:

      1) The connectome part of the work appears solid and supports the concept that a subpopulation of the population are likely VSCT neurons, that the non VSCT neurons receive the bulk of the afferent input and that these neurons project to contralateral dl2 neurons (some which may be VSCT) and other premotor neurons. Anatomically, the only concern is that no distinctions were made between the lumbar and brachial populations, and if differences in these populations exist, it would be important and interesting to describe them.

      2) Figure 2 Characterization of dl2/VSCT neurons as being primarily large dl2 neurons is quite convincing, and the observation that the dl2 neurons account for 10% of the VSCT axons is also of interest and quite compelling. A question arises, however, about the source, rostrocaudally, of the VSCT neurons and tract. Is the 10% for the total or for a specific level or levels? Can more be said/quantified about differences in these populations at different spinal levels?

      3) Whole-body collapses and subsequent over-extensions are important and speak to changes in reflex arc and motor output. The statement "usually followed by" over-extension should be followed-up. Can this be further quantified? Are the two events linked or distinct, and did over-extensions happen in the absence of collapses?

      4) These issues mesh with the lower knee height and angle of the TMP joint, even when collapses are excluded. It appears as though the control system to maintain muscle shortening (force output of extensors) is altered. I agree that stability is compromised, but could we go further to state that the compromise is due to extensor gain control?

    1. Reviewer #3:

      In this work Stachiak and colleagues investigate the role of Prox1 on the development of VIP cells. Prox1 is expressed by the majority of GABAergic derived from the caudal ganglionic eminence (CGE), and as mentioned by the authors, Prox1 has been shown to be necessary for the differentiation, circuit integration, and maintenance of CGE-derived GABAergic cells. Here, Stachiak and colleagues show that removal of Prox1 in VIP cells leads to suppression of synaptic release probability onto cortical multipolar VIP cells in a mechanism dependent on Elfn1. This work is of interest for the field because it increases our understanding of differential synaptic maturation of VIP cells. The results are noteworthy, however the relevance of this manuscript would potentially be increased by addressing the following suggestions:

      1) Include histology to show when exactly Prox1 is removed from multipolar and bipolar VIP-expressing cells by using the VIP-Cre mouse driver.

      2) Clarify if the statistical analysis is done using n (number of cells) or N (number of animals). The analysis between control and mutants (both Prox1 and Elfn1) need to be done across animals and not cells.

      3) Clarify what are the parameters used to identify bipolar vs multipolar VIP cells. VIP cells comprise a wide variety of transcriptomic subtypes, and in the absence of using specific genetic markers for the different VIP subtypes, the authors should either include the reconstructions of all recorded cells or clarify if other methods were used.

    2. Reviewer #2:

      Stachniak et al., provide an interesting manuscript on the postnatal role of the critical transcription factor, Prox1, which has been shown to be important for many developmental aspects of CGE-derived interneurons. Using a combination of genetic mouse lines, electrophysiology, FACS + RNAseq and molecular imaging, the authors provide evidence that Prox1 is genetically upstream of Elfn1. Moreover, they go on to show that loss of Prox1 in VIP+ cells preferentially impacts those that are multipolar but not the bipolar subgroup characterized by the expression of calretinin. This latter finding is very interesting, as the field is still uncovering how these distinct subgroups emerge but are at a loss of good molecular tools to fully uncover these questions. Overall, this is a great combination of data that uses several different approaches to come to the conclusions presented. I have suggestions that I think would strengthen the manuscript:

      1) Can the authors add a supplemental table showing the top 20-30 genes up and down regulated in their Prox1 KOS? This would make these, and additional, data more tenable to readers.

      2) It is interesting that loss of Prox1 or Elfn1 leads to phenotypes in multipolar but are not present or mild in bipolar VIP+ cells. The authors test different hypotheses, which they are able to refute and discuss some ideas for how multipolar cells may be more affected by loss of Elfn1, even when the transcript is lost in both multipolar and bipolar after Prox1 deletion. If there is any way to expand upon these ideas experimentally, I believe it would greatly strengthen the manuscript. I understand there is no perfect experiment due to a lack of tools and reagents but if there is a way to develop one of the following ideas or something similar, it would be beneficial:

      a) Would it be possible to co-fill VIPCre labeled cells with biocytin and a retroviral tracer? Then, after the retroviral tracer had time to label a presynaptic cell, assess whether these were preferentially different between bipolar and multipolar cell types, the latter morphology determined by the biocytin fill? This would test whether each VIP+ subtype is differentially targeted.

      b) Another biocytin possibility would be to trace filled VIP+ cells and assess whether the dendrites of multipolar and bipolar cells differentially targeted distinct cortical lamina and whether these lamina, in the same section or parallel, were enriched for mGluR7+ afferents.

    3. Reviewer #1:

      Stachiak and colleagues examine the physiological effects of removing the homeobox TF Prox1 from two subtypes of VIP neurons, defined on the basis of their bipolar vs. multipolar morphology.

      The results will be of interest to those in the field, since it is known from prior work that VIP interneurons are not a uniform class and that Prox1 is important for their development.

      The authors first show that selective removal of a conditional Prox1 allele using a VIP cre driver line results in a change in paired pulse ratio of presumptive excitatory synaptic responses in multipolar but not bipolar VIP interneurons. The authors then use RNA-seq to identify differentially expressed genes that might contribute and highlight a roughly two-fold reduction in the expression of a transcript encoding a trans-synaptic protein Elfn1 known to contribute to reduced glutamate release in Sst+ interneurons. They then test the potential contribution of Elfn1 to the phenotype by examining whether loss of one allele of Elfn1 globally alters facilitation. They find that facilitation is reduced both by this genetic manipulation and by a pharmacological blockade of presynaptic mGluRs known to interact with Elfn1.

      Although the results are interesting, and the authors have worked hard to make their case, the results are not definitive for several reasons:

      1) The global reduction of Elfn1 may act cell autonomously, or may have other actions in other cell types. The pharmacological manipulation is less subject to this interpretation, but these results are not as convincing as they could be because the multipolar Prox1 KO cells (Fig. 3 J) still show substantial facilitation comparable, for example to the multipolar control cells in the Elfn1 Het experiment (controls in Fig. 3E). This raises a concern about control for multiple comparisons. Instead of comparing the 6 conditions in Fig 3 with individual t-tests, it may be more appropriate to use ANOVA with posthoc tests controlled for multiple comparisons.

      2) The isolation of glutamatergic currents is not described. Were GABA antagonists present to block GABAergic currents? Especially with the Cs-based internal solutions used, chloride reversal potentials can be somewhat depolarized relative to the -65 mV holding potential. If IPSCs were included it would complicate the analysis.

      3) The assumption that protein levels of Elfn1 are reduced to half in the het is untested. Synaptic proteins can be controlled at the level of translation and trafficking and WT may not have twice the level of this protein.

      4) The authors are to be commended for checking whether Elfn1 is regulated by Prox1 only in the multipolar neurons, but unfortunately it is not. The authors speculate that the selective effects reflect a selective distribution of MgluR7, but without additional evidence it is hard to know how likely this explanation is.

    4. Preprint Review

      This preprint was reviewed using eLife’s Preprint Review service, which provides public peer reviews of manuscripts posted on bioRxiv for the benefit of the authors, readers, potential readers, and others interested in our assessment of the work. This review applies only to version 1 of the manuscript.

      Summary:

      This work is of interest because it increases our understanding of the molecular mechanisms that distinguish subtypes of VIP interneurons in the cerebral cortex and because of the multiple ways in which the authors address the role of Prox1 in regulating synaptic function in these cells.

    1. Reviewer #3:

      This manuscript reports results from an eye tracking study of humans walking in natural terrain. These eye movements together with images simultaneously obtained by a head-fixed camera are used to calculate optic flow fields as seen by the retina and as seen by the head-fixed camera. Next, the structure of these flow fields is described. It is noted that this structure is somewhat stable in the retinal image, due to compensatory gaze stabilisation reflexes, but varies wildly in the head-centric image. Then, the authors estimate the focus of expansion in the head-centric flow and argue that it cannot be used for locomotor control, because it also varies wildly during walking. In a second, more theoretical section of the manuscript, they calculate retinal flow for a movement over an artificial ground plane, given the locomotor and eye movements recorded previously. They describe the structure of the retinal flow and compute the distribution of curl and divergence across the retina as well as in a projection onto the ground plane. They argue that curl around the fovea and the location of the maximum of divergence can be used to estimate the direction of walking relative to the direction of gaze and in relation to the ground plane.

      I really like the experimental part of the study. However, I see fundamental issues in the theoretical part, in the general framing of the presentation, and in misrepresentations of previous literature.

      The simultaneous measurement of head-centric image and gaze with sufficient temporal resolution to calculate retinal flow during natural walking provides a beautiful demonstration of retinal flow fields, and confirms many known aspects of retinal flow. The calculation of head-centric flow from the head camera images provides a compelling, though not unexpected, demonstration that the FOE in head-centric flow is not useful for locomotor control. It is not unexpected since one of the most well-known issues in optic flow is that the FoE is destroyed when self-motion contains rotational components (Regan and Beverley, 1982, Warren and Hannon, 1990, Lappe et al. 1999). Although this is often presented as an issue of eye movements in retinal flow, it applies to all rotations and combinations of rotations that exist on top of any translational motion of the observer. Thus, the oscillatory bounce and sway motion of the head during walking is expected to render any use of the FOE in a head-centric image futile.

      Yet, the first part of the manuscript is very much framed as a critique of the idea of a stable FoE in head-centric flow, presuming that this is what previous researchers commonly believed. This argument contains a logical fallacy. Previous research argued that there is no FoE in retinal flow because of eye rotations (e.g. Warren and Hannon, 1990). This does not predict, inversely, that there is an FoE in head-centric flow. In fact, it does not provide any prediction on head-centric flow. The authors often suggest that a stable FoE in head-centric flow is tacitly implied, commonly believed, etc without providing reference. In fact, the only paper I know that specifically proposed a head-centric representation of heading is by van den Berg and Beintema (1997).

      Instead, the fundamental problem of heading perception is to estimate self-motion from retinal flow when the self-motion that generates retinal flow combines all kinds of translations and rotations. The present study shows, consistent with much of the prior literature, that the patterns of retinal flow are sufficiently stable and informative to obtain the direction of one's travel in a retinal frame of reference, and, via projection, with respect to the ground plane. This is due to the stabilising gaze reflexes that keep motion small near the fovea and produce (in case of a ground plane) a spiralling pattern of retinal flow. This is well known from theoretical and lab studies (e.g. Warren and Hannon, 1990, Lappe et al., 1998, Niemann et al., 1999, Lappe et al. 1999) and, to repeat, beautifully shown for the natural situation in the present data. The presentation should link back to this work rather than trying to shoot down purported mechanisms that are obviously invalid.

      The second part of the manuscript presents a theoretical analysis of the retinal flow for locomotion across a ground plane under gaze stabilisation. This has two components: (a) the structure of the retinal flow and the utility of gaze stabilisation, and (b) ways to recover information about self-motion from the retinal flow. Both aspects have a long history of research that is neglected in the present manuscript. The essential circular structure of the retinal flow during gaze stabilisation is long known (Warren and Hannon, 1990, van den Berg, 1996, Lappe et al., 1998, Lappe et al. 1999). Detailed analyses of the statistical structure of retinal flow during gaze stabilisation have shown the impact and utility of gaze stabilisation (Calow et al., 2004; Calow and Lappe, 2007; Roth and Black, 2007) and provided links to properties of neurons in the visual system (Calow and Lappe, 2008). These studies included simulated motions of the head during walking, as in the current manuscript, and extended to natural scenes other than a simple ground plane.

      Given the structure of the retinal flow during gaze stabilisation the central question is how to recover information about self-motion from it. The authors investigate a proposal originally made by Koenderink and van Doorn (1976; 1984) that relies on estimates of curl and divergence in the visual field. They propose that locomotor heading may be determined directly in retinotopic coordinates (l. 314). This is true, but it fails to mention that other models of heading perception during gaze stabilisation similarly determine heading in retinotopic coordinates (e.g. Lappe and Rauschecker, 1993; Perrone and Stone, 1994; Royden, 1997). In fact, as outlined above, the mathematical problem of self-motion estimation is typically presented in retinal (or camera) coordinates (e.g. Longuet-Higgins and Prazdny, 1980). The problem with the divergence model in comparison to the other models above is threefold. First, it really only works for a plane, not in other environments. Second, it requires a local estimate of divergence at each position in the visual field. The alternative models above combine information across the visual field and are therefore much more robust against noise in the flow. One would need to see whether the estimate of the divergence distribution is sufficient to work with the natural flow fields. Third, being a local measure it requires a dense flow field while heading estimation from retinal flow is known to work with sparse flow fields (Warren and Hannon, 1990). Thus, the theoretical part of the manuscript should either provide proof that the maximum of divergence is superior to these other models or broaden the view to include these models as possibilities to estimate self motion from retinal flow.

      The case is similar for the use of curl. It is true that the rotational or spiral pattern around the fovea in retinal flow provides information about the direction of self motion with respect to the direction of gaze, as has been noted many times before. This structure is used by many models of heading estimation. However, curl is, like divergence, a local property and thus not as robust as models that use the entire flow field. It may be interesting to note that neurons in optic flow responsive areas of the monkey brain can pick up this rotational pattern and respond to it in consistency with their preference for self-motion across a plane (Bremmer et al., 2010; Kaminiarz et al. 2014).

      I think what the authors may want to draw more attention to is the dynamics of the retinal flow and the associated self-motion in retinal (or plane projection) coordinates. The movies provide compelling illustrations of how the direction of heading (or the divergence maximum, if you want to focus on that) sways back and forth on the retina and on the plane with each step. This requires that the analysis of retinal flow (and the estimation of self-motion) has to be fast and dynamic, or maybe should include some form of temporal prediction or filtering. Work on the dynamics of retinal flow perception has indeed shown that heading estimation can work with very brief flow fields (Bremmer et al. 2017), that the brain focuses on instantaneous flow fields (Paolini et al. 2000) and that short presentations sometime provide better heading estimates than long presentations (Grigo and Lappe, 1999). The temporal dynamics of retinal flow is an underappreciated problem that could be more in the focus of the present study.

      Additional specific comments:

      Footnote on page 2: It is not only VOR but also OKN (Lappe et al., 1998, Niemann et al., 1999) that stabilises gaze in optic flow fields.

      Line 55: Natural translation and acceleration patterns of the head have been considered by (Cutting et al., 1992; Palmisano et al. 2000; Calow and Lappe, 2007, 2008; Bossard et al., 2016)

      Line 59: The statement is misleading that the key assumption behind work on the rotation problem is that the removal of the rotational component of flow will return a translational flow field with a stable FoE. Only one class of models, those using differential motion parallax (Rieger and Lawton, 1985, Royden, 1997) explicitly constructs a translational flow field and aims to locate the FoE in that field. Other models (Koenderink and van Doorn, 1976, 1984; Lappe and Rauschecker, 1993; Perrone and Stone, 1994) do not subtract the rotation but estimate heading in retinal coordinates from the combined retinal flow. This also applies to line 109.

      Last paragraph on page 5: Measures of eye movement during walking in natural terrain were also taken by Calow and Lappe (2008) and 't Hart and Einhäuser (2012).

      Lines 140 to 163: This paragraph is problematic and misleading as pointed out before.

      Line 193: The lack of stability is expected, as outlined above. The use of a straight line motion in psychophysical experiments reflects an experimental choice to investigate the rotation problem in retinal flow, not an implicit assumption that bodily motion is usually along a straight line.

      Line 200: That gaze stabilization may be an important component in understanding the use of optic flow patterns has also long been assumed (Lappe and Rauschecker, 1993; 1994; 1995; Perrone and Stone, 1994; Glennerster et al. 2001; Angelaki and Hess, 2005; Pauwels et al., 2007).

      Line 314: Locomotor heading may be determined directly in retinotopic coordinates. Yes, and this is precisely what the above mentioned models do.

      Line 334: What is meant by "robust" here? The videos seem to show simulated flow for a ground plane, not the real flow from any of the terrains. It is not clear whether the features can be extracted from the real terrain retinal flow.

      First paragraph on page 15: This is an important discussion about the dynamics of retinal flow in conjunction with the dynamics of the gait cycle. It should be expanded and better balanced with respect to previous work and other models. It is true that any simple inference of an FoE would not work. However, models that estimate heading (not FoE) in the retinal reference frame would be consistent with the discussion. Oscillations of the head during walking affect the location of the divergence maximum and curl as much as the direction of heading in retinal coordinates. In fact, the videos nicely show how these variables oscillate with each step. This applies to all retinal flow analyses, and is a problem for any model. It requires a dynamical analysis. The speed of neural computations is an issue, of course, but it applies to divergence and curl in the same way as to other models. There is some indication, however, that neural computations on optic flow are fast, deal with instantaneous flow fields, and respond consistently to natural (spiral) retinal flow, as described above.

      Line 393: This paragraph is misleading in suggesting that naturally occurring flow fields have not been used in psychophysical and electrophysiological experiments.

      Line 516: This has been done by Bremmer et al. (2010) and Kaminiarz et al. (2014). Their results are consistent with computing heading directly in a retinal reference frame as predicted by several models of retinal flow analysis (e.g. Lappe et al. 1999).

      References:

      Angelaki, D. E. and Hess, B. J. M. (2005). Self-motion-induced eye movements: effects an visual acuity and navigation. Nat. Rev. Neurosci., 6:966-976.

      Bossard, M., Goulon, C., and Mestre, D. R. (2016). Viewpoint oscillation improves the perception of distance travelled based on optic flow. J Vis, 16(15):4.

      Bremmer, F., Kubischik, M., Pekel, M., Hoffmann, K. P., and Lappe, M. (2010). Visual selectivity for heading in monkey area MST. Exp. Brain Res., 200(1):51-60.

      Calow, D., Krüger, N., Wörgötter, F., and Lappe, M. (2004). Statistics of optic flow for self-motion through natural scenes. In Ilg, U., Bülthoff, H. H., and Mallot, H. A., editors, Dynamic Perception, Workshop of the GI Section 'Computer Vision', pages 133-138, Berlin. Akademische Verlagsgesellschaft Aka GmbH.

      Calow, D. and Lappe, M. (2007). Local statistics of retinal optic flow for self- motion through natural sceneries. Network, 18(4):343-374.

      Calow, D. and Lappe, M. (2008). Efficient encoding of natural optic flow. Network Comput. Neural Syst., 19(3):183-212.

      Cutting, J. E., Springer, K., Braren, P. A., and Johnson, S. H. (1992). Wayfinding on foot from information in retinal, not optical, flow. J. Exp. Psychol. Gen., 121(1):41-72.

      Grigo, A. and Lappe, M. (1999). Dynamical use of different sources of information in heading judgments from retinal flow. JOSA A, 16(9):2079-2091.

      't Hart, B. M. and Einhäuser, W. (2012). Mind the step: complementary effects of an implicit task on eye and head movements in real-life gaze allocation. Exp. Brain Res., 223(2):233-249.

      Kaminiarz, A., Schlack, A., Hoffmann, K.-P., Lappe, M., and Bremmer, F. (2014). Visual selectivity for heading in the macaque ventral intraparietal area. J. Neurophys. 112(10):2470-80

      Lappe, M., Pekel, M., and Hoffmann, K. P. (1998). Optokinetic eye movements elicited by radial optic flow in the macaque monkey. J. Neurophysiol., 79(3):1461-1480.

      Lappe, M. and Rauschecker, J. P. (1993). A neural network for the processing of optic flow from ego-motion in man and higher mammals. Neural Comp., 5(3):374-391.

      Lappe, M. and Rauschecker, J. P. (1994). Heading detection from optic flow. Nature, 369(6483):712-713.

      Lappe, M. and Rauschecker, J. P. (1995). Motion anisotropies and heading detection. Biol. Cybern., 72(3):261-277.

      Niemann, T., Lappe, M., Büscher, A., and Hoffmann, K. P. (1999). Ocular responses to radial optic flow and single accelerated targets in humans. Vision Res., 39(7):1359-1371.

      Pauwels, K., Lappe, M., and Hulle, M. M. (2007). Fixation as a mechanism for stabilization of short image sequences. Int. J. Comp. Vis., 72(1):67-78.

      Perrone, J. A. and Stone, L. S. (1994). A model of self-motion estimation within primate extrastriate visual cortex. Vision Res., 34(21):2917-2938.

      Regan, D. and Beverley, K. I. (1982). How do we avoid confounding the direction we are looking and the direction we are moving? Science, 215:194-196.

      Rieger, J. H. and Lawton, D. T. (1985). Processing differential image motion. J. Opt. Soc. Am. A, 2(2):354-360.

      Roth, S. and Black, M. J. (2007). On the spatial statistics of optical flow. Int. J. Comp. Vis., 74(1):33-50.

      Royden, C. S. (1997). Mathematical analysis of motion-opponent mechanisms used in the determination of heading and depth. J. Opt. Soc. Am. A, 14(9):2128-2143.

      van den Berg, A. V. (1996). Judgements of heading. Vision Res., 36(15):2337-2350.

      van den Berg, A. V. and Beintema, J. A. (1997). Motion templates with eye velocity gain fields for transformation of retinal to head centric flow. NeuroReport, 8(4):835-840.

    2. Reviewer #2:

      The manuscript by Matthis et. al. nicely measures both the visual scene and eye, body, and head kinematics during natural locomotion. The authors propose that certain features of optic flow as observed at the retina might be useful to guide locomotion. The data are a natural follow-up to earlier work from the same group that examined patterns of gaze during locomotion across different terrains. Taken together, the work here is a fine extension of the earlier paper, suggesting an interesting perspective on the way visual information could be processed to facilitate locomotion. Unfortunately, these findings are framed in the manuscript as if they overturn a dogma about the use of the head-centered Focus of Expansion (192-195, 397-399, 440). I found this argument to be quite confusing and insufficiently supported. As a result it was hard to evaluate the impact of this work.

      The authors find that one cannot extract a useful flow-field from a head-mounted camera (section 2,153-159). The literature cited doesn't claim that it would be, and given the familiarity with the VOR, I wouldn't expect it to. I was further confused by the fact that the authors could extract a useful FoE from drone video -- a clever calibration of their analysis! As a (mediocre) drone pilot, I know that the gimbal uses pitch/yaw/roll acceleration to stabilize a camera relative to the drone body at an angle defined by the user. If the authors can extract an FoE from such footage then certainly when the VOR does the same stabilization for the eye a similar computation ought obtain (contra 52-53). Furthermore, it is well-established that the oculomotor system provides a veridical estimate of eye-in-orbit to the rest of the brain: wouldn't this be the final component necessary to transform retinal flow into "head-centered FoE." There is considerable work that proposes solutions to understand the transformation from retinal coordinates to body-centered coordinates. The manuscript would benefit from consideration of these issues.

      None of this is to say that curl as computed at the fovea isn't useful for locomotion. To that point, the authors might find Oteiza et. al. Nature 2017 https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5873946/ interesting as an example of another sensory system that uses curl as a cue for navigation. Notably, though, the manuscript doesn't even establish that it is, only that it might be. Optic flow fields generate a strong percept of self-motion, and they have been used to study perception or the neural correlates thereof. It isn't clear that the work here truly speaks to those findings, much less overturn their foundation.

    3. Reviewer #1:

      The study of how optic flow guides perception and action dated back to the 1950s and drew inspiration from pilots flying planes and birds gliding in the sky. These relatively constant-speed translational motions are different from what humans do every day, which is walking. Nevertheless, it is often assumed that laboratory findings using stimuli simulating smooth translational self-motion can be generalized to locomotive optic flow processing. In this paper, the authors directly challenge this assumption by investigating the structure of flow during natural locomotion, using simultaneous recordings of eye and body movements and the participants' view during walking. Their findings call for attention to reconsider assumptions about optic flow processing during natural locomotion, including the role of stabilizing eye movements.

      One of the most substantial contributions this paper makes is the careful characterization of the structure of flow in a naturalistic context, in terms of both the behavior involved and the environment in which the behavior occurs. The dataset is rich, challenging to come by, and complex to process. I applaud the authors' efforts to describe and contextualize the observed patterns. I am convinced about most claims made in the paper, with specific concerns and ideas to strengthen them as elaborated below. This work can have a significant impact as it is relevant not only to researchers studying vision and action in naturalistic contexts but also to researchers who translate basic science knowledge to advance real-life simulation (e.g., virtual reality, simulators, rehabilitation).

      Major Comments:

      1) A key finding from this paper is that the focus-of-expansion (FoE), a cue to heading direction, is highly variable in head-centered flow without considering eye movements. Although I am convinced about the variability of FoE velocity in head-centered optic flow based on the results reported by the authors, I see the potentials to strengthen the interpretation of this finding. The authors attribute the instability of the FoE to head motion during natural locomotion by showing the distribution of FoE velocities (Fig. 2) and the changes in head velocity as a function of % step (from one heel strike to the next, Fig. 3), respectively. More direct evidence to show this link would be that the FOE velocity changes as a function of % step, resembling patterns shown in Figure 3. Is this the case? I believe this result, if true, will strengthen the authors' claim.

      2) The instability of the FoE is contrasted against the stability of the retinal flow, as illustrated in Figure 2. The authors did not characterize eye movements used to achieve this stabilization and only briefly introduced vestibular ocular reflex (p. 2, line 21; Fig. 1 caption). While it might be beyond the scope of this paper to characterize these eye movements, it will be appropriate to include literature on how eye movements respond to laboratory optic flow stimulus (e.g., Knöll, Pillow & Huk, 2018; Niemann, Lappe, Büscher & Hoffmann, 1999). This literature provides a link between the eyes-fixed laboratory studies cited by the authors and the eyes-free naturalistic setting adopted in this paper.

      3) The other key finding is that retinal flow contains simple geometric features (curl, divergence) corresponding with the direction of heading relative to the fovea. The authors proposed that these cues could be used to determine the heading direction. This idea that there are visual cues alternative to FoE for heading direction guiding and perception is not new, as the authors have adequately cited previous studies suggesting so. Nonetheless, it is crucial to distinguish between speculation and empirical evidence showing the role of these cues. This paper has not demonstrated that participants can determine heading direction using these cues alone, or that the curl/divergence cues affect participants' behavior. The lack of an empirical test for these cues is concerning when combined with some statements that can be interpreted as it has been done. For example, on p.5 lines 105-110, the authors wrote: 'We show that this structure of fixation-mediated retinal optic flow provides a rich and robust source of information that is directly relevant to locomotor control without the need to subtract out or correct for the effects of eye rotations' and on p. 14 lines 347-349: 'We found that a walker can determine whether they will pass to the left or right of their fixation point by observing the sign and magnitude of the curl of the flow field at the fovea.' If the roles of these cues on behavior can be demonstrated from the data (e.g., by correlating simulated retinal flow cues and kinematic data), I recommend adding this analysis to support the authors' claim. Otherwise, I think all statements related to this claim (not exclusive to ones listed here) should be checked and altered.

      References:

      Knöll, J., Pillow, J. W., & Huk, A. C. (2018). Lawful tracking of visual motion in humans, macaques, and marmosets in a naturalistic, continuous, and untrained behavioral context. Proceedings of the National Academy of Sciences, 115(44), E10486-E10494. https://doi.org/10.1073/pnas.1807192115

      Niemann, T., Lappe, M., Büscher, A., & Hoffmann, K.-P. (1999). Ocular responses to radial optic flow and single accelerated targets in humans. Vision Research, 39(7), 1359-1371. https://doi.org/10.1016/S0042-6989(98)00236-3

    4. Preprint Review

      This preprint was reviewed using eLife’s Preprint Review service, which provides public peer reviews of manuscripts posted on bioRxiv for the benefit of the authors, readers, potential readers, and others interested in our assessment of the work. This review applies only to version 4 of the manuscript. Miriam Spering (University of British Columbia) served as the Reviewing Editor for this submission.

      Summary:

      Your work is based on a fascinating and rich dataset with great potential. There was general agreement on the value of these data, and on the thoroughness with which the data were collected and preprocessed. Your approach of exploring how gait-induced instabilities of the head and terrain-dependent eye movements during natural locomotion will shape retinal optic flow is important and addresses an obvious gap in the literature. It also has the potential to merge knowledge across subfields (motion processing, eye movements, locomotion). However, there are several theoretical limitations that we believe cannot be fully addressed with the current dataset, even if the manuscript was rewritten entirely, as highlighted in the reviews below.

      1) The suggestion to use curl and divergence of the retinal flow for the control of self-motion is interesting, but it is insufficiently demonstrated as a valid strategy for the visual system (and alternatives are not considered). The reviewers briefly discussed whether conducting a correlational analysis between the sign/magnitude of cues and the participants' movement at a future timepoint based on the existing data might address this issue, but the more general concern here is that any such analysis might perpetuate the (wrong) idea that these cues are used in the visual system. The seminal paper by Warren and Hannon (1990) has taken a good look at this proposal and essentially refuted it on the grounds mentioned by Reviewer 3. Their arguments still stand and not much has been made of the divergence maximum since. A more encompassing view is needed to look in general at cues that predict instantaneous heading in the retinal reference frame. Another solution could be an analysis of the dynamics of retinal heading as produced by the locomotor cycle. Then, it might be possible to provide some constraints on necessary dynamics of any of the possible algorithms for retinal flow analysis.

      2) The case against the use of the head-centric FoE is valid but presented in a confusing (and possibly misleading/exaggerated) fashion. The data presented do not appear to provide sufficient evidence to overturn the idea that the FoE is not used to control heading during locomotion.

      3) The role of stabilizing eye movements on retinal flow is insufficiently discussed. Along the same lines, the purpose of the different experimental manipulations that presumably trigger significantly different eye movement patterns is never fully elaborated. It seems that there is a missed opportunity here to take a more hypothesis-guided rather than exploratory approach.

  5. Oct 2020
    1. Reviewer #3:

      The Suv39 class of methyl transferases are responsible for establishment and maintenance of constitutive heterochromatin via the deposition of H3K9me2/me3 marks. Clr4 is the sole H3K9me2/me3 HMTase in the fission yeast S. pombe and is part of the E3 ubiquitin ligase CLRC complex. It has been shown recently that CLRC mediates the ubiquitylation of H3K14 residue which in turn boosts the methyl transferase activity of Clr4 . A region C-terminal to the chromo domain (aa 63-127) was also shown to be required to bind Ubiquitin and provide specificity for ubiquitylated H3K14 relative to unmodified H3 (Oya et al 2019 EMBO Rep. 2019 20:e48111).

      Here the authors further explore crosstalk between Clr4 activity and H3K14Ub. They do this via a structure-function approach employing a range of structural methods combined with in vivo assays. The primary finding here is that the presence of H3K14ub on histone H3 enhances Clr4 methyltransferase activity and this H3K14ub sensing region resides within the KMT methyltransferase domain itself (aa 192-490) not the aa 63-127 region as previously reported.

      The authors further identify regions within this domain that are responsible for H3K14ub binding and Clr4 mutants which abrogate this interaction. These Clr4 mutants display dramatically reduced activity towards ubiquitylated peptide substrates. In vivo tests show that the same mutants exhibit silencing defects associated with almost a complete loss of H3K9me2/me3 from centromeric heterochromatin. Additionally, the authors show that H3K14ub sensing also appears to operate within the KMT domain of human SUV39H2 but not human G9a or Arabidopsis SUVH4.<br> Thus the key differences here from the Oya et al. 2019 study are the structural approaches employed and that Ubiquitin is sensed by the KMT methyltransferase domain itself without the previously identified Ubiquitin binding region in (aa 63-127). The authors offer a reasonable explanation for this discrepancy.

      Additional analyses would perhaps help to strengthen their conclusions.

      Major Points:

      1) The relevance of the proposed mechanism in a cellular chromatin context is unclear. A significant fraction of H3K9me2/3 nucleosomes isolated from cells should also carry H3K14ub in cis. How frequently do K9Me2/3 and K14ub co-occur on nucleosomes in heterochromatin regions? This could be explored by westerns with anti-H3K9me2 and or me3 - a mobility shift equivalent to monoubiquitylation should be visible.

      2) The authors should consider including mutant peptide controls such as H3K9RK14ub to make sure what is detected here is indeed H3K9 methylation. Additionally, a completely unrelated substrate such as a ubiquitylated H4 N-terminal peptide could be used in the methyltransferase assays to strengthen the author's claims of specificity.

      3) The IP-western (Fig. 4C) shows association of Clr4 proteins with the Rik1, suggesting that they are incorporated into the CLRC complex. However, a more rigorous test would be to analyze these IPs by mass spectrometry to determine if the Clr4 GS253 and F3A mutant proteins are indeed assembled into a CLRC complex containing the other components.

      4) The Clr4-F3A mutant appears to have a differential effect on the level of transcript generation from the dg and dh regions of centromeric repeats. For completeness ChIP-qPCR data should be included for both the dg and dh regions (currently only dh is assayed Fig 4 E) to determine if a difference is also detected.

      5) Are similar structural features found in the SUV39H2 KMT domain to those shown for Clr4 (Fig 5C) that would also allow ubiquitin to dock? Does computational comparison between Suv39H2, Clr4, G9a and SUVH4 provide insight into similarities/differences?

    2. Reviewer #2:

      In this manuscript Stirpe and colleagues describe structural insight into a novel regulation mechanism of SUV39 class histone methyltransferases. Clr4 is the sole SUV39-family H3K9me2/3 methyltransferase in fission yeast and recent evidence suggests that ubiquitylation of lysine 14 on histone H3 (H3K14ub) plays a key role in H3K9 methylation. To understand the molecular mechanisms of this regulation, the authors first set up in vitro assay system and demonstrate that H3K14ub promotes Clr4 methyltransferase activity and that the catalytic domain of Clr4 senses the presence of H3K14-linked ubiquitin. The authors then performed hydrogen/deuterium exchange coupled to mass spectrometry analysis and show that ubiquitin moiety binds to a region involving residues 243-261 of Clr4. Using this information, they further show that Clr4 mutants containing amino-acid substitutions in the ubiquitin binding region lose affinity for H3K14ub. The authors also demonstrate that fission yeast strains expressing mutant Clr4 display silencing defects and lose heterochromatic H3K9me2/3. Finally, the authors demonstrate that H3K14ub also stimulates the enzymatic activity of mammalian SUV39H2.

      Comments:

      This is an excellent paper that provides structural insights into how H3K14ub stimulates Clr4 methyltransferase activity. The results presented are of high quality and convincingly controlled. The paper is carefully written, and the conclusions presented are fully supported by the data included. The results described are of high interest to the field of heterochromatin and crosstalk of histone marks. However, the following points should be addressed by the authors.

      Major points:

      Is the H3K14ub-mediated stimulation a shared property of SUV39 class methyltransferases? This is a quite important question considering the mechanisms underlying heterochromatin assembly in eukaryotic cells. While the authors demonstrate that SUV39H2's enzymatic activity is stimulated by H3K14u (Fig. 5A), it would be interesting to test whether the activity of SUV39H1, the other mammalian Su(var)3-9 homologue, is also stimulated by the presence of H3K14ub.

    3. Reviewer #1:

      H3K14ub is a histone modification that facilitates deposition of H3K9me on heterochromatin in fission yeast, but the mechanism by which this modification stimulates Clr4 was unknown. Using mutants and HDX, the authors identified the interaction surface of Clr4 for H3K14ub, which they used to design mutants that responded poorly to H3K14ub stimulation. In vivo, these mutations resulted in loss of heterochromatin marks and defects in heterochromatin-based silencing, suggesting that H3K14ub stimulation is essential to K9me-mediated silencing. Finally, the authors show that human SUV39H2 but not G9a or Arabidopsis SUVH4 can be stimulated by H3K14ub in a similar manner.

      The authors provided biochemical and structural insights into the mechanism that increases the H3K9-specific methyltransferase activity of Clr4 by H3K14ub. Although H3K14ub-mediated promotion of H3K9 methylation is shown in Oya et al. EMBO Rep 2019, this study further characterizes the potential mechanism. However, there are some issues with the results that need to be resolved.

      1) Similarity and difference with the previous study. As the authors acknowledge, this manuscript builds on a previous study by Oya et al. 2019, however I think the similarities and the differences need to be made even more explicit and better addressed.

      a) The authors should clearly state that Figure 1B and 1C are basically a confirmation of Oya et al. 2019.

      b) I am more puzzled by the difference in the mapping of the region required for H3K14ub stimulation. The authors suggest that a difference in the preparation of the recombinant proteins might be responsible. This can and should be tested as it would seemingly be a simple experiment (compare with and without GST tag).

      c) Possibly to reconcile their findings with the previous report the authors state in the description of Fig. 1 that "the N-terminus plays a regulatory role in the sensing of H3K14ub by the catalytic domain" but I don't see this reflected in the data show in Fig. 1C, given that the degree of stimulation is very similar for KMT and FL.

      2) Stimulation-defective mutants. The authors should carefully discuss the stimulation-defective mutants, which should be premised on the retention of their methyltransferase activity on unmodified H3. The authors claim that 30% loss of activity of the Clr4 KMT mutants on unmodified H3 is observed in Figure S3C (Pg 11 line 15), but this cannot be determined from the graph provided, which is normalized to unmodified H3. The authors should (1) make another graph to show the 30% loss and (2) compare Clr4 KMT mutants with catalytic-dead Clr4 KMT or dissolution buffer (no protein). It is still possible that GS253 and F3A mutations simply reduce MTase activity, thus displaying lower activity than WT in the presence of H3K14ub, which would also suggest a different interpretation for the results in vivo.

      3) Heterochromatin localization of Clr4 mutants. The FLAG ChIP results in Fig. 4E is not very informative, as with the loss of heterochromatin a loss of Clr4 is predicted. If the authors want to test whether the localization activity of Clr4 mutants is intact, (1) FLAG ChIP in the clr4+, Flag-Clr4GS253/F3A background (i.e., two clr4 alleles exist) or (2) in vitro H3K9me2/3 binding assay should be performed. Since Clr4 N-terminus might regulate MTase activity as discussed in Pg 18 line 19, it is also possible that amino acid substitutions in the KMT region affect the function of N-terminus, including CD. The co-IP in Fig. 4C is not sufficient to clarify this point as Clr4 directly binds heterochromatin via its CD, in addition to the CLRC-mediated mechanism, and it is unclear if this is affected in the mutants.

      4) Allosteric vs. binding regulation. On Pg. 11, the authors suggest that an allosteric mechanism is at play, but this is not supported by the data. In fact the observation that providing ubiquitin in trans does not stimulate and rather inhibits the activity on H3K14ub would suggest that the ubiquitin just increases binding affinity. To clarify this the authors should measure binding affinity of WT and mutants to the H3 peptide with and without ubiquitin.

    4. Preprint Review

      This preprint was reviewed using eLife’s Preprint Review service, which provides public peer reviews of manuscripts posted on bioRxiv for the benefit of the authors, readers, potential readers, and others interested in our assessment of the work. This review applies only to version 2 of the manuscript.

      Summary:

      Based on the reviews and following discussion, the editors have judged your manuscript of interest but think that additional experiments are required. We also think that several of the other points made by the reviewers might help you strengthen this manuscript and encourage you to consider addressing them if possible.

      Essential Points:

      1) Additional support for the claim that the mutants are only (or mostly) impaired in the ubiquitin binding activity. This is key for the proper interpretation of the in vivo data. As suggested by the reviewers, this could entail (but is not limited to) a better quantification or presentation of enzymatic activity (absolute instead of fold-change in stimulation), additional characterization of interacting proteins by mass spec, localization of the mutants to chromatin in a wild-type context.

      2) Clarification of allostery vs. changes in binding affinities (Rev 1, point 4) ideally including measurements for the binding affinity of WT and mutants to the H3 peptide with and without ubiquitin.

      3) Better characterization of silencing defects: ChIP-qPCR data should be included for both the dg and dh regions across mutants (Rev 3, point 4).

      4) Analysis of the conservation of structural features in SUV34H2 (Rev 3 point 5)

    1. Reviewer #3:

      Non-alcoholic fatty liver disease is a growing health issue worldwide. The pathogenesis and mechanism causing the disease are poorly understood. As the authors state correctly, unravelling mechanistic details of liver lipid metabolism is extremely important yet also technically very challenging. This report aimed at defining the role and mechanism of action of HILPDA in liver cells. The presented paper shows very interesting aspects on the role of HILPDA and brings novel concepts into the field and, as such, has extremely high potential. An overwhelming amount of data is shown that leads to development of the story. However, in the current form, the novel mechanism as outlined from the title has not been worked out with sufficient detail.

      1) de la Rosa Rodriguez et al. claim that 'The increase of DGAT1 activity via HILPDA is a novel mechanism that links elevated fatty acid levels to stimulation of triglyceride synthesis and storage in hepatocytes." Experiments correlate HILPDA with DGATs, e.g. upregulation of HILPDA in NASH, overexpression of HILPDA correlating with increase of DGAT1 levels, localization studies demonstrating colocalization of HILPDA with DGAT1 and DGAT2. As experienced in previous HILPDA studies, many effects are modest (e.g. decrease of TG in mice liver with NASH upon deletion of HILPDA, changes in plasma ALT levels).

      2) As the authors correctly state in their results section, the presented data suggest that HILPDA promotes lipid storage at least partly via an ATGL-independent mechanism. Fig 3 also indicates different sized individual lipid droplets comparing Atglistatin treatment, even though the total LD area might differ significantly.

      3) HILPDA is associated with increased DGAT activity, the suggested mechanism behind it (transcriptional activation?) is not described sufficiently. DGAT1 activity decreases FA-levels and as such would back in down-regulation HILPDA expression. To support the very interesting and very strong claim that DGAT1 is increased by direct interaction with HILPDA, this should be shown in vitro.

    2. Reviewer #2:

      This manuscript further characterizes the role of HILPDA/HIG2 in TAG/LD biology. The major finding is that HILPDA interacts with and promotes DGAT activity and TAG synthesis, which is novel given that HILPDA has largely been thought to regulate TAG turnover as a lipolytic inhibitor.

      Characterization of the interaction between HILPDA and DGAT1 (and to a lesser extent DGAT2) is the major strength of this paper and an important advancement in the field. The early parts of the paper are not particularly novel (Fig. 1) or well-designed (Fig 2. - poor NAFLD/NASH model showing almost no effects) and the study is a bit on the thin side for data.

      1) The data shown in Figure 1 is not particularly striking given that HILPDA is a known target gene of PPAR-alpha, which is activated by FAs. Showing that HILPDA expression tracks with PLIN2 is also pretty obvious as PLIN2 tracks with LD accumulation. I really don't see the need/relevance of this figure.

      2) The MCD diet is widely regarded as a poor model for NAFLD/NASH since it doesn't replicate human NASH in so many regards. As a result, the use of this model makes these studies less relevant. Also, it is referenced that HILPDA was found to be up in a MCD study, but why not look at the plethora of human and mouse studies of NAFLD that have done RNAseq or arrays to provide a more physiological assessment of its expression in NAFLD/NASH?

      3) The conclusion that effects are independent of ATGL are not overly convincing. Since ATGListatin is not specific for ATGL (Quiroga et al. 2018), a more thorough and quantitative analysis of TAG turnover with ATGL knockdown/out is warranted if these claims are to be made.

      4) Since DGAT1 mRNA is unchanged but protein goes up, it would be assumed that HILPDA is affecting DGAT1 stability/turnover. This should be considered.

    3. Reviewer #1:

      This study dissects the role of LD associated protein HILPDA in triglyceride and LD homeostasis in hepatic tissue. Using a mouse tissue-specific HILPDA KO, live cell imaging, and lipid analysis, it proposes that HILPDA promotes TAG storage in LDs independently of ATGL regulation. Instead, HILPDA is proposed to interact with DGAT1 and promote TAG synthesis/storage.

      This is an interesting and potentially exciting study that provides a new insight for HILPDA in liver fat storage. The proposed model differs from previous literature that proposes HILPDA regulates lipolysis via ATGL. Unfortunately, while the data presented support a potential role for HILPDA in DGAT regulation, a clear mechanism is not identified. The first half of the paper that phenotypes loss and over-expression of HILPDA is thorough and conclusive. The latter half of the paper, investigating the interplay between HILPDA and DGAT1, appears more preliminary.

      The critical issue in this study is that the nature of the HILPDA-DGAT1 interaction is not well defined. HILPDA over-expression is shown to increase DGAT1 protein levels, but the specific mechanism underlying this is not further dissected. Furthermore, it is still unclear whether this interaction is direct, or merely stochastic due to the fact that both DGAT1 and HILPDA reside on the same LDs in the experiments presented. More biochemical investigation as to whether these proteins physically interact in their native states, and if so whether that interaction affects DGAT1 enzymatic activity directly or allosterically, is required. Without this the study is mainly descriptive.

      Major concerns:

      1) Fig 4: overnight and acute fatty acid addition experiment: The authors propose that HILPDA enriches at sites where new fatty acids are being processed. Can you demonstrate that both these fluorescent FA species are even being incorporated into TAG during the time periods associated with the microscopy? An alternative explanation is simply that HILPDA localizes to regions of the cell where FA esterification or incorporation into other lipid species is occurring. TAG is potentially only one of many fates for these FAs. Can DGAT1/2 be colocalized with HILPDA in these experiments? Alternatively, what happens in these experiments if DGAT inhibitors are co-added with the FAs?

      2) Fig 5H: The DGAT activity assays indicate that HILPDA over-expression increases the incorporation of fluorescent FA and DAG into TAG, but it is unclear as written whether these assays are normalizing for DGAT1 protein amount. Does HILPDA over-expression enhance DGAT enzymatic activity in this panel, or merely promote TAG synthesis here by the increased total DGAT protein level noted later in the study? This is a clear distinction in mechanism, and needs to be dissected further.

      3) Fig 6/7: DGAT1-HILPDA interaction. The data presented in Fig 7 indicate that DGAT1 and HILPDA co-localize in cells and potentially are in very close proximity with one another. However, the data as presented are not enough to indicate whether these proteins directly interact. Do these proteins immunoprecipitate with one another? Some biochemical evidence for their interaction is necessary

      4) Fig 7: relatedly, the mechanism by which DGAT1 is increased in protein level from HILPDA is also unclear. Is the protein more long-lived, or stabilized in the ER when HILPDA is over-expressed? Again, protein biochemical analysis would be helpful.

    4. Preprint Review

      This preprint was reviewed using eLife’s Preprint Review service, which provides public peer reviews of manuscripts posted on bioRxiv for the benefit of the authors, readers, potential readers, and others interested in our assessment of the work. This review applies only to version 2 of the manuscript.

      Summary:

      This study further characterizes the role of lipid droplet (LD) associated protein HILPDA in LD biology. The authors propose that HILPDA promotes triglyceride (TAG) storage in LDs by a mechanism independent of ATGL, through activation of DGAT. This is a potentially interesting finding, however, as detailed by the reviewers below, the data presented do not identify a mechanism for how HILPDA affects DGAT.

    1. Reviewer #3:

      This study examines the role of iron-sulfur clusters in M. tuberculosis adaptation to nitric oxide (NO) and pathogenesis. The study uses transcriptomics to identify genes regulated by NO in vitro and then genetically and biochemically characterizes the role of SufR in responding to NO, modulating metabolic adaptations and promoting pathogenesis in macrophages and infected mice. The topic of this study is highly significant as it defines new mechanisms by which M. tuberculosis adapts to host NO. The manuscript includes numerous strengths including rigorous transcriptomic studies, well-defined physiological studies of wild type M. tuberculosis and thorough biochemical characterizations of SufR protein by spectrometry and DNA binding studies. However, the study suffers from a major experimental flaw that makes interpreting the conclusions from the genetic studies very difficult. The knockout of the sufR gene (which is a proposed repressor) also disrupts the NO inducibility of the downstream suf genes. Due to this polar effect, most of the experiments show partial or poor complementation. This complexity in the genetics raises questions about which aspects of the phenotype are directly controlled by SufR and which are controlled by the disregulated suf genes or possibly unlinked mutations. This major issue impacts a significant portion of the data and needs to be experimentally addressed to ensure that the specific function of SufR is defined by the studies. Overall, this is an ambitious, potentially exciting study, but suffers from a major flaw in the genetics that renders the major conclusions uncertain.

    2. Reviewer #2:

      The manuscript by Anand et al. describes very interesting work into the characterisation of M. tuberculosis response to NO stress. The authors identify the SufR transcriptional repressor as a sensor of NO and further show that the 4Fe-4S cluster bound to the holo-protein plays a central role in this response. Interestingly, their results indicate that SufR regulates both the suf operon and the DosR regulon in response to NO. In addition, they identified a palindromic sequence upstream of the suf operon (and some nine other genes) that holo-SufR could bind to. These results collectively indicate that SufR integrates host response to Fe-S cluster homeostasis in Mtb, providing many important contributions to the field. There are, however, several concerns and areas that need improvement and better explanations.

      Major comments:

      1) The most puzzling finding in this manuscript is the inability of sufR-Comp to complement ΔsufR, with the sufR-Comp strains showing an intermediate phenotype (e.g. Figure 5, panels D and E). The authors mention that the partial complementation is likely due to the restored expression of other sufR-specific genes (like DosR regulon). Even more surprising is the result presented in Figure 5B, in which sufR-Comp shows much slower recovery than ΔsufR. In this case, the authors argue that the induction of the entire suf operon is necessary for the growth resumption. But this doesn't explain why the sufR-Comp shows a slower phenotype compared to ΔsufR. I believe that the authors should provide a more plausible explanation for these observations.

      2) Figure 3 shows that the suf operon is not induced upon NO treatment in ΔsufR and the authors stated that removing 345 bp of sufR for constructing ΔsufR might explain this observation. Whereas the primary and alternative TSS (and I'd assume the promoter region) remain intact in ΔsufR, the authors are urged to come up with a better explanation for this result.

      3) As part of their argument, the authors mentioned that Mtb prefers IscS for housekeeping functions and the Suf system for managing stress, and made comparisons with the well-studied Isc and Suf systems of E. coli. This is against the current knowledge in the literature, and contrary to E. coli, the Isc system in Mtb has reduced to only IscS and the Suf system acts as the major player in the assembly of Fe-S clusters (see point #4 below).

      4) I do realise that the authors have used Acn in their experiments to indicate the effects of NO treatment on Fe-S clusters. However, it is known that Acn of Mtb is a target for Mtb-IscS and therefore the results presented in Figure 4A doesn't necessarily mean that the observed phenotype is due to a direct consequence of defects in the suf system upon NO treatment. The paper by Rybniker et al. (reference #65 in the current manuscript) has shown, using Y2H, activity assays and pull-down experiments, that Acn could make direct interactions with IscS in Mtb. Consistent with this, sufR-Comp didn't reinstate Acn activity. Therefore I am doubtful whether Acn is the correct enzyme to use as an indicator to look into the function of suf operon, where its Fe-S formation depends on IscS.

      5) It is a common practice in the field that not only lung burden but also burden in at least one other organ are shown (usually spleen).

    3. Reviewer #1:

      The manuscript of Amit Singh et al. describes a set of experiments that starts with looking at the transcriptomic response towards NO stress. A large number of genes show altered expression, including the Suf operon. They decide to study the Suf operon, whose encoded proteins are involved in [Fe-S] Cluster Assembly in more detail.

      Some of their findings include: that Mtb SufR is a major regulator of Fe-S cluster biogenesis in Mtb under NO stress, that SufR contains a redox-responsive 4Fe-4S cluster, that functions as a repressor and that a sufR mutant is slightly attenuated in mouse infection experiments. Although the results are convincing and important, my major problem is that in fact all of these findings have been described previously, mainly by M. Pandey (Scientific Reports 8:17359 - 2018) and D. Willemse (Plos One 0200145 - 2018). The current manuscript more specifically focuses on the role of NO in this process, but this is, in my opinion, a minor advance, as the effect of NO (and H2O2) was also reported previously.

    4. Preprint Review

      This preprint was reviewed using eLife’s Preprint Review service, which provides public peer reviews of manuscripts posted on bioRxiv for the benefit of the authors, readers, potential readers, and others interested in our assessment of the work. This review applies only to version 3 of the manuscript.

      Summary:

      Reviewers acknowledge that your submission reports some interesting results on the relationship between Fe-S and the response to NO in Mycobacterium tuberculosis. That said, several concerns were raised regarding genetic complementation and novelty.

    1. Reviewer #3:

      In this article, the Authors study the link between alpha-synuclein (α-syn) inclusions, neuroinflammation and neurodegeneration in mice injected with α-syn pre-formed fibrils (PFF) into the striatum. While this is an important question in the context of Parkinson's disease (PD), both from a pathophysiological and a therapeutic point of view, the present work seems too preliminary at this stage.

      1) The Authors conclude that microglial activation in PFF-injected mice underlies neurodegeneration in this animal model. However, this is a correlative observation and no mechanistic experiments are included to confirm a causal relationship between the inflammatory response and cell death in these animals.

      2) Another major conclusion of this study is that diffusible oligomeric α-syn species, in contrast to fully-formed α-syn inclusions, are the major drivers of microglial activation in these animals. However, the distinction between α-syn oligomers and inclusions/aggregates is not well characterized in the present work. While the Authors performed some PK digestion experiments (i.e. indicating a pathological insoluble/aggregated beta-sheet conformation) and proximity ligation assay (PLA) experiments (i.e. to detect α-syn oligomers), these assessments have not been systematically performed and quantified throughout the different brain regions of PFF-injected mice, with only a couple of qualitative images shown in Fig 1B&C (in which α-syn oligomers are also apparently seen in PBS-injected animals).

      3) As an index of α-syn "inclusions", the Authors mainly used immunohistochemistry for phosphorylated α-syn (pSyn). While pSyn has been extensively used as an index of PD pathology, it can also be seen in tissue from control subjects (e.g. Antunes et al. 2016) and may also result from a non-specific cross-reaction with other phospho-proteins, such as phosphorylated neurofilaments (e.g. Sacino et al. 2014). In addition, the Authors did not include the full quantification and statistical analyses of pSyn signal in the different regions of the different experimental groups (they only mention in the main text some percentages of signal coverage in different brain regions of these animals without any statistical quantifications).

      4) To distinguish between the effects of PFFs versus oligomers, the Authors also injected some additional mice with α-syn oligomers. However, the experiments with α-syn oligomers are only qualitative and were performed in a very limited number of animals (n=3) in a single time-point (i.e. 13 dpi), thus precluding a conclusive comparison with the experiments in PFF-injected animals. In addition, the characterization of α-syn PFFs vs α-syn oligomers is limited to a non-denaturing Western blot (Supplementary Fig. 1) and it is not clear why for intrastriatal injections, α-syn oligomers were used non-sonicated whereas α-syn PFFs were sonicated.

      5) The level of PFF-induced dopaminergic nigral degeneration that the Authors observe at 90 dpi, although statistically significant, is quite weak (16% cell loss). In the original description of this model by Luk et al (2012), dopaminergic nigral degeneration was not statistically significant until 180 dpi. Therefore, later time-points would be needed to clearly assess the link between α-syn inclusions, inflammation and neurodegeneration. Also, while neurodegeneration in the substantia nigra was assessed by stereological cell counts of intrinsic dopaminergic nigral neurons, it is not clear why in other pSyn-containing and non-containing areas (such as the frontal cortex or hippocampus) neurodegeneration was assessed instead at synaptic level, which may reflect impairment of cell bodies projecting to these areas instead of degeneration of intrinsic neurons within these brain regions.

      6) The Authors indicate that they used both male and female animals throughout the article. However, it is not indicated how many animals of each sex have been used and if there is a potential effect of sex in their results, which could be interesting to determine.

      7) From an experimental design point of view, it seems quite odd to inject animals at different ages if the aim is to assess the temporal dynamics of PFF injections at two different time-points. Because mice of different ages might be differentially susceptible to α-syn PPFs, it would seem more important to ensure that the animals have the same age at the time of the injection rather than have the same age at the end of the two different end-points. It is also not clear why the animals were obtained from two different vendors (i.e. Charles River or Janvier Labs).

      8) For statistical analyses the Authors indicate that the values of the different parameters analyzed in ipsilateral and contralateral hemispheres from control (PBS-injected) animals were grouped, in contrast to PFF-injected animals in which ipsi and contralateral hemispheres were analyzed separately. This is justified by an apparent lack of statistical differences between ipsi and contralateral hemispheres from control animals for the different parameters analyzed. However, this is actually not shown. In absence of this information, it is not possible, for instance, to determine the level of Iba1-positive microgliosis induced by PBS injection itself within the ipsilateral hemisphere.

      9) Microgliosis (i.e. Iba1 and/or CD68 immunohistochemistry) has not been systematically performed and quantified in all different brain regions, experimental groups and time-points.

      10) The transcriptomic analysis is interesting but the Authors did not validate any of the differentially-expressed genes (DEGs) detected. Also, how are "most highly changed DEGs" defined as? Does it depend on the p-value or on the fold change?

      11) A full list of DEGs and all results from the enrichment analysis for GO terms should be provided as supplementary data.

    2. Reviewer #2:

      Garcia et al. aims to investigate the relationship between α-syn, neuroinflammation, and neurodegeneration with a model of α-syn seeding in wild-type mice. The authors use transcriptional profiling to assess modest yet detectable responses to the induction of different forms of α-syn species, the characterization of which is primarily based on immunolabeling which has inherent limitations. Moreover, the discussion regarding the pathogenicity of oligomers versus fibrils is important; yet largely unsupported by rigorous characterization of the injected oligomeric species, spread of oligomers in the PFF-injected model, and better experimental controls, thereby limiting the impact of this study. Yet, the observations should be of interest to the field.

      Substantive Concerns:

      1) The authors purport that α-syn oligomers, rather than inclusions, are stronger drivers of neurodegeneration and neuroinflammation. Their primary evidence is that inclusion pathology shows no correlation with either, while oligomers and gliosis but not inclusions are found in the hippocampus of PFF-injected animals. However, no attempt was made to investigate the actual correlation with oligomeric α-syn with gliosis or synaptic integrity, as was done with inclusion load in Fig. 4. PLA was only performed in the hippocampus, while it would be expected that oligomers form elsewhere, especially in regions with inclusions. Similarly, oligomer injections were not employed extensively enough to support the arguments about the pathogenic potential of oligomeric α-syn. The only data shown from this model were of Iba-1 immunofluorescence labeling at 13dpi. While it is remarkable that Iba-1 immunoreactivity is qualitatively very strong at this early time point, it is disputable at best that "the reaction was even stronger than 90dpi after PFF injection" (line 567-568). In addition, why was only the 13dpi time point shown? It is of considerable interest if the microglial response persists with oligomeric injection as it does with PFF injection, or if microglia are able to clear injected oligomers and better prevent pathology. Finally, it is surprising that oligomer injected animals were not included in the transcriptional profiling, which could greatly strengthen the purported link between oligomeric α-syn and microglial reactivity. It may be true that oligomers are the primary driver of neurodegeneration via interactions with microglia, but this was not proven.

      2) What sort of quality control was done on the α-syn preparations? Of important concern is endotoxin contamination, especially since oligomers and PFFs were generated with very distinct procedures. This may be confounding reported measures, especially microgliosis, if endotoxic presence is significant. Additionally, the use of two distinct sonicators may be generating fibrils with different kinetics, which can be detected with Thioflavin T binding assay amongst other methods.

      3) In Supplementary Fig. 1, the authors emphasize monomeric species in their oligomers and PFFs, yet no α-syn monomer-injected controls were employed in this study. Especially since different amounts of PFFs and oligomers were injected, it would be important to account for any noise generated by introducing various amounts of monomeric species.

      4) More extensive investigation about the disagreement between histological and transcriptional data is needed. It may not be accurate that at 90dpi, "major pathological events now appear to take place at the protein level, and are measurable with quantitative histology" (line 607-608) since these protein products were not explored via histology. For example, no biochemical or immunohistochemical assays were performed to investigate the autophagic or mitochondrial changes in this model, and Iba-1 immunolabeling was the only measure taken in pursuit of probing into the immune system. The link between apparent gliosis compared with an alleged downregulation in transcription related to immunity needs to be more thoroughly investigated.

    3. Reviewer #1:

      In this manuscript, the authors seek to assess the pathogenic role of alpha-synuclein (a-syn) inclusions in the neurodegenerative process of PD. To study this important question, the authors administered intrastriatal recombinant murine a-syn PFFs in the brain of wild-type mice (to induce inclusions) and compare the extent of neurodegeneration and microgliosis in brain regions with and without a-syn inclusions. First, the authors demonstrate that neurodegeneration occurs in brain regions with and without a-syn inclusions, a finding that led them to conclude that neuronal injury does not rely on the presence of a-syn inclusions. Second, the authors found a robust immunopositivity for microglial cells in regions with or without inclusions, which was greater than that observed after the intrastriatal administration of 6-OHDA. To note, the authors demonstrate that microgliosis did not correlate with neurodegeneration in the brains of injected mice. To gain insights into the molecular response to the intrastriatal injection a-syn PFFs, the authors performed a bulk gene expression profile analysis and found a host of significant changes in inflammation-related genes and pathways. Because these changes did precede neuron loss, the authors surmise that the microglia contribute to the actual neurodegenerative process and that the microglial response is not merely the reflection of neurons dying.

      This is a mostly well executed study that intends to address an important question. The methods are for the most part appropriate and the results for the most part well presented. However, the enthusiasm of this reviewer for this work is significantly reduced due to the fact that this work is essentially correlative, over-interpretative, and rather incremental. Indeed, this work lacks the level of molecular dissection that is required to reach the strong conclusion the authors put forward. Moreover, this reviewer does not believe that the present data allow any compelling conclusion about the role of microglia in this model to be made and does not understand why and how this work contributes to our understanding of "...how the pathogenic properties of "prion-like" a-syn should be viewed." Aside from these general comments, some specific points can also be raised:

      1) A major emphasis is placed on "inclusions" but yet, unless overlooked, it is not clear to what exactly the authors refer to. It is impossible to be certain what exactly the immunopositive structures called by the authors as inclusions are. Perhaps it would be helpful to include some EM characterizations. See Fig. 1.

      2) Using TH as a surrogate of neurodegeneration is often misleading as phenotypic markers can be readily downregulated in stress cells. Thus, whether the reduced signal for TH indicates loss of TH expression vs living neurons is uncertain.

      3) Using IBA1 label microglia (and macrophages) does not tell anything in terms of activation state. Moreover, it is not clear whether the quantification of the signal is the average of the whole structure of interest (likely) and if it is, from where the illustration from the striatum is derived. Indeed, one challenge in using intrastriatal injection is that it causes radial damage (center of the injection site) and depending on where one looks, the magnitude and type of changes may be very different. It is also unclear why a unilateral injection of PFF should induce changes in the SN on both sides.

      4) While the quantification morphological methods are not optimal, the authors provide enough detail to appreciate how the work was done, and given the data generated, the methods used should be acceptable.

      5) Unless one characterizes the phenotype of microglia at a single cell level, it is no longer acceptable to formulate sound conclusions about the role (or the lack thereof) of microglia in neurodegeneration. Indeed, bulk analysis is notoriously biased toward abundant genes which is not necessarily the most meaningful and fails to take into account the heterogeneity of the neuroinflammatory response. Thus, the genomic analysis provided here is of minimal value.

    4. Preprint Review

      This preprint was reviewed using eLife’s Preprint Review service, which provides public peer reviews of manuscripts posted on bioRxiv for the benefit of the authors, readers, potential readers, and others interested in our assessment of the work. This review applies only to version 1 of the manuscript.

      Summary:

      While all three reviewers agreed that the question under investigation is of interest, they also raised a number of issues that decreased the overall enthusiasm for the work in its present form. Indeed, as you can see from the appended reviews, all three reviewers thought that more extensive work is needed to support your conclusion. In fact, new studies were recommended for every major aspects of the study including greater validation of the injected material, of the neuropathology including the quantitative morphology (of note while Rev 1 think that the lack of Stereology is acceptable, Rev 3 does not, which suggests that more technical details and stronger justification of the method you used is required), and genomic analysis such as using more up-to-date methodology to capture heterogeneity of the response as well more extensive validations of the reported changes.

    1. Reviewer #3:

      The authors ask whether and how information about an upcoming choice is encoded by neuronal activities in V1. To address this question, they recorded from multiple neurons in V1 simultaneously, while monkeys performed a delayed orientation-match-to-sample task. They then asked whether and how they could decode the stimulus presented to the animal, and/or the upcoming behavioral report of their decision (choice), from these V1 recordings. They found that the combination stimulus+choice could be decoded, and that bursty neurons were most likely to affect the decoded choice. Moreover, neurons in the superficial cortical layer also appeared to have a stronger choice signal. This suggests that the choice signal may arise outside of V1, but nevertheless be reflected by spiking activity within V1.

      This study addresses an interesting and potentially important question: where do choice signals arise in the brain, and how do V1 activities relate to those choice signals? At the same time, I was quite confused about a lot of the data presented and overall remain somewhat unconvinced. My specific critiques are as follows:

      1) In Fig. 1BC: what are these population vectors? In the case of "C", I assume these are the SVM weights that are used to discriminate between choices, and the data for each choice are pooled over both stimulus types (match or non-match). But for "S+C", I don't quite follow what is going on. Is it the case that you do the decoding just on the "correct" trials (as suggested in Table 1)? This critique should highlight the fact that I failed to understand your main point, about decoding C vs "S+C". Much more writing clarity throughout the paper would help with this, and make it possible for me to evaluate the paper's main claims.

      2) Fig. 1D is claimed to tell us how neurons respond differently under different conditions, but it does not do that. It tells us how SVM decoders weight those neurons differently under different conditions. Moreover the result seems kind of trivial: it shows that "strong weights change more" between conditions. That's not very surprising: you are subtracting bigger numbers when there are stronger weights, so the differences will be larger. Is there more going on here?

      3) In Fig. 2: what time intervals were the spikes summed for the decoding? There are some values given for different window lengths, but when did those windows start? Was it at the start of the "test" image presentation? Or some other time?

      4) It seems like movement is a confound. The claim is that choice is represented in V1. But we know from recent work by Stringer et al. (Science 2019), that movement profoundly affects V1 spiking. So if any movement signals precede the behavioural report, those will correlate with choice and be reflected by V1 spiking. In that case, is it really fair to say that V1 encodes choice? Or, rather, that the pre-report motion of the animal is encoded in V1?

      5) I couldn't find strong support for the claim that decoding is better when using superficial neurons vs. deeper ones. A panel like Fig. 7E (which does this for bursty vs non-bursty neurons) but comparing the different layers would help with this. I realize this result is somewhat implied by the differences in bursty neuron fraction across layers (which is shown), but this claim is central and so should be explicitly tested.

      6) I have concerns about a lot of the statistical tests used in this paper. For example:

      a) Fig. 2D. Should do a permutation test, to randomly assign neurons to "big" vs "small" weight categories, then redo the analysis. That will get p-value much more reliably than the t-test, which assumes (incorrectly that data are Gaussian). Another big issue is that the selection of small vs big can have some biasing effects, so the t-test between the two groups could way overemphasize significance. A permutation test is harder to fool in this way.

      b) Fig 3D statistical test compares the analysis of data with optimized weights to a case of random weights and random permutation. That's not quite fair because you optimize the weights for the real data but not for the null hypothesis you are testing. A better test would be to do random permutations of the data, then train the weights on each random permutation and test on held-out data from that random permutation. It will likely yield similar results to what you've got, but be a more compelling test in my opinion.

      c) Fig. 6B: not sure t-test is right. Are these data Gaussian?

      7) The results in Fig. 9BC seem interesting, but it's hard to parse the network diagrams. Showing 3x3 matrices for the CCM coefficients from neurons each layer to ones in each other layer would help me to evaluate the claim that the superficial layer acts as a hub.

    2. Reviewer #2:

      Here the authors present results examining the possibility of decoding a choice signal from V1. They show that a transfer learning approach that mixes stimulus and choice during training provides information about choice that is slightly better than chance. In contrast, decoding choice directly using a linear SVM results in chance decoding. They then examine potential time-varying structure in the "choice signal" and nicely show that the strongest contributions are from bursting neurons in the superficial layers of V1.

      This is a novel approach to an interesting open problem in systems neuroscience. However, based on my understanding, there are several core issues that need to be addressed.

      Major Issues:

      1) I may have misunderstood, but it is not obvious to me that the "choice signal" that the authors report is a signature of choice and not just a stimulus-driven effect. From what I understand the same image was used during an entire recording session, and the difference between target and test is either 0deg (match) or 3-10deg (nonmatch). A decoder is trained to classify the test orientation (using the correct trials only). Then choice prediction accuracy and "choice signals" are assessed using the nonmatch trials. In this setting, it seems that if there is some tuning to the stimulus orientation and some variability in the responses that eventually influences the choice then you would see a difference in the choice signal as calculated here.

      If the "choice signal" calculated here is present for the same/different responses under the match condition I would be more convinced that this is, in some sense, a representation of choice. The authors mention there were few trials in the IM condition, but it seems valuable to show. Alternatively, and I understand it may not be feasible at this stage, I would also be more convinced if the authors got similar results when the stimulus image varied from trial to trial within a recording session. Barring that, I have trouble seeing how this is a "representation" of choice, except under an extremely loose definition of "representation".

      Unless I've misunderstood something fundamental (which is possible), it seems better to frame these results as "evidence that choice can be decoded from V1 activity at slightly better than chance in this particular task" rather than "a time-resolved code that reflects the instantaneous computation of the low-dimensional choice variable in animal's brain...[that] contributes to animal's behavior as it unfolds" (as stated in the introduction).

      If I have misunderstood maybe the authors can clarify where I went wrong and/or show results from simulations to help me understand why the "choice signal" here is distinct from a situation where you just have purely feedforward effects with noisy sensory encoding in V1 and downstream decision making in a different brain area.

      2) It is also not clear to me why the "zero crossing" is the relevant time point to consider when looking at the timing of the choice signal. The point where the choice signal is farthest from zero seems much more relevant and seems to occur very close to the point where firing rates are the highest. Some clarification on this issue would be helpful. Additionally, it could be worthwhile to test what happens when the data are not z-scored. This seems like it may get rid of the zero crossing altogether. I'm somewhat surprised that there is a difference in the same/different responses after 200ms, but the fact that similar differences appear at <50ms might point to a normalization issue.

      3) I'm also concerned about the interpretation of the "plus" and "minus" and "strong" and "weak" subnetworks. It is not obvious to me whether the decoding weights will be stable. Particularly when decoding from small populations, the weights could be influenced by overfitting and omitted variables. This is a relatively minor concern compared to the above issues, but it could be helpful to explicitly measure how stable the weights are. The authors could show weights from the 1st half and 2nd half of the data or see if the weights change when decoding based on subsets of the observed neurons.

    3. Reviewer #1:

      This article asks the question as to whether V1 encodes a behavioral choice variable using visual information. The authors propose an approach, termed generalized learning, to predict the choice variable using a time-resolved code computing from V1 population spiking, in an experiment that utilizes naturalistic stimuli.

      More specifically, the authors build a decoder to predict the stimulus + choice (S+C) variable, and then utilize it to predict the choice variable. Using this approach, the authors report that population activity can predict the choice variable, relying on the overlap b/w the representation of the stimulus and the choice.

      In addition, the authors identify/study the role of different sub-populations of neurons in enabling the prediction of the choice variable. The authors report that the accumulation of a choice signal at the input of a hypothetical read-out neuron facilitates the prediction of choice from V1 population activity. The authors also report that burstiness represents a useful feature of neurons, which facilitates the accumulation of the choice signal.

      Finally, using an analysis of the intrinsic flow of V1 information with three sub-populations of neurons, the authors report that information about the choice in V1 likely comes from top-down processing.

      Major comments:

      1) In Fig. 2b, I find it difficult to assess how significantly different from chance the S+C decoder performs, compared to the choice only decoder. The authors report data from 20 sessions in Fig. 2 a. It seems to me that if the authors were to use the balanced accuracy (BAC) from these 20 sessions to build an empirical distribution of BAC across the sessions, the 95% confidence region would overlap with 0.5 (chance). Does that sound accurate to the authors?

      The authors do report that they've tested for the significance of the difference in the similarity vectors, and call them "weakly" similar.

      Put more simply, my comment relates to the following, more basic, question: how does one interpret a BAC of 0.55 vs 0.5, in terms of how much overlap this means in the shared representation between stimulus and choice? What if the BAC had been 0.7 for S+C vs 0.5 for C? Do the authors think it possible to make more precise statements about the shared representation?

      Similarly, how does one interpret different degrees of similarity? I understand the interpretation of the angle b/w the two vectors, and that at one extreme lies orthogonality and at the other co-linearity. Can one interpret the cosine of the difference in the angles as an amount of shared representation?

      I think that this represents a point that the authors should expand upon, discuss more thoroughly in the manuscript, namely can we really make a statement about how much the representations of stimulus and choice overlap?

      2) The authors S+C analysis relies heavily on the data collected when the animal chooses correctly. As far I understand, the authors suggest that the incorrect trials add "noise". I find this difficult to understand. Have the authors performed the S+C analysis when the animal chooses incorrectly? I could not understand clearly a) why restricting oneself to correct trials seems crucial, and b) the significance of this from the perspective of the representation of choice in the circuit.

      A true decoder of S+C would have 4 possible outcomes (two that the authors already consider, and two additional ones coming from incorrect trials). The authors focus on two of these. To me, this deserves a detailed discussion.

      I suggest that, very early on in the article, the authors make it clear that the S+C decoder conditions on correct choice, and a) why restricting oneself to correct trials seems crucial, and b) the significance of this from the perspective of the representation of choice in the circuit.

      3) Why do random weights (fig 4a, top right) work well? i.e. the figure looks very similar to (fig 3c). As far as I understand, the random weights come from the empirical distribution of the weights (fig 6a). This seems agnostic to the layer to which a cell belongs. How do I reconcile the authors’ statements about the importance of certain groups of cells to predicting the choice variable?

      4) The authors use different feature extraction for training and testing. The authors train on spike counts (features) and test on binary spiking activity smoothed using a first-order filter (exponential impulse response). One reason I think this might be problematic goes as follows: during training, the authors get a prediction from the SVM for a whole time segment. I have no problem with this. For testing, however, the authors get a prediction for every 1ms bin. How does one translate that into a prediction of choice for the whole window?

      I can understand the argument that testing on a different data set represents a form of transfer learning. My reservation comes from the apparent lack of a prediction on the test set, and accuracies on the test data.

      As they stand, I find the authors’ statement about the differences in the choice signal/zero crossings etc very qualitative. It would be nice to report training and test accuracy, as standard in ML.

    4. Preprint Review

      This preprint was reviewed using eLife’s Preprint Review service, which provides public peer reviews of manuscripts posted on bioRxiv for the benefit of the authors, readers, potential readers, and others interested in our assessment of the work. This review applies only to version 2 of the manuscript.

      Summary:

      Overall, as a group, the reviewers expressed excitement about the topic and questions posed in the paper. At the same time, the reviewers did not think that the data and results of analyses the authors report provide enough evidence here to justify the claim of having found a "representation of "choice" in V1. The following represent two critiques that the reviews have in common (Please refer to the individual reviews for details):

      1) The fact that the authors restrict themselves to "correct only" trials to claim that V1 encodes choice raised eyebrows.

      2) The manner in which the authors conducted the computational and statistical analysis also raised a number of questions/concerns.

    1. Reviewer #3:

      This paper looks at the effect of metal cofactor binding on the aggregation and toxicity of SOD1, which natively binds a Cu2+ and a Zn2+ ion. The authors investigate the WT SOD1, the apo SOD1 and two mutants which do not bind Cu2+ (H121F) or Zn2+ (H72F) in order to look at the effects of the metal binding on SOD aggregation and toxicity. They find by a number of assays and a computational study that Zn2+ rather than Cu2+ is the dominant factor in determining susceptibility to aggregation, membrane binding, etc. Based on this they propose that deficient Zn2+ uptake by SOD1 is responsible for the pathogenic behaviour of some mutants.

      There is a lot of interesting data in this paper supporting this hypothesis (some more so than others), however there are some points the authors should consider:

      1) A potential weakness of the computational estimation of membrane binding affinity is that the WT crystal structure was used for WT, while structure predictions from the I-TASSER server were used for apo and Cu/Zn-deficient mutants. Since one might expect the predicted structure to be of lower quality, it might then have an enhanced propensity for membrane binding via exposed hydrophobic groups? What would be obtained if the I-TASSER server was also used to generate the structure used for WT in this calculation? This point also applies to the computational validation where predicted membrane binding free energies are compared with distance to the Zn2+ or Cu2+ site of the mutants. This again involves a 2-stage prediction - firstly of the mutant structure, then of its binding energy. Maybe the authors can give some intuition as to how this can be sufficiently accurate to be useful?

      2) Correlation functions for A488-SOD1 are shown at the extremes of no SUVs versus a high concentration of SUVs. What happens at intermediate concentrations where there would be more of a mix of bound and unbound populations - can the two components be clearly resolved in the log-linear plots of G(tau)?

      3) I may have missed something, but why does the population of membrane-bound protein saturate at much less than 100%? Is there a baseline parameter for the population at high [DPPC SUV] in addition to Ka? One thing that occurred to me is that membrane binding may quench the fluorescence somewhat, so the amplitude of the membrane-bound population may be lower than it should be, hence this effect; and the differences in folding/misfolding of the SOD mutants may lead to different binding to the SUVs which would in turn affect the relative amplitudes of the two components. This wouldn't affect the fit of the sigmoidal curves, but maybe the relative fraction of slowly diffusing components should not be literally interpreted in terms of a bound population. Rather than "population membrane bound" Fig. 2f could say "Fraction bound fluorescence" or similar? This interpretation would support the authors' contention that H72F is more apo-like and H121F more holo-like.

      4) The differences in the ratio Ksvm/Ksv are basically reflecting differences in Ksv, because the values of Ksvm are all very similar. Thus it may reflect more the differences in non membrane-bound protein than differences in membrane binding, as seems to be the inference in the paper?

      5) The finding of change in secondary structure on membrane binding based on IR data, in particular increase in alpha-helical population, for the apo form and the H72F, is very interesting and strongly supports differences in membrane interaction between WT/H121F and apo/H72F - maybe this data should be included in the main text rather than the SI in fact? To me this seems a more noteworthy change than the modest differences in membrane association constants obtained from FCS.

      6) Aggregation was studied for the reduced form of the disulfides. The authors should motivate why the aggregation is studied using the reduced form of the protein while the prior work in the paper used the oxidized form (I believe?). My knowledge in this area is limited so I'm not sure which is the form more relevant to observed pathologies.

      7) A complicating factor in the perturbation of GUV membranes by the aggregates formed with/without SUVs present is the SUVs themselves. Presumably there is a significant SUV concentration in the aliquots taken from the aggregation reaction - could the SUVs rather than differences in the aggregates be responsible for the difference in the effect on GUVs? A control could be to add just SUVs to the GUV samples.

      8) For the validation, a statistical test should be used to demonstrate the significance of the observed correlations.

    2. Reviewer #2:

      In this manuscript, Sannigrahi et al studied the role of metal binding sites of SOD1 on its aggregation and toxicity. They created a Zn only, Cu only binding mutants as well as Zn/Cu binding-deficient mutant. Zn bearing mutant behaved similarly as wild type protein in terms of membrane binding, aggregate formation and toxicity, while Zn/Cu deficient mutant behaved similarly to Cu bearing (no Zn) mutant. They conclude that Zn binding pocket is crucial to keep the protein in a healthy state and in the absence of Zn binding, protein aggregates especially in the presence of membranes. Lastly, they investigated real disease mutations and sampled two mutations with different degrees of Zn binding, and confirmed the same trend; if the Zn binding pocket is influenced, mutation is more severe.

      I am not an expert of this particular biological question (ALS and role of SOD1), but I evaluated the technical aspects of the manuscript.

      In general, the manuscript is well written, the messages are clear and the conclusions are supported by data. I have only minor points.

      1) Figure 2a - how many times were the experiments performed? Do the authors show the average of multiple measurements?

      2) Figure 2e - it would be useful to show which residues interact with the membrane in the computational model.

      3) "The apoaggm appeared to exhibit network of thin aggregates (the average size was found to be 700-800 nm with an average height of 6-8 nm) which were found to be connected by the spherical DPPC vesicles (Figure.3e, inset; Figure. 3f)." Is it possible that H72F variant (or both mutants) induces a curvature or binds only curved membranes? Authors can address this by looking at the aggregation in GUVs.

      4) It would be interesting to see if the binding and aggregation of the Apo and H72F is dependent on membrane composition.

      5) In Figure 4, why didn't authors use fluorescently labelled proteins they used in Fig3, they could see the aggregation specifically, and curvature effect as well as membrane deformations. GUV pore formation can also be seen directly by fluorescent proteins in the solution.

      6) I can understand that authors picked two known mutations (G37R and I113T) to match their own mutants, and to represent a severe and a mild mutant, but it would be very useful and a lot more convincing if they also picked an intermediate mutant that is not as severe as I113T and not as mild as G37R.

    3. Reviewer #1:

      Sannigrahi et al. report the investigation of structural determinants of membrane insertion and aggregation of Cu-Zn superoxide dismutase (SOD1), an enzyme that is implicated in motor neuron disease. The authors combine mutagenesis experiments with a variety of techniques, involving tryptophan fluorescence, FTIR, AFM, Tht fluorescence, FCS, optical microscopy and computer simulation. They arrive at that conclusion that conformational change and site-specific metal binding modulate membrane insertion and aggregation of SOD1.

      Identifying the origins of SOD1 dysfunction and aggregation can have important implications in the development of therapeutic strategies for motor neuron disease. The underlying molecular biology is not well understood. The study by Sannigrahi et al. is an integrated approach involving an impressive number of complementary methods. However, the conclusions put forward are not sufficiently supported by the data presented. The applied methodologies yield data of insufficient resolution to draw the detailed molecular picture presented. Additional experimental work would be required to substantiate or provide evidence for the findings.

      1) The statistical mechanical model (WSME) is coarse-grained. It e.g. considers three consecutive amino acid residues as a block. It is therefore of limited suitability to study the effects of single-point mutations and metal-binding or conformation and aggregation.

      2) The effect of mutation and Zn/Cu-binding on Trp fluorescence spectral properties of SOD1 is marginal (Fig. 2a). Likewise, the far-UV CD spectra shown in supporting information show marginal changes. The broad spectral characteristics of far-UV CD defies an accurate, quantitative deconvolution of secondary structure content. No solid conclusions concerning a conformational change can thus be inferred. FTIR spectra are broad and smooth (i.e. lack significant sub-structure) (Fig. 2b, c). Their deconvolution in seven discrete sub-states appears ambitious and error-prone.

      3) The authors propose to determine membrane affinities of SOD1 and mutants thereof by applying extrinsic fluorescence modification and by measuring binding to artificial micelles using fluorescence correlation spectroscopy (analysis of diffusion time constants). Extrinsic fluorescence labels are hydrophobic compounds and supposedly tend to strongly interact with membrane lipids. This will provide an artificial bias of conjugates to micelle membranes. Control experiments are required to rule out effects of the labels.

      4) The influence of mutation on stability and conformation of SOD1 is unclear. Mutations H72F and H121F, introduced to alter metal binding, may as well have effects on stability and conformation (folding) of the entire domain, irrespective of the metal-bound/unbound state. Mutation itself may lead to unfolding and aggregation. Mutation of a histidine to a phenylalanine, as applied by the authors, may have disruptive effects on protein structure because a small side chain is replaced by a larger one. Thermal and/or chemical denaturation experiments, carried out on isolated protein material and mutants thereof, and their analysis are required to assess the effect of mutations on folding and stability.

    4. Preprint Review

      This preprint was reviewed using eLife’s Preprint Review service, which provides public peer reviews of manuscripts posted on bioRxiv for the benefit of the authors, readers, potential readers, and others interested in our assessment of the work. This review applies only to version 2 of the manuscript.

      Summary:

      The reviewers have discussed the reviews with one another. They acknowledge the integrated approach taken by you and your co-authors and the amount of data presented and discussed. However, the reviewers raise major concerns regarding both experiments and computer simulations. Not all conclusions are justified by the data presented and additional data are required.

    1. Reviewer #2:

      General assessment

      The manuscript of Zhang and colleagues studied the expression of PACAP and PAC1 mRNA in inhibitory and excitatory neurons in the entire mouse brain by using dual ISH method. Additionally, a behavioural test is carried out to provide a functional role for PACAP/PAC1 on olfaction and defensive behaviour followed by cFos examination of selected brain regions to indicate the role of PACAP and PAC1 in such behavioural outputs.

      Summary

      In my view, this study has two parts that could work separately.

      Part 1: the PACAP/PAC1 characterization is well designed and executed. The result description is lengthy and sometimes confusing. Figures and tables (including the supplementary information) are clear and informative. The authors decide to not show Vipr1/Vipr2 data, which should be reconsidered. Overall, this part of the manuscript represents a nice piece of work and surely will be very helpful to those who wish to work with PACAP/PAC1.

      Part 2: I think this part is the critical one in this manuscript. Starting from section 4, it uses part 1 of the manuscript to review the literature and build a neuronal circuit with PACAP/PAC1 that makes for behavioural processes. It is literally a review inside the results section. The schematic figures are interesting but also quite speculative regarding brain signalling since the authors did not perform any experiment to investigate the pathway of PACAP and the literature is scarce. Moreover, the role of Vip receptors were completely neglected here.

      Behavioural test: the authors decided for the predator odor paradigm based on the involvement of PACAP on the defensive circuit. However, a global PACAP KO is used instead of specifically targeting a brain region or a neuronal population. Not that this is not interesting, but the entire specificity applied in the first part of the study was not used to find a functional role for PACAP. Despite the cFos analysis demonstrating reduced activity in several brain regions in PACAP KO, the specific role of PACAP in such regions and the importance of each of the three PACAP receptors remained unknown. Also, the use of a global KO inhibits the understanding of the excitatory/inhibitory balance that perhaps the PACAP system may play a role. Moreover, due the specific requirement of the olfaction sense in this test (the considerable expression of PACAP on the olfactory bulb), it is not clear how much the olfaction function is affected in PACAP-deficient mice, and thus, consequently affect the defensive/fear circuit. Finally, is the change in locomotion found here due to a fear response or a hyperlocomotor activity?

    2. Reviewer #1:

      Zhang/Hernandez et al provide a fascinating and comprehensive dataset of the distribution of PACAP (Adcyap1) and PAC1 (Adcyap1r1) mRNA expressing cells in most regions of the mouse brain. Using dual (two-colour) in situ hybridization (DISH) they go further than the Allen Institute ISH datasets by revealing the co-expression with common neurotransmitters (VGAT, VGLUT1, VGLUT2) as well as linking expression to a variety of physiologically and behaviourally relevant neural circuits. Among their observations, they observe a subpopulation of PACAP-expressing CA3 neurons, find that dentate mossy cells express PACAP with a particular septo-temporal distribution, as well as prominent expression in neurons of the bed nucleus of the anterior commissure. They report overlapping PACAP/PAC1 cell groups and also find that PACAP knockout mice exhibit impaired predator odour responsiveness and reduction in neurotransmitter expression in PACAP-related regions. This is a valuable and important study on PACAPergic brain regions in mice, especially relating to the hypothalamus, but would benefit from a reorganisation to improve the presentation of data, and further quantitative criteria to strengthen the observations.

      1) The paper would benefit from a reorganisation, especially when referring to figures and tables. There are a very large number of abbreviations. A list near the beginning of the manuscript would help the reader, and would also shorten the figure legends and improve readability/flow. For the non-expert, some areas should be labelled/highlighted separately or provide more information in the figures, e.g. line 184 'ACA and the entorhinal cortex' one has to search the figure legend, find the number then search the figure panels to find the location of these brain regions. Abbreviations and brain region names should be consistent, e.g. line 241, ACC is used in text, but ACA in figure and legend. Unless mistaken, Table S1 is not mentioned in the text. Figure 9 is first mentioned in the Discussion (line 780). Since these are valuable data, refer to this figure in the main Results section in terms of the knockout. Figure S1 is very informative, but requires a lot of searching to find the panel that is referred to in the text. In Figure S1-7/7-M, panels M1-4 are identical to Fig 1E-H and the scale bar in M3 is different to 1G.

      2) In several places there are anecdotal statements and it is not clear about the reproducibility of the results. The methods for quantification (including those mentioned in Table legends) should be included in Methods. For animals, please check and state the total number of mice and rats used in the study, and whether EGFP mice were also used (as referred to in line 191). In line 816, what is a group?

      For c-fos experiments, how were these cells counted, how many sections per mouse, what was the section thickness, how were the values calculated (mean, absolute numbers). Was fos counting done blind to genotype?

      Was there variation between animals in terms of expression levels/strength? Case/animal numbers in figures would help. It is not clear what is meant throughout by statements such as 'strongest'. Is this by density in cells or number/intensity of puncta? For example, section 3.1, retina. What is meant by 'higher percentage than previously reported' (line 148)? Is this referring to both previous reports in mice? Also see Engelund et al Cell Tissue Res 2010. How many samples and/or mice were examined and how were ganglion cells counted?

      Similarly, lines 174 and 182-183, cortical expression in different layers, how were the values of 80% obtained? Again line 196, 'highest expression level of PAC1 among all brain regions' is a strong claim, how was this quantified? Line 249-251, need references/evidence for observations of mouse claustrum percentages. Line 272, 'more than 90%'. Line 463, 'the highest expression of PACAP was observed in the MnPO'.

      Line 484 in terms of the olfactory pathways, is there evidence of co-transmission or is this a hypothesis?

      Some claims will need careful revision. E.g. in the Fig 5 legend, the last sentence contradicts line 286.

      In line 187, the finding that 100% of the 3 GABAergic subpopulations expressed PAC1 is a big claim, yet there is no quantification to back this up. How many brain regions were examined, how many mice, sections, counted cells etc.? If it just refers to the primary somatosensory cortex, was it all or some layers?

      Table 2 (also applies to parts of Table 1), do blank areas of the table mean not examined? Or should there be '-' in these areas? For example, the medial septal complex contains vglut2 expressing cells but the corresponding row/column is blank.

      Line 191-193, there is the claim that PACAP mRNA was not found in cell body layers, but in Table 1 it is reported that there is weak expression in VGLUT1+ cells. Since VGLUT1 cells are in the pyramidal cell layer, this seems contradictory. It would be helpful to have a higher power image of CA1 (as for rat in Fig S2). Could expression outside this layer be in subpopulations of GABAergic neurons? Were these examined (blank in Table 1)? DG is also missing from Table 1. PAC1 expression. Line 195, claims it is selective for VGAT cells. But there are clear examples of VGAT- cells in Fig S3B expressing PAC1. What are these?

      3) Suggestion about paracrine/autocrine signalling. Is there evidence in literature for such a role? This seems speculative without immunohistochemical evidence. Hannibal 2002, carried out at both the protein and mRNA levels, showed axon terminals in multiple regions. Can these be mapped to the regions that express PAC1 in mice? Is there any evidence or could the authors comment on the existence of presynaptic PACAP receptors? Expression of PAC1 mRNA does not imply that the cell would express the protein exclusively along its somatodendritic membrane. 'Classical' neurotransmission presumably could occur in PACAP/PAC1 rich regions via local axons in addition to long-range axons.

      4) The observation of PACAP in part of temporal CA3, which the authors refer to as CA3c, has in fact previously been defined as CA3vv, corresponding to the coch expressing domain (see Thompson et al Neuron 2008, Fanselow and Dong Neuron 2010). PACAP may indeed be an additional marker along with calretinin for this principal cell subpopulation, and they may want to revise their model or refer to these earlier papers.

      5) PACAP KO. Some clarification would be welcome in terms of animal cohorts. Please state the experimental unit (i.e. n=9 mice/group). In D, the freezing data show only 8 mice, was one pair excluded due to lack of freezing in an animal, as for jumping mice in C? In Ai, Aii, Bi, Bii, does this show the traces for the total time?

      In the separate experiment (lines 630-635), was n=3 a separate cohort of mice or from the N=18 total as stated in the methods? Is the n=3 per group or total mice? This may require an increased sample size for this claim, or show quantification/statistical tests. For this test, were experimenters also blind to the genotype? The last sentence is difficult to follow.

      For the behavioural tests, please include details about whether the wooden boxes, room and experimenter were familiar to the mice before the test (which could affect variability), whether mice were tested at the same time of day, and if KO and WT animals were housed together.

      In the Discussion, ~line 797, can the authors comment on or provide evidence of possible developmental changes / compensatory mechanisms occurring in the KO animals.

    3. Preprint Review

      This preprint was reviewed using eLife’s Preprint Review service, which provides public peer reviews of manuscripts posted on bioRxiv for the benefit of the authors, readers, potential readers, and others interested in our assessment of the work. This review applies only to version 2 of the manuscript.

      Summary:

      The manuscript of Zhang and colleagues studied the expression of PACAP and PAC1 mRNA in inhibitory and excitatory neurons in the entire mouse brain by using dual ISH method. Additionally, a behavioural test is carried out to provide a functional role for PACAP/PAC1 on olfaction and defensive behaviour followed by cFos examination of selected brain regions to indicate the role of PACAP and PAC1 in such behavioural outputs. The reviewers believe that this is a valuable and important study on PACAPergic brain regions in mice, especially relating to the hypothalamus, but would benefit from a major reorganisation to improve the presentation of data, and further quantitative criteria to strengthen the observations.

    1. Reviewer #3:

      The authors touch upon a highly relevant issue. Non-synaptic peripheral interactions (NSIs) are of interest to the broader neuroscience community as they are typically left in the shadow of the more prominent network studies. The authors compare a simple computational model of pure NSI with the established model of lateral network inhibition, concluding that NSIs perform better in odour mixture identification and source separation. To achieve a comprehensive model study that would become a definitive reference in the field, I identified a number of required improvements with respect to clarity, validity, and interpretation of the model.

      1) Model approach

      The model mixes different methodological approaches and model description overall lacks clarity. The model could be severely streamlined by omitting unnecessary/unwanted simplifications and complications.

      The ORN binding rate model (Eqns.2+3) and ORN-ORN interaction (Eqn.5) are clear (see also #2) and generate activation variables x with adaptation y.

      The authors then claim to use a "biophysical spike generator", which in my eyes is not true. Rather, transfer fcn (4) generates a firing rate nu, subsequently used as intensity for stochastic point process realizations (non-homogenous Poisson, see minor #1). The Poisson assumption is surprising and ref. Kaissling et al. (2014) incomplete. Nagel & Wilson (2011) argue for Poisson-like transduction process and subsequent adaptation in the spike generating mechanism, which in a biophysical conductance/current based model generates beneficial non-renewal properties (Farkhooi et al., 2013). Omitting Eqn.4 and adaptation variable y in Eqn.3+5, using x plus noise (Poisson transduction events?) as input to a biophysical spike-generator model would elegantly separate transduction and spike generation, and naturally implement spike frequency adaptation.

      The next step is confusing: each ORN spike is transformed into a binary signal of a certain duration and amplitude (it took me quite a while to figure out what is actually meant with spike height and width). This seems an unnecessary and unwanted complication, reminiscent of simpler binary models. The biophysical voltage model of the PN includes short synaptic (tau_s) and long adaptation (tau_x) time constants that ensure the temporally extended effect of each incoming spike and synaptic amplitude is encoded as alpha_ORN. Thus, omitting the 'spike block' of height and width should be feasible and render the model more biologically realistic and transparent.

      The authors further introduce a post-hoc model for precise ORN-ORN correlations. Considering the other model simplifications (list in Discussion) this seems a rather unmotivated complication and its effect is not explored. The experimentally observed correlation could stem from either competition of co-housed ORNs or from antennal lobe network interactions affecting ORN axons. The former was explicitly excluded from the model and the latter is not captured.

      2) Model interpretation

      One major concern is the model reduction to two ORN types with exclusive odour sensitivity, which might overemphasize the NSI effect. Tuning of receptor types can be rather broad (e.g. Wilson et al., 2004). Related is the reduction to only two glomeruli. How would the picture change with increasing number of receptor types and glomeruli with a broader receptor tuning model?

      A second major concern is the restricted comparison to the pure NSI and pure LI model. If we assume that LI is present in the AL, the 3rd choice of the combined model should ideally show synergistic effects.

      The conclusion ”information about input correlations is contained in the first part of the response before adaptation takes place" in the NSI model is based on the surplus spike count within a window of 50-150ms of estimated rates above 150Hz (Fig. 8d). The 'encoding' of temporal whiff correlation was seen in the average rate for the LN but not the NSI model (Fig.8c). This looks like an ad-hoc implementation of a new measure to achieve a wanted effect of the NSI model. The authors must motivate this unusual measure with biological plausibility.

      The AL model assumes LN activation by PNs. It has been argued for different species (Galizia 2014) including D. melanogaster (Seki et al., 2010) that LNs receive direct input from ORNs. Previous computational models have used either type of implementation. What is the author's rationale behind their choice and would ORN->LN activation change their conclusions?

      What are the crucial experiments to be conducted for testing model predictions? E.g. transient (temperature-sensitive) genetic suppression of a specific OR type? Optogenetic activation of a specific OR type?

      3) Evolutionary perspective

      The abstract promises that "... results shed light, from an evolutionary perspective, on the role of NSIs, which are normally avoided between neurons..." and I was looking forward to a knowledgeable discussion. The MS would gain relevance on a broader scope if the authors could provide (comparative) arguments. Do some (older) families within the class of insects or other arthropod classes (e.g. crustaceans) lack co-housing of different ORN types? Is there known variation within groups, e.g. between different bee species? Can this be linked to ecological demands?

    2. Reviewer #2:

      In this manuscript, the authors postulate that the observed phenomena of stereotyped colocalization of OSNs in insect antenna coupled with evidence of "non-synaptic interactions" (NSI) can serve an important role in parsing mixture ratios. Parsing these ratios accurately has been of key interest both for the understanding of pheromone recognition, as well as the proposed concept of "concentration invariance".

      The authors perform a nice series of calculations showing that NSI can improve the resolution of synchronous inputs, and conversely, improve the separation between asynchronous inputs. Both aspects are important features of resolving stochastic and intermittent plume information in nature.

      Although I have collaborated in a number of computational studies, my main expertise is in the neuroethology of olfaction, and therefore my comments will be concentrated on this aspect. However, in general the computation performed appears reasonable for the concept to be tackled.

      However, I have a few questions on the rationale for the study, as well as it's interpretation I would like the authors to address. I will separate my concerns into three categories for simplicity:

      1) BIOLOGY: The choice of Drosophila for the calculations is understood and likely necessary as it is the only system for which we have sufficient neurophysiological data at both the periphery and central levels to address this question. However, the concept of co-localization itself is known across the Arthropoda, and varies widely among species. For example, while moths and flies generally have 1-4 colocalized OSNs per sensilla (and these are the two systems that the authors reference), other systems like beetles, ants, and bees have up to 20-30 colocalized sensilla. Locusts, for which Gilles Laurent performed foundational research on blend encoding, have up to 50 OSNs in the same sensilla. Further, while it is true that pheromone blend neurons are often colocalized, this is not always the case.



      Thus, I would like the authors to take some time to consider: If NSIs are important for mixture processing, why do insects like bees (who, as shown by Giovanni Galizia and Paul Szyszka referenced in the manuscript can process mixtures at high speeds) have 20-30 OSNs together? How would this work? 


      2) ENVIRONMENT: While concentration invariance and ratio processing has been shown to be important for pheromone processing in moths and some other cases, the true complexity of odor detection is just beginning to be appreciated. See (https://doi.org/10.3389/fphys.2019.00972) for a nice recent review. First, odors are not always presented as point sources, they are not often without a chemical background, and insects themselves might not always have need for such strict attention to ratio. In the case of Drosophila, one can easily argue that when locating a rotting fruit for oviposition, the exact composition of the fruit odor might be less important, although the flies have specific OSNs to detect it. 



      So, I would like the authors to address - If NSIs are important for mixture processing, what happens when they are not needed, meaning when concentration ratios are not essential for identification? Would they limit the processing otherwise? If the authors disagree with this line of thinking, I would also like them to comment on the evidence that insects always need such fine tuning of ratios in their odor detection.


      3.) OTHER EXPLANATIONS: The authors, as well as others like Tim Pearce and Christiane Linster, have spent considerable time providing computational evidence regarding mixture processing (not just monomolecular odors). While there is time spent on comparing the NSI model to other models ("Comparison with related modelling works"), it mainly focuses on how the current model incorporates more information, rather than on why it performs better in detecting ratios. 

I would like the authors to take more time here to compare the NSI to other mixture processing models (several of which are not referenced) and explain why their model is better, just like they do in comparing how NSI improves ratio processing over LN/PN activity alone. Further, they mention myelination - so can the authors explain how mammals that would need similar attention to ratios accomplish this without NSIs - are there any similarities expected?

      These explanations and additions will greatly improve the relevance of this study to insect science and future research on this interesting topic.

    3. Reviewer #1:

      This is an admirably clear account of how non-synaptic interactions (NSIs) in the ORNs in the insect sensillum might improve processing of odor mixtures with complex temporal structures. The paper methodically goes through the initial constraining to data, comparison with other models, and predictions of the improved signal representation by a model incorporating NSIs.

      The fundamental computational concept here is that the NSIs can carry out highly specific high time-resolution mutual inhibition operations. All else follows directly from this.

      General comments:

      1) My major critique of the paper is that I don't think it adds much conceptually. Higher time-resolution in responses follows directly from the biophysics of ORN interactions in a sensillum. My reading is that the improvements in coding follow directly from this improved time-resolution.

      2) While the authors discuss various limitations of the model by way of simplifications, I would like to point out another by way of network structure: the only pairwise interactions possible here are those encoded by the co-expression of ORNs in a sensillum. Thus the LN network will potentially support a wider range of lateral inhibition interactions than NSIs. There should be some data on this, and certainly the authors should comment on it.

      3) I think that perhaps the authors are missing a possible additional value of NSIs, which is that if the odor filaments are fine enough to excite only a small fraction of sensilla at a time, the NSI computation might be more effective than converging multiple homotypic ORNs into the PNs and then doing lateral inhibition. I don't know if odor filaments on this scale have been demonstrated.

      In summary, I think the paper does a very good job of presenting this model and exploring its implications. However, I found the coding implications to be obvious outcomes of the higher temporal resolution of the NSIs as compared to synaptically mediated lateral inhibition. The well described model of early insect olfaction will be of value to specialists in the field.

    4. Preprint Review

      This preprint was reviewed using eLife’s Preprint Review service, which provides public peer reviews of manuscripts posted on bioRxiv for the benefit of the authors, readers, potential readers, and others interested in our assessment of the work. This review applies only to version 2 of the manuscript.

      Summary:

      The study is a lucid analysis of non-synaptic interactions between ORNs in insect sensilla, with predictions on how these interactions could improve processing of odor mixtures with complex temporal structures. However, the reviewers and I had a number of major concerns with the study.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Please note that the authors have provided a formatted PDF version of this rebuttal, including additional figures and references, via the Open Science Framework: https://osf.io/5acqp/

      Reviewer #1

      This is an interesting and thorough study characterising human iPSC with hetero or homozygous mutation in pi3k pathway that lead to its hyper-activation. They prove that the increased stemness results from enhanced autocrine responsiveness to TGF signalling pathway. The main conclusions are well supported by the presented data. Cutting edge tools and bioinformatic analysis are adequately applied. I have only one important point:

      1) Western blot based validation of TGF pathway activation in wt and mutant iPSCs will be helpful to strengthen the results based on bioinformatic data.

      AUTHORS’ RESPONSE__:__ We thank the Reviewer for the positive evaluation of our work.

      Functional validation of the signalling hypothesis is indeed important, and we did in fact already present supportive data. Current evidence suggests that SMAD2 is the main transcription factor mediating actions of the TGFb/NODAL pathway in an early developmental context [1,2], and we have shown increased phosphorylation of SMAD2 (S465/S467) in PIK3CAH1047R/H1047R iPSCs using RPPA in the two datasets shown in Fig.2.

      We have attempted to demonstrate increased NODAL protein directly in PIK3CAH1047R/H1047R cells, but have been unsuccessful due to poor signal on immunoblotting. We thus opted for functional testing of our hypothesis using the experiment presented in Fig. 5, wherein TGFb (a surrogate for NODAL) is removed from the culture medium. Human iPSCs depend strictly on TGFb/NODAL for maintenance of NANOG expression and thus pluripotency [3,4]. Upon exclusion of TGFb/NODAL from the culture medium of normal human iPSCs, the early responses (prior to overt differentiation) are expected to be: (A) decreased NODAL expression, due to well-established autoregulation [2], then (B) a decrease in NANOG and ultimately POU5F1 (OCT3/4) mRNA levels (see also Introduction, lines 80-90). The evidence in Fig. 5 that PIK3CAH1047R/H1047R fail to exhibit these responses upon exogenous TGFb/NODAL removal supports the notion that these cells autonomously sustain TGFb/NODAL signalling.

      For improved clarity, we have also added the following information to the revised manuscript:

      lines 202-205: “This is consistent with strong NODAL mRNA upregulation and increased pSMAD2 (S465/S467) in PIK3CAH1047R/H1047R iPSCs in the current study (Dataset S2 and RPPA data in Fig. 2, respectively), and with prior evidence of activation of the NODAL/TGFb pathway in homozygous PIK3CAH1047R iPSCs.”

      Reviewer #2

      In this manuscript, Madsen et al have investigated the role of heterozygous versus homozygous PIK3CAH1047R gain-of-function mutation at maintaining stemness of induced pluripotent stem cells (iPSCs). The authors have performed high-depth RNAseq, proteomic, and RPPA analyses to show that biallelic PIK3CA alterations induce stronger activation of the PI3K signaling axis, compared to monoallelic mutations. The authors claim that a higher PI3K signaling dose activates the NODAL/TGF-b pathway, which in turn supports stemness in an autocrine fashion. These are important findings, however, the manuscript and its conclusions can be improved.

      AUTHORS’ RESPONSE__:__ We thank the Reviewer for acknowledging the importance of the work and for their constructive suggestions for improvements.

      The authors have described the role of PIK3CAH-1047R gain-of-function mutation in cancer and overgrowth syndromes. However, cancer associated somatic mutations in PIK3CA are mostly heterozygous. Similarly, PIK3CA related overgrowth syndromes (PROS) are caused by post-zygotic mosaic PIK3CA activating mutation. As such, the relevance of homozygous PIK3CA alterations to these pathological conditions is unclear. The authors should elaborate on the biological implications of their findings.

      AUTHORS’ RESPONSE__:__ We disagree with the Reviewer’s comment which implies that homozygous PIK3CA mutations are not relevant to many cancers. In our previous work [5], we provided evidence that many human cancers harbour multiple PIK3CA mutant alleles. Specifically, among cancers with a unique PIK3CA mutation, approximately 50% exhibit multiple copies according to allele copy number analysis. We further demonstrated that a substantial proportion of cancers have multiple different PIK3CA variants or additional oncogenic ‘hits’ within the pathway. These findings have been supported by other recent high-profile papers [6–8]. Such multiple alterations increase activity of the PI3K pathway beyond the level seen with heterozygosity alone [5,6]. This substantial body of literature renders our PIK3CAH1047R iPSC model system highly relevant for studying disease-relevant, dose-dependent oncogenic PIK3CA activation.

      The Reviewer is correct, however, that PROS is caused by postzygotic heterozygous PIK3CA mutations almost exclusively. Observations in homozygous cells are therefore not directly relevant to the pathogenesis of PROS. On the other hand, the heterozygous cells are closely relevant, being human, carefully matched with isogenic controls, and unperturbed by further manipulations such as artificial immortalisation. Our prior studies demonstrated no clear phenotypes in heterozygous cells in the iPSC differentiation paradigm, despite the rock solid causal nature of heterozygous mutations in PROS. This negative finding, surprising given the dramatic PROS phenotypes, is very important in understanding how best to create disease-relevant PROS models. One intent of the current study was to increase the sensitivity of our transcriptomic analysis, and to combine this with proteomic studies to determine if heterozygous cells really do not exhibit a phenotype. We now show that there are indeed faint echoes in heterozygous cells of the dramatic changes in homozygous cells. We believe that the human growth phenotype is a summative consequence of such small differences in growth behaviours sustained over months and years, highlighting how subtle difference in signalling can lead to dramatic human growth consequences across the lifecourse. Similar observations were also recently made following systematic analyses of oncogenic RAS mutations [9]. The new information we present about heterozygous PIK3CAH1047R cells, while much less “showy” than the cancer-relevant behavious of homozygous cells, we thus contend is very important for understanding of the PROS phenotype and its experimental modelling. To emphasise this point, we have added the following statements to the abstract and discussion, respectively.

      • lines 56-57: “This work illustrates the importance of allele dosage and expression when artificial systems are used to model human genetic disease caused by activating PIK3CA mutations.”
      • lines 104-106: “We discuss the implications of our findings for understanding and modelling developmental disorders and cancers driven by genetic PI3K activation.”
      • lines 333-340: “Finally, our observations are important for future studies seeking to model human PIK3CA-related diseases. The modest changes observed in heterozygous PIK3CAH1047R cells, in sharp contrast to the radical transcriptional alterations in homozygous cells, emphasise the importance of careful allele dose titration when artificial overexpression systems are used to model disorders caused by genetic PIK3CA activation. Our findings in heterozygous cells are also a reminder that very small effect sizes in cellular systems may summate and result in major human phenotypes over a life course. That such minor changes are found in a cellular study of a rare and severe disorder emphasises the challenges of modelling much more subtle disease susceptibility conferred by GWAS-detected genetic associations, where cellular effect sizes are likely to be smaller still.”

        The role of biallelic PIK3CA mutation is reminiscent of compound mutations in PIK3CA which have also been shown to increase PI3K signaling output. However, double PIK3CA mutations confer enhanced sensitivity to PI3K inhibition (Toska et al. Science 2019). Could the authors kindly speculate on this discrepancy.

      AUTHORS’ RESPONSE: We emphasise first that PIK3CAH1047R/H1047R cells do respond to BYL719 at the signalling level, as demonstrated previously [5] and in the manuscript (revised Figure S5; see also additional Western blot below). Our point is that the cells have undergone a switch to self-sustained stemness. That is, while PIK3CA activation was the driver of the initial change in cell state, the induced stemness phenotype is no longer reversed by removal of that trigger, with our data suggesting that this is now driven by self-sustained TGFb/NODAL signalling. This is in line with the role of this pathway in the maintenance of the pluripotent state. We speculate that this may be important in a cancer context where surviving stem cells may permit cancer persistence after toxic therapies, even if short term growth of tumours is reduced by agents such as PI3K inhibitors.

      Our data are not directly comparable to prior cellular data, for example in Vasan et al. [6], due to: (a) use of different cell model system and (b) assessment of different functional responses. We would also sound some methodological notes of caution re some of the prior studies alluded to, as potentially confounding differences in growth rate in the cells studied was not corrected for. It is well-established that IC50 and Emax values depend on cell division rates, and failure to correct for this can result in artefactual correlations between genotype and drug sensitivity (see, e.g., Hafner et al. Nature Methods 2016: “Growth rate inhibition metrics correct for confounders in measuring sensitivity to cancer drugs” [10]**).

      Similarly, the p110 alpha specific inhibitor, alpelisib, is highly effective against PIK3CA-mutant ER+ breast cancer and PROS. As such, the clinical relevance of the insensitivity of homozygous PIK3CA mutation to PI3K inhibitors is unclear.

      AUTHORS’ RESPONSE__:__ Efficacy of Alpelisib in PROS is currently supported only by unregistered observational studies, but is nevertheless striking. It is not relevant to our findings in homozygous cells, as the Reviewer has previously observed, however.

      As for cancer, in a randomised phase 3 trial that compared Alpelisib/BYL719 with fulvestrant to fulvestrant alone, the overall response (irrespective of PIK3CA mutant status) was indeed greater with the combination treatment (26.6 % vs 12.8 %), with a hazard ratio of 0.65 (95% CI, 0.5 to 0.85) in patients with PIK3CA-mutant caners versus a hazard ratio of 0.85 (95% CI, 0.58 to 1.25) in those without a PIK3CA mutation [11]. This trial demonstrated the utility of additional PIK3CA mutant-centric stratification, but a substantial proportion of patients with PIK3CA-mutant tumours (>50%) did not benefit from the BYL719 and fulvestrant combination [11]. However, these observations are not directly relevant to this manuscript and are instead included in a separate manuscript focused on PI3K signalling and stemness in human breast cancers (preprint [12]**).

      Figure 2: The authors have performed RPPA analysis in the presence of 100 nM BYL719. Alpelisib is commonly used at 1 uM concentration for in-vitro experiments, and has a cMax of ~5 uM. We suggest the authors perform western blot analysis to confirm the results of RPPA.

      AUTHORS’ RESPONSE__:__ We carefully chose the optimal concentration of BYL719 to preserve inhibitor selectivity, and to avoid undue toxicity and confounding off-target effects, rather than copying the dose “commonly used”. The Cmax is not relevant to our use of BYL719 in the current study as a precise tool compound. We refer the Reviewer to the known pharmacological characteristics of this compound [13,14]. According to available evidence, it is only a selective PI3Kα inhibitor at concentrations 250 nM (Table below adapted from Ref. **[13]; for formatted version, please see PDF version: https://osf.io/ecmhr/)

      Enzyme

      In vitro IC50 for NVP-BYL719 (nM)

      PI3Kα

      4.6 +/- 0.4

      PI3Kα-H1047R

      4.8 +/- 0.4

      PI3K**b

      1156 +/- 77

      PI3K**d

      290 +/- 180

      PI3K**g

      250 +/- 140

      PI4K**b

      571 +/- 42

      We have previously demonstrated (Fig. 2C in Ref. [5]) that 100 nM BYL719 is sufficient to restore pAKT (S473) levels in both heterozygous and homozygous PIK3CAH1047R to levels observed in WT cells. This is consistent with the RPPA data reported in the current work (Fig. 2B). Of note, while 500 nM BYL719 completely ablates pAKT irrespective of genotype, we previously noted substantial toxicity [5], precluding use of this or higher doses of BYL719 in our model system. This is in line with a recent Nature Cell Biology study by Yilmaz et al. ([15]) which demonstrated the essential growth-promoting role of the PI3K pathway in human pluripotent stem cells; Yilmaz et al. also demonstrate that compared to somatic cells (fibroblasts), human pluripotent stem cells suffer dramatic effects on growth/survival in response to Torin1/rapamycin [15], overall suggesting that this cell type is exquisitely sensitive to inhibition of the PI3K/AKT/mTOR pathway.

      In the present study we have also confirmed that 250 nM BYL719, used for Fig. 5 experiments, has worked as expected at the level of pAKT (S473) as shown in the below Western blot (see also revised Fig. S5; please access PDF version to view Western blot: https://osf.io/ecmhr/)

      Figures 3 and 4: The authors should expand their RNAseq analysis to demonstrate enrichment of stemness and TGFb signaling in homozygous mutant cells compared to heterozygous cells.

      AUTHORS’ RESPONSE__:__ We thank the Reviewer for this suggestion. The unsupervised MDS plot (Fig. 1A) clearly demonstrates the overlap between wild-type and heterozygous cells, strongly suggesting functional concordance and consistent differences to homozygous counterparts. Indeed, the below count table illustrates that the majority of differentially expressed genes in homozygous versus wild-type cells are also differentially expressed in homozygous versus heterozygous cells, including the direction of the change (please access the PDF version for formatted table: https://osf.io/ecmhr/)

      Comparison

      Differentially expressed gene count

      HOMvsWT

      5644

      HOMvsHET

      5764

      HOMvsWT AND HOMvsHET

      4825 (2300 upregulated; 2525 downregulated; 1 discordant)

      We have now performed additional fast gene set enrichment analyses (fgsea; shown below - please access PDF version to view figure: https://osf.io/ecmhr/) using the R package fgsea ([16]) and 14 of the Broad Institute’s 50 Hallmark Gene Set Collection [17], including manual addition of the PLURINET signature [18]. The 14 gene sets were chosen based on their relevance to answering the Reviewer’s question as well as their connection to PI3K signalling. Fold changes for all expressed genes were included in the analyses, without further thresholding in order to minimise bias.

      The results for homozygous vs wild-type comparisons are concordant with our upstream regulator analyses using IPA; as expected, TGFb signalling and PI3K signalling are among the top positively enriched (NES > 1) in comparison between homozygous and heterozygous cells. Unsurprisingly, however, the strength of the enrichments are lower when comparing the two PIK3CAH1047R genotypes.

      We are not convinced that including these surplus data will add value to the manuscript and its main message, however we will leave this decision to the discretion of the Editor (please also refer to our response to the subsequent question from Reviewer 2). Moreover, these data will remain visible in the publicly available rebuttal document.

      The authors should confirm the results of pathway analysis in vitro to show that homozygous PIK3CA mutation confers increased stemness compared to heterozygous mutation.

      AUTHORS’ RESPONSE__:__ This was a key finding in our previous publication [5]. The aim of the current study was to interrogate this phenomenon further through high-depth transcriptomic/signalling analyses.

      Figure 5: Kindly provide direct evidence demonstrating that increased PIK3CA signaling output induces NODAL expression in this experimental setting.

      AUTHORS’ RESPONSE__:__ We have consistently demonstrated increased NODAL mRNA expression (RNAseq data, Fig. S4 and Ref. [5]). Unfortunately, we have been unsuccessful in attempts to obtain good quality immunoblots for NODAL protein in PIK3CAH1047R/H1047R cells (as noted in response to Reviewer 1). We note, in fact, that such documentation of NODAL protein levels, while not unprecedented, is fairly rare.

      Also, please normalize gene expression data to WT cells so it is easy to visualize the changes in NODAL and NANOG expression in homozygous and heterozygous mutants compared to WT iPSCs.

      AUTHORS’ RESPONSE__:__ It is arithmetically more precise to normalise to the highest expression (i.e. that of PIK3CAH1047R/H1047R cells) – thereby avoiding artificial inflation of fold-changes when normalising to very low levels of expression. Ultimately, the relative levels calculated – and the increased expression of NODAL in PIK3CAH1047R/H1047R cells – are identical visually. Only the entirely arbitrary units change. Thus we do not deem normalisation to WT to be necessary or to add value to the analysis.

      Kindly quantify Fig. S5.

      AUTHORS’ RESPONSE__:__ These brightfield micrographs were taken as part of routine practice to monitor cell health during maintenance and experimentation, and are suboptimal for direct quantitation due to uneven illumination background and lack of whole-well imaging. Nevertheless, we have now undertaken quantification as the Reviewer suggests, using individual images taken during independent experimental replicates. The results have been added to Fig. S5 and support our assertion that 250 nM BYL719 had a growth inhibitory effect in homozygous PIK3CAH1047R iPSCs. All raw images and associated data have been uploaded to the Open Science Framework (https://osf.io/hbf7x/). The following short method section detailing the image analysis algorithm has also been included in the revised supplementary material:

      “Colony size quantitation from light micrographs

      Routine cell culture light micrographs were acquired on an EVOS FL digital inverted microscope (AMF4300, Thermo Fisher Scientific) using the 4X or 10X objective (final magnification 40X and 100X, respectively). For quantitation, 4X images were used for colony segmentation with Definiens Developer XD software. Background was detected using a contrast threshold; for this each pixel was compared to those in the surrounding 24 pixels (i.e. a 5x5 pixel box), and pixels with low contrast (between -50 and +50) were classified as background. Remaining pixels were classified as colonies, and any holes (pixels that were not initially classified as being part of the colony due to low contrast) were filled. Edges of the resulting colonies were smoothened by shrinking and then growing the colonies by 2 pixels. Finally, colonies less than 2000 pixels in size were reclassified as background. The area of the resulting colonies could then be measured and averaged over each field of view.”

      Reviewer #3

      In this manuscript by Madsen et al., a comparison of the transcriptome and proteome in heterozygous and homozygous PIK3CAH1047R human pluripotent stem cells mutants is presented. The authors demonstrate marked alterations in expression at both the protein and RNA level of homozygous mutants compared to wildtype, while heterozygous lines exhibit only minor changes. Multiple analytical approaches are employed to investigate network alterations, leading the authors to suggest a TGFβ-mediated rewiring of key pluripotent genes to induce a state of sustained stemness. Madsen et al. conclude with a set of experiments to functionally implicate NODAL/TGFβ autocrine signalling in PIK3CAH1047R dose-dependent stemness. The key conclusions are not convincing. While the unbiased omics approach sets up this study well, the study suffers from a lack of convincing functional assays (cell biological assays) to test their model and tease apart a phenotype for the het cells. More robust functional experiments are required to support the finding the NODAL/TGFβ signalling mediates the self-sustained stemness, particularly because this is the major novel finding distinguished from the authors previous work.

      AUTHORS’ RESPONSE__:__ We thank the Reviewer for their detailed critique. Our perspective on the robustness and novelty of our findings diverges from that of the Reviewer, however, as we elaborate on in more detail below.

      While the authors present a comprehensive omics investigation into alterations between wild type, homozygous, and heterozygous mutants, the critical functional experiments are lacking. In Figure 5, the authors seek to support the role of TGFβ in mediated stemness in the homozygous mutants, however, are not able to directly deplete TGFβ due to technical limitations of the culture conditions. Consequentially, the experiments are primarily built on the use of NODAL withdrawal and stimulation. The data presented thus implicate NODAL in the stemness phenotype, but it's not obvious TGFβ is substantially involved, particularly considering the inhibitor subsequently employed also inhibits NODAL type 1 receptors.

      AUTHORS’ RESPONSE__:__ NODAL and TGFb activate shared signalling pathways downstream from their respective receptors, and indeed they (as well as Activin) can be used interchangeably in stem cell culture, which is common practice [19–21]. Commercially available Essential 8/TeSR-E8 is supplemented with TGFb not NODAL; therefore the factor we have removed is TGFb, prior to any controlled introduction of NODAL (based on strong upregulation of its mRNA in PIK3CAH1047R/H1047R). Any residual TGFb-like ligands will be contributed by Matrigel as outlined in the text (lines 247-251). It is well-established that “NODAL/TGFb signalling” denotes signalling through SMAD2/3/4 (as opposed to BMP signalling through SMAD1/5/8), and this is how we use the term throughout the manuscript. Accordingly, it is functional activation of the “NODAL/TGFb signalling pathway” that we investigate (see also response to Reviewer 1, p.1).

      In summary, we seek not to make a distinct point about TGFb, but rather refer to NODAL/TGFb signalling as a matter of biochemical correctness. For clarity, we now replace mentions of “TGFb signalling” with “NODAL/TGFb signalling” throughout the revised manuscript. We have also revised the legend for Figure 3 to make this clearer.

      Furthermore, there is a paucity of readouts for stemness. For example, a more convincing narrative would include additional expression markers of the core pluripotency network (e.g. OCT4, SOX2, etc.) as well as functional readouts (e.g. NODAL withdrawal and assessment of differentiation) after NODAL stimulation/depletion and comparing across genotypes. Overall, the primary conclusions of this work are not well-evidence by the presented data and the authors should consider additional functional experiments or reframing the narrative.

      AUTHORS’ RESPONSE__:__ We chose the current strategy because we wanted to capture the earliest changes after depletion of NODAL/TGFb/ signalling, prior to any signalling rewiring triggered by differentiation. In fact, we believe that a strength of this study is our observation of differences in critical stemness markers in spite of the short time course. To aid non-expert readers we offered a primer on stemness genes and rationale for the markers chosen in the existing introduction (lines 80-90).

      We have further assessed additional stemness and differentiation marker genes in two independent homozygous PIK3CAH1047R cell lines using a high-throughput pluripotent stem cell scorecard (Fig. S4). This replicates the effect on cell marker genes documented by RT-qPCR in Fig.5, while also showing additional reductions in genes that were upregulated in homozygous PIK3CAH1047R cells (MYC, GDF3, FGF4) and which have previously been shown to be highly expressed in pluripotent stem cells (we have now added this additional clarification to the legend of Fig. S4) [22]. Despite the short term treatment, these data also show that no other treatment but SB431542 is capable of triggering expression of early neuroectoderm markers (CDH9, MAP2 and PAPLN) [23], prior to overt morphological changes in the cultures (Fig. S5; higher resolution images are also available via The Open Science Framework: https://osf.io/hbf7x/). Neuroectodermal gene expression is expected upon inhibition of TGFb signalling in human pluripotent stem cells [24,25].

      A key conclusion of this study is there is a dose-dependent stemness phenotype. As this is not explicitly defined, to this reader, it would imply a graded response between wild type, heterozygotes, and homozygotes in the phenotypic and molecular characteristics. However, as is noted particularly in the omics components of the manuscript, there is in fact "near-binary" alteration in the assayed characteristics. Again, this should be qualified more explicitly, but it is more consistent with the data, which suggests the heterozygotes behave very similarly to the wild types, while homozygotes have substantial alterations. I would suggest the authors consider renaming their descriptions, removing "near-binary" and "dose-dependent" to something like "dose-threshold." This suggests after X threshold of oncogenic PI3K signalling, substantial alterations occur; under this threshold (e.g. hets), changes are marginal. In the event however that there may be a more "dose-dependent" effect, I would expect the transcriptomic and proteomic changes observed in the heterozygous cell lines should be seen in the homozygous cell lines (of which they are likely in greater in magnitude in addition to other changes).

      AUTHORS’ RESPONSE__:__ This appears to us to be largely a matter of semantics. In talking of “dose dependency” we were certainly not implying a graded affect (as the Reviewer points out, our are findings are far from this, suggesting a sharp threshold of dose which triggers widespread changes), and indeed nothing in these words strictly suggests this interpretation. Nevertheless we are sensitive to the fact of the Reviewer’s interpretation of the term, and mindful that this might be shared by other readers. On the other hand talking of a “near-binary” effect seems to us to be an accurate description of our findings. We have edited the manuscript to minimise ambiguity with the following changes:

      • line 49 “dose” replaced with “strength”: “We demonstrate signalling rewiring as a function of oncogenic PI3K signalling strength, and provide experimental evidence that self-sustained stemness is causally related to enhanced autocrine NODAL/TGFb
      • line 102: “This work provides in-depth characterisation of the near-binary PI3K signalling effects seen in hPSCs ….”
      • lines 195, 198, 317: inserted “allele dose-dependent We would also like to take issue with the case that the Reviewer seems to be making that a more graded change in gene expression across heterozygotes and homozygotes is to be expected. As mentioned in the manuscript (lines 206-210), there is evidence for NODAL/TGFb pathway activation in heterozygous cells. Nevertheless given the known temporal, context- and dose-dependent effects of this pathway [1,2,26,27] and, importantly, the widely described biological properties of developmental systems (featuring positive feedback loops, bistability and hysteresis; see Ref. [28,29]), we have no reason to expect that transcriptomic and proteomic changes observed in homozygous cell lines will be reproduced in heterozygous cell lines.

      The manuscript would benefit from more direct comparisons between the heterozygotes and homozygotes.

      AUTHORS’ RESPONSE__:__ Please refer to the additional data provided in response to a similar question by Reviewer 2.

      Further to the above point, as the marginal phenotype observed in heterozygotes is a critical point in this paper, the authors would benefit from including heterozygote lines in the functional experiments presented in Fig 5. Inclusion of the hets in these experiments would instill confidence in this reader that the marginal molecular alterations characterized at the proteomic and transcriptomic level is reflected in the lack of functional stemness-sustaining behaviour.

      AUTHORS’ RESPONSE__:__ The lack of stemness-sustaining behaviour in the heterozygous clones was demonstrated across multiple different experiments in our previous work, and further functional studies of early differentiation in these cells seemed a poor use of resource and very unlikely to give useful insights. Given the major disease phenotype associated with the same genetic change (PROS), the relative lack of phenotype in heterozygous cells was surprising and holds obvious implications for disease modelling (see also response to Reviewer 2, pp.2-3), and for how model systems are “calibrated” against human developmental disease. The aim of the current work was to:

        • Determine whether increasing the depth of signalling and transcriptomic analyses would unmask small but important changes in heterozygous mutants that might have been missed in prior studies (i.e. we actively aimed to increase the power of the study for identification of subtle changes) and *
        • To characterise in greater depth the signalling and transcriptional changes underpinning the robust threshold effect observed for self-sustained stemness driven by PIK3CAH1047R/H1047R. We would further observe that PROS does not feature obvious qualititative errors in tissue specification, but rather excessive growth of more or less normally differentiated tissues. We conceptualise this as reflecting a small incremental growth advantage in normally differented tissues of certain lineages that summates to create a major disease phenotype over months and years.*

      Thus, without the functional and mechanistic experiments alluded to above, the claims/ conclusions are speculative. In particular, the cancer narrative is irrelevant to the study. Considering both the lack of conclusive differentiation experiments or relevant breast cancer experiments, the discussion on differentiation therapy for breast cancer should be removed.

      AUTHORS’ RESPONSE__:__ The reference to cancer links to a computational study of human breast cancers where we specifically looked at the relationship between strength of PI3K signalling and ‘stemness’ [12], both measured using established transcriptional indices. We have included the bioRxiv reference in our revised manuscript (see l.337). While there is an element of speculation in this cancer observation, we do feel it is important and grounded in this and the BioRXiv study, and would prefer to maintain it. However, if editors take a different view it can be removed.

      Reproducibility is a concern for this study. The authors should perform more replicates on their experiments (focusing on technical replicates of the lines employed to discern technical vs biological variability). A challenge in reading this manuscript is understanding which replicates were used for which experiments, and whether they are technical or biological (i.e. different lines). While some of the figure legends note this information, it would be helpful to provide clarity throughout the text. In addition, it should be noted that some experiments (e.g. the RPPA analysis in Fig 2B and Fig S3B) show substantial variability between replicates, but because it appears only a single technical replicate from two different cell lines was used, it is impossible to distinguish whether the variability is of a biological or technical nature. The authors would do well to focus on collecting more technical replicates of fewer biological replicates, and then expand to include more biological replicates if initial biological variation is observed.

      AUTHORS’ RESPONSE__:__ We strenuously disagree with the Reviewer on this point. Throughout this manuscript, we have been transparent and thorough in reporting how experiments were performed, including the number of both biological and technical replicates. Representative examples include:

      Legend to Figure 2A (RPPA dataset in growth-replete conditions): “The data are based on 10 wild-type cultures (3 clones), 5 PIK3CAWT/H1047R cultures (3 clones) and 7 PIK3CAH1047R/H1047R cultures (2 clones) as indicated.”

      Legend to Figure 5: “The data are from two independent experiments, with each treatment applied to triplicate cultures of three wild-type and two homozygous iPSC clones.

      Specifically to address the RPPA studies, and as is clear from the Figure 2 legend, we initially performed RPPA analyses in growth factor-replete conditions with extensive technical and biological replication, arguing against the Reviewer’s point. To aid interpretation, we opted for summarising this large dataset in Venn diagrams (following extensive limma-based statistical analysis, including correction for multiple comparisons and sample interdependence as advised in Ref. [30]). If the Reviewer deems it valuable, we could include a heatmap overview as shown below:

      [To view figure, please access PDF version of this rebuttal on https://osf.io/ecmhr/]

      We took the view that the above representation, while comprehensive, is not particularly informative to the reader. All individual data points for both total and phosphoproteins – with and without normalisation – are plotted as part of separate barplots in the accompanying RNotebook (https://osf.io/d9tca/). These clearly demonstrate that the technical and biological variability in canonical PI3K signalling responses at the level of AKT and immediately downstream of AKT is very low. The same applies to the increased phosphorylation of SMAD2 (S465/S467) in PIK3CAH1047R iPSCs. We include two examples below, and would be happy to include the link to the above RNotebook in the respective Figure legend if the Reviewer deems this helpful.

      [To view figure, please access PDF version of this rebuttal on https://osf.io/ecmhr/]

      The interpretation of the second RPPA experiment (Fig. 2B) in growth factor-depleted conditions is focused entirely on these responses due to their consistency across both datasets (further supported by low-throughput signalling analyses in the previous PNAS publication).

      We had made all raw data and guided analysis scripts for the above RPPA dataset publicly available, and the same is true for all original data as highlighted in the Materials & Methods section. Thus we strongly believe that readers have the opportunity to assess our work and reproduce our analyses/conclusions fully should they wish to do so.

      • Finally, we noted in the initial PNAS paper describing these models that we derived and worked with up to 10 independent homozygous PIK3CAH1047R clones, as well as with 3 and 4 independent heterozygous and wild-type clones, respectively. This exceeds the common use of 2 clones (if at all mentioned) in many similar studies in the stem cell literature (e.g. Ref. [31–34]). In our view, derivation of more than two independent clones is crucial for reproducibility in gene editing studies given substantial variability arising from genetic drift [35,36]. We have consistently shown the phenotypic robustness of our mutant clones across the two studies; note, for example, the low technical and biological variability in both heterozygous and homozygous mutants in the transcriptomic data in Fig. 1A. As noted in the manuscript, the high-depth RNAseq data analysis was performed in different clones and independently of the RNAseq reported in Ref. [5], yet yields highly similar results and confirms transcriptional rewiring of PIK3CAH1047R/H1047R iPSCs.*

      Throughout the text, the authors frequently reference their previous study in PNAS and often the lines of what is novel in this paper vs. reproduction of previous findings is blurred. The authors would benefit from reducing the frequency of referencing their previous study and focusing on emphasizing the novelty of the present findings.

      AUTHORS’ RESPONSE__:__ We have carefully reviewed all instances of citation of our previous study in the manuscript and have reduced their numbers to improve focus on the current findings as suggested. As noted above, however, the current study builds closely upon the findings of the previous work, and referring to these to put the current work in context is important. Indeed, this is reflected in some of the reviewers’ collective comments and questions which are answered by the prior study. We have carefully reviewed the places in which we have cited our previous study and note that except for 2 citations in the Introduction and 3 more in the Discussion, all remaining citations are in the context of linking new and old data, which we believe is important for clarity as suggested by the reviewers. However, if editors take a different view we can minimise this and reduce the number of citations.

      Without functional assays to complement and test their models, this manuscript is not a significant advance.

      AUTHORS’ RESPONSE__:__ While we take the Reviewer’s point that further studies could have strengthened robustness of the evidence supporting a mediating role of NODAL/TGFb signalling in PI3K-driven stemness, we think this assertion is far too sweeping, and neglects numerous facets of the study of use and interest to several fields (as agreed by the other reviewers). To recapitulate some key points of interest/use of this study:

      • Using a carefully derived PIK3CAH1047R iPSC model system and pharmacologically relevant doses of a recently approved PI3Ka-selective inhibitor, we demonstrate that the efficacy of the latter can depend on the strength of PI3K pathway activation and phenotype under investigation – despite expected downregulation of PI3K signalling by Alpelisib, the stemness phenotype is not reversed.
      • We link this to self-sustained TGFb signalling in cells with strong PI3K activation by homozygous PIK3CAH1047R The link between the two pathways and the underlying rewiring are likely to be relevant in other contexts, as observed recently in a breast epithelial model system [37]. Given similarity between human pluripotent stem cells and cancer cells, our findings are of wider relevance.
      • Aberrant PI3K activation has been associated with numerous pathologies, so it is important for the field to have well-characterised model systems with endogenous expression of one of the most common PIK3CA mutations. Our thorough characterisation of PIK3CAH1047R iPSCs validates one such model.
      • To our knowledge, this is the first study to provide a comprehensive and integrated characterisation of isoform-specific PI3K signalling and transcriptomic changes in human pluripotent stem cells. This is important because current knowledge of PI3K signalling in human PSCs is largely based on extrapolation of findings from mouse embryonic stem cells, with many previous studies relying on high concentrations of the non-specific pan-PI3K inhibitor LY294002 (the use of which has been discouraged by the PI3K signalling community [38]).

        I believe the narrative was written for pluripotent stem cell biologists but without robust functional and quantitative cell biological assays to test their models, I don't anticipate stem cell biologists will be very interested.

      AUTHORS’ RESPONSE__:__ The Reviewer is incorrect in his/her assertion about the target audience. PI3K signalling plays a key role in numerous disease and physiological processes as well as in development, and is of broad interest to cancer biologists, genetecists, rare disease biologists, biochemists, cell signallers, and endocrinologists among many others. Indeed we started with a primary focus on disease modelling (cancer, PROS) rather than stem cell biology, but because our findings are significant for the role of PI3K in stem cell biology as well as for these diseases, we aimed to make findings accessible across many of these readers. We refer the Reviewer to our previous response with regards to the significance of this work.

      **Minor Comments:**

      Consider adding gridlines to the MDS plots for clarity of read

      AUTHORS’ RESPONSE__:__ This is a matter of taste, and as we honestly can not see how it would enhance appreciation of the very clear clustering, we have decided to leave the plot in its current form.

      In Fig S2, some of the in-figure labelling is incorrect

      AUTHORS’ RESPONSE__:__ We thank the Reviewer for spotting this. We believe the labelling error to be corrected now and we have further tried to streamline the plot headings, but please do let us know if there is something else which we may have missed.

      In Fig S1C, the authors note poor correlation in the heterozygotes between this and a previous study. It would be helpful to qualify this discrepancy, as it is potentially concerning.

      AUTHORS’ RESPONSE__: The sensitivity to detect differential gene expression is high for large fold changes (as seen in PIK3CAH1047R/H1047R mutants) in transcriptomic studies, but declines rapidly for fold changes in expression lines 126-131: “The magnitudes of gene expression changes in PIK3CAH1047R/H1047R cells correlated strongly with our previous findings (Spearman’s rho = 0.74, p WT/H1047R iPSCs (Fig. S1C), as expected given the smaller number and lower magnitude of observed gene expression changes in heterozygous cells, and the lower depth of previous transcriptomic studies__.”*

      Line 208, the authors state that the small p-value for the homozygotes is suggestive of a dose-dependent effect. This is not the case; it simply suggests a greater probability of the effect being non-random.

      AUTHORS’ RESPONSE__:__ The Reviewer is formally correct, and we apologise for the imprecision of our language. Nevertheless biological effect size is pertinent to the p value determined, and so our statement, while requiring an inductive leap from the reader, is not wholly invalid. To tidy this up and improve precision we have reworded as follows:

      lines 215-217: “This is in keeping with the much lower effect size in heterozygous cells, and consistent with a critical role for the TGFbeta pathway in mediating the allele dose-dependent effect of PIK3CAH1047R in human iPSCs.”

      What does the height in Fig 4B correspond to? It would perhaps be of value to scale nodes based on the significance value.

      AUTHORS’ RESPONSE__:__ 4B illustrates hierarchical clustering of the module eigengenes - the height corresponds to similarity of gene expression. We clarify this in the revised manuscript.

      References

      1 Lee, K. L. et al. (2011) Graded Nodal/Activin signaling titrates conversion of quantitative phospho-Smad2 levels into qualitative embryonic stem cell fate decisions. PLoS Genet. 7.

      2 Hill, C. S. (2018) Spatial and temporal control of NODAL signaling. Curr. Opin. Cell Biol. 51, 50–57.

      3 Xu, R. H. et al. (2008) NANOG is a Direct Target of TGFβ/Activin-Mediated SMAD Signaling in Human ESCs. Cell Stem Cell 3, 196–206.

      4 Vallier, L. et al. (2009) Activin/Nodal signalling maintains pluripotency by controlling Nanog expression. Development 136, 1339–49.

      5 Madsen, R. R. et al. (2019) Oncogenic PIK3CA promotes cellular stemness in an allele dose-dependent manner. Proc. Natl. Acad. Sci. 116, 8380–8389.

      6 Vasan, N. et al. (2019) Double PIK3CA mutations in cis increase oncogenicity and sensitivity to PI3Kα inhibitors. Science (80-. ). 366, 714–723.

      7 Saito, Y. et al. (2020) Landscape and function of multiple mutations within individual oncogenes. Nature 582, 95–99.

      8 Gorelick, A. N. et al. (2020) Phase and context shape the function of composite oncogenic mutations. Nature.

      9 Gillies, T. et al. (2020) Oncogenic mutant RAS signaling activity is rescaled by the ERK/MAPK pathway 1–19.

      10 Hafner, M. et al. (2016) Growth rate inhibition metrics correct for confounders in measuring sensitivity to cancer drugs. Nat. Methods 13, 521–527.

      11 André, F. et al. (2019) Alpelisib for PIK3CA-mutated, hormone receptor-positive advanced breast cancer. N. Engl. J. Med. 380, 1929–1940.

      12 Madsen, R. R. et al. (2020) Relationship between stemness and transcriptionally-inferred PI3K activity in human breast cancer. bioRxiv 2020.07.09.195974.

      13 Fritsch, C. et al. (2014) Characterization of the novel and specific PI3Ka inhibitor NVP-BYL719 and development of the patient stratification strategy for clinical trials. Mol. Cancer Ther. 13, 1117–1129.

      14 Furet, P. et al. (2013) Discovery of NVP-BYL719 a potent and selective phosphatidylinositol-3 kinase alpha inhibitor selected for clinical evaluation. Bioorganic Med. Chem. Lett.

      15 Yilmaz, A. et al. (2018) Defining essential genes for human pluripotent stem cells by CRISPR–Cas9 screening in haploid cells. Nat. Cell Biol. 20, 610–619.

      16 Sergushichev, A. A. (2016) An algorithm for fast preranked gene set enrichment analysis using cumulative statistic calculation. bioRxiv 060012.

      17 Liberzon, A. et al. (2015) The Molecular Signatures Database Hallmark Gene Set Collection. Cell Syst. 1, 417–425.

      18 Müller, F. J. et al. (2008) Regulatory networks define phenotypic classes of human stem cell lines. Nature 455, 401–405.

      19 James, D. et al. (2005) TGFbeta/activin/nodal signaling is necessary for the maintenance of pluripotency in human embryonic stem cells. Development 132, 1273–82.

      20 Vallier, L. et al. (2005) Activin/Nodal and FGF pathways cooperate to maintain pluripotency of human embryonic stem cells. J. Cell Sci. 118, 4495–4509.

      21 Chen, G. et al. (2011) Chemically defined conditions for human iPSC derivation and culture. Nat. Methods 8, 424–429.

      22 Adewumi, O. et al. (2007) Characterization of human embryonic stem cell lines by the International Stem Cell Initiative. Nat. Biotechnol. 25, 803–816.

      23 Tsankov, A. M. et al. (2015) A qPCR ScoreCard quantifies the differentiation potential of human pluripotent stem cells. Nat. Biotechnol. 33, 1–15.

      24 Smith, J. R. et al. (2008) Inhibition of Activin/Nodal signaling promotes specification of human embryonic stem cells into neuroectoderm. Dev. Biol. 313, 107–117.

      25 Vallier, L. et al. (2004) Nodal inhibits differentiation of human embryonic stem cells along the neuroectodermal default pathway. Dev. Biol. 275, 403–421.

      26 Sorre, B. et al. (2014) Encoding of temporal signals by the TGF-β Pathway and implications for embryonic patterning. Dev. Cell 30, 334–342.

      27 David, C. J. and Massagué, J. (2018) Contextual determinants of TGFβ action in development, immunity and cancer. Nat. Rev. Mol. Cell Biol. 19, 1–17.

      28 Alon, U. (2007) Network motifs: theory and experimental approaches. Nat. Rev. Genet. 8, 450–461.

      29 Sonnen, K. F. and Aulehla, A. (2014) Dynamic signal encoding-From cells to organisms. Semin. Cell Dev. Biol. 34, 91–98.

      30 Germain, P. L. and Testa, G. (2017) Taming Human Genetic Variability: Transcriptomic Meta-Analysis Guides the Experimental Design and Interpretation of iPSC-Based Disease Modeling. Stem Cell Reports 8, 1784–1796.

      31 Wang, L. et al. (2017) GCN5 Regulates FGF Signaling and Activates Selective MYC Target Genes during Early Embryoid Body Differentiation. Stem Cell Reports 10, 287–299.

      32 Zeng, H. et al. (2016) An Isogenic Human ESC Platform for Functional Evaluation of Genome-wide-Association-Study-Identified Diabetes Genes and Drug Discovery. Cell Stem Cell 0, 1660–1669.

      33 Ho, L. et al. (2015) ELABELA Is an Endogenous Growth Factor that Sustains hESC Self-Renewal via the PI3K/AKT Pathway. Cell Stem Cell 17, 435–447.

      34 Roudnicky, F. et al. (2019) Modeling the effects of severe metabolic disease by genome editing of HPSC-derived endothelial cells reveals an inflammatory phenotype. Int. J. Mol. Sci. 20, 1–10.

      35 Veres, A. et al. (2014) Low incidence of Off-target mutations in individual CRISPR-Cas9 and TALEN targeted human stem cell clones detected by whole-genome sequencing. Cell Stem Cell 15, 27–30.

      36 Ben-David, U. et al. (2018) Genetic and transcriptional evolution alters cancer cell line drug response. Nature 560, 325–330.

      37 Katsuno, Y. et al. (2019) Chronic TGF-b exposure drives stabilized EMT, tumor stemness, and cancer drug resistance with vulnerability to bitopic mTOR inhibition. Sci. Signal. 12, eaau8544.

      38 Manning, B. D. and Toker, A. (2017) AKT/PKB Signaling: Navigating the Network. Cell 169, 381–405.

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      Summary:

      In this manuscript by Madsen et al., a comparison of the transcriptome and proteome in heterozygous and homozygous PIK3CAH1047R human pluripotent stem cells mutants is presented. The authors demonstrate marked alterations in expression at both the protein and RNA level of homozygous mutants compared to wildtype, while heterozygous lines exhibit only minor changes. Multiple analytical approaches are employed to investigate network alterations, leading the authors to suggest a TGFβ-mediated rewiring of key pluripotent genes to induce a state of sustained stemness. Madsen et al. conclude with a set of experiments to functionally implicate NODAL/TGFβ autocrine signalling in PIK3CAH1047R dose-dependent stemness.

      Major Comments:

      1.The key conclusions are not convincing. While the unbiased omics approach sets up this study well, the study suffers from a lack of convincing functional assays (cell biological assays) to test their model and tease apart a phenotype for the het cells. More robust functional experiments are required to support the finding the NODAL/TGFβ signalling mediates the self-sustained stemness, particularly because this is the major novel finding distinguished from the authors previous work. • While the authors present a comprehensive omics investigation into alterations between wild type, homozygous, and heterozygous mutants, the critical functional experiments are lacking. In Figure 5, the authors seek to support the role of TGFβ in mediated stemness in the homozygous mutants, however, are not able to directly deplete TGFβ due to technical limitations of the culture conditions. Consequentially, the experiments are primarily built on the use of NODAL withdrawal and stimulation. The data presented thus implicate NODAL in the stemness phenotype, but it's not obvious TGFβ is substantially involved, particularly considering the inhibitor subsequently employed also inhibits NODAL type 1 receptors. Furthermore, there is a paucity of readouts for stemness. For example, a more convincing narrative would include additional expression markers of the core pluripotency network (e.g. OCT4, SOX2, etc.) as well as functional readouts (e.g. NODAL withdrawal and assessment of differentiation) after NODAL stimulation/depletion and comparing across genotypes. Overall, the primary conclusions of this work are not well-evidence by the presented data and the authors should consider additional functional experiments or reframing the narrative.

      • A key conclusion of this study is there is a dose-dependent stemness phenotype. As this is not explicitly defined, to this reader, it would imply a graded response between wild type, heterozygotes, and homozygotes in the phenotypic and molecular characteristics. However, as is noted particularly in the omics components of the manuscript, there is in fact "near-binary" alteration in the assayed characteristics. Again, this should be qualified more explicitly, but it is more consistent with the data, which suggests the heterozygotes behave very similarly to the wild types, while homozygotes have substantial alterations. I would suggest the authors consider renaming their descriptions, removing "near-binary" and "dose-dependent" to something like "dose-threshold." This suggests after X threshold of oncogenic PI3K signalling, substantial alterations occur; under this threshold (e.g. hets), changes are marginal. In the event however that there may be a more "dose-dependent" effect, I would expect the transcriptomic and proteomic changes observed in the heterozygous cell lines should be seen in the homozygous cell lines (of which they are likely in greater in magnitude in addition to other changes). The manuscript would benefit from more direct comparisons between the heterozygotes and homozygotes.

      • Further to the above point, as the marginal phenotype observed in heterozygotes is a critical point in this paper, the authors would benefit from including heterozygote lines in the functional experiments presented in Fig 5. Inclusion of the hets in these experiments would instill confidence in this reader that the marginal molecular alterations characterized at the proteomic and transcriptomic level is reflected in the lack of functional stemness-sustaining behaviour.

      2.Thus, without the functional and mechanistic experiments alluded to above, the claims/ conclusions are speculative. In particular, the cancer narrative is irrelevant to the study. Considering both the lack of conclusive differentiation experiments or relevant breast cancer experiments, the discussion on differentiation therapy for breast cancer should be removed.

      3.Reproducibility is a concern for this study. The authors should perform more replicates on their experiments (focusing on technical replicates of the lines employed to discern technical vs biological variability). A challenge in reading this manuscript is understanding which replicates were used for which experiments, and whether they are technical or biological (i.e. different lines). While some of the figure legends note this information, it would be helpful to provide clarity throughout the text. In addition, it should be noted that some experiments (e.g. the RPPA analysis in Fig 2B and Fig S3B) show substantial variability between replicates, but because it appears only a single technical replicate from two different cell lines was used, it is impossible to distinguish whether the variability is of a biological or technical nature. The authors would do well to focus on collecting more technical replicates of fewer biological replicates, and then expand to include more biological replicates if initial biological variation is observed.

      Minor Comments:

      • Consider adding gridlines to the MDS plots for clarity of read
      • In Fig S2, some of the in-figure labelling is incorrect
      • In Fig S1C, the authors note poor correlation in the heterozygotes between this and a previous study. It would be helpful to qualify this discrepancy, as it is potentially concerning.
      • Line 208, the authors state that the small p-value for the homozygotes is suggestive of a dose-dependent effect. This is not the case; it simply suggests a greater probability of the effect being non-random.
      • What does the height in Fig 4B correspond to? It would perhaps be of value to scale nodes based on the significance value.

      Significance

      Nature and significance of the advance:

      • Throughout the text, the authors frequently reference their previous study in PNAS and often the lines of what is novel in this paper vs. reproduction of previous findings is blurred. The authors would benefit from reducing the frequency of referencing their previous study and focusing on emphasizing the novelty of the present findings.

      • Without functional assays to complement and test their models, this manuscript is not a significant advance.

      State what audience might be interested in and influenced by the reported findings.

      • I believe the narrative was written for pluripotent stem cell biologists but without robust functional and quantitative cell biological assays to test their models, I don't anticipate stem cell biologists will be very interested.

      Define your field of expertise with a few keywords to help the authors contextualize your point of view. Indicate if there are any parts of the paper that you do not have sufficient expertise to evaluate.

      • Stem cell biology, cancer biology, systems biology, mTORC1 signalling

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      As below.

      Significance

      In this manuscript, Madsen et al have investigated the role of heterozygous versus homozygous PIK3CAH1047R gain-of-function mutation at maintaining stemness of induced pluripotent stem cells (iPSCs). The authors have performed high-depth RNAseq, proteomic, and RPPA analyses to show that biallelic PIK3CA alterations induce stronger activation of the PI3K signaling axis, compared to monoallelic mutations. The authors claim that a higher PI3K signaling dose activates the NODAL/TGF-b pathway, which in turn supports stemness in an autocrine fashion. These are important findings, however, the manuscript and its conclusions can be improved.

      The authors have described the role of PIK3CAH-1047R gain-of-function mutation in cancer and overgrowth syndromes. However, cancer associated somatic mutations in PIK3CA are mostly heterozygous. Similarly, PIK3CA related overgrowth syndromes (PROS) are caused by post-zygotic mosaic PIK3CA activating mutation. As such, the relevance of homozygous PIK3CA alterations to these pathological conditions is unclear. The authors should elaborate on the biological implications of their findings.

      The role of biallelic PIK3CA mutation is reminiscent of compound mutations in PIK3CA which have also been shown to increase PI3K signaling output. However, double PIK3CA mutations confer enhanced sensitivity to PI3K inhibition (Toska et al. Science 2019). Could the authors kindly speculate on this discrepancy. Similarly, p110 alpha specific inhibitor, alpelisib, is highly effective against PIK3CA-mutant ER+ breast cancer and PROS. As such, the clinical relevance of the insensitivity of homozygous PIK3CA mutation to PI3K inhibitors is unclear.

      Figure 2: The authors have performed RPPA analysis in the presence of 100 nM BYL719. Alpelisib is commonly used at 1 uM concentration for in-vitro experiments, and has a cMax of ~5 uM. We suggest the authors perform western blot analysis to confirm the results of RPPA.

      Figures 3 and 4: The authors should expand their RNAseq analysis to demonstrate enrichment of stemness and TGFb signaling in homozygous mutant cells compared to heterozygous cells.

      The authors should confirm the results of pathway analysis in-vitro to show that homozygous PIK3CA mutation confers increased stemness compared to heterozygous mutation.

      Figure 5: Kindly provide direct evidence demonstrating that increased PIK3CA signaling output induces NODAL expression in this experimental setting. Also, please normalize gene expression data to WT cells so it is easy to visualize the changes in NODAL and NANOG expression in homozygous and heterozygous mutants compared to WT iPSCs

      Kindly quantify Fig. S5.

    4. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      This is an interesting and thorough study characterising human ipsc with hetero or homozygous mutation in pi3k pathway that lead to its hyper-activation. They prove that the increased stemness is results from enhanced autocrine responsiveness to TGF signalling pathway.

      The main conclusions are well supported by the presented data. cutting edge tools and bioinformatic analysis are adequately applied. I have only one important point:

      Major comment:

      1) western blot based validation of TGF pathway activation in wt and mutant ipscs will be helpful to strengthen the results based on bioinformatic data.

      Significance

      Important work for studies on signalling, cancer mutations, modelling cancer in stem cells, pluripotency regulation.

    1. Reviewer #3:

      Summary of the manuscript:

      This manuscript carefully explores different ways of analyzing fMRI data acquired during a subsequent memory paradigm. Subsequent memory paradigms (and variants thereof) are widely used in human memory research. The paradigm involves assessing activity-dependent encoding by first presenting novel stimuli (typically during human brain imaging), before classifying the stimuli post hoc using behavioral performance on a subsequent recognition test. Here, the authors use a subsequent memory paradigm to collect fMRI data from 256 volunteers, including both young (<35 years old) and older populations (>50 years old). The authors then perform cross-validated Bayesian model selection to compare categorical and parametric approaches to data analysis. The authors show that parametric models (particularly those with non-linear transformations) out-perform categorical models in explaining the fMRI signal variance during encoding.

      General assessment:

      The strengths of this manuscript are two-fold. First, the authors illustrate application of a recently published SPM toolbox (Soch et al., 2016; Soch and Allefeld, 2018), used to conduct model assessment, comparison and selection. Second, the manuscript shows that parametric models out-perform categorical models when applied to subsequent memory paradigms. The manuscript is methodologically rigorous and illustrates a pipeline for optimizing GLMs applied to fMRI data. It uses data from a large number of subjects and results are replicated in an independent cohort. The manuscript will provide a useful reference for those researchers designing subsequent memory paradigms or performing analyses on data deriving from this particular paradigm.

      Having said this, by focusing on methodological questions relating specifically to subsequent memory paradigms, the manuscript is relatively narrow in scope. Moreover, despite providing the first formal comparison of categorical and parametric models for data acquired from subsequent memory paradigms, researchers have been applying both types of model to data deriving from this task for more than 10 years.

      Major comments:

      1) The authors do not present behavioral results, yet it seems the variance in confidence on the recognition test underlies the success of the parametric modeling approach. Moreover, it seems important to show whether there are any behavioral differences between young and old adults, given the framing of the Introduction where the authors note that categorical modeling approaches may be limited by ceiling effects in young populations and low accuracy in older populations. Using the behavioral data alone, can the authors illustrate these limitations of the categorical approach?

      2) In the Introduction the authors emphasize the importance of their approach for identifying biomarkers that predict normal aging versus accelerated aging in humans. Given this comparison is not made, it seems more appropriate to move this section of the Introduction to the Discussion?

      3) Clarity of the Results section: The results are somewhat dense and hard to follow at times. One notable factor is the lack of clarity in the figures, where the key point conveyed by each figure is not always immediately apparent. Here are some suggestions to help improve this section of the manuscript:

      a) Figure 3, Figure 4A, Figure 5, Figure 6, Figure 8: it is difficult to distinguish between the red/blue/magenta colours. Can the authors use 3 colours that are more different?

      b) Can the authors explicitly state what they expect to see on selected-model maps? Given the main audience for this manuscript will be from the fMRI community, it is important that these maps are not confused with maps showing task-related modulation of the BOLD signal.

      c) Can the authors describe in more general terms the rationale behind all the different categorical models? By considering so many different models I wonder if the key comparison between categorical and parametric gets lost in the detail.

      d) Figure 3: I'm not sure how helpful this figure is for the main Results section? It doesn't address the key question posed by the authors, so is it not more suitable for the Supplement?

      e) How representative are the plots shown in Figure 4B? Do the authors observe the same gradient if assessing log Bayes factor in an ROI defined from previous subsequent memory paradigms?

      f) Section 4.2. It isn't immediately clear why models that do not include subsequent memory effects are included, if the key comparison is between subsequent memory effects in categorical and parametric models.

      g) Figure 5: The authors distinguish between 'theoretical' and 'empirical' parametric modulators. If both are defined using behavioural performance, then what is the rationale for these terms?

    2. Reviewer #2:

      This paper describes efforts to evaluate and compare different models of a subsequent memory paradigm. In particular, the goal is to improve sensitivity so that the paradigm can be used more effectively in older adults who may have memory problems.

      The paper is well written overall, and the sample size is impressive. I also think that improving sensitivity to detect memory deficits during aging and disease progression is an important goal. Finally, the approach is rigorous, as cvBMS provides a principled means of model comparison and validating the findings in another cohort is very laudable.

      That said, the paper is overly focused on a specific paradigm and it does not provide insights into neural underpinnings of a biological/cognitive function. To be clear, the goal of the paper does not appear to be to provide such insights, and is instead to "...identify several ways to improve the modeling of subsequent memory effects in fMRI".

    3. Reviewer #1:

      General assessment:

      The topic discussed in the current manuscript is interesting and the proposed framework will be a great addition to the traditional methods currently used in the studies of human memory. The manuscript investigated the applicability of parametric compared to categorical models of subsequent memory effects in fMRI. Specifically, the authors applied cross-validated Bayesian model selection (cvBMS) for fMRI models to a subsequent memory paradigm in young and older adults. The cvMBS results showed that parametric models better explained the encoding signals when compared to categorical counterparts, suggesting a new analytical framework that can be applied to participants with low memory performance including memory-impaired individuals whose data would otherwise be challenging to interpret.

      Major comments:

      1) Given that the parametric models are a critical part of this manuscript, the rationale and justifications for the use of these models especially in the context of memory fMRI experiments are currently not sufficiently discussed. For example, in the introduction, there is no reference of past findings that are in line with the assumption that BOLD signals in memory-related brain regions vary quantitatively (rather than qualitatively) as a function of the strength of encoding signals. I believe this to be critical in convincing readers why parametric models can and should be used when thinking about memory fMRI data and paradigms.

      2) While the results section is clearly written, I find the analysis section to be rather difficult to follow. Is it possible at all to even more carefully walk through each of the model subtypes with more details or consider setting up a consistent structure for how each model subtype is explained (across model types; i.e., across 3.1, 3.2, and 3.3). In addition, I believe the readers could also benefit from more explanations/motivations behind why certain models should be considered and how to conceptually think about them (e.g., what are some empirical findings which suggest that model GLM with parametric modulators that are linear, arcsine, and sine should be considered here and are good candidates but not others?).

    4. Preprint Review

      This preprint was reviewed using eLife’s Preprint Review service, which provides public peer reviews of manuscripts posted on bioRxiv for the benefit of the authors, readers, potential readers, and others interested in our assessment of the work. This review applies only to version 3 of the manuscript.

      Summary:

      We found that this paper is of interest to an audience of cognitive neuroscientists who perform subsequent memory experiments. It provides important technical advice for the analysis of this data. The paper is also of interest for researchers who want to carry out similar technical evaluations in other experiments.

      Whilst we have some comments that could improve the manuscript, we find the key claims of the manuscript to be well supported by the data, and that researchers who use this paradigm would benefit from following the advice to use parametric models. Furthermore the approaches used to support these claims are both thoughtful and rigorous.

    1. Reviewer #3:

      The focus of this manuscript from Moglie et al. is to investigate calcium entry in post-hearing OHCs via the activation of either voltage-gated calcium channels or the MOC efferent fibers. Based on the literature reported, very little is known about how OHCs handle increases in cellular calcium, although oncomodulin is believed to be the major calcium buffer in these cells. Therefore, this work attempts to address this gap in our knowledge by using a combination of calcium imaging and electrophysiology. From the results presented, the authors conclude that the large calcium signals generated by the opening of calcium channels appear to be modulated by ryanodine receptors. In addition, the opening of nicotinic receptors, caused by ACh released from active efferent fibers produced calcium transients that were contained by cisternal calcium-ATPases. The authors have also provided results that sorcin, a calcium binding protein involved in controlling calcium in myocytes, appears to control basal calcium levels and MOC synaptic activity in OHCs. The topic of the study is very interesting but unfortunately there are several major shortcomings in the design and execution of the work that drastically lower its impact. Moreover, the work appears to be designed and written for a specialized "auditory" audience.

      The main issue of the paper is that the imaging data is used as the primary means of quantifying calcium changes under different experimental conditions, including the measurements of basal calcium level. However, all experiments were performed with a non-ratiometric calcium dye, making most of the conclusions and assumptions extremely difficult to interpret.

      Another problem is that the authors make very specific conclusions regarding the mechanisms involved in calcium handling in OHCs, which are used to explain/understand how OHCs operate in vivo. However, experiments were done using whole-cell patch clamp, which is far from physiological, using unphysiological voltages (-100 mV) and at room temperature. The authors should provide evidence that the mechanisms proposed using the above experimental conditions are physiologically relevant.

      Figures 1 and 2 describe the same aspect, and should be combined. Also, it is not clear why 1 mM Ach was used for the experiments. How do the authors know that this is a physiologically saturating concentration?

      Figure 3G-H highlights another major issue with the method used. The similarity of the calcium change between the different stimulus durations could just be due to dye saturation, which is in fact suggested by the initially flat response in panel G despite the reduction in current. This finding should be corroborated by evidence indicating that the calcium dye is not saturated under their experimental conditions.

      Figure 4 describes an even more problematic result. Here calcium changes are reported as DF instead of DF/F0, which is highly inappropriate as it makes comparing different recordings extremely unreliable (F0 can vary significantly between experiments, see Figure 4F). Similarly, DF measurements are done in other experiments (e.g. Figure 5D), in which data for the control condition comes from a different cell. As mentioned above, this problem could be avoided by using a ratiometric dye (e.g., fura-2 or furaptra see Beutner-Moser 2000?).

      Figure 5B. It is surprising to see that a similar variance in baseline calcium level to that reported in Figure 4E (again using non-ratiometric measurements), is now just significant and used to support one of the main conclusions of the paper. Considering that the method used does not provide quantifiable baseline calcium levels, how are the authors able to exclude bias in their measurements due to experimental variability? What is the biological replica needed to validate their statistics based on the mean +/- sem? Also, the fact that adding sorcin "increases" the resting calcium level does not prove that it has a role in OHC function; it only shows that sorcin affects calcium levels, which is not surprising since it is a calcium binding protein.

      Figure 7D is a bit puzzling to me but I may have missed some underlying reason from published work. Why do Ryn concentrations that are known to either facilitate or block the receptors cause the same change in calcium level?

      The method section should contain a statistical statement. It should also explain the reason for using non-parametric analysis for the statistical comparisons. Also, most of the methods are only briefly described; although the authors have probably published these methods before, the method section should be more self-explanatory e.g. exactly how was the photobleaching correction performed?

    2. Reviewer #2:

      In this study, the group of Juan Goutman investigated Ca2+ signaling in immature cochlear outer hair cells (OHCs). The work focuses on the basolateral compartment analyzing Ca2+ signals mediated by afferent ribbon-type active zones and by efferent synapses. Ca2+ influx at the ribbon-type active zones is substantial, which is in keeping with the large ribbons found in OHCs. The authors show that it can be potentiated by ryanodine which indicates an interesting interplay between voltage-gated Ca2+ influx and ryanodine receptor mediated Ca2+ release from internal stores. Finally, adding recombinant sorcin, a Ca2+ binding protein prominently expressed in cardiomyocytes to the patch-pipette modulated the basal [Ca2+]i and efferent Ca2+ signalling in OHCs. The authors provide characterization of efferent and afferent Ca2+ signals. However, there are a number of issues which are discussed below:

      Novelty:

      The approach taken, and some of the conclusions, is similar to what the group presented for immature inner hair cells, that also feature afferent and efferent synapses in close proximity and with functional interaction. This is absolutely reasonable to do but presents an extension of the same concept to a related cell type.

      Relevance for understanding OHC function in the mature cochlea:

      The authors have performed experiments on organs of Corti from mice at postnatal days 12-14. This is around the onset of hearing in mice and represents a time window during which substantial changes have been shown to occur. Figures 4 and 5 of Hackney et al., JN2005 show that the cytosolic abundance Ca2+ binding proteins parvalbumin a, parvalbumin ß, and calretinin changes dramatically around this stage of development. Hence, the presented data should not be taken to conclude on the situation in the mature cochlea.

      Statistical data basis/sample size:

      Analyzing highly variable Ca2+ signals in hair cells poses the challenge of capturing the underlying distribution by sufficient sample size. Several experiments in the present study fall short in acquiring such sample size.

      Role of sorcin:

      I highly recommend the authors to provide their own sorcin immunohistochemistry. Perfusion of the cytosol with recombinant Ca2+ binding proteins is expected to affect Ca2+ signalling (reducing amplitude and spread) and in a way similar to the addition of synthetic Ca2+ chelators. With 3 µM of recombinant protein, it seems difficult to achieve a sizable effect (even when considering fully functional multiple EF-hands. In the present study, a non-significant trend towards a reduced amplitude of afferent Ca2+ signals was observed during whole-cell patch clamp with sorcin (molar concentration should be provided). The relevance of sorcin function for OHC function remains to be studied by deleting sorcin expression in OHCs and performing comparative perforated-patch recordings from sorcin-deficient mice or siRNA knock-down.

      Specific comments:

      Mention species in title and/or abstract

      What is meant by "we found that VGCC Ca2+ signals are larger than expected" please disambiguate or remove?

      Also consider replacing "VGCC Ca2+ signals" by afferent or presynaptic Ca2+ signals, as the proposed CICR contribution indicates a more complex origin of Ca2+ contributing to these signals.

      Line 56: "we found that Ca2+ signals from VGCC are unexpectedly large," see my comment above

      Line 57 and throughout: consider clarifying that you refer to signal amplitude not spatial extent of the signal (perhaps replace size by dF/F0 or amplitude)

      Line 61: "control Ca2+-based excitation-contraction coupling in cardiomyocytes"?

      Line 62: "among the most differentially expressed genes in OHCs" this statement is not useful without mentioning the cells used for the comparison

      Line 64: "Thus, the present results shed light into Ca2+ homeostasis in the hair cells involved in sound amplification at the cochlea, and unveil a role for the novel protein sorcin."

      I don't think so, please see major concerns.

      Line 70 and following: I think this first section is mainly confirmatory (work by the Mammano lab and others) and hence might better serve as supplementary information. Please add whether the data points in C-E correspond to cells and single trials or represent average responses of each OHC.

      Line 88: So, do you assume that the hotspot corresponds to a single efferent OHC synapse being activated?

      Line 97:Was this averaging including the failures? If not the example shown in Fig. 2B does not really seem representative? Consider adding a note relating the dF/F0 for ACh and efferent transmission: 2 orders of magnitude difference. Also please reflect on finding failing Ca2+ signals despite successful IPSC.

      Legend to fig. 2 should mention the imaging approach used here. Please add whether the data points in C-E correspond to cells and singe trials or represent average responses of each OHC. "during double-pulse"

      Line 102: Consider to move this explanation up to where you introduce the experiment.

      Line 117: A methods section detailing the statistical analysis is missing completely. How was the use of a non-parametric test (Friedman's test) justified: i.e. how was normality tested?

      Line 122: "localized Ca2+ rise with a measurable spread which accounted for 31 {plus minus} 5 % of the area corresponding to the imaged OHC area." How was "measurable spread" defined?

      Line 128: The maximal Ca2+ signal with 80 Hz stimulation of efferent synapses is still an order of magnitude lower than that found with ACh. The authors suggest that the Ca2+ rise is limited by SERCA pumps, but do they assume, indeed, that this clearance mechanism is not at work during ACh application?

      Line 141: How sure can the authors be that this cytosolic Ca2+ rise does not result from a store-depletion related Ca2+ entry?

      Line 155: I recommend keeping the order from 20-80 Hz as above and below to make reading easier.

      Line 178: How confident can we be that the recombinant sorcin was Ca2+ free, in other words, could the elevated basal Ca2+ simply reflect preloading of sorcin?

    3. Reviewer #1:

      This manuscript describes convincing measurements of cytoplasmic Ca2+ signals attributable to voltage gated Ca2+ channels and efferent nAChR channels. These channel coexist on the basolateral surface of OHCs and may, with the MET channels, contribute to OHC Ca2+ homeostasis. The main conclusions are that the two channel types are differentially modulated, ryanodine receptor action potentiating VGCC but not efferents, which disagrees with previous claims (Lioudyno et al 2004); and efferent responses were reduced by sorcin, a Ca2+-binding protein recently localized to OHCs, and known inhibitor of ryanodine receptors. Neither the concentration nor exact mechanism of sorcin's action was determined.

      Specific comments:

      1) In the fluorescent images in the various figures, the image orientation is unclear- is it a radial or a transverse view? It would help if in some figures, a representation of an OHC, either as a Nomarski image or as a drawing, can accompany the fluorescent image.

      2) L126. in describing Ca2+ spread, especially with long stimulation, there is concern that the high affinity dye Fluo4 will saturate. This should be discussed. I would not have used this dye - preferred a lower-affinity dye such as Fluo5.

      3) Fig. 3F and L:124. Express the spread in absolute units rather than percent of OHC diameter. I assume the conclusion (not stated) is that the Ca2+ rise is not confined to the sub-cisternal space but spreads throughout the cell. Why does it not activate release of the afferent neurotransmitter? A point not mentioned is that the efferent SK2 and BK channels are distributed along the lateral membrane.

      4) Fig. 6F. Ideally the spread of Ca2+ signals at the peak should be presented as (overlapping) Gaussians for the two sources. The significance of the 3.7 um separation (L319) between the sources needs some context.

      5) L169. State explicitly that the ryanodine results disagree with (Lioudyno et al 2004). 6) L177. Refer to Corey's Shield database (Scheffer et al 2015) who first reported the presence of sorcin mRNA in OHCs.

      7) L178. A concern is over the physiological significance of the sorcin effects. Sorcin is a Ca2+ binding protein that if present at high concentrations could supplement oncomodulin in addition to inhibiting RyRs. Can the authors determine the sorcin concentration in OHC cytoplasm? In addition it seems strange that the reported effect to sorcin is to inhibit RyRs so limiting the temporal spread of the CICR, but the present results suggest Can the authors clarify these problems.

      8) L199-204. The authors could have resolved whether sorcin affected SK2 channels by (briefly) switching to -40 holding potential where the nAChR and SK2 currents would be of opposite polarity.

      9) L350 omit 'novel' Sorcin is not a novel protein having been described in the 1990's

    4. Preprint Review

      This preprint was reviewed using eLife’s Preprint Review service, which provides public peer reviews of manuscripts posted on bioRxiv for the benefit of the authors, readers, potential readers, and others interested in our assessment of the work. This review applies only to version 1 of the manuscript.

      Summary:

      There was a consensus that the scope of the work is of general interest for the hearing field. However, three major critiques were raised:

      1) A high-affinity Ca2+ indicator was used, raising the possibility that the fluorescence signals might be saturated in some experiments (Fig.3G-F; Fig. 4G-H; Fig.5D) and thus confounding the conclusions that can be made from the observation of unchanged Ca2+ signals. In particular, could saturation explain why ryonidine has no effect on the Ca2+ influx from efferent synapses, an observation that contradicts published observations by Lioudino et al 2014?

      2) The variability of the data is large and the results are often on the verge of statistical significance, which calls for special care in the statistical methods used to evaluate the effects reported here and ensure that the sample size is large enough to reach a reliable conclusion.

      3) The experiments with sorcin appear preliminary. In particular it is worrisome that sorcin may change the Ca2+ concentration only because it is a Ca2+-binding protein.

    1. Reviewer #3:

      This neat paper continues the story of structural colour evolution in a group that is rarely appreciated for their ornamentation. The study uses colour & ecological data to model their evolution in a comparative framework, and also synthesises transcriptomic data to estimate the presence and diversity of opsins in the group. The main findings are that the tarantulas are ancestrally 'blue' and that green colouration has arisen repeatedly and seems to follow transitions to arboreality, along with evidence of perhaps underappreciated opsin diversity in the group. It's well-written and engaging, and a useful addition to our understanding of this developing story. I just have a few concerns around methods and the interpretation of results, however, which I feel need some further consideration.

      As the authors discuss in detail, this work in many ways parallels that of Hsiung et al. (2015). The two studies seem to agree in the broad-brush conclusions, which is interesting (and promising, for our understanding of the question), though their results conflict in significant ways too. Differences in methodology are an obvious cause, and they are particularly important in studies such as this in which the starting conditions (e.g. the assumed phylogeny or decisions around mapping of traits) so significantly shape outcomes. The current study uses a more recent and robust phylogeny, which is great, and the authors also emphasise their use of quantitative methods to assign colour traits (blue/green), unlike Hsiung et al.

      1) This latter point is my main area of methodological concern, and I am not currently convinced that it is as useful or objective as is suggested. One issue is that the photographs are unstandardised in several dimensions, which will render the extracted values quite unreliable. I know the authors have considered this (as discussed in their supplement), but ultimately I don't believe you can reliably compare colour estimates from such diverse sources. Issues include non-standardised lighting conditions, alternate white-balancing algorithms, artefacts introduced through image compression, differences in the spectral sensitivities of camera models, no compensation for non-linear scaling of sensor outputs (which would again differ with camera models and even lenses), and so on (the works of Martin Stevens, Jolyon Troscianko, Jair Garcia, Adrian Dyer offer good discussion of these and related challenges). Some effort is made to minimise adverse effects, such as excluding the L dimension when calculating some colour distances, but even then the consequences are overstated since the outputs of camera sensors scale non-linearly with intensity, and so non-standardised lighting will still affect chromatic channels (a & b values). So with these factors at play, it becomes very difficult to know whether identified colour differences are a consequence of genuine differences in colouration, or simply differences in white balancing or some other feature of the photographs themselves.

      2) The justification for some related decisions are also unclear to me. The CIE-76 colour distance is used, and is described as 'conservative'. But it is not so much conservative as it is an inaccurate model of human colour sensation. It fails to account for perceptual non-uniformity and actually overestimates colour differences between highly chromatic colours (like saturated blues). The authors note they preferred this to CIE-2000, which is a much better measure in terms of accuracy, because the latter was too permissive (line 300). I understand the problem, and appreciate their honesty, but this decision seems very arbitrary. If the goal is to quantitatively estimate colour differences according to human viewers, then the metric which best estimates our perceptual abilities would strike me as most appropriate. Also, the fact that all species would be classified as 'blue' using the CIE-2000, when some of them are obviously not blue by simply looking at them, is consistent with the kinds of image-processing issues noted above. I only focus on this general point because it is offered as a key advance on previous work (L 40-41), but I don't think that is clearly the case (though I agree that the scoring methods of Hsiung et al. are quite vague). I'm generally in favour of this sort of quantitative approach, but here I wonder if it wouldn't be simpler and more defensible to just ask some humans to classify images of spiders as either 'blue' or 'green', since that seems to be the end-goal anyway.

      3) L26-27, 53-56, 171-176: This is a more minor point than the above, but some of the discussion and logic around hypothesised functions could be elaborated upon, given it's presented as a motivating aim of the text (52-56). The challenge with a group like this, as the authors clearly know, is that essentially none of the ecological and behavioural work necessary to identify function(s) hasn't been done yet, so there are serious limitations on what might be inferred from purely comparative analyses at this stage. The (very interesting!) link between green colouration and arboreality is hypothesised and interpreted as evidence for crypsis, for example, but the link is not so straightforward. Light in a dense forest understory is quite often greenish (e.g. see Endler's work on terrestrial light environments) including at night which, when striking a specular, structurally-coloured green could make for a highly conspicuous colour pattern - especially achromatically (which is what nocturnal visual predators would often be relying on). This is particularly true if the substrate is brown rotten leaves or dirt, in which case they could shine like a beacon. Conversely, if the blue is sufficiently saturated and spectrally offset from the substrate it could be quite achromatically cryptic at dusk or night. To really answer these questions demands information on the viewers, viewing conditions, visual environment etc. The point being that it is a bit too simplistic to observe that, to a human, spiders are green and leaves on the forest floor may be green, and so suggest crypsis as the likely function (abstract L 22-23). So inferences around visual function(s) could either be toned down in places given the evidence at hand or shored up with further detail (though I'm not sure how much is available).

      Minor comments:

      -I'm not familiar enough with with methods for creating homolog networks to comment in detail, but the use of BLASTing existing opsin sequences against transcriptomes seems straightforward enough. As do the methods for phylogenetic reconstruction.

      -L48: What constitutes a 'representative' species? And how reasonable is it to assign a value for such a labile trait to an entire genus? I understand we can only do our best of course and simplifications need to be made, but I can imagine many cases among insects (e.g. among butterflies and flies) where genus-level assignments would be meaningless due to the immense diversity of structural colouration among species (including in terms of simple presence/absence).

      -Line 168: Wouldn't this speak against a sexual function? Only in a tentative way of course, but the presence of conspicuous structural colouration in juveniles, which is absent in adults, would suggest a non-sexual origin to me.

    2. Reviewer #2:

      This paper presents a broad-ranging overview of tarantula visual pigments in relationship with the color of the spiders. The paper is interesting, well-written and presented, and will inspire further study into the visual and spectral characteristics of the genus.

      First a minor remark, Terakita and many others distinguish between opsin, being the protein part of the visual pigment molecule and intact light-sensing, so-called opsin-based pigment, often generalized as a rhodopsin. The statement of line 65, 'convert light photons to electrochemical signals through a signalling cascade' is according to that view strictly not correct. Furthermore, the presence of opsins in transcriptomes may be telling, but it is not at all sure that they are expressed in the eyes, if at all. As the authors well know, in many animal species some of the opsins are expressed elsewhere. It may be informative to mention that.

      The blueness or greenness feature prominently in the paper, but the criteria used for determining to which class a spider belongs are not at all sure. The Colour Survey and Supplementary Table S2 refer to Birdspiders.com, but that requires a donation; not very welcoming. The other used sources are also not readily giving the insight or overview which material was sampled. I therefore think that the paper would considerably gain in palatability by adding a few exemplary photographs as well as measured spectra. Of course, I am inclined to trust the authors, but I would not immediately take color photographs from the web as the best material for assessing color data with 4-digit accuracy. Furthermore, the accessible photographs do not always show nice, uniform colors, so it might be sensible to mention which body part was used to score the animals. And finally, using CIE metric might infer to many readers that the spiders are presumably trichromatic, like us. Any further evidence?

    3. Reviewer #1:

      This study investigates the evolution of blue and green setae colouration in tarantulas using phylogenetic analyses and trait values calculated from photographs. It argues that (i) green colouration has evolved in association with arboreality, and thus crypsis, and (ii) blue colouration is an ancestral trait lost and gained several times in tarantula evolution, possibly under sexual selection. It also uses transcriptome data to identify opsin homologs, as indirect evidence that tarantulas may have colour vision.

      Otherwise, a few comments:

      1) Given that data is limited for the family (only 25% of genera could be included in this study), it seemed a shame not to discuss further the variation in colour and habit within genera. Based on Figure 1 and supplementary tables, the majority of "blue" genera contain a mix of blue and not-blue (and not-photographed) species. Does this mean that blue has been lost many more times in recent evolutionary history? And how often are "losses" on your tree likely to be the result of insufficient sampling for the genus (i.e. you happen not to have sampled the blue species)?

      2) A key conclusion of the study is that sexual selection should not be discarded as a possible explanation for spider colour. However, there is very little detail given in the discussion to build this case. Do these spiders have mating displays that might plausibly include visual signals? How common are sexually-selected colours in spiders generally? Where on the body is the blue coloration (in cases where it is not whole body)? I also missed whether the images used are of males or females or both, or how many species show sexual dimorphism in colouration (mentioned briefly in the Discussion, but not summarised for species or genera).

      3) A quick scroll through the amazing images on Rick West's site suggests that oranges and red/pinks are not rare in tarantulas. Perhaps the data is just not available, but it would be good to mention somewhere the rationale behind the blue/green focus, rather than examining all colours.

      Minor comments:

      I suggest defining stridulating / urticating setae for non-specialist readers. I had to look these up to understand that they were involved in defence.

      I notice the Rick West website says species IDs should not be made from photos alone. Is there a risk of misidentification for any photos?

      The Results section would benefit from some more clear statements of key results. For example, phrases like "AIC values to assess the relationships between greenness and arboreality are reported in Table 3" could be replaced instead with a summary statement indicating what this table shows.

      In the Figure 1 caption I think there is a typo: 'the proportions of species with images that possess blue colouration (grey = no available images)" but should this say "grey = not blue"?

      142 - the lengthy discussion here of whether there is one or more mechanisms by which blue is produced in tarantulas, and the detailed criticism of Hsuing SEMs, seems a bit out of place given that the current study does not investigate the proximate mechanism of blue colouration but merely its presence.

      The Table S7 caption states: "A * indicates currently undescribed species with blue or green colour that can be confidently attributed to corresponding genus. However, as the described species exhibit no blue or green colour, we conservatively scored these as 0." Is this a conservative approach though? If they have been confidently assigned to genus, I don't understand why they would not be included.

      Table S6 - It is not clear to me how the values for predicted N orthologs were calculated.

    4. Preprint Review

      This preprint was reviewed using eLife’s Preprint Review service, which provides public peer reviews of manuscripts posted on bioRxiv for the benefit of the authors, readers, potential readers, and others interested in our assessment of the work. This review applies only to version 1 of the manuscript.

      Summary:

      This study offers some interesting data and ideas on colour evolution in tarantulas, building upon previous work on this topic. However, the reviewers judged that the insights are too taxon-specific and that several key conclusions are too speculative. There were also concerns about the methodology for trait scoring from photographs that the authors might consider going forward.

    1. Reviewer #3:

      In this manuscript, Dr. Jeroen Bakkers and colleagues build upon their previously described cardiac-intrinsic looping of the heart, a process that is independent of the initial leftward jog of the heart that is driven by left-sided Nodal activity.

      A novel allele of tbx5a is recovered in a genetic screen for mutants affecting cardiac looping subsequent to cardiac jogging. These mutants have normal gut looping, and therefore establish LR asymmetry normally. The oudegracht (oug) allele of tbx5a is molecularly more severe than the well-known heartstrings allele, and unlike hst mutants in oug mutant hearts AV canal specification is expanded. Analysis of cardiomyocyte movement within the heart between 28 to 42 hpf demonstrates a process where while ventricular CMs are displaced in a net clockwise direction (relative to the OFT), atrial CMs do so in a counterclockwise fashion, with distinct differences between behaviour of dorsal and ventral cells in each chamber. This movement is also evident when using transgenic lines to demarcate the early left- and right-sided myocardium of the cardiac cone, which form dorsal and ventral portions of the linear heart tube. Here the dorsal myocardium is found at the outer curvature of both chambers following looping, supporting a torsional model. In the oug mutant these differences in displacement between the dorsal and ventral aspects of the chamber are not evident, perhaps explaining looping defects that are observed. Remarkably, the authors show that the looping process can be recapitulated in explanted 24 hpf hearts, with looping not requiring further addition of second heart field-derived cells. Looping defects in oug mutants can be rescued to some extent by further loss of tbx2b, supporting a model where Tbx5 and Tbx2b act to establish chamber and AVC boundaries to promote torsional rotation of the heart and cardiac looping.

      Overall this work is of a very high quality, with conclusions well supported by the evidence presented. The observations of explanted 24 hpf hearts, and demonstration of a "organ-extrinsic" process that drives looping, are of particular interest, and build well upon previously published observations.

      Substantive Concerns:

      1) Given the discrepancies observed between oug and hst mutants with respect to AVC development, have the appropriate in situs (has2, bmp4, tbx2b) been repeated in the hst background? This would be especially critical for tbx2b, given the genetic rescue experiments.

      2) The use of hearts where heartbeat has been suppressed from 28 to 42 hpf may well affect expression of nppa and formation of the outer versus inner curvature. This should be assessed. It may well be that heartbeat and flow is affected in oug mutants as well, and that defects observed are not due only to effects on CM movement/rotation. This should be commented on, at the very least.

      3) The analysis of cell shape (lines 320-332 and Figure 7) is highly confusing as presented. It was previously shown that left-derived CMs do not reach the OC (Figure 4K). Also, given the known requirements for cardiac contractility and shear stress to promote the elongation of OC CMs, these results are even further difficult to interpret. What is meant by "meandering" in this Figure is also not evident.

    2. Reviewer #2:

      Tessadori et al. address the mechanism of cardiac looping, a morphogenetic event that is essential for the generation of the different chambers of the vertebrate heart. While looping is essential for cardiac function, the complex morphogenetic events that govern this important process remain poorly understood. During the development of the two-chambered zebrafish heart, looping has been proposed to involve planar bending/buckling of the flat heart tube or torsional events that would be more similar to those involved in the formation of the helical structure of the mouse heart. In the present work, the authors use a number of elegant approaches to provide a 3-dimensional description of this process. While a recent study suggested that rotational events may be occurring at the level of the cardiac outflow tract (Lombardo et al, 2019), the present work substantially extends these findings and establishes that planar bending/buckling is only of minor importance for cardiac looping which instead depends on opposing rotational movements of the atrial and ventricular compartments that twist the heart tube around the central hinge region of the atrioventricular canal. The authors furthermore provide evidence that these morphogenetic events depend on tissue-intrinsic processes that require the function of the transcription factor tbx5a. Altogether, the present work provides important new insights into the morphogenetic events that contribute to the shaping of the zebrafish heart.

      The presented experimental work is generally of very good quality and convincing evidence is presented for the different findings. While I outline below several issues that should be clarified, the authors should already have a lot of the requested information that just needs to be included. While some additional data are requested, the required experiments should all be straightforward and allow rapid improvements that would further strengthen the work.

      Individual points:

      1) In their characterization of tbx5a/oug mutants, the authors state that cardiac looping is « defective », but a precise description of the actual type of defect is lacking. From the picture in Fig.1C it looks as if looping occurs still in the right direction, but with reduced amplitude. Is this the only type of defect observed, or are there others (e.g. absent or inverted looping)? How does this phenotype compare to the previously characterized tbx5a/hst mutant (see point 2)? The authors mention/show that cardiac looping and visceral laterality are unaffected, but numbers should be included to substantiate these claims.

      2) The authors analyse different markers of cardiac regionalization (Fig.2H) and suggest that the phenotype of tbx5a/oug mutants is different from the one previously described for tbx5a/hst (Garrity et al 2002, Camarata et al, 2010). As only oug mutant data are presented, it is however not clear to what extent the perceived differences may just be due to differences in the use / interpretation of different markers. For example Tessadori et al. talk about « Increased expression for the AV endocardial markers », which appears similar to Camarata et al. talking about « loss of AV boundary restriction » of AV marker genes. As the authors already detain the tbx5a/hst allele (used in Fig.1G) they should simply show side-by-side comparisons of marker expressions for the two mutant alleles. While the similarity or difference between oug and hst mutant phenotypes is not of major importance for the main conclusions of the paper, this point should be clarified to facilitate follow-up studies that may use either mutant to further characterize the events reported here.

      3) In Fig. 2K & 4J the authors provide a visual representation of Z cell displacement during cardiac looping. While this is very nice, the study could be strengthened further if these data could be analysed in a more quantitative way (e.g. mean displacement index at the atrial/ventricular inner/outer curvature). This would allow us to see whether the changes observed in oug mutants are significant.

      4) The authors report a novel spaw:GFP transgenic line that they use to label the left cardiac field. While the expression of this transgene in the left lateral plate mesoderm is expected, it is more surprising to see spaw as a marker of the left cardiac disc, as previous studies (e.g. Fig.1D of de Campos-Baptista et al, 2008) have shown spaw to be expressed to the left of the cardiac primordium, rather than within the cmlc2-positive cardiac disc itself. As the authors themselves mention in the discussion when comparing their results to Baker et al 2008 (which used myl7:GFP), it is essential to establish which cells are actually labelled by a transgene. A dorsal view of the 23 somite stage cardiac disc (e.g. spaw:GFP/myl7-RFP or GFP/cmlc2 two colour in situ) should be provided to clarify this issue.

      5) As for spaw:GFP, the authors should provide a dorsal view of the 23 som cardiac disc to document that lft2:Gal4 is indeed specifically expressed in the left heart primordium. They should moreover clarify the orientation of the pannels in Fig.S4. E.g. Fig.S4A presents two transversal sections of the 28 hpf heart tube in which left-originating lft2-expressing cells should be located dorsally. However lft2 cells are found in the upper half of the tube in the upper section, but in the lower half in the lower section. Does this mean that the D/V orientation is inverted between the two pictures? Please clarify.

      6) In Fig.4K and Fig.8D spaw:GFP is used to visualize left-originating cells in oug mutants. In both figures, spaw-GFP cells are located in the ventral part of transversally sectioned ventricles. I do not understand how this occurs: In wild-type animals left-originating cells initially give rise to the dorsal part of the ventricle. Through clockwise rotation of the outflow tract, these dorsal cells are then relocated to the outer curvature of the ventricle, as shown in Fig.3B. So if no rotation occurs in tbx5a/oug, why are spaw:GFP cells found in the ventral ventricle, rather than remaining in their initial dorsal position?

      7) Sample numbers should be provided for the experiments in Fig.5C and Fig.6C.

    3. Reviewer #1:

      This is an original paper by Tessadori et al, showing chamber movements during zebrafish heart looping. The combination of cell tracking and genetic tracing of left markers, including with a new 0.2Intr1spaw transgene, suggests differential movements in the ventricle and atrium. Using a new mutant line for tbx5a (oug), the authors show that defective heart looping is associated with defective chamber movements. This can be rescued by inactivation of tbx2b, indicating the importance of tube patterning into chamber/avc regions. Using explant experiments and pharmacological treatments, to interfere with the tube attachment and progenitor cell ingression, the authors conclude on intrinsic mechanisms of zebrafish heart looping, with a minor contribution from planar buckling.

      This study follows previous work of the team, showing that zebrafish heart looping is independent of Nodal signaling and suggestion of intrinsic mechanisms from explant experiments. Whereas asymmetric morphogenesis has been mainly analysed in terms of direction and downstream of Nodal signaling, this work addresses the contribution of other factors to the shape of the heart loop, including chamber movements and tbx genes. It has the potential to provide a significant advance into looping mechanisms, providing that data analysis is strengthened.

      Major comments

      1) The chamber movements are interesting new observations. Yet, their analysis is currently insufficient. Although images and cell tracking have been performed in 3D, it is unclear why the quantification is flattened in 2D. In Fig. 2-4, angles are treated as linear values, whereas they should be treated as circular values using dedicated packages . In the context of the low penetrance (Fig. 1G) and variability (Fig. S2, S6) of the phenotype, the number of samples should be increased. In Fig. 2, it seems that the movement in the ventricle is towards the posterior (or venous pole), rather than the left, and so why are the movements qualified as opposite, rather than perpendicular? In addition, vectors in the dorsal/left ventricle are not opposite, so the rationale of a rotation of the ventricle is unclear. To support the claim that authors "map cardiomyocyte behavior during cardiac looping at a single-cell level", the movement of the overall chamber should be subtracted to the cell traces.

      2) The staining of left transgenic markers is described as dorsal at 28hpf (text and Fig. 3A), and ventral at 48hpf (text and Fig. 3B) : please explain whether this implies a 180° rotation or just a general flip of the heart relative to the embryo. What is the pattern of lft2BAC in oug mutants? The legend of Fig. 9 reports "expansion of the space occupied by left-originating cardiomyocytes" : what is the percentage of the VV, VD, AV, AD regions labelled at different stages and in different experimental conditions? What is the degree of rotation of the pattern and does it correspond to that measured by cell tracking? Are markers of the inner/outer curvature (ex nppa) also rotating?

      3) The rationale for ruling out extrinsic cues of heart looping is currently unclear. It is very difficult to compare the impact of experimental conditions impairing extrinsic cues (Fig. 5-6), without a quantitative analysis of cardiac looping and of the patterns of left-transgenic markers. No observation of the twist is provided after treatment with SU5402 in vivo. What happens with the other 8/20 embryos? A caveat of explant experiments, is that the tissue may shrink and the orientation of the sample is lost. What are the parameters of the explanted tubes (pole distance, size), and which references are used to assess patterns? The authors suggest a minor contribution of planar buckling. However, neither biological quantifications (pole distance, length of the tube axis) nor computer modelling are shown to support their views and expectations. The observation that the ventricle moves posteriorly could be compatible with a convergence of the poles, potentially contributing to looping. In Fig. 6A, it seems that pole distance is higher in oug mutants. The claim on planar buckling should be altered.

      4) The importance of the avc is suggested by the rescue experiment with tbx2b inactivation. Yet the size and constriction of the avc is not quantified in the different experimental conditions. How are cell traces/displacement vectors in this region to support the proposal that the avc acts as a "fixed hinge"? Computer models would potentially be useful to understand the consequences of avc formation on the overall tube shape and chamber movement.

    4. Preprint Review

      This preprint was reviewed using eLife’s Preprint Review service, which provides public peer reviews of manuscripts posted on bioRxiv for the benefit of the authors, readers, potential readers, and others interested in our assessment of the work. This review applies only to version 1 of the manuscript.

      Summary:

      While cardiac looping is essential for cardiac function, the complex morphogenetic events that govern this asymmetric process remain poorly understood. Asymmetric morphogenesis has been mainly analysed in terms of direction and downstream of left Nodal signaling. The work of Tessadori et al. now addresses the contribution of other factors to shape the heart loop. This manuscript builds upon a previous study from the same group, showing that cardiac looping is independent of the initial leftward jog of the heart that is driven by left-sided Nodal activity. A recent study from another group (Lombardo et al, 2019) suggested that rotational events occur at the level of the cardiac outflow tract. The present work substantially extends these findings by providing more evidence of intrinsic mechanisms driving looping. The authors use a number of elegant approaches to provide a 3-dimensional description of this process. The presented experimental work is generally of high quality. The combination of cell tracking and genetic tracing of left markers, including with a new 0.2Intr1spaw transgene, suggests differential movements in the ventricle and atrium. A novel allele (oug), encoding a truncated version of the transcription factor tbx5a, is analysed, showing normal gut looping, indicative of normal left-right asymmetry establishment. This allele is molecularly more severe than the well-known heartstrings allele; unlike hst mutants, in oug mutant hearts specification of the atrio-ventricular canal is expanded. Oug mutants display defective heart looping, associated with defective chamber movements. This can be rescued to some extent by further loss of tbx2b, supporting a model where Tbx5a and Tbx2b act to establish chamber and atrio-ventricular canal boundaries to promote torsional rotation of the heart tube and shape the loop. Explant experiments and pharmacological treatments, to interfere with the tube attachment and progenitor cell ingression, do not prevent heart looping. Altogether, the present work provides important new insights into the morphogenetic events that contribute to the shaping of the zebrafish heart. However, there are important issues that should be addressed.

    1. Reviewer #3:

      General assessment:

      In this manuscript, the authors bring up a contemporary and relevant topic in the field, i.e. theta rhythm as a potential biomarker for prediction error in infancy. Currently, the literature is rich on discussions about how, and why, theta oscillations in infancy implement the different cognitive processes to which they have been linked. Investigating the research questions presented in this manuscript could therefore contribute to fill these gaps and improve our understanding of infants' neural oscillations and learning mechanisms. While we appreciate the motivation behind the study and the potential in the authors' research aim, we find that the experimental design, analyses and conclusions based on the results that can be drawn thereafter, lack sufficient novelty and are partly problematic in their description and implementation. Below, we list our major concerns in more detail, and make suggestions for improvements of the current analyses and manuscript.

      Summary of major concerns:

      1) Novelty:

      (a) It is unclear how the study differs from Berger et al., 2006 apart from additional conditions. Please describe this study in more detail and how your study extends beyond it.

      (b) Seemingly innovative aspects (as listed below), which could make the study stand out among previous literature, but are ultimately not examined. Consequently, it is also not clear why they are included.

      -Relation between Nc component and theta.

      -Consistency of the effect across different core knowledge domains.

      -Consistency of the effect across the social and non-social domains.

      -Link between infants looking at time behavior and theta.

      (c) The reason to expect (or not) a difference at this age, compared to what is known from adult neural processing, is not adequately explained.

      -Potentially because of neural generators in mid/pre-frontal cortex? See Lines 144-146.

      (d) The study is not sufficiently embedded in previous developmental literature on the functionality of theta. That is, consider theta's role in error processing, but also the increase of theta over time of an experiment and it's link to cognitive development. See, for example: Braithwaite et al., 2020; Conejero et al., 2018; Adam et al., 2020.

      2) Methodology:

      (a) Design: It is unclear what exactly a testing session entails.

      -Was the outcome picture always presented for 5secs? The methods section suggests that, but the introduction of the design and Figure 1 do not. This might be misleading. Please change in Figure 1 to 5sec if applicable.

      -Were infants' eye-movements tracked simultaneously to the EEG recording? If so, please present findings on their looking time and (if possible) pupil size. Also examine the relation to theta power. This would enhance the novelty and tie these findings to the larger looking time literature that the authors refer to in their introduction.

      (b) Analysis:

      -In terms of extracting theta power information: The baseline of 100ms is extremely short for a comparison in the frequency domain, since it does not even contain half a cycle of the frequency of interest, i.e. 4Hz. We appreciate the thought to keep the baseline the same as in the ERP analysis (which currently is hardly focused on in the manuscript), but it appears problematic for the theta analysis. Also, if we understand the spectral analysis correctly, the window the authors are using to estimate their spectral estimates is largely overlapping between baseline and experimental window. The question arises whether a baseline is even needed here, or if a direct contrast between conditions might be better suited.

      -In terms of statistical testing

      -It appears that the authors choose the frequency band that will be entered in the statistical analysis from visual inspection of the differences between conditions. They write: "we found the strongest difference between 4 - 5 Hz (see lower panel of Figure 3). Therefore, and because this is the first study of this kind, we analyzed this frequency range." ll. 277-279). This approach seems extremely problematic since it poses a high risk for 'double-dipping'. This is crucial and needs to be addressed. For instance, the authors could run non-parametric permutation tests on the time-frequency domain using FDR correction or cluster-based permutation tests on the topography.

      -Lack of examining time- / topographic specificity.

      3) Interpretation of results:

      (a) The authors interpret the descriptive findings of Figure S1 as illustration of the consistency of the results across the four knowledge domains. While we would partly agree with this interpretation based on column A of that figure (even though also there the peak shifts between domains), columns B and C do not picture a consistent pattern of data. That is, the topography appears very different between domains and so does the temporal course of the 4-5Hz power, with only showing higher power in the action and number domain, not in the other two. Since none of these data were compared statistically, any interpretation remains descriptive. Yet, we would like to invite the authors to critically reconsider their interpretation. You also might want to consider adding domain (action, number etc.) as a covariate to your statistical model.

      References:

      Adam, N., Blaye, A., Gulbinaite, R., Delorme, A., & Farrer, C. (2020). The role of midfrontal theta oscillations across the development of cognitive control in preschoolers and school‐age children. Developmental Science, e12936.

      Braithwaite, E. K., Jones, E. J., Johnson, M., & Holmboe, K. (2020). Dynamic modulation of frontal theta power predicts cognitive ability in infancy. Developmental Cognitive Neuroscience, 100818.

      Conejero, Á., Guerra, S., Abundis‐Gutiérrez, A., & Rueda, M. R. (2018). Frontal theta activation associated with error detection in toddlers: influence of familial socioeconomic status. Developmental science, 21(1), e12494.

      Köster, M., Langeloh, M., & Hoehl, S. (2019). Visually Entrained Theta Oscillations Increase for Unexpected Events in the Infant Brain. Psychological Science, 30(11), 1656-166.

    2. Reviewer #2:

      The manuscript reports increases in theta power and lower NC amplitude in response to unexpected (vs. expected) events in 9-month-olds. The authors state that the observed increase in theta power is significant because it is in line with an existing theory that the theta rhythm is involved in learning in mammals. The topic is timely, the results are novel, the sample size is solid, the methods are sound as far as I can tell, and the use of event types spanning multiple domains (e.g. action, number, solidity) is a strength. The manuscript is short, well-written, and easy to follow.

      1) The current version of the manuscript states that the reported findings demonstrate that the theta rhythm is involved in processing of prediction error and supports the processing of unexpected events in 9-month-old infants. However, what is strictly shown is that watching at least some types of unexpected events enhance theta rhythm in 9-month-old infants, i.e. an increase in the theta rhythm is associated with processing unexpected events in infants, which suggests that an increase in the theta rhythm is a possible neural correlate of prediction error in this age range. While the present novel findings are certainly suggestive, more data and/or analyses would be needed to corroborate/confirm the role of the observed infant theta rhythm in processing prediction error, or document whether and how this increase in the theta rhythm supports the processing of unexpected events in infants. (As an example, since eye-tracking data were collected, are trial-by-trial variations in theta power increases to unexpected outcomes related to how long individual infants looked to the unexpected outcome pictures?) If it is not possible to further confirm/corroborate the role of the theta rhythm with this dataset, then the discussion, abstract, and title should be revised to more closely reflect what the current data shows (as the wording of the conclusion currently does), and clarify how future research may test the hypothesis that the infant theta rhythm directly supports the processing of prediction error in response to unexpected events.

      2) The current version of the manuscript states "The ERP effect was somewhat consistent across conditions, but the effect was mainly driven by the differences between expected and unexpected events in the action and the number domain (Figure S1). The results were more consistent across domains for the condition difference in the 4 - 5 Hz activity, with a peak in the unexpected-expected difference falling in the 4 - 5 Hz range across all electrodes (Figure S2)". However, the similarity/dissimilarity of NC and theta activity responses across domains was not quantified or tested. Looking at Figures S1 and S2, it is not that obvious to me that theta responses were more consistent across domains than NC responses. I understand that there were too few trials to formally test for any effect of domain (action, number, solidity, cohesion) on NC and theta responses, either alone or in interaction with outcome (expected, unexpected). It may still be possible to test for correlations of the topography and time-course of the individual average unexpected-expected difference in NC and theta responses across domains at the group level, or to test for an effect of outcome (expected, unexpected) in individual domains for subgroups of infants who contributed enough trials. Alternatively, claims of consistency across domains may be altered throughout, in which case the inability to test whether the theta and/or NC signatures of unexpected event processing found are consistent across domains (vs. driven by some domains) should be acknowledged as a limitation of the present study.

    3. Reviewer #1:

      Köster and colleagues present a brief report in which they study in 9 month-old babies the electrophysiological responses to expected and unexpected events. The major finding is that in addition to a known ERP response, an NC present between 400-600 ms, they observe a differential effect in theta oscillations. The latter is a novel result and it is linked to the known properties of theta oscillations in learning. This is a nice study, with novel results and well presented. My major reservation however concerns the push the authors make for the novelty of the results and their interpretation as reflecting brain dynamics and rhythms. The reason for that is, that any ERP, passed through the lens of a wavelet/FFT etc, will yield a response at a particular frequency. This is especially the case for families of ERP responses related to unexpected event e.g., MMR, and NC, etc. For which there is plenty of literature linking them to responses to surprising event, and in particular in babies; and which given their timing will be reflected in delta/theta oscillations. The reason why I am pressing on this issue, is because there is an old, but still ongoing debate attempting to dissociate intrinsic brain dynamics from simple event related responses. This is by no means trivial and I certainly do not expect the authors to resolve it, yet I would expect the authors to be careful in their interpretation, to warn the reader that the result could just reflect the known ERP, to avoid introducing confusion in the field.

      A second aspect that I would like the authors to comment on is the power of the experimental design to measure surprise. From the methods, I gathered that the same stimulus materials and with the same frequency were presented as expected and unexpected endings. If that is the case, what is the measure of surprise? For once the same materials are shown causing habituation and reducing novelty and second the experiment introduces a long-term expectation of a 50:50 proportion of expected/unexpected events. I might be missing something here, which is likely as the methods are quite sparse in the description of what was actually done.

      Two more comments concerning the analysis choices:

      1) The statistics for the ERP and the TF could be reported using a cluster size correction. These are well established statistical methods in the field which would enable to identify the time window/topography that maximally distinguished between the expected and the unexpected condition both for ERP and TF. Along the same lines, the authors could report the spatial correlation of the ERP/TF effects.

      2) While I can see the reason why the authors chose to keep the baseline the same between the ERP and the TF analysis, for time frequency analysis it would be advisable to use a baseline amounting to a comparable time to the frequency of interest; and to use a period that does not encroach in the period of interest i.e., with a wavelet = 7 and a baseline -100:0 the authors are well into the period of interested.

    4. Preprint Review

      This preprint was reviewed using eLife’s Preprint Review service, which provides public peer reviews of manuscripts posted on bioRxiv for the benefit of the authors, readers, potential readers, and others interested in our assessment of the work. This review applies only to version 1 of the manuscript.

      Summary:

      Köster and colleagues report on a study in 9 month-old infants and their electrophysiological response to expected and unexpected events. All reviewers acknowledge the rationale of your study and find merit in the overall approach. However, there were major concerns expressed regarding various methodological as well as more conceptual and interpretational angles. In sum, there was consensus amongst reviewers and editors about a critical sum of methodological, conceptual, and novelty concerns.

    1. Reviewer #3:

      General Assessment:

      This study demonstrates that IP3R signaling (triggered by muscarinic receptor activation) affects excitability and quantal content of a subset of dopaminergic neurons to modulate flight duration and food search. I had no technical concerns and am generally supportive. My only major concern was that the narrative was fragmented. I believe this is because the perspective shifted between the IP3Rs and the dopamine neurons themselves, and was too focused. I think that streamlining the narrative and providing a broader perspective for the results will remedy this issue.

      Major Comments:

      -I would like the authors to expand upon their final section of the discussion to discuss more about 1) the potential context for cholinergic modulation of the PPL1-y2alpha'1 DANs, 2) the proposed role of these DANs (which have been studied in several contexts) and 3) modulation of innate behavior in general. The paper begins with the importance of modulating innate behavior, but the discussion on this topic is spare and focused almost entirely on research on the mushroom bodies of Drosophila. The discussion section leans heavily on summarizing the results, rather than making connections to work in other systems or networks.

      -The developmental section seemed somewhat tangential as the authors cannot distinguish between a developmental role for the IP3R from a need to express the ItprDN transgene prior to adulthood to overcome a potential slow turnover of endogenous IP3R. In essence, it was unclear how these results contributed to the overall narrative of state modulation of behavior. Is this section informative to the development of the mushroom bodies or rigorous validation of the novel transgene?

    2. Reviewer #2:

      The results of the individual experiments reported by the authors are convincing. The approach is rigorous and they take full advantage of the many powerful molecular genetic tools available in Drosophila. The identification of a mechanism by which a small subset of dopaminergic cells may control behavior is significant. My concerns about the manuscript are relatively minor.

      Minor comments:

      I have reviewed "Modulation of flight and feeding behaviours requires presynaptic IP3Rs in dopaminergic Neurons" by Sharma and Hasan. The authors first translated to Drosophila a dominant negative (DN) strategy first tested in mammalian cells to block the function of the fly IP3 receptor. Controls using westerns to test the expression in vivo and calcium imaging to assess inhibitory activity in an ex vivo prep were generally convincing. They then show that the DNA, RNAi and a wt transgene disrupts flight as they have shown previously using both genetic mutants and RNAi. They use genetic rescue to further show that alterations in the function of itpr in dopaminergic cells are likely to mediate at least some aspects of the flight deficit. The restricted distribution of the THD' driver was used to narrow down the identity of DA cell clusters responsible for this effect to PPL1 and/or PPL3. Additional split GAL4 lines identified a deficit when the DN was expressed in the PPL1-γ2α′1 subset of DA cells that project to the mushroom bodies. This is a key finding of the paper since it localizes the requirement of the IP3R to cells that have been implicated in other behaviors. Developmental tests using TARGET/GAL80 indicate a requirement for itpr during late development. Disruption of itpr only in the adult did not have a significant effect. This seems likely to be due to perdurance of itpr as suggested by the authors. However, these data make it difficult to determine which aspects of the phenotype are due to broad developmental deficits versus disruption of IP3R in the adult (see below). The authors next test the effects of mAhR with the idea that mAChR is likely to signal through IP3R. While it was known that developmental expression of mAcHR expression is required for adult flight, the current data more specifically that the PPL1-γ2α′1 DANs are required, enhancing the impact of the paper.

      To tie these results to vesicle recycling and release the authors use the shibere[ts] transgene in PPL1-γ2α′1. Flight bouts were disrupted via exposure to the non-permissive temperature both during late pupal development and the adult. The adult phenotype has been demonstrated previously but the developmental defect is novel. The demonstration of an effect in adults is important since it suggests loss of itpr during adulthood might also have an effect in adults even though this can't be tested due to perdurance. Expression of shibire[ts] in PPL1-γ2α′1 also disrupts feeding, and the authors next phenotype these effects with the itpr DN, indicating that IP3R expression in PPL1-γ2α′1 is required for both feeding and flight. However, here as with the flight experiments, it is not possible to directly demonstrate an effect in adults due to perdurance. They show that knockdown of mAChR also reduces feeding similar to its effects on flight and suggest that the deficits are due to disruption of the mAchR ->(Gq) ->IPR3 pathway. The suggestion of connections between mAchR and IPR3 within PPL1-γ2α′1 and the idea that PPL1-γ2α′1 controls two distinct behaviors are a significant finding and one of main contributions of the paper.

      To help link the shibire[ts] data set with and the results of perturbing mAchR and IPR3, the authors show that carbochol induced DA release is reduced, making excellent use of the relatively new GRAB-DA lines. As a control, they show that synapse density of PPL1-γ2α′1 in the γ2α′1 MB lobes are not altered. The demonstration that DA release is altered elevates the technical strength of the paper. Moreover, although further experiments might be needed to prove their model, these data support the argument that mAchR ->(Gq) ->IPR3 pathway is disrupted in the adult. The final set of experiments in Fig 6 indicate that excitability of the PPL1-γ2α′1 DANs is also disrupted by knock down or IP3R. Is it possible that this deficit contributes to the decrease in DA release by the mAchR ->(Gq) ->IPR3 and the authors nicely explain a possible mechanism and cite relevant references in the Discussion.

      The results of the individual experiments reported by the authors are convincing. The approach is rigorous and they take full advantage of the many powerful molecular genetic tools available in Drosophila. The generation of the DN transgene is a nice idea and in combination with other tools helped them to identify specific subsets of DA neurons important for the behaviors they test. However, they have previously demonstrated similar effects with mutants and RNAi, and again use them to help map the relevant cells. Since the use of the DN construct did not really go beyond the experiments using RNAi or genetic rescue, the emphasis on the importance of this reagent might be reduced in the abstract and introduction.

      Flight deficits have also been seen in other experiments on these the DANs identified by the authors. Thus, the major novel finding of this section is the demonstration that itpr is required in these cells for regulating flight. While it was previously shown that feeding behavior is also required by DAN projections to the MB, the idea that overlapping cells might control both flight and feeding is interesting. Although the idea that these two phenotypes are specifically related to each other seems somewhat speculative, one major strength of the paper lies in tying together prior observations on itpr and the DANs with their current experiments. They do this again at the cellular level using GRAB to show that carbachol induced release of DA (but not synapse density) is reduced by itpr knock-down, thus tying together data on shibere, AcHR and itpr.

      These connections make for an exciting story, and they have been cleverly woven together by the authors. On the other hand, they also represent a possible concern about the manuscript as a whole, since causal relationships between the deficits between the effects of blocking the effects of IP3R, mAcHR, neuronal excitability and vesicle release are not yet proven. It is therefore possible that all of these are relatively non-specific effects of disrupting the function of PPL1-γ2α′1 neurons. This modestly reduces the strength of the paper but is also a relatively minor concern. A second potential concern is that despite the interesting connections made by the authors as well as some exciting new data, some of the findings replicate previous data.

      A third concern is the relationship between the effects of disrupting PPL1-γ2α′1 during development versus the adult. As the authors suggest, perdurance (of protein expression) and/or "perdurance" of previously formed tetramers could easily account for the failure of itpr and mAChR knock down in the adult to cause behavioral deficits. By the same token, it is difficult to parse out the contribution of developmental defects in the DA cells versus problems with signaling in the adult and the following issues should be addressed: the observation that synaptic bouton density is not disrupted is a good way to eliminate gross disruption of connectivity during development but does not rule out other more subtle developmental defects in neuronal function. The fact that shibire[ts] can cause effects in the adult is appreciated but does not really help us to understand what IP3R and perhaps mAcHR are doing during development.

      These, too are relatively minor concerns, and the difficulty inherent in overcoming the confounding effects of perdurance are appreciated. Indeed, the authors have already made it clear that they don't know whether developmental vs adult effects of their genetic manipulations are most important. In fact, the authors have tried to address potential this concern at multiple sites, perhaps trying to address previously critiques. While all of these caveats are correct, it may be useful to consolidate some of them.

      Additional Minor Concerns.

      To validate the decrease in the overall response to carbachol in Fig 1D and E, the authors show a statistically significant difference for area under the curve. A parallel metric and statistical test might be used to support the statement that the response is delayed in 1D but not 1E.

      "Interestingly, the mitochondrial response did not exhibit a delay in reaching peak values." Why is that? A brief explanation might be useful.

      The second explanation of how shibire[ts] works might be shortened.

    3. Reviewer #1:

      The authors report experiments on Drosophila to show that the proper function of an IP3 receptor in a small subset of dopaminergic neurons is required for flight behavior. Most interesting is the fact that the requirement is restricted to a time point during pupal development. Technically, the authors report a novel dominant-negative mutant for of the IP3 receptor to interfere with its function. Physiologically, the IP3 receptor-dependent impairment in the function of the dopaminergic neurons affects both synaptic vesicle release and excitability, Also, muscarinic acetylcholine receptors are required for proper development of the flight-modulating circuit during development.

      The role of dopamine in the brain of Drosophila (as a model for general dopamine and brain function) is in the center of current research, and is studied by a large number of laboratories. More and more types of behavior are discovered that are modulated by dopaminergic neurons, and in particular those innervating the mushroom body. Therefore, the study is of very high interest for researchers working on Drosophila, but also to a broader readership.

      The experiments are well designed. with appropriate controls at place. The conclusions drawn are highly interesting and novel (dopaminergic modulation of flight behavior, perhaps in the context of food seeking behavior, molecular mechanisms of circuit maturation).

      Minor comments:

      1) A test for normal distribution of data is required to determine whether parametric statistical tests are actually appropriate.

      2) It is not clear to me why the authors conclude an acute requirement of IP3R during the adult state although the phenotype can arise through a genetic intervention during earlier time points in development (Page 9, lines 297ff). This has to be outlined much clearer. My interpretation of the data is: During a certain time window after pupal formation IP3 signaling is required for a proper formation of the neuronal circuit. This is likely to be not only a cell-intrinsic (i.e., cell autonomous) effect because the mAchR is also required during this time window. This provides an excellent example (there are actually only very few!) of circuit development that requires synaptic interactions between neurons. If one keeps in mind that dopaminergic neurons have reciprocal synapses with Kenyon cells (e.g. Cervantes-Sandova, elife 2017; should be included in schematic illustration!)), and these release acetylcholine onto dopaminergic neurons, a potential circuit maturation based on the concerted activity is most interesting. I suggest that the authors point out more precisely how they think the actual phenotype comes about, of course, with all due caution.

      3) Statistical tests should be done across independent brains, not across different cells in the same brains.

      Additional data files and statistical comments:

      A test for normal distribution of data is required to determine whether parametric statistical tests are actually appropriate.

      Figure legend 5 C should be 5B. The scaling of the y-axis is not optimal.

      Statistical tests should be done across independent brains, not across different cells in the same brains. This would cause a mixture of dependent and independent data. This is of importance!

    4. Preprint Review

      This preprint was reviewed using eLife’s Preprint Review service, which provides public peer reviews of manuscripts posted on bioRxiv for the benefit of the authors, readers, potential readers, and others interested in our assessment of the work. This review applies only to version 2 of the manuscript. Ronald L Calabrese (Emory University) served as the Reviewing Editor.

    1. Reviewer #2:

      Despite the availability of a high resolution, expertly annotated digital adult mouse brain atlas (Allen CCFv3), accurately labeled 3D digital atlases across mouse neural development are lacking. The authors have filled that gap by developing novel computation methods that transform slice annotations in the Allen Developing Mouse Brain Atlas into digital 3D reference atlases. They demonstrate that the resulting brain parcellations are superior to a naive agglomeration of the existing 2D labels, and provide MagellanMapper, a suite of tools to aid quantitative measures of brain structure. Cellular level whole-brain quantitative analysis is rapidly becoming a reality in many species and this manuscript provides a foundational resource for mouse developmental studies. The methods are sophisticated, carefully applied and thoroughly evaluated. I have mostly minor comments that should be interpreted as suggestions to strengthen or clarify the presentation, not an indication of any significant concerns.

      1) The authors developed a clever 'edge-aware procedure' that they first employed to extend existing labels to unannotated lateral regions of the brain, taking advantage of intensity gradations in underlying microscope images. As this is an innovative procedure, the authors should manually annotate a small part of the lateral brain region to compare accuracy and compare computationally generated labels to the partial lateral labels in P28 brain.

      2) I have questions about how well the edge-aware procedure performed internally within the brain to smooth region parcellation. First, the edge-aware procedure relies on intensity differences in the light microscope images. However, the work of neuroanatomists would be dramatically simplified if such gradations provided sufficient information for brain segmentation. Annotations present in the ADMBA took advantage of co-aligned ISH data (and computational approaches using co-aligned gene expression data have been used for de novo brain parcellation). Intensity differences in the light-microscope images may not always provide enough information for accurate segmentation. Could there be instances where adjacent regions do not have intensity differences, and the edge-aware procedure actually reduces the accuracy of the manual annotation? Second, it does appear that despite the care to avoid losing thin structures, there is some loss, for example for the light-green structure in the forebrain in Fig. 5E. Could the authors indicate if all labels were preserved, and perhaps provide information on volume changes by label size.

      3) The accuracy of non-rigid registration of light-sheet images to the references is assessed only using a DSC value for whole-brain overlaps. This does not assess the precision of registration within the brain. The authors should apply some other measure to measure the quality of alignment within the brain (e.g. mark internal landmarks visible in the reference and original light-sheet images, and measure the post-registration distance between them).

      4) The P56 reference is close to an adult brain. The authors should compare the boundaries of their computationally derived parcellations to the recently published Allen CCFv3 brain regions.

    2. Reviewer #1:

      The manuscript demonstrated some interesting aspects of the data processing for the 3D registration of the mouse brain. At the same time, several concerns need to be addressed, by either revising the text or making additional computations.

      1) The 3D "smoothing" was the central part of the method reported in the manuscript. For example, the inclusion of the "skeletonization" step helped prevent the loss of thin structures compared to the previous methods such as the one by Niedworok et al (Ref #40 in the manuscript). However, the overall improvement did not involve any conceptually new algorithm but instead relied on the optimization of known parameters, which may appear incremental. The authors should avoid overstating their work.

      2) The pipeline of the method involved the "mirroring" before the "smoothing" steps. Is it possible to perform the "smoothing" of one hemisphere and then "mirror" the smoothed 3D atlas onto the other hemisphere to check for the alignment? By doing so, the other hemisphere could serve as an internal control for the quality and accuracy of the 3D atlas.

      3.) The "edge-aware" adjustment, which was essential for the improvement of 3D atlas, surely worked for the large brain regions with identifiable anatomical edges based on the 2D images. However, for more delicate subregions (e.g., those in the hypothalamus) without clear anatomical boundaries, this adjustment step may become ineffective. What could then be done for these subregions? Also, it is important to note that the anatomical edges required the manual annotation.

      4) The results presented throughout the manuscript are the axial views of brains. It would be informative to include, at least in Figures 2 and 3, the coronal views of 3D atlases to exemplify the quality.

      5) It is unclear why the authors chose the P0 brains for the lightsheet imaging. In addition, since both male and female mice were analyzed, is there any difference observed within the 3D brain atlases obtained?

    3. Preprint Review

      This preprint was reviewed using eLife’s Preprint Review service, which provides public peer reviews of manuscripts posted on bioRxiv for the benefit of the authors, readers, potential readers, and others interested in our assessment of the work. This review applies only to version 3 of the manuscript. Joseph G Gleeson (Howard Hughes Medical Institute, The Rockefeller University) served as the Reviewing Editor.

      Summary:

      Despite the availability of a high resolution, expertly annotated digital adult mouse brain atlas (Allen CCFv3), accurately labeled 3D digital atlases across mouse neural development are lacking. The authors have filled that gap by developing novel computational methods that transform slice annotations in the Allen Developing Mouse Brain Atlas into digital 3D reference atlases. They demonstrate that the resulting brain parcellations are superior to a naive agglomeration of the existing 2D labels, and provide MagellanMapper, a suite of tools to aid quantitative measures of brain structure. Cellular level whole-brain quantitative analysis is rapidly becoming a reality in many species and this manuscript provides a foundational resource for mouse developmental studies. The methods are sophisticated, carefully applied and thoroughly evaluated. The manuscript reports a computational approach to transforming available 2D atlases of mouse brains into the 3D volumetric datasets. By optimizing the "smoothing" steps, a better quality of such 3D atlases is produced. In addition, the authors applied their method to the imaging dataset of neonatal mouse brains obtained by lightsheet microscopy, as proof of its potential utilization in research.

    1. Reviewer #3:

      Authors aim to test the presence and functional significance of KNDy co-transmission at the GnRH distal dendrites in the ventrolateral ARN. The authors use expansion microscopy to score synaptic connections between KNDy and GnRH distal dendrites. Next, they use ex-vivo slice imaging to report the Ca2+ transients of GnRH distal dendrons during pipette application of candidate neurotransmitters. The authors go on to investigate the functional role of kisspeptin on the pulsatile firing of KNDy neurons and the subsequent release of LH using a combination of fiber photometry and repeated blood sampling. This manuscript is a continuation of a large body of work from this laboratory. Most of the techniques used here have been previously published by this group and are at the cutting edge of this research field. As a reviewer I have two points for the authors to consider:

      1) In 2016 Qi, Nestor et al. evaluated the mechanistic properties of synchronous firing of KNDy neurons. Along with this, they demonstrated that the influence of NKB on GnRH neurons was indirect and mediated by kisspeptin from KNDy neurons. Given this, I think it is important for the authors to more specifically compare and contrast the work from Qui, Nestor et al. 2016. While the authors do cite the manuscript, the findings are not thoroughly compared.

      2) The authors show that NKB was sufficient to induce [Ca2+] in KNDy neurons, but not in GnRH dendrons. Given this, I found it curious that a delayed, indirect, spike was not observed in (Fig 2 A,B) from KNDy induction. Can the authors clarify this?

    2. Reviewer #2:

      In this manuscript Liu and co-workers use in vitro and in vivo experiments to explore KNDy neuronal input onto GnRH nerve-fibers (called dendrons) in the arcuate nucleus median eminence area. The main strength of this work is the in vivo photometry experiment to activate ARN Kiss1 neurons combined with tail blood sampling for measurements of plasma LH as a substitute for GnRH secretion. It is well known that Kiss1 deletion causes infertility. In addition, it is known that in some Kiss1Cre mouse models homozygous animals are designed to be infertile, including the mouse model used in the current study.

      1) Using the infertile homozygous Kiss1Cre mouse, the authors showed that the lack of kisspeptin eliminates LH pulses following photometry stimulation in vivo of KNDy neurons, indicating that kisspeptin is responsible for LH pulses and is the main output signal from KNDy neurons onto GnRH terminals in the ME area. They also used this animal model to show that the absence of kisspeptin did not affect the synchronous firing of KNDy neurons, illustrating that kisspeptin is not involved in synchronous firing and that synchronous firing alone does not maintain fertility. However, previous studies both in vivo (Wakabayashi et al., 2010) and in vitro (Navarro et al., 2009, Qiu et al., 2016) had already provided substantial evidence for kisspeptin being the main output signal onto GnRH neurons and that NKB and dynorphin are responsible for synchronous firing.

      2) It is interesting that although KNDy neurons release the peptides kisspeptin, NKB and dynorphin as well as the classical neurotransmitter glutamate, only kisspeptin was able to activate GnRH dendrons in the ME area. This is surprising since this group has shown previously (Herde et al 2013) that both GABA and glutamate can depolarize GnRH distal dendrons. Specifically, they showed that puff application of glutamate (500 µM) on distal dendrons in vitro elicited bursts of action potentials. Currently, the authors used a similar concentration of glutamate applied in vitro and found no effect on Dendron calcium activity. Clearly further experiments are needed to sort out these differences. Overall, although this manuscript reports some compelling in vivo studies to ascertain the specific role of kisspeptin in the GnRH distal Dendron and confirm the role of NKB and dynorphin on synchronous firing, it is of limited scope and new information.

    3. Reviewer #1:

      The authors of this high-quality paper use contemporary viral/genetic technologies to show that KNDy neurons in the ARN regulate GnRH release in median eminence (ME) via kisspeptin signaling only, even though they release all their transmitters there. They monitor GCaMP fluorescence in GnRH dendrons to establish that kisspeptin signals there, but NKB, Dyn and GLU do not, whereas these 3 transmitters signal onto Kiss1-neuron cell bodies, while kisspeptin does not. They also show that loss of kisspeptin signaling in ME prevents LH release.

      1) Fig. 6A Authors should compare dF/F trace of Kiss1-Cre -/- with +/- mice, rather than referring to unpublished results.

      2) Line 337, Authors say, "As such, it is interesting to consider whether the episodic release of NKB and dynorphin from KNDy varicosities in the region of the ventrolateral ARN may impact on other ARN neuronal cell types." It is equally interesting to consider the possibility that KNDy neurons release all their neurotransmitters in the ME and NKB, Dyn and Glu may signal to non-GnRH neurons. It would be useful to include references documenting that NKB, Dyn and GLU are released in ME, even if kisspeptin is the only molecule that can signal to GnRH dendrons. If references do not exist, would it be possible to express GCcMP6 non-specifically ME and express ChR2 in Kiss1-Cre-/- KNDy neurons to show that cells in ME can respond to the other transmitters released by KNDy-neuron activation. Antagonists could then be used to establish which transmitters are released there.

    4. Preprint Review

      This preprint was reviewed using eLife’s Preprint Review service, which provides public peer reviews of manuscripts posted on bioRxiv for the benefit of the authors, readers, potential readers, and others interested in our assessment of the work. This review applies only to version 1 of the manuscript.

      Summary:

      The importance of kisspeptin signaling from arcuate KNDy neurons (expressing kisspeptin, neurokinin B, dynorphin and glutamate) for fertility is well established. KNDy neurons are thought to be critical for the episodic release of LH by acting on GnRH-neuron terminals in the median eminence. A question posed here is whether kisspeptin is the only transmitter signaling onto GnRH terminals (referred to here as dendrons) in the median eminence. Some evidence suggests that the KNDy neuropeptides can be packaged into individual vesicles; thus, it is possible that only those vesicles containing kisspeptin travel to the median eminence. Alternatively, it is possible that all peptides and glutamate are released in the median eminence, but only receptors for kisspeptin are present there. To address this issue, the authors express a calcium indicator in GnRH dendrons and determine which transmitters can generate a calcium signal. They show that only kisspeptin can do so and go on to demonstrate that in the absence of kisspeptin (using KO mice), no signal is generated. This is an important result but does not completely distinguish between the two hypotheses.

    1. Reviewer #4:

      PREreview of "Regulatory roles of 5′ UTR and ORF-internal RNAs detected by 3′ end mapping"

      Authored by Philip P. Adams et al. and posted on bioRxiv DOI: 10.1101/2020.07.18.207399

      Review authors in alphabetical order: Monica Granados, Runhua Han, Katrina Murphy, Nik Tsotakos

      This review is the result of a virtual, live-streamed journal club organized and hosted by PREreview and eLife. The discussion was joined by 20 people in total, including researchers from several regions of the world, four of the preprint authors, and the event organizing team.

      Overview and take-home message:

      Adams et al. have demonstrated with both their genome-wide and targeted analyses of RNA elements in E.coli how two labs can collaboratively come together to make significant advances in their respective fields while also producing a model paper to open the door for more research. Their research not only looked at non-coding sRNA regulation but identified so called gene "mistakes" that also have functions. In addition, they bridged the gaps in our knowledge about how sRNAs derived from internal open reading frames can act as sponges and how termination spots of 5' untranslated regions affects sRNA regulation on their target mRNAs. Although this work is of interest in microbial gene expression, below are a few concerns that could be addressed in the next version of this paper.

      Positive feedback:

      • All this work took only a year?! Congratulations, this is really great work.
      • The journal club definitely recommends this preprint for others in the field and for peer review. This work could be an important contribution.
      • The conclusions are supported by data. Many of the newly discovered sRNA and their regulatory mechanism were experimentally confirmed and investigated. All the data analysis support the hypothesis and conclusion of each section.
      • Really appreciate the manuscript. The introduction had enough background for why the researchers took this approach. Really enjoyed reading this paper - even with a neuroscience background.
      • This preprint provides a lot of information of RNA termination sites by 3' end mapping in the model bacteria (E. coli), which also enlightens the studies relevant to sRNA discovery and RNA regulation mechanisms in other bacteria.
      • One of the most exciting and novel findings is that the 3'-end termination of the 5'-UTR of some known sRNA targets can reinforce the sRNA regulation.
      • A potentially exciting opportunity for studying differential regulation via sRNAs during the exponential growth and plateau phases.
      • The paper employs very high-throughput sequencing technologies on a bacterial model that normally doesn't get so much attention, especially on the non-coding RNAs and post-transcriptional regulation.
      • The current knowledge of sRNA regulation mechanisms are expanded.
      • Primes more questions by trying out new techniques to find new regulatory areas.
      • Just the beginning of the deeper dive model into gene regulation and Rho-dependent termination - opens the door for more research and makes this paper extra referenceable moving forward. For future research or consideration, what can be extrapolated from this research for other organisms?
      • I thought the methods were very thorough, they also have a data availability statement and uploaded the sequencing data.
      • Data is available, and UCSC browser tracks made available!
      • Gold star for having code used for calling the 3' ends open and available on github (always a pro in my eyes!) +2 for GITHUB!
      • Genome-wide data can give other researchers a chance to find new mechanisms relevant to their genes and circuits of interest.
      • So much detail was available! I am not familiar with the standard techniques in the field, but from what I read the detail seemed to be reproducible.
      • I always appreciate when the Results subsections are bolded which helps gather my thoughts.

      Major concerns:

      1) The authors may consider adding another figure panel or some additional text summarising how the 3' ends they mapped are distributed over the genome - e.g. are they enriched in any specific region or well-distributed?

      2) The authors mention that they identified 412 genomic loci putatively associated with a Rho termination event, based on a Rho score of 2.0, indicated in Table S2. However, in Fig. 1C the total number of Rho-dependent termination events mentioned is 433. The discrepancy between these two numbers can be slightly confusing. Could the authors describe the methodological differences that led to the two different numbers?

      3) The authors identify the 280nt mdtJI transcript that is the result of premature termination, and show very nicely how this transcript is susceptible to read through in the presence of spermidine under elevated pH conditions (see Figure 3). In Figure 2F, however, the Northern blot indicates the presence of a longer transcript as well in the presence of the mutant Rho. Do the authors have any indications what this longer transcript (~400bp) is?

      4) With regards to the results presented in Figure 4, the authors consider the possibilities of MicA-directed cleavage of the ompA mRNA or protection from degradation due to base pairing with the sRNA. If the first possibility were true, could the probe used in the Northern blot detect smaller fragments, or was it designed to only detect the full length transcript?

    2. Reviewer #3:

      The paper of Adams et al. attempts to provide a resource of Rho-dependent and independent transcript 3' ends in the model bacterium Escherichia coli, focusing especially on 3' ends identified in 5' UTRs and within coding sequences. Studying several of these termini in detail, the authors present interesting novel types of regulatory loops involving products of pre-mature transcription termination or of mRNA transcript processing. These include, for example, small RNAs derived from 5' UTRs of targets of canonical sRNAs, which sponge the canonical sRNAs and, in turn, affect the target they are derived from. The paper will be of interest to the microbiology and RNA communities, and may inspire in-depth investigation of regulatory loops and novel sRNAs discovered here, as well as the discovery of additional novel regulatory RNAs and new structures of regulatory loops inferred from the resource that the authors provide.

      Major comments:

      Additional analyses of the data are needed, as detailed below.

      1) Comparison between the large-scale data sets of 3' ends provided by the current and previous studies. It is very important that the comparisons between the current data set of 3' ends and previous ones will be done properly, especially the comparison with a data set generated by the same protocol (Term-seq) by the developers of the protocol, Dar and Sorek (2018). There are several issues that should be considered in regard to the comparisons to previous data and evaluation of the statistical significance:

      a) Computation of the statistical significance of overlapping results by the hypergeometric test. It is not clear how the reported p-values were computed, and it is not possible to re-compute them as the value of N was not provided. For this test, the p-value of a result at least as good as the one obtained should be computed ("cumulative p-value"). Looking at the results in the Venn diagrams presented in Supplementary Figure S1, it is hard to see how p-values of <10-100 were obtained. The authors should check their computation. They should provide the details of the computation for all hypergeometric tests included in the manuscript, to enable their assessment.

      b) Data processing to reveal 3' ends. The computational method used to process the Term-seq data is different from the one presented in the paper of Dar and Sorek. The authors should explain why they turned to a different computational scheme and what is it’s advantages. It would be more appropriate to compare the current data set and Dar and Sorek's data set when analyzed by the same computational methodology. The authors should apply their new computational method to Dar and Sorek's data, or analyze their results by Dar and Sorek's computational method, and re-assess the overlap in the determined 3' ends.

      c) Rho-dependent termination. It is not clear why the authors followed Dar and Sorek for determining Rho-dependent termination. Dar and Sorek used available data of BCM treated cells from Peters et al. (2012), and therefore could only evaluate the readthrough in the vicinity of determined 3' ends. Since the authors made the effort to treat the cells with BCM and generate sequencing libraries, it is not clear why they did not simply carry out Term-seq following BCM treatment and compared the identified 3' ends to those determined without BCM. Secondly, in evaluation of the readthrough the authors, again, modified the computational method of Dar and Sorek. This needs justification and the parameters used need explanation (window size of 500 nt and threshold of the Rho score of at least 2). For the comparison of the results, the Dar and Sorek data set and the current data set should be analyzed by the same method and the results compared. In connection to that, since the BCM experiment was conducted in the current study only once, it would be important to analyze the Peters et al. data by the new computational method and compare the results. The analyses described in comments (1b) and (1c) might improve the overlap between the results of the different studies and reduce the inconsistencies.

      d) If the present large discrepancies between the current data set and previous one stay despite the new analyses, the authors need to carefully examine the similarities and inconsistencies, try to understand the reasons for that, and assess the reliability of their data.

      e) The authors can compare their own data sets in the different growth phases and conditions. It would be interesting to examine if the same or different 3' ends were deciphered in the three experiments. I believe it is expected that many of the termini will be re-discovered but some will be different between the different growth phases and conditions. This analysis will provide an assessment of the consistency of the results and might provide new biological insights.

      2) Experimental results

      a) Several 3' termination sites were tested experimentally by molecular experiments. From the reported results it seems that all tested sites were re-confirmed by the molecular experiments. How were the studied sites selected? Were there sites from the large-scale data that were tested by the molecular experiments and were not confirmed as 3' ends? A report of true positives and false positives would provide another important assessment of the reliability of the data.

      b) It would be informative to assess the correspondence between the Rho score and the ratio of beta galactosidase activity between rho mutant and WT cells (Figure 2 and Supplementary Figure S2). It seems that genes with Rho scores below 2, such as sugE, may show high ratios. How should users of the provided resource consider the Rho score values?

    3. Reviewer #2:

      Adams et al. have comprehensively identified the 3' ends of transcripts in E. coli and demonstrate that many transcripts are prematurely terminated either by Rho-dependent or intrinsic manner. Strikingly, in addition to small RNAs prevalently discovered in 3'UTR, the authors reveal that several premature transcripts generated from 5'UTR or internal CDS also function as sponges of Hfq-dependent small RNAs, i.e. pairs of ChiZ-ChiX, IspZ-OxyS and FtsO-RybB. It remains unclear which RNA chaperones and RNases are involved in the regulation. This study introduces new members to an emerging class of bona fide regulatory RNAs derived from mRNAs.

      1) Pages 10 - 12; The results of LacZ reporter assay and northern blot seem contradictory at a glance. Expectedly the reporter experiments which are carried out with the cells of OD0.4~0.6 showed a significant increase of LacZ activity in the rhoR66S mutant, which is defective in Rho-dependent termination (Figs. 2DE and S2B). On the other hand, in many cases, the northern blot analysis of total RNA extracted from the cells of OD0.4 revealed the increase of premature terminated 5'UTR fragments in the rhoR66S strain (Figs. 2F and S2C). Moreover, some 5'UTRs exhibited different patterns at OD2.0. This cannot be accounted for simply by the difference in growth phase (the last sentence of Page 10). The authors' suggestion that higher levels of longer transcripts in the absence of Rho are processed to give the shorter products (Page 12, Lines 7-8) is confusing since the increased LacZ reporter should be expressed from the longer transcripts. This point can be clarified by rehybridizing the northern blots with probes for corresponding genes downstream of the premature termination regions.

      2) In the same direction as the comment above, the northern blot analysis for mdtJI shows that the premature termination product of mdtU (~280 nt) is increased in the rhoR66S strain during growth in a normal LB medium (Fig. 2F). In stark contrast, the increase of mdtU transcript seems not significant in the LB pH9.0 without spermidine (Fig. 3E; lanes 1 and 3). However, in the presence of spermidine, the level of mdtJI long transcript was rather decreased in the rhoR66S strain (Fig. 3E; lanes 2 and 4). This result is contradictory to the result of LacZ reporter assay (Figs. 2DE). The influence of spermidine to the mdtU-lacZ reporter expression should also be tested.

      3) Pages 20-21; The effect of RybB on FtsO has not been clarified in the manuscript. When RybB is abundant, the level of FtsO was lower than the other situations (Fig. 7B, lane 6). This is indicative of coupled degradation upon base-pairing between FtsO and RybB. However, when RybB was induced by ethanol, the level of FtsO was rather increased (Fig. 7E), probably attributable to transcriptional activation of ftsI. To clarify the reciprocal regulation between RybB and FtsO and its consequence, this reviewer suggests quantifying the half-life of each sRNA in the presence or absence of its counterpart sRNA.

    4. Reviewer #1:

      In this study, Adams et al. apply various RNA-seq-based approaches to map transcript 3'ends in E. coli in a genome-wide manner and distinguish between 3' ends derived from processing, Rho-dependent, or intrinsic termination. Strikingly, classification of 3'ends revealed that less than one quarter located within a 50 bp window downstream of annotated coding sequences (CDSs), whereas a substantial fraction fell within 5'UTRs and CDSs. The authors show that several transcription termination sites (TTSs) in 5'UTRs locate downstream of known cis-regulatory elements (riboswitches, uORFs) and may arise from premature transcription termination, leading to the hypothesis that other cis-regulatory elements may be discovered by characterizing 3'ends within 5'UTRs. Indeed, further supporting this, the authors present mechanistic data for a uORF (termed mdtU) affecting Rho-dependent transcription termination of the downstream operon in response to the polyamine spermidine.

      Other 3'ends were adjacent to known sRNA target sites within mRNA 5'UTRs or ORFs. Since several of these RNA fragments accumulate to high levels under physiological conditions, the authors go on demonstrating function for three such representatives (namely two 5'-derived RNAs, termed ChiZ, IspZ, and one ORF-internal candidate, FtsO). Interestingly, all three of them were found to be "sponges" of bona fide intergenic sRNAs, affecting either the activity of the latter (ChiZ on ChiX) or their steady-state levels (IspZ on OxyS; FtsO on RybB).

      Together, this important study expands our definition of bacterial sRNAs, demonstrates functionality of several "nonconventional" sRNAs, blurs the discrimination between regulator and target, and is expected to boost future studies looking into bacterial sRNAs derived from 5'UTRs or ORFs. The study is timely - as several recent studies proposed the existence of noncanonical sRNAs - and highly relevant as it provides data to support functionality of some of these RNAs (e.g. FtsO is the first ORF-internal sRNA with a reported function).

    5. Preprint Review

      This preprint was reviewed using eLife’s Preprint Review service, which provides public peer reviews of manuscripts posted on bioRxiv for the benefit of the authors, readers, potential readers, and others interested in our assessment of the work. This review applies only to version 1 of the manuscript.

      Summary:

      In the present study, you have comprehensively identified the 3' ends of transcripts in E. coli and demonstrated that many arise from premature transcription termination in either Rho-dependent or intrinsic manner. As a result, you discovered numerous stable RNAs derived from 5'UTRs or CDSs and functionally characterized several of these "unconventional" RNAs as sponges of well-studied Hfq-dependent small RNAs. The reviewers all agreed that this is impressive work, the findings are novel and relevant for researchers within the microbiology and RNA communities and may inspire future studies of non-canonical bacterial sRNAs. Overall, they deem the results convincingly supported by the experimental data, but would like to see a few more experimental and analytical amendments to your work.

    1. Reviewer #2:

      The manuscript addresses a very interesting topic, namely the possibility that DHX30 protein exists in two alternatively transcribed variants that have a role, respectively, in the cytoplasm and in the mitochondria. The first of the two functions is relatively new and barely addressed in the literature. The mitochondrial localization has already been described in previous works where, among others, has been shown to be important for mitochondrial function, possibly acting at the transcriptional level. The experimental approach is largely based on the "specific" depletion of either one of the two isoforms, and a downstream analysis (RNAseq, a few biochemical endpoints). The phenotypic results are relatively few and the authors conclude that DHX30 may have a role in "...coordinating ribosome biogenesis, global translation and mitochondrial metabolism...".

      The main criticism that I have of this work is that...although this term is often abused by editor's polite answers, it is rather preliminary. There are a consistent number of shortcuts that, in my mind, when taken all together, cast some doubts on the correct message. I will describe these limits by going systematically through the data.

      In Figure 1, the authors describe the effects of shDHX30 on several endpoints: 1. The authors employ here a single shRNA which is really not sufficient given the very well known problem of off-target effects; 2. With the exception of a few confirmatory experiments the whole analysis is based on a single cell line; 3. In 1B there is a plot indicating the relative translation efficiency of ribosomal protein mRNAs. However the Supplementary Table 1 is not properly annotated and not all ribosomal mRNAs seem equally regulated; 4. The polysomal profiles have very low polysomes and very high 80S, raising some questions on the actual relevance of the regulation of Pol/Sub peak described in Fig. 1g (seen with a single shRNA); 5. The statement of increased ribosome biogenesis is not solid. The authors mention quantitation of 18S rRNA and nucleolar intensity of 18S staining. However, the state of the art must be pulse-chase analysis followed by autoradiography and/or Northern blotting of rRNA precursor, possibly with two shRNAs and perhaps even with a couple of cell lines; 6. The logic by which an increase in rRNA is co-regulated with an increase of translation of ribosomal protein mRNA is obscure and has no explanations: is signalling involved? Is it indirect? 7. The authors claim an effect on translation. The correct interpretation of the polysomal profile is a reduction in initiation of translation (which in itself brings back to the question of 6. what happens to mTOR signalling?). 8. The authors show a very clear increase in AHA. How does this increase in incorporation fit with the data of Fig. 2/3 showing a reduction in mitochondrial fitness? In short this Figure assembles several data without building a strong case. All these points are touched upon but not developed properly in the following tables.

      In Figure 2, the authors show the effects of shDHX30 on mitochondrial proteins. In general, this set of data is relatively convincing. What is not totally convincing is the existence of a cytosolic form of DHX30 (Fig. 2f, for instance). I believe that the existence of a cytosolic form of DHX30 is a potentially very cool finding. But a) the levels of this cytosolic form seem minimal, b) the effects of its specific downregulation with a (single) specific shRNA are absent or a bit contradictory (Fig. 2g, MRPS22 versus MRPL11), and c) none of the assays of Fig. 1 (global DHX30 downregulation) has been reproduced by the interesting experiment, here, of the specific downregulation of either a cytosolic or a mitochondrial form of DHX30.

      Finally, in Figure 3, the authors explore the effects of downregulation of DHX30 on mitochondrial functionality. Overall, the biological effects are very convincing (in short, a reduction in the oxygen consumption rate), although the mitochondrial analysis is really rudimentary (EM? ATP? ). What strikes me is that the authors started with the point of translation of mitochondrial mRNAs and then, here, look at data on mRNA levels of the OxPhos machinery. I fail to see the mechanistic connection.

      The manuscript is written in an approximate way with some confused statements. Example, methods "rRNA biogenesis was performed" (??), fluorescence is low quality with bad resolution, I failed to find Supplementary Table 2 and 3 (perhaps it is my browser, but they seem empty). If the authors would be able to clearly define a) the effects of downregulating DHX30, b) convince about the presence of a cytosolic isoform and c) its role, this paper is really interesting.

    2. Reviewer #1:

      In this manuscript, Bosco et al. propose that DHX30 coordinates cytoplasmic translation and mitochondrial function to impact on cancer cell survival. They deplete DHX30 and report that this causes an enhancement of translation including those of mRNAs encoding for cytoplasmic ribosomal proteins, while paradoxically reducing the translation of mitoribosome protein mRNAs. There are cytoplasmic and mitochondrial isoforms of DHX30 and the authors assess the long-term consequences of knockdown of the cytoplasmic versus mitochondrial + cytoplasmic proteins. Some of the novelty of this paper has been preempted by a previous publication by Antonicka and Shoubridge showing that loss of DHX30 results in impaired mitochondrial ribosome assembly, impaired mitochondria OXPHOS assembly, impaired mitochondrial mRNA precursor processing, and a very severe decrease in mitochondrial translation. I think the work, while interesting, is preliminary and should aim to provide mechanistic insight for the phenotype associated with DHX30 knockdown.

      As far as I can see, none of the targets obtained from the polysome profiling are validated in this study. This is concerning since polysome profiling was previously reported in a Cell Report 2020 publication by the authors (GSE 95024; available at the GEO database), but the origin of the RNA-seq data in the current paper is not clear (GSE 154065; not available at the GEO database). We do not know if the RNA-seq data was generated from the same samples as the polysome profiling samples previously reported or completely independent of these (this information is lacking). Regardless, validation of any putative translation responsive genes predicted from polysome profiling data would appear to be a reasonable expectation these days.

      The authors claim that depletion of DHX30 leads to increased global translation (Figs 1f, g). They also provide evidence that translation of mRNAs encoding cytoplasmic ribosomal proteins is increased, while the translation of mRNAs encoding mitoribosome ribosomal proteins is decreased (Fig 1b). DHX30 is associated with ribosomal subunits, 80S monosone and low-molecular weight polysomes, and it also interacts with a CG-rich motif for p53-dependent death (CGPD) in 3' UTRs of mRNAs. What is lacking is a mechanism to explain these observations (if the data validates)? To this reviewer the lack of mechanistic insight is a serious shortcoming of the current submission. What is responsible for the general translational increase (including cytoplasmic rps encoding mRNAs), yet mitochondrial rp mRNA translation decrease, upon DHX30 knockdown? Many rp mRNAs have TOP motifs at their 5' ends, is this pathway affected?

      The authors previously identified DHX30 as a CGPD-motif interactor. They published this as a specific DHX30 binding motif, yet this motif is not enriched in the new data set established by the authors. I don't understand the statement put forth by the authors on line 286 that " While we cannot exclude that the CGPD motif can be implicated, only a subset of RP transcripts harbors instances of it". Either it is significantly enriched or it is not. In any event, there appears to be an inconsistency with previously published data.

      The ENCODE eCLIP data suggests that DHX30 can bind to 67 cytoplasmic ribosomal and 23 mitochondrial protein transcripts. Yet in their eCLIP validation experiments using RIP, the authors probe for the potential of DHX30 to bind to only MRPL11 and MRPS22 (Fig 2a). They write "These findings suggest that DHX30 directly promotes the stability and/or translation of mitoribosome transcripts." What about the cytoplasmic ribosome protein mRNAs, which according to the ENCODE data can also bind DHX30, yet their response to DHX30 depletion is the opposite of that of the mitoribosome protein mRNAs. I think it may be premature to correlate DHX30 with mitoribosome protein regulation.

      The comparison of the efficiency of knockdown using siRNAs targeting the cytoplasmic form versus the mitochondrial + cytoplasmic forms versus shRNA knockdown efficiency is confusing and, in my humble opinion doesn't add insight into mechanism of action. "Transient silencing of DHX30" (ie, using siRNAs) achieves ~50% mRNA reduction in HCT and U2OS cells 48-96s following transfection. On the other hand, silencing of DHX30 mRNA using shRNA achieved better levels of reduction (60-75% decrease) in U2OS and MCF7 cells (Fig S2e). The authors use these differences in knockdown efficiencies to correlate differences in expression response of several mitochondrial encoded genes. The authors need to show the extent to which DHX30 protein levels are reduced in the siRNA treated cells (only changes in mRNA levels are presented). As well, there should be a genetic rescue experiment to show that siRNA or shRNA resistant DHX30 cDNA can overcome this effect. Lane 3 of Fig 2h appears underloaded as assessed by the actin intensity. MRPL11 protein levels appear greater in lane 2 (siDHX30-C) compared to lane 1, why is that?

      Please provide details on the siRNA and shRNAs used. It appears that only one shDHX30 was used to target cytoplasmic DHX30 and one shRNA to target cytoplasmic + mito DHX30. I couldn't find information on this.

      If mutations in DHX30 are known to trigger stress granules formation, does knockdown of DHX30 do the same. Is eIF2 alpha phosphorylated upon HDX30 knockdown?

      There appears to be several DHX30 mRNAs made through alternative splicing (see https://www.ncbi.nlm.nih.gov/gene/22907). In this study, when the authors refer to cytoplasmic DHX30, is the equivalent function being attributed to these different potential isoforms?

      The pictures in Figs 1e, 2d, and S3g are quite difficult to appreciate and should be provided at higher magnification.

      Fig 2f. Why is there so much tubulin in the mitochondrial protein extract lane?

      Suppression of DHX30 mRNA leads to lowered proliferation rates in HCT116 cells. This however was not due to significant alterations in the cell cycle (Fig 4e). Apoptotic rates do not appear to be affected (compare HCT_shNT to HCT_shDHX30 in the DMSO samples of Fig 4g). Can the authors please provide an understanding into what is leading to the lowered proliferation rates if cell cycle progression and cell death are unaffected. Confusingly, "transient" silencing of DHX30 mRNA (protein levels were not assessed) in U2OS cells did not impact proliferation while in MCF7 cells it did. Although the authors attribute this difference in response to better depletion of DHX30 mRNA in MCF7 cells, they do not actually measure DHX30 protein levels and the use of different cell lines complicates the interpretation.

      Line 267 "none of the DHX30 closer homologs showed strong evidence of such localized translation". What homologs are being referred to here?

      Line 269. "Although our experiments did not enable us to confirm this in HCT116, a previous report also showed evidence for DHX30 interaction with mitochondrial transcripts in human fibroblasts by RIP-seq (Antonicka and Shoubridge, 2015). Our data instead point to a direct interaction with mitoribosome transcripts and their positive modulation as another means by which DHX30 can indirectly affect mitochondrial translation." DHX30 thus interacts with many different mRNAs and in my view it becomes difficult to ascribe a particular biological response to DHX30 to a particular set of transcripts based on interaction data.

    3. Preprint Review

      This preprint was reviewed using eLife’s Preprint Review service, which provides public peer reviews of manuscripts posted on bioRxiv for the benefit of the authors, readers, potential readers, and others interested in our assessment of the work. This review applies only to version 1 of the manuscript.

      Summary:

      The major weaknesses of the paper are: 1. The work is preliminary as there is very little mechanistic insight to explain the major findings. 2. Some of the conclusions are not substantiated by the data. 3. Targets from the ribosome profiling were not validated.

    1. Reviewer #2:

      Dzyubenko et al. have addressed the role of ECM in the control of inhibition and excitation in primary neuronal cultures. Their impact statement reads: "this study revealed the essential role of brain extracellular matrix in controlling synaptic inhibition and neuronal network activity", which makes it erroneously appear that no other past studies have addressed exactly this topic. There is a vast amount of literature on the link between ECM, particularly on PV-INs and development of inhibition, critical period and regulation by the orthodenticle homeobox 2 (Otx2) by the Hensch group. None of this literature is cited in the text. Moreover, there are numerous references indicating clear functional changes following depletion of ECM in vivo (e.g., PMID: 32457072, just to mention one of the most recent studies). In addition to failing to cite previous evidence obtained in vivo for the role of ECM in the regulation of E/I balance and development, with the exception of an anatomical study in the cortex, the authors limit themselves to studying the effects of ECM depletion in immature neuronal cultures. The following list of major concerns with the study is far from complete:

      1) It is unclear how the ratio of excitatory to inhibitory cells of 2:1 was established in the primary cultures. This seems purely coincidental based on Fig.S2, but it surely does not reflect the 4:1 or 5:1 ratio found in vivo. With such an abundance of I-cells vs E-cells in the culture, one can immediately question the physiological relevance of the findings.

      2) One of the physiological consequences of the deletion of ECM in culture is the increased amplitude and frequency of mIPSCs. However, the bimodal distribution of these mIPSC parameters begs the question of how the authors made sure that they recorded from the same neuronal types in their cultures. Moreover, the use of TTX may not ensure that the mIPSCs are Ca2+-entry independent events. Depolarized terminals, and spontaneous closures of K channels within may lead to the opening of voltage-gated Ca channels that could increase both amplitude and frequency of the "mIPSCs".

      3) A similar concern as above surrounds the MFR and MBR of the cultures as measured with the MAE. In these recordings there is no distinguishing between the firings and bursting of E- or I-neurons.

      4) The modeling part of the study cannot be but biased by the results obtained in cultures. Does it also accurately predict the effects of BMI and CGP46381? How was the effect of CGP46381 distinguished between excitatory and inhibitory terminals, as the antagonist affects GABA-B receptors on both?

    2. Reviewer #1:

      The authors of the manuscript entitled "Extracellular matrix supports excitation-inhibition balance in neuronal networks by stabilizing inhibitory synapses" undertook a study to understand the mechanism(s) by which the extracellular matrix (ECM) of the brain may stabilize neuronal excitability and synaptic plasticity. The study heavily utilized in vitro networks consisting of mature, cultured, hippocampal neurons (with a 2:1 ratio of excitatory to inhibitory neurons) where the ECM was disrupted via enzymatic treatment with chondroitinase ABC or hyaluronidase for 16 hours. Control cells were treated with vehicle (0.1 M PBS).

      The study made several interesting observations. Using their in vitro network, the authors were able to show a reduction in both excitatory and inhibitory synapse density after ECM depletion (Figure 1C). In vivo, they observed a specific decrease only in the inhibitory synapse density after ECM depletion (Figure 2D). To understand how ECM depletion-induced reductions in inhibitory synapse density affect synaptic transmission, the authors recorded miniature inhibitory postsynaptic currents (mIPSCs) in control and ECM depleted cultures. These measurements showed an increase rather than a decrease in the amplitude and frequency of mIPSCs (Figure 3C-D). In contrast, spontaneous network activity measured via multielectrode arrays revealed a significant increase in both firing rate and bursting rate after ECM depletion. Ultrastructural microscopic analysis of scaffolds within structurally complete GABAergic and glutamatergic synapses showed that ECM depletion reduced the size of gephyrin, but not PSD95 scaffolds (Figure 4C). Although the size of the gephyrin scaffolds were reduced, the immunoreactivity of GABAA receptors inside gephyrin containing postsynapses was not altered (Figure 4B, D) nor was the total expression of GABAA receptors affected (Figure S3). A significant reduction in GABABR in VGAT+ terminals was however noted.

      The current manuscript provides ample evidence for both an ECM depletion mediated reduction in inhibitory synapse density and an increase of spontaneous network activity. However, essential functional data is needed (see the list of concerns below) to support the conclusion of a homeostatic increase in inhibitory synapse strength via the reduction of presynaptic GABAB receptors. Functional evidence should also be supplied to show an ECM depletion mediated alteration in the excitation-inhibition (E-I) balance.

      Concerns:

      1) To ensure that ECM depletion did not affect cell survival in neuronal cultures, the authors examined DAPI stained neurons for fragmented nuclei, but more specific assays for cell death such as TUNEL, Fluoro-Jade or activated caspase-3 staining should be incorporated into their study.

      2) It is unclear whether enzymatic ECM digestion/disruption is equally efficient at inhibitory and excitatory synapses. Data in Figure 4C shows no magnitude reductions in the PSD95 scaffolds after ECM depletion, is this reflective of specificity or rather a less efficient enzymatic disruption at excitatory synapses?

      3) Although the PBS vehicle and ECM digestion were delivered ipsilaterally, it was unclear whether there was an accompanying effect contralaterally. This was largely because neither quantification of synapse densities nor the magnified images of the yellow contralaterally positioned squares were shown.

      4) Additional functional tests are needed to show that ECM depletion strengthens inhibitory input to single neurons. These functional tests could include measurements of the paired-pulse ratio and uIPSCs, with analysis of both the CV for uIPSCs and the failure rate. Functional tests should also be added to show that in this in vitro cell culture preparation, ECM depletion results in a functional reduction in presynaptic GABABR activation and a subsequent increase in presynaptic release of neurotransmitter.

      5) Given that excitatory synapse densities were also reduced in the cultured neuronal preparations (Figure 1C), measurement of miniature excitatory postsynaptic currents (mEPSCs) should be included in the study. In some cases, reductions in inhibition and excitation can be balanced leading to no net change in E-I balance in the neural circuit, so it's important to consider both parameters.

      6) It is unclear whether the increased firing and bursting are due to the presynaptic blockade of GABABRs or GABABRs localized elsewhere. The equally increased firing rate in the control and ECM depleted condition after bicuculine methiodide application could be interpreted to show that (in the absence of all GABAA-mediated inhibition) the maximum neuronal firing rate is largely unaffected by ECM depletion, and remains similar to the controls.

    3. Preprint Review

      This preprint was reviewed using eLife’s Preprint Review service, which provides public peer reviews of manuscripts posted on bioRxiv for the benefit of the authors, readers, potential readers, and others interested in our assessment of the work. This review applies only to [version 2] (https://www.biorxiv.org/content/10.1101/2020.07.13.200113v2) of the manuscript.

    1. Reviewer #3:

      The manuscript "EFF-1 promotes muscle fusion, paralysis and retargets infection by AFF-1-coated viruses in C. elegans" describes the ability to VSV virus coated with AFF-1 fusogen can be targeted to specific cells in vivo using C. elegans. Using this technique, the authors elegantly show that AFF-1 viruses show tissue/cellular tropism in vivo that largely match known AFF-1 or EFF-1 receptor expression, which they verify through genetic mutation and ectopic expression. Overall, I would like to commend the authors on a fascinating and scientifically thorough manuscript that would be of interest to a broad range of scientists, from C. elegans researchers to viral engineers. However, while there are several lines of evidence that suggest cell-to-cell fusion in the muscle upon EFF-1 ectopic expression, they are all circumstantial. So I suggest the authors tone down the strong language used throughout the manuscript that outright state EFF-1 induces muscle fusion, including in the title, unless they use EM or photoconvertible fluorescent markers that show actual shared cytoplasm between cells.

      Major issues:

      1) The authors have not clearly shown that EFF-1 and VSV-EFF-1 cause muscle cell fusion. Nuclei count is not evidence of cell-cell fusion (Fig. 4I) and it is not clear from the images how the authors can distinguish the plasma membrane of muscle cells in order to count nuclei per cell in Fig 4I and Fig 7O-P. Furthermore, the authors claim muscle cell fusion in the myo-3p::eff-1 strain based on indistinguishable membranes expressing membrane-bound YFP and even distribution of mCherry (Fig 5). But loss of membrane bound YFP and distribution of mCherry are not clear evidence of cell fusion, especially when qualified and not quantified. Definitive evidence of cell-cell fusion in the muscle can be shown with EM or using a photoconvertible fluorescent protein which could show actual sharing of cytoplasm between cells. So claims like the following (and many others including the title) are too strong given the data in the manuscript:

      a) "EFF-1 expression in BWMs induces their fusion" (Line 331)

      b) "evenly distributed cytoplasmic myo-3p::mCherry indicating fusion and content mixing between these cells during development" (lines 297-299)

      c) EFF-1 expression in fused BWMs enables VSV∆G-AFF-1 and VSV∆G-G spreading (line 349)

      2) Figure 3 does not convincingly show key data to fit with their hypothesis that VSV-AFF-1 infection would increase upon EFF-1 expression in a dose-dependent manner. Based off of Figure 3, the authors conclude that "hypodermal infection by VSV∆G-AFF-1 increases with conditional induction of eff-1." (Lines 229-230). But they use an assay counting GFP-positive nuclei. So the result showing a decrease in GFP+ nuclei as eff-1 levels decrease is likely due to a loss of natural syncytium formation in the hypodermis rather than due decreased infection by VSV-AFF-1. As they stated in lines 199-200, GFP+ nuclei in the hypodermis are localized closer to the injection region of the head in eff-1 mutants. So higher eff-1 expression would lead to both a larger hypodermal target for viral infection and more posterior nuclei within that target for the virus to spread towards, showing GFP expression when the syncytium becomes infected. To control for this, the authors could infect the eff-1-ts mutant with VSV-G and show no dose dependent effect.

    2. Reviewer #2:

      The manuscript by Meledin et al have used the C. elegans model to investigate two interesting aspects: (1) The consequence of ectopically fusing the normally mononuclear body wall muscle cells by expressing the eff-1 fusogen (2) using VSV∆G virus particles coated with the AFF-1 fusogen to change the tropism of the virus and preferentially infect muscle cells. This manuscript describes a novel and truly innovative approach in the C. elegans model to develop methods for cell-specific viral targeting by modifying the host genome. I find the data showing preferential and efficient infection of EFF-1 expressing cells by VSV∆G-AFF-1 spectacular, as there are many applications that could be developed using this approach. In addition, showing that fused body wall muscles do not function normally is a significant finding, even though the exact causes of the strong defects that were observed are not investigated in detail. Here, the manuscript could be strengthened, for example by including an ultrastructural (EM) analysis of the fused muscle cells.

      Overall, the manuscript is very well written and based on solid data. Some figures are a bit difficult to interpret (e.g. fig. 6 showing the fused muscle cells).

    3. Reviewer #1:

      In their manuscript, the authors examine Vesicular Stomatitis Virus (VSV) coated with fusogen infection in C. elegans based on previously developed pseudotyped virus VSVG-AFF-1. They show VSVG-AFF-1 can efficiently infect C. elegans multiple tissues through microinjection, and the infection requires the function of bilateral fusogen (AFF-1 or EFF-1) on the target cells. Furthermore, using the genetic and living imaging techniques, they observed that overexpression of EFF-1 in muscle leads to paralysis, dumpy, and uncoordinated phenotype. AFF-1 coated pseudovirus can thus infect BWMs with ectopically express EFF-1, and significantly enhance the uncoordinated behavior, which may be due to the merge of BWMs or formation of non-functional syncytial muscle fibers. This is an interesting, well-written, and thoughtful study to show that C. elegans can be infected by a virus with the bilateral fusogen and represents a significant advance in identifying important players mediating virus infection in C. elegans.

      Major Comments:

      1) myo-3 encodes a myosin heavy chain, and its promoter is very strong for the gene expression. Overexpression of myo-3p::GFP/mCherry with high concentration extrachromosome array frequently results in uncoordinated, dumpy, or paralysis phenotype, which due to inconsistent expression, chimeric expression, leak expression and varies copies expression that inhibits the endogenous promoter. The authors show that extrachromosome array of muscle expression of EFF-1 causes uncoordinated, dumpy, larval arrest, and paralysis phenotypes, which may be due to both myo-3 promoter or EFF-1 expression in the muscle. It is very difficult to draw any solid conclusion here. As most of the data were based on the extrachromsome muscle expression of EFF-1, it is important to generate a single-copy insertion of myo-3p::EFF-1 to mimic the endogenous expression levels and test whether ectopic expression of EFF-1 is required for VSVG-AFF-1 infection and others.

      2) Is it possible to examine/observe AFF-1 and EFF-1 interaction after VSVG-AFF-1 infection and in the fused BMWs in vivo?

    4. Preprint Review

      This preprint was reviewed using eLife’s Preprint Review service, which provides public peer reviews of manuscripts posted on bioRxiv for the benefit of the authors, readers, potential readers, and others interested in our assessment of the work. This review applies only to version 2 of the manuscript.

      Summary:

      All reviewers thought this is an interesting study and most of the experiments are convincingly performed. However, they also raised a number of concerns.

    1. Reviewer #3:

      Summary

      This study used the method of lesion-symptom mapping to disassociate the neural correlates underlying syntactic and semantic functions. The results suggest that different brain regions of the language network do not share similar functions; instead, they should perform different high-level functions that contribute to linguistic processing. Specifically, the pMTG and the aSTS were found associated with syntactic comprehension; the pIFG and the aIFG were found associated with expressive agrammatism; and the iAG was found associated with semantic category word fluency. Overall, I find the research question interesting. However, I have some doubt on the methodology, and the interpretation of experimental results, though not implausible, was somehow hasty. I'll elaborate below.

      Detailed comments:

      1) The fundamental reasoning underlying the method of lesion-symptom mapping.

      I agree with the paper that high-level linguistics functions are intertwined in language performance (in language comprehension and production), and any manipulation of syntax is likely to affect semantic interpretation as well. However, it seems problematic to claim that this conundrum can be solved with the help of lesion-symptom mapping, and that lesion-symptom mapping can identify brain regions "causally" involved in linguistic functions.

      Suppose that the execution of function X crucially depends on two other functions Y and Z, while function Z also causally depends on function Y. I doubt we can discover this kind of causal network from lesion-symptom mapping. In other words, simply detecting the correlation between a lesion area and the performance of a certain linguistic task is still far from detecting the actual causal dependence between a certain brain region and a certain linguistic function. Therefore, I think the paper should avoid overclaims and include more details on how the specific procedures of the current study led to contributions "towards" revealing the general or language-specific function of a brain region.

      Y → Z

      ↓ ↙

      X

      2) Methodological details of this paper.

      This issue is also related to the previous one. It seems that the assignment of the two groups of participants was based on some other studies. The specific lesion-mapping procedures adopted in this paper also followed some other studies. Though I understand that there might be some word limits for the submission, I still hope that (i) the paper includes more methodological details on these, so that the paper can be better self-contained, and (ii) some explanations are given on how these procedures led to contributions "towards" revealing the general or language-specific function of a brain region.

      3) The interpretation of results.

      The behavioral tasks used in this study, namely the comprehension of sentences with non-canonical word order, the description of pictures, and the naming of animal names, are associated with three kinds of linguistic functions: syntactic comprehension, expressive agrammatism, and semantic category word fluency. There might be alternatives to interpret these three linguistic tasks: e.g., (i) sentence-level processing vs. discourse-level processing vs. word-level processing; (ii) syntax vs. pragmatics vs. lexical ability; etc. The interpretation of results can include a discussion on these.

      4) How the findings were consistent with the theory proposed in Matchin & Hickok (2020)

      I read the paper of Matchin & Hickok (2020) ("The cortical organization of syntax", Cerebral Cortex), and found some discrepancies between the theory proposed in that paper and the finding from the current experiment. In that paper, the pMTG is associated with the lexical-syntactic function, underlying both language production and comprehension, while the pIFG is associated with linearization, underlying specifically language production. In the current study, the association between the pMTG and syntactic comprehension seems to suggest that the pMTG is specifically related to the processing of sentences with non-canonical order. Isn't the processing of this kind of sentences an issue related to linearization, not issues related to argument structure or other lexical-syntactic issues?

    2. Reviewer #2:

      This paper attempts to disentangle the neural instantiation of syntax and semantics using VLSM correlations between regions of brain-damaged tissue and language performance across three tasks in relatively large groups of stroke patients. Although the work addresses an important, and currently debated, issue in cognitive neuroscience, the paper is significantly methodologically flawed and the results are untenable.

      Major problems:

      1) Independent measures. Three tasks were used to index (1) syntactic comprehension, (2) expressive agrammatism, and (3) semantic processing. All are problematic and reliability of measurement was not addressed for any of the tasks. This is particularly problematic for expressive agrammatism, but is of concern for all measures.

      For syntactic comprehension, a combined score reflecting comprehension of three complex sentence types with long-distance dependencies (wh-movement constructions) were contrasted with scores for active sentences. This contrast is linguistically unfounded: it is not possible to isolate syntactic process using this contrast, since there are critical differences between the experimental and control sentences on several variables, beyond syntactic processing, including the number of propositions, lexical-semantics, sentence length, etc. as well as domain-general processes, etc. For any studies seeking to determine the cognitive and/or neural resources engaged for syntactic processing, a fundamental requirement is that experimental conditions consist of pairs of stimuli that differ along a single dimension - the dimension of interest - with all else kept constant across conditions, lest the comparison be confounded by additional dimension(s) (cf. Grodzinsky, 2010, for discussion). To do so in the present study the non-canonical forms would need to be contrasted with their canonical counterparts, e.g., subject-relatives for object-relatives, subject questions for object questions, etc.

      Expressive agrammatism was determined based on samples of connected speech elicited by picture description or story retelling and the "presence of expressive agrammatism was . . . rated by speech and language experts . . ." This is problematic. Subjective judgement is insufficient for a study of the scope reported. Objective analysis of the speech samples is needed to quantify salient dimensions of agrammatism or, better, inclusion of a constrained task, like that used to quantify sentence comprehension is recommended.

      2) A very gross measure of "semantic" processing was used - a word fluency task. This is arguably not a semantic task and no rationale for using it is provided. Given this, the title of the paper is inappropriate and misleading: ". . . dissociations of syntax and semantics . . .". It also is stated that assessment occurred at "a variable number of timepoints". Why? When were the time points? Were there any intervening variables between time points? Why was performance "averaged" over samples? In what way does this make the data more "reliable"? Were all participants beyond the period of spontaneous recovery (this is not evident based on data presented in Table 1)?

      3) Dependent measures. Six ROIs were selected for analysis and the rationale for their selection is based on one model of sentence processing. There are two main issues here: (1) there is no rational for using an ROI rather than a voxel-based approach; of the two approaches, a voxel-based approach is the most rigorous as ROI analyses may lead to spurious results simply based on the ROIs selected, (2) the voxel-wise analyses were uncorrected; tables reporting the coordinates derived from voxel-wise analyses are needed; the corrected voxel-wise analyses (with corresponding data tables) should replace the ROI analysis at least for first-pass analyses, (3) greater motivation/justification for selection of the 6 ROIs is needed; there are well-known and well-conceptualized data-based models of sentence processing that include ROIs other than the six tested, e.g., pSTG/pSTS (Friederici, 2012, 2018; Friederici & Gierhan, 2013; Bornkessel-Schlesewsky & Schlesewsky, 2013; Bornkessel-Schlesewsky et al., 2012). It is questioned why the authors overlook this important body of work? ROI selection could be better motivated based on data derived from well-controlled studies of syntactic and semantic processing (e.g., for syntactic processing: Bahlmann et al., 2007; Bornkessel et al., 2005; Bornkessel-Schlesewsky et al., 2010; Constable et al., 2004; Fieback et al., 2005; Friederici et al., 2006; Meltzer et al., 2010; Sonti & Grodzinsky, 2010; Thompson et al., 2010). In addition, there are several published meta-analyses within these domains that would better elucidate appropriate ROIs.

      4) Discussion/conclusions. Several statements in this section are overstatements, not supported by the study:

      a) "Research critically needs to incorporate insights from lesions symptom mapping in order to understand the architecture of language...". Why? Lesioned brains arguably have undergone reorganization (particularly in chronic stroke). This issue is not addressed in the paper.

      b) "...results are ...consistent with neuroanatomical models that posit distinct syntactic and semantic functions to different regions...". It is not possible to determine precise functions of brain regions based on lesioned tissue. The only conclusion that can be drawn is that the infarcted region is involved in and may disrupt the function of interest, but it cannot be said that it is responsible for it. Such an assertion fails to recognize the well-known fact that brain regions do not work in isolation, rather a network of regions is required for execution of complex tasks.

      c) "The [Matchin & Hickok] model posits that the ...pMTG is critical for processing hierarchical structure for production and comprehension.". The data presented do not address or support this claim.

      d) "Damage to the pMTG was significantly associated with semantic comprehension deficits...". Semantic comprehension was not tested.

      e) "damage to the pIFG was ...associated with agrammatic speech deficits". This observation, albeit unreliable based on limitations of the method used for quantifying agrammatism, does not support the M&H model; the authors claim that it does in spite of the fact that there was a "marginally" significant interaction between IFG and MTG.

      Given the substantial methodological limitations inherent in this study, the results and conclusions are unreliable.

    3. Reviewer #1:

      This is a lesion-symptom mapping study of syntactic comprehension, syntactic production, and a semantic measure, namely category word fluency. The authors argue that each of these language functions depends on a different brain region. With some revision this paper could be a worthwhile contribution to the literature, but in my opinion it largely replicates prior work, and the aspects in which it attempts to go beyond prior work are not very strong.

      1) The links between the brain regions and linguistic functions studied here have all been firmly established already. For the IFG and agrammatism, the authors cite two papers from their own work and two from other labs that already make this case (p. 8). For the pMTG and receptive syntax, there are many previous findings, most of which are cited in the present paper and/or the authors' 2020 review paper; Pillay et al. (2017) is a particularly compelling study reporting this association. Semantic fluency has previously been associated with inferior parietal cortex by Baldo et al. (2006), also appropriately cited in the present paper. In sum, none of the major findings of the present study are novel.

      2) The most novel aspect of this study is that the authors carry out some interaction analyses, which indeed are often not carried out when they should be when making claims about differential roles of different brain areas. But the value of this is undercut by the fact that these interaction analyses are still based on univariate analyses of lesion-behavior relationships in each region. The fact that many lesions to one region will extend to one or more of the other regions is simply ignored (as in most VLSM studies). This unrealistic model is just inherently limited (Mah et al., 2014). A multivariate approach to lesion-symptom mapping would be needed to make progress in teasing out differential contributions of different regions. Furthermore, one of the three interactions is not statistically significant, and another one (involving the semantic measure) is not well motivated because the authors present no analysis of the category fluency task, and therefore no principled reason to expect it to be associated with one or another semantic region. Regarding that finding, they end up making a reverse inference on p. 9, and although they cite Schwartz et al. (2011), they don't explain that that paper already showed differential roles of these two regions in a lesion-symptom mapping study. Finally, there are no interactions that actually address the segregation of syntax and semantics promised in the title.

      Some other issues to consider:

      1) Speech rate is used as a covariate to control for non-semantic factors influencing category word fluency, but it cannot possibly serve that purpose. There are many factors influencing speech rate, especially motor factors, and completely different factors contributing to word fluency performance, especially executive. The bottom line is category word fluency is really not a very helpful measure because there are too many contributing factors.

      2) There seems to be inadequate lesion coverage in the TP ROI.

      3) Although the uncorrected voxelwise maps are reassuring with respect to the main ROI analysis, the fact that they are uncorrected means that they don't really have any evidentiary value.

      4) It is problematic to combine two sentence comprehension measures without showing that they are on an identical scale or adjusting them accordingly.

    4. Preprint Review

      This preprint was reviewed using eLife’s Preprint Review service, which provides public peer reviews of manuscripts posted on bioRxiv for the benefit of the authors, readers, potential readers, and others interested in our assessment of the work. This review applies only to version 2 of the manuscript.

      Summary:

      The reviewers feel that the authors are addressing an interesting and important issue in cognitive neuroscience. Nevertheless, serious shortcomings in methods and analytic approaches, and in interpretation, were flagged by all three reviewers.