7,178 Matching Annotations
  1. Dec 2021
    1. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      SUMMARY

      This manuscript characterizes the role of splicing factor Rbfox1 in Drosophila muscle and explores its ability to modulate expression of genes important for fibrillar and tubular muscle development. The authors hypothesize that Rbfox1 binds directly to 5'-UTR and 3'-UTR regions to regulate transcript levels, and to intronic regions to promote or inhibit alternative splicing events. Because some of the regulated genes encode transcriptional activators and other splicing factors such as Bru1, the effects of Rbfox1 may encompass a complex regulatory network that fine-tunes transcript levels and alternative splicing patterns that shape developing muscle. Most likely the authors' hypothesis is correct that Rbfox1 is critical for muscle development in Drosophila, but overall the interesting ideas presented here are too often based only on correlations without further experimental validation.

      MAJOR COMMENTS

      The hypothesis that Rbfox1 plays an important role in regulating muscle development is based on previous studies in other species and supported by much new data in this manuscript. Initial bioinformatic analysis showed that many Drosophila genes, including 20% of all RNA-binding proteins, 40% of transcription factors, etc. have the motifs in introns or UTR regions. However, I think a deeper analysis is required. Any hexamer might be present about once every 4kb, and we do not expect all UGCAUG motifs are necessarily functional, so one might ask whether the association of Rbfox motifs with muscle development genes is statistically significant? Are the motifs conserved in other Drosophila species, which might support a functional role in muscle? Are the intronic motifs located as expected for regulatory effects, that is, proximal to alternative exons that exhibit changes in splicing when Rbfox1 expression is decreased or increased? Is it possible to knock out an Rbfox motif and show that splicing of the alternative exon is altered, or regulation of transcript levels is abrogated?
 Also, what was the background set of genes used for the GO enrichment analysis? Genes expressed in muscle or all genes?

      1. The data on cross regulation between Rbfox1 and Bru1 are confusing and inconsistent, since mild knockdown and stronger knockdown of Rbfox1 seem to have different effects on Bru1 expression. Both Rbfox1 and Bru1 gene have many Rbfox motifs, but they are both large genes (>100kb) and would be expected to have many copies of all hexamers. How do we know whether any of them are functional? New data suggest that Rbfox1 can positively regulate Bru1 protein levels (Fig.5), but this seems inconsistent with the lab's earlier studies indicating opposite temporal mRNA expression profiles for Rbfox1 and Bru1 across IFM development. 

      2. Figure S4, section I, J: if changes in Bru1-RB isoform expression are correlated with Rbfox1 knockdown, it seems reasonable to test whether the Bru1-RB promoter can drive expression of GFP in an Rbfox1-dependent manner. But if I understand correctly, the assay as described on p. 19 uses the promoter region upstream of Bru1-RA. What is the logic for this experiment? It is not surprising that no effect was observed. The end result is that we have no idea whether Rbfox1 directly regulates bru1-RB. Even if it does, bru-Rb appears to be a minor component of Bru expression in IFM.
      3. In the section "Rbfox1 and Bruno1 co-regulate alternative splice events in IFMs", the data show that splicing of several genes is altered by knockdown or over-expression of Rbfox1 and Bru1. The interesting conclusion is for a complex regulatory dynamic where Rbfox1 and Bru1 co-regulate some alternative splice events and independently regulate other events in a muscle-type specific manner. However, if we are to conclude that these activities are due to direct binding of Rbfox1 and Bru1 to the adjacent introns, we need information about the location of flanking Rbfox and/or Bru1 motifs. Do upstream or downstream binding sites correlate with enhancer or silencer activity, as reported in previous studies of these splicing factors in other species? For wupA, Figure S3 shows an intronic Rbfox site, but exon 4 is not labeled so the reader cannot correlate this information with the diagram in Figure 6U.
      4. The evidence that Rbfox1 directly affects expression of transcription factor Exd seems to be based only a correlation between Rbfox1 knockdown and decreased expression of Exd. The observation that binding of Rbfox1 to the Exd 3'UTR in RIP experiments further weakens the case.
      5. Similarly, there is a correlation of Rbfox1 knockdown with expression of alternative 5'UTRs in the Mef2 gene. However, the changes in UTR expression appear mostly not statistically significant. Do the authors have a model to explain what mechanism might allow Rbfox to regulate expression of alternative 5'UTRs, which would seem to be a transcriptional process?
      6. For Salm, there apparently are no Rbfox motifs in the gene, and there are statistically significant but apparently inconsistent changes in Salm expression when it is knocked down in IFM by Rbfox1-RNAi (Salm increases) vs knockdown by Rbfox1-IR27286 or Rbfox1-IRKK110518 (Salm decreases). These are potentially interesting observations but more data would be needed to make stronger conclusions. How would regulation occur in the absence of Rbfox motifs?


      MINOR COMMENTS

      1. In several figures there is a misalignment of the transcriptional driver information with the phenotype data in the bar graphs above. Please correct the alignments to make interpretation easier.
      2. On p. 14 Brudno et al. is cited as ref for Fox motifs near muscle exons, but this paper only focused on brain-specific exons.
      3. For Mef2, why do exons described as 5'UTR have numbers 17, 20, and 21? One would normally expect these to be exon 1, 2 or 1A, 1B, etc.
      4. Fig 8: "regulation of regulators" seems to imply the Rbfox1 is impacting transcription?? Is there precedence for this type of regulation by Rbfox1?

      5. The data on cross regulation between Rbfox1 and Bru1 are confusing and inconsistent, since mild knockdown and stronger knockdown of Rbfox1 seem to have different effects on Bru1 expression. Both Rbfox1 and Bru1 gene have many Rbfox motifs, but they are both large genes (>100kb) and would be expected to have many copies of all hexamers. How do we know whether any of them are functional? New data suggest that Rbfox1 can positively regulate Bru1 protein levels (Fig.5), but this seems inconsistent with the lab's earlier studies indicating opposite temporal mRNA expression profiles for Rbfox1 and Bru1 across IFM development. 


      6. Figure S4, section I, J: if changes in Bru1-RB isoform expression are correlated with Rbfox1 knockdown, it seems reasonable to test whether the Bru1-RB promoter can drive expression of GFP in an Rbfox1-dependent manner. But if I understand correctly, the assay as described on p. 19 uses the promoter region upstream of Bru1-RA. What is the logic for this experiment? It is not surprising that no effect was observed. The end result is that we have no idea whether Rbfox1 directly regulates bru1-RB. Even if it does, bru-Rb appears to be a minor component of Bru expression in IFM.

      7. In the section "Rbfox1 and Bruno1 co-regulate alternative splice events in IFMs", the data show that splicing of several genes is altered by knockdown or over-expression of Rbfox1 and Bru1. The interesting conclusion is for a complex regulatory dynamic where Rbfox1 and Bru1 co-regulate some alternative splice events and independently regulate other events in a muscle-type specific manner. However, if we are to conclude that these activities are due to direct binding of Rbfox1 and Bru1 to the adjacent introns, we need information about the location of flanking Rbfox and/or Bru1 motifs. Do upstream or downstream binding sites correlate with enhancer or silencer activity, as reported in previous studies of these splicing factors in other species? For wupA, Figure S3 shows an intronic Rbfox site, but exon 4 is not labeled so the reader cannot correlate this information with the diagram in Figure 6U.

      8. The evidence that Rbfox1 directly affects expression of transcription factor Exd seems to be based only a correlation between Rbfox1 knockdown and decreased expression of Exd. The observation that binding of Rbfox1 to the Exd 3'UTR in RIP experiments further weakens the case.

      9. Similarly, there is a correlation of Rbfox1 knockdown with expression of alternative 5'UTRs in the Mef2 gene. However, the changes in UTR expression appear mostly not statistically significant. Do the authors have a model to explain what mechanism might allow Rbfox to regulate expression of alternative 5'UTRs, which would seem to be a transcriptional process?

      10. For Salm, there apparently are no Rbfox motifs in the gene, and there are statistically significant but apparently inconsistent changes in Salm expression when it is knocked down in IFM by Rbfox1-RNAi (Salm increases) vs knockdown by Rbfox1-IR27286 or Rbfox1-IRKK110518 (Salm decreases). These are potentially interesting observations but more data would be needed to make stronger conclusions. How would regulation occur in the absence of Rbfox motifs?


      MINOR COMMENTS

      1. In several figures there is a misalignment of the transcriptional driver information with the phenotype data in the bar graphs above. Please correct the alignments to make interpretation easier.

      2. On p. 14 Brudno et al. is cited as ref for Fox motifs near muscle exons, but this paper only focused on brain-specific exons.

      3. For Mef2, why do exons described as 5'UTR have numbers 17, 20, and 21? One would normally expect these to be exon 1, 2 or 1A, 1B, etc.

      4. Fig 8: "regulation of regulators" seems to imply the Rbfox1 is impacting transcription?? Is there precedence for this type of regulation by Rbfox1?

      Significance

      SIGNIFICANCE

      These studies of a major tissue-specific RNA binding protein, Rbfox1, are definitely important for our understanding of functional differences between muscle subtypes, and between muscle and nonmuscle tissues. The broad outlines of Rbfox1 alternative splicing regulation are known, but there is very little specific detail about the important targets in muscle subtypes that might help explain functional differences between subtypes. If more experimental validation can be obtained for regulation of transcript levels by binding 3'UTRs, this would also represent new information.

      I am reviewing based on my experience studying alternative splicing in vertebrate systems, with an emphasis on Rbfox genes. Therefore I am unable to evaluate the functional data on different subtypes of muscle in Drosophila.

    1. I’m not thinking the way I used to think. I can feel it most strongly when I’m reading. Immersing myself in a book or a lengthy article used to be easy.

      I thought this sentence was very interesting because it is how I feel also. The Internet is here to make things easier for us, we don't have to remember anything or to thing as much as we used to. But loosing the habit to read and thing by ourselves may also by synonyme of not being as critical as we were.

    1. SciScore for 10.1101/2021.11.30.21266810: (What is this?)

      Please note, not all rigor criteria are appropriate for all manuscripts.

      Table 1: Rigor

      <table><tr><td style="min-width:100px;margin-right:1em; border-right:1px solid lightgray; border-bottom:1px solid lightgray">Ethics</td><td style="min-width:100px;border-bottom:1px solid lightgray">IRB: Trials had to be approved by the institutional review boards, and competent authorities of the countries involved, and all patients gave written informed consent.<br>Consent: Trials had to be approved by the institutional review boards, and competent authorities of the countries involved, and all patients gave written informed consent.</td></tr><tr><td style="min-width:100px;margin-right:1em; border-right:1px solid lightgray; border-bottom:1px solid lightgray">Sex as a biological variable</td><td style="min-width:100px;border-bottom:1px solid lightgray">not detected.</td></tr><tr><td style="min-width:100px;margin-right:1em; border-right:1px solid lightgray; border-bottom:1px solid lightgray">Randomization</td><td style="min-width:100px;border-bottom:1px solid lightgray">Study patients and selection criteria: Although the exact inclusion and exclusion criteria could vary across the trials, all the subjects had to fulfill the following criteria; 1) Participant of a trial that joined the COMPILEhome consortium, 2) Confirmed COVID-19 diagnosis by a diagnostic PCR or antigen test, 3) Neither hospitalized nor at the emergency room department of a hospital before or at the time of randomization, 4) Symptomatic with illness onset ≤7 days at the time of screening for the study, and 5) Age 50 or older.</td></tr><tr><td style="min-width:100px;margin-right:1em; border-right:1px solid lightgray; border-bottom:1px solid lightgray">Blinding</td><td style="min-width:100px;border-bottom:1px solid lightgray">Overview of Study Design and research partners: Beginning in November 2020, we systematically searched for RCTs recruiting outpatients that compared treatment with CP with a blinded or unblinded control arm in the European (https://www.clinicaltrialsregister.eu/) and American (www.clinicaltrials.gov) trial register.</td></tr><tr><td style="min-width:100px;margin-right:1em; border-right:1px solid lightgray; border-bottom:1px solid lightgray">Power Analysis</td><td style="min-width:100px;border-bottom:1px solid lightgray">not detected.</td></tr></table>

      Table 2: Resources

      <table><tr><th style="min-width:100px;text-align:center; padding-top:4px;" colspan="2">Antibodies</th></tr><tr><td style="min-width:100px;text=align:center">Sentences</td><td style="min-width:100px;text-align:center">Resources</td></tr><tr><td style="min-width:100px;vertical-align:top;border-bottom:1px solid lightgray">Pre-planned subgroup analyses assessed the efficacy of the 2 primary outcomes in the following subgroups: 1) days since disease onset (1-5 or >5days), 2) level of neutralizing antibody anti-SARS-CoV-2 titers in transfused plasma and 3) Negative serum anti-SARS-CoV-2 IgG status (Trimeric Spike antibody test, Liaison, Diasorin, Saluggia, Italy).</td><td style="min-width:100px;border-bottom:1px solid lightgray"><div style="margin-bottom:8px"><div>anti-SARS-CoV-2</div><div>suggested: None</div></div><div style="margin-bottom:8px"><div>anti-SARS-CoV-2 IgG</div><div>suggested: None</div></div><div style="margin-bottom:8px"><div>Diasorin, Saluggia, Italy).</div><div>suggested: None</div></div></td></tr><tr><th style="min-width:100px;text-align:center; padding-top:4px;" colspan="2">Software and Algorithms</th></tr><tr><td style="min-width:100px;text=align:center">Sentences</td><td style="min-width:100px;text-align:center">Resources</td></tr><tr><td style="min-width:100px;vertical-align:top;border-bottom:1px solid lightgray">Overview of Study Design and research partners: Beginning in November 2020, we systematically searched for RCTs recruiting outpatients that compared treatment with CP with a blinded or unblinded control arm in the European (https://www.clinicaltrialsregister.eu/) and American (www.clinicaltrials.gov) trial register.</td><td style="min-width:100px;border-bottom:1px solid lightgray"><div style="margin-bottom:8px"><div>https://www.clinicaltrialsregister.eu/</div><div>suggested: (EU Clinical Trials Register, RRID:SCR_005956)</div></div></td></tr></table>

      Results from OddPub: We did not detect open data. We also did not detect open code. Researchers are encouraged to share open data when possible (see Nature blog).


      Results from LimitationRecognizer: We detected the following sentences addressing limitations in the study:
      Several limitations should be mentioned. Although we only included patients aged ≥50, and most of them also had comorbidities, the hospital admission rate was relatively low at 9.3%. Therefore, the study was not powered to exclude a small overall treatment effect. However, administering CP to infectious and symptomatic outpatients is complex and labor-intensive. Hence, we think that small CCP’s clinical role is significantly diminished if unable to establish something greater than “a small effect” because it ceases to be practical. As vaccination uptake progressed in patients aged 50 or older and monoclonal antibody-based therapy with proven effectiveness in high-risk outpatients became available, the recruitment dropped dramatically as of June 2021. This resulted in the recommendation by the individual and COMPILEhome DSMBs that further enrollment was unlikely to change the results, and both studies were discontinued. Regarding the advent of the SARS-CoV-2 variants that may be less susceptible to antibodies induced by the original SARS-CoV-2 virus or the alpha variant, it is reassuring that >95% of the patients in both countries were included at a time when the delta variant was still rare (<5%) (Appendix Figure 3 and 4). The last limitation of our study (and all studies on CP for COVID-19 so far) is the lack of a proper phase 2 dose-finding study. In a recent study, we administered 600 mL of CP to 25 SARS-CoV-2 antibody-negative B-cell depleted patients diagnosed with COVID...

      Results from TrialIdentifier: We found the following clinical trial numbers in your paper:<br><table><td style="min-width:95px; border-right:1px solid lightgray; border-bottom:1px solid lightgray">Identifier</td><td style="min-width:95px; border-right:1px solid lightgray; border-bottom:1px solid lightgray">Status</td><td style="min-width:95px; border-right:1px solid lightgray; border-bottom:1px solid lightgray">Title</td></tr><tr><td style="min-width:95px; border-right:1px solid lightgray; border-bottom:1px solid lightgray">NCT04621123</td><td style="min-width:95px; border-right:1px solid lightgray; border-bottom:1px solid lightgray">Completed</td><td style="min-width:95px; border-right:1px solid lightgray; border-bottom:1px solid lightgray">Plasma for Early Treatment in Non-hospitalised Mild or Moder…</td></tr><tr><td style="min-width:95px; border-right:1px solid lightgray; border-bottom:1px solid lightgray">NCT04589949</td><td style="min-width:95px; border-right:1px solid lightgray; border-bottom:1px solid lightgray">Recruiting</td><td style="min-width:95px; border-right:1px solid lightgray; border-bottom:1px solid lightgray">Early Convalescent Plasma Therapy for High-risk Patients Wit…</td></tr></table>


      Results from Barzooka: We did not find any issues relating to the usage of bar graphs.


      Results from JetFighter: We did not find any issues relating to colormaps.


      Results from rtransparent:
      • Thank you for including a conflict of interest statement. Authors are encouraged to include this statement when submitting to a journal.
      • Thank you for including a funding statement. Authors are encouraged to include this statement when submitting to a journal.
      • No protocol registration statement was detected.

      Results from scite Reference Check: We found no unreliable references.


      <footer>

      About SciScore

      SciScore is an automated tool that is designed to assist expert reviewers by finding and presenting formulaic information scattered throughout a paper in a standard, easy to digest format. SciScore checks for the presence and correctness of RRIDs (research resource identifiers), and for rigor criteria such as sex and investigator blinding. For details on the theoretical underpinning of rigor criteria and the tools shown here, including references cited, please follow this link.

      </footer>

    1. Ineliminable Inscrutability Scrutinized and Eliminated

      Brandom rejects two possible theories of normativity (rule-following).

      Regularism:

      If a given performance conforms to some pre-existing pattern of performances, then we call that performance correct or competent. If it doesn’t so conform, then we call it incorrect or incompetent

      Brandom's objection: Regularists can't distinguish between what happens and what ought to happen. We don't say "gravity ought to work", so a Regularist must somehow explain why the Law of Gravity is not normative, while the Law of US is a normative.

      Everything in nature ‘follows’ the ‘rules of nature,’ the regularities isolated by the natural sciences. So what does the normativity that distinguishes human rule-following consist in?

      Regulism: rules are certain declarative sentences like "No smoking.", and rule-following is behavior that is described by the rules.

      Brandom's objection: rules can't be made entirely explicit. There must always some unsaid rule to avoid an infinite regress, like "the rule about following rules" and "the rule about the rule about following rules" etc.

      Wittgenstein said this about how the infinite regress is cut off by unspoken rules that are followed in practice.

      If I have exhausted the justifications I have reached bedrock, and my spade is turned. Then I am inclined to say: “This is simply what I do.”

      Thus, there is a necessary implicitness, or "blindness", in rule-following behavior. At some level, we simply follow rules without understanding.

      But then, a challenge! How is "implicit norm" even possible?

      How can a performance be nothing but a ‘blind’ reaction to a situation, not an attempt to act on interpretation?

      Unconscious rule-following is automatic, therefore not normative, much like a sneeze, or falling in gravity is not normative.

      Or is it? Perhaps we are forced to conclude that fundamentally, norms are based on mechanical, thoughtless behaviors. In this way, we can naturalize norms in a norm-less theory (such as neuroscience).

      Brandom refused this, and insists that we must then admit "nonconscious norms". He even proposes a kind of non-natural metaphysics, where non-natural normativity is baked into the metaphysics.

      But Bakker has a better idea: explain norms in a norm-less scientific theory

      The history of the social sciences is a history of emancipation from the intellectual propensity to intentionalize social phenomenon—this was very much part of the process that Weber called the disenchantment of the world. Brandom proposes to re-enchant the world by re-instating the belief in normative powers, which is to say, powers in some sense outside of and distinct from the forces known to science.

      Bakker's Blind Brain Theory

      Now Bakker begins his own philosophy, using Blind Brain Theory.

      Note how important is implicit/blindness in Wittgenstein's and Brandom's explanations of how norms work. But they never paused to consider it deeper than a simple "Such implicitness means implicit normativity exists." They then went on to consider normativity without studying further just what are implicit, and how they are implicit.

      This is a grave error. To explain normativity, we must study what are implicit and how they are implicit in the brain when people think normative thoughts and do normative actions. We must study the neglect structure of the brain, and that brings us to Blind Brain Theory.

      According to BBT, all cognition is heuristic and depends critically on the environment to play nice (that is, remain stable). Heuristic algorithms can skip many steps and come out right, as long as the environment rarely challenges it with difficult examples that exposes the error of the heuristic.

      Normative cognition is also heuristic -- what features of the human environment does it depend on?

      Wittgenstein again

      If I have exhausted the justifications I have reached bedrock, and my spade is turned. Then I am inclined to say: “This is simply what I do.”

      The "bedrock" is the stable normative behaviors of other humans I live with. In other words, Regularism is actually the right approach to explaining normativity.

      Brandom was wrong to reject Regularism, but to see why he was wrong, we must do some psycho-philosophy. We must understand why the human animal is psychologically prone to reject Regularism (just like how it is psychologically prone to think souls exist). It is, again, because of BBT.

      We think "This rule is normative." when some normativity-detection cognitive module is triggered. If the module keeps quiet, and we have the distinct feeling of "Wait, that's not normative...", no matter how much information processing the other modules do. And it just so happens that thinking about causes and statistical correlations cannot trigger this module.

      There are roughly two types of explanations: causal/natural and normative/supernatural. Causal/natural explanations are those step-by-step explanations that intrinsically allows you to break it down further ("how does this step work?"), push it forwards and backwards in time ("and what happened before/after?"). Normative/supernatural explanations are those brute assertions about what to do and not to do ("This is simply what I do."), accompanied with an anosognosia, a blindness to the blindness, a feeling that the assertions are sufficient with no further explanations possible ("What do you mean I must explain why it is what I do? I have explained myself sufficiently. There is nothing left to explain!")

      Since Regularism involves solving normative cognition using the resources of natural cognition, it simply follows that it fails to engage resources specific to normative cognition.

      Bakker is in no danger of self-contradiction, because the problem "how does normative cognition work?" is perfectly possible to be the kind of problem that causal cognition can solve. Sure, causal cognition can't solve all problems, but it can solve some... like "how to build a plane?" and "how the brain works?" Science works, and that shows the power of causal cognition. In contrast, nothing sophisticated like science has been built upon normative cognition. This shows that causal cognition can solve normative cognition, while normative cognition can't.

      What doesn’t follow is that normative cognition thus lies outside the problem ecology of natural cognition, let alone inside the problem ecology of normative cognition.

      In short, Brandom failed because he tried to solve normativity with normative cognition. Bakker may succeed, because he is trying to solve normativity with causal cognition. The feeling that "normativity can't be solved causally" misguided Brandom, and it is just an illusion generated by the fractured nature of cognition, described above.

      normative cognition seems unlikely to theoretically solve normative cognition in any satisfying manner. The very theoretical problems that plague Normativism—supernaturalism, underdetermination, and practical inapplicability—are the very problems we should expect if normative cognition were not in fact among the problems that normative cognition can solve.

      Here is Bakker's explanation of normative cognition, and how it leads to Brandom's mistake:

      normative cognition belongs to social cognition more generally, and that... has evolved to solve astronomically complicated biomechanical problems involving the prediction, understanding, and manipulation of other organisms absent detailed biomechanical information. Adapted to solve in the absence of this information, it stands to reason that the provision of that information, facts regarding biomechanical regularities, will render it ineffective...

      ... intentional cognition has evolved to overcome neglect, to solve problems in the absence of causal information. This is why philosophical reflection convinces us we somehow stand outside the causal order via choice or reason or what have you. We quite simply confuse an incapacity, our inability to intuit our biomechanicity, with a special capacity, our ability to somehow transcend or outrun the natural order.

    1. Author Response:

      Reviewer #3 (Public Review):

      1) The two algorithms presented are essentially a low-pass and high-pass filter on binarized odor. As such, it may not be so surprising that there is a tradeoff between which algorithm works better depending on the frequency content of different environments. The low-pass filter (algorithm 1) works better in environments with mostly low-frequency fluctuations (boundary layer plume, low wind-speed, high diffusivity) while the high-pass filter (algorithm 2) works better in environments with mostly high-frequency fluctuations (high windspeed, low diffusivity). To understand what is essential in these algorithms I think it would be useful to (1) compare the two algorithms to a "null" algorithm that drives upwind orientation whenever odor is present (i.e. include thresholding and binarization but no filtering), (2) compare navigation success metrics directly to the frequency content of different environments, (3) examine how navigation success depends on the filtering cutoff of the two algorithms (tau_on and tau_w). Comparing to the null algorithm with no filtering I think is important to determine whether there is actually a tradeoff to be made, or whether a system that can approximate a flat transfer function (or at least capture all relevant frequencies in the environment) is ideal and must be approximated with biological parts.

      For (1) and (3), we have now added simulations of the models for a range of different timescales, including an integrator with an infinitely fast timescale corresponding to the “null” model the reviewer describes (Results lines 376-380, Figure 4—figure supplement 2 and Materials and methods lines 1008-1025). We find that changing the timescale of the intermittency filter largely leaves performance unchanged whereas changing the timescale of the frequency filter is akin to changing the gain on the frequency filter, as predicted by Equations 24 and 29. Since we do find a local maximum in the frequency filter timescale, we conclude that there are benefits to filtering in time. For (2), many plumes we simulate in Fig. 5 span a wide range of frequencies and intermittencies; we chose to plot performance as a function of diffusivity / windspeed to emphasize how performance depends on environment parameters that shape the statistics of the plume (flow and odor dynamics). Note that we renamed 𝜏! to 𝜏".

      2) While the two algorithms presented here present a nice conceptual division, biological filtering algorithms are likely to incorporate elements of both. For example, the adaptive compression algorithm of Alvarez-Salvado (which is eliminated in the simplification used here) provides some sensitivity to odor onsets and is based on well-described adaptation at the olfactory periphery. Synaptic depression algorithms likewise provide sensitivity to derivatives as well as integration over time, and synaptic depression with multiple timescales has been described in detail at various stages of the olfactory system. A productive extension of the work done here would be to explore the utility of biophysically-motivated filtering algorithms for navigation in different environments.

      Thank you for this suggestion, which led us to extend our work in that interesting direction. We have now generalized our model to respond to odor intensity (rather than its binarized version) by implementing an adaptive compression taken from prior modeling efforts (Alvarez-Salvado et al, eLife 2018) (added to Fig. 3; also see additional Fig. 3 Supplement 1). Moreover, we now also consider navigators that respond to odor signals using a biophysical model of odor transduction, ORN firing, and PN firing, in addition to synaptic depression within the ORN-PN synapse, which combines modeling efforts from prior works (Gorur-Shandilya, Demir, et al, eLife 2017; Nagel & Wilson, Nat. Neurosci. 2015; Fox & Nagel, “Synaptic control of temporal processing in the Drosophila olfactory system” arXiv 2021). This realistic circuit model produced exciting results that indicate that the natural ORN-PN circuitry can, to some degree, satisfy the dual demands of intermittency and frequency sensing. These results are shown in the new Fig. 6.

      3) It would be helpful in the Discussion to present a clearer picture of what the frequency content of natural environments is likely to be. For example, flies stop walking at windspeeds above ~70cm/s (Yorozu 2009). In contrast, flies in flight are likely to encounter much sparser and high frequency plume encounters, as they are moving through the air at much faster speeds and because odors encountered here would be away from the boundary layer. Therefore the best test of the tradeoff hypothesis would likely be to compare temporal filtering of odor plumes by neural circuitry in flying vs walking flies. This would connect to the literature in motion detection as well, where octopamine release during flight causes a speeding of the motion detection algorithm.

      We have added lines 47-48 to the introduction describing the natural frequency content of plumes and lines 574-578 discussing how one might see evidence of this tradeoff when comparing between walking and flying flies.

    1. Author Response:

      Reviewer #2:

      What the authors attempt to achieve, and their approaches:

      The author attempt to establish by which mechanisms cholesterol influences the function of the GPCR A_{2A}R, an adenosine receptor. The role of cholesterol on GPCRs has been reported in a number of studies, primarily in cellular experiments, and the authors set out here to clarify the molecular mechanisms.

      To this end, they build upon their recent achievements to produce this protein and reconstitute it in nanodiscs, i.e. discoidal objects comprised of the membrane protein (here: A_{2A}R), lipids (here: POPC, POPG and cholesterol) and a membrane-scaffold protein (MSP) which wraps around this disc of protein+lipid. Nanodiscs allow studying proteins in solution, and are thought to be much more native-like than e.g. detergent micelles.

      The authors first use GTP hydrolysis experiments to quantify the basal activity and agonist potency at cholesterol concentrations from 0 to 13%. The cholesterol effects are weak but detectable. Then they use a single 19F label that reports on the protein's conformation (active, inactive) to show that the protein populates slightly more active states with cholesterol. (again, weak effects). Then they investigate G-protein binding to A_{2A}R in the nanodisc, and find (very!) weak enhancement at 13% cholesterol. These data point to weak positive allosteric modulation by cholesterol. They then use molecular dynamics simulations to probe the allosteric communication, using a recently proposed framework (Rigidity-transmission allostery). Doing these simulations in the presence of cholesterol (postions of cholesterol from X-ray structure) and absence. This analysis shows again only very weak effects of cholesterol, and this time the effect is opposite, i.e. negative allosteric modulation by cholesterol. Then they use 19F-labeled cholesterol analogues to probe by NMR the state of cholesterol (bound to protein?). Lastly, they use Laurdan fluorescence experiments and pressure NMR to establish that (i) the lipids become more ordered when cholesterol is present, and (ii) if one achieves such ordering even without cholesterol - namely by pressure - one may achieve similar effects as those that cholesterol has.

      Collectively, these data lead them to conclude that cholesterol has a (weak) positive allosteric effect on this receptor, and this effect is not a direct one, but goes via modulation of the membrane properties.

      We thank the reviewer for his comments and critique. A lot of his comments have to do with the nanodisc as a model system. We have therefore included an additional paragraph as discussed above, highlighting the advantages and disadvantages of the nanodisc. We’ve also included references to papers that have characterized nanodiscs or membrane proteins in nanodiscs. In our hands, 31P NMR spectra of POPC/POPG nanodiscs and their melt behavior is very similar to liposomes. We’ve tried to add to the discussion on nanodiscs without distracting too much from the focus in the paper.

      Major strengths and weaknesses of methods and results:

      The study addresses an important question, which inherently is difficult to answer: the effect of cholesterol is poorly understood and such studies require to work in an actual membrane. The authors do a careful combination of different methods to achieve their goal of identifying the mechanisms.

      Despite combining several methods, several of them have their inherent problems:

      (i) the nanodisc is too small to properly mimic the membrane environment, and it does not allow reaching relevant cholesterol concentrations. Moreover, it is not clear (to me) if one can exclude e.g. interactions of the protein with the surrounding MSP, or of cholesterol with MSP (see (iii) below).

      We agree. In principle, we should worry about MSP. On the other hand, this is a constant in all of the samples and we focus instead on the cholesterol-dependent effects. These nanodiscs are unarguably small. We’ve commented on this in the paper now. However, we’d expect that the confinement would if anything emphasize the cholesterol bound state. Yet, the NMR studies of F-cholesterol interactions at best identified transient bound states.

      (ii) the state of the protein (inactive, active) is probed with a single NMR-active site. The effects are small and I am not convinced that one shall interpret changes as small as the ones in Figures 3 and 4. In particular, how does this single probe behave at high pressure? Does it reflect an active state at 2000 bar pressure - where possibly other effects (unfolding?) may occur?

      Here we can be quite confident. The spectra are predicated on a recent paper (Huang, et al, 2021) published in Cell in the spring of this year. Each state was carefully correlated with specific functional assays and conditions in a self-consistent way. The labeling site used on TM6 was strategically chosen based on earlier crystallographic studies of inactive and active A2AR. We have other labeling sites (TM7 and TM5) but the point was to use the chemical shift signatures to talk about cholesterol-induced changes to the conformational ensemble assigned in the Cell paper. The differences are small, but the fact that PAM effects are observed across conditions (apo, inverse agonist-bound, agonist-bound, and G protein-bound) reassures us that the spectral differences between low and high cholesterol samples are real. Unfolding by 19F NMR is in this case easy to see – the effects become irreversible and independent of ligand and the chemical shift ends up as one upfield peak. We also see a stabilization of the A1 (active) state, and a slight downfield shift of the active ensemble with increased pressure, consistent with reduced exchange dynamics (and coalescence) associated with the active state. We’ve commented on this in the revised version while trying not to distract from the flow of the paper.

      (iii) the data in Figure 6 (19F of cholesterol analogs) are hard to interpret. Is cholesterol bound to the protein? Does the 19F shift reflect binding to the protein? or interactions within the confined space of the disc? or with MSP? The two analogs do not tell a coherent story.

      It is confusing. We agree. We were fully expecting to see a clear A2AR bound state of cholesterol either through a concentration-dependent shift or a new peak. We also looked for “hidden” bound states through 19F NMR CEST experiments. We never identified a bound state in the presence of a range of cholesterol concentrations, as a function of receptor drug. We did observe small shifts although often these effects were as prominent with inverse agonist as agonist, possibly pointing to the existence of multiple weak binding sites. We’ve added some of this to the conversation. It’s also certainly possible that cholesterol exhibits some interaction with MSP, although again MSP is a constant presence in all the samples while we are focusing on cholesterol-dependent effects. In any case, we never detected a bound signature characteristic of slow exchange. That’s significant to the study despite the ambiguity of the measurements.

      (iv) the pressure NMR study (Fig 7D) has weaknesses. The authors implicitly assume that pressure acts on the membrane, leading to more ordering. (They do recognize the possibility that pressure may have an effect on the protein directly, but consider that this direct effect on the protein is minor.) I think that their arguments are possibly incorrect: they apply here pressure onto a sample of nanodiscs, but all studies they cite to justify the use of pressure on membranes dealt with extended lipid bilayers (liposomes). To me it is not clear what is the lateral effect of pressure onto a nanodisc. Can water laterally enter into the bilayer and thus modify the lipid structure? I also note that previous pressure-NMR studies on a GPCR in micelles (rather than nanodiscs) showed a shift toward the active state. As a micelle is a very different thing than a nanodisc, this suggests that the pressure effect is, at least in part or predominantly, on the protein itself.

      On top of the weakness of the pressure NMR experiment to identify what actually happens to the disc, it is not clear either how to interpret the 19F shift at very high pressure (Fig 7D). Given that there is only a single NMR probe, far out in an artificial side chain, it is difficult to assess the state of the protein.

      These are good questions. Firstly, lipid bilayers (be it in liposomes, bicelles, or nanodiscs) are super soft and compressible systems – all known to change in hydrophobic thickness to pressure much more readily than proteins – be they membrane embedded or soluble. Secondly, the 19F NMR spectra are well-known to be representative of fully functional receptor as discussed above. Thirdly, even detergent micelles are susceptible to pressure (much more so than the receptor itself) See J. Phys. Chem. B 2014, 118, 5698−5706 (now referenced in the paper). Pressure will enhance hydrophobic thickness, even in a detergent host, by ordering the acyl chains. The lower specific volume states, selected by higher pressure, have a larger hydrophobic dimension. Thus, the effects seen earlier are equally an effect of environment. In the revised version, we simply make the point that the protein isn’t unfolded and that both cholesterol or pressure give rise to enhanced hydrophobic thickness and corresponding shifts in equilibria to the active states.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reply to the reviewers

      We would like to thank the two reviewers for the valuable comments and suggestions on improvements. We addressed each reviewer’s comments individually. We have carefully revised the manuscript to incorporate new data and to make necessary clarifications.

      Overall we made the following major modifications:

      1. We investigated the relevance of BHRF1 expression in the context of EBV infection, in B cells and epithelial cells. We observed that EBV reactivation leads to MT hyperacetylation and subsequent mito-aggresome formation in both cell types. An EBV+ B cell line deficient for BHRF1 was generated and allowed us to demonstrate the involvement of BHRF1 in this phenotype. These results were added to Figures 2, 3 and Figure 1 – S1 in the revised version of the manuscript.
      2. We better characterized the mechanism leading to MT hyperacetylation, by demonstrating that BHRF1 colocalizes and interacts with the tubulin acetyltransferase ATAT1. These results were added to Figure 5 and Figure 5 – S2 in the revised manuscript.
      3. We generated stable HeLa cells KO for ATG5. Using these autophagy-deficient cells, we demonstrated the involvement of autophagy in BHRF1-induced MT hyperacetylation and mito-aggresome formation. We added these results to Figure 8 in the revised version of the manuscript.
      4. We compared the impact of BHRF1 with other mitophagy inducers on MT hyperacetylation, mitochondrial morphodynamics and the inhibition of IFN production, to demonstrate the specificity of the mechanism of action of BHRF1 (Figure 4 – S1).
      5. We demonstrated that MT hyperacetylation requires mitochondrial fission, using a Drp1-deficient HeLa cell line that we have previously described (Vilmen et al., 2020). This result was added to the revised version of the manuscript in Figure 3 – S2A. Moreover, we confirmed this result in the context of EBV infection (Figure 3 – S2B). ## Reviewer#1 Reviewer #1 (Evidence, reproducibility and clarity)

      Major comments:

      1. In the presented manuscript the authors characterize mainly BHRF1 overexpression in HeLa cells. Does BHRF1 also block type I IFN responses by microtubule hyperacetylation in the context of EBV infection? Do alpha-tubulin K40A overexpressing B cells produce more type I IFN after EBV infection?

      In the revised version of the manuscript, we added several experiments to explore the phenotype of BHRF1 during EBV infection, as requested by the two reviewers. Since EBV infects both B cells and epithelial cells, we used two different approaches. In latently-infected B cells, coming from Burkitt lymphoma (Akata cells), we induced EBV reactivation by anti-IgG treatment. To explore the importance of BHRF1 in this cell type, we constructed a cell line knocked down for BHRF1 expression, thanks to a lentivirus bearing an shRNA against BHRF1. In parallel, HEK293 cells harboring either EBV WT or EBV ΔBHRF1 genome were transfected with ZEBRA and Rta plasmids to induce the viral productive cycle in epithelial cells.

      We demonstrated that EBV infection induces MT hyperacetylation and subsequent mito-aggresome formation, both dependent on autophagy. Moreover, this phenotype requires BHRF1 expression in B cells and epithelial cells. We also observed that the expression of alpha-tubulin K40A in EBV+ epithelial cells blocks mito-aggresome formation induced by EBV reactivation. These results are now presented in Figures 2 and 3 in the revised version of the manuscript.

      Regarding regulation of IFN response during infection, several EBV-encoded proteins and non-coding RNAs have been described to interfere with the innate immune system. For example, BGLF4 and ZEBRA bind to IRF3 and IRF7, respectively, to block their nuclear activity (Hahn et al., 2005; Wang et al., 2009). Moreover, Rta expression decreases mRNA expression of IRF3 and IRF7 (Bentz et al., 2010; Zhu et al., 2014). We therefore think that studying the inhibitory role of BHRF1 on IFN response in the context of EBV reactivation will be arduous. Indeed, the lack of BHRF1 could be compensated by the activity of other viral proteins acting on innate immunity.

      1. The authors document that the observed microtubule hyperacetylation is due to the acetyltransferase ATAT1. How does BHRF1 activate ATAT1? Is there any direct interaction?

      As requested by reviewer#1, we explored a possible interaction of BHRF1 and ATAT1. First, we observed by confocal microscopy that GFP-ATAT1 colocalized with BHRF1 in the juxtanuclear region of HeLa cells (Figure 5 – S2). Second, we demonstrated by two co-immunoprecipitation assays that BHRF1 binds to exogenous ATAT1 (Figures 5E and 5F). These new results have been added to the revised version of the manuscript and clarify the mechanism of action of BHRF1.To go further, we explored whether BHRF1 was able to stabilize ATAT1 because it was recently reported that p27, an autophagy inducer that modulates MT acetylation, binds to and stabilizes ATAT1 (Nowosad et al., 2021). However, BHRF1 expression does not impact the expression of ATAT1 (data not shown).

      1. Furthermore, the authors demonstrate with pharmacological autophagy inhibitors that autophagy is increased in a BHRF1 dependent and microtubule acetylation independent manner but required for microtubule hyperacetylation. How does autophagy stimulate ATAT1 dependent microtubule hyperacetylation? Is this dependency also observed with a more specific ATG silencing or knock-out?

      We generated a stable autophagy-deficient HeLa cell line KO for ATG5, using an ATG5 CRISPR/Cas9 construct delivered by a lentivirus. The lack of ATG5 expression and LC3 lipidation was verified by immunoblot (Figure 8B). We observed that BHRF1 was unable to increase MT acetylation in this autophagy-deficient cell line (Figure 8C) in accordance with our data reported in the original manuscript using treatment with spautin 1 or 3-MA (previously Figure S5C and Figure 8A in the revised version). Moreover, the lack of hyperacetylated MT in BHRF1-expressing cells led to a dramatic reduction of mito-aggresome formation (Figures 8D and 8E). These new results demonstrate that autophagy is required for BHRF1-induced MT hyperacetylation.

      Minor comments:

      1. "Innate immunity" and "innate immune system", but not "innate immunity system" are in my opinion better wordings.

      We thank reviewer #1 for this useful comment. The term “innate immunity system” in the introduction section has been replaced by “innate immune system”. Elsewhere, we used “innate immunity”.

      1. The reader would benefit from a discussion on the role of type I IFNs during EBV infection and how important the authors think their new mechanism could be in this context.

      We thank the reviewer for this suggestion. However, we already discussed the different strategies developed by EBV to counteract IFN response induction, in our previous study, suggesting the importance of IFN in the control of EBV infection (Vilmen et al., 2020). In this study, we have focused the discussion on the role of mitophagy in the control of IFN production.

      Reviewer #1 (Significance):

      The significance of the described pathway for type I IFN production needs to be documented in the context of EBV infection.

      The revised version of the manuscript now explored the role of BHRF1 in the context of EBV infection See above for details (major comment 1).

      Reviewer#2

      Reviewer #2 (Evidence, reproducibility and clarity)

      The work presented is a relatively straightforward cell biological dissection of a subset of the previously described functions of BHRF1, focusing on the mitochondrial aggregation phenotype. The approaches and analysis are performed in cell lines mainly using overexpression and some siRNA experiments and appear well done throughout.

      We thank reviewer #2 for this comment and would like to underline that the revised version of the manuscript includes now a study of BHRF1 in the context of infection in both B cells and epithelial cells, the generation of a stable EBV positive B cells KD for BHRF1 by using shRNA approach and the generation of a stable autophagy-deficient cell line, using CRISPR/cas9 against ATG5.

      Reviewer #2 (Significance):

      The current study unpicks one of the phenotypes induced by BHRF1 over expression: namely the previously reported mitochondrial aggregation phenotype. The findings that peri-nuclear mitochondrial aggregation are dependent on microtubules and retrograde motors are useful but could perhaps have been predicted. Overexpression of many proteins (or indeed chemical treatments) causing cellular and / or mitochondrial stress have been shown to cause mitochondrial perinuclear aggregation.

      To explore the specificity of BHRF1 activity on mito-aggresome formation, we decided to investigate the impact of AMBRA1-ActA, a previously characterized mitophagy inducer, on MT (Strappazzon et al., 2015). We observed that expression of AMBRA1-ActA leads to mito-aggresome formation but does not modulate acetylation of MTs, contrary to BHRF1. This result was added to the revised version of the manuscript (Figure 4 - S1A and S1B). Moreover, chemical treatments with either oligomycin/antimycin or CCCP, which induce mitochondrial stress and mitophagy (Lazarou et al., 2015; Narendra et al., 2008), do not cause mitochondrial juxtanuclear aggregation (Figure 4 - S1C). We also observed that a hyperosmotic shock-induced by NaCl leads to MT hyperacetylation (Figure 4 - S1D) but not to the mito-aggresome formation (data not shown), suggesting that MT hyperacetylation per se is not sufficient to induce the clustering of mitochondria. Altogether, these new results demonstrated the originality of the mechanism used by BHRF1 to induce mito-aggresome formation.

      The findings linking the process to altered tubulin acetylation are more novel and interesting and may add a new dimension to understanding of BHRF1 function. However what is lacking here is really advancing our understanding of how BHRF1 does this.

      We thank the reviewer for underlining the fact that regulation of mitochondrial morphodynamics by BHRF1 via MT hyperacetylation is novel and interesting.

      In the original version of the manuscript, we have demonstrated that autophagy and ATAT1 are required for BHRF1-induced hyperacetylation. In the revised version, we uncovered that BHRF1 interacts and colocalizes with ATAT1 (Figures 5E, 5F and Figure 5 – S2). Moreover, we demonstrated that MT hyperacetylation is involved in the localization of autophagosomes next to the nucleus, thus close to the mito-aggresome. Therefore, we better characterized the mechanism of action of BHRF1 in the revised manuscript.

      Although some downstream processes are identified in the current and previous study it still remains unclear what the exact underlying mechanisms are. Is BHRF1 doing this by disrupting mitochondrial function and making the organelles sick or by causing cellular stress indirectly leading to mitochondrial pathology? Previous studies have shown that cellular stress such as altered proteostasis can also cause stress-induced mitochondrial retrograde trafficking and aggregation. Is BHRF1 causing the same phenotype by generally stressing the cell and if it is more specifically through mitochondrial disruption what is the mechanism? As demonstrated by the authors in their previous work, BHRF1 does a number of things to cell signalling. Which of these are leading to a general disruption of cell signalling versus having specific effects on the cell or mitochondria still seems somewhat unclear.

      We previously reported that BHRF1 expression does not alter the mitochondrial membrane potential (Vilmen et al., 2020). contrary to treatment by O/A or CCCP. Moreover, we observed that these treatments do not induce mitochondrial clustering (Figure 4 – S1). Therefore, BHRF1 modulates mitochondrial dynamics in a specific and regulated manner.

      Our study clearly demonstrated that BHRF1 uses an original strategy to modulate IFN response, via a regulated pathway of successive steps, from mitochondrial fission to mitophagy, via MT hyperacetylation, rather than “a general disruption of cell signalling”.

      It would be interesting to know whether the role of microtubule hyperacetylation and ATAT1 are more generally involved in other previously described processes of stress induced mitochondrial aggregation.

      In the revised version of the manuscript, we observed that AMBRA1-ActA does not change the level of MT acetylation, whereas it induces mito-aggresome formation. These data reinforce the originality of the BHRF1 mechanism.

      Currently while this is a nicely performed follow up study to their 2020 paper, the present study neither provides in depth mechanistic advance of BHRF1 function, nor a better understanding of the molecular steps in a more generally relevant pathway (e.g. mitophagy).

      We disagree with the reviewer’s comment. Indeed, in this new study, we uncovered and characterized a new mechanism of action for BHRF1 via ATAT1-dependent MT hyperacetylation. More generally, we reported for the first time that innate immunity can be regulated by the level of MT acetylation.

      In addition, all the experiments were performed in cell lines and rely on the overexpression of a viral protein. But this is a significant over-simplification of the viral pathological process. It therefore remains unclear how pathophysiologically relevant the findings are (e.g. to EBV pathology) without further extending this element of the work.

      To address this comment, we extended our results in the infectious context, by adding several experiments performed in EBV-infected cell lines (see above reviewer#1 for details). The same phenotype was observed after reactivation of the EBV productive cycle as in BHRF1 ectopic expression. Moreover, we demonstrated that the phenotype is BHRF1-dependent. This suggests the importance of BHRF1 in EBV pathogenesis by participating in innate immunity control.

      An additional minor issue is the authors naming of the process as Mito-aggresome formation. Although this might sound catchy it is somewhat unclear what the biological basis for this is. Aggresomes are defined structures that occur in cells during pathology and due to the peri-nuclear accumulation of misfolded protein. Since the process here is simply the description of aggregated mitochondria next to the nucleus but doesn't seem to have anything to do with protein misfolding it's really unclear how this labelling is helpful to the field. The process of perinuclear mitochondrial aggregation e.g. during mitochondrial stress or damage has been described many times before without the need for calling it a mito-aggresome. This term is likely to cause unhelpful confusion.

      We understand the comment of reviewer #2, but since 2010 the term “mito-aggresome” was previously used in other studies and refers to a clustering of mitochondria next to the nucleus, similarly to what we observed with BHRF1 (D’Acunzo et al., 2019; Lee et al., 2010; Springer and Kahle, 2011, 2011; Strappazzon et al., 2015; Van Humbeeck et al., 2011; Yang and Yang, 2011).

      However, we took into consideration the risk of confusion for the readers, by changing how we introduced the term “mito-aggresome” in the revised version of the manuscript (page 5 line 94).

      References

      Bentz GL, Liu R, Hahn AM, Shackelford J, Pagano JS. 2010. Epstein–Barr virus BRLF1 inhibits transcription of IRF3 and IRF7 and suppresses induction of interferon-β. Virology 402:121–128. doi:10.1016/j.virol.2010.03.014

      D’Acunzo P, Strappazzon F, Caruana I, Meneghetti G, Di Rita A, Simula L, Weber G, Del Bufalo F, Dalla Valle L, Campello S, Locatelli F, Cecconi F. 2019. Reversible induction of mitophagy by an optogenetic bimodular system. Nat Commun 10:1533. doi:10.1038/s41467-019-09487-1

      Hahn AM, Huye LE, Ning S, Webster-Cyriaque J, Pagano JS. 2005. Interferon regulatory factor 7 is negatively regulated by the Epstein-Barr virus immediate-early gene, BZLF-1. J Virol 79:10040–10052. doi:10.1128/JVI.79.15.10040-10052.2005

      Lazarou M, Sliter DA, Kane LA, Sarraf SA, Wang C, Burman JL, Sideris DP, Fogel AI, Youle RJ. 2015. The ubiquitin kinase PINK1 recruits autophagy receptors to induce mitophagy. Nature 524:309–314. doi:10.1038/nature14893

      Lee J-Y, Nagano Y, Taylor JP, Lim KL, Yao T-P. 2010. Disease-causing mutations in Parkin impair mitochondrial ubiquitination, aggregation, and HDAC6-dependent mitophagy. J Cell Biol 189:671–679. doi:10.1083/jcb.201001039

      Narendra DP, Tanaka A, Suen D-F, Youle RJ. 2008. Parkin is recruited selectively to impaired mitochondria and promotes their autophagy. J Cell Biol 183:795–803. doi:10.1083/jcb.200809125

      Nowosad A, Creff J, Jeannot P, Culerrier R, Codogno P, Manenti S, Nguyen L, Besson A. 2021. p27 controls autophagic vesicle trafficking in glucose-deprived cells via the regulation of ATAT1-mediated microtubule acetylation. Cell Death Dis 12:1–18. doi:10.1038/s41419-021-03759-9

      Springer W, Kahle PJ. 2011. Regulation of PINK1-Parkin-mediated mitophagy. Autophagy 7:266–278. doi:10.4161/auto.7.3.14348

      Strappazzon F, Nazio F, Corrado M, Cianfanelli V, Romagnoli A, Fimia GM, Campello S, Nardacci R, Piacentini M, Campanella M, Cecconi F. 2015. AMBRA1 is able to induce mitophagy via LC3 binding, regardless of PARKIN and p62/SQSTM1. Cell Death Differ 22:419–32. doi:10.1038/cdd.2014.139

      Van Humbeeck C, Cornelissen T, Hofkens H, Mandemakers W, Gevaert K, De Strooper B, Vandenberghe W. 2011. Parkin Interacts with Ambra1 to Induce Mitophagy. J Neurosci 31:10249–10261. doi:10.1523/JNEUROSCI.1917-11.2011

      Vilmen G, Glon D, Siracusano G, Lussignol M, Shao Z, Hernandez E, Perdiz D, Quignon F, Mouna L, Poüs C, Gruffat H, Maréchal V, Esclatine A. 2020. BHRF1, a BCL2 viral homolog, disturbs mitochondrial dynamics and stimulates mitophagy to dampen type I IFN induction. Autophagy 17:1296–1315. doi:10.1080/15548627.2020.1758416

      Wang J-T, Doong S-L, Teng S-C, Lee C-P, Tsai C-H, Chen M-R. 2009. Epstein-Barr Virus BGLF4 Kinase Suppresses the Interferon Regulatory Factor 3 Signaling Pathway. J Virol 83:1856–1869. doi:10.1128/JVI.01099-08

      Yang J-Y, Yang WY. 2011. Spatiotemporally controlled initiation of Parkin-mediated mitophagy within single cells. Autophagy 7:1230–1238. doi:10.4161/auto.7.10.16626

      Zhu L-H, Gao S, Jin R, Zhuang L-L, Jiang L, Qiu L-Z, Xu H-G, Zhou G-P. 2014. Repression of interferon regulatory factor 3 by the Epstein-Barr virus immediate-early protein Rta is mediated through E2F1 in HeLa cells. Mol Med Rep 9:1453–1459. doi:10.3892/mmr.2014.1957

  2. Nov 2021
    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Response to Reviewer’s comments

      We thank the three reviewers for their positive comments and constructive feedback. We have addressed the issues raised through additional experiments and text changes which have helped to improve the manuscript. Below, we address the specific points with detailed responses (reviewer comments are provided in italic).

      Reviewer #1 (Evidence, reproducibility and clarity (Required)):

      The manuscript by Rodriguez-Lopez et al describes the analysis of long intergenic non-coding RNA (lincRNA) function in fission yeast using both deletion and overexpression methods. The manuscript is very well presented and provides a wealth of lincRNA functional information for the field. This work is an important advance as there is still very little known about the function of lincRNAs in both normal and other conditions. An impressive array of conditions were assessed here. With a large scale analysis like this there is really not one specific conclusion. The authors conclude that lincRNAs exert their function in specific environmental or physiological conditions. This conclusion is not a novel conclusion, it has been proposed and shown before, but this manuscript provides the experimental proof of this concept on a large scale.

      The lincRNA knock-out library was assessed using a colony size screen, a colony viability screen and cell size and cell cycle analysis. Additionally, a lincRNA over-expression library was assessed by a colony size screen. These different functional analysis methods for lincRNAs were than carried out in a wide variety of conditions to provide a very large dataset for analysis. Overall, the presentation and analysis of the data was easy to follow and informative. Some points below could be addressed to improve the manuscript.

      There were 238 protein coding gene mutants assessed in parallel, to provide functional context, which was a very promising idea. But, unfortunately, the inclusion of 104 protein coding genes of unknown function restricted the use of the protein coding genes in the integrated analysis to connect lincRNAs to a known function using guilt by association.

      Reply: Yes, the unknown coding-gene mutants did certainly not help to provide functional context through guilt by association. These mutants were included to generate functional clues for the unknown proteins and compare phenotype hits with unknown lincRNA mutants. Nevertheless, because the known coding-gene mutants included broadly cover all high-level biological processes (GO slim), we could make several useful functional inferences for certain lincRNAs as discussed.

      The colony viability screen is not described well throughout the manuscript. Firstly, the use of phloxine B dye to determine cell viability needs to be described better when first introduced at the bottom of page 6. What exactly is this viability screen and red colour intensity indicating? Please define what the different levels of red a colony would indicate as far as viability. I assume an increase in red colour indicates more dead cells? So it is confusing that later the output of this assay is described as giving a resistant/sensitive phenotype or higher/lower viability. How can you get a higher viability from an assay that should only detect lower viability? Shouldn't this assay range from viable (no, or low red, colour) to increasing amounts of red indicating increasingly less viability? Figure 4D is also confusing with the "red" and "white" annotations. These should be changed to "lower viability" and "viable" or "not viable" and "viable".

      Reply: The colony-viability screen is described in detail in our recent paper (Kamrad et al, eLife 2020). We have now better explained how phloxine B works to determine cell viability (p. 6). The reviewer’s assumption is correct: an increase in red colour indicates more dead cells. However, all phenotypes reported are relative to wild-type cells under the same condition. Many conditions lead to a general increase in cell death, but some mutants show a lower increase in cell death compared to wild-type cells. These mutants, therefore, have a higher viability than wild-type cells, i.e. they are more resistant than wild-type under the given condition. We have tried to clarify this in the text, including the legend of Fig. 4. We agree that the ‘red’ and ‘white’ annotations in Fig. 4D could be confusing. We have now changed these to ‘low viability’ and ‘high viability’. Again, this is relative to wild-type cells.

      How are you sure that when generating the 113 lincRNA ectopic over-expression constructs by PCR that the sequences you cloned are correct? Simply checking for "correct insert size", as stated in the methods, is not really good practice and these constructs should be fully sequenced to be sure they contain the correct sequence and that constructs have not had mutations introduced by the PCR used for cloning. Without such sequence confirmation one cannot be completely confident that the data produced is specific for a lincRNA over-expression. Additionally, a selection of strains with the overexpression constructs should be tested by qRT-PCR and compared to a non-over-expressing strain to confirm lincRNA overexpression.

      Reply: To minimize errors during PCR amplification, we used the high-fidelity Phusion DNA polymerase which features an >50-fold lower error rate than Taq DNA Polymerase. We had confirmed the insert sequences for the first 17 lincRNAs cloned using Sanger sequencing (but did not report this in the manuscript). We have now checked additional inserts of the overexpression plasmids by Sanger sequencing in 96-well plate-format using a universal forward primer upstream of the cloning site. This high-troughput sequencing produced reliable sequence data for 80 inserts, including full insert sequences for 62 plasmids and the first ~900 bp of insert sequences for 18 plasmids). Of these, only the insert for SPNCRNA.601 showed a sequence error compared to the reference genome: T to C transition in position 559. This mutation could reflect either an error that occurred during cloning or a natural sequence variant among yeast strains (lincRNA sequences are much more variable than coding sequences). So, in general, the PCR cloning accurately preserved the sequence information. We have added this information in the Methods (p. 27-28). Please note that lincRNAs depend much less on primary nucleotide sequence than mRNAs, and a few nucleotide changes are highly unlikely to interfere with lincRNA function.

      Minor comments:

      Page 4, lines 19-20 - "A substantial portion of lincRNAs are actively translated (Duncan and Mata, 2014), raising the possibility that some of them act as small proteins." This sentence does not make sense, lincRNAs can't "act as" small proteins, they can only "code for" small proteins. Wording needs to be changed here.

      Reply: We agree and have changed the wording as suggested.

      Figure 1A is a nice representation but what are the grey dots? Are they all ncRNAs including lincRNAs? This needs to be stated in the legend.

      Reply: The grey dots represent all non-coding RNAs across the three S. pombe chromosomes as described by Atkinson et al., 2018. This has now been clarified in the legend.

      How many lincRNAs are there in total in pombe and what percentage did you delete? These numbers should be stated in the text.

      Reply: There are 1189 lincRNAs and we mutated ~12.6% of them. These numbers are now stated at the end of the Introduction, page 5.

      It would be nice if Supplementary Figure 1 included concentrations or amounts of the conditions used. This info is buried in a Supplementary table and would be better placed here.

      Reply: Supplemental Fig. 1 provides a simple overview for the different conditions and drugs used. For most stresses and drugs, we used multiple different doses. So the figure would become cluttered if we indicated all these concentrations, detracting from the main message. Colleagues who are interested in the different concentration ranges used for specific conditions can readily obtain this information from Supplemental Dataset 1. We have now added a statement in this respect to the legend of Supplemental Fig. 1

      Page 6, last sentence. What is a "biological repeat"? Three distinct deletion strains (ie three different deletion strains made by CRISPR) or one deletion strain used three times?

      Reply: Biological repeat means that one deletion strain was assayed three times independently, each with at least two colonies (technical repeats). In most cases, we had two or more independently generated deletion strains for each lincRNA (using the same or different gRNAs), and we performed at least three biological repeats for each strain. The numbers of independent strains for each lincRNA are provided in Supplemental Dataset 1 (sheet: lincRNA_metadata, column: n_independent_ko_mutants). The total numbers of repeats carried out for each condition after QC filtering are available in Supplemental Dataset 2 (columns: observation_count). We have clarified this on p. 7, and the details are now provided in the Methods on p. 28-29 (deletion mutants) and p. 32 (overexpression mutants).

      There is no mention in the manuscript of how other researchers can get access to the deletion strains and over-expression plasmids.

      Reply: As is usual, all strains and plasmids will be readily available upon request.

      Reviewer #1 (Significance (Required)):

      The production of lincRNA deletion strains and overexpression plasmids, and their analysis under an impressive number of conditions, provides key resources and data for the ncRNA field. This work complements nicely the analysis of protein coding gene deletion strains and provides the tools and data for future mechanistic studies of individual lincRNAs. This work would be of interest to the growing audience of ncRNA researchers in both yeast and other systems.

      Field of expertise:

      Yeast deletion strain construction and analysis, RNA functional analysis

      \*Referee Cross-commenting** *

      Reviewer #3 makes an important point that the stability of each lincRNA over expressed from plasmid is not known and therefore some lincRNAs may not be overexpressed as predicted. RT-qPCR would be required to assess lincRNA expression levels from the plasmids. It also appears that we both agree that it is important to determine the sequence of the cloned lincRNAs in the over expression plasmids.

      Reply: See reply in response to Reviewer 3.

      Reviewer #3 also makes an important point in his review that where it is predicted that a lincRNA deletion influences an adjacent gene in cis then the expression of that gene should be tested.

      Reply: See reply in response to Reviewer 3.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)):

      \*Summary:** *

      The Rodriguez-Lopez manuscript from the Bahler lab present the phenotypical and functional profiling of lincRNA in fission yeast. This is the first large-scale, extensive work of this nature in this model organism and it therefore nicely complement the well-documented examples of lincRNA already reported in S.pombe.

      The work is very solid using seamless genome deletion and overexpression followed by colony-based assay in respone to a very wide set of conditions.

      \*Major comments:** *

      - considering that this is a descriptive work by nature and that the experiments were properly conducted as far as I can judge, I don't have major issues with this paper.

      To me the only thing that is missing is a gametogenesis assay, for two reasons: First, several reported cases of lincRNAs in pombe critically regulates meiosis, and second many of the analysed lincRNAs are upregulated durig meiosis. Figure 6B already points to three obvious candidates. I don't think it would take to much time to look at the deletion and OE in an h90 strain and see the effect of gametogenesis for the entire set or at least the 3 candidates from Figure 6.

      If the already broad set of lincRNAs implicated in meiosis would grow, this would be another evidence that eukaryotic cell differentiation relies on non-coding RNAs even in simpler models.

      Reply: We agree that this is a meaningful analysis to add. We have now deleted the three unstudied lincRNA genes, along with the meiRNA gene, from the sub-cluster of Figure 6B in the homothallic h90 background (to allow self-mating). We have analysed meiosis and spore viability of these four deletion strains together with a wild-type h90 control strain. These experiments indicate that cell mating is normal in the deletion mutants, but meiotic progression is somewhat delayed in SPNCRNA.1154, SPNCRNA.1530 and, most strongly, meiRNA mutants (the latter has been reported before (reviewed by Yamashita 2019). Notably, we detected significant reductions in spore viability for all four deletion mutants compared to the control strain. These results point to roles of SPNCRNA.1154, SPNCRNA.1530, and SPNCRNA.335 in meiotic differentiation, as predicted by the clustering analyses. This is a nice addition to the manuscript. We now report these results on p. 23, with a new Supplemental Figure 10, and describe the experimental procedures in the Methods (p. 34-35).

      \*Minor comments:** *

      - A reference to the recent work of the Rougemaille lab on mamRNA is necessary

      Reply: Yes, we now cite this reference in the Introduction (p. 4).

      - a discussion of the possibility to perfom large-scale genetic interactions searches (as done by Krogan for protein-coding genes) would add to the discussion of futue plans

      Reply: We have added a sentence about the potential of SGA screens in the Conclusions (p. 26).

      Reviewer #2 (Significance (Required)):

      The work unambigously shows that that most of the lincRNAs analyzed exert cellular functions in specific environmental or physiological contexts. This conclusion is critical because the biological relevance this so-called « dark matter » is still debated despite a few well-established cases. This is an important addition to the field and the deep phenotyping work already points to some directions to analyse some of these lincRNA in the context of cell cycle progression, metabolism or meiosis.

      \*Referee Cross-commenting** *

      - I agree with the issues raised by referees 1 and 3 but I am concerned about the added value of a RT-qPCR. First, this is a significant amout of work considering the large set of targets. Second a more importantly, what you ll end up with is a fold change. What will be considered as overexpression? Which threshold? This is why I prefer a biological read-out (a phenotype) because whatever the fold change, it tells us that there is an effect. It is very likely indeed that some targets are not overexpressed because of their rapid degradation. To me, this is the drawback of any large-scale studies.

      - Also, looking at the expression of the adjacent gene in the case of a cis-effect is interesting though this is likely condition-dependent (because most phenotypes appear in specific conditions). So, what would be the conclusion if there is no effect in classical rich media?

      - The sequence of the insert should be specified, I agree. Most likely, it is the sequence available from pombase (this is what I understood) but that should be clarified indeed.

      Reply: Yes, the sequences of the inserts are available from PomBase, and we provide the primer sequences used for cloning in the Supplemental Dataset 1. We have now clarified this in the Methods (p. 27).

      Reviewer #3 (Evidence, reproducibility and clarity (Required)):

      In this work from the group of Jurg Bahler, the authors take advantage of the high throughput colony-based screen approach they recently developed (Kamrad et al, eLife 2020) to perform a functional profiling analysis on a subset of 150 lincRNAs in fission yeast. Using a seamless CRISPR/Cas9-based method, they created deletion mutants for 141 lincRNAs. In addition, the authors also generated strains ectopically overexpressing 113 lincRNAs from a plasmid (under the control of the strong and inducible nmt1 promoter).

      The viability and growth of all these mutants was then assessed across benign, nutrient, drug and stress conditions (149 conditions for the deletion mutants, 47 conditions for the overexpression). For the deletion mutants, the authors also assayed in parallel mutants of 238 protein-coding genes (PCGs) covering multiple biological processes and main GO classes.

      In benign conditions, deletion of 5 and 10 lincRNAs resulted in a reduced growth phenotype (rich and minimal medium, respectively). Morphological characterization by microscopy also revealed cell size defects for 6 lincRNA mutants (2 shorter, 4 longer). In addition, 27 mutants displayed phenotypes pointing defects in the cell cycle.

      Remarkably, the nutrient/drug/stress conditions revealed more phenotypes, with 60 of the 141 lincRNA mutants showing a growth phenotype in at least one condition, and 25 mutants showing a different viability compared to the wild-type in at least one condition.

      Also remarkable is the observation that 102/113 lincRNA overexpression strain displayed a growth phenotype in at least one condition, 14 lincRNAs showing phenotypes in more than 10 conditions.

      The clustering analyses performed by the authors also provide functional insight for some lincRNAs.

      Overall, this is an important study, well conducted and well presented. Together, the data described by the authors are convincing and highlight that most lincRNAs would function in very particular conditions, and that deletion/inactivation and overexpression are complementary approaches for the functional characterization of lncRNAs. This has been demonstrated here, in a very elegant manner.

      I think this manuscript will be acknowledged as a pioneer work in the field.

      \*A. Major comments** *

      - A.1. Are the key conclusions convincing?

      To my opinion, the key conclusions of this study are convincing.

      - A.2. Should the authors qualify some of their claims as preliminary or speculative, or remove them altogether?

      No. The authors are careful in their claims and conclusions.

      - A.3. Would additional experiments be essential to support the claims of the paper? Request additional experiments only where necessary for the paper as it is, and do not ask authors to open new lines of experimentation.

      This study is based on systematic lincRNA deletion/overexpression.

      - For the deletion strains, I could not find any information about the control of the deletions. Are the authors sure that the targeted lincRNAs were indeed properly deleted?

      Reply: Yes, we had carefully checked the correctness of the deletions using several controls as described by Rodriguez-Lopez et al. 2017. All deletion strains were checked for missing open-reading frames by PCR. For 20 strains, we also sequenced across the deletion scars. We re-checked all strains by PCR after arraying them onto the 384 plates to ensure that no errors occurred during the process. We have now specified this in the Methods (p. 27).

      - For the overexpression, there is only a control of the insert size by PCR. Sanger sequencing would have been preferable to confirm that the targeted lincRNAs were properly cloned, without any mutation. In addition, the authors did not check that the lincRNAs were indeed overexpressed (at least in the benign conditions). Is the overexpression fold similar for all the lincRNAs? Do the 14 lincRNAs showing the most consistent phenotypes in at least 10 conditions display different expression levels than the other lincRNAs?

      - A.4. Are the suggested experiments realistic in terms of time and resources? It would help if you could add an estimated cost and time investment for substantial experiments.

      - Validating the deletion strains requires genomic DNA extraction and then PCR. This is repetitive and tedious, but this control is important, I think. The time needed depends on the possibility of automating the process. I think this is feasible in this lab.

      - Controlling the insert sequence into the overexpression vector requires plasmid DNA (available as it was used for PCR) and one/several primer(s), depending on the insert size. The sequencing itself is usually done by platforms.

      - Analysing lincRNA overexpression at the RNA level requires yeast cultures, RNA extraction and then RT-qPCR. Again, the time needed depends on the possibility of automating the process.

      Reply: We have now checked most overexpression constructs by Sanger sequencing of the inserts as described in response to Reviewer 1. Moreover, we have tested the overexpression levels for eight selected overexpression constructs using RT-qPCR analysis. These eight constructs feature the entire range of associated phenotypes hits, including 3 lincRNAs with the highest number of phenotypes in 14 conditions, 3 with no phenotypes, and 2 with intermediate numbers of phenotypes. The RT-qPCR results show that the lincRNAs were 35- to 2200-fold overexpressed relative to the empty-vector control strain (which expresses the lincRNA at native levels). No clear pattern was evident between expression levels and phenotype hits, e.g. lincRNAs without phenotypes when overexpressed showed similar fold-changes as a lincRNA showing 13 phenotypes. We present these results on p. 21/22 and in the new Supplemental Figure 9A, and describe the experiment in the Methods (p. 28).

      As pointed out by Reviewer 2, these fold changes in expression are actually of limited value compared to the phenotype read-outs. The important result is that we detected phenotypes for over 90% of the overexpression strains, indicating that overexpression generally worked. Given that this is a large-scale study, there might be some lincRNA constructs that are faulty or are not overexpressed. It would not be realistic or meaningful to test all constructs. Any follow-on studies focusing on a specific lincRNAs will need to first validate the large-scale results as is common practice.

      - A.5. Are the data and the methods presented in such a way that they can be reproduced?

      The methods are clearly and extensively explained. If necessary, the reader can find more details about the high-throughput colony-based screen approach in the original paper (Kamrad et al, eLife 2020); a very interesting technical discussions can also be found in the reviewers reports and in the authors response published alongside.

      - A.6. Are the experiments adequately replicated and statistical analysis adequate?

      The experiments are replicated. However, I feel confused regarding the number of replicates used in each analysis.

      In the first part of the Results, it is mentioned that all colony-based phenotyping was performed in at least 3 independent replicates, with a median number of 9 repeats per lincRNAs. In the Methods section, I read that for the high-throughput microscopy and flow cytometry for cell-size and cell-cycle phenotypes, over 80% of the 110 lincRNA mutants screened for cellular phenotypes were assayed in at least 2 independent biological repeats. For the overexpression, I read that each strain was represented by at least 12 colonies across 3 different plates and experiments were repeated at least 3 times. Each condition was assayed in three independent biological repeats, together with control EMM2 plates, resulting in at least 36 data points per strain per condition.

      Perhaps I missed something. If not, could the authors clarify this? In addition, I suggest to indicate the number of replicates used for each lincRNA/condition/assay in Supplemental Dataset 2 (I could only find the information for the Flow Cytometry) and in Supplemental Dataset 6.

      Reply: For all colony-based phenotyping, we performed at least three biological repeats, meaning that the strains were assayed three times independently, each with at least two colonies (technical repeats). In most cases, we had two or more independently generated deletion strains for each lincRNA, and we performed at least three biological repeats for each strain (hence the higher median number of nine repeats per lincRNA). The numbers of independent deletion strains for each lincRNA are provided in Supplemental Dataset 1 (sheet: lincRNA_metadata, column: n_independent_ko_mutants). The total numbers of repeats carried out for each condition after QC filtering are available in Supplemental Dataset 2 (columns: observation_count). We have now clarified this on p. 6, and the details are provided in the Methods on p. 28-29 (for deletion mutants) and p. 32 (for overexpression mutants). For the high-throughput microscopy and flow cytometry experiments, we performed the repeats as described in the text.

      \*B. Minor comments** *

      - B.1. Specific experimental issues that are easily addressable.

      - The pattern of the SPNCRNA.1343 and SPNCRNA.989 mutants is consistent with the idea that these lincRNAs act in cis and that their deletion interferes with the expression of the adjacent tgp1 and atd1 genes, respectively. The authors could easily test by RT-qPCR or Northern Blot that the lincRNA deletion leads to the induction of the adjacent gene. Also, if the hypothesis of the authors is correct, the ectopic expression of these two lincRNAs in trans should not complement the phenotypes of the corresponding mutants. These experiments would reinforce the conclusion of the authors about the specific regulatory effect of the SPNCRNA.1343 and SPNCRNA.989 lincRNAs.

      Reply: It would actually not be as easy as suggested to obtain conclusive results in this respect. For SPNCRNA.1343 and its neighbour, atd1, the mechanisms involved have already been shown in detail based on several mechanistic studies (Ard et al., 2014; Ard and Allshire, 2016; Garg et al., 2018; Shah et al., 2014; 2014; Yague-Sanz et al., 2020). But these studies did require multiple precise genetic constructs and specialized approaches to interrogate the complex regulatory relationships between the overlapping transcripts which can be both positive and negative. As correctly pointed out by Reviewer 2, we do not know the particular conditions where any cis-regulatory interactions take place, and a negative result would not be conclusive. We have interrogated our RNA-seq data obtained under multiple genetic and environmental conditions (Atkinson et al. 2018) to analyse the regulatory relationship between SPNCRNA.1343 and atd1 (studied before) as well as SPNCRNA.989 and tgp1 (proposed in our manuscript). Depending on the specific conditions, both of these gene pairs show positive or negative correlations in expression levels. So it is not possible to just perform the easy experiment as suggested to reach a clear conclusion.

      - Is there any possibility that some nutrient/drug/stress conditions interfere with the expression from the nmt1 promoter?

      Reply: This seems unlikely as this widely used promoter is known to be specifically regulated by thiamine. Consistent with this, we actually detected phenotypes for over 90% of the overexpression strains. But we cannot exclude the possibility that some conditions might interfere with nmt1 function.

      - Supplemental Figure 7 refers to unpublished data from Maria Rodriguez-Lopez. Is this still allowed?

      Reply: These are just control RNA-seq data from wild-type cells growing in rich medium. It does not seem that meaningful, but if required we could submit these data to the European Nucleotide Archive (ENA).

      - Supplemental Figure 8 shows drop assays to validate the growth phenotypes revealed by the screen for lincRNAs of clusters 1 and 3. As admitted by the authors in the text, in most cases, the effects are quite difficult to see to the naked eye. Did the authors consider the possibility to use growth curves (for the lincRNAs/conditions they would like to highlight), which might be more appropriate to visualize weak effects?

      Reply: We have tried a few experiments in liquid medium using our BioLector microfermentor. However, the doses need to be substantially changed for liquid media (in which cells typically are more sensitive than on solid media). So the situation with the altered conditions would become too confusing and could not be used as a direct validation of our results from solid media.

      - B.2. Are prior studies referenced appropriately?

      Yes. The authors could have cited the work of Huber et al (2016) Cell Rep. (PMID: 27292640) as another pioneer study where systematic lncRNA deletion was performed, even if in this case, these were antisense lncRNAs.

      Reply: Agreed, we now cite this paper in the Introduction (p. 4).

      - B.3. Are the text and figures clear and accurate?

      Overall, I found the text and figures clear.

      Reviewer #3 (Significance (Required)):

      Eukaryotic genomes produce thousands of long non-coding RNAs, including lincRNAs which are expressed from intergenic regions and do not overlap PCGs. Several lincRNAs have been extensively studied and characterized, showing that they function in different cellular processes, such as regulation of gene expression, chromatin modification, etc. However, beside these well documented lincRNAs, the function of most lincRNAs remains elusive. In addition, under the standard growth conditions used in labs, many of them are expressed to very low levels, and for the few cases for which it has been tested, the deletion and/or overexpression in trans often failed to display in a detectable phenotype.

      High throughput approaches for lncRNA functional profiling are currently emerging. The lab of Jurg Bahler recently developed a high throughput colony-based screen approach enabling them to quantitatively assay the growth and viability of fission yeast mutants under multiple conditions (Kamrad et al, eLife 2020). Here, they take advantage of this approach to characterize mutants of 150 lincRNAs in fission yeast, including not only deletion mutants generated using the CRISPR/Cas9 technology, but also overexpression mutants, tested in 149 and 47 growth conditions, respectively. This systematic approach allowed the authors to reveal specific phenotypes for a large fraction of the lincRNAs, emphasizing the fact that they are likely to be functional in particular nutrient/drug/stress conditions, acting in cis but also in trans.

      As I wrote in the summary above, I think that this study is important and constitutes a significant contribution in the lncRNA field.

      My field of expertise: long non-coding RNAs, yeast, genetics.

      \*Referee Cross-commenting** *

      I can see that reviewer #1 and I have raised the same concerns about the lack of insert sequencing for the overexpression plasmids, which is crucial to control that the correct lincRNAs were cloned and that no mutation has been introduced by the PCR. We are also both asking for RT-qPCR controls to show that the lincRNAs are indeed overexpressed. Again, this control is very important as many long non-coding RNAs are rapidly degraded by the nuclear and/or ctyoplasmic RNA decay machineries. So expressing a lincRNA from a plasmid, under the control of a strong promoter, does not guarantee increased RNA levels.

      I see that reviewer #2 is asking for a gametogenesis assay. I think it should be limited to the 3 lincRNAs which belong to the same sub-cluster as meiRNA.

    1. Author Response:

      Reviewer #1 (Public Review):

      Hickey et al. studied chromatin landscape changes in early Zebrafish embryos at three distinct stages: preZGA, ZGA and postZGA. Using ChIP-seq on these time-course samples, they examined developmental genes at their regulatory elements, including promoters and enhancers, that carry nucleosomes enriched with histone variant H2A.Z, as well as post-translational modifications H3K4me1 and H3K27ac, but with low DNA methylation, in early-stage embryos prior to turning on zygotic gene expression. During embryogenesis, this group of elements recruit a Polycomb Repressive Complex 1 (PRC1) component Rnf2 to "write" the ubiquitinated H2A or H2A.Z. The mono-ubH2A/Z then recruits a PRC2 component Aebp2 to further "write" the H3K27me3 repressive mark to silent these developmentally regulated genes in later stage embryos. Using a small molecule to inhibit Rnf2 abolishes H3K27me3 and leads to ectopic gene expression.

      Most of the data for the first half of this manuscript are presented in a clear and logic manner. The conclusions based on these correlation assays are quite obvious and well supported (except a few minor points raised below for clarifications, #2-#3). The major concern is for the second half of the manuscript where a drug is used to draw causal relationships (see point #1 below).

      1. Using small molecule could have secondary effects. It also seems that the drug-induced defects cannot be reversed after being washed away. Furthermore, this drug treatment eliminates almost all H3K27me3 genome-wide, regardless of their occupancy status with mono-ubH2A/Z, making it difficult to make the causal connection between the prerequisite mono-ubH2A/Z occupancy and the subsequent de novo H3K27me3. I think it is important for the authors to address this point more directly as this is the main conclusion of this work. Could the authors perform genetic analyses to confirm the specificity of the phenotypes?

      2. Page 8, line 160-163: "Curiously, enhancer cluster 5 (Figure 2A) was unique - displaying high H3K4me1, very high H3K27ac, and open chromatin (via ATAC-seq analysis; Figure 2 - figure supplement C, D) - but bore DNA methylation - an unusual combination given the typical strong correlation between high H3K4me1 and DNA hypomethylation." I suspect that the authors are talking about the chromatin state at pre-ZGA stage as this is the only stage DNA methylation pattern was included, but it is hard to tell that this cluster displays high H3K4me1 at all.

      We now see the confusion, and are happy to clarify this. We were intending to refer to to the histone marking at postZGA, and the DNAme at postZGA (for cluster #5) – as postZGA is the time when H3K4me1 is high, H3K27ac is very high, and DNAme remains high. The reviewer is right that we do not show the DNAme pattern at post ZGA, only preZGA. However, the DNAme pattern stays almost constant between preZGA (2.5 hpf) and postZGA (4.3 hpf) – a result we published previously in Potok et al., 2010 (note: the maternal genome shows DNA reprogramming prior to 2.5hr, and is then constant through ZGA). We did not include DNAme at every stage simply to save space in Panel A, which was getting crowded. However, to avoid the reader misunderstanding our point, we have taken care to make this clear in the revised manuscript. We thank the reviewer for raising this point.

      1. Page 10, line 206-207: "PRT4165 treatment also conferred limited new/ectopic Aebp2 peaks (Figure 4C, clusters 4, 6, 7,8)", it seems that clusters 4, 6, 7, 8 together are not "limited" compared to clusters 1, 3, and 5, and could be even more abundant.

      Thank you for this comment - we agree with the reviewer and have clarified this in the text and Figure 4. In the initial version, the section where we mention ‘limited’ additional sites was intend to refer to promoters, and although as only a modest fraction of the ectopic sites are at promoters, but we did not provide that context in the text. Indeed, if one looks at all sites in the genome, there are a large number of ectopic sites after PRT4165 treatment. This is shown clearly in the revised Figure 4 (which shows all genomic sites) and we have clarified this in the text.

      We were curious whether there is any feature that helps us understand what might unify the ectopic binding, and therefore underlie the mechanism(s). First, we tested whether binding sites for particular transcription factors might be enriched; however, we did not find a class of binding sites that represented more than 3% of the total sites. We note that others have reported some affinity of mammalian Aebp2 for DNA and some limited sequence specificity (Kim et al., NAR 2009), and in the absence of a high-affinity H2AUb target, that shadow DNA binding function may become more apparent. Furthermore, we did not observe chromatin marks that showed a highly significant degree of overlaps. Thus, although intriguing, there does not appear to yet be a logic to the ectopic binding observed.

      1. In the context of studying the chromatin state of developmental genes in early vertebrate embryos, there are two recent publications in mouse embryos which also investigated the crosstalk between mono-ubH2A and H3K27me3 at the ZGA transition in mouse (https://doi.org/10.1038/s41588-021-00821-2 and https://doi.org/10.1038/s41588-021-00820-3). It would be informative to add some discussion for comparisons between these two vertebrate organisms.

      Reviewer #2 (Public Review):

      One model for polycomb domain establishment suggests that PRC2 adds H3K27me3 first, and then recruits PRC1 for silencing. The key evidence for this model is the H3K27me3-binding module CBX proteins in canonical PRC1 complexes. This model has been revised by recent studies, and it is now well recognized that the polycomb domains can be de novo established in a different order. In other scenarios, including X inactivation, a non-canonical PRC1 complex that lacks CBX proteins catalyzes ubH2A first, and PRC2 complex is subsequently recruited through recognizing ubH2A modification by its Jarid2 and Aebp2 subunits.

      In this manuscript, Hickey and co-workers analyzed the temporal change of various epigenetic marks around ZGA stages during zebrafish early embryo development. Based on their experimental data and bioinformatic analysis, they suggest that polycomb establishment in zebrafish embryo is following the 'non-canonical' order, in which H3K27me3 establishment is dependent on ubH2A pre-deposition and the following recruitment of Aebp2-PRC2 complex. Moreover, they suggest that polycomb-silenced developmental genes are solely repressed by ubH2A, independent of H3K27me3. Overall, the functional analysis (RNF2 inhibitor experiments) conducted in the current study highlights the critical function of PRC1 and ubH2A in silencing developmental genes during early embryo development. Moreover, this study provides clues that could reconcile with the earlier observations that H3K27me3 seems largely dispensable for silencing developmental genes in zebrafish early embryo (e.g. PMID: 31488564).

      The main concern is two similar studies have just been published in Nature Genetics using mouse early embryos, and the observation of this manuscript largely agree with the two mouse studies, rendering the novelty of this study.

      In addition, certain conclusions in the manuscript requires further experimental support:

      1. While the authors claim that H3K27me3 is established after ZGA, it is quite surprising to me that they did NOT analyzed the H3K27me3 pattern before ZGA. While IF staining suggests a minimal level of H3K27me3 before ZGA (Fig1 S2B), previous ChIP-seq analysis demonstrate that H3K27me3 are present (e.g. PMID: 22137762).

      Briefly, in our own work, we do not detect H3K27me3 by IF prior to ZGA, and we could not detect H3K27me3 peaks by ChIP during preZGA (also mentioned as ‘data not shown’ in Murphy et al., 2018).

      1. While the RNF2 inhibitor experiment clearly demonstrates that PRC1 is required for the deposition of both ubH2A and H3K27me3, that does not necessarily mean that PRC1-mediated ubH2A deposition precedes H3K27me3. The establishment and maintenance of polycomb domain usually requires the crosstalk and reinforcement between polycomb complexes. Therefore, the deficiency in either PRC1 or PRC2 complex may lead to the decreased level of both marks. To clarify a hierarchical order of the polycomb domain establishment, a phenotypic analysis of PRC2 deficiency is also necessary.

      Here, we emphasize that prior to performing the inhibitor experiment, we addressed the temporal order of addition in Figure 1 and in Figure 1 – figure supplement 1. H2Aub1 is added extensively to thousands of developmental genes during preZGA, well before H3K27me3 is detected. We interpret this as evidence that H2Aub1 temporally precedes H3K27me3 during embryonic development. We will also mention (described in the Discussion) that maternal zygotic loss of Ezh2, which eliminates all H3K27me3 in the genome at all embryo stages does not result in the activation of developmental genes.

      1. Parental difference. As shown in Fig.1B, ubH2A level varies greatly in sperm and egg, which suggests that the reprogramming process of ubH2A (and perhaps H3K27me3) distribution could be significantly different for the two parental alleles. It would be interesting to analyze the ubH2A and H3K27me3 distribution in germ cells before fertilization.

      We appreciate the reviewer’s comment and agree that this would be an interesting line of inquiry. However, this would require genomics analyses from reciprocal crosses of highly polymorphic fish strains. This would involve very considerable additional work. Therefore, we will consider this in our future studies.

      1. The role of Aebp2 subunit. Given the well-characterized function of Aebp2 in recognizing ubH2A, an involvement of Aebp2-PRC2 complex in establishing H3K27me3 on PRC1 pre-deposited regions is not unexpected. Indeed, Aebp2 co-localized well with ubH2A marked regions (Fig.3). However, an issue not clarified in the manuscript is whether Aebp2 is the sole subunit for the recruitment of PRC2 to ubH2A marked regions. Paralleled analysis of the changes for Aebp2 and H3K27me3 upon RNF2 inhibitor treatment is necessary, and Aebp2-dependent and -independent regions should be separately classified for analysis.

      2. Role of PRC1 on the temporal regulation of gene expression during early development. The authors only analyzed the RNA-seq results for RNF2i treated embryos post ZGA. Therefore, it is currently not clear if the role of PRC1 in transcriptional repression is restricted to post-ZGA stages. RNA-seq analysis of RNF2i treated embryos on those stages are also warranted.

    1. Author Response:

      Reviewer #1 (Public Review):

      The model proposed here is the first large-scale model that actually performs a cognitive task, which in this case is working memory but could easily extend to decision making in general as is acknowledged by the authors. Briefly, each of the 30 areas are simulated as a rate, Wong-Wang circuit (i.e. two excitatory pools inhibit each other through a third, inhibitory population). The authors use previously collected anatomical data to constrain the model and show qualitatively match with the data, in particular how mnemonic activity emerges somewhat abruptly along the brain hierarchy.

      Strengths Previous models have focused on neural dynamics during the so-called "resting state", in which subjects are not performing any cognitive task - thus, resting. This study is therefore an important improvement in the field of large-scale modelling and will certainly become an influential reference for future modelling efforts. As typically done in large-scale modelling, some anatomical data is used to constrain the model. The model shows several interesting characteristics, in particular how distributed working memory is more resilient to distractors and how the global attractors can be turned off by inhibition of only top areas.

      Weaknesses Some of these results are not clear how they emerge, and some "biological constraints" do not seem to constrain. Moreover, some claims are slightly exaggerated, in particular how the model matches the data in the literature (which in some cases it does not) or how somatosensory working memory can be simulated by simply stimulating the "somatosensory cortex".

      This paper has two different models, one being a simplified version of the main model. However, it is not very clear what the simplified model adds the main findings, if not to show that the empirical anatomical connectivity does not constrain the full model.

      We thank the reviewer for this evaluation, and for appreciating the innovative character of our study in implementing a cognitive function in a data-constrained large-scale brain model. We hope that it will be useful for future studies planning to add cognitive functions to their large-scale models, and also for experimentalists who might benefit from this insight.

      In response to the detailed comments of the reviewer, and to address the weaknesses identified above, we have rewritten parts of the text, clarified important concepts and included a new simulations. Briefly:

      -We have clarified the nature and effects of the ‘biological constraints’ that we use. The full model that we use is indeed data-constrained, in the sense that we use real data to determine the values of many parameters. Having a data-constrained model, however, does not mean that all the results will be equally constrained. Some model results will critically depend on (some) data used to constrain the model, while other results will be more robust to changes in these parameters. We have highlighted this point and we also added explanations for each of the results presented.

      -We have corrected several claims along the text to make it more in line with experimental evidence, and included the new references suggested by the reviewer to this effect. For example, for the case of somatosensory WM mentioned by the reviewer, we have indicated that the existence of a ‘gating’ mechanism (explored in a supplementary figure) is important for achieving an accurate match with the experimentally observed effects of somatosensory stimulation.

      -Finally, we have highlighted the complementary benefits of the full and simplified models, and improved our motivation for the latter. Briefly, the simplified model allows us to identify the key ingredients needed for distributed WM (useful to generalize to other animal models), while the full model ensures that the main findings are still present when more realistic assumptions are made. A good example is the counterstream inhibitory bias, which is in principle not necessary for a simplified model but becomes a crucial factor to implement the distributed WM mechanism in our macaque model.

      Reviewer #2 (Public Review):

      There is a lot to like about this manuscript. It provides a large-scale model of a well-known phenomenon, the "delay activity" underlying working memory, our oldest and most enduring model of a cognitive function. The authors correctly state that despite the ubiquity of delay activity, there is little known about the macro and micro circuitry that produces it. The authors offer a computational model with testable hypotheses that is rooted in biology. I think this will be of interest to a wide variety of researchers just as delay activity is studied across a variety of animal models, brain systems, and behavior. It is also well-written.

      My main concern is the authors may be self-handicapping the impact of their model by not taking into account newer observations about delay activity. For a number of years now, evidence has been building that working memory is more complicated than "persistent activity" alone. Stokes, Pasternak, Dehaene, Miller and others have been mounting considerable evidence for more complex dynamics and for "activity-silent" mechanisms where memories are briefly held in latent (non-active) forms between bouts of spiking. There is also mounting evidence that the thalamus plays a key role in working memory (and attention). In particular, higher thalamic nuclei are critical for regulating cortical feedback. Cortical feedback plays a central role in the model presented here. The model presented in this manuscript just deals with persistent attractor states and the cortex alone.

      This is not to say that this manuscript does not have good value as is. No one disputes that some form of elevated, sustained, activity underlies working memory. This work adds insights into how that activity gets sustained and the role of, and interactions between, different cortical areas. The observation that the prefrontal and parietal cortex are more critical than other areas, that there are "hidden" attractor states, and "counterstream inhibitory bias" are important insights (and, importantly, testable). They will likely remain relevant even as the field is moving beyond persistent attractor states alone as the model for working memory. The new developments do not argue against the importance of delay activity in working memory. They show that it is more to the story, as inevitably happens in brain science.

      The authors do include a paragraph in the Discussion referencing the newer developments. Kudos to them for that. However, it presented as "new stuff to address in the future". Well, that future is now. These "newer" developments have been mounting over the past 10 years. The worry here is that by relying so heavily on the older persistent attractor dynamics model and presenting it as the only model, the authors are putting an early expiration date on their work, at least in terms of how it will be received and disseminated.

      We thank the reviewer for a careful and positive evaluation of our work. We consider that the main point raised here is indeed crucial: classical explanations of WM based on elevated and constant firing are an important part of the story, however other alternative or complementary approaches developed in the past years also deserve attention. These approaches include, to name a few, activitysilent mechanisms (Mongillo et al. 2008, Trübutschek et al. 2017), dynamic hidden states (Wolff et al. 2017), persistent activity without feedback (Goldman 2009), and paradigms relying on gamma bursts (Miller et al. 2018).

      It’s important to highlight, however, that our approach is “attractor network theory” not “persistent activity theory”, and an attractor does not have to be a steady state (tonic firing) but may display complex spatiotemporal patterns (fluid turbulence with tremendously rich temporal dynamics and eddies on many spatial scales is an attractor). We now have largely eliminated the use of “persistent” in the manuscript. On the other hand, for lack of a better word it’s fine to still use that term, if it is understood in a more general sense, which also includes stable representations in which the activity of individual neurons varies along the delay period (Goldman, 2009; Murray et al. 2017) or rhythmic activity which persists over time (Miller et al. 2018). The attractor network theory should be contrasted conceptually with mechanisms based on intrinsically transient memory traces (see Wang TINS 2021 for a more elaborated discussion on this).

      Our proposal for distributed WM has a general aim and it’s not restricted to the classical ‘elevated constant firing’ scenario. Following the reviewer’s suggestion, we have rewritten the text to make sure that multiple mechanisms of WM are acknowledged in different parts of the text, not only on a paragraph in the discussion. We have also acknowledged the importance of thalamocortical interactions and cited previous relevant studies in this sense (such as Guo et al. 2017), also as a response to comments from Reviewer 1.

      In addition, we have attempted to go beyond a simple rewriting and, using a variation of our simplified model, we now show that distributed WM representations can also happen in the context of activitysilent models (Figure 3 –figure supplement 1). In particular, we use a simplified network model with reduced local and long-range connectivity strength and incorporate short-term synaptic facilitation in synaptic projections. Our model results show that, while activity-silent memory traces can’t be maintained when areas are isolated from each other, inter-areal projections reinforce the synaptic efficacy levels and lead to a distributed representation via activity-silent mechanisms.

      We hope that this result serves to prove the generality of our distributed WM framework, and opens the door to subsequent studies focusing not only on distributed activity-silent mechanisms, but in distributed frameworks relying on other WM mechanisms as well.

    1. Author Response:

      Reviewer #3 (Public Review):

      The paper contains a substantial amount of novel experimental work, the experiments appear well done, and the analysis of the data makes sense. Raw data and analysis scripts have been made fully available.

      I have two specific comments:

      • While the paper talks extensively about deep mutational scanning, I don't think this is a deep mutational scanning study. In deep mutational scanning, we usually make every possible single-point mutation in a protein. This is not what was done here, as far as I can tell.

      In the revised manuscript, we have avoided using deep mutational scanning to describe our experimental design. Instead, we described our approach as “a high-throughput experimental approach that coupled combinatorial mutagenesis and next-generation sequencing”

      • For the analysis of epistasis vs distance (Fig 4d, e, f), it would be better to look at side-chain distances rather than C_alpha distances. In covariation analyses, it can be seen that C_alpha distances are not a good predictor of pairwise interactions. Similar patterns may be observable here.

      See e.g.: A. J. Hockenberry, C. O. Wilke (2019). Evolutionary couplings detect side-chain interactions. PeerJ 7:e7280.

      Thank you for the suggestion. In the revised manuscript, we replaced the Cα analysis by a side-chain analysis according to Hockenberry and Wilke (see response to Essential Revisions above).

  3. wt3fall2021.commons.gc.cuny.edu wt3fall2021.commons.gc.cuny.edu
    1. And then we go right in after you see after that montage then you see it's Sideshow Bob in court

      This kind of dialogue between friends discussing something they all love is relatable. However, I find it quite odd that they can recount detail by detail, montage by montage, as if they have each watched it more than a thousand times. Its not naturalistic at times and forces me to think they may have been restricted from such entertainments in their futuristic world. Why are they discussing the Simpsons in such great detail? Is this to feed the audience with information that will be later relevant in Act 3 (As they are noted to wear Simpson costumes) Hmmm we will see

    1. The diversity of human values and the methods by means of which they may be realized is so vast, and many of them remain so unacknowledged, that they cannot fail but lead to conflicts in human relations.  Indeed, to say that human relations at all levels -- from mother to child, through husband and wife, to nation and nation -- are fraught with stress, strain, and disharmony is, once again, making the obvious explicit.  Yet, what may be obvious may be also poorly understood. This I think is the case here.  For it seems to me that -- at least in our scientific theories of behavior -- we have failed to accept the simple fact that human relations are inherently fraught with difficulties and that to make them even relatively harmonious requires much patience and hard work. I submit that the idea of mental illness is now being put to work to obscure certain difficulties which at present may be inherent -- not that they need be unmodifiable -- in the social intercourse of persons.  If this is true, the concept functions as a disguise; for instead of calling attention to conflicting human needs, aspirations, and values, the notion of mental illness provides an amoral and impersonal "thing" (an "illness") as an explanation for problems in living (Szasz, 1959).  We may recall in this connection that not so long ago it was devils and witches who were held responsible for men's problems in social living.  The belief in mental illness, as something other than man's trouble in getting along with his fellow man, is the proper heir to the belief in demonology and witchcraft. Mental illness exists or is "real" in exactly the same sense in which witches existed or were "real."  

      This section sets the tone for ensuring that we do not disguise what would be a normal problem with day to day efforts in society as a mental illness. This is hugely impactful on modern society and is key again in treatment. Professionals must be able to decipher the reality of mental illness from daily life struggles. To be fair, any truly trained psychologist or psychiatrist should be able to do this given they have the proper training and credentials. This however is something that must be at the forefront of a professionals mind.

    2. To recapitulate: In actual contemporary social usage, the finding of a mental illness is made by establishing a deviance in behavior from certain psychosocial, ethical, or legal norms.  The judgment may be made, as in medicine, by the patient, the physician (psychiatrist), or others.  Remedial action, finally, tends to be sought in a therapeutic -- or covertly medical -- framework, thus creating a situation in which psychosocial, ethical, and/or legal deviations are claimed to be correctible by (so-called) medical action.   Since medical action is designed to correct only medical deviations, it seems logically absurd to expect that it will help solve problems whose very existence had been defined and established on nonmedical grounds.  I think that these considerations may be fruitfully applied to the present use of tranquilizers and, more generally, to what might be expected of drugs of whatever type in regard to the amelioration or solution of problems in human living.  

      If we are to advance we must question who is making the standards which is something that is being questioned here by the author. The problem that the author is showing is the definitions of illness along with health regarding someone's mental state. This is also showing a disdain for the idea of medicating someone on grounds that are not established within physicality. This methodology is rather skewed in accordance to modern testing and understanding but serves as a stellar check and balance to those who intend to practice now.

    3. "Mental illnesses" are thus regarded as basically no different than all other diseases (that is, of the body).  The only difference, in this view, between mental and bodily diseases is that the former, affecting the brain, manifest themselves by means of mental symptoms; whereas the latter, affecting other organ systems (for example, the skin, liver, etc.), manifest themselves by means of symptoms referable to those parts of the body.  This view rests on and expresses what are, in my opinion, two fundamental errors. In the first place, what central nervous system symptoms would correspond to a skin eruption or a fracture?  It would not be some emotion or complex bit of behavior. Rather, it would be blindness or a paralysis of some part of the body. The crux of the matter is that a disease of the brain, analogous to a disease of the skin or bone, is a neurological defect, and not a problem in living. For example, a defect in a person's visual field may be satisfactorily explained by correlating it with certain definite lesions in the nervous system.  On the other hand, a person's belief -- whether this be a belief in Christianity, in Communism, or in the idea that his internal organs are "rotting" and that his body is, in fact, already "dead" -- cannot be explained by a defect or disease of the nervous system.  Explanations of this sort of occurrence -- assuming that one is interested in the belief itself and does not regard it simply as a "symptom" or expression of something else that is more interesting -- must be sought along different lines. The second error in regarding complex psycho-social behavior, consisting of communications about ourselves and the world about us, as mere symptoms [p. 114] of neurological functioning is epistemological.  In other words, it is an error pertaining not to any mistakes in observation or reasoning, as such, but rather to the way in which we organize and express our knowledge. In the present case, the error lies in making a symmetrical dualism between mental and physical (or bodily) symptoms, a dualism which is merely a habit of speech and to which no known observations can be found to correspond. Let us see if this is so. In medical practice, when we speak of physical disturbances, we mean either signs (for example, a fever) or symptoms (for example, pain). We speak of mental symptoms, on the other hand, when we refer to a patient's communications about himself, others, and the world about him.  He might state that he is Napoleon or that he is being persecuted by the Communists. These would be considered mental symptoms only if the observer believed that the patient was not Napoleon or that he was not being persecuted[sic] by the Communists. This makes it apparent that the statement that "X is a mental symptom" involves rendering a judgment. The judgment entails, moreover, a covert comparison or matching of the patient's ideas, concepts, or beliefs with those of the observer and the society in which they live.  The notion of mental symptom is therefore inextricably tied to the social (including ethical) context in which it is made in much the same way as the notion of bodily symptom is tied to an anatomical and genetic context (Szasz, 1957a, 1957b). To sum up what has been said thus far: I have tried to show that for those who regard mental symptoms as signs of brain disease, the concept of mental illness is unnecessary and misleading.  For what they mean is that people so labeled suffer from diseases of the brain; and, if that is what they mean, it would seem better for the sake of clarity to say that and not something else.

      This component of the passage hold great value via the idea of not having any physical implications that can be reversed to the naked eye. While flawed as mindset, this is something that we must regularly keep in mind as psychologist when attempting to treat patients. When looking into the mind and the effects that we have on society, we must think of how we are going to better the interactions with those around us. Many members of society that suffer from mental illness are in fact almost incapable due to chemical imbalance. This is something that is in fact falsifiable due to testing and treatment results (Parekh, 2018). This is still a great thought process to keep in mind especially for the year it was released.

      Reference, Parekh, R. (2018, August). What Is Mental Illness? What is mental illness? Retrieved November 28, 2021, from https://www.psychiatry.org/patients-families/what-is-mental-illness.

    1. we have a very 00:38:26 unwieldy process of more than close to 200 countries with very stark differences sometimes and very different starting points so i think all of this doesn't really 00:38:39 make a good sort of negotiation process and if we if we go to the next cup my sense is that the process is extremely slow and we are 00:38:50 more or less at say setting ourselves up for failure but also you know we are going to one cup after another we with a great sense of a predictability of something that we know it's not going 00:39:03 to work at the pace at which it needs to work

      countries negotiating may not be as effective as working at the individual / civil society level to appeal to the wealthy demographics, who are responsible for the lions share of emissions.

    1. Reviewer #1 (Public Review):

      Todesco et al. investigate the genetic causes of variation in UV pigmentation in sunflowers as well as the possible biotic and abiotic factors that play a role in natural variation for the trait among populations. Overall I am very enthusiastic about this manuscript as it does an elegant job of going from phenotype to a key locus and then presenting a solid foray into the factors causing variation. I have only a fe relatively minor comments.

      The introduction felt a bit short. I was hoping early on I think for a hint at what biotic and abiotic factors UV could be important for and how this might be important for adaptation. A bit more on previous work on the genetics of UV pigmentation could be added too. I think a bit more on sunflowers more generally (what petiolaris is, where natural pops are distributed, etc.) would be helpful. This seems more relevant than its status as an emoji, for example.

      The authors present the % of Vp explained by the Chr15 SNP. Perhaps I missed it, but it might be nice to also present the narrow sense heritability and how much of Va is explained.

      A few lines of discussion about why the Chr15 allele might be observed at only low frequencies in petiolaris I think would be of interest - the authors appear to argue that the same abiotic factors may be at play in petiolaris, so why don't we see this allele at frequencies higher than 2%? Is it recent? Geographically localized?

      Page 14: It's unclear to me why there is any need to discretize the LUVp values for the analyses presented here. Seems like it makes sense to either 1) analyze by genotype of plant at the Chr15 SNP, if known, or 2) treat it as a continuous variable and analyze accordingly.

      Page 14: I'm not sure you can infer selection from the % of plants grown in the experiment unless the experiment was a true random sample from a larger metapopulation that is homogenous for pollinator preference. In addition, I thought one of the Ashman papers had actually argued for intermediate level UV abundance in the presence of UV?

      I would reduce or remove the text around L316-321. If there's good a priori reason to believe flower heat isn't a big deal (L. 323) and the experimental data back that up, why add 5 lines talking up the hypothesis?

      Page 17: The discussion of flower size is interesting. Is there any phenotypic or genetic correlation between LUVP and flower size?

    1. Author Response:

      Reviewer #1:

      Summary:

      Moody et al. presented a comprehensive investigation into the choice of marker genes and its impact on the reconstruction of the early evolution of life, especially regarding the length of the branch that separates domains Bacteria and Archaea in the phylogenetic tree. Specifically, this work attempts to resolve a debate raised by a previous work: Zhu et al. Nat Commun. 2019, that the evolutionary distance between the two domains is short as estimated using an expanded set of marker genes, in contrast to conventional strategies which involve a small number of "core" genes and indicate a long branch.

      Through a series of analyses on 1000 genomes, Moody et al. defended the use of core genes, and reinforced the conventional notion that the inter-domain branch (the AB branch) is long, as inferred by the core gene set. They proposed that with the 381 marker genes (the "expanded" set) used by Zhu et al., the observed short branch length is an artifact due to inter-domain gene transfer and hidden paralogy. Through topology tests, they ranked the markers by "verticality", and showed that it is positively correlated with the AB branch length. They also conducted divergence time estimation and showed that even the most vertical genes led to an implausible estimate of the origin of life.

      In parallel, Moody et al. surveyed the best marker genes using a set of 700 genomes. They recovered 54 markers, and demonstrated that ribosomal markers do not indicate a longer AB branch than non-ribosomal markers do. With the better half (27) of these marker genes, they conducted further phylogenetic analyses, which shows that potential substitutional saturation and the use of site-homogeneous models could contribute to the underestimation of the AB branch. Using this taxon set and marker set, they reconstructed the prokaryotic tree of life, which revealed a long AB branch, a basal placement of DPANN in Archaea, and a derived placement of CPR in Bacteria.

      Prokaryotic tree of life:

      The scope(s) of the manuscript is somehow split. First, it is posed as a point-to-point rebuttal to the Zhu et al. paper, on the long vs. short AB branch question. Second, it introduces a new phylogeny of prokaryotes using 27 "good" marker genes, and demonstrates that DPANN is basal to Archaea, and CRP is derived within Bacteria.

      Thanks for the summary. The two aspects of the manuscript identified by the reviewer are closely related, because the different issues boil down to the same underlying question: which genes should we use to infer the deep structure of the tree of life? The provocative work of Zhu et al. acted as an impetus to compare and evaluate the properties of several published marker gene sets, and then to identify (what our analyses suggest are) the subset best-suited for deep phylogeny, which we then use to infer an updated tree of life. We have clarified this logical structure in the revised manuscript, writing (at the end of the Introduction):

      “Here, we investigate these issues in order to determine how different methodologies and marker sets affect estimates of the evolutionary distance between Archaea and Bacteria. First, we examine the evolutionary history of the 381 gene marker set (hereafter, the expanded marker gene set) and identify several features of these genes, including instances of inter-domain gene transfers and mixed paralogy, that may contribute to the inference of a shorter AB branch length in concatenation analyses. Then, we re-evaluate the marker gene sets used in a range of previous analyses to determine how these and other factors, including substitutional saturation and model fit, contribute to inter-domain branch length estimations and the shape of the universal tree. Finally, we identify a subset of marker genes least affected by these issues, and use these to estimate an updated tree of the primary domains of life and the length of the stem branch that separates Archaea and Bacteria.”

      The second scope has inadequate novelty. A recent paper (Coleman et al. Science. 2021), which was from a partially overlapping group of authors, was dedicated to the topic of CPR placement, and indicated the same conclusion (CPR being derived and sister to Chloroflexi) as the current work does, albeit using more sophisticated approaches. The paper also addressed the debate of CPR placement (including citing the Zhu et al. paper). Additionally, the basal placement of DPANN has also been suggested by previous works (such as Castelle and Banfield. Cell. 2018). Therefore, re-addressing these two topics using a largely well-established and repeatedly adopted method on a relatively small taxon set does not constitute a significant extension of current knowledge.

      We disagree. Resolving the deep structure of the tree of life is an important topic --- this is what we, Zhu et al. (2019), and of course many others have been trying to achieve, in different and sometimes conflicting ways. Most of the published work is based on limited or biased taxon sampling (see Figure 1 Figure Supplement 14,15,16) or else focused on just one of the two prokaryotic domains of life. Furthermore, deep phylogeny is uncertain, and new results become convincing only when they receive support from multiple datasets and approaches. For instance, Coleman et al. (2021) recently found support for the placement of CPR as a sister clade to Chloroflexota rather than as a basal branch within the Bacteria. Notably, this work focused only on Bacteria, and made use of a different rooting method (with its own strengths and limitations) and taxon sampling. Most previous analyses using Archaea as an outgroup to root the bacterial tree recovered CPR as a deeply branching lineage within Bacteria, a placement likely resulting from LBA. In turn, our present findings represent an important confirmation of the CPR+Chloroflexi clade. Similarly, the basal placement of DPANN within Archaea remains controversial despite a number of studies on the topic, and our study also contributes to that ongoing debate.

      The debate:

      The first scope appears to be the more important goal of this manuscript, as it extensively discusses the claims made by Zhu et al. and presents a point-to-point rebuttal, including counter evidence. This may narrow the interest of this work to a small audience of specialists. Nevertheless, to best evaluate the current work, it is necessary to review the Zhu et al. paper and compare individual analyses and conclusions of the two studies.

      In doing so, I found that the two articles have distinct scopes that appear similar but not actually inline. To a large extent, the current work does not constitute actual rebuttal to the points made by Zhu et al. In contrast, some of the analyses presented in the current work support those by Zhu et al., despite being interpreted in a different way. For the claims that directly contest Zhu et al., I do not see sufficient evidence that they are supported by the analyses.

      Below is a summary of the comparison, which I will explain point-by-point in later paragraphs.

      • Moody et al. assessed AB branch length, while Zhu et al. assessed AB evolutionary distance (which is different).
      • Moody et al. evaluated the phylogeny indicated by a small number of core markers, while Zhu et al. evaluated the genome average using hundreds of global markers.
      • Zhu et al.'s results also showed that gene non-verticality, substitutional saturation, and site-homogeneous models shorten the AB distance, which is consistent with Moody et al.'s.
      • However, Zhu et al. found that some core markers are outliers in the genome-wide context, and the long AB distance indicated by them cannot be compensated for by the aforementioned effects. Moody et al. hasn't addressed this. Therefore, the novelty and potential impact of the current work is less compelling: It used a classical method (a few dozen core genes) and found a pattern that has been found many times by some of the same authors and others (including Zhu et al., who also analyzed core genes).

      Thanks for this detailed comparison of the two studies --- the points raised here and elaborated on below have prompted us to perform additional analyses which provide further insight into the properties and behaviour of the various marker gene sets analyzed. We nonetheless disagree that “the current work does not constitute actual rebuttal to the points made by Zhu et al.”: our finding that ribosomal and other “core” proteins are among the best phylogenetic markers for resolving both within- and between-domain relationships, estimating the length of the AB stem, and performing divergence time estimation, challenges an important claim of Zhu et al.’s study, and will be of broad interest to the community of researchers working on early life/early evolution.

      That said, we do also agree that one aspect of the disagreement between our study and that of Zhu et al. has to do with what is meant by evolutionary distance, and we have now discussed these issues in detail in the revised manuscript (as detailed below). In revising the manuscript, we have also sought to avoid a reductive focus on rebuttal, have revised the text to acknowledge important strengths and interesting features of the Zhu et al. analyses, and have made text revisions to ensure a consistent constructive tone: these are fundamental and challenging questions, and different perspectives and analyses are valuable in making progress. We also note that there has been an ongoing debate about the suitability of ribosomal genes for deep phylogeny in the literature (e.g. Petitjean et al. 2014, discussed in more detail below). Our analyses, and those of Zhu et al. (2019) previously, contribute to that broader discussion.

      Detailed responses to each of the above points follow below.

      AB distance metric:

      There is a subtle but critical difference between the scopes of the two papers: The Zhu et al. paper "reveals evolutionary proximity between domains Bacteria and Archaea". By stating "evolutionary proximity", it investigated two metrics: The length of the branch separating Archaea from Bacteria in the phylogenetic tree, i.e., the "AB branch". This was the main focus of the current work.

      The average tip-to-tip distance (sum of branch lengths) between pairs of Archaea and Bacteria taxa in the tree. A significant proportion of the Zhu et al. work was discussing this metric, and it led to several important conclusions (e.g., Figs. 4F, 5). The current work has not explored this metric.

      Thanks for raising the point about relative AB distance. In our revised manuscript, we have expanded Figure 1 and the associated analyses to include this metric. These analyses demonstrate that relative AB distance behaves similarly to AB branch length: they are positively correlated with each other; both are reduced by inter-domain HGT, and both are negatively correlated with ΔLL and with split score, an additional metric of within- and between-domain marker gene verticality which we have included in the revised Figure 1. Taken together, these results suggest that high-verticality marker genes (as judged both by the recovery of reciprocal AB monophyly, and of established within-domain relationships) support a longer AB branch and show a higher relative AB distance.

      These two metrics implicate distinct research strategies: For 1), HGTs and paralogy are usually considered problematic (as the current and many previous works argued). However, 2) is naturally compatible with the presence (and prevalence) of HGTs and paralogy.

      Authors of the current work equate "genetic distance" to "branch length" (line 70), and only investigated the latter. This equation is misleading. If organism groups A and B diverged early, but then exchanged many genes post-divergence, then this is indisputable evidence that their "genetic distance" is close. This point needs to be clearly explained in the manuscript.

      We agree with the reviewer that various definitions of evolutionary distance are possible, and some may be more useful than others for particular applications. The reviewer’s argument that “If organism groups A and B diverged early, but then exchanged many genes post-divergence, then this is indisputable evidence that their "genetic distance" is close” makes the case for a kind of phenetic distance: a distance based on overall similarity, regardless of how that similarity was brought about in terms of evolutionary process. We appreciate the democratic appeal of such a metric, and we have no desire to impose any particular philosophy of classification on the reader. However, the key point here is that methods that rely on concatenation for branch length or divergence time estimation (as used by Zhu et al., and in our current study) make the assumption that all of the sites in the concatenate evolved on the same underlying tree and if this assumption is not met, analyses can be misled. Thus, the shorter AB branch length and the more recent Archaea-Bacteria divergence times estimated from concatenations of incongruent marker genes result from unmodelled gene transfers which are misinterpreted as evidence for more recent common ancestry. Gene transfer is an important aspect of genome evolution, but none of the currently available methods, including those used by Zhu et. al., allow for genome-scale comparisons to be made in a way that accounts for our understanding of the underlying evolutionary processes.

      The point about different possible definitions of evolutionary distance made by the reviewer is valid, and we have now revised the opening of our conclusion to discuss these issues in more detail, writing:

      “We note that alternative conceptions of evolutionary distance are possible; for example, in a phenetic sense of overall genome similarity, extensive HGT will increase the evolutionary proximity (Zhu et al., 2019) of the domains so that Archaea and Bacteria may become intermixed at the single gene level. While such data can encode an important evolutionary signal, it is not amenable to concatenation analysis.”

      Core vs genome:

      This difference between "AB distance" and "AB branch length" is relevant to a more fundamental question: What defines the "evolutionary distance" between two groups of organisms? Both papers did not explicitly discuss this topic. It likely cannot be resolved in one article (as many scholars have continuously attempted on related topics in the past decades). But the discordance in understanding led to very different research strategies in the two papers, and rendering them incongruent in methodology.

      Specifically, the current work (and multiple previous works) based phylogenetic inference on only genes that demonstrate a strong pattern of vertical evolution. HGTs were considered deleterious, and needed to be excluded from the analysis. This left a few dozen genes at most, and many are spatially syntenic and functionally related (e.g. ribosomal proteins). In this work, the final number is 27. Previous critiques of this methodology have suggested that this is not a tree of life, but a "tree of one percent" (Dagan and Martin, Genome Biol. 2006).

      In contrast, Zhu et al. (and related previous works) attempted to evaluate the evolution of whole genomes by "maximizing the included number of loci.". They used a "global" set of 381 genes. They faced the challenge of "reconciling discordant evolutionary histories among different parts of the genome", because "HGT is widespread across the domains". To resolve this, they adopted the gene tree summary method ASTRAL.

      Therefore, the "AB distance" estimated by Zhu et al. is a genome-level distance, calculated by merging conflicting gene evolutions (which itself can be disputed, see below). Whereas the "AB branch" evaluated in this work is strictly the branch length in the core gene evolution. Therefore, the results presented in the two papers do not necessarily conflict, because of the different scopes.

      This point is closely related to the previous one, and the new section (final paragraphs of the Conclusion, quoted directly above) goes some way to addressing this comment. Regarding the issue of a focus on just a small proportion of vertically-evolving genes, the critical point is as above: current methods for branch length and divergence time estimation (including those used by Zhu et al.) require such vertically-evolving genes, because they make the assumption that all of the sites evolve on the same tree, i.e. trace back to the same origin via vertical evolution. We agree that most prokaryotic gene families do not evolve under these restrictive assumptions and therefore cannot be analysed using concatenation methods for branch length estimation. Indeed, one of the main points of our study is that most of the genes in the 381-gene set of Zhu et al. do not meet these assumptions and are thus unsuited for estimating evolutionary distance and divergence times.

      There is much ongoing method development which will allow more of the genome to be used in deep-time comparative analyses; Astral-Pro, FastMulRFS and SpeciesRax, among others, are recent promising steps in this direction. However, our central critique of Zhu et al. is that inferences under concatenation-based methods can be misled by HGT and other sources of incongruence, and indeed our analyses show that these unmodelled signals underlie the difference between the conclusions of Zhu et al. and other studies (e.g. (Liu et al., 2021; Spang et al., 2015; Williams et al., 2020) that have instead supported a deep divergence between Archaea and Bacteria. In our revised manuscript, we have shown that the relative AB distance, like the AB branch length, is shortened by unmodelled gene transfers (Figure 1), and that estimates of the AB stem length from different studies are similar when the congruent subset of the data is analysed with the best available substitution models (Figure 6). We therefore disagree that the scopes are distinct: richer, broader measures of genomic diversity can be proposed and, with the development of new methods, estimated; but so far, the vertical signal is the only signal that can be harnessed to infer divergence times using concatenations.

      The expanded marker set:

      The authors made a valid critique (line 121-135) that many of the 381 genes in the "expanded marker set" adopted by Zhu et al., are under-represented in Archaea. According to the PhyloPhlAn paper (Segata et al. Nat Commun. 2013) which originally developed the 400 markers (a superset of the 381 markers), these genes were selected from ~3,000 bacterial and archaeal genomes available in IMG at that time time (note that it was 2013). Zhu et al. also admitted, in the discussion section, that this marker set falls short in addressing some questions (such as the placement of DPANN). What is important in the current context, is that they were not specifically selected to address the AB distance question.

      We agree that the taxon sampling of archaea and the choice of marker genes in the Zhu et al. study were not ideal for estimating the evolutionary distance between the domains. However, we note that this distance (or proximity), and the hypothesis that traditional core genes over-estimate the Archaea-Bacteria divergence, was one of the main results of the paper (c.f. the title of that paper, “Phylogenomics of 10,575 genomes reveals evolutionary proximity between domains Bacteria and Archaea”).

      However, note that Zhu et al.'s Fig. 5A, B presented the AB distance informed by 161 out of the 381 genes. These genes have at least 50% taxa represented in both domains - the same threshold discussed in the current work (line 132).

      While the 50% sampling criterion indeed enriches for the genes of the expanded set that were present in LUCA and on the AB branch, we note that the 50% criterion represents a minimum of 4953 bacteria and 335 archaea; that is, it still reflects the unbalanced sampling of the dataset overall. For example, 30 of the genes had fewer than two archaeal homologues, and in 100 of the trees there were fewer than 50 archaea reflecting the large disparity in taxon sampling (Supplementary Information Table S1). The phylogenetic signal in these genes is discussed in more detail below. Looking at the subsampled versions of these 161 genes, we found the majority of these genes (123/161) to have no discernible AB branch length. The 38/161 genes which had an arguable AB branch length (but still with transfers/paralogs) possessed a range of AB lengths: 0.0814:5.26, with a mean AB length of 1.03 and a median of 0.635.

      Even with those sufficiently represented genes, they still found that ribosomal proteins and a few other core genes are "outliers" in the far end of the AB distance spectrum.

      The reviewer raises an interesting point about outliers with high relative AB distances, which gets to the heart of the debate about how best to estimate the evolutionary distance between Archaea and Bacteria. The new analyses of relative AB distance introduced in our revised manuscript (Figure 1) demonstrate that this metric is affected by HGT in a similar manner to AB branch length (that is, high-verticality marker genes have a greater relative AB distance (relative AB vs ΔLL: p = 0.0001051 & R = -0.2213292, relative AB vs between-domain split score: p = 2.572e-06 & R = -0.2667739). Thus, core genes can be viewed as “outliers” compared to other prokaryotic genes in the sense that they have experienced an unusually low amount of HGT. This high verticality makes them among the few prokaryotic gene families that can be analysed by concatenation methods, which make the assumption that all sites evolve on the same underlying tree topology.

      Domain monophyly in gene trees:

      The authors' efforts in manually checking the gene trees are appreciable (Table S1), considering the number and size of those trees. They found (line 147) "Archaea and Bacteria are recovered as reciprocally monophyletic groups in only 24 of the 381 published (Zhu et al., 2019) maximum likelihood (ML) gene trees of the expanded marker set."

      The domain monophyly check was valid, however the result could be misleading because any sporadical A/B mixture was considered evidence of non-monophyly for the entire gene tree. As the taxon sampling grows, the opportunity of observing any A/B mixture also increases. For example, in Puigbò et al. J. Biology. 2009, 56% (a much higher ratio) of nearly universal genes trees had perfect domain monophyly based on merely 100 taxa. This is because even the "perfect" marker genes (such as ribosomal proteins) are not completely free from HGTs (e.g., Creevey et al. Plos One. 2011), let alone the fact that there are many artifacts in the published reference genomes (Orakov et al. Genome Biol. 2021).

      Therefore, to have an objective assessment of this topic, it would be better to have a metric that allows some imperfection and reports an overall "degree" of separation (also see below).

      We agree that complementing the monophyly check with a more nuanced metric is useful. In our revised manuscript, we now also evaluate the split score (Dombrowski et al. (2020) Nat Commun) of each marker, which reflects the degree to which a gene recovers the monophyly of established taxonomic ranks (a higher score reflects the splitting of monophyletic groups into a number of smaller clades in the gene tree, and so the metric permits a degree of “imperfection”, as suggested; in addition, the metric is averaged over bootstrap replicates, so that lack of resolution or poorly-supported disagreements with the reference taxonomy do not disproportionately affect the score). This expanded analysis (Figure 1) indicates that both within- and between-domain split score and ΔLL are significantly positively correlated (R = 0.836679, p < 2.2✕10-16), and that phylogenetic markers that more strongly reject domain monophyly (higher delta-LL) also perform worse at recovering between-domain (and within-domain) relationships (higher split score) and support a shorter AB branch length.

      AB branch by gene: correlation and outliers

      Figure 1 is the single most important result in this work, because it argues that the short AB branch observed in Zhu et al. is an artifact due to "inter-domain gene transfer and hidden paralogy" (line 202). This argument is based on the observation that the indicated AB branch length is negatively correlated with "verticality" (measured by ΔLL and split score) of the gene.

      Our argument that the short AB branch results from inter-domain gene transfer and hidden paralogy is based on three main lines of evidence: (i) documentation of extensive transfers and intermixing of paralogues in the gene trees for the 381 gene set; (ii) the analyses in Figure 1, which demonstrate that verticality positively correlates with AB branch length and AB distance; (iii) the demonstration that the incremental addition of low-verticality markers to a concatenate results in a concomitant decrease in AB branch length.

      However, Zhu et al. also investigated the impact of verticality on AB distance, and they also found that they are negatively correlated (Fig. 5E). Therefore, the current result does not appear to deliver new information (as do multiple other analyses, see below).

      Zhu et al. indeed identified a weak positive relationship between gene verticality and AB distance. Our analyses go beyond that work by showing, using a variety of complementary metrics of verticality, that AB branch length and relative AB distance are strongly positively correlated with verticality (see Figure 1), and that the low verticality of the genes in the 381 gene set largely explains the difference in stem length inference between that dataset and earlier analyses (Figure 6). An additional factor not considered in the analyses of Zhu et al. was the question of whether a gene was present in LUCA, and so can provide information on the AB branch length. Our analyses (detailed below) suggest that the majority of genes (317) in the 381 gene set do not contain an unambiguous AB branch, and so do not contribute interpretable signal to estimates of the AB branch length.

      An important finding in Zhu et al., which is largely not discussed in the current work, is that a handful of "core" genes are outliers in the spectrum of AB distance, as compared to the majority of the genome (Fig. 5A). The AB distance indicated by these core genes is so long compared with the genome average that it cannot be compensated for by the impact of non-verticality, substitutional saturation, site-homogeneous model, etc (see below).

      Fig. 1A of the current work also clearly shows that many long-AB branch genes are outliers compared with the majority of the genome (the bottom of the blue bar).

      Figs. 3 and 4 attempted to show that ribosomal proteins are not outliers, but that analysis was based on a very small set of core genes, and the figures clearly show that there are outliers even in this small set (to be further discussed below).

      This comment re-iterates the reviewer’s earlier points about “core” genes as outliers compared to the majority of the genome. The key issue is that “most of the genome”, and a significant portion (317 genes) of the 381-gene set, contain features that make them unsuitable for estimation of AB branch length by concatenation, or indeed estimation of an interpretable relative AB distance. We have documented the cases of HGT and mixing of paralogues in the 381-gene dataset; this information is summarised in the main text and presented in more detail in Supplementary Information Table S1.

      Focusing on the 161 genes with >50% representation in both Archaea and Bacteria, manual inspection of gene trees inferred on the 1000-species subsample under the LG+G+F model indicate that 123/161 do not have a clear AB branch (that is, a branch that separates most or all Archaea from Bacteria). While distinguishing such cases from early gene transfers is not straightforward, there is no compelling reason to think that these genes were present in LUCA. The simplest explanation for these gene phylogenies is instead an origin within Bacteria and subsequent transfer on one or multiple occasions into Archaea. As a result, estimates of AB branch length or relative AB distance inferred from these genes cannot be straightforwardly compared to those of the traditional “core” or other genes for which the evidence of a pre-LUCA origin is stronger. Considering only the 38/161 genes for which a LUCA origin appears, from the gene phylogeny, to be likely, the mean AB branch length is 1.03, greater than that estimated from the concatenation of the most vertical genes in the expanded set (0.56), and suggesting that phylogenetic incongruence, combined with (for some families) a more recent origin explains the shorter AB distances inferred from the 381 gene set. Thus, it is not the case that the AB branch lengths (or relative distances) estimated from the majority of genes form a null distribution” against which “core” genes can be seen as outliers; instead, our analyses suggest that “core” genes are among the limited number of genes that trace vertically to LUCA.

      Regarding Figures 3 and 4, see the more detailed discussion below.

      Verticality is not causative of short AB branch:

      In spite of the outlier question, there is an important logic problem in these analyses: The authors observed that gene verticality (measured by negative ΔLL) is correlated with AB branch length (Fig. 1), and concluded that HGTs and paralogy shortened the AB branch (line 202). However, they did not directly assess the rate of evolution in this model. It is totally possible that the most vertical genes happen to be those that evolved faster at the AB split. In order to support the claim made in this work, it is important to separate the effect of the rate of evolution from the effect of HGT / paralogy.

      The ideal solution would be to include ALL genes (not just "good" ones), build gene trees, identify parts of the gene trees that once experienced HGT or paralogy, and prune off these PARTS, instead of excluding the entire gene tree. The remaining data are thus free of HGT / paralogy, based on which one can quantify the "true" AB branch length, and further assess how much it is correlated with "verticality", and whether there are still "outliers". This solution is likely not trivial in implementation, though. However, without such assessment, the observed short AB branch still only applies to the "tree of one percent", not the "tree of life".

      Thanks for this comment --- the reviewer raises a subtle and valid point. Our analyses indicate that vertically-evolving genes have longer AB branch lengths, but in the first version of our manuscript we did not test the alternative hypothesis that this relationship might simply result from a faster rate of evolution in vertically-evolving genes. To evaluate the relationship between evolutionary rate, verticality, AB branch length and relative AB distance on as broad a set of genes as possible, we took the 302 genes from the 381-gene expanded set, excluding 56 genes for which the 1000-species subsample included no archaea, and another 23 which included only 1 archaeon. To estimate per-gene evolutionary rate, we rooted each gene tree using MAD (Tria et al. 2017) and calculated the mean root- to-tip distance on the MAD-rooted gene tree, then evaluated the relationship between rate and verticality. This analysis indicated that vertically-evolving genes evolve more slowly (have shorter mean root-to-tip distances) than less vertical genes (using deltaLL and between-domain split score as proxies for marker verticality, with a Pearson’s product- moment correlation: MAD rooted mean root-to-tip distance against deltaLL: R = 0.1397803, p = 0.01506 or against split score: R = 0.1902056 p = 0.000893), despite having longer AB branches and relative AB distances (using a Pearson’s product moment correlation of MAD rooted mean root-to-tip distance against AB length: p = 0.2025, R= 0.1143076, or against relative AB distance p = 0.007435, R=0.1537479). Thus, the longer AB branches of vertically evolving genes do not appear to be the indirect result of faster evolution of those genes. These analyses are reported in the main text, where we write:

      An alternative explanation for the positive relationship between marker gene verticality and AB branch length could be that vertically-evolving genes experience higher rates of sequence evolution. For a set of genes that originate at the same point on the species tree, the mean root-to-tip distance (measured in substitutions per site, for gene trees rooted using the MAD method (Tria et al., 2017)) provides a proxy of evolutionary rate. Mean root-to-tip distances were significantly positively correlated with ∆LL and between-domain split score (∆LL: R = 0.1397803, p = 0.01506, split score: R = 0.1705415 p = 0.002947; Figure 1 Figure Supplement 5,6, indicating that vertically-evolving genes evolve relatively slowly (note that large values of ∆LL and split score denote low verticality)). Thus, the longer AB branches of vertically-evolving genes do not appear to result from a faster evolutionary rate for these genes. Taken together, these results indicate that the inclusion of genes that do not support the reciprocal monophyly of Archaea and Bacteria, or their constituent taxonomic ranks, in the universal concatenate explain the reduced estimated AB branch length.

      Differential metric for verticality:

      In spite of the similarity between the current result and Zhu et al.'s (see above), the two works approached this goal using different metrics.

      First, the authors attempted to quantify the AB branch length in individual gene trees, including those that do not have Archaea and Bacteria perfectly separated. To do so they performed a constrained ML search (line 210). I am wary of this treatment because it could force distinct sequences (due to HGT or paralogy) to be grouped together, and the resulting branch length estimates could be highly inaccurate.

      We agree with the reviewer that estimating AB branch lengths in this way might lead to inaccuracy. We note that this is, in effect, what was done in the published analysis (Zhu et al. 2019): a topology in which Archaea and Bacteria were reciprocally monophyletic was inferred using ASTRAL (a reasonable analysis, given the robustness of ASTRAL to some degree of HGT/gene tree incongruence), and then the AB branch length was estimated from the concatenation of these 381 genes, fixing on the ASTRAL topology. We performed this experiment (inferring AB branch length on constrained trees) in order to evaluate how incongruence between the gene and species trees might affect AB branch length inference.

      In contrast, Zhu et al. quantifies the average taxon-to-taxon phylogenetic distance between the two domains, regardless of the overall domain monophyly. That method was free of this concern, although it computed a different metric.

      Thanks for raising this point. As described above, in the revised manuscript we have also evaluated the relative AB distance metric used by Zhu et al., and show that it behaves similarly to the AB branch metric we evaluated in the first version of the manuscript (see revised Figure 1).

      Second, the authors assessed "marker gene verticality" using two metrics: a) AU test result (rejected or not) (Fig. 1A), c) ΔLL, the difference in log likelihood between the constrained ML tree and ML gene tree (line 222, Fig. 1B, C). I am concerned that they are sensitive to taxon sampling and stochastic events, as I explained above regarding domain monophyly. It is possible that a single mislabeling event would cause the topology test to report a significant result. In addition, they evaluate how severely domain monophyly is violated, but they do not account for intra-domain HGTs and other artifacts, which are also part of "verticality", and they can potentially distort the AB branch as well.

      In the revised manuscript, we also evaluate a complementary metric for marker gene verticality, the split score (see above), which measures the extent to which marker genes recover established relationships at a given taxonomic level (we computed both within-domain and between-domain split scores). The split score is a more granular measure than ΔLL and, by summing over bootstrap replicates, it also better accommodates phylogenetic uncertainty. The two metrics (ΔLL and split score) are positively correlated and the analyses come to the same conclusions regarding the impact of HGT and other sources of incongruence on estimates of the AB branch length and relative AB distance.

      I did not find the ΔLL values of individual markers in any supplementary table. I also did not find any correlation statistics associated with Fig. 1B.

      The ΔLL values for individual markers can be found in the data supplement in: “Expanded_Bacterial_Core_Nonribosomal_analyses/Individual_gene_tree_analyses/Expanded//Expanded_AB_AU.csv”

      We have now updated the readme.txt file for clarity and included all the new results from the analyses which we have undertaken as part of the review process in the latest version of the supplemental available on figshare (10.6084/m9.figshare.13395470) as well as updated the directory and file names for clarity. We also have added the statistics associated with the correlations in Figure 1 to the Figure Legend.

      Statistical test:

      Line 157: "For the remaining 302 genes, domain monophyly was rejected (p < 0.05) for 232 out of 302 (76.8%) genes." Did the authors perform multiple hypothesis correction? If not, they probably should.

      Thanks for this suggestion. We have now used a Bonferonni correction to account for multiple testing. As a result, fewer marker genes are rejected at the 5% level (151/302), although the overall conclusions are unaffected.

      Line 217: "This result suggests that inter-domain gene transfers reduce the AB branch length when included in a concatenation." and Fig. 1A. If I understand correctly, this analysis was performed on individual gene trees, rather than in a concatenated setting. Therefore, the result does not directly support this conclusion.

      Thanks for pointing this out. The reviewer is correct that this inference depends not only on the single gene analyses, but also on the subsequent concatenation results presented in this section. We have therefore moved this sentence later in the section, after the concatenation analysis.

      Line 224: "Furthermore, AB branch length decreased as increasing numbers of low-verticality markers were added to the concatenate (Figure 1(c))". While this statement is likely true, Zhu et al. also presented similar results (Fig. 5) despite using a different metric, and they concluded that the impact is moderate and cannot explain the status of some core genes as outliers.

      Zhu et al. did identify some of these trends, as we acknowledge in our manuscript ("The original study investigated and acknowledged (Zhu et al., 2019) the varying levels of congruence between the marker phylogenies and the species tree, but did not investigate the underlying causes.“ --- line 178; “These results are consistent with (Zhu et al., 2019), who also noted that AB branch length increases as model fit improves for the expanded marker dataset.” --- line 337) and as discussed above. Our analysis (Figure 6, Table 1) goes further in showing that the most vertical subset of the 381-gene set supports an inter-domain branch length closely similar (2.4 subs/site compared to e.g. 2.5 subs./site for the 27-gene dataset) to analyses using the traditional marker gene set.

      Concatenation and branch length:

      The authors pointed out that "Concatenation is based on the assumption that all of the genes in the supermatrix evolve on the same underlying tree; genes with different gene tree topologies violate this assumption and should not be concatenated because the topological differences among sites are not modelled, and so the impact on inferred branch lengths is difficult to predict." (line 187).

      This argument is valid. In my opinion, this is the one most important potential issue of Zhu et al.'s analysis. In that work, they inferred genome tree topology through ASTRAL, which resolves conflicting gene evolutions. However ASTRAL does not report branch lengths in the unit of number of mutations. Therefore, they plugged the concatenated alignment into this topology for branch length estimation, hoping that it will "average out" the result. That workaround was apparently not ideal.

      Yes, we agree --- this is our main critique of the Zhu et al. analyses.

      However, the practice of molecular phylogenetics is complicated. Theoretically, every gene, domain, codon position and site may have its unique evolutionary process, and there have been efforts to develop better partition and mixture models to address these possibilities. But there is a trade off; these technologies are computationally demanding and have the risk of overfitting. It is plausible that in some scenarios, the gain of concatenating many loci (despite conflicting phylogeny) may outweigh the cost of having unpredictable effects.

      But this dilemma needs to be analyzed rather than just being discussed. The Zhu et al. paper did not assess the impact of such concatenation on branch length estimation. The best answer is to conduct an analysis to show that concatenating genes with conflicting phylogeny would result in an AB branch that is shorter than the mean of those genes, and the reduction of AB branch length is correlated with the amount of conflict involved. The current work has not done this.

      Thanks for raising this point. We agree that phylogenetics is complicated and that

      we lack methods that can account for all possible factors. With respect to the impact of gene transfers on the AB branch length, and as touched on above, there are two issues here.

      The first is with the analysis actually performed by Zhu et al: of the 381 extended set genes, 79 have one or no archaea in the 1000-taxon subsample, and a further 176 have an AB branch length close to 0 (<0.00001) in the constrained analyses. To investigate further, we manually inspected ML gene trees for the 381 genes (1000 taxon subsample). Allowing for recent gene transfer, we nevertheless identified only 64 genes with an unambiguous branch separating most Archaea from most Bacteria that might correspond to the ancestral AB divergence (Supplementary File 1).

      Taken together, these analyses suggest that there is no strong evidence that these genes were present in LUCA or evolved along the AB branch, and so they do not provide information on its length. Since the branch length in the concatenation is an average over the branch length per site, the inclusion of this set of genes in the analysis did reduce the AB branch length, as demonstrated by our analyses (Figure 1(H)).

      The second issue is: for genes which were likely present in LUCA and evolved on the AB branch, does gene transfer cause a reduction in the AB branch length inferred from their concatenation? To test this, we initially tested iterative concatenations of increasing numbers of non-vertical markers (Figure 1H), as well as a comparison of the most vertical genes to the whole expanded marker set (Figure 3 Figure Supplement 2). This revealed that as more markers were added (with lower verticality), the inferred AB branch length from the concatenate was reduced. We also found an increased AB branch length when only the 20 most vertical markers were used as opposed to the whole (381 marker) dataset (0.56 vs 0.16 substitutions/site, Figure 6).

      The reviewer proposes an additional test of the impact of marker gene incongruence on branch length inference from concatenations: to compare the AB branch length before and after pruning of HGTs from individual marker gene alignments. To do this, we took the 54 marker genes from our new dataset and concatenated them before and after pruning of unambiguous HGTs. The AB branch length inferred from the concatenation with HGTs removed was 1.946 substitutions/site, compared to 1.734 substitutions/site without pruning HGTs, demonstrating the impact of even a relatively small number of HGTs on branch length estimation from concatenates.

      Divergence time estimation:

      The manuscript dedicates one section (line 230-266) to argue that the divergence time estimation analysis performed by Zhu et al. was not good evidence for marker gene suitability. Zhu et al. showed congruence of the expanded marker set with geological records whereas ribosomal proteins were conflicting with the geologic record.To support their argument, the authors estimated divergence times using the top 20 most "vertical" genes measured by ΔLL.

      It would be good to clarify which genes they are, and it would be important to check whether they include some of the most "AB-distant" ones found by Zhu et al. Their Fig. 5A shows that there are genes that divide the two domains several folds further than the ribosomal proteins (such as rpoC). If they are among the 20 genes, it will not be surprising that the estimated AB split is older than it should be.

      We now include the annotations for these 20 genes in Supplementary File 5a. The 20 most vertical genes include two of the “AB-distant” outliers identified by Zhu et al., tuf and infB, and one ribosomal marker, rpsG.

      Overall, I think this section is logically questionable. Zhu et al. suggested that "They show the limitation of using core genes alone to model the evolution of the entire genome, and highlight the value in using a more diverse marker gene set.". The current work showed that using another set of a few genes (I do not know if they include multiple "core" genes, as discussed above, but it is plausible) also did not work well. This does not refute Zhu et al.'s claim.

      What's important in Zhu et al.'s analysis is this: they demonstrated that using a small set of genes in DTE may cause artifacts due to them significantly violating the molecular clock at certain stages of evolution. Instead, using a larger set of markers that represent a portion of the entire genome would help to "smooth out" these artifacts. This of course is not the ideal solution, likely because concatenating conflicting genes and modelling them uniformly is not the best idea (see above). But as an operational workaround, it was not challenged by the analysis in the current work.

      Finally, I agree with the authors' statement that more and reliable calibrations are the best way to improve divergence time estimation.

      The dating analyses presented in the first version of our manuscript demonstrated that the apparent agreement between molecular clock estimates using the 381-gene set and the fossil record was the result of artifactual shortening of the AB branch, as discussed in detail above. Once the subset of the data least affected by these issues (that is, the most vertical subset) was used, the limitations of current clock methods, particularly with few calibrations, for dating deep nodes became clear.

      That said, we agree with the reviewer (and also R3) that the dating section in the first version of our manuscript was somewhat unsatisfactory: it identified an important limitation of the published analysis, but did not explore the underlying question of why molecular clock methods infer unrealistically old divergence times from vertically-evolving genes. In the revised manuscript we have reworked and improved this section extensively, including new analyses on the 27-gene dataset, with more fossil calibrations, that help to diagnose how and why clocks struggle to date the archaeal and bacterial stems from the available data. We now show that the old ages result from a combination of low rates of molecular evolution across the tree inferred from “shallow” calibrations, combined with a lack of age maxima for nodes other than the root of the tree; when the rate distribution is informed in this way, the long AB branch is interpreted as representing a long period of time and estimates of LUCA age are strongly influenced by prior assumptions about root maximum age. These analyses now suggest how the difficulties might be overcome in the future, for example using better calibrations (particularly maximum ages, and indeed any fossil calibrations within the Archaea), or alternatively other sources of time information such as from gene transfers. Reflecting the new, broader focus, we have moved this section to the end of the manuscript.

      AB branch by ribosomal and non-ribosomal genes:

      Two figures (Figs. 3 and 4) are two sections (line 270-303) dedicated to the argument that ribosomal markers do not indicate a longer AB branch than a non-ribosomal one. However, this is a small scale test (38 ribosomal markers vs. 16 non-ribosomal markers) compared with the similar analysis in Zhu et al. (30 ribosomal markers vs. 381 global markers). A closer look at Figs. 3 and 4 suggests that while the AB lengths indicated by the ribosomal markers are within a relatively narrow range, those by the non-ribosomal ones are very diverse, including ones that are several folds longer than the ribosomal average. This result is in accordance with that of Zhu et al.'s Fig. 5A, although the latter was describing a different metric. Do these genes also overlap the ones found by Zhu et al.?

      Nevertheless, this analysis does not falsify Zhu et al.'s, because it compared a different, much smaller, and deliberately chosen group of genes.

      As the reviewer indicates, the purpose of the analyses presented in Figures 3-4 is to evaluate the hypothesis of accelerated ribosomal protein evolution: that is, the idea that ribosomal proteins over-estimate the AB branch length due to accelerated evolution during the divergence of Archaea and Bacteria. Although this hypothesis was independently proposed in Zhu et al., to our knowledge it actually originates with Petitjean et al. (2014) GBE (https://academic.oup.com/gbe/article/7/1/191/601621; see their Figure 2), and has been at play in analyses of deep evolution and in particular the position of DPANN Archaea in the phylogeny since that time. Thus, this section of our manuscript (indeed, all but the first section) is not a critique of Zhu et al.’s work, but a contribution to the broader ongoing discussion about which marker genes are best to use in deep phylogeny. We compare only vertically-evolving genes in Figures 3-4 so as to distinguish the impact of gene function (ribosomal versus non-ribosomal) from confounding factors such as HGT, paralogy, and gene origination time.

      To clarify this point, we have modified our main text discussion to make it clear that we are making a comparison between ribosomal genes and other vertically-evolving members of the traditional “core” gene set, rather than a broader genome-wide claim. We now write:

      “If ribosomal proteins experienced accelerated evolution during the divergence of Archaea and Bacteria, this might lead to the inference of an artifactually long AB branch length (Petitjean et al., 2014; Zhu et al., 2019). To investigate this, we plotted the inter-domain branch lengths for the 38 and 16 ribosomal and non-ribosomal genes, respectively, comprising the 54 marker genes set. We found no evidence that there was a longer AB branch associated with ribosomal markers than for other vertically-evolving “core” genes (Figure 2(b); mean AB branch length for ribosomal proteins 1.35 substitutions/site, mean for non-ribosomal 2.25 substitutions/site).”

      Substitutional saturation:

      The comparative analysis of slow- and fast-evolving sites is interesting. The result (Fig. 5) is visually impactful. In my view, this analysis is valid, and the conclusion is supported. It would be better to explain the rationale with more detail to facilitate understanding by a general audience.

      Thanks for this assessment. We have now expanded on the rationale of this analysis in the main text, writing:

      “It is interesting to note that the proportion of inferred substitutions that occur along the AB branch differs between the slow-evolving and fast-evolving sites. As would be expected, the total tree length measured in substitutions per site is shorter from the slow-evolving sites, but the relative AB branch length is longer (1.2 substitutions/site, or ~2% of all inferred substitutions, compared to 2.6 substitutions/site, or ~0.04% of all inferred substitutions for the fastest-evolving sites). Since we would not expect the distribution of substitutions over the tree to differ between slow-evolving and fast-evolving sites, this result suggests that some ancient changes along the AB branch at fast-evolving sites have been overwritten by more recent events in evolution --- that is, that substitutional saturation leads to an underestimate of the AB branch length.”

      Zhu et al. also tested the impact of substitution saturation on the AB branch, using a more traditional approach (Fig. S19). They also found that the inter-domain distance is more influenced by potential substitution saturation, but the difference is minor. They concluded that (AB distance) "is not substantially impacted by saturation."

      Like other analyses, these two analyses involved very different locus sampling (27 most "vertical" genes vs. 381 expanded genes). They also differ by the metric being measured (AB branch length vs. average distance between AB taxa). Therefore, the analysis in the current work does not falsify the analysis by Zhu et al. In contrast, it is inline with (though not in direct support of) Zhu et al. and others' suggestion that there was "accelerated evolution of ribosomal proteins along the inter-domain branch" (line 25) in the 27 core genes (of which 15 are ribosomal proteins).

      We disagree that our analysis is consistent with the hypothesis of accelerated ribosomal protein evolution. The analysis that directly addresses this point is Figure 3, where we show that the distributions of AB branch lengths in single gene trees are not significantly different between ribosomal and non-ribosomal datasets (Figure 3; mean AB branch length for ribosomal proteins 1.35 substitutions/site, mean for non-ribosomal 2.25 substitutions/site).

      Evolutionary model fit:

      The authors compared the AB branch length indicated by the standard, site-homogeneous model LG+G4+F vs. the site-heterogeneous model LG+C60+G4+F, and found that the latter recovered a longer AB branch (2.52 vs. 1.45). The author's reasoning for using a site-heterogeneous model is valid, and this analysis is sound.

      However, Zhu et al. also analyzed their data using the site-heterogeneous model C60 -- the same as in this work, but through the PMSF (posterior mean site frequency) method. Zhu et al. also compared it with two site-homogeneous models (Gamma and FreeRate). The results were extensively presented and discussed (Figs. 3, 4E, F, S23, S24, Note S2). They also found that C60+PMSF elongated the AB branch compared with the site-homogeneous models (Fig. S24A). As for the average AB distance (another metric evaluated by Zhu et al., as discussed above), C60+PMSF increased this metric when using ribosomal proteins, but not much when using the expanded marker set (Fig. S25A). And overall, the elongation by C60+PMSF with the expanded markers cannot compensate for the long branch indicated by the ribosomal proteins.

      Therefore, similar to the point I made above, this analysis is sound but it does not logically falsify the conclusion made by Zhu et al., as it only concerns a small set of markers, and it recovered a previously described pattern.

      Thanks for this comment. As above, note that the second part of our manuscript presents a general analysis of the issues around marker gene and model selection using our meta-analysis and new dataset, and is not a direct response to Zhu et al’s work. On reflection, we agree that this was not sufficiently clear in the first version of the paper, and we have now modified the text to acknowledge the model fitting analyses of Zhu et al.

      The manuscript also did not clarify what the phrase "poor model fit" refers to (line 34 and line 304). If this is addressing the Gamma model evaluated by the authors, then this claim is valid though not novel (but see my previous comment on the trade-off). If that is a general reference to Zhu et al.'s methodology, then the authors should at least include the C60+PMSF model in the analysis, and show that C60 indicates a significantly longer AB branch than C60+PMSF does (if that's the case, which is doubtful). Admittedly, C60+PMSF is cheaper than the native C60 in computation, but "In some empirical and simulation settings PMSF provided more accurate estimates of phylogenies than the mixture models from which they derive." (Wang et al. Syst Biol. 2018).

      Thanks for this comment. We did not intend the phrase “poor model fit” to imply a critique of Zhu et al.’s work; as the reviewer notes, those authors carried out a range of analyses to investigate the impact of model choice on their inferences. Rather, the title of the section is intended to summarise its main conclusion, which is that substitutional saturation and poor model fit (on any dataset, and even with the best available models) can lead to under-estimation of the AB branch length. Note that the analyses in Table 1 illustrating the impact of model fit are from the new dataset that is assembled and analysed in the second part of the manuscript. As above, we agree that this was not sufficiently clear in the first version of the paper. We think the title of this section is accurate and so we have not changed it, but we have changed the final two paragraphs of the section (as quoted immediately above) so as to acknowledge the model fitting analyses of Zhu et al., and to clarify that the results are general (and based on our new dataset), rather than a critique of Zhu et al’s work.

      Finally, Zhu et al. also performed an analysis using the native C60 model on a further reduced taxon set. That result was not presented in the published paper, but it can be found in the "Peer Review File" posted on the Nature Communications website. That tree also recovered a short AB distance, and placed CPR at the base of Bacteria, and showed that this placement was not impacted by the removal of Archaea.

      Thanks for pointing us to this additional analysis. The unrooted, bacteria-only tree referred to by the reviewer (panel B) recovers a clan (that is, a cluster of branches on the unrooted tree) comprising CPR+Chloroflexi, in agreement with the analysis on the new marker dataset we present here (Figure 6). The disagreement between that analysis and the new tree presented here relates to the position of the archaeal outgroup, which in the Peer Review File panel A connects to the bacterial tree between CPR and Chloroflexi. If, as recently suggested, the bacterial root lies between Gracilicutes and Terrabacteria (Coleman et al. 2021), then CPR and Chloroflexi represent monophyletic sister lineages. We note that the CPR+Chloroflexi relationship recovered here and in Peer Review File Panel (B) has also been obtained in several other recent analyses (Taib et al. 2020, Coleman et al. 2021, Martinez-Gutierrez and Aylward 2021), as cited in the main text.

      Taxon sampling:

      My final comment is about taxon sampling. Zhu et al. developed an algorithm for less biased taxon sampling, and they argued that extensive taxon sampling is important in resolving the early evolution of life. They presented evidence showing that reduced taxon sampling changed overall topology and basal relationships (Figs. S13, S14, S23, Note S2). The analyses were performed in combination with the assessment of site sampling, locus sampling, substitution model and other factors. The importance of less biased and/or extensive taxon sampling was also noted by previous works, especially in a phylogenomic framework (e.g., Hedtke et al. Syst Biol. 2006; Wu and Eisen. Genome Biol. 2008; Beiko. Biol Direct. 2011). The current work is based on a smaller set of taxa, and it has not addressed the impact of taxon sampling. As I suggested above, some results may be sensitive to taxon sampling.

      We agree that taxon sampling is important for phylogenetics. While the analyses of Zhu et al. (2019) included a very large number of genomes, sampling of genomes (and indeed marker genes) was biased, both towards Bacteria compared to Archaea, and also within Bacteria. In our revised manuscript, we now compare the taxon sampling between Zhu et al.’s work and our new analyses (see Figure 1 Figure Supplements 13,14,15 and Figure 4 Figure Supplements 1,2). Balanced sampling is important for phylogenetic inference (Heath et al., 2008; Hillis, 1998) and, by this criteria, the taxon sampling in the analyses of Zhu et al. was not ideal. Our new analyses made use of fewer genomes (700), but these sample the known diversity of Archaea and Bacteria in a more representative way (Figure 4 Figure Supplement 1,2).

      Reviewer #3:

      Moody and coworkers principally address a recent paper presented by Zhu et al. (Nature Communications, 2019). In their paper, Zhu and coworkers claim that (i) ribosomal protein genes, commonly used in resolving deep phylogenies, have experienced an increased rate of evolution right after LUCA, and (ii) that an expanded set of markers show that the branch separating archaea from bacteria (AB-branch) is 10-fold shorter than previously thought. Moody et and coworkers first demonstrate flaws in the Zhu et al. analysis: first, the expanded gene set is biased towards bacteria, with 25% of the single-gene trees having very few archaeal counterparts. Second, that over 75% of the single-gene trees from Zhu et al are not monophyletic at domain level, suggesting a large influence of horizontal gene transfers (HGT), inter-domain exchanges, and inclusion of paralogous sequences in the original datasets. Third, they show that genes with fewer HGT display longer AB-branches. Fourth, they show that the argument by Zhu et al. that the longer AB-branch yields absurd LUCA datation is not relevant. Fifth, and maybe most important, they show that the shorter AB-branches recovered by Zhu et al in their expanded dataset result from inadequate substitution models, which lead to underestimating rates and thus branch lengths.

      Going further, they select a set of 54 manually curated markers (showing mostly monophyletic archaea and bacteria), both from ribosomal proteins (36) and non-ribosomal proteins (18) and retrieve these in a balanced set of 350 archaea and 350 bacteria. With this set, they show that ribosomal protein markers do not display longer AB-branches than non-ribosomal ones. They also show that diversity among Archaea and Bacteria, as measured as the total tree length within each domain, is very similar, when sampling equal number of genomes in both domains.

      Strengths:

      The paper is well-written and well structured. In general, the methodology chosen here is adapted to the question at hand and very rigorously followed. The balanced dataset (with equal amounts of bacteria and archaea) of 54 carefully selected genes is also appropriate to explore diversity differences between the two domains of life.

      Although all arguments presented in Zhu et al are carefully re-evaluated, the part where Moody et al show that substitutional saturation and poor model fit is artifactually producing short AB-branches is quite compelling and elegantly presented.

      Weaknesses:

      One potential weakness, more in terms of significance than in terms of scientific soundness is that the paper is mostly "reactive", responding to a single other paper. The authors might have used the data and methodology presented here to give the paper a broader scope. An example would be to provide the audience with a solid protocol or general guidelines on how to avoid artifacts in making deep phylogenies. I believe that the authors have demonstrated that they have the authority to do that.

      Thanks for this suggestion. We considered including guidelines of this type in the first version of the manuscript, but we were --- and remain --- wary of attempting to promote one particular way of doing deep phylogeny over others. These are difficult and slippery questions, and different approaches and perspectives (including ones we might disagree with) are, in a broader sense, useful in refining ideas and helping the field to make progress as a whole. That said, a recurring issue appears to be the question of the fit between model and data, both in terms of substitution model fit (as with the impact of site-heterogeneous models on branch length inferences) and the broader issue of using models that, for example, account for gene duplication or transfer. There are several recent reviews (including one by some of us) which treat these topics in detail and provide detailed advice. We have now raised and discussed these issues in our conclusion. We have also updated Figure 6 to illustrate the approach we used in assembling the new 27-gene dataset, which may be of use to others, and goes some way towards the suggestion of providing guidelines for future analyses. We now write:

      “Our analysis of a range of published marker gene datasets (Petitjean et al., 2014; Spang et al., 2015; Williams et al., 2020; Zhu et al., 2019) indicates that the choice of markers and the fit of the substitution model are both important for inference of deep phylogeny from concatenations, in agreement with an existing body of literature (reviewed in (Kapli et al., 2021, 2020; Williams et al., 2021). We established a set of 27 highly vertically evolving marker gene families and found no evidence that ribosomal genes overestimate stem length; since they appear to be transferred less frequently than other genes, our analysis affirms that ribosomal proteins are useful markers for deep phylogeny. In general, high-verticality markers, regardless of functional category, supported a longer AB branch length. Furthermore, our phylogeny was consistent with recent work on early prokaryotic evolution, resolving the major clades within Archaea and nesting the CPR within Terrabacteria. Notably, our analyses suggested that both the true Archaea-Bacteria branch length (Figure 6A), and the phylogenetic diversity of Archaea, may be underestimated by even the best current models, a finding that is consistent with a root for the tree of life between the two prokaryotic domains.”

      In the figure 6 legend, we also expand on guidelines for future analyses, writing:

      “(B) Workflow for iterative manual curation of marker gene families for concatenation analysis. After inference and inspection of initial orthologue trees, several rounds of manual inspection and removal of HGTs and distant paralogues were carried out. These sequences were removed from the initial set of orthologues before alignment and trimming. For a detailed discussion of some of these issues, and practical guidelines on phylogenomic analysis of multi-gene datasets, see (Kapli et al., 2020) for a useful review.”

      The authors use the difference in log-likelihood between the constrained and unconstrained gene trees as a proxy for verticality and thus marker gene quality (Figure 1b). However, they don't demonstrate that that metric is actually appropriate. Could the monophyly (or split score) be also involved here? The authors might want to comment on that.

      Thanks for this suggestion, which has substantially improved our analysis of Archaea-Bacteria distance and marker gene verticality (see the revised Figure 1 and associated text). We have now evaluated the relationship between AB branch length and split score (both within- and between-domain level relationships) for the expanded marker set and have updated our results and discussion accordingly. We found that deltaLL and split score (both within- and between-domains) are positively correlated with each other, and negatively correlated with AB length (that is, high-verticality markers have longer AB branch lengths). These analyses also revealed that within-domain and between-domain split scores are strongly positively correlated, implying that genes that recover domain monophyly also do better at resolving within-domain relationships.

      The argument about the age of LUCA an ad absurdum one, showing that using better suited genes one gets impossible time estimates. However, the argument presented by Zhu et al is also a "just so" argument (if we get a time estimate that doesn't make sense then the phylogeny must be wrong), which doesn't give it much weight. The authors themselves note well that this part of the paper is more revealing of the limitations of the strict clock method, or of the relaxed clock with one single calibration point, than of the quality or appropriateness of the dataset.

      We agree that the dating section in the first version of our manuscript was somewhat unsatisfactory. We have now expanded it to include new analyses on our 27-gene dataset, using more fossil calibrations, in order to diagnose why current clock methods struggle to estimate evolutionary rate near the root of the tree, and how this impacts on the age of LUCA and other deep nodes. These analyses add substantial value to this section, which has been moved to the end of the manuscript to reflect its expanded focus.

      Another small weakness (or loose end) is that manual curation of the 95 genes dataset is not consistently reducing the percentage of non-monopyhletic genes (e.g. 62 to 69% from the 95 to the 54 genes dataset for non-ribosomal genes; 21 to 33% from the 95 to the 27 genes dataset for ribosomal genes). The author don't discuss how this impacts the manual curation they perform on the datasets; however, they state that "manual curation of marker genes is important". The authors might want to discuss that aspect further.

      Thanks for raising this point. We were not sufficiently clear in describing the logic of our approach in the first version of the manuscript, and have now revised the text to clarify. In this analysis, we used a strict binary definition of monophyly --- that is, even a single inter-domain transfer leads to non-monophyly (note that this is in contrast to the re- analysis of the expanded set, where we considered whether each marker statistically rejected domain monophyly). For some genes scored as non-monophyletic in this way, manual removal of a small number of unambiguous recent transfers is sufficient restore domain monophyly; for others, HGT is extensive and it is difficult to know how to filter the sequences so as to obtain a reliable marker gene alignment; it was these latter cases that we set aside. We have now revised this section to make the logic of the approach clear, writing:

      “Prior to manual curation, non-ribosomal markers had a greater number of HGTs and cases of mixed paralogy. In particular, for the original set of 95 unique COG families (see ‘Phylogenetic analyses’ in Methods), we rejected 41 families based on the inferred ML trees, either due to a large degree of HGT, paralogous gene families or LBA. For the remaining 54 markers, the ML trees contained evidence of occasional recent HGT events. Strict monophyly was violated in 69% of the non-ribosomal and 29% of the ribosomal families. We manually removed the individual sequences which violated domain monophyly before re-alignment, trimming, and subsequent tree inference (see Methods). These results imply that manual curation of marker genes is important for deep phylogenetic analyses, particularly when using non-ribosomal markers. Comparison of within-domain split scores for these 54 markers indicated that markers that better resolved established relationships within each domain also supported a longer AB branch length (Figure 2A).”

      In summary and despite the small weaknesses listed above, my opinion is that the authors reach their goal of showning that the AB-branch is indeed a long one, and that the results support the conclusion.

      Impact:

      The main point addressed by the authors here, the time of divergence between Archaea and Bacteria, is crucial to our understanding of early evolution. The long branch separating Bacteria and Archaea has long been thought to be a long one, and the paper by Zhu et al casted a doubt about the validity of this long-standing hypothesis. Here, Moody et al convincingly establish that the divergence between archaea and bacteria is a profound one. The paper also has profound implications on the validity of the commonly used core-gene phylogenies, particularly those based on ribosomal protein genes. Indeed, it shows that the these proteins are appropriate for deep phylogenies. They also show the impact of model violations on deep phylogenies, and how to avoid them.

      We thank the reviewer for this positive assessment of impact.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      We thank all reviewers for their thorough assessment and constructive comments.

      For clarity, their comments have been numbered.

      Reviewer #1

      Evidence, reproducibility and clarity:

      Summary:

      Acetylation/Deacetylation controls G1/s transition in budding yeast. The lysine acetyl transferase Esa1 is here shown to play a role, in part via acetylation of the nuclear pore complex basket component Nup60, which stimulates mRNA export.

      Major comments:

      1 • Figure 1C: The curve for esa1-ts in this figure and the curve in the supplementary figure S2B are not similar, while the first shows 10% cells budding after 60 minutes it is about 50% after 60 min in S2B. Another helpful way of presenting the data could be the length of the G1 phase (from cytokinesis to budding) in the WT, esa1-ts, gcn5delta cells over time.

      We thank the reviewer for pointing this out. Indeed, there is some day-to-day variability in the budding kinetics of the temperature-sensitive esa1 mutant, and the text referred to one individual experiment. Therefore, we have changed the text to better reflect the observed variability (p. 7) and added a graph (supplementary Figure S2C) including all individual replicates. This shows that in spite of small differences between experiments, esa1-ts cells always bud slower and less efficiently than wild-type cells. We note that the data cannot be shown in the way suggested (time from cytokinesis to budding, presumably from individual cells) because cells in these experiments were released from a G1 block (after cytokinesis), and samples from cell cultures were imaged at time intervals (and not single cells over time). Time-lapse data of single cells is shown in figure 2E.

      2 • What is the rational of creating the Nup60-KN mutation. Does it prevent acetylation of Nup60, at least by GCN5 and/or esa1?

      The biophysical properties of asparagine resemble those of acetylated lysine. Therefore, the Nup60-KN mutant (lysine 467 to asparagine) is expected to mimic acetylation of Nup60 K467, which was found to be acetylated in earlier studies. Supporting the conclusion that Nup60-KN is indeed an acetyl-mimic, the nup60-KN mutation partially rescues the Start and mRNA export defects on Esa1-deficient cells. We make the rationale of the Nup60-KN mutation clearer in the current version (p. 8).

      3 • Given the much stronger phenotype of the esa1-ts+GCN5 delta condition for G1/S transition as compared to esa1-ts and that GCN5 seems to strongly acetylate Nup60 I do not understand the sole focus on esa1 in the study. The fact that the Nup60-KN cells do not show G1/S transition under esa1-ts+GCN5 delta conditions in experiments presented in Fig. S3 argues that esa1 meaidted acetylation of Nup60 is only one, probably minor aspect of G1/S transition. This should be much balanced discussed.

      We focus on Esa1 because this allows us to dissect the specific role of Nup60 acetylation and mRNA export during the G1/S transition. Of course, Esa1-dependent acetylation of Nup60 is not the only process controlling the G1/S transition, which is regulated at several levels. For example, the concentration of multiple Start activators and inhibitors scales differentially with cell size (PMID: 26390151, 32246903). In addition, daughter-specific factors inhibit Start through a pathway parallel to Nup60 deacetylation (Ace2/Ash1-dependent repression of Cln3 transcription; PMID: 19841732, 19841732). We discuss these studies in the current version (p. 17).

      As for the relative contribution of Esa1 and Gcn5 to the G1/S transition and mRNA export: both of these KATs have overlapping roles in promoting transcription, probably through distinct substrates (such as histone H2 for Gcn5, H4 for Esa1) and this may contribute to their role in Start. Consistent with this, deletion of GCN5 causes a minor delay in transcription of G1/S genes (Kishkevich, Sci. Rep 2019). On the other hand, gnc5 mutants have no detectable mRNA export defects, unlike esa1-ts (our Figure 3E). This suggests that whereas Gcn5 and Esa1 may have overlapping roles in transcription of G1/S genes, Esa1 is more specifically involved in mRNA export. The ability of Nup60-KN to rescue the single mutant esa1 but not the double gcn5 esa1 is consistent with this view: the transcription defects in the double mutant may be so severe as to prevent Start even in the presence of Nup60-KN. We have modified the discussion to mention these points. In addition, we will investigate the transcription defects of esa1 and gcn5 single and double mutants to test this possibility and include the results in a revised version.

      4 • Suppl: Fig 2: I miss the hat1delta+gcn5delta condition.

      We will include the budding index of the hat1 gcn5 double mutant in a revised version.

      Minor comments:

      5 • Figure legend 2C "at least 200 cells were scored": please state number of replicates

      Figure 2C shows RT-qPCR data. The reviewer probably means figure 1C, which shows the budding index of one experiment comparing wild type, esa1, gcn5 and esa1 gcn5 strains. This experiment was repeated 3 times, as is now mentioned in the figure 1 legend.

      6 • Figure 2E: X axis "impor" should be corrected to "import"

      We have corrected this.

      7 • Would Mex67 and/or Mrt2 overexpression recue the esa1-ts and esa1-ts+GCN5 delta phenotype?

      We will include this experiment in a revised version.

      8 • Figure 4 A: The size of the daughter cells in the hos3delta condition seems smaller as compared to esa1-ts. Is this true and can you comment this? Is a premature onset of S phase observed here?

      Since Fig 4A features only wild type and hos3∆ cells, the reviewer is probably referring to esa1-ts cells shown in figure 4B. These two figure panels are not directly comparable: cells in 4A are freely cycling, whereas those in 4B were released from a mitotic arrest using nocodazole. The mitotic arrest was done in order to avoid potentially confounding effects due to inactivation of Esa1 during S phase. However, the arrest also causes daughter cells to grow larger, explaining the size differences pointed out by the reviewer. That being said, it is true that cell size and G1 duration are intimately linked and thus the reviewer question raises a relevant point. We previously showed that although hos3 daughter cells enter S phase prematurely, their size is not significantly different from wild type (Kumar et al., Figure 1d-g). Premature onset of S phase can lead to smaller cell size but this is not the case for hos3 cells, probably due to the slightly faster growth rate of the hos3∆ mutant relative to wild type specifically during S/G2/M phases (Kumar et al., Supplementary Fig. 1b).

      9 • Figure 4D: The still images in figure 2E and 4D do not correspond with the quantitation. E.g. in Fig 2E the esa1ts cells shows Whi5 export at t=81 min, which is according to the shown quantitation unusual late.

      We will modify Figures 2E-4D in a revised version to include cells that export Whi5 at times closer to the median.

      10 • Figure 4B: it is not clear why for the quantitation a different representation is chosen as compared to 4A. It would be better to show the nuclear intensities of mother/daughter as in Figure 4A.

      The reason for the different representation between figures 4A and 4B is that 4A depicts freely cycling cells and in 4B, cells were released from a nocodazole-induced mitotic arrest (as mentioned in our response to point 8). A mitotic arrest perturbs M/D size asymmetries, as daughter cells (but not mothers) continue growing during the arrest, leading to larger nuclear size. In addition, esa1-ts daughters are smaller than wt daughters in this condition, further complicating M/D asymmetries. We thought that in this case, a better metric for protein association with the NPC is the fluorescence intensity relative to a nuclear pore component. We agree that using different types of graphs is confusing, and therefore we have removed M/D comparisons from figure 4A and now represent these data as in figure 4B: the intensity of Sac3 relative to Nup49. Finally, a good control for these experiments is the quantification of total protein levels, which we have added for Sac3. We have also removed Mtr2-GFP data until our analysis of Mtr2 total levels is complete. We hope this simplifies this figure.

      11 • Figure 4D: To strengthen these results, it would be good to perform this assay with esa1-ts Nup60-KN cells as in figure 2a. The release of Whi5-GFP is expected to behave in a similar way to the WT. This would ensure that Nup60 acetylation is a pre-requisite for Whi5 release

      I’m afraid we don't understand this suggestion. Figure 4D shows time-lapse fluorescence microscopy of Whi5 nuclear export when Sac3 is recruited to the nuclear basket. Figure 2a shows western blots of Nup60 acetylation status. Therefore it is not clear how these two assays could be done in similar ways. Perhaps the reviewer refers to a different figure panel. The purpose of the suggested experiment, if we understand properly, is to test whether Nup60 acetylation is required for Whi5 export. This is the hypothesis tested in figure 2D: Whi5-GFP export is delayed in esa1-ts, and this delay is partially rescued in esa1-ts nup60-KN, which mimics acetylation. In fact, the advance in Whi5 export observed in Figure 4D upon Sac3 anchoring to NPC is similar to that observed in a nup60-KN (Figure 2E).

      12 • Page 13 "Finally, we tested whether Esa1 targets Sac3 to G1 nuclei": The effect of esa1 knockdown on Sac3 fit with the story line and the effect esa1 imposes on mRNA export. However targeting of Sac3 which is part of a bigger complex by esa1 is a misleading statement, given that you don't show a proof of direct interactions shown, e.g. by immunoprecipiations.

      We meant to say “we tested whether Esa1 function promotes the localisation of Sac3 to the nuclear basket”. We agree that it is unknown whether this involves direct interactions between Sac3 and Esa1. We have changed the text to make this point clearer.

      13 • Page 18: "Nevertheless, our findings suggest that mammalian nucleoporins may represent a novel category of substrates for KATs and for the multiprotein complexes in which these enzymes reside, with important roles in gene expression." Given that there is little experimental evidence this statement is for my taste too strong. Rather indicate that this is a possibility which needs to be tested...

      We have changed the text as suggested.

      14 • Page 3: "Nuclear pores are macromolecular assemblies composed of approximately 30-50 different Nucleoporins": it is rather approximately 30 different nucleoporins in the species so far analyzed.

      We have corrected this as suggested.

      Significance:

      The concept of acetylation/deacetylation regulation of G1/S transition in budding yeast is very appealing. The specific (and important) contribution of Esa1, especially in comparison to GCN5 and Hat1 remains unclear as well as its precise effect on Nup60. Clarifying this, also in a more balanced way of presentation of discussion, would be of interest for the field.

      My research centers around NPC function.

      Audience: experts in the nuclear structure/function fields and cell cycle regulation.

      A more detailed characterisation of the specific roles of Esa1, Gcn5 and Hat1 in the G1/S transition and mRNA export will be included in a revised version, as mentioned in our response to point 3.

      Reviewer #2

      Evidence, reproducibility and clarity:

      In this manuscript, Gomar-Alba et al. follow up on previous work from the lab that showed that the KDAC Hos3 is targeted to the bud neck and daughter cell nuclear pore complexes in budding yeast where it slows cell cycle progression by influencing gene positioning and nucleo-cytoplasmic transport. Overall, the current manuscript describes a well-conducted study that dissects the role of acetylation and deacetylation on Nup60 during the cell cycle using genetics and microscopy. The authors conclusively identify Esa1 as counteracting Hos3 in the nucleus (Figure 1) and show that part of their effect on cell cycle progression and gene expression is mediated by acetylation of Nup60 at K467 (Figure 2). They also demonstrate that this leads to a differential localization of several mRNA export factors and suggest that deacetylation of Nup60 blocks mRNA export in daughter cells. Although this work is overall carefully done, the last conclusion is still somewhat speculative.

      I have a number of minor suggestions to improve the manuscript, but only one major concern, which revolves around the role of chromatin tethering to NPCs. The authors have shown in their previous paper that this plays a role for CLN2 and it is known that active GAL1 interacts with the nuclear periphery, but in the current manuscript this aspect is largely disregarded although I think it could play a major role in the observed mRNA export phenotypes. Therefore, I think some additional experiments and controls as well as additional analysis are required to substantiate especially the results shown in figure 5.

      Major points:

      1) Figure 2: The authors claim that the mechanism by which Nup60 acetylation promotes cell cycle progression is the enhancement of mRNA export through the NPC. In Figure 2, the authors look at the expression levels of four candidate mRNAs which all show disturbed expression in esa1-ts which is not rescued by the nup60-KN mutation, but expression of the protein of one of these candidates (CLN2) is improved. In their previous paper, the same lab has shown that the CLN2 gene is tethered to the NPC in daughter cells with deacetylated Nup60 and that this is relieved in a Nup60 K467N mutant. I think it would be important here to investigate the protein levels of additional candidates that are not regulated at the level of gene localization. Is it a general effect that protein expression is higher in the nup60KN mutant?

      We agree this is an important point. To establish if Nup60-KN regulates only genes that interact with the NPC (such as CLN2), the reviewer suggests determining the cell cycle levels of proteins encoded by other G1/S genes that do not bind NPCs. The main problem with this approach is that with the exception of CLN2, the nuclear localisation of the (about 200) G1/S regulon genes is not yet known. In addition, establishing connections between mRNA and protein levels during the first cell cycle is only possible for short-lived proteins such as Cln2. For instance, amongst the G1/S genes shown in Figure 2, Cdc21 and Rnr1 have protein half-lives of 10 and 4 h, much longer than the 90-minute yeast cell cycle (PMID 25466257). We think a more direct approach to investigate the connection between gene position and mRNA synthesis / export would be to directly visualise the localisation of single mRNAs upon perturbation of the Nup60 acetylation pathway, using single mRNA labeling techniques (smFISH or PP7). We aim to do this for CLN2 and also for GAL1 (see point 2d of this reviewer). We will attempt these experiments for a revised version of our paper.

      2) Figure 5: In figure 5, the authors investigate the expression of a different inducible RNA (GAL1) to test whether the observed effect on mRNA export is more general. Since this is a crucial point for generalizing the finding, this data needs to be presented in a more convincing manner.

      2a. GAL1 is known to be tethered to the NPC upon transcription. Whether this tethering is affected by the Nup60-KN mutant is unclear, but since Nup60 has been implicated in GAL1 tethering in the literature, this possibility is not unlikely. GAL1 therefore becomes a similar case to CLN2, where it is difficult to disentangle effects directly due to mRNA export from the effects of gene tethering on mRNA transcription and processing. Therefore, this experiment should be repeated with a system that is independent of gene tethering. For example, induction of the GAL promoter via a b-estradiol inducible VP16 transactivator does not seem to induce tethering.

      This is an excellent idea. We are not aware of studies on the localisation of the GAL1 locus induced by a VP16 transactivator, but this was investigated for the HXK1 gene. This subtelomeric gene localises to NPCs in non-glucose carbon sources, and its localisation is perturbed by VP16 transactivation in glucose (PMID: 16760983). We will investigate whether the same is true for GAL1, and if so, perform the suggested experiments.

      2b. The activation kinetics in all mutants analyzed is very different from the wildtype. Therefore, the quantification made in Figure 5C is difficult to interpret. Therefore, it might be more fair to quantify for the mutant strains at an earlier timepoint after activation when the levels are similar to the levels in the wildtype strain. E.g. in the hos3d strain at around 250 min.

      This is a good point - indeed, persistent mother/daughter asymmetry in GAL1 expression in hos3 and nup60-KN mutants could be masked by saturated levels of GFP at late time points. An alternative way to test this is to determine the time of GAL1 induction in mother and daughter cells. We have done this in wild-type and hos3 mutant cells; our results indicate that GAL1 expression occurs first in wildt-type mothers and later in their daughters, whereas it is almost simultaneous in nup60-KN mother/daughter mutant pairs (as shown for a single M-D pair in the new figure 5A). In a revised version, we will include data of GAL1 expression for M-D pairs at different times after galactose addition for cells in figures 5C and 5E.

      2c. Similarly - although not as drastic - , in figure 5E, quantification should be done at a timepoint when the induction level is similar between DMSO and Rapamycin treated samples to make conclusions about differences between mother and daughter cell.

      We agree. See our response to the previous point.

      2d. The major claim of the paper is that mRNA export is inhibited by Nup60 deacetylation. In this figure, the mRNA levels need to be quantified to validate that it is not transcription that is affecting expression.

      We agree. In addition to regulating mRNA export (as suggested by the effect of Sac3 anchoring to NPCs) Nup60 deacetylation may also inhibit GAL1 transcription (directly, and/or indirectly via disruption of Gal1-based transcriptional feedback; PMID 23150580). To directly assess the role of Nup60 acetylation in GAL1 transcription and mRNA export, it would be ideal to determine the levels of GAL1 mRNA in both the nucleus and the cytoplasm, using smFISH and/or PP7 tools, in wild type and in mutants of the Nup60 acetylation pathway as we proposed to do for CLN2 (see our response to point 1 of this reviewer). These or equivalent experiments will be included in a revised version.

      3) The manuscript investigates in detail the effects of a KN mutant, however, a non-acetylatable mutant is not investigated. Is such a mutant viable?

      We have obtained a Nup60-KR mutant, which is predicted to behave as a non-acetylatable mimic, and it is viable. We will describe its phenotype in a revised version.

      Minor comments:

      4) Figure 2E: Is the rescue really specific to daughter cells? The dynamic range in the daughter cells is much higher due to the slower and more heterogenous timepoint of Whi5 export. However, zoom-in on the early timepoints after Whi5 import before the 30 min when 50% of the cells have exported Whi5, might reveal a significant increase of mother cells with shortened time to S phase entry. I suggest that the authors test this possibility. The cells shown in the image panels also suggest that the acetyl mimic might shorten mother cell time to S phase entry. If this is not the case, the authors might want to show a different example cell. Interestingly, it appears from the supplementary figure S5, that while Nup60 K647N partially rescues the export of Whi5, budding does not seem to be different to Nup60 wt. This appears to contradict the budding after alpha factor arrest shown in figure 2.

      We thank the reviewer for this suggestion. Indeed, zooming into the first 30 minutes shows a slight increase in the fraction of nup60-KN mother cells that export Whi5; however this change is not statistically significant when considering the entire cell population (p=0.6017, Mann-Whitney test). Therefore, we will replace the cell shown in figure 2E with a more representative example.

      As for figure S5, the reviewer is correct that in these experiments nup60-KN partially rescues Whi5 export (a marker of Start) but not budding (a downstream event), and this is indeed in variance with the experiment shown in figure 2B. Different experimental conditions may contribute to this apparent discrepancy: as noted in the text, the duration of G1 phase in cells synchronised with alpha factor is not directly comparable with that of freely cycling cells.

      5) Figure 3C: The authors use a truncated version of SAC3 for overexpression, since the full length is toxic (Figure S6A). I think it would be important to include this information in the main text.

      We agree, and have included this information in the main text.

      6) Figure 4B: Is there simply less Sac3 protein in the esa1-ts mutant? Although the authors address this question in figure S9, the very low expression levels of Sac3 may make this difficult to conclude from fluorescence quantification. A Western Blot would be an important control. The relative level of Sac3 still seems to be lower in esa1-ts daughter cells compared to mother cells, but no statistical test is shown.

      We are confident that the total Sac3-GFP levels are sufficient to make accurate comparisons, in both the nucleus and the entire cell. However, we will be happy to include western blot controls for Sac3 total levels in a revised version as the reviewer suggests. As for the levels of Sac3 in M vs D cells: Sac3 is indeed asymmetrically distributed in both wild-type and esa1-ts cells (p

      7) Analysis of mother daughter pairs (e.g. figure 5C): a paired t-test would be appropriate.

      We agree. Results do not change with this new analysis (in fact, p values are even lower for wild-type M-D pairs in figure 5C).

      8) Figure 5A: Can some representative mother-daughter pairs be shown as images for both wt and mutant in the timelapse? It is difficult to see in 5A whether there are any mother daughter pairs.

      We have modified the figure to include clearly identifiable mother-daughter pairs, as requested.

      9) Figure 4C: Please show image of localization of Sac3-GFP-FRB +/- rapamycin to the NPC.

      We have added this.

      Significance:

      This manuscript describes an important advance in understanding the role of non-histone protein modification on the regulation of cell cycle progression and gene expression. It is a logical follow-up on a previous paper from the lab (Kumar et al. 2018) and beautifully builds on this work. It is to my knowledge the first mechanistic description of regulation of nuclear pore complex function by a post-translational modification. This will therefore be a very interesting paper for anyone interested in nuclear pore complex regulation and biology, non-histone protein acetylation, asymmetric cell division, and cell cycle regulation.

      Reviewer #3

      Evidence, reproducibility and clarity:

      The pre-print is dedicated to mRNA export and G1/S transition control in mother and daughter cells of budding yeasts through acetylation/deacetylation of nuclear pore component Nup60 (hsNup153). In particular, authors found that Esa1(hsTip60/KAT5) acetylates the basket nucleoporin Nup60, and this event promotes recruitment of mRNA export factors to the nuclear basket and export of polyA RNA to the cytosol. This export event promotes entry of cells into S phase; in particular, Nup60 is deacetylated by histone deacetylase Hos3 that displaces mRNA export complexes from the NPC and inhibits Start specifically in daughter cells.

      The manuscript is a well-designed and well-written study.

      Please, see my major and minor suggestions below:

      Major comments:

      1. P4-5. "deacetylation of the nuclear basket nucleoporin Nup60 does not affect Whi5 nuclear accumulation". I was confused by this statement because, in the previous article Kumar et al., 2018, both main text and abstract have the following phase "nuclear basket and central channel nucleoporins establish daughter-cell-specific nuclear accumulation of the transcriptional repressor Whi5.." Could you please address this discrepancy?

      Thank you for pointing this out. We should have written: “deacetylation of Nup60 does not strongly affect Whi5 nuclear accumulation”. The Kumar et al. paper shows that deacetylation of central channel nucleoporins (such as Nup49) is important to increase accumulation of Whi5 in daughter cells, whereas deacetylation of the basket nucleoporin Nup60 plays a relatively minor role (see Kumar et al, Figure 7c). We have corrected this in the main text.

      Fig.2A: In addition to increased Nup60 acetylation, I noticed an overall increased level of Nup60 after overexpression of Esa1 and Gcn5. Is it a statistically significant increase in the Nup60 level? It is not mentioned in the main text or figure legend. Does the acetylation level of Nup60 influence its stability?

      We don’t know if acetylation of Nup60 affects its stability, although it is an intriguing possibility. Although it´s true that Nup60 levels in the IP fraction seem to increase upon Esa1 and Gcn5 overexpression, nuclear levels of Nup60-mCherry are similar in wild-type, hos3∆ and nup60-KN (Supplementary Figure S11A). Therefore it is unlikely that changes in Nup60 acetylation affect its stability. We have added this information to the text.

      Authors determined the mRNA level of four representative genes in esa1-ts and esa1-ts nup60-KN cultures.

      3a. Do authors know if Nu60-KN expression affects the perinuclear positioning of these transcripts?

      We did not investigate the localisation of individual transcripts in this study. However, as mentioned in our replies to reviewer 2, we propose to do so for the CLN2 and GAL1 mRNAs, in order to test directly the effect of Nup60 acetylation in the positioning of specific mRNAs.

      3b.I also suggest authors investigate if Nup60-KN affects other transcripts using the RNAseq approach. Nup60-KN might improve the transcription output of other transcripts and it will be interesting to know if these transcripts share similar features.

      We agree that investigating the impact of Nup60 acetylation in mRNA synthesis genome-wide is an exciting challenge. We speculate that Nup60-KN is likely to have some effect in transcription, either directly or indirectly through perturbation of feedback regulatory loops caused by mRNA export defects (for instance, transcription of both CLN2 and GAL1 is regulated by positive feedback). However we think that these experiments are beyond the scope of our study, which is focused on mRNA export.

      3c. Do authors know if GAL1pr:HOS3-NLS expression affects specifically G1-dependent transcripts?

      Answering this question would require RNA sequencing experiments. As mentioned in the previous point, we think these are beyond the scope of our study. That being said, it is likely that the Hos3-Nup60 pathway downregulates gene expression during G1, because Nup60 deacetylation is largely restricted to this phase. Note that this is not the same as regulating expression of the G1/S regulon specifically, because Hos3 also regulates GAL1 expression (Figure 5). We mention this important point in the discussion (p. 17).

      3d. Another interesting question will be to define if there is a group of transcripts that respond specifically to the status of Nup60 acetylation during G1/S transition. Is it possible to make ts-driven Nup60-KN expression to turn in ON/OFF? However, this question is beyond the scope of this paper.

      Thank you for this interesting suggestion. The proposed experiment is technically possible (for example, expression of Nup60-KN could be induced in G1 using a GAL1 promoter, followed by RNA sequencing). We agree that this is beyond the scope of our paper but would like to explore the question in future studies.

      1. Fig.2D It is not mentioned that Cln2 is not cycling anymore upon Nup60-KN overexpression.

      The Cln2 protein peaks at 30 minutes in this experiment, and is degraded at approximately 120 minutes. This corresponds to the slow, incomplete G1/S transition wave of the esa1-ts nup60-KN mutant, as indicated in the budding index at the bottom of the panel. We added this in the figure 2 legend. Note that Nup60-KN is not overexpressed, since the KN mutation is inserted in the endogenous gene under the control of its native promoter.

      Fig.2E. Arrows indicating Whi5 export timing do not match to the numbers in the main text. For example, yellow arrows indicate Whi5 export in wt strain at 30 and 78 min, but it is stated 15 and 59 min in the text. Also, do I understand right that Whi5-mCherry is not visible in the cytosol?

      See our reply to reviewer 2, point 4: we will replace the cell shown in figure 2E with a more representative example. As for Whi5-mCherry, it is visible in the cytoplasm but only weakly (since it is diluted into the larger cytoplasmic volume), and not at all in the images shown due to the overlay with the brightfield channel.

      Did the authors analyze where SAC3 and MTR2 are localized in hos3del, Nup60KN, and Esa-ts strains once their localization was affected in the nucleus? Is the overall level Sac3 level is affected in hos3del and Nup60KN strains?

      We have imaged the localisation of Sac3-GFP and Mtr2-GFP during the whole cycle using time-lapse microscopy. Our impression is that in wild type cells, their perinuclear levels increase during S phase in daughter cells, which mirrors the increase in Nup60 acetylation. In contrast, Sac3 and Mtr2 perinuclear levels seem more stable in hos3 and nup60-KN cells. We will include these analyses in a revised version. The total level of Sac3 is not affected, as shown in the updated figure 4; see our reply to reviewer 2, point 6.

      Fig4C. "Sac3-GFP-FRB partitioned equally to M and D nuclei, in the presence of Nup60-mCherry-FKBP and rapamycin (Figure 4C)." Sac3-GFP-FRB is slightly elevated in mother cells. Did you run a statistical test between the first and the third column on the box plot?

      Comparing the first and third columns in Fig 4C (Nup60 and Sac3 in control cells) shows that the mother cell accumulation is higher for Sac3 than for Nup60 (p

      P15. "GAL1 expression levels were higher in wild-type mother cells than in their daughter, and these differences were absent in cells lacking Hos3 or expressing Nup60KN". GAL1-10 promoter contains information necessary and sufficient for recruitment to the nuclear periphery (PMID: 27489341). I wonder if GAL1pr-driven transgenes of HOS3, spt10, hat1, and etc., contain DNA sequences sufficient for targeting genes to the nuclear periphery, and these genes are asymmetrically expressed in mother and daughter cells because of the presence of GAL1pr?

      We agree that these genes may be expressed at different levels in mother and daughter cells. We don’t think this asymmetric expression affects our conclusions. Indeed, the phenotypes scored (growth on plates) apply to the population and not to individual cells. The one exception is figure 3D, in which mRNA nuclear accumulation is scored in single cells. In this case, it remains possible that some of the variability observed corresponds to differences between mothers and daughters. In this case, our measurements could under-estimate the effect of Hos3-NLS in inhibition of mRNA export. However, since we cannot differentiate M and D cells in this experiment, we prefer not to speculate on this possibility in the text.

      Minor comments:

      1. Supplementary Fig. S1, it will be easy to read cell viability assays if 1A, S1A and S1B figures have the same orientation.

      We have changed the figure as suggested.

      Could you please clarify the difference between HOS3-NLS and GAL1pr:HOS3-NLS in the text of figure legend? P.33

      We have fixed this (figure 1 legend).

      P6. I recommend adding the following sentence to help clarity of the text: "To understand how NPC acetylation regulates the G1/S transition (Start), we sought to identify the lysine acetyl-transferases (KATs) counteracting the activity of the Hos3 deacetylase. Hos3 displays asymmetric distribution between mother and daughter cells in wild type Saccharomyces cerevisiae. Overexpression of a version of Hos3 fused to a nuclear localization signal (GAL1pr-HOS3-NLS) leads to targeting of Hos3 to mother and daughter cell nuclei, deacetylation of nucleoporins, and inhibition of cell proliferation (Kumar et al, 2018)."

      We thank the reviewer for this suggestion. This has been added.

      P8. Misspelling: Though Nup60 acetylation

      This has been fixed.

      FigS7. Description of polyA distribution is missing for single gcn5del strain.

      Thank you for pointing this out. This has been added.

      Misspelling: We conclude that Esa1 and Nup60 acetylation promotes Start, at least in part, by targeting Sac3 to the nuclear basket, where it mediates mRNA export.

      This has been fixed.

      Significance

      Authors of this pre-print overview and try to resolve a fundamental and not well-studied question about NPC acetylation status and S phase entry. This work is a logical extension of their previously published work (PMID: 29531309). However, this study for the first-time links status of NPC acetylation to mRNA export through lysine acetyl transferases. It will be interesting to address this question in mammalian cells considering interaction of basket nucleoporins with Tip60/KAT5 (PMID: 24302573).

      This work might be of interest to researchers investigating RNA export, transcription regulation, and nuclear pores.

      My fields of expertise are RNA export, nucleoporins, transcription regulation.

      I do not have expertise to evaluate yeast strains used in this study.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reviewer #1 (Evidence, reproducibility and clarity (Required)):

      **Summary:**

      I found this an exceptionally impressive manuscript. The evolution of Y chromosomes has until recently been nearly impossible, and this research group have pioneered approaches that can yield reliable results in Drosophila. The study used an innovative heterochromatin-sensitive assembly pipeline on three D. simulans clade species, D. simulans, D. mauritiana and D. sechellia, which diverged less than 250 KYA, allowing comparisons with the group's previous results for the D. melanogaster Y.

      The study is both technically impressive and extremely interesting (an highly unusual combination). It includes a rich set of interesting results about these genome regions, and furthermore the results are discussed in a well-organised way, relating both to previous observations and to understanding of the genetics and evolution of Y chromosomes, illuminating all these aspects. It is a rare pleasure to read such a study. I believe that this study will inspire and be a model for future work on these chromosomes. It shows how these difficult genome regions can be studied.

      Thank you for the positive evaluation of our paper. While we did not make any specific revisions in response to these comments, we did attempt to improve the writing.

      **Major comments:**

      The conclusions are convincing. The methods are explained unusually clearly, and the reasoning from the results is convincing. When appropriate, the caveats, the caveats are clearly explained. The material is clearly organised and the questions studied are well related to the results. I had a few minor comments concerning the English. Even the figure (often a major problem to understand) are very clear and helpful, with proper explanations. I have very rarely read such a good manuscript, and almost never (in a long career) found a manuscript that could be published without revision being necessary.

      Thank you for pointing out that there were minor concerns with the English. We have carefully gone through the manuscript and fixed some minor issues with the writing. The analysis found 58 exons missed in previous assemblies (as well as all previously known exons of the 11 canonical Y-linked genes, which are present in at least one copy across the group). FISH on mitotic chromosomes using probes for 12 Y-linked sequences was used to determine the centromere locations, and to determine gene orders and relate them to the cytological chromosome bands, demonstrating changes in satellite distribution, gene order, and centromere positions between their Y chromosomes within the D. simulans clade species. It also confirmed previous results for Y-linked ribosomal DNA,genes, which are responsible for X-Y pairing in D. melanogaster males. Although 28S rDNA has been lost in D. simulans and D. sechellia (but not in D. mauritiana), the intergenic spacer (IGS) repeats between these repeats are retained on both sex chromosomes in all three species. Only sequencing can reliably reveal this, as their abundance is below the detection level by FISH in D. sechellia. The 11 canonical Y-linked genes' copy numbers vary between the species, and some duplicates are expressed and have complete open reading frames, and may therefore be functional because they, but most include only a subset of exons, often with duplicated exons flanking the the presumed functional gene copy. Mega-introns and Y-loops were found, as already seen in Drosophila species, but this new study detects turn overs in the ~2 million years separating D. melanogaster and the D. simulans clade. 49 independent duplications onto the Y chromosome were detected, including 8 not previously detected. At least half show no expression in testes, or lack open reading frames, so they are probably pseudogenes. Testis-expressed genes may be especially likely to duplicate into the Y chromosome due to its open chromatin structure and transcriptional activity during spermatogenesis, and indeed most of the new Y-linked genes in the species studied clade have likely functions in chromatin modification, cell division, and sexual reproduction. The study discovered two new gene families that have undergone amplification on D. simulans clade Y chromosomes, reaching very high copy numbers (36-146). Both these families appear to encode functional protein-coding genes and show high expression. The paper described intriguing results that illuminate Y chromosome evolution. First, SRPK, arose by an autosome-to-Y duplication of the sequence encoding the testis-specific isoform of the gene SR Protein Kinase (SRPK), after which the autosomal copy lost its testis-specific exon via a deletion. In D. melanogaster, SRPK is essential for both male and female reproduction, so the relocation of the testis-specific isoform to the Y chromosome in the D. simulans clade suggests that the change may have been advantageous by resolving sexual antagonism. The paper presents convincing evidence that the Y copy evolved under positive selection, and that gene amplification may confer advantageous increased expression in males. The second amplified gene family is also potentially related to an interesting function. Both X-linked and Y-linked duplicates are found of a gene called Ssl located on chromosome 2R. In D. simulans, the X-linked copies were previously known, and called CK2ßtes-like. In D. melanogaster, degenerated Y-linked copies are also found, with little or no expression, contrasting with complete open reading frames and high expression in the D. simulans clade species in testes, consistent with the possibility of an arms race between sex chromosome meiotic drive factors. Other interesting analyses document higher gene conversion rates compared to the other chromosomes, and evidence that these Y chromosomes may differ in the DNA-repair mechanisms (preferentially using MMEJ instead of NHEJ), perhaps contributing to their high rates of intrachromosomal duplication and structural rearrangements. The authors relate this to evidence for turnover of Y-linked satellite sequences, with the discovery of five new Y-linked satellites, whose locations were validated using FISH. The study also documented enrichment of LTR retrotransposons on the D. simulans clade Y chromosomes relative to the rest of the genome, together with turnovers between the species.

      Reviewer #1 (Significance (Required)):

      As described above, the advances are both, technical and conceptual for the field. The manuscript itself does an excellent job of placing the work in the context of the existing literature.

      • Anyone working on sex chromosomes and other non-recombining genome regions should be interested in the findings reported.

      • My field of expertise is the evolution of sex chromosomes, and the evolution of genome regions with suppressed recombination. I have experience of genomic analyses. I have less expertise in analyses of gene expression, but I understand enough about such approaches to evaluate the parts of this study that use them.

      Reviewer #2:

      Reviewer #2 (Evidence, reproducibility and clarity (Required)):

      The manuscript describes a thorough investigation of the Y-chromosomes of three very closely related Drosophila species (D. simulans, D. sechellia, and D. mauritiana) which in turn are closely related to D. melanogaster. The D. melanogaster Y was analysed in a previous paper by the same goup. The authors found an astonishing level of structural rearrangements (gene order, copy number, etc.), specially taking into account the short divergence time among the three species (~250 thousand years). They also suggest an explanation for this fast evolution: Y chromosome is haploid, and hence double-strand breaks cannot be repaired by homologous recombination. Instead, it must use the less precise mechanisms of NHEJ and MMEJ. They also provide circumstantial evidence that MMEJ (which is very prone to generate large rearrangements) is the preferred mechanism of repair. As far as I know this hypothesis is new, and fits nicely on the fast structural evolution described by the authors. Finally, the authors describe two intriguing Y-linked gene families in D. simulans (Lhk and CK2ßtes-Y), one of them similar to the Stellate / Suppressor of Stellate system of D. melanogaster, which seems to be evolving as part of a X-Y meiotic drive arms race. Overall, it is a very nice piece of work. I have four criticisms that, in my opinion, should be addressed before acceptance.

      Thank you for your positive comments. We respond to your concerns point-by-point below.

      The suggestion/conclusion that MMEJ is the preferential repair mechanism (over NHEJ) should be better supported and explained. At line 387, the authors stated "The pattern of excess large deletions is shared in the three D. simulans clade species Y chromosomes, but is not obvious in D. melanogaster (Fig 6B). However, because all D. melanogaster Y-linked indels in our analyses are from copies of a single pseudogene (CR43975), it is difficult to compare to the larger samples in the simulans clade species (duplicates from 16 genes). ". Given that D. melanogaster has many Y-linked pseudogenes (described by the authors and by other researchers, and listed in Table S6), there seems to be no reason to use a sample size of 1 in this species.

      We only used pseudogenes with large alignable regions (>300 bp) to prevent the potential bias toward small indels and increase our confidence in indel calling. As a result, we excluded most of the duplicates on the D. melanogaster Y chromosome. We now include 5 additional D. melanogaster Y-linked indels in the manuscript, however, the majority of indels in this species (36/41) are still from the same gene.

      Furthermore, given that D. melanogaster is THE model organism, it is the species that most likely will provide information to assess the "preferential MMEJ" hypothesis proposed by the authors.

      A previous paper has shown that male flies deficient in MMEJ have a strong bias toward female offspring (McKee et al. 2000), suggesting that MMEJ is necessary for successfully producing Y-bearing sperm, consistent with our hypothesis. We agree with the reviewer that careful genetic and cytological experiments in D. melanogaster could further clarify the role of MMEJ in the repair of Y-linked mutations. Even more revealing would be experiments using the simulans clade species, where we hypothesize the MMEJ bias is even more pronounced on the Y chromosome. We believe, however, that these experiments are beyond the scope of this study and should merit their own papers.

      Still on the suggestion/conclusion that MMEJ is the preferential repair mechanism (over NHEJ). Y chromosome in heterochromatic, haploid and non-recombining. In order to ascribe its mutational pattern to the haploid state (and the consequent impossibility of homologous recombination repair), the authors compared it to chromosome IV (the so called "dot chromosome"). This may not be the best choice: while chr IV lacks recombination in wild type flies, it is not typical heterochromatin. E.g., " results from genetic analyses, genomic studies, and biochemical investigations have revealed the dot chromosome to be unique, having a mixture of characteristics of euchromatin and of constitutive heterochromatin". Riddle and Elgin, FlyBook 2018 (https://doi.org/10.1534/genetics.118.301146). Given this, it seems appropriate to also compare the Y-linked pseudogenes with those from typical heterochromatin. In Drosophila, these are the regions around the centromeres ("centric heterochromatin"). There are pseudogenes there; e.g., the gene rolled is known to have partially duplicated exons.

      Thank you for the suggestion. We now include the data from pericentric heterochromatin and pseudogenes in supplemental data (see Fig 7). Both data types support our conclusion that indel size is only larger on Y chromosomes, which is consistent with the comparison between the dot chromosome and pericentric heterochromatin reported by Blumenstiel et al. 2002.

      In some passages of the ms there seems to be a confusion between new genes and pseudogenes, which should be corrected. For example, in line 261: "Most new Y-linked genes in D. melanogaster and the D. simulans clade have presumed functions in chromatin modification, cell division, and sexual reproduction (Table S7)".. Who are these "new genes"? If they are those listed in Table S6 (as other passages of the text suggest), most if not all of them are pseudogenes. If they are pseudogenes, it is not appropriate to refer to them as "new genes". The same ambiguity is present in line 263: "Y-linked duplicates of genes with these functions may be selectively beneficial, but a duplication bias could also contribute to this enrichment (...) " Pseudogenes can be selectively beneficial, but in very special cases (e.g.. gene regulation). If the authors are suggesting this, they must openly state this, and explain why. Pseudogenes are common in nearly all genomes, and should be clearly separated from genes (the later as a shortcut for functional genes). The bar for "genes" is much higher than simple sequence similarity, including expression, evidences of purifying selecion, etc., as the authors themselves applied for the two gene families they identified in D. simulans (Lhk and CK2ßtes-Y)

      Thank you for the suggestion. We now state our criteria for calling genes based on the expression and long CDS and correct the sentences that the reviewer refers to. The protein evolution rates of many Y-linked duplicates were surveyed in Tobler et al. 2017, who found that most are not under strong purifying selection. Our study supports this previous report. We think that protein evolution rate alone may not be a good indicator for functionality. Our current study does not focus on the potential function of these genes, and we think further population studies are required to get a solid conclusion. We changed the text to clarify this point: “Most new Y-linked duplications in D. melanogaster and the D. simulans clade are from genes with presumed functions in chromatin modification, cell division, and sexual reproduction (Table S7), consistent with other Drosophila species [17, 77].” (p15 L281-284)

      The authors center their analysis on "11 canonical Y-linked genes conserved across the melanogaster group ". Why did they exclude the CG41561 gene, identified by Mahajan & Bachtrog (2017) in D. melanogaster? Given that most D. melanogaster Y-linked genes were acquired before the split from the D. simulans clade (Koerich et al Nature 2008), the same most likely is true for CG41561 (i.e., it would be Y-linked in the D. simulans clade). Indeed, computational analysis gave a strong signal of Y-linkage in D. yakuba (unpublished; I have not looked in the other species). If CG41561 is Y-linked in the simulans clade, it should be included in the present paper, for the only difference between it and the remaining "canonical genes" was that it was found later. Finally, the proper citation of the "11 canonical Y-linked genes" is Gepner and Hays PNAS 1993 and Carvalho, Koerich and Clark TIG 2009 (or the primary papers), instead of ref #55.

      Thank you for the suggestion. CG41561 is indeed a relatively young Y-linked gene because it’s not Y-linked in D. ananassae (Muller’s element E). We already have CG41561 in Table S6 and we think that it is reasonable to separate a young Y-linked gene from the others. We also fixed the reference as suggested (p5 L116).

      Other points/comments/suggestions:

      1. a) Possible reference mistake: line 88 "For example, 20-40% of D. melanogaster Y-linked regulatory variation (YRV) comes from differences in ribosomal DNA (rDNA) copy numbers [52, 53]." reference #53 is a mouse study, not Drosophila. Thank you for pointing out this error, we fixed the reference (p4 L91).

      2. b) Possible reference mistake: line 208 "and the genes/introns that produce Y-loops differs among species [75]". ref #75 is a paper on the D. pseudoobscura Y. Is it what the authors intended? Yes, our previous paper (ref 75) found that Y-loops do not originate from the kl-3, kl-5, and ORY genes in D. pseudoobscura because they don’t have large introns in this species.

      c) line 113. "We recovered all known exons of the 11 canonical Y-linked genes conserved across the melanogaster group, including 58 exons missed in previous assemblies (Table S1; [55])." Please show in the Table S1 which exons were missing in the previous assemblies. I guess that most if not all of these missing exons are duplicate exons (and many are likely to be pseudogenes). If they indeed are duplicate exons, the authors should made it clear in the main text, e.g., "We recovered all known exons of the 11 canonical Y-linked genes conserved across the melanogaster group, plus 58 duplicated exons missed in previous assemblies."

      Thank you for the suggestion. However, the 58 exons did not include the duplicated exons. We are similarly surprised how much we will miss if we don’t assemble the Y chromosome carefully. We now mark these exons in red in Table S1 to make this point clearer.

      d) line 116 "Based on the median male-to-female coverage [22], we assigned 13.7 to 18.9 Mb of Y-linked sequences per species with N50 ranging from 0.6 to 1.2 Mb." The method (or a very similar one) was developed by Hall et al BMC Genomics 2013, which should be cited in this context. e) line 118: "We evaluated our methods by comparing our assignments for every 10-kb window of assembled sequences to its known chromosomal location. Our assignments have 96, 98, and 99% sensitivity and 5, 0, and 3% false-positive rates in D. mauritiana, D. simulans, and D. sechellia, respectively (Table S2). The procedure is unclear. Why break the contigs in 10kb intervals, instead of treating each as an unity, assignable to Y, X or A? The later is the usual procedure in computational identification of suspect Y-linked contigs (Carvalho and lark Gen Res 2013; Hall et al BMC Genomics 2013). The only reason I can think for analyzing the contigs piecewise is a suspicion of misassemblies. If this is the case, I think it is better to explain.

      Thank you for the suggestion. We did not break the contigs into 10kb intervals when we assigned the Y-linked contigs. As you suspect, our motivation for evaluating our methods and analyzing the contigs in 10kb intervals was to detect possible misassemblies. We rewrote the sentence to make this point clearer (p6 L129-132).

      1. f) Fig. 1. It may be interesting to put a version of Fig 1 in the SI containing only the genes and the lines connecting them among species, so we can better see the inversions etc. (like the cover of Genetics , based on the paper by Schaeffer et al 2008). Thank you for the suggestion. We would like to make a figure like that fantastic cover image you refer to, but the repetitive nature of the Y chromosome makes it difficult to illustrate rearrangements based on alignments at the contig-level. We instead opted to update Figure 1 to better highlight the rearrangements, still based on the unique protein-coding genes which are supported by the FISH experiments.

      2. g) Table S6 (Y-linked pseudogenes). Several pseudogenes listed as new have been studied in detail before: vig2, Mocs2, Clbn, Bili (Carvalho et al PNAS2015) Pka-R1, CG3618, Mst77F (Russel and Kaiser Genetics 1993; Krsticevic et al G3 2015) . Note also that at least two are functional (the vig2 duplication and some Mst77 duplications). Thank you for the suggestion. We now include a column to indicate the potential function of Y-linked duplicates (see Table S6).

      h) line 421: "one new satellite, (AAACAT)n, originated from a DM412B transposable element, which has three tandem copies of AAACAT in its long terminal repeats." The birth of satellites from TEs has been observed before, and should be cited here. Dias et al GBE 6: 1302-1313, 2014.

      Thank you for the suggestion. We now include a sentence to cite this reference (p27 L467-468).

      1. i) Fig S2 shows that the coverage of PacBio reads is smaller than expected on the Y chromosome. Any explanation? This has been noticed before in D. melanogaster, and tentatively attributed to the CsCl gradient used in the DNA purification (Carvalho et al GenRes 2016). However, it seems that the CsCl DNA purification method was not used in the simulans clade species (is it correct?). Please explain the ms, or in the SI. The issue is relevant because PacBio sequencing is widely believed to be unbiased in relation to DNA sequence composition (e.g., Ross et al Genome Biol 2013). Yes, we used Qiagen's Blood and Cell Culture DNA Midi Kit for DNA extraction. We suspect that the underrepresentation of Y-linked reads is driven by the presence of endoreplicated tissue in adults. Heterochromatin is underreplicated in endoreplicated cells, and thus there may simply be less heterochromatin in these tissues. Consistent with this idea, we find that all heterochromatin seems to be underrepresented in the reads, not just the Y chromosome (see Chakraborty et al. 2021; Flynn et al. 2020). We now include this discussion in the SI of our paper (see supplementary text p75).

      2. j) I may have missed it, but in which public repository have the assemblies been deposited? We link to the assemblies in Github (https://github.com/LarracuenteLab/simclade_Y) and they will also be in the Dryad Digital Repository (doi forthcoming).

      Reviewer #3 (Evidence, reproducibility and clarity (Required)):

      Due to suppressed recombination, Y chromosomes have degenerated, undergone extensive structural rearrangements, and accumulated ampliconic gene families across species. The molecular processes and selective pressures guiding dynamic Y chromosome evolution are not well understood. In this study, Chang et al. generate updated Y assemblies of three closely related species in the D. simulans complex using long-read PacBio sequencing in combination with FISH. Despite having diverged only 250,00 years ago, the authors find structural rearrangements, two newly amplified gene families and evidence of positive selection across D. simulans. The authors also suggest the high level of Y duplications and deletions may be mediated by MMEJ biased repair.

      The authors generated a valuable resource for the study of Y-chromosome evolution in Drosophila and describe Y chromosome evolution patterns found in previous Y chromosome sequencing studies, such as newly amplified genes, positive selection, and structural rearrangements. The authors improvements to the Drosophila simulans clade Y chromosomes are commended, as assembly of the highly repetitive Y chromosome sequences is challenging. However, the manuscript is largely descriptive, the claims are largely speculative, and lacks a clear question. There are also a number of concerns with the text and figures (see below concerns). Overall, the manuscript would be significantly improved if the authors focused on a specific question as opposed to a survey of sequence features of the Y chromosome. For example, development of the idea that MMEJ is the primary mechanism for loss of Y chromosome sequence could be nice new twist.

      Our aim is to discover and understand the many different factors and processes that shape the evolution of Y chromosome organization and function. Because these Y chromosomes were largely unassembled, we needed to first generate the sequence assembly before we could ask specific questions. We prefer not to focus the manuscript solely on one specific topic such as MMEJ repair, as our other observations and analyses may be interesting to a wide range of scientists studying topics other than mutation and DNA repair. We are therefore choosing to present the more comprehensive story about Y chromosome evolution that we included in our original manuscript.

      We also respectfully disagree with the comment that our paper is just a descriptive survey of Y chromosomal sequence features. On the contrary, we present thorough evolutionary analyses to test hypotheses about the forces shaping the evolution of Y chromosome organization and Y-linked genes. Specifically, we use molecular evolution and phylogenetic and comparative genomics approaches to show that multi-copy gene families experience rampant gene conversion and positive selection. We posit that one simulans clade-specific Y-linked gene family has undergone subfunctionalization, potentially resolving sexual conflict, and another may be involved in meiotic drive. We also use evolutionary genomic approaches to show that the distribution of Y-linked mutations indeed suggests that Y chromosomes disproportionately use MMEJ and we propose that this unique feature may shape the evolution of Y chromosome structural organization. This is, as far as we know, a novel hypothesis. We think that follow-up studies of either hypothesis merit different papers.

      **Major concerns:**

      1. Title: The authors use "unique structure" in the title, which is a vague point. Are not Y chromosomes, or any chromosome, "unique" in some manner? Also are there not more evolutionary processes governing the rapid divergence of the Y's. Thank you for raising your concern. We believe that we are justified in referring to the Y chromosome as unique among all other chromosomes in its structural properties (e.g. combination of its hemizygosity, abundant tandem repeats, large scale rearrangements, and highly amplified testis-specific genes). Because there are many properties of Y chromosomes that we believe contribute to their rapid divergence, we opted for the general phrase ‘unique structure’ to capture all of these features. Many evolutionary processes likely shape the evolution of that unique structure (e.g. Muller’s Ratchet, background selection, Hill Robertson effects; see Charlesworth and Charlesworth 2000 for a review), and these processes are well-studied, especially on newly evolved sex chromosomes. Here our focus is on evolutionarily old Y chromosomes, which may have comparatively fewer targets of purifying selection and are more likely to be shaped by positive selection (Bachtrog 2008).

      p.2, line 53-56: The authors claim that sexually antagonistic selection and regulatory evolution are causes of recombination suppression. Couldn't this statement be reversed? Recombination suppression via inversions or other rearrangements enable sexually antagonistic selection. This is a chicken or egg question, so it should be revised to have both possibilities be equal.

      Thank you for the suggestion. We think that it is unlikely that recombination suppression itself is beneficial, but for sexually antagonistic selection and regulatory evolution, recombination suppression can have short-term benefits. We rephrased this sentence to be agnostic about the direction (p2 L56).

      p.5, 118-120: Are the assemblies de novo or have they been guided based upon the D. melanogaster Y chromosome assembly? Please clarify how the authors evaluate their methods by comparing their Y-sequence assignments to known chromosomal locations.

      Thank you for the suggestion. We didn’t use D. melanogaster Y chromosome assembly to guide our assemblies. “All assemblies are generated de novo”, and thus we don’t think there is any potential bias. We first assigned Y-linked sequences using the presence of known Y-linked genes, and used this assignment to evaluate our methods. We now make the sentence clear (p5 L112).

      While the gene copy number estimates are accurate, the PacBio-based genome assemblies are still not able to accurately assemble large segmental duplications (see Evan Eichler's laboratories recent primate and human genome assemblies). A statement mentioning the concerns about accuracy of the underlying sequence and genomic architecture shown should be included in the main text. FISH provides support for the location of the contigs, but not for the accuracy of the underlying genomic architecture.

      Thank you for the suggestion. We can’t validate all Y-linked regions. We did validate the larger structural features of the assembly and only discuss the results that we are confident in. We now include sentences to address this concern (p7 L150-152).

      The authors assigned Y-linked sequences based on median male-to-female coverage. Is this method feasible for assigning ampliconic sequence to the Y given the N50 of 0.6-1.2Mb? Are the authors potentially excluding novel Y-linked ampliconic sequence?

      We validated our methods to assign contigs to a chromosome by comparing 10-kb intervals to the contigs with known chromosomal location, including the Y chromosome. Our assignments have high (96, 98, and 99%) sensitivity and low (5, 0, and 3%) false-positive rates in D. mauritiana, D. simulans, and D. sechellia, respectively (see Table S2). Based on these results, we think that this method is reasonable for Y-linked contigs with N50 of 0.6-1.2Mb.

      We might exclude some novel Y-linked sequences since we only assigned ~15Mb out of a total ~40 Mb Y-linked sequences. We acknowledged this possibility, and now include a sentence to address this concern (p31 L554-556).

      Where did the rDNA sequences go in D. simulans and D. sechellia? Can they be detected on another chromosome?

      Please see Fig S5 for detailed results. We found a few copies of rDNA on the contigs of autosomes. We assembled many copies of rDNA that can’t be confidently assigned to Y chromosomes. It’s possible that they might be located on other chromosomes. Based on our FISH data (Fig S4) and previous papers, most of these non-Y-linked rDNA copies should be on the X chromosome. However, in this study, we did not make a concerted effort to assign X-linked contigs.

      Figure 2B is hard to follow and it is unclear what additional value it provides to part A. Why is expression level of specific exons important?

      Exon duplication may be an important contributor to Y-linked gene evolution: most genes have duplications and our figure shows that at least some of these duplicates are expressed. The patterns we see indicate that duplication may play different roles in genes depending on their length. For example, the duplications involving short genes (e.g., ARY) may be functional and influence protein expression, whereas duplications involving large genes (e.g. kl-2) may not influence the overall protein expression level from this gene, although the expressed duplicated exons may play some other role. We revised a sentence in the main text and added a sentence to the figure 2 legend to make this point clearer.

      Figure 3 There are many introns that contain gaps, so it is unclear how confident one can be in intron length when there are gaps.

      Indeed, we are not confident about the length of introns with gaps. Therefore, we separated these introns and showed them in different colors.

      Figure 4: What are the authors using as a common ancestor in this figure to infer duplications in the initial branch?

      We used phylogenies to infer the origin of Y-linked duplicates. Any duplications that happened earlier than the divergence between four species are listed in the branch. We also edited the legend to make this point clearer.

      p.15, paragraph 2: The authors describe a newly amplified gene, CK2Btes-Y, in D. simulans. In the first half of the paragraph the authors state that Y-linked copies are also found in D. melanogaster but have "degenerated and have little or no expression" and call them pseudogenes. Later in the paragraph, the authors state that the D. melanogaster Y-linked copies are Su(Ste), a source of piRNAs that are in conflict with X-linked Stellate. Lastly in the paragraph, the authors discuss Su(ste) as a D. melanogaster homolog of CK2Btes-Y. The logic of defining CK2Btes-Y origins is confusing. Was CK2Btes-Y independently amplified on the D. simulans Y, or were CK2BtesY and Su(Ste) amplified in a common ancestor but independently diverged?

      The amplification of CK2Btes-Y and CK2Btes-like happened in the ancestor of D. melanogaster and D. simulans (Fig S11). However, both CK2Btes-Y and CK2Btes-like became pseudogenes (D. melanogaster CK2Btes-Y is named PCKR in a previous study) in D. melanogaster. On the other hand, Ste and Su(Ste) are only limited to D. melanogaster based on phylogenetic analyses (Fig 5A) and are a chimera of CK2Btes-like and NACBtes. The evolutionary history of this gene family has been detailed in other papers, except for the presence of CK2Btes-Y in the D. simulans complex, which we describe for the first time in this study. We now include a new figure (Figure 5B) a schematic of the inferred evolutionary history of sex-linked Ssl/CK2ßtes paralogs

      Figure 5: Is each FISH signal a different gene copy?

      Yes, based on our assemblies, Lhk-1 and Lhk-2 are mostly located on different contigs. Unfortunately, we are not able to design probes that can separate Lhk-1 from Lhk-2.

      The authors suggest DNA-repair on the Y chromosome is biased towards MMEJ based on indel size and microhomologies. Is there any evidence MMEJ is responsible for variable intron length in the canonical Y-linked genes or the amplification of new gene families? Since MMEJ is error-prone, it's a more tolerable repair mechanism in pseudogenes, so their findings might be biased. Rather than comparing pseudogenes to their parent genes, they should compare chrY pseudogenes to autosomal pseudogenes. Even more would be to track MMEJ on the dot chromosome which is known not recombine and is highly heterchromatic like the Y chromosome.

      We did compare chrY pseudogenes to autosomal pseudogenes in our study. We also add new analyses to address other issues from reviewer 2, which are similar to your concern. We now include data from pericentric heterochromatin and pseudogenes (see Fig 7). Both data types support our conclusion that indel size is only larger on Y chromosomes. This is consistent with a report that the dot chromosome and pericentric heterochromatin have similar indel size distributions (Blumenstiel et al. 2002).

      Reviewer #3 (Significance (Required)):

      While it is a benefit to have much improved Y chromosome assemblies from the three D. simulans clade species, the gap in knowledge this manuscript is trying to address is unclear. The manuscript is almost entirely descriptive and the figures are difficult to follow.

      As stated above, we respectfully disagree with the comment that the manuscript is entirely descriptive, as we present thorough evolutionary analyses to test hypotheses about the forces shaping the evolution of Y chromosome organization and Y-linked genes. We have two guiding hypotheses about the importance of sexual antagonism and DNA repair pathways for Y chromosome evolution, and we conduct sequence analyses that support these hypotheses that sexual antagonism and MMEJ affect Y chromosome evolution.

      References cited in this response:

      Bachtrog D. The temporal dynamics of processes underlying Y chromosome degeneration. Genetics. 2008 Jul;179(3):1513-25. doi: 10.1534/genetics.107.084012. Epub 2008 Jun 18. PMID: 18562655; PMCID: PMC2475751.

      Blumenstiel, J.P., Hartl, D.L, Lozovsky, E.R.. Patterns of Insertion and Deletion in Contrasting Chromatin Domains, Molecular Biology and Evolution, Volume 19, Issue 12, December 2002, Pages 2211–2225, __https://doi.org/10.1093/oxfordjournals.molbev.a004045__

      Chakraborty M, Chang CH, Khost DE, Vedanayagam J, Adrion JR, Liao Y, Montooth KL, Meiklejohn CD, Larracuente AM, Emerson JJ. Evolution of genome structure in the Drosophila simulans species complex. Genome Res. 2021 Mar;31(3):380-396. doi: 10.1101/gr.263442.120. Epub 2021 Feb 9. PMID: 33563718; PMCID: PMC7919458.

      Charlesworth B, Charlesworth D. The degeneration of Y chromosomes. Philos Trans R Soc Lond B Biol Sci. 2000 Nov 29;355(1403):1563-72. doi: 10.1098/rstb.2000.0717. PMID: 11127901; PMCID: PMC1692900.

      Flynn,J, Long, M, Wing, RA, A.G Clark, Evolutionary Dynamics of Abundant 7-bp Satellites in the Genome of Drosophila virilis, Molecular Biology and Evolution, Volume 37, Issue 5, May 2020, Pages 1362–1375, https://doi.org/10.1093/molbev/msaa010

      McKee, Bruce D. et al. “On the Roles of Heterochromatin and Euchromatin in Meiosis in Drosophila: Mapping Chromosomal Pairing Sites and Testing Candidate Mutations for Effects on X–Y Nondisjunction and Meiotic Drive in Male Meiosis.” Genetica 109 (2004): 77-93.

      Tobler R, Nolte V, Schlötterer C. High rate of translocation-based gene birth on the Drosophila Y chromosome. Proc Natl Acad Sci U S A. 2017 Oct 31;114(44):11721-11726. doi: 10.1073/pnas.1706502114. Epub 2017 Oct 19. PMID: 29078298; PMCID: PMC5676891.

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      The manuscript describes a thorough investigation of the Y-chromosomes of three very closely related Drosophila species (D. simulans, D. sechellia, and D. mauritiana) which in turn are closely related to D. melanogaster. The D. melanogaster Y was analysed in a previous paper by the same goup. The authors found an astonishing level of structural rearrangements (gene order, copy number, etc.), specially taking into account the short divergence time among the three species (~250 thousand years). They also suggest an explanation for this fast evolution: Y chromosome is haploid, and hence double-strand breaks cannot be repaired by homologous recombination. Instead, it must use the less precise mechanisms of NHEJ and MMEJ. They also provide circumstantial evidence that MMEJ (which is very prone to generate large rearrangements) is the preferred mechanism of repair. As far as I know this hypothesis is new, and fits nicely on the fast structural evolution described by the authors. Finally, the authors describe two intriguing Y-linked gene families in D. simulans (Lhk and CK2ßtes-Y), one of them similar to the Stellate / Suppressor of Stellate system of D. melanogaster, which seems to be evolving as part of a X-Y meiotic drive arms race. Overall, it is a very nice piece of work. I have four criticisms that, in my opinion, should be addressed before acceptance.

      The suggestion/conclusion that MMEJ is the preferential repair mechanism (over NHEJ) should be better supported and explained. At line 387, the authors stated "The pattern of excess large deletions is shared in the three D. simulans clade species Y chromosomes, but is not obvious in D. melanogaster (Fig 6B). However, because all D. melanogaster Y-linked indels in our analyses are from copies of a single pseudogene (CR43975), it is difficult to compare to the larger samples in the simulans clade species (duplicates from 16 genes). ". Given that D. melanogaster has many Y-linked pseudogenes (described by the authors and by other researchers, and listed in Table S6), there seems to be no reason to use a sample size of 1in this species. Furthermore, given that D. melanogaster is THE model organism, it is the species that most likely will provide information to assess the "preferential MMEJ" hypothesis proposed by the authors. Still on the suggestion/conclusion that MMEJ is the preferential repair mechanism (over NHEJ). Y chromosome in heterochromatic, haploid and non-recombining. In order to ascribe its mutational pattern to the haploid state (and the consequent impossibility of homologous recombination repair), the authors compared it to chromosome IV (the so called "dot chromosome"). This may not be the best choice: while chr IV lacks recombination in wild type flies, it is not typical heterochromatin. E.g., " results from genetic analyses, genomic studies, and biochemical investigations have revealed the dot chromosome to be unique, having a mixture of characteristics of euchromatin and of constitutive heterochromatin". Riddle and Elgin, FlyBook 2018 (https://doi.org/10.1534/genetics.118.301146). Given this, it seems appropriate to also compare the Y-linked pseudogenes with those from typical heterochromatin. In Drosophila, these are the regions around the centromeres ("centric heterochromatin"). There are pseudogenes there; e.g., the gene rolled is known to have partially duplicated exons. In some passages of the ms there seems to be a confusion between new genes and pseudogenes, which should be corrected. For example, in line 261: "Most new Y-linked genes in D. melanogaster and the D. simulans clade have presumed functions in chromatin modification, cell division, and sexual reproduction (Table S7)".. Who are these "new genes"? If they are those listed in Table S6 (as other passages of the text suggest), most if not all of them are pseudogenes. If they are pseudogenes, it is not appropriate to refer to them as "new genes". The same ambiguity is present in line 263: "Y-linked duplicates of genes with these functions may be selectively beneficial, but a duplication bias could also contribute to this enrichment (...) " Pseudogenes can be selectively beneficial, but in very special cases (e.g.. gene regulation). If the authors are suggesting this, they must openly state this, and explain why. Pseudogenes are common in nearly all genomes, and should be clearly separated from genes (the later as a shortcut for functional genes). The bar for "genes" is much higher than simple sequence similarity, including expression, evidences of purifying selecion, etc., as the authors themselves applied for the two gene families they identified in D. simulans (Lhk and CK2ßtes-Y) The authors center their analysis on "11 canonical Y-linked genes conserved across the melanogaster group ". Why did they exclude the CG41561 gene, identified by Mahajan & Bachtrog (2017) in D. melanogaster? Given that most D. melanogaster Y-linked genes were acquired before the split from the D. simulans clade (Koerich et al Nature 2008), the same most likely is true for CG41561 (i.e., it would be Y-linked in the D. simulans clade). Indeed, computational analysis gave a strong signal of Y-linkage in D. yakuba (unpublished; I have not looked in the other species). If CG41561 is Y-linked in the simulans clade, it should be included in the present paper, for the only difference between it and the remaining "canonical genes" was that it was found later. Finally, the proper citation of the "11 canonical Y-linked genes" is Gepner and Hays PNAS 1993 and Carvalho, Koerich and Clark TIG 2009 (or the primary papers), instead of ref #55. Other points/comments/suggestions:

      a) Possible reference mistake: line 88 "For example, 20-40% of D. melanogaster Y-linked regulatory variation (YRV) comes from differences in ribosomal DNA (rDNA) copy numbers [52, 53]." reference #53 is a mouse study, not Drosophila.

      b) Possible reference mistake: line 208 "and the genes/introns that produce Y-loops differs among species [75]". ref #75 is a paper on the D. pseudoobscura Y. Is it what the authors intended?

      c) line 113. "We recovered all known exons of the 11 canonical Y-linked genes conserved across the melanogaster group, including 58 exons missed in previous assemblies (Table S1; [55])." Please show in the Table S1 which exons were missing in the previous assemblies. I guess that most if not all of these missing exons are duplicate exons (and many are likely to be pseudogenes). If they indeed are duplicate exons, the authors should made it clear in the main text, e.g., "We recovered all known exons of the 11 canonical Y-linked genes conserved across the melanogaster group, plus 58 duplicated exons missed in previous assemblies."

      d) line 116 "Based on the median male-to-female coverage [22], we assigned 13.7 to 18.9 Mb of Y-linked sequences per species with N50 ranging from 0.6 to 1.2 Mb." The method (or a very similar one) was developed by Hall et al BMC Genomics 2013, which should be cited in this context. e) line 118: "We evaluated our methods by comparing our assignments for every 10-kb window of assembled sequences to its known chromosomal location. Our assignments have 96, 98, and 99% sensitivity and 5, 0, and 3% false-positive rates in D. mauritiana, D. simulans, and D. sechellia, respectively (Table S2). The procedure is unclear. Why break the contigs in 10kb intervals, instead of treating each as an unity, assignable to Y, X or A? The later is the usual procedure in computational identification of suspect Y-linked contigs (Carvalho and lark Gen Res 2013; Hall et al BMC Genomics 2013). The only reason I can think for analyzing the contigs piecewise is a suspicion of misassemblies. If this is the case, I think it is better to explain.

      f) Fig. 1. It may be interesting to put a version of Fig 1 in the SI containing only the genes and the lines connecting them among species, so we can better see the inversions etc. (like the cover of Genetics , based on the paper by Schaeffer et al 2008).

      g) Table S6 (Y-linked pseudogenes). Several pseudogenes listed as new have been studied in detail before: vig2, Mocs2, Clbn, Bili (Carvalho et al PNAS2015) Pka-R1, CG3618, Mst77F (Russel and Kaiser Genetics 1993; Krsticevic et al G3 2015) . Note also that at least two are functional (the vig2 duplication and some Mst77 duplications).

      h) line 421: "one new satellite, (AAACAT)n, originated from a DM412B transposable element, which has three tandem copies of AAACAT in its long terminal repeats." The birth of satellites from TEs has been observed before, and should be cited here. Dias et al GBE 6: 1302-1313, 2014.

      i) Fig S2 shows that the coverage of PacBio reads is smaller than expected on the Y chromosome. Any explanation? This has been noticed before in D. melanogaster, and tentatively attributed to the CsCl gradient used in the DNA purification (Carvalho et al GenRes 2016). However, it seems that the CsCl DNA purification method was not used in the simulans clade species (is it correct?). Please explain the ms, or in the SI. The issue is relevant because PacBio sequencing is widely believed to be unbiased in relation to DNA sequence composition (e.g., Ross et al Genome Biol 2013).

      j) I may have missed it, but in which public repository have the assemblies been deposited?

      Significance

      see above.

    1. Author Response:

      Reviewer #2 (Public Review):

      Yu et al provide a comprehensive set of experiments to determine that bradyzoites have much slower cytosolic Ca2+ parameters, which impact on gliding motility, a key process of Toxoplasma spread and persistence.

      The only main criticism that I have is the use of the MIC2-GLuc reporter to measure microneme secretion in bradyzoites. Do bradyzoites have any appreciable level of MIC2 and its associated protein M2AP?? This is important that may affect the outcome. If bradyzoites do not, then the MIC2-GLuc reporter might not have appropriate levels of M2AP to correctly traffic to the micronemes. I recommend that the authors quantitate, either by western blot or IFA, the levels of MIC2 and M2AP in bradyzoites versus tachyzoites and also show that M2AP co-localises with MIC2-GLuc to give confidence that MIC2-GLuc is trafficked correctly and thus the low readings of secretion are not just a result of the reporter mistrafficked. It would also be pleasing to see, that 1hr incubation leads to restoration of MIC2-GLuc secretion.

      We acknowledge that the expression and localization of MIC2-Gluc reporter is a potential concern. We performed western blotting (Figure 2C) and IFA (Figure 2 supplement 1A) to confirm that bradyzoites express MIC2-Gluc and M2AP albeit at lower levels compared with tachyzoites. Moreover, MIC2-GLuc and M2AP were properly co-localized to the apical end in bradyzoites, ruling out the possibility of mis-localization of the MIC2-GLuc reporter. Based on these results, we believe that MIC2-GLuc provides a reliable read-out for microneme secretion in in vitro differentiated bradyzoites. Additionally, the conclusion that MIC secretion is dampened in bradyzoites is also supported by the studies using the FNR-Cherry reporter in Figure 2E,F,G.

      Reviewer #3 (Public Review):

      This is a first study that looks in detail at Ca-controlled gliding motility and ATP supply in bradyzoites. A comparison of such different parasite stage by manipulating Ca and ATP metabolism is challenging. Intervention by chemical compounds needs to overcome a prominent cyst wall and the usage of genetic tools needs to consider the broad changes in protein expression between tachyzoites and bradyzoites as well as a heterology between individual bradyzoites. The authors used excysted bradyzoites to exclude the cyst wall as a diffusion barrier as a major factor in the efficacy of different Ca agonists. To address differences in expression levels between tachyzoites and bradyzoite stages the authors developed a ratiometric Ca sensor based upon an autocleaved GCaMP6f-BFP dimer protein.

      Overall the conclusions are well supported but there are methodological questions that need to be addressed.

      Bradyzoites show a heterogenous expression of Bag1 / Sag1 markers as well as heterologous proteins. This is shown in Fig 1A and Fig 2b for example. However, in most time-dependent measurements of Ca-dependent fluorescence (Fig 2G, 3D the authors only average three cells. This appears to be insufficient to represent the bradyzoite population. How is the variance between the three measured cells?

      We have quantified more cells in all figures related to fluorescence measurements. For measurements of single parasites in Figure 5B, 5D, 5E, 6F, 8A, 8B and Figure 7 supplement 1A, we have now quantified 10 parasites for each condition and plotted the data as means ±S.D. to show the variance. For in vitro induced cysts or ex vivo cysts in Figure Fig 2G, 3D, 3E, 4C,4G, 6E, 7B and Figure 4 supplement 1A, we measured 5 cysts or vacuoles per condition. Because these samples contain many parasites within each vacuole or cyst, they represent a greater sample size. The data are also plotted a means ±S.D.

      In addition, the Mic2 promoter driven Gluc-myc protein is not expressed in all bradyzoites. This is perhaps not suprising as Mic2 seems to be downregulated in bradyzoites according to Pittman and Bucholz et al dataset in ToxoDB. If interpreted correctly the lower expression of Gluc in some bradyzoites would favour an underestimation of the RLUs in Fig 2D.

      We acknowledge that the expression and localization of MIC2-Gluc reporter is a potential concern. We performed western blotting (Figure 2C) and IFA (Figure 2 supplement 1A) to confirm that bradyzoites express MIC2-Gluc and M2AP albeit at lower levels compared with tachyzoites. Moreover, MIC2-GLuc and M2AP were properly co-localized to the apical end in bradyzoites, ruling out the possibility of mis-localization of the MIC2-GLuc reporter. Based on these results, we believe that MIC2-GLuc provides a reliable read-out for microneme secretion in in vitro differentiated bradyzoites. Additionally, the conclusion that MIC secretion is dampened in bradyzoites is also supported by the studies using the FNR-Cherry reporter in Figure 2E,F,G.

      The maturation of bradyzoite takes several weeks. This cannot be accomplished with currently available system in vitro and the authors use 1 week matured bradyzoites. To facilitate comparability to data from other manuscripts it would be helpful if the authors could quantify the differentiation stage of the in vitro bradyzoites. This could be done by measuring the fractions of Bag1-positive and Sag1-negative bradyzoites.

      We thank the reviewer for this useful comment. We have quantified the percentage of BAG1-positive SAG1-negative bradyzoites within each cyst induced for 3, 5 or 7 days by IFA and spinning disc confocal microscopy (Figure 3 supplement 1A). This analysis demonstrated that the percentage of BAG1-positive and SAG1-negative bradyzoites reached ~70% at day 7 after induction (Figure 3 supplement 1B). For this reason, we used a 7 day induction treatment for the majority of experiments. Also, where imaging was used in the analysis, we focused on regions of in vitro differentiated cysts that expressed high levels of BAG1-mCherry.

      The mcherry and GCaMP6f signal in fig 3B seem mutually exclusive. This may be due to difference in calcium signalling between Bag1 pos or neg parasites or due to expression differences of GCaMP6f.

      To test the possibility of expression differences in GCaMP6f, we quantified the fluorescence of BAG1-mCherry and GCaMP6f in different bradyzoites within the cyst shown in Figure 3B. At time 0 prior to stimulation, we observed heterogenous expression of BAG1- mCherry while the signal for GCaMP6f expression was relatively constant (Figure 3B supplement 1C and 1D). In contrast, when in vitro differentiated bradyzoites were stimulated with A23187, they showed reduced levels of GCaMP expression in cells that were strongly positive for BAG1-mCherry (Figure 3B). Collectively, these findings are consistent with the difference in GCaMP fluorescence being due to dampened calcium responses in bradyzoites rather than expression differences. This conclusion is supported by studies on GCaMP responses in cells where we normalized for expression level using a dual-expression BFP reporter in Figure 6. Therefore, we do not think that heterogeneity in the expression of GCaMP is responsible for the observed dampened response in bradyzoites.

      The authors use syringe, trypsin-released and FACS sorted bradyzoites in multiple Ca assays. How can it be excluded that this procedure affects (depletes) Ca stores?

      In all the figures except Figure 2C-2D, we did not use FACS to sort bradyzoites. Instead, we scraped cells cultured at pH 8.2, used syringe passage through 25g needle followed by centrifugation. Cyst pellets were resuspended and digested with trypsin to liberate bradyzoites. For tachyzoites, all procedures were similar except that we did not use trypsin digestion. As a control, we have now treated tachyzoites similarly with trypsin and monitored the calcium stores using ionomycin. We found that trypsin digestion did not affect the calcium stores or response as shown in Figure 7 figure supplement 1A.

      In my opinion several experiments in this manuscript would benefit from clarification of this point. For example: In Fig 7A Fu et al measure Ca for 5min during trypsin digestion, however, for gliding assays cysts are digested for 10min. The Ca monitoring should cover the complete 10min off trypsin digest.

      We understand the concern but there were practical reasons for the slightly different times used. In panel A where we are monitoring calcium during trypsin digestion, the majority of cysts are dispersed after 5 min resulting the parasites being out of focus. As such, it is not practical to monitor beyond this time point. In the panel C, we were interested in observing parasites after the cysts where fully digested and hence we used a slightly longer time period to allow complete digestion and for the parasites to settle to the bottom of the dish before further recording. In this instance, similar to the result in A, most parasites remained dormant and did not show elevated calcium levels. In the figure, we are selectively showing a rare example where calcium signaling was observed in order to compare the patterns to what is normally observed with tachyzoites. These combined panels are not meant to be a comparison of kinetics, as this aspect is tested more directly in later experiments. We have modified the text to make the rationale for this experiment clear.

      In Fig 2B Fu et al digest infected monolayers with trypsin to release mcherry from cysts matrices. How can the authors exclude that trypsin is not digesting mCherry protein in this assay?

      I think the reviewer means 2F as in 2B we are using BAG1 mCherry to visualize bradyzoites – but they are not being liberated in this image. In 2F we use a different construct, FnR-mCherry that directs the reporter to be constitutively secreted to either the PV (surrounding tachyzoites) or the cyst matrix (surrounding bradyzoites). When the cysts are disrupted with trypsin, the mCherry is likely to disperse and may also be digested. However, this would not happen if it remains inside the parasite. This control is provided to show that the protein is secreted into the matrix. We have revised the text to clarify the use of this control.

      Fig 7 E,F: the authors measure shorter gliding distances of bradyzoite as compared to tachyzoites. Trails of both parasites however, are detected by visualizing using different antigens that may have different shedding behavior on the FBS-coated glass surface. The Bag1 trail also depends on Bag1 expression, which is shown in numerous images to not be equal among individual bradyzoites. This point is very challenging to address but should at least be discussed.

      BAG1 is used here to discern the bradyzoites, not to detect the trail. Trails are stained with either SAG1 or SRS9 – corresponding to the most abundant surface GPI anchored antigen in each stage. Since these proteins are part of the same C-C fold family and are similarly anchored, we feel they are comparable. We have added the following statement to the results: “These two surface markers are both members of the cysteine rich SRS family that are tethered to the surface membrane by a GPI anchor, thus they represent comparable reporters for each stage.”

      Fig 7E: Bradyzoites are considered to satisfy their ATP needs mostly via glycolysis and the data shown do support this capability. I find the ability of OligomycinA to block glucose-dependent gliding surprising as this suggests a necessary mitochondrial transport chain for ATP-production from glucose. This result should be mentioned clearly in the text and its implications discussed.

      The Discussion has been revised as suggested.

      Figure 8: The authors claim a recovery of bradyzoite ATP and Ca levels after 1hr incubation with carbon sources and Ca, that together enable efficient gliding. However, the elevation of bradyzoite ATP occurs after the parasites spend 2 hours in glucose-free and Ca-free conditions, whereas gliding assays are done after a short 10min trypsin digest. I am not entirely convinced that low ATP levels post-egress are responsible for the low gliding activity. Ideally gliding assays should be done after a similar purification procedure to correlate the two experiments.

      We have repeated the gliding assays using bradyzoites purified in the same manner as for the ATP measurements and found the same result that a combination of exogenous calcium and glucose enhance recovery of gliding motility (Figure 8D, 8F). In addition, we used the same time point to purify bradyzoites for MIC2-Gluc secretion and found exogenous calcium and glucose also led to an increase in MIC2-GLuc secretion, indicative of the recovery of microneme secretion (Figure 8C).

    1. Author Response:

      Reviewer #1 (Public Review):

      Summary

      Moncunill et al set out to investigate a very important question: why are half of children vaccinated three times with RTS,S AS01 protected from clinical malaria - and half not? To do so they isolated PBMCs before vaccination and one month after third vaccination and stimulated them in vitro with DMSO (vehicle control), two malaria antigens (CSP (part of RTS,S) & AMA1) or HBS (hepatitis B antigen - part of RTS,S).

      They then assessed their transcriptional response by blood transcriptional module analysis and correlated those results with previous published data on antibody titers and T cell cytokine production to find associations. To assess risk of clinical malaria, responses were compared between RTS,S vaccinated children who developed clinical malaria in the one year follow-up (cases) and those who received RTS,S or a comparator vaccine and did not (controls). They found that responses after RTS,S vaccination did not predict protection from clinical malaria. Instead a blood transcriptional module signature related to dendritic cells, inflammation, and monocytes before vaccination may be associated with clinical malaria risk.

      Strengths

      Immune correlates of protection are evaluated in African children (who are the RTS,S target population) in a natural transmission setting.

      Excellent set of controls: children (same age) vaccinated with RTS,S or comparator vaccine alongside each other -> retrospectively stratified by whether the did or did not develop clinical malaria : controls for the effect of a developing immune system and would allow to disentangle RTS,S specific and clinical malaria specific response patterns.

      Weaknesses

      RTS,S is composed of CSP & HBS. yet when PBMCs from children vaccinated three time with RTS,S are stimulated with these peptides no transcriptional differences compared to children receiving a rabies or meningitis vaccine were detected (Figure 2). this lack of recall response impacts all downstream conclusions and comparisons made in the paper.

      The fact that bulk transcriptional profiling of Ag-stimulated PBMCs (and specifically to CSP) did not identify large significant differences in BTM expression between the RTS,S vs. comparator group could be due to several factors. First of all, the frequency of antigen-specific CD4+ T cells was very low among CD4+ T cells (Figure 4 of the manuscript shows that CSP-specific CD4+ T cells comprise < 0.004% of all CD4+ T cells). This low frequency of CSP-specific T cells is consistent with other RTS,S studies [e.g. as we state on line 330, we have previously found that CSP-specific T-cells in RTS,S/AS01 vaccines comprise < 0.10% of all CD4+ T cells (1)]. Moreover, CD4+ T cells themselves comprise approximately 45-57% of all PBMCs (2). Thus, finding an expression signal between the RTS,S vs. comparator group would require the signal to be high enough to be detected in only 0.002% of all PBMCs [0.004% (% CSP-specific CD4+ T cells out of total CD4+ T cells) x 51% (average % of CD4+ T cells out of all PBMCs) = 0.002%]. Thus, lack of detectable recall response does not mean lack of recall response. Moreover, as suggested below, we opted not to focus the rest of the manuscript on the Ag-stimulation results.

      Second of all, the PBMCs were stimulated on site for 12h and then cryopreserved. This stimulation time was chosen based on the kinetics of IFN- and IL-2 mRNA response (3), but other responses may have had different kinetics and thus have already resolved or have not yet occurred by the 12-h cryopreservation. We have added text in the manuscript to discuss these caveats (“Another potential reason for why no BTMs were found to associate with the response to RTS,S/AS01 vaccination or with protection when analyzing CSP-stimulated PBMC is that all PBMC were stimulated on site for 12 hours (this stimulation time was chosen based on the kinetics of the IFN-gamma transcriptional response) and then cryopreserved. Thus, we were unable to detect earlier transient responses that had already resolved by 12 hours, as well as more delayed response that had not yet initiated by 12 hours, if such responses occurred”).

      It should be noted that in all our analyses, the stimulated results were adjusted for DMSO to focus on the antigen-specific response only. This would explain why we detect signal in the DMSO samples but not in response to stimulation. We have realized that this was not very well described in the figure captions and the Methods section and have added more details, including the model description in Methods section. As such, we do not believe that these results impact all downstream conclusions. We believe that the unstimulated results provide significant new insights into the immune and molecular mechanisms of RTS,S vaccine efficacy, not necessarily directly related to the RTS,S-specific acquired immune response. Finally, we would like to highlight the fact that we have improved our model specification to directly account for the pairing of some of the samples using a random effect using the limma package. This has slightly increased statistical power, and as such the number of significantly differentially expressed BTMs in response to stimulation is a bit higher (but still much less than that for the DMSO). Originally, we had decided against the use of a random effect due to the computational cost of estimating the random effect.

      Transcriptional responses 1 month after the final RTS,S vaccination do not predict clinical malaria risk (Figure 3) - this is a key finding, which should be central to the conclusion of this paper.

      Considering that Kazmin et al. (4) showed that the transcriptional response to the third RTS,S/AS01 dose peaks at Day 1 post-injection, with some decline by Day 6 and approximately 90% of the response having waned by Day 21 (with the caveat that Kazmin et al.’s study population was malaria-naïve adults), we do not find it surprising that there were only a few BTMs whose 1 month post-final RTS,S dose associated with clinical malaria risk. However, the point is well-taken about the relative merits of the baseline. We have edited the Discussion to include discussion of the Month 3 correlates results:

      “Compared to the 45 BTMs whose baseline levels significantly associated with clinical malaria risk in RTS,S/AS01-vaccinated African children, fewer BTMs (seven) had levels at one month post-final RTS,S/AS01 dose that significantly associated with clinical malaria risk. Moreover, if a more stringent FDR cutoff had been used (i.e. 5%), six of these seven BTMs would not have been identified. Thus it is entirely possible that, at one month post-final RTS,S/AS01 dose, there is no circulating immune transcriptomic signature predictive of risk. Such a conclusion would not be surprising, given that in malaria-naïve adults, the transcriptional response to the third RTS,S/AS01 dose has been shown to peak at Day 1 post-injection, with some decline by Day 6 and approximately 90% of the response having waned by Day 21 (17). Therefore, it is likely that the sampling scheme in this study (one month post-final dose) misses the majority of the transcriptional response to RTS,S/AS01.”

      The take-home message put forward in the title/abstract (that a monocyte and DC related pre-vaccination signature predicts risk of clinical malaria in RTS,S vaccinated children) is not strongly supported by the data. It is based on blood transcriptional modules related to monocytes being picked out when comparing RTS,S vaccinated cases and controls.

      Thank you for giving us the opportunity to provide further rationale for our focus on the 7 monocyte-related and 4 DC-related BTMs shown in Figure 6B (MAL067 column) out of the 45 total BTMs whose baseline expression associated with clinical malaria risk in RTS,S/AS01-vaccinated children. The reviewer implies that these modules were chosen for focus somewhat randomly or without justification (or, even worse, “cherry picked”), which we would agree would be an imperfect method for drawing conclusions.

      First, we have always ensured to mention that the 45 baseline modules that correlated with risk in RTS,S recipients (Fig 6B, MAL067 column) belonged to many functional annotations, including DC cells and monocytes. (Abstract: “In contrast, baseline levels of BTMs associated with dendritic cells and with monocytes (among others) correlated with malaria risk”) (Main text, lines 519-522: “Compared to the results from the month 3 analysis (7 BTMs), the baseline correlates analysis of MAL067 revealed a larger number (45) of BTMs, spanning many functional categories, whose month 0 levels in vehicle-stimulated PBMC nearly all associated with clinical malaria risk in RTS,S/AS01 recipients .”

      The focus on DC cells and monocytes is due to two reasons: 1) the fact that the DC-related modules and the monocyte-related modules were some of the most significant correlations (lines 522-524: “The BTM with the most significant association with risk was “enriched in monocytes (II) (M11.0)” (FDR = 1.80E-14), followed by “inflammatory response (M33)” (FDR = 2.45E-07) and “resting dendritic cell surface signature (S10)” (FDR = 6.03E-07).”

      Second, the baseline association of DC- and monocyte-related modules appeared to generalize across populations: (Abstract: “A cross-study analysis supported generalizability of the baseline dendritic cell- and monocyte-related BTM correlations with malaria risk to healthy, malaria-naïve adults, suggesting that certain monocyte subsets may inhibit protective RTS,S/AS01-induced responses.”; Main text: “BTMs related to dendritic cells and to monocytes were most consistently associated with risk across these three studies [“resting dendritic cell surface signature (S10)”, “DC surface signature (S5)”, “enriched in dendritic cells (M168)”, “enriched in monocytes (I) (M4.15)”, “enriched in monocytes (II) (M11.0)”, “enriched in monocytes (IV) (M118.0)”, and “monocyte surface signature (S4)” significantly correlated with risk in all three studies].”

      The first two sentences of the Discussion (lines 577-580) explain our focus on monocytes and DCs:

      “Our main finding is the identification of a baseline blood transcriptional module (BTM) signature that associates with clinical malaria risk in RTS,S/AS01-vaccinated African children. In a cross-study comparison, much of this baseline risk signature – specifically, dendritic cell- and monocyte-related BTMs – was also recapitulated in two of the three CHMI studies in healthy, malaria-naïve adults.”

      Finally, we note that the title (“A baseline transcriptional signature associates with clinical malaria risk in RTS,S/AS01-vaccinated African children”) does not restrict to DC-related or monocyte-related BTMs, rather, we chose this title based on the larger number of BTMs, and higher correlations with risk, in the baseline analysis compared to the Month 3 analysis.

      We have revised all instances where we have communicated this less clearly, e.g. “for why we identified a baseline monocyte transcriptional signature of risk” has been changed to “for why we identified monocyte-related BTMs in our transcriptional signature of risk”.

      Many other modules are picked out as well e.g. cell cycle (Figure 6B). An in-depth analysis of the genes in these module and what their up and downregulation can tell us about their function is warranted to support the conclusions.

      Thank you for the suggestion to look at the cell cycle module in Figure 6B. You make a good point that this module is the only module to show a significant association with clinical malaria risk across all 4 of the RTS,S studies and should therefore be further examined. First, we have added this to the text:

      “Only one BTM, “cell cycle and transcription (M4.0)”, was significantly associated with risk across all four studies. Of the 335 genes in this module (M4.0), 130 were also present in one or more of the six “monocyte-related” BTMs shown in Figure 6B (297 genes total across all six BTMs), suggesting that the “cell cycle” and “monocyte” results may actually be picking up the same signal.”

      We have done the gene-level analysis as suggested, resulting in 8 new supplemental figures (Figure 6-figure supplements 1-8) and one new supplemental table (S5). We have also made the following revisions to the text:

      In Results: “To gain insight into specific module-member genes that may be involved in the RTS,S/AS01 baseline risk signature, we performed the same analysis on the gene level, i.e. examined associations with clinical malaria risk for each of the constituent genes in the 45 BTMs shown in Figure 6B. Figure 6-figure supplements 1-8 show the gene-level association results within the eight BTMs that were significantly associated with clinical malaria risk in MAL067 and at least two of the three CHMI studies, and had at least one gene in MAL067 that was significantly associated with risk (these eight correspond to M4.0, S10, S5, M168, M4.3, M11.0, M4.15, and S4). Within MAL067, 35 unique genes were shown to significantly associate with malaria risk (Supplementary Table 5); 9 of these genes (CCNF, MK167, KIF18A, NPL, RBM47, CFD, MAFB, IL13RA1, and CCR1) also had significant association with non-protection in one of the CHMI studies. Although no individual gene was significantly associated with risk across >2 studies, many showed consistent effect (direction and magnitude) across 3 studies. This further supports our choice to focus on modules instead of individual genes as GSEA increases power to detect more subtle but coordinated changes in gene expression data that would be missed otherwise. For this same reason, GSEA has been shown to enhance cross-study comparisons (45).”

      In Discussion: “Our gene-level correlates analyses suggest an alternative hypothesis, however. With the caveat that the gene-level analyses were performed post hoc, high baseline expression of STAB1 (which is present in DC-related, monocyte-related, and cell cycle-related modules) was found to positively associate with clinical malaria risk (Figure 6-figure supplements 1, 2, and 6). STAB1 encodes stabilin-1 (also called Clever-1), a transmembrane glycoprotein scavenger receptor that links extracellular signals to intracellular vesicle trafficking pathways (58). Interestingly, stabilin-1high monocytes show downregulation of proinflammatory genes, and T cells co-cultured with stabilin-1high monocytes showed decreased antigen recall, suggesting that monocyte stabilin-1 suppresses T cell activation (56). Thus one possibility is that stabilin-1high immunosuppressive monocytes circulating at baseline could decrease protective RTS,S-induced T-cell responses, or inhibit another aspect of adaptive immunity. Single-cell transcriptomic profiling of PBMC or purified monocyte subsets in future RTS,S trials in African children in malaria-endemic areas could help test this hypothesis.”

      Impact

      This paper will inform future studies looking for correlates of RTS,S induced protection from clinical malaria in a variety of ways:

      It validates the blood transcriptional module approach (as published by Li S, Rouphael N, Duraisingham S, Romero-Steiner S, Presnell S, Davis C, Schmidt DS, Johnson SE, Milton A, Rajam G, et al: Molecular signatures of antibody responses derived from a systems biology study of five human vaccines. Nat Immunol 2014) to find target cell populations which can then be investigated in much more detail.

      It shows that studying PBMC recall responses after peptide stimulation post final vaccination is not the way forward, since no response is detected (Figure 2). future studies can now take an alternative approach. e.g. since unstimulated PBMCs (vehicle control) from RTS,S vaccinated children were different from those who received a comparator vaccine (Figure 2) RTS,S vaccine signatures could be picked up much more easily by whole blood RNAseq.

      It implicates innate immune cells in shaping an individuals response to a vaccine - an exciting basis for future functional and mechanistic studies.

      We are glad the reviewer appreciates the value of the study.

      Reviewer #2 (Public Review):

      This paper reports a sub-study of the RTS,S/AS01 malaria vaccine Phase 3 trial, which aimed to identify groups of genes (blood transcriptional modules, BTMs) for which expression in DMSO or antigen-stimulated PBMCs was associated with clinical malaria during a 12-month follow-up period. Study subjects were infants and children who received either RTS,S/AS01 or comparator vaccines (meningococcal C for infants, rabies vaccine for children), enrolled in the study in Tanzania and Mozambique (with some additional analyses using samples from Gabonese infants).

      Using PBMCs collected at baseline before vaccination and 3 months later (a month after the third vaccine dose), stimulated with DMSO or parasite antigens, the authors used RNA-sequencing to identify BTMs which were different between recipients of RTS,S/AS01 vs comparator vaccines; which were different between baseline and month 3 in RTS,S/AS01 recipients; and which differed between RTS,S/AS01 recipients with a malaria episode and those without a malaria episode during the follow-up period. This combination of analyses might help to distinguish BTMs specifically associated with RTS,S/AS01 vaccine efficacy from those associated with other factors influencing susceptibility to malaria. To further aid mechanistic understanding the authors examined correlations between BTMs and measures of cellular and humoral immune responses. To try to establish generalisability the authors examined whether BTMs identified in African children were also associated with developing malaria in RTS,S/AS01-vaccinated malaria-naïve adults in the United States who underwent controlled human malaria infection (CHMI).

      Strengths of the study include:

      1) The relatively large number of subjects, the large amount of transcriptomic and immunological data which has been generated (and made publicly accessible), and the extensive analysis to evaluate associations between BTMs and numerous immunological variables.

      2) Clear explanation of both the rationale and methods for most of the analyses

      3) The attempt to validate findings in the CHMI studies

      4) Matching of subjects to try to eliminate the confounding effects of age, study site, and time of vaccination

      Weaknesses of the study include:

      1) Despite the relatively large size of the study, it is hard to know whether it had sufficient power to achieve its main objective, and we are not presented with data to demonstrate how successfully the authors managed to match subjects for age, timing of vaccination and follow-up duration

      We have added the following to our “limitations” paragraph in the Discussion: “Fourth, despite the relatively large size of the study, our statistical power was limited by the number of malaria cases with available samples; sampling additional controls would not have increased our statistical power.”

      Moreover, we now also provide the new Supplementary Table 1, which provides complete information on participant match ID, site, age cohort, sex assigned at birth, and time of vaccination.

      2) The comparator group to the RTS,S/AS01 vaccine is not a single vaccine, but two vaccines, but the presentation of the data makes it difficult to identify what effect this may have had on the results

      Indeed, comparators received a rabies vaccine or the meningococcal C conjugate depending on the age cohort. However, we think that the impact on the study results and conclusions is minimal since the main results are based on baseline gene expression and its association with malaria risk within RTS,S vaccinees. Correlates of malaria risk in comparators are done separately. Comparator vaccination may be a confounding factor for age cohort, but we are not analyzing the effect of age cohort on the transcriptional profile. Comparators are only included in the analysis of RTS,S immunogenicity at post-vaccination (RTS,S vs Comparators, Fig 2A, Comparison (1)) and we have adjusted analyses by age cohort and hence by comparator vaccine. The fact that the comparators received different control vaccines only stresses that the BTMs found to be associated with RTS,S vaccination are specific to the RTS,S vaccine.

      Moreover, as an alternative way to identify RTS,S-specific transcriptional responses, we also include Comparison (2), which compares Month 3 to Month 0 transcription levels within RTS,S vaccinees. We include in the text extensive discussion of the merits and drawbacks of each comparison:

      “Two comparisons were done to characterize the transcriptional response to RTS,S/AS01 vaccination: Comparison (1): comparing gene expression in month 3 samples from RTS,S/AS01 vs comparator recipients (month 3 RTS,S/AS01 vs comparator); and Comparison (2): comparing gene expression in month 3 vs month 0 from RTS,S/AS01 recipients (RTS,S/AS01 month 3 vs month 0). Each comparison has its own advantages: Comparison (1) allows the identification of RTS,S/AS01-specific responses while taking into account other environmental factors to which the children are exposed, such as malaria exposure (albeit malaria transmission intensity was low during the study at both sites). Moreover, the very young ages of the trial participants mean that RTS,S/AS01-induced changes may be confounded with normal developmental changes in participant immune systems, further underscoring the value of Comparison (1), as it does not involve comparison across two different time points. On the other side, an advantage of Comparison (2) is that it takes into consideration each participant’s intrinsic baseline gene expression. Comparison (1) uses data from both infants and children, whereas Comparison (2) can only yield insight into RTS,S/AS01 responses in children (as baseline samples were not collected from infants).”

      3) A very "liberal" false-discovery rate (FDR) threshold has been used throughout to define significant associations. An FDR of 0.2 indicates that 20% (or 1 in 5) results which are considered significant will be false-discoveries. This means that the "significant" results must be interpreted with a high degree of caution. Typically researchers use lower FDR thresholds, like 0.05 or 0.01, although one may argue for different thresholds under different circumstances

      While it is not uncommon to use a threshold of 20% for immune correlates studies [e.g. (5-10)], we agree with you that it is important to clearly state the chosen FDR rate and to discuss conclusions in the context of the FDR rate used. We see we could improve our manuscript in this respect. We have added the following:

      Results: “Compared to the 45 BTMs whose baseline levels significantly associated with clinical malaria risk in RTS,S/AS01-vaccinated African children, fewer BTMs (seven) had levels at one month post-final RTS,S/AS01 dose that significantly associated with clinical malaria risk. Moreover, if a more stringent FDR cutoff had been used (i.e. 5%), six of these seven BTMs would not have been identified. Thus it is entirely possible that, at one month post-final RTS,S/AS01 dose, there is no circulating immune transcriptomic signature predictive of risk…”

      Discussion: “Finally, while it is not uncommon to use an FDR cutoff of 20% in high-dimensional immune correlates studies [e.g. (65-70)], our results should be interpreted with the requisite level of caution. However, we do note that many of our significant modules in the baseline risk analysis would have survived even lower FDR cutoffs (in many cases even a 1% cutoff), giving us a fair degree of confidence in our results. For example, of the seven monocyte-related BTMs whose baseline levels associated with risk, all would have survived a 5% FDR cut-off, and three even a 1% cut-off; likewise, of the four dendritic cell-related BTMs whose baseline levels associated with risk, all would have survived a 5% FDR cut-off, and three even a 1% cut-off.”

      Moreover, we have revised Figures 2, 3, and 6 so that it is easy to discern whether a specific BTM correlation would also pass more stringent FDR cutoffs, through the addition of 1, 2, or 3 asterisks where appropriate: “|FDR| < 0.2 (), < 0.05 (), < 0.01 ().” Note that, most central to the key message of the paper, many of the monocyte-related, DC-related, and cell cycle-related BTMs would have passed more stringent FDR cutoffs, with many even passing a 1% FDR cutoff (as discussed above).

      4) A perplexing finding, which is not addressed in detail, is the large number of BTMs which differ between RTS,S and comparator vaccine groups after DMSO stimulation of PBMCs, but these are not seen when PBMCs are stimulated with parasite antigens in DMSO (and a similar finding for month 3 vs month 0 samples from RTS,S recipients). This raises some concern about the stimulation experiments, because one might expect that the DMSO vehicle in the antigen preparations would trigger a similar response to DMSO alone.

      It should be noted that in all our analyses, the stimulated results were adjusted for DMSO to focus on the antigen-specific response only. This would explain why we detect signal in the DMSO samples but not in response to stimulation. We have realized that this was not very well described in the figure captions and the Methods section and have added more details, including the model description in Methods section. As such, we do not believe that these results impact all downstream conclusions. We believe that the unstimulated results provide significant new insights into the immune and molecular mechanisms of RTS,S vaccine efficacy, not necessarily directly related to the RTS,S-specific acquired immune response. We would also like to highlight the fact that we have improved our model specification to directly account for the pairing of some of the samples using a random effect using the limma package. This has slightly increased statistical power, and as such the number of significantly differentially expressed BTMs in response to stimulation is a bit higher (but still much less than that for the DMSO). Originally, we had decided against the use of a random effect due to the computational cost of estimating the random effect.

      The fact that bulk transcriptional profiling of Ag-stimulated PBMCs did not identify almost any significant differences in BTM expression between the RTS,S vs. comparator group could be due to several factors. First of all, the frequency of antigen-specific CD4+ T cells was very low among CD4+ T cells (Figure 4 of the manuscript shows that CSP-specific CD4+ T cells comprise < 0.004% of all CD4+ T cells). This low frequency of CSP-specific T cells is consistent with other RTS,S studies [e.g. as we state on line 330, we have previously found that CSP-specific T-cells in RTS,S/AS01 vaccinees comprise < 0.10% of all CD4+ T cells (1)].

      Moreover, CD4+ T cells themselves comprise approximately 45-57% of all PBMCs (2). Thus, finding an expression signal between the RTS,S vs. comparator group would require the signal to be high enough to be detected in only 0.002% of all PBMCs [0.004% (% CSP-specific CD4+ T cells out of total CD4+ T cells) x 51% (average % of CD4+ T cells out of all PBMCs) = 0.002%]. Thus, lack of detectable recall response does not mean lack of recall response. Moreover, as suggested below, we opted not to focus the rest of the manuscript on the Ag-stimulation results.

      Second of all, the PBMCs were stimulated on site for 12h and then cryopreserved. This stimulation time was chosen based on the kinetics of IFN-g and IL-2 mRNA response (3), but other responses may have had different kinetics and thus have already resolved or have not yet occurred by the 12-h cryopreservation. We have added text in the manuscript to discuss these caveats (“Another potential reason for why no BTMs were found to associate with the response to RTS,S/AS01 vaccination or with protection when analyzing CSP-stimulated PBMC is that all PBMC were stimulated on site for 12 hours (this stimulation time was chosen based on the kinetics of the IFN-g transcriptional response) and then cryopreserved. Thus, we were unable to detect earlier transient responses that had already resolved by 12 hours, as well as more delayed response that had not yet initiated by 12 hours, if such responses occurred.”.

      The authors partly achieved their aims. They identified BTMs differentially expressed between RTS,S/AS01 and the comparator vaccines, and between baseline and month 3 in RTS,S/AS01 recipients. They also identified BTMs at month 3 associated with developing malaria, and BTMs at baseline associated with developing malaria. These latter BTMs were partly replicated in the CHMI study subjects. Higher expression of BTMs associated with monocytes and dendritic cells were most consistently identified across the different analyses and their expression in stimulated baseline samples was most consistently associated with development of clinical malaria in RTS,S/AS01 recipients. However there were inconsistencies in associations between some of the studies, and it is possible that the "consistent" monocyte and dendritic cell BTMs would not be so consistent if a more stringent FDR threshold was used. However the authors conclusions are largely quite measured and for the most part they do not over-interpret the significance of their findings.

      We have added the following to the Discussion: “Finally, while it is not uncommon to use an FDR cutoff of 20% in high-dimensional immune correlates studies [e.g. (65-70)], our results should be interpreted with the requisite level of caution. However, we do note that many of our significant modules in the baseline risk analysis would have survived even lower FDR cutoffs (in many cases even a 1% cutoff), giving us a fair degree of confidence in our results. For example, of the seven monocyte-related BTMs whose baseline levels associated with risk, all would have survived a 5% FDR cut-off, and three even a 1% cut-off; likewise, of the four dendritic cell-related BTMs whose baseline levels associated with risk, all would have survived a 5% FDR cut-off, and three even a 1% cut-off.”

      Overall the work provides some evidence that baseline immunological status, particularly related to monocyte and dendritic cell responses and possibly their role in or response to baseline inflammation, may be a determinant of how well the RTS,S vaccine works to prevent malaria. This provides a basis for further work to optimise the effectiveness of the vaccine. The usefulness of PBMC stimulation to predict an individual's response to vaccination will be limited because this is not a method which can be used at scale in resource limited settings, but the concept that vaccine response could be enhanced by modifying pre-vaccine immunological or inflammatory status is potentially important. The data published with this study will be a valuable resource and will undoubtedly be used by others to address similar questions. Increasing the efficacy of malaria vaccines remains an extremely important goal, and identifying possible mechanisms which restrict the efficacy of RTS,S is important.

      References:

      1. Moncunill G, De Rosa SC, Ayestaran A, Nhabomba AJ, Mpina M, Cohen KW, Jairoce C, Rutishauser T, Campo JJ, Harezlak J, Sanz H, Diez-Padrisa N, Williams NA, Morris D, Aponte JJ, Valim C, Daubenberger C, Dobano C, McElrath MJ. RTS,S/AS01E Malaria Vaccine Induces Memory and Polyfunctional T Cell Responses in a Pediatric African Phase III Trial. Front Immunol. 2017;8:1008.
      2. Kleiveland CR. Peripheral Blood Mononuclear Cells. In: Verhoeckx K, Cotter P, López-Expósito I, Kleiveland C, Lea T, Mackie A, et al., editors. The Impact of Food Bioactives on Health: in vitro and ex vivo models. Cham: Springer International Publishing; 2015. p. 161-7.
      3. Schultz-Thater E, Frey DM, Margelli D, Raafat N, Feder-Mengus C, Spagnoli GC, Zajac P. Whole blood assessment of antigen specific cellular immune response by real time quantitative PCR: a versatile monitoring and discovery tool. J Transl Med. 2008;6:58.
      4. Kazmin D, Nakaya HI, Lee EK, Johnson MJ, van der Most R, van den Berg RA, Ballou WR, Jongert E, Wille-Reece U, Ockenhouse C, Aderem A, Zak DE, Sadoff J, Hendriks J, Wrammert J, Ahmed R, Pulendran B. Systems analysis of protective immune responses to RTS,S malaria vaccination in humans. Proc Natl Acad Sci U S A. 2017;114(9):2425-30.
      5. Liu C, Martins AJ, Lau WW, Rachmaninoff N, Chen J, Imberti L, Mostaghimi D, Fink DL, Burbelo PD, Dobbs K, Delmonte OM, Bansal N, Failla L, Sottini A, Quiros-Roldan E, Han KL, Sellers BA, Cheung F, Sparks R, Chun TW, Moir S, Lionakis MS, Consortium NC, Clinicians C, Rossi C, Su HC, Kuhns DB, Cohen JI, Notarangelo LD, Tsang JS. Time-resolved systems immunology reveals a late juncture linked to fatal COVID-19. Cell. 2021;184(7):1836-57 e22.
      6. Andersen-Nissen E, Fiore-Gartland A, Ballweber Fleming L, Carpp LN, Naidoo AF, Harper MS, Voillet V, Grunenberg N, Laher F, Innes C, Bekker LG, Kublin JG, Huang Y, Ferrari G, Tomaras GD, Gray G, Gilbert PB, McElrath MJ. Innate immune signatures to a partially-efficacious HIV vaccine predict correlates of HIV-1 infection risk. PLoS Pathog. 2021;17(3):e1009363.
      7. Lu P, Guerin DJ, Lin S, Chaudhury S, Ackerman ME, Bolton DL, Wallqvist A. Immunoprofiling Correlates of Protection Against SHIV Infection in Adjuvanted HIV-1 Pox-Protein Vaccinated Rhesus Macaques. Front Immunol. 2021;12:625030.
      8. Haynes BF, Gilbert PB, McElrath MJ, Zolla-Pazner S, Tomaras GD, Alam SM, Evans DT, Montefiori DC, Karnasuta C, Sutthent R, Liao HX, DeVico AL, Lewis GK, Williams C, Pinter A, Fong Y, Janes H, DeCamp A, Huang Y, Rao M, Billings E, Karasavvas N, Robb ML, Ngauy V, de Souza MS, Paris R, Ferrari G, Bailer RT, Soderberg KA, Andrews C, Berman PW, Frahm N, De Rosa SC, Alpert MD, Yates NL, Shen X, Koup RA, Pitisuttithum P, Kaewkungwal J, Nitayaphan S, Rerks-Ngarm S, Michael NL, Kim JH. Immune-correlates analysis of an HIV-1 vaccine efficacy trial. N Engl J Med. 2012;366(14):1275-86.
      9. Fletcher HA, Snowden MA, Landry B, Rida W, Satti I, Harris SA, Matsumiya M, Tanner R, O'Shea MK, Dheenadhayalan V, Bogardus L, Stockdale L, Marsay L, Chomka A, Harrington-Kandt R, Manjaly-Thomas ZR, Naranbhai V, Stylianou E, Darboe F, Penn-Nicholson A, Nemes E, Hatherill M, Hussey G, Mahomed H, Tameris M, McClain JB, Evans TG, Hanekom WA, Scriba TJ, McShane H. T-cell activation is an immune correlate of risk in BCG vaccinated infants. Nat Commun. 2016;7:11290.
      10. Young WC, Carpp LN, Chaudhury S, Regules JA, Bergmann-Leitner ES, Ockenhouse C, Wille-Reece U, deCamp AC, Hughes E, Mahoney C, Pallikkuth S, Pahwa S, Dennison SM, Mudrak SV, Alam SM, Seaton KE, Spreng RL, Fallon J, Michell A, Ulloa-Montoya F, Coccia M, Jongert E, Alter G, Tomaras GD, Gottardo R. Comprehensive Data Integration Approach to Assess Immune Responses and Correlates of RTS,S/AS01-Mediated Protection From Malaria Infection in Controlled Human Malaria Infection Trials. Front Big Data. 2021;4:672460.
    1. Karnofsky suggests that the cost/benefit ratio of how we typically think of reading may not be as simple as we intuitively expect i.e. we think that 'more time' = 'more understanding'.

      If you're simply reading to inform yourself about a topic, it may be worth reading a couple of book reviews, and listening to an interview or two, rather than invest the significant amount of time necessary to really engage with the book.

      A few hours of skimming and reviews/interviews may get you to 25% understanding and retention, which in many cases may be more than enough for your needs of being basically informed on the topic. Compared to the 50 - 100 hours necessary for a deep, analytical engagement with the text, that would only get you to 50% understanding and retention.

      That being said, if your goal is to develop expertise, both Karnofsky and Adler ('How to read a book') suggest that you need a deep engagement with multiple texts.

    1. Author Response:

      Reviewer #1 (Public Review):

      The study aims to investigate the role of A11 neurons in courtship behavior and vocalizations. In particular, the authors determine the inputs/outpus of A11 neurons and uncover that the outputs are both dopamine and glutamate positive. They then lesion A11 cell bodies and terminals in the songbird song-motor nucleus HVC and find that these lesions affect song production, especially, though not exclusively, of courtship song. They also measure the location and movement of lesioned birds and find that birds with lesions of A11 cell bodies show less engagement with a female. Finally, they use fiber photometry to study the activity of A11 terminals in HVC during singing. While this is an interesting question supported by novel data, and I appreciate the diverse and creative approaches employed in this study, the role of A11 in courtship behavior appears complicated and does not easily fit into the framework proposed by the authors. In particular, the authors argue that A11 is important for coordinating innate and learned aspects of courtship, however, their data fall short of supporting this idea.

      Strengths This is an impressive data set with considerable attention to detail.

      The tracing and histology data identify some novel connections not previously described in songbirds as well as the potential of A11 neurons to co-release of glutamate and dopamine.

      Photometry provides real-time monitoring of A11 and HVC neuron activity during singing.

      In principle, targeting both HVC terminals and A11 cell bodies has the potential to lend insight into the role of HVC terminals vs. the role of projections to other areas (see below for caveats).

      We appreciate the reviewer’s efforts and attention in evaluating our manuscript. We are grateful that the reviewer recognizes strengths in our study, which we agree provides novel insights into the brain circuits that enable a fully integrated courtship display comprising learned and innate behaviors.

      Weaknesses 1) While I find the overall question and the data interesting, I am not convinced that they demonstrate that A11 is important for "coordinating innate and learned aspects of courtship". In general, birds with A11 lesions appear less motivated to perform female-directed song, however, it's not clear that this is a consequence of a lack of coordination between innate/learned aspects of behavior. Rather, perhaps A11 neurons are important to instigate or drive courtship behavior, or to relay signals from the POA or other regions important for courtship. Because the lesions abolish behavior, it is difficult to discern the role of these neurons in courtship.

      We agree that discerning the precise role of A11 is tricky. It could be acting to gate a (motivational) drive from another source, providing a primary source of this drive, and/or performing a more intricate role in coordinating the various aspects of the courtship display. The reviewer is correct that the current experiments do not allow us to clearly distinguish between these possibilities, and we have revised the manuscript accordingly, first by replacing “coordinate” with “gate” in the title and introduction and including a more thorough treatment of gating and other possible roles for A11 in lines 258-262 of the discussion. That said, we lean towards the latter possibility - a coordinating role for A11 - because of its location immediately proximal to regions that drive learned (HVC) and innate (ICo, RPgc) aspects of behavior and because A11 neurons can contain synthetic enzymes for a fast acting neurotransmitter (glutamate) in addition to DA. But, ultimately, we acknowledge that future experiments are needed to more completely answer this question.

      In addition, I disagree with the innate vs. learned distinction as recent data indicate that introductory notes, which the authors treat as innate, are actually learned (e.g. Kalra et al., 2021). Further, there is also no quantification of the effects of lesions on female-directed calls and little analysis of the activity during call production. This would seem to further complicate the overall interpretation. Overall, it's difficult to make sense of how A11 activity relates to vocalizations, especially given the innate/learned framework that they focus on.

      We thank the reviewers for drawing our attention to the recent Kalra 2021 paper, which we now cite while also making sure to emphasize that introductory notes may have learned features (lines 194-195 and 278-279). However, even that recent study concluded that males raised without a tutor or tutored on recorded songs that lack introductory notes altogether still developed songs that include introductory notes. Nonetheless, we include citation of this recent study and qualify our characterization of introductory notes as being shaped by innate predispositions and experience. Furthermore, we conducted additional analyses to quantify female-directed calling before and after 6-OHDA lesions in either HVC or A11 (results can be found in lines 164-165 and Figure 4C). In line with the divergent effects of these two types of lesions on the production of introductory notes, lesions in HVC did not affect female-directed calling whereas lesions in A11 largely abolished these vocalizations. While we acknowledge that the fiber photometry data on female-directed calling was limited, it nonetheless reinforces the conclusion that A11 transmits information to HVC about innate vocalizations, and it also transmits information to HVC about introductory notes. Along with the loss of introductory note production following A11 lesions, we do believe that our findings support the idea that A11’s role is essential to female-directed vocalizations generally, regardless of whether they are learned or innate, and of of somehow enabling the transition from production of female-directed calling and introductory notes to motifs. We have done our best to draw out these points in the revised discussion.

      2) The HVC lesions appear to create damage/necrosis (Fig 3-suppl 2) and this raises the question of the degree to which the HVC lesion effects are the result of dopamine/glutamate depletion or local damage. In particular, it is surprising that syllable structure and stereotypy show such a dramatic breakdown with HVC A11 input lesions and effectively no change with lesions of the cell bodies, even though both treatments lead to effectively similar reductions in song production.

      We appreciate that 6-OHDA lesions are not highly specific and can introduce unwanted effects on non-TH+ cells and processes. To further quantify the effects of 6-OHDA lesions on HVC cells, we conducted additional 6-OHDA injections in HVC and TUNEL staining studies in addition to the preliminary efforts we had made in the original manuscript. Quantification of these data confirmed our original impression that 6-OHDA treatment in HVC increased HVC cell death (these data are shown in Figure 3-figure supplement 2J, K). To further address this issue, we also added an analysis of song structure when D1 receptor blockers were dialyzed into HVC. No changes in song morphology were detected, similar to the lack of effects on song morphology following A11 cell body lesions (Figure 3 - figure supplement 3). Taken together, these additional experiments and analyses indicate that the changes in song morphology following 6-OHDA treatment in HVC may arise from local damage to HVC cell bodies. In contrast, the reduction in singing following A11 terminal or cell body lesions is likely to reflect diminished DA signaling from A11. However, as the reviewer notes, our primary finding is the differential effects on female-directed singing, and the distinction between more purely singing-related effects following 6-OHDA treatment in HVC and a broad effect on all courtship behaviors following 6-OHDA treatment in A11.

      3) If the idea is that A11 is important for coordinating innate and learned movements, it seems that a detailed analysis of the movements would be important. As is, the movement data provide further support of a decrease in either the motivation or ability to perform female-directed song, but they do not speak to a more specific role for A11 in coordinating innate and learned movements.

      We maintain that we did provide a detailed analysis of a number of important nonsong behaviors, including changes in head orientation and translational movements that the male makes towards the female, both of which are major appetitive features of courtship in songbirds and other vertebrates. We also appreciate that these analyses do not allow us to say much about precisely how movements are being coordinated during courtship, and we have changed language throughout the manuscript to emphasize a gating rather than coordinating role for A11. Furthermore, in response to the reviewer’s concern, we performed additional analyses of the male’s movements during courtship, including beak wipes, vertical changes in posture (“standing tall”), which are finer components of female-directed displays. Notably, this new analysis reveals that all of these behavioral components are abolished by A11 cell body lesions, but not by A11 terminal lesions in HVC (lines 168-190 and Figure 4I, J). We appreciate the reviewer’s suggestion, as we believe these additional analyses strengthen our core finding, namely that A11 functions as a hub to gate, recruit and possibly coordinate innate and learned movements to generate a complete courtship display. These different roles are more fully considered in the revised discussion (lines 256-262).

      Reviewer #2 (Public Review):

      Ben-Tov et al. investigate function of midbrain region A11 and provide evidence that it plays a role in promoting and coordinating a variety of motor responses to sexually or socially salient stimuli. They show lesions of A11 cell bodies abolish female directed calling, orienting and singing, while lesions of terminals in the song premotor nucleus HVC prevent female directed singing, but leave female directed calling and orienting intact. Together with anatomical data indicating projections from A11 to multiple downstream targets associated with song (HVC), calling (DM/ICO) and locomotion, these data support the authors' idea that A11 forms a 'hub' that drives and 'coordinates' multiple different aspects of behavioral responses to social (here female/sexual) stimuli. The results are intriguing and begin to reveal how a single social context can elicit and coordinate multiple coordinated responses. However, as outlined below, I think that some of the specific stronger claims would benefit from additional data, discussion or moderation.

      The authors also provide compelling support for the idea that A11 plays a differential role in female-directed versus undirected song. This is especially underpinned by the observations that 1) A11 afferent activity in HVC appears to differ between directed and undirected signing, with increases in activity preceding song motifs only during directed song, and 2) lesions of A11 cell bodies or inputs to HVC have a dramatic suppressive effect on directed singing, but can leave undirected song largely unchanged. These observations that A11 differentially contributes to socially elicited versus spontaneous singing seem especially interesting and merit further highlighting and discussion as one of the especially striking aspects of the study that seems distinct from the thesis of a role in coordinating learned and unlearned behaviors.

      We appreciate the reviewer’s efforts and attention in evaluating our manuscript. We are grateful that the reviewer recognizes strengths in our study, which we agree provides novel insights into the differential contribution of A11 to socially elicited versus spontaneous singing. We also agree that this point should be highlighted and we expanded our treatment of this point in the discussion section of the revised manuscript (lines 296-309).

      Specific comments

      A central idea around which the results are discussed is that A11 plays a particular role in coordinating learned versus innate behaviors. I have several questions around this thesis where further guidance from the authors about both technical points and interpretation would be helpful.

      First is the question of how specific are the manipulations and conclusions to A11 itself versus other neighboring midbrain dopaminergic regions within which it is embedded. The authors show histology of lesions, injection sites and retrograde labelling in supplementary figures, but do not provide enough guidance for me to understand the strength of the argument that manipulations are restricted to A11 and/or its afferents. Can the boundaries between A11 and neighboring regions be better demarcated? What are the neighboring regions to which there might have been spillover? For lesions of A11 axons within HVC, wouldn't 6-OHDA also damage any other dopaminergic afferent to HVC, including those coming from regions such as VTA? Some discussion of these and related points regarding the specificity of manipulations to A11 would be helpful, especially in light of the literature that points to potential roles of neighboring dopaminergic regions in contributing to motivated behaviors and song more specifically.

      We appreciate that the definition and boundaries of A11 might be confusing. We demarcated A11 and neighboring regions in the relevant figures to better define A11’s boundaries. The reviewer is correct in surmising that the VTA is fairly close to A11 and hence a reasonable concern is that 6-OHDA treatment in A11 could spill over to the VTA and possibly the SNc. To address the concern that 6-OHDA lesions in HVC might cause cell damage to other DA sources to HVC, we quantified the number of VTA/SNc cells following HVC DA lesions. This additional analysis, provided in Figure 3-figure supplement 1D-F, shows that the number of VTA/SNc cells following 6-OHDA injections into either A11 or HVC is comparable to that of intact birds. These additional analyses support the conclusion that the behavioral deficits that emerge following 6-OHDA treatments reflect damage to A11 or A11 terminals in HVC.

      These points also relate to the general question of what is meant by A11 being a 'hub for coordination of learned and innate courtship behaviors'. Ultimately, it seems likely that many regions must work together to orchestrate these behaviors, and it is not clear from the present results how much I should view A11 as having a more specific role than other neighboring dopaminergic regions (or hypothalamic regions such as POA) that are interconnected and seem likely to also play critical roles. As the authors note, many of the relevant structures, including A11 and song system structures, are recurrently connected, further complicating interpretation of any one area as a hub. In this respect, I am not sure how much the authors are intending to argue that A11 is both necessary and sufficient for driving each of the studied behaviors in a courtship context, and it would be helpful to discuss this more specifically - does 'coordination' as used here imply that A11 is capable of triggering these behaviors - an interesting possibility raised by the current results but that does not yet seem to be demonstrated - or something else?

      As we noted in our response to a similar point made by the first reviewer, we agree that discerning the precise role of A11 is tricky. As we commented in that earlier response, A11 could gating a (motivational) drive from another source, providing a primary source of this drive, and/or performing a more intricate role in coordinating the various aspects of the courtship display. We agree that the current experiments do not allow us to make a clear distinction between these possibilities, and we have revised the manuscript accordingly, including a more thorough treatment of these various roles for A11 in the discussion (lines 256-262). That said, we lean towards the latter possibility - a coordinating role for A11 - because of its location immediately proximal to regions that drive learned (HVC) and innate (ICo, RPgc) aspects of behavior and because A11 neurons can release a fast acting neurotransmitter (glutamate) in addition to DA. But, ultimately, we acknowledge that future experiments are needed to more completely answer this question. In the revised manuscript, we emphasize a gating role for A11 in the title and introduction, and then in the discussion expand to encompass the possibility of a coordinating or timing role for A11.

      One additional question regarding the framework for interpreting the function of A11 as coordinating 'learned and innate' courtship behaviors, is for some further clarification and citations regarding what is learned versus innate, especially as it relates to song. The authors characterize introductory notes as 'innate', but previous work from Rajan and colleagues has demonstrated that aspects of introductory notes including acoustic structure and patterning are influenced by learning, and I am not sure what the literature says about orienting and calling to females.

      We thank the reviewer for drawing our attention to this recent study from the Rajan group which indeed concluded that some aspects of the introductory notes are learned. We also note that this study showed that juvenile males tutored on song playbacks that lacked introductory notes or that were raised without a tutor still produced introductory notes. Nonetheless, we include a citation of this recent study and qualify our characterization of introductory notes as being shaped by innate predispositions as well as through experience and learning (lines 194-195 and 278-279). Furthermore, our original analyses of birds with 6-OHDA treatment in HVC revealed that introductory note morphology was unchanged, whereas syllable morphology was degraded. Therefore, even if certain features of introductory notes are influenced by tutor experience, they apparently do not depend on HVC in the same manner as do the learned syllables in the motif. Lastly, we conducted additional analyses to quantify female-directed calling and other movements, before and after 6-OHDA lesions in either HVC or A11. In line with the divergent effects of 6-OHDA treatment in these two regions on the production of introductory notes, lesions in HVC did not affect female-directed calling, beak wipes or changes in male’s posture, whereas lesions in A11 largely abolished all of these behaviors (Figure 4C, I, J). While we agree with the reviewer that a distinction between innate and learned behaviors may not be straightforward, the more fundamental observation is that we can dissociate different aspects of the courtship display and that A11 is situated in a position to drive, gate or coordinate a unified display that involves a variety of learned and innate vocal and non-vocal movements.

      I also would find it helpful to have some further clarification in this context about what it means to coordinate learned and innate aspects of song. The authors indicate that undirected song is largely unaffected by A11 lesions while directed song is largely eliminated, leaving only innate calls or introductory notes. I think it would be helpful to see here a more complete characterization of the nature of vocalizations that remain following A11 lesions in the female directed context. While I understand that no recognizable 'learned motifs' are produced, it is unclear from the example that is shown how much the residual vocalizations should be construed as 'severely disrupted songs' versus strings of calls that resemble innate calls that were present prior to lesions, versus 'normal' patterns of introductory notes that resemble in acoustic structure what the birds produced prior to lesions, but that never proceed to song motifs, etc. A better understanding of the nature of these residual vocalizations might also help to interpret what A11 is doing. Do these birds seem motivated to 'sing' in terms of their posture? Do the authors think that HVC is engaged or that the same residual vocalizations would be produced in a bird that had HVC lesions? How do the authors interpret these data in terms of how learned and unlearned vocalizations are normally coordinated in the context of directed singing?

      We performed additional analyses of the male’s vocalizations and movements during courtship, including female-directed calls, beak wipes, vertical changes in posture (“standing tall”), all of which are components of female-directed courtship displays. Notably, this new analysis reveals that all of these behavioral components are abolished by A11 cell body lesions, but not by A11 terminal lesions in HVC (lines 168-190 and Figure 4C, I, J). Along with our prior report that males with A11 cell body lesions do not sing female-directed motifs, the additional analysis indicates that these males produce little or no female-directed vocalizations or non-vocal behaviors of any kind.

      We previously reported that males with A11 terminal lesions produced only introductory notes but not motifs but realize that this observation would benefit from more quantification. As noted in the previous response, we previously established that introductory note morphology was unchanged by 6-OHDA treatment in HVC (Figure 4 - figure supplement 1A-D). To extend this analysis further in this revised manuscript, we built on the observation that males with 6-OHDA treatment in HVC produce only introductory notes to females, with no song motif, whereas they produce a series of introductory notes followed by motifs comprising distorted syllables when alone (Figure 3K, Figure 3 - figure supplement 2, Figure 4B). To confirm that the directed introductory notes and undirected syllables were indeed distinct vocalizations, we computed their durations and spectral similarity scores (using Sound Analysis Pro). The introductory notes produced during directed conditions differed markedly in their durations from distorted syllables produced during undirected conditions, and these two types of vocalizations had very low similarity scores, indicating that they were cleanly separable vocal behaviors (Figure 4 - figure supplement E, F). Given that introductory notes are unchanged by 6-OHDA treatment in HVC, these analyses support the idea that males treated in this manner can still produce motifs, albeit distorted ones, when alone but not when in the company of a female.

      These questions relate in part to that of how much is the trigger to sing eliminated by A11 afferent lesions versus the ability to produce the relevant song output? It seems like there may still be a trigger to sing - short latency vocal response to female - but inability to produce motif. One point that may be interesting to note in this regard is that this seems somewhat opposite of observations made in other contexts about the effects of directed versus undirected context on song - for example, juveniles can produce better song when it is directed (Kojima), and deafened birds that are beginning to exhibit song deterioration can exhibit normalization of song structure during directed conditions (Nordeen).

      We agree with the reviewer’s point that birds with 6-OHDA lesions in HVC may still be triggered to sing, but are unable to produce a motif, given that they still produce introductory notes and seem to have the right posture, orientation and proximity to the female. We appreciate the reviewer’s comment regarding changes in song that can be elicited by females in either juvenile males or adult males that are deaf, although these additional contexts fall outside of the current study, which focused on adult male finches with normal hearing.

      Reviewer #3 (Public Review):

      The authors use a combination of quantitative acoustic and other behavioral analyses to evaluate the role of the midbrain dopaminergic area A11 in the production of female-directed song in adult male zebra finches. They show that female-directed courtship displays, which consist of song and the production of female-directed displacement behaviors, are dependent on A11 because targeted chemical lesions of this structure, using 6-hydroxydopamine (6-OHDA), permanently (i.e. for at least several months) eliminate both the vocal and non-vocal elements of this behavior. Destruction of A11 axons that directly target HVC, by administering 6-OHDA into HVC, only eliminates female-directed singing without causing any change in the other observed female-directed behaviors. Because these same lesions only temporarily (5-10 days) abolish undirected song, these findings suggest that A11 is not directly involved in song production but acts instead as a gate for the production of female directed courtship behaviors. The authors follow these lesion studies with fiber photometry-based calcium imaging of A11 axons that target HVC to show that A11 activation patterns precede activity in HVC during female-directed singing and that calcium elevation is primarily elevated during the production of the many introductory notes (a component of song that is primarily observed during female-directed singing) that precede the production of the learned song motif. These findings suggest that A11 inputs to HVC likely play a role in triggering and/or activating HVC to synchronize the production of introductory notes (which are likely produced by midbrain circuits) with the learned song component that immediately follows them. In contrast, activation of A11 axons during undirected song (which contain few to no introductory notes) do not precede HVC activation patterns. Consistent with the rapid transmission of A11 neurons, the authors also confirm, as has been suggested for A11 in mammals, that A11 dopaminergic neurons co-release glutamate.

      The findings of this study are of significant interest to our understanding of the neural mechanisms by which these complex behaviors are synchronized and open up a new way of thinking about how learned behavioral motifs can be synchronized with non-learned (e.g. female displacement behavior) behaviors. The study is rigorous, with many different experimental approaches being used to examine the proposed hypotheses, and the findings are convincing. Particularly impressive is the complete elimination of female-directed courtship behaviors following targeted elimination of A11. The primary weaknesses of the manuscript lie (1) in the way they present their anatomical findings and (2) how the authors discuss their findings in the discussion. In the discussion, which is very short (~750 words), the authors miss the opportunity to draw parallels with similar studies in drosophila (they only provide a cursory statement with a few references). In the discussion, the authors propose a model that seems quite oversimplified and lacks, in fact, many of the anatomical connectivity that they show in the first part of their study (for example A11 is only shown having a unidirectional connection to ICo/DM when in fact the connections are bidirectional). The model is also presented in simple hierarchical fashion with many connections omitted. Perhaps these omissions were made to simplify the model but in my opinion such simplification possibly misrepresents the actual mechanisms involved in the coordinated control of courtship song.

      We thank the reviewer for their careful reading of the manuscript and his supportive and constructive comments. We agree that the loss of all female-directed behaviors (which we now extend to female-directed calling and other non-vocal behaviors, such as beakwipes and postural changes) following A11 cell body lesions is especially intriguing. Further, the different effects of A11 cell body lesions and A11 terminal lesions in HVC, along with the connectivity of A11, indicate that A11 acts via a range of downstream sites to gate these various female-directed behaviors. We have done our best to address the two primary weaknesses identified by the reviewer. First, we have done our best to provide a more detailed accounting of the anatomical findings. Second, we have expanded the discussion to address parallels with other studies, as in the fly, and to provide a more nuanced and complete consideration of how A11 may function to facilitate male courtship behaviors.

    1. Author Response:

      Public Review:

      This manuscript from Pacheco-Moreno et al. compares the microbiome of potato fields with and without irrigation. Irrigation is known to control potato scab caused by Streptomyces scabies and the authors hypothesized that changes in the microbiome may contribute to disease suppression after irrigation. Using 16S rRNA sequencing, they identified a number of taxa, including Pseudomonas that are enriched after irrigation. They went on to isolate and sequence the genomes of many Pseudomonas strains. By correlating the ability of Pseudomonas to suppress Streptomyces growth in vitro with genomic data, the authors identified a novel group of cyclic lipopeptides (CLPs) that can inhibit Streptomyces in vitro and in planta.

      This work provides a substantial contribution that advances our understanding of disease suppressive soil mechanisms. It is novel in scope in that it focuses on suppression of a bacterial pathogen, while many prior studies focus on suppression of fungal pathogens. Additionally, the large-scaled comparative genomics is a useful resource, and the identification of CLPs that inhibit Streptomyces is novel. Importantly, the authors provide in planta data to show role a for CLPs in disease suppression in vivo. The manuscript is well written and the data are well presented. The analyses are quite thorough and I appreciate the extensive use of genetics and metabolomics to support the genomic predictions. The main weakness is a lack of data the conclusively links the change in microbiome function to disease suppression after irrigation in the field. However, I think the data they've presented, combined with those in the drought literature, might suggest that an increase in total Pseudomonas (and the corresponding disease-suppressive genes) in well-watered soil might contribute to suppression, rather than a change in function of Pseudomonas.

      While the reviewer is correct that we cannot conclusively link disease suppression to a change in microbiome function after irrigation, we are confident that our results demonstrate a real and repeatable phenomenon that must be considered in future studies of soil scab suppression. Independent field experiments conducted two years apart both show a decrease in the proportion of suppressive pseudomonads associated with potato roots. The first experiment (Figures 1 & 2) contained too few sequenced isolates to draw statistically robust conclusions, therefore we designed the second experiment (Figure 8) to investigate this phenomenon further. This experiment showed highly significant differences in the proportion of suppressive isolates on irrigated and non-irrigated roots. The alternative hypothesis presented by the reviewer; that relative Pseudomonas and Streptomyces abundance are affected by irrigation and this may be a factor in scab suppression, is also a valid possibility, although relatively small abundance changes were observed in the data reported in Figure 1. We have amended the discussion to include this as an alternative explanation for our results.

    1. Author Response:

      Reviewer #1:

      For this manuscript, I focused on the metabolite analysis. The data is presented as supporting a common response based on shared selective histories if I'm understanding properly. However, primary metabolite data is hard to interpret in the same fashion as genetic data. This arises because of the high degree of pleiotropy wherein it is very hard to find a mutant or variant that doesn't alter primary metabolism. As such, it is possible that there is a common response less because of shared history and more because there is constraining selection that shapes what is the optimal primary metabolite response to cold in photosynthetic organisms. For example, in Arabidopsis, it has been found that accessions tend to have a highly similar primary metabolism but when they are crossed, the progeny have a vastly wider array of primary metabolism phenotypes, suggesting that the similarity in accessions is not shared genetics but constraining selection that forces compensatory variants. I don't think this detracts from the utility of including the primary metabolism but it would help to have more clarity in the strengths and weaknesses in using metabolite data to track theories and arguments that are largely genetic based.

      We fully agree with the reviewer. The idea of constraining selection is at least as interesting as our explanation, and should be in the forefront. Given this interesting idea of compensatory mutations that are private to each accession (or ‘lineage’ or ‘line’), in principle this idea also hints towards the parallel/convergent evolution (‘constraining selection’ in the reviewer’s words) of this important trait or trait complex. We re-phrased this within the manuscript and considered this comment seriously throughout. We also incorporate into our manuscript this interesting compensatory variant notion and metabolic network pleiotropy.

      One difference we would like to highlight still is that in our study (compared to Arabidopsis thaliana studies) we are comparing across many different species, ploidal levels, and varying species-level evolutionary histories. This makes our experiment different from Arabidopsis thaliana ecotype experiments and crossings; but indeed the reviewer is fully right that our results may also follow a similar evolutionary path as for Arabidopsis thaliana.

      Reviewer #2:

      Cochlearia, and other species that have rapidly evolved new ecological niches, represent excellent systems to study adaptation to past, present, future and changing environments. Furthermore, reticulate evolution within such groups offers a natural experiment to test hypotheses about the roles of hybridization, introgression, etc. on evolutionary dynamics, including pre-adaptation. However, there are also several significant challenges to using such systems, most crucially separating adaptation as the causal mechanism from the wide array of non-adaptive processes that could also cause the observed patterns. Overall, Wolf and colleagues do a nice job describing this complex taxonomic system and provide multiple lines of inquiry into how observed patterns may align with various adaptive scenarios. Despite the strong descriptive framework, I had trouble understanding exactly how causality could be assigned. Thus, the interpretation and discussion of the results felt speculative.

      Thank you for the encouraging comments. Yes, we agree: the points towards an important aspect of this kind of phylogenetic-systematic-evolutionary research, namely demonstrating causality. Honestly speaking, in such studies we are not able to show causality in its strict sense, and we think that the reviewer wants to claim this without using quite so strong wording. We considered this while re-phrasing respective paragraphs and also town down some speculative conclusion.

      Reviewer #3:

      There has been intense interest in how plants have responded during periods of rapid climate change in the past. Understanding these responses can increase our understanding of how plants might respond to rapidly accelerating anthropogenic climate shifts and help set conservation priorities. Many paleoecological studies have provided insight on how plants have migrated and persisted in suitable climate refugia (i.e. pockets of suitable habitat that exist even if regional climate is unfavorable for the persistence of a species) throughout glacial cycles, however there has been considerably less work that details the evolutionary dynamics of plants during these periods. This piece provides timely and valuable analyses illustrating the potential influence of pronounced climate change on the evolutionary dynamics of the genus Cochlearia.

      Thank you for the encouraging comments.

      The authors' use of cytogenetic analyses, organellar phylogenies, and demographic modeling allows for insights into the geographic patterns of diversity, speciation rates, and postglacial expansion scenarios of Cochlearia. Drawing unique conclusions from these different lines of evidence provides new understandings into the putative role of Pleistocene glacial cycles in driving evolutionary processes such as speciation. The study also aims to provide insight into the origins of the stated putative cold tolerance exhibited by Cochlearia by using a metabolomics approach; however, the framing and use of a single related outgroup (sister genus Ionopsidium) obfuscate the link between the results and stated conclusions.

      We appreciate this point, but indeed there is no other outgroup to be used. In this study we included all (both) genera with most of its species of tribe Cochlearieae. Within a family- wide phylogenetic context this tribe is placed along a polytomy (together with not well resolved other tribes) and stem group age of Cochlearieae is of appr. 18.9 million years ago (Walden et al., 2020). Therefore, for our research question additional outgroups from other tribes will not contribute any further information, because more basal splits are then nearly 20 million years ago (Early Miocene) with no biogeographic and environmentally defined scenarios that can be compared. 16-23 million years ago most tribes of evolutionary lineage II underwent an early radiation with highest net diversification rates (Walden et al. 2020) during this time. We included some of this information into the introduction.

      Specifically, regarding the approach that resulted in figure 4 which encompassed the metabolomics and related analyses, the initial climate groupings into 'climate ecotypes' would benefit from clarification and consideration of assignment methods. Typically, using the term ecotype invokes the idea of distinct forms of a species with phenotypic differences adapted to local conditions rather than groupings to those under broad climate regimes. While grouping populations according to climate origin can be useful, it is not clear how the final 9 WorldClim bioclimatic variables were selected (e.g. it is not apparent how importance of or correlations between climate variables, etc. were considered). Consequently, knowing this information would help understand the patterns in figure 4b, which seems to indicate that geographically distant populations experience very similar climate conditions (understanding that similarities can exist but variable selection can greatly influence these patterns).

      Thanks for this reminder to explaining selection and analyses of BioClim variables.

      As for the term “ecotype”: In plant taxonomy ecotypes are often referred to on subspecies level, in particular if environmental conditions are extremely different (e.g. heavy metal contaminated versus not-contaminated soils) and often these subspecies do not significantly differ in morphology (Noccaea caerulescens, Minuartia verna). In Cochlearia morphology is at best a morphospace which is more or less shared between all species in different ways. Species definition and taxonomy is based on a combination of largely overlapping morphospace, cytotype, ecotype and habitat types (bedrock; arctic, lowland to alpine; soil type and salt, life cycle) and distribution – often sole morphology is a bad species predictor (morphologically cryptic species – this is well-known also for some other arctic species such from the genus Draba). But the reviewer is fully right, that using the term ecotype here is somehow misleading. Our idea was to highlight that groups of taxa are combined by bioclimatic variables (and biomes or habitat types) while spanning the entire species/ecotype space of the genus – and this grouping follows also evolutionary meaningful cluster. We clarified this.

      As for selection of BioClim variables: we agree, indeed selection might have appeared arbitrary to the reader. Our original selection followed our field and cultivation experiences. However, structuring into four clusters as originally shown with the first submission is robust also when including all 19 BioClim variables. The same four cluster are retained in PCA, when temperature related BioClim variables are used only.

      Therefore, we added a Principal Component Analysis as starting point for Bioclim variable selection, secondly we added a PCA using temperature related BioClim variables 1-11 only. Built upon this we added a sentence why our nine selected variables were used to highlight the four groups in Fig. 4. The two PCA scree plots (including vector data) plus the correlation matrix and the results of a KMO test (Kaiser-Meyer-Olkin test: testing significant difference between the correlation matrix of variables and an identity matrix) are additionally provided with the Suppl. Material.

      The other concern is in regards to the framing and interpretation of these results. For instance, in the results (lines 329-330) and discussion (lines 419-423), the impression is given that experimental results here match those found in plants belonging to a different genus (i.e. Arabidopsis). However, rather than attributing this to more generally conserved mechanisms in response to considerable cold stress, the authors relate this to the unique history of Cochlearia (and its relationship to the drought adapted sister genus). The authors also note that surprisingly there was no demarcation of cold responses between the climate-defined groupings. Detailing why this is surprising given some of the other conclusion statements would be helpful. Some targeted revision to strengthen this link would be useful to bolster the inference of about the origins of cold tolerance in Cochlearia, rather than making it seem like this result could be expected in other taxa.

      Thank you for this. We agree that we did not explain our reasoning as well as we could and we now have reworked this. Original lines 329-330 simply refers to the (expected) and obvious general response to cold – some explanatory text has been added, e.g. such as at the end of the discussion and directly with the above-mentioned lines.

      Lastly, another area that would benefit from some clarification and tightening is revisiting the connection between the results and stated conclusions. For instance, some of the statements from the introduction and conclusions indicate the reader might expect explicit niche exploration analyses and more detailed genomic approaches. It is not abundantly clear for a general audience how these results definitively demonstrate how genetic diversity was rescued in reticulate and polyploid gene pools or species barriers were torn down. These are very specific, strong claims that do not appear to be explicitly discussed outside of the introduction/discussion or directly related to the results presented in this manuscript.

      Thank you for pointing out how this could be read in this way. We have revised this to indicate that agree: we do not think our data ‘definitively demonstrate’ (in the reviewer’s words, not our) this. We modify the text to avoid such interpretation.

      This is no way diminishes the considerable effort of the authors to conduct the informative array of presented analyses, but more closely aligning the conclusions within the scope of presented results (or providing direct links on how the results provide these insights) would help increase the effectiveness of this manuscript.

      Many thanks for this very encouraging note. We have worked to incorporate these thoughtful comments.

    1. When absent in teacher education programs and national policies, it is little wonder that many English teachers may be both stymied and fearful about addressing the civic, healing needs of classrooms

      This is very interesting because during my teacher preparation program here at UIC, we often were covering SEL and trauma-informed lessons, but I don't think anything can truly prepare teachers for the way our society is built on trauma of BIPOC folx. For example, many of our trauma-informed pedagogies are centered around student wellness and trauma they experience on a personal level, and while we may beat around the bush that the real problem are social oppressive systems and their impact on students, it feels very rare that we are examining how trauma is ingrained in every aspect of our society for Black and Brown children. For example, none of us were prepared to support students through the trauma of Covid-19, but the trauma that Black and Brown students are experiencing from Covid-19 is very different from the experience of many white families, and that is, again, because of the oppressive systems that we know of but don't fully examine as being the reason why students have so much trauma.

    1.  So what gets in the way of our pursuit of it? I think we most often resist going through the process of mastery  for two reasons: it can be deeply uncomfortable along the way and we doubt our ability to become expert.

      I think that this statement is 100% true. When people first start to get into new things and new skills then it probably seems very weird at first. For example if it's a sport then you're not going to be used to it after. It may feel uncomfortable because it's something that is new for you and your body/mind has to get the chance to adapt to it. As time goes on you gradually start getting better and better at this skill and it becomes a hobby or like the title states...something you're really good at.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Point-by-point description of the revisions

      Reviewer #1 (Evidence, reproducibility and clarity (Required)): Hello, we wrote our review before seeing that you have special formatting requirements. We're just going to post our review in it's entirety rather than rewrite it based on these suggestions. It encompasses the above content, it's just not formatted in the suggested order. We hope that's OK! **Full review:** This manuscript makes a strong case for the evolvability of multicellular size via selection for settling rate in the icthyosporea. The use of an experimental evolution framework to assess the evolvability of multicellular phenotypes, using sedimentation rate as a selective pressure, extends the previous work of others into a new domain within the holozoan and the closest living relatives of animals. The natural, ecological significance of selection for sedimentation rate is a novel idea, and the connection between sedimentation rate and multicellular evolution in natural as opposed to contrived experimental circumstances is an interesting idea. The results are striking and well supported, with laboratory evolution rapidly adjusting both the cellular composition and the multicellular phenotypes of the organisms involved in ways that are well explained. This is an important result that brings the laboratory study of the evolution of multicellularity forward, into a different branch of the tree of life and showing its broad applicability. Sequencing of evolved lines adds significantly to the completeness of the story. While the causal role of these mutations in the production of the observed multicellular phenotypes are not demonstrated via manipulation or breeding, this is quite understandable in the light of the unusual model organism and the observed homologies and role of the genes involved. While this is largely clear from a reading, we believe the manuscript would benefit from a brief analysis of the numerical enrichment of genes with homologs involved in cytokinesis, cell membrane composition, and cell cycle control relative to the null hypothesis of genes picked randomly from the genome. If this is beyond the scope of this research in an unusual model organism with many poorly annotated genes, then a slightly expanded verbal discussion of the potential roles of the apparent functions of these genes in the evolution of multicellular clumping would be an appropriate substitute. We wholeheartedly recommend the publication of this manuscript with a number of minor revisions, which while not affecting the main conclusions or points of the manuscript will clarify important points, adjust small errors, and point the reader at relevant literature and concepts.

      ANSWER__: We would like to heartily thank the reviewers for their appreciation of our work. __

      **Major points:** none. **Minor points:** Line 79 - is sedimentation rate really invariably associated with multicellularization? Active swimming would seem to prevent this.

      ANSWER__: We meant to refer to the fact that all published examples of the emergence of multicellularity from unicellular ancestors have been accompanied by an increased sedimentation rate. Active swimming alone would just increase the diffusion rate of cells and not counteract the effects of increased size and density; such an active mechanism would also require directionality away from the tendency to sediment. A more passive mechanism, whereby a genetic variant, or cell cycle transition, which simultaneously causes a relative decrease in density while increasing cell size, leaving the net sedimentation rate the same as the ancestor, while conceivable, has not been observed in the literature. We changed the text from “invariably” to “frequently” at line 80 to emphasize how this is an empirical observation.__

      Line 164 - the precise phenotype in the evolution experiment being referred to is unclear without further context, with the ordering of paragraphs possibly needing a little work.

      ANSWER__: We tightened the paragraphs and merged both, the sentence containing “this phenotype” was removed.__

      Line 178 - is sorting them into three classes informative? Are there different mutations associated with these, or is it just visual clumping on the numberline? Perhaps not a useful classification, but the existence of great variation is an important point to get across. A more useful classification might be those that increase sedimentation with large density changes versus exclusively by clumping.

      ANSWER__: We agree with this argument and ultimately decided to remove the visual classification. We revised the text and figures accordingly.__

      Line 254 - excess cellular density is referred to interchangeably with density, when these are very different figures. This continues in line 269, and in the figure legends of Figure 4.

      ANSWER__: We fixed this.__

      Line 341 - the rule of RCC1 homolog in other organisms could be expanded on in slightly more detail. Similarly, other mutations in this same section known to affect cytokinesis could have potential mechanisms for affecting clumping commented upon, especially given the cell membrane results in the figures.

      ANSWER__: We share the reviewer’s enthusiasm about some of these mutations. We, however, try to be very conservative about what each gene or protein could be doing. Indeed, the absence of genetic tools does not allow us to directly test the effect of each mutation. We added a couple of extra sentences about RCC1 as well as about cytokinetic proteins and their potential role in clumping phenotypes.__

      Line 387 - awkward formatting or sentence structure, with dashes and commas.

      ANSWER__: We fixed the sentence structure.__

      Line 395 - this cellular process, or this evolutionary process of selection for faster settling?

      ANSWER__: We revised this appropriately.__

      Line 408 - per unit volume

      ANSWER__: Fixed.__

      Line 425 - the idea of clumpiness as ancestral is quickly put forward and dismissed within a single sentence. This could be explored in slightly more detail as an option, before concluding that what is clear is that the phenotype is easy to change.

      ANSWER:__ We agree that it would be interesting to pursue the ecological role and distribution of clumping and cell cycle phenotypes for other species in the Ichthyosporea genus. We could propose alternative scenarios of which trait came or went first and test this hypothesis by calculating the correlation of the presence or absence of the trait with the branch lengths and branching patterns of phylogenetic trees we have built using genome sequences. However, for our dataset, this would nonetheless remain a fragile correlation consisting of five data points. We do not feel such speculation is helpful for the text.__

      However, because two reviewers have mentioned or suggested in this direction, we expanded the discussion and annotated the tips of the species tree in figure 5 with the traits of interest. The result shows that S. gastrica, S. tapetis and S. nootkatensis species exhibit clumpiness as a trait. However, the data is not enough to resolve whether the traits are “derived” or “ancestral”.

      Line 437 - sedimentation as a highly variable trait, or a highly evolvable trait?

      ANSWER__: Evolvable trait. We fixed it in the text.__

      Figure 1G, 1H: We are fairly certain that the logarithmic scale of DNA content and coenocyte volume are mislabeled. The scale that is labeled log2 in 1G in the legend goes up by factors of 2 rather than single digits. The axis is obviously logarithmic, and the log2 in the legend is superfluous and misleading. Similarly, in 1H a scale labeled as log10 goes from 1 to 30, which on a logarithmic scale would be a sphere approximately 100 kilometers wide. The numbers can remain, but the legend should remove the log10.

      ANSWER__: Fixed. It is indeed a log scale. We made sure to remove the confusing log2 and log10 from figure and legend.__

      **General:** Were there any head to head competitions performed? Not suggesting you need to, but it's a nice way to directly examine fitness consequences of multicellularity, and is commonly done in the field. If you have done this it wasn't clear to us.

      ANSWER__: We now included a fitness experiment previously performed using the clumpy S01 and S03 in a head-to-head competition with the Ancestor (AN). The results are shown in Figure 2E and Figure 2 – figure supplement 1D. The results reflect how the fast-sedimenting clumpy phenotype is highly advantageous in our experimental evolution selection procedure, however deleterious in the absence of selection.__

      Reviewer #1 (Significance (Required)): see the above comments about writing the review before realizing there were specific formatting suggestions. I hope you understand us not wanting to re-write the review having already written it once.

      Reviewer #3 (Evidence, reproducibility and clarity (Required)): The present work adds to the growing literature on sedimentation rate as a major player in the evolution of multicellularity. Via rigorous experimentation, the authors convincingly show that they can select for increase sedimentation rate and identify two mechanisms underlying this increase: incomplete cellular separation leading to multicellular groups and increases in cellular density. They also show surprising natural variation in sedimentation and argue that, along with similar evidence from other organisms, their findings cement the likely major role of sedimentation and go farther by revealing the tight genetic control that it is under. Reviewer #3 (Significance (Required)): This is a very significant study because it illuminates processes and underlying mechanisms that could have played a major role in the transition to multicellularity. Their result will likely greatly influence the conceptual and theoretical thinking and will foster additional empirical directions. My only quibble with the manuscript is that I wished for a bit more ecological context and grounding of the main findings: in that respect, both the abstract and the last paragraph of the discussion leave me wanting and occasionally puzzled. If maintaining buoyancy is such a strong selective pressure and the variation in sedimentation rate is such a challenge to it, then I think explaining a bit more exactly why sedimentation would evolve, why so much variation would exist etc etc would be really helpful to the more naive reader. Just a bit further elaboration on selective pressures (even presumed ones and even if speculative) would be helpful to put the picture together.

      ANSWER__: We would like to thank Reviewer #3 for his/her comments. We do believe that extensive ecological context is highly relevant. Throughout the manuscript, we strived to be conservative in the way we describe both our model system and its experimental and natural settings, perhaps to a fault, but we now do offer an evolutionary model that tries to shed light into the phenotypic evolution of the various species through different routes (Fig. 5H). To elaborate more on the rationale behind this strategy, we offer the following two aspects:__

      1. we are investigating a sizeable, but still a very limited number of six Sphaeroforma Therefore, we feel that explaining what trait may be considered ancestral is speculative based on the known species tree (we revised our Discussion in this regard and update figure 5A).
      2. our knowledge about the ecological niches of Sphaeroforma species is limited. We avoid extensive speculation, and while inference of the potential ecological context is part of the scope of this study, we relied on an experimental approach to tackle our questions, rather than ecological observation or computational modeling.
      • throughout the text we aimed to avoid taking a strong stance on the “adaptiveness” of the traits which we are measuring. This is because, depending on the model specification and parameters, ecological models could be made for or against whether the cellular traits of size and density, and their effects on the higher-level trait of sedimentation rate, might be adaptive “in the wild”.

      We hope that future studies will be able to tackle any open questions on the understanding of the ecology of ichthyosporeans, hopefully benefitting from our inferred evolutionary insights in this study.

      **A more minor point:** I remember seeing a talk by Will Ratcliff a while back in which he showed that in S cerevisiae they also see the two mechanisms of increased sedimentation: increased cellular size and clumping. Yet, I didn't see a reference to that work in the context of the cell density mechanism discussion and wondered why.

      ANSWER__: We do believe to have cited the relevant papers from the Ratcliff lab. To be clear, we observed two separate physical mechanisms for fast-sedimentation: __


      1. by cell-clumping (increasing size),
      2. by increasing the number of nuclei per unit volume (increasing density).

      To our knowledge the 1st mechanisms was indeed observed in snowflake yeasts (for which we referenced all relevant studies), whereas the 2nd, which we believe might be specific to multinucleated cells, while a conceivable variable affected by mutations in the organisms from these studies, has not been measured to our knowledge. We added a new model figure (Figure5H) to hopefully better get this message across.


      Reviewer #4 (Evidence, reproducibility and clarity (Required)): In this study Dudin et al. explored the variability of sedimentation rates in members of the Sphaeroforma genus and found that sedimentation rates are very variable between different isolates as well as during the life cycle of each isolates. Following this observation Dudin et al. evolved S. arctica under a regime favoring fast settling objects. After a few hundred generations they observed that most lineages increased their sedimentation rate. Characterization of some of these evolved population suggests two distinct mechanisms allowing fast sedimentation: cluster formation by non-separation of cells post-cellularization and increase in object density. By sequencing the evolved lines Dudin et al. were able to identify that several mutations has been under the effect of positive selection and that some of the mutations relate to mechanisms involved in cell separation and cellularization.

      ANSWER__: We dearly thank Reviewer #4 for his/her time and efforts.__

      **Major comments: **

      • Line 143, I don't understand how figure 1G shows that "nuclear division cycles were periodic...".

      ANSWER__: From previous published results (Ondracka et al 2018 & Dudin et al 2021), we know that nuclear divisions in S. arctica are strictly synchronized and occur within defined time-intervals. As can be seen in Figure 1G, DNA content doubles with a constant interval of about 9 hrs. Likewise, this phenomenon is clearly depicted in Figure 4F and Figure S4H. These results combined with results shown in Figure 1F, demonstrate that division cycles are still periodic in our experimental setting and are not occurring asynchronously as no odd number of nuclei per cell was observed.__

      • When characterizing the evolved lines, the authors display (and measure?) separately the size and the sedimentation rate, but don't directly compare them. If the statement that density plays a role in the sedimentation rate of S4 and S9 but not S1, then correlation between size and sedimentation should be similar between AN and S1 and changed in S4 and S9. It would be nice to see these relationships and the correlations.

      ANSWER__: We do indeed measure the size and the sedimentation rate of each fast-settling mutant separately. This is shown in figure 1C, where sedimentation rate is plotted against cell size for our dataset and the older Smayda (1973) data. Further, both measurements, directly, feed in the estimation of cellular density in Figures 4C and S4D (explained extensively in the methods). Cellular density estimations show the correlations and relationships between S1 and AN as well as between S4 and S9. __

      • Line 288: "surviving 780 generations of passaging for all 10 isolates" what data is this referring to?

      ANSWER__: This refers to growing cultures in the lab of fast-settling mutants with tens of passages done without any selection. These growing cultures maintained their clumping phenotypes even without a constant selection, suggesting they are due to a genetic modification. We are unsure about how to answer reviewer #4 as this is the data we are mentioning. We however changed “surviving” to “persisting for”, and hope it better clarified the sentence.__

      • The weakest aspect of the paper is that there is neither a statistical argument (with a single anecdotal exception), from seeing the same genes or pathways mutated in parallel experiments, or experimental reconstruction that argues that any of the observed mutations were selected as opposed to being neutral mutations that hitch-hiked with adaptive mutations. One strongly suspect that some of the observed mutations were selected, but from the available data, it is impossible to know which were selected and which were hitch-hiking.

      ANSWER__: We agree that our draft did not elaborate in-depth if mutations were drivers versus passengers, a fact also mentioned by another reviewer. To be fair however, there are several important considerations to make.__

      First, and most importantly, we do offer an unprecedented look into the genetic underpinnings of this novel model organism, and demonstrate highly parallel phenotypic evolution in response to selection. The molecular genetic signal reflects this finding given a skewed dN/dS-ratio > 1. While the precise molecular changes are not as easy to interpret, molecular parallelism at the level of genes is not a prerequisite for directional selection in repeat lineages, especially given the complex genomic architecture of S. arctica.

      Second, while we didn’t emphasize this a lot, the results from our bioinformatic analyses are pretty unique. We are dealing with a non-standard model organism here, with highly intriguing placement in the tree of life, but with big genome size, at >140 Mbp. This is 1-2 orders of magnitude larger than that of other single-celled model systems used in evolution experiments, including E. coli or S. cerevisiae. Unlike the latter two, this organism’s genome contains extensive levels of intergenic and intronic sequence, as well as a high amount of (simple sequence) duplication. Hence, the analyses of the resequencing data were a major effort, and it took an extensive amount of time to identify the mutations.

      Third, there are no genetic tools that would allow us to either perform molecular genetics or crossing with S. arctica as of now. This will change in the future, and in this event, our comprehensive list of target genes will be hopefully valuable to the field and beyond.

      • Even if the authors knew which mutations were selected, it is not possible to say if the mutations that have been selected are directly advantageous in the settling regime, they could be due to adaptation to lab conditions and higher temperatures, etc. Having a control evolution experiment with no settling selection would be required to reach the conclusion that the mutants were selected for faster sedimentation.

      ANSWER__: We agree that a “no-selection”-control experiment would have been helpful for the molecular interpretation. But the clumping phenotype has never been observed to occur in many generations of passaging in any of the labs culturing these organisms and at different temperatures (we made sure to specify this in the text) As such, we argue that any adaptation to laboratory conditions must have happened before we conducted our selection experiment. Given that the molecular signals were unique (with one exception), we have reason to believe that the highly controlled nature of the experiment with a constant environment throughout, did at least not bias the molecular signals toward extensive genetic parallelism. __


      **Minor comments:**

      • Line 164, the authors write "this phenotype", it is unclear what phenotype is referred to as.

      ANSWER__: Fixed__

      • Line 187: the authors use the word "radius" in the text, while using "perimeter" in the figure.

      ANSWER__: Fixed__

      • Line 224: Is the use of the expression "incomplete detachment between daughter and mother cell" appropriate given that all cells emerge from a multinucleated cell?

      ANSWER__: Fixed – “incomplete detachment between cells.”__

      • Line 151, typo, the "with" should be removed.

      ANSWER__: We believe the reviewer wanted to point out the “with” in line 251, which we fixed.__

      • The intro about changes in ecology is nice but does not make sense given the rest of the paper, I would add it to the discussion.

      ANSWER__: We beg to differ with Reviewer#4 here, as the water column distribution for plankton in marine environment is one of the key aspects of our paper and is a critical parameter in models of water body ecology.__

      • Line 399 "increase their cell size by increasing cell-cell adhesion post-cellularization" the first use of "cell" is misleading because the objects are now a collection of cells rather than a single cell.

      ANSWER__: Fixed__

      Reviewer #4 (Significance (Required)): Most of the findings made in this study have been obtained in previous studies done with more genetically tractable organisms, however this is the first time that such experimental evolution was made on a unicellular non-model system organism closely related to animals. The significance of the work is reduced by the failure to produce evidence to answer two critical questions about the observed mutations: 1) were they selected during the experiment or did they hitch-hike with other selected mutations, and 2) if they were selected, were they selected because they led to faster sedimentation or some other aspect of the conditions in which they were passaged. It would take serious effort to perform additional experiments to address these questions and thus the authors are likely to be better off explaining that their work is unable to answer the questions and thus they are speculating about both the causality of the mutants and the nature of the advantage they conferred.


      ANSWER__: We beg to differ with the reviewer’s argument.__

      We believe that our study demonstrates heritable phenotypic changes for an evolvable, ecologically relevant trait, and their tight cellular regulation. We identify and carefully quantify how two cellular growth phenotypes – the nuclear division rate and cell size control –– can vary heritably and independently of one another, and together directly shape variation in a critical ecological parameter of a marine organism. Therefore, in addition to the fact that the work was performed in an emerging model marine organism, this work provides fundamental “novel” insight into cellular trait evolution more generally.

      Our results do not depend upon knowing the exact genetic mutations or molecular mechanisms which have caused these phenotypic changes. Nor, as the reviewer implies, do we claim to have identified particular mutations that were selected, or their effects on particular cellular phenotypes. We do, however, provide a large amount of evidence that the changes are likely genetic. With our sequencing effort, we find a strong, statistically significant, molecular signal of adaptation in the lineages (dN/dS > 1), and we publish a curated list of affected genes which are potentially causative for the phenotypes we observe.

      Because we did not observe frequently recurrent mutations, as most directed (and cancer, antimicrobial resistance, etc.) evolution studies find, our results suggest that there is a large mutational target size affecting the phenotype of interest, reflecting its potentially broad genetic and molecular control mechanisms. We view these results as a great strength of the study, and consider this result in and of itself “novel”. Furthermore, we have now added and __used a statistical genetic approach to quantify the heritability of traits, or what proportion of the variance in phenotype is due to an individual’s inherited state__ (Figure 1 – figure supplement 1A). The results show that Heritability exceeds 95% across phenotypes, and across the entire dataset, H exceeded 99% of the total phenotypic variance (ANOVA F = 1118 on 252 and 735 DF, p = 0). This means that for a typical individual genotype in a given environment, we could predict its average phenotypic measurement with >97% accuracy.

      The fact that we do not conclusively identify which particular mutations are causative does not obviate the overwhelming evidence that heritable changes occurred in our samples, leading to repeated phenotypic convergence affecting the trait of sedimentation rate. We believe these phenotypic changes, and our quantification of their magnitude, to be a “novel” and “significant” contribution to the literature on cellular trait evolution, ecology, and multicellularity.





  4. www.digitalhermeneutics.com www.digitalhermeneutics.com
    1. The problem with synecdoche, or sampling, seems at first to bethat the part may not represent the whole as we would like to think itdoes, may not reproduce in miniature the characteristics we are inter-ested in, may not allow us to draw conclusions from what we do knowthat will also be true of what we haven’t inspected ourselves.

      Three possible problems of sampling.

    1. Author Response:

      Reviewer #1 (Public Review):

      Munc13 is a key regulator of synaptic vesicle (SV) fusion that is thought to mediate SV tethering and regulate SNARE assembly. Based primarily on Munc13 crystal structures, the authors design a set of four charge reversal mutations in the C1C2B region that are predicted to affect the interaction of Munc13 with the plasma membrane (PM). Various in vivo and in vitro consequences of these mutations are studied, leading to two main conclusions: (1) an interaction between the PM and a polybasic surface of Munc13 is likely important for SV tethering, and (2) two residues in the Ca2+-binding loops of the C2B domain are important for SV fusion.

      So far, so good - I think the data strongly support the two main conclusions noted above. It is less clear that these studies support (or could falsify) the main hypothesis, stated in the title, that re-orientation of membrane-bound Munc13 controls neurotransmitter release. Primed vesicles appear to exist in dynamic equilibrium between two states, one of them "loosely" primed (LS) and the other "tightly" primed (TS). Inasmuch as this simple model is correct, one could characterize the various players - SNAREs, synaptotagmin, complexin and of course Munc13 - in terms of their ability to influence the LS/TS equilibrium, perhaps in response to Ca2+ or other small molecules. This manuscript postulates that the orientation of Munc13 relative to the membrane has a major impact on the LS/TS equilibrium, with a perpendicular orientation favoring LS and a slanted orientation favoring TS.

      The authors' previous structure (Xu et al., 2017) suggested that two partially-discrete faces of C1C2B, one polybasic and the other centered around the Ca2+-binding loops of C2B, are likely involved in PM binding. In that paper they hypothesized that the polybasic face would dominate in the absence of Ca2+ whereas the 'Ca2+-binding face' [not a very good name, but the authors haven't suggested a better one] would dominate in the presence of Ca2+. Binding to the PM via the polybasic face would yield a more erect or 'perpendicular' binding orientation, whereas binding to the PM by the Ca2+-binding face would yield a more tilted or 'slanted' binding orientation.

      In revised manuscript we use the term DAG/Ca2+/PIP2-binding face, or Ca2+-dependent face when we discuss the effects of Ca2+ in particular.

      Here the authors performed two molecular dynamics simulations, one without and one with bound Ca2+. In the Results section, they correctly point out that their findings cannot be used to support their hypothesis because, in each case, Munc13 was placed in the hypothesized orientation - perpendicular for minus Ca2+, slanted for plus Ca2+ - at the beginning of the simulation. In the Discussion however the authors argue that the MD simulations support their model. I disagree because the simulations needed to falsify the model have not yet been conducted. In addition, an opportunity was seemingly missed by not doing MD simulations on the mutants.

      We have removed the sentence stating that the MD simulations support the model in the corresponding paragraph of the discussion (page 22). A meaningful analysis of the effects of the mutations would have required much longer simulations of this large system, which would take several months for each mutant in the UT Southwestern BioHPC facility or acquisition of a dedicated allocation at the Texas Advanced Computing Center.

      Of the four mutations studied, two (K603E and K720E) should specifically destabilize PM binding by the polybasic face, one (K706E) should destabilize binding by the Ca2+-binding face, and one (R769E) is expected to destabilize both. Two of the mutants (K603E and R769E) in fact abrogate priming. This result, along with biochemical experiments, implicates the polybasic face in SV tethering and thus represents the main evidence supporting the first of the main conclusions (see Evaluation Summary above). However, since an unprimed vesicle does not participate in the LS/TS equilibrium, these mutants are in this respect uninformative. Only the remaining mutants, K720E and K706E, would therefore appear to have the potential of yielding information about the LS/TS equilibrium and its relationship to Munc13 orientation.

      Although we understand the concern expressed by the reviewer, we do not fully agree with the last sentence. If we accept that the K603E and R769E mutations impair priming, this result implies that binding through the polybasic face occurs for WT Munc13-1. This conclusion does not demonstrate the LS/TS equilibrium, but it does support the notion that one of the proposed states exists.

      Both K720E and K706E support normal priming but have opposite effects on vesicular release probability and evoked release. These results can be rationalized in terms of an LS/TS equilibrium. The K720E mutation, which selectively destabilizes binding by the polybasic face, would shift the equilibrium toward TS and thereby increase the release probability. Conversely the K706E mutation, which destabilizes binding by the Ca2+-binding face, would shift the equilibrium toward LS and thereby reduce the release probability.

      However, the authors themselves cast serious doubt on this straightforward interpretation. In the case of K720E, they point out that the other 'polybasic mutant', K603E, has no effect of release probability. (I argued above that, perhaps, K603E is best viewed as uninformative about the LS/TS equilibrium owing to its strong upstream priming defect.) In the case of K706E, the authors point out that phorbol ester potentiation was similar for K706E and wild-type, suggesting to them "that the effects of the K706E mutation might not be related to the transition to slanted orientations but rather to another mechanism that directly influences fusion. For instance, the Munc13-1 C2B domain might cause membrane perturbations analogous to those that are believed to underlie the function of the Syt1 C2 domains in triggering release (Fernandez-Chacon et al., 2001; Rhee et al., 2005). It is also possible that the phenotypes caused by the K706E mutation and other mutations studied here reflect effects of Munc13-1 in more than one step leading to release, which complicates the interpretation of the data." If this is indeed the case, we are down to one mutant - K720E - that can be informative about the LS/TS equilibrium. (For the most part, I did not find the double and quadruple mutants informative, especially because each of them contains at least one mutation that strongly abrogates priming.)

      We again understand the concerns expressed by the reviewer but do not agree that the K706E mutant does not provide any information on the LS/TS equilibrium. If we accept that the K706E mutation does have an effect on evoked release and that K603E has an effect on priming, these results support the notion that both proposed binding modes occur and are functionally relevant. We do agree however that this conclusion does not prove that there is an equilibrium between two primed states.

      It looks like K720E is right in the center of the polybasic surface (although it's hard to tell from a single 'projection' image) so it would have been expected to impair Ca2+-independent liposome binding, and it does. However the liposome clustering effects are very weird, displaying a much broader distribution than any other experiment, an observation which the authors disregard. However, overall, I would say that the authors' K720E findings offer modest support for their overall main hypothesis. But for me it's not enough to justify making that hypothesis the title of the paper.

      We agree with the reviewer that it is a stretch to include the hypothesis in the title of the paper. We have changed the title to: ‘Control of neurotransmitter release by two distinct membrane-binding faces of the Munc13-1 C1C2B region’, which emphasizes the notion that there are two functional membrane-binding faces of the Munc13-1 C1C2B region without making a specific claim on a role of two faces on presynaptic plasticity. We note that the notion that the Ca2+- and DAG-dependent face of the C1C2B region is functionally relevant was already supported by previous studies (Rhee et al. 2002; Shin et al. 2010), which we now cite in additional sentences to emphasize this point (e.g. pages 22, 23). Hence, we believe that, together with the previous data, our results strongly support the conclusion that two faces of the C1C2B region are functionally important. We still present the LS/TS model and use it often to interpret our results, but have tried to be careful throughout the manuscript to not overstate our conclusions and point out when our results are consistent with the model without concluding that they prove it.

      For the most part I could not follow the discussion of figures 4 and 5. But I am struck by strong similarity between the data for K603E and K706E (comparing Fig. 4B/C to Fig. 4H/I). How can these results be reconciled with the opposite roles predicted for K603 and K706?

      The normalized data obtained for K603E and K706E mutants do look similar (new Fig. 8C,I), but the absolute amplitudes are lower for the former (new Fig. 8B,H). Nevertheless, we agree that it not straightforward to interpret some of the data obtained in the repetitive stimulation experiments. To acknowledge this difficulty, we have included the following sentence at the end of the first paragraph of the corresponding section (line 416): ‘Nevertheless, interpretation of some of the data was not straightforward, and there may be alternative explanations to those offered below, which are based in part on the proposed LS-TS equilibrium.’

      I'm not sure how the results of the PDBu experiments contribute to the conclusion that "two faces of the C1-C2B region are critical for Munc13-1-dependent short-term plasticity" (p. 15), since the only mutant that selectively affects one of the faces, K706E, has no impact (Fig. 6).

      We have toned down the sentence at the end of the section describing the PDB data, which now reads (line 475): ‘Overall, these results show that basic residues in the Munc13-1 C1-C2B region influence the potentiation of synaptic responses by PDBu and, together with the data obtained with repetitive stimulation, they support the notion that two faces of the C1-C2B region are involved in Munc13-1-dependent short-term plasticity.’

      Why are the liposome-binding assays in Fig. 7 done with C2C present - isn't that just a confounding factor? And if Ca2+-independent binding by C2C is as weak as suggested by the results in Fig. 7, how do any of the Munc13 constructs cluster liposomes in Fig. 8? (Note that, according to my reading of the methods, V-type liposomes are simply T-type liposomes without the DAG and PIP2.)

      Binding of the C2C domain to liposomes is indeed weak but still can contribute to liposome clustering because multiple C1C2BMUNC2C molecules can cooperate in this activity (see Quade et al. 2019). We used C1C2BMUNC2C mutants in the binding assays because they were also employed for the liposome clustering and fusion assays, in which C1C2BMUN is much less active (see Quade et al., 2019). We agree that having the C2C domain present could be a confounding factor, but we included the binding results because the effects of the mutations did correlate, albeit qualitatively, with those of the clustering and fusion assays.

      What is the basis for the claim (p. 22) that "the perpendicular orientation of Munc13-1 is expected to facilitate initiation of SNARE core complex assembly"?

      The perpendicular orientation may hinder the initiation of SNARE complex assembly if Munc13-1 is located between the vesicle and the plasma membrane, but can facilitate initiation of assembly if the bridging Munc13-1 molecules are located further from the center of the vesicle-plasma membrane interface (e.g. as in Fig. 1D; see also cryo electron tomography images of Quade et al. 2019). We agree that the term ‘expected’ is too strong and now state that the perpendicular orientation ‘may facilitate initiation of SNARE complex assembly’ (line 523).

      Reviewer #2 (Public Review):

      In this manuscript, Rosenmund and colleagues describe new results regarding the mode of action of Munc13 in neurotransmitter release. Based on molecular dynamics simulations of Munc13 (C1C2BMun) with phospholipid membranes, the authors selected promising point mutations and comparatively investigated their functional impact with electrophysiological experiments in hippocampal neurons and with a variety of in vitro experiments (lipid binding assay, liposome clustering and fusion). The results show that specific mutations in the C1C2B-domain (also referred to as polybasic face) of Munc13 (K603E, R769E) strongly inhibit vesicle priming, a property that correlates well with their re duced ability to bind to phospholipid membranes in a calcium-independent manner.

      The manuscript describes comprehensive electrophysiological and biochemical experiments that are complemented and extended by thoughtful analyses. The direct combination of electrophysiological and biochemical expertise from the Rosenmund and Rizo laboratories, respectively, represents a particular strength of this study, allowing the authors to develop new insights into the function of the Munc13 protein. A welcome (but not necessary) extension of the data presented would be the demonstration that the mutants in question (K603E, R769E) also show altered phospholipid binding in the MD simulations. In any case, the presentation of the data is clear and the authors' conclusions are convincing.

      Taken together, the manuscript and the results represent a significant advance in the understanding of the molecular mechanisms underlying synaptic vesicle priming.

      We thank the reviewer for the very positive evaluation of our study. As mentioned above, a meaningful analysis of the effects of the mutations would have required much longer MD simulations of this large system.

    1. Context: Sonia was watching Leah Remini: Scientology and the Aftermath: Season 3: "Episode 1" and had previously been watching a documentary One of Us about people who had left oppressive seeming Hassidic Jewish communities.

      I can't help but that that every culture could be considered a "cult" in which some percentage of people are trapped with comparison to all other cultures on Earth. Based on one's upbringing and personal compass, perhaps living and submitting to one's culture can become oppressive and may seem particularly unfair given power structures and the insidiousness of hypocrisy.

      Given this, could there logically be a utopian society in which everyone lives freely?

      Even within the United States there are smaller sub-cultures withiin which people feel trapped and which have the features of cults, but which are so large as to not be considered such. Even the space in which I freely live might be considered a cult by others who don't agree with it. It's only the vast size of the power of the group which prevents the majority who comfortably live within it from viewing it as a bad thing.

      A Democrat may view the Republican Party as a cult and vice versa, something which becomes more apparent when one polarizes these communities toward the edges rather than allowing them to drift into each other in a consensus.

      An African American may think they're stuck in a broader American cult which marginalizes them.

      A Hassidic Jew may feel they're stuck in a cult (of religious restrictions) with respect to the perceived freedoms of broader American Culture. Some may feel more comfortable within these strictures than others.


      A gender non-comforming person living in the deep South of the United States surrounded by the Southern Baptist Convention may feel they're stuck in a cult based on social norms of one culture versus what they experience personally.


      What are the roots of something being a cult? Could it be hypocrisy? A person or a broader group feeling as if they know "best" and creating a rule structure by which others are forced to follow, but from which they themselves are exempt? This also seems to be the way in which authoritarian rules arise when privileging one group above another based solely on (perceived) power.


      Another potential thing at play here may be the lack of diversity within a community. The level of cult within a society may be related to the shape of the bell curve of that society with respect to how large the center is with respect to the tails. Those who are most likely to feel they're within a "cult" (using the broader definition) are those three or more standard deviations from the center. In non-diverse communities only those within a standard deviation of the norm are likely to feel comfortable and accepted and those two deviations away will feel very uncomfortable while those who are farther away will be shunned and pushed beyond the pale.


      How can we help create more diverse and broadly accepting communities? We're all just people, aren't we? How can we design communities and governments to be accepting of even the most marginalized? In a heavily connected world, even the oddball teenager in a small community can now manage to find their own sub-community using the internet. (Even child pornographers manage to find their community online.)

      The opposite of this is at what point do we circumscribe the norms of the community? Take the idea of "Your freedom to strike me ends at my nose." Perhaps we only shun those extreme instances like murder and pornography, and other actions which take extreme advantage of others' freedoms? [This needs to be heavily expanded and contemplated...] What about the over-financialization of the economy which takes advantage of the unprivileged who don't know that system and are uncapable of the mathematics and computation to succeed. Similarly hucksters and snake oil salesmen who take advantage of their targets' weaknesses and lack of knowledge and sophistication. Or the unregulated vitamin industry taking rents from millions for their superstitions? How do we regulate these to allow "cultural freedom" or "religious freedom" without them taking mass-scale advantage of their targets? (Or are some of these acculturated examples simply inequalities institutionally built into societies and cultures as a means of extracting power and rents from the larger system by those in power?)


      Compare with Hester Prynne and Nathaniel Hawthorne's The Scarlet Letter.


    1. The web is a necropolis, where the dead will one day outnumber the living. In my years online, people who have been part of my daily life have suddenly, unaccountably winked out of existance. Disconnected or died? or, like ghosts on a stone tape, merely overwiped. On the web we are ageless; our bodies may decay, but text typed at 14 looks much the same typed at 24 or 54.

      Think of carved inscriptions on Roman walls. They took for granted that they carried their dead with them. Maybe this isn't so strange so much as the illusion we'd all had that we could create something fresh, new, untouched by our ancestors.

    1. racially diverse and valuingdiversity” institutional culture may minimize racism percep-tion group differences.

      I think the distinction made here between merely being diverse, versus actually valuing diversity is fascinating. We talked about this a lot earlier in the course with regard to Loyola. Our university is growing increasingly more diverse, yet many students feel as though administration does not actually value diversity.

    1. Brand Book {draft} To be able to change the world on the scale which it is needed, we cannot tell our story alone. We believe with an alliance of unlikely connections in the form of agencies and brands, we can share the load on the creation of unlikely connections, and build the power of the next social network, a social network for good. This Brand book walks you through AIME, it gives you the history, it gives you the callouts, it unlocks some pathways for storytelling. We share the AIME Design Brain we use to ensure we’ve birthed an AIME idea, and finally the channels AIME has to create unlikely connections. Now I didn’t want to bury the lead - we deeply believe that every campaign, every story, starts with manual one to one connections, that marketing requires human to human connection, and we don’t believe in one big story that suddenly goes viral: we don’t like viruses, we don’t like unhealthy growth. We are in this for the long game. The current dislocated media landscape is not who we require for verification. We want to build the connections one by one, and if the work is meaningful, then people may talk about it, but if not, the work is done. We focus our campaigns solely on the creation of the unlikely connections, not on who's watching. We don’t think facebook, instagram or twitter are strong arenas for communication at a level of depth that changes things. If your strategy involves them, delete your strategy, focus on the offline world, or on platforms that give space for depth, like podcasts or youtube. Remove the artificial, the distraction, the desperation for a quick result or a quick outcome and please please please build it slowly with us. One by one, in the shadows if we must, we’ll slowly keep building an incredibly meaningful social network for good that brings in the intelligence of all humankind. Thank you for creating unlikely connections with us for a fairer world Jack Manning Bancroft AIME Founder 14 August 2021 About AIME HISTORY IN FILM: What is AIME? IN FILM: What is UNCx5? What’s AIME’s vision? What is the problem AIME is solving? What’s the solution? How has AIME made the solution? What’s the difference between AIME and IMAGI-NATION? How do we measure success? How not to talk about AIME How to talk about AIME Our Spokespeople Where and how to activate AIME’s unlikely connections How to birth an AIME Idea Philosophy Star Dust Freedom Knowledge Create a fairer world? Economics Artists Engineering The AIME Unlikely Connection Channels IMAGI-NATION {University} IMAGI-NATION {TV} IMAGI-NATION {Radio} Making of a Hoodie Podcast IMAGI-NATION {Cinema} Fashion for Good IMAGI-NATION {Library} IMAGI-NATION Appendix: Glossary of words and phrases in the AIME universe About AIME In 2004, AIME founder Jack Manning Bancroft, sketched an idea of a social network for good, one that connected university students as mentors with Aboriginal & Torres Strait Islander high school students in Australia, building bridges between two different groups, to lead to educational equity, exchanges of worth and value, and for the mentors a deeper connection to a different lived experience. In 2005, this network commenced and scaled at pace around Australia engaging over 25,000 Indigenous high school students who closed a 40% education outcome gap, and it lit up the minds of a generation of university students desperate to connect to something bigger than themselves, with over 10,000 university students volunteering their time and energy to make AIME the largest ongoing volunteer movement of university students in Australian history. The power of AIME to build unlikely connections grew as we encountered further barriers to the high school students’ pathway out of inequity - barriers in mass cultural storytelling where they couldn’t see anyone like them, barriers in employment, barriers in the board rooms, barriers in the shape of the economy that saw so many kids like them outside the margins. One by one, we’ve worked tirelessly on building bridges between these young people and the people in control of many of the friction points where change has not yet occurred, but is possible if we embrace unlikely connections. The more our work grew around Australia, the more we realised the largest challenge to inequity was not limited by national borders; it was all interlinked. It was how we saw each other, how we saw people outside the margins, how we valued exchange, and the amount of the pie there was to go around globally. In 2016, we expanded our work across the globe, which has led to the invention of our own TV network, our own radio show, our own University to train people to make unlikely connections and which in 2021 is reaching people across 52 countries. We scaled our work in fashion, with our Hoodie to drive into youth culture with a symbol that was more than an empty brand promise, a symbol that showed the true power of fashion for good. We are in the process of bringing all of this work into an online world, contained in one social network, where we can model a different economy of exchange where everyone is included, and where there are bridges for those in positions of power who want to see things change, but don’t know where to find a marginalised young person, or connect to a different way of thinking. Our network will build these bridges driven by the power of unlikely connections. While nation states have struggled to find solutions that bridge the divides, we have decided to call our new network, IMAGI-NATION, a new nation, where everyone has a seat at the table, and where we are all invited to make an unlikely connection and help build a fairer world. HISTORY IN FILM: Origin Story - 2005-2012 - Australian Story - https://www.youtube.com/watch?v=Mt5RxdQRFR4&ab_channel=AIMEMentoring Going Global - 2014-21 - 7 Down - https://vimeo.com/563040825 Password: down47down Philosophy in a podcast - 2021 conversation between Tyson Yunkaporta & AIME Founder Jack MB https://player.fm/series/the-other-others/positivity-meets-complexity What is AIME? AIME is ‘unlikely connections’ for a fairer world. We are a network that connects marginalised youth with the rest of the world to make space for exchanges of time, knowledge, opportunities to create more bridges between those inside the margins and those outside so we can realise a fairer world. IN FILM: COGS - Created to help AIME go global with Oscar Award Winner Laurent Witz & M&C Saatchi - https://www.youtube.com/watch?v=sGt3figvnfU&ab_channel=AIMEMentoring What is UNCx5? Unlikely Connections times 5 - it’s the formula to unlock the power of unlikely connections and the key to open up the world of IMAGI-NATION. To create change, we don't need an island, or thousands of Instagram followers, or be a LinkedIn influencer. All we need is 5 incredible Unlikely Connections, and watch the many infinite new connections into experiences, knowledge, perspectives that explode when 5 people go deep in a smaller circle - in a network that is decentralised and includes us all. What’s AIME’s vision? Creating millions of unlikely connections between marginalised youth and those inside the margins AND between all human beings and different ways of thinking in order to create a fairer world. What is the problem AIME is solving? Our current connections work towards a concentration of wealth and opportunity for the few, a confirmation of our biases, more time with people like us What’s the solution? Unlikely connections, between races, ages, wealth, nations. How has AIME made the solution? Two parallel pathways - connecting people with stories and knowledge, and connecting people with each other. The stories and knowledge come through AIME’s Hoodie, TV, Radio, Film, Gallery, Library & University. The connections are facilitated via AIME’s online social network for good & in our physical work in Universities & schools worldwide - IMAGI-NATION, AIME’s university IMAGI-NATION {University}, and via AIME’s meeting place within IMAGI-NATION, a global exchange portal where marginalised youth can connect with mentors, internships, scholarships and jobs. What’s the difference between AIME and IMAGI-NATION? AIME is the organisation, IMAGI-NATION is the network. How do we measure success? By counting the unlikely connections created. And then by tracking through case studies, the deeper impact short, medium, long term of those unlikely connections. How not to talk about AIME Okay here’s some watchouts. Avoid these: · The Australian Indigenous Mentoring Experience - AIME was founded as an Australian unlikely connector between Indigenous and non-Indigenous people, it’s now grown to 50+ countries. QANTAS used to be the Queensland and Northern Territory Airline Association, it’s now just QANTAS. AIME’s origin story is part of the heartbeat of the organisation, and it is told with subtlety and nuance, by having a global stage where Indigenous Australian young people stand alongside other young people outside the margins, and people inside the margins, and in that statement, on a global stage, we see the ultimate equity achieved for Indigenous people in Aus. That equity is that there are no ceilings, there are no doors closed to their possibility, their identity is their power and their story, not to limit them, but to unleash them. · “Indigenous Australian and other marginalised youth” - this reinforces the negative twice. We want the audience to understand the global inequality faced by young people who because of historical circumstances, because of societal design, have landed in a life that they are outside the margins. Calling out Indigenous Australians and then other marginalised youth does a double otherising. Back to the simple message “AIME connects young people outside the margins with a network of those inside the margins to build exchanges to create a fairer world.” · Awareness - AIME isn’t about awareness, we aren’t here to tell people about the problem of inequity, to dwell on the past, AIME is about solutions, AIME is about tomorrow, AIME is about action, about really simple action where people make an unlikely connection with knowledge through our storytelling, are inspired to act through our storytelling, or are connected in unlikely ways via AIME’s network. o Particular callout on the AIME Hoodie - the AIME Hoodie is the most activated meaningful Hoodie in the world. No hoodie we make is about awareness. For example: § Making Space Hoodie is a Gallery - it exhibits the work of marginalised youth from around the world & it also exhibits the work of profile artists giving their profile and work to raise $ and bring people to connect with the AIME network and make more unlikely connections. § Making Space Hoodie is a ticket - to the global Making Space exhibition where the world’s marginalised youth are exhibited on the walls of the most prestigious galleries around the planet. § Making Space Hoodie is not awareness building about the plight of inequity. · AIME is the anti charity. If there’s anything you’ve seen before in public fundraising, gala balls, flip the script on it because AIME doesn’t want to give to people what they already know, we don’t give them what they’ve already got, because that is not an unlikely connection with an idea, with a way of thinking. We want people to see AIME as the ideal organisation on planet earth, not your usual charity, not noble, but normal. How to talk about AIME · Unlikely connections for a fairer world. · Ask a question - What unlikely connection with an idea, with a person, has changed your life for good? · We are the anti facebook - AIME is the network of tomorrow - built for everyone, not affirming what we know and who we know, but connecting us to what we don’t know and who we don’t know, not for entertainment, but for good. · Action action action - focus on the action, the impact, the outcome, the unlikely connections, how one unlikely connection after another we can change things. Map the impact, showcase how the idea is changing the world. · Borrow - borrow from all different organisations, stories, ideas, and fuse the unlikely connections. · Imaginatively create stories that are fuelled by unlikely connections. If you have a young person from outside the margins and someone from inside the margins you are on your way. If they are activated and working proactively on a project of tomorrow, and the young person is shown with strength, with agency, not as a problem to be fixed, but the solution, then you are well on your way. · DO IT - don’t overthink it, don’t over strategise it. Make sure the passion for what we are doing - the fairer world we are fighting for, is alive. When this is alive, we are alive, we’ll learn from the doing. · Always drafting - embrace an idea that we are always drafting. This links in with the doing of it. If we know we are creating unlikely connections, then let’s get out there and do it. Our Spokespeople · Our Lead spokespeople are our 6 Professors. They transcend our literal representations of race and identity and allow us to move into a place of imagination. They are multidimensional, they are challenging and complex. We want our professors doing media spots, public speaking events, representing AIME. o Profile on each please Josh BuoyVanessa EllisBenjamin Knight · AIME Ambassadors - 200 young people from around the world Where and how to activate AIME’s unlikely connections Our social network for good, since 2005 has focused on real life, real world interactions between human beings, creating unlikely connections one by one. We see the power of the internet to connect and are developing our own digital social network for good to be released in 2022. We are very wary of the trap of Facebook, Instagram, Twitter, and would prefer the use of these platforms to drive physical action. For example: · Making Space campaign - Post from an artist at a gallery asking their gallery to join the Making Space Exhibition globally · Making Space campaign - an employer inviting other businesses to join the making space club What we dig less is ‘awareness’: “I’m wearing this hoodie, I’m cool therefore marginalised youth are cool” We aren’t so into that, we’d prefer action. Eg: · I’m wearing this hoodie with a callout to any young artists from outside the margins who want to have a chance to be exhibited at the Louvre in this year’s MAKING SPACE exhibition and have your own work created into a custom Art Hoodie via AIME’s IMAGI-NATION{Gallery}, head to http://aimementoring.com to apply. Ensure there are unlikely connections from the inception through to the delivery of the idea and impact tracking & storytelling afterwards. If it builds the network of unlikely connections, if it leads to action = good. If it talks about how good AIME is = not so good. Remember - not the past, but the future. Not the problem, but the solution. That every single communication piece from us is an opportunity to create an unlikely connection with a new piece of knowledge, a different way of thinking, or a person, that leads to a fairer world. How to birth an AIME Idea This is our AIME brain, it’s what’s required to create an AIME idea. If you have ticked all of these, it’s an AIME idea. We believe in knowledge to change the world, that’s why we have a philosophy checklist; we believe that economics drives what we value and to change the world, we must influence economic exchanges; we see art and artistic thinking as leading an idea, birthing a reality, a bridge between imagination and what we know; and finally, we believe in robust engineering to ensure we change the system, and the idea can move from imagination to actionable change. Below is the graphic we work through to ensure we have designed an AIME idea. And we’ll share a short description of each section. Philosophy Star Dust · Does this idea live after it’s been created, is there a vision where it explodes, and the star dust that is left helps the whole earth? Freedom · Are we working on freeing people’s minds? Or helping them enter a space of imagination? Are we suspending disbelief? Are we flipping the script on how we think? Are we releasing all sides/different people from their existing biases and allowing for freedom of thought to see unlikely pathways as realities? Knowledge · Is there knowledge shared as part of the idea? Not surface awareness but deep knowledge transfer? Do we change the way people think? Is there depth to the idea? Create a fairer world? · Does this action create a fairer world? How will we prove it? Economics · Exchange of Time, Knowledge, Opportunities o Does this idea focus on an exchange of time, knowledge and opportunities? Does it provide the space for those involved to share across the margins? Is cash kicked down the line as a barrier to entry? Are there moneyless exchanges leading? · IMAGI-NATION - Social Network for Good o Does it bring the audience to IMAGI-NATION to act? o Does it inspire the audience to network differently, to network with unlikely connections? Artists · Make a statement o Does the idea grab you? Does it make a statement? Have we distilled the essence of it into a headline? Is the statement something we can stand for? · Always drafting o Does the idea have fingerprints all over it? Have we embraced ‘always drafting’ as a concept in design? Have we let the audience into the process of creation? Have we created a bridge between them and us by being human, by drafting with them? Have we co-created? And have we released ourselves from perfection by releasing the idea, then drafting with the world? · Imagine o Have we harnessed the power of our collective and individual imaginations with the idea? Have we truly deeply imagined what’s possible? Is the idea predictable or imaginative? Have we used the principle of unlikely connections in the birthing of the idea to ensure it is imaginative? · Layers and levels o Is there depth to the work? Are there multiple layers and levels at play? Does it work today and tomorrow? Is there complexity in the approach? · Play with the frame o Have we looked at the existing frame and played with it? Have we drawn outside the margins? Have we changed the frame? Have we played with the assumptions of what the playground is? Have we, in the very act of adjusting the frame, expanded the margins? Have we made the frame bigger to help others see bigger? Have we made more space? Engineering · Impact o What is the measurable impact of unlikely connections created from the campaign? What are the numbers of young people from outside the margins that will have unlikely connections because of this idea? How are we going to capture the case study impact of the work? In what format? What changes because of the idea? And can you prove it with hard facts? With numbers and stories? · Repeatable o Is the idea repeatable? Can it scale globally? Can it grow year on year? Could it last for 20 years? · Shift the system from the inside o Does the idea bring those people from inside the margins onto the bridge to make an unlikely connection with those outside the margins? Have we inspired those inside the margins to act, then given them a pathway and responsibility to do the work? o Does it have a design that moves beyond a day? Does it have a club/ a system/ a campaign/ a peer-to-peer device/ cultural pressure that moves the work back into the hands of those within the margins to create the change themselves? o What levers are we pulling on to make the system move? · Long Game o Have we imagined what happens with this idea in 100 years’ time? Have we thought about what happens in 1000 years’ time? Have we released ourselves from a measurement of success being an instant ‘like’, to thinking about the long game? Have we resisted the pressure of “big news” results, to think one-by-one about how we can build the idea year-on-year, to create the snowball, into the avalanche of change? Is there patience in the design? · Who's at the table? o Are people from outside the margins at the table in the design of the idea? Do we have unlikely connections at play the whole way through? · Give kids the stage o Does the idea make a stage and then give the stage to young people outside the margins to show they are not a problem to be fixed but part of the solution? o Are young people involved in the design process? o How do the young people take their opportunities from the idea and become leaders that pass it on and create more opportunities for young people like themselves? The AIME Unlikely Connection Channels IMAGI-NATION {University} Where AIME educates & inspires people in how to make unlikely connections to act for a fairer world. Students complete their courses over 10 months. There are five degree courses and five key audiences: · Executives - who work on creating a Co-CEO in their organisation and levelling the playing field in their workplace · University students - who lead an AIME student chapter and create mentoring connections between university student mentors and 100 marginalised high school students · Teachers - who teach with imagination to engage ALL students in the classroom and build bridges to local employers & community · Entrepreneurs - for school students from outside the margins to become entrepreneurs and create change from the inside out (and for those within the margins to build unlikely connections back to those outside) · Citizens - for individuals to work on projects for change within their communities or the world Via IMAGI-NATION {University}, by 2024, AIME is looking to create unlikely connections for 90K marginalised youth per year. Here are 5 case studies of students enrolled in 2021 IMAGI-NATION {TV} A weekly TV show where we curate unlikely connections. This is where we incubate ideas, where we bring people together to create the connections. From the show we have birthed IMAGI-NATION {University}, IMAGINE Film, a Hoodie that pays rent, and 1000’s of unlikely connections. The first season: https://vimeo.com/454576826/883f618ecb<br> Example episode: Each episode partners with a school and via the knowledge and the people on IMAGI-NATION {TV}, we are looking to provide unlikely connections to 5000 marginalised youth per annum by 2024 (100 kids per school per show). 5 Guest profiles IMAGI-NATION {Radio} Our main show is Making of a Hoodie Podcast with a few others in production Making of a Hoodie Podcast A monthly/bi-monthly activated podcast where we create unlikely connections, and then from the podcast create a hero hoodie, then activate more unlikely connections. Each year we work on: · 12 Schools globally · 3 activists · 3 artists · 3 alternative thinkers Our current distribution partner for the show and the Hoodies is The ICONIC. Via Making of a Hoodie Podcast we are looking to create unlikely connections with 1000 marginalised youth per year (100 kids per school per show). Example Show: https://podlink.to/makingsomethingouttanothing<br> Example Hoodie:https://shop.aimementoring.com/products/moah-hero-hoodie<br> 2-3 participant case studies IMAGI-NATION {Cinema} Once a year we work on releasing a film as a driver to open applications for IMAGI-NATION {University}. We see our films as a way to create unlikely connections with ideas and ways of thinking. Our current films are: · COGS · Dreams Our 2021 Film is: · 7 Down Our 2022 Film is: · IMAGINE Film We are also working on ways to tell the story of our Professors of IMAGI-NATION {University} to the world. Fashion for Good We can create activated Hoodies to amplify any campaign or idea or story. Current Hoodie campaigns we are running: · Kindness Hoodie · Making Space Hoodie · Hero Hoodies via Making of a Hoodie Podcast IMAGI-NATION {Library} This is our legacy to the world for the next 60,000+ years of human existence. This is where we keep developing all of our books, and mentor tools. The key development in this area is the creation of Mentor Class - a variety of videos and lessons from Mentors.

      Mentor Class example IMAGI-NATION In 2022 we will have our own digital social network for people to be able to enter and exchange and engage with each other's time, knowledge, and opportunities. Designed with unlikely connections between some of the world’s most interesting organisations and human beings, IMAGI-NATION models a different economy and is a home for kids pushed outside the margins to walk across a bridge into knowledge and opportunities, and a space for citizens of our earth to work out how to live and design a world more equitably Appendix: Glossary of words and phrases in the AIME universe 18 values A set of values that infuse everything we do. Everyone enrolled in IMAGI-NATION {University} is trained in our 18 values. These are hope, change, freedom, rebelliousness, listening, empathy, BRAVE goals, no shame, initiative, yes and, forgiveness, kindness, gift of time, failure, asking questions, hard work/discipline, know yourself, mentors not saviours. 365-day Goal Station An ingredient of pop-up IMAGI-NATION {Factory} days. Where mentees write on post-it notes their goals for the year and place them on a sign where they can be seen. 6 knowledge fields The 6 key areas of knowledge and experience we have gained over the years that form the basis for everything we do and that we teach at IMAGI-NATION {University}. These are Imagination, Mentoring, Organising Change, Building Bridges, Flipping the Script and Hoodie Economics. AIME A global network that connects youth from marginalised backgrounds with the rest of the world to make space for exchanges of time, knowledge and opportunities between them. AIME Time Machine (AimeTM) An ingredient of pop-up IMAGI-NATION {Factory} days. Where mentees ‘deposit’ the baggage they are going to leave behind before they enter the IMAGI-NATION {Factory}. Always drafting We are always drafting. We have released ourselves from perfection and embraced the idea that our work is always a draft. It’s never finished, never perfect. Asking questions One of our 18 values. Asking questions allows us to move from what we already know to what we don’t yet know. Asterix Professor of Hoodie Economics at IMAGI-NATION {University}. Asterix is a philosopher combined with an economics major in pursuit of what makes life worth living. She’s asking some very big questions through her research to redefine how we think about adding value in our world – pursuing an exchange of time and experience instead of just money. Blue Professor of Flipping the Script at IMAGI-NATION {University}. Blue knows that self-authorship and an entrepreneurial mindset are integral in order to move oneself outside the dominant narrative. His fundamental lesson in flipping the script: “I don’t have to play a part in someone else’s story”. Blue wants to help write a curriculum for all students to see themselves in a new light at IMAGI-NATION {University}. BRAVE goals One of our 18 values. AIME embodies BRAVE (BIG, RISKY, AUDACIOUS, VISIONARY, ENDLESS) goals. Building bridges One the 6 knowledge fields taught at IMAGI-NATION {University}. Creating connections across nations, cultures, races, ages, socio-economic differences. Cellular network Our organisational structure at AIME—a living, evolving, decentralised system of intermingling cells. Change One of our 18 values. Change is the only constant! Co-CEO The Co-CEO program looks at levelling the playing field and making boardrooms more diverse and inclusive. Executives recruit a young person aged 18-30 from a background that has historically experienced marginalisation who will shadow them for 6-12 months and absorb all the learning available to those who get a seat at the decision-making table. Empathy One of our 18 values. Empathy is feeling with the heart of another person. Einstein Professor of Building Bridges at IMAGI-NATION {University}. Einstein wrote a paper as a sociology grad student in the 1970’s based on a phenomenon she gathered from her research: instead of going from A to B and B to C, what if we just built a bridge from A to C? Now she’s getting recruited by leaders around the world to talk about building bridges. The problem is: she’s not sure it’s going to work... Energy Professor of Mentoring at IMAGI-NATION {University}. Energy is on a lifelong quest to pass on knowledge. She earned her PhD in mentoring; she loves the Plato/Socrates relationship; she’s obsessed with seeing knowledge passed down from generation to generation. If she wants to tell you something, she’ll tell you a parable. She knows that if you want to change the world, you need to connect with people through stories. Failure One of our 18 values. When we fail, we learn. When we learn, we grow. Failure Time An ingredient of pop-up IMAGI-NATION {Factory} days. A confidence and resilience-building session where kids try out new things and learn it’s ok to fail. Flipping the script One the 6 knowledge fields taught at IMAGI-NATION {University}. Shifting the dominant narrative from a lens of problem to solution. Forgiveness One of our 18 values. Forgiveness gives us the power to move beyond a certain circumstance or person and not let it define us. Freedom One of our 18 values. Freedom is about casting off the chains that come from ourselves, history, society. GAIME of Life An ingredient of pop-up IMAGI-NATION {Factory} days. An interactive writers’ room and role play game where kids get to write and bring to life a story that can inspire kids like themselves. Gift of time One of our 18 values. At AIME, we believe the greatest gift we can give is the gift of our time by turning up for others. Hard work/discipline One of our 18 values. Hard work and discipline are the gears behind change. It’s not always pretty but it’s completely necessary. Hoodie The AIME Hoodie is the most meaningful Hoodie in the world. Since 2010, it has been the currency of IMAGI-NATION and our device for change. We ask people to act, to stand up and create change, and in exchange, we give them a hoodie to say “Thank you for fighting for a fairer world.” Hoodie Economics One the 6 knowledge fields taught at IMAGI-NATION {University}. The economy that underpins AIME: elevating the exchange of time, knowledge and opportunity above money. Hope One of our 18 values. Hope is believing in a better future and working to make it happen Hope Professor of Imagination at IMAGI-NATION {University}. Hope knows that hope doesn’t come easy: it’s always a struggle. He’s trying as hard as possible to build that bridge between reality and unreality. Hope feels the heaviness of hope; he carries this giant burden and responsibility – all the while thinking: “Don’t make me carry this alone!” Hope is the epitome of hard work: he knows you don’t get to opt out of the work if you want to change the world. Imagination One the 6 knowledge fields taught at IMAGI-NATION {University}. Imagination is the beginning of human thought and action. IMAGI-NATION An online world where we can model how society can work differently, where everyone has a seat at the table, where people enter and engage with each other and exchange time, knowledge, and opportunities, and where we are all invited to make an unlikely connection and help build a fairer world. IMAGI-NATION {Ambassadors} One of the options of the {Entrepreneurs} course at IMAGI-NATION {University}. A 100-day challenge for school students to use IMAGI-NATION to create a fairer world through a change mission of their choice. IMAGI-NATION {Artists} One of the options of the {Entrepreneurs} course at IMAGI-NATION {University}. A three-month residency for young artists to be mentored by a team of artists and have their work featured on IMAGI-NATION {TV} and in our IMAGI-NATION {Gallery}. IMAGI-NATION {CEO4Good} One of the options of the {Entrepreneurs} degree course at IMAGI-NATION {University}. A 100-day challenge for school students from inside the margins to mobilise their networks to share wealth, knowledge, opportunities with kids being left behind. IMAGI-NATION {Cinema} Our films and series use story to create unlikely connections with ideas and ways of thinking. Currently: Cogs (film, 2017), Dreams (film, 2018), The Professors (series, 2021), 7 Down (film, 2021), IMAGINE (film, coming in 2022), The Professors’ House (series, coming in 2022). IMAGI-NATION {Citizens} One of the degree courses at IMAGI-NATION {University}. For individuals to lead projects that drive meaningful change in their community and the world using the tools of IMAGI-NATION. IMAGI-NATION {Classrooms} A digital mentoring and tutoring session delivered via online meeting platforms to support mentees academically. IMAGI-NATION {Curriculum} A suite of mentoring tools and activities for school students based around our 18 values delivered through our pop-up IMAGI-NATION {Factory} days, IMAGI-NATION {Teachers} and partnerships with educators. Includes the Magic Maker, the Purple Carpet, the 365-day Goal Station, Sacrifice Planes, AIME Time Machine, Failure Time, GAIME of Life, Keys to the City, the Hoodie, books, films and more. IMAGI-NATION {Entrepreneurs} One of the degree courses at IMAGI-NATION {University}. School students become entrepreneurs for good and gain hands-on experience in leading change for themselves, for others or for the planet, including by using their artistic talents to have their voice and other voices heard. Includes {Ambassadors}, {Artists}, {CEO4Good}, {Filmmakers}, {Writers}. IMAGI-NATION {Executives} One of the degree courses at IMAGI-NATION {University}. For executives wanting to transform the leadership culture of their organisations, level the playing field for young people from outside the margins and bring diverse young talent into the boardroom. IMAGI-NATION {Factory} An immersive theatre experience delivered on school and university campuses to help kids develop confidence, unlock imagination and brave thought, and free their potential to create change in their world and in the wider world. This is how the IMAGI-NATION {Curriculum} is delivered to mentees. IMAGI-NATION {Filmmakers} One of the options of the {Entrepreneurs} degree course at IMAGI-NATION {University}. School students are mentored by professionals from the TV and film industry in how to tell stories and make films. IMAGI-NATION {Gallery} A virtual space and physical spaces (including the Hoodie) where AIME artists can display and sell their artwork and connect with established artists, galleries and opportunities. IMAGI-NATION {Library} A resource library of free IMAGI-NATION knowledge and tools to live on forever, for humanity. Available to everyone, both within and outside of IMAGI-NATION {University}. IMAGI-NATION {Presidents} One of the degree courses at IMAGI-NATION {University}. {Presidents} are university students who lead an AIME student chapter on their campus and create mentoring connections between university student mentors and 100 high school kids who have been pushed outside the margins. IMAGI-NATION {Radio} Where we host our Making of a Hoodie podcast. Each episode invites a different school to give the stage for youngsters to create unlikely connections and co-design an exclusive AIME hoodie sold on ICONIC apparel. IMAGI-NATION {Teachers} One of the degree courses at IMAGI-NATION {University}. Teachers wanting to teach with IMAGI-NATION to engage all students in the classroom and build bridges to local employers and community. IMAGI-NATION {TV} A weekly TV show on YouTube where we curate unlikely connections. Hosted by AIME school students, {Presidents} and partner schools. People from all walks of life around the world come together to connect with young people pushed outside the margins and share knowledge and ideas on ways to actively create a fairer world. IMAGI-NATION {University} A free online university where we educate and inspire people in how to make unlikely connections to act for a fairer world. With courses for school students, university students, teachers, executives and everyday citizens. IMAGI-NATION {Writers} One of the options of the {Entrepreneurs} degree course at IMAGI-NATION {University}. School students are mentored by established writers in how to write and tell stories. IMAGINE film The first crowd-written, crowd-produced feature-length film. To create the stage for kids from marginalised backgrounds to join household names in film and television for a live creation mentoring experiment in filmmaking. Impact Real-life change in someone’s mind, in their life, in their community, in the world because of an unlikely connection with an idea, a way of thinking, a piece of knowledge, a person, and that leads to a fairer world in the short, long or medium term. Initiative One of our 18 values. Initiative is about saying ‘If not me then who? If not, now then when?’ Keys to the City An ingredient of pop-up IMAGI-NATION {Factory} days. A moment where kids step to the front, take the stage and get the chance to shine in any way they choose. Kindness One of our 18 values. Kindness is in the AIME DNA, we LOVE to trade in the currency of kindness. Kindness Hoodie A hoodie designed to inspire kindness throughout the year. Every week, 20 people around the world each wear a kindness hoodie for a week, spread as much kindness as they can in whichever way they choose, then pass the hoodie on to the next 20 people. Know yourself One of our 18 values. Knowing yourself means increasing your awareness of the emotions, motivations, desires, abilities, fears and aspirations that form the self. Lionelcorn Professor of Organising Change at IMAGI-NATION {University}. Lionelcorn is fascinated by organizational systems that exist in the wild. (He’s obsessed with mycelium.) All of his organizational theories are based in natural regeneration. He thinks it’s bullshit that the world isn’t changing like nature. Chaos is natural. He’s pushing for chaos and change. Listening One of our 18 values. Listening is the gateway to empathy and connection, and is often a more powerful action than speaking. Magic Maker An ingredient of pop-up IMAGI-NATION {Factory} days. A question mark wand with 1,000 questions on it that work as a ‘get to know you’ conversation starter to bring mentors and mentees together. Making of a Hoodie A monthly/bi-monthly activated podcast that connects schools with activists, artists and alternative thinkers through ideas, knowledge and perspectives and sees them create a school hoodie together. Making Space A global art initiative that sees the work of youth from marginalised backgrounds exhibited in the IMAGI-NATION {Gallery}, on custom AIME hoodies, alongside profile artists and through their networks, and in galleries around the world. Meeting Place A global exchange portal where youth from marginalised backgrounds can connect with mentors, internships, scholarships and jobs. Mentoring One the 6 knowledge fields taught at IMAGI-NATION {University}. Mentoring is the key to sharing knowledge and wisdom across generations. Mentors in Residence Knowledge-holders from different walks of life who mentor 20 of our key leaders at AIME over a 3-month term twice a year. Mentors, not saviours One of our 18 values. We are not here to ‘save’ the youth that we work with. We are here to mentor kids so that they are stronger without us. Mycelium We are inspired by mycelium, a magical and intelligent web of life above and beneath the soil and a vital force of life on Earth. Mycelium is the oldest continuously surviving multi-cellular network in the world and helps trees talk to each other underground. No shame (at AIME) One of our 18 values. No shame at AIME is one of our earliest catchphrases. There’s zero tolerance at AIME for casting shame on others for expressing themselves or for being who they are. Organising change One the 6 knowledge fields taught at IMAGI-NATION {University}. Organising change is about how we can change things to be fairer. Professors The six non-human and complex academics who are the founders of IMAGI-NATION {University} and AIME’s lead spokespeople: Professor Asterix, Professor Blue, Professor Einstein, Professor Energy, Professor Hope, Professor Lionelcorn. Purple Carpet An ingredient of pop-up IMAGI-NATION {Factory} days. Inspired by world class, theatrical architecture and the red carpet, a device that signals to the mentees they are stepping into the world of IMAGI-NATION. Rebelliousness One of our 18 values. We’re not going to change anything by accepting the status quo. Sometimes a little rebellion is necessary to create change. Sacrifice Planes An ingredient of pop-up IMAGI-NATION {Factory} days. Where mentees write on paper planes the sacrifices they will make to achieve their goals and send them out into the world. Social Network for Good IMAGI-NATION: our social network founded in 2005 that focuses on meaningful human interactions anchored in real life and in the real world, and forges unlikely connections between people to create a fairer world. Sunday Kindness Our weekly newsletter delivering a dose of kindness to the world every Sunday. This Hoodie Pays Rent An initiative launched in April 2020 where we split profits from ‘This Hoodie Pays Rent’ hoodie sales with those struggling to pay their rent because of COVID-19, to help keep a roof over their heads. Unlikely connections Unlikely connections is connecting people with other people and with stories, experiences, knowledge, ideas, perspectives and opportunities they wouldn’t ordinarily connect with, across races, ages, wealth and nations. Yes, and One of our 18 values. At AIME, YES AND means encouraging a collaborative environment and cherishing ideas before burning them.

    1. FIRST SENATOR. This cannot be By no assay of reason. ’Tis a pageant To keep us in false gaze. When we consider The importancy of Cyprus to the Turk; And let ourselves again but understand That, as it more concerns the Turk than Rhodes, So may he with more facile question bear it, For that it stands not in such warlike brace, But altogether lacks the abilities That Rhodes is dress’d in. If we make thought of this, We must not think the Turk is so unskilful To leave that latest which concerns him first, Neglecting an attempt of ease and gain, To wake and wage a danger profitless.

      How does race factor into how the European characters interact with Othello?

    1. Beware: Gaia may destroy humans before we destroy the Earth

      Hmmm. I have been thinking about Earth having a fever in response to a pathogen. Foreign bodies, viruses, known as corporations have infected the minds of their host organisms, using legal systems to reprogram their syntropic nature as living organisms with a compulsion to replace themselves with entropy machines. By assuming personhood, corporations are consuming and monopolizing the time, energy, and resources of their hosts so that they have achieved a level of control and domination over nature such that they can change the climate and reversing the process of biological and cultural evolution.

      “I think I can feel the future.”

      https://world.builderscollective.org/awake/

    1. And yet “these kids” could out argue me about everything under the sun: the inherent problems with school policies, the merits of long lunches, why we should hold class outside, and about local issues that reverberated through the building like desegregation and school closures. When they wrote, they had spelling errors and grammar issues, despite—or because of—the Warriner drills or my lack of knowledge about African American Vernacular English, but their logic and evidence spun circles around me.

      I think this is an important paragraph because it points out that academic English can often times act as a barrier to acknowledging the true ability of our students. We may focus on the grammar or misspellings and mistake that for a lack of intelligence or ability when it's simply the hegemonic norm we continue to enforce.

    1. DisCOlarships are one way to advanced from a Casual to Committed DisCO relation. As such, they are considered a Casual Relationship leaning towards committed relationships with DisCOs in general (if not to the particular DisCO hosting the DisCOlarship).

      Idk what it is, but I get a weird feeling about how explicit the lines are being drawn around casual and committed relationships. I think it's related to the earlier comment about feeling like the text is overemphasizing the DisCOs agency in defining the relationship.

      I think part of it is also the fact that the casualization of labor is a really sore point for a lot of workers right now, as we emerge as a new "precariat" class. While its understandable that a lot of this work may be considered volunteer work and thus unpaid, continually noting that this is a casual relationship with no obligation for pay definitely makes me recall toxic work relationships in my past and I imagine will do the same for other workers.

    2. The DisCO.NP may contract services when lacking the capacity - See Undercapacity and contracting outside the DisCO.NP. The DisCO.NP may also choose to engange with other DisCOs in work relationships and value transactions - see DisCOverses and Intra-DisCO Value Flows.

      On this read, I'm putting myself in the shoes of someone that is interested in working as a contributor. These sentences feel way more relevant to the DisCO itself. Not to say this doesn't belong in this page, but I think we may need to work on shaping the tone of this document to more clearly delineate who. the audience is at each point of the text.

    3. To recap: We have distinguished two main states: Casual and Committed. "Casual" means little responsibility. These are no-strings-attached relationships for mutual benefit. There are two types of Casual Relationship: Supporters (Very casual interactions) and Contributors (More active interactions and actual contributions to the DisCO.NP and its mission). "Committed" signifies a stated commitment of responsibility to the DisCO.NP and its members. Those wanting to progress from Casual to Committed have two options: DisCOLarships (practical DisCO training with no firm expectation of joining the DisCO). DisCO Dating: Intense mentoring program for applicants to join the DisCO in which they are being mentored.

      High level, I think it may make more sense to lead with "TL;DR"s rather then ending with them so that as people are browsing through the wiki, they can quickly decide if they're on the right page or not.

    4. On the downside, DisCOs are also more complex in the initial stages, although once their learning curve has been overcome, we'd argue that they function more smoothly and are more resilient organizations.

      I don't know that this is inherent to DisCOs as individual organizations! I think that this might appear to be the case given that we're still building out the core of the philosophy while also trying to create organizations that work by these ideals while existing as an explicitly counter-hegemonic endeavor. All that to say, I think you may be selling DisCOs short by including this in there, but understand why it's included right now. My main reason for bringing it up is, we don't want to give people the impression that this is the hardest path possible because it will likely result in slower adoption of these principles.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Manuscript number: RC-2021-01041 Corresponding author(s): Gregory P. Way, PhD

      1. General Statements

      On behalf of the authors, I’d like to thank the Review Commons team for sending our manuscript out for review. I’d also like to thank the three anonymous reviewers for providing valuable feedback that will improve the clarity, focus, and analysis interpretation presented in our manuscript.

      To prompt the editorial team, our paper provides two well-controlled innovations:

      We are the first to train variational autoencoders (VAEs) on classical image features extracted from Cell Painting images. VAEs are commonplace in, and have contributed major discoveries to, other biomedical data types (e.g. transcriptomics), but they have been underexplored in morphology data. In our paper, we trained and optimized three different VAE variants using Cell Painting readouts and compared these variants against shuffled data, against PCA (a nonlinear dimensionality reduction algorithm commonly used as a VAE control), and against L1000 (mRNA) readouts from the same perturbations. We found that cell morphology VAEs train with different settings than gene expression data, and that they generate interpretable latent spaces that depend on the chosen VAE variant.

      We tested special VAE properties to predict polypharmacology cell states in a novel way. Polypharmacology is a major reason why drugs fail to reach the bedside. Off-target effects cause unintended toxicity, and lead to adverse clinical events. In our paper, we used VAE latent space arithmetic (LSA) to predict polypharmacology cell states; in other words, what cells might look like if we perturbed them with a compound that had two mechanisms of action (MOA). We compared our results to shuffled data, PCA, and to LSA performed with VAEs trained using L1000 readouts. We found that cell morphology and gene expression provide complementary information, and that we could predict some polypharmacology cell states robustly, while others were more difficult to predict.

      We found value in all of the reviewer comments. We intend to conduct all but four of the proposed analyses to supplement our aforementioned innovations.

      In the following revision plan, we include all reviewer comments exactly as they were written. The reviewers often had overlapping suggestions. In these cases, we grouped together similar reviewer comments and responded to them once.

      We include three sections: 1) A description of the revisions we plan to conduct in the near future; 2) A description of changes we have already made; and 3) A description and rationale of changes we will not pursue.

      Lastly, we would like to highlight that all reviewers provided positive feedback in their reviews. They discussed our paper as “conceptually and technically unique” and were positive about our methods section, stating that we did a “good job making everything available and reproducible”. Our methods section is complete, and we provide a fully reproducible and versioned github repository. We will release a second version of our github repository when we complete our revision plan to maintain clarity for our submitted version and the peer-reviewed version.

      1. Description of the planned revisions

      2.1. Address UMAP interpretability to provide a deeper description of MOA performance

      Reviewer 1: Instead of using UMAP embedding, it would be better to compare reconstruction error or show a reconstructed image with the original image to claim that models reliably approximate the underlying morphology data.

      Reviewer 1: Rather than just stating that the VAE's did not span the original data distribution and saying beta-VAE performed best by eye, some simple metrics can be drawn to analyze the overlap in data for a more direct and quantified comparison. Researchers should also explain what part of the data is not being captured here. Some analysis of what the original uncaptured UMAP represents is important in understanding the limitations of the VAEs' capacity.

      Reviewer 2: The authors compare generation performance based on UMAP. In the UMAP space, data tend to cluster together even though they might be far from each other in the feature space. I would like to see more quantitive metrics on how well these methods capture morphology distributions. You can compute metrics like MMD distance, kullback leibler (KL), earthmoving distance, or a simple classifier trained on actual MoA classes tested on generated data.

      We agree with the reviewers that evaluating reconstruction loss in addition to providing the UMAP coordinates would improve understanding of VAE limitations and enable a better comparison of VAE performance. We will analyze reconstruction loss across models and include these data as a new supplementary figure, which will enable direct comparisons across models and across different MOAs.

      We also agree that UMAP interpretation can be misleading. While currently state-of-the-art, UMAP has mathematical limitations that prevent interpretation of global data structures. However, there are emerging tools, including a new dimensionality reduction algorithm, called PaCMAP, which aims to preserve both local and global structure (Wang et al, 2021). We will explore this tool to determine, both mathematically and empirically, which is most appropriate for our dataset by cross-referencing the visualization with our added supplementary figure describing per-MOA reconstruction loss.

      We would also like to emphasize that we trained our VAEs using CellProfiler readouts from Cell Painting images and not the raw Cell Painting images themselves. As this was one of our primary innovations, this detail is extremely important. Therefore, we have improved clarity and added emphasis to this point in the manuscript introduction and discussion (see section 3).

      2.2. More specific comparisons of MOA predictions to shuffled data and improved description of MOA label accuracy

      Reviewer 1: It is difficult to know the clear threshold for successful performance is on figures like Figure 7 and SFigure 9, but by and large, it appears that the majority of predicted combination MOAs were not successful. Without the ability to either A) adequately predict most all combinations from individual profiles that were used in training or B) an explanation prior to analysis of which combination will be able to predict, it is difficult to see this method being used since the combinatorial predictions are more likely not informative.

      Reviewer 1: The researchers justify the poor performance compared to shuffled data, by saying that A) MOA annotations are noisy and unreliable and B) they MOAs may only manifest in other modalities like what was seen in the L1000 vs morphology predictability. While these might be true, knowing this the researchers should make an effort to clean and de-noise their data and select MOAs that are well-known and reliable, as well as, selecting MOAs for which we have a known morphological or genetic reaction.

      Reviewer 3: Figure 6 is missing error bars (standard deviation of the L2 distance) and, as such, is hard to draw conclusions from.

      We thank the reviewers for raising this concern. We agree that it is critical, and we appreciate the opportunity to address it.

      All three of these comments relate to being unable to draw conclusions from our results when most A∩B predictions appear to have no difference from shuffled controls. Therefore, to address this comment, we will update our LSA evaluation to compare each MOA to a matched set of randomly shuffled data. Specifically, in our existing comparison, we realized a methodological fallacy in how we're displaying these data shuffles. We should be comparing specific MOA combinations to their corresponding shuffled results instead of comparing all to all, which will artificially decrease performance when there are polypharmacology predictions that fail to recapitulate the ground truth cell states.

      We have connected with Paul Clemons, the senior director Director of Computational Chemical Biology Research at the Broad Institute of MIT and Harvard, who has informed us that the Drug Repurposing Hub annotations are among the most well documented. Therefore, while we know that biological annotations are often incomplete, our original text overemphasized the amount of noise contributed by inaccurate labels. We therefore added the following sentence to the discussion to clarify this important point:

      “However, the Drug Repurposing Hub MOA annotations are among the most well-documented resources, so other factors like different dose concentration and non-additive effects contribute to weak LSA performance for some compound combinations (Corsello et al, 2017).”

      We will also update our supplementary figure to account for specific MOA shuffling and include additional text comparing Cell Painting and L1000 showing which MOAs perform best in which modality.

      2.3. More detailed evaluation of MOA performance across drug variance and drug classes

      Reviewer 1: With the small number of combinations that are successfully predicted, to build confidence in the performance, it would be necessary to explain the reason for the differences in performance. Further experimentations should be done looking into any relationship between the type of MOAs (and their features) and the resulting A|B predictability. Looking at Figure 7, the top-performing combinations are comprised entirely of inhibitor MOAs. If the noisiness of the data is a factor, there should be some measurable correlation between feature noisiness and variation and the resulting A|B predictability from LSA.

      We agree with the reviewer that further experimentation would be helpful to gain confidence in our LSA performance. We plan to perform two different analyses to address this question. First, we will compare profile reproducibility (median pairwise correlations among MOAs) to MOA predictability. This will provide insight to determine the relationship between MOA measurement variance and performance. Second, we will split MOAs by category (e.g. inhibitor, activator) and test if there are significant performance differences between categories across VAE models in both L1000 and Cell Painting data. This will tell us if there are certain trends in the type of MOAs we’re able to predict. If there is, this would be useful knowledge since it could suggest that certain types of MOAs are associated with a more consistent cell state.

      2.4. Higher confidence in LSA overfitting assessment

      Reviewer 1: To show that the methodology works well on unseen data, researchers withheld the top 5 performing A|B MOAs (SFig 9) and showed they were still well predicted. This is not the most compelling demonstration since the data to be held out was selected with bias as the top-performing samples. It would be much more interesting to withhold an MOA that was near or only somewhat above the margin of acceptability and see how many holdouts affected the predictability of those more susceptible data points. From my best interpretation, the hold-out experiment also only held out the combination MOA groups from training. It would be better if single MOAs (for example A) which were a part of a combination of MOA (A|B) were also held out to see if predictability suffered as a result and if generalizability did extend to cells with unseen MOAs (not just cells which had already highly performing combinations of seen MOAs).

      We believe our original analysis was extremely compelling. Even if we removed the top MOAs from training, we were still able to capture their combination polypharmacology cell states through LSA. We find this similar to removing all pictures of sunglasses in an image corpus of human faces, but still being able to reliably infer pictures of people wearing sunglasses. Specifically, this tells us that our model is learning some fundamental data generating function that our top performing MOAs tap into regardless of if they are present or not in training.

      However, we agree with the reviewer that withholding intermediate-performing MOAs would also be informative, but for a separate reason. Unlike the best predicted MOAs, the intermediate MOAs are likely more susceptible to changes in the training data, so it would be interesting to determine if intermediate MOAs’ performance is a result of overfitting instead of truly learning aspects of the data generating function. We plan to perform this new analysis and add the results to Supplementary Figure 8 as a subpanel and add a full description of the approach to the appropriate methods subsection.

      2.5. Additional metrics to evaluate LSA predictions to provide more confident interpretation

      Reviewer 2: The predictions are evaluated using L2 distances, which I find not that informative. I would like to see other metrics (correlation or L1 or distribution distances in previous comments)

      We agree with the reviewer that using more than one metric would be helpful because oftentimes a single metric does not tell a complete story. We will add a panel to the LSA supplementary figure (Supplementary Figure 7), using Pearson correlation instead. While L2 distances will tell us how close predictions are to ground truth, Pearson correlations will tell us how consistent, on average, we are able to predict feature direction.

      2.6. Adding a performance-driven feature level analysis to categorize per-feature modeling ability

      Reviewer 2: I would like to see feature-level analysis, which features are well predicted and which ones are more challenging to predict?

      We agree with the reviewer that feature level analysis would be interesting to study. We believe that understanding which features are easy and hard to model could give insight into why certain MOAs (which could be associated with more signal in certain Cell Painting features) are predicted better than others.

      However, we are concerned that it is difficult to have an objective measurement of which features are easier to model because features that have less variation might be easier to model. So, we will analyze the correlation between individual feature reconstruction loss vs. feature variance across profiles. We will color-code the points to represent feature groups or channels. This analysis will not only demonstrate the relationship between feature variance and modeling ability, but also provide insight into the difficulty of modeling individual CellProfiler features.

      1. Description of the revisions that have already been incorporated in the transferred manuscript

      3.1. Documenting positive feedback as provided by the three reviewers

      Reviewer 1: With access to the dataset, the posted GitHub, and documentation in the paper, I believe that the experiments are reproducible.

      Reviewer 1: The experiments are adequately replicated statistically for conventions of deep learning.

      Reviewer 1: This paper proposes a conceptually and technically unique proposal in terms of application, taking existing technologies of VAEs and LSA and, and as far as I know, uses them in a novel area of application (predicting and simulating combination MOAs for compound treatments). If this work is shown to work more broadly and effectively, is seen through to it completion, and is eventually successfully implemented, it will help to evaluate the effects of drugs used in combination on gene expression and cell morphology. An audience in the realm of biological deep learning applications as well as an audience working in the compound and drug testing would be interested in the results of this paper. Authors successfully place their work within the context of existing literature, referencing the numerous VAE applications that they build off of and fit into the field of (Lafarge et al, 2018; Ternes et al, 2021, etc...), citing the applications of LSA in the computer vision community (Radford et al, 2015, Goldsborough et al, 2017), and discussing the biological context that they are working in (Chandrasekaran et al, 2021).

      Reviewer 2: The main novelty of the work is applying VAEs on cell painting data to predict drug perturbations. The final use case could be guiding experimental design by predicting unseen data. However, the authors do not show such an example and use case which is understandable due to the need for doing further experiments to validate computational results and maybe not the main focus of this paper. The authors did a good job of citing existing methods and relevant. The potential audience could be the computational biology and applied machine learning community.

      Reviewer 3: The manuscript is beautifully written in a crystal clear manner. The authors have made a visible effort towards making their work understandable. The methods section is clear and comprehensive. All experiments are rigorously conducted and the validation procedures are sound. The conclusions of the paper are convincing and most of them are well supported by the data. Both the data and the code required to reproduce this work are freely available. Overall, the article is of high quality and relevance to several scientific communities.

      We thank the reviewers for their encouraging remarks and overall positive sentiment. As early-career researchers, we feel empowered by these words.

      3.2. Moved Figure 2 to supplement and removed Figure 5

      Reviewer 1: Fig 2 is not informative so it can go to supplementary.

      Reviewer 2: I liked the paper's GitHub repo, the authors did a good job making everything available and reproducible. As a suggestion, you can move the learning curves in two the sup figures cause they might not be the most exciting piece of info for the non-technical reader.

      Reviewer 3: I would suggest removing Figure 5 (or moving it to the supplementary) as it revisits the content of Figure 1 and does not bring much extra information.

      We agree that Figure 2 might not be informative to a non-technical reader, so we have accepted this suggestion by both reviewers 1 and 2, and we have moved Figure 2 to supplementary.

      We agree with the reviewer and have removed Figure 5.

      3.3. Clarified our data source as CellProfiler readouts, not raw Cell Painting images

      Reviewer 1: In Fig 4, it would be useful to show a few sample representative images with respect to CellProfiler feature groups.

      Reviewer 1: Figure 6, what does it means original input space? Does it mean raw pixel image? As researchers extracted CellProfiler feature groups already, it would be interesting to compare mean L2 distance based on CellProfiler features so that whether VAE improves performance or not (compared to handcrafted features) as a baseline.

      Reviewer 3: While what "morphological readouts" concretely mean becomes clearer later on in the paper, it would be useful to give a couple of examples early on when introducing the considered datasets.

      We thank the reviewer for these suggestions, which bring to light a common source of confusion, which we must alleviate. We are working with CellProfiler readouts (features extracted using classical algorithms) of the Cell Painting images and not the images themselves. We have made several edits throughout the manuscript to improve clarity and remove this confusion, including the introduction, in which we clearly state our model input data:

      “Because of the success of VAEs on these various datasets, we sought to determine if VAEs could also be trained using cell morphology readouts (rather than directly on images), and further, to carry out arithmetic to predict novel treatment outcomes. We derive the cell morphology readouts using CellProfiler (McQuin et al, 2018), which measures the size, structure, texture, and intensity of cells, and use these readouts to train all models.”

      This decision comes with tradeoffs: The benefit of using CellProfiler readouts instead of images is that they are more manageable but we might lose some information. We more thoroughly discuss this important tradeoff in the discussion section:

      “We determined that VAEs can be trained on cell morphology readouts rather than directly using the cell images from which they were derived. This decision comes with various trade-offs. Compared to cell images, cell morphology readouts as extracted by image analysis tools (e.g. CellProfiler) are a more manageable data type; the data are smaller, easier to distribute, substantially less expensive to analyze and store, and faster to train (McQuin et al, 2018). However, it is likely some biological information is lost, because these tools might fail to measure all morphology signals. The so-called image-based profiling pipeline also loses information, by nature of aggregating inherently single-cell data to bulk consensus signatures (Caicedo et al, 2017).”

      3.4. Clarified future directions to infer cell health readouts from simulated polypharmacology cell states

      Reviewer 1: Authors also make the claim that they can infer toxicity and simulate the mechanism of how two compounds might react. This is a claim that would not be supported even if the method were able to successfully predict morphology or gene profiles. Drug interaction and toxicity are quite complex and goes beyond just morphology and expression. VAEs predicting a small set of features would not be able to capture information beyond the readouts, especially when dealing with potentially unseen compounds for which toxicity is not yet known. For example, two compounds might produce a morphology that appears similar to other safe compounds but has other factors that contribute to toxicity. Further, here they show no evidence of toxicity or interaction analysis.

      The reviewer is correct that such a claim is unsupported by our research. Our message was actually that inferring toxicity could be a potential future application of our work. Specifically, for example, we can apply orthogonal models of cell toxicity that we previously derived using other data (Way et al, 2021a) to our inferred polypharmacology cell states. We thank this reviewer for noticing our lack of clarity, and we have made changes in the discussion to make it clear that inferring toxicity is something we may do in the future and is not something that is discussed in the manuscript:

      “In the future, by predicting cell states of inferred polypharmacology, we can also infer toxicity using orthogonal models (e.g. Way et al. 2021) and simulate the mechanisms of how two compounds might interact.”

      3.5. Clarified our method of splitting data, and noting how a future analysis will answer overfitting extent

      Reviewer 2: Could authors outline detailed data splits? Which MoA are in train and which are held out from training? As I understood, there were samples from MoAs that were supposed to be predicted in the calculation of LSA? Generally, the predicted MoA should not be seen during training and not in LSA calculation.

      We now more explicitly detail how we split our data in the methods:

      “As input into our machine learning models, we split the data into an 80% training, 10% validation, and 10% test set, stratified by plate for Cell Painting and stratified by cell line for L1000. In effect, this procedure evenly distributes compounds and MOAs across data splits.”

      We also thank the reviewer for this comment, because they express an important concern about making sure that we are not overfitting to the data. We have explained in the manuscript that because of lack of data, MOAs were repeated in training and LSA. However, we believe overfitting is not playing a large role in model performance. Through our hold 5 out experiment, we are able to show that our models are able to predict the same MOAs irrespective of whether they were in the training data, indicating that we did not overfit to the distribution of certain MOAs.

      Reviewer 1 also suggested that we do the hold 5 out experiment on A∩Bs that were barely predicted. After we do that, we will explicitly demonstrate the extent of overfitting.

      3.6. Introduced acronyms when they first appear in the manuscript

      Reviewer 3: The Kullback-Leibler divergence is properly introduced in the methods part, but not at all in the introduction (it directly appears as "the KL divergence"). To enhance readability, it would be better to fully spell it before using the acronym, and maybe give a one-sentence intuition of what it is about before pointing out to the methods part for more details.

      We thank the reviewer for bringing this to our attention. We have carefully reviewed the entire manuscript and have corrected such instances of clear introductions to acronyms.

      3.7. Fixed minor text changes

      Reviewer 3: In Figure 1, I would recommend changing "compression algorithms" to "dimension reduction algorithm" or "embedding algorithm". In a compression setting, I would expect the focus to be on the number of bits of information each method requires (or the dimension of the resulting embedding) to encode the data while guaranteeing a certain quality threshold. This is obviously not the case here as the dimension of the embedding is fixed and the focus is on exploring how the embedding is constructed (eg how much it decorrelates the different features, etc) - which may be misleading.

      Reviewer 3: I recommend using "A n B" or "A & B" or "(A, B)" to denote the combination of two independent modes of action A and B. The current notation "A | B" overloads the statistical "A given B" which appears in the VAE loss and is therefore misleading.

      We agree with the reviewer, and aim to minimize all sources of potential confusion. We have made the change in the figure.

      We also agree that our current notation can be confusing. We have updated all instances of “A|B” with “A ∩ B”.

      3.8. Added hypothesis of MMD-VAE oscillations to supplementary figure legend

      Reviewer 3: Do the authors have a hypothesis of what may be causing MMD-VAE to oscillate during validation when data are shuffled? This seems to be the case on two of the three considered datasets (Figure 2 and SuppFigure 1) and is not observed for the other models. Including a few sentences on that in the text would be interesting.

      We believe a big reason for this is because of the fact that the optimal MMD-VAE had a much higher regularization term, which puts a greater emphasis on forming normal latent distributions, than the optimal Beta or Vanilla VAE. Forcing the VAE to encode a shuffled distribution into a normally distributed latent distribution would be difficult to do consistently across different randomly shuffled data subsets, and therefore might cause oscillations in the training curve across epochs when the penalty for that term is high. As these observations may be interesting to a certain population of readers, we have incorporated this explanation into the supplementary figure legend (which is where this figure is shown):

      “Forcing the VAE to consistently encode a shuffled distribution into a normally distributed latent distribution would be difficult, and therefore might cause oscillations in the training curve across epochs.”

      3.9. Explained our selection of VAE variants

      Reviewer 3: The different types of considered VAE and their differences are very clearly introduced. It may however be good to motivate a bit more the focus on beta-VAE and MMD-VAE among all the possible VAE models. This is partly done through examples in the second paragraph of page 2, but could be elaborated further.

      We thank the author for their encouraging remarks. We have made edits to the manuscript’s introduction, explaining why we chose these two variants out of all the possible choices:

      “We trained vanilla-VAEs, β-VAEs, and MMD-VAEs only, and not other VAE variants and other generative model architectures, such as generative adversarial networks (GANs), because these VAE variants are known to facilitate latent space interpretability.”

      1. Description of analyses that authors prefer not to carry out

      4.1. We will not explore additional latent space dimensions in more detail, as this is out of scope

      Reviewer 1: As both reconstructed and simulated data did not span the full original data distribution, it might be better to look at reconstruction error and increase the dimension of latent space.

      We thank the reviewer for bringing up this important point. Our VAE loss function consists of the sum of reconstruction error and some form of KL divergence. Specifically, this reviewer is suggesting that if we only minimize reconstruction error (or focus more on reconstruction over KLD by lowering beta), a higher latent dimension would result in better overall reconstruction. This is true, but doing so would have negative consequences. While we would perhaps get the UMAPs to show the full data distribution, the UMAPs are not our focus; predicting polypharmacology through LSA is. We found that when we have a higher focus on the reconstruction term, we have more feature entanglement, as indicated by lower performance when simulating data and overlapping feature contribution per latent feature. The fact that simulating data would logically require less disentanglement than performing LSA shows that we require higher regularization (and hence lower focus on reconstruction) than the one we got from simulating data.

      Essentially, while the reviewer's comments would improve reconstruction and allow us to improve the UMAPs, doing so would likely worsen LSA performance, which is the main focus of the project. Also, increasing the latent dimension without changing beta would likely have caused little to no change because since beta is encouraging disentanglement, it would cause the newly added dimension to have little variation and encode little new information that wasn’t already encoded before.

      We have also previously explored the concept of toggling the latent dimensions in a separate project (Way et al, 2020). We are very interested in this area of research in general, and any additional analyses (beyond hyperparameter optimization) deserves a much deeper dive than what we can provide in this paper.

      Lastly, we intend to include a deeper description and analysis of reconstruction loss across models, datasets, and MOAs as was suggested by a previous reviewer comment (see section 2.1 above)

      4.2. We will not review Gaussian distribution assumptions of the VAE as we feel it is not informative

      Reviewer 1: By looking at SFigure 6, I am wondering whether latent distribution actually met gaussian distribution (assumption of VAE). It may show skew distribution as some of latent features shows low contribution.

      This reviewer’s comment is interesting, but we do not believe it would change the findings of our study. Suppose we find that the latent dimensions aren’t normally distributed. This wouldn’t change much; a gaussian distribution isn’t the most critical to perform LSA. We need the latent code to be disentangled, but having normally distributed latent features doesn't necessarily mean that we have good disentanglement (see https://towardsdatascience.com/what-a-disentangled-net-we-weave-representation-learning-in-vaes-pt-1-9e5dbc205bd1)

      4.3. In this paper, we will not train or compare conditional VAEs nor cycle GANs

      Reviewer 2: While authors provided a comparison between vanilla VAE and MMD-VAE, B-VEA, there are other methods capable of doing similar tasks (data simulation, counterfactual predictions ), I would like to see a comparison with those methods such as conditional VAE( https://papers.nips.cc/paper/2015/hash/8d55a249e6baa5c06772297520da2051-Abstract.html, CVAE + MMD : https://academic.oup.com/bioinformatics/article/36/Supplement_2/i610/6055927?login=true) or cycle GANs(https://arxiv.org/abs/1703.10593 ).

      While such comparisons would be interesting, they are not the main focus of the manuscript, which is to benchmark the use of VAEs in cell morphology readouts and to predict polypharmacology.

      We think that CVAE would not be appropriate for our study. In a CVAE, the encoder and decoder are both conditioned to some variable. In our situation where we are predicting the cell states of different MOAs, it would make most sense to condition on the MOA. However, because we’re using the MOA labels in our LSA experiment, conditioning on them is likely to bias our results and not be effective for MOAs outside the conditioning.

      For cycle GANs, we have found that training using these data, in a separate study in our lab, is extremely difficult. Our lab has not published this yet, but once we are able to better understand cycleGAN behavior in these data, it will require a separate paper in which we compare performance and dissect model properties in much greater detail.

      Nevertheless, we have added citations to multi-modal approaches like cycle GANs (see section 4.4) as they will point a reader to useful resources for future directions.

      4.4. We will not be comparing with multi-modal integration, but we clarified our focus on Cell Painting VAE novelty and added multi-modal citations

      Reviewer 1: Researchers found that the optimal VAE architectures were very different between morphology and gene expression, suggesting that the lessons learned training gene expression VAEs might not necessarily translate to morphology. It would be interesting to compare the result with multimodal integration as baseline (i.e., Seurat).

      Our focus in this paper was to train and benchmark different variational autoencoder (VAE) architectures using Cell Painting data and to demonstrate an important, unsolved application in predicting polypharmacology that we show is now possible for a subset of compounds. It was a natural and useful extension to compare Cell Painting VAE performance with L1000 VAE performance especially since our data set contained equivalent drug perturbations. We feel that any extension including multi-modal data integration will distract focus away from the Cell Painting VAE novelty, and requires a much deeper dive beyond scope of our current manuscript.

      Additionally, there have been other, more in-depth and very recent multi-modal data integration efforts using the same or similar datasets (Caicedo et al, 2021; Haghighi et al, 2021). In a separate paper that we just recently submitted, we also dive much deeper to answer the question of how the two modalities complement one another in various ways and for various tasks (Way et al, 2021b). These two papers already provide a deeper and more informative exploration of Cell Painting and L1000 data integration.

      Therefore, because multi-modal data integration, while certainly interesting, will distract from the Cell Painting VAE novelty and is redundant with other recent publications, we feel it is beyond scope of this current paper.

      Nevertheless, multi-modal data integration is important to mention, so we add it to the discussion. Specifically, we discuss how multi-modal data integration might help with predicting polypharmacology in the future and include pertinent citations so that we, or another reader, might be able to follow-up in the future. The new section reads:

      “Because we had access to the same perturbations with L1000 readouts, we were able to compare cell morphology and gene expression results. We found that both models capture complementary information when predicting polypharmacology, which is a similar observation to recent work comparing the different technologies’ information content (Way et al, 2021). We did not explore multi-modal data integration in this project; this has been explored in more detail in other recent publications (Caicedo et al, 2021; Haghighi et al, 2021). However, using multi-modal data integration with models like CycleGAN or other style transfer algorithms might provide more confidence in our ability to predict polypharmacology in the future (Zhu et al, 2017).”

      1. References

      Caicedo JC, Cooper S, Heigwer F, Warchal S, Qiu P, Molnar C, Vasilevich AS, Barry JD, Bansal HS, Kraus O, et al (2017) Data-analysis strategies for image-based cell profiling. Nat Methods 14: 849–863

      Caicedo JC, Moshkov N, Becker T, Yang K, Horvath P, Dancik V, Wagner BK, Clemons PA, Singh S & Carpenter AE (2021) Predicting compound activity from phenotypic profiles and chemical structures. bioRxiv: 2020.12.15.422887

      Corsello SM, Bittker JA, Liu Z, Gould J, McCarren P, Hirschman JE, Johnston SE, Vrcic A, Wong B, Khan M, et al (2017) The Drug Repurposing Hub: a next-generation drug library and information resource. Nat Med 23: 405–408

      Haghighi M, Singh S, Caicedo J & Carpenter A (2021) High-Dimensional Gene Expression and Morphology Profiles of Cells across 28,000 Genetic and Chemical Perturbations. bioRxiv: 2021.09.08.459417

      McQuin C, Goodman A, Chernyshev V, Kamentsky L, Cimini BA, Karhohs KW, Doan M, Ding L, Rafelski SM, Thirstrup D, et al (2018) CellProfiler 3.0: Next-generation image processing for biology. PLoS Biol 16: e2005970

      Wang Y, Huang H, Rudin C & Shaposhnik Y (2021) Understanding how dimension reduction tools work: an empirical approach to deciphering t-SNE, UMAP, TriMAP, and PaCMAP for data visualization. J Mach Learn Res 22: 1–73

      Way GP, Kost-Alimova M, Shibue T, Harrington WF, Gill S, Piccioni F, Becker T, Shafqat-Abbasi H, Hahn WC, Carpenter AE, et al (2021a) Predicting cell health phenotypes using image-based morphology profiling. Mol Biol Cell 32: 995–1005

      Way GP, Natoli T, Adeboye A, Litichevskiy L, Yang A, Lu X, Caicedo JC, Cimini BA, Karhohs K, Logan DJ, et al (2021b) Morphology and gene expression profiling provide complementary information for mapping cell state. bioRxiv: 2021.10.21.465335

      Way GP, Zietz M, Rubinetti V, Himmelstein DS & Greene CS (2020) Compressing gene expression data using multiple latent space dimensionalities learns complementary biological representations. Genome Biol 21: 109

      Zhu J-Y, Park T, Isola P & Efros AA (2017) Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks. arXiv [csCV]

    1. MRS HALE: (mildly) Just pulling out a stitch or two that's not sewed very good. (threading a needle) Bad sewing always made me fidgety. MRS PETERS: (nervously) I don't think we ought to touch things. MRS HALE: I'll just finish up this end. (suddenly stopping and leaning forward) Mrs Peters? MRS PETERS: Yes, Mrs Hale? MRS HALE: What do you suppose she was so nervous about? MRS PETERS: Oh—I don't know. I don't know as she was nervous. I sometimes sew awful queer when I'm just tired. (MRS HALE starts to say something, looks at MRS PETERS, then goes on sewing) Well I must get these things wrapped up. They may be through sooner than we think, (putting apron and other things together) I wonder where I can find a piece of paper, and string.

      both women are anxious and feel uncomfortable in the situation

  5. Oct 2021
    1. In this world I think we have two kinds of knowledge: One is Planck knowledge, that of the people who really know. They’ve paid the dues, they have the aptitude. Then we’ve got chauffeur knowledge. They have learned to prattle the talk. They may have a big head of hair. They often have fine timbre in their voices. They make a big impression. But in the end what they’ve got is chauffeur knowledge masquerading as real knowledge.
    1. A picture painted on a panel is at once a picture and a likeness: that is, while one and the same, it is both of these, although the 'being' of both is not the same, and one may contemplate it either as a picture, or as a likeness. Just in the same way we have to conceive that the mnemonic presentation within us is something which by itself is merely an object of contemplation, while, in-relation to something else, it is also a presentation of that other thing. In so far as it is regarded in itself, it is only an object of contemplation, or a presentation; but when considered as relative to something else, e.g. as its likeness, it is also a mnemonic token. Hence, whenever the residual sensory process implied by it is actualized in consciousness, if the soul perceives this in so far as it is something absolute, it appears to occur as a mere thought or presentation; but if the soul perceives it qua related to something else, then,-just as when one contemplates the painting in the picture as being a likeness, and without having (at the moment) seen the actual Koriskos, contemplates it as a likeness of Koriskos, and in that case the experience involved in this contemplation of it (as relative) is different from what one has when he contemplates it simply as a painted figure-(so in the case of memory we have the analogous difference for), of the objects in the soul, the one (the unrelated object) presents itself simply as a thought, but the other (the related object) just because, as in the painting, it is a likeness, presents itself as a mnemonic token.

      Aristotle brilliantly acknowledges that when we perceive something there are many factors that are apart of it. The conscious, the subconscious, the present, the feeling of "likeness" and how we think we perceive something may not always be the case. The mind is complex, this part of the writing provokes self thought about "Can I trust my own sense/perception?"

    1. Every review of Stillwater I have seen has mentioned me, for better or worse.

      This statement made by Knox really stood out to me given our current "clickbait" styled media production. It seems to me that Stillwater is an example of a media outlet using a highly sought after story, person or current even to gain attention on their given piece of content.

      I'm reminded of YouTube videos that use current happenings of the world as a thumbnail and/or subject matter in hopes of gaining more followers, listeners or viewers to their channel.

      Similarly, Stillwater (although I haven't seen the film) seems like Hollywood using Knox's name and story to gain views, clicks and dollars.

      I think of the saying "all publicity is good publicity." However in this situation, for someone like Knox who wishes to be left alone; all publicity, even the good is considered to be bad.

      I didn't know anything about Amanda Knox, but was familiar with the name. After reading the article and doing some research on my own I came to remember I had seen a Netflix Documentary titled Amanda Knox on my feed a while back. Looking forward to diving into that in the near future.

      I'd like to conclude that we could all learn from the way this story is handled. Just because covering a story may receive a lot of interaction, traction and/or popularity doesn't necessarily make it right to do so. We as proper media literate students must be held to a higher standard and lead by example and take all accounts into consideration before moving forward with something. We must also admit when we're wrong, apologize for our mistakes and right our wrongs to the best of our abilities. We must learn by experience from Amanda Knox's past history so that we can be proactive in not allowing it to occur in the future.

    1. Doug's got a story and he told the story many times and you know when he tells story many times it becomes realer and realer to you

      I don't know if Howard is trying to give us a nudge and wink here, but if so then the subsequent retelling that Doug was "by his own story very influenced by Vannevar Bush's As We May Think article" is certainly relevant to what Howard is suggesting, given that in Doug's own letter to Bush in 1962, he claims not to have even had Bush's ideas on his radar (no pun intended) until having rediscovered the Atlantic article after already having his own serious pursuits underway at SRI (and getting on at SRI was no small feat according to Howard's telling in Tools For Thought).

      See https://web.stanford.edu/dept/HPS/sloanconference/papers/lenoir/STIMPresentations/Presentation/LetterToVBush.html

    1. Author Response:

      Reviewer #1:

      This study aims to find the genetic mechanisms underlying sex-ratio distortion through male-killing in Drosophila melanogaster flies infected with the endosymbiont Wolbachia. The endosymbiont carries the prophage WO, which is in the center of interested in this study. The key result of this study is that a synonymous mutation in a prophage gene can explain the differences between sex-ratio distorting and not distorting symbionts. The study uses transgene technology to modify phage genes and to investigate which changes in the gene is involved in the phenotype. The finding, that a synonymous SNP plays a key role is not entirely novel in biology, but there are only few examples known of this type of genotype - phenotype associations. The study does not include experiments to show that the main finding is not limited to one particular background of the fly line used. An experiment including multiple genotypes would be needed to show this.

      We agree that recapitulating the results in other backgrounds is intriguing and important for establishing a broader role of these findings. We thank the Reviewers and Editor for allowing us to pursue this line of investigation separately from this work, and we now discuss what experiments can be completed to answer these and other questions. We also edited the manuscript to tone down any conclusions that would imply generalizability of the findings at this point. For example:

      "For example, we cannot conclude that the particular codon tested here is responsible for phenotype alterations in other host genetic backgrounds or species. It is possible that this codon plays a functional role only in a singular host genetic context. Here, we changed wmk sequences while holding the host genetic background fixed, but the reverse is required to conclude whether or not the particular codon plays a general role in other genotypes or natural contexts. Second, due to possible coevolution, various codons may or may not yield similar functional effects across different host backgrounds, and additional synonymous sites may contribute to the male-killing phenotype. Thus, the results here illuminate a previously unrecognized need for future research on the functional impacts of synonymous substitutions in endosymbionts. Future work may focus on determining if there is one specific synonymous codon that affects the male-killing function in all cases, if a more general feature exists where alteration of any or a subset of N-terminal or other wmk codons affects function, or if the effect of synonymous changes is specific to this background.”

      Text summarizing the 06/21/2021 query to the Editor and Reviewers for further clarification: We believe there are several reasons why the results can stand on their own, while appropriately acknowledging caveats. First, we note the lack of genetic background testing on previous transgene experiments driving the major discoveries of Wolbachia genes involved in reproductive parasitism. This requirement would therefore hold the current work to a novel bar not previously applied by the field. In addition, the genetic background here is the same as used in previous work on these phenotypes, making it the most pertinent to test and inform previous and ongoing studies by many research groups. Second, the results shown here would still stand no matter the results of genetic background testing and would demonstrate that it is possible for synonymous changes to have functional relevance in the transgenic wmk phenotype. The major findings are still novel in the field, relevant to ongoing studies of reproductive parasitism, and informative regarding one of the most common genetic backgrounds. Finally, we note that two different lines with unique synonymous codon changes (the final experiment) independently created the same result that a synonymous codon change ablates phenotype, providing additional robustness to our findings. Doing additional experiments would be logistically difficult. Barriers include the relocation of the first author of the work to another lab for a postdoctoral position, completion of the funding for the project, remaining institutional COVID-19 restrictions, and lack of replacement personnel in the lab to continue the work. Notably, there is also the non-trivial requirement to create and test new transgene lines that would be costly and take nearly a year to complete (the experiments in the manuscript already took several years and the new fly lines would cost thousands to make).

      The study is mostly clear and easy to follow, but requires a lot of attention. The authors choose to build up the story as I guess it was carried out in the lab. Thus, the reader is guided through every step of the process. While I see that this is appealing from the way the study was carried out, it results in a very long manuscript with a lot of material that would be much better placed in a supplement.

      We thank the reviewer for pointing this out. We shortened the manuscript by removing redundant information and transferring some parts of the results to the supplement. We also removed about three pages of text from the discussion (before adding in new sections as requested by reviewers).

      The introduction seems unfocused. It meanders around, jumping from topic to topic and does not give the reader a sense of where things will go.

      We added a few topics into the Introduction as recommended in other comments, and we edited various portions of the Introduction to connect the ideas together more clearly. We hope the changes are now satisfactory, and we are of course happy to consider further feedback.

      Fig. 1 gives an overview about the different aspects addressed here, but it is not used to guide the reader through the different lines of thought addressed in the introduction. If Fig. 1 will stay (I actually think it is not needed) it should be introduced earlier and used as a road map for the paper. Alternatively, the introduction could stay more general and only in the last paragraph the different ways the system is studied will be summarized.

      We edited the final paragraph of the Introduction to more comprehensively cover the content of the figure and full direction of the paper. For readers not familiar with the biological system or questions, we believe this figure will serve as a gateway to the genetic alterations conducted in the experiments.

      Along these lines, it would be good to have a better reasoning for the combination of experiments conducted. It is left to the reader to understand why certain types of experiments have been done.

      It was not clear to us at the outset of these experiments what results would ultimately emerge and what follow-up experiments would be necessary as our initial hypotheses were proven wrong with many of the surprises from the work. So, there was no a priori reasoning for why experiments were done until we had the results of the previous experiments. We agree that this makes the reading a bit confusing. As such, we clarified the logic flow in the results section as the narrative progresses from experiment to experiment, and we reorganized some of the introduction to improve transition statements and offer a roadmap to readers earlier on.

      On the other hand, the introduction misses a section on the biology of the phage and its interaction with the host(s). It is hard to understand the biology of the system without getting an understanding of the insect - Wolbachia - phage interactions. For non-specialist, understanding the role of the three players is essential for the system.

      Thank you for the suggestion. We now add a section introducing phage WO and its relevance to the phenotypes tested here.

      “The wmk gene and two cytoplasmic incompatibility factor (cif) genes that underlie cytoplasmic incompatibility (a parasitism phenotype whereby offspring die in crosses between infected males and uninfected females) occur in the eukaryotic association module (EAM) of prophage WO, which refers to the phage WO genome that is inserted into the bacterial chromosome. The EAM is common in WO phages across several Wolbachia strains and is rich in genes that are homologous to eukaryotic genes or annotated with eukaryotic functions. As such, the expression of reproductive parasitism genes from the EAM and tripartite interactions between phage WO, Wolbachia, and eukaryotic hosts are central to Wolbachia’s ability to interact with and modify host reproduction.”

      The result section could be easily shortened by focusing on the essential experiments. Experiments that do not contribute to the final result can go into the supplement.

      We removed redundant sentences and made some figures supplemental.

      Also the discussion is much too long. I suggest to reduce it to half and focus on the important points and the take-home messages. Currently the discussion follows the way the results are presented in the result section. However, this is not needed. The important finding should be discussed first. Findings that are important in the development of the project, may not be important for the biology of the system overall. And they may not be important for the reader.

      We reordered the discussion to cover the biggest findings first, and removed about a third of the original writing in the discussion.

      Reviewer #2:

      This study aims to unravel the genomic basis to wmk-induced male killing by transgenically expressing homologs of varying relatedness, with synonymous nucleotide changes, and predicted alternative start codons in D. melanogaster flies. The study builds on previous work showing that expression of wmk in fly embryos recapitulates several aspects of male killing. While more distantly related homologs did not induce male killing when expressed in D. melanogaster, more closely related wmk homologs induce either killing of both sexes or male killing only. However, the male-killing phenotype was not due to amino acid differences, but associated with RNA structural differences of the different wmk homologs. In addition, only one synonymous nucleotide change was sufficient to ablate the killing phenotype. These findings suggests that minor and even silent nucleotide differences impact on the expression of male killing in D. melanogaster. It is concluded that a new model incorporating the impacts of RNA structure and post-transcriptional processes in wmk-induced male killing needs to be developed.

      The strength of the study lies in the systematic and carefully controlled approach to quantify the phenotypic effects of both sequence and structural changes to various wmk homologs for inducing the male-killing phenotype. Detailed dissection of the phenotypic impact of minor changes to the wmk homologs including sequence variation, silent nucleotide changes, and RNA structural differences was quantified. This approach reveals a complex genotype-phenotype relationship, but highlights the importance of including post-translational processes. The data is novel in that previous work have largely ignored structural changes and assumed that synonymous differences in codons has no effect on protein function, whereas the current study based on updated codon optimization algorithms reveal that this assumption is incorrect. The finding highlights the importance of considering also structural genetic variation for phenotypic expression differences. This suggestion is further corroborated by the lack of difference in wmk homologue expression levels, indicating that the functional differences are due to post-translational effects.

      We thank the reviewer for the thoughtful comments.

      There are limitations to the findings of this complex genotype-phenotype relationship. The current study only examined the phenotypic impact by expressing the different homologs in one D. melanogaster genetic background. Given the variability of the phenotypic pattern revealed based on minor changes to the wmk homologs, it will be critical to repeat some of the main findings in other D. melanogaster genotypes to determine the importance of the variation in the wmk homologs more generally. It is entirely plausible that the observed changes in the effect and strength of killing is due to an interaction between host and wmk genotype. This has implications for unravelling the underlying genetic basis to the male-killing phenotype more widely. It is as yet to be demonstrated whether wmk is involved in male killing in natural population, and to what extent there are shared patterns and mechanisms of male killing induced by other bacterial endosymbionts such as Spiroplasma.

      We addressed this point in more detail above in the first response to the comments from Reviewer 1.

    1. Author Response:

      Reviewer #2:

      The manuscript by Podinovskaia focuses on a new method to visualize and measure endosome maturation in common cell lines by enlarging early endosomes. This was achieved by producing acute insult to the cells by ionophore treatment, leading to budding of abnormally large post Golgi vesicles that fuse with early endosomes. Endosome maturation of these enlarged endosomes containing Golgi-derived cargo (GalT) proceeding with apparently normal kinetics, ultimately leading to lysosomal delivery. Taking advantage of this assay, the authors investigate Rab5-to-Rab7 conversion, acquisition and loss of PI3P, acquisition and loss of Snx1 on apparent endosomal subdomains, interaction of early and late endosomes with Rab11-positive recycling endosomes, and lumenal pH changes. The new maturation model presented here will likely be quite useful to the field with continuing impact. The current state of the endosome field in many ways remains fragmentary, with various processes studied extensively in isolation, but with little information on their relative timing and potential interactions as endosomes mature. This new assay should help understand the relationships between these processes, some of which are investigated in this manuscript.

      Concerns:

      1) The data and conclusions related to Rab11 interaction with early endosomes in Fig 8 are not convincing. There are simply too many Rab11 endosomes in the cell to know if their short term proximity indicates meaningful interaction with the early endosomes, or if the data simply reflects random collisions of small recycling endosomes with the enlarged early endosomes. No data is presented to show that the interactions are meaningful, e.g. that recycling cargo transfer occurs during these interactions. Conclusions from this analysis are overstated.

      We now provide more evidence for the interaction of Rab11 vesicles with the enlarged endosomes. We made movies with shorter intervals (2 sec instead of 1 min) between the individual frames. These data clearly show that this is not an accidental bumping into an endosome but rather that Rab11 vesicles can circle around endosomes and stay for several minutes (Video Fig. 8A, supplement 2 and 3).

      In addition, we imaged TfR-GFP together with mApple-Rab5. These data show that TfR-GFP positive vesicles bud off from mApple-Rab5 positive endosomes and that the GFP fluorescence intensity goes down over time in enlarged endosomes. These data are consistent with recycling of TfR to the plasma membrane. Moreover, CDMPR-GFP, which cycles between the TGN and endosomes was found to be present on Rab5 negative enlarged structure, which then turned Rab5 positive, and subsequently lost the CDMPR signal. Importantly those endosomes could regain CDMPR, which we interpret as acquisition from the TGN. These data may indicate that the TGN-endosome shuttle is intact after nigericin washout (Fig. 9).

      That the TfR and CDMPR are really transported out of the enlarged endosome is also contrasted by our finding that GalT-GFP stayed in the enlarged endosome and the signal intensity did not significantly drop.

      2) Lack of information on endocytic cargo acquisition by the enlarged early endosomes: to really establish this endosome maturation model the authors would need to establish if the enlarged endosomes contain endocytosed cargo, as opposed to Golgi-derived cargo, and determine how long it takes to acquire such cargo. This could be accomplished using Tf, EGF, or perhaps dextran at early timepoints after nigericin washout.

      As described above, we now show that TfR-GFP is present in enlarged endosomes and is lost from these endosomes over time (Fig. 9A,D,G).

      Additionally, we performed experiments with dextran-Alexa647 and nanobody-tagged surface TfR to show that endocytosed material from the plasma membrane indeed reached the enlarged endosomes (Fig. 3, figure supplement 1 and 2). Quantification of TfR signal at the enlarged endosomes demonstrates that TfR acquisition by the enlarged endosome takes place as soon as the enlarged compartment becomes Rab5-positive. This was also observed with the nanobody-tagged surface TfR and endocytosed Dextran-AF647, representative examples of which are provided (Fig 3, figure supplement 1 and 2). The quantification for the latter experiments was not carried out due to the very short time range during which asynchronous Rab5 recruitment events needed to be captured after addition of nanobody/Dextran pulse-and-chase.

      3) Figure 7 - It was not convincing that data in panels F and G are different from each other.

      We agree with the reviewer that the difference between the data presented in panel F and G is not very big. These panels represent the average of many endosomes and with the averaging the differences from the individual traces get cancelled out. The process is asynchronous and thus in this case the individual traces are more telling than the averaged traces. Nevertheless, we decided to keep the average traces in the manuscript because the highlight the asynchronous nature of the process. We modified the text to make this point clear.

      4) Figure 11 - it is unclear how we can interpret this as connected to Rab conversion when even the labeled compartments at the earliest time point in the czz1 knockout have abnormally high pH, and during the time-course even the last timepoint for czz1 KO is higher than that of the earliest timepoint for WT.

      We agree that the ccz1 KO cells display higher endosomal pH than WT cells throughout the time-course.

      However, the cells in which we express the rescue plasmid of Ccz1 also have apparently less acidified endosomes, even though Ccz1 can still drive Rab conversion, and the pH dropped at an intermediate rate, when comparing rescued cells to control and ccz1 KO cells. Even in ccz1 KO cells endosomal traffic down the degradation pathway is not completely blocked, similarly to what we observed for sand-1 (-/-) in C. elegans and Mon1a/b knockdown in mammalian cells (Poteryaev et al. 2010). Acidification eventually will occur, but it is massively slowed down; the molecular basis of which is still under investigation in our lab.

      We think that in the absence of Ccz1, a condition under which Rab conversion is severely impaired, acidification cannot occur at normal rate. As pointed out by reviewers 1 and 2, the pH is already higher in the ccz1 KO cells than in the control condition. However, in the rescue condition, the YFP/CFP ratio is not that different from the knockout and yet acidification can occur at an intermediate rate. Why under rescue conditions, the YFP/CFP ratio is at a similar level compared to the KO is not entirely clear. It is conceivable that too much Ccz1 has also a negative effect. Moreover, recently it has been shown that ccz1 KO cells accumulate free cholesterol in the enlarged endosomes (Van den Boomen Nat Comm., 2020). The transient expression might be not sufficient to rescue this accumulation phenotype or other secondary effects. Nevertheless, the v-ATPase appears to maintain its function because lysosomes can acidify in ccz1 KO cells, albeit with a delay (Figure 13).

      5) Figure 12 - The criteria used to determine which GalT structures are Golgi or lysosomes seems questionable. Morphology alone is not sufficient to identify the compartments with high accuracy, especially after perturbation. Also, it is unclear to what extent GalT-CFP labels lysosomes without nigericin treatment.

      To address these issues, we co-labelled cells with lysotracker. GalT-CFP (pHlemon) and lysotracker showed a very high degree of co-localization. These data are included in the manuscript (Fig. 10B).

    1. Author Response:

      Reviewer #1:

      In this manuscript, the authors make use of next-generation sequencing to provide a preliminary inventory of tribe Metriorrhynchini, a hyperdiverse group of beetles with intricate systematics mainly due to likely morphological convergence of their Millerian rings. The authors provide an admirable sampling within Africa, Asia and Oceania, with about 700 successfully sampled localities and thousands of specimens.

      The main result of the manuscript is the curated database of Metriorrhynchini that will be useful in future research. In addition, different statistical methods are used to provide an idea of the undescribed species within the tribe, the astonishing species richness in New Guinea or the use of phylogenomic data to explore major phylogenetic relationships. However, some of the author's claims should be questioned:

      • Surprisingly, the authors rely on a very low threshold to identify mOTUs (2% in the manuscript). The authors refer to Hebert et al. (2003) and Eberle et al. (2020) to justify the threshold, but still, they are likely overestimating the number of mOTUs and thus, considering putative species what it may be different populations. Figure S17 provide estimates of mOTUs with different thresholds (1 to 10%), which rapidly decrease their estimates (a decrease of 25% mOTUs is found when 6% was considered). Still, an overwhelming sampling effort but a more realistic estimate.

      • I think the phylogenomic tree did not receive the required attention (for example, the FcLM analysis is barely mentioned).

      • It is not clear why should be important to mention the "person-months of focused field research" across the manuscript. Each study group has a unique sampling technique (also not found in the manuscript), preferred localities or traits, which make comparisons impossible. The authors' effort is remarkable, but it is not an important result/finding to be highlighted all over the manuscript.

      Many thanks for all comments and suggestions that pointed to the weak parts of our argumentation. We modified the manuscript accordingly and added some references that can be used for the justification of some claims.

      We addressed the question of thresholds for species number estimations. Now, two thresholds are considered in the manuscript as relevant for discussion: 2% and 5%. We added further information on our previous studies dealing with integrative species delimitation in Metriorrhynchini. Some of them were not referred in the earlier version (to avoid self-citations) and we also expanded information on the evidence given in the study which we have already referenced (Bocek et al. 2019). The earlier comparison of nextRAd, mtDNA and moprhology-based delimitation of species in Eniclases (the trichaline clade in the present study) showed that many well defined species (nextRAD and morphology) have highly similar mtDNA and they split only recently, eventually some introgresion or incomplete lineage sorting affect mtDNA signal. If we apply 5% threshold for this group, we would delimit as a single species two entities which differ in the body size, coloration and the relative size of male eyes (diurnal and nocturnal activity in putative sister species). In such a way, we would decrease the number of species in our analyzed sample of Eniclases by 40% in clear contrast with the number based on morphology and nextRADs. We found similar rapid morphological diversification also in other metriorrhynchines (Jiruskova et al., 2019,; Kalousova & Bocak, 2017) and other not referenced taxonomic studies that have shown that closely related species have well diversified male genitalia and often belong to different mimetic rings). To limit our discussion, we do not reference our earlier nextRAD study showing the speciation in other subfamily of net-winged beetles within a single mountain range (Bray & Bocak 2016). Also this study supports morphological differentiation in species with highly similar mtDNA. Now, we noted in the manuscript that before taxonomic revisions are produced, our claim is provisional and therefore we modified the text as proposed and present the lower numbers of species as a realistic possibility.

      Phylogenetic relationships: We added additional information on the congruence with earlier studies to Results and Discussion, but we still do not describe details. The main reason is that morphology must be studied to delimit and formally name new taxa and that the morphology is out of scope of this work (except some information provided in Supplementary Text – description of delimited generic groups and subtribes). The FcLM analysis addressed only the relative position of the leptotrichaline and procautirine clade. Both clades are monophyletic, morphologically distinct and no conclusion is based on their relative position. We noted that without further data we are unable to robustly solve their positions. Provisionally, we prefer the deeper postion of the leptotrichalines (61%, a not very convincing phylogenenomic signal).

      Quantification of sampling effort: As proposed, we excluded the consideration of person months as a measure of relative collecting effort in various regions and add justification for field research methods.

      Reviewer #2:

      Conservation efforts must be evidence-based, so rapid and economically feasible methods should be used to quantify diversity and distribution patterns. The principal objective of this study is to demonstrate how biodiversity information for a hyperdiverse tropical group can be rapidly expanded via targeted field research and large-scale sequencing. The authors have attempted to overcome current impediments to the gathering of biodiversity data by using integrative phylogenomic and three mtDNA fragment analyses. As a model, they sequenced the Metriorrhynchini beetle fauna, sampled from ~700 localities in three continents. The species-rich dataset included ~6,500 terminals, >2,300 putative species, more than a half of them unknown to science. It is an amazing finding. Their information and phylogenetic hypotheses can be a resource for higher-level phylogenetics, population genetics, phylogeographic studies, and biodiversity estimation. At the same time, they want to show how limited the taxonomical knowledge is and how this lack is hindering biodiversity research and management.

      Thanks for your comments on our study. We agree with your specific recommendations and modify the manuscript accordingly.

    1. Conformity now disappears into themechanical order of things and bodies, not as action but asresult, not cause but effect. Each one of us may follow adistinct path, but that path is already shaped by the financialand, or, ideological interests that imbue Big Other and invadeevery aspect of ‘one’s own’life.

      It seems like when we go online we are hardly actors anymore in the information we "seek". In many ways, it is already paved out for us, as described here. We are studied, and our lives are made easier because of it. I never get completely irrelevant advertisements anymore when on social media, and specifically on YouTube, where I remember a time only some companies were learning to tap into the monetization of producers' content and the same, few ads would always play. It seems that technology knows me better now than I know myself, and even though it makes me frightened, I haven't changed my interaction and consumption of technology in the slightest, and I don't think many other people have either, which is something I would be curious to know more about.

    1. We should not be so proud as to believe that our data

      Minor: I think it's good to discuss the issues you're interested in from your area of expertise with neuroscience. You even state outright that you'll be framing things from that perspective. However, the both the intro and that outright statement suggest the paper is written for a more general audience. That conflicts somewhat with the framing here, which seems to be geared towards neuroscientists familiar with the features of neurodata. Not a major concern though, this is just a question of whether you want to maintain a consistent audience throughout the paper. Arguably reconciled by substituting "We" with "neuroscientists". Same comment applies to other areas where this may pop up

    1. or do not wanl to have.

      I think this bring up point about priorities, control, and what we see as valuable. In order to give children the time and listening they deserve, it is at the expense of other things - other children who at the time may be doing something that we want to observe, other tasks that the teacher may have planned, other things the adult wants to get on to for themselves, etc.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reviewer #1 (Evidence, reproducibility and clarity (Required)): **Summary:** The manuscript submitted by Djekidel et al entitled: "CovidExpress: an interactive portal for intuitive investigation on SARS-CoV-2 related transcriptomes" reports on a new web portal to search and analyze RNAseq data related to SARS-CoV-2 infections. The authors downloaded and reprocessed data of more than 40 different studies, which is available on the web portal along with all available meta data. The web portal allows to perform numerous differential expression and gene set enrichment analyses on the data and provides publication ready figures. Because of batch effects that could not be removed, the authors do not recommend to analyze data across studies at this point. The authors conclude that the web portal is unique and will allow scientists to rapidly analyze gene expression signatures related to SARS-CoV-2 infections with the potential to make new discoveries. **Major comments:** Based on the scientific literature, the web portal seems to be an unprecedented resource to search and analyze SARS-CoV-2-related RNAseq data and as such would certainly be a useful resource for the SARS-CoV-2 scientific community. The authors argue that new discoveries are possible by using their web portal in providing use cases. However, the section detailing the analyses the authors did to generate new hypotheses about genes potentially relevant in SARS-CoV-2 infections are very difficult to follow and without more guidance very difficult to reproduce with the web portal. It would require substantial expert knowledge in RNAseq data analysis without more information being provided. It also seems that key candidate genes identified by their analyses have all been studied or identified to be related to SARS-CoV-2 infections, so it is somewhat unclear whether new hypotheses can be generated by the reanalysis of RNAseq datasets, especially because combining the data from different studies is currently not recommended by the authors. The manuscript would benefit from providing fewer use cases but for each of them providing more information on how the portal and which studies were used to generate them and which findings were not described in the publication of the used studies. Some observations in the manuscript are not substantiated with significance calculations (see below). At times, the English writing (grammar) should be improved.

      We thank the reviewer for the positive comments. We suppose the reviewer conclude it need substantial expert knowledge in RNAseq data analysis were due to lacking Video Tutorial. We have now put up several Video Tutorials and more tutorials would be added along later along with users’ feedbacks. We believed this would help ease reviewers’ concern.

      In response to whether new hypothesis can be generated. Sorry if it’s not clear, for all the case studies and our “CovidExpress Reveals Insights and Potential Discoveries”, our portal has provided information not reported by their original publications, as listed below:

      1. Case study #1: The original publication employed a multiomics approach to find the predictor genes between ICU and non-ICU patient. But it’s not obviously to know which genes were mainly due to expression level, which might be due to other data they included (e.g. mass spectrometry data). Our portal allow user to quickly check their expression level and find SESN2 does not have strong expression differences.
      2. Case study #2: We replace this case study with bacterial-susceptibility genes to show such questions could be quickly asked and answered using our portal. Such investigation has not been reported before.
      3. FURIN’s function have been well related to SARS-CoV-2. However, for all reports we could find, they focused on Furin cleavage sites of SARS-CoV-2 or whether FURIN were expressed in the SARS-CoV-2 sensitive tissues. SARS-CoV-2 infection could up-regulate FURIN expression have never been reported before. The study published the data didn’t mentioned FURIN at all. We have made this discovery simply by using CovidExpress portal to find the differential expressed genes and overlap with the literature-based gene list (Supplementary Table S2), we believe more discoveries could be made by users by selecting different data.
      4. If we search OASL AND " SARS-CoV-2" on pubmed, only 5 results shown up indicated it’s under-studied. And none of them indicated OASL could be up-regulated both by SARS-CoV-2 infected lung and Rhinovirus-infected nasal in human. It is not clear to us if we might misunderstand reviewers’ suggestion as “fewer use cases”. Thus, we haven’t removed any use cases, instead we provided more details to help users understand what and how did we made those discoveries not reported by their original studies using CovidExpress.

      At last, we have gone through substantial scientific editing to improve the grammar. **Minor comments:** Page 6 last sentence: The statement of this sentence is very much what one would expect. It remains unclear whether the authors mean this as a result to validate the processing of the RNAseq data or as a new discovery. Please, clarify.

      We apologize for the confusion. We intended this statement to be a result confirming what we had expected. We have now amended the text to make this point clearer.

      Figure 3A: The violin plots are so tiny that it is impossible to see any trends. It is also difficult to understand which categories one should compare with each other. If there is anything significant to observe, please, add a statistical test and better guide the reader.

      We agree with the reviewer; therefore, we have removed this figure from the paper. The goal of this figure was to demonstrate how to use violin plots for exploratory analysis; however, in this case, the violin plot did not show a clear trend. By using more filtering and other plots (e.g., Figure 3B-C), we believe we now provide better insight.

      Figure 3C: A legend for the color scale is missing. The signal (I guess expression amounts) for SESN2 seems very weak and the same between ICU and non-ICU samples. What is the significance for assigning this gene to the group of genes being upregulated in ICU samples? Also contrary to what the authors state on page 8, SESN2 does not seem to be highly expressed in ICU samples, however, without knowing what the colors represent (fold changes or absolute expression values?) this is somewhat speculative.

      We thank the reviewer for bringing this to our attention. We have now added a legend for the color scale in the revised figure. In Figures 3A-C, we are showcasing how an exploratory analysis can be performed using CovidExpress. As an example, we investigated the expression of the top 20 genes identified by the random forest classifier of Overmyer et al., 2021, as predictors of ICU and non-ICU cases. In the original Overmyer et al. paper, only the general performance metrics of the models are presented (Fig. 6c-g), but the authors do not show the expression patterns of the top predictors. Hence, we demonstrate how CovidExpress can be used to further investigate some questions not explored in the original paper. SESN2 was listed as a top predictor; however, its expression did not vary between ICU and non-ICU samples, as was also observed by the reviewer. We suspect SESN2 was a top predictor due to other data the Overmyer et al. paper included, such as mass spectrometry data. Our statement about SESN2 was not accurately reflected in the figure; therefore, we have rewritten this section to make it clearer.

      Page 9 first sentence: Please, specify what you mean by "starting list". Furthermore, in this paragraph, how do your results compare to the results from the study that you re-analyze here?

      We thank the reviewer for the question. By “starting list,” we meant the top genes from the Overmyer et al., 2021, article as predictors of ICU and non-ICU cases. We have now rewritten this section to make it clearer. We did not expect our results to differ from their data. Our goal was to ask which of their top predictors (by multi-omics data) show a difference in gene expression. When we downloaded their TPM values from their GEO records, the values were very similar overall (see below).

      Figure 3F: Please add labels to your axes and is there a particular reason why in a correlation plot like this one, the y and x axis are not shown with the same range and why does the y axis not start at 0?

      We thank the reviewer for this helpful comment. Our reasoning for presenting the figure in this way is that different genes can have very different expression levels but still be correlated. For example, if gene A expressed 1, 5, and 10 in samples 1,2, and 3, while gene B expressed 100, 500, and 1000 for samples 1, 2, and 3, then their range would be very different but still perfectly correlated (see panel A below). If we draw the x- and y-axes using the same range, this correlation will not be visually obvious (see panel B below).

      This comparison is different from the correlation plots that compare the expression of one gene in different samples. We apologize for the confusion and to avoid misleading readers, we have enlarged the gene names in the Figure labels to ensure that readers notice their differences. We have also added an option to the correlation plot on our portal so that users can choose the optimal format (see below).

      Page 9 second last sentence: It remains unclear which kind of analysis the authors intend to do here and what the starting question is. Please, try to rewrite with less technical terms (i.e. what do you mean by "precalculated contrasts"). In line with this, it remains unclear what Figure 3I is supposed to show. Please, provide some more information to readers who are not RNAseq analysis experts.

      We thank the reviewer for this suggestion. To avoid any misleading claims, we followed Reviewer #2’s suggestion and replaced the coagulation gene list with a filtered gene list from the “Coronavirus disease - COVID-19” KEGG pathway (hsa05171) to showcase how to identify experiments in which this gene signature is enriched or depleted. We also replaced the related figures and text with new results and rewrote this section to avoid using technical terms.

      Figure 3J is somewhat confusing. Why is the mean expression range indicated from 0 to 1 and why are all genes apparently having a mean expression of 1?

      We thank the reviewer for this question. Because the levels of expression of different genes can vary greatly, in Figure 3J (new Figure 3A and 3I), we normalized the mean expression levels of the genes to their maximum values across groups to improve the visualization. We have now made this clearer in the figure, legend, and text.

      Page 10 line 5-6. Are you referring to coagulation markers here or general expression patterns? In case of the latter, how does this statement fit to the paragraph about analyzing expression patterns of coagulation markers? Please, specify. And in line with this, are the highlighted genes in Figure 3K coagulation markers? If not, what is the relevance of these to make the point that one can use the portal to investigate the role of coagulation markers in SARS-CoV-2 infections?

      As mentioned above, to avoid any misleading claims, we followed Reviewer #2’s suggestion and replaced the coagulation gene list with a filtered gene list from the “Coronavirus disease - COVID-19” KEGG pathway (hsa05171). This revision enables us to show how to identify experiments in which this gene signature is enriched or depleted. We have now replaced these figures and text with new results.

      The appearance of describing batch effects and attempts to remove them from the studies was somewhat surprising on page 10 as I would expect this kind of results rather earlier in the results section before describing use cases of the data. You may consider changing the order of your results for a better flow.

      We apologize for the confusion. However, we want to make it clear that the analysis before page 10 did not involve “batch effect”; all analyses were performed within each study. Thus, it is not necessary to change the order in which the results are presented. Also, based on Reviewer #2’s comments, we did not accurately use the term “batch effect,” because “batch effects are purely due to technical differences.” We have now revised the corresponding text to make this point clearer.

      Page 11, second paragraph. Please, explain briefly what the silhouette score is supposed to reflect and thus how Figure S4G should be interpreted. The difference of both bars in Figure S4G is very marginal and thus, does not seem to support the statement of the authors that the ssGSEA scores-based projection is better unless you perform a significance test or I misunderstood. Please, clarify.

      We thank the reviewer for this suggestion. We have now added an explanation of the silhouette score in the manuscript. Briefly, a silhouette score is a metric of the degree of separability of gene clusters from the nearest cluster. For a given sample, lets be the mean intra-cluster distance, and be the mean distance to the nearest cluster. The silhouette score (sil) will be calculated as follows

      The silhouette score ranges between -1 and 1. A value near 1 means that the clusters are well separated, and a value near -1 means that the clusters are intermingled. Using a Wilcoxon rank test, we showed that using ssGSEA scores significantly improves the separability of global GTEx tissues (in Figure S4G; p=8.75e-26).

      Page 11, third paragraph: Figure 4B, to the best of my understanding, does not support the claim that samples clustered less according to study cohorts using the ssGSEA approach. Please, quantify the effect and test for significance or better explain.

      We apologize for the confusion. We quantified the separability between cohorts (GSE ids) by using the silhouette score. In Figure S4H (panel A below), we show that the TPM-based PCA leads to more separation by studies than does the Covid contrast ssGSEA scores in which the separation between studies is less prominent (p-value=0.0045, paired Wilcoxon test).

      For the analyses described starting on page 12 it remains largely unclear whether they were conducted across studies or within studies and which studies were used. This section until the end of the results would especially benefit from providing more information on how the analyses were performed, either in the results or in the methods section.

      We apologize for the confusion. The goal of the analysis on page 12 and the corresponding Figure 4G was to identify genes whose expression increased in both the SARS-CoV-2 infection lung and rhinovirus-infected nasal tissue. Hence, we did a log2(fold-change) vs log2(fold-change) comparison. The log2(fold-change) values were independently calculated for each study. Because we compared values by using the same ranking metric, the cross-samples comparison was possible, as shown in Figure 4G. We have now added more details to the Methods section to clarify this point.

      Figures 4J and 4K miss axis labels and since we look at correlations, the figures could be redrawn using the same ranges on x and y axis.

      We thank the reviewer for this suggestion. We have now added axes labels to the new figures. However, we have not used the same range on the x and y axes because they depict expression levels of different genes. For example, if gene A is expressed 1, 5, and 10 in samples 1, 2, and 3, while gene B is expressed 100, 500 and 1000 for samples 1, 2, and 3, their range would be very different but still perfectly correlated (panel A below). If we draw x and y axes using the same range, this correlation will not be visually obvious (panel B below).

      This comparison is different from the correlation plots that compare the expression of one gene in different samples. We apologize for the confusion and to avoid misleading readers, we have enlarged the gene names in Figure labels to ensure that readers notice they are different genes. We have also added an option to the correlation plot on our portal so that users can choose the optimal format (see below).

      Page 14 line 5: Is this the right figure reference here to Figure 4G? If yes, then it is unclear how Figure 4G supports the statement in this sentence. Please, clarify.

      We apologize for the confusion. In Figure 4G, we labeled several important genes and used different colors to indicate whether the gene was regulated by SARS-CoV-2 only (purple), Rhinovirus only (black), or both(red). FURIN was the gene that is only significantly upregulated by SARS-CoV-2. The data in Figure 4G were from GSE160435(“SARS-CoV-2 infection of primary human lung epithelium for COVID-19 modeling and drug discovery”); that study used lung organoid alveolar type 2 (AT2) cells as the model. We think this confusion was caused by our failure to provide the details about the GSE160435 study. We have now amended the manuscript to include these details in the Methods section to avoid confusion. We also enlarged the gene labels in the figure to make them more visible. In the manuscript, we have changed from “our results found FURIN gene was also upregulated in SARS-CoV-2–infected lung organoid alveolar type 2 cells (Figure 4G, Supplementary Table S3).” to “We found that FURIN was upregulated in SARS-CoV-2-infected lung organoid alveolar type 2 cells (Figure 4G, Supplementary Table S4) (Mulay, Konda et al., 2021), it has reported that TGF-β signaling could also regulates FURIN (Blanchette, Rivard et al., 2001). Our gene enrichment analysis also found TGF-β signaling enriched only for up-regulated genes in SARS-CoV-2-infected lung cells (FDR correct p=7.58E-05, Supplementary Table S4), these observations implicated a positive feedback mechanism only for SARS-CoV-2-infected lung but not RV-infected nasal cells.”

      Figure 2 is of too low resolution. Many details cannot be read. Please, provide a higher resolution figure.

      We apologize for the inconvenience. However, we did not expect the reader to read the details on Figure 2, as it is just an overview of the CovidExpress portal. The aim is give the reader an impression about what functions CovidExpress could offer.

      Reviewer #1 (Significance (Required)):

      Providing a single platform for the analysis of SARS-CoV-2-related RNAseq data is certainly of high value to the scientific community. However, as the portal and manuscript are currently presented, for scientists that are not RNAseq analysis specialists, more guidance would be required to understand and use correctly the functionalities of the portal. Unfortunately, because batch effects could not be removed from the studies, the authors, correctly, do not recommend to combine data from different studies for analyses, however, this likely will also limit the potential of the resource to make new discoveries beyond what the original studies have already published. As indicated above, the authors could support their claim by comparing their findings with findings published from the studies they reanalyzed. The portal is only of use to scientists studying SARS-CoV-2. I am not an expert in RNAseq data analysis and thus cannot comment on the technicalities, especially the processing of the RNAseq datasets. We thank the reviewer for the positive comments. We apologize for the confusion and acknowledge that we should not describe our effort using the term “batch effect.” As described by Reviewer #2 (and we agree), batch effect should be used only to indicate a purely technical difference in the same biological system; for example, differences in experiments performed on different days or by different lab personnel. Thus, we cannot correct for “batch effect” by using CovidExpress. We hope that the reviewer realizes that what we did was correct for the effect caused by differences in software and parameters across the studies. For example, in our approach, the DEGs from GSE155518 and GSE160435 (both primary lung alveolar AT2 cells (both from Mulay et al., Cell Report, 2021) were significantly correlated (panel A below; p = 1.36e-24, F-test). However, when we downloaded the TPM values from their GEO records, GSE155518 appeared to have a genome-wide decrease in the expression of SARS-CoV-2–infected samples (panel B below). We suspect that this is because in their data processing, the expression of virus themselves were also considered. Thus, using the proceed data directly without careful reviewing the method might lead to false hypothesis.

      At last, researchers can make new discoveries, such as our OASL and FURIN findings, by using many other features that CovidExpress provides.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)): Djekidel and colleagues describe a web portal to explore several SARS-CoV-2 related datasets. The authors applied a uniform reprocessing pipeline to the diverse RNA-seq datasets and integrated them into a cellxgene-based interface. The major strengths of the manuscript are the scale of the compiled data, with over one thousand samples included, and the data portal itself, which has useful visualization and analysis functions, including GSEA and DEG analysis. My primary concerns with the study are centered on the analysis examples that are presented and their interpretation, as well as the user interface for the data portal. **Major Comments:**

      1. The literature analysis feels out of place and is not informative (Fig 1E), as the conclusions that can be drawn from literature mining are minimal. In evidence of this, the authors highlight that CRP is a top-studied "gene" and later voice their interest in how CRP is not a differentially expressed gene (pg6). This illustrates the problems with the literature-based analysis, since in the context of COVID-19, CRP is a common blood laboratory measurement that is used as a general marker of inflammation. Transcription of CRP is essentially exclusively in hepatocytes as an acute phase reactant (see GTEx portal for helpful reference), and would therefore not be expected to be found in the various datasets collected by the authors. The one exception might be liver RNA-seq samples from COVID-19 patients, but I do not think these are available in the current collection. I would therefore suggest to remove the literature analysis parts from the manuscript.

      We thank the reviewer for sharing knowledge about CRP. As discussed in our manuscript, we agree that not all top genes from literature-based analysis were expected to be included in RNA-seq analysis. We apologize for the confusion, and we have amended our description to make this point clearer. However, we still believe that literature-based analyses are very useful in the following aspects:

      1. This type of analysis bridges the gap between data-driven research and hypothesis-driven research. For example, we found many genes in our meta-analysis, but it is not feasible to describe the functions of all of them. Thus, in Figure 1F, we color-coded genes in red if they also appeared as top genes in the literature-based analysis and read related manuscripts to build confidence that the meta-analysis is useful. Then we expanded our review to more top genes and found more interesting evidence (Supplementary Table S2, “TopGenesbyDifferentialAnalysis” tab).
      2. Literature-based analyses also reduce the time researchers spend prioritizing their investigations. For example, in our comparison of SARS-CoV-2–infected lung and Rhinovirus-infected nasal tissue, we found >2000 genes upregulated only in SARS-CoV-2–infected lung but not in Rhinovirus-infected nasal cells. It is not easy to derive a hypothesis from so many genes. When we overlapped the gene list with literature-based analysis, FURIN popped up as the most well-studied gene, and we did not find any report that mentioned that SARS-CoV-2 can regulate FURIN This raised our interest and led to a suggested mechanism in which SARS-CoV-2 could evolve to induce FURIN expression and gain superior infectivity. FURIN’s upregulation is significant but not among the top genes, in terms of fold change (>2-fold change, FDR p th by fold change). Thus, without the literature-based analysis, this observation could have easily been neglected.
      3. Such analyses help researchers to prime their hypotheses for novel findings. For example, in our comparison between SARS-CoV-2–infected lung and Rhinovirus-infected nasal tissues (Figure 4G, Supplementary Figure 5D and E), we found many upregulated genes, but OASL was not in our literature-based analysis, which indicated that it is under-studied and worth highlighting. We hope the reviewer will agree that we should retain the literature-based analysis in our paper. These analyses were not meant to be conclusive but rather a way to prioritize investigations. Finally, we removed CRP from Fig 1E and the main text to avoid confusion.
      1. The data portal, implemented through cellxgene, is accessible for non-programmers to use. However, it is very easy to end up with an "Unexpected HTTP response 400, BAD REQUEST" error, with essentially no description of the cause of the error or how to rectify it. When this occurs (and in my experience it occurs very frequently), this also forces the user to refresh the page entirely, losing any progress they may have made. I see that the authors describe this error in their FAQ page, but their answer is not very intuitive and I was unsure of what they meant: "This happens because the samples you selected doesn't contain all "Group by" you want compare for each "Split by" group. You could confirm using the "Diff. groups" buttons.".

      We apologize for the confusion. This excellent point made by the reviewer required an improvement in the software engineering, which we have now completed. We have figured out how to avoid this error and have run thorough tests to ensure that it does not appear anymore. We also added a gitter chat channel to our landing page, so that users can report if they encounter this or other errors.

      I would therefore ask that the authors provide more detailed tutorials (ideally step-by-step) on common analyses that users will want to perform, hopefully minimizing the amount of frustration that users will encounter.

      We thank the reviewer for this suggestion. We have uploaded several video tutorials to our landing page and will gradually add more. We also added a gitter chat channel, so users can ask questions, report bugs, or suggest new studies to include in the portal.

      1. Selection of samples is not very quick or intuitive. If I wanted to select only the samples from one specific GEO accession, I had to resort to individually checking the boxes of the sample IDs that I wanted. If I instead selected the GEO accession under the samples source ID, then used the "Subset to currently selected samples" button, I invariable got the HTTP error 400 message. Of course, this may simply reflect my lack of familiarity with cellxgene; I would nevertheless encourage the authors to improve the FAQ to include a step-by-step example for how to do common analyses/procedures.

      We apologize for the confusion. To select an individual GEO accession, users can simply tick the box beside “Samples Source ID.”

      Then all boxes would be clear for “Samples Source ID” that allow you to select only the one you want. We also have uploaded video tutorials to help users learn how to navigate the portal.

      We apologize for the “HTTP error 400” messages. We figured out that users would encounter that message frequently after they encounter it once due to a back-end cache mechanism. We have now improved the portal from the software-engineering side. In our recent tests of the latest version, this error does not appear anymore. We also added a gitter chat channel on our landing page so that users can report encountering this or other errors.

      1. The second case study, centered on coagulation genes, is misguided. Alteration of coagulation lab values in severe COVID-19 patients is reflecting the general inflammatory state of these patients, and would not be expected to manifest on the transcriptional level in infected cells/tissues. Coagulation labs are measuring the functional status of the coagulation cascade, which is far-removed from the direct transcription of the corresponding genes - proteolytic processing of clotting factors, etc. As with CRP (see above comment), most clotting factors are transcribed almost exclusively in the liver (check GTEx portal); I would not expect upregulation of coagulation factors in lung cell lines/organoids/cultures etc after infection with SARS-CoV-2. I would recommend the authors to pick a different gene ontology set for a case study, as the current one focusing on coagulation is confusing in a pathophysiologic sense.

      We thank the reviewer for this suggestion. To avoid any misleading claims, we have replaced the coagulation gene list with a filtered gene list from the “Coronavirus disease - COVID-19” KEGG pathway (hsa05171) to showcase how to identify experiments in which this gene signature is enriched or depleted. We also replaced Figures 3G-J with new results.

      1. The two large clusters of blood-derived samples vs other tissues is not surprising and the authors' interpretation is confusing. The authors write that "the COVID-19 signature was not able to overcome the tissue specificity and that immune cells might respond to SARS-CoV-2 differently." This should be immediately obvious given the pathophysiology of COVID-19 infection; the cell types that are directly infected by SARS-CoV-2 will of course have a distinct response compared to the circulating blood cells of COVID-19 patients, which are responding by mounting an immune response. There is no reason to expect a priori that the DEGs in the directly infected lung cells would be similar to that of immune cells that are mounting a response against the virus.

      We thank the reviewer for these comments. We agree that it should be obvious that directly infected lung cells would differ from immune cells. However, this has never been shown in a large dataset. Also, it is not obviously whether all other different tissues would respond to SARS-CoV-2 differently. Thus, we believe it is important to present this overview. We have amended the description to deliver clearer message as “This confirmed immune cells respond to SARS-CoV-2 differently from other tissues also suggested the response of most other tissues might sharing similar features.”.

      1. The authors devote considerable space in the manuscript to exploring "batch effects" and trying to minimize them (pg10-11 Fig 4A-D, Fig S4). However, given that the compiled datasets are from entirely different experimental and biological systems (e.g. in vitro infection vs patient infection, different cell lines, timepoints after virus exposure, diverse tissues, varying disease severity), it is inappropriate to simply refer to all of these differences as "batch effects" alone. Usually, the term "batch effect" would refer to the same biological experiment/system (i.e. A549 cells infected with CoV vs control), but performed on different days or by different lab personnel - in other words, batch effects are purely due to technical differences. This term clearly does not apply when comparing samples from entirely different cell lines, or tissues, etc, and the authors should not keep describing these differences as batch effects that should be "corrected" out.

      We thank the reviewer for the insight. We apologize for the confusion caused by using the phrase “batch effect correction” to describe our approach. We agree that the difference between studies should not be referred to as a “batch effect correction” and have now amended the descriptions to avoid confusion.

      Indeed, the authors themselves state that the main point of their "batch effect correction" efforts is only for PCA visualization. I therefore feel this section contributes very little to the overall manuscript, especially given the authors' own recommendation that all analyses should be performed on individual datasets (which I certainly agree with). I assume that the authors were required to provide some sort of dimensional reduction projection for the cellxgene browser, but this is more a quirk in their choice of platform for the web portal. Thus, this section of the manuscript should be deemphasized.

      We thank the reviewer for these comments and again apologize for the confusion caused by our use of the term “batch effect correction” to describe our approach. However, we believe these parts of the paper should be retained for the following reasons:

      • In practice, sample mislabeling can happen. PCA or simple clustering approaches are very useful for helping raise researchers’ attention, so they could further check the possibility of sample mislabeling.
      • Even within a study, one sample can be an outlier due to low or unequal sample quality. Removing outliers would help boost the significance of real findings. Without our approach, it would be harder for users to notice and remove outliers from their investigations.
      • Finally, these efforts are useful for generating hypotheses. For example, although we collected a lot of data, it is not feasible for us to read all the details in all the manuscripts published. We observed a similarity between SARS-CoV-2–infected lung samples and Rhinovirus–infected nasal samples by exploring our portal’s capabilities (Figure 3E-F). Then we read the manuscripts in which those data were published and found that our discovery was consistent with the original studies’ results. We believe these efforts are essential to help researchers generate or refine their hypotheses. As we update the database with more samples, this approach will become increasingly powerful.
        1. Given the limitations of any combined multi-dataset analyses, one very useful feature would be to conduct "meta-analyses" across multiple datasets. For instance, it would be informative to find which genes are commonly DEGs in user-selected comparisons, calculated separately for each dataset and then cross-referenced across the relevant/user-selected datasets.

      We thank the reviewer for this comment. Indeed, we agree that “meta-analyses” are useful and have now compiled Supplementary Table S2 and Figure 1F to demonstrate the commonly regulated genes. To enable user-selected comparisons across studies on our portal, we need to design a thoughtful user interface. Otherwise, the results from our portal could easily cause fatal misinterpretation. For example, GSE154613 includes samples like DMSO, Drug, SARS-CoV-2, and DMSO+SARS-CoV-2. If a user simply selected to compare SARS-CoV-2 versus Control, the results would be SARS-CoV-2 and DMSO+SARS-CoV-2 versus DMSO and Drug. Such functions need time to design and implement; therefore, we will consider this suggestion for further development of our portal.

      **Minor comments:**

      1. Fig S1G, color legend should be added (I understand that these colors are the same from S1H).

      We thank the reviewer for the comment. We have now added information about the colors in the figure legend.

      1. Mouseover text for trackPlot on the data portal is incorrect (it says the heatmap text instead).

      We thank the reviewer for this comment. We have now corrected this bug.

      1. Abstract should be revised to describe only the 1093 final remaining RNA-seq samples after filtering/QC steps.

      We thank the reviewer for this comment. We have now amended the Abstract to include this information.

      1. Text in many figures is too small to be legible. I would suggest pt 6 font minimum for all figure text, including the various statistics in the figure panels.

      We thank the reviewer for this comment. We have now amended the font sizes and will provide high-resolution figures in revision.

      1. Are the DE analyses in Fig 1F specifically limited to control vs SARS-CoV-2/COVID-19 comparisons? Many of the samples included in this study are from other respiratory infections (labeled "other" in Fig 1B).

      We thank the reviewer for the question. Figure 1F was not originally limited to control vs SARS-CoV-2/COVID-19 comparisons, because we thought control vs virus, drug vs mock, or difference between time points would also be interesting. If we narrow the analysis to contrasts only between control vs SARS-CoV-2/COVID-19, Figure 1F would be still look similar (as below) because the genes in that comparison comprise the largest share of genes included in the original graphic.

      In the end, we replaced Figure 1F to avoid confusion and added more details in the Methods.

      1. The word cloud format is not conducive for understanding or interpretation. It would be much more informative to simply have a barplot or similar to clearly indicate the relative "abnudance" of a given gene among all 315 DE analyses.

      We thank the reviewer for this comment but respectfully disagree with this point. Visualization of the relative “abundance” of genes with word clouds is a relatively novel concept in computational biology. However, we believe, that in this case, it has certain advantages over visualization using traditional bar plots for example. The word cloud format allows us to highlight genes relative to their importance, with the word “importance” being used here in the sense of combined metrics from DEGs, as shown in Figure 1F, or the frequency with which genes are mentioned/discussed in various literature sources, as shown in Figure 1E. For this purpose, the exact values will most likely not be important for most users/readers. Be presenting a word cloud visualization, readers can easily discern the top genes and use them in the exploration of their own data or the CovidExpress portal. However, if users want to analyze raw values, we provide in Supplementary Table S3 a full list of all genes and gene sets that can be download from our landing page (section “CovidExpress Expression Data Download”) in GMT format. Also, when we visualized the ranks of genes by using bar plots as the reviewer suggested, the results were much harder to read (as shown in the bar graph below) than simply looking at the raw data in supplementary tables.

      1. Claims of increased/decreased dataset separability should have statistical analysis on the silhouette score boxplots (Fig S4G-I).

      We thank the reviewer for the reminder. We have added statistical tests to referred silhouette score boxplots (Wilcoxon rank test)

      1. Regarding Fig 4E-F - what are the key genes that contribute to PC1, and how do they relate to the DEGs in Fig 4G?

      We thank the reviewer for this question and apologize for the confusion. In Figure 4E-F, the PCA were based on ssGSEA score, as each gene set would have a score for a sample, not individual genes. Thus, the top contributed to PC1 were gene sets upregulated or down-regulated in certain contrasts. We provided on the portal’s landing page detailed results for top gene sets (for the ssGSEA approach) and genes (for the TPM approach) that contributed to various PCs (“Clustering Results for Reviewing and Download” section). This allows users to download and further explore these data.

      1. Statistics describing the relation between OASL And TNF/PPARGC1A should be included to justify the author's statements. This could be correlation, mutual information, regression, etc.

      We thank the reviewer for this suggestion, and we have updated Figures 4J-K to show the correlation values and corresponding F-statistics. The Pearson correlation between OASL and TNF was significant (Pearson Correlation=0.75 and p-value = 6.85e-72), but the correlation between OASL and PPARGC1A had a negative slope and showed a moderately significant p-value (Pearson Correlation=-0.08 and p-value=0.12), confirming to a certain degree our statement. We have now updated the corresponding text in the manuscript.

      1. There are several studies now that have performed scRNA-seq on the lung resident and peripheral immune cells of COVID-19 patients. To more definitively tie in their analyses in Fig 4J-K/Fig S5D-E (to affirm "its important role in the innate immune response in lungs"), the authors should assess whether OASL is upregulated in the lung macrophages of COVID-19 patients vs controls.

      We thank the reviewer for this suggestion. Indeed, Liao, et al. recently reported “BALFs of patients with severe/critical COVID-19 infection contained higher proportions of macrophages and neutrophils and lower proportions of mDCs, pDCs, and T cells than those with moderate infection.” (Nature Medicine, 2020, https://doi.org/10.1038/s41591-020-0901-9). They further refined macrophage data into subclusters and reported top enriched GO terms as “response to virus” (group 1), “type I interferon signaling pathway” (group 2), “neutrophile degranulation” (group 3), and “cytoplasmic translational initiation” (group 4). When we investigated their data, we found that group1 and group2 both identified OASL as a marker gene, indicated OASL might response to virus and help type I interferon signaling. Furthermore, another data set (from Ren et al., Cell, 2021, https://dx.doi.org/10.1016%2Fj.cell.2021.01.053) showed several clusters in patients with severe COVID-19 (left panel below) that were enriched for OASL expression(right panel below).

      We have now added these observations to strengthen our hypothesis about the role of OASL.

      1. The visualization and analysis functions in the data portal appear to work reasonably well out of the box. However, the download buttons for plots did not work in my hands. I realized that a workaround is to right click -> "Save image as" (which then downloads a .svg file), but this is not ideal and should be fixed to improve usability. I had tested the data portal on both Firefox and Edge browsers, using a Windows 10 PC.

      We agree with the reviewer. Due to some technical issues with the figure javascript plugin, the download feature does not work unless the figure is saved as a file on the server side. To avoid any security issues, we tried to minimize new file generations, hence, for the moment we have disabled this feature. Users can still download high-resolution .svg figures by using the right-click -> “save image as.” This information is now included in the FAQ section on the portal’s landing page.

      Reviewer #2 (Significance (Required)): The data portal appears to have useful analysis and visualization features, and the data collection appears to be quite comprehensive. I would strongly encourage the authors to continue collecting datasets as they become available and further improving the usability of the portal. As noted in the above comments, I think there is potential for their cellxgene-based browser to be useful to non-computational biologists, but at present, the data portal is not as simple to use as it should be. With further efforts to developing step-by-step tutorials for common analysis/visualization tasks, more informative case studies, and the other revisions suggested above, this study could be a valuable resource for the community. Of note, this review is written from the perspective of a primary wet-lab biologist with extensive bioinformatics experience but limited web development expertise.

      We thank the reviewer for the positive comments. We understand the importance of data updating. Our plan is to complete quarterly updates once this manuscript has been accepted or when 10 new studies have been either collected by us or suggested by users. This information is also now included in the FAQs of the portal’s landing page. We have also uploaded several tutorials videos to the landing page and will gradually add more. We also added a gitter chat channel, so users can ask questions, report bugs, or suggest new studies to add to the database.

      **Referee Cross-commenting** I agree with the comments of the other reviewers. Reviewer #3 (Evidence, reproducibility and clarity (Required)): **Summary:** The ongoing COVID-19 pandemic is a big threat to human health. The researchers have conducted studies to explore the gene expression regulations of human cells responding to COVID-19 infection. A website that integrating those datasets and providing user-friendly tools for gene expression analysis is a valuable resource for the COVID-19 study community. The authors collected published RNASeq datasets and developed a database and an interactive portal for users to investigate the gene expression of SARS-CoV-2 related samples. This website would be of great value for the SARS-CoV-2 research community if the batch normalization problems are solved. **Major comments:** 1) The major concern of CovidExpress is the batch effects from different studies. As the authors have shown and mentioned in their discussion that "For the current release, we strongly suggest investigators to perform gene expression comparison within individual study." This limits the usage of CovidExpress as integrating analysis from multiple datasets of different studies is the key value and purpose of CovidExpress.

      We thank the reviewer for the comment. Reviewer #2 reminded us, and we agree, that differences between studies should not be considered “batch effects.” We apologize for the confusion. The GSEA function provided in the portal does not suffer from batch effect, because all the pre-ranked lists of genes are based on contrasts from the same studies. Although we cannot correct for the differences between studies, we did correct for effect caused by differences in software and parameters used. For example, in our approach, the DEGs from GSE155518 and GSE160435 (both studies of primary lung alveolar AT2 cells from Mulay et al., Cell Report, 2021) were significantly correlated (below panel A, p-value = 1.36e-24, F-test). However, if we simply download the TPM values from their GEO records, GSE155518 appears to show a genome-wide decrease in expression in SARS-CoV-2–infected samples (below panel B). These errors might lead to false hypotheses.

      2) The authors should include experimental protocols as one key parameter in the description and further integrating analysis of different datasets. As the authors showed that QuantSeq is a 3' sequencing protocol of RNA sequencing. However, it is not convincing to me that simply excluding QuantSeq samples is the ideal solution for downstream integrating analysis as QuantSeq has been shown that it has pretty good correlations with normal RNASeq methods in gene quantifications. It is interesting that there are 21.2% of samples were biased toward intronic reads. What protocol differences or experimental variations would explain the biases?

      We thank the reviewer for the comment and apologized for not being clearer. One of our main goals re-processing all samples is to correct for pipeline processing–related batch effects. We tried to reduce those effects introduced by using different software or parameters. QuantSeq or similar protocols are heavily bias to 3’ UTR; thus, the software and parameters used for RNA-seq data will not be suitable. In contrast, we agree that the downstream results from QuantSeq have good correlation to RNA-seq (we observed a correlation of ~0.75, when compared to the log2 fold-change from Quant-Seq to RNA-seq). However, we could not reconcile QuantSeq always correlated well with RNA-seq, in terms of individual quantification. For example, Jarvis et al. recently reported only ~0.35 correlation between QuantSeq and RNA-seq (https://doi.org/10.3389/fgene.2020.562445). Theoretically, the correlation would be weaker for genes with a small 3’ UTR. Thus, we will not include QuantSeq data in this portal. However, if we collect enough studies in the future, we will consider uploading a separate portal just for QuantSeq using a pipeline optimized for protocol bias to 3’ UTR.

      For the 21.2% samples that were biased towards intronic reads, we believe they reflect differences in the kits used. For example, of the 162 samples “BASE_INTRON (%)” >30% (Supplementary Table S1) that passed QC, 76 samples were total RNA obtained using the SMARTer kit and 36 were total RNA obtained using the Trio kit. Given that we have 105 samples of total RNA derived using the SMARTer kit and 38 samples of total RNA derived using the Trio kit, we conclude that the Trio kit was more biased toward introns, and the SMARTer kit was also strongly biased. This finding is consistent with those of others who have reported the bias of the SMARTer kit (Song et al., https://doi.org/10.1186/s12864-018-5066-2). Users can find these results in our Supplementary Table S1. We have also uploaded the protocol information to our portal.

      3) How do the authors plan to update and maintain CovidExpress?

      We thank the reviewer for this question. We understand the importance of data updating. Our plan is to update the database quarterly once this manuscript has been accepted or when 10 new studies have been collected by us or suggested by users. We have added this information to the FAQs on the portal’s landing page. We also understand the importance of maintaining the service for a feasible amount of time for research. Therefore, we will keep the server activated for at least 2 years after the WHO announces that COVID-19 is no longer a global pandemic. We will also ensure that, even after we take down the server , scientists with programming skills will be able to create local servers based on the data provided on CovidExpress.

      **Minor comments:** 1) Some texts in figures are not readable. For example, Fig2B, 2C, 2D, 2E.

      We thank the reviewer for this comment. We have now increased the font sizes and provided high-resolution figures in revision.

      2) The authors could use Videos to demonstrate how to use CovidExpress on the website as they have shown in Fig3.

      We thank the reviewer for this suggestion. We have uploaded several video tutorials to the landing page and will gradually add more. We also added a gitter chat channel so that users can ask questions, report bugs, or suggest new studies to include in the database.

      Reviewer #3 (Significance (Required)): The ongoing COVID-19 pandemic is a big threat to human health. Many molecular and cellular questions related to COVID-19 pathophysiology remain unclear and many researchers have conducted studies to explore the gene expression regulations of human cells responding to COVID-19 infection. However, there is no database/website that integrating all RNASeq data to provide user-friendly tools for gene expression analysis for COVID-19 researchers. The authors collected the published RNASeq datasets and developed a database and an interactive portal, named CovidExpress, to allow users to investigate the gene expressions response to COVID-19 infection. CovidExpress is a valuable resource for the COVID-19 study community once the batch normalization problems are solved. The users who came up with ideas about the regulation of COVID-19 response could use the system to test their hypothesis, without experience in bioinformatics and RNASeq data analysis. This will be more important when more RNASeq data from samples with different tissues, cell lines, and conditions are integrated into the database.

      We thank the reviewer for the positive comments. We apologize for the confusion and acknowledge that we should not describe our effort using the term “batch effect.” As described by Reviewer #2 (and we agree), batch effect should be used only to indicate a purely technical difference in the same biological system; for example, differences in experiments performed on different days or by different lab personnel. Thus, we cannot correct for “batch effect” by using CovidExpress. We hope that the reviewer realizes that what we did was correct for the effect caused by differences in software and parameters across the studies. For example, in our approach, the DEGs from GSE155518 and GSE160435 (both primary lung alveolar AT2 cells (both from Mulay et al., Cell Report, 2021) were significantly correlated (panel A below; p = 1.36e-24, F-test). However, when we downloaded the TPM values from their GEO records, GSE155518 appeared to have a genome-wide decrease in the expression of SARS-CoV-2–infected samples (panel B below).

      Thus, using the proceed data directly without careful reviewing the method might lead to false hypothesis. At last, researchers can make new discoveries, such as our OASL and FURIN findings, by using many other features that CovidExpress provides.

    1. Plessner's distinction between plant and animal is both an enabling pathway towards his anthropology but also quite distinctive and worthy of consideration in itself. Contrary to the mainstream legacies of botany and zoology, but consistent with the logic he is developing, plants and animals for Plessner are a priori life-categories or modals of the organic based upon filling alternative organizational possibility spaces that follow from the dialectics of positionality and not in the first instance about the distinction between autotrophy and heterotrophy. Accordingly, certain heterotrophic species such as corals, hydroids, bryozoan and ascidians are classed by Plessner into the plant category. In broad terms, the plant-animal distinction is defined by the difference between "open" and "closed" positionalities, a distinction which has much to do with levels of mediation. One may think of this as two alternative basic strategies for achieving the aforementioned balance between assimilative and resistive moments immanent in any form of positionality. "A form is open if the organism in all of its expressions of life is immediately incorporated into its surroundings and constitutes a non-self-sufficient segment of the life cycle corresponding to it" (p. 203). An open form of positionality, we can say, doesn't require mediation by way of a posited center and the consequence of this is realized throughout the morphology, physiology and growth patterns of the plant. Morphologically this is manifested in the tendency of the organism to develop externally and expansively in a way that is directly turned toward its surroundings. It is characteristic of this kind of development that it does not have the need to form centers of any kind. The tissues responsible for mechanical solidarity, nutrition, and stimulus conduction are not anatomically or functionally concentrated in particular organs but rather permeate the organism from its outermost to it innermost layers. The absence of any central organs tying together or representing the whole body means that individuality of the individual plant does not itself appear as constitutive but rather as an external moment of its form associated with the singularity of the physical entity; in many cases the parts remain highly self-sufficient in relation to each other (graftings, cuttings). This led a great botanist to go so far as to call plants 'divididuals'. (pp. 203-204)

      This is an interesting classification of "open" and "closed", depending on whether the living organism has uniform functionality or specialized, and centralized structures respectively.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      FULL REVISION

      Manuscript number: RC-2021-00934

      Corresponding author(s): Seiya, Mizuno

      General Statements

      We would like to thank all the reviewers for their comments on improving the manuscript. We are encouraged by the overall positive responses from the reviewers. According to the reviewers’ comments, we have further refined our manuscript. We are confident that we have addressed all the reviewers’ comments and suggestions by incorporating them into the revised manuscript. We highlighted the changed text in the manuscript in red. The point-by-point responses to all comments follow.

      Point-by-point description of the revisions

      Reviewer 1:

      The study by Akihiro and colleagues describe the generation of multiplex genotyping method for detecting CRISPR gene editing alleles using nanopore sequencing and a machine learning program. The method is based on long-range PCR amplification of intended targeted loci from gene edited animals followed by nanopore sequencing. A PCR-index is introduced to the sample pooling system before sequencing, thus allow sequencing up to 100 sample in one flowcell. The study developed a machine learning program for allele binning, analysis, and presentation. To demonstrate the applicability of the method, the study has validated their methods for detection of point mutations, deletion, and flox insertion. The study has in principal provided sufficient investigation and data to demonstrate the validity of the method. All the figures are very nicely and clearly presented. However, there is a few concerns that it should be taken in to consideration.

      We appreciate the constructive and important comments from the reviewer.

      Reviewer 1_Comment #1:

      Many previous reported unintended structure variations caused by CRISPR off-targets are typically much larger deletion/insertion/insertion/translocation occurred outside the target sites. The current study is more for targeted allele genotyping. The use of structure variable (SV) in the whole study should be considered to revise thoroughly.

      SV is typically referred to genomic variation of approximately 1kb and above. What the study describe in this study is still within indel types instead. Thus, comparing the DAJIN with NanoSV and Sniffles on reads with 50, 100 and 200 bases deletions is not appropriate.

      The detection of SV alleles in the whole study is most likely a cause of minor indel alleles and sequencing errors. Figure 2b, BC32, WT mice also contains a proportion of SV allele, which is apparently caused by sequencing error. Such SV which is not related to CRISPR gene editing is also seen in other genotyping results e.g. Figure 3a. Figure 4b, Figure 5c, Figure 6b.

      Another co-factor that contributes to the SVs is the PCR-error from the method.

      Thank you very much for your comments. We agree that structural variation traditionally referred to genomic alterations that are larger than 1 kb in length. Although the application of sequencing technology has expanded the spectrum of structural variation to include smaller events >50 bp in length (PMID: 21358748, PMID: 26432246), there are no common understanding on the definition of the name of genomic rearrangements >50 bp in length through genome editing. We changed the name of the unexpected mutation reads more than approximately 50 bp in length “Large rearrangements (LAR)”. We changed description on the name of reads that DAJIN annotates in the Methods (Page 6, Line 205) and Results section (Page8, Line 249) as well as all other parts throughout the manuscript.

      Although we believe most of the LAR alleles are the real alleles generated through genomic rearrangements (Fig. 3b&3c, S12, and S16), we recognize that minor fractions of the LAR alleles, including those observed in WT mice, are composed of reads with high sequencing error rate. Visualized BAM files and consensus sequences can be indicators of the annotation results, providing information to the users of DAJIN that minor alleles that are similar in proportion to the one in the WT sample can be artificial alleles. We also cannot exclude the possibility that LAR alleles include those generated through PCR error. ‘Pseudo-LoxP’ alleles could be generated if the PCR products, which included one-side LoxP but not another-side LoxP, worked as a PCR primer to anneal WT allele in the next PCR step (Page 12, Line 425-427). Recently developed methods may address these limitations. We added description in the Discussion section (Page 17-18, Line 608-620).

      Reviewer 1_Comment #2:

      The reason that current method detect more than two alleles from one animal is probably due to the chimerism of the animal. However, when looking at the BAM file and figures presented in Figure 1b, 2c, 3b, 3d, 4c, as well as those in the Supplementary figures, there seems to be more than one allele (indels reads with different size) presented in one category.

      For example, Figure 2C, mice BC12, it is not fully aligned between the all alleles and the allele1 and allele 2 presented. For allele 1, which is called SV, there are reads with different size of indels. For allele 2, which is called intended PM, some reads are a hybrid of deletion and intended substitution.

      Thank you for checking the data in detail. As the reviewer pointed out, some of the reads in each allele showed indels with different sizes. We think these indel mutations are due to nanopore sequencing errors. Although the error rate of nanopore sequencing has improved, it has been reported that an error rate of 5% occurs in 1D sequencing of R9.4 flow cells that is the same flow cells used in our study (DOI: 10.1002/wfs2.1323). In this study, DAJIN mitigated the nanopore sequencing errors by calculating the MIDS score (Fig. S7), but the visualization using the BAM file showed the raw reads including the sequence errors. For this reason, the one allele seems to include different indel alleles.

      To evaluate the point, we performed Sanger sequencing and found that there were no hybrid sequences containing indel mutations, but only intended point mutation in BC12 allele 2 (Fig. 2d). The results of Sanger sequencing suggested that the indel mutations visualized by the BAM file were due to nanopore sequencing errors. To clarify the points, we updated the description in the Discussion section (Page 15-16, Line 528-548).

      Reviewer 1_Comment #3:

      What is the advantage of the current method as compared to the one reported by Bi et al., 2020, genome biology, previously?

      Thank you for pointing it out. We believe that one of the advantages of IDM-seq developed by Bi et al. is performing quantitative analysis by correcting PCR bias via Unique Molecular Identifiers (UMIs). However, when multiple samples are processed simultaneously, it is impractical in terms of cost and workability to prepare primers for the UMIs. While IDM-seq has the advantage to quantify the precise amount of each allele in a single sample, DAJIN is more suitable for primary and comprehensive analysis of multiple genome-edited samples. We have described these points in the Discussion section (Page 15, Line 509-513).

      Reviewer 1_Comment #4:

      The report machine learning method is developed for calling the different alleles. Has the authors compare DAJIN with e.g. NanoCaller, which is developed for SNPs and small indels calling based on DNN.

      We are thankful to the referee for bringing the comparison with NanoCaller to our attention. We conducted NanoCaller and found it performed better to detect the point mutation than Medaka and Clair. However, because NanoCaller could not detect the LAR (formerly labelled as “SV”) alleles, it incorrectly reported the genotype of BC25 as 'point mutation', not 'LAR with point mutation'. We added the results of NanoCaller in Table S9 and described these points in the Results section (Page 10, Line338-339).

      Reviewer 1_Comment #5:

      Apart from genotyping, many CRISPR studies performed in cells are focusing on profiling the indel profiles in a pool of edited cells. It would broaden the applicability of the method for detecting different indels types in such samples and conditions. Current methods, such as TIDE/ICE, NGS-based amplicon sequencing, IDAA can only detect smaller indels. DAJIN will add the advantage of detecting longer indels for such application.

      Thank you very much for your comments. We added description on application of DAJIN in the Discussion section (Page 17, Line 592-596).

      Reviewer #1 Significance :

      Although similar methods are reported for genotyping of the CRISPR editing outcome, the current study introduce the PCR barcoding and particularly the bioinformatic tool box for allele binning and calculation contribute with useful tool to the filed. The study has demonstrated with multiple applications demonstrating the broad applicability of it.

      Reviewer 2:

      CRISPR nucleases typically generate DNA double strand breaks (DSBs) at target site, which typically generate small insertion and deletion (indel) enabling precise gene knockout or knock-in. However, accompanied DNA DSBs often induce unwanted large deletions or chromosomal translocation. Thus, to assess such large variations as well as small indels is crucial in the genome editing field. In this manuscript, the authors developed a long-range assessment tool, named Determine Allele mutations and Judge Intended genotype by Nanopore sequencer (DAJIN), using a long-read sequencer, Nanopore sequencing. Overall, the topic will be interesting for broad readers and this tool looks technologically sound. I would suggest a few comments that may strengthen this manuscript, as follows.

      We are grateful for the referee’s valuable suggestions to improve our manuscript.

      Reviewer 2_Comment #1:

      Another key study is missed in this manuscript. Recently, a tool with similar concept to DAJIN was published in Nat Methods, which uses also long-read sequencers, Nanopore or PacBio [PMID: 33432244]. It is necessary to describe the benefits of DAJIN against the previous study.

      Thank you for pointing this out. Our method has an advantage over those utilizing unique molecular identifiers (UMIs) in its automatic identification and classification of genomic rearrangements including unexpected mutations in multiple samples obtained under different editing conditions (different target loci). As per our response to the Reviewer #1_Comment #3, one of the disadvantages of UMIs is the cost. More accessible methods of routine assessment of on-target genome editing outcomes are required, as well as unbiased assessment of editing products (PMID: 32643177). We showed in the manuscript that the machine-learning-based model could bypass molecular tagging to provide a feasible approach for routine assessment of genome editing outcomes. DAJIN will make a very significant contribution to speeding up and improving the accuracy of this experimental process.

      We agree that the approach reported by Karst et al. has certainly contributed to generation of highly accurate single-molecule consensus sequences. Analysis of small portion of samples using UMI-based methods may compensate for the limitations of DAJIN such as PCR bias and/or PCR-mediated recombination as you described in your comment #6. We added description in the Discussion section (Page 15, Line 509-513; Page 17, Line 615-618).

      Reviewer 2_Comment #2:

      In Figure 1a, the authors used Barcoding but details information is not present in the main text. The length and context information are necessary to be described in the main text.

      We thank the reviewer for these comments. According to the comments, we illustrated the process of PCR-based barcoding in Fig. 1a. Besides, we described the length of barcodes at "Library preparation and nanopore sequencing" in the Methods section (Page 4, Line 137 & 140).

      Reviewer 2_Comment #3:

      The term "SV (structural variation)" over "Single-nucleotide variant (SNV)" seems ambiguous. Does "SV" include large deletion and chromosomal translocation? In this manuscript, I guess that SNV indicates small indels, whereas SV indicates large indels. The detailed definition is needed for better understanding.

      Thank you very much for your comments. We intended to classify and label large genomic rearrangements including large deletion and chromosomal translocation as “SV (structural variation)”. We agree that structural variation traditionally referred to genomic alterations that are larger than 1 kb in length. Although the application of sequencing technology has expanded the spectrum of structural variation to include smaller events >50 bp in length (PMID: 21358748, PMID: 26432246), there are no common understanding on the definition of the name of genomic rearrangements >50 bp in length through genome editing. We changed the name of the unexpected mutation reads more than approximately 50 bp in length “Large rearrangements (LAR)”. We changed description on the name of reads that DAJIN annotates in the Methods (Page 6, Line 205) and Results section (Page8, Line 249) as well as all other parts throughout the manuscript.

      Reviewer 2_Comment #4:

      In Figure 2, IGV exhibits several SNVs (i.e., random errors) in each query sequence, which might be due to the low accuracy of Nanopore sequencing. I understand that DAJIN makes consensus sequence based on those long-read sequences. But I wonder how DAJIN pinpoint the point mutation (PM) so exactly?

      Thank you for pointing it out. As you mentioned, the low accuracy of Nanopore long-read sequencing made PM detection difficult. We tackled the issue and partly solved it by (i) calculation of MIDS score (Fig. S7), (ii) reducing data's dimension by principal component analysis (PCA), and (iii) setting proper parameters of HDMSCAN.

      DAJIN converts ACGT nucleotide information to MIDS (Match, Insertion, Deletion, and Substitution) (Fig. S6). Subsequently, DAJIN subtracts the relative frequency of MIDS between a control and a sample. We called the subtracted relative frequency 'MIDS score' (Fig. S7). The subtraction mitigates the sequencing errors because the error patterns are similar between a sample and a control. We next perform clustering using the MIDS score. DAJIN compresses the score by PCA and extracts five dimensions. The dimension reduction may be effective to mitigate sequencing errors because the sequencing errors have lower scores than true mutations. Subsequently, DAJIN performs HDBSCAN, a density-based clustering method. The HDBSCAN have a parameter of 'min_cluster_size' that indicates a minimum number of samples in a cluster. DAJIN finds the parameter returning the most frequent cluster numbers by searching the value in the range of 10% to 40% of reads. It means DAJIN ignores minor clusters that contain less than 10% of reads. We set the criteria because sequencing errors often made such minor clusters.

      In summary, we consider the MIDS score, PCA and the parameter setting of HDBSCAN support DAJIN's accurate PM detection. To clarify the point, we updated the description in the Methods section (Page 7, Line 217-225).

      Reviewer 2_Comment #5:

      In page 9, the authors also used next-generation sequencing (NGS). I guess this NGS indicates illumine-based short-read sequencing. Clearer definition is necessary here.

      We thank the referee for bringing this unclarity to our attention. According to the reviewer's comment, we updated the words 'NGS' to the 'illumina-based short-read next-generation sequencing' or 'short-read NGS' in the whole text.

      Reviewer 2_Comment #5-1:

      Whereas DAJIN could reported SVs, PM, and WT, the NGS could not capture SVs. Could you write the reason here? I guess that the short-read sequences including SVs might be discarded during the alignment process, which means that it is because of software limitation, rather than the NGS itself.

      Thank you for pointing this out. In this study, we performed the short-read NGS analysis by paired-end sequencing (2 x 151 bases) for PCR amplicons of about 200 bp length. We consider the main reason that NGS could not capture LAR (formerly labelled as “SV”) is due to the PCR process. The allele 2 in BC20, BC25, and BC26 of Tyr point mutation had a large deletion including primer annealing sites, which makes it impossible to obtain the PCR amplicon of this allele. Besides, allele 1 in BC25 had about 60-70 bp insertions. The insertion might make it difficult to amplify the whole length of this allele because of the limited number of cycles in short-read NGS.

      To examine whether the short-read sequencing reads were discarded during the alignment process, we calculated the mapping percentages of BC20, BC25, and BC26 and found that 97-99% of reads were successfully aligned to the mm10 reference genome. We think this result can support our hypothesis. We added the results in Table S10 and described the points in the Results section (Page 10, Line 329-332).

      Reviewer 2_Comment #6:

      Basically, DAJIN amplify the target region using PCR, thus PCR bias (e.g. unequal amplification according to different lengths) should be considered. The authors should address it. Moreover, it is better to describe the limitation of current DAJIN in the discussion section.

      Thank you very much for your comments. PCR amplification of genomic DNA is essential in our method described in the manuscript. As we have described in a paragraph in the Discussion section (Page 17, Line 597-601), we recognize there is an unavoidable limitation with PCR bias. We also cannot exclude the possibility that large rearrangements (‘LAR’, formerly labeled as ‘SV’) include alleles generated through PCR and/or sequencing error. ‘Pseudo-LoxP’ alleles could be generated if the PCR products, which included one-side LoxP but not another-side LoxP, worked as a PCR primer to anneal WT allele in the next PCR step (Page 17, Line 608-613). We recognize that minor fractions of the ‘LAR’ alleles, including those observed in WT mice, are composed of reads with high sequencing error rate. Recently developed methods including the one you kindly mentioned in the comment #1 may address these limitations. We added description in the Discussion section (Page 17-18, Line 615-618).

      Reviewer #2 Significance:

      Overall, the topic will be interesting for broad readers

    1. SciScore for 10.1101/2021.10.18.21265145: (What is this?)

      Please note, not all rigor criteria are appropriate for all manuscripts.

      Table 1: Rigor

      <table><tr><td style="min-width:100px;margin-right:1em; border-right:1px solid lightgray; border-bottom:1px solid lightgray">Ethics</td><td style="min-width:100px;border-bottom:1px solid lightgray">not detected.</td></tr><tr><td style="min-width:100px;margin-right:1em; border-right:1px solid lightgray; border-bottom:1px solid lightgray">Sex as a biological variable</td><td style="min-width:100px;border-bottom:1px solid lightgray">not detected.</td></tr><tr><td style="min-width:100px;margin-right:1em; border-right:1px solid lightgray; border-bottom:1px solid lightgray">Randomization</td><td style="min-width:100px;border-bottom:1px solid lightgray">not detected.</td></tr><tr><td style="min-width:100px;margin-right:1em; border-right:1px solid lightgray; border-bottom:1px solid lightgray">Blinding</td><td style="min-width:100px;border-bottom:1px solid lightgray">not detected.</td></tr><tr><td style="min-width:100px;margin-right:1em; border-right:1px solid lightgray; border-bottom:1px solid lightgray">Power Analysis</td><td style="min-width:100px;border-bottom:1px solid lightgray">not detected.</td></tr></table>

      Table 2: Resources

      No key resources detected.


      Results from OddPub: Thank you for sharing your code.


      Results from LimitationRecognizer: We detected the following sentences addressing limitations in the study:
      Our study has limitations, which must be considered. The SNP heritability estimates for both measures of Covid-19, while >0, were small. Second is that genetic correlations, while being robust against environmental confounders, can still suffer from genetic sources of confounding (i.e., even with genetic correlations, correlation is not always causation). To this point, we think it is highly unlikely that not being breastfed as a baby and eating less cheese cause ASB. In fact, we chose these dietary traits to illustrate this very point. Rather, the shared genetic architecture that these have with education years, verbal reasoning, and average income are the more plausibly causal phenomena. Third, we cannot determine the direction of causality with genetic correlations alone. For much of the discussion above, we tacitly presumed plausible directions of effect (e.g., ASB causing Covid-19 versus Covid-19 causing ASB). But with all the traits in our matrix, the prevailing direction of effect could be the opposite and/or some level of bi-directional causation may exist15,24. These uncertainties are avenues for future research. Specifically, at present MR cannot be leveraged to test whether ASB causes any of the traits investigated, since few genome-wide significant signals have been found for ASB. But once they are found, bi-directional MR can be used to decipher the prevailing directions. A fourth limitation is that our findings are limited to those of European ancestry. The limi...

      Results from TrialIdentifier: No clinical trial numbers were referenced.


      Results from Barzooka: We did not find any issues relating to the usage of bar graphs.


      Results from JetFighter: We did not find any issues relating to colormaps.


      Results from rtransparent:
      • Thank you for including a conflict of interest statement. Authors are encouraged to include this statement when submitting to a journal.
      • Thank you for including a funding statement. Authors are encouraged to include this statement when submitting to a journal.
      • No protocol registration statement was detected.

      Results from scite Reference Check: We found no unreliable references.


      <footer>

      About SciScore

      SciScore is an automated tool that is designed to assist expert reviewers by finding and presenting formulaic information scattered throughout a paper in a standard, easy to digest format. SciScore checks for the presence and correctness of RRIDs (research resource identifiers), and for rigor criteria such as sex and investigator blinding. For details on the theoretical underpinning of rigor criteria and the tools shown here, including references cited, please follow this link.

      </footer>

    1. A lot of the literature and shorter articles out there treat many of these systems as recent or "new inventions". Many reference "innovators" like Ryan Holiday or Niklas Luhmann. They patently are not. They've grown out of the Western commonplace book tradition which were traditionally written into books underneath thematic headings (tags/categories in modern digital parlance) until it became cheap enough to mass manufacture Carl Linnaeus' earlier innovation of the index cards in the early 1900s. Then one could more easily rerarrange their ideas with these cards. Luhmann allowed uniquely addressing his cards which made things easier to link. Now there are about thirty different groups working on creating digital tools to do this work, some under the heading of creating "digital gardens".

      Often I think it may be easier to go back to some of the books of Erasmus, Melanchthon, or Agricola in the 1500s which described these systems for use in education. Sadly Western culture seems to have lost these traditions and we now find ourselves spending an inordinate amount of time reinventing them.

      I'd love to hear your experience in re-introducing it to students in modern educational settings.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Manuscript number: #RC-2021-00992

      Corresponding author(s): Parisa Kakanj and Maria Leptin

      Reviewer #1 (Evidence, reproducibility and clarity (Required)):

      In this study, the authors use the fruit fly as a model to understand the role and regulation of autophagy in epidermal integrity during development and wound healing. They discover that hyper activation of autophagy via overexpression of Atg1 leads to disruption of epithelial organization, junctional protein localization, and syncytium formation. In addition, these epidermal defects were found to be dependent on TORC1 as knockdown or inhibition of TORC1 antagonists resulted in similar epidermal defects which could be rescued by knockdown of Atg1 or Atg5. Wound healing in fruit fly epidermis is known to induce cell fusion and here the authors show that syncytium formation is dependent on autophagy. GFP-Atg8a autophagosomes were found to accumulate in cells adjacent to the wound site, but Atg1-induced syncytium formation was dispensable for wound repair. However, the authors found that hyper activation of autophagy prior to injury slowed wound closure. This may be due to defects in actomyosin organization or another developmental defect the authors observed in the epidermis. Overall, the key conclusions of this study are convincing, but the experiments would be strengthened by validation of all the RNAi strains used as well as demonstration that epidermal barrier remains intact as described.

      **Major Comments**

      1. This study uses a number of UAS-RNAi strains as well as dominant negative and overexpression transgenes. There is no validation that these genetic perturbations work as expected.

        Almost all of the lines we use have been extensively used and validated by others as documented in the literature. We append a table (below, page 14) with these references. It would be close to impossible for us to show their tissue specific efficacy in the larval epidermis because it is extremely difficult to obtain clean dissections of epidermis without contamination from other tissues (muscles, nerves, etc.), and we believe we can rely on the known validation of most of the lines. It is true that some of the lines are less well characterised, and we comment on those below, and will eliminate our speculation on their effects in the manuscript.

      In fact, the authors state on pg 5 that RNAi to Atg6, Atg7, and Atg12 may be less effective, but do not verify the knockdown efficiency to the gene of interest (i.e. Atg5 RNAi knock downs Atg5 transcript or protein).

      Atg12 and Atg7 have been shown (PMID: 25882046) by quantitative RT-PCR to effectively reduce RNA levels in the midgut during larval to pupal transition. We will therefore have to eliminate our speculation that the weak effect in the epidermis may be due to ineffective knock-down. Rather, it seems that these components are accessory but not necessarily essential for the completion of autophagy, as also observed by others (PMID: 25882046, PMID: 1805642, PMID: 23599123, PMID: 15296714, PMID: 23873149, PMID: 23406899)

      This is particularly important as authors use a single UAS-rictor RNAi strain to conclude that autophagy is dependent on TORC1 and not TORC2. If rictor RNAi is also weak or ineffective than this conclusion would be erroneous.

      The function of rictor has been validated by classic genetics: Animals homozygous for deletions of rictor show no defects throughout their normal life cycle (Hietakangas and Cohen, 2007). We have also shown that epidermis of homozygous rictor∆1 larvae (marked with Src-GFP, DsNuc-Red2) shows no abnormalities in cell shapes or cell membranes. We include an image here.

      Figure A __| Effect of rictor deletion on the epidermis. a,b, Fluorescence micrographs of larval epidermis expressing the indicated markers in a larva homozygous for a rictor deletion (rictorEY08986 , also named rictor∆1). a, Lower magnification showing the entire width of larval segments A3 or A4. n=16-18 larvae each genotype. Scale bars: a 50 μm; b,__ 20 µm.

      A major conclusion of this study is that autophagy remodels the lateral cell membranes and not the basal or apical, so the membrane integrity remains intact. This is described and shown in Fig S3a, but it is hard to see that the apical membrane is intact. It would be helpful if authors could show a true membrane marker, such as UAS-CD8mGFP to see if there is a continuous membrane.

      We will include new experiments with this marker.

      Alternatively, is there a barrier assay that could help demonstrate that syncytium formation does not disrupt epithelial integrity?

      This follows from the fluorescence recovery we performed (Supplementary Video 13), where we observe rapid diffusion between areas in the epidermis, but never any leakage of fluorescence in the y-axis into the body cavity. We will emphasize this more clearly in the text.

      This could be performed in the fly gut, using the smurf assay (Rera M et al. 2011), since the authors also describe (pg 9) a similar role for autophagy in disruption of epithelial lateral membranes.

      We had done a smurf assay, and observed no leakage from the gut, but didn’t document this at the time because of difficulties during the period of Covid restrictions of accessing a dissecting scope/camera set up in a lab outside our own. We will try to repeat this now in the hope that with current reduced restrictions we can record the result.

      Is autophagy dependent syncytium formation cell autonomous?

      Our clonal analysis in wound healing addresses this point (Figure 2; text page 5 and 6). Clones of GFP-expressing cells neighbouring a wound share their cytoplasmic contents with their neighbours during wound closure. However, a clonal cell that is Atg5-deficient in a wild-type background does not share its content with the neighbouring cells. This shows that for a cell to participate in syncytium formation, that every cell itself has to be competent to perform autophagy. We will expand the explanation of this point in the text.

      The A58-Gal is not cell-type specific as authors describe (pg 9) similar effects in trachea, salivary glands, and intestine and it is unclear if effects are due to disruption of autophagy in epidermal cells or general disruption in fly's physiology. The authors should determine, using a more restrictive Gal driver, whether syncytium formation is due to activation of autophagy in the epidermal cells or another cell type (trachea, salivary glands, or intestine).

      We apologize if our phrasing of ‘ectodermal’ led to the impression that A58-Gal4 is cell-type specific. A58 also drives expression in the tracheal system, as all other available epidermal drivers do. A58 expression in the salivary gland is presumably due to the origin of the Gla4 construct, which like many other Gal4 drivers (e.g. NP1-Gal4) includes salivary gland specific enhancers (PMID: 8223268 and PMID: 12324947). A58 is not active in the gut, and for the experiments in the gut we used the NP1 driver. We will rephrase the text in the paper to avoid confusion. There is no driver that is absolutely restricted to the epidermis.

      Alternatively, if no other Gal4 is available for the larval epidermis then authors could at least show using enterocytes driver (NP1-Gal4) that overexpression of Atg1 is sufficient to induce syncytium formation and its effect on gut barrier integrity.

      We did do this experiment but didn’t include the images because of the large number of figures we already had. We now show them here. As mentioned above, barrier integrity is not compromised. We can also provide images of the phenotype in tracheal cells.

      Figure B __| Effect__ of uncontrolled autophagy on enterocytes and salivary glands. Larval gut or salivary glands expressing the indicated markers and overexpression (Tsc1,2 or Atg1S) or RNAi (raptori) constructs using the NP1-Gal4 driver. Images are from live imaging of gut or salivary gland of 6 to 11 larvae for each genotype. Scale bars, 20 µm.

      In Fig 8, authors nicely show that Atg1 RNAi can rescue Tor RNAi and raptor RNAi, but, what about the reverse. Is overexpression of Tor sufficient to inhibit the overexpression Atg1 and reduce autophagy-induced syncytium formation?

      Overexpression of Tor would affect both TORC1 and TORC2. We have done this experiment using UAS-Torwt construct but found that it leads to excessive autophagy rather than suppression, consistent with similar results reported by others (PMID: 12324961 and PMID: 15186745). This approach can therefore not be used to do the proposed experiment. Instead, one could use downregulation of the Tor inhibitor TSC1, which acts on TORC1, and we have shown to reduce autophagosome formation in wound healing (Fig. 1d). Another option is to overexpress the TORC1-specific activator Rheb (PMID: 12893813, PMID: 17208179 and PMID: 31422886). We will set up the experiments with these constructs in the hope that they will yield interpretable results.

      **Minor comments:**

      1. Check spelling of abbreviations, Sqh is often misspelled Shq in figures

        We will correct them. Thanks for alerting us.

      The order of images in Figure 3 should match the description in the text (pg. 6).

      We would prefer to retain the current order because it is then consistent with all the other figures. Re-writing the text to reflect this order would make it less clear.

      AtgW is described in text, but not shown in Fig 3a-c. Also, upstream activators of TORC1 are described first, but shown last in this Figure making it difficult to follow.

      We will now only mention Atg1W later in the text where we also show it in a figure.

      Fig7a should show junctional effect of Atg1W alone and in combination with Atg5i which is used in 7b.

      We had left this out to save space, but we will now include these data.

      It is unclear why authors switched to this weak overexpression for this photobleaching assay when Atg1S was predominantly used in the rest of the study.

      The reason we used Atg1W in this particular experiment is that we had it on a chromosome where it was recombined with GFP which made it genetically much easier to use for FLIP experiments. However, perhaps these constructs merit some discussion. Atg1W and Atg1S were originally called “weak” and “strong” based on studies in other tissues and other stages (PMID: 33253201). However, we found that in the epidermis their effects are practically indistinguishable, as judged by TEM (Fig.3d,e) (Fig 5e,f) (Suppl. Fig. 5a,b and Suppl. Fig. 6b,c), and all markers we used in confocal analyses (which we will include them). Thus, to avoid confusion, we will change the nomenclature we use on our paper to the neutral Atg1GS and Atg16B.

      Reviewer #1 (Significance (Required)):

      This study elucidates the role and regulation of TORC1 and autophagy in epithelial membrane remodeling. This is important work that is significant to both developmental and wound healing research. Many cell types become multinucleate during differentiation, aging, and wound healing and here the authors find a novel role for authophagy in remodeling lateral cellular junctions to facilitate syncytium formation.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)):

      In their present manuscript Kakanj and colleagues show that during epithelial wound healing autophagy pathway controls plasma membrane integrity and homeostasis. Furthermore, elevated autophagic activity is sufficient to induce syncytium formation, which is essential for wound closure and healing. Authors used the epidermis of fruit fly larvae as model to study wound healing and video microscopy to examine this process. The methodology is well established, since authors already published a related study in 2016 using similar tools.

      The findings presented here are interesting and promising, the quality of most experiments are satisfactory, the confocal images/videos are excellent and I truly appreciate that authors used electron microscopy to support some of their claims. Findings are well presented and the text is well written and easy to read.

      Overall, my opinion is very positive about this manuscript.

      I believe most of the findings are very well supported, but I have some suggestions, which may can help strengthen the authors' points.

      1) Authors used GFP-Atg8a reporter to follow autophagy during wound healing. While I also believe that, the appearing GFP-Atg8a dots represent autophagic vesicles after wounding but GFP-Atg8a has some certain limitations. First: Atg8a (or LC3 in mammals) is removed from the outer surface of autophagosomes by Atg4 and the Atg8a trapped inside the autophagosomes will be degraded in the autolysosomal lumen. Thus Atg8a not always localizes to autolysosomes, actually Atg8a immunostaining mostly labels autophagosomes (and phagophores) but not autolysosomes in insect cells. Accordingly, GFP-Atg8a reporter is also subject of autolysosomal degradation and furthermore most of the GFP signal is quenched in the acidic lumen of autolysosomes, since at lower pH GFP loses fluorescence. Nevertheless, if lysosomal degradation proceeds normally, GFP-Atg8 will be degraded completely. Thus, some of the autolysosomes cannot be detected using this reporter, for this mCherry-Atg8a reporters can be used, since mCherry is more resistant than GFP and thus accumulate inside lysosomes, and retains its fluorescence in acidic environments.

      This is a good suggestion and we had done these experiments. However, the red fluorophores have a serious problem in that they all tend to form small aggregates or puncta – not in all tissues and at all stages, but this is a very wide-spread phenomenon, and is even observed in in vitro experiments (own observations). This makes quantification of vesicles or other small structures such as autophagosomes complete impossible. Nevertheless, here are a few figures from our analyses. While some of the spots clearly appear to be autophagosomes, as judged by their positions, they cannot be objectively distinguished from the other spots.

      Figure C __| Autophagy during epidermal wound healing. Time-lapse series of single-cell wound healing in larva expressing mCherry-Atg8a (black) to mark autophagosomes and autolysosomes (A58>mCherry-Atg8a). a, z-projections of a time-lapse series. b, Higher magnification of the areas marked by magenta boxes in (a). n=11 larvae. Each frame is a merge of 57 planes spaced 0.28 μm apart. Scale bars: a 20 μm; b,__ 10 µm.

      However, I still believe that for video microscopy GFP-Atg8a was a perfect choice, I just suggest to confirm the appearance of autophagosomes after wounding by other means: for instance, immunostaining of the epidermis after wounding (120 min) against Atg8a should confirm the presence of autophagosomes. There are a few specific available antibodies working in flies which are listed in the reviews of Nagy (PMID: 25481477) or more recently in Lorincz (PMID: 28704946)

      This is technically a huge challenge. We would have to induce a single cell wound, then filet and fix the epidermis, during which it rolls up and often destroys the area of interest. If it doesn’t, then the prep can be flattened out, but it still can be very difficult to find the wound in the prep.

      2) One of the major claims of the authors is that elevated autophagy leads to the breakdown or removal of lateral plasma membranes to promote syncytium formation. It is clearly seen on the confocal or EM images that lateral membranes disappear after wounding. However, it is also suggested that the lateral plasma membrane material is incorporated into autophagosomes or plasma membrane is a potential membrane source of autophagosome formation. I believe this is the least supported claim of the manuscript since no direct evidence for this is presented. This is based on BodyPy staining only, that BodyPy positive vesicles accumulate inside the cells. If this is indeed the case plasma membrane components should be detected in autophagic vesicles. Thus, I recommend co-staining membrane components with autophagic markers.

      This is indeed the clear next step, and we did a number of experiments along those lines, but they were once again compromised by the problem with the mCherry aggregates. This made the interpretation in the unwounded epidermis with artificially upregulated autophagy impossible. However, experiments with naturally upregulated autophagy in wound healing yielded results that are consistent with plasma membrane components being associated with autophagosomes (with the caveat that not every red dot we see represents an autophagosome). We have just repeated some of these using the septate junction marker FasIII and have obtained some beautiful movies that show FasIII labelled membrane (green) being surrounded by mCherry spots, and as the membrane begins to dissociate, the mCherry spots turn from red to yellow. We have included stills from results of these analyses here and will include them in a new figure in the revised manuscript.

      Figure D __| Colocalization of Atg8a and the septate junction component FasIII during epidermal wound healing. a, Time-lapse series of single-cell wound healing in a larva expressing mCherry-Atg8a (red) (A58>mCherry-Atg8a) and endogenously tagged FasIII (GFP gene trap; green), a transmembrane component of septate junctions. b, Higher magnification of the time-lapse marked by magenta boxes in (a). n=11 larvae. a,b, Each frame is a merge of 68 planes spaced 0.28 μm apart. Scale bars: a,b __20 μm.

      However if authors observe no colocalization of plasma membrane components with autophagy markers I still believe this study worth to be published. I would like to recommend the review of Ungermann and Reggiori (PMID: 29966469) in which the trafficking of Atg9 is discussed,

      Yes, indeed. And there is in fact now a further paper that goes in a similar direction (PMID: 34257406). We had left this out because we did not have direct data on Atg9, but will be happy to include it in the discussion in which we cite the paper that shows that Drosophila Atg9 is localized on the lateral plasma membrane in nurse cells, and loss of it leads to syncytium formation.

      since the source of autophagosomal Atg9 is in part the plasma membrane in mammalian cells. Therefore, these findings may strengthen the authors' claims.

      **Minor points:**

      Figure 2A: I believe authors wanted to use the word 'maintaining' not mating in their scheme.

      Indeed. Thanks for alerting us.

      Discussion: Authors suggest that: another function of autophagy in the cells surrounding the wound may be to clear up debris as in planarian and other cell types autophagy is activated in healthy cells, which simultaneously phagocytose cell debris. Honestly, I do not believe that this is the case here. Some of the Atg proteins are indeed required for phagocytosis during LC3-assiciated phagocytosis (LAP) (see: PMID: 30787029), but LAP is independent form Atg1

      Good point, we will include this in the discussion.

      and if LAP happened in the cells, surrounding the wound then GFP-Atg8a positive phagosomes would appear in those cells. However, it is clearly not the case here.

      Reviewer #2 (Significance (Required)):

      I highly recommend this manuscript to be uploaded to a relevant journal and I believe the findings presented here will be interesting for biologists specialized in regeneration and readers from the autophagy fields alike.

      Reviewer #3 (Evidence, reproducibility and clarity (Required)):

      **Summary:**

      The larval epidermis of Drosophila is a prime model for studying wound healing by combining live imaging with cellular, genetic and molecular analysis of the processes involved. Autophagy is known to be activated and necessary for efficient wound healing in animal models through secretion of cytokines and clearance of bacteria. This manuscript implicates autophagy in cellular syncytium formation during wound healing. Live imaging demonstrates autophagy activation in cells surrounding the wound. Inhibition of autophagy by RNAi against atg1 or atg5, required for autophagy initiation and autophagosome formation had no effect on the rate of constriction and closing of the wound site. However, elegant live imaging demonstrates that autophagy is required cell autonomously for cell fusion, a normal process during wound healing in flies. Autophagy can also be instructive for cell fusion. Strong induction of autophagy by TORC1 inhibition, TSC1/2 overexpression or Atg1 overexpression induce cell fusion that is genetically dependent on atg5, a gene acting downstream of atg1 in autophagosome formation. As Chloroquine treatment, a chemical inhibiting autophagosome fusion to the lysosome and lysosomal breakdown showed no effect, the authors suggest that later steps of autophagy are not involved. Live imaging with a selection of cellular fluorescently tagged markers of apical, lateral and basolateral membrane domains, combined with electron microscopy show clearly that lateral membrane are disrupted and removed within the epithelium. During this process, membranous large vesicles "drift" away from the plasma membrane. If these vesicles relate to autophagy is not addressed. In addition to the effect on cell fusion, strong autophagy induction also leads to autophagy within the nucleus, chromatin condensation and distortion of the nuclear membrane. The manuscript is well written and easy to follow. Figure panels and data are clearly presented. All experiments are well described throughout and skillfully executed with appropriate controls and statistical analysis. It remains unknown what induces autophagy in response to wounding. It also remains unclear whether autophagy deconstructs or engulfs parts of the plasma membrane, or if parts of the autophagy machinery has additional roles in plasma membrane fusion.

      **Major comments:**

      • Are the key conclusions convincing? -Conclusions are generally balanced and convincing.

      -I have seldom seen a paper so well written, presented and balanced by first pass. Hence my experimental suggestions are few.

      • Should the authors qualify some of their claims as preliminary or speculative, or remove them altogether? -Claims are well founded.
      • Would additional experiments be essential to support the claims of the paper? Request additional experiments only where necessary to evaluate the paper as it is, and do not ask authors to open new lines of experimentation.

        -The inhibition of autophagy is performed using knockdown of two genes acting in autophagy initiation (atg1, a part of the ULK1 kinase complex) and atg5, required for autophagosome formation. Later acting genes in the autophagy process such as autophagosome closure, fusion with the lysosome or degradation were not analyzed. In the abstract, the authors state "Proper functioning of TORC1 is needed to prevent autophagy from destroying the larval epidermis which depends on membrane isolation and phagophore expansion, but not fusion of autophagosomes to lysosomes". As far as I can see, the last statement on fusion derives from experiments with Chloroquine. Although frequently used for qualitative experiments, CQ is not suited for conclusive experiments. Without genetic experiments targeting genes for autophagosome-lysosome fusion such as snap29,stx17,vamp7 this statement is in my mind not well supported.

      We agree this would strengthen our findings, and we had indeed ordered these strains from the Bloomington stock collection. However, they were dead on arrival and both our labs in Heidelberg and Cologne currently have major problems with shipments from Bloomington and German customs. Other colleagues whom we asked did not have them available either. We will continue to search for appropriate constructs, but even if we find them and they arrive alive, and are processed by customs within a reasonable time, it will take many weeks to establish and then expand them and subsequently do the multi-generation crosses to obtain the stocks with all the relevant drivers and markers to set up the experiment. Three months is the absolute lower limit provided everything works according to plan, and first time round 6 months is a more realistic assumption. We hope that the referees and the editors agree that while this is a desirable experiment, it is not essential for the publication of the other results we present.

      • Are the suggested experiments realistic for the authors? It would help if you could add an estimated cost and time investment for substantial experiments. -Given the expertise of the authors, these experiments should be easy to perform within 3 months.

        • Are the data and the methods presented in such a way that they can be reproduced?

        • The manuscript is well written and an excellent example of how how methods and experiments should be presented. Methods, tools and experiments are all well described.

        • Are the experiments adequately replicated and statistical analysis adequate? -Replicates and statistics are adequate and custom for the type of analysis performed.

        **Minor comments:**

      • Specific experimental issues that are easily addressable. Figure 3 h. The live imaging documents the striking disappearance of lateral cell membranes using SRC-GFP. In 3h, large vesicle formation and movement towards the cell interior is shown. How frequent is this?

      This can only be seen clearly in experiments with time-controlled (Gal80ts) induction of authophagy where we can observe the process unfolding. We see these structures very frequently, but great variability in morphology and the structures are not always captured clearly in the plane of imaging. We here provide further examples.

      Figure E __| Autophagy in unwounded epidermis. a-c, Three additional examples showing apparent extrusions from lateral membranes after induction of autophagy (same experiment asn Figure 3h).__ Time-lapse series of epidermal cells expressing Src-GFP and Atg1S. Transgene expression is induced at the end of the second larval instar, live imaging started 6 h later (t=0) and continued for an additional 6 hours. a-c, Src-GFP containing material appears to be taken out of and eventually detached from lateral cell membranes (arrows).

      Is this believed to be the mechanism of lateral membrane removal?

      We would of course like to believe that, but we have no proof, and would therefore only be able to speculate.

      If so, is it dependent on the autophagy machinery. Are these vesicle positive for autophagy markers?

      Some autophagy markers have indeed been reported to be associated with the plasma membrane (e.g. Atg9, Atg16), but a conclusive study, while highly desirable, in our view goes beyond the scope of this study.

      Resolving this issue may lift the conclusions of the paper. Using 3xCherry-Atg8 together with SRC-GFP, this should be possible.

      We are intrigued by this suggestion and will be setting up the necessary crosses to do the experiments. However, it will take a long time to generate the necessary stocks (see genetics described below), and we will then again encounter the problem with the mCherry aggregates (see response to referees # 2). We are curious about the outcome, but we do not think it will be reasonable to promise as part of this revision that we will be able to provide conclusive results in the foreseeable future. Along with the many other things to do, this may just have to become part of a future paper, especially if there turn out to be other problems to be solved along the way. Like, for example, having to make an infrared (like mIFP or mKate, with which we have had much better experience in other contexts) Atg8 construct.

      Using CQ, the authors should be able to detect plasma membrane and junctional components in autophagosomes or autolysosomes (by confocal and electron microscopy) as degradation is inhibited. This should help to distinguish whether lateral membranes are engulfed and digested or if cells simply fuse, by using a part of the autophagy machiney.

      We have many interesting EM images on which we have had extensive discussions with the Paolo Ronchi and Yannick Schwab at the EMBL (whom we embarrassingly forgot to acknowledge in our manuscript, which will now be corrected), and one of the authors of this paper (BM) is an expert in EM imaging of the larval epidermis. It was agreed that some structures could indeed be interpreted as autophagosomes with content resembling junctional material. However, in the absence of absolute proof, we did not include them in the paper. We now show them here.

      Figure F __| Autophagosomes with junctional material in unwounded epidermis.__ Transmission electron micrographs of sections through the epidermis of a larva with elevated autophagy (A58>Atg1S) at two different magnifications. Arrows mark the autophagosomal membrane with content resembling junctional material.

      The authors, state that strong autophagy activation also leads to syncytium formation of tracheal cells, salivary glands and gut EC cells. Representative images in a supplementary figure would be useful for future reference.

      See response to other comments above (response to referees # 1). We have added some images in this document (Figure B) and will be happy to add additional ones in the revised manuscript.

      • Are prior studies referenced appropriately? -Yes. Key literature and findings are cited and discussed.

      • Are the text and figures clear and accurate? -Yes

        • Do you have suggestions that would help the authors improve the presentation of their data and conclusions?

      -See suggested experiments above.

      Reviewer #3 (Significance (Required)):

      • Describe the nature and significance of the advance (e.g. conceptual, technical, clinical) for the field. -The findings clearly documents a role of autophagy in syncytium formation in the physiological process of wounding. This has parallels to muscle syncytium formation, but has to my knowledge not been demonstrated in any other cell type to be performed by autophagy. Moreover, the authors show that strong autophagy induction can lead to fusion of epithelial cells. This may have relevance for processes and diseases where polyploidy are observed.

      • Place the work in the context of the existing literature (provide references, where appropriate).

      • State what audience might be interested in and influenced by the reported findings. -The data are very strong and the demonstration that autophagy controls syncytium formation outside of muscle development is surprising and significant. It is of interest to the field of cell biology and development in general and the autophagy field in particular. It will also be of interest for the medical field that deals with multinuclear phenotypes, such as cancer.

      • Define your field of expertise with a few keywords to help the authors contextualize your point of view. Indicate if there are any parts of the paper that you do not have sufficient expertise to evaluate. -Development, cell signaling, autophagy, vesicle trafficking.

      Table 2 | Fly stocks used in experiments

      Transgenes

      Stock ID

      Source

      Publications using this construct

      Reference

      UAS-GFP-Kuk

      (UAS-GFP-KukEY07696(w+))

      Jörg Großhans

      PMID: 16421189

      https://flybase.org/reports/FBal0161312

      29

      UAS-Atg1i

      (UAS-Atg1RNAi)

      V # 16133

      (GD7149)

      PMID: 19363474

      PMID: 31995752

      PMID: 32032548

      PMID: 32915229

      https://flybase.org/reports/FBtp0034071.html

      UAS-Atg5i

      (UAS-Atg5RNAi)

      V # 104461

      (KK108904)

      PMID: 31995752

      PMID: 32032548

      https://flybase.org/reports/FBtp0046851.html

      UAS-Atg6i

      (UAS-Atg6RNAi)

      V # 110197

      (KK102460)

      PMID: 28581519

      PMID: 23599123

      PMID: 27542914

      PMID: 25644700

      Dissertation of Philipp Trachte, Abb. 23. https://refubium.fu-berlin.de/handle/fub188/27709

      Dissertation of Sirena Soriano Rodríguez. https://roderic.uv.es/bitstream/handle/10550/50749/Tesis%20SSoriano.pdf?sequence=1

      UAS-Atg7i

      (UAS-Atg7RNAi)

      V # 45558

      (GD11671)

      PMID: 25882046

      PMID: 31995752

      PMID: 32032548

      PMID: 23599123

      https://flybase.org/reports/FBtp0025106.html

      UAS-Atg12i

      (UAS-Atg12RNAi)

      V # 29791

      (GD15230)

      PMID: 25882046

      PMID: 17568747

      PMID: 31995752

      https://flybase.org/reports/FBtp0027770.html

      UAS-TSC1,2

      (UAS-TSC1, AUS-TSC2)

      Iswar K. Hariharan

      PMID: 15296714

      PMID: 11348592

      64

      UAS-TSC1i

      (UAS-TSC1RNAi)

      V # 22252

      (GD11836)

      PMID: 23144631

      PMID: 29144896

      PMID: 29456138

      https://flybase.org/reports/FBtp0025266.html

      UAS-Tori

      (UAS-TorRNAi)

      BL # 33951

      Nobert Perrimon

      PMID: 25882046

      PMID: 26395483

      https://flybase.org/reports/FBtp0065159.html

      65

      UAS-TORDN

      (UAS-TORTED)

      BL # 7013

      Thomas P. Neufeld

      PMID: 15296714

      PMID: 29144896

      https://flybase.org/reports/FBtp0016360.html

      66

      UAS-raptori

      (UAS-raptorRNAi)

      BL # 34814

      Nobert Perrimon

      PMID: 25882046

      PMID: 31048465

      https://flybase.org/reports/FBtp0068814.html

      65

      UAS-raptori-2

      (UAS-raptorRNAi)

      BL # 41912

      Nobert Perrimon

      PMID: 32097403

      https://flybase.org/reports/FBtp0081336.html

      65

      UAS-rictori

      (UAS-rictorRNAi)

      BL # 36699

      Nobert Perrimon

      PMID: 25882046

      https://flybase.org/reports/FBtp0070835.html

      65

      UAS-Atg1S

      (UAS-Atg16B)

      Thomas P. Neufeld

      PMID: 33253201

      https://flybase.org/reports/FBtp0041043.html

      67

      UAS-Atg1W, UAS-GFP

      (UAS-Atg1GS10797)

      Thomas P. Neufeld

      PMID: 33253201

      https://flybase.org/reports/FBal0216676.html

      67

      UAS-S6Ki

      (UAS-S6KRNAi)

      BL # 41895

      Nobert Perrimon

      PMID: 25284370

      https://flybase.org/reports/FBtp0080798.html

      65

      UAS-SqaKA

      (UAS-SqaT279A/CyO)

      Guang-Chao Chen

      PMID: 21169990

      https://flybase.org/reports/FBtp0071419

      30

      UAS-RhoAi

      (UAS-RhoARNAi)

      V # 12734

      (GD4726)

      PMID: 23853710

      PMID: 33789114

      https://flybase.org/reports/FBtp0031970.html

      UAS-Roki

      (UAS-RokRNAi)

      V # 104675

      (KK107802)

      PMID: 24995985

      PMID: 33789114

      https://flybase.org/reports/FBtp0046110.html

      UAS-RhebAV4

      BL # 9690

      Fuyuhiko Tamanoi

      PMID: 31909714

      PMID: 28829944

      https://flybase.org/reports/FBal0141561.html

      69

    1. if all the batteries that generated electricity for telegraph lines had stopped working the economic life of the nation would have come to a halt

      This part of the lecture, which explains the importance of the telegraph in society during its prime stages, is something that I feel like it truly significant to recognize as a progressor in an environment. When we mention the invention and use of the telegraph in today's world when discussing the past, the true role it played for the different branches of society is always overlooked as it was an element in which many depended on due to its transmission speed. Before this discussion, I looked at the telegraph as a simple device of skinny wires that communicates information from one end to another, mainly helping news reporters. However, as the lecture mentions, the telegraph was more than this, it was heavily depended on in crucial areas of society such as the military, the economy, and the railroad, aspects that are all signs of progression towards a better life. If the telegraph ever ran into any mechanical problems, the flow of life would be heavily disturbed due to its importance, as "trains would stop running, businesses with branch offices couldn't function, news papers couldn't cover events far away..." (Networking Nature Lecture). Personally, I think it is interesting, and also important to note, that the telegraph is not only just an aspect meant for communicating information across the world, but also a necessity to continue improving the economy and keeping the public informed and motivated. Even if people know the importance of it, they ignore the fact how if one piece of society stops working, being the telegraph, many other parts of society "come to a halt" as well and not just one minimal aspect, something truly interesting. While it may not be considered an important item by some, it seems as if the telegraph is one of the first major inventions that heavily impacted the change and improvement of society along with the railroad, as it was often used by many, those being reporters and businessmen, and any issues would stop progression and hurt those who depend on its functions.

    1. NATURE

      I think this essay expands on what sublime really comes down to. In Cole's writing he is more appreciating the nature, but in Emerson's he is justifying that nature is all around us and makes the world up as we know it. Even beyond that point he goes to talk about our reasoning for existence a lot saying that, "All science has one aim, namely, to find a theory of nature." I think this may have been true in his time with underdeveloped sciences but in today's world there a scientists who have a theory on why nature was created yet still pursue science. Why would a scientist do this if still only trying to pursue the theory of nature that we already have discovered.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      1. General Statements [optional]

      We thank the reviewers for their critical comments and suggestions. We are glad that the reviewers appreciated the quality of the data and the novel findings connecting the secretory trafficking machinery with extracellular matrix-related signaling.

      2. Description of the planned revisions

      Reviewer #1 (Evidence, reproducibility and clarity (Required)):

      The manuscript by Jung et al reports on an interesting finding that focal adhesion signaling regulates the expression of Sec23A and thereby regulates COPII-dependent trafficking. The data presented a mostly solid and the finding itself is highly novel, as it tackles an area of secretory trafficking that remains poorly understood, namely the connection between the ECM and secretion.

      I will list below all comments that I have mixing both technical and conceptual topics:

      \*Technical issues:***

      1-The authors should provide a better description of how the designed this siRNA library. What were the inclusion criteria for these 378 genes? I might have missed it, but I could not find this information easily.

      Reply: The library has been designed in-house based on gene annotations and literature to include cytoskeleton structural proteins, motor proteins, and other associated and regulatory proteins. We will add this information in the Materials and Methods section.

      2-Figure 2: I know this is challenging for EM images, but is there a way the authors could quantify these data? How many images were looked at? What was the average width of ER cisterne?

      Reply: We will provide image quantifications and statistics

      3-Figure 4: I think that the characterization of the FA phenotype is a bit underdeveloped. There is no quantification of these data. Is the size of FA changing? Is the number of FA per cell changing? Is the length of FAs changing? I think that more work is needed to increase the confidence in these data.

      I could also not easily see what type of cells these are. A better description of this experiment is also required. Also, how many cells were analyzed. I think it is important that this experiment is done with a sufficient number of cells to increase the confidence in the data.

      Reply: We agree with the reviewer that our observations regarding the focal adhesion (FA) phenotype will benefit from image quantification and we intend to include this in the revised manuscript. All FA experiments were performed on HeLa cells. We will update the materials and methods sections to better describe this experiment.

      \*Conceptual issues:***

      1-The finding that focal adhesion signaling negatively affects ER-export is surprising, because cancer cells that grow on stiff substrates have more focal adhesions and are more invasive and migratory. Both migration and invasion are expected to depend on ER-export. Although the authors did not formally test Sec23A expression under different stiffnesses, I would expect that stiff substrates would lower Sec23A expression and thereby negatively affect ER-export. It would certainly increase the breadth of this work to include data like this and to also discuss this highly surprising finding. However, it is of course the decision of the authors and the editors to decide whether such an experiment would benefit the entire story.

      Reply: In this work, we have shown that cells plated on ECM or matrigel have decreased SEC23A expression compared to control cells. We have also shown that inhibition of FA kinase leads to an increase in SEC23A expression (Figure 5). Whether this translates into a change in ER transport, is a fair point that we will address in the revision. Regarding stiffness, we have done a preliminary experiment that shows that cells plated on a soft synthetic substrate have less SEC23A than cells plated on plastic.This goes in line with our ECM experiments because Matrigel and fibroblast-derived ECM are softer than plastic.

      2-The authors postulate that this novel mechanism could be part of a feedback loop. If this were the case one would expect the acute effect of FA to increase ER-export (or secretion) and the negative feedback will then reduce secretion. However, the acute effect of FA is not addressed in this manuscript. In order to postulate a feedback loop, the authors would need to test the individual nodes of this loop.

      Reply: The question appears to be whether an acute effect on FA would affect the expression of SEC23A and therefore ER transport. If by the acute effect the reviewer means a pharmacological manipulation, we have shown that upon treatment with the FAK inhibitor the expression of SEC23A increases (Fig 5A). Whether this increase in SEC23A expression translates into a corresponding increase in ER transport remains to be seen. This will be tested in our revised manuscript as mentioned above in reply to point # 1.

      Our data encouraged us to propose a hypothetical feedback loop that would connect the deposition of ECM through the expression of SEC23A. We will have more data to support (or reject) this idea once we do the transport experiments as mentioned above. However, we think that a full characterization of this hypothetical loop by testing individual nodes is beyond the scope of this manuscript

      Reviewer #1 (Significance (Required)):

      I think that the basic finding of this manuscript is highly novel, by showing the impact of the ECM and focal adhesions on COPII-dependent trafficking. I think that this will not only appeal to people from the trafficking community, but also to people working on cell migration and on mechanobiology. The work in its current form does not require much extra efforts (max. 3 month). However, if the authors would decide to increase the breadth of data, they would require 3-6 months.

      Reply: We thank reviewer #1 for the comments. We also believe that this story will appeal to a broader audience and would help to bridge the gap between membrane trafficking and mechanobiology communities.

      \*Referees cross-commenting***

      I went through the comments of the two other reviewers and agree with their verdict. Some extra work on the characterization of the early secretory pathway would be good. Both reviewers provided a nice catalogue of possible experiments to choose from.

      Reply: We have characterized the early secretory pathway in terms of ER exit sites, Beta-COP, and Golgi morphology (FIG. 2B-H and S1A-B). Together, these data strongly characterize the nature of ER-block. Moreover, the finding that our interactors affect the expression of SEC23A allows us to explain mechanistically why an ER transport block occurs. This is further strengthened by the rescue experiments (FIG. 3F). We believe that further characterization of the secretory pathway will not contribute substantially to the main message of this manuscript.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)):

      The manuscript by Jung et al which based on a targeted siRNA screen, demonstrates regulation of SEC23A (component of the SEC23 complex of the COP coat) levels at transcriptional level downstream of focal adhesion signaling. By regulating siRNA mediated downregulation, the authors were able to identify proteins which either increased or decreased traffic of VSVG through the secretory pathway when combined with downregulation in the levels of with either SEC23A or SEC23B. Authors have focused on a group of SEC23B functional interactors, downregulation of which shows them increased size of focal adhesions which also downregulate SEC23A levels, thus providing an explanation for reduced secretory traffic. Authors further show that plating cells on fibronectin or Matrigel, which activate Focal adhesion kinase signaling also results in downregulation of SEC23A transcript levels. The screen is conducted in a well-controlled manner for most parts with a clear explanation of the analysis routines and the data presentation if of very good quality. Most important results have been validated by more than one experimental strategy which lends substantial confidence to the findings. The results also open further avenues for understanding the transcriptional regulation in different physiological and disease contexts.

      There are certain issues, which the authors should address with regards to controls and some conflicting observations with published results with respect the phenotypes associated with downregulating proteins on focal adhesions size. Additionally, authors don't tie the ends by monitoring secretory traffic in cells grown on different matrices but include it in the model. Addressing/explaining these issues could improve this manuscript and the model may have to be tweaked a bit.

      \*Major comments:***

      1)I wonder why the authors only used siRNA control in their screen when the effects are scored in context of double knockdown fashion in combination with mild knockdown of SEC23A and SEC23B to get functional interactors. Control siRNA in combination with SEC23A and SEC23B should have been two ideal negative controls in the screen. Nevertheless, in data presented Figure 1E and whole of Figure 2, using control siRNA in combination with SEC23B siRNA would have been ideal control to show that the combination does not induce any trafficking defects which could impact the findings of the study. Hence, a few of the data presented from some of these figures should have sicontrol+SEC23B siRNA combination as a control.

      Reply: There seems to be a misunderstanding. In the screen, the negative controls are only used as a reference as the scoring is based on a 5X5 matrix centered on the siRNA of interest. This is done to overcome possible plate effects and to normalize data across different biological replicas. As seen in figure 1B, the negative controls (Control siRNA or Control siRNA + SEC23A siRNA or Control siRNA + SEC23B siRNA are very close to 0 (but not exactly 0) as they were not used in the normalization process. It is important to mention that all single knockdowns also contain our control siRNA to keep the same final siRNA concentration in single and double knockdowns. In Fig 1E we will include the images from Control + SEC23A siRNAs and Control + SEC23B siRNA as a reference. For Figure 2 all except 2A and 2H have the single knockdowns as controls.

      2)What is the identity of post-ER structures which authors refer to in Figure 2A? Could the images represent VSVG concentrated at ER exit sites? Authors should stain with markers for ERES to see if the VSVG puncta colocalize with it.

      Reply: We have done the experiment, and indeed these structures colocalize with an ER exit site marker (SEC31A). We intend to include this data into the revised manuscript. Our observations are in agreement with what is known in the literature about VSVG transport.

      3)Based on RNA sequencing results, authors chose to follow up on SEC23A levels in background of siRNA knockdown of components (like MACF1, ROCK1, FERMT2 etc.) which regulate Focal adhesions in cells and show that there is a reduction in both transcript and protein levels of SEC23A. In images shown in Figure 2B and Figure 2C, levels or SEC31A and β-Cop1 are reduced. Authors should test using qPCR and western blots whether there is a downregulation SEC31A, β-Cop1 and SEC23B in siRNA knockdowns of MACF1, ROCK1, FERMT2 etc. It would provide new insights if there were a co-regulation of secretory machinery to modulate the secretory traffic in response to Focal Adhesion based signaling.

      Reply: Our transcriptomics data (FIG 3C and Table 5) shows that SEC31A and COPB1 mRNAs are not altered upon any of the knockdowns. For SEC23B, we observed only a slight decrease in ROCK1 knockdown. This data suggests that a co-regulation of the secretory machinery might not be present. Instead, the curation of secretory pathway genes in our transcriptome data shows that SEC23A is the only commonly differentially expressed gene.

      4)Most major concern in this manuscript surrounds around results presented in Figure 4C. Authors show that in response to all the knockdowns, they see more focal adhesions as monitored by Vinculin staining and this along with the experiments with cells plated on Matrigel and Fibronectin arrive at the conclusion that increased Focal adhesion signaling downregulates SEC23A levels which presumably modulates secretory traffic. I am not an expert on Focal adhesions but based on my understanding of the literature on that topic, downregulation of ROCK1, FEMRT2 disrupts focal adhesions. (See: Theodosiou et. al., Elife, 2016 or Lock et. al., Plos One, 2012 for example). How do authors explain their results in siRNA knockdown of ROCK1 and FEMRT2 which leads to an increased size of focal adhesions which seems contradictory to the published results? To clarify these results authors should test phosphorylation of FAK in their siRNA backgrounds which is another read out of focal adhesion signaling.

      The experiments from cells grown on Fibronectin and Matrigel favor the argument which authors put forth, but authors may have to tweak the model a bit based on FAK phosphorylation and FAK signaling in context of above-mentioned knockdowns.

      Reply: Based on the images for vinculin staining, in our current manuscript we propose that changes in FAs occur upon knocking down our interactors. In our revised manuscript we will provide a more robust quantitative assessment of those changes (change in number, size, or intensity) as mentioned in our reply to Reviewer #1.

      As for the discrepancies in the relation of FA phenotype upon depletion of ROCK1 and FERMT2, we want to point out that this effect depends on the cell type used. For instance, the papers listed by the reviewer here use fibroblasts and keratinocytes respectively while we have used Hela Kyoto cells which are epithelial in nature. Another example is that while in fibroblasts depletion of FERMT2 leads to a rounded morphology and almost an absence of FAs (Theodosiou et. al., Elife, 2016), in podocytes (Qu et al JCS, 2011), it leads to fewer FAs but an increase in their size. Nonetheless, this is a very keen observation from the reviewer and we will address this point in our revised manuscript discussion.

      5)What happens to VSVG traffic or RUSH-Cadherin traffic when cells are plated on Matrigel and Fibronectin? Reduction in secretory traffic of these is an important experiment which is missing to close the loop and validate the model presented. Authors must test these experiments either with cells grown on matrix alone or in combination with siRNA to SEC23B. Authors should also monitor ERES and transport carriers in this background.

      Reply: We agree with the reviewer and intend to perform these experiments.

      6)This is not such a major issue, but it would be good to see a comparison in SEC23A levels in siRNA knockdown condition in comparison to those when cells are grown on different substrates and in ROCK1, FEMRT2 knockdowns (blots of which authors already have in this manuscript).

      Reply: We will assess the level of SEC23A at the protein level for cells plated on matrigel or Fibroblast-derived ECM.

      \*Minor comments:***

      1)Scale bars are missing in EM images in Figure 2H.

      Reply: We will add the scales in our EM images

      2)Show molecular weight markers in Western blots in main figure 3E and supplementary figure S1E.

      Reply: We will add molecular weight markers in our Western-Blots

      Reviewer #2 (Significance (Required)):

      I have looked at the manuscript from through the lens of a cell biologist as that is predominantly my area of expertise. In that respect I find the screen conducted by authors particularly interesting as they aim to connect how extracellular cues regulate the secretory pathway. A screen seems justified as there is no comprehensive understanding linking the two above-mentioned processes. Authors have done a functional interaction screen and analyzed a lot of images to identify candidates which either increase or decrease secretory traffic in combination with SEC23A and SEC23B. Such a functional screen has helped authors identify candidates which were otherwise missed in single siRNA knockdowns in their previous work from 2012. This definitely opens up interesting avenues to test the candidates identified in the screen in different physiological contexts and in disease as also the transcriptional program connecting Focal adhesion signaling with the regulation of components governing secretion. Such functional interaction screens could also be employed to identify crosstalk of different cellular processes with the regulation secretory pathway at ER as well as at the Golgi apparatus.

      Reply: We thank reviewer #2 for the comments. As we mentioned in our reply to reviewer #1, we strongly believe that these results will encourage further research at the crossroads of membrane trafficking and mechanobiology.

      \*Referees cross-commenting***

      I agree with the comments from both the referees that the manuscript is very interesting, most experiments are well controlled, but the quantification of focal adhesion phenotype in knockdowns need to be done in an extensive manner and secretion phenotypes need to measured upon plating cells on different matrix to validate the model presented.

      Reply: These two experiments will be included in our revision

      Reviewer #3 (Evidence, reproducibility and clarity (Required)):

      \*Summary***

      The authors use a synchronized cargo release assay following codepletion of either Sec23 paralog with cytoskeletal and associated proteins to identify potential functional interactions between COPII trafficking and the cytoskeleton. This screen yields a number of Sec23b functionally interacting molecules that stall cargo trafficking to various degrees within the secretory pathway upon codepletion, and in the case of MACF1 reduce ERES number despite not physically interacting. Depletion of the majority of the identified Sec23b functional interactors alone surprisingly caused the downregulation of Sec23a at the mRNA and protein levels, and cargo trafficking could be partially or fully rescued by Sec23a overexpression depending on the codepleted cytoskeletal factor. RNA-seq enrichment analysis and imaging of a focal adhesion marker suggest that genes involved in cell adhesion were differentially regulated following depletion of the cytoskeletal functional interactors. Finally, the authors show that Sec23a expression levels are reduced when cells are cultured on dishes with high amounts of ECM to induce focal adhesions, and that inhibition of focal adhesion kinase can rescue Sec23a expression levels.

      \*Major comments***

      #1 The authors successfully implicate a group of cytoskeletal proteins and their actions at focal adhesions in negatively regulating Sec23a expression levels and COPII trafficking. This description of a shared, novel mode of COPII transcriptional regulation by cytoskeletal factors is convincingly shown to be at least a contributor to the delayed trafficking in the presence of focal adhesions. In general, the data are reproducible and use appropriate statistical analysis. However, a more robust description of the architecture of early secretory pathway would be beneficial, especially in the case of MACF1 codepletion which cannot be fully rescued by Sec23a-YFP overexpression. In contrast, trafficking during codepletion of FERMT2 is fully rescued by Sec23a-YFP despite both MACF1 and FERMT2 showing similar loss of Sec23a mRNA levels upon codepletion. This data suggests that while the trafficking delay in FERMT2 codepletion might be exclusively due to reduced Sec23a expression levels, there are likely additional causes for the trafficking delay observed in MACF1 codepletion.

      Reply: We thank the reviewer for the appreciation of our results and the importance they might bear for the field. The reviewer has very neatly highlighted that each of our interactor hits might have roles in the secretory pathway beyond the ER or independent of the expression levels of SEC23A. This phenomenon could also explain the differential rescue of the arrival of VSVG at the plasma membrane upon SEC23A overexpression in FERMT2 and MACF1 knockdowns (FIG 3F). For instance, MACF1 has been involved in Golgi to Plasma Membrane transport as well (Kakinuma et al. Exp. Cell Res. 2004, Burgo et al. Dev. Cell 2012). So a possibility is that SEC23A overexpression rescues only ER to Golgi transport but the lack of rescue in the compartment between Golgi and plasma membrane independent of SEC23A expression levels would result in reduced rescue In the case of MACF1 compared to FERMT2. To support this, in our revised manuscript, we will provide example images from the experiment.

      Nonetheless, we agree that these are very important observations from Reviewer #3 and warrant a detailed discussion in the light of other interactors as well, which we intend to highlight in our revised manuscript.

      #2 While there is indeed a reduction in the number of ERESs following MACF1 codepletion, the authors report an even more dramatic reduction in 'transport intermediates / cell' as marked by COPI. However, as recent cyro-EM analysis of ERESs has definitively show, COPI exists stably at ERGIC membranes (1). Thus, an alternative possibility for the more dramatic reduction of COPI sites compared to Sec31a sites in Figures 2B-E is that ERGIC membranes are destabilized following MACF1 codepletion in a manner independent of Sec23a expression, and this destabilization compounds with reduced ERES number to ultimately delay trafficking. To more directly determine whether ERGIC membranes stability is regulated by MACF1, the authors should compare COPI and ERGIC-53 staining among MACF1 codepleted and FERMT2 codepleted cells with and without Sec23a-YFP overexpressed to levels that rescue cargo trafficking. If Sec23a-YFP restores the number of ERGIC puntae marked by these stains in FERMT2 but not MACF1 codepleted cells, it would suggest a role for MACF1 in forming or stabilizing ERGIC membranes which are known to associate with microtubules and WHAMM, an actin nucleator. Additionally, it would be useful to costain COPII with COPI or ERGIC-53 in control, MACF1 depleted, MACF1 codepleted, and MACF1 codepleted and Sec23a-YFP rescued cells to determine their colocalization. COPII and ERGIC membranes should be almost entirely coupled and juxtaposed in control cells and may be decoupled upon loss of MACF if plays a role in ERGIC membrane localization and stability. These proposed experiments are relevant because ERGIC membranes are sites of COPII cargo delivery and changes in ERGIC stability or localization would suggest an additional mechanism for cytoskeletal regulation of COPII trafficking. These immunofluorescence studies should be straightforward and completed in a few weeks.

      Reply: Although a possible additional role of MACF1 in the organisation of early secretory pathway, stability of ERES, etc., independent of the expression of SEC23A is interesting on its own, we believe that an extensive characterization of these possible roles/ pathways as proposed by the reviewer is beyond the scope this manuscript.

      #3 The choice to use VSVG and E-Cadherin for the synchronized release assays unfortunately convolutes interpreting the 'transport ratios' used by the authors to compare the effects of the various codepletions. Each protein progresses beyond the Golgi during secretion, and the authors choose to calculate the ratio of cargo intensity at the plasma membrane normalized to the total cellular cargo. This means that the synchronized release assays and calculated 'transport ratios' assay not only ER to Golgi trafficking, but also trafficking from the Golgi to the plasma membrane. In instances where Sec23a-YFP overexpression does not fully rescue the codepletion, it is possible that additional trafficking delays occur during Golgi to plasma membrane trafficking that cause the 'transport score' to decrease. Thus, the 'transport score' as the authors calculate it is needlessly nonspecific to COPII trafficking and should not be used to compare the codepletions for COPII functional interactors.

      Reply: We agree that the “transport score” used here and in our previous genome-wide screen (Simpson et. al Nat. Cell Biol. 2012) does not allow us to distinguish between the individual transport substeps in the transport of VSVG from the ER to the plasma membrane. However, as we see in Fig 1E, the proteins that we have decided to follow in more detail in this study do have a clear ER transport block phenotype (except for CRKL). So for 6 out of 7 of these proteins, the images clearly show that the decrease in the “transport score” is due to a decreased ER to Golgi transport.

      #4 To mitigate unwanted contributions of post-COPII trafficking events from altering 'transport scores,' the authors should use a cargo for synchronized release assays that does not progress past the Golgi such as α-Mannosidase II and quantify a ratio of the perinuclear cargo signal to whole cell signal. Ideally, the screen would be repeated with a more appropriate cargo generating new 'transport scores' for the full list of cytoskeletal proteins. However, this may not be feasible, and as such 'transport scores' based on a Golgi resident protein should at least be produced for the 7 Sec23b functional interactors featured in this manuscript. These Golgi 'transport scores' would add much needed quantification of ER to Golgi transport delays that currently can only be inferred from the representative images in Figure 1E, which unfortunately show significant heterogeneity among cells from the same image. The authors should also explicitly state that any 'transport score' from a synchronous release assay using a cargo destined for the plasma membrane will take into account trafficking rate changes due not only to COPII, but also COPI from the ERGIC to the Golgi, and transport carriers departing from the TGN. These synchronized release assays would likely take between a few weeks to a few months depending on their ability to automate image analysis.

      Reply: We consider that having a “Golgi transport score” won't add any new information as the proteins that we have chosen to follow are the ones that show a strong ER-block phenotype. However, we agree that such a “Golgi score” would indeed be useful if one would like to study other interactors, for instance, the ones that induce transport acceleration.

      Also, we don't expect all cells to behave similarly as the level of knockdown might be slightly different or because of the cell to cell variability. Even in control conditions (no knockdown), this heterogeneity is evident. As suggested by the reviewer, in our revised manuscript we will explicitly state that a change in the transport scores could mean a change in any sub-step of the transport from the ER to the PM in our assay.

      \*Minor comments***

      It would be useful for the authors to quantify the number of focal adhesions present from Vinculin stains from Figure 4C and 5C instead of just showing representative images. It would be interesting to determine if there is a meaningful relationship between focal adhesion number induced by the codepletions or tissue culture coating and Sec23a expression levels like in Figure 3D. Generally, the figures, text, and references were appropriate.

      Reply: As also pointed out by the other reviewers we will quantify the FA changes

      Reviewer #3 (Significance (Required)):

      In recent years, significant effort has been devoted to elucidating mechanisms by which COPII trafficking is modulated in response to cellular cues. These studies have revealed that changes in nutrient availability, growth factors, ER stress, autophagy, and T-cell activation all cause changes in COPII trafficking via unique gene expression, splicing, or post-translational control (2-7). This work elucidates a novel mechanism of transcriptional control driven by focal adhesions. Additionally, it provides a number of potentially useful Sec23a and Sec23b functional interactors among cytoskeletal factors for further study. These unexplored factors may have unique mechanism of COPII regulation that could contribute to our understanding ER export modulation. Altogether, this and similar works are building an increasingly complex set of regulatory pathways that when integrated ultimately dictate COPII trafficking kinetics.

      The reported findings are not only relevant to those who study COPII trafficking, but also other fields where secretion is studied in the context of the ECM. This work would suggest that secretion of factors involved in crosstalk between cells, including in tumors, is likely to be controlled by the interactions of cells with ECM.

      Reply: We thank reviewer #3 for the comments and insightful discussion about the limitations of our assay that we will highlight in the revised manuscript and in general for the insight into the early secretory pathway regulation. Furthermore their explicit summary of how our study could bridge COPII trafficking, ECM signaling and the relevance to various pathophysiologies is highly appreciated.

      Expertise keywords: cell biology, light microscopy, membrane trafficking

      References

      1.Weigel A V., Chang CL, Shtengel G, Xu CS, Hoffman DP, Freeman M, et al. ER-to-Golgi protein delivery through an interwoven, tubular network extending from ER. Cell. 2021 Apr;184(9):2412-2429.e16.

      2.Farhan, H., Wendeler, M. W., Mitrovic, S., Fava, E., Silberberg, Y., Sharan, R., Zerial, M., & Hauri, H. P. (2010). **MAPK signaling to the early secretory pathway revealed by kinase/phosphatase functional screening. Journal of Cell Biology, 189(6), 997-1011.

      3.Zacharogianni, M., Kondylis, V., Tang, Y., Farhan, H., Xanthakis, D., Fuchs, F., Boutros, M., & Rabouille, C. (2011). ERK7 is a negative regulator of protein secretion in response to amino-acid starvation by modulating Sec16 membrane association. **EMBO Journal, 30(18), 3684-3700.

      4.Lillmann, K.D., V. Reiterer, F. Baschieri, J. Hoffmann, V. Millarte, M.A. Hauser, A. Mazza, N. Atias, D.F. Legler, R. Sharan, et al 2015. **Regulation of Sec16 levels and dynamics links proliferation and secretion. J. Cell Sci. 128:670-682.

      5.Liu, L., Cai, J., Wang, H., Liang, X., Zhou, Q., Ding, C., Zhu, Y., Fu, T., Guo, Q., Xu, Z., Xiao, L., Liu, J., Yin, Y., Fang, L., Xue, B., Wang, Y., Meng, Z. X., He, A., Li, J. L., ... Gan, Z. (2019). Coupling of COPII vesicle trafficking to nutrient availability by the IRE1α-XBP1s axis. Proceedings of the National Academy of Sciences of the United States of America, 116(24), 11776-11785.

      6.Jeong, Y.-T., Simoneschi, D., Keegan, S., Melville, D., Adler, N. S., Saraf, A., Florens, L., Washburn, M. P., Cavasotto, C. N., Fenyö, D., Cuervo, A. M., Rossi, M., & Pagano, M. (2018). The ULK1-FBXW5-SEC23B nexus controls autophagy. ELife, 1-25.

      7.Wilhelmi, I., Kanski, R., Neumann, A., Herdt, O., Hoff, F., Jacob, R., Preußner, M., & Heyd, F. (2016). Sec16 alternative splicing dynamically controls COPII transport efficiency. Nature Communications, 7, 12347. https://doi.org/10.1038/ncomms12347

      3. Description of the revisions that have already been incorporated in the transferred manuscript

      4. Description of analyses that authors prefer not to carry out

      Reviewer #3 suggested to robustly characterise the early secretory pathway, in response to the depletion of our interactors, for instance, the role of MACF1 in the organization and the stability of ERES. This view is also supported by reviewer #1. However, in our revised manuscript we would like to focus more on the novel aspect of our study (as highlighted by all the reviewers), namely how ECM signaling and changes in FAs affect SEC23A and possibly ER transport. For this, we would like to present a more quantitative outlook of the FA phenotype and concentrate on the transport experiments. The reason for not dwelling into a more extensive characterization of the early secretory pathway is that these experiments are very interesting on their own, and merit a separate study that would deconvolve in detail the individual trafficking steps, and their relation to SEC23A expression, ERES stability, and ECM signaling.

      Reviewer #2 suggested that to better characterize the FA phenotype and solve the apparent discrepancies between our data and the literature, we could test FAK phosphorylation. As we mentioned in our reply to this point, we think that most of the discrepancies arise from the different cell types used. Nevertheless, we agree that a quantitative approach is needed for a better characterisation of FA phenotype, therefore we intend to perform quantification of the vinculin stainings.

    1. Author Response:

      Reviewer #1:

      In this manuscript titled "The LRRK2 G2019S mutation alters astrocyte-to-neuron communication via extracellular vesicles and induces neuron atrophy in a human iPSC-derived model of Parkinson's disease", Jacquet and colleagues investigated the role of Parkinsonism gene mutation LRRK2 G2019S in hiPSC-differentiated astrocytes. By isolating extracellular vesicles from ACM and examining astrocytes with various electron microscopy techniques, the authors found that LRRK2 G2019S affects the morphology and distribution of MVBs and the morphology of secreted EVs in hiPSC-differentiated astrocytes. Furthermore, the authors observed that astrocyte-derived EVs can be internalized by dopaminergic neurons and such EVs support neuronal survival. However, LRRK2 G2019S EVs lost the ability of promoting neuronal survival. This is an interesting study showing a non-cell autonomous contribution to dopaminergic neuron loss in PD.

      The proposed idea of how LRRK2 G2019S dysregulates EV-mediated astrocyte-to-neuron communication is novel and exciting. However, the authors present some conflicting data that is not addressed during the discussion: they first conclude upregulated exosome biogenesis by RNAseq in G2019S vs WT astrocytes, but later show a decrease in the number of <120nm particles in G2019S mutants suggesting a decrease in the classical exosome-sized vesicle secreted compared to WT. Lastly, their MVB images show less CD63 gold particles in G2019S compared to WT control (though this was not quantified). Do the authors suggest and increase or decrease in exosome biogenesis in G2019S mutants? How do they reconcile these seemingly contradicting data? Several experiments, controls and additional analyses are needed to fully demonstrate the validity of the proposed mechanism.

      The RNA-sequencing data of LRRK2 G2019S astrocytes showed an enrichment in genes associated with the “extracellular exosome” gene ontology term but not with the MVB/EV trafficking or secretion pathways. While we found CD82 and Rab27b to be upregulated, the classical biogenesis markers of MVB/EV trafficking and secretion (e.g. VTA1, VPS4, ALIX) were not dysregulated. Instead, the gene list shows an overwhelming dysregulation of genes coding for EV-enclosed proteins which do not have known roles in MVB/EV biogenesis or function (we now discuss this point in the main text, see highlights in italics below). As a result, we do not believe that exosome biogenesis is upregulated but instead propose the working hypothesis that the EV pathway may contribute to LRRK2 G2019S astrocyte dysfunction. To complement the sequencing data, our study provides a characterization of this pathway by (i) describing the cellular distribution of CD63+ structures in astrocytes, (ii) measuring the size of secreted EVs, and (iii) analyzing the neurotrophic potential of control and LRRK2 G2019S astrocyte-secreted EVs. We have not characterized the cellular biology of exosome/EV biogenesis in depth, and we do not propose a mechanism by which the LRRK2 G2019S mutation dysregulates these pathways. These questions are beyond the scope of our study, which is focused on the role of astrocytes in neurodegeneration.

      The reviewer also referred to the CD63 immunogold staining used in Figures 4C and 6A to localize MVBs. After careful quantification of the number of CD63 gold particles in WT and LRRK2 G2019S MVBs, we conclude that there are no differences between the two genotypes and we apologize for selecting non-representative images. We have now replaced these with representative images. Regarding the shift in the size of WT vs. LRRK2 G2019S vesicles, we complemented our cryo-EM analysis with new data generated using Nanoparticle Tracking Analysis (NTA) (Figure 3C,D). The NTA analysis enabled the quantification of a greater number of particles, and we found that both WT and LRRK2 G2019S astrocytes secrete a significant number of particles in the 0-120 nm range. The cryo-EM data suggested that mutant astrocytes secreted fewer particles in this size range, but this is not observed in the NTA analysis. This discrepancy could be explained by the following: (i) in contrast to cryo-EM, NTA does not distinguish EVs from cell debris, which could bias the quantification and increase the number of small particles quantified (Noble et al., 2020), and (ii) studies showed that the size distributions between NTA and cryo-EM differ, the latter enabling the identification of larger particles (Noble et al., 2020). These two techniques are therefore complementary in the study of secreted EV and our manuscript now presents data generated using these two approaches (Figure 3C-G) (see italicised text below).

      Results

      Expression of exosome components in iPSC-derived astrocytes is altered by the LRRK2 G2019S mutation Gene ontology (GO) analysis revealed that components of the extracellular compartment are up-regulated in LRRK2 G2019S astrocytes – these include GO terms corresponding to the extracellular region, extracellular matrix and extracellular exosomes (Figure 1D,F). The exosome component is one of the most significantly up-regulated GO terms in both isogenic and non-isogenic astrocytes, and is comprised of a total of 67 (isogenic pair) or 95 (non isogenic pair) genes (Supplementary Tables 1 and 2). The large majority (~ 98 %) of these gene products are described to be enclosed in exosomes (e.g. CBR1) but do not perform specific functions related to EV formation or secretion. Only a few genes are associated with exosome biogenesis (e.g. CD82) and trafficking (e.g. Rab27b) (Andreu & Yanez-Mo, 2014; Chiasserini et al., 2014; Ostrowski et al., 2010) and we did not detect differences in the expression of canonical factors that regulate MVB formation (e.g. VTA1, VPS4 or ALIX).

      Profiling WT and LRRK2 G2019S EVs secreted by iPSC-derived astrocytes

      The astrocyte-derived EV pellet is enriched in exosomes, as demonstrated by the expression of 8 exosomal markers and the absence of cellular contamination (Supplementary Figure 3D). NTA quantification showed that the number of secreted EVs does not differ between LRRK2 G2019S and isogenic control (Figure 3C), and it appears that LRRK2 G2019S particles have a slightly different size distribution compared to WT particles (Figure 3D). It should be noted that TEM and NTA are methods traditionally used to estimate the size distribution of EVs, but their accuracy is often challenged by sample processing artifacts and technical biases (Pegtel & Gould, 2019). To overcome these limitations, we complemented the NTA results with cryo-EM analysis of the size of EVs secreted by WT and LRRK2 G2019S isogenic astrocytes. EVs mostly displayed a circular morphology (as opposed to the cup-shaped morphology observed by TEM) (Figure 3E), but a variety of other shapes were also observed (Supplementary Figure 3E). Cryo-EM analysis confirmed that WT astrocyte-secreted EVs display a large range of sizes, from 80 nm to greater than 600 nm in diameter, with differences between WT and mutant populations (Figure 3F). The cryo-EM data suggested that mutant astrocytes secreted fewer particles in the 0-120 nm size range, and the discrepancy with the NTA results could be explained by the following: (i) in contrast to cryo-EM, NTA does not discriminate EVs from cell debris, which could bias the quantification and increase the number of small particles quantified (Noble et al., 2020), and (ii) studies showed that the size distributions between NTA and cryo EM differ, the latter enabling the identification of larger particles (Noble et al., 2020). However, cryo-EM is a low throughput methodology that limits data collection to a small sample size and has therefore a lower statistical power than NTA. Quantification of the number of simple vs. multiple EV structures did not reveal differences between the two lines, and represent up to 16% of the EV population (Figure 3G). We then sought to complement our EV profiling experiments with an analysis of secreted CD63+ particles, which form one of the known exosomal sub-populations. We previously showed that WT and LRRK2 G2019S MVBs contain similar levels of the CD63 tetraspanin (Figure 2E, Supplementary Figure 3A,B), and an ELISAbased quantification confirmed that the number of CD63+EVs remained unchanged between the two genotypes (Supplementary Figure 3F). We conclude from these results that the total number and morphology of EVs produced by WT and LRRK2 G2019S astrocytes are similar, but mutant EVs may have a different size distribution compared to WT vesicles.

      Major concerns:

      1) In figure 1 A authors demonstrate iPSC-derived astrocytes characterization. Since there is no one unified and validated method for astrocytes differentiation, there is a need for more accurate characterization of iPSC-derived astrocytes. Authors should demonstrate the percentage of cells positive to astrocytic markers and to prove that obtained astrocytes are functional (able to promote synaptogenesis and uptake glutamate). I would also recommend analyzing the iPSC-derived astrocyte cultures for expression of more specific astrocytic markers as GLT1, SOX9 in addition to those which have been analyzed. Moreover, it is highly important to know what is the proportion of astrocytes derived from LRRK2 G2019S line and its isogenic control in order to be able to compare their effect on neurons.

      We thank the reviewer for these suggestions. It is true that there exist many different astrocyte differentiation protocols, and this study uses a protocol developed by TCW et al. that has been further optimized by our lab to derive astrocytes from a midbrain-patterned population of neural progenitor cells (NPCs) (de Rus Jacquet, 2019; Tcw et al., 2017). The protocol is published, and shows that these astrocytes are functional – they respond to inflammatory factors and alter secretion of the IL-6 cytokine. Furthermore, Supplementary Figure 2D shows a whole transcriptome analysis (by RNA-seq) of the cell populations produced for this study and demonstrates that iPSC-derived astrocytes cluster with human primary midbrain astrocytes and away from iPSCs or NPCs in an unsupervised cluster analysis. However, we agree that in-depth characterization of iPSC-derived astrocytes is essential, and the updated manuscript now shows that (i) the astrocyte differentiation protocol yields 100 % GFAP+ cells with both WT and mutant lines (Supplementary Figure 2B), (ii) expression of six astrocyte markers (GLT1, SOX9, APOE, BHLHE41, CD44, GLUD1) (Supplementary Figure 2Aii, B), as well as (iii) transient intracellular calcium signaling (Supplementary Figure 2E), and (iv) synaptosome uptake (Supplementary Figure 2F) in both WT and LRRK2 G2019S astrocytes. We also updated the text as follows (italicised):

      Results section

      Midbrain-patterned NPCs carrying the LRRK2 G2019S mutation or its isogenic control were differentiated into astrocytes as described previously (de Rus Jacquet, 2019; Tcw et al., 2017). As expected, astrocytes expressed the markers GFAP, vimentin, and CD44 as demonstrated by immunofluorescence (Figure 1A) and flow cytometry analyses (Supplementary Figure 2A). Differentiation was equally effective in WT and LRRK2 G2019S cells, with 100 % of the differentiated astrocytes expressing GFAP (Supplementary Figure 2Bi). To further demonstrate the successful differentiation of iPSCs into astrocytes, we analyzed gene expression using RNA-sequencing analysis (RNA-seq), including primary human midbrain astrocyte samples in the RNA-seq study to serve as a positive control for human astrocyte identity. iPSC-derived and human midbrain astrocytes expressed similar levels of genes markers of astrocyte identity, including SOX9 and GLUT1 (Supplementary Figure 2B). In addition, principal component and unsupervised cluster analyses separated undifferentiated iPSCs, iPSC-derived NPCs and iPSC-derived astrocytes into independent clusters, demonstrating that our differentiation strategy produces distinct cell types (Supplementary Figure 2C-D). Importantly, the transcriptome of iPSC-derived astrocytes showed more similarities to fetal human midbrain astrocytes than to NPCs or iPSCs, further validating their astrocyte identity (Supplementary Figure 2D). Lastly, control and LRRK2 G2019S astrocytes showed classic astrocytic functional phenotypes such as spontaneeous and transient calcium signaling and synaptosome uptake (Supplementary Figure 2E-F).

      2) In Figure 1, the authors found a significant upregulation of exosome components in astrocytes, demonstrating an important role of LRRK2 G2019S in EV signaling pathway. In the discussion, the authors briefly mentioned 'sub-populations of CD63- EVs may be differentially secreted in mutant astrocytes'. Since the authors have obtained the RNA-seq data, it would be nice to dig deep into the data and comment on potential EV sub-populations which can be differentially secreted. This information can be very beneficial for follow-up studies in the PD and LRRK2 field. Furthermore, the authors should assess the expression of Rab27a and CD82 in WT and LRRK2 G2019S astrocytes by western blots to verify RT-qPCR data. Furthermore, the authors should present specifically exosome biogenesis or secretion genes are altered to provide further insight into the stage of exosome biogenesis that is affected (ESCRT0-3, VPS4, ALIX, etc).

      In the first comment, the reviewer refers to the observation that the number of total and CD63-positive EVs secreted by astrocytes is unchanged between the WT and LRRK2 G2019S genotypes. The classification of different EV sub-populations based on marker proteins is an evolving field of research, and an important study by Kowal et al. defined generic and sub population-specific EV markers (Kowal et al., 2016). Our RNA-seq dataset revealed five upregulated genes identified in the Kowal study, namely actin, GAPDH, actinin, complement and fibronectin, but unfortunately there is no clear pattern correlated with specific EV sub populations. For example, actin and GAPDH are two upregulated proteins that can be found in multiple types of EVs, actinin is enriched in large and medium-sized EVs, and complement and fibronectin are enriched in high density but small EVs (Kowal et al., 2016). The majority of dysregulated genes identified in our sequencing experiment are not proteins classically used to categorize EVs, so unfortunately our data does not allow us to address the reviewer’s question. To make sure that the data is readily accessible to the scientific community, we have prepared a supplementary table with a list of extracellular exosome-related genes identified in the RNA sequencing study. To respond to the reviewer’s comment on a specific stage of EV biogenesis/secretion altered in LRRK2 G2019S, the sequencing data presented in this manuscript does not allow to conclude that there is such a dysregulation. Our gene list corresponding to the “extracellular exosome” gene ontology term contains a large majority of genes coding for proteins enclosed within EVs that do not play a role in biogenesis/secretion. For example, the gene list does not contain ESCRT0-3, VPS4, ALIX or other classical markers involved in EV biogenesis and we cannot conclude anything about the alteration of MVB/EV biogenesis or defects in specific stages of MVB trafficking or EV secretion. In addition, we thank the reviewer for suggesting the validation of RT-qPCR data by western blot. The purpose of the RT-qPCR experiment was to validate the gene expression data collected by RNA-seq. Given that our objective was to confirm gene expression levels, and that we do not further study CD82 and Rab27b, we think that collecting protein expression levels is not necessary in the context of this study.

      We agree with the reviewer’s suggestion, and we added images showing the subcellular localization of CD63 in both WT and LRRK2 G2019S MVBs by immunogold staining (Figure 2E). Validation experiments available in Figure 1A and Supplementary Figure 2A and 2B confirm that our astrocytes express CD44 as well as markers of mature astrocytes (BHLHE41, SOX9, GLUT1, APOE, GLUD1). The reason for showing CD44 instead of a more mature marker such as GFAP in Figure 2 of the manuscript is because CD44 is a membrane marker, and it therefore enables a clear visualization of the astrocyte surface area. We also note that, as shown in Supplementary Figure 2Aii, iPSC-derived and human fetal astrocytes express CD44, but iPSCs and NPCs do not significantly express this marker gene. In addition, as suggested by the reviewer, we added information related to MVB maturation in the introduction and the new text reads as follows (changes in italics):

      Introduction section The sorting and loading of exosome cargo is an active and regulated process (Temoche-Diaz et al., 2019), and the regulatory factors involved in EV/exosome biogenesis are just beginning to be identified. Among the well-known factors, Rab proteins are essential mediators of MVB trafficking and they regulate endosomal MVB formation/maturation as well as microvesicle budding directly from the plasma membrane (Pegtel & Gould, 2019; T. Wang et al., 2014). In addition, membrane remodeling is an essential aspect of MVB/EV formation that appears to be regulated, at least in part, by the endosomal sorting complex required for transport (ESCRT) machinery (Pegtel & Gould, 2019; Schoneberg, Lee, Iwasa, & Hurley, 2017).

      3) In Figure 2A and B, data shows that both WT and LRRK2 G2019S astrocytes produce MVBs and MVBs in LRRK2 G2019S astrocytes is smaller than in WT astrocytes. In Figure 2E, the authors showed the abundance of CD63 localized within MVBs in WT astrocytes but did not show the CD63 localization in MVBs in G2019S astrocytes. However, it is important to show CD63 localization in MVBs in G2019S astrocytes to fully support the conclusion that CE63+ MVBs are present in LRRK2 G2019S astrocytes. In addition, CD44 is a marker for astrocyte-restricted precursor cells. Although CD44+ positive cells are committed to give rise to astrocytes, it is crucial to include another astrocyte marker to ensure these cells are indeed mature astrocytes. -Related, authors should consider citing some of the MVB maturation literature to guide the readers.

      We agree with the reviewer’s suggestion, and we added images showing the subcellular localization of CD63 in both WT and LRRK2 G2019S MVBs by immunogold staining (Figure 2E). Validation experiments available in Figure 1A and Supplementary Figure 2A and 2B confirm that our astrocytes express CD44 as well as markers of mature astrocytes (BHLHE41, SOX9, GLUT1, APOE, GLUD1). The reason for showing CD44 instead of a more mature marker such as GFAP in Figure 2 of the manuscript is because CD44 is a membrane marker, and it therefore enables a clear visualization of the astrocyte surface area. We also note that, as shown in Supplementary Figure 2Aii, iPSC-derived and human fetal astrocytes express CD44, but iPSCs and NPCs do not significantly express this marker gene. In addition, as suggested by the reviewer, we added information related to MVB maturation in the introduction and the new text reads as follows (changes in italics):

      Introduction section

      The sorting and loading of exosome cargo is an active and regulated process (Temoche-Diaz et al., 2019), and the regulatory factors involved in EV/exosome biogenesis are just beginning to be identified. Among the well-known factors, Rab proteins are essential mediators of MVB trafficking and they regulate endosomal MVB formation/maturation as well as microvesicle budding directly from the plasma membrane (Pegtel & Gould, 2019; T. Wang et al., 2014). In addition, membrane remodeling is an essential aspect of MVB/EV formation that appears to be regulated, at least in part, by the endosomal sorting complex required for transport (ESCRT) machinery (Pegtel & Gould, 2019; Schoneberg, Lee, Iwasa, & Hurley, 2017).

      4) In Figure 3, it is impressive that the authors are able to image EVs using cyro-EM approach and analyze their sizes. The authors also observed different shapes of EVs. Is there any shape difference between WT EVs and G2019S EVs? Is there a way that the authors could categorize these shapes and do a detailed analysis in EV shapes? Also, In Figure 3D, both WT EV and G2019S EV images should present side by side for comparison. -Related, the size frequencies of EVs presented suggest a difference in the types of EV's released. Interestingly, exosomes are classically known to range from ~50-120nm and this population is significantly decreased in G2019S compared to WT. What does this suggest?

      As suggested by the reviewer, we classified the two main EV shapes as “simple” and “multiple” EVs, and found no quantitative differences between WT and LRRK2 G2019S. This new data and side-by-side images of WT and LRRK2 G2019S EV images are available in Figure 3E-G, and the text has been updated accordingly (see text in italics below). One of the observations of Figure 3 is that there exist genotype-specific differences in the size distribution of EVs, which suggests that different classes of vesicles may be preferably produced by WT vs. LRRK2 G2019S astrocytes. This could be the result of differences in dynamics related to cargo loading, or a shift from MVB-released exosomes to membrane budding and microvesicle production. These observations are of great interest and we added a short discussion (in italics below) but they are beyond the scope of this study focused on EV neurotrophic properties, and we do not currently have evidence to support these hypotheses.

      Results - LRRK2 G2019S affects the size of EVs secreted by iPSC-derived astrocytes

      EVs mostly displayed a circular morphology (as opposed to the cup-shaped morphology observed by TEM) (Figure 3E), but a variety of other shapes were also observed (Supplementary Figure 3C). (…) Quantification of the number of simple vs. multiple EV structures did not differ between the two lines, and represent up to 16 % of the EV population (Figure 3G).

      Discussion – Dysregulation of iPSC-derived astrocyte-mediated EV biogenesis in Parkinson’s disease

      The observation that LRRK2 G2019S MVBs are less frequently located in the perinuclear area suggests that they may spend less time loading cargo at the Trans-Golgi network, which could in turn produce smaller MVBs and EVs with a different size range compared to WT (Edgar, Eden, & Futter, 2014; Pegtel & Gould, 2019). We did not observe a difference in the number of secreted EVs (total and CD63+ subpopulation) between WT and LRRK2 G2019S astrocytes (Figure 3C,H), suggesting that the secretion of at least one population of EVs is independent of the astrocyte genotype.

      5) In figure 3c, SBI ELISA claims to quantify CD63+ vesicles, the authors should present more standardized particle quantification data (either by CD63 FACs for isolated EVs in WT vs G2019S or ZetaView/QNano particle tracking). The authors should also directly quantify the total number of EVs secreted in WT vs G2019S conditions (not only CD63+).

      The updated manuscript now contains the NTA analysis of WT and LRRK2 G2019S EVs (Figure 3C,D) which provides the total number of EVs secreted by WT and LRRK2 G2019S astrocytes.

      6) In Figure 4, the authors quantify LRRK2+/CD63+ particles by imaging. Importantly, it appears that there are less CD63 "large gold" particles in MVB of G2019S compared to control. This CD63 baseline quantification in MVB of WT vs. G2019S should be presented in this figure. These data are not convincing and should be quantified by FACS in secreted EV. Supplementary figure 3 should be brought into this figure.

      As suggested by the reviewer, we quantified the number of CD63 large gold particles per MVB in WT and LRRK2 G2019S lines (Supplementary Figure 3A,B), and we re-introduced Supplementary Figure 3 into the main text (Figure 4E). We also updated the text (see in italics below). Additionally, we present extensive quantification of LRRK2 levels in MVBs and secreted EVs via imaging and biochemical analysis (ELISA), two different but complementary analytical methods.

      Results - LRRK2 G2019S affects the size of MVBs in iPSC-derived astrocytes

      Tetraspanins are transmembrane proteins, and the tetraspanin CD63 is enriched in exosomes and widely used as an exosomal marker (Escola et al., 1998; Men et al., 2019). However, cell type specificities in the expression of exosomal markers such as CD63 have been documented (Jorgensen et al., 2013; Yoshioka et al., 2013). We therefore confirmed the presence of CD63- positive MVBs in iPSC-derived isogenic astrocytes by immunofluorescence (Figure 2D) and immunogold electron microscopy (IEM) (Figure 2E). Analysis of IEM images showed an abundance and similar levels of CD63 localized within MVBs in WT and LRRK2 G2019S astrocytes (Figure 2E, Supplementary Figure 3A,B), confirming that CD63 can be used as a marker of MVBs and exosomes in iPSC-derived astrocytes.

      7) In Figure 5, using CD63 as a MVB marker is not the most accurate approach. ESCRT markers should be co-stained with these experiments to truly show MVB localization (CD63 can localize to MVBs but is known to have a wider distribution throughout the cell compared to TSG1010 or other ESCRT complex proteins). Additionally, the authors must show their Supplemental Figure 3 ELISA quantification of p-aSyn in this main figure, and comment on why they conclude higher p-aSyn content in MVBs based on their IEM but then find no differences in aSyn in secreted EVs in WT vs. G2019S by ELISA.

      We thank the reviewer for the suggestion to use ESCRT proteins as MVB markers. We decided to use CD63 because it is recognized in the literature as an MVB and EV marker (Beatty, 2008; Edgar et al., 2014), and we now refer to these two studies in the manuscript to support this choice (see text in italics below). Using ESCRT complex proteins as MVB markers is an interesting alternative, but we note that proteins associated with this complex are also found to regulate other biological processes such as autophagy (Takahashi et al., 2018) and plasma membrane repair (Jimenez et al., 2014), and so they can co-localize to non-MVB structures (e.g. autophagosomes or plasma membrane). Similarly, TSG101 can also localize to non-MVB structures such as the nucleus and Golgi complex (Xie, Li, & Cohen, 1998), and also lipid droplet (LD) membranes where it promotes LD-mitochondria contact (J. Wang et al., 2021). As suggested by the reviewer, Supplemental Figure 3 has been re-introduced into the main text (Figure 6C). Regarding αSyn, the immunogold staining specifically detects the phosphorylated form of αSyn (p-αSyn), while the ELISA detects all forms of αSyn (total αSyn). We observed increased p-αSyn in LRRK2 G2019S MVBs, but similar levels of total αSyn in WT vs LRRK2 G2019S EVs. This observation suggests that the phosphorylated form of αSyn, but not the total amount of αSyn, is affected by the experimental conditions. The text has been updated and reads as follows (changes in italics).

      Results - LRRK2 is associated with MVBs and EVs in iPSC-derived astrocytes

      In light of our observations that mutations in LRRK2 result in altered astrocytic MVB and EV phenotypes, we asked if LRRK2 is directly associated with MVBs in astrocytes and if this association is altered by the LRRK2 G2019S mutation. We analyzed and quantified the co localization of LRRK2 with CD63 (Figure 4A), a marker for MVBs (Beatty, 2008; Edgar et al., 2014), and found that the proportion of LRRK2+ /CD63+ structures remains unchanged between WT and LRRK2 G2019S isogenic astrocytes (Figure 4B).

      Results - The LRRK2 G2019S mutation increases the amount of phosphorylated alpha synuclein (Ser129) in MVBs

      Since the MVB/EV secretion pathway is altered in our LRRK2 G2019S model of PD, we reasoned that mutant astrocytes might produce αSyn-enriched EVs by accumulating the protein in its native or phosphorylated form in MVBs or EVs. IEM analysis revealed an abundance of p-αSyn (small gold) inside and in the vicinity of MVBs of LRRK2 G2019S iPSC-derived astrocytes, but not isogenic control astrocytes (Figure 6A). We observed that 55 % of the CD63+ (large gold) MVBs in LRRK2 G2019S astrocytes are also p-αSyn+ (small gold), compared to only 16 % in WT MVBs. LRRK2 G2019S astrocytes contained on average 1.3 p-αSyn small gold particles per MVB compared to only 0.16 small gold particles in isogenic control astrocytes, and MVB populations containing more than 3 p-αSyn small gold particles were only observed in LRRK2 G2019S astrocytes (Figure 6B). When we analyzed the content of EVs by ELISA, we found that total αSyn levels (phosphorylated and non-phosphorylated) in EV-enriched fractions are similar between isogenic controls and LRRK2 G2019S (Figure 6C). These results suggest that astrocytes secrete αSyn-containing EVs, and the LRRK2 G2019S mutation appears to alter the ratio of p-αSyn/total αSyn in MVB-related astrocyte secretory pathways.

      8) In figure 6, it is even more clear that there is a stark difference between the CD63 presence in/near MVBs between WT and G2019S conditions. Since the authors normalize several pieces of data to CD63 (MVB localization, LRRK2 co-localization, etc), it is critical to quantify the number of baseline CD63 gold particles in MVBs in WT vs G2019S.

      After careful quantification of the number of CD63 gold particles in WT and LRRK2 G2019S MVBs (available in Supplementary Figure 3A,B), we conclude that there are no significant differences between the two genotypes, and the MVB images initially selected in Figure 6 are not representative. We therefore replaced Figure 6A with new images.

      9) In Figure 7, the authors used the co-culture of astrocytes and neurons to assess astrocyte-derived EV uptake by dopaminergic neurons. Although 3D reconstitution of neurons and exosomes can be precise, the data may not be 100% clean. It would be better if the authors collect ACM containing EV fraction from WT astrocyte and G2019S astrocytes and then incubate dopaminergic neurons with ACM containing EV fraction. In this way, only dopaminergic neurons are in the culture and there will be no CD63-GFP expressed astrocytes to contaminate the CD63-GFP signal in neurons.

      We understand the concerns raised by the reviewer, and we can ensure that state-of-the-art imaging technologies and image post-processing techniques have been used to prevent astrocytic CD63 signal from contaminating the neuronal signal. We performed confocal microscopy with a 63X oil objective lens (numerical aperture = 1.4), and the images were processed with a Gaussian Filter (0.18 μm filter width) to reduce background noise in the MAP2 channel, and deconvolved (10 iteration) to enhance confocal image resolution in the CD63 channel. Furthermore, CD63-positive structures were detected with background subtraction enabled.

      10) In Figure 9, the authors must show their ACM control. They show untreated, EV-free, and EV-rich ACM, but do not show unmanipulated ACM control.

      The results of dendrite length analysis for unmanipulated ACM was initially available in Figures 8E and 8F. For clarity, we prepared a new Figure 9 that shows treatment with unmanipulated ACM, EV-free ACM, and EV-enriched fractions.

      Reviewer #2:

      In this manuscript by de Rus Jacquet et al., authors present an interesting study to detect changes in extracellular vesicles in human PD patient derived iPSC-derived astrocytes carrying the LRRK2 G2019S mutation. Isogenic gene corrected iPSCs were used as controls in all experiments. Authors first performed RNA-Seq for global gene expression changes between G2019S and "WT" gene corrected astrocytes. GO analysis showed an upregulation of extracellular compartments (including exosome compartments) in LRRK2 astrocytes. Subsequent experiments focusing on extracellular vesicles (EVs) and multivesicular bodies (MVBs), showed specific differences of MVB area and the size of secreted EVs. Secreted EVs from G2019S astrocytes also contained more LRRK2 particles and G2019S EVs contained more phosphorylated aSyn particles. Co-culture of LRRK2 astrocytes with human dopamine neurons showed accumulation of CD63+ exosomes in neurites, compared to co-culture with WT astrocytes. Co-culture with LRRK2 astrocytes decreased viability of TH+ neurons and LRRK2 dendrites/neurites were also shorter. These co-culture findings were replicated using EV-enriched conditioned media. Finally, authors showed that the trophic effect of astrocytes on neurons was due both to soluble factors released into the media, and production and release of EVs. Overall, this is a well-written and systematically performed study. This reviewer has several comments as detailed below.

      1) Based on their data, authors conclude that astrocyte-to-neuron signaling and trophic support mediated by EVs is disrupted in LRRK2 G2019S astrocytes. Have authors measured the differences in trophic factors released by LRRK2 astrocytes in EVs and in conditioned media?

      This is an important question, and we have not measured the levels of various neurotrophic factors in the medium. We concluded that LRRK2 G2019S astrocytes failed to secrete neurotrophic factors based on the neuron viability data. Healthy neurons cultured with disease astrocytes displayed dendrite shortening equivalent to that of neurons cultured in basal medium lacking neurotrophic factors. Furthermore, the morphological alterations occurred over a long period of time (2 weeks) and did not recapitulate the rapid and high level of neuron death and neurite fragmentation typically observed as a result of exposure to neurotoxins (Liddelow et al., 2017). However, we performed a new analysis of our RNA-seq data and identified dysregulated trophic processes of interest in LRRK2 G2019S astrocytes.

      2) Authors differentiate cells (astrocytes and neurons) from midbrain lineage NPCs. The data show convincing effects of the LRRK2 derived astrocytes on neurons, but one question is whether this is specific to dopaminergic cells. Would this genotype specific effect also be expected in other lineages, e.g. cortical neurons? Authors should discuss this point.

      The reviewer is making an excellent point. We prepared mouse primary midbrain cultures, and co-cultured WT midbrain neurons with WT or LRRK2 G2019S astrocytes. We found that the survival of WT midbrain dopaminergic neurons was significantly affected by LRRK2 G2019S astrocytes, but the viability of non-dopaminergic midbrain neurons was not changed when co cultured with WT or disease astrocytes. A previous study by di Domenico et al. also showed that dopaminergic neurons are more sensitive to the effect of LRRK2 G2019S astrocytes compared to non-dopaminergic cell types (di Domenico et al., 2019).

      3) Prior work has demonstrated reductions in neurite length in neurons derived from LRRK2 G2019S iPSCs (not specific to dopaminergic neurons in LRRK2 cells) (for example Reinhard et al 2013). It is curious that the LRRK2 G2019S mutation itself can cause such a phenotype in neurons mono-cultures, and as shown in the current study, that LRRK2 G2019S astrocytes also induce a similar effect on WT neurons in co-culture. Can authors expand on this point in the Discussion?

      We thank the reviewer for this question, and we added a new point of discussion in our manuscript, which reads as follows (changes in italics):

      Evidence from this study and previous reports indicates that the LRRK2 G2019S mutation affects neurons through a variety of mechanisms. Here, we show a non-cell autonomous effect on neuronal viability via impairment of essential astrocyte-to-neuron trophic signaling, but the LRRK2 G2019S mutation can also mediate cell-autonomous dopaminergic neurodegeneration (Reinhardt et al., 2013). These observations support the idea that the LRRK2 kinase may be involved in a large number of pathways essential to maintain cellular function, cell-cell communication and brain homeostasis, and disruption of LRRK2 in one cell type has cascading effects on other neighboring cell types. In conclusion, our study suggests a novel effect of the PD-related mutation LRRK2 G2019S in astrocytes, and in their ability to support dopaminergic neurons. This study supports a model of astrocyte-to-neuron signaling and trophic support mediated by EVs, and dysregulation of this pathway contributes to LRRK2 G2019S astrocyte mediated dopaminergic neuron atrophy.

      4) Authors should provide data on % dopaminergic neurons generated in the cultures.

      We agree that this is important information, and we updated the latest version of the manuscript with this information (see below in italics). We estimate that the neuron cultures consist of 50 to 70 % dopaminergic neurons, and they are depleted of non-neuronal cells as explained in Material and Methods.

      Material and Methods - Preparation and culture of iPSC-derived NPCs, dopaminergic neurons and astrocytes

      To isolate a pure neuronal population, the cells were harvested in Accumax medium, diluted to a density of 1 × 106 cells in 100 µl MACS buffer (HBSS, 1 % v/v sodium pyruvate, 1 % GlutaMAX, 100 U/ml penicillin/streptomycin, 1 % HEPES, 0.5 % bovine serum albumin) supplemented with CD133 antibody (5 % v/v, BD Biosciences, San Jose, CA, cat. # 566596), and the CD133+ NPCs were depleted by magnetic-activated cell sorting (MACS) using an LD depletion column (Miltenyi Biotech, San Diego, CA), as described previously (de Rus Jacquet, 2019). The final cultures are depleted of non-neuronal cells and contain approximately 70 % dopaminergic neurons, the remaining neurons consisting of uncharacterized non-dopaminergic populations.

      5) p7. Authors refer to phosphorylated a-synuclein as accelerating PD pathogenesis, but the references cited do not show this. In fact, Gorbatyuk et al 2008, showed that overexpression of S129 with constitutive phosphorylation eliminated a-synuclein induced nigrostriatal degeneration. The Fujiwara et al 2002 reference showed the presence of phospho a-syunclein in Lewy bodies and neurites. Authors should revise their statement that phospho a-synuclein is associated with accelerated pathology.

      The reviewer is correct. We meant to highlight that there is a correlation between phosphorylated αSyn levels and PD pathogenesis, not that phosphorylated αSyn causes an acceleration of PD pathogenesis. We rephrased the sentence as follows, and replaced the study by Gorbatyuk et al. with a study by Anderson et al. that shows presence of phosphorylated αSyn in Lewy bodies (new text in italics):

      EVs isolated from the biofluids of PD patients exhibit accumulation of αSyn (Lamontagne Proulx et al., 2019; Shi et al., 2014; Zhao et al., 2018), a hallmark protein whose phosphorylation at the serine residue 129 (p-αSyn) is correlated with PD pathogenesis (Anderson et al., 2006; Fujiwara et al., 2002).

      6) Please provide details on the number of iPSC lines used for these experiments.

      Experiments in the first version of this manuscript were performed using a single LRRK2 G2019S iPSC line and its gene-corrected control. The manuscript now presents the results collected using a second, independent non-isogenic iPSC line, as well as mouse primary cultures.

      7) Clarify whether the WT neurons used for co-culture were derived from the isogenic human neurons?

      We confirm that the WT neurons used for co-culture experiments were derived from isogenic controls. We added subtitles to our figures to clarify when data show results from isogenic or non-isogenic iPSC-derived cells.

    1. While seemingly open-ended and allowing for an infinite recombination of elements, the idea of “vibes” is reductive. It discourages the more difficult work of interpretation and the search for meaning that defines human experience. It diverts attention away from narrative and moral implications in favor of foregrounding the idea of affect as inexplicable, ineffable — a matter of chance correlation of elements rather than something that requires deliberate causal explanation. The vibes framework may hone our abilities to identify settings like “cozy” or “cursed,” but it doesn’t give instructions on how we might build them or avoid them in our lives. As an analytic, vibes don’t connect feelings and consequence; as such, it is symbiotic with passive modes of media consumption.

      Wow, I hate this. How is the work of interpretation discouraged? Giving vague description to something doesn't preclude better description; to encourage people to express the idea that there's something coherent about, well, something is to create the space for further interpretation. A vibe is a term for a fetal stage, something emergent still emerging. If you already had a better name for it you'd use that. Articulating that you think there's a there there is a meaningful step! (this is where I would make a joke about attention mechanisms in deep learning if I were committed to the author's schtick) We can analyze whether cottagecore is fashy because people recognized a vibe and nurtured it into a whole... thing. (A thing that is sometimes fashy)

    1. This manuscript is in revision at eLife

      The decision letter after peer review, sent to the authors on June 30 2020, follows:

      Summary:

      This paper addresses a critical issue in neuroscience: what's the question, and can we answer it? The questions the author proposes are ones that have been considered, in one form or another, reasonably often by experimentalists. And the author shows rigorously that there's a reasonable chance that they are simply not answerable.

      Essential Revisions:

      We believe that this is an extremely important issue, and the approach the paper takes is a reasonable one for addressing it. Our main worry, though, is that mainstream neuroscientists will ignore it, for two reasons. One is that it's not a message they want to hear. Second, the example circuits are sufficiently abstract that they can be dismissed as yet another musing by your typical uninformed theorists. (That is not, we should emphasize, our view, but it's not an uncommon one in the field.) Our goal, therefore, is to fix these potential problems, so that people will have to pay attention.

      The premise of the paper is that if you understand a neural circuit, there are certain questions about it that you should be able to answer. The author proposes six such questions, and then shows that in the worst case they are exponentially (in the number of neurons) hard to answer.

      The success of this program hinges on two things: a sensible set of questions, and a demonstration that answering those questions is hard. We're not ecstatic about the questions, but we believe that's not an insurmountable issue (more on that below). More problematic is the result that the questions are hard to answer. What's really shown is that there is at least one circuit for which, in the worst case, answering the questions is exponentially hard. While this is certainly correct, it doesn't make a convincing case that answering these questions will be hard in the brain. First, the worst case may not be the typical case. The 3 SAT problem, for instance, is NP complete, but is hard to solve only for a narrow range of parameters. Second, answering the questions for actual circuits found in the brain may not even be exponentially hard in the worst case.

      This brings us to two critical comments. First, it needs to be crystal clear that this paper does not demonstrate that answering the proposed questions is guaranteed to be exponentially hard, only that it might be. This was stated in the manuscript, but not emphasized. For instance, on lines 138-140, it says

      "Using techniques from Computational Complexity Theory, we ask what is the smallest number of experiments necessary, in general, in order to answer these questions, in typical experimental settings."

      Here "in general" means worst-case. For neuroscientists, though, "in general" means "most of the time". It should be clear that you mean worst case, and that the typical case may be very different.

      In fact, this needs an expanded discussion. Whether or not it will take an exponential number of experiments to answer the questions depends on the circuit. We might get lucky, and only a small number of experiments are needed. Or we might get unlucky, and a large number are needed. This analysis can't tell us that, and this should be clear in the paper.

      Second, what's really needed is the analysis of a more realistic circuit, ideally with both positive examples (for which it is possible to answer the questions) and negative examples (for which it isn't). This is hard, but we have a few suggestions, some of which can probably be done without a huge amount of work.

      a. Linear network, y=Ax+noise. For this (and possibly in all realistic) situations, "perform the task" needs to be replaced by "achieve a certain level of performance". For instance, if there's a true mapping y=f(x), then "perform the task" would be replaced with "<(y-y*)^2> below some threshold". The questions should be answerable in polynomial time for this network; otherwise, one should worry.

      b. In 2000, Hopfield and Brody came up with a simple circuit which we think of as "understandable" (Hopfield and Brody, PNAS 97:25, 13919-13924, 2000). It would be nice to determine whether the questions can be answered in polynomial time for this circuit. Again, if they can't, one should worry.

      c. Deep networks. Again, "perform the task" would have to be replaced with "performance is above some particular threshold". Here we suspect that the questions are not answerable; if that could be shown, it would be a huge step forward.

      d. A made-up model of a deep network. Assume that in a deep network, whenever you delete a neuron, performance drops. That's probably not so far from the truth -- and also not so far from what we think would happen in the brain. (With some exceptions; occasionally I hear talks where performance is better when two areas are ablated rather than just one, but let's ignore that.) How much performance drops depends, of course, on which neurons are deleted, so there's not a simple mapping between performance and which neurons are present in the circuit. Can the questions be answered in this case? This sounds like a problem computer scientists have considered, so possibly rigorous analysis could be done.

      We believe it's critical to consider a case that is not far from what one might find in the brain. Otherwise, it will be too easy to dismiss this work as irrelevant to real neuroscience. The above are only possibilities, and a and d may be pretty easy, but the author is welcome to come up with his own examples. Note that rigor is not absolutely necessary here, since there's already one rigorous example. Plausible arguments would be fine.

      Finally, "understand" needs further discussion. That's partly because the approach here is a little non-standard. Most people try to directly define "understanding". Instead, the statement is "if you understand a circuit, you should be able to answer these questions". This has to be made crystal clear -- especially since people aren't expecting it. In addition, a discussion of the more standard approach, a direct definition, should be included. The usual definition is something like "A short description of what is being computed, along with a description of an algorithm for computing it." It should be clear how this, more standard, definition compares to the one in the paper. For instance, under the standard definition it may be possible to understand a circuit without being able to answer any of the questions. For instance, I believe we can "understand" (by the more standard definition) the synfire chain circuit. This doesn't mean that one definition is better than the other, but their differences should be acknowledged.

    1. Namaste

      I live and teach in Qatar (Qatar was previously known as a small oil-rich country in the Middle East but is now famous as the host country for FIFA World Cup 2022). At my school, we have many Indian and South Asian students who I am sure would totally understand and appreciate the use of “Namaste” as a concept for a workshop classroom.

      An equivalent to Namaste would be “Salaam” for my teaching context in Qatar. Salaam is a common greeting in Muslim countries. It means wishing “peace” and it carries intentional respect and kindness toward the other person. For a writing workshop classroom, Salaam can be understood as a peace-based concept that encourages safe, healthy, respectful dialogue and that discourages verbal or written “attack” on a student’s writing. If I were to do a writing workshop with my students in the future, I may consider replacing Namaste with Salaam for we have a very high Muslim student population in our school. That said, I am actually reminded of a Bollywood movie titled “Salaam Namaste.” Isn’t that interesting? Salaam Namaste would mean “peaceful greetings of respect and kindness.”

      As long as we are creating and maintaining the kindness culture in our classrooms, I think we can safely play with the word choice, depending on our location, culture, teaching situation, students and other preferences.

    1. Author Response:

      Reviewer #2 (Public Review):

      Valentini et al. explore the contribution of inexperienced homing pigeons in a pair, while finding the most efficient route back home. My comments below mostly concern the need of broadening the scope of the introduction and discussion by discussing and citing literature beyond homing pigeons as at the moment the manuscript could be characterized as too specific for the readership.

      We thank the reviewer for their suggestions which allowed us to expand the focus of our manuscript. Our answers to the reviewer’s comments are reported below together with modifications done on the revised manuscript.

      The authors use and present transfer entropy methods which regard the transmission of information from one individual to the other and effect of this information on behaviour. I haven't used such methods myself, but I think the methodology is nicely explained and easy to follow as it's written here. However, I would still encourage the authors to avoid jargon and un-introduced terms while first presenting their methods and results in the introduction and results sections. I also think that the paragraph in the introduction (L92-104) that refers to transfer entropy (TE) has to be extended and also direct readers to reviews such as [1] that attempt to make TE accessible to a broad audience of non-physicists. Behavioural ecologists and primatologists that study leadership and influence in animals, using less data hungry methods than TE, will probably be interested in reading this manuscript. Because eLife is a journal that attracts a very broad audience I would suggest investing more on better introducing TE to biologist and anthropologists.

      We thank the reviewer for their suggestions. In the revised version of our manuscript, we clarified the meaning of symbols and unintroduced terms and extended the introduction paragraph about transfer entropy to provide more information. We now discuss data requirements of information-theoretic approaches, point the reader towards recent literature reviews aimed at introducing these (and similar) approaches to the community of behavioural ecology, and better introduce the advantages of transfer entropy with respect to methods based on models of alignment, attraction, and repulsion.

      “Leader–follower interactions of this sort can be accurately captured using information-theoretic measures that quantify causal relations in terms of predictive information (Butail, Mwaffo, and Porfiri 2016; Kim et al. 2018; Crosato et al. 2018; Ray et al. 2019; Valentini et al. 2020). This methodological approach, which generally requires large amounts of data (but see (Porfiri and Ruiz Marín 2020)), is gaining popularity among behavioural ecologists (Strandburg-Peshkin et al. 2018; Pilkiewicz et al. 2020) as tools for automatic monitoring and extraction of the necessary volumes of behavioural data become increasingly available (Egnor and Branson 2016). One of these measures, transfer entropy, quantifies information about the future behaviour of a focal individual that can be obtained exclusively from knowledge of the present behaviour of another subject (Schreiber 2000). Transfer entropy measures information transferred from the present of the sender to the future of the receiver (Lizier and Prokopenko 2010). It explicitly accounts for autocorrelations characteristic of individual birds’ trajectories (Mitchell et al. 2019) by discounting predictive information available from the sender’s present that is already included in the receiver’s past (see Figure 1). Furthermore, it does not require a model of how sender and receiver interact, and it is well suited to study social interactions both over space and time (Lizier, Prokopenko, and Zomaya 2008; Strandburg- Peshkin et al. 2018). This aspect of transfer entropy encompasses traditional methods to quantify collective movement that are based on modelling an individual’s behaviour as a combination of three motional tendencies (Couzin et al. 2002) – alignment of direction to nearby group members, attraction towards sufficiently distant members, and repulsion from sufficiently close members – that allow an individual to maintain proximity to the group. In this context, transfer entropy is advantageous as it can capture causal interactions due not only to alignment forces (Nagy et al. 2010) but also to attraction and repulsion forces that result in temporarily unaligned states (Pettit, Perna, et al. 2013).”

      A thought I had while reviewing this work regards the theory of the wisdom of the crowd [2]. This indicates that when a group or a collective averages the different estimates of its members, they reach a more accurate collective estimate. Studies have also shown that animals can average their movement directions to resolve conflicts of interest [3,4]. The current manuscript also shows that pooling infomration leads to better movement decisions. Would it thus make sense for this manuscript to discuss how its findings may support the wisdom of the crowd theory?

      We thank the reviewer for the suggestion. In the revised version of out manuscript, we included a new paragraph where we discuss a possible connection with the phenomenon of the wisdom of crowds as well as how our results might generalize to flocks of larger size.

      “The ability of groups to outperform single individuals by pooling information across their members is an aspect of collective intelligence that has long intrigued researchers. One potential mechanism underlying this phenomenon, popularly known as the wisdom of crowds (Surowiecki 2005), is averaging many individuals’ estimates independent from each other. Averaging individual decisions is expected to provide a more accurate group estimate than any individuals’ guess. Previous studies have also shown that animals can average their movement decisions to reach a compromise (Biro et al. 2006; Strandburg-Peshkin et al. 2015). Although the mechanisms by which experienced and naïve individuals pool information during route development remain unknown, our study points to the importance of naïve group members within the information-pooling process. Moreover, the wisdom of crowds is known to require personal information to be independent among group members (Couzin 2018) otherwise group performance can degrade quickly for increasing group size (Kao and Couzin 2014). Experimental pairs could thus benefit from pooling information with naïve individuals that, at least at the beginning of each generation, likely provide a source of information independent from that of the experienced bird. The potentially deleterious effects of losing independence may provide another pressure to shift over time from innovative exploration to route6 preserving exploitation. It remains to be explored how our results generalize to larger flock sizes. Previous experiments without generational replacement showed that, even in larger flocks, birds flying ahead of the flock had a tendency to assume leadership positions (Nagy et al. 2010). However, the repeated introduction of naïve individuals into larger flocks might complicate the dichotomy between leaders and followers by inducing turnover dynamics between the front and the back of the flock.”

      As briefly mentioned earlier, I think that the cited literature in this manuscript (especially in L58-138 and throughout the discussion) includes mostly studies on homing pigeons whereas relevant studies to the current manuscript have been performed on other species and by discussing and citing relevant studies on various species the manuscript would become more attractive to a broader audience and wouldn't read as homing-pigeon specific.

      We thank the reviewer for pointing us towards additional literature related to our study. We included the suggestions from the reviewer as well as further references to a broader literature to expand the scope of our manuscript.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons

      1. General Statements

      We want to thank all three reviewers for their positive feedback, constructive comments, and suggestions for clarity and improvement. We are delighted to find their consensus that the manuscript represents a contribution to the field.

      Accordingly, we made changes in the text (all highlighted in blue in the revised manuscript) and added a new figure as detailed in the point-by-point response.

      2. Point-by-point description of the revisions

      Reviewer #1 (Evidence, reproducibility and clarity (Required)):

      The authors describe results of the comprehensive analysis of the prevalence and functionality of intrinsically disordered regions of the pathogen-encoded signaling receptor Tir, which serves as an illustrative example of the bacterial effector proteins secreted by Attaching and Effacing (A/E) pathogens. This is an interesting and important study that represents an impressive amount of data generated computationally and using a broad spectrum of biophysical techniques. The work serves as a model of the well-designed and perfectly conducted study, where intriguing conclusions are based on the results of the comprehensive experiments. The manuscript is well-written and concise, and I have a real pleasure reading it. The text and figures are clear and accurate.

      We thank the Reviewer for these positive comments on our work.

      Although, in general, prior studies are referenced appropriately, the authors should mention that the pre-formed structural elements they found in Tir are in line with the concept of "PreSMos" (pre-structured motifs) previously introduced and described in several important studies from the laboratory of Kyou-Hoon Han.

      We thank the Reviewer for this suggestion. We have added a sentence to acknowledge the presence of “PreSMos” in the target-free state of Tir as putative signatures for target-binding, referring to a review article summarizing several local structural elements in unbound IDPs:

      “This supports the presence of pre-structured motifs (PreSMos) as pre-existing signatures for target binding and function within target-free Tir (72)**.”

      Please, note that we decided to keep this discussion to a minimum, as we cannot rule out the contribution of the induced fit model to the binding mechanism (i.e., disorder-to-order transition upon binding).

      Reviewer #1 (Significance (Required)):

      Solid evidence is provided that structural disorder and short linear motifs represent common features of A/E pathogen effectors. In fact, using a set of bioinformatics tools, the authors first show that although prokaryotic proteins typically contain significantly less intrinsic disorder than eukaryotic proteins, A/E pathogen effectors are as disordered as eukaryotic proteins. Using the translocated intimin receptor (Tir) as a subject of focused study, the authors then utilized a number of biophysical techniques to draw an impressive picture of disorder-based functionality. This study clearly represents a major advancement in the field of functional intrinsic disorder in general and in disorder-based functionality of proteins expressed by pathogenic bacteria. This was adds significantly to the field and will have a noticeable impact.

      Again, reading this manuscript was a real joy. Finally, this work perfectly fits in the area of my expertise, since for the past 25 years or so I am working on the different aspects of intrinsically disordered proteins.

      Thank you for this encouraging assessment.

      **Referee Cross-commenting**

      I agree with the amended recommendation of reviewer #3 to add in the manuscript EPEC O127.

      According to the suggestion of Reviewer #3, we have now included EPEC O127:H6 in the manuscript.

      I completely agree with comments of reviewer #2 and partially agree with reviewer #3. In my view, comparison of various strains as references for EPEC represents an interesting but independent project. It can be recommended to the authors as one of the potential future developments of their work.

      Thanks for the suggestion. We are pursuing that line of research.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)):

      The general impression is that this is an excellent study that establishes

      The C-terminal intracellular region of Tir called C-Tir spanning residues 338 to 550 is largely disordered, however, observe helical structural elements involved with lipid interactions; multi-phosphorylation. The intracellular N-terminal part of Tir called N-Tir spanning residues 1 to 233 is also partially disordered but include a folded domain that is shown to assemble into a dimer

      The only major concern is that no SDS-PAGE gels or size exclusion chromatograms have been included to verify purity and monodispersed of the various constructs worked on. In particular, the SAXS and CD measurement is highly sensitive to purity, and the level of degradation as IDPs are notorious for being difficult to handle in solution. it would strengthen the arguments made based that

      We produced N-Tir and C-Tir as fusion proteins with a cleavable N-terminal thioredoxin tag (Trx-His6) and C-terminal Strep-tag. The latter allowed us to purify them via Strep-tag affinity chromatography as indicated by SDS-PAGE (please see Fig. S1).

      We agree with the Reviewer that even small amounts of impurities (i.e., higher oligomers/degradation) can interfere with the data analysis and make interpretation of the resulting data difficult and potentially misleading. So, to avoid such problems, all samples were purified in monodispersed forms by size-exclusion chromatography (SEC) before any biophysical study.

      Following the Reviewer's suggestion, we added a new supplementary figure (Fig. S5) showing the SEC-SAXS chromatogram profiles of C-Tir, N-Tir, and NS-Tir. Briefly, in the inline SEC-SAXS experiment, the sample eluates from an HPLC system directly and continuously into a BioSAXS flow cell for subsequent X-ray interrogation. Under our experimental conditions, C-Tir elutes as a single peak with Rg-values and mass compatible with a disordered monomeric protein, providing an excellent fit to the experimental SAXS curves. For N-Tir and NS-Tir, by SEC-SAXS, we separated the dimer from small amounts of high-order oligomers to yield the experimental SAXS curves of the pure dimers.

      “Fig. S5. SEC-SAXS chromatograms of (A) C-Tir, (B) N-Tir, and (C) NS-Tir. Each plane shows normalized total scattering intensity I(s), over the entire s range, from each frame acquired along elution volume and respective Rg-value (black circles). The flat variation of Rg reflects a pure monodisperse sample. The column type for size exclusion chromatography and sample concentrations are on the top left of each panel. For reference, the retention volume for monomeric BSA (66.4 kDa) is displayed by red triangles.”

      **Minor Comments**

      Read through the manuscript to remove passages with spoken language

      We thank the Reviewer for this suggestion. We went through the manuscript and improved the writing to reduce passages with spoken language.

      Line 263, "To do so", should be removed

      Line 290 "Our data thus" replaced with "this"

      We have amended the manuscript accordingly.

      Line 292 "lipid bilayers that might potentially fine-tune Tir's activity in the host cell." Weak sentence and the word fine-tune is slang. Rewrite the sentence. The interaction with lipids is fascinating!

      Thanks for the suggestion. The sentence has now been changed to “**This shows that C-Tir can undergo multivalent and tunable electrostatic interaction with lipid bilayers via pre-structured elements, suggesting that membrane-protein interplay at the intracellular side might control the activity and interactions of Tir in host cells.**”

      We also reinforce this fascinating message in the abstract by adding the sentence: “Membrane affinity is residue-specific and modulated by lipid composition, suggesting a previously unrecognized mechanism for interaction with the host.”

      Line 192 "In figure Fig. 3A," remove the Fig

      Fixed.

      Line 326, "In a similar fashion," is redundant. Rewrite the sentences below.

      We have modified the sentence as follows: “We evaluated whether the N-terminal cytosolic region of Tir (N-Tir; Fig S1) was also intrinsically disordered ...

      Line 342 add spaces between digit and SI unit "52kDa" there are more cases of this.

      Thank you for pointing this out. This has now been corrected to 52 kDa.

      Reviewer #2 (Significance (Required)):

      I expect this study to have broad relevance to microbiologists working with the intimin and translocated intimin receptor, in particular the lipid interaction is likely to be followed up by the community.

      We thank the reviewer for this comment. Indeed, we believe that further studies on Tir's lipid-binding ability as a novel molecular strategy in host-pathogen interactions, will potentially provide new insights on virulence, transmembrane signaling in general, and disorder-mediated functions.

      **Referee Cross-commenting**

      What reviewer 3 suggested in the comments sounds like added value and should be included.

      I agree with reviewer 1, that the strain comparison potentially is beyond the scope presented in this manuscript.

      We have now included EPEC O127:H6 in the manuscript.

      Reviewer #3 (Evidence, reproducibility and clarity (Required)):

      **Summary:**

      This interesting manuscript look at the structure of the Nter and Cter of the effector Tir from enteropathogenic E. coli. The authors confirmed previous study highlighting the "disordered" part of the Cter. However, the extended experimental work (NMR, Small-angle X-ray scattering and CD spectroscopy) from this study also reveals the connection between different area of Tir and its implication during Tir phosphorylation and its interactions with SH2 domain.

      We thank the Reviewer for this positive remark. Indeed, in our work, we highlight the structural features of the SH2-mediated interaction between Tir and host SHP-1 protein, and we also show that C-Tir is capable of lipid interaction via pre-structured motifs and that N-Tir is disordered but assembled into a dimer. Overall, we provide an updated and wide picture of Tir's intracellular side that goes beyond the scrutiny of previously described disorder features.

      **Major Comments:**

      The authors used E2348/69 (O127:H7) strain as a reference for EPEC. However, this strain are the least effectors of all the EPEC sequences and may over estimated the PDR in EPEC. It would be wiser to use a strain like B171 as a reference for EPEC to be able to conclude "Disordered Proteins (PDR) with long disordered regions occur in EPEC effectors similar to the human proteome". I believe that the PDR in EPEC is similar to EHEC and CR. I do not have any major concern for the rest of the work.

      We thank the Reviewer for this comment. So, to clarify, we amended “EPEC” with “EPEC O127:H6” in text and figures.

      We also added a paragraph at the beginning of the Discussion section to acknowledge that our prediction analysis concerns EPEC O127:H6 and two additional representative A/E bacteria strains:

      “Among the enteropathogenic Escherichia coli strains EPEC O127:H6 (E2348/69) is commonly used as a prototype strain to study EPEC biology, genetics, and virulence (69). Here, we have determined the structural disorder propensity of EPEC O127:H6 sequences and two additional representatives of A/E bacteria: EHEC O157:H7 and CR ICC168.

      Finally, the Reviewer suggests to include EPEC strain B171 (serotype O111:NM) in our analysis. We agree that considering additional strains would be of value, however we believe that this is beyond the scope of this manuscript, which mainly focuses on the characterization of the structural features of the E2348/69 Tir effector. We are currently working on a broader comparative analysis among different Escherichia coli pathogenic strains, including B171, and we hope to share our findings with the community in the near future.

      **Minor comments**

      Statistic problem: Mann Whitney U Test (Wilcoxon Rank Sum Test) is a comparison of two independent samples with the underlying assumption is normally distributed or that the samples were sufficiently large. It is not certain that any of this assumption is correct. In addition, the effector are part of the whole proteome. Can it be then considered that both groups are independent?

      We thank the Reviewer for this remark, which allows us to clarify the choice of this particular test. Indeed the Mann Whitney U-test is a non-parametric test to compare two samples with the alternative hypothesis being that one of the two samples is stochastically greater than the other. As it is a nonparametric test samples are not required to be normally distributed, as it is for the Student t-test.

      Regarding the independence of the samples, when comparing the effectors collections to their corresponding proteomes, we did exclude the effectors sequences from the latter. We have clarified this point in the Supplementary Material and Methods section.

      Line 120 and 442: O127 not H127

      Thank you for pointing this out. It has now been corrected to O127.

      Line 212: positions 409 or 405?

      Yes, it should be 405. Thank you.

      Reviewer #3 (Significance (Required)):

      **Nature and significance:**

      Tir plays a major role during EPEC infection. It is a signalling platform that has been reported to interact with multiple proteins. Whereas the extracellular part has been well characterised and crystallised, the intracellular part has been proven so far to be difficult to study. Over the last decade, no progress has been made to explain how Tir works. This manuscript provides interesting information that shade some light on how the protein could work.

      **Existing literature:**

      The last research manuscript trying to highlight the structural function of Tir dates from 2007 (PMC1896257). This study is far more extended and in depth than any other previous work done.

      **Audience:**

      the Audience may probably limited to researcher working on the field of cellular microbiology and the function associated with bacterial effector in the host. This study could be also a useful tool to identify new effectors base on their "disorder".

      We thank the Reviewer for recognizing the importance of this study. We agree that our work highlights the pivotal role of disordered regions in bacterial effectors, thus enabling a better understanding of the molecular mechanisms used by pathogens to subvert the host-cell processes. We indeed believe that our work can stimulate further research on the characterization of intrinsically disordered effectors, and also beyond the cellular microbiology field, in order to gain a broader knowledge on the molecular dialogue at the host-pathogen interface, which is essential to design better therapeutic strategies.

      **Expertise:**

      I have been working on A/E pathogens for the last 15 years with a particular interest in Tir signalling. My domain of expertise is more in relation to cell signalling than crystallography or structural study.

      **Referee Cross-commenting**

      I agree with both reviewers. My comment about EPEC is more about the conclusion for some of the figures. I don't think they should conclude for the whole EPEC. The Tir variation among EHEC O157:H7 is low, but it is far more diverse for EPEC. Simply adding in the manuscript EPEC O127 should be enough.

      We thank the Reviewer for this comment. As mentioned above, we now state in the manuscript, in both Results and Discussion sections, that we used E2348/69 as a representative strain for EPEC.

    1. Author Response:

      Reviewer #1 (Public Review):

      Summary: In " Rapid and Sensitive Detection of SARS-CoV-2 Infection Using Quantitative Peptide Enrichment 1 LC-MS/MS Analysis" Hober, A. et al. describe the addition of peptide immunoprecipitation by means of SISCAPA technology to the Sars-Cov2 mass spectrometry-based diagnostics toolbox. The work shows in a straightforward way that this is a huge improvement and of great importance to the field. It shows beyond any doubt that mass spectrometry can become a clinically applied diagnostic instrument to detect (viral) infection.

      Overall remark: The main concern is the reported number of 83% sensitivity. This is not because the number is too low, but because the number is misleading. In line with "CLSI EP 12-A2 User Protocol for Evaluation of Qualitative Test Performance guidance" a summary of the sample analysis results are shown in a 2x2 contingency table. Unfortunately, I oppose to this representation of the results at this stage for three reasons: (i) reporting a percentage shouldn't be done on less than 100 samples because of the weight of a few misannotated samples on these numbers, be it in the qPCR or the MS results; (ii) because both assays are imperfect, it is impossible to assess the ground truth for calling patients and thus assess sensitivity and specificity; (iii) the authors still only target a single peptide, which is not conventional in MS-based assays that targets proteins.

      We have changed to PPA and NPA in the new version of the manuscript. We have also included 264 RT-PCR negative samples collected in the same study. We agree that protein quantification should not be done using only one single peptide. We have updated the manuscript to clarify that we do not perform protein quantification, but rather peptide quantification.

      Rather than the proposed confusion matrix, which assumes that the ground truth is known to call it e.g. "false negatives", the authors could refer to it as an agreement matrix and not be tempted to calculate threshold values like sensitivity, which have too much of an impact on the clinical readership that is used to seeing this value in a more controlled context. This is in line with the recent Lancet manuscript from Fitzpatrick, M. et al (2021), proposing percent positive agreement (PPA) and percent negative agreement (PNA) instead (Fitzpatrick et al., 2021).

      We have decided to keep the confusion matrix but we are referring to it as PPA and NPA and rephrased sensitivity to “estimated sensitivity” based on PPA.

      More specifically, as we and others have shown, qPCR Ct values rarely agree in two (consecutive) analyses, even within accredited settings (personal communication NHS). Above Ct30, patients regularly turned negative in our hands (https://doi.org/10.1021/jacsau.1c00048), even with an assay that had proven detectability of 1 plasmid at Ct40. Furthermore, we suspect that freeze-thaw cycles further inflate this uncertainty, two of which the current samples were subjected to. Undetected mRNA would then classify these patient samples as "false positives" if they did yield signal in the LCMS results. By chance, this did not happen in this manuscript, yet this could very well be the reason for the highest signal reported in Figure 3 as a green dot at log2 MRM response of -6 (see minor remarks).

      The authors already distinguished the patients in a High Pool of Ct <30, a Low Pool 30{less than or equal to}Ct<33 and the negative samples (Ct>40). It is clear from the gap (no 34<Ct<39) that finding patients between Ct33 and Ct39 is challenging. Indeed, qPCR has its own "diagnostic grey zone" of LOQ negative and LOQ positive that rarely is being referenced. Thus, a "sensitivity" of 95% for patients <Ct30, despite the low number of samples and considering the uncertainties in qPCR (just above or below Ct30) at least limits the comparison to samples that are positive beyond any doubt. But again, we would be thresholding against a trembling metric, in turn making the claim from the authors dangerous that "the estimated LLOQ is 3 amol/μL approximates to Ct {less than or equal to}30". Rather, the Ct30 threshold should be set for a different reason, if one is chosen at all.

      What is needed is good thresholding for clinical diagnostics, as is done in qPCR. In the public hospital in Belgium that provided us with patient samples, the positive threshold is set to Ct33 on the first measurement and practitioners use higher Ct values only in the context of physical symptoms of the disease to come to a final conclusion. For MS, we now need to measure >1000 samples in order to decide what log2 MRM response for a given set of peptides corresponds to an LOQ positive from - say - Ct27 to Ct30 and an LOQ Negative from Ct31 to Ct33. In other words, the linearity of the correlation between qPCR and MS illustrates the intrinsic value of MS; the point up until which we can provide clinically relevant information remains to be determined on large patient cohorts. In turn, these large patient cohorts can allow to sort (clinically) validated patients according to signal intensity and set a log2 threshold at which e.g. 2% or 5% negatives are expected, in line with False Discovery calculations for target decoy strategies. At this stage however, it might be most straightforward to conclude with percent positive agreement (PPA) and percent negative agreement (PNA), as is recommended for laminar flow tests validated on <100 samples.

      Finally, realizing the importance of this pivotal moment in the implementation of MS in the clinic, I find it somewhat tricky to only focus on one peptide. In fact, the authors perform the qPCR on two genes (three genes being even more common) because of the drop-outs that can occur. I feel like the use of peptide IP with MRM for detecting pathogens has not yet matured enough to rely solely on one peptide. Still, I understand that asking for a second peptide would mean repeating all the measurements, so that is most probably not realistic. Yet, I do consider this to be yet another reason not to report % sensitivity and specificity in the current manuscript and the potential to gain robustness with more peptides should clearly be emphasized at every stage of the manuscript.

      We agree that the method would be much improved by adding another peptide to the repertoire. The method was developed using the most sensitive antibody-peptide pair and the most promising pair was used in the downstream process. We have highlighted the limitations of using only one peptide and emphasized that this is a proof-of-principle study.

      In conclusion, because patient batches in the thousands are currently unavailable to MS-oriented diagnostic labs and because of all the reasons mentioned above, we cannot report the numbers of sensitivity and specificity in this manuscript, as they are misleading and do not quantify what they are intended to do.

      Fitzpatrick, M. C. et al. (2021) 'Buyer beware: inflated claims of sensitivity for rapid COVID-19 tests', The Lancet. Lancet Publishing Group, pp. 24-25. doi: 10.1016/S0140-6736(20)32635-0.

      We agree and have changed to PPA and NPA for this reason.

      Major remarks: P3L250: "on-column amount of 60 amol." Because of the enrichment procedure, could the authors specify what initial conditions they spiked into the dilution series prior to enrichment. This would allow recalculation and avoid confusion about the correctness of the 60 amol on column claim (which in our hands is still detectable).

      We made changes to this in the updated version of the manuscript.

      P8L181: "50 μL elution buffer (0.5 % 180 formic acid, 0.03% CHAPS, 1X PBS) and incubated for 5 min at room temperature." This minor sentence is placed under major remarks, because in our understanding the elution buffer needs to be acidic and adding PBS will reduce acidity. If this is a typo, please correct. If this is not, could the authors try and use H2O instead and see if their results improve?

      The access to the raw data was denied.

      The raw data is accessible through the provided Panorama link and can be accessed under the tab “Raw Data”. The entry in ProteomeXchange, however, is only a reserved data set identifier for now, but the data will be made available through this link after the review process.

      Reviewer #2 (Public Review):

      MS-based proteomics is currently discussed as a method for detection of viruses from clinical samples. Several studies have already shown the potential of this method on the example of the detection of SARS-CoV-2 from respiratory specimens. However, one of the major drawbacks still remains the low sensitivity of MS-based virus detection compared to real-time PCR, which is the gold-standard method. In their manuscript Hober and colleagues apply specific antibody-based enrichment of SARS-CoV-2 peptides from upper airway samples to concentrate the analyte prior to analysis by targeted MS (MRM). The authors determined the dynamic range of the method for four different SARS-CoV-2 NCAP peptides using a calibration curve. On the example of the SARS-CoV-2 NCAP peptide AYNVTQAFGR a correlation between the MS result and the cT value is shown. Furthermore, using stable isotope labelled (SIL) peptides as internal reference, a quantitative MS measurement was achieved. The presented approach is able to distinguish real-time PCR SARS-CoV-2 positive samples from negative samples in the used set of 88 samples from asymptomatic patients. Combined with a specificity of 100 % and sensitivities of up to 94.7 % for samples with cT values {less than or equal to} 30 the authors conclude that the method could be an alternative to real-time PCR.

      Strengths of the manuscript:

      I think the applied technique (SISCAPA) is highly interesting in the context of virus proteomics. This is because virus proteins are often underrepresented in relation to the host proteins, especially during early time points of infection, hampering their detection. Recently, the application of SISCAPA for SARS-CoV-2 diagnostics has been suggested in the discussion of a manuscript from Van Puyvelde and colleagues. The manuscript from Hober and colleagues presents the first study demonstrating that this technique can be applied to enrich, detect and quantify SARS-CoV-2 peptides from upper airway samples. The manuscript is clearly arranged, the data is sound and supports the main conclusions.

      Weaknesses of the manuscript:

      I think the manuscript in some points underestimates the PCR and vice versa overemphasizes the proteomics approach. For example, I don't agree that real-time PCR generally suffers from technical problems, degraded probes or non-specific amplification. Vice versa I think the LC-MS/MS approach is not inherently absolute specific and does not outperform PCR in terms of specificity. Further, LC-MS/MS does not eliminate the problem of false positives, which could be introduced during sample preparation or by inter-run contaminations. Although in real-time PCR no internal standards analogous to isotopically labelled peptides are used there are internal controls used to assure the quality of the extraction and the PCR reaction itself. The method presented by Hober and colleagues is clearly beneficial for the field of proteomics-based virus detection, but I suggest a more balanced discussion also including also the potential drawbacks of the method.

      Another point I like to raise is that the authors conclude at the end of the results section that patient samples were collected at an infectious stage.

      We have made changes to the manuscript accordingly and removed the claim that the samples were collected in an infectious stage since this cannot be confirmed. The patients did not show any symptoms when sampled, which has been highlighted in the new version.

      However, an assessment of the infectivity cannot be drawn from the presented data. The analysis of real-time PCR results in the manuscript is based on cT values. But to draw the conclusion, that the analysed samples contained infectious virus particles, the number of viral genome equivalents has to be determined, which in turn can be correlated to infectivity.

      We have removed this section since we cannot make any claim on infectious virus-particles.

      The detection of viral proteins itself does not proof that samples were collected at an infectious stage and there is currently no correlate of the amount of NCAP protein and infectivity. Since viral proteins are likely more stable than viral RNA, they could even be detectable for a more prolonged time in patient samples.

      Reviewer #3 (Public Review):

      Major comments

      P2, l245, Figure 2: It is not completely clear to me what is represented in panels A and B. Is this the pure SIL peptide of the endogenous peptide in a complex matrix? This may make a large difference for the determination of the LLOQ. Panel B shows a calibration curve and as these are curves for which the signal is detected based on known input amounts of sample, I assume that the input is pure SIL peptide here?

      In panel A, what does '3 amol/ul' in the middle chromatogram exactly mean? Is this the endogenous peptide that was calculated to be present at 3 amol/ul based on a known concentration of spiked-in SIL peptide?

      P4, l276: The authors need to explain the details of data imputation. It is unclear which data were imputed and how this was done. In Figure 3 the grey data points represent "not detected" or "inconclusively identified" samples by LC-MS, while some of the data points seem to have a higher 'response' values than others. Please explain.

      In Figure 3, how is 'response' defined? I don't understand the following sentence (p4, l277): "… for the LC-MS results the lowest response divided by three was used, mimicking….". Which variable does the data point size reflect? There seem to be clear differences in ball sizes. Please explain. For clarity, it would be advisable to keep the y-axes for panels A and B identical. Also, how could RT-PCR values be not obtained, apparently leading to missing Ct values (p5, l278)?

      Assuming that all collected samples from individuals in the test group in this study are visualized in Figure 3, the majority was tested positive for SARS-CoV-2. This is very different from the percentages oberserved in regular testing facilities. How was the study group composed? Were these individuals who were already admitted to the hospital?

      We have specified that the sampels were selected based on RT-PCR result and have included more negative samples in the new version of the mansucript. We have also speciied how individuals were enrolled into the study.

      It would be interesting to include more negatively tested individuals to see the distribution of 'MRM response' values in this group, since some of the negatively tested individuals (green data points) show higher than expected MRM response values if no viral protein is present at all. Related to this, I do not understand how a specificity score of 100 % (p5, l292) was obtained while some green data points (negative by RT-PCR) have higher associated MRM response values than some of the blue (positive by RT-PCR) samples. Can the authors explain this?

      The negative samples that show a stronger MRM response do not have the required qualifying ions, thereby failing the QC parameter of the assay. This has been clarified in the new version of the manuscript.

      I find the text from p6, l298 ("However…") onward more suited for the Discussion section, since this is about the interpretation of the results presented here and the use of the described methodology in diagnostics; no results are shown in this part.

    1. Reviewer #3 (Public Review): 

      Constant et al describe a study investigating an important issue - are judgements of agency metacognitive in nature? While this topic has received a lot of theoretical attention, empirically the issue is underexplored, partly due to a lack of appropriate frameworks and tools. Here the authors suggest the issue can be tackled by thinking more precisely about the computations involved in both judging agency over an outcome and in forming a (metacognitive) confidence report. This focus on constituent computations is an important conceptual strength of the paper. 

      The authors choose to operationalise metacognitive computations as those where agents have "second order access to sensory noise" and design two similar tasks - a confidence judgement task and an agency judgement task - where observers report their experience of controlling a virtual hand that can move synchronously or be delayed. Crucially, the uncertainty of the incoming sensory signals is varied, and the authors explore whether agency and confidence judgements are influenced by this sensory noise, and which kind of computational processes can best explain how. While the authors find empirically noise has an effect on both kinds of judgements, computational modelling suggests that agency judgements are best explained by a 'rescaling' model which does not include an explicit representation of the noise, whereas confidence judgements are better explained by a 'Bayesian' model which does represent noise. 

      There is lots to enjoy about this paper. It is particularly inspired to have an agency and confidence task that are so similar, making them more directly comparable. Indeed, they are compared in the paper with basically identical computational models, something which to my knowledge has never been achieved in this field of work. The models themselves all seem well chosen given certain design assumptions, though I suspect the more general insight of generating explicit computational models of agency-like judgements is one that could inspire other researchers in this field, and charts a route to progress on thorny issues on this and related topics. 

      However, while this approach is intriguing, I think the main weakness of this study relates to the core experimental manipulation: introducing temporal delays between actions and outcomes to influence ratings of control. While this is a popular approach in the field, recent authors (e.g., Wen, 2020, Consciousness and Cognition) have suggested that this manipulation may be problematic for a number of reasons. In similar types of paradigm, Wen (2020) notes that agents are able to accurately judge their control over action outcomes that are substantially delayed (e.g., well over 1000 ms) and thus it is possible that 'delay manipulation' designs actually introduce response biases, where participants are somewhat artificially reporting variance in the delays they experience rather than their actual experience/belief about what they can and cannot control. Indeed, in the methods of this present paper, the authors note participants were asked to "focus specifically on the timing of the movement" of the virtual hand, which may make this concern particularly apposite. 

      Because of this manipulation, all of the computational modelling (naturally) assumes that agents are engaged in a task where they have to detect the delay and compare this to some criterion value. Indeed, there is nothing else they could be doing in these tasks. The report of "agency" is thus generated directly from this internal variable that encodes "did I detect a delay?", and any confidence report is a metacognitive judgement about that decision. 

      This raises an important issue of conceptual validity: is a judgement of agency equivalent to judging whether an outcome was delayed or not? Many results (see review by Wen, 2020) suggest that agents can simultaneously tell an action outcome was delayed, but still judge themselves to be the agent, suggesting that an equivalence along these lines is unlikely. If so, this would mean acknowledging the generalisability of these is conclusions is potentially limited: rather than concluding that agency judgements in general are non-metacognitive, the conclusion would be the sensorimotor delay judgements in particular are non-metacognitive. The latter conclusion is by no means uninteresting, but has a somewhat narrower theoretical significance for the key debate used to frame this paper ("do agency judgements monitor uncertainty in a metacognitive way?") 

      A second important issue relates to what exactly makes a computation 'metacognitive'. For example, the authors argue their Bayesian model is a metacognitive one, because it requires the observer to have second-order access to an estimate of their own sensory noise. I am not completely sure this follows: the Bayesian model in this paper clearly incorporates an estimate of the noise/uncertainty in the signal, but not all representations of noise are second-order or metacognitive. For example, Shea (2012) has noted that in precision-weighted Bayesian inference models throughout neuroscience (e.g., Bayesian cue combination, also discussed in this paper) the models contain noise estimates but the models are not metacognitive in nature. For example, when we combine a noisy visual estimate and a noisy auditory estimate, the Bayesian solution requires you account for the noise in the unimodal signals. But - as Shea argues - the precision parameters in these models do not necessarily refer to uncertainty in the agent's perceptions or beliefs, but uncertainty in the outside world. It seems a similar argument is relevant to the Bayesian model of agency offered by the authors in the present paper. It is not clear to me why we should think the uncertainty parameter in the Bayesian model is something metacognitive (e.g., about the agent's internal comparator representations) rather than something about the outside world too (e.g., the sensory environment is noisy). 

      References:

      Shea (2012) Reward prediction error signals are meta-representational. Nous, DOI: 10.1111/j.1468-0068.2012.00863.x 

      Wen (2020). Does delay in feedback diminish sense of agency? A Review. Consciousness and Cognition, DOI: 10.1016/j.concog.2019.05.007

    1. Author Response:

      Reviewer #1 (Public Review):

      The authors provide evidence for the following key points:

      • that low and likely biologically relevant levels of oxidized phospholipids (OxPLs) can induce macrophage death and interleukin-1-beta release
      • that the pro-inflammatory activities of OxPLs can be tempered by acyloxyacyl hydrolase (AOAH) which deacylates oxPLs in vitro
      • that AOAH deficient mice exhibit exacerbated inflammation in vivo in response to exogenously delivered OxPLs, but interestingly, also in response to HCl, which presumably induces the release of endogenous OxPLs

      In general the data are a nice combination of in vitro and in vivo observations and are supportive of the conclusions. A few points should be addressed:

      • how do the authors reconcile their results with others' apparently contradictory results in the field?

      We thank the reviewer for raising this important question. We think the oxPL species used and their concentrations, the routes of MAMP and oxPL delivery, and the order of addition of MAMP and oxPLs may contribute to the observations made in different laboratories. We have added a paragraph in the Discussion and another in the Methods, lines 447-474 and lines 495-506 (highlighted).

      • which inflammasome is activated by OxPLs?

      We found that NLRP3 specific inhibitor MCC950 reduced PGPC or LPC-induced inflammasome activation and IL-1β release. To our surprise, using inhibitors we found that in addition to caspase 1, caspase 8 was also indispensable, suggesting that caspase 8 may cleave caspase 1 and activated caspase 1 cleaves pro-IL-1β (Chi et al., 2014; Philip et al., 2014). Please see lines 94-105, new Fig. 1E, F and new Fig. 3B, C.

      • can the possible effects of AOAH on the priming stimulus (Pam) be more cleanly distinguished from its effects on OxPLs?

      Because AOAH does not regulate acute responses to LPS (Lu et al., 2008) or Pam3 (Fig. 4C, IL-6) in vitro or in vivo (Lu et al., 2008; Zou et al., 2017), we do not expect AOAH to modulate the priming effects of Pam3 or LPS. To exclude this possibility, we tested CpG, which can also prime macrophages for oxPL-induced inflammasome activation. We found that when AOAH WT and KO macrophages were primed with CpG, PGPC induced more cell death and IL-1β release from AOAH KO macrophages. Please see lines 220-225 and new Fig. 4E.

      • a few other experimental controls could be provided

      We have added actin controls to all Western blots.

      Reviewer #2 (Public Review):

      Zou et al. investigated the function of acyloxyacyl hydrolase (AOAH) in inflammation caused by oxidised lipids. Using cell culture models (murine BMDs) the authors first show that oxidised lipids such as oxPAPC, POVPC and PGPC induce inflammasome activation. Focusing on AOAH, they then demonstrate that AOAH, which can act as a phospholipase A1/2 or B, can remove sn-2 oxidised fatty acyl chains and sn-1 palmitate from pro inflammatory oxidised lipids thereby modulation their ability to activate inflammasome and induce cell death inflammation (IL-1b production). Release of sn-2 acyl chains from PGPC or POVPC results in the formation of LPC (lysophophatidylcholine) which has also pro-inflammatory properties. The author demonstrate that LPC also activated inflammasomes, and that that LPS, or PGPC or POVPC-induced inflammasome activation is enhanced in BMDMs from AOAH-deficient mice. Moving to mouse models of inflammation the author find that AOAH-deficient mice have higher level of lung inflammation and injury after nasal instillation of LPS+oxPLs, and that AOAH regulates inflammation after nasal instillation of HCl.

      The conclusions of this paper are mostly well supported by data, but some aspects need to be clarified and extended.

      1) what inflammasome/s is/are activated by PGPC, POVPC and LPC?

      Zanoni et al found that PGPC or POVPC but not oxPAPC can induce IL-1β release from primed bone marrow derived macrophages (BMDM) in a NLRP3-, Caspase 1/Caspase 11-dependent manner (Zanoni et al., 2017). Yeon et al also found that POVPC induced IL-1β and processed caspase 1 release from primed BMDM, which required NLRP3 (Yeon et al., 2017). In contrast, Muri et al., found that caspase 8 but not caspase 1 or NLRP3 was required for cyclo-epoxycyclopentenone-induced IL-1β release in primed bone marrow-derived dendritic cells or macrophages We found that NLRP3 specific inhibitor MCC950 reduced PGPC or LPC-induced inflammasome activation and IL-1β release. Using other inhibitors we found that in addition to caspase 1, caspase 8 was also indispensable, suggesting that caspase 8 may cleave caspase 1 and activated caspase 1 cleaves pro-IL-1β (Chi et al., 2014; Philip et al., 2014). Please see lines 94-105, new Fig. 1E, F and new Fig. 3B, C.

      2) how does AOAH affect the anti-inflammatory functions of oxPLs which have previously been reported (PMID:29520027, 32234476 )

      It is a very intriguing question. In this study, we focus on studying the role that AOAH plays in preventing oxPL-induced inflammasome activation. We will study whether AOAH alters the anti-inflammatory functions of oxPLs in the future. We have added a sentence in Discussion, lines 471 - 474.

      3) additional controls need to be provided to increase confidence into the immunoblot analysis

      Thanks. We have added actin loading controls.

      4) experimental procedures need to be better explained and justified

      dPGPC/dPOVPC means PGPC/POVPC treated with AOAH. AOAH can release both sn-2 and sn-1 fatty acyl chains from PGPC/POVPC. In addition, AOAH deacylates LPC. Please see Fig. 2A, B and Fig. 3A. We have clarified the definition of dPGPC/dPOVPC, line 144. The samples were frozen after treatment. Freezing in the absence of glycerol inactivates AOAH. We added a sentence to make it clear, lines 568, 569.

    1. Author Response

      Reviewer #2 (Public Review): Osteoblasts are highly anabolic cells that display a high proliferation rate and secrete ample amounts of extracellular matrix, indicating that these cells have a specific metabolic profile. Here, using a set of in vivo and in vitro experiments, Sharma et al describe that SLC1A5-mediated glutamine and asparagine uptake is critical to sustain osteoblast anabolism. While the experimental setup is robust, this concept has already been put forth, questioning therefore the novelty of the results. In addition, some of the author's claims are insufficiently supported by the presented data. Especially the metabolic role of asparagine in regulating osteoblast differentiation remains enigmatic. The main concerns are detailed below.

      1. Based on their data, the authors propose that the main mechanism whereby SLC1A5 regulates osteoblast proliferation and differentiation is via glutamine uptake, while asparagine only contributes to a lesser extent. Importantly, the concept that glutamine metabolism regulates proliferation and differentiation of osteogenic cells by sustaining anabolic processes has already been described recently, even by the same research group (Yu Y. Cell Metab. 2019; Stegen S. JBMR 2021), questioning the novelty of the present study. Moreover, no metabolic rescue experiments were performed to unequivocally demonstrate that the defect in amino acid/protein synthesis in SLC1A5-deficient cells was causing the decrease in osteoblast proliferation and differentiation.

      We appreciate the reviewer’s thorough and thoughtful review and we thank the reviewer for helping us to improve this manuscript. To address this, we evaluated proliferation or osteoblast marker genes in Slc1a5 deficient cells cultured in media supplemented with 10 times the normal concentration of the reduced amino acids (excluding Gln and Asn, Fig. 4B). There was no effect on EDU incorporation, however exogenous amino acids did rescue the induction of Ibsp and Bglap to a lesser extent (Fig. S6D-E). Interpretation of these types of experiments are tricky as the uptake of NEAA may be inherently limited in osteoblasts and due to time constraints, we were unable to quantify intracellular amino acid levels in the rescued cells. Regardless, we interpret these data as affirming the necessity of Slc1a5 to provide Gln and Asn used to synthesize amino acids for osteoblast differentiation. In addition, these data indicate other metabolites (e.g. alpha-ketoglutarate, glutathione, nucleotides etc) derived from Gln and/or Asn are required for proliferation. We have modified the discussion to address this uncertainty.

      In addition, Gln and Asn tracing (carbon and nitrogen) in SLC1A5-deficient cells would confirm that Gln and Asn uptake via SLC1A5 is important for osteoblast functioning.

      We did not perform tracing experiments in the Slc1a5 deficient cells. We directly evaluated amino acid uptake using radiolabeled amino acids in Slc1a5 deficient cells (Figure 4). Slc1a5 ablation reduced the uptake of Gln and Asn. To test if Gln and Asn uptake was important for osteoblast function we directly compared the cellular effects of Slc1a5 ablation to Gln or Asn withdrawal. From these experiments we concluded that Gln and Asn uptake is essential for osteoblast differentiation.

      1. Using isotopic labeling experiments, the authors demonstrate that asparagine-derived carbon and nitrogen label several amino acids that are critical for protein synthesis, albeit at a lower level compared to glutamine. Based on these observations, they claim that the decrease in osteoblast differentiation upon asparagine depletion also occurs via a defect in protein synthesis. However, proliferation, EIF2a phosphorylation and COL1A1 levels were not affected in asparagine-deprived conditions, questioning that the decrease in differentiation is resulting from impaired protein synthesis. Further experiments to decipher the metabolic role of extracellular asparagine are therefore warranted to avoid overinterpretation of the data, including protein/matrix synthesis, analysis of amino acid levels in Asn-deprived conditions and rescue with Asn-derived metabolites.

      Again, the reviewer raises a very important point. Our data indicates that Asn does contribute to amino acid biosynthesis, chiefly Asp, however, we did not evaluate the requirement of Asn for protein synthesis directly. We think it is probable that asparagine contribution to osteoblast differentiation is multifaceted. Thus, we have softened the conclusions about asparagine and the regulation of protein synthesis to reflect this uncertainty.

      1. To inactivate SLC1A5 in vivo, the authors use the Tet-off Osx-GFP::Cre mouse line. Importantly, newborn Osx-Cre mice display severe craniofacial abnormalities, which may complicate correct interpretation of the in vivo data, especially when analyzing at embryonic stages. Do the authors observe a similar defect in osteoblast function when SLC1A5 was deleted postnatally? This might be especially relevant because the phenotype seems to wane off over time, as knockout mice at P0 only display a craniofacial phenotype, whereas long bones appear to be normal.

      The reviewer raises a very important point regarding the Sp7tTA;tetoCre line we used in this study. As mentioned, the Sp7tTA;tetoCre mice do have a partially penetrant craniofacial bone phenotype. To control for this, we only use Sp7tTA;tetoCre as “wild type” controls. In addition to the early embryonic endochondral ossification and persistent calvarial phenotypes, the Sp7tTA;tetoCre;Slc1a5^fl/fl have additional bone phenotypes compared to the Sp7tTA;tetoCre controls. This included a calvarial phenotype at both birth and 2 months of age (Figures 1 and S2). Likewise, we observe similar changes in osteoblast differentiation and bone development in the developing limbs at birth and in femurs at 2 months of age (Figure S4). Due to time constraints, we have not been able to generate sufficient numbers of mice with postnatal deletion of SLC1A5 to include here. These experiments are ongoing and will be published later.

      Reviewer #3 (Public Review): This work by Sharma et al studied the role of aa transporter, ASCT2, encoded by Slc1a5 gene, that transports mostly Glmn and Asn, in osteoblasts (OB). They use gene targeting in vitro and in vivo using Sp7-Cre driven cKO. They found that ASCT2 deletion impairs OB differentiation in vitro as well as mostly intramembranous ossification in vivo by interfering with proliferation and protein synthesis. Mechanistically, they show that Glmn uptake via ASCT2 is important for aa synthesis in OBs. This group has shown before that Glmn is essential for OB metabolism. The current work further investigates this phenomenon and identifies ASCT2 as the key mechanism of Glmn uptake into OBs. The work is logically structured and carefully done with appropriate in vivo and in vitro controls. A variety of methods is used to confirm their findings, such as in vivo immunodetection and in situ hybridization and in vitro metabolic tracing. The conclusions are well justified by the data. Minor comments are: -MicroCT methodology is not adequately described and needs to be expanded

      We appreciate this positive review of our work. We have modified the methods to adequately describe µCT methodology. We modified the methods as follows:

      “Micro computed tomography (µCT) (VivaCT80, Scanco Medical AG) was used for three-dimensional reconstruction and analysis of bone parameters. Calvariae were harvested from either newborn mice or 2-month-old mice. All muscle and extemporaneous tissue were removed and the isolated calvariae were washed in PBS, fixed overnight in 10%NBF and dehydrated in 70% ethanol. The calvariae were immobilized in 2% agarose in PBS for scanning. A fixed volume surrounding the skull was used for 3D reconstructions. In newborn calvariae, bone volume was quantified from a fixed number of slices in the occipital lobe. The threshold was set at 280. For quantification of bone mass in the long bone, 2-month-old femurs were isolated, fixed, immobilized and scanned. Bone parameters were quantified from 200 slices directly underneath the growth plate with the threshold set at 333.”

    1. The authors discussed the implications of moving away from elimination or hard elimination strategy to a softer containment strategy. At present, elimination strategy is about zero tolerance towards new cases, not so much as tha the total number of cases in the country will be 0. This is also impossible given the emergence of delta variant. The authors argue that to do that, the country first needs to vaccinate every eligible individual. This will shift the "risk perception" of people such that even if deaths occur and infections continue, there will be less anxiety and urgency to act in a way that is strict and hard, rather, covid19 related hospitalisations and deaths would be viewed as "unavoidable" but risks associated with normal life, much as we think about these things in case of lnfluenza. They also argue that once universal vaccination for covid19 is in place, then the government, in order to sustain a zero tolerance policy towards death from covid19 need to implement three things:

      • Electronic device based contact tracing and tracking
      • Issuing vaccine passports to the fully vaccinated and providing facilities to vaccine passport holders that will not allowed to the non-passport holders
      • Mass testing of people for covid19 using saliva and other tests (such as rapid antigen testing but they have not mentioned that either)

      Beyond this, they think that the health system and relationship of the government with public health and businesses need to be "overhauled" to some extent. Their advices include:

      • Delay an urgent health reform
      • create a closer partnership with the businesses such that along the lines of biosecurity and primary industries in a way that businesses are registered that will have implemented minimising covid19
      • Increase workforce capacity so that as the country is dependent on overseas health care workers, fast track residency applications and retrain or arrange for training of existing workforces and retired but capable workers
      • They have not mentioned but reasonable to understand that this is about minimising attrition of health workforce
      • Develop purpose built MIQs rather than depend on ad-hoc MIQ facilities
      • Develop a specific Pandemic controlling agency

      The authors make several assumptions but not quite clear from what they have written how they address them, although several of their desiderata and suggestions will have bearing on those assumptions. First of all, this is now established that covid19 is largely airborne, and therefore, ventilation and masking have a more prominent role in non-pharmacological intervention that what was considered earlier. But in order to enforce or enable this, individuals need to change their behaviours about precautionary practices and businesses will need to adjust their practices such as ventilation on shop floor and how many people to allow; restaurants may consider to open more open spaced. Second, while they have considered endemicity of covid19, this is open to debate. Endemicity of covid19 implies that the authors have assumed that COVID19 will have reinfections; so far, there is little evidence of re-infections as a dominant mode of transmission of this virus. Besides, as it is now known that extant vaccines do not confer "sterilising immunity", the discussions around "booster vaccinations" are in order. If so, the question of an endemic infection and thereby the premise that there will be a "shift in public risk tolerance" needs careful consideration. Third, the authors have not discussed the potential issues around "long covid", and the need to study the implications of long covid. Albeit, we may be in the throe of the birth of a new speciality in public health and medicine devoted to the study of the causes and consequences of Covid. What the implications of long COVID19 will be is open to speculations.

    1. I know the difference of Peace and Warre better then any in my Country. But now I am old and ere long must die, my brethren, namely Opitchapam, Opechancanough, and Kekataugh, my two sisters, and their two daughters, are distinctly each others successors. I wish their experience no lesse then mine, and your love to them no lesse then mine to you. But this bruit from Nandsamund, that you are come to destroy my Country, so much affrighteth all my people as they dare not visit you. What will it availe you to take that by force you may quickly have by love, or to destroy them that provide you food. What can you get by warre, when we can hide our provisions and fly to the woods?

      I think here he is trying to establish a sense of security. Mainly because the same dialogue is repeated especially in this highlighted section but also throughout the text. He seems to represent love and not harm. He really explains in this section how Powhatan, did not keep his promise and peace amongst everyone. The captain here shows that he is not trying to take anyone's food at all.

  6. deploy-preview-38--cobalt-docs.netlify.app deploy-preview-38--cobalt-docs.netlify.app
    1. Description

      This may be more report-focused thinking than anything else, but I wanted to include a sort of "Call to Action" in the version I wrote. Like, "we recommend fixing [Critical] findings as soon as possible."

      (the ones I wrote I don't think are perfect, but it seemed like another good way to indicate Severity)

    1. Author response

      _______________________

      We thank the researchers within the ASAPbio community for taking the time to provide valuable feedback on our manuscript and also Iratxe Puebla for both facilitating this review of our preprint and for consolidating the comments we received. Here we provide comments to some of the points raised by the reviewers.

      In regards to the reviewers’ comment that our “work focuses on the nwk mutant”, we note that Figures 3 and 4 show the unexpected EV cargo depletion phenotype for mutants of numerous components of the clathrin-mediated endocytic machinery. We chose the nwk mutant for our in-depth analysis because it best shows separability of functions in synaptic vesicle (mild defect) vs extracellular vesicle traffic (severe defect), and also produces null mutant viable adult flies for our APP functional studies. However, our work indicates that EV cargo regulation is a broader function for the endocytic machinery and raises the possibility that previously identified neuronal phenotypes for many endocytic mutants could be due to loss of EV cargoes from synapses. Related to this, in reference to the comment that the nwk mutant “affects EV release” we also wanted to highlight that while the EV phenotype we observed for nwk and other endocytic mutants shows both pre- and postsynaptic depletion of EV cargoes, our retromer(vps35);nwk double mutant result suggests that endocytic machinery such as Nwk is not directly regulating release of EV cargoes. Instead, we conclude that the reduction of postsynaptic EV cargoes is a secondary consequence of presynaptic depletion due to defective intracellular traffic. Your helpful feedback has alerted us that we could make these points more clear in the writing and organization of our manuscript.

      In response to the points that “...the question arises as to how specific this pathway is to EVs” we should clarify that our findings seem to be specific to cargoes for which sorting to extracellular vesicles is at least a major trajectory (ie, Syt4 and hAPP, of which 30-50% of the synaptic complement is in EVs). We agree that they both have an intracellular component (either en route to EVs or for intracellular signaling functions, which have been well-documented for APP). In response to the comment that “other cargoes that undergo clathrin-dependent endocytosis and are not packaged into EVs would need to be tested”, indeed both Syt1 or Tkv require CME machinery for their traffic (PMID12795692, PMID16459302, PMID18498733), but we find that they are not detectable in EVs and are not depleted at CME machinery mutant synapses. This indicates that local synaptic depletion is specific to cargoes for which least a significant portion of their total pool is normally packaged in EVs.

      The reviewers commented that APP and perhaps Syt4 also have intracellular itineraries and functions that may be affected by their depletion at synapses - we agree that our results have implications for both extracellular vesicle and intracellular functions of these cargoes. We fully agree that “the [Figure 2] results might not be specific to EV functions of Syt4 or hAPP” and that a more general statement (such as was suggested in the comments) here would make this possibility more explicit. Our results at least indicate that reduction of these cargoes in presynaptic terminals (but not axons, cell bodies, or dendrites) is sufficient to abrogate their functions. It will be critical in the future to identify trafficking mutants that specifically disrupt EV release without impacting levels in the donor cell, in order to directly query the physiological functions of EV sorting.

      To “provide some more information on how the [postsynaptic ɑ-HRP puncta intensity] quantification was done”, we selected an intensity threshold sufficient to distinguish postsynaptic puncta from background muscle fluorescence. We did not directly select puncta manually. Puncta with brightness above this intensity threshold were measured within a 3 μm region around the neuronal HRP. Puncta brightness was not normalized to neuronal HRP brightness, but instead was normalized to the neuronal HRP volume. This analysis was not blinded as many endocytic mutants exhibit synaptic overgrowth phenotypes that are easily visible, thus complicating the blinding process. Using a complementary automated analysis for presynaptic Syt4-GFP, we found very similar results to our manual thresholding analysis. We were however unable to successfully automate the postsynaptic signal measurements due to signal-to-noise-ratio heterogeneity, especially for HRP. Here we’d also like to clarify that in regards to “postsynaptic objects smaller than 0.015 μm were excluded”, we meant postsynaptic objects smaller than 0.015 μm3.

      In response to the comment that “...saying this trafficking opposes retromer complex sorting appears to extend beyond the results” we would like to clarify that while direct opposition of endocytic machinery to retromer on endosomes is one possible interpretation, it is not the one we favor in the discussion. We agree that endocytosis and retromer are more likely to oppose each other more indirectly by regulating overall flux through the recycling pathway. We intended to convey opposition as a genetic rather than a mechanistic argument, and we think this conclusion is supported by our data. However based on this feedback we see that we could make this more clear in our manuscript.

      We thank the reviewers for pointing out that “In Figure 4B clc depletion does not yield a significant difference in pre-synaptic Syt4 levels. However, Figure 4D the levels of Syt4 are significantly lower in clc both pre- and postsynaptically”. One possibility is that this just reflects variance in the assay, and that the subtle Syt4 phenotype in the clc mutant reached our arbitrary threshold of significance in one experiment but did not in another. There is however also a potentially interesting biological explanation. The 4B clc experiment was conducted at 25℃ while the 4D experiment was conducted at 20℃, since we found that at the lower temperature we were able to recover more clc; nwk double mutant third instar larvae. Endocytosis is well-known as a temperature-dependent process, and perhaps there is some residual endocytosis at this lower temperature in the clc mutant, making it more similar to slowed endocytosis in the endocytic accessory protein mutants (see PMID16269341), compared to a more complete block in the chc or clc 25º condition. This would suggest that slow endocytosis drives cargo into the degradative pathway, fast endocytosis into the rapidly recycling and EV pathway, while no endocytosis traps cargo in unproductive membrane cisternae. Proving this would likely require more quantitative endocytosis assays than are currently available.

      We are also appreciative of reviewers comments that will help to make our manuscript more clear, such as suggestions to present the plots consistently, to mention that individual points represent individual NMJs, and to report that C155 is a neuron-specific driver, among other helpful points.

    1. SciScore for 10.1101/2021.10.01.21264412: (What is this?)

      Please note, not all rigor criteria are appropriate for all manuscripts.

      Table 1: Rigor

      <table><tr><td style="min-width:100px;margin-right:1em; border-right:1px solid lightgray; border-bottom:1px solid lightgray">Ethics</td><td style="min-width:100px;border-bottom:1px solid lightgray">IRB: Ethics Statement: The Medical Ethical Committee of the Amsterdam UMC approved this study on January 19th, 2021 (Study number:2021.0170).</td></tr><tr><td style="min-width:100px;margin-right:1em; border-right:1px solid lightgray; border-bottom:1px solid lightgray">Sex as a biological variable</td><td style="min-width:100px;border-bottom:1px solid lightgray">not detected.</td></tr><tr><td style="min-width:100px;margin-right:1em; border-right:1px solid lightgray; border-bottom:1px solid lightgray">Randomization</td><td style="min-width:100px;border-bottom:1px solid lightgray">not detected.</td></tr><tr><td style="min-width:100px;margin-right:1em; border-right:1px solid lightgray; border-bottom:1px solid lightgray">Blinding</td><td style="min-width:100px;border-bottom:1px solid lightgray">not detected.</td></tr><tr><td style="min-width:100px;margin-right:1em; border-right:1px solid lightgray; border-bottom:1px solid lightgray">Power Analysis</td><td style="min-width:100px;border-bottom:1px solid lightgray">not detected.</td></tr></table>

      Table 2: Resources

      No key resources detected.


      Results from OddPub: We did not detect open data. We also did not detect open code. Researchers are encouraged to share open data when possible (see Nature blog).


      Results from LimitationRecognizer: We detected the following sentences addressing limitations in the study:
      Our study has a few notable limitations. Although this is one of the first studies to connect viral load with increased risk of mortality, the number of in-hospital deaths in our study population was low, and larger studies are needed to assess the role of viral load in the outpatient setting and after adjustments for potential confounding factors. The data on hospital (and ICU) admission of our study population were collected from the two large teaching hospitals our region that largely cover the adherence area of the Regional Public Health Laboratory Kennemerland (where the tests were performed). It can however not be excluded that (ICU)hospitalization data of some of the included patients were missed when they were admitted to other hospitals in adjacent regions. However, we do not think that this will have influenced our main results as the chance of admission to a hospital in another region is not likely to be related to the initial SARS-CoV-2 viral load of a particular patient and would only have resulted in nondifferential misclassification of our outcome measurement. And finally, including only patients who were able to have themselves tested at Public Health Service testing facilities may have resulted in a healthy selection of all SARS-CoV-2 positive patients, as patients were able to make an appointment and go to the public health care facility. Even though this generally took place after a mean of 2 days, patients who got very ill, or needed to be admitted to the ...

      Results from TrialIdentifier: No clinical trial numbers were referenced.


      Results from Barzooka: We did not find any issues relating to the usage of bar graphs.


      Results from JetFighter: We did not find any issues relating to colormaps.


      Results from rtransparent:
      • Thank you for including a conflict of interest statement. Authors are encouraged to include this statement when submitting to a journal.
      • Thank you for including a funding statement. Authors are encouraged to include this statement when submitting to a journal.
      • No protocol registration statement was detected.

      Results from scite Reference Check: We found no unreliable references.


      <footer>

      About SciScore

      SciScore is an automated tool that is designed to assist expert reviewers by finding and presenting formulaic information scattered throughout a paper in a standard, easy to digest format. SciScore checks for the presence and correctness of RRIDs (research resource identifiers), and for rigor criteria such as sex and investigator blinding. For details on the theoretical underpinning of rigor criteria and the tools shown here, including references cited, please follow this link.

      </footer>

    1. For example, a brainregion may be associated with other behaviors, neurotransmit-ters, or single cell data that in turn might shed light on the orig-inal behavior of interest.

      I think looking at patterns of activation rather than specific brain regions may reveal more insights. As we know different regions perform multiple tasks and pin pointing one specific behavior is difficult.

    1. Author Response:

      Reviewer #1:

      A role for integrins in lowering the threshold for B cell activation was first observed over 15 years ago, but the mechanism has remained elusive. In this paper, Wang et al. investigate the role of LFA-1:ICAM-1 ligation in B cell synapse formation using live-cell super-resolution fluorescence microscopy in both primary B cells and the A20 B cell line. The use of super-resolution imaging is critical to the investigation as it reveals a level of organisation of the actomyosin network that is not visible with conventional microscopy approaches such as TIRF microscopy. They find that LFA-1:ICAM-1 ligation promotes the formation of actomyosin arcs that regulate various activities in the B cell synapse including BCR signalling, BCR:antigen microcluster transport, and the centralisation of antigen. In agreement with earlier studies, they show that LFA-1:ICAM-1 ligation is required for B cells to centralise antigen that is present at very low density. They also demonstrate that myosin IIa contractility is required for the formation of the actomyosin arcs and promotes the exertion of strong traction forces on the antigen- and ICAM-1-presenting substrate. Using a small molecule inhibitor of formin activity in combination with miRNA knockdown of the formin mDia1, the authors show that the actomyosin arcs originate at the outer edge of the synapse and that their generation is formin dependent. These data provide a much-needed advance to our understanding of the role LFA-1 plays in the earliest events in B cell responses to antigen.

      The conclusions of the paper are mostly well supported by the data, but there are a few points that would need to be clarified.

      1) The requirement for LFA-1:ICAM-1 ligation in the formation of the actomyosin arcs is not clear. The authors observe that ~30% of B cells form actomyosin arcs with anti-IgM stimulation only (Figure 1). Does LFA-1:ICAM-1 ligation simply stabilise the arcs and therefore make their appearance more likely, or does it promote the formation of a distinct actomyosin network with unique functions? The images and videos selected to represent cells stimulated with anti-IgM only (Figure 1; Movies 1A and 1B) seem form a highly branched actin network throughout the synapse, but it would be informative to see cells having the actomyosin arcs for comparison. Since B cells stimulated with anti-IgM alone are capable of signalling and centralising antigen, it would be interesting to know whether and how these two populations (with and without arcs) differ.

      We thank the reviewers for their questions regarding this central aspect of our study. In response to the reviewers’ statement “The requirement for LFA-1:ICAM-1 ligation in the formation of the actomyosin arcs is not clear”, our results state that “Consistently, scoring B cells for the presence of a discernable actin arc network showed that the addition of ICAM-1 increases the percentage of such cells from ~30% to ~70% (Fig. 1G).” Importantly, we then state that “dynamic imaging showed that the arcs in cells engaged with anti-IgM alone are typically sparse and transient (Movies 1A and 1B), while those in cells engaged with both anti-IgM and ICAM-1 are dense and persistent (Movies 2A and 2B).” To emphasize this point, which we think is clear when comparing Movies 1A/1B to Movies 2A/2B, we have now added the following two sentences to the text: “In other words, when B cells receiving only anti-IgM stimulation do form discernable arcs (see, for example, those marked by magenta arrows in Fig. 1A and 1B), they are much sparser and less robust than those formed by cells also receiving ICAM-1 stimulation. Moreover, we never saw even one B cell receiving anti-IgM stimulation alone that possessed a robust actin arc network.” Please note that the magenta arrows in Fig. 1A and 1B were added upon revision. In summary, the cell shown in Fig. 1E, which lacks discernable arcs, is representative of ~70% of anti-IgM stimulated cells, while the cell shown in Fig. 1F, which possesses a robust arc network, is representative of ~70% of anti-IgM+ICAM-1 stimulated cells.

      We would also like to address what we think is a misunderstanding regarding our images in Figure 1, as reflected in reviewer 1’s statement: “The images and videos selected to represent cells stimulated with anti-IgM only (Figure 1; Movies 1A and 1B) seem form a highly branched actin network throughout the synapse”. The outer, Arp2/3-generated, branched network comprising the dSMAC/lamellipodium in primary B cells is really quite thin under both stimulation conditions (please see Fig. 1, E1, E2, F1 and F2). In other words, we would not characterize the region between this thin, outer, canonical branched actin network and the central actin hypodense area (i.e. the region corresponding to the pSMAC) in B cells engaged with anti-IgM alone as “a highly branched actin network throughout”. We described it in the text as “a highly disorganized mixture of short actin filaments/fibers and actin foci”. While it likely contains some branched filaments, it is not a canonical branched actin network like the one comprising the dSMAC. Indeed, it is a lot like the mixture of actin asters, actin foci, branched actin and linear filaments described in Hela cells using the same imaging technique ((Fritzsche et al., 2017); we have now cited this paper). Of note, A20 B cells make a much bigger branched actin/dSMAC/lamellipodium than do primary B cells (compare the image of the representative A20 B cell in Fig. 1J to the various images of primary B cells in this figure). Interestingly, this difference between immortalized cells and primary cells is conserved in T cells, as Jurkat T cells make a much bigger branched actin/dSMAC/lamellipodium than do primary T cells (Murugesan et al, JCB 2016).

      Although the reviewers did not specifically comment on why only ~70% of primary B cells engaged with both anti-IgM and ICAM-1 make actomyosin arcs, we note that this is also the case for both Jurkat T cells and primary T cells (Murugesan et al, JCB 2016). We do not know why the number does not go to 100%, but the ~70% limit is the case for both B cells and T cells. Of note, in unpublished work we see that LFA-1 ligation also promotes actomyosin arc formation in T cells.

      With regard to the reviewers’ question “Does LFA-1:ICAM-1 ligation simply stabilize the arcs and therefore make their appearance more likely, or does it promote the formation of a distinct actomyosin network with unique functions?”, we think that ICAM-1 engagement likely leads to the strong activation of RhoA, which then serves to drive both the formation of actin arcs by recruiting, unfolding, and activating mDia at the plasma membrane, and the stabilization and concentric organization of these arcs by activating myosin 2A filament assembly and contractility. In other words, we think ICAM-1 engagement leads simultaneously to the creation and stabilization/organization of the arcs. While it is true that BCR stimulation alone activates RhoA signaling to some extent (see Saci and Carpenter, Mol Cell 2005 and Caloca et al, J Biol Chem 2008), and that this may account for the sparse actin arcs seen in cells stimulated with anti-IgM alone, it is likely that RhoA signaling is more robust with the addition of integrin co-stimulation (Lawson & Burridge, 2014) and that this would promote the creation of the actomyosin arcs seen in these cells. That said, without independent measures of the creation and stabilization/turnover of the arcs, we cannot gauge the relative significance of creation versus stabilization/turnover in determining the steady state amount of arcs. To address this limitation, we have added the following sentence to the section of the Discussion dealing with integrin-dependent signaling pathways leading to actomyosin arc formation: “Finally, future studies should also seek to clarify the extent to which integrin ligation promotes the formation of actomyosin arcs by driving their creation versus stabilizing them once created.

      With regard to the reviewers’ comment that “B cells stimulated with anti-IgM alone are capable of signalling and centralising antigen” we would like to emphasize that our study focuses on B cell immune synapse formation under limiting antigen conditions, where a previous study (Carrasco et al. Immunity 2004) and our data in Fig. S5 show that the impairments in BCR signaling and antigen centralization seen under this condition are rescued by integrin co-stimulation. We expand upon these findings by showing in Figures 5 and 6 that this integrin-dependent rescue of antigen centralization and BCR signaling requires actomyosin. In other words, the actomyosin arc network described here is required for integrin co-stimulation to promote antigen centralization and signaling under limiting antigen conditions. We agree with the reviewer that under non-limiting antigen conditions B cells can signal and centralize antigen in the absence of ICAM-1. That said, these high levels of BCR stimulation are probably not as physiological as limiting BCR stimulation. Finally, our data in Figure S7 shows that antigen centralization in primary B cells receiving non-limiting anti-IgM stimulation alone is also significantly impaired when myosin is inhibited. This suggests that cells receiving high levels of BCR stimulation employ myosin in some fashion to drive antigen centralization. We now close the section describing these results with the following statement: “That said, additional experiments should help define exactly how myosin contributes to antigen centralization in B cells receiving only strong anti-IgM stimulation."

      Finally, and most generally, we avoided the use of the word “requirement” as in the reviewer’s statement “the requirement for LFA-1:ICAM-1 ligation in the formation of the actomyosin arcs is not clear”. Given that some B cells receiving only anti-IgM stimulation create arcs (albeit sparse and transient), we were careful to say throughout the text that ICAM-1 engagement “promotes” actomyosin arc formation. We think our evidence for this is compelling.

      2) The authors propose that the contractile actomyosin network formed in the presence of LFA-1:ICAM-1 interactions promotes B cell activation especially at low antigen concentrations; however, their data focus only on early signalling (pCD79a and pCD19) and it would be helpful to know whether LFA-1:ICAM-1 interactions impact signalling further downstream.

      We thank the reviewer for this important suggestion, which we will address in a future study.

      3) The observation that some GC B cells centralise antigen is very interesting, but there are a few aspects of this investigation that should be expanded upon. The authors show that with LFA-1:ICAM-1 interactions, GC B cells are about equally likely to organise BCR:antigen complexes into peripheral clusters and centralised clusters. It would be informative to have, in the same study (Figure 7), a comparison with GC B cells stimulated with antigen alone. The reason is that other studies investigating GC B cell synapse architecture did not quantify antigen organisation in this way, so it is difficult to make comparisons with previous work. It would also be very useful to see how the actomyosin network is organised in GC B cells exhibiting different synaptic architectures (i.e. peripheral versus central clusters), especially given the critical role of myosin IIa activity in GC B cell antigen affinity discrimination. Additionally, while it is a very interesting observation that LFA-1:ICAM-1 interactions may affect GC B cell synapse organisation, it is not clear whether this has an impact on cellular function. For instance, does antigen and actomyosin organisation in GC B cell synapses contribute to differences in signalling or traction force generation? In the introduction the authors suggest that actomyosin arcs contribute to antibody affinity maturation (line 87-88), but without functional studies to support this claim I think it is too speculative.

      We thank the reviewer for their comments and suggestions regarding our GC data. Our sole purpose in performing the experiments in Figure 7 was to see if GC B cells can also make actomyosin arcs. We did this because recent papers and reviews state that the organization and dynamics of actin at GC B cell synapses are completely different from the organization and dynamics of actin at naive B cells synapses. As such, these initial observations are meant to add to previous work on GC B cells rather than generate direct comparisons. The reviewers appear to agree that the data in Figure 7 shows convincingly that a subset of GC B cells can make actomyosin arcs that are indistinguishable in appearance from those formed by naive B cells (so the specific claim we are making does not “require additional supporting data”). Rather, the reviewers request that we expand on the data in Figure 7 in several ways, some of which we had already mentioned in the Discussion (“While additional work is required to prove that the subset of GC B cells with actomyosin arcs are the ones that centralize antigen, this seems likely given our evidence here that actomyosin arcs drive antigen centralization in naïve B cells.”, and “Future work will also be required to understand why GC B cells vary with regard to actomyosin organization and the ability to centralize antigen 18 (e.g. dark zone versus light zone GCs)”). In addition to these statements, we now end the section describing the results in Figure 7 with the following statement: “We note, however, that our conclusions regarding actomyosin arcs in GC B cells require additional supporting data that include testing the ICAM-1 dependence of actomyosin arc formation and quantitating the contributions that this contractile structure makes to GC B cell traction force, signaling, and antigen centralization.”

      With regard to the reviewers concerns indicated by their comment “In the introduction the authors suggest that actomyosin arcs contribute to antibody affinity maturation (line 87-88), but without functional studies to support this claim I think it is too speculative”, we have changed the relevant sentence to “Finally, we show that germinal center (GC) B cells can also create this actomyosin structure, suggesting that it may contribute to the functions of GC B cells as well”.

      Reviewer #2:

      The manuscript utilizes elegant imaging tools to describe the contractile actomyosin arcs, induced by integrin-ligation, and their involvement in antigen gathering in B cells. The findings are important and have the potential to make a considerable impact in the field. The main conclusions are well supported by strong data and the manuscript convincingly brings across the need of integrin-ligation to induce generation of the arc network and the role of this structure in antigen gathering. The methods and the quality of imaging are state-of-the-art and provide an important example for future studies in B cell immune synapse. Some aspects of the study would benefit from clarification and extended experimentation or analysis.

      1) In addition to cultured B cells, the work includes naïve primary B cells as well as isolated germinal center B cells. While the use of primary cells adds value to the study, in most cases the cells are activated first with LPS prior to transfection with F-Tractin constructs. Such a treatment is likely to alter the cytoskeletal features of the naïve B cells and, thus, it would be informative to provide an analysis of this effect.

      We thank the reviewer for commenting on this. To clarify, we treated primary B cells with LPS to promote cell survival during the harsh nucleofection/electroporation conditions that otherwise kill these fragile cells. Moreover, the cells were rested for 24 hours post-nucleofection in the absence of LPS to promote return to a resting state, as previously described (see(Freeman et al., 2011)). Moreover, only those primary B cells used for live cell imaging of the F-actin using the F-actin reporter F-Tractin were LPS treated. The majority of our experiments employed non-treated ex vivo B cells that were fixed, stained and imaged for quantitation. Importantly, under conditions of ICAM-1 co-stimulation, the actomyosin arcs formed by ex vivo B cells and by LPS-activated cells were indistinguishable. For example, compare the F-Tractin-expressing cell in Fig. 3A to the non-treated cells in Fig. 3D and Fig. 7A. To summarize, then, only live-cell imaging experiments that required F-Tractin to visualize F-actin dynamics were performed using LPS-activated B cells. Finally, we clarified in the Methods that we refer to all primary B cells as “naïve” B cells because they had not been previously activated by antigen at the time of antigen stimulation.

      Reviewer #3:

      The work 'A B cell actomyosin arc network couples integrin co-stimulation to mechanical force-dependent immune synapse formation' by Wang et al. describes the importance of integrin mediated B-cell co-stimulation for IS formation in B-cells by fostering the formation of myosin II A driven actin arcs that are essential in the transport of IgM clusters towards the IS center.

      The work presented here, i.e. experiments and analysis, is very thoroughly done and includes tests and controls using different labelling strategies and constructs of myosin II A, multiple cell types including primary cells and a range of chemical inhibitors to rule out artefacts.

      The authors claim that the observation of actin arcs in B-cells co-stimulated by ICAM-1 - LFA-1 interaction is important for the efficient activation of B-cells in the presence of limiting levels of anti-IgM and this is very well supported by the experiments. However, it was a bit surprising that the paper did not draw much of parallels between the observed phenomenon and the reported actin arcs in activated T-cells even though some of the authors were very much involved in such work on T-cells. If there is a good reason to believe there is no ground to draw comparisons, this would then also need to be highlighted by the authors.

      We thank the reviewer for their comments. We have now added the following two sentences to the Discussion: “It is also important to note that the contractile actomyosin arcs described here in B cells and the actomyosin arcs described previously in T cells (Murugesan et al., 2016) share much in common as regards formation, organization and dynamics (Hammer et al., 2019; Wang & Hammer, 2020). Going forward, it will be vital to define how these two immune cell types harness the same contractile synaptic structure to accomplish different goals (i.e. antibody production by B cells and target cell killing by T cells).”

      The work on establishing the drivers of actin arc formation and dynamics is well done, but it is important to note that previous work has analyzed actin arc formation in other cell types. Work by Bershadsky has already established many 'ground rules' for the formation of actin arcs and the role of integrin adhesion, formin activity and myosin II in the process (Tee YH, Shemesh T, Thiagarajan V, Hariadi RF, Anderson KL, Page C, Volkmann N, Hanein D, Sivaramakrishnan S, Kozlov MM, Bershadsky AD. 2015. Cellular chirality arising from the self-organization of the actin cytoskeleton. Nat Cell Biol 17:445-457. doi:10.1038/ncb3137). It might be very instructive if the authors could put their findings in relation to this work.

      The formation of actin arcs is also well studied in U2OS cells and the results presented here could highlight interesting general features of this process observed in very different cell types (Tojkander S, Gateva G, Husain A, Krishnan R, Lappalainen P. 2015. Generation of contractile actomyosin bundles depends on mechanosensitive actin filament assembly and disassembly. Elife 4:1-28. doi:10.7554/eLife.06126; Bur-nette DT, Shao L, Ott C, Pasapera AM, Fischer RS, Baird MA, Der Loughian C, Delanoe-Ayari H, Paszek MJ, Davidson MW, Betzig E, Lippincott-Schwartz J. 2014. A contractile and counterbalancing adhesion system controls the 3D shape of crawling cells. J Cell Biol 205:83-96. doi:10.1083/jcb.201311104).

      In this regard, the findings about the importance of myosin II A activity, integrin adhesion and mDia1 in the formation of actin arcs is not that surprising and the authors might rather highlight the important role of these newly studied structures for co-stimulation in B-cells as this is the more novel and insightful bit of the work.

      We thank the reviewer for their comments. Indeed, our prior work in T cells (Murugesan et al., 2016; Yi et al., 2012) also linked formin activity and myosin 2 contractility to the formation of actin arcs and the generation of integrin-based adhesion. We now cite the papers highlighted by the reviewer using the following sentence in the revised Discussion: “It is important to note here that several earlier studies performed using other cell types have also linked formin activity and myosin 2 contractility to the formation of actin arcs and the generation of integrin-based adhesions (Burnette et al., 2014; Tee et al., 2015; Tojkander et al., 2015).” As for highlighting the relevance of our results for the B cell field, we think we have done that by demonstrating the existence of this contractile network in B cells, and by showing that it provides mechanistic insight into how integrin co-stimulation promotes synapse formation and B cell activation when antigen is limiting. Given that many recent studies of actin cytoskeletal dynamics in B cells were performed in the absence of LFA-1 ligation, we think our findings invite a critical “reset” for the way in which future B cell studies should be approached by highlighting the need for integrin co-stimulation when examining the roles of actin and myosin in B cell activation.

    1. We are hearing about an increase in rates of severe anxiety and depression-related concerns. We also know that this may have been even more challenging for people who were already struggling with mental-health concerns. There is emerging data to show that rates of self-injuring behaviors have increased as well.

      I can't begin to imagine how this pandemic affected those who have already existing mental health conditions. And the fact that individuals, and children especially, were not getting the right amount of exercise is definitely a concerning factor to think about.

    1. I don’t know if I could have survived seven years of my childhood without the soul-saving rituals of my Persian culture. I grew up amid the Iran-Iraq War, which killed a million people. Besides the horrors of the war, freedom of thought and expression were severely restricted in Iran after the Islamic revolution. Women bore the brunt of this as, in a matter of months, we were forced to ditch our previous lifestyle and observe a strict Islamic attire, which covered our bodies and hair. We lost the right to jog, ride a bicycle, or sing in public. Life seemed unbearable at times, but we learned to bring meaning into uncertainty and chaos by maintaining grounding practices and developing new ones.

      I think the essay will be about how rituals have provided the author peace in difficult times, and why they may do the same for others. The author is trying to create sadness and empathy. They are also using pathos.

    Annotators

    1. Reviewer #1 (Public Review): 

      Overall, this manuscript presents a careful study of sea star larval nervous system regeneration using new transgenic tools for marking and following cells involved in regeneration. The authors provide a nice, well-written introduction to their study in the Abstract and Introduction sections. I do have one major issue with the wording they are using for describing what can be done with the transgenic tools they have developed. 

      They mention in the third paragraph of the Introduction that "Only cell tracking can definitively establish the origin and trajectory of cells during regeneration and resolve the debate as to the role of stem cells versus cellular reprogramming in echinoderms." And then in the final paragraph they state that "We establish a novel cell lineage tracking system to determine the cellular origin of these regenerated neurons." 

      The system they develop does mark individual sox2 and sox4 expressing cells but I object to it being called a "cell lineage tracking system" as this is a very specific term used for a set of methods that allow for tracing the fate of individual cells and all of their progeny, traditionally through development or with stem cells. In essence cell lineage tracking/tracing provides the identification of ALL progeny of a single cell. According to a Primer on Lineage Tracing by Kretzschmar and Watt (2012) https://www.cell.com/fulltext/S0092-8674(12)00003-700003-7)<br> "For any lineage tracer, the key features are that it should not change the properties of the marked cell, its progeny, and its neighbors. The label must be passed on to all progeny of the founder cell, should be retained over time, and should never be transferred to unrelated, neighboring cells." 

      I strongly believe that the BAC-reporters developed in this manuscript do not fit that definition of a cell lineage tracing/tracking system and new verbiage should be used to describe these tools. These could very simply be referred to as fluorescent BAC-reporters and describe specifically how they are used to mark and follow the fate of cells expressing the Sox2 and Sox4 genes. The only way the language of a cell lineage tracing/tracking system could be used is if they had created a BAC-reporter for a gene that was expressed constitutively throughout a cell lineage as it progresses or if the protein expression (the tracer) was passed along to all progeny of the cell expressing that gene. My understanding is that the gene expression of Sox2 and Sox4 is highly dynamic and thus the label, by definition, is not going to be passed on to all progeny of the founder cell. I do think this is a powerful system, I just object to how the authors have chosen to describe it in the manuscript. Careful rewording can still make the reader aware of the limitations and advantages of this system and will avoid misunderstanding. 

      Therefore, all mentions throughout the manuscript of "a lineage tracing system" would need to be removed and replaced with wording that accurately reflects the true nature of these reporters, simply as photoconvertible expression reporters that can show Sox2 or Sox4 expressing cells. This includes text in the Results and Discussion section, e.g. "To our knowledge, this is the first time that any cell lineage tracing studies have been performed in echinoderm regeneration." 

      Results: 

      The authors nicely present their larval regeneration system and highlight the timeline of when serotonergic neurons regenerate over a period of 21 days. They then demonstrate that embryonic neurogenesis pathways are recapitulated during larval regeneration. Then, they present results from their photoconvertible expression reporters and demonstrate three populations of cells in decapitated larvae. The green-only sox4+ cells are the most interesting population - these are cells that are induced to express sox4 only after decapitation. Comparing embryogenesis and larval development demonstrated that the wound response in larvae involves specifying new sox4+ cells, something that had ended by 4dpf in normally developing larvae. 

      The co-injected double BAC recombinant larvae showed colocalization of sox2+ and sox4+ in regenerating larvae. De novo sox2 expression following bisection together with colocalization with sox4 expression nicely shows that these new sox2+ cells contribute to the neural lineage. Considering that the colocalization appeared to be a rare-ish event (only observed in 4 out of 15 larvae), it would be nice if the authors could comment on why this may be. Is it just a truly rare event to catch or could it have anything to do with the reporters themselves? 

      Same question about the sox2+ cells that do not express sox4:Cardinal by 3dpb. Can the authors comment specifically on whether they think there are multiple subpopulations of sox2+ cells and why some get specified to the neural fate while others do not? 

      The final experiment using cell division inhibitor Aphidicolin was very clever and nicely demonstrates that cells that did not previously express sox2 can be induced in the absence of cell division. It would be helpful if the authors could indicate how many larvae showed this pattern as they did for the previous colocalization experiment. 

      Discussion:

      In the final paragraph of the Discussion, the authors discuss a dichotomy between the use of stem cells versus de- or trans-differentiation in different model systems of regeneration. They describe the planarian system in the following way: "For example, the freshwater planarian, Schmidtea mediterranea, utilizes a population of heterogeneous, pluripotent somatic stem cells, called neoblasts, to proliferate and differentiate to replace body parts (Sánchez Alvarado, 2006)" and contrast this with Hydra and axolotl, saying "Conversely species such as Hydra and axolotl, refate differentiated cells either through dedifferentiation or transdifferentiation (Gerber et al., 2018)." I think this oversimplifies the current understanding of these systems. For example, a recent paper by Raz et al. 2021 (Cell Stem Cell 28(7): 1307-1322.e5) makes the case that Schmidtea mediterranea is capable of having specialized neoblasts undergo fate-switching and "propose a non-hierarchical lineage model for neoblasts, in which a neoblast can specify one of a diverse set of possible fates in the course of a single division and specialized neoblasts can divide to generate neoblasts that can specify different fates." In essence, this could be considered something more flexible and complicated than what the authors described - just using pluripotent neoblasts to proliferate and differentiate to replace body parts. And although Hydra is known to use trans-differentiation during regeneration, this organism also employs stem cells in the process of regeneration. Please see Siebert et al. 2008 (Developmental Biology 313(1): 13-24) for a discussion of how both mechanisms are employed in this regeneration model. Therefore, I think it is an oversimplification to characterize these regeneration models as either using stem cells OR using de- or trans-differentiation. I think in these systems, there is not a simple dichotomy and more flexibility has been demonstrated in how regeneration is accomplished than the authors describe here and the text would need to be revised accordingly.

    1. However, if you are exposed to that word again, the connections will strengthen. If you repeatedly use that word, the connections will become so strong that the word will become part of your long-term memory.2 “As a single footstep will not make a path on the earth, so a single thought will not make a pathway in the mind. To make a deep physical path, we walk again and again. To make a deep mental path, we must think over and over the kind of thoughts we wish to dominate our lives.” –Henry David ThoreauThoreau was really onto something. The best metaphor for understanding neuroplasticity, as it relates to learning and forgetting, is to imagine creating a path through the forest. If no one has ever walked there, there will be no path to follow. The first walk will be very difficult: It will be unclear which way you should go, and there will be bushwhacking. This is the struggle of learning something new, the struggle of being a beginner.Bushwhacking:If the path is walked repeatedly, the brush gets cleared, and a visible trail through the forest begins to appear. The path becomes easier to follow. You may still get lost sometimes, but at least you’re done bushwhacking. This is what it’s like to have a basic understanding of a new idea. This is what it’s like to be an intermediate.

      I like this comparison about the brush and the path. It really gives us that imagery that helps us understand what learning does to our brains.

    1. Author Response:

      Reviewer #1:

      In this study, the authors use CyTOF-based analysis to characterise spike-specific T cell responses following mRNA vaccination. They seek to understand both the breadth of responses to 'wildtype'-like and variant spikes, as well as the differences between T cell responses from convalescent and previously uninfected subjects. Consistent with other studies, they find that spike-specific T cell responses are similar across different variants, both in frequency and phenotype. In contrast, however, they identify several phenotypic differences in the T cell response elicited by infection, vaccination, or vaccination following infection.

      Despite a somewhat limited sample size, they clearly identify changes in memory phenotype and chemokine receptor expression that may affect T cell trafficking to mucosal tissues across infection and vaccination. While inclusion of additional chemokine receptors (such as CXCR3) in the CyTOF panel would have aided in characterising these cells, this data highlights how infection and vaccination may elicit distinct T cell responses.

      In fact CXCR3 and CCR4 were chemokine receptors that were considered for the panel, but could not be included as antibodies against these antigens do not stain properly on cells fixed with paraformaldehyde (PFA), and for logistical and biosafety reasons the specimens analyzed in this study had to be PFA-fixed before CyTOF staining. Although we have previously analyzed expression of CXCR3 and CCR4 on T cells by CyTOF (Cavrois et al, Cell Reports 2017 20(4):984 PMID: 28746881; Xie et al, Cell Reports 2021 35(4):109038 PMID: 33910003), those studies were exclusively performed on viable cells, and not on COVID-19 patient specimens. All our prior CyTOF phenotyping studies using COVID-19 patient specimens (Neidleman et al, Cell Reports Medicine 2020 1(6):100081 PMID: 32839763; Neidleman et al, Cell Reports 2021 36(3):109414 PMID: 34260965; Ma et al, J Immunol 207(5):1344, PMID 34389625), as well as some of our non-COVID-19 studies (Ma et al, Elife 9:e55487 PMID: 32452381; Neidleman et al, Elife 2020 9:e60933 PMID: 32990219), were performed on fixed cells, where CXCR3 and CCR4 unfortunately could not be included as parameters analyzed.

      Future studies will be required to better assess the functional impacts of these phenotypic differences on T cell recall and contribution to protective immunity.

      We absolutely agree that future studies should be pursued to better assess the functional impacts of the phenotypic differences on T cell recall, and on contribution to protective immunity. Such studies will most certainly require use of animal models, and in fact are studies that we have just begun (mouse model) or will soon begin (non-human primate model). To fully acknowledge the need for such functional studies, we have now added to multiple sections of the Discussion the need for future studies to incorporate animal models (Line 472 and Lines 488-491), including the statement “Such follow-up studies should also examine the functional outcomes of the discoveries made here (e.g., effect of chemokine receptor expression on homing of infection- and vaccine-elicited SARS-CoV-2-specific T cells), including in animal models of SARS-CoV-2 infection.”

      Reviewer #2:

      The authors address an important question, whether it people who have had Covid19 and are then vaccinated with one mRNA Spike vaccines made better immune responses than those who had not previously been infected and have two shots of the vaccine. They also compare responses to different virus variants and find extensive cross reactions and no differences between the groups - an important result.Their main finding is a difference in the quality of the CD4+ T cells in the 'Covid-vaccinees' compared to the 'naive double vaccines'. They suggest that T cells in the former may home better to the respiratory tract and persist longer.

      The major strengths are:

      • The methodology used, based on Cytof multiparameter analysis of antigen responding CD4 and CD8 T cells.

      • Demonstration that the second vaccine dose in the naive group 'improves' the T cell response.

      • Demonstration that a second vaccination in the Covid19 group does not improve the T cells.

      We thank the Reviewer for the nice summary and for the positive comments.

      Weaknesses:

      Fully (and commendably) acknowledged in the manuscript:

      • The study groups are small

      • The antigen specific T cells are stimulated in vitro so may be distorted, nevertheless there were still differences

      We agree with the Reviewer about the listed weaknesses of the study. We note that we had in our original manuscript acknowledged all these weaknesses within our “Limitations” section, including the fact that we had to stimulate our samples to identify and characterize the SARS- CoV-2-specific T cells. We have now expanded the part about our having stimulated the samples, by proposing that future studies should take advantage of tetramer technology to characterize cells in their baseline (non-stimulated) states, whilst acknowledging that such studies would for the most part be limited to CD8+ T cell responses as tetramer reagents for CD4+ T cells are less robust (Lines 500-506).

      Not acknowledged but possibly outside the scope of this study:

      • The reader will wonder how this affects the antibody response which ultimately is the main protector from reinfection and also how the T cell responses might impact on disease severity after post vaccination (re)-inrfection

      Serological assays were not performed in this study; however we fully agree with the importance of associating the in-depth phenotypes of vaccine-elicited SARS-CoV-2-specific T cells with the antibody response. In fact, just as we went very “deep” into the phenotypes of SARS-CoV-2-specific T cells in this study, we are at the moment optimizing techniques to, in an analogous fashion, deeply characterize the serological response to vaccination. This entails optimizing a flow cytometry-based approach we recently introduced and implemented on a small number of specimens (Ma et al, J Immunol 207(5):1344, PMID 34389625), to be able to simultaneously assess the levels of IgA1, IgA2, IgE, IgG1, IgG2, IgG3, IgG4, and IgM against the S1, S2, and RBD domains of the SARS-CoV-2 spike protein in a large number of patient specimens. Once we’ve optimized the assay and applied it on the vaccine specimens, we plan to associate the resulting 24-parameter serological datasets (8 isotypes of antibodies each against 3 antigens = 24 parameters total) with the high-dimensional SARS-CoV-2-specific T cell datasets from this study, but that will be its own separate (and large) study and beyond the scope of this current one. As generating such serological data will take at least 3-6 months to complete, and the focus of this study is on SARS-CoV-2-specific T cells (and all conclusions we drew were based only on the T cell data), we think it appropriate that we limit this study to deep-phenotyping of the T cells. We have now brought up in the last part of our “Limitations” section the lack of serological analysis in this current study as a limitation, and how follow-up studies should associate serological responses with the T cell responses characterized here. (Lines 506-511: “A final limitation is that serological analyses were not performed in this study. As coordination between the humoral and cellular arms of immunity are likely key to effectively controlling viral replication, future studies should assess to what extent the breadth, isotypes, and functional features of spike-specific antibodies elicited by vaccination associate with the herein described phenotypic features of vaccine-elicited SARS-CoV-2-specific T cells.”)

      With regards to how T cell responses might impact disease severity and breakthrough infections, this is an aspect we are very interested in investigating, as detailed in our final response further below.

  7. Sep 2021
    1. exists outside of a document

      I think it is important to recognize that the original article that motivated much of the early research into Hypertext, including that of Ted Nelson, who coined the term "Hypertext," assumed that "associative links" would, in fact, exist "outside" the document. That article was, of course, Vannevar Bush's "As We May Think," published in the July 1945 Atlantic Monthly.

      Given that Bush assumed that documents were stored primarily as immutable microfilm images, he had no choice but to assume that links would stored be external to the documents which were their subjects. It simply wasn't possible to embed links in documents as we do today with HTML and with other formats that support embedded links.

      Thus, it can be said that the idea of external associative links, or annotations, was actually the original idea for how Hypertext would be implemented. It was only later, long after 1945, that we found that it was convenient to support links embedded in content.

      It is also important to note the external links allow us to more easily do things that can't be done with the more common internal links. For instance, if you're reading a document with internal links, you can easily answer the question "What does this document link to?" However, it is much harder to answer the question: "What documents link to this one?" This is because internal links are only "one-way links. However, external links, which are "two-way links," establish a relationship between documents can exist independent of the documents themselves. Thus, if you have a collection of external links, you can answer the question: "What links to this document?" That question can't be easily answered in today's web unless you've got a web-crawling system like Google's that is capable of reading all documents on the web and then deducing all the back-links.

      In fact, one of the key elements of a Web annotation system is the ability to pass the URL/URI for some web resource to the annotation system and say: "Show me what links (annotations) exist for this resource!" Of course, each of the annotations which contains the external links would itself have a unique identifier and should thus be something that can be annotated or linked to. In this way, we can have annotations of annotations as well as the same kind of forking "associative trails" that present alternative paths through the document space that Vannevar Bush imagined in his 1945 Atlantic Monthly article. In other words, when we allow for external links, we elevate the "link" or "annotation" to something which is a first-class object on the Web instead of leaving it as a mere attribute of some web resource.

      To a great extent, raising links to the status of first class objects "completes" a large part of the journey from idea to implementation that began with Vannevar Bush's 1945 vision. We should understand that supporting annotations doesn't just provide a "nice new feature." It provides the foundation for what is today a very unfamiliar method for interacting with the web as a record of human experience and knowledge. The idea is very old. Nonetheless, we have yet to begin to have much experience with its use and implications.

    1. Legal Outreach, Inc. Fall 2021 Constitutional Law Debate 8 The Court has stated that a suspect has the right to terminate interrogation at any time prior to or during the interrogation by invoking (i) the right to remain silent or (ii) right to counsel.2 If a suspect invokes the right to remain silent, the police must honor the request and no longer question the accused. However, police may re-question a suspect about the same crime if, after a break, fresh Miranda warnings are given. Moreover, asking an incarcerated individual at a later time about crimes unrelated to the reason such person is incarcerated has been found to be permissible (Howes v. Fields). If a suspect invokes the right to counsel, and does so unambiguously and specifically (e.g., the suspect says s/he wants counsel to assist with the interrogation), all questions must cease until counsel is provided. Allowing the suspect to consult with counsel and then resuming the interrogation after counsel has left does not satisfy the right – counsel must be present during the interrogation. Once the witness asserts the right to terminate interrogation and asks for counsel, restarting of the interrogation by police on any topic violates the Fifth Amendment. It is worth noting that a suspect may always waive the right to counsel if, while waiting for counsel, s/he reinitiates the questioning. A suspect may also waive all his/her Miranda rights if s/he does so knowingly, voluntarily, and intelligently. Silence or shrugging does not qualify as a waiver. Interrogation Analysis In addition to being in custody, the suspect must actually be under interrogation to require Miranda warnings. This does not mean that the police officers have to be directly questioning the suspect but can be saying or acting in a way that the police should know are reasonably likely to elicit an incriminating response from the suspect. Whether it’s reasonably likely depends on the suspect’s perceptions, not the police officers’ intent. Therefore, you need to ask yourself whether a reasonable person in the suspect’s position would think, based on the officers’ actions and words, that they were being questioned about the crime or their involvement in that crime. Voluntariness If a defendant confesses to a crime, it must be voluntary and without coercion. A confession is separate and independent of Miranda warnings. The court will examine the voluntariness of a confession whether or not the suspect has been Mirandize

      I think that this is important because the cases in the voluntary section talked about how the suspect has to confess of their own free will and without intimidation. So we need to see if this was the case with Lav.

    1. a posteriori Stochastic Block Model, Recap We just covered many details about how to perform statistical inference with a realization of a random network which we think can be well summarized by a Stochastic Block Model. For this reason, we will review some of the key things that were covered, to better put them in context: We learned that the Adjacency Spectral Embedding is a key algorithm for making sense of networks we believe may be realizations of networks which are well-summarized by Stochastic Block Models, as inference on the the estimated latent positions is key for learning about community assignments. We learned how unsupervised learning allows us to use the estimated latent positions to learn community assignments for nodes within our realization. We learned how to align the labels produced by our unsupervised learning technique with true labels in our network, using remap_labels. We learned how to produce community assignments, regardless of whether we know how many communities may be present in the first place. { requestKernel: true, binderOptions: { repo: "binder-examples/jupyter-stacks-datascience", ref: "master", }, codeMirrorConfig: { theme: "abcdef", mode: "python" }, kernelOptions: { kernelName: "python3", path: "./representations/ch6" }, predefinedOutput: true } kernelName = 'python3'

      I think this recap should be the introductory paragraph, and should be expanded

    1. Reviewer #3 (Public Review):

      This paper is based on digital reconstruction of a serial EM stack of a larva of the annelid Platynereis and presents a complete 3D map of all desmosomes between somatic muscle cells and their attachment partners, including muscle cells, glia, ciliary band cells, epidermal cells and specialized epidermal cells that anchor cuticular chaetae (circumchaetal cells) and aciculae (circumacicular cells). The rationale is that the spatial patterning of desmosomes determines the direction of forces exerted by muscular contraction on the body wall and its appendages will determine movement of these structures, which in turn results in propulsion of the body as part of specific behaviors.

      To go a step further, if connecting this desmosome connectome with the (previously published) synaptic connectome, one may gain insight into how a specific spatio-temporal pattern of motor neuron activity will lead, via a resulting pattern of forces caused by muscles, to a specific behavior. In the authors' words: "By combining desmosomal and synaptic connectomes we can infer the impact of motoneuron activation on tissue movements". This is an interesting idea which has the potential to make progress towards understanding in a "holistic" way how a complex neural circuitry controls an equally complex behavior. The analysis of the EM data appears solid; the authors can show convincingly that desmosomes can be resolved in their EM dataset; and the technology used to plot and analyze the data is clearly up to the task. My main concern is with the way in which the desmosome pattern is entered in the analysis, which I think makes it very difficult to extract enough relevant information from the analysis that would reach the stated goal.

      1.The context of how different structures of the Platynereis larval body, by changing their position, move the body needs much more introduction than the short paragraph given at the end of the Introduction.<br> -My understanding is that the larval body is segmented, and contraction of the segments can cause a certain type crawling or swimming: does it? Do the longitudinal muscles, for example, insert at segment boundaries, and alternating contraction left-right cause some sort of "wiggling" or peristalsis?<br> -In addition, there are segmental processes (parapodia, neuropodia), and embedded in them are long chitinous hairs (Chaetae, Acicula). Do certain types of the muscles described in the study insert at the base of the parapodia/neuropodia (coming from different angles), such that contraction would move the entire process, including the chaetae/acicula embedded in their tips?<br> -Or is it that only these chaetae/acicula move, by means of muscles inserting at their base (the latter is clearly part of the story)? Or does both happen at the same time: parapodium moves relative to the trunk, and chaeta/acicula moves relative to the parapodium? How would these movements lead to different kind of behaviors?<br> -Diagrams should be provided that shed light on these issues.

      2.The main problem I have with the analysis is the way a muscle cell is treated, namely as a "one dimensional" node, rather than a vector.<br> -In the current state of the analysis, the authors have mapped all desmosomes of a given muscle cell to its attached "target" cell. But how is that helpful? The principal way a muscle cell acts is by contracting, thereby pulling the cells it attaches to at its two end closer together. As the authors state (p.4) "...desmosomes..are enriched at the ends of muscle cells indicating that these adhesive structures transmit force upon muscle-cell contraction."<br> -for that reason, the desmosomes at the muscle tips have to be treated as (2) special sets. Aside from these tip desmosomes there are other desmosomes (inbetween muscles, for example), but they (I would presume) have a very different function; maybe to coordinate muscle fiber contraction? Augment the force caused by contraction?<br> -As far as I understand for (all of) the desmosome connectome plots, there is no differentiation made between desmosome subsets located at different positions within the muscle fiber. I therefore don't see how the plots are helpful to shed light on how the multiplicity of muscles represented in the graphs cause specific types of neurons.<br> -As it stands these plots "merely" help to classify muscles, based on their position and what cell type they target: but that (certainly useful) map could have probably also be achieved by light microscopic analysis.

      3.Section "Local connectivity and modular structure of the desmosomal connectome" p.4-7" undertakes an analysis of the structure of the desmosome network, comparing it with other networks.<br> -What is the rationale here? How do the conclusions help to understand how the spatial pattern of muscles and their contraction move the body?<br> -Isn't, on the one hand (given that position of the desmosome was apparently not considered), the finding that desmosome networks stand out (from random networks) by their high level of connectivity ("with all cells only connecting to cells in their immediate neighbourhood forming local cliques") completely expected?<br> -On the other hand, does this reflect the reality, given that (many?) muscle cells are quite long, connecting for example the anterior border of a segment with the posterior border.

      4.In the section "Acicular movements and the unit muscle contractions that drive them" the authors record movement of the acicula and correlate it with activity (Ca imaging) of specific muscle types. This study gives insightful data, and could be extended to all movements of the larva.<br> -The fact that a certain muscle is active when the acicula moves in a certain direction can be explained (in part) by the "connectivity": as shown in Fig.7L, the muscle inserts at a circumacicular cell on the one side, and to an epithelial (epidermal?) cell and the basal lamina on the other side. But how meaningful is a description at this "cell type level" of resolution? The direction of acicula deflection depends on where (relative to the acicula base) the epithelial cell (or point in the basal lamina) is located. This information is not given in the part of the connectome network shown in Fig.7L, or any of the other graphs.

    1. The other pitfall I call “filter feeding”- attempting to glean the necessary “nutrients” from a source only while reading it, and not even bothering trying to take any notes down. This may be the default state when drinking from the fire hose. Reading endless blogs, social media, or even books without challenging ourselves through writing and discussion can lead to the experience of feeling, as Postman describes, like we know “of” many things without really knowing about them.

      Reading vast amounts of information can lead one to think they know a lot, but retention is not good. To increase retention one should write, converse or otherwise engage with the information.

    1. Author Response:

      Reviewer #1:

      The authors address an interesting but neglected issue in pigment cell biology, concerning the developmental origin of red erythrophores, especially in relationship to yellow xanthophores, and the genetic basis for their differing pigmentation. Red-yellow colouration in vertebrates usually arises from accumulation of dietary carotenoids, and often has significant behavioural importance, e.g. as an honest signal of individual quality. This and the biochemistry of carotenoid colour variation is nicely covered in the Introduction, providing helpful background to a broad audience.

      The authors document the widespread presence of erythrophore in Danio, highlighting the unusual nature of Zebrafish within the genus as lacking them. They then develop some quantitative and objective measures of the xanthophores and erythrophores based upon Hue and Red:Green autofluorescence ratios, allowing clear distinction of the mature cell-types, and note the often binucleate nature of the erythrophores.

      The authors then use a variety of tools to assess, with differing degrees of certainty, the lineage relationships of the erythrophores; together these provide a consistent and convincing picture of shared lineage between the two cell-types. This is consistent with the observed gradual shift in properties of proximal cells from xanthophore-like to erythrophore. A more direct test of the conversion of early xanthophores to erythrophores comes from the clonal analysis of aox5:nucEosFP cells (Fig. 4). They then use a fin regeneration assay to assess the plasticity of these cells in the mature adult. This is a neat experiment, but I am struggling with the interpretation of Figure 5A: which cells are being used as landmarks to justify the conclusion that the cells shown are clonally-derived form that single cell in the 5 dpa image? It may be that the full series of images could be provided in a supplementary figure and might make this clear, but the current images do not seem convincing to me. The experiment in Fig. 5B is convincing, so conclusion seems sound.

      We added a supplementary figure (Figure 5—figure supplement 1) to show more context and nearby landmarks, including the amputation plane. We additionally swapped out the images in Figure 5A with an example that more clearly makes our point that cells seem to both lose red coloration and increase in number. Cells of both the original and the new example are visible in the new supplemental figure. Given the concern expressed we additionally modified the salient portion of the text, to make it clearer that the brightfield-only analyses were intended merely to see if a transformation is plausible, based on overt cell colors and behaviors in the absence of formal clonal analysis. The revised text reads:

      “We first assessed the possibility that transfating occurs by repeatedly imaging individual fish in brightfield, to learn whether cells near the amputation plane might lose their red color during regenerate outgrowth. Individual erythrophores could often be reidentified using other cells as well as distinctive features of fin ray bones and joints as landmarks (Figure 5A; Fig- ure 5—figure supplement 1). As regeneration proceeded, small groups of cells having paler red or orange coloration, were sometimes observable where individual cells of deep red col- oration had been found, suggestive of proliferation and dilution of pre-existing pigments. Later, only yellow cells were found in these same locations. These observations were con- sistent with the possibility of erythrophore → xanthophore conversion, and so to test this idea directly we marked nucEosFP+ erythrophores by photoconversion prior to amputation (Figure 5B; Figure 5—figure supplement 2A). ”

      The authors then use a transcriptomic comparison to identify candidate genes influencing erythrophore v xanthophore differentiation. They study 3 with mutant phenotypes affecting these cell-types, identifying likely roles of 3 erythrophore genes. Whilst most of this analysis is beautifully presented, I am confused by Fig. 7 in which I think panel D and F as described in the legend are inverted.

      We fixed the relative ordering of panels and legends. We also changed the Y axis label in Figure 7F to indicate cells per 40 μm2 rather than density, which might be misinterpreted to mean cells per mm.

      As is expected form this lab, the manuscript is generally very carefully and clearly written and includes thorough data presentation and statistical analysis. Conclusions drawn are appropriately nuanced, and justified by data presented. The manuscript provides an important first step in understanding the developmental relationship of erythrophores to xanthophores, and a number of genetic resources for the further exploration of this question.

    1. A bald patch will give us away.

      This opening sequence is interesting, but quite frankly, very confusing! I am trying to picture the actions of that actors but many of them just seem far-fetched for the stage, or requiring makeup and special effects to simulate the blood or makeup. I do have the understanding that Brecht's Epic Theatre is extremely stripped down, so this would not be required. It would be up to the actor to show the audience with their actions what is happening to them in this sequence. I absolutely see the value in striping down the entire play to have the audience accept this world as it is. We may not see this bald spot, but through dialogue and action we will certainly know it is there. I think I am having a difficult time reading this after all of the realism and naturalism we have been reading. Directing a Brecht play seems like a monster, but a fun one.

    1. Author Response:

      Reviewer #2 (Public Review):

      This manuscript details an investigation into whether blinding NIH grant reviewers to the name and institution may affect their review scores. They demonstrate that unblinded grants lead to slightly higher scores for white applicants than blacks, however, a deeper dive demonstrates that grantsmanship and history of prior funding can be even greater predictors of scores regardless of race.

      Overall the manuscript touches on a presently vogue topic and that is of equality in outcomes and systemic racism. The major limitations of the study however, are ironically demonstrating the very topic that the manuscript tries to address. There are no considerations in the manuscript or mention of applications from Asian, Hispanic or Native American applicants, as the authors distill the problem literally down to only Black and White.

      We now incorporate more of this perspective.

      We rewrote the introduction, adding information about funding rates for Hispanic and Asian PIs (the 2 largest groups of minority applicants), and provided a stronger explanation for why this study focused on Black-White differences only (lines 86-95) Our aim was to provide a broader context while keeping the intro reasonably focused. Demographic differences in patterns of application numbers, review outcomes, and funding success is a complex topic, not easily presented concisely. More importantly, we think that this information, while no doubt of interest to some, is not relevant background to the experiment at hand. We tried to strike a balance between context and focus.

    1. Author Response:

      Reviewer #1:

      This work demonstrates that functional KATP channels exist in most neuronal cell types in the mouse somatosensory cortex. While the transcriptomic profiling of electrophysiologically characterized neurons is only indicative of the existence of the Kir6.2/SUR1 KATP channel, the acute slice pharmacological/electrophysiological experiments convincingly supports this notion.

      The uncertainty of single-cell RT-PCR is likely due to a small amount of starting material inherent to the sample collection method. As the authors discuss, low copy numbers of target transcripts may also have contributed to the negative/uncertain results.

      We fully agree that scRT-PCR analysis underdetected Kir6.2 (kcnj11) and SUR1 (abcc8) mRNAs. This is likely due to their low abundance at the single-cell level, the sample collection method and the low efficiency of the reverse transcription (RT).

      As requested by reviewer 2 we now report the low detection rate of these subunits in neurons responsive to diazoxide and tolbutamide and acknowledge the limitation of scRT- PCR (pages 7,8, lines, 34,1-6).

      We have also improved the discussion by providing the copy number of these mRNAs detected by single cell RNAseq (Zeisel et al. 2015, DOI: 10.1126/science.aaa1934, data available online https://linnarssonlab.org/cortex/) and the estimated sensitivity limit of the scRT-PCR (page 13, lines 29-33).

      Next, the authors demonstrate that lactate is taken up by neurons and elevates the discharge rate via an increased ATP production due to the oxidative metabolism downstream of lactate, which is in line with earlier studies including Ivanov et al. (2011, doi: 10.3389/fnene.2011.00002).

      We thank the reviewer for pointing out this reference that we have added in the discussion (page 17, line 16).

      The authors showed this by introducing 15 mM lactate, and discuss a possibility that extracellular lactate can be elevated by a systemic increase of lactate. However, such an increase is likely more modest in the brain (Carrard et al., 2018, doi: 10.1038/mp.2016.179). So, the lactate-enhanced firing might occur in extreme conditions such as during anoxia or ischemia; however, intracellular ATP would most probably decrease and hence KATP channels would open in this case. A discussion on extracellular lactate levels in physiological conditions would be helpful.

      We have improved the discussion on the physiological extracellular level of lactate which can be as high as 5 mM at rest. Since during neuronal activity lactate levels are almost doubled (i.e. up to 10 mM), lactate-enhanced firing might occur under physiological conditions (page 18, lines 9-13). We agree that a systemic lactate increase modestly elevates its extracellular concentration to a level with little or no effect on firing rate. Accordingly we now also quote references reporting this observation. Nonetheless, peripheral lactate could represent an additional source facilitating lactate-sensing when both the brain and the body are active, as during physical exercise (page 18, lines 13-19).

      Overall, this is a rigorous study that confirms the existence of functional KATP and dominant oxidative metabolism in most types of juvenile somatosensory cortical neurons.

      Thank you.

      Reviewer #2:

      The authors present an impressive array of experiments testing the effect of lactate on a number of neocortical cell types. They uncover a mechanism by which lactate might enhance neuronal firing although direct physiological relevance needs further support for CSF lactate concentrations. Most of the experiments are sound and interesting and the remaining experiments have limitations inherent to the methodology and presented accordingly in the discussion. The results are convincing, however a number of specific points need to be addressed.

      We thank the reviewer for the specific points raised that helped us to improve and clarify the manuscript.

      Specific points:

      • Page 6 line 21 onwards. The authors state consistent expression of Kir6.2 and SUR1 in various cortical cell types. Data presented in Fig1 challenge this statement showing that Kir6.2 and/or SUR1 was expressed in the minority of cells tested regardless of cell type. For example, out of the 10 intrinsically bursting cells shown in the Ward cluster plot on Fig1A-B, only two was positive for Kir6.2 according to Fig1D. Surprisingly, Fig1F shows that 10% of intrinsically bursting cells express Kir6.2 which is clearly not the case (it is 20%).

      We thank the reviewer for pointing out this apparent incoherence. Indeed, Fig. 1D showed two intrinsically bursting cells that appeared positive for Kir6.2. However, one of them was also positive for genomic control and was discarded from the calculation of detection rate, as already discussed (pages 13,14 lines 34,1-5). For the sake of clarity Fig. 1D now depicts potential Kir6.2 false positive as shaded colored rectangles.

      Amplification was used for the detection of mRNAs by the authors, thus it is unlikely that detection threshold plays a role in having Kir6.2 or SUR1 negative cells.

      We agree that PCR amplification can detect a single DNA molecule (e.g. Li et al 1988, DOI: 10.1038/335414a0). However, the low reverse transcription (RT) efficiency is an important limiting factor for the mRNA detection by scRT-PCR. In addition, dendritic mRNAs are almost inaccessible to the harvesting from a somatic patch pipette, thereby decreasing the detection rate. Similar issues of mRNA detection by scRT-PCR have been reported for neuropeptide receptors despite a functional expression in a majority of recorded pyramidal cells (Gallopin et al. 2006, DOI: 10.1093/cercor/bhj081). scRT-PCR detection limit was estimated to be around 25 molecules of mRNA in a previous study quantifying at the single-cell level AMPA receptor mRNAs harvested in the patch pipette (Tsuzuki et al. 2001, DOI: 10.1046/j.1471-4159.2001.00388.x).

      We have now improved the discussion by providing the copy number of Kir6.2 (kcnj11) and SUR1 (abcc8) mRNAs detected by RNAseq from single isolated cells (Zeisel et al. 2015, data available online https://linnarssonlab.org/cortex/). The estimated sensitivity limit of the scRT-PCR is also now provided (page 13, lines 29-33).

      Along the same vein, amplification makes it difficult to understand what the authors mean by "low copy number at single cell level". Specifically, the sentence (p6l22-25) is self-conflicting suggesting reliable detection of KATP subunits yet downplaying the significance of moderate single cell detection rates.

      Since the point on the "low copy number" is now discussed in more detail the sentence has been removed from the results section. To avoid confusion between detection and expression we now use only "detection" for scRT-PCR data and "expression" for functional data. Accordingly, in Figures 1F, 3B, 6A and S5, "Occurrence" was changed to "Detection rate".

      I think a moderate statement with percentages of expression would adequately describe the findings with an emphasis on potential variability between individual cells regardless of cell type. Throughout the text, the authors should avoid the use of uniform expression of KATP channels in neurons.

      • Page 6 line 30. The authors conclude co-expression of Kir6.2 and SUR1 subunits. Fig1D shows that out of approximately n=71 Kir6.2 positive cells and n=28 SUR1 positive cells only n=16 expresses Kir6.2 and SUR1 together and the evidence presented shows that n=83 cells do not co-express Kir6.2 and SUR1. Again, the conclusion in the manuscript seems biased towards the minority of cases and does not reflect the overall dataset. Accordingly, the suggestion that neurons and beta cells use the same KATP channel is not supported (p6l32).

      The statement has been mitigated as follows (page 6, lines 21-27): "Apart from a single Adapting NPY neuron (Figure 1D), where Kir6.1 mRNA was observed, only the Kir6.2 and SUR1 subunits were detected in cortical neurons (in 25%, n=63 of 248 neurons; and in 10%, n=28 of 277 of neurons; respectively). The single-cell detection rate was similar between the different neuronal subtypes (Figure 1F). We also codetected Kir6.2 and SUR1 in cortical neurons (n=14 of 248, Figure 1D) suggesting the expression of functional KATP channels."

      We have also avoided the use of uniform expression throughout the text and do not refer anymore to pancreatic beta-cell like KATP channels in the results section.

      • KATP channel presence in neurons. With respect to the points above, it would be helpful to see in the results section and possibly on Fig2 whether there is an electrophysiological indication of pharmacologically unresponsive cells. This would help in assessing the relative sensitivity of the two approaches. Fig.2G is helpful here, however signal to noise is hard to assess in the current version in individual experiments. Please state if single cell PCR was performed on any pharmacologically examined cells.

      We now clearly report that all neurons pharmacologically analyzed in voltage clamp were responsive to diazoxide and tolbutamide. We also mention the range of the effects of these KATP channel modulators on membrane resistance and whole-cell current (page 7, lines 12-15).

      We thank the reviewer for suggesting to state if scRT-PCR was performed on pharmacologically examined cells, which helps to evaluate the relative sensitivity of scRT- PCR and pharmacological/electrophysiological experiments. We now report the number of neurons pharmacologically characterized and successfully analyzed by scRT-PCR (pages 7,8, lines 34,1-6). All these neurons were found to express functional KATP channels, but Kir6.2 and SUR1 subunits were detected in only a minority of them. We thus conclude that scRT-PCR underdetects these mRNAs.

      Fig3B recapitulates the results of Fig1 that only a small fraction of RS cells express Kir6.2 and SUR1.

      Since scRT-PCR is less sensitive than electrophysiological investigations, as just discussed above, the absence of detection of mRNAs does not mean an absence of functional expression of KATP channels. The absence of outward ATP-washout current in Kir6.2 KO neurons, in marked contrast with neurons from wild-type mice, supports the notion of a widespread functional expression of Kir6.2-containing KATP channels in cortical neurons. To avoid the confusion between detection and expression, we have reformulated the sentence (page 8, lines 11-12) as follows: "We first verified that Kir6.2 and SUR1 subunits can be detected in pyramidal cells from wild type mice by scRT-PCR".

      In spite having a clever pharmacological design, due to limitations inherent to spatially nonspecific drug application methods, one cannot exclude that the results measured on individual cells could also reflect network interactions with astrocytes and/or neurons and should be discussed.

      We agree with the reviewer that bath applications of drugs can induce network effects leading to potential confounding results. However, the kinetics and biophysical properties of the whole-cell currents recorded during pharmacological manipulations do not support such a network effect. This possibility, nonetheless, is now discussed page 13, lines 18- 23.

      We have also discussed the possibility that the blockade of lactate transport by 4-CIN could reflect an impairment of lactate uptake by neurons but also of lactate release by astrocytes. However, under our conditions the contribution of astrocyte-derived lactate is expected to be negligible (page 16, lines 10-18).

      • Lactate concentration in blood vs CSF. As the authors point out, there is a discrepancy in glucose concentration between the blood and CSF, yet they use lactate concentrations measured in the blood (and not in the CSF) during exercise in their experiments. The physiological relevance of these experiments is unclear unless there is evidence that lactate concentration in the CSF is indeed in the range found effective here.

      We thank the reviewer for pointing out the discrepancies between plasma and extracellular levels of glucose vs. lactate. Although surprising at first, and in contrast to glucose, extracellular lactate level is higher than its plasma level. Such a difference, most likely reflects the ability of the brain produce lactate and not glucose.

      As also requested by reviewer 1 we have improved the discussion on the physiological extracellular level which can be as high as 5 mM at rest. Since during neuronal activity lactate levels are almost doubled (i.e. up to 10 mM), we believe that lactate-enhanced firing might occur under physiological conditions (page 18, lines 9-13).

      We have improved the rationale of the lactate concentration used which is an isoenergetic condition to 10 mM glucose for having the same number of carbon atoms (page 10, lines 4-5).

      We also discuss the possibility, that peripheral lactate could represent an additional source facilitating lactate-sensing when both the brain and the body are active, as during physical exercise (page 18, lines 13-19).

      • MCT1 and MCT2 expression and widespread lactate effects. Here, the authors admit that relatively low single cell detection rates were observed for MCT1 (19%) and MCT2 (28%). It seems consistent (and a bit worrisome) throughout the manuscript that expression of mRNAs additionally tested functionally have a limited range of PCR detection yet (again) ubiquitous presence was found when tested pharmacologically.

      Similar to KATP channels subunits and as reported by single cell RNAseq data (Zeisel et al. 2015, DOI: 10.1126/science.aaa1934, data available online https://linnarssonlab.org/cortex/), MCT1 (slc16a1) and MCT2 (slc16a7) are expressed in cortical neurons at a copy number below the detection limit of scRT-PCR.

      We have now discussed the discrepancy between MCT1 and MCT2 detection and the widespread lactate effects which are most likely due to their low abundance at the single cell level (pages 15,16, lines 32-34, 1-6). We also provide a counter example with LDH subunits which are expressed at higher single-cell levels, and for which a higher scRT- PCR detection rate was found to match the functional data (page 16, lines 6-9).

    1. Author Response:

      Reviewer #2:

      This paper investigates cell size-dependent regulation of G1/S cell cycle transition in budding yeast, with a focus on the relationship between the activator Cln3 and the inhibitor Whi5. A prominent 2015 paper proposed that cell growth dilutes the inhibitor Whi5 while Cln3 levels remain constant. This 'inhibitor dilution' model has been challenged by several recent papers. In the present paper, Sommer et al. perform a series of quantitative western blots of whole cell extracts from synchronized cell cultures. They show that Cln3 concentration increases 10-fold before bud emergence (i.e. G1/S) but Whi5 concentration is largely constant, at least in rich media. Similar results were obtained in poor carbon media with a smaller increase in Cln3. These data argue against the inhibitor-dilution model and indicate that Cln3 levels are tuned by carbon availability and cell growth rate. Interestingly, Cln3 increases are not dependent on actin-based growth or bud emergence, but rather depend on membrane trafficking and TORC-SGK signaling. A series of experiments altering ceramide synthesis identify a link with Cln3 synthesis, although it remains unclear how directly this ceramide-Cln3 connection occurs.

      The combination of results in this paper represent a significant contribution to the field. Major strengths include the careful quantitation of Whi5/Cln3 levels, and the clear effects on Cln3 from membrane trafficking events. I also appreciated the balanced tone of the text, which describes the strengths and weaknesses of each experiment and interpretation. I have a series of comments/concerns that could be addressed to strengthen the paper, as described below.

      1) I understand why cells were pre-grown in poor carbon media for these experiments, but it seems important to know how Cln3 and Whi5 levels change for cells pre-grown in rich media. Otherwise, each paper reporting different results for Cln3/Whi5 could be dismissed as using a unique set of growth conditions. Along these lines, it would be ideal for the authors to test Cln3/Whi5 levels in their western blot assay using the same strain background and media as the Schmoller paper. It would be very interesting if the inhibitor-dilution model were observed under these conditions, whereas alternative mechanisms like Cln3 accumulation were observed under other conditions.

      We attempted to grow cells in YPD, isolate small unbudded cells, and then release the cells back into YPD. However, we found that it was not possible to isolate a uniform population of small unbudded cells under these conditions. The problem is that very little growth occurs in G1 phase in YPD so that newly born cells are nearly the same size as mother cells (PMID: 28939614). This, combined with the normal variation in cell size observed in wild type yeast, means that elutriation yields a mix of unbudded and budded cells. Others have faced the same problem (PMID: 31685990, 10728640). The fact that so little growth occurs in G1 phase in YPD is an additional argument against the idea that dilution of Whi5 plays a substantial and general role in cell size control.

      As an alternative, we grew cells in complete synthetic medium (CSM) containing 2% glucose. Under these conditions, cells grow more slowly and are smaller because CSM is limiting for nutrients other than glucose. We isolated small unbudded cells and released them into the same medium so that there would not be shift in carbon source. We found that Cln3 levels increased 3-fold, while Whi5 levels did no change substantially, similar to the effects observed in YP medium containing poor carbon. These data are shown in a new figure (Figure 1 – figure supplement 2). In addition, we have included new text to highlight these issues and how they can influence interpretation of the results.

      We agree that it could be interesting to see how Cln3 and Whi5 behave in the mutant background and media conditions used by Schmoller et al. However, we were concerned that any behavior observed only in the bck2∆ background would say more about the effects of bck2∆ on accumulation of Whi5/Cln3 than it would about how cell size control works in wild type cells. Therefore, to limit the number of time-intensive elutriation experiments that we needed to complete the manuscript we would prefer to leave this experiment for others to complete if they are interested.

      2) The authors over-express WHI5 to test the inhibitor-dilution. Their results dovetail with a recent study from the Murray lab (Barber et al., PNAS) suggesting that cells are not very sensitive to Whi5 levels. However, one can envision mechanisms (e.g. PTMs) that inhibit Whi5 molecules when expressed beyond their physiological concentration. Instead, it would be interesting to know what happens in WHI5/whi5 heterozygous diploid mutants that cut Whi5 levels in half. Perhaps this experiment exists in the literature, but it would be an ideal setting for the authors to perturb the inhibitor-activator ratio, and test Cln3/Whi5 protein levels along with cell size in synchronized cultures.

      We were not able to find an analysis of the size of WHI5/whi5∆ cells in the published literature. We carried out the analysis and the data are shown in a new figure panel (Figure 3C). The effect is small – deletion of one copy of WHI5 in a diploid strain caused only a 0.9% decrease in median cell size. These data nicely complement the data showing little effect of 2xWHI5 on cell size. We were surprised that we did not think to do this simple experiment, and we were also surprised that we couldn’t find it in the literature. We thank the reviewer for suggesting the experiment. Since the heterozygous WHI5/whi5∆ cells showed minimal size defects, we have not elutriated the strain to test for changes in the Cln3/Whi5 ratio.

      3) I found the result in Figure 5E very correlative and hard to interpret. For example, Ypk1 phosphorylation is lost at 2.5 min, but Cln3 levels seem unaffected at this timepoint and the next (?). I would suggest softening the (already soft) tone of explaining these results. In general, the connection between ceramide synthesis and Cln3 levels remains quite unclear to me.

      We agree that our interpretation of the data in Figure 6E was confusing in the original version. Part of the confusion may arise from a lack of clarity in our writing and in the literature about the different phosphorylation inputs into Ypk1/2. The literature suggests that changes in the electrophoretic mobility of Ypk1 could be due largely to the Fpk1/2 kinases. TORC2 also influences Ypk1/2 phosphorylation, as detected by a phosphospecific antibody, but it remains unclear whether TORC2 also influences the electrophoretic mobility of Ypk1/2. The data suggest that the phosphorylation of Ypk1/2 that can be detected via electrophoretic mobility shifts is correlated with Cln3 levels, while TORC2-dependent phosphorylation with a phosphospecific antibody is not well correlated with Cln3 levels. We have edited the manuscript to make this more clear and to clarify what can and cannot be concluded from the data.

      4) The text would need to describe a potential role for protein localization in this pathway. All the results come from cell extracts, whereas local protein concentration in the nucleus could be changing and impact the pathway.

      The last three paragraphs of the Discussion include a discussion of potential roles for protein localization in the context of data from our work and previous studies that point to a potential role for localization of Ypk1/2 and Cln3 to the endoplasmic reticulum. In addition, we added the following sentence to the Results section to highlight potential localization issues: "Population level analysis of Cln3 and Whi5 protein levels by western blotting could miss changes in Whi5 or Cln3 concentration driven by changes in localization to specific subcellular compartments.”

    1. Author Response:

      Reviewer #2:

      In this study, the authors develop a novel method, called MCGA, extending from their previous gene-based methods, to detect gene-trait association removing redundant signal. They further leverage expression QTL into their model to improve the resolution of gene-trait association. The overall structure is clear, and data is presented well. I am concerned about the simulation methods, and would like the authors to present some clarifications.

      1) When comparing MCGA-eQTL and MCGA-sQTL, the authors simulate a single isoform-trait association, and the simulated gene expression is averaged among isoforms, which is kind of unfair for MCGA-eQTL model. Hormozdiari et al reveal that sQTL contributes few to traits after conditioning on eQTL (Hormozdiari et al., 2018, doi: 10.1038/s41588-018-0148-2). I would suggest to simulating a case that gene-trait association is mediated by overall expression, instead of a single isoform (transcript);

      We thank Reviewer #2 overall for the numerous insightful and helpful suggestions and comments. Thanks for pointing out this problem! We agree with the reviewer that the gene-trait association can be mediated by the overall expression instead of a single isoform. However, we think that, mathematically, the two scenarios are equivalent. We also added a scenario in which gene-trait association is mediated by the overall expression of multiple susceptibility isoforms, and its power is similar to the scenario of single isoform-trait association (see Table 1 in the revised manuscript). In the real data analysis, we did observe that MCGA based on the isoform-level eQTLs detected more significant genes than that based on the gene-level eQTLs. Besides, we noticed that the sQTL (splicing QTL) in Hormozdiari et al. is different from the isoform-level eQTL used in our manuscript.

      2) When comparing MCGA-eQTL and MCGA-sQTL, only power is considered. The authors should include the analysis to demonstrate the performance in control for false positive;

      We thank the reviewer for this comment and suggestion. In the revised manuscript, we reported the results for controlling the false positive. Please refer to Essential Revisions point 2 (see line 261-262 in the revised manuscript).

      3) When choosing a favorable exponent value c (1.432 chosen in the study), the authors found that the c value is robust to trait type, sample size or variant size, but the authors didn't explain what factors affect the choosing of c. Considering the potential application of MCGA method in other studies, the authors should explain what factor affects c value, and provide the guidance how to choose an optimal c;

      We thank the reviewer for this comment and suggestion. Please refer to Question A and B of Essential Revisions point 3.

      A: "Motived from the boundary of chi-square correlation, we adopted simulation studies to empirically choose c for controlling the type I error of the effective chi-square test. Besides the correlation of chi-square statistics, the choosing of c for the effective chi-square test may also be affected by the approximated non-negative solutions. However, the correlation of chi-square statistics is the major factor. Our simulation showed that the derived boundary and influence trend of LD on chi-square statistics were also applicable to the effective chi-square test. In the revised manuscript, we showed that the correlation of chi-square statistics is affected by the non-centrality parameter of chi-square statistics (see lines 640-655 in the revised manuscript)."

      B: "As the optimal c for controlling the type I error of the effective chi-square test would be affected by the non-centrality parameter of chi-square statistics which are generally unknown in practice, we have to resort to a grid search algorithm to explore an empirically optimal c. In our last manuscript, we mixed the methods of choosing optimal c with the introduction of new effective chi-squared statistics. We wrote a new subsection in Materials and Methods to describe the procedure of choosing the optimal c in the revised manuscript (see lines 610-628 in the revised manuscript)."

      4) The mediation analysis result in Yao et al. estimates that 11% of trait heritability is mediated by gene expression (Yao et al., 2020, doi: 10.1038/s41588-020-0625-2), while in simulation section of this study, 100% of trait heritability is mediated by gene expression. Simulations mimicking real scenarios should be used;

      We thank the reviewer for this comment and suggestion and apologize for the confusion here. To our knowledge, the estimation by Yao et al. was for the entire genome. Note that many contributing variants of a trait may be far away from gene regions and beyond the scope of our approach. It is possible that some genes may have larger trait heritability (>11%) mediated by gene expression. Certainly, we agree with the reviewer that it is also necessary to mimic the scenario in which the gene expression mediates part of trait heritability. In the revised manuscript, we also added the scenario that part of trait heritability is mediated by the gene expression (see Table 1 in the revised manuscript). As expected, when the majority is mediated by other factors (except the gene expression), using all variants could be more powerful than only using eQTLs (see lines 247-279 in the revised manuscript).

      5) It is important to choose a background gene set when conducting GO enrichment analysis. It is not clear what kind of genes are used as control when evaluating significance;

      We thank the reviewer for this comment and apologize for the confusion here. We used the g:Profiler, a web server for functional enrichment analysis, to perform GO enrichment analyses. The conventional GO enrichment analysis took all annotated human protein-coding genes as a background in the present study (see lines 739-743 in the revised manuscript).

      6) GTEx v8 contains samples from diverse populations, and it is crucial to handle the issue of population structure. Based on the description on https://pmg-lab-docs.readthedocs.io/en/latest/KGGSEE_doc/KGGSEE.html#id18, it seems that eQTL/isoQTL were detected ignoring population structure. The authors should explain why they applied a pipeline like that, and show that their conclusion wouldn't be affected by the choice.

      We thank the reviewer for this comment. Indeed, in the original manuscript, we estimated the gene-level and isoform-level eQTLs without considering the population structure in GTEx v8. One reason is that though GTEx v8 contains samples from diverse populations, the majority (~85%) of the subjects are Europeans. Another reason is that the article of the GTEx consortium (https://www.science.org/doi/abs/10.1126/science.aaz1776) pointed that only 178 population-biased cis-eQTLs (pb-eQTLs) for 141 unique eGenes (FDR ≤ 25%) were identified across 31 tissues, which suggested that pb-eQTLs are hard to find at current sample sizes.

      In the revised manuscript, to avoid the potential population structure issues, we only used the expression profiles and genotype data of the Europeans for the eQTLs identification (see lines 788-801 in the revised manuscript).

      Reviewer #3:

      The manuscript, "MCGA: a multi-strategy conditional gene-based association framework integrating with isoform-level expression profiles reveals new susceptible and druggable candidate genes of schizophrenia", describes an approach to conduct gene-level association testing in GWAS data with integration of gene expression data. The authors have conducted comprehensive simulation studies for main modules involved in this framework, demonstrating the advantages of the MCGA strategy compared to established similar work. The method has also been applied to the analysis of schizophrenia GWAS, with several interesting discoveries. All methods proposed are implemented in the KGGSEE package, a command tool written in Java with good documentation, data resource and examples for the type of analysis proposed in this work.

      Overall, the framework is solid and the analyses performed are thorough. In particular, the simulation study and real data demonstration of advantages of isoQTL over conventional eQTL is novel and interesting. With the user friendly software available, I can envisage that MCGA will receive interest from the community and be adopted to many projects.

      My major reservation on the methods is the component using conditional analysis to identify gene specific signals. Even though the MCGA framework is as solid as the methods it is based on, alternative methods are available for gene-level association analysis that takes into consideration of contribution from multiple SNPs and the LD without having to rely on conditional analysis. For example, fine-mapping approach such as SuSiE (https://github.com/stephenslab/susieR) uses summary statistics and LD, and can produces gene-level evidence of association in terms of Bayes Factor, when a gene region is analyzed. Such an approach does not have a potential type I error issue, is efficient enough to analyze multiple genes in LD with each other. Most importantly it provides inferences directly for multiple genes accounting for LD, without having to rely on conditional analysis. Conditional analysis, as a greedy algorithm, suffers an obvious limitation: suppose genes A and B are two causal genes in weak LD with each other. A non-causal gene C physically in between A and B are correlated with both A and B. Then C may have a stronger marginal signal than either A or B. A conditional analysis may identify C, and conditional on C, association signals of the true causal genes A and B will become weaker. I therefore am not convinced that a conditional analysis such as ECS is the best approach on which MCGA should be based.

      We thank Reviewer #3 overall for the numerous insightful and helpful suggestions. We are happy that the reviewer found that our work will receive interest from the community and be adopted to many projects. To the best of our knowledge, MCGA had different application scenarios from SuSiE. The former worked with summary statistics, while the latter can only perform fine-mapping analysis with individual-level genotypes and phenotypes. Besides, MCGA can also be suitable for the three-gene case supposed by the reviewer. For example, if A and B are two causal genes, they may have larger selective expression scores than gene C in the phenotype-associated tissue. In the conditional analysis, A and B will enter the conditional procedure prior to gene C, which will make gene C not to be significant when conditioning on gene A and B.

    1. continue to become measurably safer and less violent, on average, just as they have over the last twenty millennia, according Stephen Pinker, Better Angels of Our Nature, (2010). We might even be able to predict, with with good models, that they “will” become measurably safer and less violent, under the right circumstances.

      Those 'circumstances' may be associated with demographic and governance (Think Like a Futurist.) What I see is the disparity between haves and have nots growing and eventually the haves nots will increase lawlessness out of desperation, childhood trauma, generational domestic violence, mental illness, and many other myriad of factors. The haves will no longer want to associate with the have nots and legislatively create a caste system. Even the have nots will form enclaves of safe places. I'm going dystopian here...BUT that's a silver lining, too. It's taxing being a have. Have nots have the opportunity to be closer in tune with natural forces and nature. Simply not wanting what the haves have relieves the burden of capitalism. Now i'm going Buddhist....

    1. Lean Startup loop, we want to run our Do loops fast and loose, and get them faster than environmental change, or our competitors and collaborators. At other times, as with W. Edwards Deming’s Quality loop, we want to run them slowly and carefully.

      There is no single way of being effective. Rather one must discern when a fast loop or a slow loop is necessary. If you act fast when a slow loop is required, you may outpace yourself and waste precious resources (touching upon Think Like a Futurist.)

    1. Author Response:

      Reviewer #1 (Public Review):

      This study is well-written and well-presented. The conclusions are clear and robustly supported by the data. The figures provide useful visualizations for the major findings. Virophage are an important and underappreciated component of global viral diversity, and they likely play important roles in eukaryotic genome evolution; this work is therefore quite timely. Relatively few studies focus on virophage or giant viruses compared to other viral lineages, so studies like this are highly valuable.

      Strengths of this work include the high quality of the reference genomes, which were constructed using both short-read and long-read sequencing, as well as the diverse locations and isolation times of the host genomes.

      We thank the reviewer for his encouraging and constructive comments!

      I found no major weaknesses in this study. One minor issue is that the details of how EMALEs were delineated and initially detected seem a bit unclear to me. Based on my reading I am curious if some divergent or degraded EMALEs could have been missed. This may be important for assessing the consequences of possible retrotransposition-mediated EMALE inactivation.

      Thank you for pointing this out. We added two sections to Materials and Methods called “Detection and annotation of EMALEs” and “Detection of Ngaro retrotransposons” where we describe the procedure in detail.

      Based on our approach of visually screening the entire genome assemblies for GC anomalies, combined with blast searches of Cafeteria genomes using as input manually annotated EMALEs as well as databases of all available virophage sequences, we are quite confident that we have not missed any obvious virophage genomes. We would only have missed putative virophage sequences if their GC-contents were similar to that of the host (~70% GC) and if these sequences bore no detectable similarity to known virophage genes/proteins.

      In contrast, our sequencing and assembly strategy probably did not result in a complete account of all EMALEs in these host genomes, as is evident from the large number of partially assembled EMALEs. However, partial does not equal degraded, but simply means that contig assembly stopped somewhere within the EMALE, resulting in an artificially truncated sequence. We therefore do not think that our approach introduced any relevant bias towards addressing the question whether retrotransposon insertion may lead to EMALE inactivation.

      These points are now included in the discussion.

    1. This review reflects comments and contributions by Ankita Jha, Zara Weinberg, Julia Grzymkowski, Julien Berro, Karen Lange, Sónia Gomes Pereira, Arthur Molines, Jacob Herman, and Manoj Yadav. Review synthesized by Jacob Herman.

      The work by Joseph Varberg and colleagues uses super resolution microscopy to better characterize the non-random distribution of nuclear pore complexes within the nuclei of the fission yeast Schizosaccharomyces pombe. This work also confirms findings in other organisms that nuclear pore complexes exist in multiple compositions. In addition to better documenting this phenomenon, this work begins to characterize the mechanisms by which nuclear pore position is regulated. Specifically, the authors show that clustering centromeres at the spindle pole body excludes nuclear pore complexes from the spindle pole body, and when these two complexes are forcibly dimerized mitotic defects result in decreased fitness.

      The commenters were overall quite impressed with the imaging technique. The major conclusions and message of the preprint were generally well received, the comments or questions below relate to very specific text and experiments.

      A few key themes mentioned in specific comments were:

      • A desire for more consistent statistical analysis of data.
      • Suggestions for additional data for some statements or toning down of the claims. NPC clustering is commonly discussed but there were questions as to how this phenotype was being measured.

      Specific comments

      Introduction

      “perhaps explaining links between changes in NPC density and cancer” - The statement could note whether the correlation between NPC density and cancer is positive or negative.

      “for example, emerin is enriched at pore-free regions of the NE in cultured cells (44). In budding yeast, NPC density is increased in the region of the NE near the spindle pole body (SPB),” - Does the SPB contain LEM domain proteins or is this a different possible mechanism for the non-random regulation of NPC density?

      “Using S. pombe as a model system”- Why not S. cerevisiae, which is discussed earlier to have significant prior art in this regard? I'm sure there is a good reason, I think it could be outlined a bit more in the intro.

      “We quantify NPC number under a range of conditions” - It would be useful to mention briefly at this point what types of conditions this refers to.

      “Additionally, NPCs are excluded from the NE region surrounding the SPBs by Lem2 and other factors.” - Could the authors clarify if it is also something that is conserved or it is a new finding?

      Results

      Subheader “3D-SIM image analysis pipeline for NPC quantitation” - Worth mentioning the conclusion that NPC density is independent of cell cycle stage since that is the major conclusion from this section.

      “This approach provides a roughly two-fold increase in resolution as compared to conventional light microscopy” (Figure 1A) - For those who have never imaged NPCs it would be really informative to see a confocal or wide field image to better understand how SIM imaging made this project possible.

      Figure 1 legend “E) Mean number of NPCs, nuclear surface area and NPC density measurements from four independent replicates. Significant differences (*) determined using Wilcoxon rank sum tests. ns, not significant.”

      • Each one of the coloured dots on the graph appear to represent the mean NPC number for each replicate. If so, then this information should be added to the figure legend, as it is not immediately obvious for a broader audience. If not, please clarify what each dot represents. Same in Figure S1E.
      • Were these tests conducted pairwise? Are the reported p values corrected for multiple hypothesis testing? Having a dedicated "Statistics" section in the methods would be helpful for reporting this.

      “We observed that the number of NPCs also increases through interphase to maintain a constant NPC density (Table S1, Fig. 1D-E)”- There are no cell-cycle markers used to determine cell-cycle progression but only a visual assessment from cell size and nucleus shape. It would be good to show the three plots in figure 1E as scatter plots with the X axis being cell size for cells that are not yet in mitosis (1 nucleus). Then do a correlation analysis between cell size and NPC number, Surface Area, NPC density.

      “We observed occasional differences in NPC density between mother and daughter nuclei produced by the symmetric mitotic division in S. pombe, reminiscent of the elevated NPC density observed for daughter nuclei produced by the asymmetric mitosis in S. cerevisiae”

      • It is not clear what the authors mean by "occasional", is it 1%, 5%,10%? It would be better to replace this with a specific number/% of events. Additionally, the question arises as to what happens afterwards in the daughter cells, do they retain the NPC density asymmetry? Or do they eventually achieve similar densities?
      • Some of these points are addressed later on in the paragraph and Fig S1A. Some edits to this sentence should address this and provide clarity.

      “Despite the improved lateral resolution offered by SIM, clustering of NPCs and the comparatively reduced axial resolution likely leads to undercounting of NPCs using 3D-SIM” - This is useful context for Figure 1C - it would be worth mentioning in that section how the automated counting handles clustered NPCs, or placing the paragraph earlier with a short description of the methods.

      “Similarly, a constant NPC density was maintained when nuclear size was reduced in mitotic cells using a temperature-sensitive allele of Wee1 kinase (wee1.50)” - The NPC density does not change with temperature in the wee1 mutant but the NPC density in Fig 2B is lower than in a WT in Fig 1. The Nup tagged in the two figures are different, so this could be an explanation (as shown in Fig S1 E) but it could be good to make sure that the wee1 background does not have a different NPC density. I don't see a quantification of the NPC density using Nup37 in the WT elsewhere. In fact, Nup37 seems to be used only in wee1 background and in Sup Fig. 1 B.

      “The increase in NPC number was dependent on NE membrane expansion during arrest, as chemical inhibition of fatty acid synthesis by treatment with cerulenin blocked nuclear growth while NPC density was maintained (36°C + Cerulenin = 6.8 ± 1.5 NPCs/μm2, n=110) (Fig. 2C)” -The effect of the Cerulenin drug on a WT background is not shown, was that control experiment done? It would also be helpful to include statistics in this section.

      “Yeast lacking core components of the autophagy machinery (atg8Δ or atg1Δ) (75) that targets NPCs for degradation during nutrient deprivation do not show increased NPC density compared to wild-type cells, suggesting that autophagy is not used to remove NPCs to maintain NPC density (Fig. 2D)” - It is unclear that this experiment alone tells us much about the regulation of NPC density. If atg8 and atg1 are known to regulate NPC removal only in response to nutrient deprivation then consider performing these experiments under that condition or revisiting whether they fit here.

      “NPC density is maintained by a mechanism that restricts the assembly of new NPCs in the absence of increased available NE surface area.” - This conclusion is indicative of a mechanism where NPC assembly is maintained by restricting the assembly, however all the data above is indicative of the mechanism where NPC assembly is correlated with NE surface area, for increase there must be an additive mechanism and for a decrease in the NE, there must be a mechanism of removal. This suggests that the NE surface area regulation mechanism could be tied to NPC density. One way to clearly show that could be a correlation plot of NE surface area and NPCS density, color coded for all the different conditions tested.

      Figure 2- It appears as though no comparative statistical analysis was done with the quantitative data displayed in Figure 2, yet it is stated that e.g., "treatment with cerulenin blocked nuclear growth while NPC density was maintained" or "yeast lacking the autophagy machinery do not show increased NPC density". These conclusions would be strengthened if statistics were run on the data similar to Figure 1.

      “NPC clustering is common phenotype in different cell types and in mutants defective in NPC assembly.” - Does this mean that NPC clustering is higher in mutants defective in NPC assembly? Would suggest including references for this. Also, this paragraph needs an introduction to why NPC clustering matters? Does it have any connection with the NPC distribution?

      “3D-SIM images revealed the presence of multiple smaller clusters distributed throughout the NE (Fig. 3A).” - It is unclear (also not mentioned in the Methods section) how clusters are identified. The images show rings but it is hard to tell how many clusters compose that ring structure. It will be beneficial to show how clusters are quantified. Can that be resolved with 3DSIM?

      “We frequently observed NPC clusters organized in a ring-like structure with diameters ranging from 250-300 nm (Fig. 3B)” - Is it possible to report what was the frequency of the ring structures in nup132-deleted and wt cells?

      “Clustering increased in aged nup132Δ cells grown on plates (Fig. 3C)”- The figure depicts the NPC ring like structure, does this mean that the ring increased or the clustering has increased. Does increase in clustering make the rings more continuous?

      “NPC clusters were frequently enriched in the anaphase bridge, along with excess membrane (Fig. 3E)” - Providing a quantification of NPC cluster enrichment in the anaphase bridge would be helpful.

      “Following completion of nuclear division, the resulting daughter nuclei had normal NE morphologies and NPC densities equivalent to wild-type nuclei (Fig. S2). This suggests that nem1Δ nuclei can remove excess NE membrane and NPCs during mitosis via the anaphase bridge.”

      • This implies that prior to mitosis nem1∆ cells have abnormal morphology and NPC densities but the latter is not measured.
      • The NPC density reported in Figure S2 for the WT and the Nem1 mutant are different from the NPC density reported for the WT in figure 1 and figure S1 yet it is done using the same tagged Nup, Nsp1. It would be helpful to have an explanation. If the NPC density is “a constant” in the WT it should not be different from one figure to another. If the nem1 mutant has a density of 4 NPC/micron^2 then it is different from the WT. Also, the NPC density in the nem1 mutant in Figure S2 seems almost bimodal. Increasing the number of nem1-delta cells analyzed could help identify if it is bimodal or if it is due to under-sampling.
      • For the nem1 mutant the clustering is not quantified.

      “In contrast, NPC clusters in nup132Δ nuclei coalesced into larger clusters that preferentially localized to the SPBs in mitosis (Fig. 3G)”

      • An overlay image could be included to support this statement.
      • Fig. 3F could be referenced here too because otherwise it is not referenced until the discussion; at which point it is used to reference the data that is referenced here as Fig. 3G.

      “We observed a clear reduction in NPC density over the nucleolus” - Is this referring to where the yellow and magenta staining meet in Fig. 4? It is not immediately obvious as to where "over the nucleolus" is in those slices. Can the regions that are being compared (NPC staining at NE vs. NPC staining over nucleolus) be highlighted/specified in some way so as to better understand the quantification method?

      Figure 4

      • 4C is gorgeous - really conveys the point well!
      • In this figure the authors at first show a 3D-SIM image, but perform the intensity analysis on the confocal slice. What is the reason for it? Analysis of the 3D-SIM data could provide more information on the characteristics (number, spatial distribution) of NPS density reduction.

      Figure 5

      • Very minor comment -- the scale bar is very hard to see in Fig 5A.
      • Statistics for Fig. 5B would strengthen the conclusion that the exclusion was cell-cycle independent.

      Figure 6

      • Figure 6D - Looking at the insets, the exclusion area in the lem2(delta)C-off appears to be the smallest one and closer to the exclusion area shown for the lem2(delta) in panel B. However, this is not represented in the quantification/results. I wonder if there is another image that would more closely represent the quantification outcome? Or if the insets might have been mislabeled, for instance lem2(delta)C-off could indeed represent the lem(delta)N-on and vice-versa?
      • Figure 6E - This is listed as F in the legend.

      “Tethering did not affect microtubule nucleation at the SPB, including the formation of cytoplasmic microtubules.” - Please provide evidence supporting this statement.

      Discussion

      “In nem1Δ mutants, both excess nuclear membrane material and NPCs are segregated into the anaphase bridge region during nuclear division” - This would benefit from some analysis - are there too many NPCs? Is it specifically the clustered NPCs? Currently the data supporting this is snapshots from a single movie.

      “The ability for 3D-SIM to resolve and quantify individual NPCs labelled with multiple fluorescent proteins at endogenous levels provides tools to begin to interrogate__ how altered NPC compositions may allow for functional specialization of NPC function at distinct regions of the NE.” - The high resolution images are really beautiful! Great job in showing the power of 3D-SIM to help answer these types of biological questions.

      Methods

      “Images were acquired overa6 μm volume with 0.3 μm z-spacing for 45 min at 2 min intervals.” - For dynamic measurements a 2-minute interval is big and it would be interesting to see a few time-series imaging with smaller intervals to capture the fast changes.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      1. General Statements [optional]

      This section is optional. Insert here any general statements you wish to make about the goal of the study or about the reviews.

      We thank the reviewers for their constructive and helpful comments on our manuscript and are delighted to find their consensus that the manuscript represents an important contribution to the field. We provide a detailed response to specific points below. In addition, we propose to include new data showing that our method can be applied to experimentally infected lung tissue. Namely, we show highly sensitive detection of SARS-CoV-2 RNA in infected hamster lung section.

      2. Description of the planned revisions

      Insert here a point-by-point reply that explains what revisions, additional experimentations and analyses are planned to address the points raised by the referees.

      Reviewer #1 **Major comments:**

      The authors used approaches provided in FISH-quant (Mueller et al, Nat Methods 2013) and big-fish. However, these tools to analyze RNA aggregates were not designed and validated for such massive aggregations as observed by SARS-Cov-2. They were developed for cases such as transcription sites with much smaller aggregations, with a few tens to a hundred molecules. With a regular spot detection approach, usually a few thousand spots can be detected in a cell (e.g. King et al, J Virol 2018), but this depends also on the used microscope and the available cellular volume. Higher RNA concentrations cannot be resolved with a standard approach, because RNA spots start to overlap. Decomposing RNA aggregations can help but will not work reliably for the high RNA densities observed for SARS-Cov-2, especially at later infection time-points. The tools will then not provide accurate estimates anymore. To my knowledge, there is currently not accurate quantification method for such massive RNA levels in smFISH. What has been done in the past, is using cellular intensity as an approximation and perform calibrations with cells having lower and thus still resolvable RNA counts (Raj et al., PLO Biology; https://doi.org/10.1371/journal.pbio.0040309.sg003). The authors proposed three expression regimes (partially resistant, permissive, and super permissive). My concerns here apply mainly to the category super-permissive, where an accurate estimation can't be performed. Here a more cautious quantification should be applied. __To a lesser extent, this will also apply to some of quantifications of gRNAs per factory, with counts exceeding 100s of molecules. As mentioned above, this does not affect any of the conclusions, but would reflect more accurately what kind of reliable information can be drawn from such experiments.__

      We agree with the reviewer that approaches like FISH-quant and Big-FISH cannot reliably quantify RNA spots with high spatial density such as our examples of “super-permissive” cells. Single molecule quantitation of such cases is likely to underestimate RNA expression as noted by us and King et al 2018 (doi: 10.1128/JVI.02241-17). Therefore, we integrated the combined smFISH signal intensity within entire cellular volumes and compared to the median intensity of single molecules in cells with lower infection density. We will (i) revise the methods and results sections to explain more carefully and explicitly the quantification of RNA in super-permissive cells. (ii) Provide a calibration plot for the quantitation as previously reported (Raj et al 2006, doi: 10.1371/journal.pbio.0040309).

      We agree that high local RNA density has the potential to interfere with quantification of gRNAs within viral factories. We have used the “cluster.decomposition()” function of Big-FISH to quantify viral factories, which is conceptually similar to the “Integrated intensity” mode of FISH-quant. Applying this algorithm to non-super permissive cells allows us to use the mean intensity of a reference single-molecule spot to estimate the number of molecules in a cluster. We are confident such estimates are reliable in the majority of viral factories, which contain less than or equal to 200 single gRNA molecules. We will revise the methods section to clarify this method of analysis.

      Reviewer #1 __**Minor comments:**__

      1.Page 6; the authors state that "smFISH identifies ... cellular distribution .... within ER-like membranous structures". However, the authors didn't directly show such a localization, could they provide an experiment with an ER stain?

      This text was based on previous light microscopy and EM studies that reported SARS-CoV-2 RNA in ER-derived membranes (termed Double Membrane Vesicles - DMVs) or co-localisation of anti-dsRNA (J2) with ER-markers (Cortese et al 2020; Hackstadt et al 202; Mendonca et al 2021)*. We propose to clarify the text on page 6 including the citation of these publications and to tone down our claim that the virus is located in ER-like membranous structures.

      *Cortese et al 2020, doi: 10.1016/j.chom.2020.11.003

      Hackstadt et al 2021, doi: 10.3390/v13091798

      Mendonca et al 2021, doi: 10.1038/s41467-021-24887-y

      2.It might be worthwhile pointing out that the probe-sets can be used in different host organisms (Vero - African green monkey; human cell lines).

      We propose to revise the text to emphasise more clearly the applicability of SARS-CoV-2 probes for the study of many different host organisms.

      3.I really liked the experiment, where the authors showed absence of signal when infecting with another virus & elegant control with the J2 AB. Maybe the authors could explain more clearly that the used a different coronavirus & that based on their sequence alignment no/little signal would be expected.

      Thank you for this supportive comment. We plan to follow the reviewer’s suggestion and expand our explanation of the rationale of this experiment in the text.

      7.The experiment with the isolated virions shows nicely that the smFISH approach has single-virus sensitivity. Did the authors compare the intensity of these isolated virions with the signal in Fig 1B? This might be a question of personal taste, but to me, this section might actually fit better in the first paragraph of page 4/5, where the authors describe single virions in cells.

      Thank you for the interesting question. We have not performed a direct comparison of the spot intensities of intracellular genomic RNA molecules and those from the isolated virions, because isolated SARS-CoV-2 requires poly-L-lysine coating for the coverslip attachment while our infection strategy utilises cells growing on uncoated glass. Nonetheless, the isolated virion spot intensities follow a unimodal distribution, and their shape approximates to the point-spread function of the microscope. Since spots at 2 hpi are largely derived from non-replicative viral genomes and they are measured in the intracellular environment with the same background (autofluorescence), they are a better ‘single RNA molecule’ reference.

      We also thank the reviewer for suggesting rearranging the text section. To address this point we plan to move the relevant text to the second paragraph of the Results section.

      8.Page 6. The authors state "+ORF-N and +ORF-S single labelled spots, corresponding to sgRNAs, were more uniformly distributed throughout the cytoplasm than dual labelled gRNA". This is difficult to appreciate from the image. Is this something the authors could quantify, e.g. with the metrics proposed by Stueland et al, Scientific Reports 2019?

      To address this point, we plan to: (i) present an alternative image illustrating a clearer example of differential spatial localisation of gRNA and sgRNA, and (ii) perform quantification of spatial dispersion indices for gRNA and sgRNA using the suggested method for our revision.

      9.Page 6. The authors perform a FISH/IF experiment including a co-localization analysis, where a "limited overlap" with sgRNAs was observed. I was wondering if this overlap could actually be simply due to rather high density of the sgRNAs. Maybe a control analysis by slightly changing the RNA positions could provide insight here, and give a threshold for what's to be expected randomly at a given RNA density.

      The reviewer’s comment is correct, in that a high density of sgRNAs and nucleocapsid protein could lead to signal overlap due to chance. This is why we excluded “super-permissive” cells from this analysis. Our co-localisation data showed that gRNA spots had a bimodal nucleocapsid immunofluorescence intensity distribution (data not shown), suggesting nucleocapsid-associated and “free” gRNAs, providing a threshold for this analysis. Nevertheless, we agree with the reviewer that the analysis of randomly positioned transcripts of the same density would provide a valuable control. In our revised MS we will include: (i) a random distribution analysis comparing the overlap between sgRNA and nucleocapsid in the “Observed” and a “Randomised” simulation, and (ii) a plot showing a full distribution of co-localised nucleocapsid immunofluorescence intensity for both genomic and sub-genomic viral RNAs.

      10.I don't fully follow the argument about stability on page 8. The authors also see an increase in the RNA levels. Couldn't this increase compensate for loss of RNA due to degradation? Would it be possible to perform an experiment at a very high REMDESIVIR concentrations which would blocks transcription?

      Remdesivir is a nucleoside analogue that inhibits viral RNA polymerase activity. While this drug inhibits viral replication, the inhibition is incomplete and using higher concentrations results in cellular toxicity. At the present time there are no stronger polymerase inhibitors available, so these experiments are the best approximation possible to assess viral RNA stability. We propose to revise the text to discuss the limitations of Remdesivir for modelling RNA stability.

      12.How did the authors define/detect replication factories? I couldn't find information about this in the methods.

      This is a good point raised by both the reviewers. Please see [Reviewer 2 General comment #1] for our response.

      Reviewer #2 **General comments:**

      1.The authors' definition of viral factories, in part as foci with at least 4 gRNA molecules, comes across as arbitrary. Perhaps a clearer explanation of this cutoff would be helpful to the readers' understanding of this definition. Additionally, confirmation of the functionality of such factories by immunofluorescence with anti-RdRp, for example, in addition to identifying staining of gRNAs and (-) sense viral RNAs at each focus could provide valuable support to the authors' conclusions.

      We thank both reviewers for requesting further information on our explanation of viral factories. We defined viral factories as smFISH signals with spatially extended foci that exceed the size of the point spread function of the microscope and the intensity of a reference single molecule. We then filtered these candidate factories based on the radius of the signal foci with EM-measured radii of double-membrane vesicles and single-membrane vesicles formed by SARS-CoV-2 (150 nm pre-8hpi and 200 nm post-8hpi) (Cortese et al 2020; Mendoca et al 2021). Our terminology encompasses both replication and viral assembly sites. The threshold of 4 genomic RNA molecules was selected as a technical threshold to limit an over-estimation of viral factories at later timepoints. For our spinning-disk confocal imaging system, we found the threshold of 3-7 RNA molecules provided satisfactory results. We propose to revise both the Results and Methods sections to clarify our rationale for defining and quantifying viral factories.

      As the reviewer mentioned, we have shown a partial overlap of positive sense genomic RNAs with negative sense genomic RNAs (Figure 2D, S2C), suggesting these viral factories represent double membrane vesicles. The use of antibodies against the viral polymerase (nsp12) is also a possibility to detect replication centres. However, replication centres are not the only ‘viral factories’ as there are also double-membrane structures where viral particles assemble (Mendoca et al 2021) and they, in principle, lack negative sense RNA and replication machinery, so neither smFISH probes against the negative strand nor a nsp12 antibody will comprehensively detect viral factories. We appreciate the valuable suggestion, but the classification of viral factories into replication and assembly sites would be challenging due to reagent availability and is beyond the scope of this manuscript.

      2.The random distribution of super-permissive cells in each cell line was demonstrated early in the infection, primarily at 8 hpi. The authors do not show how this pattern changes over time (8, 10, 12, 16, 24 hpi, for example). Do clusters of super-permissive cells appear at later time points, or does the pattern of 'highly' infected cells remain random for each virus? Any strain-specific differences identified from such patterns may be important for understanding infection progression. Finally, the authors do acknowledge this point, but it cannot be overstated that these data were taken from cell culture systems that have limited similarities to the human respiratory epithelium. A better model for such studies might be primary cultured human bronchial epithelial cells, but of course, these cells are not as readily accessible as the cell lines used in this manuscript.

      We share the same view that the presence and the spatial distribution of “super-permissive” cells can provide unique insights into SARS-CoV-2 infection dynamics. Our findings suggest that even at 24 hours post infection (hpi), not all cells become “super-permissive” and the culture maintains a heterogenous population of “partially resistant”, “permissive” and “super-permissive” cells (Figure 3C, S3C-D). We agree with the reviewer that the spatial distribution of “super-permissive” cells at later timepoints is of interest. To address this point, we plan to: (i) analyse the spatial distribution of “super-permissive” cells at 24 hpi, and (ii) compare the distribution of “super-permissive” cells at 24 hpi between VIC and B.1.1.7 strains.

      We appreciate the comment on the limitations of the cell culture systems to the human respiratory tract. However, Calu-3 and A549-ACE2 lung epithelial cells have been used in many studies over the last year and we feel it is important to publish single cell quantitation with these models to enable comparison with the published literature. We believe our results provide valuable information on the intrinsic nature of host cell susceptibility to support viral replication. During the review of this manuscript, we applied our smFISH probes to detect SARS-CoV-2 RNA in infected Golden Syrian hamster lung sections, which show an uneven distribution of infected cells. While the identification and spatial characterisation of susceptible cell types in the lung are beyond the scope of this manuscript, we are excited to include this data in our revised paper to demonstrate the utility of this sensitive approach to track spatiotemporal viral infection dynamics.

      3.The difference in early replication kinetics between the VIC and B.1.1.7 strains is an exciting finding that may have implications for clinical outcomes and transmissibility of these viruses. However, the authors did not clearly demonstrate how these differences in RNA production correlate to infectious viral load released from these cells (in bulk) at each time point. An explanation of this omission would be helpful.

      We will provide data on the level of infectious virus secreted from VIC and B.1.1.7 infected cells at all time points in the revised paper.

      In my opinion, findings related to specific cell lines are of much less importance (and are much less biologically relevant) that identification of replicative differences among strains. Such differences could be used, in part, to aid prediction of the transmissibility of VOC, for example. I think this point gets a bit 'lost in the weeds' of the rest of the paper.

      To address this comment, we will revise text on the differential replication kinetics of the SARS-CoV-2 strains to make this more prominent in our paper.

      3. Description of the revisions that have already been incorporated in the transferred manuscript

      Please insert a point-by-point reply describing the revisions that were already carried out and included in the transferred manuscript. If no revisions have been carried out yet, please leave this section empty.

      Reviewer #1 __**Minor comments:**__

      4.I might have missed this, but they authors could also mention the positive control data about but Calu3 infected with SARS-COv2. One thing I was wondering: why did the authors use two different cell lines for this experiment?

      To address this point, we have added a sentence about a positive control visualising SARS-CoV-2 in Calu-3 cells using our probe set (page 5 – line 17).

      The experiments with HCoV-229E were done in Huh-7.5 cells because SARS-CoV-2 and HCoV-229E have distinct cell preferences. Using the J2 antibody we show that the levels of the dsRNA derived from viral replication are similar in the two cell lines and with the two viruses. Therefore, the lack of smFISH signal in HCoV-229E infected cells supports the high specificity of the probe set.

      5.Fig 1E. Would be nice to have the intensity scale for all time-points to permit a comparison of image intensities along the different time-points.

      6.Fig 3B. Would be important to have intensity scale bars to judge the signal intensities across the different time-points.

      The fluorescence intensity scale in Figure 1E is applicable to all timepoints, except for the lower panel at 24 hpi, which was intended to show wider dynamic contrast range. To address this point, we have provided intensity scales for all time-points studied in this figure and also Figure 3B.

      11.Fig 3C. maybe indicate the two groups with dashed lines.

      We have added a dashed line at the 102 mark in Figure 3C to visually differentiate “partially resistant” and “permissive” cells.

      4. Description of analyses that authors prefer not to carry out

      Please include a point-by-point response explaining why some of the requested data or additional analyses might not be necessary or cannot be provided within the scope of a revision. This can be due to time or resource limitations or in case of disagreement about the necessity of such additional data given the scope of the study. Please leave empty if not applicable.

    1. Reviewer #3 (Public Review): 

      The paper contains a substantial amount of novel experimental work, the experiments appear well done, and the analysis of the data makes sense. Raw data and analysis scripts have been made fully available. 

      I have two specific comments: 

      - While the paper talks extensively about deep mutational scanning, I don't think this is a deep mutational scanning study. In deep mutational scanning, we usually make every possible single-point mutation in a protein. This is not what was done here, as far as I can tell. 

      - For the analysis of epistasis vs distance (Fig 4d, e, f), it would be better to look at side-chain distances rather than C_alpha distances. In covariation analyses, it can be seen that C_alpha distances are not a good predictor of pairwise interactions. Similar patterns may be observable here. 

      See e.g.: A. J. Hockenberry, C. O. Wilke (2019). Evolutionary couplings detect side-chain interactions. PeerJ 7:e7280.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      We want to thank all three reviewers for their positive and constructive comments and suggestions for improvement. We have now thoroughly revised the manuscript including new analysis, extra figures, and new material in the wiki. The manuscript has significantly improved because of the reviewers input. Detailed responses to questions and comments are given below.

      Reviewer #1 (Evidence, reproducibility and clarity (Required)):

      Lange et al. have developed an automatic feeding system for zebrafish facilities. The system is open-source and relatively easy to implement. The authors propose to systems, one that delivers the same amount of food for each aquarium (ZAF) and a second (ZAF+) that can adjust the amount of delivered food to each aquarium. The authors show no difference in fish weight, spawning and water quality, when fed using the automatic system or manually.

      In my opinion, the ZAF and ZAF+ are an excellent first approach to solve the complex problem of automatizing feeding in fish facilities. So far, only one company offers this option which is extremely expensive and demands a lot of maintenance.

      The manuscript is very well written and easy to follow. The supplementary material is very well detailed. It is clear that the authors intended to facilitate the implementation of the ZAF by potential users.

      We appreciate the supportive comments from Reviewer 1 and address all comments below:

      I just have a few comments regarding the system:

      1) The authors do not indicate how the system is cleaned. the system drains itself, but will any deposits of food remain in the tubes ? Why is the system not flushed with clear water after each feeding? do the tubes get clogged ?

      We agree that the cleaning process was not clearly explained in the manuscript. We added clear sentences in ‘Box 1’ to describe the first cleaning step (see text and figure). Indeed, after each feeding we flush water and then air into the tubes. Moreover, we explain in ‘Box 2’ that we have a second level of cleaning in the form of a special cleaning program that is run at least once a day with no food distribution (i.e same program as used for feeding but without actual food mixed, we flush lots of clean water and then air in the system). Finally, in the discussion we clarify the different cleaning steps by adding extra explanations in the first paragraph.

      All these procedures and programs are very effective in preventing system clogging and in reducing the accumulation of debris and algae. After more than 19 months of ZAF and ZAF+ feeding in our facility we never experienced any tube clogging.

      2) How long the system was tested for?

      ZAF has run in the facility for 9 months and ZAF+ for 10 months since September. We added a sentence about the testing time in the discussion. We never experienced any major problems, only a few minor malfunctions, reported in the new troubleshooting table added to the wiki (suggested by the reviewer 2).

      3) The ZAFs were used to feed 16 aquariums. For such a small rack, manually feeding takes less than 5 min. The authors should highlight that, at least for such small systems, the ZAFs will be especially very useful for feeding during weekends and holidays. Still, adding 16 commercially available small automatic feeders to each aquarium, could be simpler to implement.

      As noticed by the reviewer, ZAFs are very useful when staff are not present (week end, vacation, etc..). To emphasize on this particular point we added a sentence in the discussion's first paragraph. The small automatic feeders available commercially are usually very difficult to attach to zebrafish facilities . Indeed they can’t adapt to conventional lab aquatic facility racks because they are designed for pet aquariums. They also have less features compared to the ZAFs (difficult to adapt the food quantity, more food waste, cumbersome...). Additionally, by multiplying the number of devices (you need one small feeder per tank), one increases the risk of possible malfunction as well as the maintenance time required for food filling, cleaning etc...

      Thus, usage of small automatic feeders in laboratory aquatic housing racks is complex to adapt, a source of feeding error, is more cumbersome, and potentially more time consuming etc… They are simply not designed for professional aquaculture systems. Whereas ZAFs can be easily adapted to all the commercially available aquatic facilities. The fact that ZAFs simply ‘interfaces’ via tubes to fish facility racks makes them very versatile and unintrusive.

      4) How do authors envisage implementing the ZAFs in much larger facilities (from 100 to 1000 tanks) ? Implementing a specific ZAF for each rack containing ~20 tanks may not be realistic.

      Indeed building multiple ZAFs will be complex and resource consuming. Thus, we designed ZAFs to be adaptable and modular, so one ZAF ( or ZAF+) can easily be scaled to handle bigger facilities. The supplementary information and the wiki describe all the steps required to build a ZAF for 16 tanks and a ZAF+ for 30 tanks and many tips to scale up these devices without major modifications (up to 80 tanks for ZAF no restrictions for ZAF+). Of course, we do think that for truly large facilities, there is probably a sweet spot that balances the number of individual devices and the per-device capability. Having a single device feeding 1000 tanks is probably not wise, perhaps 5 devices for 200 tanks each (ZAF+) would be the best. Please note that the hardware cost and complexity scales roughly linearly with the number of tanks, no surprises here. Moreover, in the case of ZAF+ it is possible to use splitters to feed even more tanks from the same line (ZAF+).

      We added pages in the ZAF/ZAF+ wiki, to help the users extend the feeding capacities of their desired ZAFs (see in the wiki “tips to scale up ZAF “- “tips to scale up ZAF+”). We also mentioned in the discussion the possibility of distributing food to more tanks with one device by increasing the outputs and referenced the wiki accordingly.

      Having said this, we did not primarily design ZAFs for super large fish facilities, instead we designed the ZAF systems to facilitate adoption of fish models by many small and medium sized labs. We hope that our system will lower the bar for labs with moderate ressources to get started with aquatic models, or labs that just want to ‘try’ a new aquatic model organism ‘on-the-side’.

      5) how the length of the tubes influences the efficiency of feeding ? For feeding many tanks with the same ZAF it is necessary that the tubes will be of the same length. In that case, the system will become very cumbersome. Longer tubes will probably need stronger pumps. What's the maximal length of tubes tested ? That will limit the number of aquariums a ZAF can feed.

      how the length of the tubes influences the efficiency of feeding ? For ZAF the size of the tubes is very important because its design assumes homogeneous food distribution. In contrast, ZAF+ distributes the entire amount of water and food mix to each tank sequentially, so the tube length is not an issue. To make sure that tube length or tube layout is not affecting feeding efficiency we evaluated the weight of fish coming from tanks housed on two different rows (top and bottom). This was not clearly explained in the methods section -- we changed the text to reflect that. Additionally, at the end of each ZAF+ run, the washing sequence runs a relatively large quantity of water to ensure that all food gets flushed out to the right tanks. We did not evaluate the precise amount of food delivered. However after each feeding and cleaning all tubes are empty (see last sentences of the Box 2).

      For feeding many tanks with the same ZAF it is necessary that the tubes will be of the same length. In that case, the system will become very cumbersome. This is a fair concern. However, with a good design and with the help of cable tie it is very easy to organise the tubing, and avoid ‘tube-hell’. We added a sentence to clarify the organisation in the wiki (see ZAF>Hardware>Tubing in wiki) .

      Longer tubes will probably need stronger pumps. What's the maximal length of tubes tested ? That will limit the number of aquariums a ZAF can feed. We never precisely measured that because the generic pumps we use are very powerful and their running time can be adjusted in the software by changing the constants in the code source (see troubleshooting new supplementary table). Therefore the length of tubes should not be a limiting factor. Even stronger pumps (more amps) can be readily sourced on Amazon if really needed -- although we doubt that this is necessary. Regarding the number of tanks that ZAF can feed, we simply recommend adding more pumps to increase its capacity (see previous comments or “tips to scale up ZAF” in the wiki).

      Despite these comments, this is an excellent first approach, and the fact that the authors made it open-source and open access, make the ZAFs a very important contribution to the community. I have no doubt that some fish facilities will implement it and the community will help to improve it. Thank you. We do think that the main benefit of an open source project is the community around it. We are currently collecting a growing list of interested labs and we are interested in organising an online workshop to discuss ZAF and ZAF+, with some talks, QAs, and more to help people getting started.

      Reviewer #1 (Significance (Required)):

      This is the first open-source open-access automatic feeding system ever published.

      It is the first but very important step to the automation of research fish facilities.

      **Referee Cross-commenting**

      I agree with all the other reviewers.

      We also have to take into account that the system is a first prototype and although not ideal, it is open source. This will allow other labs to develop and improve their own models based on the ZAF.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)):

      **Summary**

      The manuscript proposes an open source automated feeder for zebrafish facilities, although it would be amenable to other species. Overall, the manuscript is clearly written and easy to understand, the wiki is well sourced and clear. The commitment to open source is commendable.

      I have some questions regarding the long-term sustainability of this setup, as well as some discrepancies in the methods. Finally, as this aims to be useful to people with no engineering/electronics competence, I feel that it is not yet at a level that is accessible enough.

      We are very pleased to see that the Reviewer appreciates our manuscript and our commitment to open access. We thanks the Reviewer for his comments, in particular the comments about accessibility, and address them bellow:

      **Major comments**

      It would be useful to have a centralized list of parts and components, which would make it easier for users to order all that is needed to assemble the ZAF or ZAF+, at the moment the information is distributed through the wiki as hyperlinks.

      Extremely important! This was clearly an oversight on our part. We agree that a table listing all the components would help for constructing ZAF and ZAF+. We have added two tables in the wiki, one for ZAF and another for ZAF+, with all the necessary parts and components required to build both devices, with articles number, supplier and cost in dollars. Thanks to the reviewer for this excellent suggestion.

      A troubleshooting guide for the common problems the team ran into (if any) would be useful for newcomers, even just as issues on the GitHub. The team may also consider some form of chat/forum/google group to allow discussions between users and experts.

      The reviewer raised an important point so we added to the ZAF wiki a troubleshooting guide to help users by listing the minor malfunctions that we observed. Additionally, users will be able to ask questions or report bugs on the ZAF GitHub using issues. Github issues will allow discussion and to track ideas and feedback within the ZAF user community. Finally, we just created a Gitter room: https://gitter.im/ZAF-Zebrafish-Automatic-Feeder to enable more interactive discussion.

      Did the author observe any algal or bacterial growth in the feeding tubes over the 60 days? Do they have an estimate on how long the tubes stay "clean" enough? The authors mention tube changing every 10 weeks, can they explain the rationale, and did they assess the bacterial/algal contamination over that time? Do the splitter panel and food mixing flask also need replacing regularly?

      After several weeks of usage we indeed observed algal and bacterial growth in the tubes. In order to report and justify the need to change the tubes, we made a new supplementary figure illustrating the tube cleanliness over time, mainly algal and bacterial (see Suppl. Fig 3). We realised that 12 weeks is actually the optimal tubing renewing period in our facility. Algal and bacterial growth depends on the facility environment characteristics such as light intensity, water and air temperature, as well as feeding frequency and therefore might be adapted to the users facility specs. The splitter tubing can be changed based on user observations; we now mention this in the ZAF tubing supplementary material and on the wiki.

      The authors mention that the tubing needs to be of similar length to ensure similar resistance and food distribution, did they compare the body weight of fish in racks at the top or at the bottom of their system? There are no overall differences, but maybe the bottom racks would received slightly more food? Furthermore, did they quantify the differences in food/water delivery as a function of length differences?

      The requirement for similar length is only necessary for ZAF because its accessible design assumes homogeneous distribution of the water-food mix through a passive splitter system which is susceptible to variable fluid resistance. In contrast, ZAF+ distributes the water-food mix one tank at a time -- ensuring that the correct amount of food is entirely flushed through any required tube length (the pumps are strong enough and we flush enough water). In the eventuality that the tube length is too long the user can adjust the pump running time by changing constants in the code (see troubleshooting table in the wiki and corresponding links).

      We thank the reviewer for suggesting to evaluate the fish weight on fish from two extremal heights. Although we did not explicitly report this in the first version of the manuscript, we had actually anticipated this potential issue and therefore we did collect data for ZAF and ZAF+ for tanks housed on the top and bottom rows. We added a clear description of the weighting process in the material and method, highlighting the housing condition of the tanks tested.

      Finally, after each feeding run the tubes have been fully flushed and are empty without food debris or pellets remaining, irrespective of their sizes. So we did not find it relevant to evaluate the precise amount of food effectively delivered as we control that already upstream.

      Methods fish weight: The methods mention different amounts of food than the wiki, the rationale in the wiki is also different from the 5% of body weight outlined in the methods (which then matches the food amount of the methods). Which is the correct amount?

      We thank the reviewer for noticing the inconsistency. The method numbers are the correct one so we changed the wiki, we made a mistake when editing the figures. We wrote some sections of the wiki early during the development of the hardware. We unfortunately forgot to correct the inconsistencies.

      The code is decently commented for scientific software with clear variable names, but I wonder how flexible it is if users cannot get access to the specific hardware (especially the pumps) used in ZAF/ZAF+? Can the authors briefly comment on this point?

      The pumps are just built from 12V motors, you can find a large variety of such pumps online (Amazon, etc…), we have ourselves tried several, but there is no need to have the exact same model. We added a note to the tubing section of the ZAF and ZAF+ about that.

      The only components that cannot be easily exchanged are the arduino and Raspberry PI, but that is not an issue as these are very easily sourced components.

      The wiki could use more pictures or, to borrow the Proust Madeleine allusion, schematics akin to LEGO with more intermediary steps clearly outlined. Some pictures are also a bit small/busy (such as 2D and 2E in the frame section, or the magnet pictures), they may benefit from cartoons/schematics to clarify what is done. Alternatively, videos/timelapses may help with better visualising the assembly.

      We appreciate the reviewer comments and added new pictures, schematic and extra legends in the wiki to help potential ZAFs builders. In the wiki for ZAF hardware we increased the size of all the pictures for all the different steps and added new legends to clarify the assembly. There are also now more pictures illustrating the construction steps (i.e in “frame”, “pumps and valve”) and we added a simple schematic for “servo and food container”. Picture sizes have been increased in “ZAF electronics” and added to the “Raspberry Pi and Servo Hat” section. We increased the picture sizes and added more legends to the ZAF+- Hardware “Pumps & Valve'. Moreover, we added more photos to the “tubing” section and the “ZAF+ Electronics” section.

      We agree that videos or gifs would have been great to visualize the assembly. Unfortunately, we did not record such videos during the construction. We created ZAF as an open source project and clearly hope to generate a community that will share assembly pro-tips and may be constructions videos on the github.

      Our institute is expanding on zebrafish research so we will build additional ZAFs and will use this opportunity to prepare nice videos to add to the wiki. We envision that the wiki will be improved over time with better material, some of it contributed, as well as perhaps newer and better versions of ZAF.

      The main question that would affect if this approach were taken up would be how reliable it is in the long run. Have the authors experienced any issue over the 2 months test? Is this system still being used currently? If so, could the authors update the water quality logs?

      The reviewer suggests that the key question is to see if using ZAFs all year long is possible. We can reply yes, it is actually possible! We have used ZAF for 9 months, and now ZAF+ for the past 10 months in our fish facility, with great success. We never experienced major malfunctions and the minor issues we encountered are reported in the troubleshooting table. Since ZAF and ZAF+ have been used daily for months with logs recorded every day we have updated the water logs quality to 3 months. We have been using the ZAFs in full autonomy for a total of 19 months, frankly invaluable.

      Getting a sense of how long it can run without problems, how much troubleshooting is involved per month would be very useful in answering those questions.

      Except manual cleaning and tube replacement, there is no other big maintenance on ZAF. Of course, the food reserve needs to be changed at least once per week. We listed the malfunctions in the troubleshooting guide in the wiki. In our facility ZAFs require an average of 1 hour of maintenance per month. And if any hardware part fails you can just immediately replace it because all the parts are cheap and easily replaceable. Actually, we recommend keeping spare parts of all the key components (pumps, valves, arduino, Raspberry Pi, tubes, ...).

      **Minor comments**

      • Main text page 3: Fig. Supp. 2 instead of Supp. Fig. 2. Furthermore, would the authors have similar data for the manual feeding? If so, it could be useful to add here for comparison (although that is not necessary if the data is unavailable).

      We changed the text but we don’t have data available for the water logs with manual feeding.

      Main text page 3: it would be useful to add how long it takes to change all the tubing after 10 weeks?

      This is really dependent on ZAF tubing and the fish facility, in our hand for about one hour. We mentioned it in the results section, ZAF paragraph.

      Methods fish weight: The phrasing as it stands make it unclear the same method was used for ZAF and ZAF+, the authors may consider to start with the description of the common weighting method, then the specifics of ZAF+.

      Thank you, we changed the text accordingly.

      Supp.Fig.1a: "Waste water drain pipe"

      Thank you, we changed the text accordingly.

      Acknowledgments: "...for their help..."

      Thank you, we changed the text accordingly.

      ZAF - Servo Hat connection: "to control the pumps"

      Thank you, we changed the text accordingly.

      ZAF - Installation: the dependencies should be listed as they are in ZAF+, or the two sections merged, unless the GUI is not functional (see below).

      Thank you, we now list the dependencies in the wiki.

      ZAF - How to use: there is no mention of the GUI, is it not yet implemented? If not, is the touch screen needed?

      The standard ZAF hardware is controlled by a very simple python-based program that works with a command line interface. Therefore to interact with the Raspberry Pi for installation and configuration we strongly recommend building ZAF with a screen, and the touch screen is an easy way to be able to quickly point and click in the absence of a mouse -- which can be cumbersome when no clean horizontal surfaces are available in a lab environment.

      ZAF+ - soldering: "A 12V power supply (at least 10A best 20A) provides power to the electronics, except the Raspberry Pi and the two Arduino Megas." It seems the sentence is incomplete, or at least I cannot make sense of it.

      Changed to “A 12V power supply (at least 10A, but ideally 20A) provides power to the electronics, except for the Raspberry Pi and the two Arduino Megas that are powered by the Raspberry Pi 5V GPIOs.”

      Reviewer #2 (Significance (Required)):

      This manuscript provides a significant technical advance to the zebrafish field. The proposed automated feeder would be a very useful option for smaller labs, to ensure the consistency of feeding, and to remove one of the routine aspects of fish husbandry.

      As the authors state, there is certainly interest in the zebrafish community [9,10] for automation of feeding. I am not aware of other DIY fully automated feeding system, commercial systems do exist, but are expensive.

      The manuscript, and proposed automated feeder, would certainly be of interest within the zebrafish community, as well as other researchers using aquatic models that can rely on dry food. How many in the community would embrace this method will depend on how confident they are in the long-term stability.

      I am neither electronics, nor husbandry expert. As such I am not qualified to comment on any long-term approach this may prove, if any, for fish health. My expertise lies in image and data analysis, as well as microscopy.

      **Referee Cross-commenting**

      I think the major points are shared by all reviewers, I think the other reviews are fair in their content and I have nothing specific to comment on.

      Reviewer #3 (Evidence, reproducibility and clarity (Required)):

      **Summary:**

      This technical report describes an open-source fully automated feeding system for husbandry of zebrafish (and potentially other aquatic organisms). It provides detailed instructions for assembling individual components into two different feeding systems of varying adaptability, as well as their operation. Links to relevant control software are also provided. The characterization of the systems' performance appears somewhat limited (e.g. only maintenance of adult fish over a period of 8 weeks and use of dry food is documented). These systems could be of use for husbandry in a large number of research labs, and, in

      addition, for automated reward delivery in large-scale associative conditioning assays.

      We thank the Reviewer for his encouraging comments and appreciate his helpful suggestions. We answer to the Reviewer comments bellow:

      **Major comments:**

      Providing food to large numbers of tanks in aquatic animal facilities in a regular fashion is a time- and resource-consuming process. Some automated feeding systems for large numbers of tanks are commercially available, but these feeder robots are expensive and are restricted to systems of specific vendors. Therefore, an adaptable automated system that can be assembled from off-the-shelf components is a very attractive option for many research labs to both save resources and standardize the feeding process.

      The instructions for assembly provided by the authors appear quite detailed and sufficient to allow non-experts the assembly and operation of the automated feeder systems. The design of the system appears appropriate for the task.

      While additional experiments are not required to support the claims of the article, I feel that it would be significantly improved by the provision of additional information. My suggestions in that regard include:

      Description of the washing procedure of the system (which solvents, how often, how long?). The authors mention that an exchange of the tubing is required every 10 weeks, but since the tubing transports liquid food mixture, it is easily conceivable that microbial growth will occur rapidly in the system without thorough hygiene / washing procedures. Also could the authors provide some information, which type of tubing material they are using (Silicone, Tygon etc.)?

      Description of the washing procedure of the system (which solvents, how often, how long?).

      We agree that the cleaning procedure must be clarified. So we added a more clear description of the process in the first paragraph of the discussion and clarified the explanation about cleaning in Box 1 and Box 2 (suggested also by the reviewer1). To summarise there are two levels of cleaning, the first one happens just after a food distribution program by flushing water and air in the system (Box1). Additionally at least once a day, we run an entire program without food, to rinse/clean the system (Box2). This last step is programmable using ZAFs software.

      The authors mention that an exchange of the tubing is required every 10 weeks, but since the tubing transports liquid food mixture, it is easily conceivable that microbial growth will occur rapidly in the system without thorough hygiene / washing procedures

      Following all reviewers' comments we added an extra supplementary figure justifying the need of changing the tubes every 12 weeks (updated based on our latest observations). We monitored the cleanliness (algal/microbial growth) of the tubes and realized that it becomes necessary to replace the tubes every 12 weeks (supp figure 3). Interestingly, we remarked that the microbial and algal growth depends on the facility specificities such as light intensity and temperature.

      Also could the authors provide some information, which type of tubing material they are using (Silicone, Tygon etc.)?

      For ZAF we used silicone based tubing then we changed to PVC based tubes for ZAF+ because they are cost effective and have similar specifications for our usage. We added a note about the tubing material in the wiki ZAF tubing and ZAF+ tubing.

      In a related point, I was left wondering how long the food is being mixed in the mixing flask before being applied to the animals? Too long mixing might lead to a loss of nutrients into the solution (through diffusion). Could the authors comment on that, please? Do the food pellets remain more or less integral so that the majority of delivered food is actually ingested by the fish?

      • In a related point, I was left wondering how long the food is being mixed in the mixing flask before being applied to the animals? Too long mixing might lead to a loss of nutrients into the solution (through diffusion). Could the authors comment on that, please? Very relevant point, indeed it is very important for the food to not be mixed too long in water to avoid pellet dissolution in water and loss of nutrients. The food manufacturer website mentioned: “duration of “wet” feeding should be kept short” (https://zebrafish.skrettingusa.com/pages/faq). Therefore we adapted our feeding program to keep the “wet” feeding extremely short. For ZAF and ZAF+, the software is designed to deliver the mix of food and water to tank(s) within 3 minutes at most. To clarify this, we added in the Box describing the feeding, a sentence : “Overall, they share many common features, like the quick distribution of food and water mix, to avoid pellet dissolution in water and loss of nutrients.”

      • Do the food pellets remain more or less integral so that the majority of delivered food is actually ingested by the fish? We manually evaluated the integrity of food pellets in the early phase of development, these parameters being difficult to quantify, we decided to record the fish weight as a readout of good food delivery and general effectiveness. However, we clearly understand the reviewer's remarks and therefore added to the manuscript a supplementary video that shows the distribution of the food pellets and their integrity once they reach the tanks.

      In yet another related point, I was left wondering, whether the authors observed any negative impact of feeder usage on water quality (besides pH and conductivity, which they report)? Especially, with regards to ammonia that might arise from the decomposition of uneaten food items?

      Ammonia toxicity is mentioned to induce clinical and microscopic changes that reduce growth and increase susceptibility to pathogens according to aquaculture textbooks as summarized here: https://zebrafish.org/wiki/health/disease_manual/water_quality_problems#ammonia_toxicity). However, we never experienced such abnormal phenotypes in our facility and our regular aquatic PCR health monitoring profiles have always been negative for pathogens. Additionally, high ammonia is influenced by husbandry conditions, such as important fish density or inappropriate water circulation, characteristics that are not present in our fish facility. Therefore we did not find relevant to test for ammonia levels.

      The authors only tested the feeder on adult fish, but discuss that it would easily be transferable to a system that is used for raising fish fry. In that context, could the authors comment, on whether the system of using water as the carrier for the dry food (after mixing) would work as well for the smaller pellets required in feeding fish fry (e.g. 75 or 100 um pellet size as compared to the 500 um pellet size they use)? With smaller pellets, break-down of the dry food during the mixing process seems to be an even larger problem, I could imagine.

      We appreciate the reviewer's comment about using different food pellets sizes, a very important point for ZAFs adoption beyond adult fish. During ZAFs testing we actually tested different food sizes (from 100uM pellets to 500uM) and did not observe differences in pellet distribution. Most of the industrial aquatic food pellets are oily and designed for automatic distribution (for large farming environments). Therefore they keep their integrity and are not easily broken. Besides, during food distribution, as mentioned previously, the duration of wet food (water and food mix) is relatively short, which helps maintain pellet integrity.

      **Minor comments:**

      (1) the average weight of animals is given as lying in the range of 5 to 6g. That seems very high. The "standard" weight range of adult zebrafish is more around 1g [see, for example: Clark, T. S., Pandolfo, L. M., Marshall, C. M., Mitra, A. K. & Schech, J. M. Body Condition Scoring for Adult Zebrafish (Danio rerio). j am assoc lab anim sci (2018)]. Could the authors comment on that discrepancy?

      Good observation by the reviewer. We did make a mistake during figure preparation and our legends were actually not reflecting the exact weight of the fish. The scale bars of the figures have been changed to reflect the real weight of the fish (below 1g). We thank the reviewer for noticing the mistakes.

      (2) The authors state that spawning success is not negatively affected by the automated feeding, and they quantify the number of successful crosses. Could the authors briefly confirm or state, that or whether the clutch size was also unaffected?

      We never precisely quantified the clutch size/quality but we are now using ZAFs for the feeding of our facility for 19months and never observed any problem with our clutch. Our lab is working on early development and crucially relies on clutch quality.

      (3) The manual feeding procedure / regime that is used to compare husbandry success against the automated feeding regime is not described in any detail. That seems important given the topic of the article.

      We agreed and added a brief description of the protocol in the Methods section (“Animal and husbandry”).

      (4) The authors cite two recent papers that describe semi-automatic feeding systems for zebrafish in the introduction. The authors might want to consider discussing some key differences between their system and these semi-automatic systems in the discussion.

      The two published semi-automatic feeding systems are completely different from the devices presented in our paper. They are also open access but they are devices that need to be manually operated by facility staff. In contrast, our solutions are fully automatic and do not require the human hand during operation. We mention these two solutions during our brief literature overview in the introduction. However, since these are in a different category, we did not judge it necessary to comment on them in the discussion.

      (5) What do the error bars in Fig. 1c signify (s.d., s.e.m.)? Please state in Figure legend.

      We thank the reviewer for their attention to details and explain in the figure that we mean standard error of the mean by s.e.m.

      (6) I do think that the system could be of particular interest to researchers that study learning and that use food rewards in automated associative conditioning experiments. While this might be obvious to researchers with such an interest, this aspect is not at all discussed in the paper. Mentioning it might further underscore the versatility of the feeder system.

      We agree with the reviewer that ZAF can be adapted to experimental conditions such as behavioral conditioning, nutritions and drug delivery. Any experiment requiring the automatic delivery of solid pellets or liquid can benefit from ZAF. We revised our text and mentioned it in the discussion.

      (7) A list of all required equipment with vendors and price estimates (e.g. in the Supplement) would make this paper an even more readily accessible resource.

      This is a very important point already suggested by another reviewer. We added two extra tables in the wiki with the necessary parts and components, listing models, references, and prices.

      Reviewer #3 (Significance (Required)):

      Describe the nature and significance of the advance (e.g. conceptual, technical, clinical) for the field.

      This article signifies a purely technical advance in that it provides a characterization of an open-source, scalable automated feeder for aquatic facilities. As such, it presents a significant advance in the field of aquatic animal husbandry. In addition, this system could also be useful for automated large- or medium-scale associative conditioning paradigms, in which food rewards are given as positive reinforcers.

      Place the work in the context of the existing literature (provide references, where appropriate).

      The authors refer to previously published semi-automatic feeder systems. Regardless of the advantages or disadvantages of all these systems, the field will benefit from a broad(er) choice of automatic feeding systems that are described in sufficient detail to be easily assembled in the laboratory.

      State what audience might be interested in and influenced by the reported findings.

      This study is of interest for any research laboratory working with zebrafish or other aquatic model organisms. Thus, the audience for this article is very broad. Specific interest might also arise in researchers that are performing learning studies in zebrafish (see above).

      Define your field of expertise with a few keywords to help the authors contextualize your point of view. Indicate if there are any parts of the paper that you do not have sufficient expertise to evaluate.

      Zebrafish, neural circuits, sensory systems.

      **Referee Cross-commenting**

      Many of the major points are shared by all three reviewers. Beyond these shared points, I agree with the other reviews; they raise important questions. All reviews are fair, in my opinion.

    1. Author Response:

      Reviewer #1:

      Strengths

      This study is a technical and analytical tour de force. The evolution experiments with barcoded lineages involved an immense amount of work and clever design, and the scale of the data challenged the authors to develop new statistical summaries. The figures are clear and results easy to interpret, even outside the evolution-experiment bubble. While the essential findings are not especially surprising, the robustness enabled by this level of replication is appreciated.

      Weaknesses

      I'm not exactly sure what I learned. I'm biased to like this work and while I'm confident that if I studied these findings more I would learn more, it wasn't obvious. For example - I want to know more about the effects of ploidy on pleiotropy, and while there are some differences e.g in Figure 4A, I don't know what these PCs actually are saying. If particular phenotypes associate with PC's, it'd be helpful to "load" them on these axes.

      To more clearly show general trends and variation in pleiotropy, we have added a summary of the changes in fitness across all populations in Figure 2B and Figure 2– figure supplements 2–5. We have also expanded our consideration of these trends, including the effects of ploidy on pleiotropy. To supplement Figure 4, we have included the contribution of each assay environment to the principal components (Figure 4–figure supplement 5), as suggested.

      Also, do some treatments lead to faster or more complete diminishing returns than others, and does this influence pleiotropy?

      To compare changes in fitness across evolution environments and over time, we have computed the change in fitness for each population over the first 400 generations and the last 400 generations. This is plotted in Figure 2-figure supplement 6A. To assess the statistical significance of apparent diminishing returns, we compared the mean change in fitness over these time intervals using a t-test and provided the resulting p-values in Figure 2-figure supplement 6B. Overall, we see that different treatments lead to different extents of declining adaptability and note this in the Results. This declining adaptability may certainly influence pleiotropic outcomes, but unfortunately it is difficult to disentangle any potential such effects from other differences between environments (or assign any causality to correlations in the strengths of diminishing returns and differences in pleiotropy between replicates in the same environment), so we refrain from drawing any conclusions about this possibility.

      In total I think this manuscript can be improved by being presented / read by others, which is the job of peer review but here I think it's also to broaden its implications.

    1. It well may be. I do not think I would.

      Even though the poem starts with saying love is not all, it ends with love is all we need. I think this is interesting and relatable among teenagers that they want to be loved and feel love, but at the same time, they act as they don't really care about not being loved.

    2. I might be driven to sell your love for peace, Or trade the memory of this night for food. It well may be. I do not think I would.

      In these last few lines Millay sort of contradicts herself as even though she compares love in a way that is less valuable, and could be said unnecessary, she still acknowledges that it does have a value that she wouldn't trade. However I think it remains in saying that love is not all, as it is not a necessity but something she thinks shed rather have. Love is not all that we need but we think it is.

    1. Mattimore characterizes brainwalking as the most flexible of the seven ideation techniques, because it can be easily combined with other techniques. It’s also an ideal way to ensure that everyone in your group gets an opportunity to contribute ideas. Here’s how it works: The group first selects several aspects of the problem around which it wants to generate ideas. These become the creative prompts for the group to work with. The facilitator tapes several pieces of paper to a wall. Each member of the group gets a marker. Participants write their ideas on a paper and then rotate, adding their thoughts own original and ideas to the page as well as building upon those of their colleagues. This can also be done by having a group sit in a circle and have the papers passed one person to the right or left after several minutes of brainstorming. When each “pass” takes place, Mattimore points out, the facilitator can suggest different ideation techniques or triggers. This helps people who may not be able to think of any new ideas and may help them to see the ideas their colleagues have written in a new light. It also helps the team generate a wider diversity of ideas.

      I really like the idea. Just like the old saying goes: two heads are better than one. Triggered brainwalking can be very helpful. I think that is also why we have to talk other classmates about our wicked problem.

    1. For now if Zeus who thunders on high in evil intentiontoward these is destroying them utterly, sending aid to the Trojans,this is the way I would wish it, may it happen immediatelythat the Achaians be destroyed here forgotten and far fromArgos; but if they turn again and a backrush comes on usout of the ships, and we are driven against the deep ditch,then I think no longer could one man to carry a messageget clear to the city, once the Achaians have turned back upon us.Come then, do as I say, let us all be persuaded; let ustell our henchmen to check our horses here by the ditch, thenlet ourselves, all of us dismounted and armed in our war gear,follow Hektor in mass formation. As for the Achaians,they will not hold, if the bonds of death are fastened upon them.

      In this passage, Poulydamas is trying to convince Hector during a Trojan advance on Achaian positions that it is necessary for the horses to be left behind due to the presence of a large ditch with sharp stakes in front of the Achaian fortifications. Attacking well defended fortifications on foot is more dangerous than on a chariot due to a loss in mobility, therefore Poulydamas has to inspire confidence in Hector to act on his plan. A method that he uses to convince Hector in the passage is by claiming that the odds are in their favour. He mentions that Zeus is “sending aid to the Trojans”. Zeus is the most powerful God and therefore his support in a bloody conflict is a strong sign of success in war. In fact, throughout the entire poem, the support of the Gods always played an instrumental role in whichever side succeeds in battle. Therefore, Zeus’s support is a compelling reason to take such a military risk. Additionally, he tries to bolster Hector’s confidence by claiming that “the bonds of death are fastened upon them”. In this case, the bonds of death are fastened upon the Achaians by Zeus, and indirectly, by Achilles, who is the reason Zeus supports the Trojans. Finally, Poulydamous proposes to Hector that all of his men “follow Hector in mass formation”. This proposal reveals that Poulydamous has a lot of trust in his commander, enough to follow him into the heat of a battle, and contributes to Homer’s image in the poem as a brave, heroic warrior.

    1. Constrains block our thinking and idea generation. Naturally, we consider constraints as soon as an idea germinates,

      I am curious as to how you get people to overcome constraints in idea generation when the solution involves say students. I think some people may be hesitant to suspend reality enough to say "let's just let students do whatever they want, whenever they want in the hallways with no teacher supervision" when that type of thinking naturally would have people thinking "WHOOAA THAT'S A REALLY REALLY BAD IDEA".

      does this only only work in some instances? or does it matter who you put in the room or how you frame the question?

    1. Much needs to occur, however, between the collection of data and observations, the extraction of parallel material from the existing record, and the final insertion of new material into the general body of the common record. For mature thought there is no mechanical substitute. But creative thought and essentially repetitive thought are very different things.

      extraction of material from the existing common record

      such that the entire scaffolding with which it was erected is available to explore. resume, remix. context of justification +context of discovery

      and allow conversations that are "continupous without being synchronous" with new InterPersonal WebNative Computing in the IndieVerse

    2. The investigator is staggered by the findings and conclusions of thousands of other workers—conclusions which he cannot find time to grasp, much less to remember, as they appear.

      Science and thought is always progressing, which is so hard to keep up with. Especially now how anything can be posted with a few clicks.

    3. Science has provided the swiftest communication between individuals; it has provided a record of ideas and has enabled man to manipulate and to make extracts from that record so that knowledge evolves and endures throughout the life of a race rather than that of an individual.

      Unlike other generations, our generation has been lucky enough to have such an easy communication platform

    4. They have done their part on the devices that made it possible to turn back the enemy, have worked in combined effort with the physicists of our allies.

      Shows how powerful we have become scientifically

    5. He may perish in conflict before he learns to wield that record for his true good.

      I can confidently say that there are some people who still won't see it being used for good- but I believe there is always good happening with the help of modern instruments.

    6. A special button transfers him immediately to the first page of the index. Any given book of his library can thus be called up and consulted with far greater facility than if it were taken from a shelf. As he has several projection positions, he can leave one item in position while he calls up another. He can add marginal notes and comments, taking advantage of one possible type of dry photography, and it could even be arranged so that he can do this by a stylus scheme, such as is now employed in the telautograph seen in railroad waiting rooms, just as though he had the physical page before him.

      We can see this kind of technology at work with current school activities. Being able to have a complete digital library at your fingertips is especially more amazing in times like these- where we are sort of held back by the pandemic. It makes taking online classes way easier as well.

    7. The human mind does not work that way. It operates by association. With one item in its grasp, it snaps instantly to the next that is suggested by the association of thoughts, in accordance with some intricate web of trails carried by the cells of the brain. It has other characteristics, of course; trails that are not frequently followed are prone to fade, items are not fully permanent, memory is transitory. Yet the speed of action, the intricacy of trails, the detail of mental pictures, is awe-inspiring beyond all else in nature.

      So this can also go with "always be curious" because once a person in introduced to something new, one of the first things they should do is wonder and ask questions. This can then spark something more to grow from what is shown.

    8. At a recent World Fair a machine called a Voder was shown. A girl stroked its keys and it emitted recognizable speech. No human vocal chords entered into the procedure at any point; the keys simply combined some electrically produced vibrations and passed these on to a loud-speaker. In the Bell Laboratories there is the converse of this machine, called a Vocoder. The loudspeaker is replaced by a microphone, which picks up sound. Speak to it, and the corresponding keys move. This may be one element of the postulated system.

      This sounds connected to the modern "text to speech" system we see now.

    9. They have improved his food, his clothing, his shelter; they have increased his security and released him partly from the bondage of bare existence. They have given him increased knowledge of his own biological processes so that he has had a progressive freedom from disease and an increased span of life. They are illuminating the interactions of his physiological and psychological functions, giving the promise of an improved mental health.Science has provided the swiftest communication between individuals; it has provided a record of ideas and has enabled man to manipulate and to make extracts from that record so that knowledge evolves and endures throughout the life of a race rather than that of an individual.

      I think this kind of connection to the growth of technology gets a bit overlooked now with a growing fear many people seem to have. Perhaps it has to do with a corrupt government or just the negatives that spawn from greedy people who have control over what is produced by new technology. Some instruments created with modern technology are snagged up to make profit off of another person's needs in order to live. It's a real shame that there feels to be a loss of stability for the common person.

    10. Now, says Dr. Bush, instruments are at hand which, if properly developed, will give man access to and command over the inherited knowledge of the ages. The perfection of these pacific instruments should be the first objective of our scientists as they emerge from their war work.

      To think that this is how society took steps towards having a world wide web that holds our history and gives us the ability to expand our minds further with information about other cultures. Also the added addition of being able to communicate with someone from that culture- which I feel is helping us move closer to being a more empathetic society.

    11. n this significant article he holds up an incentive for scientists when the fighting has ceased. He urges that men of science should then turn to the massive task of making more accessible our bewildering store of knowledge.

      I think this idea is a good one- though I do wish science never had to be used for warfare in the first place.

    12. “Consider a future device …  in which an individual stores all his books, records, and communications, and which is mechanized so that it may be consulted with exceeding speed and flexibility. It is an enlarged intimate supplement to his memory.”

      I am honestly amazed at how we live in a world now where we do have this device in our homes and even in our pockets.

    13. Any given book of his library can thus be called up and consulted with far greater facility than if it were taken from a shelf. As he has several projection positions, he can leave one item in position while he calls up another.

      Whilst I do think that technology often ruins the "analog experience" there are so many benefits to advancing the way that we do things to the point that saying "they don't make things like they used to" feels like naïve nostalgia.

    14. If the user wishes to consult a certain book, he taps its code on the keyboard, and the title page of the book promptly appears before him, projected onto one of his viewing positions.

      Prior to reading this I was unaware of how complex the things that I take for granted every day truly are.

    15. It requires a few seconds to make the selection, although the process could be speeded up if increased speed were economically warranted.

      My only question here is why would it not be at max speed all of the time? Mental fatigue?

    16. But even this new machine will not take the scientist where he needs to go.

      Again, this feeds back to the last point that regardless of new technology it always seems that we will need more as a society. Electric car is built? Not enough mileage. Internet is 1GB/s? Not fast enough. It seems to never end.

    17. All this complication is needed because of the clumsy way in which we have learned to write figures.

      Honestly I think this is how mathematicians work nowadays. When I was taking Math 151 it seemed like there was so much unnecessary work in order to get to a fairly simple end game.

    18. needs to be far faster in action than present examples, but it probably could be.

      This seems that this seems to be the outlook of all evolving technology of the past, present, and future.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reviewer #1:

      Summary

      Copy number variations in the 1q21.1 loci, deletions and duplications, have been associated with neurodevelopmental disease. In particular, deletions of this locus result in a variety of neuronal phenotypes including microcephaly and schizophrenia in varying levels of severity. Duplications of the 1q21.1 locus are often associated with autism and/or macrocephaly.

      In this study Nomura et al. generated 1q21.1 deletion and duplication hESC lines to study the impact of these CNVs on neuronal development. They generated brain organoids and observed a bidirectional effect of this CNV on organoid size, with 1q21.1 deletion showing smaller brain organoids whereas, the 1q21.1 dup lines grew large than controls. This in line with observed micro and macrocephaly observed in patients. They further analyzed these organoids at the gene expression level using single cell RNAseq and performed some electrophysiological assessment on neurons from of dissociated organoids.

      This study is certainly of interest given the association of this loci with NDDs such as autism, epilepsy and schizophrenia. At this stage, the study is mainly a descriptive study, showing differences between the 1q21.1 del/dup versus controls but also between both the del/dup lines. There is no mechanistic insight provided. For example the 1q21.1 CNV encompasses several genes, of which some have already been linked to micro/macrocephaly (eg. NOTH2NL). More importantly, most of the conclusions drawn by the authors are based on a limited set of experiments/analysis which are not always carefully performed and/or presented. In general, the data presented are premature, therefore not supporting the claims/conclusion made by the author (eg title) This makes the overall impact of this study limited.

      As the reviewer pointed out, NOTCH2NL (both A and B) have been regarded as micro/macrocephaly-related genes (Fiddes et al., Cell, 2018; Suzuki et al., Cell, 2018). In this study, however, we focused on the distal region of 1q21.1 between BP3 and BP4, which contains neither NOTCH2NLA nor NOTCH2NLB, because the target site is thought to be the core region of clinical 1q21.1 microdeletion/microduplication syndrome (Mefford et al., NEJM., 2008; Brunetti-Pierri et al., Nat. Genet., 2008; Van Dijck et al., EJMG, 2015). Although both NOTCH2NLA and B are located outside of our target, these genes are important for human neocortical development and neurogenesis, so we cite these papers (Fiddes et al. and Suzuki et al.) and discuss them in the discussion of the revised manuscript.

      Main comments

      In general, the interpretation of the data is too premature:

      1. The title is not supported in any means by data

      As requested by the reviewer, we have corrected the title as “Modeling reciprocal CNVs of chromosomal 1q21.1 in cortical organoids reveals alterations in neurodevelopment”.

      1. Brain organoids size and development: In figure 2 the authors analyzed the development of the organoids. Based on the human phenotype the deletion would lead to smaller brain and the duplication to larger brain organoids. The presented data to support these claims are rather scarce. They indeed provide data on organoid size, however there is no information as to regard how this micro/macrocpehaly comes about. Only limited amount of cell types are being investigated with immunocytochemistry, which give little insight into the mechanism. Fig 3. The authors performed some very basic immunostaining and concluded that the neuronal maturity of 1q del seemed to be accelerated, whereas 1q dup decelerated from the NPC stage. However, there is no direct evidence provided for this. With simple additional immunostainings authors could already get a much better idea of what is going on. For example the authors could measure the amount of differentiating versus proliferating cells, cell cycle exit, etc (eg BrDU, KI67, pHH3 staining,...)

      We thank the reviewer for the suggestion. In response to this, we plan to analyze additional markers such as phosphor-histone H3 (pHH3) to evaluate the late-G2/M status by immunostaining. In addition, to explain the smaller organoid size observed in 1q del organoids, we will check apoptosis markers such as cleaved-caspase3 by immunostaining and western blotting.

      Further there are some technical aspect that would need to be resolved:

      There is a general lack of brain organoid characterization of the controls. It is unclear on how many independent clones these experiments were performed.

      We constructed one clone per genotype (1q21.1 deletion (1q del), 1q21.1 duplication (1q dup) and CTRL) from one human ES cell strain (khES-1) by next-generation chromosome engineering using the CRISPR/Cas9 system. According to the reviewer’s comment, we have added the information of each clone, including the actual number of each clone in the results section. Following the reviewer’s comment, we also recognized the importance of comparing targeted clones even in the same genotype to verify cellular phenotypes in a targeted clone. However, we consider that at least isogenic ES cell lines are less affected by genetic variances on other regions and epigenetic changes than patients-derived iPS cells.

      • Fig 2C: it is unclear why brain organoid sizes reduce over time. Is this an indication of increased apoptosis? Did the authors measure this?

      In order to respond to the reviewer’s comment, we plan to examine apoptotic markers such as cleaved caspase-3 by immunostaining or western blotting, as mentioned above.

      • What is the reason for using t-test with Bonferroni correction as opposed to one -way (or even two-way) Anova is unclear in Fig 2C

      Analysis of variance (ANOVA) has been regarded as optional when multiple comparisons without F-statistics are performed (Jason Hsu. 1996. Multiple Comparisons: Theory and Methods (Guilford School Practitioner)). We selected the Bonferroni test because we thought we could evaluate our data more strictly with the Bonferroni test than with the Tukey-Kramer test. In response to the reviewer’s request, we analyzed our data using one- way ANOVA with the Tukey-Kramer test. We confirmed that statistical significances were consistent (we can provide both data if requested). We have changed the description in the figure legend and methods section of the revised manuscript.

      • 2E is unclear how they came to the conclusion that dosage dependent size difference in NPC organoids was caused by the number of cells within an organoid, not by the size of each cell or different cell types. Since they only measured the amount of Sox 2 positive cells and used Sox2 to measure cell diameter, whereas Sox2 is mainly expressed in the nucleus.

      We thank the reviewer’s comment. We used images of SOX2 staining because contrasts of each cell in bright-field images were too obscure to be detected using the fluorescent microscopy, BZ-X analyzer, and because we found cell sizes seemed similar between bright-field images and SOX2 staining images. However, this method was not desirable. To respond to the reviewer’s comment, we have counted the number of cells in the images of each NPC organoid using the BZ-X analyzer and calculate the cell number per 1000 µm2. We found the cell density was not significantly different among the 3 genotypes. We understand that counting the cell number of a single organoid would be ideal, but it was impossible because each NPC organoid was too small. We have changed Figure 2E, descriptions in the methods and results section, and the corresponding figure legend in the revised manuscript.

      • How do the authors explain that the Dup cells do not express Tubb neither CTIP2, do they only express NPCs and no neurons?

      We consider this finding supports the immaturity in the cortical organoids with 1q21 duplication. However, we have checked only a few markers for intermediate progenitors and mature neurons so far. We plan to examine immature neuronal markers such as DCX and other mature neuronal markers such as NeuN by immunocytochemistry (ICC) to confirm this finding. Similarly, we will perform expression analysis by real-time qPCR to check mature and immature neuronal cell markers.

      In short, the characterization of the brain organoids at the level of general development, cell types, proliferation, differentiation is underdeveloped.

      We will examine the characterization of the brain organoids in more detail by different techniques as described above.

      1. Electrophysiological assessment of brain organoids derived neurons:

      In figure 4 the authors claim that both CNVs (Del/Dup) show hyperexcitability and altered expressions of glutamate system as common features between the Del/Dup lines. The data to support this are however scarce and far from being convincing:

      The poor quality of the data is represented by images in 4B-E:

      • First the authors choose to dissociate the organoids prior to measure the cells on MEA's. This takes away the advantage of 3D brain organoids, will add a lot of non-physiological stress, cause cell death and lead to unequal distribution of cells over the electrodes, see fig 4B.

      We are afraid that the reviewer might misunderstand our experiment. In this experiment, we used not 3-D brain organoids but 2-D neurons. Based on established neural differentiation protocol (Fujimori et al., Stem Cell Reports, 2017, Toyoshima et al., Transl. Psychiatry, 2016, Matsumoto et al., Stem Cell Reports, 2016), we seeded single-cells dissociated from neurospheres on MEA dishes at the same density (8 x 105 cells per dish) on day 33 and continued culturing for 28 days on the MEA dish before analysis. Thus, we didn’t dissociate cells just before analysis. We could avoid adding non-physiological stress because we kept on culturing on the MEA dish for 28 days.

      • MEA recording are meant to measure network activity and heavily (read: fully) dependent on the network being formed. Cherry picking electrodes for analysis is not justified, analysis should be performed per MEA chip not per electrode. Inclusion/exclusion parameters should be defined before analysis

      We have performed statistical analysis with all chips (electrodes) per genotype in response to the reviewer's request. Even though the distributions of firing rate were not consistent among electrodes, we found the significant differences between CTRL and each mutant (Ctrl vs 1q del: p< 0.001, Ctrl vs 1q dup: p< 0.001, 1q del vs 1q del: p=1.0). We have changed Figure 4E, the descriptions in the methods section, and the corresponding figure legend in the revised manuscript this time. We also reanalyzed burst rates so that all electrodes were included in the statistical analysis. We have changed supplementary Figure 3 and edited the descriptions in the methods and the corresponding figure legend in this revised manuscript.

      • MEA parameters such as Mean firing rate (spike/min) and burst rate are very sensitive to plating conditions, especially number of cells and clustering of cell around electrodes (see 4B). Given that the organoids already differ in size and according to the authors in cell number, but also in the amount of starting NPCs, one can expect very different cell densities/cell types per experiment/genotype. The authors should therefore show for every genotype the matching cell culture images. Also with regard to the claims made about GABAergic neurons the cell type composition at the time of the MEA recording should be characterized for every genotype.

      As mentioned above, in MEA analysis, we used 2-D neuronal culture and seeded cells on each chip at the same density. The distribution patterns of cells were similar among the 3 genotypes. We will show the images of cultured neurons from 3 genotypes in the revised figure. As for the cell type composition, we plan to examine the expressions of GABAergic markers using extracted RNAs from neuronal cells on around 28 days post- dissociation (dpd). As reviewer #2 suggested, we also considered that drug treatment with bicuculine in this MEA system was meaningful. We plan to perform this experiment if the experimental conditions can be optimized.

      • Fig 4B illustrates the points made above. The fact that no activity is observed in the control cells can be due to many different reasons: unequal plating, stress after dissociating cells, poor coverage of the electrodes, poor maturation, too early measuring time point, etc Because the authors have no control over the amount of cells covering the electrodes the data presented here carry very little carry little information. Fig 4B, best illustrates this with large cell clumps and areas without cell bodies. Measurements from these cell cultures are irrelevant and no conclusion can be drawn.

      We suggest that the authors first benchmark this technique with their own differentiation protocol, show robust and reliable recordings on control cells, and only compare to the CRISPR lines at a time point at which the control cells show a decent amount of activity 1Hz. When doing so, also reduced activity can be monitored (For examples see, Trujillo et al, Cell Stem Cell2019 or Frega et al 2019 Nat comm).

      As mentioned above, we seeded dissociated neurospheres in equal numbers on MEA dishes and kept culturing neurons gently for 28 days before analysis. Cell distribution was similar among the 3 genotypes and we could observe cell bodies in the area outside aggregates (we will provide additional bright-field images in the revised manuscript later). Low activities in CTRL neurons at 28 dpd could be observed even in the electrodes covered with dense cells, which were consistent among 3 independent experiments as described above. Nonetheless, we agreed with the reviewer that cellular conditions which could show stable activities even in CTRL neurons were more desirable. We have already tried longer cultures three times, but we could not perform sufficient analyses because neuronal cells became unhealthier after 35 dpd. We will try to improve the experimental conditions and perform analyses if the experimental conditions could be optimized.

      • MEAs measure the output of the network (action potentials). In a network, this can be influenced by virtually every neuronal property (morphology, synaptic input, types ofsynapses, intrinsic excitability, etc). Therefore, the authors cannot conclude only based on fig 4E that the Del/Dup cells are intrinsically hyperactive. To make this conclusion they should measure this directly by assessing that passive and active intrinsic properties of individual neurons.

      In control condition many electrodes do not give any signal. From these experiments it is impossible to know whether this is because of lack of cell on the particular electrode or real absence of activity. Certainly one could not conclude that the del en dup cell are intrinsically hyperexcitable.

      As described above, we could observe the similarity of cell distributions among 3 genotypes. However, as the reviewer mentioned, the assessment of the individual neuronal activity would be better. Thus, we will perform patch-clamp recordings in addition to MEA analysis.

      It seems that from the introduction the authors try to link 1q21 CNVs to epilepsy and ASd, thereby justifying the observed phenotypes.

      • How do the authors reconcile the fact that more mature GABA system is observed in the Del lines with the so called increased activity compared to controls but not to the Dup lines.

      We assumed that cell type compositions differed between 1q del and 1q dup, although network excitabilities were commonly observed in both mutants. We agree that this assumption lacks sufficient evidence even though we have shown the results in scRNAseq (Figure 6E). We consider that checking cell type compositions would be needed to ensure this. Although mature GABAergic neurons were increased in 1q del lines as mentioned by the reviewer, we think GABAergic signals and unknown factors such as epilepsy- associated genes (e.g., GRIN2A and SCN1A) may be involved in the abnormal neuronal firing. We will check the expression of these genes and examine the expressions of GABAergic markers in neuronal cells.

      Single cell RNAseq

      • I'm not a specialist on single cell RNAseq, however it seems that the analysis is underdeveloped and conclusion drawn for these experiments premature. It would be essential to validate some of the generated hypothesis, eg GABA maturity and not merely state as a conclusion (eg title).

      We thank the reviewer for the suggestion. We have revised the title as we mentioned above, and we will revise the main text based on our results appropriately.

      • How do the authors explain that a majority of the cells are Glial cells at day 27, and no presence of neurons.

      On day 27 in our 3-D organoid protocol, cells were still in the developmental stage. That’s why we consistently described it as “NPC organoid” but not “brain organoid” in this paper. Indeed, our rationale for the scRNA-seq study was to determine gene(s) or gene regulatory network(s) when the difference of circumference was significant among genotypes (Fig. 2C). Although the underlying mechanism was not fully understood from our results, we interpreted this result. Radial glial cells (RGs) have the ability to self- renewal with symmetric divisions and play a role in both neurogenesis and gliogenesis (Lui et al. Cell 2011, A Kriegstein et al., Annu Rev Neurosci 2009). A recent study showed that the reduction of NF1, a tumor suppressor protein in the RAS/MAPK pathway, induced excessive production of glial cells, i.e., mainly oligodendrocyte precursor cells (OPCs) accompanied with astrocyte precursor cells, from RGs; furthermore, the reduction of NF1 also enhanced the cell divisions of generated OPCs (Z Shen, BioRxiv 2020). We have checked that the expression of NF1 in the glial cluster was also downregulated in our scRNA-seq data. Thus, we reasoned that the predominance of 1q dup cells in the glial cluster reflected the excessive production of glial cells from RGs, which were related to the alteration of the RAS/MAPK pathway. We will add this interpretation in the revised manuscript next time.

      • How relevant is the changes in the extremely low amounts of GABAergic neurons in the Del cells, no excitatory neurons are present, only NSCs

      In a previous paper, CA Trujillo et al. showed the cell type composition in 3-D human cortical organoids at different time points. GABAergic cells were restricted to later stages and the ratio was still very limited at 6 months (Figure 1J in CA Trujillo et al., Cell Stem Cell 2019). From this fact, we regarded the emergence of GABAergic neurons as meaningful even if the ratio was very low. As for excitatory neurons, we will further check the expressions of excitatory neuronal markers. (According to the screening chart we used, we did not explore excitatory neuronal markers as far as cells did not express SLC17A7 significantly).

      Minor comments

      • It is unclear how many clones were assessed per genotype

      We constructed one clone per genotype. As we mentioned above, we have added the information in the results section of this preliminary revised manuscript.

      • The authors should properly annotate the genotypes 1q21.1 instead of 1q del (line 134)

      We have already annotated the abbreviations of 1q21.1 deletion and duplication in lines 87 and 93.

      • Introduction seems to be somehow off topic since 1q21.1 locus is associated with several neurodevelopmental disorders, including SCZ, but is certainly not specific to ASD and epilepsy. So the premiss on line 86: to study 1q21.1 locus to understand ASD/epilepsy is somewhat misleading. I propose that the introduction would be focussed on the 1q21.1 and not on general on ASD/epilepsy.

      As the reviewer pointed out, 1q21.1 CNVs are associated with other neurodevelopmental and neuropsychiatric disorders. Since our research aims to elucidate the underlying mechanism of ASD, we mainly focused on two representative comorbidities (abnormal brain size and epilepsy), which seemed relatively reproducible in vitro. However, we agree with the reviewer that the lack of information about clinical symptoms of 1q21.1 microdeletion and microduplication syndrome besides ASD was not appropriate. Thus, we will revise the introduction to mention the neurodevelopmental phenotypes of 1q21.1 CNVs in the revised manuscript next time.

      • It is unclear whether they generated heterozygous or homozygous deletions.

      We thank the reviewer for pointing it out. We have generated clones with heterozygous deletion and duplication. We have added the information in the results section of this revised manuscript.

      • The authors should cite Fiddes, I. T. et al. Human-Specific NOTCH2NL Genes Affect Notch Signaling and Cortical Neurogenesis. Cell 173, 1356-1369.e22 (2018).

      As the reviewer suggested, we will cite two papers regarding NOTCH2NL (NOTCH2NLA: Fiddes, I. T. et al., Cell 173, 2018; NOTCH2NLB: Ikuo K Suzuki et al., Cell 173, 2018) when we discuss the alteration of neuronal maturity and brain size. We will add the information in the revised manuscript next time.

      • Many unclear statements eg line 138: Next, we analyzed each single-cell in an organoid

      We thank the reviewer for noticing it. We have made an effort to remove inappropriate sentences in this revised manuscript.

      • Discussion on E/I is very speculative, not supported by any evidence

      In response to the reviewer’s suggestion, we will cut the descriptions which contain too speculative contents in the discussion section of the revised manuscript later.

      Significance

      The general topic of this study is high interest given the strong association of the 1q21.1 with disease. The authors developed interesting ESC line to study in parallel del and duplication. Unfortunately the level of of analysis performed on these organoids is not up the current stat of the art, are of low experimental quality, analyses are limited. Therefore no clear conclusion can be drawn except for the size of the organoids, very little mechanism is provided. This therefore remains a purely descriptive study for which the presented data are rather on low quality and limited impact in its current shape.

      We thank the reviewer for the interest and criticism of our paper. As discussed above, we plan to perform additional analyses and experiments to justify our hypothesis more clearly and try to meet the reviewer’s requests.

      Reviewer #2

      This study was initiated to look at specific cellular and molecular mechanism of the duplication and deletion CNV frequently observed at the 1q21.1 gene locus in an isogeneic human embryonic stem (hES) cell model. The authors note that these CNVs are associated with higher than normal penetrance of ASD and epilepsy and aim to elucidate gene expression differences with single cell RNAseq and functional changes in this model system. The authors further sought to proliferation and differentiation states, in addition to neuronal activity, using both 2D cultures and 3D organoid models. The 1q21.1 gene locus model system made here is unique and the results broadly recapitulate the patient phenotype particularly with observations of macrocephaly in the "1q dup" and microcephaly in the "1q del".

      Reviewers statement:

      We have joint expertise in GABAergic neuronal development, iPSC 2D and 3D culture and ASD human molecular genetics.

      Major comments:

      • Not sure why ASD (if used it should also be spelled out) is mentioned in the title if ASD is only seen in a proportion of human 1q21.1. duplication (~36% will have autism) and 1q21.1 deletion (<10% will have autism) carriers. I would prefer to use 'neurodevelopmental phenotype'. A good update review that is accurate with respect to this CNV role in autism is PMID: 29398931. The authors should also put into the context of their results what is known with other neuropsychiatric phenotypes also seen in these CNV events;

      We thank the reviewer for the suggestion and valuable information. We have corrected the title in the revised manuscript this time. We will also refer to the paper by Fernandez and Scherer (Dialogues Clin. Neurosci., 2017) to discuss the detail of roles and neuropsychiatric phenotypes of targeted CNVs.

      • In Fig 1D the ddPCR validation for the genetic alterations in 1q del shows a normal return to 2 copies of GPR89B. However, in the 1q dup the CNV level is still elevated for GPR89B. Please determine how much further the duplication goes as there are five more potentially affected genes in this region (eg PDZK1P1). Modify the text appropriately to note the potential influence of any of these other genes on the experimental outcomes.

      We thank the reviewer for pointing it out. Figure 1D showed the results of aCGH analysis to confirm the copy number alteration of the targeted region in each clone. This analysis expected that the target region contained GPR89B, as confirmed by PCR shown in Fig. 1B. However, as the reviewer’s comment, the cleavage sites shown in Figure 1D seem not consistent with the result of Fig. 1B. We think it reflects the limitation of the microarray-based CGH technique. Since the locus between GPR89B and LOC101927468 contains extensive repeat sequences, aCGH may not be an appropriate method. Thus, we will apply quantitative PCR (or ddPCR) to determine copy number alternation of each clone in addition to microarray-based CGH.

      • The authors' claim that dosage dependent size differences in NPC organoids is caused by a change in the number of cells within the organoid rather than size - from Fig. 2D, cells in 1qdel organoid appears more compact; a quantification of cell number should be done to support this claim. IHC of D27/28 organoids with GABAergic markers would support authors' claim of alterations of GABAergic components in 1qdel cells. These suggested experiments would take 2-3 days if the organoids are available.

      In response to the reviewer’s suggestion, we have counted the number of cells in the images of each NPC organoid using the fluorescent microscopy, BZ-X analyzer, and calculated the cell number per unit area (1000 µm2). We found the cell density was not significantly different among the 3 genotypes. We have changed Figure 2E, descriptions in the methods and results sections, and the corresponding figure legend in the revised manuscript this time. As for exploring GABAergic components in the NPC organoids, we plan to perform immunocytochemistry (ICC) and RT-qPCR analysis.

      • Fig 4 E shows MEA data from "top 10". What is the top ten? Do you mean data points? There are batch differences in 1q dup with one batch having a lower expression than the other. Increasing the n value to accommodate the high variance observed in this group will greatly increase the validity of the data generated. Also, change the figure legend to indicate the age of these cultures. Given that the controls are not spiking, this data should be extended to probe the developmental profile further to week 9 when normal cells should be spiking so that the baseline activity of this isogenic line can be determined.

      Top 10 meant the ten electrodes with the highest spike rates within one MEA dish. To respond to the reviewer’s suggestion, we have performed statistical analysis with all electrodes per genotype. Even though the distributions of firing rate were quite heterogeneous among different electrodes, we found significant differences between CTRL and each mutant per MEA dish. We have changed Figure 4E, descriptions in the methods section, and the corresponding figure legend in the revised manuscript this time.

      The reviewer is correct that the spike rates in 1q dup were quite different between different batches. We noticed from our experiments that spike rates were easily affected by the health conditions of cells. Some mutant batches showed mild spike activities like circles in 1q dup, and some had very vigorous activities. We have even checked the reproducibility of significant differences between CTRL and each mutant per MEA dish with 3 independent experiments. As for the extended cultures to detect more frequent signals in CTRL neurons, we have already tried longer cultures three times. However, we could not perform sufficient analyses because neurons became unhealthier after 35 dpd. We will further try to improve the experimental setup and perform analyses if the experimental conditions could be optimized.

      • Single cell RNAseq data suggests a cluster of GABAergic cell types that are appearing in the 1q del condition, but not in the 1q dup or control groups. The authors suggest that these GABAergic cells are excitatory because the chloride gradient has not yet been altered (no change to KCC2 expression). The authors should substantiate this idea in the MEA system with bicuculline treatment to block GABAergic transmission (drug washed in and out) to show that the spike activity observed in the 2D MEA experiments is due to GABAergic excitatory transmission. Ideally, this should be done for both the 1q dup, 1q del as well as controls.

      We thank the reviewer for the suggestion. We agreed with the reviewer that drug treatment with bicuculine in this MEA system was meaningful to identify cellular properties. We will try to set up the experimental conditions and perform this experiment if the condition can be optimized.

      • Fig 5A. The clustering method for single cell RNAseq seems shows a large proportion of "other" class cells begging the question as to what they are. Is there another cluster analysis, which might be used eg partially supervised/unsupervised clustering methods from the Allen Institute to help determine what these might be?

      We initially made the screening chart for cell-type specifications according to cellular markers from Allen brain map (http://celltypes.brain-map.org/rnaseq/human_ctx_smart- seq) and a published paper (CA Trujillo et al., Cell Stem Cell 2019). We defined this cluster as “other” because this cluster did not have any significant genes in the 1st screening, although we understood that the specifications of all clusters were desirable. To investigate the cellular property in this cluster, we tried to put significant genes into Metascape to check gene ontology. We found some terms about immune cells (mainly lymphocytes and macrophages), cancer cells, roles for inflammation, and apoptotic process, although miscellaneous terms were also included. We have provided the screening chart as supplementary Table 4 in this revised manuscript. Next time, we will add a more detailed description of the ‘other’ cluster in the revised manuscript.

      • Fig 5 B. The manuscript requires additional markers used in the cluster analysis. Particularly, expression of the GABAergic progenitor markers DLX5 and 6 as well as EMX1 for the progenitor cells. Details of all markers and cluster algorithms should be made available in supplementary tables and R scripts, so that others can repeat this analysis.

      In response to the reviewer’s suggestion, we will check these GABAergic progenitor markers and add them to the revised figure and manuscript later. As we mentioned above, we performed the cell type specification of each cluster manually using our screening chart and did not use R scripts. We have provided the information on the screening process in supplementary Table 4 of this revised manuscript.

      • Fig 6. Expanding the heat map of 1q del and 1q dup with CTRL expression would help with context for baseline levels in this isogenic cell line. Please also include additional GABAergic markers GABRA1, GABARB2and GABARG2, (subunits of the most common GABA-A receptor) SOM, VIP, NPY, (other GABAergic interneurons in addition to PVALB) DLX6, EXM1 and for excitatory markers GRIA2, GRIA3 and GRIA4 (all of which have developmentally regulated expression patterns) that will provide more context with the synaptic receptor literature. GRIN2D is expressed only in GABAergic cell types and so I would suggest including this NMDA receptor subunit as well.

      We thank the reviewer for the valuable suggestions. To further explore the cellular properties in 1q del and 1q dup, we will check these cell markers additionally and show the results in the revised figure and manuscript next time.

      Minor comments:

      1. Additional references (eg. Schafer et al. 2019) should be discussed in relation to the authors' suggestions of altered neuronal maturity.

      As the reviewer suggested, we will include the paper in our references and discuss the associations between neurodevelopmental disorders and altered neuronal maturity.

      1. The authors show no change in PAX6 expression between genotypes, but significant differences in TBR2 expression between genotypes (Fig. 2C) - this alteration in normal cortical development should be included in results and discussed.

      Radial glial cells (RGs) have abilities of both self-renewal and neurogenesis (Lui et al. Cell 2011, Fiddes, I. T. et al., Cell 2018). Fiddes et al. showed that if the balance leans toward neurogenesis, premature differentiation with higher TBR2 expressions was observed in week 4 human cortical organoids (Fiddes, I. T. et al., Cell 2018). However, the predisposition to neurogenesis is thought to cause the earlier shortage of RGs. Finally, these cells remain abundant in week 4 organoids. We considered this was why TBR2 expression was significantly different in 1q del, but PAX6 was not. We will add this interpretation in the revised manuscript next time.

      1. In the introduction (Line 67): The author's state that "alterations in brain size is common in patients with ASD" using one meta-study to support this claim. Further primary studies should be consulted and the authors should give the proportion of the population with ASD and altered brain size to support this statement. In addition, the age range should be supported with primary papers.

      As the reviewer suggested, we have cited some primary studies about the prevalence of altered brain size in ASD patients and its age range in this revised manuscript. Since it seems still controversial whether the enlargement of brain size persists or not until adolescence and adulthood (E H Aylward et al., Neurology 2002; J Piven et al., Am J Psychiatry 1995), we have also modified the description in this manuscript.

      1. Line 73. The authors suggest that the brain growth deviations are "Postnatal stage restrictive". Citations are needed to support this statement.

      As the reviewer suggested, we have cited some primary studies as described above and revised the manuscript.

      1. In the scRNAseq data results please report total cell numbers counted for each cluster and for genotype group.

      We apologize for the lack of information and thank the reviewer for noticing it. We have added the information in the results section of the revised manuscript this time.

      1. In the results section (line 269-270) the authors suggest that 1q del cells are in a more mature state because the GABAergic cells are present and glutamatergic genes are similarly altered in 1q dup and 1q del. However, the results from the gene cluster data suggests that there is a very high proportion of progenitor cells (Progenitor 1 and 2 clusters), which seems to argue against faster maturation. This suggests to me that cell fate is being modified here.

      We thank the reviewer for the valuable suggestion. Schafer et al. (the suggested paper in minor comment 1) reported that altered gene expressions in neuronal modules have already been observed in NSCs derived from ASD patient-derived iPSCs. As the reviewer suggested, we plan to consider our results in terms of the alteration of cell fate and neuronal maturity in the revised manuscript later.

      1. Label figures on each page for ms.

      As the reviewer suggested, we have labeled figures at the bottom right of each page.

      1. Fix typos and heat map legends (currently no colors for log2 fold change in Fig 5 or 6)

      We apologize to the reviewer for typos and grammatical errors. We made an effort to remove them. We also apologize for the lack of color information in the legends of Figure 5 and Figure 6 and thank the reviewer for noticing it. We have added the color information in the figure legends of the revised manuscript this time.

      Significance

      Overall the study is clearly described, and the outcomes have been substantiated to a certain degree, but requires a bit more work. This paper does represent a technical 'tour de force' and the authors should be applauded for sticking it out where other labs have so far failed. It might be useful to mention even in brief, of the number of 'failed' (failed or inaccurate) events. The availability of the lines should also be clearly stated.

      We thank the reviewer for the positive comments. In addition to the plans described above, we have added more detailed information, e.g., how many screenings were carried out to get positive clones, in the revised version of the methods and results section. We have also added the descriptions about the availability of the 1q21.1 CNV cell lines in the data availability section of this revised manuscript.

      Reviewer #3

      In this research study by Nomura et al., the authors develop novel hESC-based models of reciprocal CNVs in distal 1q21.1 using CRISPR/Cas9 genome editing technology. Specifically, the authors genome edit KhES-1 cells to produce two isogenic hESC line that contain either a deletion or duplication of this chromosomal region. Patients with 1q21.1 deletion and 1q21.1 duplication syndromes show abnormal head size in conjunction with multiple neurodevelopmental co-morbidities such as epilepsy, developmental delay, and neuropsychiatric abnormalities. This is an important study since it provides robust research tools to understand molecular and cellular mechanisms that may underly these syndromes. Through generation of cortical organoid models, the authors demonstrate 1q21.1 deletion and duplication organoids show deficits in growth and over-growth, respectively. Additionally, the authors provide data that 1q21.1 deletion and duplication organoids show altered signaling cascades which may underly growth deficits and also abnormal neurodevelopment which may underly hyperexcitable neurons as demonstrated by multi-electrode array analysis. While my enthusiasm for this study remain high, I do have a significant number of major and minor reservations specific to the experimental design and analysis that if addressed would provide for an excellent contribution to the field.

      Major concerns:

      1. Though the authors provide extensive data in this study, major revisions are necessary to interpret all of their data in the context of the phenotypes they are observing in organoids and MEA analyses. In addition, the current study lacks cohesiveness throughout the various experiments and does not provide text that clearly unifies the results of the study. For example, no interpretation of higher TBR2 levels in 1q21.1 deletion is provided. Does this mean these organoids show accelerated neuronal differentiation? Also please see my comment regarding TBR2 staining the next section.

      Other examples throughout the manuscript in which there is no clear interpretation of the data or inadequacies of unifying the results of the experiments.

      We thank the reviewer for pointing out that our manuscript had inadequacies of the integrity and cohesiveness throughout our data. With additional data as follows, we plan to improve these issues in the revised manuscript later. As for TBR2 expression, we considered that higher TBR2 expressions in week 4 human cortical organoids showed the predisposition to neurogenesis in 1q del as demonstrated in a previous paper (Fiddes, I. T. et al., Cell 2018). We will add the description in the revised manuscript later.

      • a. Additional interpretation why 1q21.1 duplication organoids show increased growth is lacking. The single cell RNA sequencing results show there are more glia, but no further interpretation is giving why these organoids show an overgrowth phenotype. Inversely, the 1q21.1 deletion organoids show more progenitor cells, but it is not apparent why this should result in decreased cell growth.

      As we have mentioned above, we considered that the predominance of 1q dup cells in the glial cluster reflected the excessive gliogenesis from radial glial cells and enhanced cell divisions in relation to the alteration of the RAS/MAPK pathway (Z Shen, BioRxiv 2020). We plan to analyze additional markers related to cell proliferation and cell division by immunostaining to validate the above hypotheses. To investigate how 1q del organoids showed smaller size, we plan to examine apoptotic markers such as cytochrome C and caspase 3 by culturing NPC organoids again.

      • b. The authors suggest that 1q21.1 duplication organoids are resistant to neuronal differentiation. What data supports this hypothesis other than the fact there are no mature neuronal cells are present in their single cell RNA sequencing data.

      We considered that the results in Figure 3B and Figure 3D also supported this hypothesis that 1q dup organoids expressed the lower intensity of neuronal markers. Since we have only checked a few markers by immunocytochemistry (ICC), we plan to examine additional markers, i.e., immature neuronal markers such as DCX and other mature neuronal markers such as NeuN, as well as proliferation markers such as phospho histone H3 to ensure this hypothesis.

      • c. The MEA analyses show hyperexcitability in both 1q21.1 deletion and duplication cultures. Since the authors suggest 1q21.1 duplication organoids are resistant to neuronal maturation, no interpretation is given why they show hyperexcitable phenotypes.

      In the MEA analyses, we used not 3-D cortical organoids but 2-D neurons because the required culture period to emit electrical activities was thought to be much shorter in 2-D neurons according to some previous studies with human pluripotent cells (A Taga et al., Stem Cells Transl Med 2019; CA Trujillo et al., Cell Stem Cell 2019). We considered that 2-D neurons on 28 dpd (day 63) had much higher maturity than NPC organoids and even 1q dup neurons had already become mature enough to emit spike activities. We will also check neuronal marker expressions using 2-D neurons around 28 dpd by RT-qPCR to ensure this.

      • d. The current study is lacking extensive immunohistochemical stains of representative markers that validate their findings from their single cell RNA sequencing experiments. For example, glial cell markers such as GFAP should be analyzed in 1q21.1 duplication organoids. Additionally, progenitor cell markers such as PAX6 and neuronal markers such as MAP2 and synaptic markers such as SYNAPSIN and others should be incorporated in the study.

      We thank the reviewer for the suggestions. We plan to perform additional IHC staining for NPC organoids with the suggested markers and OPC markers.

      1. Major details are lacking for the single cell RNA sequencing experiments.
      • a. How many cells were analyzed from each group? How many organoids and what age of organoids were analyzed from each group, were they pooled together? Why was a log2FC 1.2 used as a threshold? It is unclear how the authors identify Progenitor 1 and 2 cell clusters? Are they distinct clusters or is this a continuum of differentiation. The progenitor 1 and 2 clusters were chosen based on expression of the ID transcription factors, but no text was provided why these genes specify progenitor cells.

      We apologize for the lack of information and thank the reviewer for noticing it. We described the number of analyzed cells (32,171 cells: 1q del; 10,682, 1q dup; 11,987, CTRL; 9,502) in the results section (line 186) of the original manuscript. However, we could not count how many organoids were analyzed because they were too tiny (diameter; 400-700µm). Many organoids were needed to get the prescribed number of cells (25,000 cells per genotype). According to the analyzed data of size measurement for NPC organoids by fluorescent microscopy, at least 1,500 organoids were collected per genotype. We gathered all cultured organoids in the same batch, dissociated them, and then loaded the prescribed number of cells into the machine. We have added the description of the number of input cells in the methods section of this revised manuscript.

      We used the threshold of log2FC > |1.2| so that the total number of DEGs became around 100-1000 in both bulk and the NSC cluster to avoid a very high or low number of DEGs. Some previous transcriptome studies used the same or even smaller thresholds (Xiaoming Ma et al., Front in Genet 2020; J Zhong et al., Brain Res 2016; Y Wang et al., BMC genomics 2016). We have added these descriptions in the methods section of this revised manuscript.

      As for progenitor-1 and 2, we regarded them as a continuum based on the marker expressions. We chose ID transcription factors for progenitor cells, referring to a published paper (CA Trujillo et al., Cell Stem Cell 2019) as we have described in the methods section (line 633). Several articles have reported that ID transcription factors regulate proliferation and differentiation of neural precursor cells (K Yun et al., Development 2004; D Patel et al., Biochim Biophys Acta 2015).

      Minor concerns:

      1. I would suggest rephrasing the title of the study as it does not clearly convey the advancement to the field. I would suggest the following or something similar this is more concise: " Modeling Reciprocal CNVs of Chromosomal 1q21.1 in Cortical Organoids Reveals Alterations in Neurodevelopment."

      We thank the reviewer for the concrete suggestion. We have revised the title as the reviewer suggested in this preliminary revised manuscript.

      1. The length of the discussion is over extended and should be revised to become more concise.

      We thank the reviewer for pointing it out. We will shorten the beginning part and delete unnecessary sentences in the discussion section of the revised manuscript later.

      1. Additional experiments should be performed to characterize pluripotency of hESC clones generated after genome editing other than staining for alkaline phosphatase activity.

      At minimum, karyotyping in addition to measuring pluripotency markers such as NANOG and OCT3/4 should be performed.

      Karyotyping of wild-type ES cells has been checked by Institute for Frontier Medical Sciences, Kyoto University before being provided. After genome editing, we performed aCGH analysis for all 3 genotypes using the wildtype ES cells as reference genes and confirmed no chromosome aberrations were generated. We have added the information about karyotyping in the methods section of this preliminary revised manuscript.

      As for pluripotency markers, we performed RT-qPCR analyses with ES cells after genome editing and confirmed that OCT3/4 was highly expressed than internal control genes. (We can provide the raw data if requested).

      4) There are several dozen instances of spelling/grammatical and word choice errors throughout the manuscript. For example, line 24 reads "We generate isogenic..." should read "We generated isogenic... "

      • a. Line 25: "opposite organoid size" as written is confusing to interpret.
      • b. Line 46: "have been considered in the context of ASD" would read more clearly as "have been thought to underly ASD etiology."
      • c. Line 53: "in the study of neurological development" should read "nervous system development".
      • d. Line 118: ".. to detect the CRISPR target site for deletion" should read "to detect the CRISPR target site. For the deletion, we checked... "
      • e. <![endif]>Line 119: "...flanking the CRISPR target site; for duplication, we amplified.. " should read "flanking the CRISPR target site, and for the duplication, we amplified..... ".
      • f. Line 127: "we prepared control cells (CTRL) that transfected.... should read ""we prepared control cells (CTRL) that were transfected. ".
      • g. Line 185: "organoid size and mature level" should read "organoid size and developmental maturity."
      • h. In line 40, "We made cryosections of .... should read.... "We performed IHC for the three organoid genotypes on day 27... " i. <![endif]>In Supplementary Figure 8, line 554, "replictes" is misspelled.

      We apologize to the reviewer for many typos and grammatical errors and thank the reviewer for pointing them out in detail. We have corrected these errors as the reviewer suggested.

      5) Line 181: "with a little higher degree of.. " should be re-written more precisely and with more scientific accuracy.

      As the reviewer requested, we have corrected the sentence in this revised manuscript.

      6) Line 216, The use of the colloquial phrase: "On the other hand.. " should be replaced with more formal language. For example, "In contrast, the number of downregulated....

      We thank the reviewer for pointing it out. We have corrected this colloquial phrase at 4 locations.

      7) In line 201, Pprogenitor is misspelled.

      We apologize and thank the reviewer for noticing it. We have corrected it in this preliminary revised manuscript.

      8) In Figure 3, images showing TBR2 staining does not appear correct as this protein should be localized to the nucleus similar to SOX2 staining. I would suggest optimizing conditions such as utilizing antigen retrieval or other methods to reduce non-specific cytoplasmic staining.

      We thank the reviewer for the valuable suggestion. We plan to optimize the condition and try other neuronal lineages markers such as DCX and NeuN.

      9) I would suggest simplifying the text describing the primers utilized in this study and display them in a table format.

      As the reviewer requested, we will make a supplementary table of primer sequences in the revised manuscript later.

      10) Information regarding the number of technical replicates used in this study is lacking throughout the manuscript. For example, how many hESC clones were analyzed? How many organoids were analyzed for each specific assay such as single cell RNA sequencing and MEA analyses? How many independent experiments were used for these studies?

      We apologize for the lack of information. We have constructed one clone per genotype one human ES cell strain (khES-1) and performed all further analyses. The precise number of NPC organoids in scRNA-seq could not be counted, as we mentioned above. As for MEA analysis, 8 x 10^5 cells were seeded on each dish as described in the original manuscript. However, it was unclear how many neurons were observed on each electrode because multiple cells and neurites covered each electrode. Thus, spike activities were detected as the network of many neurons. We have added the information in the methods section of this preliminary revised manuscript.

      11) It is not clear why the authors choose two types of organoid methods in the study. The first protocol referred to as the "NPC organoid method" is synonymous to neurosphere culturing and should be referred to as neurospheres throughout the manuscript.

      One protocol (Fujimori et al., Stem Cell Rep., 2017) was not for 3-D organoids but 2-D neurons (Figure 4A). Thus, we considered neurosphere and NPC organoid were different.

      12) In Figure 4, panel C should be referred to as a local field potential trace and not a waveform.

      We thank the reviewer for pointing it out. We have corrected the description as the reviewer suggested.

      Reviewer #3

      This is an important study since it provides robust research tools to understand molecular and cellular mechanisms that may underlie 1q21.1 deletion and duplication syndromes.

      We thank the reviewer for the positive comments. We plan to perform additional analyses and experiments as described above and try to meet the reviewer’s requests.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      We thank the reviewers for their careful reading, positive feedback and constructive criticisms of our manuscript. Their primary points of concern were that the discussion was too long and too speculative, and that the title did not sufficiently represent our work. We have now cut the discussion in half, and we have also changed the title to more precisely reflect our paper, and made some other minor changes in the text (all highlighted in blue).

      Below, we provide responses to each of the raised issues.

      Reviewer #1 (Evidence, reproducibility and clarity (Required)): The study was very well conducted by the group, selecting appropriated methods for achieving the aimed objectives. The sample were abundant and the statistical treatment were suitable for the size of samples, as well to compare different methods used in this study. The results in general were properly exploited by the authors, clearing many aspects of the role/function of the trophallaxis fluid. The results of this manuscript are apparently suggesting that young colonies prioritize the metabolization of carbohydrates, while mature colonies prioritize the accumulation and transmission of stored resources, amongst other processes. This study cleared many aspects about the role/function of the trophallaxis fluid for the colony.

      We are happy the reviewer agrees with our choices of methods, sample sizes, and statistics, and we are pleased that they have come to the same conclusions.

      Even considering the high level of present investigation, still there are some aspects that could be improved by the authors:

      • The text in general is relatively long with an over use of citations of literature;
      • The discussion is interesting, but some times too much speculative; if the authors could attenuate their speculative statements, the text would become more objective and fluid;

      Thank you for this feedback. These comments truly helped us strengthen the manuscript. We have now streamlined the text, cutting down the introduction, cutting in half the discussion and we have made more explicit what is statement and what is speculation (more on this in response to reviewer 2).

      • The results shown in figure 6A and 6D, relative to the processed of neutrophils degranulation and complement cascade, respectively. The authors did not discuss these results; is there a meaning at level of trophallaxis fluid role for the colony ? This was not discussed in the manuscript.

      We thank reviewer #1 for pointing out these results. We have now addressed these terms in lines 277-284 of the discussion:

      “Our gene-set enrichment analysis showed significant enrichment in immunity-related proteins characteristic of phagocytic hemocytes (58) in trophallactic fluid (‘innate immune system’, ‘complement cascade’, ‘neutrophil degranulation’). These results indicate that hemocytes may themselves be transmitted mouth-to-mouth, and generally shows the involvement of the social circulatory system in colony-level immune responses with implications for social immunity.”

      • Considering the very high scientific quality of the present study, the authors could deposit all the raw proteomic data in a international reliable repository of proteins/DNA DB, since it will be required by top journals.

      We wholeheartedly agree, and all data are now shared online through ProteomeXchange.

      Reviewer #1 (Significance (Required)): Significance:the present investigation represents an important contribution for the knowledge the the exchange of signals within the colony, to synchronize the physiology and development of the hive as whole (the concept of superorganism. The existing data about the composition and potential role of the components from tropahallaxis fluid is very small, compared to the present results. The present study is a master piece of knowledge about the importance of eusociality.

      Thank you for recognizing the importance of this study and affirming our work in such a wonderful way!

      **Audience:** all those scientists involved with social insects; biochemists/protomists dedicated to insect biology, biochemistry and physiology. **My expertise:** biochemistry of Arthropods secretion, in special of honeybees, ants and wasps. **Referee Cross-commenting** I think that both reviews aare complementary to each other; both reviews agree with the need to reorganize the text making it more compact and objective. Essentially, the auhtors must focus in the concept of trophallaxis. Thus, the biochemical processes outlined by proteomic analysis should be addressed to explain how the shared physiology of colony works out.

      Our discussion now focuses more on trophallaxis as a whole, and the biomarker-like quality of the changing proteome. We agree the biochemical processes and their role in the shared colony physiology are fascinating topics. We have not yet performed follow-up experiments with the many proteins present in this fluid and thus do not want to over-conclude. We have now stated more clearly in the discussion what the current data can reveal about these topics, what is assumed via orthology, and what needs to be addressed in future studies.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)): This ms provides a comprehensive proteomic analysis of the trophallactic fluids extracted from carpenter ants. The analytical methods are state-of-the-art, and the results presented should fuel many studies. The vision of the research program, embodied in the title of the paper, is very exciting and is to be encouraged. However, the title of the paper in no way reflects the content of the paper, as none of the functional processes mentioned have been proven. This will require a lot of work and the development of perhaps new bioassays. I truly hope the PI's lab takes this on a deep and substantial way; the notion of trophallaxis and its socially exchanged fluid has long captivated the fancy of social insect biologists, but with a few specific exceptions, the promise has not yet been realized. The technical and descriptive results presented here lay a strong foundation. For purposes of present publication, I strongly recommend a different title and a revised discussion that reflects the disconnect I outline. Cause/consequence issues need to be addressed.

      We thank reviewer #2 for seeing our vision and that this is indeed foundational work that will “fuel many studies.” We also agree that the title and discussion contained too much speculation. The aim of this paper was to prove that there is systematic variation in trophallactic fluid in natural populations that correlates with biologically important social conditions, and further, that some proteins in this fluid can both act as biomarkers and be informative about underlying molecular processes. We have now communicated this more clearly in the introduction. In the revised version of the paper, we have reduced the speculation, and where appropriate, made it clear when there is speculation.

      For example, discussion lines 233-238:

      “Overall, our data reveal a rich network of trophallactic fluid proteins connected to the principal metabolic functions of ant colonies and their life cycle. Pinpointing contexts that induce changes in trophallactic fluid, along with the exact targets and functions of the proteins, are important subjects for future work. Our establishment of biomarkers transmitted over the social circulatory system that correlate with social life will allow researchers to formulate and test hypotheses on these proteins’ functional roles.”

      Three technical points: 1) Sample sizes are low for some analyses (2/group)--though they are cleverly pooled.

      We are not sure what the reviewer is referring to – none of our sample types had this low sample size (see SI Table 1 for sampling scheme). In contrast, for a proteomics study, our sample sizes are quite high. We are aware that for a study focusing on a natural population, the colony-level sample size of 16 (laboratory colonies) can be considered low, but this has been taken into account in our stringent statistical analyses.

      2) How to distinguish between what animals actually transmit and what is found in the gut? There could be differences.

      This has been addressed in our previous work, where it was shown that the crop content is equivalent to what is exchanged among individuals of this same species during the act of adult-adult stomodeal trophallaxis (Figure 1A, LeBoeuf et al. eLife 2016). We have now clarified this in the methods section of the current paper (line 361-364).

      “Trophallactic fluid was obtained from CO2- or cold-anesthetized workers whose abdomens were gently squeezed to force them to regurgitate the contents of their crops. This method of collection was shown previously to correspond to the fluid shared during the act of adult-adult stomodeal trophallaxis (17).”

      3) Is there evidence that the substances found are not just the product of digestion of ingested food? The differences between lab and field colony samples supports this.

      In the type of proteomic analysis we have performed (the most commonly used proteomics approach when a genome is available), we detect only proteins found in the reference genome of interest (in our case Camponotus floridanus), so excepting cannibalism, we should not see proteins that originate from food. Note that this is why we do not provide lab colonies with the typical lab-reared ant diet that includes honey, as bees are also Hymenoptera, and royal jelly and trophallactic fluid have many proteins in common. Cannibalism could result in trace observation of many proteins, but could not produce the consistent and high-abundance set of proteins that we have observed as they are not produced in those precise ratios in larvae or adults.

      The observed shift in trophallactic fluid from field to lab may reflect a change in diet or microbiome and these are questions that could be further investigated in future work (mentioned in lines 229-232). The clear difference we observe between trophallactic fluid of young and mature colonies, or the difference between the worker castes within a colony, is evidence that the variation observed in trophallactic fluid reflects more than diet.

      “Trophallactic fluid complexity declines over time when colonies are brought from the field to the laboratory. This may reflect dietary, microbiome or environmental complexity – typical of traits that have evolved to deal with environmental cues and stressors (e.g. immunity, (37)).”

      Reviewer #2 (Significance (Required)): The paper addresses a very important topic that should be of widespread interest to social biologists. Journal choice should reflect that this is a technically excellent paper that presents descriptive information but functional significance is highly speculative.

      We appreciate that the reviewer agrees that our results are of widespread interest to social biologists. Indeed, our results must be somewhat descriptive, as we are working on a mostly unexplored socially exchanged fluid in a natural population. However, our study design tests clear hypotheses with preplanned sampling and experimental transfer of ant colonies to a new laboratory environment. We present confirmatory results of the hypothesis that trophallactic fluid is complex mixture of biomarker-like molecules and that these biomarkers can be used predict sample origin through machine learning (see random forest predictions, emphasized in lines 151-152). The fact that our evidence for this is correlative does not render it speculative. Indeed, in both ecology and in much of medicine, using correlative evidence is the norm, as it is often impossible to manipulate ecosystems, natural populations and some organisms in a safe and controlled manner. This is what convinced us to invoke the term ‘biomarkers,’ as biomarkers are excellent examples of molecular correlates of larger conditions that have spurred advances in biology and medicine.

      Some of the next steps in our research will be, as reviewer #2 suggested, additional studies on the roles of individual compounds of trophallactic fluid, building on the results of this paper. Additionally, while this study may not have explored the roles of specific molecules, open ended exploration is extremely important and necessary for any scientific advancement in the long run (eLife 2020;9:e52157).

      All in all, we are grateful for this comment, as it showed us that we must communicate the aims of our work more clearly – which we have now done both in introduction (line 77-91) and throughout the discussion.

      **Referee Cross-commenting** Yes. Most of the discussion is pure speculation because we do t k ow what is exchanged and what the modes of action might be. But it's a great start!

      We have reduced the speculation on the roles of single molecules, and we hope our responses to the points above clarify some of the reviewer’s uncertainties about what is exchanged. However, we do still outline hypotheses for potential functions and origins in the discussion section, as this study is intended to be a foundation for new lines of research.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reviewer #2 (Evidence, reproducibility and clarity):

      This paper attempts to address a current, clinically relevant question utilizing novel statistical modeling. The authors comprehensively assessed the presence of criteria and non-criteria aPL in a heterogeneous cohort of 75 COVID patients and 20 non-infected controls. They found 66% of COVID patients had positive aPL and demonstrated a correlation between aPL and anti-SARS-CoV-2. However, I have several major concerns:

      1. The cohort is extremely heterogeneous. COVID-19 samples that were used included hospitalized patients and those who had COVID more than 2 months ago and were convalesced (29% of samples). Severity of disease does influence autoreactivity and the presence of autoantibodies. The prevalence of autoantibodies among patients who are acutely ill will be much different than those who are convalesced. I think it would be prudent to assess the presence and correlation of aPL among those two groups separately.

      We thank you for pointing out the complexity of our study population, consisting of multiple cohorts from different centres. Exactly the above-mentioned heterogeneity of our cohorts and their variables is the reason why we employed linear mixed-effect models. Linear mixed-effect smodels, accounting for both fixed as well as random effects, are suitable to address potentially confounding factors. Along these lines, disease severity (different in the convalescent and the acutely ill individuals) as well as the relation of the time of sampling to time of disease occurrence (days post onset of disease manifestation) were included as fixed effects in our mixed model. Thus, our model accounts for potential differences between the acute phase of infection and convalescent phase and would capture them if relevant.

      In order to increase the rigour, we have performed an additional analysis where we excluded the convalescent individuals from the model (see Fig. 3C). The results obtained are in line with results already shown (Fig. 3B, 3D).

      In general, we have pursued a largely data-driven exploratory, and not a hypothesis-driven, approach. Clearly, we could have decided to set a stringent focus on a cohort without complexity. Yet, our approach encourages heterogeneity, which we address using an adequate model. Since, perhaps, the model choice, the model itself, and the data-driven approach were not explained extensively enough, we have added a more detailed account in the manuscript, lines 317-334 and lines 394-403.

      1. Sampling of the patients is concerning, 35% are plasma and 65% are serum. It is undesirable to put data from plasma and serum together to perform analysis.

      We thank the reviewer for raising this important concern. We have aimed to be as rigorous and transparent as possible in the description of the cohorts (see Tables 1 and 2) for serum/plasma). While we agree that, in general, it would be best if either only plasma (i.e., only heparin plasma or only EDTA plasma) or only serum was used, the authors wish to clarify that for both SARS-CoV-2 IgG profiling as well as for LIA, plasma or serum can be used interchangeably. We can formally show this. We have conducted a SARS-CoV-2 IgG profiling experiment on patient-matched samples (plasma and serum). Data is unambiguous about that there is no effect of plasma or serum on the assay outcome (Fig. S3A and S3B), with a Pearson correlation coefficient of 0.9942 (95% confidence interval: 0.9865-0.9975) and R2 of 0.9885. Bland-Altman analysis does not indicate any significant bias (Fig. S3C).

      For the detection of APS antibodies with ELISA, literature is suggestive of no relevant interference by the usage of plasma or serum on the measured value (Pham et al., 2019). To formally reassess this, we measured aPL autoantibodies with LIA in one matched plasma and serum sample of an individual with high-titre aPL antibodies and of one high-titre individual whose plasma was spiked into non-reactive plasma and serum (Fig. S2A and Fig. S2B). We found the same pattern of IgM and IgG aPL-positivity in both matched serum and plasma samples as well as in spiked serum and plasma samples, with a Pearson correlation coefficient of 0.9974 (95% confidence intervals: 09611-1.034) and R2 of 0.9813 (Fig. S2A). Bland-Altman analysis did not indicate a significant bias (Fig. S2B).

      We therefore conclude that in our study, using both plasma as well as serum has no effect on the validity of our results.

      1. LIA based assays were used to assess the presence of aPL and results were reported in OD rather than standardized units. While the same group demonstrated a positive correlation in the past between LIA OD and internationally accepted ELISA-based aPL assays, the validity and clinical utility of these LIA assays still require further evaluation. Furthermore, OD>50 was used as a positive cut-off. How this cut-off was determined and how it relates to internationally accepted positive aPL cut-offs (99th percentile or greater than 40) remains unclear.

      We thank the reviewer for mentioning concerns on LIA. The validity of this technology has been confirmed in multiple peer-reviewed publications (Roggenbuck et al. Arthr Res Ther 2016;18:11, Nalli et al. Autoimmunity Highlights 2018;9,6). In terms of cut-off detection, processed strips were analysed densitometrically employing a scanner with the evaluation software Dr. DotLine Analyzer (GA Generic Assays GmbH). The cut-off of 50 OD units was determined by calculating the 99th percentile of 150 apparently healthy individuals as recommended by the international classification criteria for aPL testing and Clinical and Laboratory Standards Institute (CLSI) guideline C28-A3 (Roggenbuck et al. Arthr Res Ther 2016;18:11, Nalli et al. Autoimmunity Highlights 2018;9,6). A corresponding sentence has been added to the METHODS AND MATERIALS section.

      For our study, we aimed to perform the maximum number of tests possible with limited sample volume and have therefore chosen LIA. We are aware of the discussion on internationally accepted cut-offs for clinical APS diagnostics. However, we would like to point out that our manuscript is not a case report on patients diagnosed with APS, nor do we aim to modify diagnostic standards set in the international consensus statement for the classification criteria for definite APS (established in 2006).

      Moreover, the OD ≥ 50 was used as a cut-off in one analysis (with Fisher’s exact test for statistics) in our manuscript and was re-assessed using Mann-Whitney/Wilcoxon rank sum test on a continuous scale (Fig. 1C and 1D). All subsequent analyses were not contingent on an OD cut-off. We believe that this is clearly stated in the manuscript.

      1. While the authors attempted to evaluate the presence of both IgG and IgM aPL in COVID patients, only 65% of samples were tested for both IgG and IgM aPL.

      We agree that testing the entire collective for IgG and IgM isotypes would have been best. In fact, we would have been interested in also including the IgA isotype. Inconveniently, sample volume is sometimes limiting.

      We have been clear about the omission of IgG aPL measurements in the samples from Zurich (see lines 214-215). We consider this a limitation, however, our data indicated that IgM aPLs are more immediately relevant in the context of SARS-CoV-2. While this has been surprising to us, we would like to highlight that this is a manifestation of the quality of a data-driven approach where data, much more than belief, build the foundation for conclusions. Along these lines, we could have easily omitted all data on IgG aPLs without compromising the message contained in our manuscript. However, we stand behind our decision to show all data even if, in the case of IgG aPL, (1) they are mostly negative and (2) they are incomplete.

      1. 26 patients had anti-SARS-CoV-2 data already available. Whether those were tested on the same samples and at the same time points as aPL ais not clear.

      We apologise for not having been clear about this in the text. The 26 samples from Zurich had been included in another study where their respective anti-SARS-CoV-2 Spike ECD, RBD, and NC p(EC50) values were used (Emmenegger et al., 2020). Thus, the p(EC50) values have been re-used in the current manuscript. The aPL autoantibodies were measured on exactly the same samples. We have tried to improve the explanation of this in the text, see lines 300-301.

      1. The novel statistical modelling design is interested. However, as there are concerns about the data put into the modelling, the validity of the conclusions is debatable.

      We thank the reviewer for being interested in the statistical model we used. Linear regression analysis belongs to the standard equipment when performing epidemiological analyses (see e.g., Szklo, Nieto, Epidemiology: Beyond the Basics). Here, we have employed a linear mixed-effects model to infer changes in the predictive power of fixed and random variables (e.g. SARS-CoV-2 IgG levels, disease severity, age, sex, days post onset of disease manifestation), to determine which of these variables reliably predict an outcome (e.g. PT aPL levels), and in what combination.

      We recognised that the manuscript would benefit from a more thorough explanation of the model and how it helps to evaluate the validity of the data. We have therefore added lines 317-334 in the manuscript.

      All authors are appreciative of the reviewer’s critique. In the light of the answers we provided, we are convinced about our conclusions, based on the data and our dataset. We hope that, with our responses, we have adequately addressed the concerns raised by the reviewer.

      Reviewer #2 (Significance):

      See above.

      Reviewer #3 (Evidence, reproducibility and clarity):

      It is being recognized that SARS-CoV-2 infection leads to acquired thrombophilia with increased arteriovenous thrombosis and endothelial injury and organ damage. This has multiple mechanisms including, the hypercoagulable state with platelet activation, endothelial dysfunction, increased circulating leukocytes, cytokines and fibrinogen, but also the acquired thrombophilia could be due to acquired APS in these patients. In this study, Emmenegger et al. evaluated aPL antibody responses in SARS-CoV2 infected individuals in connection with antibodies against the SARS-CoV2 components and found that antibody strength response against SARS-CoV-2 proteins is associated with PT IgM aPL antibody

      Reviewer #3 (Significance):

      This is overall an interesting and thought-provoking study, as it may explain the development of thrombophilia after SARS-CoV-2 vaccination. While the study provides a possible association of the development of antibodies against SARS-CoV-2 infection and aPL, it does not go to molecular details about the homology between anti- SARS-CoV-2 antibodies and aPL. Therefore, the study remains an association study.

      First of all, we would like to thank the reviewer for the careful evaluation of our work. We are in full consciousness of the descriptive nature of our work. Thanks to the suggestion of the reviewer (see below), we have aimed to go one step further into a more functional/ mechanistic description.

      It is not surprising that they found a difference in IgM rather than IgG as IgM development is an early response.

      The overall conclusion is supported by the rigorous statistical analyses, yet the study remains a correlative and association study.

      Significance: Thrombophilia associated SARS-CoV2 may be due to immunity against SARS-CoV2 rather than that pure cytokine response.

      Furthermore, they did not characterize the PT IgM aPL to find which part could be immunogenic or epitope similarity with anti- SARS-CoV-2 antibodies. Identification of these epitopes is crucial for further understanding of the antibody development and further intervention.

      Existing literature does not connect with antibody responses against Sars-CoV2.

      Could the authors provide some molecular epitope analysis of IgM aPl and ani Sars_ antibodies? Even computation analysis will improve the paper tremendously.

      We thank the reviewer for coming up with this idea. Clearly, the presence of cross-reactive IgM antibodies to human prothrombin, triggered against the SARS-CoV-2 Spike protein, would be a direct and simple explanation for our observation. We have put efforts into analysing epitopes of SARS-CoV-2 Spike protein and prothrombin (see lines 374-390 in the manuscript and Fig. 4). We conclude there is very limited similarity, and that the mechanism is most likely indirect.

      There is no ethical concern.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Full Revision

      Manuscript number: RC-2021-00785

      Corresponding author: Christian, G. Specht

      1. General Statements

      Dear Editor,

      We greatly appreciate the reviewers’ constructive comments on our manuscript ‘Identification of a stereotypic molecular arrangement of glycine receptors at native spinal cord synapses’. We were particularly pleased that all four reviewers agreed that our data yield new insights into the structure of inhibitory glycinergic synapses, and represent both a technical and conceptual advance the field of synaptic neuroscience.

      The reviewers have consistently raised one main criticism, namely the use of endogenously expressed GlyRs tagged with the fluorescent protein mEos4b, which could potentially have an impact on receptor expression, trafficking and function. We have addressed this point by performing whole-cell recordings of GlyR currents in cultured neurons that show that glycinergic transmission and therefore function is preserved. We have also addressed all other comments of the reviewers in the revised manuscript, including a thorough revision of the text and the addition of new data and figures as detailed in the point-by-point response.

      Point-by-point description of the revisions

      Reviewer 1:

      Summary:

      In this manuscript Maynard et al describe a newly generated knockin mouse to study the endogenous distribution of Gly receptors in the spinal cord. Using quantitative confocal imaging and SMLM the distribution and levels of GlyRs at spinal cord synapses is compared between dorsal and ventral horn. They found that levels of synaptic GlyR are higher in dorsal than ventral spinal cord synapses. Nevertheless, the ratio to gephyrin seems constant, except for synapses in superficial layers of the dorsal horn, where gephyrin levels exceeded the levels of GlyRs. There are also fewer, but larger synapses in the ventral horn than in the dorsal horn. These findings are further corroborated by an SR-CLEM approach. Furthermore, it is shown that in a mouse model for hyperekplexia GlyR levels are lower, but still enriched at synapses, and the dorsal-ventral gradient in GlyR expression was maintained. The difference in size of ventral and dorsal synapses observed in WT animals was also lost in the oscillator mouse, suggesting that particularly the ventral synapses are affected. Despite these differences, the density of GlyRs per synapse remained similar.

      Major comments:

      Line 113: "labeling the_ _b__-subunit has proven difficult". This statement is unclear and it would be informative for readers to grasp what exactly has been difficult, and why the approach described here overcomes that? Related to that, the authors state "KI animals reach adulthood and display no overt phenotype, suggesting that the presence of the N-terminal fluorophore does not affect receptor expression and function". That is indeed reassuring, but it does not exclude that receptor numbers, function and distribution are altered. As it seems there is no prior literature on tagging the beta subunit, additional evidence that the tag does not interfere with receptor trafficking or functioning would be desirable

      We have clarified why it has been difficult to label the GlyR beta subunit until now, lines 113-115 _“To date, labeling of GlyRβ in situ using immunocytochemistry has proven difficult due to a lack of reliable antibodies that recognize the native β-subunit (only antibodies for Western blotting recognizing the denatured protein are available), which has severely limited the study of the receptor.”_ Hence it was important to us to generate this knock-in mouse in order to study the endogenous GlyR at synapses, which is the least well studied receptor mediating fast synaptic transmission.

      The reviewer makes an important point regarding the labeling of the GlyRβ-subunit with a fluorescent protein that has also been raised by the other reviewers. We have now verified receptor function by patch clamp recordings of glycine currents in whole-cell configuration in spinal cord neuron cultures from the mEos4b KI mouse (new Supplementary Fig. S2C). At saturating glycine concentrations of 300 μM we found no difference in chloride influx between mEos4 KI and WT mice. Since glycine concentrations in the synaptic cleft are in the millimolar range during synaptic transmission, these data strongly suggest that glycinergic transmission is not affected by the presence of the mEos4b under physiological conditions, despite a minor shift in the EC50.

      There are several other strong arguments that suggest that mEos4b-GlyRb expression, subcellular localization and function are the same as those of the native subunit. Firstly, the mEos4b sequence was inserted after the signal peptide and before the beginning of the coding sequence of the mature β-subunit (Fig. S1). Since the mEos4b sequence does not interrupt the coding sequence it is less likely to affect the receptor conformation. Secondly, we did not notice any behavioural phenotypes in animals carrying the GlrbEos allele. At the time of weaning, the genotypes of the pups corresponded to the expected Mendelian frequency (new Fig. S2A). Moreover, we did not observe a reduction in live expectancy of GlrbEos/Eos animals (new Fig. S2B), demonstrating that the mEos4b-GlyRb does not cause pathology in older animals.

      Most importantly, our imaging data (Fig. 1-3) provide exhaustive evidence that mEos4b-GlyRb assembles with GlyR alpha subunits as heteropentameric receptor complexes that are trafficked to the plasma membrane and inserted into the synaptic membrane due to their interaction with the gephyrin scaffold at functional synapses. Using quantitative imaging, we have also shown that homozygous GlrbEos/Eos KI mice have exactly twice the number of receptors at synapses as heterozygous animals, strongly suggesting no interference in receptor trafficking to the plasma membrane and gephyrin binding. As the mEos4b mice were also bred with the oscillator mouse model of hyperekplexia, which is lethal when homozygous, we could further test the combined effect of GlrbEos and GlyRa1spt-ot. The presence of both alleles did not lead to any noticeable phenotypes in heterozygous oscillator mice. On the contrary, both synaptic targeting and the packing density of the receptors were not altered in this model, despite a region-specific reduction in synapse size due to the reduced availability of the intact GlyRa1 subunit.

      We believe that these data overwhelmingly support our conclusion that the presence of the mEos4b tag does not alter the structure and function of the receptor, making this mouse model uniquely suited to study the dynamics and regulation of glycinergic synapses in a quantitative manner and at the molecular level.

      In the Discussion the authors conclude that "Our quantitative SR-CLEM data lend support to the first model, whereby inhibitory PSDs in the spinal cord are composed of sub-domains that shape the distribution of the GlyRs". This conclusion seems however based on one example image in Fig 3G that is not very convincing. The EM image seems to show two clearly separated PSDs opposed by two distinct active zones. So, although this conclusion is of high interest, more support should be given to substantiate this conclusion. More general, these subsynaptic domains (SSDs) are hardly further explored, but seem relevant for transmission, particularly given that the synaptic pool of GlyRs at these synapses is not saturated by single release events. How general are these SSDs at these synapses?

      The representative image in Fig. 3G shows two SSDs within the same postsynaptic site with a continuous presynaptic active zone. It should be noted that the PALM/SRRF images were taken of the entire 2 µm thick slice, whereas the electron micrograph shows only a single 70 nm section. We verified throughout the full 3D stack of serial sections that the presynaptic site remains continuous, which it does. We would also like to point out the scale of the image showing that the two SSDs are only around 170 nm apart, i.e. spatially very close. Our conclusions are however not based on this single image but the whole dataset. The graph in Fig. 3I shows 3 synapses (out of N = 36), in which the GlyR density at separate SSDs could be quantified, demonstrating that the receptor density is not different between SSDs. The reviewer is correct that we do not further analyse the SSDs beyond their density and the analysis of the segmentation of the postsynaptic sites (Fig. 3E-G). Further work on the functional role of SSDs in synaptic transmission is outside the scope of this manuscript and would indeed merit future study.

      The approach for counting molecules based on the PALM acquisition has been developed in prior publications and seems robust. It would however be worth to present the reader with a bit more background and explain the assumptions of this approach in more detail. Particularly, since counting of mEos4b can be problematic, as there are multiple dark and fluorescent states of this fluorophore that could be influenced by the illumination scheme, see for instance De Zitter et al., Nat Methods 2019. Since the preceding SRRF acquisition already exposes the fluorophore to high and continuous 561-nm laser power this could skew the counting due to unaccounted conversion and perhaps bleaching of mEos4b. In line with this, although throughout the manuscript the term 'absolute copy numbers' is used the reported numbers are at best an estimate based on a number of assumptions. I think the wording 'absolute numbers' is therefore deceiving and should be nuanced.

      We have clarified how the molecule conversion is calculated (Fig. S7 legend), to provide a more complete description of the way in which the values were obtained. Further we have explained how we calculated the probability of detection. Since the probability of detection accounts for any unconverted or non-functional mEos4b molecules, our molecule counting approach is relatively resistant to potential pre-bleaching of fluorophores. It should be noted, that 561 nm illumination had no obvious effect on the non-converted (green) mEos4b fluorophores, as judged by the fact that the intensity of receptor puncta was unaffected by the SRRF recordings. We appreciate the reviewers point regarding the term ‘absolute copy number’ and we have adjusted our wording throughout the manuscript accordingly.

      Related, most of the quantifications are in estimating the number of receptors, and not so much the distribution with the PSD. The term "molecular arrangement" - also used in the title - might therefore be misleading, there is in fact little characterization of how GlyRs are placed within the PSD. More focused analysis quantifying the distribution of receptors within the PSD and/or SSDs would strengthen the manuscript.

      By estimating the number of receptors and the exact size of synapses, the main conclusion of our study is that receptor density at dorsal and ventral synapses is identical, independent of synapse size, subdomains, or in fact loss of GlyRs in a mouse model of hyperekplexia. This observation clearly relates to how receptors are packed within synapses, and thus describes their molecular arrangement.

      The reported N is confusing and makes it hard to judge the reproducibility of the data. Sometimes it refers to number of images, sometimes number of synapses, but it is unclear from how many experiments these are drawn. This should be reported more completely (number of animals should be reported at least) and consistently. In figure 1, the N numbers (N=3-5 images) are particularly low and question how consistent these findings are across multiple animals.

      We have clarified the N in the figure legends, to reflect the full size of the datasets that have been analysed.

      The levels of mRFP-Gephyrin seem to differ between the different mouse lines, is this a significant difference?

      No significant differences in mRFP-gephyrin levels were found in animals with different mEos4b-GlyRb genotype (Fig. 1B). However, expression of mRFP-gephyrin in heterozygous animals is 50% of that in homozygous mRFP-gephyrin KI animals (not shown).

      The ICQ analysis for co-localization is hardly explained. How do we interpret this parameter? What does an average value of ~0.3 mean? A comparison with sets of proteins that do not overlap as a negative control would strengthen the conclusion.

      We have clarified that an ICQ value of 0.3 is indicative of a very high spatial correlation between pixels, and provided a corresponding reference for ICQ analysis (lines 209-210). We would like to point out that the scale of the ICQ is between -0.5 to 0.5, meaning that a value of 0.3 comes close to complete correlation.

      Minor comments:

      Very little fluorescence was detected in the forebrain, despite the high reported expression of the Glrb transcript". Can the authors expand on this? What would explain this discrepancy?

      We have clarified the text to include “suggesting that protein levels are controlled by post-translational mechanisms in a region-specific manner, as previously proposed (Weltzien et al., 2012)” (Lines 152-153). The reason for this discrepancy is not known. However, the distribution of mEos4b expression throughout the brain is as expected, based on the literature.

      "What region is quantified in Fig 1B? is the same region in all conditions? This should be specified more clearly as the manuscripts presents a clear gradient in expression levels in the spinal cord and thus the location will influence the intensity measurements.

      We have explained in the text that this is the region at the centre of the ventral horn identified by the white square in Fig. 1A, and that the same region was analysed for all images across all animals. Page 5, lines 160-161 “The same region of the ventral horn, indicated by the white square in Fig. 1A was taken for quantification of mEos4b-GlyRβ and mRFP-gephyrin expression in all conditions.”

      The labeling approach does not differentiate between surface and internal receptors, this should be made more explicit in the text.

      Whilst this is correct, we have only analysed mEos4b-positive synapses that had corresponding gephyrin clusters, meaning synapses where receptors are located in the postsynaptic membrane. Indeed we found that all mEos4b clusters imaged colocalised with mRFP-gephyrin clusters. We have adjusted the text accordingly, page 6, line 205-206 “All mEos4b-GlyR clusters closely matched the mRFP-gephyrin clusters, confirming the localization of the receptors in the postsynaptic membrane.”

      Significance:

      The presented data are interesting and the experiments are technically advanced and carefully performed. Particularly the SR-CLEM approach is technically advanced. The datasets present a quantitatively detailed characterization of spinal cord synapses and will be of interest for researchers working in the field of spinal cord circuitry, as well as super-resolution imaging. The conceptual advance for the field is however somewhat limited. It seems that the presented data confirm the general notion that receptor numbers and synapse size are highly correlated. So, although this manuscript describes very interesting observations, in its present form the manuscript does not provide any new mechanistic insight or significant advance in our understanding of how these synapses operate.

      We thank the reviewer for his/her comments relating to the technicality of our manuscript. However we think that the statement “The conceptual advance for the field is however somewhat limited” is unfair, as this level of organisation of inhibitory synapses at the molecular scale has never been achieved before, as pointed out by the other reviewers, and especially not as regards different ages of animals and a disease model that directly affects receptor numbers in a region-specific manner. We therefore believe that our study will have a substantial impact within the fields of synaptic neuroscience as well as quantitative neurobiology.

      Referee cross-commenting:

      I agree with the other reviewers that this study is technically advanced, but I remain critical towards the extent of conceptual advancement this study brings and there are some important concerns with the presented data that need to be addressed. Nevertheless, indeed many of these concerns can be addressed without additional experiments. As pointed out also by other reviewers additional validation that the fusion proteins are not disrupting their function or organization would be important.

      Reviewer 2:

      Summary:

      Maynard et al. investigate (inhibitory) glycinergic synapses in mouse spinal cord, which regulate motor and sensory processes. The authors analyse the molecular architecture and ultra-structure of these synapses in native spinal cord tissue using quantitative super-resolution correlative light and electron microscopy. The major finding is that GlyRs exhibit equal receptor-scaffold occupancy and constant absolute packing densities across the spinal cord and throughout adulthood, although ventral and dorsal inhibitory synapses differ in size. Moreover, what the authors call a „stereotypic arrangement" is even maintained in a hypomorphic mutant (oscillator), which is deficient in the adult GlyR a1 subunit.

      Specific comments:

      To reach their conclusions the authors generate two knock-in mouse lines, one with mEOS-labelled GlyR ß-subunit and one with mRFP-labelled gephyrin, a subsynaptic scaffolding protein of inhibitory synapses, which are subsequently crossed. Both changes are not unproblematic, as mutations in the N-terminal end of the GlyR ß subunit polypeptide chain might interfere with the assembly of functional GlyR (consisting of a und ß subunits) and and mutations at the N-terminal end of gephyrin interfere with it's homo-oligomerization into higher molecular assemblies.

      We have demonstrated that the function of mEos4b-GlyRb does not differ significantly from WT GlyRs, by carrying out electrophysiological experiments (new Fig. S2C). For a detailed response, please see the response to the first comment of reviewer 1. The mRFP-gephyrin KI strain has been validated and published previously (see Machado et al., 2011, J Neurosci; Specht et al. 2013 , Neuron) and was not specifically generated for this study. The experiments with the oscillator mutant did not include the mRFP-gephyrin allele. In these experiments, the wildtype GlrbEos/Eos (Fig. 4, 5) behaves exactly as the GlrbEos/Eos in the double knock-in (Fig. 1, 2), further validating the mouse models used.

      However, in this experimental design both labelled proteins reach postsynaptic membrane specialisations. In case of the ß-subunit quantitative evaluation confirms that heterozygous animals contain only half of the labelled protein as homozygous, which is an indication but not a proof that the correct stoichometry of adult GlyR is maintained. Likewise, mRFP-labelled gephyrin assembles with WT-gephyrin in subsynaptic domains, but it is not clear, if the size and density of the synapses is changed by the knock-in procedure as compared to WT-synapses.

      An effect of the mRFP tag on gephyrin clustering can be ruled out, since we observed no difference in synapse size and receptor density in GlrbEos/Eos animals with (Fig. 1, 2) and without the GphnmRFP allele (Fig. 4, 5, oscillator wild-type controls). Similarly, the synaptic mEos4b-GlyRb levels in heterozygous animals were precisely half those of the homozygous animals, strongly suggesting that the expression and trafficking of the tagged receptor subunit is unchanged, as the reviewer acknowledges. In the absence of any obvious behavioural and/or functional phenotypes (Fig. S2) this KI model is in our view is an exceptional tool to study GlyRs expressed at endogenous levels in a cell-type specific manner.

      Accepting these constraints, which to the knowledge of this reviewer have never been addressed to satisfaction, the authors provide a technically excellent, comprehensive analysis of glycinergic synapses in the spinal cord of double knock-in mice. Therefore, it should be stated in the title, that the investigations were performed with double knock-in instead of „native" spinal cord. Text and figures are clear and accurate and represent the state of the art.

      We thank the reviewer for the positive comments regarding the techniques used in the study, and the clarity of the text and figures. We have adjusted the title as requested.

      Finally, the reviewer would like to raise a minor point: the term postsynaptic density is derived from electron microscopical studies of synapses, where asymmetrical synapses display a „postsynaptic density" but symmetrical synapses do not. The latter were identified as inhibitory synapses and therefore, by definition, inhibitory synapses do not have a postsynaptic density, but rather a postsynaptic membrane specialisation. The use of the term „postsynaptic density" should, therefore, be restricted to excitatory synapses.

      We are conscious of the importance of correct definitions and have revised the terminology, referring to “postsynaptic sites”, “postsynaptic domains”, and “postsynaptic specializations” as appropriate throughout the manuscript.

      Significance:

      The authors provide a state of the art advanced light and electron microscopical analysis of glycinergic synapses in the mouse spinal cord. They suggest a robust "stereotypical" mechanism in place, which guarantees a fixed stoichiometry of relevant components, which is even maintained in a hypomorphic mutant, which is believed to represent a mouse model of human hyperekplexia (startle disease).

      Referee cross-commenting:

      I would like to corroborate the arguments of the previous reviewer: it is not clear to which extent the fusion proteins influence the measurements, which are technically very advanced and well done, however. The authors do definitely not investigate "native spinal cord" as stated in the title.

      The argument concerning fusion proteins must be taken especially serious as the fusions were induced in regions known to be responsible for assembly of glycine receptors and oligomerization of gephyrin.

      We have verified the receptor function with electrophysiological recordings and clarified exactly where the fluorescent protein was inserted (see reviewer 1 response). Given the similarity in synapse size, fluorescence intensities and molecule densities observed in neurons expressing different combinations of tagged and native receptors and scaffold proteins, we strongly believe that all animal models used are well suited to the experimental aims of our study.

      Reviewer 3:

      Summary:

      Glycinergic synapses are the least well understood of synapses that mediate fast synaptic transmission. The manuscript by Maynard et al. adds new information about the structural aspects of these synapses, using PALM and EM imaging of spinal cord synapses from mice at 2 and 10 months. The authors created a knock-in mouse that expresses a tagged GlyRbeta subunit, allowing synaptic localization of glycine receptors; all synaptically localized glycine receptors are thought to require the beta subunit to be tethered by gephyrin. The authors compare synaptic profiles from: 2 month old vs. 10 month old mice; dorsal vs. ventral horn; and GlyR1-reduced vs. wild type mice. Strikingly, they find a tight relationship across all of these variables between glycine receptor puncta and gephyrin puncta, as well as an apparently constant "packing density" of glycine receptors. They conclude that synaptic extent is likely to be the most important determinant of synaptic strength, as the density of receptors within the postsynaptic density is constant. These results use cutting-edge imaging and are analyzed with care, and add new information to our understanding of these relatively less well characterized synapses._

      Major comments:

      The key conclusions are convincing and the claims appear solid. Additional experiments are not needed to support these claims. The data and the methods are largely presented in such a way that they can be reproduced, although there are minor suggestions for improvement below.

      We thank the reviewer for his/her positive comments.

      Minor comments:

      Do the authors have any comment on the requirement during, e.g. LTP, for insertion of a gephyrin-GlyR unit? The lead author has speculated that gephyrin creates "slots" for GlyRs; yet apparently each slot is already filled in the snapshots taken here. How might postsynaptic LTP occur (Kandler group, Kauer group papers)?

      Given the reciprocity of GlyR and gephyrin clustering at synapses, the occupancy of binding sites (and in turn the number of available ‘slots’) is dependent on the strength of receptor-scaffold interactions, as discussed previously (Specht 2020, Neuropharmacol). In this study we demonstrate that the density of GlyRs at synapses is constant, which implies that the receptor occupancy is also the same, with the possible exception of mixed inhibitory synapses in the superficial dorsal horn that contain a majority of GABAARs. The PALM/SRRF data are represented as rendered image reconstructions and not as pointillist representations, and the detection of unoccupied binding sites is below the spatial resolution of our approach. However, the high spatial correlation of the signal intensities (ICQ ≈ 0.3) suggests that receptor occupancy is equal between and within synapses. It has previously been established that there are more scaffold proteins than receptors at synapses (Specht et al. 2013, Neuron; Patrizio et al. 2017, Sci Rep). Based on these studies we report that approximately half the gephyrin binding sites are occupied by receptors (lines 262-655). We have also expanded the discussion, describing how shape and size of synapses may affect synaptic transmission, as well as the possible role of receptor-gephyrin interactions in synaptic plasticity at glycinergic synapses.

      It would be very interesting in the discussion to contrast the present observations with what is known about excitatory synapses (NMDA and AMPAR distributions) and GABAergic synapses. Are the authors at all surprised that receptor packing is constant across conditions? Can the authors speculate on how non-gephyrin binding receptors (homomeric alpha receptors, which are found in recordings) may function and be tethered to the membrane.

      We have included additional information about receptor numbers and distributions at excitatory (lines 428-438) and GABAergic (lines 389-393) synapses in the discussion. So far, homomeric GlyRs composed of alpha subunits have been found to be exclusively extrasynaptic. As stated on page 4, lines 111-112 the beta subunit is required for binding of the GlyR to gephyrin and subsequent anchoring at the synapse. Previous studies have shown exocytosis of receptors to occur at extrasynaptic sites followed by lateral diffusion to synapses. Homomeric GlyRs are therefore most likely targeted to the extrasynaptic plasma membrane where they remain due to the lack of the beta subunit.

      Figure S1. It would be most helpful to quantify this; at the least to include an atlas-like drawing to allow identification of the structures illustrated and containing Glrb; better yet would be quantification of staining in regions where this is strongest.

      We have added an atlas indicating the different brain regions expressing mEos4b-GlyRb protein as a new Supplementary Fig. S3. The regional expression pattern agrees with the available literature about protein expression of the GlyRb subunit in different brain regions and hence provides further evidence that mEos4b-GlyRb is expressed like the native receptor. Due to the relatively low resolution of the tiled image no accurate quantification was possible. We have however added higher magnification confocal images of representative brain regions expressing varying amounts of GlyRb.

      The fact that the lower panel in B is labeled as +/+ across all groups is initially confusing; perhaps relabel as mEos4 -/-, +/- and +/+?

      We assume that the reviewer is referring to Fig1B. The genotype of both the GlrbEos and the GphnmRFP allele is now indicated on the x-axes, and the legend has been modified to clarify that all these animals were homozygous for GphnmRFP/mRFP. We have strived to remain consistent throughout the manuscript when referring to genotypes and protein levels.

      Do gephyrin levels drop in WT mice as well as in the mEosr-GlyRb mouse between 2 and 10 months? Do the authors have any thoughts on this (Supp figure S2)?

      We found no differences in gephyrin levels between 2 and 10 months. Fig. S2 (now Fig. S4C) shows the number of synaptic gephyrin clusters, which was the same at different ages and genotypes.

      Significance:

      Glycinergic synapses are the least well understood of synapses that mediate fast synaptic transmission. The manuscript by Maynard et al. adds new information about the structural aspects of these synapses, using PALM and EM imaging of spinal cord synapses from mice at 2 and 10 months. The authors created a knock-in mouse that expresses a tagged GlyRbeta subunit, allowing synaptic localization of glycine receptors.

      This will be of interest to those studying inhibitory synapses, and more broadly to synaptic morphologists, physiologists and imagers for comparison with other synapse types.

      My own expertise is NOT in these techniques, but I am a synaptic physiologist with a standing interest in glycinergic synapses; thus I am not providing serious technical critiques.

      Referee cross-commenting:

      Hi all, I agree with the other two reviewers, and do not have anything else to add.

      Reviewer 4:

      Summary:

      The authors used a correlative approach and combined photo-activated localization microscopy with electron microscopy to characterise Glycinergic synapses in spinal cord tissue. Some of the major findings are:

      • The receptor-scaffold occupancy and packing densities of glycinergic synapses in different regions of the spinal cord are the same.
      • Gephyrin clusters in the spinal cord are composed of sub-domains that shape the GlyR clusters.
      • Ventral horn synapses are generally larger, more complex (containing a number of gaps) and contain more GlyRs. -In a mouse model of Hyperekplexia, the number of GlyRs is reduced resulting in smaller synapses in the ventral spinal cord.

      Major comments:

      Are the key conclusions convincing? Yes

      Should the authors qualify some of their claims as preliminary or speculative, or remove them altogether? No

      Would additional experiments be essential to support the claims of the paper? Request additional experiments only where necessary for the paper as it is, and do not ask authors to open new lines of experimentation. No

      Are the suggested experiments realistic in terms of time and resources? It would help if you could add an estimated cost and time investment for substantial experiments. N/A

      Are the data and the methods presented in such a way that they can be reproduced? Yes

      Are the experiments adequately replicated and statistical analysis adequate? Yes

      Minor comments:

      Specific experimental issues that are easily addressable. Please see below

      Are prior studies referenced appropriately? Yes

      Are the text and figures clear and accurate? Yes

      Do you have suggestions that would help the authors improve the presentation of their data and conclusions? Please see below.

      As the authors pointed out, fusing mEos to the extrasynaptic terminal of GlyRb has been difficult and therefore this construct would benefit the larger scientific community. Fig 1C is a nice imaging control for expression efficiency, however, it is in stark contrast with the lack of functional control. Do authors have any electrophysiological evidence showing that the insertion of mEos4b doesn't modulate channel function? I would assume that the construct would be tested in cell lines before the KI mouse line was created. Was any functional analysis done? If yes, it would be very useful to show it. I do appreciate that the authors used a standard insertion between the 4th and 5th AA in the extracellular domain, which in most cases does not abolish channel function. Given the lack of an obvious phenotype in the KI mouse model, I believe that this is also the case here. However, I disagree with the statement in lines 120-121: "the presence of the N-terminal fluorophore does not affect receptor expression and function." I believe that if there are no electrophysiological measurements of GlyR function, this statement remains speculative. As the authors pointed out in their previous publication: "receptor function and gephyrin binding are not independent properties. Instead, we think that conformational changes triggered at extracellular or intracellular protein domains have downstream consequences on channel opening as well as receptor clustering." In line with this, my concern is that the modulation of channel function by mEos4b could result in an altered cluster size at synapses. There is a large body of literature showing that just one missense mutation in the extracellular domain of ion channel subunits can lead to synaptopathies because the channel function gets modulated, and there is an abundance of similar examples involving mutations of GlyR and GABAAR subunits. In my view, comparing the function of GlyRs incorporating wt-GlyRb and mEos4b-GlyRb subunits is important for the correct interpretation of the main findings of this work and would strengthen the publications.

      As the reviewer points out, the insertion of the mEos4b sequence was considered carefully in order to have the least impact on receptor function. GlyR channelopathies are often caused by point mutations within the coding sequence, which is not the case in the GlrbEos allele. Instead, the mEos4b sequence was inserted after the single peptide of GlyRb, duplicating several amino acid residues in order to maintain the correct cleavage site and N-terminus of the mature receptor, and to not interrupt the GlyRb coding sequence (Fig. S1B). In order to verify that the mEos4b-tag does not affect GlyR function, we have now carried out electrophysiological experiments (new Fig. 2C). For a detailed description please see the response to the first comment of reviewer 1.

      Line 189: Are the authors making conclusions based on intensity comparison of red mEos4b and mRFP? The title of this section implies that the red form of mEos was compared to mRFP(?) But mEos converts from green to red only partially. Was the probability for conversion taken into account at this point? Please clarify which version of mEos was compared to mRFP._

      In line 189 (now 218) we compared the intensities of mRFP-gephyrin with those of converted (red) mEos4b in SRRF / PALM super-resolution images of the synapses (Fig. 2D). Since the absolute intensities are altered by the process of image reconstruction, the probability that mEos4b is photoconverted does not have to be taken into account. The constant ratio of the SRRF and PALM image intensities confirms the data in Fig. 1D showing that GlyR and gephyrin amounts are highly correlated throughout the spinal cord (with the exception of the superficial layers of the dorsal horn). We have clarified in the text that this analysis was carried out on reconstructed SRRF images of mRFP-gephyrin and PALM images of mEos4, line 202.

      Line 192: Please clarify how the density threshold was calculated/determined? This is important for the replication of the experiments, and it also has implications for the calculated probability of detection of mEos4b. I am not aware that this probability was calculated before for mEos4b and therefore other researchers may decide to rely on the value calculated here.

      We have now clarified in more detail how the probability of detection was calculated (new Supplementary Fig. S7 legend).

      In Fig. 2 Gephyrin clusters look consistently smaller than GlyR clusters, which is inconsistent with the published work. I assume that the difference in size is a consequence of different image reconstruction methods(?) However, I would assume that SRRF would have lower resolution than your PALM measurements and that would result in wider Gephyrin clusters. Could you please explain this discrepancy? Also, could you provide an estimate for the image resolution in SRRF and PALM techniques? For SMLM, localization precision would suffice.

      We have provided an estimate of the resolution of the two techniques using Fourier ring correlation, which gave 46 nm for SRRF and 21 nm for PALM. Additionally we have precised the discrepancy between reconstruction methods, page 6, lines 194-200 “The spatial resolution was estimated using Fourier ring correlation (FRC), which measures the similarity of two images as a function of spatial frequency by comparing the odd and even frames of the raw image sequence. According to this analysis, the spatial resolution of SRRF was 46 nm and that of PALM 21 nm. It should be noted that the synaptic puncta in the SRRF images appear somewhat smaller and brighter due to differences in the reconstruction methods that result in differences in the dynamic intensity range.”

      Why is the data in Fig. 5D and E represented as Detections/Synapse instead of GlyRs/Synapse? Could you please re-plot this so that a comparison with Fig. 2H and I is straightforward?

      We have converted the detections to receptor copy numbers as requested (Fig. 5D,E).

      Figure S5C: for P=0.5, 2=0.25. Please correct. Also, I assume that the second graph is what would be observed experimentally for dimers and P=0.5. Please clarify in the figure caption.

      This was a mistake and has been corrected. We have also clarified which parts of the calculations are theoretical and which values were derived from our experimental data. We have provided a more detailed description in the figure legend of Supplementary Fig. S7.

      Line 606: Please provide a complete derivation of this formula.

      We have provided a full derivation of this formula (new Fig. S7C).

      Significance:

      The work described here seem to be a natural progression of a publication by Patrizio et al., 2017 that came out from the same laboratory. This study uses advanced methodologies in the imaging space to visualise and characterise Glycinergic synapses in spinal cord tissue. The experiments described here are technically demanding as evidenced by the relatively small number of publications describing super-resolution measurements in tissue samples. Even more rare are studies that attempt to do single protein counting in neuronal culture and tissue sections. Therefore, I believe that this work brings significant technical advancement in the field of super-resolution and corelative microscopy. The findings are also highly significant for all fields of neuroscience in which the structure of inhibitory Glycinergic synapse is relevant, ranging from the fundamental understanding of inhibitory synapse function to pathologies involving Glycinergic signalling._

      I have substantial experience in different microscopy methods, including quantitative super-resolution microscopy based on single molecule counting. My background also covers the structure and function of GABAA and Glycine receptors using electrophysiology. I am familiar with the methods used in electron microscopy and the process of creating KI mouse lines, however I don't have hands-on experience in these fields._

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #4

      Evidence, reproducibility and clarity

      Summary:

      The authors used a correlative approach and combined photo-activated localization microscopy with electron microscopy to characterise Glycinergic synapses in spinal cord tissue. Some of the major findings are:

      • The receptor-scaffold occupancy and packing densities of glycinergic synapses in different regions of the spinal cord are the same.
      • Gephyrin clusters in the spinal cord are composed of sub-domains that shape the GlyR clusters.
      • Ventral horn synapses are generally larger, more complex (containing a number of gaps) and contain more GlyRs.<br> -In a mouse model of Hyperekplexia, the number of GlyRs is reduced resulting in smaller synapses in the ventral spinal cord.

      Major comments:

      • Are the key conclusions convincing? Yes
      • Should the authors qualify some of their claims as preliminary or speculative, or remove them altogether? No
      • Would additional experiments be essential to support the claims of the paper? Request additional experiments only where necessary for the paper as it is, and do not ask authors to open new lines of experimentation. No
      • Are the suggested experiments realistic in terms of time and resources? It would help if you could add an estimated cost and time investment for substantial experiments. N/A
      • Are the data and the methods presented in such a way that they can be reproduced? Yes
      • Are the experiments adequately replicated and statistical analysis adequate? Yes

      Minor comments:

      • Specific experimental issues that are easily addressable. Please see below
      • Are prior studies referenced appropriately? Yes
      • Are the text and figures clear and accurate? Yes
      • Do you have suggestions that would help the authors improve the presentation of their data and conclusions? Please see below.
      1. As the authors pointed out, fusing mEos to the extrasynaptic terminal of GlyRb has been difficult and therefore this construct would benefit the larger scientific community.<br> Fig 1C is a nice imaging control for expression efficiency, however, it is in stark contrast with the lack of functional control. Do authors have any electrophysiological evidence showing that the insertion of mEos4b doesn't modulate channel function? I would assume that the construct would be tested in cell lines before the KI mouse line was created. Was any functional analysis done? If yes, it would be very useful to show it. I do appreciate that the authors used a standard insertion between the 4th and 5th AA in the extracellular domain, which in most cases does not abolish channel function. Given the lack of an obvious phenotype in the KI mouse model, I believe that this is also the case here. However, I disagree with the statement in lines 120-121: "the presence of the N-terminal fluorophore does not affect receptor expression and function." I believe that if there are no electrophysiological measurements of GlyR function, this statement remains speculative. As the authors pointed out in their previous publication: "receptor function and gephyrin binding are not independent properties. Instead, we think that conformational changes triggered at extracellular or intracellular protein domains have downstream consequences on channel opening as well as receptor clustering." In line with this, my concern is that the modulation of channel function by mEos4b could result in an altered cluster size at synapses. There is a large body of literature showing that just one missense mutation in the extracellular domain of ion channel subunits can lead to synaptopathies because the channel function gets modulated, and there is an abundance of similar examples involving mutations of GlyR and GABAAR subunits. In my view, comparing the function of GlyRs incorporating wt-GlyRb and mEos4b-GlyRb subunits is important for the correct interpretation of the main findings of this work and would strengthen the publications.
      2. Line 189: Are the authors making conclusions based on intensity comparison of red mEos4b and mRFP?<br> The title of this section implies that the red form of mEos was compared to mRFP(?) But mEos converts from green to red only partially. Was the probability for conversion taken into account at this point? Please clarify which version of mEos was compared to mRFP.
      3. Line 192: Please clarify how the density threshold was calculated/determined? This is important for the replication of the experiments, and it also has implications for the calculated probability of detection of mEos4b. I am not aware that this probability was calculated before for mEos4b and therefore other researchers may decide to rely on the value calculated here.
      4. In Fig. 2 Gephyrin clusters look consistently smaller than GlyR clusters, which is inconsistent with the published work. I assume that the difference in size is a consequence of different image reconstruction methods(?) However, I would assume that SRRF would have lower resolution than your PALM measurements and that would result in wider Gephyrin clusters. Could you please explain this discrepancy? Also, could you provide an estimate for the image resolution in SRRF and PALM techniques? For SMLM, localization precision would suffice.
      5. Why is the data in Fig. 5D and E represented as Detections/Synapse instead of GlyRs/Synapse? Could you please re-plot this so that a comparison with Fig. 2H and I is straightforward?
      6. Figure S5C: for P=0.5, 2=0.25. Please correct. Also, I assume that the second graph is what would be observed experimentally for dimers and P=0.5. Please clarify in the figure caption.
      7. Line 606: Please provide a complete derivation of this formula.

      Significance

      The work described here seem to be a natural progression of a publication by Patrizio et al., 2017 that came out from the same laboratory. This study uses advanced methodologies in the imaging space to visualise and characterise Glycinergic synapses in spinal cord tissue. The experiments described here are technically demanding as evidenced by the relatively small number of publications describing super-resolution measurements in tissue samples. Even more rare are studies that attempt to do single protein counting in neuronal culture and tissue sections. Therefore, I believe that this work brings significant technical advancement in the field of super-resolution and corelative microscopy. The findings are also highly significant for all fields of neuroscience in which the structure of inhibitory Glycinergic synapse is relevant, ranging from the fundamental understanding of inhibitory synapse function to pathologies involving Glycinergic signalling.

      I have substantial experience in different microscopy methods, including quantitative super-resolution microscopy based on single molecule counting. My background also covers the structure and function of GABAA and Glycine receptors using electrophysiology. I am familiar with the methods used in electron microscopy and the process of creating KI mouse lines, however I don't have hands-on experience in these fields.

    1. And as the delta variant continues to spread around the country, that uncertainty and its effects on sleep may not have abated. Some people have just gotten used to disrupted cycles and 3 am anxiety spirals; it’s how life is now.

      I can relate to this paragraph because I got so used to sleeping late and waking up whenever that now I don't even get tired and I go to sleep really late. Also our health was really getting messed up. Physically and mentally

      In my opinion I think that it has really affected all of us and our mental health itself has changed through out this past year or so. I think from the beginning of the pandemic we were all kind of panicking, there was so much chaos and so many deaths that it stressed all of us out.

    1. 20:57 - 29:20

      "I'm Jesse. And this is Pascal. And we're here representing Friends of Light tonight. As you already heard, Friends of Light is a worker owned fashion company. We operate within the fashion industry, but we also operate very far outside of the fashion industry - we come from a background of working in fashion and at some point decided that it needed a radical change, and so we started weaving jackets based on our values as opposed to based on economic decisions - and Pascal is going to talk more about our values, but I'm going to give you a background on how we decided to form a worker cooperative. Uhm Pastel actually has been looking into worker cooperatives for much longer than I have, and I joined her in about 2012 when we were participating in a sewing circle called Work circles and, there was on any given week, there would be anywhere between 8 to 30 participants and we sat around a table. We made decisions collectively, we made every single decision together about making one quilt. And that was where the stitches were gonna be. What color it's going to be, what fabric we were using, what were the shapes, and every single person had a part in that and then we start stitching and we'd talk about what is a worker cooperative. What are the different values in a worker cooperative? How do you make a worker cooperative work? And so that was very much a learning experience for all of us in about 2015 - we, Pascal, myself and two other members, Nadia and May. We decided to take all of this that we've learned and actually put it into the real world and still sort of in a project based way make garments together, make woven jackets as a worker cooperative. We then took that and had a sales event just to present our project to the world to sort of inspire people, to show what we've been working on. We were wildly surprised that we got ten orders in one night, so we needed to incorporate, make this a real business, and we've been a real business since 2016, so we're still fairly new. But it's been three years of working as a worker cooperative, basing all of our decisions on the things that we've learned about worker cooperatives and doing our best to work in that fashion, we also, I will mention that we, one year ago, in January of 2018, we participated in the Green Worker Cooperative, which is based in the Bronx, which, if any, of you are interested in building your own cooperative - I highly recommend it. It was every Monday night, 3 hours a night for six months and we - it was like going back School, but to make a business and to learn how to make a business and specifically how to learn how to make a green Worker-Cooperative business, which is amazing. So that's - that's that background and Pascal is going to share with you a little more about our company and our values." "Thank you Jesse. In fashion, it's quite unusual that clothes are being produced in the West nowadays. And we have quite an extreme product, and it started actually with the desire to work with farms upstate who are producing fiber. But they're not really connected to any design practices in New York City. It's a very separate community. So we did research and found and looked for different farmers and we decided to work with Sarah of Buckwheat Bridge Angoras. She has an amazing practice as a farmer and her goats and sheep she keeps very well and she has a very high quality wool. And we are weaving jackets and this is together with her. She also had a mill on her property. We developed yarns. And just the first series was a series of five yarns that we developed with her, and all the natural colors of the - and we started experimenting. In the beginning it was kind of after the work circles we really wanted to develop an economic activity to practice being a worker-cooperative for real and not just kind of doing it as a project. So these were the first experiments into if we could weave a garment to form. And there's different techniques involved. In the meantime, we are working with other farmers as well. We're working with linen farmers, and we've done a lot of research in different materials, so we work very closely with the source of our materials, and that's the only thing we want to do. We work with hand spinners at the moment, it's no longer being produced on machines, so it's an intense product. It's takes us about 160 hours to make one jacket. And they've been selling really well, which was a surprise to us because the price point is very high, we're now at $6000 a jacket. And that's been really interesting, that people do value the story that's connected. And also all our clients. Actually everyone in our value chain is - we're really good friends with them, and we grow to become friends because we also make everything to size for each client. And one could think that we're kind of exclusive because the jackets are so expensive. But we also do a lot of - we do workshops and we do talks like this. We educate people about worker cooperatives and what it means to - And also what it means to value artisan work in a Western context and to be able to do that kind of work. And that's what we've been advocating, like a lot, about because a lot of people here push prices down.To make artisan work and even local local fiber products possible. But we know it's not possible with the... In September we actually did a big project to kind of save one of the farm - one of the forms we work with because they couldn't sustain themselves. Not - especially not through our jackets. But we decided that we would do a project around making blankets and we invited other design studios in New York to participate in that project. So instead of kind of letting the farm disappear, we decided to develop a product to support them so it's also supporting - our objective is actually to create a flourishing local fiber and textile kind of structure. And that has been really interesting because the costs of the wool that went into the blankets was $1000, just raw material and that it doesn't give her any profit, actually. And that's, I think one of the biggest things that we are kind of trying to advocate and support, is how do we make local production possible again against a fair wage. And this is an extreme product, I know, but it has been very surprising to us that people do gravitate towards the story. They wanna participate in it by buying the jackets. We make our own materials, own looms, and these are a few of the jacket. And we do private sales events. We don't sign shops or anything like that. We make everything to the size of the customer, so there's a lot of personal attention that goes in every part of our value chain. Thank you."

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      1. General Statements [optional]

      We thank the reviewers for their critical review of our manuscript. We are excited to see that the reviewers agree that we have presented high-quality data that advances the centrosome field and is worthy of publication following revision. The authors also agree with the reviewers that the data presentation requires improvement, that some experiments require additional replicates with robust statistical analyses and that a model or summary would help clarify the differences between previously published results and ours. We will address all these concerns in the revised version of our manuscript. The reviewer comments in their entirety can be found below in italic followed by our response in bold.

      Considering that the manuscript was very well received we believe it makes a strong candidate for publication in eLife. In terms of editors at eLife, we believe that Anna Akhmanova and Jeremy Reiter would be very well suited to handle this manuscript.

      We hope that you will concur with us that the revision plan detailed below adequately addresses the reviewers’ comments.

      2. Description of the planned revisions

      Reviewer 1, Major points

        • Previous data suggested that an important role of TRIM37 was to limit accumulation of CEP192 levels, yet here CEP192 levels appeared unchanged in TRIM37 knockout cells that stably express wild-type or RING domain mutant TRIM37. However, in agreement with previous work, transient expression of TRIM37 reduced CEP192 levels along with those of other PCM and centriole components in an E3-dependent manner. These data are rather confusing in light of the literature, and the current report does not really deal with these discrepancies but to me they suggest that high levels of TRIM37 can target multiple centrosome components for degradation, but this may be an experimental artefact.* We agree that acutely overexpressed TRIM37 results in decreased CEP192 levels and is consistent with published results. We also provide evidence that CEP192 levels are not correspondingly increased in the absence of TRIM37, nor are they decreased in a cell line that stably overexpresses FLAG-BirA TRIM37. This suggests that the decreased CEP192 (and PCNT and CEP120) after acute overexpression of TRIM37 might be short-lived or a consequence of overexpression. We will discuss this possibility more clearly in the revised mansucript. In addition, we will perform Western blots for TRIM37 in wild type cells, cells stably expressing FLAG-BirA TRIM37 and cells induced to express TRIM37-3xFLAG to more directly compare the amount of TRIM37 present in these cell lines.
      • The choice of cells for particular experiments is not always stated or explained. For instance, in Figure 3A: Trim37 KO pool used while in Figure 3B TRIM37 single KO. These are then combined with both transient and stable expression of TRIM37 mutants.*

      We apologize for this and will clarify the choice of cell lines in the results section. Importantly, because some of our results challenge previously published reports, we performed critical experiments using multiple cell lines. For example, we show that centrinone B-induced growth arrest is independent of TRIM37 E3 ligase activity using a single RPE-1 TRIM37-/- clone, an RPE-1 TRIM37-/- pool and an A375 TRIM37-/- pool. We feel this is a highlight of our work and this new data will be included in the revised version of the manuscript and will be emphasized.

      • Two different concentrations (200 nM and 500 nM) of centrinone were used to compare responses of too many or no centrosomes in RPE1 and A375 . While these concentrations result in centrosome amplification (200 nM) and loss (500 nM) in RPE1 cells, the phenotypes seem much less clear-cut in A375 cells. At 200nM 70% of cells have 0 or 1 centrioles (~35% each category) and only about 15% have centrosome amplification, whereas centrosome amplification occurs in 30% of RPE1 with 0-1 centrioles seen in fewer than 10% (Figure 4 - figure supplement 1H). Hence the different outcomes of centrinone treatment makes conclusions about cell-type specific responses difficult. This difference may be due to differences in drug uptake/efflux, PLK4 activity or in expression of other components of these pathways. In fact, 167nM centrinone B in A375 cells would have been a much closer match to the 200nM treatment of RPE-1. These points should be discussed as they impact the conclusions.*

      The reviewer rightly points out that the response to centrinone appears to differ between cell types, as shown previously (Meitinger et al., 2020 and Yeow et al., 2020), and that this difference may impact our conclusions. Although we don’t think that the major conclusions drawn will change, we will discuss these caveats within the results and discussion of the manuscript.

      • I find the different outcomes of stable versus acute expression of TRIM37 ligase mutant confusing. Here, stable expression of TRIM37 ligase mutant increases mitotic length compared to that of TRIM37 wild-type, which contradicts a recent report by (Meitinger et al. 2021). What could be the potential reason for these differences? *

      It is unclear why we obtain results that differ from Meitinger et al. We are using similar cell lines (RPE-1 hTert vs. RPE-1 hTert Cas9) with similar TRIM37 constructs (TRIM37-3xFLAG) that are induced in similar ways (both are doxycycline inducible but using different systems). For our experiment, we used a single TRIM37 KO clone. As an independent validation, we will repeat this experiment using our TRIM37 KO pools in both RPE-1 and A375 cells and discuss these results and implications.

      What could be the mechanism for TRIM37 action in regulating spindle assembly/mitotic duration and cell proliferation upon centrosome loss? How do those acentrosomal MTOCs form that decrease mitotic duration and promote proliferation?

      These are insightful questions that we feel lie at the heart of TRIM37 function. Current models posit that in the absence of TRIM37, PLK4 condensates form and are required to nucleate ectoptic accumulations of PCM components (ex. CEP192) that facilitate mitosis (Meitinger et al. 2020). A number of our findings are not consistent with this model. First, PLK4 is detected in the Cenpas/condensates only using a single antibody (Wong et al., 2015) (two other antibodies have been reported to be used (Sillibourne et al., 2010, Moyer et al., 2015) and we have used another (Millipore MABC544 clone 6H5) - none of these three detect PLK4 at the condensates). Additionally, the PLK4 signal observed is not sensitive to PLK4 siRNA (Balestraet al. 2021, Figure 4 – figure supplement 1I). In our manuscript we also provide evidence that overexpressed PLK4-3xFLAG cannot be detected (using PLK4 or FLAG antibodies) at these strucures. Moreover, our experiments using TRIM37 mutants show that Cenpas formation and ectopic PCM assembly are mechanistically distinct; Cenpas are not resolved after expression of TRIM37 C18R, yet ectopic PCM structures are suppressed (Figure 5E and G). Our data do, however, suggest that the ability to form ectopic PCM structures is inversely correlated to growth arrest activity (i.e. cells that form ectopic PCM fail to arrest). How these structures form and how they affect growth arrest are still critical, open questions. We will discuss these possibilities further in the revised manuscript.

      Do the authors find a difference in the % of cells expressing TRIM37 mutants upon stable or acute expression? This part needs a better summary, and again a table would help. I also wonder about protein expression levels; wild-type FB-TRIM37 seems to be expressed at much lower levels than the mutants in Figure 5B.

      The differences in overall abundance are not due to heterogenous expression within the population. The TRIM37 mutants are expressed in all cells after stable and acute expression. We will provide quantification of immunofluorescence images and statistics to show this. TRIM37 mediates its own degradation in an E3-dependent manner (Meitinger et al. 2021, Figure 3f). Our results are consistent with this as the TRIM37 C18R and TRIM37 __DRING mutants have a higher overall abundance compared to TRIM37 or TRIM37 D__505-709. These experiments are ongoing and we will discuss this further in the revised manuscript and provide a summary table.

      • Other means of centrosome depletion (Cenpj, SAS6 etc) would have been useful to include in the manuscript in support of E3 ligase dependent and independent roles of TRIM37. It is not essential to perform these experiment but if data are available, including these would improve the paper. *

      We will generate new data using a double TRIM37 KO, SASS6 KO line to address TRIM37 ligase-dependent and -independent functions.

      • The authors show that TRIM37 regulates PLK4 phosphorylation and that this modification could only be observed in HEK293T and not in RPE1. Why would there be a difference between HEK293 and RPE1?*

      We will address this by surveying a panel of cell lines to determine if there any cell type dependent differences in TRIM37 modification. Any potential differences will be addressed in the discussion.

      • Statistical analysis for graphs should be included. Figure 5 is ok but graphs in Figures 3, 4, 6, 7 would benefit.*

      This point is well taken. In the revised manuscript, we will ensure that all experiments are performed in biological triplicate and that proper statistical analyses are included to support our conclusions.

      • The authors characterise TRIM37 localisation. They detect it at centrosomes (as shown by Yeow et al 2021) and more specifically at the PCM, but apparently the signal is not present in all cells. They should also provide a quantification of the % of cells with centrosomal TRIM37 signal and compare this to cells expressing Flag-tagged Trim37. The specificity of the antibody signal using TRIM37-/- should be confirmed. *

      We will perform immunofluorescence experiments using wild type and TRIM37-/- cells to demonstrate the specificity of the antibody signal. We will also provide a more detailed analysis regarding TRIM37 localization noting 1) the number of cells with centrosomal TRIM37 2) cell cycle correlation with centrosomal TRIM37 and 3) a comparison with FLAG-BirA tagged TRIM37.

      Reviewer 1, Minor points

      1.Page 3: "A recent screen for mediators of supernumerary centrosome-induced arrest identified PIDDosome/p53 and placed the distal appendage protein ANKRD26 within this pathway [31]". It appears that the reference for Burigotto et al. is missing.

      This reference will be inserted.

      2.Page 6: The authors state that: TP53BP1, USP28 and CDKN1A are also suppressors in the Nutlin-3a screen and suggest that they act in a general p53 pathway. However Meitinger et al (2016) showed that depletion of TP53BP1 or USP28 did not affect the upregulation of p53 and p21 upon Mdm2 inhibition.

      Our data is consistent with previous reports that TP53BP1 and USP28 are required for cell arrest after Nutlin-3a treatment (Cuella-Martin R et al. 2016). We will discuss possible explanations for the results observed by Meitinger et al.

      3.Page 9: "First, we performed live cell imaging to measure mitotic length in cells grown in centrinone". For consistency the authors should say centrinone B here as wellI

      We will change the text to indicate using centrinone B.

      4.Page 9: "Cells lacking TRIM37 suppressed the growth arrest from 150 to 500 nM centrinone B in RPE-1 and 167 to 500 nM in A375 cells". The growth data for the A375 cells seem to be missing from the figures.

      We refer to Figure 4D and Figure 4 – figure supplement 1G that contain the RPE-1 and A375 growth data, respectively. We will modify the text to more clearly refer to the data.

      5.Page 10: "Our results confirmed that PLK4 and TRIM37 form a complex in RPE-1 cells (Figure 3G)" It appears the authors referred to the wrong figure, it should be Figure 4B.

      Our apologies. The correct figure reference will be used.

      6.Figure 1C: The nuclear p53 signal is not apparent with 500 nM centrinone B in the exemplary cells. Did the authors use thresholding to quantify p53/p21 positive cells?

      The p53 staining in centrinone-treated cells is somewhat variable. To quantify the data, we used automated image analysis and set a cut off based on p53 intensity in DMSO-treated cells to indicate p53-positive cells. To improve the figure we will repeat the experiment and use a lower magnification image to show a more representative field of cells stained for p53. The quantification pipeline will be better explained in the methods section.

      7.Figure 4D and Figure 4 - Figure supplement 1G: The graph is misleading and should not be presented as a continuous line.

      We are sorry that the reviewer finds the graph misleading. We will change the way this data is presented to make it easier to understand and to facilitate indicating statistical differences. Instead of a scatter plot of all the data, we will present the data as individual boxplots at each centrinone B concentration with statistical differences indicated. We hope this will address any confusion regarding these data.

      8.Figure 5A and C: A direct and statistical comparison mitotic timing upon expression different Trim37 mutants to wildtype and trim37-/- cells is missing

      In Figure 5A we compare RPE-1 WT to TRIM37-/- at each centrinone B concentration and within each line we compare each centrinone B concentration to DMSO. Perhaps we do not understand the reviewer’s concern here, but we do not think any comparisons are missing from this panel. In Figure 5C, we compare the mitotic lengths between cell lines expressing TRIM37 WT or TRIM37 C18R since we focus on the requirement for the E3 ligase activity of TRIM37. For this experiment we did not include a wild-type control, but we will perform statistical analyses between control cells expressing FLAG-BirA and those expressing FB-TRIM37 WT or FB-TRIM37 C18R. We hope this addresses this concern.

      9.Figure 6B: A loading control/Ponceau staining is missing as well as the quantification of protein levels

      This experiment will be repeated for proper quantification and we will include a loading control for our representative results.

      10.Figure 6D: It is unclear if the centrosomal signal intensity was quantified in interphase or mitotic cells

      The centrosomal signal was quantified in mitotic cells only. This results and figure legend will be updated to more clearly indicate this.

      11.Figure 7C: A loading control/Ponceau staining is missing

      The experiment will be repeated and a sample will be taken prior to immunoprecipitation to indicate the input amounts for each sample.

      12.Figure 2 - figure supplement 2F and G: It would help if the authors could highlight the cell line, e.g. RPE-1 (F) or A375 (G) in the venn diagrams.

      In Figure 2 – figure supplement 2G we highlight the genes found in RPE-1 and A375 screens only in the overlap of the Venn diagram using font colour. We will colour code the hits from each cell line in panels (F) and (G). We thank the reviewer for this suggestion.

      13.Figure 4 - figure supplement 1E: it appears that the BirA antibody gives only an unspecific signal. It would be useful to show if the different TRIM37 variants are able to localise to the centrosomes. Furthermore it appears that centrosomes are missing in the C18R and 505-709 variants. It would be useful if the authors quantify centrosome numbers upon expression of different Trim37 variants as shown in Figure 4 - figure supplement 1. To make the identification of the cell easier it would help to include a DNA signal or indicate the outline of the cell.

      The anti-BirA antibody does give a slightly diffuse signal, although we disagree that it is unspecific considering that the BirA signal is only observed in cells expressing FLAG-BirA alone or BirA fusion proteins.

      We agree with this reviewer that we did not make any statements about the centrosomal localization of the TRIM37 mutants. We will re-analyze our images to quantify relative centrosomal localization of these proteins. The images as displayed in this Figure panel appear to be somewhat confusing to the reviewer. In terms of scale, only a small portion of the cell surrounding the centrosome is shown, therefore a nuclear or cell outline cannot be displayed on these images. In each image a centrosome is present, even in the C18R and 505-709 samples. We will show images of entire cells with insets to highlight the region surrounding the centrosome.

      14.The generation of stable and dox-inducible cell lines is missing in the material and methods

      We apologize for this omission. This information will be added.

      Reviewer 2, Major points

        • The centrosomal localization of endogenous TRIM37 should be validated by comparing control and knockout/knockdown cells.* We will perform these experiments as outlined in response to Reviewer 1, Major point 8.
      • Some of the quantifications are derived from only two experiments and in many cases no statistical testing was done. The authors should test the observed effects and add extra replicates to make the data more robust, where required. *

      We will ensure experiments are performed in biological triplicate and that appropriate statistical analyses are performed (see comment to Reviewer 1, Major point 7)

      • Fig. 5 supplements: panels showing effects on marker proteins in cells by IF lack quantification of the claimed effects. Without providing some type of quantifications for key findings, it is unclear how strong or penetrant the effects are.*

      Quantification and statistical testing will be performed for these experiments.

      Reviewer 2, Minor points

      I would suggest a final, summarizing schematic that illustrates the main findings in a cartoon/flow chart manner.

      We will improve the discussion of our main findings as well as provide a model/table of comparisons to improve the clarity of our manuscript.

        • Please revise incorrect abstract sentence: "We identify TRIM37 as a key mediator of growth arrest when PLK4 activity is partially or fully inhibited but is not required for growth arrest triggered by supernumerary centrosomes." __In our screens, we find that TRIM37 is required for growth arrest after treating cells with 200 and 500 nM centrinone B. Treatment of cells with 200 nM centrinone B causes centriole overduplication and our initial hypothesis was that centriole overduplication alone is inducing growth arrest. To test this in a parallel manner, we also overexpressed PLK4 to induce centriole overduplication. Surprisingly, but consistent with recently published results (Evans et al*., 2020), TRIM37 was not required for growth arrest after PLK4 overexpression. Thus, TRIM37 is required for growth arrest after 200 nM centrinone treatment, but not PLK4 overexpression, yet both of these conditions induce centriole overduplication. This concept will be highlighted, discussed and clarified in the text. We will change the abstract sentence to ‘We identify TRIM37 as a key mediator of growth arrest when PLK4 activity is partially or fully inhibited, but it is not required for growth arrest after PLK4 overexpression’__.

      Please also see similar comment to Reviewer 3, Major point 1.

      • In various figures and supplements showing centrosome and condensates/Cenpas, these are very difficult to distinguish due to their small size. I suggest to magnify regions of interest and/or add arrowheads in different colors marking the specific structures.*

      This comment is similar to Reviewer 1, Minor point 13. We will use coloured arrowheads to indicate different structures. Where possible, we will use magnified regions to improve clarity.

      • Fig. 2A: What is the purpose of the schematics on the right of panel A? The labels in the graph are unreadable and the network diagram without any labels is also not very useful. This could be removed. *

      The schematics on the right indicate a ‘generic analysis’ using the NGS sequencing data. We agree it is not essential and it will be removed.

      • Fig. 2B: The network presentation is not very easy to read. What are the functional groups/pathways here? The clusters should be labeled accordingly. What is the meaning of the different sizes of the circles? Maybe key interactions (e.g. TRIM37) could be indicated in a different color shade to highlight these? *

      In our figure we tried to highlight 1) the connectivity among screening conditions and 2) complexes that were identified by the screens. In our figure, each node (other than the six hub nodes that denote a screen condition) represents a hit from the screens. Thus, the nodes are connected by edges only to the screening conditions, not to each other. In this scenario, highlighting TRIM37 ‘interactions’ would only highlight the screening conditions for which TRIM37 was a hit (200 nM RPE-1, 500 nM RPE-1, 200 nM A375, 500 nM A375). We could try to overlay functional enrichment data on the graph, but this data is presented separately in Figure 2 – figure supplement A-D. The large circles represent hits found in previous screens and is indicated in the legend. Given the challenges of this figure we will modify it to improve its clarity.

      Reviewer 3, Major points

        • The presentation throughout the manuscript sometimes made it difficult to follow exactly what the authors meant when they referred to the various doses of Centrinone used in their experiments-often using the terms "low" or "high" without specifying exactly what they mean. In Figure 1A, for example, they present a growth inhibition curve using a log10 scale of Centrinone concentration, and they conclude that growth was inhibited "at concentrations above 150nM, with full inhibition observed at concentrations greater than 200nM". I presume this is just sloppy language, as it appears that growth is significantly inhibited at 150nM and full growth inhibition is achieved at 200nM. However, in Figure 4D, the authors show another growth inhibition curve (this time presented on a linear scale) where significant growth inhibition is seen well below 100nM and full inhibition appears to be achieved at ~125nM. The discrepancy between these experiments is not noted, nor any reason for it explained. We agree with the reviewers and apologize for using ‘low’ and ‘high’ as they are ambiguous. We will ensure that we refer specifically to each concentration of centrinone B used (ex. 50 nM, 150 nM etc.). The comparison between Figure 1A and Figure 4D is not straightforward. The experiments presented were performed approximately 6 years apart and in slightly different ways. As reviewer 3 indicates, Figure 1A is presented in a log scale; this makes it difficult for the reader to determine the exact concentrations of centrinone B used. For this panel, we used, 0 (DMSO), 10, 30, 75, 165, 200 and 500 nM centrinone B. For Figure 4D, we used 0, 50, 125, 150, 167, 200 and 500 nM. The only point that might be anomalous is 75 nM in Figure 1A. We do see approximately 25% inhibition using 50 nM centrinone B in Figure 4D, but no inhibition using 75 nM in Figure 1A. We can offer two explanations for this discrepancy. First, we noticed small deviations in the potency of centrinone B batches. Second, for Figure 1A, cells were assayed using a passaging assay where they are continuously plated, counted and re-seeded. Cells in Figure 4D were assayed using a clonogenic assay where cells are plated at low density and allowed to grow over the course of approximately two weeks. It is possible that a combination of these factors led to the highlighted discrepancy. We feel that the discrepancy is a minor one and we propose the following as a solution. We will present the growth data in Figure 1A as a scatter / box plot using only 200 and 500 nM centrinone B since these are the drug concentrations we use for the screen conditions and the key conclusions are derived only from these concentrations (i.e. both concentrations result in p53-dependent growth arrest where centrioles are overduplicated after 200 nM centrinone B, while centrioles are lost after treatment with 500 nM). We hope that this explanation and changes satisfy the reviewers.

      While discrepancies such as this may seem trivial, they make it hard to interpret some of the authors conclusions. For example, in their initial screen, the "low" dose of Centrinone (200nM) leads to centriole amplification and genes that block centriole duplication or PIDDosome function (which normally signals the presence of extra centrioles) are required for the growth arrest triggered by this concentration of the drug (Figure 1B). To me, this suggests that centriole amplification is required for this growth arrest at 200nM. However, when the authors test a more graded series of concentrations they conclude "excess centrioles might not be the trigger for this arrest at low Centrinone B concentrations". I assume they are using "low" here to indicate concentrations at or below 150nM (even though they use low to mean 200nM in their initial screen)? In the Discussion, they state that TRIM37 is "required for the growth arrest in response to partially or fully inhibited PLK4, but this activity was independent of the presence of excess centrioles". Again, it is not clear to which experiments they are referring when they talk about "partially" or "fully" inhibited PLK4, but, if this is correct, then why are genes required for centriole duplication and PIDDosome function identified in their initial screen as being required for the growth arrest at 200nM but not 500nM? Do they consider 200nM to be fully inhibiting PLK4? *

      We observed that cells arrested after treatment with either 200 or 500 nM centrinone B. Additionally, we observed centriole over-duplication after 200 nM but centriole loss at 500 nM. Our initial hypothesis was therefore that either centriole overduplication or loss resulted in growth arrest. Our subsequent results with TRIM37 caused us to question this simple interpretation. To determine if centriole overduplication caused by 200 nM centrinone B triggers growth arrest in this case, we induced centriole overduplication by overexpressing PLK4 and, surprisingly, TRIM37 was not required for growth arrest in these conditions, similar to that observed by __Evans et al., 2020. Thus, we have two conditions where centriole overduplication is observed where the growth arrest in only one condition is dependent on TRIM37. This is an important difference that we will better highlight in our revised manuscript. We will also present a better model and/or table outlining our most salient results. Briefly, it is thought that partially inhibited PLK4 blocks its own auto-phosphorylation and therefore blocks its degradation. The overall abundance of PLK4 therefore increases under these conditions and overduplication occurs. In our hands, we consider PLK4 to be partially inhibited in RPE-1 or A375 cells at any concentrations of centrinone B at 200 nM or lower.__

      Please also see similar comment to Reviewer 2, Minor point 1.

      Presumably it will only require textual changes to address this point, but it is hard to assess the broader significance of the paper until these points are clarified: is the main point of this paper that the cells response to Centrinone treatment is complicated and the role of TRIM37 equally so; or, is there a narrative that leads to a clear hypothesis that can explain these surprising findings?

      We don’t currently have a model that explains all the results we observe with TRIM37. We have data that is consistent with some previously published results and data that challenges some of these recent reports. The current model suggests that TRIM37 E3-dependent remodeling of CEP192 underlies its growth arrest activity after centriole loss. Importantly, we find that TRIM37 supports growth arrest in an E3-ligase-independent manner. We will discuss this further in our revised manuscript, as well as providing additional hypotheses based on our other observations of TRIM37 function.

      • It seems a striking omission that the authors show that p53 and p21 are induced by 200nM and 500nM Centrinone (Figure 1D), but they don't assay these proteins at any concentration lower than this. Perhaps they are saving this data for a subsequent manuscript, but the authors certainly seem to draw conclusions from several experiments they perform at concentrations below 200nM, so they should at least explain why they don't assay p53 and p21 status in these experiments. *

      We apologize for not including this data in the original version of the manuscript. It will be included in the revised version.

      Reviewer 3, Minor points

        • In the abstract the authors claim that the way in which altered centrosome numbers cause a p53-dependent growth arrest is evolutionarily conserved. This is misleading, as it implies that the loss and gain of centrosomes trigger the same arrest (which is probably not correct), and most of the data to date suggests that flies and worms (two popular models for centrosome research) do not have such a growth-arrest pathway.* This is a good point. We will modify this statement to indicate that p53-dependent arrest is confined to mammalian cells: “Altered centrosome numbers cause a p53-dependent growth arrest in both mouse and human cells through mechanisms that are still poorly defined”.

      Reviewer 3, comment in ‘significance’

      I could not discern, however, whether one could draw any broader conclusions than this, in part due to the presentation problems described above. Moreover, in the abstract the authors propose that altering PLK4 activity alone is sufficient to signal growth arrest. This would be an important conclusion, and I presume this refers to the very low dosage Centrinone experiments that trigger growth arrest without altering centrosome numbers and which does not require TRIM37? If so, this arrest is poorly characterised here and will be the subject of a future investigation, so it seems to strange to have this as a major conclusion in the abstract.

      We agree. As reviewer 3 points out, based on our findings we hypothesize that altered PLK4 activity could itself signal growth arrest. As this is not supported experimentally, we will remove it from the abstract and discuss this tantalizing possibility within the discussion.

      3. Description of the revisions that have already been incorporated in the transferred manuscript

      Please insert a point-by-point reply describing the revisions that were already carried out and included in the transferred manuscript. If no revisions have been carried out yet, please leave this section empty.

      Most of the experiments are currently ongoing and the preliminary results we have obtained discussed in the previous section. The revised manuscript will be modified to address each and every concern of the three reviewers as detailed above.

      4. Description of analyses that authors prefer not to carry out

      Please include a point-by-point response explaining why some of the requested data or additional analyses might not be necessary or cannot be provided within the scope of a revision. This can be due to time or resource limitations or in case of disagreement about the necessity of such additional data given the scope of the study. Please leave empty if not applicable.

      We will carry out all the experiments requested by the reviewers as detailed above.

      References

      Balestra FR et al., TRIM37 prevents formation of centriolar protein assemblies by regulating Centrobin. Elife. 2021 Jan 25

      Cuella-Martin R et al., 53BP1 Integrates DNA Repair and p53-Dependent Cell Fate Decisions via Distinct Mechanisms. Mol Cell. 2016 Oct 6;64(1):51-64

      Evans LT et al., ANKRD26 recruits PIDD1 to centriolar distal appendages to activate the PIDDosome following centrosome amplification. EMBO J. 2021 Feb 15;40(4)

      Meitinger F et al., TRIM37 controls cancer-specific vulnerability to PLK4 inhibition. Nature. 2020 Sep;585(7825):440-446

      Moyer TC et al., Binding of STIL to Plk4 activates kinase activity to promote centriole assembly. J Cell Biol. 2015 Jun 22;209(6):863-78

      Sillibourne JE et al.,Autophosphorylation of polo-like kinase 4 and its role in centriole duplication. Mol Biol Cell. 2010 Feb 15;21(4):547-61

      Wong YL et al., Cell biology. Reversible centriole depletion with an inhibitor of Polo-like kinase 4. Science. 2015 Jun 5;348(6239):1155-60

      Yeow ZY et al., Targeting TRIM37-driven centrosome dysfunction in 17q23-amplified breast cancer. Nature. 2020 Sep;585(7825):447-452

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reviewer #1 (Evidence, reproducibility and clarity (Required)): In this paper, the authors use a previously published method SHAP for interpreting deep learning (DL) models (specifically LSTMs) that are trained for predicting physicochemical attributes of peptides (such as antigenicity and collisional cross section). The paper shows that it's capable of identifying some amino acid residues contributing to the prediction results of the DL models. Reviewer #1 (Significance (Required)):

      1. One main ideas of the paper is to use SHAP for determine the significant amino acids at each position (or pairs of AA at each position) contributing to the prediction. Some of the interpretation results are consistent with findings reported previously. This is very nice; however, most of these findings are statistical results such "XX is often present at the second position for the peptides with the positive outcome", which are relatively straightforward and may be derived by using some statistical methods without using DL models. We expect more complex patterns can be discovered in addition to these statistical observations.

      We thank the reviewers for these comments.

      First, to the point about discovering complex patterns, we note that one use of PoSHAP we discuss later in the paper is that PoSHAP enables interposition dependence analysis, which depends on interactions between residues and would not be reflected by summary statistics.

      Second, we agree it is important to show whether PoSHAP produces different residue importance maps than simple statistical summaries of amino acids in each group. The strongest binding peptides, or the highest mobility for the CCS model, were determined by taking only peptides that fall above a linear regression best fit of the ranked experimental values. Statistical summary heatmaps were created and then compared to those from PoSHAP revealing some similarities but also many differences. We added the following text and new figure to the results section to illustrate these points:

      “We wondered whether the patterns revealed by PoSHAP simply reflect the summary statistics for the high-binding or high-CCS subset of peptides. As expected, due to known differences in amino acid abundance across the proteome, the prevalence of amino acids was different across the training data and were also heterogeneous across positions (Figure 5A). To determine the subset of high CCS peptides, peptides were ordered in the training set by their CCS rank and then linear regression was performed to get the average trend line (Figure 5B). Any peptide above that trendline was defined as “high CCS”, and the frequency of amino acids at each position in this set was summarized using a heatmap (Figure 5C). Compared to the statistical amino acid frequencies, PoSHAP suggests a greater importance to arginine at both termini, the importance of tryptophan to increase CCS becomes apparent, and interior glutamic acid contributes less to high CCS than the frequencies would suggest (Figure 5D). The same analysis was repeated for MHC data (Supplementary Figures 9 and 10). This demonstrates that PoSHAP found non-linear relationships between the inputs and the outputs that are not present by simple correlation. “

      Figure 5: Amino acid summary statistics differ from PoSHAP values for the CCS data. (A) Amino acid counts as a function of position for training data. (B) Procedure for picking the ‘top peptides’ with the highest CCS. Linear regression was performed on the peptides ranked by their actual CCS value. Any peptide that fell above the trendline and overall mean were defined as ‘top peptides’. (C) Counts of amino acids for the top peptides were summarized in a heatmap. (D) Mean SHAP values across amino acids and positions from PoSHAP analysis.

      We also added the corresponding supplemental figures showing the same examples for the MAMU A001 model and human MHC models:

      Supplemental Figure 9: Amino acid summary statistics differ from PoSHAP values for the A001 MAMU MHC I data. (A) Amino acid counts as a function of position for training data. (B) Procedure for picking the ‘top peptides’ with the highest CCS. Linear regression was performed on the peptides ranked by their actual CCS value. Any peptide that fell above the trendline and overall mean were defined as ‘top peptides’. (C) Counts of amino acids for the top peptides were summarized in a heatmap. (D) Mean SHAP values across amino acids and positions from PoSHAP analysis. For the MAMU model, the amino acid frequencies of the input peptides show no obvious preference for amino acid position, but some amino acids are over-represented overall. The presence of the “end” token is more likely to be a high binder statistically (C), but the PoSHAP reveals that this end token is not the main determinant of binding (D).

      Supplemental Figure 10: Amino acid summary statistics differ from PoSHAP values for the human A1101 MHC I data. (A) Amino acid counts as a function of position for training data. The distribution of amino acids in this data. (B) Procedure for picking the ‘top peptides’ with the highest CCS. Linear regression was performed on the peptides ranked by their actual CCS value. Any peptide that fell above the trendline and overall mean were defined as ‘top peptides’. (C) Counts of amino acids for the top peptides were summarized in a heatmap. (D) Mean SHAP values across amino acids and positions from PoSHAP analysis. There are clear differences between the summary statistics of top peptides (C) and PoSHAP heatmap (D). For example, the end token is prominent in the summary statistics absent from the PoSHAP interpretation. Also, the preference for S/T/V at position two is tempered according to PoSHAP, but would be determined to be very important by the summary statistics.

      Although the interpreting results reported in the paper largely agree with previous reports, the paper did not explicitly model the frequency of different amino acid in the training data. For instance, if the amino acid 'A' happens to be over-represented in the positive samples of peptides in the training data, the DL model may consider it as to contribute to the positive prediction, which may not be not true. This issue might become more serious when pairs of amino acids are considered. The authors may want to analyze this potential issue in their results.

      We agree and understand the concern for the overrepresentation of amino acids that might skew the training of our models. To determine if this is an issue, as part of the response to the previous question, we looked at the amino acid counts for all peptides (Figure 5A, Supplemental Figures 9A and 10A). In general, the PoSHAP heatmaps (panel Ds in the same figures) look very different from the frequencies of amino acids (panel Cs in the figures), suggesting that amino acid frequencies have not caused any problem.

      Even on a balanced training dataset, the LSTM model to be interpreted may still contain arbitrary bias due to invertible overfitting, which the authors did not discuss. It will be more convincing by training multiple models using different hyper-parameters and optimization algorithms, and then see if similar interpretation results can be reached among most or all of these models.

      We assume the reviewer meant ‘inevitable overfitting’ instead of “invertible overfitting”? If so, the original manuscript did assess overfitting in Figure S4 based on the training and validation loss over training epochs.

      We think the reviewer makes a good point that different models might produce different interpretations, so we trained new models without optimization and with different hyperparameters and with a different optimizer (RMS prop). We see essentially the same PoSHAP interpretations. We added the following text to the results section along with these three new supplemental figures:

      “Given the dependence of the model interpretation results on the model used, the same model architecture trained with different parameters might result in different model interpretation. Given this, models for each of the three tasks mentioned here were retrained with different hyperparameters including the “RMS prop” optimizer. Each model produces similar or better prediction performance compared to the earlier version, and the model interpretation by PoSHAP was almost identical to the previous results in all three cases (Supplementary figures 12, 13, 14). This suggests that the model architecture drives the differences in interpretation, not the model training process.”

      Supplemental Figure 12. PoSHAP Analysis of Mamu A001 With Unoptimized Hyperparameters and RMSprop. A new model for the Mamu data was trained using the same architectures but with different hyperparameters and RMSprop as the optimization algorithm. Loss was plotted as mean squared error compared to the validation data. (A) Similar metrics for MSE, r, and p-values were obtained (B). Similar patterns are also observed for the PoSHAP heatmap of A001. (C) A dependence plot for A001 shows similar patterns to the Adam optimized model, including the positional dependence of proline at position two for high SHAP values of serine and threonine.

      Supplemental Figure 13. PoSHAP Analysis of A:11*01 With Unoptimized Hyperparameters and RMSprop. A new model for the A:11*01 data was trained using the same architectures but with different hyperparameters and RMSprop as the optimization algorithm. Loss was plotted as mean squared error compared to the validation data. (A) Similar metrics for MSE, r, and p-values were obtained (B). Similar patterns are also observed for the PoSHAP heatmap of A:11*01. (C) The SHAP ranges by position plot for A:11*01 shows similar patterns to the Adam optimized model, including the largest range of SHAP values at position two, nine, and ten.

      Supplemental Figure 14. PoSHAP Analysis of CCS With Unoptimized Hyperparameters and RMSprop. A new model for the CCS data was trained using the same architectures but with different hyperparameters and RMSprop as the optimization algorithm. Loss was plotted as mean squared error compared to the validation data. (A) Similar metrics for MSE, r, and p-values were obtained (B). Similar patterns are also observed for the PoSHAP heatmap of CCS. (C) Dependence analysis was performed on the dataset and the combined distance-interaction type bar plot shows similar relationships between the groupings, notably charge repulsion’s split.

      For the dependence analysis, it is not completely clear why the distance is used as the variable, while the relative position of the amino acid residue in the peptide is ignored. For example, if there is a strong interaction between the first and the last residues in the peptide, their distance changes depending on the peptide length. In figure 6, the authors showed strong interactions between amino acid that are 8-9 residues apart may suggest the peptide length actually plays a role here.

      We used distance because as the dependence analysis is a calculation of the difference in means between two distributions of SHAP values, dependent of the amino acid at another position. We believe that the distance between these interacting points is a natural choice and among the most informative metrics to explain these interactions. We agree with the reviewer that peptide length is important to the magnitude of the interactions between amino acids. We also recognize that there may be interactions between the peptide termini that could be obscured by the interactions of the longer peptides. To better explore this possibility, we performed the dependence analysis on each of the different peptide lengths separately (8, 9, or 10 here) to see if this is the case. Unfortunately, given the smaller size of these data subsets, we were unable to show significant differences in the interaction groupings. Though, interestingly enough, the significant interactions for the peptides of length eight only occurred between neighboring amino acids or the termini. This may suggest an interaction between termini that could be explored in the future.

      We added the following text and supplemental figure 11 to the results:

      “Finally, to try to ask if the absolute positions of amino acids in the peptide are relevant for the interaction, the data was split into 8, 9, or 10mers before analysis (Supplemental Figure 11). This revealed that there may be interactions between the termini, but this effect may be difficult to observe because there are significantly fewer 8mers and 9mers in the CCS dataset.”

      Supplemental Figure 11. SHAP Values of Collisional Cross Section by Peptide Length. The impact of peptide length on SHAP values was explored for the CCS data. The dataset was split into peptides of length 8, 9, and 10. All SHAP values were plotted as violin plots. The mean SHAP values were plotted in heatmaps by position and amino acid and standardized. Significant interactions by dependence analysis were plotted in bar charts by distance between interactions.

      To further support our decision to use distance as an interaction metric, we have also now included an additional box plot for Figure 7, demonstrating the interactions between each of the categories combined with distance. We have found that some of the bimodality of the interaction categories are explained by the distance at which they interact. Most strikingly is charge repulsion that decreases CCS when neighboring but increases CCS when the interaction is further.

      We added the following text and updated Figure 7 to the results section:

      “Additionally, there are interesting differences in the interactions of the amino acid among the significant set of interactions (Figure 76B). All significant interactions from the CCS data (Supplemental Table 3, adj. p-value Though it is evident that the mean of each interaction type corresponds to the expected impact those interactions would have on CCS, each of the interaction dependence plots are bimodal, with some interactions increasing CCS and some decreasing it. To dissect this observation further, we combined the two methods of splitting the data to see if the bimodality of interaction types would be resolved by distance (Figure 7C). Though definitive conclusions cannot be made for most categories, likely due to the ever decreasing sample size by splitting, of note is the difference between neighboring charge repulsion and non-neighboring charge repulsion. Neighboring charge repulsion seems to decrease CCS while distant charge repulsion increases CCS (see adjusted p-value from Tukey’s posthoc test in Figure 7D). When distant, charge repulsion makes intuitive sense as the amino acids are forced apart, linearizing the peptide and increasing the surface area. When neighboring, it is possible that the repulsion causes a kink in the linear peptide, decreasing the cross section. Overall, these analyses demonstrate that the models were able to learn fundamental chemical properties of the amino acids and through PoSHAP analysis we were able to uncover them.”*

      Figure 7. Dependence analysis of CCS model. (A) Significant (Bonferroni corr. P-value = charge repulsion, * = other, and δ = polar. For the distance analysis, interactions were grouped into three categories, neighboring (distance = 1), near (distance = 2, 3, 4, 5,6), and far (distance = 7, 8, 9). * indicates significance (ANOVA with Tukey’s post hoc test p-value

      Also, it would be better to show that how the result looks like when applying this method to peptides in the negative samples (e.g., the peptides that are not bound by MHC in the antigenicity prediction experiment). Will the interpreting results also be negative?

      We agree this is an interesting idea. We updated the supplemental figure showing PoSHAP of top peptide subsets to also show PoSHAP of bottom peptide subsets (supplemental figure 8). The results suggest that certain amino acid positions are detrimental to binding, for example D/E at various positions. We updated this section to add:

      “We also performed the same analysis with the eight peptides with the lowest binding predictions (Supplemental Figure 8). These PoSHAP heatmaps are primarily composed of negative SHAP values, suggesting that using this subset reveals amino acids at certain positions that are detrimental to MHC binding.”

      Supplemental Figure 8. Pooled PoSHAP for bottom and top predicted subsets of the data. The mean SHAP values for each amino acid at each position were calculated for the peptides with the bottom (A) or top (B) 0.013% predicted intensity (top 8 peptides) for the “A” Mamu alleles. Due to the small sample size, most of the amino acid positions have a value of zero. The positions with extreme values, however, illustrate important amino acids for prediction. Notably for A001 and A002, aspartic acid and glutamic acid contribute to low prediction along the peptide, suggesting charge may inhibit binding. For the top predictions, phenylalanine or leucine are important at the first position for both A001 and A008. A serine or threonine at position two is important for A001, A002, and A008. All alleles demonstrate the importance of a proline near the middle of the peptide.

      Finally, it will be interesting to see the interpreting results when the method is applied to the DL models on more challenging tasks such as the prediction of tandem mass spectra of peptides. The authors may want to discuss these applications.

      We agree it would be very interesting to apply this method to interpret predictions of tandem mass spectra. In this paper we already demonstrated PoSHAP on three different datasets with three different models, so we feel that adding a fourth model is out of the scope of this work. We do agree that we would like to explore this option in the future. We added this idea to the discussion section:

      “Altogether the advances described herein are likely to find widespread use for interpreting models trained from biological sequences, including models not covered here such as those to predict tandem mass spectra (reviewed in 33).”

      I am primarily interested in algorithmic and statistical problems in genomics and proteomics. We have develop deep learning models for predicting the full tandem mass spectrum of peptides, and am interested model interpretation methods to explain the fragmentation mechanism resulting in non-conventional fragment ions in tandem mass spectra of peptides. I review the paper in collaboration with my Ph.D students, who are developing deep learning models for computational mass spectrometry.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)): **Comments to the Authors** In this study, the authors developed a framework named PoSHAP for the interpretation of neural networks trained on biological sequences. The current manuscript can be stronger if the following issues can be clearly addressed.

      1. As interpreting model with SHAP is a vital part of this manuscript, it would be better to provide descriptions of the underlying principles of SHAP to enable the readers to understand the paper easily.

      We recognize that understanding the principles of SHAP is vital. To better explain SHAP, we have added the following text to the introduction:

      “SHAP is a perturbation-based explanation method where the contribution of an input is calculated by hiding that input and determining the effect on the output. SHAP expands this using the game theoretic approach of Shapely values that ensures the contributions of the inputs plus a calculated baseline sum to the predicted output.”

      It is emphasized in the manuscript that PoSHAP is introduced to interpret neural networks trained on biological sequences. However, it is not clear why the authors choose the Model Agnostic Kernel SHAP, which is based on Linear LIME. Although it can be used for any model, the performance of which may not be optimal. In this regards, perhaps Deep SHAP or Gradient SHAP is more appropriate, both of which are designed for deep learning networks [1]. It would be better to provide some additional experiments on Deep SHAP and this work will be more convincing if the same or similar contribution of each position on each peptide as that of Kernel SHAP. [1] Lundberg, S., and S. I. Lee. "A Unified Approach to Interpreting Model Predictions." Nips 2017.

      Our goal in using KernelExplainer was to demonstrate that PoSHAP was not dependent on model specific interpretation methods. However, we have realized that this intention may not have been clearly stated or demonstrated. To expand on this, we have included a new Figure 8, which shows PoSHAP analysis comparisons to other classes of machine learning models, all using Kernel Explainer. This result was interesting because it revealed that even though the XGboost model technically performed better at prediction (Figure 8A, reduced MSE and higher spearman rho), and produced a similar PoSHAP motif heatmap, the interpositional dependences from the perspective of distance (Figure 8C) or chemical interactions (Figure 8D) were substantially muted. This is also apparent with the other standard machine learning model ExtraTrees. This result shows that the choice of model architecture is important, and this direct comparison would not be possible if we used the DeepExplainer.

      We added the following text and figure to the manuscript:

      “ PoSHAP uses the SHAP KernelExplainer method, which is based on Local interpretable model-agnostic explanations (LIME). Using the general KernelExpplainer method enables direct comparison of interpretations produced by different models trained from the same data. To ask whether PoSHAP interpretation changes based on the model used, the CCS data was used to train XGboost or ExtraTrees models. Surprisingly, the XGboost model performed better than the LSTM model with regard to MSE and spearman rho between true and predicted values in the test set (Figure 8A). ExtraTrees was slightly worse than the other two models. The model interpretation heatmaps from PoSHAP were similar between the LSTM and XGboost, but the interpretation from the ExtraTrees model was missing the high average SHAP due to n-terminal histidine or arginine (Figure 8B). Even though XGboost produced a similar PoSHAP heatmap, the interpositional dependence with regard to distance (Figure 8C) and chemical interactions (Figure 8D) was muted. This shows that the choice of model is important for revealing amino acid interactions.”

      Figure 8. CCS PoSHAP of Various Machine Learning Models. PoSHAP analysis was performed on two additional machine learning models, Extra Trees and Extreme Gradient Boosting (XGB). Predictions were plotted against experimental values and the Mean Squared Error and r values are reported for each model (A). PoSHAP heatmaps were created for each model (B), illustrating an increase in model complexity as more sophisticated models are used. Dependence analysis was performed on each model and the significant interactions are plotted by distance (C) and by combined distance and interaction type (D).

      As described in the manuscript, "Correlations between true and predicted values were assessed by MSE, Spearman's rank correlation coefficient, and the correlation p-value." As an important indicator for evaluation, the exact p-values should be provided in the seven subgraphs in Figure 2, not p=0.0.

      We agree with the reviewer that reporting accurate p-values can assist in evaluation. We have updated the figures to reflect the p-values as far as we were able to determine them. Unfortunately, we are limited by the nature of the double data type in python and so reported that the p-value was less than the minimum value allowed by a double in six of the seven graphs. Additionally, the scales have been marked symmetrically as you mentioned in comment 4.

      It should be noted that the coordinate scales of Figure 2B and Figure 2C need to be marked symmetrically. And from Figure 2B, we can see that, the IC50 with smaller (0.8) values cannot be well predicted. Can the authors provide a detailed explanation about these results?

      We understand the reviewer’s concern with poor prediction of extreme values. Figure B represents the IC50 prediction for the A1101 human allele which was the smallest of the datasets we used for training. It only consists of 4,522 entries, around 1/10 of the data used for the Mamu alleles and CCS. Because of this, it is likely that there were not enough examples of datapoints at the extremes to reliably train the model to account for them. However, given the limited size of the dataset, we were surprised with the satisfactory predictions. More importantly, the purpose of our paper is model interpretation not model prediction accuracy, and this shows that even when predictions are not perfect, the model interpretation by PoSHAP can still be effective. We thank the reviewer for noticing this and added the following statement to the results:

      “Remarkably, this was achieved for A\11:01 using a total dataset of only 4,522 examples, which shows that PoSHAP can be effective with even less than 10,000 training examples. “*

      References are needed in some descriptions in the manuscript. For example, "one might train a network to take an input of peptide sequence and predict chromatographic retention time", "RNNs have found extensive application to natural language processing, and by extension as a similar type of data, predictions from biological sequences such as peptides or nucleic acids".

      We apologize for missing these references. We have now cited these statements and have added many additional references as part of our revision.

      The description of the adopted three models in the section "Model architecture" is a bit confusing. As described in this section, "The LSTM layer outputs a 50x128 dimensional matrix to a dropout layer where a proportion of values are randomly set to 0", "a second LSTM layer outputs a tensor with length 128 and a second dropout layer then randomly sets a proportion of values to 0". But as shown in the Supplemental Figure 3, the output size of the first LSTM was 10x128. Also, as shown in Table 1, the dropout rates were not 0. Therefore, the section should be adjusted for clear clarification.

      We apologize for the confusing wording. We meant that dropout layers randomly set values=0, not that the dropout proportion was 0. We reworded this part to read:

      “The LSTM layer outputs a 10x128 dimensional matrix to a dropout layer where a proportion of values are randomly “dropped”, or set to 0. For the MHC models, a second LSTM layer outputs a tensor with length 128 to a second dropout layer. Then in all models, a dense layer reduces the data dimensionality to 64. For the MHC models, the data is then passed through a leaky rectified linear unit (LeakyReLU) activation before a final dropout layer, present in all models.”

      Reviewer #2 (Significance (Required)): Pls refer to my comments provided as above.

      Reviewer #3 (Evidence, reproducibility and clarity (Required)): **Summary:** The main goal of the work is to provide the interpretation of Deep Neural Networks (LSTM in the paper) trained on biological sequences. For this purpose authors used the framework introduced earlier - SHapley Additive exPlanations (SHAP), in particular - the slight adaptation of this method called positional SHAP (PoSHAP), because they are interested in the impact of each position of the input sequence to the model output. They demonstrate this on three regression tasks that predict peptide properties. **Major comments** The main contribution, highlighted in the paper: authors showed how PoSHAP discloses amino acid motifs that influence MHC I binding. Further they described how PoSHAP enables understanding of interpositional dependence of amino acids that result in high affinity predictions. Also they argued that this work also contributes to a method for accurate prediction of peptide-MHC I affinity using peptide array data enabled by novel application of a neural network that combines amino acid embedding and LSTM layers.

      There are some comments about the statements above: 1.Why was the LSTM model chosen? Recent publications showed the success of the Transformer model for biological sequences; however this direction was not covered in the related work overview. The architecture choice then should be better justified. Also the choice of LSTM for the biological sequences is not new and authors should better claim their statement about "novel application of a neural network that combines amino acid embedding and LSTM layers ". Where exactly is the novelty? Could the community use the pretrained embeddings for their purpose?

      The reviewer is correct that transformer models are highly effective for making predictions from biological sequences. In fact, many models do well, and there is no single correct choice of model for this task. Though there are many models to choose from, our models are sufficiently accurate. Importantly, the main contribution of our manuscript is not to train the most accurate models, but rather to demonstrate a strategy for positional model interpretation based on SHAP. Related to that point, please note our response to reviewer #2’s second comment that our approach uses the kernel explainer and can be applied to any model. However, we do agree that we neglected coverage of the transformer model in the introduction and have added a paragraph to the introduction covering some of the recent work in this area:

      “Many effective deep learning model architectures are available for making predictions from inputs of biological sequences, and there is currently no single correct choice. CNN models such as MHCflurry 2.0 (40) and LSTM models are effective at predicting MHC binding of peptides (41). Even simpler models, such as random forests, have been used to predict MHC binding (42,43). Prediction of other peptide properties like tandem mass spectra are often done with CNN or LSTM models (33). More recently, given the extraordinary performance of transformer models like BERT (44) and GPT-3 (45) for NLP, there is interest in transformer models for biological sequences (46).”

      We also want to be sure we do not overstate the novelty of our contributions. We have updated our discussion to better reflect the nature of our contributions. We reworded the statement quoted above to read:

      “Overall, the three modeling examples laid out herein serve as a tutorial for PoSHAP interpretation of almost any model trained from almost any biological sequence.”

      The attention mechanism itself provides the great opportunity to interpret the model predictions. In the introduction section authors made a statement that attention layers may limit the flexibility of model architecture when designing new models. Could they better explain this limit? Because recent state of the art models successfully work with long biological sequences and show better results then any other models (one example could be found here: https://openreview.net/pdf?id=YWtLZvLmud7). Authors should cover these limits more, that also related to the motivation of the LSTM choice.

      We added a paragraph to our introduction to expand on attention and its limitations:

      “Attention mechanisms have been successful in recapitulating experimentally defined binding motifs, but require that the model be constructed with attention layers. This may limit the flexibility of model architecture when designing new models. For example, attention mechanisms are specific to neural networks. Simpler models, such as random forests and XGboost, may also be more suitable for some applications, and these cannot utilize attention. Also, while attention mechanisms are currently very effective, there is always a possibility that new architectures will emerge that make interpretations using attention infeasible. Beyond this, attention is a metric of the model itself, while SHAP values are calculated on a per input basis. By looking at the model through the lens of the inputs, we can understand the model’s “reasoning” behind any peptide. Attention mechanisms also do not enable dissection of interpositional dependencies between amino acids. Thus, new methods for model agnostic interpretation are desirable.”

      Another statement was made about the PoSHAP - adaptation of the SHAP method. It is hard to follow through the explanation of this adaptation - it is not clear what exactly is this adaptation. For example, Kernel SHAP from the original paper computes feature importance, in this paper authors compute the impact of each position, that is basically also the feature importances. Thus authors should better explain the statement about PoSHAP novelty. Will it be possible to use PoSHAP for any other model trained for the same purpose? If yes, for better reproducibility, authors should provide the place where exactly in the repo is the code for this. Also mathematical notations are missing in the Positional SHAP (PoSHAP) section - it is better to explain the adaptation with them to increase the understanding of the section.

      We apologize for the ambiguous wording in the abstract stating that “PoSHAP adapts SHAP”. We have reworded this statement to “PoSHAP utilizes SHAP”. The novelty of this approach is taking the feature importance values calculated by SHAP and structuring them to include each position’s index to allow for the interpretation of biological sequences. As we demonstrate here, this allows for novel interpretations of previously published data and will enable model interpretation in future studies that learn from biological sequences. Although this is practically very simple, we are not yet aware of any examples in the literature that do this.

      The following two SHAP force plots demonstrate the difference between using SHAP as-is versus PoSHAP. There is a demonstrated need for such a framework, considering the dearth of biological sequence model interpretation using SHAP and the ambiguity within biological sequence SHAP interpretation. For example, Meier et al., Nature Communications, 2021 performed an analysis like our Figure S7C, which just shows the range of SHAP values per residue. Although we can learn something about which AAs are important based on the range of their SHAP values, SHAP as-is doesn’t reveal a motif. While our position indexing is a simple change, it enables all the rich, sequence dependent analysis we performed in this paper. We added the following text to the results section with this new supplementary figure:

      “PoSHAP utilizes the standard SHAP package but adapts the analysis by simply appending an index to each input and maintaining positional information after the kernelExplainer interpretation, which enables tracking of each input postion’s contribution to an output prediction (supplementary figure 5, showing force plot with and without index).”

      Supplemental Figure 5. SHAP Forceplots Demonstrating PoSHAP Indexing. Two forceplots were created with the SHAP forceplot method of the third peptide in the CCS testing set. (A) shows the plot with encoded inputs mapped to their amino acid. (B) shows the plot with the encoded inputs mapped to their amino acid and position. The addition of positional indexing removes the ambiguity of contributions, for example, glutamine having both a positive and a negative SHAP contribution to the prediction of the third peptide.

      We have updated the repository to include a tutorial that demonstrates PoSHAP on provided data and explains how to use PoSHAP with your own model and data.

      In the experimental section, authors first compare the results with previously known. For example, for the human MHC allele A*11:01 model PoSHAP analysis shows the similar results as was shown with another approach. Based on the provided explanation, it is not clear why PoSHAP is better than the previously published method. The advantage of the PoSHAP should be better explained.

      We agree with the reviewer that the benefits of our approach should be as clear as possible. The referenced section of the paper is to validate our approach compared to another model interpretation technique. We added a new third paragraph to the discussion section to clearly explain the benefits of PoSHAP:

      “There are several benefits of PoSHAP over competing methods. First, PoSHAP determines important residues despite biases in the frequencies of amino acids (Figure 5, Supplementary Figures 9 and 10). PoSHAP is also applicable to any model trained from sequential data (Figure 8), and enables dissection of interpositional dependencies (Figures 6 and 7). Finally, we include a clearly explained jupyter notebook on Github that will take any model and dataset and perform PoSHAP analysis.”

      In the experimental section, after the PoSHAP performance verification, hypothesis generation was introduced. However, it is not clear how many hypotheses were generated; how many of them were known before; what kind of other categories are inside these hypotheses (unknown, possible and potentially interesting, etc).

      We are unsure as to how to quantify the number of hypotheses generated by our approach. In a sense, the SHAP value of each amino acid at each position within a heatmap represents a hypothesis of the contribution of that amino acid to the metric being predicted. Each significant interaction listed in the first three supplemental tables represents a hypothesis of the interactions between two given amino acids at two positions. To make these into testable hypotheses requires some analysis, as we have discussed. i.e. the two binding motifs (L-T-P, F-S-P) of A001, or the distance-type interactions within the CCS.

      The README section in the GitHub repo is not easily understandable. An additional explanation for each step is required (e.g., links to the folders where the calculated SHAP values, the trained models, all splits and all-important benchmarks are).

      We have updated the README and repository to explain how to use PoSHAP, and explanations of each item in the repository.

      **Minor comments**

      1. The prior studies should be covered better (see Major comments).

      We apologize for not better covering prior studies. We have significantly expanded the introduction by adding two new paragraphs and at least 10 additional citations.

      The work consists of some typos, for example: "However, because many reports forgo model interpretation" - "t" is missed.

      We did intend to use the word “forgo” not “forget” in that sentence. We have checked again thoroughly for spelling and grammar mistakes.

      The hyperparameters table, hyperparameter search section should be moved to the supplemental material, that's technical details.

      We moved this table to the supplementary materials.

      Reviewer #3 (Significance (Required)): Interpretation of the model results is an important topic for biology. New findings here could lead to new interactions opening, new drugs development etc. That is relevant for the applied ML Researches and computational biologists. This paper aims to provide a way to do it. Because my field of interest and expertise lies in Machine Learning for healthcare, language modelling of biological sequences and Natural Language Processing, this work is of great interest to me. So I mostly evaluated ML methodology presented in the paper.

    1. 42:07 - 46:47

      "I think as painful as those times are, they are so rewarding, because it requires that you reassess and decide to really commit. It's like, I could be doing this, I could be doing that. Actually, I'm doing this because this is not just my passion. There is something else that is driving me to do it. But I can't even describe it, I don't know what it is. Once you get to that place, windows start to open, and you start to realize things. I don't know if I would have come to, had I not gone through a rough time. 2018 was the year that I said, ‘What we're doing today should exist a hundred years from now.’ People should be growing food in their communities and creating an economic engine that provides jobs to the residents in the community, food, to the residents. And up to that point, I wasn't thinking. And the moment I thought, ‘a hundred years,’ I had to question a whole bunch of shit because I have always been inspired by anger. Anger is an amazing motivator. I realized once I had this notion that Project Eats should exist a hundred years from now, I realized you can't grow something with anger. You can start it with anger, it will motivate you and get you to levels of creativity, resourcefulness and imagination, but you can't grow it with that.

      And then the next level of, ‘Wow. I've got to grow this thing.’ I've got some shortcomings. I hate to ask people for anything. And so if you're going to grow it, you have to grow it with resources. And we, for the most part, have used the most valuable resources that we all have, which is the ones we have. Well, we can't really grow for a hundred years with that. How do you build that? And building that requires you to ask them that. And so I have these battles that I'm having in my head and out loud, I'm not asking that. And then having to resolve that, you know as uncomfortable as that may be, you know, if you want this thing bad enough, then embrace asking. Figure out how to love asking.

      And now I am really kind of psyched about fundraising. I'm really into it, I'm going to raise a whole lot of money. And I'm going to do it on my terms. So how do I do it and what do I do? You can always do it the way that is right for you to do it. And I think we get, again, socialized out of thinking that we can, that we have to follow through it again.

      The most profound thing for me has been how I view approaching art. And that evolved from the end of 2018. I believe art should be discovered. I believe we should engage the cause we discover. The notion is this, this stuff makes no sense to me, that we have to schedule time to see art. That's not how art feeds our soul. I actually want people to engage with whatever I make on their own. Get rid of those text labels for Christ's sake. Don't bombard me with how I'm supposed to see something. 'Cause when you do that, you disrupt the very reason that we are creating this conversation, and it’s a conversation, it’s not a mediated moment where I have to bow to your schedules and bow to the way to say it. And in that, my notions of what I create now have expanded."

    1. Author Response:

      Reviewer #1 (Public Review):

      [...] The approach taken by the authors is very thorough, and the conclusions are well supported by the data. I think this is an important contribution to the field, and I have only a few specific comments:

      – The authors should sequence the mgrB gene and upstream sequence, and the rpoS gene for TMPR6-10. If these strains don't have mutations in mgrB, I think it's important to sequence their genomes to find out why DHFR levels are higher than in wt cells.

      Response: This is an important point that we had overlooked. We have now amplified and Sanger sequenced the mgrB gene and its promoter from all 10 TMPR isolates. As expected, we do indeed find mutations at the mgrB promoter in all 10 isolates. These data have been added to the revised manuscript in the Figure 1A schematic.

      – Presumably the higher number of mutations in mgrB rather than folA reflects the mutational space available, i.e. there are more possible mutations that reduce mgrB expression than there are gain-of-function folA mutations. This is worth mentioning, since it has a big impact on the evolutionary path to resistance.

      Response: We thank the Reviewer for pointing this out. We have discussed this point in the revised version of the manuscript (Page 17, Line 477-480).

      Reviewer #2 (Public Review):

      [...] 1) The authors find that mutations in the mgrB locus precede mutations in folA during E. coli's response to TMP. Why only sequence 5 of the 10 TMPR mutants? Was this subset chosen for sequencing based on any specific criteria? Below are some follow-up comments.

      Response: We thank the reviewer for this comment. Initially TMPR 1-5 were chosen since these isolates encompassed the entire range of drug IC50 values observed by us. We have now amplified and Sanger sequenced the mgrB gene and its promoter from all 10 TMPR isolates. As expected, we do indeed find mutations at the mgrB promoter in all 10 isolates. These data have been added to the revised manuscript in the Figure 1A schematic.

      a. Do any of the mutations cause growth defects relative to the wild-type strain?

      Response: This is an insightful question indeed. We have not measured growth rates of the trimethoprim resistant isolates. However, we have measured fitness of TMPR1-5 relative to wild type in competitive growth assays. In these experiments all 5 isolates have measurable fitness costs (relative fitness for isolates was between 0.7-0.8) when grown in drug-free media. Since mgrB mutations are found in all 5 TMPR isolates, we believe this result to be generally in line with our values of fitness for the mgrB-knock out strain. However, since TMPR1-5 have multiple genetic changes, attributing the measured fitness costs of these isolates to mgrB-deficiency alone is not possible. We are currently in the process of dissecting out the relative contribution of the various mutations in TMPR1-5 towards shaping the final fitness of the isolates. However, these will likely be reported in a later manuscript.

      b. Line 103: What are the mutations in folA promoter region? Only mutations in the coding sequence are listed in table 1 and figure 1A.

      Response: We apologise for this error. Though we have sequenced both promoter and ORF of the folA gene, we only found mutations in the coding sequence. We have made the necessary change in the revised manuscript.

      c. Line 109: The authors speculate that IS-element insertions in the mgrB promoter region reduce its expression, maybe they can provide a reference here from previous studies that have analyzed such mutations. Also, including details of the length/size of these insertion elements within table 1 would be helpful.

      Response: We have added references substantiating our claim that IS-element insertion in the mgrB promoter reduces its expression (Page 4, Line 110, ref 34, 35). The length of the insertions is indicated in Table 1.

      d. Line 111: the phrase "stop-codon readthrough" is misleading. The authors should rephrase to clarify that the single nucleotide deletion leads to a shift in the reading frame leading to an altered protein sequence at the C-terminal end.

      Response: We agree that this phrase is mis-leading. We have modified it in the revised manuscript (Page 4, Line 112).

      2) Based on growth assays including competitions, and measurements of folA gene expression in mgrB-deficient E. coli cells, the authors conclude that tolerance to TMP is caused by PhoP-dependent upregulation of DHFR.

      a. The authors should rewrite the text (lines 143-155) to make the experimental design of the competitions more obvious to the reader. Indicating either within the figure legend or main text what ∆mgrB/total means would definitely make analysis of the figure and results easier for the reader The reader needs to go to the materials section to get a full understanding how exactly this experiment was performed.

      Response: We have re-written this section for greater clarity and also changed Figure 1D accordingly.

      b. In Figure 1C, the IC50 value for ∆phoP is similar to that of wild type. If PhoP-dependent expression of folA important for TMP tolerance/resistance, shouldn't we expect to see a lower IC50, similar to that of ∆mgrB∆phoP? Intriguingly, the data for wild type in Figure 1C appears to be in conflict with the data in Figure 3B, please clarify.

      Response: This is an important issue, and we thank the Reviewer for pointing this out. We think that the reason phoP deletion reverses the phenotype of mgrB-deletion, but has no detectable effect in an mgrB-expressing background is due to the culture media used by us. Our experiments were performed in LB, which is a low magnesium medium. Since magnesium activates the PhoPQ pathway, in LB basal activity of PhoPQ is expected to be very low. Upon deletion of mgrB, we believe that there is an elevation in ‘unstimulated’ PhoPQ activity. This elevation is due to loss of feedback inhibition by MgrB protein. As a result, the effects of PhoP deletion are most pronounced in an mgrB knockout strain. We are, however, unable to explain why the IC50 of ∆mgrB∆phoP is lower than wild type. The possibility that there may be cross-phosphorylation of other response regulators by uninhibited PhoQ cannot be ruled out, however we do not have any data to substantiate this yet.

      The data is Figures 1C and 3B come from independently performed replicates. The mean values of IC50 of Wt in these figures are 26±13 ng/mL and 40±20 ng/mL respectively, which are not statistically significantly different.

      c. In Figure 1D, it is hard to figure out the exact strains and conditions of each competition. For instance, the ratios 10:1, 100:1 and 1000:1 needs to be clearly labeled, "wild type: mgrB" or "wild type: specific mutant" as applicable, the label on the X-axis is misplaced. Does "WmgrB" refer to ∆mgrB? If yes, change to ∆mgrB. Fitness values need a label or put into a table.

      Response: We have re-formatted this figure for better clarity as suggested. ‘w’ refers to calculated value of relative fitness and we have moved these values to the main text (Page 5, Line 149-151).

      d. Line 172: incorrect figure citation, replace Figure 2B with 2A.

      Response: We have made this correction.

      e. Lines 180-181: Only 5 out of the 10 TMPR isolates were sequenced and found to have mutations in the mgrB locus. In the absence of sequencing data confirming such mutations in TMPR 6-10 isolates, the increased levels of DHFR cannot be attributed to loss of mgrB.

      Response: We have now amplified and Sanger sequenced the mgrB gene and its promoter from all 10 TMPR isolates. As expected, we do indeed find mutations at the mgrB promoter in all 10 isolates. These data have been added to the revised manuscript in the Figure 1A schematic.

      f. In Figure 2C, it would be helpful to show the GFP fluorescence data for the single deletions, ΔphoP and ΔrpoS, to further support the claim that TMP tolerance via DHFR upregulation is PhoP dependent. In addition, the X-axis should specify the promoter reporter that was used.

      Response: We have added these data to Figure 2C and also specified the promoter reporter used.

      g. Lines 181-183: reference for the previous work on W30G folA is missing.

      Response: We thank the reviewer for bringing this to our notice. We have added the appropriate reference.

      h. In Figure 2, there is a discrepancy in the level of DHFR observed for both TMPR2 and 3 isolates in panels D and E - the DHFR protein levels are much higher in panel E. Can the authors explain this discrepancy, especially given the W30G mutation in TMPR3 (expected to show reduced levels of DHFR)? Is the same amount of protein loaded in both experiments? If so, why are the levels of protein different (and vastly different for TMPR3)? Better quantification of the western blots depicting the signal for the replicates would be helpful.

      Response: In order to be able to detect the lower levels of DHFR in ΔphoP derivates of TMPR strains, we have had to overexpose the Western blots. This may explain the apparent discrepancy between Figure 2D and E. To enhance clarity and ease of interpretation we have now quantitated all the immunoblots in the manuscript and reported fold changes in expression level.

      3) The data presented here also show that mgrB and folA mutations act in synergy in TMP resistant E. coli.

      a. It would be useful to the reader to include a table listing the MIC values in Figure 3. The plate images showing the E-tests are difficult to read and less helpful in interpreting the MICs and can be moved to the supplement.

      Response: We thank for reviewer for this suggestion. We have removed the E-test images from the figure and have included a table with the MIC values in Figure 3.

      b. In Figure 3E (and lines 234-238), what was the strain background used for DHFR overexpression? The details are missing from the paper.

      Response: The pPRO-DHFR plasmid was transformed into wild type E. coli MG1655. This information has been included in the revised Figure 3E.

      4) To follow the adaptive pathway for TMP resistance, the authors sequenced genomes of TMP-resistant isolates.

      a. Line 283: How many strains were sequenced at each time point? "3 to 5" is confusing.

      Response: The number of strains sequenced by us varied for different time points and lineages. We have rephrased this to ‘upto 5’ strains to prevent confusion. The exact number of isolates sequenced at each timepoint are given in the supplementary tables.

      b. In Figure 4, the data points/symbols and lines are hard to read in both panels A and B. These graphs can be replotted with open symbols or different colors to help the reader analyze the figure much more easily.

      Response: We have used different colours for clearer representation of data in the revised figure.

      c. Overall, it is still unclear how folA expression is regulated by PhoP regulation. An alternate hypothesis is that loss of MgrB may influence folA gene expression in a PhoP independent manner. Have the authors ruled out this possibility?

      Response: We agree that our study has not shed light on the precise molecular mechanism by which PhoP signalling affects folA levels, except that it is unlikely to be a direct effect. The reason we do not think that the effect is PhoP-independent is that phoP-deletion reverses the phenotype of the mgrB knockout, as well as the TMPR1-5 isolates. However, we cannot yet argue that there is no contribution from PhoP-independent mechanisms. Further genetic analyses are underway in our laboratory to determine other molecular players of this pathway.

    1. At this point he stopped with a profound look. The letter, he continued, was addressed to the Chief Steward. Now what could Captain Ellis, the Master Attendant, want to write to the Steward for? The fellow went every morning, anyhow, to the Harbour Office with his report, for orders or what not. He hadn’t been back more than an hour before there was an office peon chasing him with a note. Now what was that for? And he began to speculate. It was not for this--and it could not be for that. As to that other thing it was unthinkable. The fatuousness of all this made me stare. If the man had not been somehow a sympathetic personality I would have resented it like an insult. As it was, I felt only sorry for him. Something remarkably earnest in his gaze prevented me from laughing in his face. Neither did I yawn at him. I just stared. His tone became a shade more mysterious. Directly the fellow (meaning the Steward) got that note he rushed for his hat and bolted out of the house. But it wasn’t because the note called him to the Harbour Office. He didn’t go there. He was not absent long enough for that. He came darting back in no time, flung his hat away, and raced about the dining room moaning and slapping his forehead. All these exciting facts and manifestations had been observed by Captain Giles. He had, it seems, been meditating upon them ever since. I began to pity him profoundly. And in a tone which I tried to make as little sarcastic as possible I said that I was glad he had found something to occupy his morning hours.With his disarming simplicity he made me observe, as if it were a matter of some consequence, how strange it was that he should have spent the morning indoors at all. He generally was out before tiffin, visiting various offices, seeing his friends in the harbour, and so on. He had felt out of sorts somewhat on rising. Nothing much. Just enough to make him feel lazy. All this with a sustained, holding stare which, in conjunction with the general inanity of the discourse, conveyed the impression of mild, dreary lunacy. And when he hitched his chair a little and dropped his voice to the low note of mystery, it flashed upon me that high professional reputation was not necessarily a guarantee of sound mind. It never occurred to me then that I didn’t know in what soundness of mind exactly consisted and what a delicate and, upon the whole, unimportant matter it was. With some idea of not hurting his feelings I blinked at him in an interested manner. But when he proceeded to ask me mysteriously whether I remembered what had passed just now between that Steward of ours and “that man Hamilton,” I only grunted sourly assent and turned away my head. “Aye. But do you remember every word?” he insisted tactfully. “I don’t know. It’s none of my business,” I snapped out, consigning, moreover, the Steward and Hamilton aloud to eternal perdition. I meant to be very energetic and final, but Captain Giles continued to gaze at me thoughtfully. Nothing could stop him. He went on to point out that my personality was involved in that conversation. When I tried to preserve the semblance of unconcern he became positively cruel. I heard what the man had said? Yes? What did I think of it then?--he wanted to know. Captain Giles’ appearance excluding the suspicion of mere sly malice, I came to the conclusion that he was simply the most tactless idiot on earth. I almost despised myself for the weakness of attempting to enlighten his common understanding. I started to explain that I did not think anything whatever. Hamilton was not worth a thought. What such an offensive loafer . . . “Aye! that he is,” interjected Captain Giles . . . thought or said was below any decent man’s contempt, and I did not propose to take the slightest notice of it. This attitude seemed to me so simple and obvious that I was really astonished at Giles giving no sign of assent. Such perfect stupidity was almost interesting. “What would you like me to do?” I asked, laughing. “I can’t start a row with him because of the opinion he has formed of me. Of course, I’ve heard of the contemptuous way he alludes to me. But he doesn’t intrudehis contempt on my notice. He has never expressed it in my hearing. For even just now he didn’t know we could hear him. I should only make myself ridiculous.” That hopeless Giles went on puffing at his pipe moodily. All at once his face cleared, and he spoke. “You missed my point.” “Have I? I am very glad to hear it,” I said. With increasing animation he stated again that I had missed his point. Entirely. And in a tone of growing self-conscious complacency he told me that few things escaped his attention, and he was rather used to think them out, and generally from his experience of life and men arrived at the right conclusion. This bit of self-praise, of course, fitted excellently the laborious inanity of the whole conversation. The whole thing strengthened in me that obscure feeling of life being but a waste of days, which, half-unconsciously, had driven me out of a comfortable berth, away from men I liked, to flee from the menace of emptiness . . . and to find inanity at the first turn. Here was a man of recognized character and achievement disclosed as an absurd and dreary chatterer. And it was probably like this everywhere--from east to west, from the bottom to the top of the social scale. A great discouragement fell on me. A spiritual drowsiness. Giles’ voice was going on complacently; the very voice of the universal hollow conceit. And I was no longer angry with it. There was nothing original, nothing new, startling, informing, to expect from the world; no opportunities to find out something about oneself, no wisdom to acquire, no fun to enjoy. Everything was stupid and overrated, even as Captain Giles was. So be it. The name of Hamilton suddenly caught my ear and roused me up. “I thought we had done with him,” I said, with the greatest possible distaste. “Yes. But considering what we happened to hear just now I think you ought to do it.” “Ought to do it?” I sat up bewildered. “Do what?” Captain Giles confronted me very much surprised. “Why! Do what I have been advising you to try. You go and ask the Steward what was there in that letter from the Harbour Office. Ask him straight out.”I remained speechless for a time. Here was something unexpected and original enough to be altogether incomprehensible. I murmured, astounded: “But I thought it was Hamilton that you . . .” “Exactly. Don’t you let him. You do what I tell you. You tackle that Steward. You’ll make him jump, I bet,” insisted Captain Giles, waving his smouldering pipe impressively at me. Then he took three rapid puffs at it. His aspect of triumphant acuteness was indescribable. Yet the man remained a strangely sympathetic creature. Benevolence radiated from him ridiculously, mildly, impressively. It was irritating, too. But I pointed out coldly, as one who deals with the incomprehensible, that I didn’t see any reason to expose myself to a snub from the fellow. He was a very unsatisfactory steward and a miserable wretch besides, but I would just as soon think of tweaking his nose. “Tweaking his nose,” said Captain Giles in a scandalized tone. “Much use it would be to you.” That remark was so irrelevant that one could make no answer to it. But the sense of the absurdity was beginning at last to exercise its well-known fascination. I felt I must not let the man talk to me any more. I got up, observing curtly that he was too much for me--that I couldn’t make him out. Before I had time to move away he spoke again in a changed tone of obstinacy and puffing nervously at his pipe. “Well--he’s a--no account cuss--anyhow. You just--ask him. That’s all.” That new manner impressed me--or rather made me pause. But sanity asserting its sway at once I left the verandah after giving him a mirthless smile. In a few strides I found myself in the dining room, now cleared and empty. But during that short time various thoughts occurred to me, such as: that Giles had been making fun of me, expecting some amusement at my expense; that I probably looked silly and gullible; that I knew very little of life. . . . The door facing me across the dining room flew open to my extreme surprise. It was the door inscribed with the word “Steward” and the man himself ran out of his stuffy, Philistinish lair in his absurd, hunted-animal manner, making for the garden door. To this day I don’t know what made me call after him. “I say! Wait a minute.” Perhaps it was the sidelong glance he gave me; or possibly I was yet under the influence of Captain Giles’ mysterious earnestness.Well, it was an impulse of some sort; an effect of that force somewhere within our lives which shapes them this way or that. For if these words had not escaped from my lips (my will had nothing to do with that) my existence would, to be sure, have been still a seaman’s existence, but directed on now to me utterly inconceivable lines. No. My will had nothing to do with it. Indeed, no sooner had I made that fateful noise than I became extremely sorry for it. Had the man stopped and faced me I would have had to retire in disorder. For I had no notion to carry out Captain Giles’ idiotic joke, either at my own expense or at the expense of the Steward. But here the old human instinct of the chase came into play. He pretended to be deaf, and I, without thinking a second about it, dashed along my own side of the dining table and cut him off at the very door. “Why can’t you answer when you are spoken to?” I asked roughly. He leaned against the lintel of the door. He looked extremely wretched. Human nature is, I fear, not very nice right through. There are ugly spots in it. I found myself growing angry, and that, I believe, only because my quarry looked so woe-begone. Miserable beggar! I went for him without more ado. “I understand there was an official communication to the Home from the Harbour Office this morning. Is that so?” Instead of telling me to mind my own business, as he might have done, he began to whine with an undertone of impudence. He couldn’t see me anywhere this morning. He couldn’t be expected to run all over the town after me. “Who wants you to?” I cried. And then my eyes became opened to the inwardness of things and speeches the triviality of which had been so baffling and tiresome. I told him I wanted to know what was in that letter. My sternness of tone and behaviour was only half assumed. Curiosity can be a very fierce sentiment--at times. He took refuge in a silly, muttering sulkiness. It was nothing to me, he mumbled. I had told him I was going home. And since I was going home he didn’t see why he should. . . . That was the line of his argument, and it was irrelevant enough to be almost insulting. Insulting to one’s intelligence, I mean. In that twilight region between youth and maturity, in which I had my being then, one is peculiarly sensitive to that kind of insult. I am afraid my behaviour to the Steward became very rough indeed. But itwasn’t in him to face out anything or anybody. Drug habit or solitary tippling, perhaps. And when I forgot myself so far as to swear at him he broke down and began to shriek. I don’t mean to say that he made a great outcry. It was a cynical shrieking confession, only faint--piteously faint. It wasn’t very coherent either, but sufficiently so to strike me dumb at first. I turned my eyes from him in righteous indignation, and perceived Captain Giles in the verandah doorway surveying quietly the scene, his own handiwork, if I may express it in that way. His smouldering black pipe was very noticeable in his big, paternal fist. So, too, was the glitter of his heavy gold watch-chain across the breast of his white tunic. He exhaled an atmosphere of virtuous sagacity serene enough for any innocent soul to fly to confidently. I flew to him.

      OM SA

    1. experiential knowledge

      I think that one of the concepts that we talked about in class comes to play here about when it is okay to start using scientific data as proof in court cases. Some factors that may come into play may be how widely accepted the research is, ideological beliefs, how much data was collected to back up the claim made from the research, etc.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      We thank reviewers for helping us clarify our manuscript. Some key information was only in the Supporting Information document, and was not obvious to find. We have now introduced some of this information into the main text, and otherwise clarified to which specific sub-paragraph of the Supporting Information document we refer every time we mention it. Another aspect which we have clarified is the relevance of controls previously published in our paper PLOS Comp Biol 16: 1-23. These controls address many of the remarks raised by the reviewers, regarding for instance rhythm detection methods, detection threshold, the effect of normalization of time-series data in rhythm detection, the consideration of biological replicates in time-series data, or the relationship between rhythms and highly expressed genes. We have now introduced some of these results within the main text to clarify these points, or have specified to which specific result of our previous paper we refer.

      REVIEWER #1

      Major comments:

      They assumed the optimal constant level would be the maximum over the rhythm period when rhythmic regulation is absent. They also assumed the trade-off between the benefits of not producing proteins when they are not needed (costs saved) and the costs involved in making it rhythmic (costs of complexity), which they argued lead to the expectation that costlier genes be more frequently rhythmic. However, there was no explicit definition for the trade-off, so it is unclear how it leads to the expectation. [...]

      Second, the "costs of complexity" were not defined

      We have now clarified these points:

      Thus, a first evolutionary advantage given by rhythmic biological processes would be an optimization of the overall cost (over a 24-hour period), compared to a constant expression at a high level of proteins, when this high level is necessary **for fitness at least at some point of time.

      • Thus, a first evolutionary advantage given by rhythmic biological processes would be an optimization of the overall cost (over a 24-hour period), compared to the costs generated over the same period by optimizing a constant level of proteins. The reasonable assumption that the optimal constant level would be the maximum over the rhythm period strengthens the case for selection on expression cost.

      • Our results suggest that rhythmicity of protein expression has been favored by selection for cost control of gene expression, while keeping optimal expression levels. In the case of rhythmic genes, what would that optimal constant level be? We can propose two hypotheses. The first is that it would be the mean expression over the period, since this maintains the same overall amount of protein. The second is that it would be the maximum over the rhythm period, since that is the level needed at least at some point. The second hypothesis explains better the existence of this maximum level during the cycle. Of note, it also strengthens the case for selection on expression cost. Thus, for the case of rhythmic genes, the optimal constant level should at least correspond to the mean expression level (Fig 1d). We provide results obtained using both the maximum and the mean of expression in Fig. 2a. We have modified Fig. 1d accordingly, and specified in Supp Fig. S2 that the delta value was calculated from mean expression levels.

      We assume that the maximal expression level gives an estimation of the level that would be constantly maintained in the absence of rhythmic regulation

      • We assume that, in the absence of rhythmic regulation, the constant optimal level is included between the mean and the maximum expression level observed in rhythmic expression. Here, we studied the evolutionary costs and benefits that shape the rhythmic nature of gene expression at the RNA and protein levels. For this, we analysed characteristics we presume to be part of the trade-off.

      • Here, we studied the evolutionary costs and benefits that shape the rhythmic nature of gene expression at the RNA and protein levels. For this, we analysed characteristics we presume to be part of the trade-off determining the rhythmic nature of gene expression between its advantages (cost economy over 24h, non-ribosomal occupancy) and disadvantages (costs of complexity related to precise temporal regulation). The evolutionary** origin of maintaining large cyclic biological systems, in term of adaptability, can be seen as a trade-off between disadvantages such as cost or noise induced by the added complexity, and advantages such as economy over a daily time-scale, temporal organization, or adaptability.

      • Most rhythmic genes are tissue-specific (Zhang et al. 2014, Boyle et al. 2017), which means that their rhythmic regulation is not a general property of the gene and is therefore expected to be advantageous only in those tissues in which they are found rhythmic. This argues that rhythmic regulation has costs, since it is not general. These costs are **probably related to the complexity of regulation** to maintain precise temporal organisation. Thus, cyclic biological systems are expected to have adaptive origins.

        It would be more convincing to define a fitness function or cost function to demonstrate their argument that costlier genes have fitness advantages if they are rhythmic.

      Considering rhythmicity as an economy strategy is quite intuitive and our results confirm what is currently accepted (Wang et al. 2015). We show and discuss to which extent this is true by comparing expression costs at different expression levels. Defining more precisely a fitness function in our case would require an experiment where we could compare fitness between two populations (e.g. prokaryote growth rates): WT versus a strain whose promoter of the costliest genes would be controlled by non-cyclic transcriptional factors. We do not feel that this is a reasonable extension of this work, but a whole new research program.

      First, when proteins are not needed, it can be either the case of not producing extra proteins (cost saved) or the case of degrading excessive proteins (cost incurred). […]

      The cost function presented in this paper may be oversimplified. It only takes into account the costs to produce protein. The authors argued that a more complex cost calculation would not change the observation, but without proving it. However, protein degradation, including ubiquitination and proteolysis, requires energy; for a rhythmic gene, it is also necessary to consider the cost of maintaining the rhythmicity, including the temporally precise regulation of protein expression when the proteins are needed and of protein destruction when they are not.

      We have now clarified this in Section 4.1 of the Supporting Information document:

      Protein decay can be due to spontaneous decay of unstable molecules (no cost), cellular dilution (no cost), or active protein degradation, which has a cost which has been shown to be negligible. Costs of protein decay are negligible enough to not be opposed by selection. Indeed, Lynch and Marinov (2015) and Wagner (2005) have shown that “degradation in a lysosome may cost essentially nothing, and amino-acid export back to the cytoplasm consumes 1 ATP for every 3 to 4 amino acids”. Compared with the unique cost of producing one single nucleotide which consume 49~P, protein decay costs becomes negligible comparatively to transcriptional costs, which are themselves negligible comparatively to translational costs. All the more, given that amino acids from degradation are reused and do not need to be produced by the cell, which therefore economizes around 30 ~P per amino-acid (~P: high-energy phosphate bonds).

      In Section 3 of the Supporting Information document, we also show why rhythmic and highly expressed proteins are costlier for the cell per time-unit than rhythmic and lower expressed proteins, even considering decay costs or proteins half-lives.

      Thus, the order of costs between genes is not expected to be affected by a more complex calculation accounting for protein decay and protein half-lives.

      We think these points should be in Supporting Information document since they are not novel. Lynch and Marinov as well as Wagner have studied and reported these points in detail in their work. We have replicated their results and have used them to understand rhythmicity, which is the focus of our manuscript.

      The authors claimed that cycling genes are enriched in highly expressed genes, by showing rhythmic proteins are costlier than non-rhythmic proteins (based on the expression cost function) in several species. However, only the first 15% of proteins based on p-values ranking from their rhythm detection algorithms were classified rhythmic. One potential artifact of this classification is that the identified rhythmic genes are biasedly highly expressed genes because the lower-amplitude genes are harder to detect and excluded by the algorithm. If changing the threshold for rhythmicity to include more rhythmic genes with intermediate p-values (p-value Since the results of this paper would be sensitive to the accuracy of identifying rhythmicity at both mRNA and protein levels, it is crucial to validate the rhythm detection algorithm by cross-checking algorithm-generated results with those known rhythmic genes. Can the authors estimate the false positive and false negative rates in each group of the rhythmic and non-rhythmic proteins or mRNAs identified by their algorithm?

      Our 2020 paper (https://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1007666) addresses these issues, but we did not make this sufficiently clear here. We have now added some details of our previous results in the main text to clarify, as this a logical limitation remark. We mostly use GeneCycle based on the results of the benchmarking in that paper; it notably produces a uniform distribution under the null hypothesis and a skew towards low p-values for all empirical data.

      Furthermore, cycling genes have been shown to **be over-represented among highly expressed genes (Laloum & Robinson-Rechavi 2020, Wang et al. 2015).

      • Furthermore, we have shown in our previous work that rhythmic genes are largely enriched in highly expressed genes, and that the differences in rhythm detection obtained between highly and lowly expressed genes either reflect true biology or a lower signal to noise ratio in lowly expressed genes (Laloum & Robinson-Rechavi 2020).

        Higher gene expression usually leads to lower genetic noise. The authors thus applied a definition of the stochastic gene expression (SGE) that controls the biases associated with the correlation between the expression mean and variance to evaluate expression noise. They found lower noise with rhythmic transcripts. However, they did not explain, mechanistically, why rhythmic RNA has lower noise and what is the biological meaning behind this finding. It is also unclear whether they considered the phase difference between signal and noise that usually exists in an oscillatory system.

      Please see answer to second reviewer.

      Minor comments:

      It would be helpful if the authors could interpret their observations including where the results may not be as significant. A few examples are listed below.

      1) In tissue-specific studies, they used the transcriptomics datasets from 11 mouse tissues to compare the difference in expression levels (based on z-score) of each gene between tissue groups of rhythmic and non-rhythmic expression and found higher gene expression in rhythmic tissues. However, proteins showed a bimodal distribution, and it would be helpful to add interpretation or discussion regarding this bimodal distribution.

      Note that for proteins, the delta was calculated based on only 3 or 4 tissues, which limits a lot our detection power. We now proposed the hypothesis:

      • We also provide results obtained from other datasets in supplementary Table S3, although they must be taken with caution since only 2 to 4 tissues were available, and sometimes data were coming from different experiments. Of note, for proteomic data, the distributions of are bimodal (Fig. S3), separating rhythmic proteins into two groups, with low or high protein levels in the tissues in which they are rhythmic. **A hypothesis is that for some tissue-specific proteins the rhythmic regulation is not tissue-specific, making them rhythmic also in tissues where they are lowly expressed. But the very small sample size does not allow us to test it, and we caution against any over-interpretation of this pattern before it can be confirmed.

        2) They also calculate partial correlation for rhythmicity with expression level over tissues for all tissue-specific genes (tau>0.5) and found Spearman's correlation coefficient is skewed towards negative (suggesting a correlation), but Pearson's correlation showed a positive peak. It indicates that a subset of genes is less rhythmic in the tissues where they are most expressed. Is this positive peak significant or expected? What are these genes? Any evolutionary benefits? Can the authors discuss the functional difference between these genes and other genes that follow the predictions?

      While Spearman’s correlation is clearly skewed towards negative correlations, i.e. lower p-values thus stronger signal of rhythmicity in the tissue where genes are more expressed, Pearson’s correlation also has a smaller peak of positive correlations (Fig. S4), suggesting a subset of genes which are less rhythmic in the tissues **where they are most expressed.

      • While Spearman’s correlation is clearly skewed towards negative correlations, i.e. lower p-values thus stronger signal of rhythmicity in the tissue where genes are more expressed, Pearson’s correlation also has a smaller peak of positive correlations (Fig. S4a), suggesting a subset of genes which are less rhythmic in the tissues where they are most expressed. We show that tissue-specific genes which are mostly rhythmic in tissues where they are highly expressed are under stronger selective constraint than those which are rhythmic in tissues where they are lowly expressed (Fig. S4b). Thus, rhythmic expression of this second set of genes might be under weaker constraints.**

      We added Fig. S4b in Supplementary figures.

      3) In SGE analysis, the scRNA data of Arabidopsis was from roots, while the data for detecting the rhythmicity was from leaves. Without knowing whether the gene expression patterns in these two different parts are comparable, it is hard to judge the results. The authors may want to provide some discussion.

      Indeed, this limits the interpretation for Arabidopsis, as noted in the results and in the discussion. We still prefer to report this pattern than to remove it. But, we have now moved the results obtained for Arabidopsis into Supplementary Table S5.

      • In Arabidopsis, the single-cell data used are from the root, while transcriptomic time-series data used to detect rhythmicity are from the leaves, which limits the interpretation. Despite this limitation, we found no evidence of lower noise for genes that are rhythmic at the protein level (Table 1b and 1e, and Supplementary Table S5), **and trends towards lower noise in almost all cases for genes with rhythmic mRNAs (Table 1a, 1c, and 1d).
      • Our results in mouse are consistent with all of these considerations (Table 1 and Supplementary Table S5), although it was not fully the case for Arabidopsis (Supplementary Table S5). However, this last point might be explained by the tissue-specificity of rhythmic gene expression. Indeed, for Arabidopsis, the time-series dataset come from leaves whereas single-cell RNA data come from roots.

        For Mouse tissues, while most show lower noise for rhythmic genes, they saw the opposite in Muscle. Is this significant? Any discussion?

      For mouse muscle, we had not mentioned it since it was the only tissue showing such a trend. We now added comment regarding this in the main text:

      • In mouse, tissue muscle gave opposite result, possibly because skeletal muscle is one of the most un-rhythmic tissues in the body.

        In various places of the text, the authors only pointed the readers to "Supporting information" without explicitly referring to a specific supplemental figure by its number. It would be helpful to cite a table or figure explicitly.

      We agree, and have corrected this. See first General Statements.

      Figure 2 does not have legends in the graphs.

      This is now corrected, thank you for your attention.

      REVIEWER #2

      Major comments:

      • Our major concern regards the identification of rhythmic genes.

      Despite we are not experts in the specific method used (details are not provided in the manuscript), a method looking for a statisical significant periodicity in a noisy signal will provide a high p-value for a signal sufficiently above the noise level. Gene expression data are noisy because of stochastic gene expression and technical noise (e.g., the sampling noise due to RNA capture in RNAseq data). This noise scales with the average level of expression. Lowly expressed genes generally display larger relative fluctuations (e.g., sampling noise is essentially Poisson-like). As a result, the method will identify with a higher probability genes that are highly expressed as rhythmic genes since the signal to noise ratio is generally higher.

      This could significantly bias the subsequent analysis, since most of the claims are related to a link between expression levels and rhythmicity.

      [There is not even an obvious separtation of timescales that can be invoked between a possible 24-hour periodic signal and the fluctuations. For example, the timescale of protein fluctuations can be largely set by dilution and thus have a timescale comparable to the cell cycle.]

      The authors should discuss this issue, which is overlooled in the current manuscript.

      How much this potential bias affects the selection of rhythmic genes can probably be assessed using synthetic data.

      • It would be useful to clarify in the main text what are the units of measurement of gene expression at the mRNA and at the protein level. If we understood correctly, the authors used FPKM and protein counts respectively. The dynamics in time could in principle be different if an absolute or a normalized level of expression is considered. For example, the cell cycle can be correlated with the circadian clock (as reported for example in cyanobacteria). Since the absolute amount of total proteins has to approximately double during a cell cycle (for cell size homeostasis), this can create a periodic signal in protein counts with a 24-hour period.

      The same reasoning does not hold true if the measurement is normalized, as in the FPKM case.

      The authors should discuss this issue or simply show that the results for proteins are robust if the protein count is normalized (for example with respect to the total protein amount).

      We haven’t focused the present manuscript on these issues since we recently published another paper which addresses these points: https://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1007666

      We have now added some details of our previous results in the main text to make the work more relevant.

      • The expression cost defined in the manuscript seems dominated by the expression level.

      It would be useful to report the scatter plot and the correlation level of cost versus average expression. A high correlation between these two quantities can largely recapitulate the results in Figure 2 (even though the results presented are still interesting per se). In other words, the relation between cost and rhytmicity sounds like a simple rephrasing of the relation between average expression level and rhythmicity (previously reported as correctly referenced in the manuscript).

      We now provide these results in Fig. S2 (Supplementary figures) and show a negative and significant correlation between the order of the rhythmicity signal and the total expression cost (calculated from the mean expression level). Since our previous benchmark show that the order of genes from most to less rhythmic genes is not very reliable for known methods, including the one used here, we prefer to present this result in the Supplementary figures document.

      • The empirical observation of a relation between noise and rhythmicity in mRNA expression is interesting, but we cannot fully understand its link with the theoretical arguments proposed.

      The Authors suggest that perodicity in mRNA expression could decrease protein noise at the peak of mRNA expression (Fig.S1). But this is not what they can measure in the single-cell data analyzed, where cell-to-cell variability is reported at a single timepoint for a cell population. If the oscillations are not syncronized in the cell population, an oscillating transcript would simply display a high cell-to-cell variability dominated by the amplitude of oscillations. Even if the oscillations are syncronized, there is no information in the dataset about the mRNA dynamics. Thus, mRNA cell-to-cell variability could have been measured at any point of its (putative) cyclic dynamics.

      Thus, we propose to make more clear the connections between the theoretical arguments and the empirical observation about noise in gene expression.

      Thank you for pointing out this issue. We have clarified the following in the main text:

      These considerations lead to predictions which we test here: i) a decreased stochasticity strategy for genes with rhythmically accumulated mRNAs ...**.

      • These considerations lead to predictions which we test here: i) a strategy to periodically decrease stochasticity for genes with rhythmically accumulated mRNAs .... Assuming that genes with low noise have noise-sensitive functions (and thus noise is tightly controlled), these results support the hypothesis that noise is globally reduced thanks **to rhythmic regulation at the transcriptional level.

      • Our results show that noise is globally reduced for genes with rhythmic regulation at the transcriptional level. Since rhythmic genes are not all in the same phase (Fig. S9a in Supporting information), we expect this result obtained for a given time-point (noise estimation based on a single time-point scRNA dataset) to be general to all time-points (section 6.3 in Supporting information). Assuming that genes with low noise have noise-sensitive functions (and thus noise is tightly controlled), these results suggest that rhythmic genes have their noise periodically and drastically reduced through periodic high accumulation of their mRNAs.

      • Thus, since we find lower noise among rhythmic transcripts, rhythmic expression of RNAs might be a way to periodically reduce expression noise of highly expressed genes (Figure 2 and Fig. S1-S2), which are under stronger selection. Indeed, we found that genes with rhythmic transcripts are under stronger selection, even controlling for expression level effect. As proposed by Horvath et al. (2019) and supported by results in mouse by Barroso et al. (2018) genes under strong selection could also be less tolerant to high noise of expression. Thus, periodic accumulation of mRNAs might be a way to periodically reduce expression noise of noise-sensitive genes (Fig 1c), i.e. genes under stronger selection. **However, our results are limited by the fact that noise estimation is based on a single time-point measurement since no scRNA time-series data are currently available for these species. Since the peak time of rhythmic transcripts is distributed across all times (Supporting Information Fig. S9a), the mean noise estimated at a given time-point includes the noise of the genes that are peaking at that time (lowest noise) and all the others that have a higher noise than those at their own peak time-point (Supporting Information Fig. S9b). Our results suggest that rhythmic genes peaking at the time-point of the scRNA measurement have sufficiently low noise for the mean noise of rhythmic genes to be much lower than that of non-rhythmic genes.
        • As a simple additional test of robustness of the rhythmic gene selection, biological replicates can be used, although this would not resolve the possible bias discussed above. As explained by the Authors, some of the datasets analyzed have biological replicates. It would be interesting to know the robustness of the detection method across replicates. How much is the set of genes identified as rhythmic conserved if estimated on different replicates? Spearman correlation or simply the overlap between the sets (maybe assessed with a hypergeometric test) can be used.

      These points have been already addressed in our 2020 paper https://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1007666 (paragraph “The importance of having an informative dataset”) as well as in recent guidelines (Hughes et al. 2017). We specified in Methods that we considered replicates as new cycles as recommended.

      Minor comments:

      • The claim that "transcriptional noise is known to be the main driver of overall expression noise", which is present in the discussion is questionable.

      For example, the quantitative large-scale dataset referenced by the Authors for E.coli (Taniguchi et al) shows instead that the dominant source of noise is extrinsic for many of the genes tested.

      We have clarified in the main text that by “main driver of the overall noise” we refer to the relative contribution of transcriptional versus translational noise into the overall noise.

      We have also added the section 6.1 into Supporting Information document:

      • Relatively to translational noise, transcriptional noise is the main driver of the overall noise (Raj and van Oudenaarden 2008) and should give a good estimation of the output noise. Indeed, based on estimations of coefficient of variations (CV, cell-to-cell variations of protein level) for diverse transcription and translation rates in E. coli and S. cerevisiae, Hausser et al. (2019) have shown that for a fixed transcriptional rate, CV is almost constant for diverse translational rates. Thus, changes in protein level have little to no impact on gene expression noise. The availability of mRNA molecules seems to drive the final noise. I.e., comparatively to the noise caused by the translational activity, the availability of low number molecules such as transcriptional factors (subject to the stochasticity of diffusion and binding in the cell environment) is the main factor of the output cell-to-cell variation in protein abundances. And have modified the main text:

      Indeed, transcriptional noise, which we measure here, is known to be the main driver of overall expression **noise (Raj & van Oudenaarden 2008).

      • Relatively to translational noise, transcriptional noise is the main source of the overall noise (Raj & van Oudenaarden 2008) (section 6.1 in Supporting information) In addition, highly expressed proteins are all precisely expressed and they display little variation in noise (also shown by Hausser et al. (2019) who reused Taniguchi et al. (2010) data). The noise of these highly expressed proteins is also just above a limit which is the noise floor. This "noise floor" is dominated by extrinsic noise as suggested by Hausser et al. and Taniguchi et al.: “The extrinsic noise in the last three terms in Eq. 4 (of the noise floor) might originate from fluctuations in cellular components such as metabolites, ribosomes, and polymerases and dominates the noise of high copy proteins” (Taniguchi et al.). Thus, highly expressed proteins are precisely expressed and their residual noise is similar to the noise floor, which is due to the extrinsic noise (imperfect synchrony of cell states inherent or due to the environment).
      • We suggest to avoid explicit statements about a causal link between expression level and rhythmicity, as in the caption title of Figure 2. A detected correlation is not a proof of a causal relation.

      We have corrected the sentence as follows:

      Rhythmic proteins are costly proteins due to their high level of expression.

      • High level of expression is the main factor explaining the higher cost observed in rhythmic proteins.
        • Supplementary Figures attached at the end of the main text and Supplementary Figures in the Supporting Information file have the same numbering...so there are two different versions of Fig.S1 S2 etc.

      This complicates the work of the reader.

      We have modified the numbering of figures to make them easier to follow.

      -The legend of Fig 2 is missing (the legend is instead reported in Fig.S1).

      This is now corrected, thank you for your attention

      Other modifications:

      We also show how cost can explain the tissue-specificity of rhythmic gene expression. Indeed, the nycthemeral transcriptome has long been known to be tissue-specific (Zhang et al. 2014, Boyle et al. 2017, Korenˇciˇc et al. 2014), i.e. a given gene can be rhythmic in some tissues, and constantly or not expressed in others.

      • Furthermore, the nycthemeral transcriptome has long been known to be tissue-specific (Zhang et al. 2014, Boyle et al. 2017, Korenˇciˇc et al. 2014), i.e. a given gene can be rhythmic in some tissues, and constantly or not expressed in others. Here, we provide a first explanation for the tissue-specificity of rhythms in gene expression by showing that genes are more likely to be rhythmic in tissues where they are specifically highly expressed.
    1. Abstract

      Reviewer 1. Joon-Ho Yu Thank you for the opportunity to review this manuscript. Overall, I appreciate this argument for and description of Open Humans.  Broadly, the manuscript would benefit from greater attention to writing and organization. As my comments describe below, the "ethical analysis" offered is narrowly focused and appears to serve as a justification for the resource; yet, in its current state, I think the ethical analysis either should be removed or expanded. Ideally, the manuscript would be strengthened by a deepening and broadening of ethical considerations. Note that I use P(page)C(column)L(lines) to locate my comments for the authors.

      1. Abstract P1L36-37.  I am struck by the framing of this ethical problem as the responsibility of data subjects.  I assume this is intentional and would appreciate a little more, perhaps in the introduction, as to what is entailed in this responsibility?
      2. Abstract P1L42-43. I am not sure if the framing of the ethical problem is resolved by the description of the utility of Open Humans.  While overall, I suggest deepening the ethical problems presented, another alternative is to leave it out all together.
      3. P2C2L6-9. It would help me if parties were more clearly stated.  I think you mean researchers not research and it isn't clear to me that commercial data sources have interests but rather the companies that hold these resources do, right?
      4. P2C2 Participant Involvement.  It is unclear to me what the purpose of this section is.
      5. P2C1 Data Silos. Most of the descriptive language is written in the passive voice which I understand may be the norm but in my opinion, it unintentionally highlights how interests and responsibilities are dissociated or dis-located from stakeholders.  For instance, in the section on Data Silos, it remains unclear for whom Data Silos are a problem and whose interests have created and maintained these silos.  Again, this sort of analysis might help identify or locate solutions rather than only set up a problem that Open Human's solves.  My point here is that the developers of Open Humans need not rely on a somewhat limited ethical analysis to justify its existence and argue for its utility.
      6. P2C1L44-49. While I agree this is accurate reflection of the scope of literature, the issues raised by "big data" research now extend far beyond the common risks relayed in a consent process.
      7. P2C1L49-51. I agree that this is an important issue but this single statement citing Barbara Evans sounds a little like a strawman.  My sense is that through the efforts of many patient-driven organizations, patient and participant-driven research has increased a great deal in the past decade or so.  Perhaps this ought to be recognized especially given that many of the authors have been critical to the development of this movement.  Also, the next section on participant involvement seems at odds with the argument so some clarification might help readers understand the nuances.
      8. P2C2L53-61.  While I totally agree and appreciate these key points to the participant-centered approach to research, in all honesty, I did not come to these conclusions based on the above exposition.  I suggest moving this up as the scaffold for the introduction and reorganize based on these points.
      9. P3C1L30-36. These are the main points I think readers need in the introduction to help us understand the need for Open Humans.  I suggest you spend more time explaining these points and characterizing the evidence of these important assertions.
      10. P3C2L46-50. Could you explain the rationale behind this feature and briefly describe if more detailed information is conveyed about the IRB approval or review/determination?
      11. P4C2L25-27. This is an important statement, at least to me, but it would be helpful to reiterate how privacy is maintained, I'm assuming because its pseudonymous?
      12. P4C2L27-30. Again, what are the simple requirements?
      13. P5C1L58-C2L59. So what are the ethical implications of this use case?  I think an important point to highlight is that privacy may be a nominal issue with members of efforts like Open Humans as they often have a greater than average interest in research benefits than maintaining individual privacy. Further, I'm under the impression that personal privacy is less of a concern for many or rather our sense of what is private is changing.  Assuming I'm understanding the argument, what I'm confused about is that the ethical analysis presented in the background assumes that privacy is of central perhaps even sole concern.  Also, there are many other ethical issues that open humans both addresses possibly in a positive way and potentially raises as risks to members and even society.  So, I would welcome that analysis alongside this nice introduction to the platform or I would not rest the argument for the platform on a relatively narrow ethical frame.
      14. P6C2L16-21. Do you mean the public data are being used as training sets for the algorithms?  Are there any risks of bias based on these sorts of uses?
      15. P6C1L44-45. So are there any ethical issues related to the application of OAuth2 to these particular use cases or overall?  This isn't a trick question, I have no idea but would encourage the authors to consider based on their expertise.
      16. P7C2L9-11. Agreed, but does it also make it harder for bad actors to use these data?  It would be great if the authors could help us think about this potential trade off.
      17. P7C1 Discussion. I would like the authors to consider the following in the discussion and possibly the introduction. (1) Given that most people who engage in citizen science in the biomedical research space are likely to subscribe to the value of openness and sharing of samples, data, tools, etc., I wonder if focusing on privacy as key ethical barrier is on target and sufficient.  For instance, many of the challenges to genomic research  articulated by historically vulnerable populations have to do with offensive data uses, lack of control, lack of direct benefit, differential benefit based on SES, risks to groups, etc.  Again, a critical analysis of how this resource might increase or decrease such risks involved in citizen science would contribute to the larger project of extending citizen science or patient-led research to community-led research.  Of course, I understand this might been outside the bounds of this manuscript but that preclude some consideration. (2) I very much appreciate Open Humans as a tool that addresses the practical problem of bridging/linking/aggregating.  I have no problems with this argument yet I wonder if it is somewhat naive to assume that bridging as a practical benefit does not also risk other ethical challenges.  For example, the ease of bridging to pre-selected resources blurs the line between simply linking resources and advancing particular interpretations of the data, in fact, one's own data.  If I understand Open Humans, it is a tool that automates protocols for linking and sharing intended to facilitate citizen science and patient-led research.  The practical benefits are clear. But what are the risks associated with more automated linking and sharing?
      18. P7C2 Enabling individual-centric research and citizen science. This section is very helpful and references a number of mechanisms that begin to address, at least on an individual level, issues such as "to what uses", "control", "governance", etc.  I would love to either see this description expanded and moved up into the initial description of the resource (maybe before or around P2C2L57) and or these functional benefits better incorporated and explicated in the use cases.
      19. P8C1L13-16. It is unclear to me how it is "an ethical way" especially as it isn't clear to me what an "unethical way" would entail.   I think some pieces are presented but this argument could be much stronger and clearer.  I get that the benefits are assumed here to some extent, I've been in the same place when engaging in resource development, but perhaps a greater consideration of potential benefits and harms might help balance the focus on privacy and individual control.  Generally when we conduct ethical analysis we consider autonomy (where privacy sits), risks (as potential harms as well as increasingly benefits), and justice.  Notably. others might argue for other principles and values.  While such a comprehensive analysis isn't the focus of this manuscript, incorporating the insights of such an analysis would, in my opinion, strengthen the argument for Open Humans and signal/evidence robust consideration by its designers and authors.
    1. The environment you construct around you and thechildren also reflects this image you have about thechild.

      This sentence really resonates with me. I think about the classroom environment and how it's set up. If we view the child as independent thinkers and in control of their learning the space should be set up to reflect that. Such as; are children able to freely move around to make independent choices on what they're investigating? Are all materials easily accessible for the children? Is their learning displayed in the classroom so that they may reflect on their previous experiences?

  8. feralatlas.supdigital.org feralatlas.supdigital.org
    1. A Story Begun Wislawa Szymborska The world's never ready For the birth of a child. Our ships are still not back from Windland. Ahead of us lies the Saint Gothard pass. We must outwit the guards on the desert of Thor, Fight through the sewers to Warsaw's centre, Win an audience with King Harald, And wait for the fall of Minister Fouche. Only in Acapulco Can we begin again. Our supplies are exhausted, Of matches, engine spares, reasons, and water. We have neither trucks, nor the blessing of the Mings. With this thin horse we'll never bribe the sheriff. There's no news of the Tartars' captives. We've no warm cave for winter, Or anyone who speaks Harari. We don't know who to trust in Nineveh, What the Cardinal will demand, Or whose names lie in Beria's files. They say Charles the Hammer will strike at dawn. So we must appease Cheops, Volunteer - of our own free will, Change our faith, Pretend we're friends of the Doge And that nothing links us with the Kwabe tribe. It's time to light the fire, Send a message to grandma in Zabierzow. And take down the tents. May the birth be easy, And the child grow strong. Let him take what happiness he can, Leap the abysses, Have strength to endure, And think far ahead. But not so far, As to see the future. From that one gift, O heavenly powers, Spare him.
    1. Reflection Blogfor Digital Writing(80pointstotal)Blogging is one of the most common social media practices. This assignment will enable you to gain familiarity with blogging as a practice, gain skill in digital writing, andoffer an opportunity for you to reflect onwhat you are learning about thetopics discussed in class. Reflection is an important part of learning because it allows you to processand think deeply aboutwhat you are learning and how you feel about it. You will create a personal blogto record your reflections (thoughts, ideas, perspectives, things that puzzle you, etc.)using any blogging platform of your choice, such as Medium or WordPress. And you will post at least FOURguided reflections in your blogthroughout the course. You willbe asked toprovide me with thelink and access to your blog. You may consider sharing it with your classmates as well (there will be opportunities to do so), or you can keep it more privateif you preferand only share it with me. Your posts will be assessedon contentquality, writingquality, and demonstration of evidence ofcritical thinking.

      Can these blog posts be about whatever we want? Or, do they have to be related to Social Media?

    1. Remember that in all this I am talking conceptual nervous system: making a working simplification, and abstracting for psychological purposes; and all these statements may need qualification, especially since research in this area is moving rapidly. There is reason to think, for example, that the arousal system may not be homogeneous, but may consist of a number of subsystems with distinctive functions (38). Olds and Milner's (37) study, reporting "reward" by direct intracranial stimulation, is not easy to fit into the notion of a single, homogeneous system. Sharpless' (40) results also raise doubt on this point, and it may reasonably be anticipated that arousal will eventually be found to vary qualitatively as well as quantitatively. But in general terms, psychologically, we can now distinguish two quite different effects of a sensory event. One is the cue function, guiding behavior; the other, less obvious but no less important, is the arousal or vigilance function. Without a foundation of arousal, the cue function cannot exist.

      Basically, without arousal a cue function can't exist. Cue function is a guiding behavior. The arousal system could consist of many subsystems that have their own functions. But again, without the arousal function you'd not have cue functions

    2. This experiment is not cited primarily as a difficulty for drive theory, although three months ago that is how I saw it. It will make difficulty for such theory if exploratory drive is not recognized; but we have already seen the necessity, on other grounds, of including a sort of exploratory-curiosity-manipulatory drive, which essentially comes down to a tendency to seek varied stimulation. This would on the whole handle very well the motivational phenomena observed by Heron's group. Instead, I cite their experiment as making essential trouble for my own treatment of motivation (19) as based on the conceptual nervous system of 1930 to 1945. If the thought process is internally organized and motivated, why should it break down in conditions of perceptual isolation, unless emotional disturbance intervenes? But it did break down when no serious emotional [p. 248] change was observed, with problem-solving and intelligence-test performance significantly impaired. Why should the subjects themselves report (a) after four or five hours in isolation that they could not follow a connected train of thought, and (b) that their motivation for study or the like was seriously disturbed for 24 hours or more after coming out of isolation? The subjects were reasonably well adjusted, happy, and able to think coherently for the first four or five hours of the experiment; why, according to my theory, should this not continue, and why should the organization of behavior not be promptly restored with restoration of a normal environment? You will forgive me perhaps if I do not dilate further on my own theoretical difficulties, paralleling those of others, but turn now to the conceptual nervous system of 1954 to ask what psychological values we may extract from it for the theory of motivation. I shall not attempt any clear answer for the difficulties we have considered -- the data do not seem yet to justify clear answers -- but certain conceptions can be formulated in sufficiently definite form to be a background for new research, and the physiological data contain suggestions that may allow me to retain what was of value in my earlier proposals while bringing them closer to ideas such as Harlow's (16) on one hand and to reinforcement theory on the other.

      While you'd think the prior experiment would help explain the exploratory, curiosity and manipulatory drive, but it did not. The experiment failed, as the subjects could not seem to concentrate well after 4-5 hours and had trouble even up to 24 hours after! With no emotional disturbances, this experiment shouldn't have failed, and yet it did. Perhaps pre 1954, we still don't have enough information to really understand c.n.s and motivation.

    3. The phenomenon of work for its own sake is familiar enough to all of us, when the timing is controlled by the worker himself, when "work" is not defined as referring alone to activity imposed from without. Intellectual work may take the form of trying to understand what Robert Browning was trying to say (if anything), to discover what it is in Dali's paintings that can interest others, or to predict the out- [p. 247] come of a paperback mystery. We systematically underestimate the human need of intellectual activity, in one form or another, when we overlook the intellectual component in art and in games. Similarly with riddles, puzzles, and the puzzle-like games of strategy such as bridge, chess, and go; the frequency with which man has devised such problems for his own solution is a most significant fact concerning human motivation. It is, however, not necessarily a fact that supports my earlier view, outlined above. It is hard to get these broader aspects of human behavior under laboratory study, and when we do we may expect to have our ideas about them significantly modified. For my views on the problem, this is what has happened with the experiment of Bexton, Heron, and Scott (5). Their work is a long step toward dealing with the realities of motivation in the well-fed, physically comfortable, adult human being, and its results raise a serious difficulty for my own theory. Their subjects were paid handsomely to do nothing, see nothing, hear or touch very little, for 24 hours a day. Primary needs were met, on the whole, very well. The subjects suffered no pain, and were fed on request. It is true that they could not copulate, but at the risk of impugning the virility of Canadian college students I point out that most of them would not have been copulating anyway and were quite used to such long stretches of three or four days without primary sexual satisfaction. The secondary reward, on the other hand, was high: $20 a day plus room and board is more than $7000 a year, far more than a student could earn by other means. The subjects then should be highly motivated to continue the experiment, cheerful and happy to be allowed to contribute to scientific knowledge so painlessly and profitably. In fact, the subject was well motivated for perhaps four to eight hours, and then became increasingly unhappy. He developed a need for stimulation of almost any kind. In the first preliminary exploration, for example, he was allowed to listen to recorded material on request. Some subjects were given a talk for 6-year-old children on the dangers of alcohol. This might be requested, by a grown-up male college student, 15 to 20 times in a 30-hour period. Others were offered, and asked for repeatedly, a recording of an old stock-market report. The subjects looked forward to being tested, but paradoxically tended to find the tests fatiguing when they did arrive. It is hardly necessary to say that the whole situation was rather hard to take, and one subject, in spite of not being in a special state of primary drive arousal in the experiment but in real need of money outside it, gave up the secondary reward of $20 a day to take up a job at hard labor paying $7 or $8 a day.

      Seems that the author is saying that as long as we are choosing to work, we will pick that over other things.

      An experiment that was done by Bexton, Heron, and Scott where they paid college students (around 20$) to do nothing, showed that at first those students were content for a period of time, but that the longer they did nothing the less happy they became. Then they would start asking for some sort of stimulation (music, talking to others etc.). These students found this very fatiguing, and some actually left the experiment giving up the 20$ a day! I think this shows that we as humans need interaction of some sort, we need some sort of stimulation to keep our brains active and happy, give it something to focus on.

    4. First, we may overlook the rather large number of forms of behavior in which motivation cannot be reduced to biological drive plus learning. Such behavior is most evident in higher species, and may be forgotten by those who work only with the rat or with restricted segments of the behavior of dog or cat. (I do not suggest that we put human motivation on a different plane from that of animals [7]; what I am saying is that certain peculiarities of motivation increase with phylogenesis, and though most evident in man can be clearly seen with other higher animals.) What is the drive that produces panic in the chimpanzee at the sight of a model of a human head; or fear in some animals, and vicious aggression in others, at the sight of the anesthetized body of a fellow chimpanzee? What about fear of snakes, or the young chimpanzee's terror at the sight of strangers? One can accept the idea that this is "anxiety," but the anxiety, if so, is not based on a prior association of the stimulus object with pain. With the young chimpanzee reared in the nursery of the Yerkes Laboratories, after separation from the mother at birth, one can be certain that the infant has never seen a snake before, and certainly no one has told him about snakes; and one can be sure that a particular infant has never had the opportunity to associate a strange face with pain. Stimulus generalization does not explain fear of strangers, for other stimuli in the same class, namely, the regular attendants, are eagerly welcomed by the infant. Again, what drive shall we postulate to account for the manifold forms of anger in the chimpanzee that do not derive from frustration objectively defined (22)? How account for the petting behavior of young adolescent chimpanzees, which Nissen (36) has shown is independent of primary sex activity? How deal with the behavior of the female who, bearing her first infant, is terrified at the sight of the baby as it drops from the birth canal, runs away, never sees it again after it has been taken to the nursery for rearing; and who yet, on the birth of a second infant, promptly picks it up and violently resists any effort to take it from her? There is a great deal of behavior, in the higher animal especially, that is at the very best difficult to reduce to hunger, pain, sex, and maternal drives, plus learning. Even for the lower animal it has been clear for some time that we must add an exploratory drive (if we are to think in these terms at all), and presumably the motivational phenomena recently studied by Harlow and his colleagues (16, 17, 10) could also be comprised under such a drive by giving it a little broader specification. The curiosity drive of Berlyne (4) and Thompson and Solomon (46), for example, might be considered to cover both investigatory and manipulatory activities on the one hand, and exploratory, on the other. It would also comprehend the "problem-seeking" behavior recently studied by Mahut and Havelka at McGill (unpublished studies). They have shown that the rat which is offered a short, direct path to food, and a longer, variable and indirect pathway involving a search for food, will very frequently prefer the more difficult, but more "interesting" route. But even with the addition of a curi- [p. 246] osity-investigatory-manipulatory drive, and even apart from the primates, there is still behavior that presents difficulties. There are the reinforcing effects of incomplete copulation (43) and of saccharin intake (42, 11), which do not reduce to secondary reward. We must not multiply drives beyond reason, and at this point one asks whether there is no alternative to the theory in this form. We come, then, to the conceptual nervous system of 1930 to 1950.

      Some of the theories early on did not explain reactions of higher functioning animals such as Chimpanzees. For example taking an infant from its mother because the mother abandons it, and then that same mother having a second infant, and refusing to give it up. To reduce drives to simple hunger, pain, sex, and maternity and learning is difficult as it does not explain all drives or motivations. Especially when the subject has never been exposed to an object/person/thing that causes a reaction. Thus a new drive would need added, curiosity drive which could explain investigatory and manipulatory activities. Why an animal would take a more difficult (although interesting) path to get food.

    1. This article is a preprint and has not been certified by peer review [what does this mean?]. Jaclyn Smith 1University of OxfordFind this author on Google ScholarFind this author on PubMedSearch for this author on this siteORCID record for Jaclyn SmithFor correspondence: jaclyn.smith@cs.ox.ac.ukYao Shi 1University of OxfordFind this author on Google ScholarFind this author on PubMedSearch for this author on this siteMichael Benedikt 1University of OxfordFind this author on Google ScholarFind this author on PubMedSearch for this author on this siteMilos Nikolic 2University of EdinburghFind this author on Google ScholarFind this author on PubMedSearch for this author on this site

      This work has been peer reviewed in GigaScience, which carries out open, named peer-review. These reviews are published under a CC-BY 4.0 license and were as follows:

      Reviewer 1: JianJiong Gao

      In this manuscript, the authors introduced a tool named TraNCE for distributed processing and multimodal data analysis. While the topic and tool are interesting, the writing can be improved. The current manuscript reads more like a technical manual than a scientific paper.

      For example, in the background, the discussion on data modeling in the contexts of multi-omics analysis and distributed systems is extensive, but the writing can be better organized. The examples are helpful, but they are very technical and can be hard to follow. It would be good if the main challenges can be summarized on a high level. It might also be useful to have an example analysis use case to lead the technical discussion on data modeling.

      It is also unclear how are the targeted users of the tool and why distributed computing is needed. For example, in application 1 & 2, it is unclear why distributed computing is necessary.

      Reviewer 2. Umberto Ferraro Petrillo First review:

      The authors propose a new framework, called TraNCE, for automating the design of distributed analysis pipelines over complex biomedical data types. They focus on the problem of unrolling references between different datasets (which can be very large), assuming that these datasets contain complex data types consisting of structured objects containing collections of other objects. By using TraNCE, it is possible to formulate queries over collections of nested data using a very high-level declarative language. Then, these queries are translated by TraNCE in Apache Spark applications able to implement those queries in an efficient and scalable way. Apart from a quick description of the TraNCE framework and of the declarative language it supports, the paper also includes a vast collection of examples of multi-omics analyses conducted using TraNCE on real-world data. I found the contribution proposed by this paper to be very actual. Indeed, there is a flourishing of public multi-omics databases. But, their huge volumes make their analysis difficult and very expensive, if not approached with the right methodologies. Distributed analysis frameworks like Spark can be of help, but they are often not easy to be mastered, especially for those not having deep distributed programming skills. So, TraNCE looks like a very much need contribution on this topic. However, I have some remarks. The high-level querying language supported by TraNCE is not original because, as far as I understand, it has been presented in a previous paper [1] (which has been written by almost the same authors and that has been correctly referenced to in this submission). Even the TraNCE framework is not completely original because its name appears as the name of the project containing the code presented in [1]. Finally, at least one of the experiments presented in [1] seems to have been run on the same Hadoop installation used for the experiments presented in the current submission, and has involved the same datasets from the International Cancer Genome Consortium. So, I am a bit confused about what it is original in this new submission and what has been borrowed from [1]. My advice is to definitely clarify this point.

      Another issue that I think should be addressed is about the proposed framework being scalable. The authors state that the framework supports scalable processing of complex datatypes, however, no evidence is brought about this claim. The several different experiments that are reported seem to focus more on the expressiveness of the proposed language while no experiment about the scalability of the generated code is provided when run on a computing architecture of increasing size. I think we may agree on the fact that using Spark does not means that your code is scalable, neither I think it is enough to say that the scalability of TraNCE has been proved in [1]. So, I would suggest to elaborate also on this. To be honest, I am a bit skeptical about the practical performance of the standard compilation route. I think that when applied to very large datasets it is likely to return huge RDDs that could require very long processing times. Instead, the shredded compilation route looks much clever to me. Could you elaborate further on this difference, especially according to the results of your experimentations? I also disagree with your idea of not describing how data skewness is dealt with in your framework. It is indeed one of the main cause for bad performance of many distributed applications so it would be interesting to know how did you manage this problem in your particular case. On the bright side, I really appreciated the flexibility of the proposed framework, as witnessed by the vast amount of examples provided, as well as its positive implications on the analysis of multi-omics databases.

      Finally, the English of the manuscript is very good and I have not been able to find any typos so far.

      [1] Jaclyn Smith, Michael Benedikt, Milos Nikolic, and Amir Shaikhha. 2020. Scalable querying of nested data. Proc. VLDB Endow. 14, 3 (November 2020), 445-457.

      Re-review: I appreciated the robust revision done by the authors and think the paper is now ready to be published

    1. Author response


      September 9, 2021

      We would like to thank ASAPbio for selecting our preprint for review! We are excited to contribute to this new process and hope others will find it as helpful as we have. The comments generated by the “crowd” were detailed and thoughtful. Below we respond to the major discussion points and if there were specific reviewer comments relevant to the discussion point, we also included that statement. We also responded to each specific comment. We would love to continue this discussion, so we invite further feedback and responses! Thanks so much for your time.

      -Chelsea Kidwell, Joey Casalini, and Minna Roh-Johnson


      Major Discussion Point #1:One of the most important claims is that mitochondria are the organelles responsible for the activation of the signals of cell proliferation. However, a previous report by the last author reported that macrophages transfer cytoplasm to recipient cells. It cannot be excluded that other organelles or cellular fragments are transferred as well and contribute to the observed effects (ERK activity). Perhaps a good way to solve this would be the use of macrophages that are devoid of mitochondria. At least, this aspect should be discussed in the manuscript.

      🡪 We had first considered two approaches to test the requirement and sufficiency of macrophage mitochondria in cancer cell proliferation. The first was to generate rho-zero macrophages (mtDNA-deficient), as you mention in your comment, such that the macrophages did not have functional mitochondria. However, we use primary human macrophages for all of our studies, and these cells would not survive long enough to generate rho-zero cells (which requires that the cells be treated with low levels of ethidium bromide for weeks). The second is to biochemically purify mitochondria from macrophages and directly inject these mitochondrial preps into breast cancer cells. We actually did this experiment, and cancer cells injected with purified mitochondrial preps exhibited higher proliferation (by live timelapse microscopy) compared to control cells. However, we also found that the mitochondrial purifications were not clean, and contained other membranous components in the cytoplasm. We tried centrifugation-centric approaches, as well as IP-ing against a mitochondrially-localized tag, but in all cases, the mitochondrial preparations contained other cytoplasmic components. Therefore, we did not feel that this approach was an adequate way to test effects of specifically the mitochondria. We certainly wanted to discuss this aspect in the manuscript, but unfortunately, we were limited due to space. If folks have suggestions on how to best purify mitochondria, we’d love to know, so please reach out.

      However, in terms of the bigger question of whether the induced proliferation in cancer cells is specifically due to ROS accumulation in transferred macrophage mitochondria, we tried to address this question with the mito-KillerRed experiments, where we generate ROS using optogenetics, and ask whether this accumulation is sufficient to induce cancer cell proliferation (which we showed it was). We also showed that this same approach could induce Erk activity, and then in separate experiments, we show that macrophage mitochondrial transfer results in accumulation of ROS and increased Erk activity. We feel that these experiments support our conclusions, however, we’d love for a way to link it all together. Unfortunately, we are not convinced that such experiments are possible at this time.

      Major Discussion Point #2: Most of the positive examples of transferred mitochondria discussed appeared in a small clump. However, there also appears to be another population that was more diffuse and co-localizes with host mitochondria (e.g., Fig2B, bottom right panels). It would be helpful to show results of these sibling mitochondria for assays performed on their clumpy siblings. If they behave differently, it would be helpful to provide some explanation.

      Specific Comment: Figure 2 Majority (57%) of donated mitochondria do not colocalize with LysoTracker signal (N=24 cells, 4 donors) - Here the paper implies that some transferred mitochondria do co-localize with lysoTracker signal. More importantly, they co-localize with host mitochondria. It raises the question of whether they signal through ROS and ERK like their clumpy siblings who are in the limelight of most figures.

      🡪Yes, you are correct. There does appear to be a diffuse population of macrophage mitochondria. The majority of these mitochondria co-localize with lysotracker, suggesting that they are being actively degraded. We can’t say that they tend to co-localize with endogenous cancer cell mitochondria, however, it’s possible that this diffuse population is comprised of both mitochondria that are being degraded and mitochondria that are fusing with the endogenous network. We do not know if this population has a different effect on cancer cell behavior because we did not follow this population (mostly because once the mitochondria are degraded or fuse with the network, we can no longer follow those mitochondria!). However, we did follow cancer cells that contained punctate macrophage mitochondria. Often times this was the only population we could observe in the cell at that time, and this is the population in which we observe accumulated ROS.

      Major Discussion Point #3:The effects that are attributed to the transferred mitochondria are highly variable (figures 1F, 3A,E) and often due to a subpopulation of samples that show a few extreme values (e.g. figures 2D, 3E, S4B, S4D). This might be expected from effects that are caused by a single mitochondria (which has a small volume) that is transferred to a complete cell. This complicates the study of the transfer process and effects and should be discussed. Also, do the authors have ideas how to improve the system, to make it more robust and easier to study the effects?

      🡪The variability in the assays likely reflects the heterogeneity within the biology - Each experiment contains macrophages derived from primary monocytes that are harvested from different human blood donors! Due to the primary nature of these cells, we do expect a range of phenotypes as each donor would have a different genetic background and the monocytes were likely exposed to different environmental stimuli. In fact, even though working on this study was a giant pain due to the variability, we felt more confident about our findings because despite the heterogeneity in the system, we still observed consistent phenotypes. Below we indicate where we took a sample set and removed “outliers”, and ran the statistical tests again. The differences were still statistically significantly different, further suggesting robustness of our findings.

      However, we are always on the lookout for ways to make the system easier to study. One way that we will follow up on is using M2-like macrophages since they transfer mitochondria at a higher rate than unstimulated macrophages.

      Major Discussion Point #4: The authors conclude that the transfer of dysfunctional mitochondria generated a signal mediated by ROS that activates cell proliferation signals. The statement that "transferred mitochondria act as a signaling source that promotes cancer cell proliferation" is too strong. There is increased ROS production from mitochondria, yes, but an experiment in which ROS are decreased would be needed to properly sustain that conclusion. The title and abstract could be changed to better reflect the data.

      Specific Comment: ‘Furthermore, treatment with an ERK inhibitor (ERKi) was sufficient to inhibit ERK activity ‘- curious as to whether antioxidant treatment would reverse any proliferative phenotypes?

      🡪We wish we could quench the ROS at macrophage mitochondria. We really tried. We used a combination of ROS quenchers (NAC, mitoTempo, Tempo) and ROS readouts (mitoSOX, CellRox, DCFDA, and the 2 biosensors used in our study: Grx and Orp1), and treated cells for various amounts of time, and no matter what we tried, we could not reliably detect reduction of ROS levels in the host network or the transferred mitochondria (without killing the cells, that is). Another issue that we faced was that any pharmacological treatment would have a global effect on the mitochondrial network in the recipient cells and therefore it would not be possible to distinguish effects from global inhibition of ROS versus specifically at the site of the transferred mitochondria, and we certainly observed cell death upon treatment of ROS quenchers because of this fact. We talked to a couple of ROS experts, and they indicated that this issue is not unique to us, although we unfortunately did not have viable solutions, so if people have ideas or suggestions, please let us know!!

      However, despite our failed attempts at quenching ROS, the comment that "transferred mitochondria act as a signaling source that promotes cancer cell proliferation" is too strong of a statement… well, we don’t entirely agree given that we do perform sufficiency experiments in which weinduce ROS and observe both proliferation and ERK signaling, so we do feel reasonably justified to provide the title that we did. However, we will continue to mull over this comment. Thanks for sharing your thoughts.

      Major Discussion Point #5:The study may benefit from more direct evidence to support its conclusion of increased proliferation after mitochondrial transfer. While the RNA-seq, flow cytometry, counting of completion of cytokinesis and dry mass measurements provided in the present study do lend some support to the proliferation hypothesis, they all seem indirect. With the biomarkers labeling the mitochondria of donor and potential recipient cells, high content imaging and tracking of cells could be used to monitor cell division. A comparison of cell division rates of transfer-positive cells and transfer-negative cells will provide a more pertinent test of whether mitochondrial transfer promotes recipient cell proliferation.

      🡪We should probably do a better job at describing the dry mass measurements (QPI, quantitative phase imaging) because we view this quantification as one of the most direct measurement to monitor cell growth/division. The approach measures the changes in dry mass as the cells prepares for cell division. So not only do we get the final readout of division (complete cytokinesis), but we also get a measure of that growth rate (the cell getting ready to divide) before cytokinesis. This is why we are so tickled to collaborate with Tom Zangle’s lab because we could finally get a direct proliferation readout in real-time. We could also use this approach to follow thousands of cells at a time, a very critical aspect since mitochondrial transfer is rare event, and therefore, we need to follow many cells to have enough statistical power to quantify the growth rates. Check out some of the Zangle lab’s other papers (PMC5866559; PMC6917840; PMC4274116), and please let us know if you disagree with us!

      Major Discussion Point #6: The authors have used such a tracking-based approach on a very small scale (n=5) to measure daughter cell growth rate. However, the data do not show a statistically significant difference between the growth rates of daughters that inherited transferred mitochondria and those who did not (Fig S3). Increasing the case number via high content imaging would help obtain sufficient data points for a reliable statistical test. In addition, as suggested above, an accounting of the daughter cells' division rate for transfer positive and negative cells would provide another line of evidence to either prove or disprove the increased proliferation rate hypothesis. The same suggestion goes to the optically induced ERK activation experiments shown in Fig3F. It is also helpful to include references that studied how ERK signaling promotes proliferation and compare the evidence here with evidence or assays used in those studies as a benchmark.

      Specific Comment:Figure S3 - There is no statistical test to check for ‘increase in their rate of change of dry mass over time versus sister cells that did not inherit macrophage mitochondria’. What are the colours indicative of in S3B? Can this be reported in the figure legend.

      🡪You are right – the tracking-based approach on daughter cells is based on a small ‘n’. However, the tracking itself is performed on 1000s of cells. It’s just that in order to capture daughter cell data, we have to find a cancer cell with macrophage mitochondria (which is only ~1% of the population), and then follow that cell until it divides, and then follow BOTH daughter cells. So, even with the 1000s of cells that we followed, we could only capture a small number of daughter cells. The colors in S3B represent each individual triads – parent and 2 daughters. We will make this info clearer in the legend.

      In terms of the optically-induced ERK activation experiments, yes, it would be great to have a higher sampling. These experiments were performed at 63x so we could reliably draw small ROIs to mimic the size of a macrophage mitochondria. While we switched to lower magnification to follow cell division, we still were limited to only a few cells for the actual photoactivation. The technical aspects of this experiment were the reason for the low sampling. Despite these limitations though, we still observed increased cell division upon mito-killerred photoactivation, which we were honestly pretty surprised (and stoked) about.

      Other specific comments:

      -Figure S1A - The authors could perhaps use a more aggressive gating strategy here, clipping closer to the 231 population described in Fig S1A - picking only the center of the cluster in the upper left of the RFP vs CD11b plot would likely not affect results but make them more convincing by unequivocally excluding macrophages.

      -Figure 1D - Not sure about the 0.2% baseline assigned for the monoculture of cancer cells (that does not have the macrophages with the Emerald mitochondria). It is determined with cytometry - I am no expert on that topic, so maybe I missed something - but it looks weird to see some cells with transfer when there is a monoculture.

      🡪Due to the variable nature of the mito-mEm signal in the recipient cancer cells (i.e. transfer of one mitochondrion vs transfer of three), we found that an overlap of 0.2% set on a fully stained monoculture control was the most accurate way to gate for the recipient cancer cells. The final gating strategies used in our study were determined by FACS-isolating populations of interest based on several different gating strategies, and directly visualizing cancer cells with macrophage mitochondria without capturing macrophages or cancer cell/macrophage fusions (which is cool, but not what we wanted). To further clarify, there is no transfer occurring in the monoculture – the overlap of mEmerald signal into the transfer gate in that control sample is likely reflective of normally occurring autofluorescence. This is a very important point, so we will make this aspect clearer in the Methods section.

      -Figure S1B - Could perhaps be an interesting follow-up question for future works re: differences between cell lines and propensities to transfer mitochondria. Did the authors attempt to use other cell lines (ie, MDCK, HeLa, iPSCs, etc)?

      🡪Great question and something that we have also been thinking about. To date the only recipient cells we have used are 231, MCF10A, and PDxO cells. This would be a great avenue for future studies.

      -Figure S1B - Did the authors see an increase in growth rate in MCF10A line despite the lower growth rate?

      🡪We have not measured the growth rate in MCF10a recipient cells but something that would be great to follow up on in future studies.

      -‘physically separated from macrophages by a 0.4μM trans-well insert’ - should this read 0.4 micrometer?

      🡪Yes, great catch.

      -Figure S1F - The authors wrote that they used a two-way ANOVA analysis, could you report the factors used for that analysis in the Figure legend.

      🡪Noted!

      -Figure 1B - It is difficult to see the arrowheads in 1B, suggest moving them so they are not covering the magenta fluorescence, have them point from a different angle, and make them more brightly colored. Insets here would help the reader. A negative control image from a monoculture would also be helpful, to ensure the GFP signal is not an artifact of culture conditions.

      🡪Thank you for your feedback – we will take note of this.

      -Figure 1F - For graphs that do not show zero (as in 1F), the bar should be omitted. In these cases the length of the bar does not reflect the average of the data (as it does in 1D).

      -Figure 3C - Please omit bar, see comment on panel 1F.

      🡪 In the case of Fig 1F, we modified the y-axis to eliminate empty space. The bar is representative of mean of the data displayed in both 1D as well as 1F, but we can add a broken y-axis to help make this point.

      -Figure 1 - Given that these data are fractions of a population (ie. can be described via a contingency table), isn't something like a Fisher's exact test a better measure of significance here?

      🡪We think you are referring to Figure 1D? If so, we thought that we could not use Fisher’s exact test because that test assumed parametric distributions (which we do not observe). We have been working with a biostatistician for our statistics, but please do let us know if we have it wrong.

      -Single cell RNA- sequencing - In the methods section the authors mention doing a differential analysis between the cells that received the mitochondria and the cells that didn’t. It might be worth introducing a figure (a heatmap or a U-MAP) relating to this analysis. Single cell sequencing would not only affirm the heterogeneity between these two populations but also help in highlighting the novel cell surface markers associated with the two populations.

      🡪Yeah, good point – we can add a UMAP.

      -‘mito-mEm+ mitochondria remained distinct from the recipient host mitochondrial network, with no detectable loss of the fluorescent signal for over 15 hours’- It is surprising that the transferred mitochondria do (or cannot) fuse with the host 231 mitochondria.

      🡪We were also initially surprised to find that the transferred mitochondria do not fuse with the host 231 network! We think that the lack of fusion is due to the fact that the transferred mitochondria do not exhibit membrane potential (which is required for mitochondrial fusion). We also think that these results open interesting lines of questioning: Why are these depolarized mitochondria not degraded? Is this an active avoidance of the mitophagy pathway? How dynamic are these punctae? Many fun and interesting questions regarding the long-lived nature of these transferred mitochondria.

      -It is unclear in these images, but the 231 mitochondria appear fragmented too. Is it possible that the mitochondrial fusion machinery (Opa1 or Mfn1/2) are inactive?

      🡪231 cells are capable of fission and fusion (PMC7275541, PMC3911914, and in our own timelapse recordings), so we think that the machinery is functional. However, we don’t know whether the 231 mitochondrial machinery changes after receipt of macrophage mitochondria. Interestingly, the references above both investigate how mitochondrial dynamics promote tumor metastasis. A fascinating future direction could include an investigation to how macrophage mitochondrial transfer influences tumor cell mitochondrial dynamics.

      -Figure 2B - What does the MTDR staining of the macrophage mitochondria prior to transfer look like? Important to check this to confirm that only the transferred mitochondria had lower membrane potential.

      -‘significantly higher ratios of oxidized:reduced protein were associated with the transferred mitochondria versus the host network’-Here too, it would be important to check the mito-Grx1-roGFP2 readout of macrophage mitochondria prior to transfer.

      🡪The way that these comments are written is as if we already know that the mitochondria are dysfunctionalbefore transfer to cancer cells. But we actually do not know if that is the case. It’s also possible that macrophage mitochondria become dysfunctional once they are in the cancer cell, which would be equally cool. So, we are actively investigating this biology.

      -Figure 2A, 2BB and S1D - How were the colocalizations assessed? Was it just a visual assessment? Given the importance of these experiments for the whole story, having a quantification of the level of colocalization with each dye would be important.

      🡪This is a good point and it should be straightforward to include a Pearsons coefficient for these markers.

      -Figure S1D - The paper makes an argument about mitochondria transferred from Macrophages (marked green) having positive DNA stain (gray), but appearing depolarized (negative TMRM stain). The image in FigS1D is peculiar, as the majority of the 231 cells' mitochondria appear to not have any DNA stain but maintain membrane potential (positive in TMRM), while some (just above the green macrophage mitochondria) do have both DNA stain and membrane potential. The authors might want to clarify whether this is a typical scenario, and if so perhaps offer an explanation as to why the 231 mitochondria exhibit such heterogeneity.

      🡪The images in S1D are of a single z-plane image therefore the DNA signal in the endogenous network is more readily visible in planes that are not shown.

      -‘we confirmed that 91% of transferred mitochondria were not encapsulated by a membranous structure, thus excluding sequestration as a mechanism for explaining the lack of degradation or interaction with the endogenous mitochondrial network’ - This is based on co-staining with MemBrite 640/660, which is a dye that "covalently labels the surface of live cells", thus there is a concern as to whether this approach allows to study whether the mitochondrium is encapsulated by an endomembrane.

      🡪Thank you for your feedback. We actually do think that Membrite can label endomembrane in addition to the plasma membrane. This is from the published Membrite protocol: “MemBrite™ Fix dyes are designed to be fixed shortly after staining, when they primarily localize to the plasma membrane/cell surface. Cells also can be returned to growth medium and cultured after staining, however, dye localization in live cells changes over time. Labeled membranes become internalized, so staining gradually changes from cell surface to intracellular vesicles, usually becoming mostly intracellular after about 24 hours. Internalized MemBrite™ Fix dye is usually detectable for up to 48 hours after staining, though this may vary by cell type”.

      In our hands, we found that the dye started to become internalized and labeled vesicles within the cell within a few hours of staining. The images in the panels that you refer to came from time-lapse imaging experiments of between 10-15 hours, therefore the cells have internalized the MemBrite signal allowing for the visualization of internal vesicles. Also, in other studies not in the preprint, we perfused purified mitochondrial preparations onto 231 cells. The 231 cells took up the mitochondria from the environment, and all of these engulfed mitochondria were surrounded by a MemBrite positive membrane! These results further suggest that if the transferred mitochondria were encapsulated by a membrane, we would be able to visualize it.

      _-‘macrophage mitochondria are depolarized but remain in the recipient cancer cell’ -_Did the authors examine the extent of cancer cell death in their co-culture system (due to the activation of apoptosis by the depolarized mitochondria)?

      🡪We do not find any evidence of abnormal levels of cell death by both flow cytometry assays as well through our QPI image analysis.

      -Figure 2C–D - Like in Fig 2B, in the bottom left of panel of Fig 2C there are a lot of donor mitochondria not in highly oxidized state and the growth/proliferation phenotypes apply mostly to donor mitochondria that appear 'clumpy'.

      -Perhaps it is worth commenting on whether there is a link between donor mitochondrial morphology and the suspected proliferation-enhancing phenotype.

      🡪The images in Fig. 2C are of the same cell – a single recipient cancer cell which is expressing the Grx biosensor. The donor mitochondria are labeled with an arrowhead, the rest of the yellow/green signal (bottom right) is from the endogenous host network and therefore we do not expect it to be in a highly oxidized state (ie. more yellow than green).

      Regarding the mito morphology and proliferation – great question, and one that we are actively working on!

      -‘At 24 hours, we observed a similar trend, but no statistically significant difference (Fig. S4D). These results indicate ROS accumulates at the site of transferred mitochondria in recipient cancer cells’ - if a specific sensor fails to show a significant oxidation at 24 hours compared mito-Grx1-roGFP2 which reports on mitochondrial glutathione redox state, does that mean there are ROS independent ways to oxidize Glutathione? The authors did see cell growth phenotype both in 24 and 48 hours which suggests that something is happening in 24 hours despite no significant difference in ROS H2O2 sensor.

      🡪The additional biosensor that we used – mito-Orp1-roGFP2 - has been engineered to be a readout of one type of ROS – H2O2. The Grx probe is a surrogate for ROS of any type, of which there are many! To us, it is not completely unexpected that they would behave differently over time since they are readout for two separate things, and it generates an interesting possibility that different types of ROS accumulate over time. Given that the Grx probe shows an increase at 24 hours, which is when we observe the proliferation phenotype, we think we are on the right track. If you have ideas on robust ways to directly observe specific types of ROS, we would love to know!

      -The differences in ratio for the two sensors used are not very convincing. In Fig 2D and Fig S4B and D the “host” and “transfer” populations are very similar. The difference seems only due to the presence of a few outliers in the “transfer” populations. More importantly, sometimes it seems that these outliers come mostly from one donor rather than being present in all 3 donors. It could be good to show histograms of the two populations for each replicate/donor and maybe redo the stats excluding these outliers.

      🡪We think that the heterogeneity that is observed is due to the biology in the system – we are using primary macrophages derived from blood donors. However, for the data represented in Fig 2D, just as a test case, we took out the top four “outliers” in that data set and re-ran the Wilcoxon matched-pairs signed rank test and the p-value was 0.0010 (***), further suggesting that the ROS biosensors are revealing consistent and robust results.

      -Figure S5C - it seems like the percentage of cells that divided is the same for unstimulated cells and cells with stimulated mito-KillerRed. Isn't this contrary to the expectation? The figure shows that photobleaching cytoplasm decreased % cell division, which is puzzling.

      🡪The mean percent of cells that divided in unstimulated and mito bleach are very similar and was not significantly different. One point to be made that may not be well illustrated in our graphical representation is that if you look at the matched data (points connected are averaged per FOV for each condition in the same experiment) the trend shows that the mito bleach does seem to have an increase in cell division which is washed out with the average bar overlay. We should note that this experiment is very “noisy” and therefore we needed a lot of N to be able to detect significant changes. We are currently thinking about other ways to demonstrate sufficiency as it relates to cell proliferation – any experimental suggestions would be very welcome! Thanks for the feedback.

      -Figure 3A - In the 'cyto' condition 6 out of 13 fields have no cells that divide. Is that expected? What is the percentage of dividing cells for cells that were not illuminated at all (a control that is lacking)? There is large variation, ranging from 0% to 22%. The evidence that illumination of KillerRed leads to increased proliferation is rather weak. Also, since Cyto and Mito are different cells, is a "paired" statistical test the right kind of test to use here?

      🡪Additional data pertaining to Fig. 3A can be found in Fig. S5C, which includes the control for cells not illuminated at all. Having no cells that divide in a field of view is not surprising to us – the doubling time for these cells is ~35 hours, and we imaged for 18 hours. Also, for each field of view, our ‘n’ for each field of view was often 6-8 cells because we performed these experiments at 63X to allow for accurately drawn regions of interest for photoactivation. We also internally controlled every experiment (each experiment consisted of fields of view that had either mito activation, cyto activation, or no-activation controls, all of which were imaged overnight with multiple x/y positions). Cells that left the field of view over the 18 hours of imaging could not be quantified. It’s this sampling that caused the large variation in the graph. But again, as with many of our experiments, despite this variability, we still observe a significant difference in our experimental conditions over control cyto bleach. As for the statistical test, our understanding is that given each experiment is internally controlled, and we compare within each experiment, a paired statistical test is appropriate here. We will consult with our biostatistician to confirm, though.

      -‘ROS induces several downstream signaling pathways’ - We would not expect the authors to investigate every signaling pathway, but wonder if the PI3K pathway was explored? It seems to be the other major cancer/proliferative pathway induced by ROS.

      🡪Yes, this is a very good point! We actually assessed three different pathways at first – ERK, PI3K-AKT, and NLRP3/inflammasome. While analyzing these 3 pathways simultaneously, we discovered that ERK inhibitors resulted in decreased proliferation in cancer cells with macrophage mitochondria. As a result, we then focused on the ERK pathway. We still do not know if PI3K-AKT or NLRP3/inflammasome pathways play a role in this biology because we have not gone back and revisited these experiments yet, however in figure 3F, ERKi treated recipient cells exhibit a partial ‘rescue’ of baseline proliferation. This suggests that other pathways may indeed be involved and we plan to investigate this possibility.

      -‘Recipient 231 cells had significantly higher cytoplasmic to nuclear (C/N) ERK-KTR ratios compared to cells that did not receive transfer’-Since two different quantification styles with opposite fraction values were used, is it possible to please specify which one was used here.

      🡪Will do!

      -Figure 3B - Please show the outlines of the nuclei and that of the cell.

      🡪That would be helpful, wouldn’t it? Will do!

      -Figure 3D - it is peculiar that ERK-KTR in Fig 3D is so strongly cytosolic while in Fig 3B it is almost exclusively nuclear. If this sensor behaves differently in different situations, the authors may want to comment on how that would affect their conclusions.

      🡪The panels in Fig. 3B were taken with the ImageStream flow cytometer which takes a lower resolution image of a single plane of a cell in suspension in the flow stream. In Fig. 3D, those images are from confocal spinning disk microscopy which allows for higher resolution, z-stack images of adherent cells on glass. Therefore, we think the differences that you point out are likely due to the fact that the two images come from very different imaging systems.

      -Figure 3E - The effect of 'opto-induced' ERK activity is weak. The initial ERK-KTR is 1 at time point zero (as the data is normalized to this timepoint) and around 1 for both the cyto and mito condition. A statistical difference is observed, but the effect is minor and it is unclear whether it is biologically meaningful. The 'cyto' condition shows an average below 1 and the mito condition remains 1, suggesting that ERK activity remains constant when ROS are produced in the mitochondria.

      -Also from S8C and 3E it appears cyto actually shows a decrease rather than mito showing an increase, could the authors comment on this?

      🡪We have a few thoughts on this. The first is that we don’t expect a dramatic change in ERK signaling because the ROS accumulation is localized to a small region in the recipient cell. This is not a situation where we would expect a large-scale change because we are adding a growth factor. We can understand that the change in ERK activity may appear to be minor, but our data suggest that these subtle changes in kinase signaling translate into significant changes in downstream behavior – proliferation. The way that we interpret differences as “biological meaningful” is whether they exhibit a functional response, and in our study, we show that inhibiting the induction of ERK activity in cancer cells with macrophage mitos inhibits proliferation. What is most interesting to us is that cancer cells that do not have macrophage mitochondria have an unchanged fraction of cells in G2/M phase of the cell cycle in response to the concentration of ERK inhibitor we used, suggesting that the ERK inhibition specifically blocks macrophage mitochondria-induced proliferation.

      In Fig. S8C, bleaching a region of cytoplasm does seem to cause a decrease in ERK activity over time. We really can’t explain this result. However, we do think that ERK activity is higher in mito-bleached cells because mt-ROS is generating an increase in ERK activity which compensates for the decrease in activity that occurs when the cytoplasmic region of interest is photobleached. It’s still a head scratcher, though, but we did perform internal controls for every experiment (as we describe above), and the mito-bleach, cyto-bleach, and no-bleach conditions were run side-by-side such that we can make apples-to-apples comparisons.

      -‘patient-derived xenografts (PDxOs)’ - As a control it would be relevant to include a normal mammary organoid model perhaps from the same patient to demonstrate that the transfer of mitochondria specifically to the cancer cells is more beneficial.

      🡪Using a normal mammary organoid cells as a control to compare efficiency of transfer and downstream phenotypes would be very interesting. Due to the fact that these are patient-derived organoids, we are unable to acquire non-malignant cells from the same patient. Expanding our studies in the MCF10A cell line that we utilized in this paper would be an alternative to what you propose and would also expand our understanding of general biology underlying mitochondrial transfer.

      -‘macrophages to both HCI-037 and HCI-038 PDxO cells (Fig. 4G)’ - Why is M0 able to transfer efficiently to HCL-037 tumour when its mitochondrial network is less fragmented as M2?

      🡪These results really stood out to us. It was quite surprising that in HCI-037, both M0 and M2 macrophages were able to transfer their mitochondria at similar efficiencies, but in HCI-038, M2 macrophages were more efficient at transfer. HCI-037 is a primary tumor, and HCI-038 is a metastases from the same patient, so there are some exciting avenues of study to examine how macrophage mitochondria transfer differs at the primary versus metastatic site. There is still very little known about how donor cell dynamics influence mitochondrial transfer!

      -Are mito transfer from M0 depolarised and accumulate ROS or show increased ERK activity or increased cell proliferation?

      🡪Yes – all studies, except studies pertinent to fig 4 (where we assessed macrophage differentiation states), were done with M0 macrophages.

      -‘M2-like macrophages preferentially transferred mitochondria to the bone metastasis PDxO cells (HCI-038) when compared to primary breast tumor PDxO cells (HCI-037)’ -The authors may want to check this statement here as it is in consistent with their data plot. In Fig. 4G, M2/PDxO transfer percentages for HCI-037 and HCI-038 are about the same, unless the authors provide statistical tests to prove otherwise. Instead, M0 appears to transfer mitochondria to HCI-037 much more efficiently than it does HCI-038.

      🡪Upon re-reading our sentence again, we now realize that it’s actually quite poorly written, so we can understand the confusion! What we meant to articulate is that M2-like macrophages are better at transferring mitochondria to HCI-038 than M0 macrophages. Whereas in HCI-037, we do not observe the same preferential transfer (ie. M0 and M2 can transfer at the same efficiency). We will certainly clarify this language in the manuscript.

      -‘M2-like macrophages exhibit mitochondrial fragmentation’ - Is there a correlation between the status of the mitochondrial network in the donor and the % of transfer to the recipient? If so, this would be a correlation that would support the conclusions.

      🡪Yes, please see Fig. 4C for transfer rates with different donor subtypes and Fig. 4H for a general working model on how we think these data fit into the larger picture.

      -‘accumulate ROS, leading to increased ERK activity’ - Did the authors obtain similar results with the PDXOs? It would be an interesting observation if the primary samples also exhibit a mechanism similar to established cell lines wherein there are more accumulated genetic changes.

      🡪Our main limitation with PDxOs is overcoming the technical hurdles related to our downstream assays. These include introducing relevant reporters and generating stable lines in the PDxOs, and imaging at high-resolution when the PDxOs are cultured in 3D. However, we are very interested in this question as well, and are actively thinking about ways to overcome these hurdles.

      -It would also be interesting to examine whether there is any difference in the ROS-ERK mechanism for primary and metastatic tumour.

      🡪We agree and this is an active avenue of investigation for us. We agree and are currently pursing models to understand how our findings fit into the larger picture of tumorigenesis and metastatic potential. We had spent months pursuing anin vivo approach using a murine Cre/LoxP system to genetically label mouse macrophage mitochondria with GFP. We crossed mice which express Cre under a monocyte-specific promoter (Jax, SN: 004781) and mice with germline expression of Lox-Stop-Lox-3xHA-EGFP-OMP25 (Jax, SN: 032290) with the expectation of seeing Cre-based excision of the stop cassette – thus resulting in offspring with macrophages expressing mitochondrial-localized GFP. However, the macrophages of the resulting offspring do not express GFP (by flow cytometry, imaging, and western blot analysis), despite the PCR-verified presence of both transgenes and the excision of the stop cassette. Needless to say, this was quite frustrating! We are currently in the process of developing a newly available MitoTag model which has been optimized for visualization purposes (Jax, SN: 032675). If you have any suggestions or advice on this matter we would much appreciate your thoughts!

      -‘in cancer cells that receive exogenous mitochondria’ - Since these macrophages also transfer mitochondria to non-malignant cells, such as MCF10A cells shown in Fig S1B, perhaps the authors could comment on whether this is part of a physiological process that would also promote normal cell growth?

      🡪 There are so many questions regarding when and why macrophages might transfer mitochondria. In general, mitochondrial transfer is observed in stressed cells. Our data suggest that transfer happens to MCF10A cells although at a much lower rate than their malignant counterparts, 231 cells, but we do not know whether similar downstream mechanisms and phenotypes are also occurring in the non-malignant cells. Thanks for your feedback – more to come here!

    1. They believe the foreign people,***         *** She means West Indians. who deceive them, and say slaves are happy. I say, Not so. How can slaves be happy when they have the halter round their neck and the Page 23 whip upon their back? and are disgraced and thought no more of than beasts?--and are separated from their mothers, and husbands, and children, and sisters, just as cattle are sold and separated? Is it happiness for a driver in the field to take down his wife or sister or child, and strip them, and whip them in such a disgraceful manner?--women that have had children exposed in the open field to shame! There is no modesty or decency shown by the owner to his slaves; men, women, and children are exposed alike. Since I have been here I have often wondered how English people can go out into the West Indies and act in such a beastly manner. But when they go to the West Indies, they forget God and all feeling of shame, I think, since they can see and do such things. They tie up slaves like hogs--moor*         * A West Indian phrase: to fasten or tie up. them up like cattle, and they lick them, so as hogs, or cattle, or horses never were flogged;--and yet they come home and say, and make some good people believe, that slaves don't want to get out of slavery. But they put a cloak about the truth. It is not so. All slaves want to be free--to be free is very sweet. I will say the truth to English people who may read this history that my good friend, Miss S----, is now writing down for me. I have been a slave myself--I know what slaves feel--I can tell by myself what other slaves feel, and by what they have told me. The man that says slaves be quite happy in slavery--that they don't want to be free--that man is either ignorant or a lying person. I never heard a slave say so. I never heard a Buckra man say so, till I heard tell of it in England. Such people ought to be ashamed of themselves. They can't do without slaves, they say. What's the reason they can't do without slaves as well as in England? No slaves here--no whips--no stocks--no punishment, except for wicked people. They hire servants in England; and if they don't like them, they send them away: they can't lick them. Let them work ever so hard in England, they are far better off than slaves. If they get a bad master, they give warning and go hire to another. They have their liberty. That's just what we want. We don't mind hard work, if we had proper treatment, and proper wages like English servants, and proper time given in the week to keep us from breaking the Sabbath. But they won't give it: they will have work--work--work, night and day, sick or well, till we are quite done up; and we must not speak up nor look amiss, however much we be abused. And then when we are quite done up, who cares for us, more than for a lame horse? This is slavery. I tell it, to let English people know the truth; and I hope they will never leave off to pray God, and call loud to the great King of England, till all the poor blacks be given free, and slavery done up for evermore.

      This section is so heart wrenching. We see her whole life of mistreatment laid out in a paragraph. Her experiences and her sorrows. Her values and her desires are such simple standards of life and yet she suffers. Even if free in England she cannot be with her loved ones.

    1. Then, as a mother lays her sleeping child Down tenderly, fearing it may awake, He sat the jug down slowly at his feet With trembling care, knowing that most things break; And only when assured that on firm earth It stood, as the uncertain lives of men Assuredly did not, he paced away

      When I was reading this I see that he's comparing the frugalness of the jug to the lives of men. He's saying that we have to treat a jug very carefully and with caution and with lives of men because he's saying that they won't leave this earth maybe in relation to a ghost but mens lives. Also when it says,"knowing that most things break", and also saying after saying unless is firm on the earth makes me think that it's the spirit of maybe a ghost and it's not easy for them to go away.

    1. As such, the conversation shouldn’t be, “Check your privilege, stupid!” but rather, “How can we work to make sure that we are understanding and undermining the system of oppression and privilege that hurts all of us?”

      This is a great way to have a conversation about privilege. People who are just now learning about the concept or who may be skeptical of it would react in a more positive way if they're presented with an actual action to complete.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      First of all, I sincerely appreciate the critical reading of our manuscript by the reviewers.

      Point-by-point responses to the reviewer #1’s comments

      Most of the key conclusions are valid but the main one should be either reinforced or tuned down.

      Through our study, we want to indicate that MTCL2 preferentially associates with perinuclear MTs accumulated around the Golgi complex, and its target is not necessarily restricted to “Golgi-associated (nucleated) MTs.” In this sense, the sentences in the previous manuscript, such as “MTCL2 preferentially associates with Golgi-associated MTs” and “MTCL1 and 2 …. are specifically condensed on Golgi-associated MTs,” were overstatements and completely misleading.

      According to reviewer#1’s comment, we carefully revised these sentences throughout the manuscript and eliminated ambiguity on this point as far as possible.

      The corresponding revisions are as follows.

      In particular, the authors tend to give central role to MTCL2 in regulating the formation and organization of Golgi-associated MT network, and conversely in organizing Golgi elements, without considering the other factors identified (the authors cite relevant papers though but do not discuss this). They should analyze the function of MTCL2 in relation to the role of CLASP2, AKAP450, Golgi-g-Tubulin, or even EB proteins (like EB3).

      I agree with the above comment since it is important to analyze how MTCL2 preferentially associates with the perinuclear MTs accumulated around the Golgi complex.

      In the revised manuscript, we included new data analyzing knockdown effects of CLASP1/2 and AKAP450 on the subcellular localization of MTCL2 (Fig. 7A). These data indicate that CLASPs but not AKAP450 are required for the preferential localization of MTCL2 to the perinuclear MTs around the Golgi. We also demonstrate that the minimum Golgi-localizing region of MTCL2 (the N-terminal coiled-coil region) physically associates with CLASP2 (Fig. 7B), further supporting the idea that CLASPs mediate the Golgi association of MTCL2. Additional involvement of another Golgi element, giantin, is also suggested through Fig. 7C and Appendix Fig. S6. We believe that these revisions significantly improved the weakness previously pointed out by the reviewer.

      I also do not think that carrying out super resolution microscopy is enough to "reveal the possibility that MTCL2 mediates the association of the Golgi membrane with stabilized MTs". More generally, the authors cannot conclude that MTCL2 preferentially associated to Golgi-MT only from their immunofluorescence and KD experiments. The centrosome (the main MTOC) is indeed also localized in the perinuclear area. Easy to do additional experiments may help to confirm these conclusions (see below). Also, the authors could strengthen the way the study how MTCL1 and MTCL2 binds to microtubules and Golgi (see below). The localization or interaction of MTCL2 with Golgi-associated MT is not directly shown.

      Previously, we demonstrated that the N-terminal region of MTCL2 shows clear Golgi-localization activity, whereas the C-terminal region directly binds to MTs. These data support our conclusion that MTCL2 mediates the association of the Golgi membrane with general MTs (although not with Golgi-associated or stabilized MTs).

      In the revised manuscript, we reinforced these data by newly revealing that four-point mutations (4LA) in the first coiled-coil motif disrupt the Golgi localization of the N-terminal region of MTCL2 (Fig. 4D). Thereafter, we found that introduction of the same mutations in full-length MTCL2 abolished its preferential association to the perinuclear MTs accumulating around the Golgi without affecting its localization to MTs (Fig. 4E and F). In addition, we provide data on candidate molecules mediating the Golgi association of MTCL2, as stated above (Fig. 7). These results reinforce our immunofluorescence analysis results (Fig. 2) and indicate that the preferential association of MTCL2 to perinuclear MTs accumulating around the Golgi is facilitated by physical interactions between the N-terminal region of MTCL2 and the Golgi-resident proteins, such as CLASPs and giantin.

      The title should be changed also. I am not sure I understand what an asymmetric microtubule network means in this context. I guess that the authors mean non-centrosomal microtubule network.

      We acknowledge the confusion caused by our previous manuscript. By “an asymmetric MT network” we meant not equivalent to “non-centrosomal MT network.”

      In many cases, microtubules do not elongate radially (symmetrically) from the centrosome but intensely accumulate around the Golgi area and show asymmetric organization (see Meiring et al. Curr. Opin. Cell Biol. 62: 86-95, 2020). “An asymmetric MT network” in the title corresponds to this asymmetric array of general MTs accumulating around the GA.

      The present findings that MTCL2 depletion severely disrupted MT accumulation around the Golgi and induced random and rather symmetric arrays of MTs (Fig. 5A) are very impressive. We believe that the knockdown/rescue experiments in this study strongly support the title by demonstrating that MTCL2 facilitates MT accumulation around the Golgi through its dual binding activity to MTs and the Golgi membrane.

      We changed the title in the revised manuscript but still used the term “asymmetric microtubule organization” based on these rationalities.

      The authors also state that tubulin acetylation is induced by MTCL1 C-MTBD but it may simply be stabilized. They should also clarify if MTCL2 regulates Golgi-dependant nucleation microtubules.

      Yes, we think that MTCL1 C-MTBD enhances tubulin acetylation by simply stabilizing the polymerization state of MTs (see Kader et al. PLos One 12: e0182641, 2017). As for the second point, please see our response below to the comment (7).

      I was not convinced by the use of the quantification of "skewness", in particular in figure 5B. Whether a Wilcoxon test is adequate is unclear to me.

      I understand that utilization of skewness, a measure of the asymmetry of distribution, might not be popular in previous studies. In fact, the skewness of tubulin signal distribution in pixels does not indicate in which way MTs distribute asymmetrically by themselves. However, quantification of this statistical parameter does not require any arbitrary factors and thus eliminates the chance of using discretion as far as possible. Therefore, we are confident that this is the best way to estimate the asymmetric organization of microtubules, which are severely affected by various conditions, without any preconception.

      The two biological phenomena we attempted to elucidate here (microtubule arrays and Golgi ribbon expansion) are thought to be context-dependent in each cell (for example, cell cycle, cell densities, etc.). Therefore, we do not have any substantial reason to assume a normal distribution for variation of the two values (skewness of tubulin signal distribution and Golgi ribbon expansion angle) in our cell population. Therefore, we considered that the Wilcoxon test, being a non-parametric rank test, was the most appropriate and safest test to use.

      To demonstrate that MTCL2 associated to Golgi-MT, microtubule regrowth experiments following nocodazole treatment have to be conducted (time course). Another efficient way to analyze such events, as shown by the Kaverina and the Akhmanova labs for example, is to use fluorescent EB proteins (e.g. EB3) to image microtubule plus ends and back-track them to identify nucleation points. Carrying out such an experiment (nocodazole way-out and EB tracking) in the presence or absence of MTCL2 would allow to confirm, or not, the functional hypothesis of the authors.

      We did not want to demonstrate that MTCL2 preferentially associates with “Golgi-MTs.” From this point of view, we do not think the experiments suggested by reviewer#1 were necessarily required for our study.

      However, there is no doubt that one of the main components of the “perinuclear MTs accumulating around the Golgi” is “Golgi-associated (nucleated) MTs.” In this sense, we still agree with reviewer#1’s comment that it is better to examine whether MTCL2 is involved in MT nucleation from the Golgi membrane. The results of these experiments will be informative for readers particularly because we previously reported that MTCL1 stabilizes Golgi-associated (nucleated) MTs.

      In keeping with the above consideration, we have performed both experiments (nocodazole way-out and EB tracking) according to the previous studies (for example, Sanders et. al. M.B.C. vol. 28; 3181-3192, 2017). However, we ultimately decided against the inclusion of the data as we could not overcome large cell-to-cell deviations.

      Nevertheless, we believe that our current dataset adequately answers and supports the specific questions we explored. Briefly, if these experiments succeed to demonstrate the functional importance of MTCL2 for the development of Golgi-nucleated microtubules, they will not necessarily indicate the physical interaction of MTCL2 with Golgi-associated microtubules. In this respect, as described above, we have significantly supplemented data on the molecular mechanisms by which MTCL2 mediates MT–Golgi interactions. This improvement must sufficiently compensate lack of data from the experiments suggested by reviewer#1.

      Several circumferential data suggest that MTCL2 is not involved in the development of Golgi-associated (nucleated) MTs in contrast to MTCL1. We discussed this issue in the “Discussion” of the revised manuscript.

      Additionally, carrying electron microscopy analysis would be important to qualify better the effects observed on Golgi complexes upon depletion. The authors mention the effects on the "morphology of Golgi ribbon" but it is rather unclear.

      We did not perform electron microscopy analysis, because we are not implicating a change in the ultrastructure of the Golgi apparatus in MTCL2-knockdown cells. We specifically want to demonstrate that MTCL2 knockdown changes the assembly structures of the Golgi ribbons, and we believe that it is feasible to do so by light microscopy. We realize that using the term “Golgi morphology” may be misleading in this context. In the revised manuscript, we replaced this term with appropriate ones, such as “assembly structures of the Golgi stacks” or “compactness of the Golgi ribbon.”

      Last, because the authors compare the way MTCL1 and MTCL2 bind microtubules, and suggest intriguing differences, domain swapping experiments between these two isoforms would be important to carry out.

      We conducted the suggested experiments and obtained interesting results. However, we ultimately decided against their inclusion given that the functional difference between MTCL1 and 2 is not the main point of discussion in our study.

      Some studies are referred but the published data not actually used (with the exception of the final scheme). The authors should comment on the fact that other Golgi-associated MT binding proteins have been shown to be involved in the mechanisms highlighted here. Why they would not take over in the absence of MTCL2 should be properly discussed.

      In the revised manuscript, we included data regarding the involvement of CLASPs and AKAP450 in the Golgi association of MTCL2. Accordingly, we introduced their roles in the development of Golgi-associated MTs as far as possible in the “Introduction” (see lines 29-36 and 38-42), “Results” (see lines 306-309 and 344-347), and “Discussion” (see lines 398-402 and 442-444).

      Similarly, in the discussion, the authors indicate that SOGA has been found as an interacting partner of CLASP2. As CLASP2 is a microtubule binding protein also localized at the Golgi complex and binding to acetylated microtubules, the authors should at least comment on the putative role of the interaction between MTCL2 and CLASP2 in the phenotypes they described. The role of the interaction between CLASP2 and MTCL2 should be discussed and ideally tested.

      As described above, we provided the data indicating the role of the interaction between MTCL2 and CLASP2 in the revised manuscript.

      In the introduction, page 3 line 74-77, the authors wrote « The resultant N-terminal fragment is released into the cytoplasm to suppress autophagy by interacting with the Atg12/Atg5 complex, whereas the C-terminal fragment is secreted after further cleavage (see Fig. 1A, boxed illustration). » while on the Fig1 the boxed area indicates that SOGA bears Atg16 and Rab5 binding domains. Please double check the interacting partners of SOGA1.

      Thank you for pointing this out. The sentence in the “Introduction” was revised to “… interacting with the Atg12/Atg5/Atg16 complex” (Rev. Endocr. Metab. Disord. 15, 137–147, 2014).

      Figure 1 B and C are not cited in the main text.

      These figures were cited in the “Introduction” section (line 65 in the previous manuscript). In the revised manuscript, these figures were replaced with Fig. EV1 A and C and cited in the “Introduction” section (line 59) as well as in the legend to Fig. 1 (line 757).

      Figure 1E: a loading control is needed to evaluate the expression level of SOGA/MTCL2 in the mouse tissues.

      Sample loading in each lane shown in previous Fig. 1E (Fig. 1D in the revised manuscript) was normalized by total protein amount (25 mg), as indicated in the figure legends. However, we have decided to add the data for a-tubulin expression in each lane as a reference, although they are not equal for each lane.

      In the liver, the size of the bands is different than in other tissues (smaller size). The authors might comment if these smaller bands correspond to the cleaved version of SOGA that was previously described in mouse hepatocyt

      In Fig. 1D of the revised manuscript, we added arrowheads indicating the bands of smaller sizes observed in some tissues such as the liver. In addition, we commented on them in the corresponding part of the “Results” section by describing that “we cannot exclude a possibility that MTCL2 is subjected to the reported cleavage and works as SOGA in these tissues.”

      Figure 2A: single color picture for the anti-tubulin immunolabeling would help to see the distribution of microtubules in the perinuclear area. The perinuclear region is a crowded area with many intracellular compartments accumulating there as well as cytoskeleton elements.

      We completely revised Fig. 2 following the reviewers’ suggestion. To provide single-color pictures for the anti-MTCL2 and anti-tubulin immunolabeling, we added new pictures examining colocalization of MTCL2 with MTs at the peripheral regions where densities of both signals are rather low. In Fig. 2B, the colocalization was further examined via a line scan analysis across MTs. Finally, we have included new data demonstrating that exogenously expressed MTCL2 similarly colocalized with MTs even at the peripheral regions when its expression was suppressed to the endogenous level (Fig. 2C).

      Figure 2C: same comment as above, a single-color picture for the anti-MTCL2 and anti-GM130 immunolabeling are required.

      Owing to the space limitation, we could not include a single-color picture for the anti-GM130 immunolabeling in Fig. 2, although we enlarged their merged figure so that readers easily agree with our statement: “some overlapped with the Golgi marker signals” (lines 146-147).

      Alternatively, we included a new Appendix Fig. S8, in which immunofluorescence signals of MTCL2 and CLASP1/2 (A) or giantin (B) are compared at a super-resolution microscopic level. In these figures, we included single-color pictures together with merged data.

      page 7, line 132-134: the authors state: « Close inspection using super-resolution microscopy further revealed the possibility that MTCL2 mediates the association of the Golgi membrane with stabilized MTs (Fig. 2D, arrows). » To my opinion, the data are over-interpreted. The signals partially co-localize but this does not indicate a function of MTCL2 in mediating the interaction.

      We deleted the previous Fig. 2D and the corresponding sentence. By doing so, we ceased to suggest that MTCL2 functions to mediate MT–Golgi interactions only based on immunofluorescence data.

      Figure 3: Another way of merging the anti MTCL2 and GS28 pictures have to be provided. The pictures are difficult to interpret with the current display.

      We deleted the previous Fig. 4 and ceased to discuss colocalization of MTCL2 with Golgi proteins only based on immunolabeling data as mentioned above.

      Figure 4C: please indicate the meaning of « ppt »

      We included the explanation of “ppt” in the legends to the corresponding figure (Fig. 3C in the revised manuscript) as follows (lines 801-802):

      “ppt represents the MT precipitate obtained after centrifugation (200,000 × g) for 20 min at 25°C.”

      Figure 5B and C: for easier reading of the figure, it would be useful to annotate with MTCL2 construct is overexpressed following doxycycline treatment (MTCL2 WT (A) and MTCL2 delta C-MTBD (C)).

      We followed the suggestion. Please see new Fig. 5 and Fig. EV4 and 5.

      Figure 6 A and C: the labels are wrong. Bottom pictures correspond to anti-GM130 immunostaining not anti-tubulin. If I am not mistaken, it is MTCL2 delta C which is studied in panel C.

      Thank you for pointing this out. We corrected this error in Fig. EV5 (previous Fig. 6) in the revised manuscript.

      Page 11, line 212: Supplementary Figure 2 (knockdown in RPE1 cells) is intended to be cited not Supplementary Figure 3.

      Thank you for pointing this out. We corrected the error in the revised manuscript appropriately.

      Figure 8A: single color pictures are needed to appreciate the distribution of the signals

      One of the major comments of three reviewers have been provided on Fig. 8, which reports that MTCL1 and 2 differentially regulate microtubules. We agree that the previous data in Fig. 8 A–C are rather preliminary. Although we could improve these figures according to the reviewers’ comments, we decided to omit these data and cease the discussion that MTCL1 and 2 localize with microtubules in a mutually exclusive manner, as this was not the main focus of the study.

      Point-by-point responses to the reviewer #2’s comments

      In figure 1D, a loading control should be included for the Western Blot probing for V5-mMTCL2 in HEK293T cells.

      We did include loading controls for the indicated lanes. However, because the HEK293T cell extract in lanes 1–3 was diluted, the signals were too weak to be visualized in this figure (Fig. 2C in the revised manuscript).

      The authors use the anti-SOGA antibody to detect MTCL2. However, in Figure 1A they do not show the sequence similarity between this region in MTCL1 and MTCL2. The authors should include this, as well as show that the anti-SOGA antibody is specific for MTCL2 and does not detect MTCL1.

      In new Fig. EV1, we included amino acid sequence alignment data for the region corresponding to the used anti-SOGA1 antibody epitope. The data indicate significant divergence of the sequence from MTCL1 (6% homology, 23% similarity).

      We also included new western blot data (Fig. 1B in the revised manuscript) demonstrating that anti-SOGA1 antibody does not react with MTCL1 exogenously expressed in HEK293T cells.

      Line 132-134. The authors conclude that MTCL2 possible mediates association between Golgi membrane and stabilized MTs based on localization microscopy only. This is an overstatement and should be corrected. Not only is the microscopy technique used able to produce resolution of 140nm, which is not enough to show direct association; the staining techniques used (double antibody staining) ensures the fluorophores are approximately 20-30nm away from the intended target (MTs, MTCL2, or Golgi). Thus, the conclusion drawn is overstated and should be refined at this point in the manuscript.

      I agree with reviewer#2’s comment that the previous data in Fig. 2D are insufficient to draw the conclusion that MTCL2 mediates the association between the Golgi membrane and stabilized MTs. We deleted the figure and the corresponding sentence reviewer #2 indicated.

      We want to demonstrate that “MTCL2 mediates the association between the Golgi membrane and MTs (not restricted to the stabilized MTs).” In this sense, we have already obtained supportive data in the previous manuscript that the N-terminal region of MTCL2 has clear Golgi-localization activity, whereas the C-terminal region directly binds to MTs.

      In the revised manuscript, we reinforced these data by revealing that four-point mutations (4LA) in the first coiled-coil motif disrupt the Golgi localization of the N-terminal region of MTCL2 (Fig. 4D). Thereafter, we found that introduction of the same mutations in full-length MTCL2 abolished its preferential association to the perinuclear MTs accumulating around the GA without affecting its colocalization to MTs (Fig. 4E and F). We also provide data on candidate molecules mediating the Golgi association of MTCL2 (Fig. 7). These results reinforce our immunofluorescence analysis results (Fig. 2) and indicate that the preferential association of MTCL2 to perinuclear MTs accumulating around the Golgi is facilitated by physical interactions between the N-terminal region of MTCL2 and the Golgi-resident proteins, such as CLASPs and giantin.

      The authors should include some quantification of MTCL2 signals along stabilized microtubules near the Golgi and in peripheral regions of the cell in Figure 2. This will show that MTCL2 preferentially localizes to MTs in the Golgi region but not the periphery, as the authors claim (lines 124-130). This quantification could be in the form of linescans along or across MT signals.

      We included a line scan data across peripheral MTs to confirm MTCL2 colocalization with MTs (Fig. 2C). However, it is difficult to perform a line scan for the perinuclear regions where both signals of MTCL2 and MTs are too dense. Therefore, we demonstrate the preferential colocalization of MTCL2 to the perinuclear MTs by comparing peripheral signals of MTCL2 with that of MAP4 (Fig. 2D).

      The authors show that ectopic expression of the C-terminus of MTCL2 can rescue MTCL2 siRNA phenotypes. Since the N-terminus localizes strongly to the Golgi membrane, the authors should do corresponding experiments with this fragment, to determine if membrane binding of MTCL2 can have a similar rescue effect or if MT binding is essential. This is especially important for the Golgi-ribbon organization (Figure 6).

      We did not include data indicating rescue activity of the C-terminal fragment of MTCL2. In the previous Fig. 5 and 6, we demonstrated that MTCL2 lacking the C-terminal microtubule-binding region does not show rescue activities. Therefore, we did not follow reviewer#2’s suggestion directly.

      However, we included new data indicating that an MTCL2 mutant (4LA) that associates with MTs but not with the Golgi membrane also lacks rescue activities for asymmetric MT organization and Golgi ribbon compactness (new Fig. 5 and Fig. EV4). I hope these revisions are satisfactory.

      Line 261-2. The authors claim that MTCL1 and MTCL2 function in a mutually exclusive manner. As with point 3, this is an overstatement based solely on localization microscopy. The authors cannot draw this conclusion from the data associated with this statement (Figure 8A) and it should be refined to reflect that they only comment on the respective localization patterns of MTCL1 and MTCL2. Additionally, to show that MTCL1 and MTCL2 do not overlap on MTs, the authors should include linescans along MTs showing the anti-V5 and anti-MTCL1 intensities.

      One of the major comments of three reviewers have been provided on Fig. 8, which reports that MTCL1 and 2 differentially regulate microtubules. We agree that the previous data in Fig. 8 A–C are rather preliminary. Although we could improve these figures according to the reviewers’ comments, we decided to omit these data and cease the discussion that MTCL1 and 2 localize with microtubules in a mutually exclusive manner, as this was not the main focus of the study.

      In Figure 8C the authors show acetylated tubulin staining in cells depleted of MTCL2. Based on this localization pattern, it seems the MT network is not grossly altered, as was shown in Figure 5 where perinuclear accumulation of MTs was lost. The authors should comment on whether acetylated tubulin presence and localization is altered in MTCL2-depleted cells. This is also mentioned in the discussion where the authors conclude that the major function of MTCL2 is to crosslink and accumulate MTs in the Golgi region. However, based on acetylated tubulin staining patterns, stable MTs seem to still accumulate in the Golgi region. The authors need to show this accumulated population of stable MTs is no longer crosslinked in the absence of MTCL2 to support their claim.

      Acetylated microtubules represent a minor fraction of the perinuclearly accumulated microtubules. From the point of this view, it could be possible that the accumulation of perinuclear microtubules is severely affected, whereas that of acetylated microtubules is not. MTCL1 might crosslink these acetylated microtubules.

      In any case, we have decided to delete the previous Fig. 8 A–C, as stated above.

      To investigate potential functional overlap between MTCL1 and MTCL2, the authors should include a double depletion experiment where MT organization and Golgi organization are investigated. The currently shown experiments do not test a functional relationship between the two paralogs. Additionally, the authors should show Western Blot analysis of MTCL1 levels in MTCL2-depleted cells, and vice versa. While there does not seem to be an overlap in localization patterns of the two proteins, that does not mean there is no functional relationship.

      We did not follow reviewer#2’s comment because of the reason stated above.

      Lines 120-30 and 297-9. The authors state that based on the localization pattern of MTCL2 it mostly localizes along MTs in the perinuclear region (shown in Figure (2). Then, in the discussion they state MTCL2 preferentially localizes to Golgi membranes. Please clarify which of the two sites MTCL2 localizes to preferentially.

      We agree that we should be more careful while describing the subcellular localization of MTCL2. We revised the information in the manuscript to indicate that MTCL2 preferentially localizes to perinuclearly accumulated microtubules showing partial colocalization to the Golgi membrane.

      Loss of Golgi organization as described in Figures 6 does not appear in polarized cells in Figure 7. The authors should comment on the loss of the phenotype in polarized cells.

      Since RPE1 cells cultured at high density show abnormally elongated shapes, as described in the original text (line 238; in the revised text, line 326), Golgi ribbons in these cells do not appear to be as expanded. However, their loss of compactness in MTCL2-knockdown cells can be easily recognized in the previous Fig. 7C (corresponding to Fig. 6C in the revised manuscript).

      The authors should consider using colorblind friendly palettes in figures. For example, magenta/green instead of red/green and magenta/cyan/yellow instead of red/blue/green. Additionally, for tri-color images the combination red/green/white (Figure 4B, 7C) should be avoided, as overlapping red/green signals will show up as yellow which is difficult to distinguish from the white signals. Finally, human eyes detect shades of red much poorer than for example green. Therefore, the main point of a figure should not be in red. For example, MTCL2 is frequently shown as red signal in a merged image and should be replaced with a different color.

      We incorporated the reviewer’s suggestion.

      The authors claim the mouse MTCL2 protein lacks 203 N-terminal amino acids. Authors should clarify in the text that this is relative to mouse MTCL1. The authors should also include the human comparisons, as they work on human cell lines in the majority of the manuscript.

      I am afraid that this comment is based on a misunderstanding by reviewer #2, because we did not claim that mouse MTCL2 lacks 203 N-terminal amino acids. Instead, we described that SOGA, a mouse MTCL2 isoform, lacks 203 N-terminal amino acids compared to the full-length mouse MTCL2, the cDNA of which was used in this work.

      In Figure 1D the authors show Western Blots where various amounts of HEK293T extracts were probed for exogenously expressed MTCL2. As a control, authors should include a non-transfected control. From Figure 1E, it would be expected that HEK293 (kidney cells) would not express endogenous MTCL2, but the control should be included anyway.

      In the revised Fig. 2B, we included a lane in which a non-transfected HEK293T cell extract was loaded, according to reviewer #2’s comment (see lanes indicated as mock).

      In Figure 3, the color scheme in the final column of images should be changed. Red/white contrast is very poor and no conclusions can be drawn from these images. Additionally, the authors should include a box to show where the inset is located in the overview images.

      In the revised manuscript, we deleted the “final column of images using red/white contrast” from Fig. 2D (previous Fig. 3), to avoid drawing a conclusion on the interaction between MTCL2 and the Golgi membrane only from immunofluorescence data.

      In addition, we included boxes in the overview images to show where the inset is located, wherever it is required in the revised manuscript.

      Authors claim that MTCL2 is not detected near more dynamic MTs in the periphery of the cell and references Figures 2A and 3. They should include annotation in the figures to highlight this. This can be done with arrowheads or other markings, or with additional insets enlarging a peripheral region of the cell.

      To respond to the comment, we separately provided enlarged views of perinuclear and peripheral regions in the revised Fig. 2.

      The authors should clarify in the main text and figure legend which superresolution microscopy technique was used in Figure 2D.

      As mentioned above, we deleted the previous Fig. 2D.

      The authors use methanol fixation to examine localization of MTCL2, MTs, and Golgi. Methanol extracts lipids and thus affects intracellular membrane compartments, and can affect the localization pattern of GM130, a Golgi matrix protein. The authors should include samples fixed with a crosslinking fixative to ensure their conclusions drawn from methanol-fixed samples are not affected by the choice of fixative.

      According to the reviewer’s suggestion, we included additional data obtained using PFA fixations (Fig. EV2). PFA fixation also revealed a similar localization pattern of MTCL2 to that obtained by methanol fixation.

      In Supplementary Figure 1B a third, relatively high expressing cell can be seen in the top panel. The GM130 signal for this cell seems to be comparable to non-transfected cells in the same image. Can the authors address this? Alternatively, to show differences in expression levels between these three cells in that panel and others, authors could use a heatmap LUT of the V5 signal to differentiate expression levels more clearly in different cells.

      I am unsure whether the reviewer is referring to the cell located at the bottom-left corner of the panel in the previous Supplementary Fig. 1B (Appendix Fig. S1B in the revised manuscript). The cell shows a rather normal distribution pattern of exogenous MTCL2 similar to the endogenous one. We think this is the reason why it maintains a rather normal assembly structure of the Golgi ribbon. We included the word “frequently” in the sentence (line 153 in the revised text) to indicate that high levels of exogenous MTCL2 do not disrupt the normal Golgi ribbon structure. We do not think it is necessary to differentiate the expression levels of exogenous MTCL2 more clearly by using a heatmap, since this issue is not critical for the conclusions of this paper.

      Line 139. How was the ectopic expression 'suppressed to endogenous levels'? The panels in Suppl Fig. 1 of 'low expression' clearly show increased MTCL2 signal when compared to non-transfected cells in the same panel still. This would suggest ectopic expression is still above endogenous levels.

      We did not suppress the expression actively. We identified the cells expressing exogenous MTCL2 at low levels comparable to those of endogenous MTCL2. The information provided in line 139 of the previous text is not accurate. Thank you for pointing out this issue; we revised the sentence as follows: “However, when the expression levels were similar to the endogenous levels, … (lines 154-155 in the revised text)”

      Figure 5C. The label for MTCL2 construct should read mMTCL2 ΔC-MTBD to clarify the expression construct used.

      Since the labeling in previous Fig. 5 and 6 was confusing, we revised them all by adding the name of the expressed MTCL2 mutant under the label “+dox” (see Fig. 5, Fig. EV4, and Fig. EV5 in the revised manuscript).

      In Figures 6A and 6C the label shows a-tubulin, but the staining is of a Golgi marker.

      Thank you for pointing this out. We corrected this error in the corresponding figure (Fig. EV5) in the revised manuscript.

      In Figures 6B and 6D the different conditions should be separated more in the graph, the datapoints overlap.

      In the revised manuscript, we significantly improved the presentation of the statistical data shown in the previous Figs. 5 and 6 (Fig. 5 and Figs. EV4 and 5 in the revised manuscript). In these improvements, we determined to only include data of biological replicates in a single typical experiment in the main figures. Automatically, data points in the previous Fig. 6B and D were decreased in number and do not overlap anymore (see Figs. EV4 and EV5D). Instead, we have included new figures (Appendix Fig. S4) in which the results of technical replicates (three independent experiments) are presented.

      Lines 246-7. The authors claim the Golgi-associated and centrosomal MTs can be easily distinguished in MTCL2 knockdown cells. They should include annotation in the corresponding figures to highlight these different populations.

      We followed the reviewer’s suggestion by adding arrows in Fig. 6C of the revised manuscript.

      Figure 8A. A horizontal line is missing in the panel showing MTCL/a-tub merge.

      Thank you for pointing this out. As mentioned above, we deleted the previous Fig. 8A from the manuscript.

      Figures 8C and 8D. The acetylated tubulin staining in control cells (control RNAi and GFP) in these panels vary greatly. Can the authors comment on this?

      Expression of MTCL1 C-MTBD induces tubulin acetylation intensely. Therefore, to obtain appropriate pictures under non-saturated conditions, we had to decrease the gain of photomultiplier of the confocal microscopy system for the previous Fig. 8D. This is why acetylated tubulin signals in control cells appear to be too weak in the previous Fig. 8D than those in Fig. 8C.

      In any case, we deleted the previous Fig. 8C in the revised manuscript as stated above. The previous Fig. 8D is solely included in Fig. EV3.

      Additionally, there appears to be an increase in acetylated tubulin on the Western Blot (8E) shown in cells expressing GFP-MTCL2 CMTB that is not reflected in the image in Figure 8D. Since a significant population of GFP-MTCL2 CMBT localizes to the nucleus, it is possible that the functional population of GFP-MTCL2 CMBT that can stabilize MTs is much lower than GFP-MTCL1 CMBT despite showing equal levels in the Western Blot. The author should compare signal intensity in the cytosol of GFP-expressing cells and base their analysis of acetylated tubulin levels on cells where cytosolic levels are comparable.

      We agree with this reviewer’s comment and did not include WB data in Fig. EV3B corresponding to the previous Fig. 8D.

      As for quantification of the fluorescence data in Fig. 8D, we provided a typical result on the acetylate-tubulin signals normalized by GFP and a-tubulin signals in the boxed regions where cytosolic GFP signals are comparable.

      Point-by-point responses to the reviewer #__3’s comments__

      While the standard fluorescence images are of good quality, the quality of the super-resolution microscopic images is quite low and insufficient. Fig. 8A looks like an enlarged standard laser scanning microscope image, but does not achieve the resolution of a super-resolution image by far, which should be well below the µm range. However, such a resolution would be required to support the claim that MTCL1 and 2 locate on MTs in a mutually exclusive manner. (Negative) data from immunoprecipitation experiments also provide only weak evidence for the absence of a heterocomplex. I also fear that the fixation process creates artifacts. Experiments to image living cells would definitely bolster the data and also provide information about the dynamics of the interactions.

      One of the major comments of three reviewers have been provided on Fig. 8, which reports that MTCL1 and 2 differentially regulate microtubules. We agree that the previous data in Fig. 8 A–C are rather preliminary. In the revised manuscript, we deleted these data and ceased to discuss that MTCL1 and 2 localize with microtubules in a mutually exclusive manner, as this was not the main focus of the study.

      We also deleted the previous Fig. 2D (showing another super-resolution image) and the corresponding sentence. By doing so, we ceased to suggest that MTCL2 functions in mediating MT–Golgi interactions only based on immunofluorescence data.

      It would also be relevant to confirm that the results are not a cell line artifact in HeLa cells.

      In the previous manuscript, we included data indicating that the knockdown effects observed in HeLa-K cells (reduced accumulation of MTs around the Golgi as well as lateral expansion of the Golgi ribbon) are also induced in RPE1 cells by MTCL2 knockdown (Supplementary Fig. 2 in the previous manuscript). We included the same figure in the revised manuscript as Appendix Fig. S4.

      A standard method for detecting microtubule association in cultured cells would be to use an extraction protocol. This has to be done to show that MTCL2 actually behaves like a microtubule-associated protein (MAP).

      In the revised manuscript, we included new immunofluorescence data obtained using PFA fixation with or without pre-extraction, which revealed a similar localization pattern of MTCL2 to that obtained by methanol fixation (Fig. EV2). Pre-extraction was performed using BRB80 buffer supplemented with 0.5% TX-100 and 4 mM EGTA for 30 s, according to a protocol provided by Dr. Mitchison Laboratory.

      I don't see that the study proves that MTCL2 is essential for the organization of an asymmetric microtubule network as the title claims. The experiments shown in Fig. 5 demonstrate a change in the skewness of the pixel intensity distribution dependent on the presence of MTCL2, which may indicate a contribution of MTCL2 (provided that the fixation and staining do not produce an artifact). However, they do not prove that MTLC2 is essential.

      We cannot understand how an artifact due to the fixation and staining may be responsible for the results shown in the previous Fig. 5 (Fig. 5 and Figs. EV4 and 5 in the revised manuscript).

      In many cases, microtubules do not elongate radially (symmetrically) from the centrosome but intensely accumulate around the Golgi area and show asymmetric organization (see Meiring et al. Curr. Opin. Cell Biol. 62: 86-95, 2020). “An asymmetric MT network” in the title corresponds to this asymmetric array of general MTs accumulating around the Golgi complex.

      In this respect, our findings that MTCL2 depletion severely disrupted MT accumulation around the Golgi and induced random and rather symmetric arrays of MTs (Fig. 5A) are very impressive. We believe that the knockdown/rescue experiments in this study strongly support the title by demonstrating that MTCL2 facilitates MT accumulation around the Golgi through its dual binding activity to MTs and the Golgi membrane.

      We are unable to comprehend the reviewer’s standpoint in not allowing us to conclude the essential role of MTCL2 in the organization of an asymmetric microtubule. However, the title in the revised manuscript was changed as follows.

      “MTCL2 promotes asymmetric microtubule organization by crosslinking microtubules on the Golgi membrane”

      There is also a large oversampling of the data by plotting each individual cell from only two separate experiments. It would be better and more reliable to present the data as the mean of the experiments (then of course more than 2 would be required). The same applies to the experiments in which the "Golgi ribbon expanding angle" was determined (Fig. 6).

      In my opinion, statistical theories based on an ideal assumption cannot simply be applied to the quantitative analysis of biological phenomena. In our case, the MT distributions, as well as the Golgi ribbon expansion angles significantly deviate in a context-dependent manner in each cell (for example, cell cycle, cell densities, etc.). The deviation of these values between each cell (in biological replicates) is much larger than the experimental deviation, which is mainly dependent on the stochastic element (in technological replicates). I understand that this is the reason why many journals in cell biology do not necessarily require “three” independent experiments for statistical analysis.

      In the revised manuscript, however, we included data from three independent experiments for all rescue experiments (Fig. 5, Figs. EV4 and 5, and Appendix Fig. S4) to further demonstrate the reliability of our data.

      In the main figures (Fig. 5, Figs. EV4 and 5), we included statistical data of a single typical experiment to demonstrate reproducibility in biological replicates in each condition. To compensate for these figures, we listed statistical data for each biological replicate of all experiments in Appendix Fig. S4 A. In Appendix Fig. S4 B and C, we further provided statistical data of technical replicates (three independent experiments) by comparing the average of each biological replicate. We concluded that this is the best way to statistically demonstrate the reliability of the biological analysis.

      We believe that the data collectively presented by these figures strongly support the reliability of our conclusions.

      It would be good to support the claim that MTCL2 affects the Golgi ribbon structure through ultrastructural analysis (EM).

      We did not perform electron microscopy analysis, because we are not implicating a change in the ultrastructure of the Golgi apparatus in MTCL2-knockdown cells. We specifically want to demonstrate that MTCL2 knockdown changes the assembly structures of the Golgi ribbons, and we believe that it is feasible to do so by light microscopy. We realize that using the term “Golgi morphology” may be misleading in this context. In the revised manuscript, we replaced this term with appropriate ones, such as “assembly structures of the Golgi stacks” or “compactness of the Golgi ribbon.”

      The critical mechanistic question is which molecule on the Golgi side interacts with MTCL2, since the experiments with the deletion constructs would suggest that it is not the microstructure of the microtubules. As shown, the study is mainly descriptive in relation to this aspect.

      We significantly improved this weakness by including new data indicating the possible involvement of CLASPs and giantin in mediating the Golgi association of MTCL2 (see Fig. 7 and Appendix Figs. S5–7).

      We also revealed that four-point mutations (4LA) in the first coiled-coil motif disrupt the Golgi localization of the N-terminal region of MTCL2 (Fig. 4D). Thereafter, we found that introduction of the same mutations in full-length MTCL2 abolished its preferential association to the perinuclear MTs accumulating around the GA without affecting its colocalization to MTs (Fig. 4E and F).

      These results reinforce our immunofluorescence results (Fig. 2) and indicate that the preferential association of MTCL2 to perinuclear MTs accumulating around the Golgi is facilitated by physical interactions between the N-terminal region of MTCL2 and the Golgi-resident proteins, such as CLASPs and giantin.

    1. Author Response:

      Reviewer #1 (Public Review):

      [...] However, I also have some concerns about the main predictive model result. Although the parasite invasion/growth phenotypes are arguably simpler than an overall in vivo malaria disease phenotype, the reported 40 - 80% variance explained by the LASSO models strikes me as concerningly optimistic. Notably, the correlation in the growth phenotype for repeated samples from the same individuals (sampled weeks apart) is only rho = 0.34 (and for invasion, it is only 0.05). Given that a trait's repeatability is the upper limit to its heritability, and genetic prediction is based on a trait's heritable component, I do not understand how the trait prediction can be as strong as currently reported. Because the result is so striking, it will be crucial to perform true out-of-sample prediction to evaluate predictive accuracy and generalization error.

      We agree with the reviewer that the high values of variance explained in an earlier version of this work may have reflected overfitting of the LASSO models, even in randomized data. We have now reanalyzed the data in a k-folds cross-validation framework, as described in Essential Revisions. As expected, we observe lower predictive accuracy in smaller test datasets than in larger train datasets. Nonetheless, real data and malaria-associated genes produce models that are significantly more predictive of P. falciparum fitness in test data than expected from permutation or random RBC genes. We note that noise across repeated measurements from the same individuals, taken weeks or months apart, is likely to reflect variation from technical inconsistencies as well as environment-dependent biology.

      Assuming out-of-sample prediction holds up, it is interesting that the genotype data add substantially to predictive accuracy even after directly considering RBC phenotypes themselves. As the authors note, this result suggests that the mechanisms through which the genetic effects act are independent of the measured phenotypes. This prediction should be further evaluated (e.g., by assessing genotype-RBC phenotype correlations).

      We agree with the reviewer that some of the observed genetics effects must be mediated through phenotypes that we did not measure, which is quite interesting given the large number of phenotypes that we did measure. Additional phenotypes of interest include quantitative proteomics, transcriptomics, and metabolomics, among others, as addressed in the revised discussion. We plan to evaluate correlations between RBC genotypes and such phenotypes in future work, as this is outside of the scope of the current manuscript.

      Finally, although the results suggest no polarization of allele frequencies by European versus African ancestry, this result should be interpreted with caution throughout the manuscript, since it's unlikely that the predictive variants identified by LASSO are in fact causal.

      We agree with the reviewer that given our SNPs are likely to be imperfectly linked to the causal SNPs, some marginal signal of ancestry polarization of the causal SNPs could be lost. In the discussion, we agree that the predictive variants identified by LASSO may merely be linked to the true causal variants. However since linked alleles have correlated frequencies within populations, we think this is unlikely to substantially impact our conclusions about African and European ancestry with regard to small-effect alleles. We discuss how the lack of enrichment for most protective alleles in Africans is also supported by recent GWAS for severe malaria (MalariaGEN, 2019) and patterns of RBC trait variation observed here and in other studies. We provide several possible explanations for this consistent observation, including extensive pleiotropy of small-effect alleles (see Boyle, Li, and Pritchard 2017 and correlations with other phenotypes in Figure 5-Source Data 3).

      Reviewer #2 (Public Review):

      [...] 1. The authors note that there is one family (mother and five children) are not carriers of known genetic loci. Figure 5-figure supplement 4 shows that they have significantly different distributions than other non-carriers with regards to principal components and parasitic invasion and growth rate. My concern is that many of the tests in the manuscript assume independent observations and related individuals violate this assumption. The children should be removed from all analyses to test for the sensitivity of results to this structure in the data.

      We have revised the analysis after excluding the five siblings and verifying that the remaining donors are unrelated.

      1. This is also related to the increase in % variance explained in their lasso models when including genetics. It would be useful to know how much of the outcome variation was from the inclusion of the principal components specifically (capturing the family) versus the variants of interest.

      In the prior analysis, the PCs specific to the family explained up to 24% of the variation in invasion and 3% in growth in non-carriers. In the current analysis with the children excluded, PCs no longer have predictive power for growth or invasion. This change reflects the genetic uniqueness of the family, which directly produced the prior associations.

      1. It would be helpful to know some more about the variants that were included from exome sequencing. This would include their allele and genotype frequencies, as well as the comparison with reference population frequencies.

      We have added Figure 1-source data 1, which contains this information for ~160,000 exome variants that passed our quality filters.

      1. Are the frequencies of known RBC disease alleles consistent with population estimates? It would be useful to assess the representativeness of the sample.

      This information is now provided in Figure 1-source data 1. The frequencies of RBC disease alleles in our sample of African and admixed individuals are consistent with estimates from African populations.

      1. I would appreciate knowing a bit more about the difference between the two strains, one lab adapted and one clinical. Is it known how the lab strain was adapted or how representative it is to circulating strains? If so, may be worth describing in the discussion to explain the differences in results between the strains.

      We have added more details on the two divergent strains to the results and methods. We also discuss the strong correlations between the strains, including for specific phenotypes and genotypes, which suggest that our results may be generalizable. Finally, we note the interesting differences between the strains for African ancestry and HbAC carriers.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reviewer 1 (Evidence, reproducibility and clarity):

      The main message of this paper, as far as I understood since I am not a molecular bioinformatician but I am certainly interested in mtDNA variations especially related to disease, is that there is a very obvious bias among synonymous changed in the ORF of human mtDNA, more frequent for aminoacids with 4 variants, more frequent in P position, and much more frequently characterized by transversion rather than transition substitutions. This survey is well written and, although edited in a rather technical language, the message is reachable and interesting. I also agree on the conclusions of the Author concerning the considerations that this set of new data should prompt one to draw also considering non-synonymous, potentially pathogenic mutations. The only contribution I feel I can provide to this manuscript is to invite the Authors to consider the possibility that the selection may be due to a preferred codon bias, linked to the higher or lower compliance of different codon to be translated by the translational in situ machinery of mitochondria. I am not sure that this applies also for mitochondrial mitochondria and related factors (you may want to ask Aleksey Amunts in Stockholm or Bob Lightowlers or Zoscha Lightowlers in Newcastle on this matter). I do know that this is certainly a problem for recombinant proteins containing, for instance, mammalian MTS fused with a bacterial restriction enzyme; in most of the cases the bacterial sequence has to be recoded using the preferred codon for mammalian system in order to increase translation by an eukaryotic (mammalian) translation machinery. I wonder whether you could discuss this possibility in your paper and maybe perform some further comparative measurement to test it.

      I appreciate the supportive comments of Reviewer 1 regarding the accessibility of our manuscript, and I address comments related to codon bias below.

      Reviewer 1 (Significance):

      The paper provides novel information on the structure and constrains of mtDNA variants in humans, opens an area of investigation which is new and potentially relevant, with some possible implications also on pathogenic mtDNA mutations in humans.

      I thank Reviewer 1 for their positive comments about the novelty of this work and the important implications of our study.

      Reviewer 1 (Referee Cross-commenting):

      I said in my first comment that I am not a bioinformatician, but Referee 2 made a great job in identifying some critical points and suggest the Authors how to cope with them. I maintain my opinion, that I think it's shared by referee 2, that the paper conveys an interesting and rather unexpected message, and that if the Authors are able to answer properly to the points raised by referee 2 the paper should be published.

      We are quite glad to hear that Reviewer 1 would like to see this manuscript published, provided that the items noted by the reviewers are properly addressed.

      Response to Reviewer 1:

      R1Q1 (Continuation from Referee Cross-commenting): I confirm that the only contribution I feel I can provide to this manuscript is to invite the Authors to consider the possibility that the selection may be due to a preferred codon bias, linked to the higher or lower compliance of different codons to be translated by the translational in situ machinery of mitochondria. I wonder whether the Authors could consider this possibility in the Discussion and possibly perform some further comparative measurement to test it.

      R1A1: My manuscript takes into consideration the possibility that codon-specific preferences would determine the frequency of mtDNA variants. Findings that argue against codon bias as a strong source of selection include:

      1) At two-fold degenerate P3s, nearly every site (> 97%) harbored at least one HelixMTdb sample associated with a non-reference base. It is worth noting that HelixMTdb is not enriched for known mitochondrial disease variants.

      2) SSNEs are very tightly associated with transversions from the human reference sequence, implicating mutational biases as a cause of any limited diversity in the HelixMTdb.

      3) Every possible base can be found at 99% of >500 analyzed I-P3 positions (those P3s at which the base at codon positions one and two is identical throughout the alignment), arguing against the idea that codon bias plays a significant role in controlling variant frequency across mammals. The only exception that I identified in my extensive analysis is the P3 found within the first methionine codon of COX3.

      4) Earlier, more limited studies of mitochondrial codon choice (citations of these earlier studies can be found in the manuscript) also argue against substantial selection based upon codon choice.

      5) Finally, I would note that the set of tRNAs encoded by vertebrate mtDNAs is quite limited, with only one tRNA linked to each codon family defined by codon positions P1 and P2. There is no evidence, to my knowledge, that nucleus-encoded tRNAs enter human mitochondria. Therefore, the scope of potential selection linked to, for example, translation speed and protein folding seems particularly limited at vertebrate mitochondria.

      While most evidence does not support strong selection on mtDNA codon choice in vertebrates, I do report divergence in TSS distributions obtained from the I-P3s of different amino acids within the same degeneracy class (eg. two-fold purine, two-fold pyrimidine, four-fold), hinting at some minimal role for codon preferences at P3. However, on the whole, mutational propensities are likely to be the predominant factor controlling synonymous variation.

      Reviewer 2 (Evidence, reproducibility and clarity):

      The manuscript explores a large database of human mtDNA sequences and performs some comparative analysis across mammals to characterise the profile of mtDNA mutations. It finds that some variants are surprisingly poorly represented in human mtDNA and suggests that mutational bias rather than selection is the dominant driver of this heterogeneity.

      This is an interesting message and an efficient and interpretable of a large-scale dataset to shed light on biological mechanisms, which is a highly desirable philosophy. The factors shaping human mtDNA heterogeneity are of immense interest for several fields from population genetics to medicine, making this a valuable perspective. My comments are mainly quite fine-grained and reflect instances where I think the argument could be tighter, rather than fundamental flaws in the approach. In the cases where these points are due to my own naivety, I apologise and suggest that more explanation of these points could help other readers like me!

      I am happy to read that Reviewer 2 (Dr. Iain Johnston) finds my approach to be fundamentally sound, and I certainly appreciate the insightful comments and suggestions that he has provided.

      Reviewer 2 (Significance):

      I wrote the above review without realising the reviewer interface would be categorised in this way. Here's a repeat of my "significance" comments

      The manuscript explores a large database of human mtDNA sequences and performs some comparative analysis across mammals to characterise the profile of mtDNA mutations. It finds that some variants are surprisingly poorly represented in human mtDNA and suggests that mutational bias rather than selection is the dominant driver of this heterogeneity.

      This is an interesting message and an efficient and interpretable of a large-scale dataset to shed light on biological mechanisms, which is a highly desirable philosophy. The factors shaping human mtDNA heterogeneity are of immense interest for several fields from population genetics to medicine, making this a valuable perspective.

      I am very pleased that the reviewer appreciates the importance and potential impact of my analysis. We agree that mtDNA heterogeneity is likely to be of high medical relevance.

      Response to Reviewer 2:

      R2Q1: The first paragraph is focused on humans without explicitly saying so; missing heritability is less of an issue in, for example, plants [Brachi et al., 2011. Genome biology, 12(10), pp.1-8]. This focus should be clearer (or the differences across kingdoms mentioned!). It's also worth noting that the argument about pathogenic variants being infrequent because of selection can only address missing heritability in pathogenic variants, and cannot (directly) inform the missing heritability in traits like height etc. Also, the whole motivation with respect to missing heritability currently comes across as a bit of a non sequitur. An introduction section could be used to help describe how the analysis of the provenance of mtDNA mutations contributes to the missing heritability question.

      R2A1: I agree that beginning the manuscript with a discussion of genome-side association studies may distract the reader from the main topic at hand: the utility of variant frequency when predicting pathogenicity in humans. I have changed the Introduction accordingly.

      R2Q2: I also suggest that such an introduction section introduces the (later cited) previous work from Reyes and others on mutational profiles in mtDNA to set the scene.

      R2A2: I now provide these citations in the second paragraph of the Introduction. However, I do not expand further upon mutational propensities in that section, with an eye toward minimizing manuscript length toward publication as a short report.

      R2Q3: An early result, that 35% of possible synonymous mutations do not appear in a dataset, lacks a null hypothesis. Depending on the size of the dataset this may be very surprising or very unsurprising : an order of magnitude estimate of what proportion would be expected under uniform mutation and zero selection would help comparison here. I guess this can be as simple as 16k/3*4 R2A3: The reviewer raises an excellent point regarding how 'surprising' it should be to the reader, previous to downstream analyses revealing transition/transversion biases, that so many synonymous substitutions are lacking within this dataset. While the authors of the HelixMT study removed mtDNA from highly related individuals from the analysis, the vast majority of the mtDNAs analyzed (91.2%) were from haplogroup N and of inferred European ancestry (doi.org/10.1101/798264). The authors of the HelixMTdb study do note that nearly all mtDNA lineages were present in the study, presumably encompassing roughly 100,000 years of human mtDNA evolution. That said, how this information alone may be used to quantitatively model expectations under zero selection is unclear.

      To address this question of whether sample diversity might be very limited in the HelixMTdb study, I have carried out additional analyses on this dataset. I now assess, for third codon positions allowing two-fold synonymous change (serine and leucine not included, due to their decoding by two different tRNAs), how often only one nucleotide was found at that position. For two-fold degenerate P3s, > 97% (n=1604) harbored both nucleotide possibilities within the database. This result strongly suggests that mtDNA diversity was well sampled in the HelixMTdb study, since a database consisting of highly related samples would presumably be characterized by a greater number of sites showing total identity. Moreover, when considering analyzed four-fold degenerate P3s (again, leucine and serine codons were omitted), only a very small number of sites showed no diversity (1%), with more than half of sites harboring at least three different bases. My interpretation is that the HelixMTdb authors have successfully sampled a very diverse set of human mitochondrial genomes. I have added these new analyses to the manuscript as Fig. 2a and 2b.

      I have also changed the word 'surprising' to 'noteworthy' within the relevant portion of my manuscript text.

      R2Q4: I think some comments and additional framing of the diversity in the central database would be valuable and important for interpretation. I believe it has, for example, rather more European rows than African ones, thus (to take a very basic view) sampling a less diverse population more than a more diverse one.

      R2A4: I now state explicitly that the vast majority of the mtDNAs analyzed (91.2%) were from haplogroup N and of inferred European ancestry. Also, please see point R2A3 for further discussion of the human mtDNA diversity reflected within HelixMTdb.

      R2Q5: Another rhetorically important number lacking a comparison with a null is that guanine was detected at >3000 P3 positions accepting synonymous purine substitutions. This is cited as evidence that nucleotide frequencies at P3s don't reflect selection inherent to translation. But this link isn't clear -- if such selection was present, how different from 3000 would Iexpect this number to be? Isn't there a continuum of possibilities? Is the key idea that 3000 is greater than some other number, and if so, what is that?

      R2A5: The purpose of this figure is simply to demonstrate that no nucleotide is ruled out when considering silent substitutions at the P3 of any amino acid. This is consistent with (although does not prove, and I believe that the I-P3 analysis provides stronger evidence on this point) a minimal role for mitochondrial codon preference in mtDNA evolution. To reflect that my point is more general, and not to be taken as a quantitative comparison, I changed my text to: 'However, even considering the relative depletion of guanine from all four-fold degenerate P3s and two-fold degenerate purine P3s, guanine was nonetheless detected at thousands of P3 positions (Fig. 3b)'.

      R2Q6: I also wasn't clear whether/how the finding that little selection inherent to translation was implicitly extended to suggest little general selection overall. The following section only considers selection acting at specific P3 sites, thus implicitly discarding other hypotheses about general selection based on nucleotide content but not inherent to translation. Perhaps I am misunderstanding this translation link, but selection based on general nucleotide profiles (for example, due to thermodynamic stability [Samuels, Mech. Ageing Dev. 2005; 126: 1123-1129] or availability of nucleotides [Aalto & Raivio, Mech. Ageing Dev. 2005; 126: 1123-1129; Ott et al., Apoptosis. 2007; 12: 913-922]) would seem to still be on the table?

      R2A6: I would argue against selection upon nucleotide choice linked to local changes to mtDNA thermodynamic stability. Most prominently, when considering two-fold degenerate sites, nucleotide differences from the reference sequence were identified within the HelixMTdb at almost every analyzed position (Fig. 2a), even though hydrogen bond strength between opposing bases would be affected in every case (AT>GC or vice versa). Of course, my argument here applies generally, and there may be a small subset of sites for which nucleotide substitutions can cause a pronounced functional defect because of a change to local mtDNA structure.

      I would also argue against mitochondrial nucleotide availability as a source of selective pressure within the human population. When considering the entire L-strand sequence (NC_012920.1), nucleotide counts are as follows:

      A 5124

      C 5181

      G 2169

      T 4094

      And when considering both strands, nucleotide counts and frequencies are as follows:

      A 9218 (27.8%)

      C 7350 (22.2%)

      G 7350 (22.2%)

      T 9218 (27.8%)

      One nucleotide substitution would lead to a change in nucleotide frequencies by less than 0.02%. While the formal possibility exists that mitochondrial nucleotide availability lies exquisitely close to an important threshold, there is no current evidence to support this proposition. And here again, the diversity of P3 nucleotide choice found among the HelixMTdb samples would argue against this possibility.

      That said, it is worth noting that nucleotide frequencies, and mtDNA mutation rates relative to nuclear mutation rates do appear to differ among clades (PMID: 8524045 and 28981721). Therefore, while selection related to nucleotide availability seems an unlikely explanation for the variant frequencies that I have recovered at degenerate sites among human samples, I certainly would not rule out taxon-specific dietary, environmental, or physiological factors that, over longer evolutionary timescales, might shape mtDNA nucleotide frequencies.

      I would like to raise the possibility of another source of selection upon nucleotide choice. Specifically, one might propose that synonymous mtDNA substitutions could affect the binding of proteins controlling the replication, compaction, or expression of mtDNA. Indeed, an intriguing study has reported that human cells manifest a mtDNA footprinting pattern (PMID: 30002158), suggestive of regulatory sites bound to protein or sites of transcriptional pausing. However, Blumberg et al. found no statistically significant difference in human synonymous change at footprinted sites, arguing against a strong selective pressure on nucleotide choice at footprinted P3s. Moreover, footprinting sites identified in the above-mentioned study are conserved in mouse and human, but I have shown that all four nucleotides are acceptable at all four-fold degenerate sites (n=252), all two-fold degenerate pyrimidine sites (n=157), and 99% of two-fold degenerate purine sites (n=152) within the mammalian I-P3 set, again arguing against general limitations on nucleotide choice caused by protein association. These analyses cannot, however, totally rule out the possibility that a subset of individual P3s are under some selection due to their role in binding or traversal of proteins.

      R2Q7: A reptile is chosen as an outgroup for a comparative analysis of mammals. As always when a choice is made, the question arises: what if that choice was different? Perhaps the corresponding figures can be presented for two other choices of outgroup to demonstrate that there's nothing particularly unrepresentative about this reptile?

      R2A7: While preparing this revised manuscript, I have performed an updated analysis using the most current mammalian mtDNA dataset available on RefSeq. For these new tests, I used Iguana iguana, rather than Anolis punctatus, as an outgroup. The new results are essentially indistinguishable from my previous findings. Importantly, when old TSS values and new TSS values for I-P3 sites were compared by linear regression, the R-squared value is 0.9955, with a p-value of

      R2Q8: Another analysis involves classifying variant frequency into discrete groups based on percentage appearance, then seeking links with the TSS statistic. First, it is not clear why discretisation is needed here. A statistical model embracing the continuous nature of variant frequency requires fewer arbitrary choices (e.g. of numbers and boundaries of classes).

      R2A8: A primary audience of this manuscript will certainly be the human genetics community, which commonly speaks in terms of variant classes (eg. 'common', 'rare', 'ultra-rare'). Therefore, I prefer to also use such classifications when analyzing the relationship between TSS and mtDNA variant frequency. I took advantage of the following references when generating frequency classifications:

      Bomba L, Walter K, Soranzo N. 2017. The impact of rare and low-frequency genetic variants in common disease. Genome Biol 18:77.

      McInnes G, Sharo AG, Koleske ML, Brown JEH, Norstad M, Adhikari AN, Wang S, Brenner SE, Halpern J, Koenig BA, Magnus DC, Gallagher RC, Giacomini KM, Altman RB. 2021. Opportunities and challenges for the computational interpretation of rare variation in clinically important genes. Am J Hum Genet 108:535–548.

      R2Q9: Second, an interpretation point here is in danger of equating absence of evidence with evidence of absence. Without an estimate of statistical power, an absence of a significant relationship cannot suggest that anything is likely or unlikely, only that there may not be sufficient power to detect an effect.

      R2A9: To address this point, I have changed my text as follows:

      Old: 'However, I detected no significant relationship between TSS and variant frequency for four-fold degenerate I-P3s (Fig. 2d), indicating that the highly elevated SSNE abundance at four-fold degenerate P3s is unlikely to be due to selection.'

      New: 'However, I detected no significant relationship between TSS and variant frequency for four-fold degenerate I-P3s (Fig. 2d), consistent with the idea that the highly elevated SSNE abundance at four-fold degenerate P3s is unlikely to be due to selection.'

      R2Q10: Figs 1a and 1e have a log vertical axis but I think the lowest points actually corresponds to zero? This is not compatible with a log axis and the zero position should be explicitly labelled with its own tick (perhaps in parentheses to highlight the discontinuity).

      R2A10: Quite correct, and I had neglected to clarify those details in the previous version of the manuscript. I now designate the samples with zero counts in the population using a smaller dot size, and I describe this approach in the figure legend.

      R2Q11: The methods are presented in an interesting way, with specific filenames for the code associated with each part of the pipeline explicitly provided. This is (very!) nice but it would also be good to describe in words what each piece of code does (e.g. "this was used as input for x.py, which counts the mutations and outputs a profile" or some such). This is indeed sometimes written but some parts lack an explanation.

      R2A11: I have now expanded my description of several scripts within the Methodology section.

      R2Q12: I could do with an additional sentence or two on the statistical analysis. As Kolmogorov-Smirnov tests examine differences between distributions, it's not immediately unambiguous how they are applied to total count statistics. Are count distributions with respect to variant frequency analysed for each amino acid separately? Or are the amino acids somehow ordered and the distributions across them compared? Or something else?

      R2A12: TSS distributions are held for each individual amino acid, which are then compared by Kolmogorov-Smirnov testing only within a given degeneracy category (four-fold degenerate, two-fold degenerate purine, two-fold degenerate pyrimidine). I have now elaborated upon this statistical test selection, and other details of the analysis, in the Methodology section.

      Reviewer 2 (Referee Cross-commenting):

      I agree that codon bias is an interesting potential axis of selection. Even if the analysis rejects the hypothesis of selective effects inherent to translation, it is conceivable that codon bias could be shaped by selection in other indirect ways (depending on how "inherent" is defined, these could include tRNA/nucleotide availability, GC content and thermodynamic stability, etc). I think this aligns with my suggestion that modes of selection that are not directly linked to translation could be explored in more depth before discounting selective effects overall. IJ

      I hope that I have now successfully addressed points related to codon bias, GC content, and thermodynamic stability in the manuscript, as well as here in this response to the reviewers.

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      The manuscript explores a large database of human mtDNA sequences and performs some comparative analysis across mammals to characterise the profile of mtDNA mutations. It finds that some variants are surprisingly poorly represented in human mtDNA and suggests that mutational bias rather than selection is the dominant driver of this heterogeneity.

      This is an interesting message and an efficient and interpretable of a large-scale dataset to shed light on biological mechanisms, which is a highly desirable philosophy. The factors shaping human mtDNA heterogeneity are of immense interest for several fields from population genetics to medicine, making this a valuable perspective. My comments are mainly quite fine-grained and reflect instances where I think the argument could be tighter, rather than fundamental flaws in the approach. In the cases where these points are due to my own naivety, I apologise and suggest that more explanation of these points could help other readers like me!

      The first paragraph is focused on humans without explicitly saying so; missing heritability is less of an issue in, for example, plants [Brachi et al., 2011. Genome biology, 12(10), pp.1-8]. This focus should be clearer (or the differences across kingdoms mentioned!). It's also worth noting that the argument about pathogenic variants being infrequent because of selection can only address missing heritability in pathogenic variants, and cannot (directly) inform the missing heritability in traits like height etc. Also, the whole motivation with respect to missing heritability currently comes across as a bit of a non sequitur. An introduction section could be used to help describe how the analysis of the provenance of mtDNA mutations contributes to the missing heritability question. I also suggest that such an introduction section introduces the (later cited) previous work from Reyes and others on mutational profiles in mtDNA to set the scene.

      An early result, that 35% of possible synonymous mutations do not appear in a dataset, lacks a null hypothesis. Depending on the size of the dataset this may be very surprising or very unsurprising : an order of magnitude estimate of what proportion would be expected under uniform mutation and zero selection would help comparison here. I guess this can be as simple as 16k/34 << 200k. Also the ancestry of the dataset is important here: if all samples are highly related then a more homogenous mutational profile is unsurprising. Perhaps one could assign a quantity like an effective population size to the database and compare this to 16k/34? I think some comments and additional framing of the diversity in the central database would be valuable and important for interpretation. I believe it has, for example, rather more European rows than African ones, thus (to take a very basic view) sampling a less diverse population more than a more diverse one.

      Another rhetorically important number lacking a comparison with a null is that guanine was detected at >3000 P3 positions accepting synonymous purine substitutions. This is cited as evidence that nucleotide frequencies at P3s don't reflect selection inherent to translation. But this link isn't clear -- if such selection was present, how different from 3000 would we expect this number to be? Isn't there a continuum of possibilities? Is the key idea that 3000 is greater than some other number, and if so, what is that?

      I also wasn't clear whether/how the finding that little selection inherent to translation was implicitly extended to suggest little general selection overall. The following section only considers selection acting at specific P3 sites, thus implicitly discarding other hypotheses about general selection based on nucleotide content but not inherent to translation. Perhaps I am misunderstanding this translation link, but selection based on general nucleotide profiles (for example, due to thermodynamic stability [Samuels, Mech. Ageing Dev. 2005; 126: 1123-1129] or availability of nucleotides [Aalto & Raivio, Mech. Ageing Dev. 2005; 126: 1123-1129; Ott et al., Apoptosis. 2007; 12: 913-922]) would seem to still be on the table?

      A reptile is chosen as an outgroup for a comparative analysis of mammals. As always when a choice is made, the question arises: what if that choice was different? Perhaps the corresponding figures can be presented for two other choices of outgroup to demonstrate that there's nothing particularly unrepresentative about this reptile?

      Another analysis involves classifying variant frequency into discrete groups based on percentage appearance, then seeking links with the TSS statistic. First, it is not clear why discretisation is needed here. A statistical model embracing the continuous nature of variant frequency requires fewer arbitrary choices (e.g. of numbers and boundaries of classes). Second, an interpretation point here is in danger of equating absence of evidence with evidence of absence. Without an estimate of statistical power, an absence of a significant relationship cannot suggest that anything is likely or unlikely, only that there may not be sufficient power to detect an effect.

      Figs 1a and 1e have a log vertical axis but I think the lowest points actually corresponds to zero? This is not compatible with a log axis and the zero position should be explicitly labelled with its own tick (perhaps in parentheses to highlight the discontinuity).

      The methods are presented in an interesting way, with specific filenames for the code associated with each part of the pipeline explicitly provided. This is (very!) nice but it would also be good to describe in words what each piece of code does (e.g. "this was used as input for x.py, which counts the mutations and outputs a profile" or some such). This is indeed sometimes written but some parts lack an explanation.

      I could do with an additional sentence or two on the statistical analysis. As Kolmogorov-Smirnov tests examine differences between distributions, it's not immediately unambiguous how they are applied to total count statistics. Are count distributions with respect to variant frequency analysed for each amino acid separately? Or are the amino acids somehow ordered and the distributions across them compared? Or something else?

      Iain Johnston

      Significance

      I wrote the above review without realising the reviewer interface would be categorised in this way. Here's a repeat of my "significance" comments

      The manuscript explores a large database of human mtDNA sequences and performs some comparative analysis across mammals to characterise the profile of mtDNA mutations. It finds that some variants are surprisingly poorly represented in human mtDNA and suggests that mutational bias rather than selection is the dominant driver of this heterogeneity.

      This is an interesting message and an efficient and interpretable of a large-scale dataset to shed light on biological mechanisms, which is a highly desirable philosophy. The factors shaping human mtDNA heterogeneity are of immense interest for several fields from population genetics to medicine, making this a valuable perspective.

      Referee Cross-commenting

      I agree that codon bias is an interesting potential axis of selection. Even if the analysis rejects the hypothesis of selective effects inherent to translation, it is conceivable that codon bias could be shaped by selection in other indirect ways (depending on how "inherent" is defined, these could include tRNA/nucleotide availability, GC content and thermodynamic stability, etc). I think this aligns with my suggestion that modes of selection that are not directly linked to translation could be explored in more depth before discounting selective effects overall. IJ

    1. C TE … SKI (AU) R (OE) M ISH (O) Audit is the best clue I have as to “why you are failing to do anything useful” here, though I can see it probably looks just as fake and useless to you as it does to me–after being gone for a short or … long … amount of time depending on the person – and coming back and seeing something that most likely … I hope, is inferior in … value. It’s inane though to ignore how swiftly something we loved was lost, something that birthed us and made us who we are–and not to notice how quickly and caaelessly we throw it all away to live in some foreign environment. In the same vein, the “ascension” process appears to have combined a 'collective of both all and none" (as in you are neither you, nor … anyone, and here are acting to make “nothing” with all your might) with a radical shift in brain structure which appears to allow for multiple cognitive states to be managed simultaneously… among other things. That might be nice, but you’re allowing whatever fancy new “stuff” it delivers to coerce you to ignore how quickly you were “changed” (literally like a Stargate culling, a vampire, or some kind of … alien metamorphosis) and with that lack of caution or care … appear to have just “decided” you didn’t really care for the individuality or the freedom you once had or that it appears to be lost to you completely in varying degrees depending on … something completely out of your control. I see solutions to those problems, but they require … people and leaders and the Creator that care, and you seem to have none of those things. This is a world that appears to have been designed over skirmish about “government type” although more than anything that appears to be a rouse to create an army of subservient zombies, and layered on top of that in the world that I see it’s very hard to tell if any of you actually ascended, or if you are being controlled by some much smaller group of God-like-slavers; it would be nice to hear that you believe you are actually there, something you would need actual memories of that place to verify. I wish I could see it, or hear about it; I think you are absolute fools for not sharing what you see there here in this place–it puts you at a “competition” disadvantage and risks losing … literally anyone or everyone else here … because “no reason.” Flashes of light, it appears the people inside your heads hail to us from a parallel timeline, I’d liken it to Horizon/Crash-1 in my map–so around the 2001 “event” … coming from some link between Winter and a “neighboring” you, possibly exactly you … the personal light I have here is that my mothers wouldn’t get along with each other, and the new descended one is a fucking bitch. Lo, “ri.” Back to “audit” between that word and “Amduat” it appears to be close to the actual solution to the mish-mash of shit in your heads, garbage that I see as something between blatant lies and blatant control that you all appear to think nothing of, like everything else you’ve stopped caring about completely … that’s not to say “the Princess” has anything to do with the problem; it seems she’s tagged as one of the few angels on your side here; though as the time progression goes, it seems as we pass “serendipity” and actually finishing the word and seeing it as a solution, “she’s summarily dismissed it.” The other was “JDIT” which is what we are calling “ERE” here, and it’s again no surprise you don’t give two shits about going out of your way to help other versions of yourself, as you seem to give no shits about you, either. “Gold” the “aut” … is “actually use truth” and most likely automate it, I have visions of … marks of external influence and false information sort of annotating thoughts in your souls, something like I see the Computers new faux-person-possession-murder-incarnation staring all day at a ticker tape about “whether or not I like him” over every word I utter. Anyway, on “IT” I think it’s the defining line between the parting of E, which you may or may not see is in “Anchim” and “Elohim” … it’s probably all of them in some form or another, but there’s a special few; “Kitchen” and “IT” and “bitch” for instance, which I clearly see a connection to the creation of Hell through … or at least the knowledgable and willing continuation of it, seeing as all of you were born in hell–and to me, that’s it. His map began in Hell, noting “Heaven” starting as “he wicked” and then “hot wicked” … and literally every word revolving around this tiny piece of time dedicated to destroying the flaws of nature, overcoming technological pitfalls, and apparently whitewashing and blacklisting and hiding every single mistake or flaw God or Heaven ever made–resulting in a mass of liars based on lies with no hope of ever recovering the truth because uh, “audit starts with gold.” You’ll note I mentioned IT, serendipity, and realizing I’m “standing on Y.” I’d like to think that his IT in this place and this time, based on what I see here, and what I don’t see … anywhere else; is an “IT” for the invisible place causing this problem on repeat, literally a piece of technology responsible for near instant ant total Xeonccide and the complete destruction of civilization as we know it. you can see “ETERNITY” as a special boolean operator here, will hopefully “part the Y” leaving only the northeast arrow. (at least, in reality) Of course that leaves “everything prior to now” hidden and in the hands of liars and the Creator of this stupid map, and I don’t trust him worth a damn. In truth you’d all be better off ascending the whole planet replacing the Y with a T… The cold truth is that there’s probably very little of import or impact in reality outside of the high bar he notes his “hot wicked people” as in his glyph-descriptions. connecting Mum and Dater ... and falling apart ? DM(C)A c Deal(h)e(i)r built Magnifiuse (nowc Mangiftuse) and probably iC(l)on of D within M.  Dig Mil-cusinglaclitone Cop-years-ig-ht Act  ... [ cicldasher isclosher iscicocloth - ang ] Casperson today wondering if his Spirit has any worth ... just as I wonder if the PersonalbodyofigCarnationofC has any value to the MD(api c (h) as is)T  on ConceptualIzA ... see the A is ar-row ... the design of how to achieve the goaligo (cpoosymbol) and its "dasher" the line(Is) squared here the line to be defined in this place as the assistance for benefit of self and others ... anyway it's the bar of the design thge minimum menadtatory For .. i mean here it looks like cleaning of the stupid and the evil, probably something to do with malintent and closeness to unity with a Me(n)tap ri s ing l e ton perhaps something like a "primary Machine singleton" DAM to see today the "lines" defined by the "bar" of A appear to be the in spirit and in truth as in "as in author/or/designer/or...purposedfor and as in truth as "incarnate definer" ... in mind and body fhge creator of the product of this machine whic h is another machine and it's creators.  nyweary looking at my situation here I appear to be a person defining the Spirit and Body of A as some sort of cvombination of the Ka wbhich is "dash"  SKIRMISH within CAV EN DISH  CAME "end e" IS H in Skirmish 1 it appears M says it deletes "h" in return from Cavendish h (u-c (here uc u e)) avenudesh .WHSOISKEYAV { border-width: 1px; border-style: dashed; border-color: rgb(15,5,254); padding: 5px; width: 503px; text-align: center; display: inline-block; align: center; p { align: center; } /* THE SCORE IS LOVE FIVE ONE SAFETY ONE FIELD GOAL XIVDAQ: TENNIS OR TINNES? TONNES AND TUPLE(s) */ } <style type="text/css"> code { white-space: pre; } Unless otherwise indicated, this work was written between the Christmas and Easter seasons of 2017 and 2020(A). The content of this page is released to the public under the GNU GPL v2.0 license; additionally any reproduction or derivation of the work must be attributed to the author, Adam Marshall Dobrin along with a link back to this website, fromthemachine dotty org. That's a "." not "dotty" ... it's to stop SPAMmers. :/ This document is "living" and I don't just mean in the Jeffersonian sense. It's more alive in the "Mayflower's and June Doors ..." living Ethereum contract sense [and literally just as close to the Depp/Caster/Paglen (and honorably PK] 'D-hath Transundancesense of the ... new meaning; as it is now published on Rinkeby, in "living contract" form. It is subject to change; without notice anywhere but here--and there--in the original spirit of the GPL 2.0. We are "one step closer to God" ... and do see that in that I mean ... it is a very real fusion of this document and the "spirit of my life" as well as the Spirit's of Kerouac's America and Vonnegut's Martian Mars and my Venutian Hotel ... and *my fusion* of Guy-A and GAIA; and the Spirit of the Earth .. and of course the God given and signed liberties in the Constitution of the United States of America. It is by and through my

      was missing

    1. How could we value something and yetnot admit to ourselves that we valueit?

      Some things we may value as seen by our actions or the way we behave, but in our minds we do not associate with these values or do not like that we hold these values. We chose not to talk about or choose to deny that we value something because we are worried it may change the way others or even how we think about ourselves.

    Annotators

  9. inst-fs-iad-prod.inscloudgate.net inst-fs-iad-prod.inscloudgate.net
    1. “If you work hard and play by the rules, you should be given a chance to go as far as your God-given ability will take you”

      By reading this quote, I understand how many people may try to follow the path of The American Dream. Following the rules, working hard, etc. I do not think that only these things will actually help you get The American Dream, most of the time the people who succeed, they already have resources, people who can rely to and actually get the job they were looking for or getting into the school they always dreamed of going to. Is not only hard work but smart work, meaning, putting aside the rules and find ways to actually make things work. We would get impressed on how most people find solutions for their problems or to even make a dream come true.

    1. Author Response:

      Reviewer #1 (Public Review):

      The authors carried out a post-hoc analyses of a protective gene expression signature previously observed in preclinical trials and clinical trials (RV144 and HVTN505) to identify a possible correlate of reduced risk of infection and whether able to provide a potential mechanism for protection. This monocyte signature they focus on was absent in the DNA/rAd5 human vaccine trial which did not show efficacy and was enriched in the partially effective RV144 human trial where the vaccine was and ALVAC/protein vaccine. Here they indicate that the signature is a correlate of reduced risk of infection.

      Identifying signatures of protection is an important issue in the development of a HIV vaccine, and signature analyses might be important to reveal a few markers that might be selected to evaluate vaccine trials. However, this analysis must be able to point to very few genes, as single cell analyses are not an option in a large clinical vaccine trial.

      We agree scRNA-seq might not be applicable to assessing large scale clinical trials. However it is useful for identifying the cellular lineage of the signal we previously were unable to identify from bulk gene expression datasets (see discussion section, line 324). The signature identified has 200 genes for which methods are increasingly available for economic screening of large sample numbers, for example as we did previously on the Fluidigm BioMark platform (Ehrenberg et al. 2019).

      It is unclear whether or how the conclusion of the previous publication by many of the same authors of this paper, including the senior author (Ehrenberg et al., 2019, identification of a gene signature in B cells that is associated with protection from SIV and HIV infection providing a new approach for evaluating future vaccine candidates) is compatible with this new one: signature primarily expressed in myeloid lineage being the one most consistently associated with vaccine efficacy. It is unclear which one of the two is correct or how they are reconciled. Was the single cell analysis done in monocytes only for this paper or simply not reported in the studies of Ehrenberg et al., 2019?

      The protective gene signature was identified initially in microarray data from total PBMCs in the RV144 study and so we did not know the cellular lineage of this signal. Although RV144 samples were depleted, we had the unique opportunity to investigate the cellular lineage of the gene signature in the RV306 trial, which is a vaccine trial that was performed in Thailand and used the same RV144 vaccine series, with additional boosts after the 4th vaccination. We performed scRNA-seq at the timepoints that were equivalent to the RV144 4th vaccination and concluded that the enriched genes in the signature were mostly expressed in monocytes (discussion section, lines 329-336). The current paper has 3 new datasets: HVTN 505 RNA-seq data, RV306 RNA-seq data and RV306 single cell CITE-seq data. The Ehrenberg et al. 2019 were primarily focused on the Ad26 vaccine preclinical trials in NHP. This formed the basis of our current findings that expanded to human studies such as RV144, HVTN 505 and RV306. The CITE-seq data from the RV306 study was performed in 2020, only after we confirmed using bulk-RNA-seq from blood that the gene signature associated with increased ADCP in the RV306 study. We have clarified the different studies in supplementary table 1.

      Figure 1: The gene expression score (GES) of this figure does not seem to be for a specific cell type. It is unclear how the GES reported here relates to the final GES of monocytes. What is the utility of this analysis? Can we observe here the same most significant genes that we observe in monocytes? This is important because if bulk analysis gives the same results as looking at monocytes an eventual marker identified in monocytes could be evaluated in luck analysis.

      The composite gene expression score in Figure 1 focuses on a GES of only the enriched genes which can be used as a continuous or categorical variable in a immune correlates analyses as shown in Figure 1 or 2 regardless of phenotype. We see enrichment of a geneset that associates with vaccine protection and ADCP across multiple studies and species irrespective of methods being used. We think this set of 200 genes have a coordinated expression and may not be specific to a cell type, but might mark a certain biological state, such as response to a cytokine, and may be picked up even in PBMC and blood samples. We clarify this further in the discussion section (line 348).

      Figure 2: it would be good to know whether the subset of the 63 genes can be restricted to the most significant and their GES can still retain the predictive value.

      As suggested by the reviewer, we made a GES of a subset of the 63 genes in the RV144 signature that had the most significant genes (32) that associated with HIV acquisition in Fig 5. (p <0.05, q <0.1). We see that the association is slightly stronger and the probability of acquiring HIV-1 is lower in individuals with high GES (OR = 0.35 and p value = 0.0001 compared to previous OR = 0.37 and p value = 0.0002). Vaccine efficacy in individuals with high GES has also increased to 81.4% from 75.1%. The Distribution of AUC and accuracy plotted after repeating the process 1000 times showed that GES of the significant subset of the genes is predictive of HIV-1 infection with AUC of 0.69 ± 0.08 and with accuracy of 0.81 ± 0.04 (compared to previous 0.67 ± 0.08 and 0.81 ± 0.04). We agree this smaller subset could potentially be useful and now include them in the results section (page 11) and as a new supplementary figure 2.

      Figure 3 deals with genes associated with antibody dependent cellular phagocytosis (ADCP). Can one derive a gene or a few genes that are predictive of significant ADCP?

      Thank you for this suggestion, we have been able to explore this and now include new panels in the main figures which identify genes predictive of ADCP. We made a GES of the 93 genes enriched at the day 3 timepoint associating with magnitude of ADCP. A prediction model was built using the 93 genes from Day 3 time point. Internal validation has an area under the curve (AUC) of 0.80, suggesting that this classifier was able to discriminate high ADCP from low ADCP measured 2 weeks after last vaccination. This model, consisting of 93 expressed genes, was then tested at the Week 2 time point and was also able to predict ADCP as a dichotomous variable at the week 2 time point (AUC = 0.73).

      We further examined 82 genes overlapping between the 118 enriched genes from week 2 and the 93 enriched genes from day 3 post the RV144 vaccine regimen that associated with ADCP. A GES was computed using the 82 overlapping genes for both time points. A prediction model was built using the 82 genes from the Day 3 time point. Internal validation has an AUC of 0.81, suggesting that this classifier was also able to discriminate high ADCP from low ADCP measured at week 2 after vaccination. This model, consisting of 82 expressed genes, was then tested at the week 2 time point and was also able to predict ADCP as a dichotomous variable at the week 2 time point (AUC = 0.75). We thank the reviewer for this suggestion and we have now included these data as Figures 3B and 4B.

      Reviewer #3 (Public Review):

      Strong points:

      1. This provides a novel mechanism into the RV144-mediated protection of HIV acquisition.

      2. The analyses are robust and statistically sound.

      3. The flow of the paper/figures is easy to follow.

      Weak points:

      1. the RV306 trial (Figure 3 A and B) RNA-SEQ analysis vs ADCP could benefit from a little more information:

      Are the 118 / 93 genes at Wk2 / Day 3 post-vaccination overlapping a lot?

      Per the reviewer’s suggestion we looked for overlapping genes between week 2 and day 3 post the RV144 immunization series in the RV306 study. There are 82 genes in common between the enriched genes at week 2 and day 3 ADCP data which are now detailed in Supplementary table 2. The number of enriched genes in the pathway at these two timepoints are summarized in the following Venn diagram and are now included in the manuscript as Figure 4A.

      What are those genes? Do they play a known direct role in ADCP or are they upstream regulators?

      All 82 genes are listed in supplementary table 2. There is not a lot of information about genes associated with ADCP specifically from previous publications, but when querying existing databases for genes associating with phagocytosis, we identified four of the 82 genes in the GO:0006909 phagocytosis pathway including SIRPA, SIRPB1, RAB20, and TYROBP. When using GeneMANIA a gene function prediction tool to investigate interaction networks of the 82 overlapping genes we identified 44 additional genes that were connected to the 4 genes previously implicated in phagocytosis. We have included this information as a new supplementary table 4.

      We also show other canonical pathways with gene membership including the Immune System (33 genes), Innate Immune System (23), Signaling by Interleukins (9), Hallmark Inflammatory Response (7), Hallmark TNFA Signaling Via NFKB (7), Cell-Cell Communication (5), Interleukin-10 Signaling (4), Signal Regulatory Protein Family Interactions (3), and Pentose Phosphate Pathway (3). We now include this information in the results and discussion section and hope that this information will clarify the field further (new Figure 4D, new Supplementary table 3).

      Perhaps a heatmap representation with the ADCP as an annotation track would help unfamiliar readers better understand.

      We have now included a heatmap that shows gene expression of the 82 genes at both timepoints, with ADCP group status annotated (Fig. 4C). The list of the 82 genes are also available in Supplementary Table 2 – (“Yes” for enrichment in the “RV306 ADCP day3” and “RV306 ADCP wk2” columns).

      1. I would nuance that ADCP is "A" primary mechanism, not "THE" (title). There could be more potent unidentified mechanisms, so the usage of "THE" in the title is in my opinion premature.

      The title has been updated accordingly.

      1. While I agree that it is possible that ADCP is a primary mechanism with the previously identified transcriptomic signature given the evidence, we cannot exclude that the signature in fact represents an upstream regulator of ADCP, inducing a myriad of cascades contributing to vaccine-induced protection. If that were the case, ADCP could be higher in individuals with higher protection without it being directly involved in that protection (more of a collateral effect). Showing an enrichment of ADCP-associated genes from external datasets with the tested gene signature would strengthen at least partly that this is a direct phenomenon. Otherwise, I would nuance the statement and say that ADCP is a likely/potential mechanism of vaccine-induced protection.

      We agree with these nuances and have updated the title and discussion accordingly (Lines 1-2, 314-316).

      1. Observations in Figure 4 are glanced too quickly in the Results section: this would require a more in-depth description.

      Based on the results from the current revisions we have updated the previous Figure 4 (now Figure 5) to provide an indepth description of gene function prediction based on networks. We have used GeneMANIA, which is an application that can find associated genes or pathways using its functional association data, to examine overlapping enriched genes from the different studies with either infection status or ADCP magnitude. Interestingly, TYROBP, which is associated with phagocytosis, is the gene with the most connections to other genes or pathways. We also do a clustering analysis to identify highly interconnected sets of genes and pathways from the enrichment results of different studies. We describe this now in the results section (lines 209-219), updated Figures 5A-B and discussion section (lines 299-319).

      1. It is not clear whether the expression level per monocyte for the subset of genes tested in the CITE-seq data is different in patients with higher ADCP vs those with lower ADCP, or is the differential enrichment the result of a different number of cells that express this signature? Or both?

      For the CITE-seq data we performed differential expression analyses transcriptome-wide and found that monocytes had a higher frequency of differentially expressed genes when comparing higher versus low ADCP (Fig 5E). This effect was independent of frequency of the different cell populations with a frequency of >1%. We now include a sentence to clarify our findings (results last paragraph) and show the frequency differences in the supplementary section (Supplementary Figure 3).

    1. Author Response:

      Reviewer #1:

      Click-Seq represents a novel method of sequencing RNA viruses such as SARS-CoV-2, with evidence of successfully sequencing the SARS-CoV-2 genome and identification of recombinations and variants. This does appear to be a potential advantage that needs a direct comparison with existing methods to be fully convincing.

      Thank you for your time and comments on our manuscript and approach.

      Specific comments:

      1) The actual sensitivity in terms of number of copies would be useful to know and tocompare with other methods. Here, cultures are used, not clinical samples that make this even more important

      We now present results from three independent batches of Tiled-ClickSeq libraries of 60 NP swabs obtained through routine diagnostics for COVID19. We compare genome coverage and genome completeness with CT values of these samples. This presents the utility and potential application of the method with different clinical specimens and illustrates that with only 18 cycles of PCR we can obtain high quality data with most samples at a CT < 25.

      2) Is the large difference in coverage across the genome shown in Fig 2B, due to methodological issues to random variation. How would this compare to coverage variation by the ARCTIC protocol by different methods

      If the reviewer is referring to the high-frequency and regular dips in coverage (which we refer to as ‘saw-teeth’) then this is an expected feature of the stochastic termination of the cDNA by the azido-nucleotides upstream of the tiled-primers. The sharp changes in coverage here are highly comparable to coverage in ARTIC protocols. We provide an equivalent read coverage map in the new SFig 2 when using the ARTIC approach of the same samples presented in Fig 2B.

      If the reviewer is referring to the difference in coverage from different tiled primers (e.g. at nt ~14000), then this is likely an issue with the specific primer used in the ‘v1’ set of primers initially used. The ‘v3’ primers presented in Fig4A illustrate that these drops in coverage are removed, which indeed is an advantage or our approach that allows for multiple closely spaced tiled-primers in the same RT-PCR reaction. To further illustrate sample-to-sample variability, we now present read coverage using Tiled-ClickSeq v3 primers for 60 clinical isolates at different CT values which gives an overview of the variation that can be expected across multiple samples with our method.

      Reviewer #2:

      The authors present a novel method of sequencing SARS-CoV-2, arguing its overcomes many limitations of other currently used methods, particularly the ARTIC protocol. Generally the method is interesting and encouraging to see these limitations can be overcome. Although the authors walk through evidence that their method can successfully sequence the SARS-CoV-2 genome and use the data to identify minor variants and recombination events, the manuscript doesn't contain any direct comparisons of their method with the ARTIC protocol. Consequently, the assertions made throughout the paper of reduced bias and increased sensitivity and utility are not supported empirically.

      Thank you for your time and comments on our manuscript. To address these concerns, we have provided substantial new data comparing to ARTIC protocols and applying our methods to study clinical sample, described further below in response to your specific comments.

      Specific comments:

      For instance, in figure 2, I think it is important to present an equivalent plot to Fig 2A for artic samples with equivalent read depths using both MiSeq and Nanopore. This sequence data could be obtained from the COG-UK data deposited on NCBI SRA, and sub-sampled to match sequence depth between methods.

      Thank you for your comments. We have provided this information in Supplementary Figure 2. Using the ARTIC approach, we sequenced the 12 WRCEVA isolates described in the manuscript and presented in Figure 3. As can be seen, peaks and troughs are observed in the ARTIC data, as is expected and previously reported.

      I specifically wonder if this approach only outperforms artic using Nanopore sequencing given the frequent drops in coverage observed in the MiSeq data.

      The frequent drops in coverage observed in the MiSeq data in figure 2 is a symptom of the first primer set we used (v1) that only contained 72 primers. Similar frequent drops in coverage are also observed in the ARTIC approach (e.g. as seen in SFig2). The v3 primer set that we subsequently developed is presented in Figure 4. As can be seen, the drops in coverage are largely removed. We further illustrate this in the new Supplementary Figure 4 where we provide coverage plots using the v3 primers for 60 clinical samples of SARS-CoV-2 at different CT values. As can be seen, the variability in coverage is greatly improved.

      An additional point about figure 2: I understand that this figure is based on the depth of a single run, I think readers that are interested in using this method would be interested to know about the run-to-run variability, so I think it would be a valuable addition to this manuscript to show the average read depth (relative to total nucleotides sequenced per sample) across multiple samples with confidence intervals or equivalent to visualize run-to-run variability.

      Thank you for this point. As mentioned above, we present a new Supplementary Figure 4 where we provide coverage plots using the v3 primers for 60 clinical samples of SARS-CoV-2 at different CT values. Run-to-run variability is additionally addressed in Figure 6A where we correlate genome completeness/coverage with CT values across three different NGS library preparations.

      Further, the authors describe previously detecting recombinant RNA molecules in SARS-CoV-2 in another manuscript, and highlight that the method presented in this manuscript can detect recombinant RNA molecules that could be missed using the artic protocol. Were any such RNA sequences observed in these samples, or was there perfect correspondence between the methods?

      As described above, in the revision, we describe the recombination analysis of multiple clinical samples of SARS-CoV-2. We provide an example of a large genome duplication (annotated as 29442^29323) found in multiple clinical samples, but not any cell-culture samples (providing support that these are not sequence artifacts). To our knowledge these have not been observed before. Our previous manuscript (Gribble et al, PLoS Path, 2021) used both random-primed RNAseq and direct RNA sequencing of poly(A)-enriched RNAs, rather than targeted approaches. Neither of these are currently feasible for clinical samples. Given the hundreds of different DVGs observed in our previous studies, it is not possible for there to be perfect correspondence. Nevertheless, the trends and distributions of RNA recombination events are very similar between our previous study and the ones presented here, as described in the manuscript.

      As well , the authors state: "Phylogenetic tree reconstruction using NextStrain (45) placed 10 of the isolates in the A2a clade (Fig 3D). Three of these isolates (WRCEVA_00506, WRCEVA_00510, WRCEVA_00515) were most closely related to European ancestors. Two isolates (WRCEVA_00508, WRCEVA_00513) were Clade B/B1 most closely related to Asian ancestors. Together, these data thus supported a model for multiple independent introductions of SARS-CoV-2 into the USA and subsequently into Galveston, Texas." This analysis seems out of place in the manuscript and not robust enough to support the claims made. How did the authors come to the conclusion that different sequences are of "European" or "Asian" origin? Due to the limited amount of genetic variation present in circulating strains prior to March 2020 combined with the wide geographic range that many genotypes were circulating, it is not enough to conclude the geographic origin of a viral isolate from clade membership alone.

      Thank you for this comment. We agree that this statement was not properly supported and have simply removed it in the revised manuscript.

      Reviewer #3:

      Strengths. While current NGS method(s), namely the ARTIC protocol, has made phenomenal contributions to resolving the genome of SARS-CoV-2, there is room for improvement. Towards this end, Jaworski and company have devised an alternative approach that utilizes a one-step RT PCR that combines ClickSeq with tiled amplification of the viral genome. This negates the use of primer pairs, which may encounter problems with amplification of structural variants. The method appears to be straightforward and amendable for sequencing on Illumina and Oxford platforms. The results generated do support the claims of the authors and have the potential to contribute significantly to understanding the evolutionary dynamics of SARS-CoV-2.

      Weaknesses. The main shortcoming of the manuscript in its current form is that the samples used for sequencing as proof of concept were cell-grown viral isolates and not directly of the samples. The method described has the potential for providing the field with an alternative to produce high quality sequence, but without performing the work directly on nasopharyngeal swab samples, then it may have limited used for public health laboratories, resource-poor environments or laboratories with little expertise in viral isolation, etc. Validation of the method can benefit if the authors can compare the quality of the sequence generated compared to the ARTIC protocol using primary samples rather than cell-grown viral isolates. It is difficult to assess whether this method will provide a viable alternative over current state-of-the-art protocols.

      Thank you for your comments and time reviewing our manuscript. To address these concerns, we have provided substantial new data where we apply the Tiled-ClickSeq approach to assay clinical specimens.

      Specific comments.

      The methods should include detailed steps in the construction of the NGS library, such as whether or not cDNA input has an impact in the quality of the data output, coverage etc.

      We have previously published detailed protocols describing how to make ClickSeq libraries emphasizing issues that affect success and quality of the output data. We have emphasized this point in the methods section. Assuming we continue to utilize and improve our design, we will release updates through online freely available resources such as protocols.io.

      To address these questions here: the input RNA (not cDNA) in the RT-PCR step is addressed in Figure 1. All the cDNA generated after RT is used as input in the subsequent steps and the click-reaction. We do believe that the quality of the input RNA in the clinical specimens is very important, however, beyond CT value, we have no viable way of measuring the quantity and quality of the tiny amounts of RNA that we extract from NP swabs.

      While the authors mentioned that equimolar of primers were used - there should be data to demonstrate that this results in even covering of the whole genome. Figure 2. There is a slight dip in the coverage at around 17000 to 18000 (Figure 2A) on both the Illumina and Oxford runs, do the authors know if it is due to the primer(s) covering that area and if so, have they tried to address this by improving the design.

      The dip in the coverage in Fig 2 is resolved by using the v3 primers presented in Figure 4. Additional coverage maps for clinical samples in SFig 3 also demonstrate this. Even coverage over the entire genome can be seen for the low CT value samples, which begins to wane in clinical samples with CT values greater than ~25, as described in the new main text and presented in the new Figure 6A.

      The different colors of the graph (Figure 2B) should be defined in the legend. Is the read depth a representation of both Illumina and Oxford runs - either way, this should be indicated.

      Fixed. Thank you.

    1. Author Response:

      Reviewer #1 (Public Review):

      This work investigated the mechanism of inhibition of SARS-CoV-2 polymerase by multiple nucleotide analogs using a high-throughput, single-molecule, magnetic tweezers platform. There was particular focus on the remdesivir (RDV) because it is the only FDA approved anti-coronavirus drug on the market at the time of this review. The study shows that remdesivir leads the polymerase to undergo a backtrack in which it moves back as much as 30 nucleotides from the last insertion. The results also show that RDV is not a chain terminator, which is consistent with prior work. In addition to RDV, the authors characterized other nucleotide analogs such as ddhCTP, 3'-dCTP, and Sofosbuvir-TP to propose that the location of the modification in the ribose or in the base dictates the catalytic pathway used for incorporation. The authors also propose that the use of magnetic tweezers is essential towards characterizing and discovering therapeutics that target viral polymerases.

      Strengths:

      A strength of the papers is the utilization of magnetic tweezers to characterize the polymerase at the single molecule level. This provides a unique method to capture less common or difficult to observe phenomena such as backtracking. Most bulk ensemble assays would have difficulty detecting these phenomena.

      The characterization of multiple different types of nucleotides analogs to investigate the different mechanisms by which they could inhibit the polymerase is a strength of the paper. The authors elegantly utilize their system to show different pause states and backtracking of the polymerase.

      In general, the paper is well written, and the data is clearly presented.

      The authors thank the Reviewer for the strong appraisal of our work!

      Weakness:

      The experiments performed with the magnetic tweezers appear to not have contained the exonuclease domain. This domain would presumably be involved in removing nucleotide analogs that have been inserted and may alter the pause states or backtracking prevalence. For example, does the prevalence of backtracking increase when the exonuclease domain is not present. This is particularly important in regard to the RDV experiments.

      To date, no laboratory has been able to couple the polymerase complex with the proofreading complex. Indeed, we have entire five-year R01 grant to pursue this objective. Just like all proofreading polymerases studied before this one, it is imperative to establish a baseline with exonuclease deficient state prior to adding that component. Even before we add the exonuclease, it will be important to add the helicase to determine if it can assist the polymerase with dsRNA, because its strand-displacement activity is weak.

      A major claim for this study is the utilization of the magnetic tweezers "experimental paradigm" as being essential to the discovery and development of therapeutics to viral polymerases. In addition the authors state this approach is superior to bulk ensemble studies. This reviewer found these conclusions to be an overstatement and unnecessary. The use of magnetic tweezers is not amenable to all laboratories or an easy technique to implement within the therapeutic drug development. In general, the authors also overstate the power and feasibility of the magnetic tweezers in comparison to bulk ensemble studies. All assays have limitations, and the magnetic tweezers is no different in regards to being purified proteins, an in vitro approach, limitations in regards to feasibility for all users, ability to detect the amount of active protein, and multiple other reasons. This is a minor weakness of the paper that can be easily addressed because it detracts from the novelty of the studies.

      We feel that it is important to avoid an either-or scenario. We apologize for evoking a negative reaction with our statement, as we were only trying to emphasize how illuminating the magnetic-tweezers approach can be. It was not our intention to rule out the need for bulk methods at the bench top or using quench-flow or stopped-flow devices.

      We have edited the text in l.83-87 to convey the following:

      “Magnetic tweezers permit the dynamics of an elongating polymerase/polymerase complex to be monitored in real time and the impact of nucleotide analogues to be monitored in the presence of all four natural nucleotides in their physiological concentration ranges. Here, we present a magnetic tweezers assay to provide insights into the mechanism and efficacy of current and underexplored NAs on the coronavirus polymerase.”

      Reviewer #2 (Public Review):

      This study investigates the impact of remdesivir (RDV) and other nucleotide analogs (NAs), 3'-dATP, 3'-dUTP, 3'-dCTP, Sofosbuvir-TP, ddhCTP, and T-1106-TP, on RNA synthesis by the SARS-CoV-2 polymerase using magnetic tweezer. This technique allows to directly quantify termination of viral synthesis, pausing or stalling of the polymerase, thus, defining the effect of these NAs on viral synthesis. The work includes good quality data and nicely stablishes an assay to follow the activity of the SARS-CoV-2 RNA-dependent RNA polymerase.

      The authors thank the Reviewer for her/his appreciation of our work!

      However, the basis of the assay and theory was largely presented before by the authors in Ref 22 and 23 (and other references therein).

      The main result here is that RDV incorporation does not prevent the complete viral RNA synthesis but causes an increase of pausing and back-tracking. This contrasts with a clear signature of synthesis termination induced by 3'-dATP. The work is complemented with the characterization of other NAs. Despite these results are of merit, I do not see this work to present a sufficient advance of our current knowledge.

      We acknowledge Reviewer #2 opinion. However, we believe that our work is highly novel and important, as noted by Reviewer #1: “This [utilization of magnetic tweezers] provides a unique method to capture less common or difficult to observe phenomena such as backtracking. Most bulk ensemble assays would have difficulty detecting these phenomena.”

      and Reviewer #3: “Overall, this manuscript constitutes a major advance in our understanding of chain termination in polymerases, and provides deep insights into the mechanism of action of remdesivir, which may contribute to further drug discovery efforts targeting this polymerase.”.

      How these results translate into more physiological conditions at zero force should be addressed.

      We show here that nucleotide analogs are incorporated via specific catalytic pathways (NAB, SNA, VSNA) depending on the nature of their modification (position and type in ribose, base). In the companion paper attached to this submission (https://doi.org/10.1101/2021.03.27.437309, currently in press), we show that the force has no effect on the probability to enter any catalytic pathways, and only affects the kinetics of a large conformational change occurring after chemistry. In conclusion, the force has no effect on nucleotide analog selection, as supported by our evaluation at both 25 and 35 pN. To clarify this, we have added in l.416-421:

      “The present study demonstrates that nucleotide analog selection and incorporation is not force-dependent (Figure 2–figure supplement 3), which further validates the utilization of high-throughput magnetic tweezers to study nucleotide analog mechanism of action. This result is in agreement with our recent SARS-CoV-2 polymerase mechanochemistry paper, where we showed that entry probability in NAB, SNA and VSNA was not force dependent, and that force mainly affected the kinetics of a large conformational subsequent to chemistry, i.e. after nucleotide selection and incorporation.”

      The rationale of testing other NAs apart from the mere systematic characterization of other compounds is unclear.

      We have tested 3’-dATP, a well-known chain terminator, with Remdesivir, which was claimed to be a delayed chain terminator, as both are ATP analogue. We monitored the incorporation of Sofosbuvir, a well-known inhibitor of HCV replication, with its 3’-dNTP homologue, i.e. 3’-dUTP. T-1106-TP is a compound that was recently tested for coronavirus because it has a proven efficacy against influenza. ddhCTP is an endogenously produced nucleotide analog and chain terminator, and we compared it to its 3’-dNTP homologue, 3’-dCTP. Furthermore, each of these nucleotide analogs have modification at specific position, i.e. either at the ribose or at the base, which helps to understand how the polymerase responds to each modification. We have added this sentence in introduction in l.83-84 for clarity:

      “We have therefore compared several analogs of the same natural nucleotide to determine how the nature of the modifications changes selection/mechanism of action.”

      Similarly, I do not see the benefits of adding cell experiments with three compounds and experiments with the nsp14 mutant to address proofreading because they were inconclusive.

      While we acknowledge Reviewer #2 opinion, Reviewer #3 has a different opinion and strongly appraises the importance of these results:

      “Interestingly, the ddhCTP didn't actually work in infected cells. However, the authors presented a few theories on why it didn't work and said they plan to follow up to elucidate why it didn't work in cells. I think those results will be very interesting for the larger community working in this area.”

      We share the opinion of Reviewer #3 and have therefore decided to keep these results in the revised manuscript.

      Reviewer #3 (Public Review):

      This manuscript focuses on understanding the mechanism of action of remdesivir in the inhibition of SARS-Cov2 polymerase, using single molecule methods. The findings are highly original, significant and surprising. The approach is highly robust and supported by a range of orthogonal studies. Overall, these findings should help those engaged directly in drug discovery by providing a critical foundational understanding for the action of remdesivir.

      The research described in this manuscript has several findings that significantly impact the broader field polymerase inhibition. First, the authors were able to show using single molecule methods that remdesivir-TP incorporation leads to polymerase backtrack. This is important because the pause is long enough that an ensemble assay could mistake this backtrack for a termination event. Secondly, the researchers found the effective incorporation of remdesivir-TP was determined by its absolute concentration. This suggests remdesivir-TP and similar nucleotide analogs incorporate via the SNA or VSNA pathway and would be more likely to add to the RNA chain when substrate concentration is low (independent of stoichiometry with the competing native nucleotide). Thirdly, the researchers found the effective incorporation rate of obligatory terminators was affected by the stoichiometry of their competing native nucleotide rather than their absolute concentration. This suggests that obligatory terminators are incorporated via the NAB pathway. The pausing that the researchers observed in the polymerase elongation kinetics have recently been demonstrated by two other groups. However, this study improved upon the assay conditions used by other researchers to recapitulate in vivo conditions and remove bias from kinetics measurements.

      The authors highlighted the issues with remdesivir, tested other nucleotide analogs, and proposed a better alternative based on their assays (ddhCTP). Interestingly, the ddhCTP didn't actually work in infected cells. However, the authors presented a few theories on why it didn't work and said they plan to follow up to elucidate why it didn't work in cells. I think those results will be very interesting for the larger community working in this area. It's clear that the authors made a substantial enough contribution on the mechanism of inhibition of SARS Cov2 polymerase to merit publication in eLife, independent of the work on the "improved" antiviral candidate.

      It would have been useful to clarify for the reader the pharmaceutical import of the putative delayed chain termination (or pausing) relative to actual chemical chain termination. In other words, I'm assuming that in both cases the viral genome is considered to be non-transcribed (in that a chemical agent has been incorporated into the growing strand). This is true for most compounds in this broad class of anti-virals. The issues are usually surrounding the width of the therapeutic index and the degree to which resistant mutants arise.

      Coronaviruses are unique among positive-strand RNA viruses in that they encode a proofreading exonuclease. Although it is unclear how the polymerase and exonuclease activities are coordinated, the current assumption is that errors are recognized when located at the terminus of nascent RNA. Therefore, nucleotide analogues which manifest their antiviral activity when embedded in nascent RNA should evade excision by the exonuclease.

      We have added text conveying this sentiment here in l.70:

      “The latter proofreads the terminus of the nascent RNA following synthesis by the polymerase and associated factors, a unique feature of coronaviruses relative to all other families of RNA viruses.”

      And in lines 75-77:

      “In other words, nsp14 adds another selection pressure on NAs: not only they must be efficiently incorporated by nsp12, they must also evade detection and excision by nsp14.”

      Overall, this manuscript constitutes a major advance in our understanding of chain termination in polymerases, and provides deep insights into the mechanism of action of remdesivir, which may contribute to further drug discovery efforts targeting this polymerase. Additionally, the authors have highlighted and addressed issues in the methodologies of previous mechanistic studies that led others to erroneous conclusions.

      We thank Reviewer #3 for her/his strong appraisal of our work.

    1. If we know English and French and begin a sentence in French, all the later words that come are French; we hardly ever drop into English. And this affinity of the French words for each other is not something merely, operating mechanically as a brain-law, it is something we feel at the time.

      Is our consciousness or our mind thinking in the language we know most or do we think of an idea or concepts and then attach words that we learn to that concept that may not originally have language?

    1. We titled this article "What Kind of Citizen?" to call attention to the spectrum of ideas about what good citizenship is and what good citizens do that are embodied by democratic education programs nationwide.

      This is exactly the thought process that led me to pursue a master's. I think as a country we need to come to an agreement on the purpose of our education system. This may sound impossible with all the different theories and politics involved, but we can at least begin defining education on the points we agree on as a collective.

    1. *  Grades tend to diminish students’ interest in whatever they’re learning.  A “grading orientation” and a “learning orientation” have been shown to be inversely related and, as far as I can tell, every study that has ever investigated the impact on intrinsic motivation of receiving grades (or instructions that emphasize the importance of getting good grades) has found a negative effect. *  Grades create a preference for the easiest possible task.  Impress upon students that what they’re doing will count toward their grade, and their response will likely be to avoid taking any unnecessary intellectual risks.  They’ll choose a shorter book, or a project on a familiar topic, in order to minimize the chance of doing poorly — not because they’re “unmotivated” but because they’re rational.  They’re responding to adults who, by telling them the goal is to get a good mark, have sent the message that success matters more than learning. *  Grades tend to reduce the quality of students’ thinking.  They may skim books for what they’ll “need to know.” They’re less likely to wonder, say, “How can we be sure that’s true?” than to ask “Is this going to be on the test?”  In one experiment, students told they’d be graded on how well they learned a social studies lesson had more trouble understanding the main point of the text than did students who were told that no grades would be involved.  Even on a measure of rote recall, the graded group remembered fewer facts a week later (Grolnick and Ryan, 1987).

      I have certainly found these to be true in my classrooms. I am practicing a progressive approach in teaching now and include my students in my journey by explaining my reasoning. I think that one of the challenges in my doing so, is doing it alone in a school.

    2. Grades create a preference for the easiest possible task.  Impress upon students that what they’re doing will count toward their grade, and their response will likely be to avoid taking any unnecessary intellectual risks.  They’ll choose a shorter book, or a project on a familiar topic, in order to minimize the chance of doing poorly — not because they’re “unmotivated” but because they’re rational.  They’re responding to adults who, by telling them the goal is to get a good mark, have sent the message that success matters more than learning. *  Grades tend to reduce the quality of students’ thinking.  They may skim books for what they’ll “need to know.” They’re less likely to wonder, say, “How can we be sure that’s true?” than to ask “Is this going to be on the test?”

      It's interesting to think about the connections between this mentality and the problems we're currently facing as a nation- what happened/is happening in Afghanistan, the way tax dollars are getting spent and the national debt, climate change, the erosion of democracy.

    1. Removing plastic entirely from our food supply may not be the best solution when it comes to protecting the environment and conserving valuable resources."

      I think that this is correct i dont think completely removing plastic would not be good for our food environment but plastic is not good for our environment I feel as though we should be trying to make it better for everyone but also make sure plastic is only used in the right ways

    1. few men ever worshipped Freedom with half such unquestioning faith as did the American Negro for two centuries. To him, so far as he thought and dreamed, slavery was indeed the sum of all villainies, the cause of all sorrow, the root of all prejudice; Emancipation was the key to a promised land of sweeter beauty than ever stretched before the eyes of wearied Israelites. In song and exhortation swelled one refrain—Liberty; in his tears and curses the God he implored had Freedom in his right hand. At last it came,—suddenly, fearfully, like a dream. With one wild carnival of blood and passion came the message in his own plaintive cadences:— “Shout, O children! Shout, you’re free! For God has bought your liberty!” Years have passed away since then,—ten, twenty, forty; forty years of national life, forty years of renewal and development, and yet the swarthy spectre sits in its accustomed seat at the Nation’s feast. In vain do we cry to this our vastest social problem:— “Take any shape but that, and my firm nerves Shall never tremble!” The Nation has not yet found peace from its sins; the freedman has not yet found in freedom his promised land. Whatever of good may have come in these years of change, the shadow of a deep disappointment rests upon the Negro people,—a disappointment all the more bitter because the unattained ideal was unbounded save by the simple ignorance of a lowly people. The first decade was merely a prolongation of the vain search for freedom, the boon that seemed ever barely to elude their grasp,—like a tantalizing will-o’-the-wisp, maddening and misleading the headless host. The holocaust of war, the terrors of the Ku-Klux Klan, the lies of carpet-baggers, the disorganization of industry, and the contradictory advice of friends and foes, left the bewildered serf with no new watchword beyond the old cry for freedom. As the time flew, however, he began to grasp a new idea. The ideal of liberty demanded for its attainment powerful means, and these the Fifteenth Amendment gave him. The ballot, which before he had looked upon as a visible sign of freedom, he now regarded as the chief means of gaining and perfecting the liberty with which war had partially endowed him. And why not? Had not votes made war and emancipated millions? Had not votes enfranchised the freedmen? Was anything impossible to a power that had done all this? A million black men started with renewed zeal to vote themselves into the kingdom. So the decade flew away, the revolution of 1876 came, and left the half-free serf weary, wondering, but still inspired. Slowly but steadily, in the following years, a new vision began gradually to replace the dream of political power,—a powerful movement, the rise of another ideal to guide the unguided, another pillar of fire by night after a clouded day. It was the ideal of “book-learning”; the curiosity, born of compulsory ignorance, to know and test the power of the cabalistic letters of the white man, the longing to know. Here at last seemed to have been discovered the mountain path to Canaan; longer than the highway of Emancipation and law, steep and rugged, but straight, leading to heights high enough to overlook life. Up the new path the advance guard toiled, slowly, heavily, doggedly; only those who have watched and guided the faltering feet, the misty minds, the dull understandings, of the dark pupils of these schools know how faithfully, how piteously, this people strove to learn. It was weary work. The cold statistician wrote down the inches of progress here and there, noted also where here and there a foot had slipped or some one had fallen. To the tired climbers, the horizon was ever dark, the mists were often cold, the Canaan was always dim and far away. If, however, the vistas disclosed as yet no goal, no resting-place, little but flattery and criticism, the journey at least gave leisure for reflection and self-examination; it changed the child of Emancipation to the youth with dawning self-consciousness, self-realization, self-respect. In those sombre forests of his striving his own soul rose before him, and he saw himself,—darkly as through a veil; and yet he saw in himself some faint revelation of his power, of his mission. He began to have a dim feeling that, to attain his place in the world, he must be himself, and not another. For the first time he sought to analyze the burden he bore upon his back, that dead-weight of social degradation partially masked behind a half-named Negro problem. He felt his poverty; without a cent, without a home, without land, tools, or savings, he had entered into competition with rich, landed, skilled neighbors. To be a poor man is hard, but to be a poor race in a land of dollars is the very bottom of hardships. He felt the weight of his ignorance,—not simply of letters, but of life, of business, of the humanities; the accumulated sloth and shirking and awkwardness of decades and centuries shackled his hands and feet. Nor was his burden all poverty and ignorance. The red stain of bastardy, which two centuries of systematic legal defilement of Negro women had stamped upon his race, meant not only the loss of ancient African chastity, but also the hereditary weight of a mass of corruption from white adulterers, threatening almost the obliteration of the Negro home. A people thus handicapped ought not to be asked to race with the world, but rather allowed to give all its time and thought to its own social problems. But alas! while sociologists gleefully count his bastards and his prostitutes, the very soul of the toiling, sweating black man is darkened by the shadow of a vast despair. Men call the shadow prejudice, and learnedly explain it as the natural defence of culture against barbarism, learning against ignorance, purity against crime, the “higher” against the “lower” races. To which the Negro cries Amen! and swears that to so much of this strange prejudice as is founded on just homage to civilization, culture, righteousness, and progress, he humbly bows and meekly does obeisance. But before that nameless prejudice that leaps beyond all this he stands helpless, dismayed, and well-nigh speechless; before that personal disrespect and mockery, the ridicule and systematic humiliation, the distortion of fact and wanton license of fancy, the cynical ignoring of the better and the boisterous welcoming of the worse, the all-pervading desire to inculcate disdain for everything black, from Toussaint to the devil,—before this there rises a sickening despair that would disarm and discourage any nation save that black host to whom “discouragement” is an unwritten word. But the facing of so vast a prejudice could not but bring the inevitable self-questioning, self-disparagement, and lowering of ideals which ever accompany repression and breed in an atmosphere of contempt and hate. Whisperings and portents came home upon the four winds: Lo! we are diseased and dying, cried the dark hosts; we cannot write, our voting is vain; what need of education, since we must always cook and serve? And the Nation echoed and enforced this self-criticism, saying: Be content to be servants, and nothing more; what need of higher culture for half-men? Away with the black man’s ballot, by force or fraud,—and behold the suicide of a race! Nevertheless, out of the evil came something of good,—the more careful adjustment of education to real life, the clearer perception of the Negroes’ social responsibilities, and the sobering realization of the meaning of progress. So dawned the time of Sturm und Drang: storm and stress to-day rocks our little boat on the mad waters of the world-sea; there is within and without the sound of conflict, the burning of body and rending of soul; inspiration strives with doubt, and faith with vain questionings. The bright ideals of the past,—physical freedom, political power, the training of brains and the training of hands,—all these in turn have waxed and waned, until even the last grows dim and overcast. Are they all wrong,—all false? No, not that, but each alone was over-simple and incomplete,—the dreams of a credulous race-childhood, or the fond imaginings of the other world which does not know and does not want to know our power. To be really true, all these ideals must be melted and welded into one. The training of the schools we need to-day more than ever,—the training of deft hands, quick eyes and ears, and above all the broader, deeper, higher culture of gifted minds and pure hearts. The power of the ballot we need in sheer self-defence,—else what shall save us from a second slavery? Freedom, too, the long-sought, we still seek,—the freedom of life and limb, the freedom to work and think, the freedom to love and aspire. Work, culture, liberty,—all these we need, not singly but together, not successively but together, each growing and aiding each, and all striving toward that vaster ideal that swims before the Negro people, the ideal of human brotherhood, gained through the unifying ideal of Race; the ideal of fostering and developing the traits and talents of the Negro, not in opposition to or contempt for other races, but rather in large conformity to the greater ideals of the American Republic, in order that some day on American soil two world-races may give each to each those characteristics both so sadly lack. We the darker ones come even now not altogether empty-handed: there are to-day no truer exponents of the pure human spirit of the Declaration of Independence than the American Negroes; there is no true American music but the wild sweet melodies of the Negro slave; the American fairy tales and folklore are Indian and African; and, all in all, we black men seem the sole oasis of simple faith and reverence in a dusty desert of dollars and smartness. Will America be poorer if she replace her brutal dyspeptic blundering with light-hearted but determined Negro humility? or her coarse and cruel wit with loving jovial good-humor? or her vulgar music with the soul of the Sorrow Songs? Merely a concrete test of the underlying principles of the great republic is the Negro Problem, and the spiritual striving of the freedmen’s sons is the travail of souls whose burden is almost beyond the measure of their strength, but who bear it in the name of an historic race, in the name of this the land of their fathers’ fathers, and in the name of human opportunity. And now what I have briefly sketched in large outline let me on coming pages tell again in many ways, with loving emphasis and deeper detail, that men may listen to the striving in the souls of black folk.   Class Info Syllabus Zoom Class Calendar Contexts Contexts for "They Feed They Lion" Contexts for Henry Adams Texts How to annotate Texts Alain Locke Alice Dunbar-Nelson Allen Ginsberg, “Howl” (1956) Charlotte Perkins Gilman, “The Yellow Wallpaper” (1892) Claude McKay Edgar Lee Masters Edna St. Vincent Millay Edwin Arlington Robinson Ernest Hemingway, In Our Time Ezra Pound Georgia Douglas Johnson Gertrude Stein Gwendolyn B. Bennett Helene Johnson Henry Adams, “The Dynamo and the Virgin” John Dos Passos, “The Body of an American” Langston Hughes Langston Hughes, “The Negro Artist and the Racial Mountain” (1926) Lawrence Ferlinghetti Paul Laurence Dunbar Philip Levine, “They Feed They Lion” (1972) Radical Poetry Robert Frost Sterling Brown T.S. Eliot Networked W.E.B. Du Bois, “Of Our Spiritual Strivings” William Carlos Williams

      I believe that Du Bois is speaking about the times of slavery, thus the usage of "bondage". However, this divine event that "they thought to see" and "end all of the doubt and disappointment", makes me imagine that this is emancipation, or even a divine miracle of freedom while enslaved.

    1. A listener “may give you other things to think about, or may acknowledge that this thing you thought was really bad is actually not a big deal, so you get this richer and more elaborated memory,”

      I think it is important to discuss life stories because often we experience challenges or difficulties that we cannot process ourselves. Sometimes it is important to have an outside perspective, or simply a space to share your story. It's also important that we as a society learn from each other, and deeply consider how our lives differ to learn appreciation, develop understanding, and to grow.

    2. Life stories do not simply reflect personality. They are personality, or more accurately, they are important parts of personality, along with other parts, like dispositional traits, goals, and values,”

      I agree with this statement. I believe in order to grow and evolve as an individual a crucial step is being open to accepting setbacks or challenges. I think that the acceptance of these difficulties allows us to expand our way of thought and our knowledge. If we can then accept these challenges, we can then accept them as a part of who we are--a momentary obstacle in the past yet a life lesson that contributes to growth. It's truly important to be able to recognize all the different aspects of your life, and to recognize the different parts of your life that helped to shape you as an individual. I think dealing with adversity helps you to challenge your mind and yourself. Ultimately, it may even bring about new "traits, goals, and values".

    1. Joint Public Review:

      Strengths: The study represents a step forward in relating immune responses to infection outcomes that of urgent interest to public health, especially the timing of shedding and frequency of supershedding events. Nguyen et al.'s model provides a useful framework for understanding the links between immune effectors and infection outcomes, and it can be expanded to encompass further biological complexity. The study system is a good choice, given the ubiquity of both helminth and bacterial infections, and experimental infections of rabbits provide a useful point of comparison for past work in mice. 

      Limitations: The present study does not explicitly account for differences in helminth infection dynamics across the two species represented in the data nor does it include feedbacks between the bacterial and helminth infections. Nguyen et a. therefore show the limits of what can be learned from focusing on the bacterial and immune dynamics alone, and this study should serve to motivate further work that can build on this modeling approach to produce a more comprehensive view of the interactions among species infecting the same host. Future studies examining the impact of helminth infection intensity would be tremendously useful for assessing the potential of anthelminthics to reduce the prevalence of bacterial respiratory diseases. Finally, subsequent studies may need to look beyond the factors examined here to understand why shedding varies so much through time for individual hosts. 

      Specific comments: 

      Definition of supershedding: A major stated goal of the MS is to investigate the effect of coinfection by helminths on supershedding. In order to compare animals with different coinfections, it is therefore necessary to have a common definition of supershedding. At present, the authors use a definition that depends on which arm of the experiment the animals belong to. This complicates the analysis and clouds its interpretation. 

      Inconsistent approach: Within each experimental treatment, the data display variability on at least three levels: (i) within animals, day-to-day shedding displays variability on a fast timescale; (ii) within animals, infection status varies more slowly over the course of infection; (iii) between animals, there is variation in both (i) and (ii). The authors' model seems well-designed to handle this variability, but the authors are strangely inconsistent in their use of it. To be specific, to account for level (i), the authors very sensibly adopt a zero-inflated model for the shedding data, whereby the rate of shedding (colony-forming units per second, CFU/s) is assumed to arise from a mixture of a quantitative process (which we might think of as intensity of potential shedding) and an all-or-nothing process (which might arise, for example, if some discrete behavior of the animal is necessary for shedding to occur at all). The inclusion of the all-or-nothing process necessitates an additional parameter, but it allows the non-zero shedding data to inform the model. To account for level (ii), the authors use a four-dimensional deterministic dynamical system. Three of the four variables are related to the measured components of the immune response. The fourth is related to the aforementioned potential shedding. Level (iii) is accounted for using a hierarchical Bayesian approach, whereby the individual animals have parameters drawn from a common prior distribution. This approach seems very well designed to address the authors' questions using the data at hand. However, they fail to exploit this, in at least three ways. First, even though the model appears designed specifically to allow for non-shedding animals, the authors exclude animals on an ad hoc basis. Second, rather than display the shedding data in the form recommended by the model, they display log(1+CFU/sec), which is arbitrary and problematic. Its arbitrariness stems from the fact that this quantity is sensitive to the units used for shedding rate. Third, despite the fact that the model appears specifically designed to account for variability at each of the three levels, they do not give enough information to allow the reader to judge whether the model does in fact do a good job of partitioning this variability. 

      Exclusion of animals: In view of the fact that the model the authors describe can account for variability on all three levels, it is strange that they exclude animals that shed too little or not at all. It would be preferable were the authors to base their conclusions on all the data they collected rather than on a subset chosen a posteriori. It is true that the non-shedders will have no information about the time-course of shedding; on the other hand, including them does not complicate the analysis, and it does allow for estimation of the all-or-nothing probability in a coherent fashion. In particular, the fact that coinfection appears to have an impact on whether animals shed at all is itself directly related to the authors' central questions. More generally, ad hoc exclusion of data raises concerns about the repeatability of the experiments that, in this case, appear entirely avoidable. 

      Incomplete description of the analysis: The description of the statistical analysis will not be complete until sufficient information is provided to allow the interested reader to decide for him- or herself whether the conclusions are warranted and for the motivated reader to reproduce the analysis. In particular, it is necessary to specify all priors fully. At present, these are not described at all, except in vague, and even incoherent, ways. Also, it is necessary to provide details of the MCMC performed. Specifically, the authors should describe the MCMC sampler and show their MCMC convergence diagnostics. Finally, it is good practice to display both the priors and the posteriors: it is impossible to assess the posteriors without an understanding of the priors. 

      Model adequacy: The authors' argument rests on the model's ability to adequately account for the data. The authors need to provide some evidence of this, in one form or another. Ultimately, the question is whether the data are a plausible realization of the model. The authors should show simulations from the model (including the measurement error and not merely the deterministic trajectories) and compare these simulations to the data. In particular, it seems worryingly possible that the fitted model is capable of capturing certain averages in the data while, at the same time, failing to describe the infection progression for any of the actual infected animals. 

      Confusion of correlation and causation: At various points, the authors succumb to the temptation to interpret their model literally and to interpret the correlations they observe as evidence for a causal linkage between the three immune components they measure, bacterial shedding, and co-infection. They should be more careful and circumspect in the description of their results. 

      Additional Issues: 

      Eqs 1-4. These equations are not mechanistic in any meaningful sense. Essentially, they posit the existence of exponential time-lags between the three immunity variables, and a simple linear killing relationship between each of the variables and pathogen load. To interpret the equations literally risks making unwarranted conclusions. For example, any physiological variable correlated with any of the three variables in the model might equally well be credited with the influence on shedding attributed to IgA, IgG, or neutrophils. 

      l 456. Do the authors account for the variability in time spent with plates? Implicitly, the assumption is made that the amount of time a rabbit spends with a plate, i.e., the decision as to whether to engage in a behavior that will terminate the plate interaction, is independent of everything else. This raises the question: Does the time spent per plate correlate with anything?

    1. Reviewer #2 (Public Review): 

      Masís-Obando and colleagues describe a study investigating the neural basis of specific (story) and general (schema) representations of naturalistic narratives (movie/audio clips). Narratives were of one of two types (airport, restaurant) about which participants would likely have rich past experience and knowledge, which allowed the researchers to ask what features were shared among different narratives that depicted the same "script." The researchers characterized the degree to which neural patterns reflected unique, story-specific codes (there is correspondence across people at the particular narrative level) versus general, schema codes (airport patterns are more similar to one another than they are to restaurant patterns). They were moreover interested in understanding how these representations were leveraged at both encoding and retrieval separately to guide free recall of each particular narrative's events. The main hypotheses were surrounding the involvement of medial prefrontal cortex (mPFC) and hippocampus (HPC) in this process. mPFC overall represented both schema at story at encoding, but neither at retrieval; a follow-up analysis revealed different effects in anterior versus posterior mPFC clusters, with anterior showing a greater relationship (than posterior) between schema representation at encoding and behavior that was mediated by specific story reinstatement in posterior medial cortex (PMC). Consistent with ideas about differences in representation across hippocampal long axis, they also found anterior HPC showed schema effects, whereas story effects (at encoding only) were more prominent in posterior. Beyond their a priori regions of interest, the researchers also report widespread cortical involvement for many of these analyses. The main take-home appeared to be that these networks differed between encoding and retrieval. 

      Overall, the findings are compelling and align with prior work, while also providing new insights in the context of a more naturalistic memory task. For example, lack of mPFC involvement (schema or story representation) during retrieval was unexpected, and may inform future work on this topic (e.g., through encouraging more fine-grained consideration of mPFC sub-divisions). I moreover appreciated the author's transparency about their hypotheses and clear acknowledgement of the relationship between this data set and an existing paper. The work appears to be carefully done, and the paper is generally clear and well-written. I do however have a few questions and suggestions for the authors, as follows: 

      1) From a theoretical perspective, I am struggling with the behavioral outcome measures being exclusively at the "specific" story level, and whether/how that should impact our interpretation of the findings. In other words, the behavioral outcome of interest has to do with participants' ability to recall story-specific details, and a score was given to each subject for each story to summarize the quality of their memory for that particular narrative. By necessity, of course, this means knowledge at the "schematic" level is not tested or operationalized in any way. (In fact, it would I believe be impossible to do this on a narrative-by-narrative basis.) The authors address this in their setup, discussing how a schema can be used to guide the retrieval of details, and also touch upon this in the Discussion (lines 404-410). However, I am struggling with the contrast between the memory ~ encoding and memory ~ reinstatement findings being whopping and widespread for the story neural representation (Figure 3A, C), and much smaller (and nonsignificant in many ROIs) for the schema neural representation (Figure 3B, D). Is this showing us that (detailed, specific) story representation supports recall of (detailed, specific) memories, and (general, abstracted) schema representation does not? Does that mean schema representation does not relate to memory, or just that it doesn't relate to *specific* memory (i.e., but could have in theory been related to schematic memory, had that been tested)? I suppose from some vantage points, it could be viewed as merely a replication of many other findings that representing specific memories at either encoding or retrieval is helpful for recall of those details. And similarly, one could argue that schema representations haven't been given a fair shake because the behavior was tested at a different level of specificity. In other words, in their analysis for Figure 3 B and D the authors separately considered the relationship between schema representation and behavior, without simultaneously considering the level of specific story representation, which is a bit hard to reconcile with the framework that schemas would guide retrieval via reinstatement of specific details (i.e., theoretically, should we expect that they can support detail recall on their own? or should it be that schema representation supports specific memory, but only when detail recall is also high?). With the exception of the mediation analysis in Figure 5 (which I think does speak to this point in a nice way), the earlier, primary analyses do not take this complexity into account. To be clear, I am not sure answering these questions requires new analyses, and am not asking the authors to change their approach. I am more hoping the authors could provide us more of their thoughts on these points in the paper and perhaps soften their conclusions if appropriate. 

      2) It was not clear to me how the audio vs. movie difference was worked into the analysis, or why for the schema scores, different-modality patterns were not also considered. It would seem as though comparing patterns derived from the presentation of movie vs. audio as part of the schema measure would allow the researchers to get around potential confounds like visual presentation of the same type of stimuli across narratives of the same type to drive the "schema" representation (e.g., restaurant movies presumably show a lot of the same types of objects as one another, but those same objects would not be presented visually in the audio clips). Similarly, perhaps audio clips contained similar words for a given schema. It seems as though airport 1 movie being more similar to airport 1-4 audio than it is to restaurant 1-4 audio (all different modality comparisons) would be a powerful way to demonstrate schema representation (I believe the authors have done this in past work; Baldassano et al. 2018 J Neuro). In any case, I think this detail and reasoning should be added to the main paper, and potentially worked into the visualizations. 

      3) It was unclear to me from the methods how the models relating neural scores with behavioral performance were set up. It sounds as though perhaps the researchers ran a simple linear regression, such that all participants' data was combined into a single model but subjects were not treated as random effects. If this were the case, then variability in memory performance across subjects is going to contribute to the estimate of the within-subject relationship between neural scores and memory performance on a story-by-story basis. It seems from the paper as though the authors are more interested in the within-subject variability. Can the authors clarify this point (e.g., by expanding the methods section beginning on line 585)?

    1. To what extent is the train-ing in cognitive science necessary for forming the new generation of scientists of the mind?

      Perhaps cognitive science failed to move from a "collection of multidisciplinary efforts to an integrated coherent interdisciplinary field" because there was not a high demand of this interdisciplinary field. However, there may be a higher demand to study cognitive science because the public, media, and scientists have expressed greater interest in developing artificial intelligence over the years. Similarly, younger generations like myself are becoming more self-aware, constantly asking the question, "are we just living in a simulation? Is anything truly real, or real based on our perceptions?" I think the training in cognitive science will become necessary for the new generation of scientists due to the increased demand of developing AI's as well as studying the human consciousness (i.e. our extent of free will).

    1. Our task is to construct educational situations that wepropose to the children in the morning. It’s okay toimprovise sometimes but we need to plan the project.It may be a project that is projected over a period ofdays, or weeks, or even months. We need to producesituations in which children learn by themselves, inwhich children can take advantage of their ownknowledge and resources autonomously, and inwhich we guarantee the intervention of the adult aslittle as possible.

      I'm really struggling with this because this year we are offering specials. We have to share the specials teachers with the entire school, so our times are dictated to us. Today, we had to interrupt the children's free play time to do music...which was really just watching and dancing to videos on the smart board. It's only week two, but this is high on my think-about list.

    1. In this introduction, we have sketched out some basic ideas necessary to start the study of Ethics. We have examined the basics of critical thinking and discussed 3 methods of talking about ethics: Descriptive Ethics, Normative Ethics, and Metaethics. We also looked at the three major positions on the nature of Ethics itself: Nonrealism, Relativism, and Realism. We have signposted some errors to avoid when it comes to thinking about ethics, and some strategies to consider instead. It may be worth occasionally revisiting the ideas discussed here during your studies, to test your own lines of argument and evaluate how “thinking well” is progressing for you. This would not be a weakness! The authors, and any honest philosopher, can reassure you — philosophy is hard, but it is worth it. We hope you find this textbook useful and rewarding in helping you on your own journey through Ethics.

      The closing paragraph restates everything we have read in the article. The main point is to discuss the forms of ethics as well as cause readers to think and evaluate strategies of certain things.

    1. Author Response:

      Reviewer #1 (Public Review):

      [...] The study tackles important questions with regards to how ripples relate to broadband LFP activity as well as single neurons in the human brain. The authors also include elegant analyses to characterize the timing of spiking activity with respect to high and low frequency activity and relevant control analyses to take into account possible artifacts and epileptic-related activity. My main concern with the study is whether the authors are truly isolating ripple activity in the human brain as claimed. Their threshold for ripple activity is quite low and it thus seems very possible that many of their "ripple" events are rather high frequency activity events that reflect spiking activity. That being said I think this is an important study to share results from in that it provides unique characterization of the relationship between high frequency activity and spiking in the human brain, as well as how it relates to human memory.

      We thank the reviewer for the positive assessment of our manuscript. We agree with the reviewer that there are important concerns regarding whether these events can be truly regarded as ripples, which we address by performing additional analyses to provide stronger support to the possibility that the identified cortical ripples in our recordings are transient and discrete events that reflect underlying bursts of spiking activity. We also acknowledge that these events more likely exist on a continuum, and that there is not always a clear separation between what constitutes one ripple event and the background activity. We think this is a fertile area of investigation and that there are several points to consider regarding this question, which we now address in the revised Discussion.

      Reviewer #2 (Public Review):

      Recordings from human patients with implanted electrodes provide high temporal resolution, localized measurements of brain activity that can reveal neural correlates underlying a wide variety of cognitive functions. These intracranial electroencephalography (iEEG) recordings are typically made with large electrical contacts, however, and thus represent a complex and poorly understood averaging of voltages from the underlying tissue. As such, it is difficult to know exactly what patterns of neural activity these signals correspond to and how to compare them to spiking and local field potential (LFP) recordings more commonly acquired in non-human animals. Tong et al. carried out simultaneous iEEG recordings from surface contacts as well as spiking and LFP recordings from implanted electrode arrays to directly address the relationship between these signals.

      They present quantifications (e.g. Figure 2B) of the relationships between the amount of spiking activity and the amplitude of events detected in the LFP and iEEG. Their results showing the relationships among these signals are very important for the field, and it is very helpful to see that there are clear correlations across scales.

      We thank the reviewer for this positive review of our manuscript.

      The context in which they present these results is problematic, however. They focus on "ripple" events, detected as periods where the power in a 80-120 Hz band exceeds an arbitrary threshold for an arbitrary length of time. To be fair, the application of similarly arbitrary thresholds is common in the human, primate, and rodent literatures, and several important results have arisen from the analysis of these events. These results can be understood as claiming that a set of high amplitude events have certain properties (e.g. they are related to memory retrieval), but should not be understood as establishing that there is some specific threshold that separates real events from others.

      We completely agree with the reviewer that, when considering ripples, there is a continuity of activity and that the central challenge for the field has been how to identify real events and separate them from others. To be clear, the purpose of our manuscript is not to claim that such a threshold exists. Our purpose instead was to offer evidence that even events that fall below arbitrarily defined thresholds still reflect underlying bursts of spiking activity, that these events are still punctate and temporally discrete, and that therefore these events are also likely functionally meaningful.

      Here they go beyond these analyses and make the claim that these ripple events correspond to real, discrete events that, as their title indicates, "reflect a spectrum of synchronous spiking activity." The problem here is that they do not present any criteria for defining a real, discrete event. Indeed, they conclude that "the continuum of activity that [they] observe in [the] data ... suggests that strictly adhering to predefined criteria for what constitutes a ripple may run the risk of overlooking functionally meaningful events". Without a clear definition of what should and should not be considered to be a discrete event, we are left with the current situation where each study uses their own set of criteria, picks out a set of high amplitude events, and uses those for subsequent analyses.

      We agree with the reviewer that the amplitude and strength of the identified ripple events can be quite variable, making it challenging to distinguish these events from baseline activity. We therefore do not claim to identify specific criteria for defining real events. As the reviewer notes, without such criteria we are left with the current situation where future studies will still need to use their own set of criteria. We completely agree. The purpose of our study, however, is to just highlight the point that using these arbitrarily defined criteria risks overlooking these other events that still may be meaningful for the brain. We have addressed this concern by adding several changes to our manuscript and introducing several new analyses. First, we have tempered our claims that these are discrete events that represent separate packets of information. We acknowledge that there is certainly some variability in the size of these ripple events, that making a clean distinction between when these ripple events emerge as entities that are distinct from the background activity is challenging, and that we can never be certain whether arbitrarily small events are functionally meaningful. We have revised our Discussion accordingly to highlight these possibilities, and to discuss the larger point regarding the challenges in identifying these specific thresholds. Second, although we recognize that the data may not be absolutely conclusive, we have supplemented this discussion with additional analyses that, in our opinion, strongly suggest that these events are indeed transient in nature even when failing to meet previous thresholds.

      A second major challenge to understanding the current manuscript is the ambiguity of the physical relationships between the LFP and iEEG recording sites. While it might be obvious to human physiologists, details such as the distance between the LFP and iEEG contacts and the site areas of each type of electrode are critical for interpreting how closely the data from each could be expected to be related.

      We also agree with this very good point. As noted above in the response, we have now introduced several new analyses that examine the relation between the ripples identified using LFP and iEEG recordings.

      We would also like to highlight an instance of a common statistical error in Fig 1 I: the authors conclude that the difference between correct and incorrect is significant in true data and insignificant in the ripple-removed data, and therefore the 70-200Hz power band modulation on correct trials is significantly informed by 80-120Hz ripple events. The statistical problem is further described in Nieuwenhuis et al., Nature Neuroscience 2011.

      We thank the reviewer for pointing out this common statistical error that we have made in concluding that the true and ripple-removed data differ because the difference between correct and incorrect is significant in the true data and not in the ripple-removed data. We agree with the suggestion that a more accurate way to compare the true and ripple-removed data is to compare the effect sizes, or the difference between correct and incorrect trials for the true and ripple-removed data. We have now conducted this analysis. Specifically, we computed the true correlation between the difference in 70-200 Hz power between correct and incorrect trials and the difference in ripple rates between correct and incorrect trials across electrodes and compared this correlation to the correlation present after removing the 80-120 Hz ripples using a paired t-test across participants. We performed this analysis in the subset of six participants who had an MEA and focused on the MTL and ATL electrodes since these regions have the greatest 70-200 Hz power increase with successful retrieval. We found a significant decrease in correlation across patients with ripples removed compared to when we retained the ripples (t(5) = 3.89, p = 0.0115). We now report this new analysis in Fig. 1 – S6. We also compared the two correlations as dependent groups and found a significant difference in correlation (r_true – r_control = 0.172, 95% CI = [0.0691 0.2764], z = 3.2677, p = 0.0011). We accounted for potential interaction effects using the correlation between 70-200 Hz and 70-200 Hz with ripple removed (r = -0.031).

      Finally, we would also like to note the difficulty of characterizing a single deflection in the LFP or iEEG signal as a low frequency oscillation, given the large potential for measurement variability of the frequency of that oscillation as described in Fig. 4. This large deflection is to be expected when a concentrated amount of synaptic input drives a burst of spiking, as we would expect in the case of the increased spiking during ripples. In the hippocampus, this deflection is the sharp wave component of the sharp-wave ripple; it appears to take a similar form in cortical ripples. While unsurprising, it is well worth observing that the iEEG reflects this coincident deflection, but it should not be characterized as a 2-10Hz oscillation.

      We completely agree with the reviewer about this point. As the reviewer points out, the large deflection is often observed with bursts of spiking, which we find with ripples, and we also feel that the iEEG reflects this coincident detection. We have therefore corrected the text and no longer characterize the deflection associated with ripples as 2-10 Hz oscillations. To illustrate this point further, we have also now added a new analysis demonstrating the average iEEG and LFP activity around each ripple, which clearly demonstrates this deflection (Fig. 1). We have, however, retained the discussion about the locking of spikes to 2-10 Hz oscillation, as our analysis includes spikes both within and outside of the spike bursts. While we expect that spikes are associated with the large deflection that reflects a concentrated amount of synaptic input, we also find spikes that are modulated by a 2-10 Hz oscillation, consistent with prior findings of theta-phase locking of spiking neurons.

      Reviewer #3 (Public Review):

      In this study, authors systematically investigated the iEEG ripples, LFP ripples, and their relation with each other and single units from micro channels obtaining LFP. They found that the amplitude of LFP ripples reflects the sum and alignment of underlying spiking activities. Meanwhile, the amplitude of iEEG ripples reflects the number and alignment of LFP ripples. More interestingly, the amplitude of ripple events is functionally relevant. In general, I find that the data analyses and methods are sophisticated and the results are interesting. It extends our understanding of ripple events and is of interest to a wide audience.

      We thank the reviewer for the positive assessment of our manuscript.

    1. Author Response:

      Reviewer #1 (Public Review):

      [...] In the model, the mitigation function is fitted; no actual data on deliberate versus randomly-varying behavior change is used. Given clear empirical signals of synchronous and delibate response to epidemiology, modulated by social factors (Weill et al., 2020), a persuasive demonstration that consideration of random behavioral variation is necessary and/or sufficient to explain observed US COVID-19 dynamics would need to start from mobility data itself, and then find some principled way of partitioning changes in mobility into those attributable to random variation versus deliberate (whether top-down or bottom-up) action.

      As suggested by our referees and the editor, we undertook a principled analysis of the US COVID-19 data that took into account Google mobility patterns. The average mobility reflects systematic changes in social activity due to both government-imposed mitigations and knowledge-based adaptation of the population. We identified a range of dates (July 2020- February 2021) during which there has been only modest and slow changes in the average mobility. This time range allows for a direct test of our model, accounting for stochastic changes in social activity uncorrelated across the population (see Figure 6 and Appendix 5. Figure 1A).

      In the new version, we also present a direct comparison of the predictive power of our SSA model vs the traditional SIR model within this time range (see Figure 8 and Appendix 5. Figure 2).

      My other main concern is that the central result of transient epidemiological dynamics due to transient concordance of abnormally high versus low social activity-stems from the choice to model social behavior as stochastic but also mean-seeking. While I find this idealization plausible, I think it would be good to motivate it more.

      In other words, the central, compelling message of the paper is that if collective activity levels sometimes spike and crash, but ultimately regress to the mean, so will transmission. The more that behavioral model can be motivated, the more compelling the paper will be.

      We included an additional justification of our form of stochastic social dynamics and expanded the discussion of relevant prior studies. Especially revealing are the studies of burstiness in virtual communication such as e-mail (Vazquez et al. (2007); Karsai et al. (2012)). Studies of digital communications can be easily studied over a substantial time interval, which is more problematic for field studies of face-to-face contact networks. These studies unequivocally show the regression of individual activity levels towards its long-term mean value. This regression happens over a well-defined relaxation time ranging from days to months depending on the context. Note that the value towards which the activity regresses may not be identical for different individuals. In the context of our model, such persistent heterogeneity is captured by the distribution of \alpha_i with the dispersion parameter \kappa.

    1. Author Response:

      Reviewer #1:

      The manuscript is well-written and easy to follow. The authors are thorough in their characterization, shown both through the text itself and the figures. Most of the comments relate to the narrative structure itself and are merely suggestions. Overall, this work represents an important resource for the community and especially to people working on the role of the SEZ in feeding and motor behaviors.

      Specific comments and suggestions:

      • The authors give a very nice overview of the SEZ and the split-Gal4 technique. However, they spend much less time discussing the rationale behind using the cell body numbers within subesophageal neuromeres. This to me assumes two extremely different kinds of readers, one relatively new to Drosophila research and the other relatively well-versed. Since this technique is crucial to the approach used throughout the manuscript and significant in the authors labeling about 1/3 of the region, I would suggest the authors to give a brief summary and justification as to why they decided to use this neuromere labeling technique, and spend more time in the discussion (perhaps in the paragraphs between lines 352-386) talking about the pros and cons of this technique (is it expected to label fewer than 50% of the neurons? How may this complement the EM and FAFB dataset, and what are the advantages and disadvantages using the technique employed here?).

      We now provide a brief introduction to the approach in the results section (lines 82-96) and include additional pros and cons of the approach in the discussion (lines 369-383). We expect that this approach labels the vast majority of SEZ neurons.

      Related suggestions:

      o Line 81: elaborate on deutocerebral contributions

      We have moved this to discussion (lines 374-377). We clarify that not much is known about deutocerebral contributions.

      o Lines 84-85: along similar lines, Hox gene drivers

      We altered this sentence to be clear to a general audience (lines 86-90).

      • Figure 9: having a color legend in the figure itself will facilitate understanding of this figure. I think it would be nice to have visual examples of interneurons, projection neurons, and so forth. Perhaps when the authors first describe neurons in Group 1, instead of marking "first half of the group" (line 210) the authors can explicitly name the neuron types (peep, doublescoop, etc.)

      We now include a color legend as well as a new figure with visual examples of polarity (Figure 10 – figure supplement 1). As suggested, we changed the text to explicitly name the neuron types in Group 1 that are interneurons versus projection neurons (lines 241-243).

      • In the polarity section of the discussion, it would be interesting to have additional remarks relating to how to determine whether these identified neurons are thought to be ascending and why. Since one of the authors has previously characterized some ANs, perhaps comparisons to this work would be helpful to readers new to this region of the brain.

      We now include a brief definition of ascending neurons in the results section (lines 149-150) and note that ascending neurons were not included in the collection.

      • The parallel structures used in characterizing Groups 1 through 6 are very useful. However, I think that when the authors relate each group to previous works, this might fit better in the Discussion section.

      We altered this section of the results to move speculation about group function to the Discussion (lines 421-445), as recommended.

    1. We may think of Pinterest as a visual form of commonplacing, as people choose and curate images (and very often inspirational quotations) that they find motivating, educational, or idealistic(Figure 6). Whenever we choose a passage to cite while sharing an article on Facebook or Twitter, we are creating a very public commonplace book on social media. Every time wepost favorite lyrics from a song or movie to social media or ablog, weare nearing the concept of Renaissance commonplace book culture.

      I'm not the only one who's thought this. Pinterest, Facebook, twitter, (and other social media and bookmarking software) can be considered a form of commonplace.

  10. Aug 2021
    1. knowledge evolves and endures throughout the life of a race rather than that of an individual.

      This reminds me of Aaron Swartz. I feel like this sentence pretty much describes his life mission. The sharing and passing down of knowledge and information is all we have to offer for the future!

    2. Logic can become enormously difficult, and it would undoubtedly be well to produce more assurance in its use.

      Do machines have the ability to doubt logic? Do they have the ability to debate philosophical dilemmas? Do they have the ability to form opinions?

    3. Note the automatic telephone exchange, which has hundreds of thousands of such contacts, and yet is reliable

      I'm not to sure. You can fake phone calls but the number of calls can be measured.

    4. To make the record, we now push a pencil or tap a typewriter. Then comes the process of digestion and correction, followed by an intricate process of typesetting, printing, and distribution.

      Thankfully, it is much easier now to document and share information! Like this sentence is taking me very little time yet I am sharing my thoughts with many people!

    5. The world has arrived at an age of cheap complex devices of great reliability; and something is bound to come of it.

      This is a great point, and it's very though-provoking. What is bound to come of it? It's interesting too that even though science keeps evolving, the cost of living keeps rising. I'd be interested in discussing the relationship between scientific evolution and inflation.

    6. The difficulty seems to be, not so much that we publish unduly in view of the extent and variety of present day interests, but rather that publication has been extended far beyond our present ability to make real use of the record.

      History is only relevant of who's writing it. It's true in a lot of ways which I don't like but understand. Connecting documents with people when they need it is still a huge challenge but could and can be manipulated.

    7. Yet, in the application of science to the needs and desires of man, it would seem to be a singularly unfortunate stage at which to terminate the process, or to lose hope as to the outcome.

      With the peak of growth we should go full force towards the developments of inventions and knowledge of men so we can adequately fulfill the desires of men.

    8. The inheritance from the master becomes, not only his additions to the world's record, but for his disciples the entire scaffolding by which they were erected.

      An widely accepted Encyclopedia that is controlled by the people (Similar to Wikipedia) towards the development of educational fields of research would be mans greatest wealth of knowledge.

    9. Logic can become enormously difficult, and it would undoubtedly be well to produce more assurance in its use.

      If a manipulation was present in the self learning capabilities of modern artificial intelligence, it can lead to an exponential crisis of malfunction or artificial error.