7,306 Matching Annotations
  1. Nov 2023
    1. Author Response

      The following is the authors’ response to the original reviews.

      Re: Revised author response for eLife-RP-RA-2023-90135 (“The white-footed deermouse, an infection-tolerant reservoir for several zoonotic agents, tempers interferon responses to endotoxin in comparison to the mouse and rat” by Milovic, Duong, and Barbour”)

      The revised manuscript has taken into account all the comments and questions of the two reviewers. Our responses to each of the comments are detailed below. In brief, the modifications or additional materials for the revision each specifically address a reviewer comment. These modifcations or materials include the following….

      • a more in-depth consideration of sample sizes

      • a better explanation of what p values signify for a GO term analysis

      • a more detailed account of the selection of the normalization procedure for cross-species targeted RNA-seq (including a new supplemental figure)

      • several more box plots in supplementary materials to complement the scatterplots and linear regressions of the figures of the primary text

      • provision in a public access repository of the complete data for the RNA-seq analyses as well as primary data for figures and tables as new supplementary tables

      • the expansion of description of the analysis done for the revision of Borrelia hermsii infection of P. leucopus. This included a new table (Table 10 of the revision) • development of the possible relevance of finding for longevity studies by citing similarities of the findings in P. leucopus with those in the naked mole-rat

      • what we think is a better assessment of differences between female and male P. leucopus for this particular study, while still keeping focus on DEGs in common for females and males. This included a new figure (Figure 4 of the revision).

      • removal of reference to a “inverse” relationship between Nos2 and Arg1 while still retaining ratios of informative value

      We note that in the interval between uploading the original bioRxiv preprint and now we learned of the paper of Gozashti, Feschotte, and Hoekstra (reference 32), which supports our conception of the important place of endogenous retroviruses in the biology and ecology of deermice. This is the only addition or modification that was not a direct response to a reviewer comment or question, but it was germane to one of Reviewer #1’s comments (“Regarding..”).

      Reviewer #1:

      Supplemental Table 1 only lists genes that passed the authors statistical thresholds. The full list of genes detected in their analysis should be included with read counts, statistics, etc. as supplemental information.

      We agree that provision of the entire lists of reference transcripts and the RNA-seq results for each of the 40 animals is merited. These datasets are too large for what the journal’s supplementary materials resource was intended for, so we have deposited them at the Dryad public access repository.

      While P. leucopus is a critical reservoir for B. burgdorferi, caution should be taken in directly connecting the data presented here and the Lyme disease spirochete. While it's possible that P. leucopus have a universal mechanism for limiting inflammation in response to PAMPs, B. burgdorferi lack LPS and so it is also possible the mechanisms that enable LPS tolerance and B. burgdorferi tolerance may be highly divergent.

      The impetus for the study was the phenomenon of tolerance of infection of P. leucopus by a number of different kinds of pathogens, not just B. burgdorferi. We take the reviewer’s point, though. Certainly, the white-footed deermouse is probably most notable at-large for its role as a reservoir for the Lyme disease agent. We doubt that the species responses to LPS and to the principal agonists of B. burgdorferi are “highly divergent”, though. Other than the TLR itself-TLR4 for LPS vs the heterodimer TLR2/TLR1 for the lipoproteins of these spirochetes--the downstream signaling is generally similar for amounts comparable in their agonist potency.

      We had thought that we had addressed this distinction for B. burgdorferi and other Borreliaceae members by referring to the earlier study. But we agree with the reviewer that what was provided on this point was insufficient in the context of the present work. Accordingly, for the revision we have added a new analysis of the data on experimental infection of P. leucopus with Borrelia hermsii, which lacks LPS and for which the TLR agonists eliciting inflammation are lipoproteins. We do this in a format (new Table 6) that aids comparison with the LPS experimental data elsewhere in the article. As the manuscript references, B. burgdorferi infection of P. leucopus elicits comparatively little inflammation in blood even at the height of infection. While this phenomenon with the Lyme disease agent was part of the rationale driving these studies, the better comparison with LPS was 5 days into B. hermsii infection when the animals are spirochetemic.

      Statistical significance is binary and p-values should not be used as the primary comparator of groups (e.g. once a p-value crosses the deigned threshold for significance, the magnitude of that p-value no longer provides biological information). For instance, in comparing GO-terms, the reason for using of high p-value cutoffs ("None of these were up-regulated gene GO terms with p values < 1011 for M. musculus.") to compare species is unclear. If the authors wish to compare effect sizes, comparing enrichment between terms that pass a cutoff would likely be the better choice. Similarly, comparing DEG expression by p-value cutoff and effect size is more meaningful than analyses based on exclusively on p-value: "Of the top 100 DEGs for each species by ascending FDR p value." Description in later figures (e.g. Figure 4) is favored.

      Effect sizes--in this case, fold-changes--were taken into account for GO term analysis and were specified in the settings that are described. So, any gene that was “counted” for consideration for a particular GO term would have passed that threshold and with a falsediscovery corrected p value of a specified minimum. There is no further scoring of the “hit” based upon the magnitude of the p value beyond that point. It is, as the reviewer writes, binary at that point. We are in agreement on those principles.

      As we understand the comment above, though, the p-values referred to are in regard to the GO term analysis itself. The objective was discovery followed by inference. The situation was more like a genome-wide association study (GWAS) study. This is not strictly speaking a hypothesis test, because there was no stated hypothesis ahead of time or one driving the design. The “p value” for something like GO term analysis or GWAS provides an estimate of the strength of the association. It is not binary in that sense. The lower the p value, the greater confidence about the association. In a GWAS of a human population an association of a trait with a particular SNP or indel is usually not taken seriously unless the p value is less than 10^-7 or 10^-8. In the case of GO terms, the p value approximates (but is not equivalent to) the number of genes that are differentially expressed that belong to a GO cluster out of the total number of genes that define that cluster. The higher the proportion of the genes in the cluster that are associated with a treatment (LPS vs. saline), the lower the p value. Thus, it provides information beyond the point at which it would be rightly deemed of little additional value in many hypothesis testing circumstances.

      That said, we agree that the original manuscript could have been clearer on this point and have for the revision expanded the description of the GO term analysis in the Methods, including some explanation for a reader on what the p value signifies here. We also refrain from specifying a certain p value for special attention and merely list 20 by ascending p value.

      The ability to use of CD45 to normalize data is unclear. Authors should elaborate both on the use of the method and provide some data how the data change when they are normalized. For instance, do correlations between untreated Mus and Peromyscus gene expression improve? The authors seem to imply this should be a standard for interspecies comparison and so it would be helpful to either provide data to support that or, if applicable, use of the technique in literature should be referenced.

      The reviewer brings up an important point that we considered addressing in more depth for the original manuscript but in the end deferred to considerations about length and left it out.

      But we are glad to address this here, as well as in the revised manuscript.

      We did not intend to imply either that this particular normalization approach had been done before by others or that it “should” be a standard. We are not aware of another report on this, and it would be up to others whether it would be useful or not for them. We made no claim about its utility in another model or circumstance. The challenge before us was to do a comparative analysis of transcription in the blood not just for animals of one species under different conditions but animals of two different genera under different conditions. A notable difference between the animals was in their white blood cell counts, as this study documents. White cells would be the source of a majority of transcripts of potential relevance here, but there would also be mRNA for globins, from reticulocytes, from megakaryocytes, and likely cell-free RNA with origins in various tissues. If the white cell numbers differed, but the non-white cell sources of RNA did not, then there could be unacknowledged biases.

      It would be like comparing two different kinds of tissues and assuming them to be the same in the types and numbers of cells they contained. Four hours after a dose of LPS the liver cells (or brain cells) would differ in their transcriptional profiles from untreated the livers (or brains) of untreated animals for sure, but there would not be much if any change in the numbers of different kinds of cells in the liver (or brain) within 4 hours. The blood can change a lot in composition within that time frame under these same conditions. Some sort of accounting for differing white cell numbers in the blood in different outbred animals of two species seemed to be called for.

      The normalization that was done for the genome-wide analysis was not based on a particular transcript, but instead was based on the total number of reads, the lengths of the reference transcripts, and the distributions of reads matching to the tens of thousands of references for each sample. This was done according to what are standard procedures by now for bulk RNAseq analyses. Because the reference transcript sets for P. leucopus and M. musculus differed in their numbers and completeness of annotation, we did not attempt any cross-species comparison for the same set of genes at that point. That would not be possible because they were not entirely commensurate.

      The GO term analysis of those results provided the leads for the more targeted approach, which was roughly analogous to RT-qPCR. For a targeted assay of this sort, it is common to have a “housekeeping gene” or some other presumably stably transcribed gene for normalization. A commonly used one is Gapdh, but we had previously found that Gapdh was a DEG itself in the blood in P. leucopus and M. musculus at the four hour mark after LPS. The aim was to provide for some adjustment so datasets for blood samples differing in white blood cell counts could be compared. Two options were the 12S ribosomal RNA of the mitochondria, which would be in white cells but not mature erythrocytes, and CD45, which has served an approximately similar function for flow cytometry of the blood. As described in what has been added for the revision and the supplementary materials, we compared these different approaches to normalization. Ptprc and 12S rRNA were effectively interchangeable as the denominator with identifying DEGs of P. leucopus and M. musculus and cross-species comparisons.

      Regarding the ISG data-is a possible conclusion not that Peromyscus don't upregulate the antiviral response because it's already so high in untreated rodents? It seems untreated Peromyscus have ISG expression roughly equivalent to the LPS mice for some of the genes. This could be compared more clearly if genes were displayed as bar plots/box and whisker plots rather than in scatter plots. It is unclear why the linear regression is the key point here rather than normalized differences in expression.

      In answer to the question: yes, that is possible. In the interval between uploading of the manuscript and this revision, we became aware of a study by Gozashti and Hoekstra published this year in Molecular Biology and Evolution (reference 32) and reporting on the “massive invasion” of endogenous retroviruses in P. maniculatus and the defenses deployed in response to achieve silencing. We cite this work and discuss it, including related findings for P. leucopus, in the revision.

      We had originally intended to include box plots as well as scatterplots with regressions for the data, but thought it would be too much and possibly considered redundant. But with this encouragement from the reviewer we provide additional box plots in supplementary materials for the revision.

      Some sections of the discussion are under supported:

      The claim that low inflammation contributes to increased lifespan is stated both in the introduction and discussion. Is there justification to support this? Do aged pathogen-free mice show more inflammation than aged Peromyscus?

      We respectively point out that there was not a claim of this sort. We stated a fact about P. leucopus’ longevity. We made no statement connecting longevity and inflammation beyond the suggestion in the introduction that the explanation(s) for infection tolerance might have some bearing for studies on determinants of life span.

      But the reviewer’s comment prompted further consideration of this aspect of Peromyscus biology. This led eventually to the literature on the naked mole-rat, which seems to be the rodent with the longest known life span and the subject of considerable study. The discussion section of the revision has an added paragraph on some of the similarities of P. leucopus and the naked mole-rat in terms of neutrophils, expression of nitric oxide synthase 2 in response to LPS, and type 1 interferon responses. While this is far from decisive, it does serve to connect some of the dots and, hopefully, is considered at least partially responsive to the reviewer’s question.

      The claim that reduced Peromyscus responsiveness could lead to increased susceptibility to infection is prominently proposed but not supported by any of the literature cited.

      There was not this claim. In fact, it was framed as a question, not a statement. Nevertheless, we think we understand what the comment is getting at and acknowledge in the revision that there may be unexamined circumstances in which P. leucopus may be more vulnerable.

      References to B. burgdorferi, which do not have LPS, in the discussion need to ensure that the reader understands this and the potential that responses could be very different.

      We think we addressed this comment in a response above.

      Reviewer #2:

      1. How were the number of animals for each experiment selected? Was a power analysis conducted?

      A power analysis of any meaning for bulk RNA-seq with tens of thousands of reference transcripts, each with their own variance, and a comparison of animals of two different genera is not straight forward. Furthermore, a specific hypothesis was not being tested. This was a broad, forward screen. But the question about sample sizes is one that deserves more attention than the original manuscript provided. This now provided in added text in two places in Methods ( “RNA-seq” and “Genome-wide different gene expression”) in the revision.

      1. The authors conducted a cursory evaluation of sex differences of P. leucopus and reported no difference in response except for Il6 and Il10 expression being higher in the males than the females in the exposed group. The data was not presented in the manuscript. Nor was sex considered for the other two species. A further discussion of the role that sex could play and future studies would be appreciated.

      We agree that the limited analysis of sex differences and the undocumented remark about Il6 and Il10 expression in females and males warranted correction. For the revision we removed that analysis of targeted RNA-seq of P. leucopus from the two different studies. For this study we were looking for differences that applied to both species. This was the reason that there were equal numbers of females and males in the samples. We agree that further investigation of differences between sexes in their responses is of interest but is probably best left for “future studies”.

      But in revision we do not entirely ignore the question of sex of the animal and provide an additional analysis of the bulk RNA-seq for P. leucopus with regard to differences between females and males. This basically demonstarted an overall commensurability between sexes, at least for the purposes of the GO term analysis and subsequent targeted RNA-seq, but did reveal some exceptions that are candidate genes for those future studies.

      In the revision, we also add for the discussion and its “study limitations” section a disclaimer about possibly missing sex associated differences because the groups were mixed sexes.

      1. The ratio of Nos2 and Arg1 copies for LPS treated and control P. leucopus and M.musculus in Table 3 show that in P. leucopus there is not a significant difference but in M.musculus there is an increase in Nos2 copies with LPS treatment. The authors then used a targeted RNA-seq analysis to show that in P. leucopus the number of Arg1 reads after LPS treatment is significantly higher than the controls. These results are over oversimplified in the text as an inverse relationship for Nos2/Arg1 in the two species.

      We agree. In addition to providing box plots for Arg1 and Nos2, as suggested by Reviewer #1, we also replaced “ratio” in commenting on Arg1 and Nos2, with “differences in Nos2 and Arg1 expresssion” replacing “ratio of Nos2 to Arg1 expression” at one place. At another place we have removed “inverse” with regard to Nos2 and Arg1. But we respectfully decline to remove Nos2/Arg1 from Figure 5 (now Figure 6) or inclusion of Nos2/Arg1 ratios elsewhere. According to our understanding there need not be an inverse relationship for a ratio to have informative value.

      Recommendations For the Authors

      We thank the two reviewers for their constructive recommendations and suggestions, in some case pointing out errors we totally missed. For the great majority, the recommendations were followed. Where we decline or disagree we explain this in the response.

      Reviewer #1 (Recommendations For The Authors):

      • How was the FDR < 0.003 cutoff chosen for DEG? All cutoffs are arbitrary but there should be some justification.

      We agree and have provided the rationale at that point in the paper (before Figure 3) in R2: "For GO term analysis the absolute fold-change criterion was ≥ 2. Because of the ~3-fold greater number of transcripts for the M. musculus reference set than the P. leucopus reference set, application of the same false-discovery rate (FDR) threshold for both datasets would favor the labeling of transcripts as DEGs in P. leucopus. Accordingly, the FDR p values were arbitrarily set at <5 x 10-5 for P. leucopus and <3 x 10-3 for M. musculus to provide approximately the same number of DEGs for P. leucopus (1154 DEGs) and M. musculus (1266 DEGs) for the GO term comparison."

      • It would be helpful to include a figure demonstrating the correlation between CD45 and WBC ("Pearson's continuous and Spearman's ranked correlations between log-transformed total white blood cell counts and normalized reads for Ptprc across 40 animals representing both species, sexes, and treatments were 0.40 (p = 0.01) and 0.34 (p = 0.03), respectively.")

      In both the first version of the revision (R1) and in R2 we provide a fuller explanation of the choice of CD45 (Ptprc) for normalization as detailed in the response to Reviewer #1's public comment. In the revision only Pearson's correlation and p value is given. We did not think another figure was justified after there was additional space devoted to this in both R1 and R2.

      • Unclear what the following paragraph is referring to-is this from the previous paper? Was this experiment introduced somewhere? "Low transcription of Nos2 and high transcription of Arg1 both in controls and LPS-treated P. leucopus was also observed in the experiment where the dose of LPS was 1 µg/g body mass instead of 10 µg/g and the interval between injection and assessment was 12 h instead of 4 h (Table 4)."

      This experiment is described in the Methods in the original and subsequent versions, but we agree that it is not clear whether it was from present study or previous one. Here is the revised text for R2: "Low transcription of Nos2 in both in controls and LPS-treated P. leucopus and an increase in Arg1 with LPS was also observed in another experiment for the present study where the dose of LPS was 1 µg/g body mass instead of 10 µg/g and the interval between injection and assessment was 12 h instead of 4 h (Table 4)."

      • Regarding the differences in IFNy between outbred and BALB/c mice-are there any other RNA-seq datasets you can mine where other inbred mice (B/6, C3H, etc) have been injected with LPS and probed roughly the same amount of time later? Do they look like BALB/c or the outbreds?

      In both the original and R1 and R2 we cite two papers on the difference of BALB/c mice. While this is of interest for follow-up in the future, we did not think additional content on a subject that mainly pertains to M. musculus was warranted here, where the main focus is Peromyscus.

      • Figure 8 and its legend are difficult to follow. The top half of the figure is not well explained and it's unclear what species this is. Decreased use of abbreviations would help. Consider marking each R2 value as Mus or Peromyscus (As done in Fig 9). There are some typographical errors in the legend ("gree," incomplete sentence missing the words LPS or treatment AND Mus: "Co-variation between transcripts for selected PRRs (yellow) and ISGs (gree) in the blood of P. leucopus (P) or (M) with (L") or without (C)."

      This is now Figure 9 in both R1 and R2. We revised it for R1 to include references to the box plots in supplementary materials, but agree with Reviewer #1's recommendation to correct the typos and make the legend less confusing. We did not think that further labeling of the R2 values in the scatterplots with the species names was necessary. The data points are not just colors but also different symbols, so it should be fairly easy for readers to distinguish the regression lines by species. For R2 this is the revised legend with additions in response to the recommendation underlined:

      "Figure 9. Co-variation between transcripts for selected PRRs and ISGs in the blood of P. leucopus (P) or M. musculus (M) with (L) or without (C) LPS treatment. Top panel: matrix of coefficients of determination (R2) for combined P. leucopus and M. musculus data. PRRs are indicated by yellow fill and ISGs by blue fill on horizontal and vertical axes. Shades of green of the matrix cells correspond to R2 values, where cells with values less than 0.30 have white fill and those of 0.90-1.00 have deepest green fill. Bottom panels: scatter plots of log-transformed normalized Mx2 transcripts on Rigi (left), Ifih1 (center), and Gbp4 (right). The linear regression curves are for each species. For the right-lower graph the result from the General Linear Model (GLM) estimate is also given. Values for analysis are in Table S4; box plots for Gbp4, Irf7, Isg15, Mx2, and Oas1 are provided in Figure S6."

      • Discussion section could benefit from editing for clarity. Examples listed: o Unclear what effect is described here "The bacterial infection experiment indicated that the observed effect in P. leucopus was not limited to a TLR4 agonist; the lipoproteins of B. hermsii are agonists for TLR2 (Salazar et al. 2009)."

      Both R1 and R2 include the new section on the B. hermsii infection model. This was added in response to Reviewer #1 public comment. So the expanded consideration of this aspect should address the reviewer's recommendation for more clarity and context here. For R2 we modified the text in the discussion of R1:

      "The analysis here of the B. hermsii infection experiment also indicated that the phenomenon observed in P. leucopus was not limited to a TLR4 agonist."

      o Unclear what the takeaway from this paragraph is: "Reducing the differences between P. leucopus and the murids M. musculus and R. norvegicus to a single all-embracing attribute may be fruitless. But from a perspective that also takes in the 2-3x longer life span of the whitefooted deer mouse compared to the house mouse and the capacity of P. leucopus to serve as disease agent reservoir while maintaining if not increasing its distribution (Moscarella et al. 2019), the feature that seems to best distinguish the deer mouse from either the mouse or rat is its predominantly anti-inflammatory quality. The presentation of this trait likely has a complex, polygenic basis, with environmental (including microbiota) and epigenetic influences. An individual's placement is on a spectrum or, more likely, a landscape rather than in one or another binary or Mendelian category."

      We agree that modification, simplication, and clarification was called for. In response to a public comment of Reviewer #1 we had changed that section, leaving out reference to longevity here. Here is the revised text in both R1 and R2:

      "Reducing differences between P. leucopus and murids M. musculus and R. norvegicus to a single attribute, such as the documented inactivation of the Fcgr1 gene in P. leucopus (7), may be fruitless. But the feature that may best distinguish the deermouse from the mouse and rat is its predominantly anti-inflammatory quality. This characteristic likely has a complex, polygenic basis, with environmental (including microbiota) and epigenetic influences. An individual’s placement is on a spectrum or, more likely, a landscape rather than in one or another binary or Mendelian category."

      Minor comments:

      • Use of blue and red in figures as the -only- way to easily distinguish between groups is a poor choice-both in terms of how inclusivity of color-blind researchers and enabling grayscale printing. Most detrimental in Figure 2, but also slightly problematic in Figure 1. Use of color and shape (as done in other figures) is a much better alternative.

      We agree. Both figures have been modified to include an additional characteristic for denoting the data point. For Figure 1 it is a black filling, and for Figure 2 it is the size of symbol in additon to the color. This should enable accurate visualization by color blind individuals and printing in gray scale. We have added definitions for the symbols within the graph itself, so there is no need to refer to the legend to interpret what they mean.

      • Note the typo where it should read P leucopus: "The differences between P. musculus and M. musculus in the ratios of Nos2/Arg1 and IL12/IL10 were reported before (BalderramaGutierrez et al. 2021),"

      We thank the reviewer for pointing this typo out, which also carried over to R1. It has been corrected for R2.

      • Optional: Can the relationship between the ratios in figure 5 and macrophage "types" be displayed graphically alongside the graphs? It's a little challenging to go back and forth between the text and the figure to try to understand the biological implication.

      We considered something like this but in the end decided that we were not yet comfortable assigning “types” in this fashion for Peromyscus.

      Reviewer #2 (Recommendations For The Authors):

      • Be consistent with nomenclature for your species/treatment groups in the text, figures, and tables. For example, you go back and forth between "P. leucopus" and "deermouse" in the text. And in figures you use "P," "Peromyscus", or "Pero".

      In the Methods section of the original and revisions R1 and R2 we indicate that "deermouse" is synonymous with "Peromyscus leucopus" and "mouse" is synonymous with "Mus musculus" in the context of this paper. We think that some alternation in the terms relieves the text of some of its repetitiveness and that readers should not have a problem with equating one with the other. The use of "deermouse" also reinforces for readers that Peromyscus is not a mouse. With regard to the abbreviations for P. leucopus, those were used to accommodate design and space issues of the figures or tables. In all cases, the abbreviations referred to are defined in the legends of the figures. So, we respectfully decline to follow this recommendation.

      • Often the sentence structure and/or word choice is irregular and makes quick/easy comprehension difficult. Several examples are:

      o The third paragraph of the introduction

      We agree that the first and second sentences are unclear. Here is the revision for R2:

      “As a species native to North America, P. leucopus is an advantageous alternative to the Eurasian-origin house mouse for study of natural variation in populations that are readily accessible (9, 53). A disadvantage for the study of any Peromyscus species is the limited reagents and genetic tools of the sorts that are applied for mouse studies.”

      o The first line after Figure 5 on page 9.

      We agree. The long sentence which we think the reviewer is referring to has been in split into two sentences for R2.

      “An ortholog of Ly6C (13), a protein used for typing mouse monocytes and other white cells, has not been identified in Peromyscus or other Cricetidae family members. Therefore, for this study the comparison with Cd14 is with Cd16 or Fcgr3, which deermice and other cricetines do have.”

      o The sentence that starts "Our attention was drawn to..." on page 14.

      We agree that the sentence was awkward and split into two sentences.

      “Our attention was drawn to ERVs by finding in the genome-wide RNA-seq of LPS-treated and control rats. Two of the three highest scoring DEGs by FDR p value and fold-change were a gagpol polyprotein of a leukemia virus with 131x fold-change from controls and a mouse leukmia virus (MLV) envelope (Env) protein with 62x fold-change (Dryad Table D5).”

      • For figures with multiple panels, use A), B) etc then indicate which panel you are discussing in your text. This is a very data heavy study and your readers can easily get lost.

      We agree and have added pointers in the text to the panels we are referring to. But we prefer to use easily understood descriptors like “left” and “upper” over assigned letters.

      • For all the figures, where are the stats from the t-tests? Why didn't you do a two-way ANOVA? Instead of multiple t-tests?

      Where we are not hypothesis testing and we are able to show all the data points in box-whisker plots with distributions fully revealed, our default position is not to apply significance tests in a post hoc fashion. If a reader or other investigator wants to do this for other purposes, e.g. a meta-analysis, the data is provided in public repository for them to do this. We are not sure what the reviewer means by "multiple t-tests" for "all figures". Where we do 2-tailed t-tests for presentation of data for many genes in a table for the targeted RNA (where individual values cannot shown in the table), there is always correction for multiple testing, as indicated in Methods. The p values shown as "FDR" are after correction.

      • Results paragraph "LPS experiment and hematology studies"

      o List the two species for the first description to orient the reader since you eventually include rat data.

      We agree that this is warranted and followed this recommendation for R2.

      o Not all the mice experienced tachypnea, but the text makes it seem like 100% did.

      We are not sure what the reviewer is referring to here. This is what is in the text on tachypnea: "By the experiment’s termination at 4 h, 8 of 10 M. musculus treated with LPS had tachypnea, while only one of ten LPS-treated P. leucopus displayed this sign of the sepsis state (p = 0.005)." The only other mention of "tachypnea" was in Methods.

      • Figure 1: Why was the M. musculus outlier excluded? Where any other outliers excluded?

      That data point for the mouse was not "excluded" from the graph. It is identified (MM17) for reference with Table 1, and there is the graph for all to see where it is. It was only excluded from the regression curve for control mice. There was no significance testing. There were no other outliers excluded.

      • Figure 3: explain the colors and make the scales the same for all the panels or at least for the upregulated DEGs and the downregulated DEGs.

      We have modified the legend for Figure 3 to include fuller definitions of the x-axes and a description of the color spectrum. We decline to make the x-axis scale the same for all the panels because the horizontal bars in “transcription down” panels would take up only a small fraction of the space. The x-axes are clearly defined and the colors of the bars also indicate the differences in p-values. We doubt that readers will be misled. Here is the revised legend: “Figure 3. Gene Ontology (GO) term clusters associated with up-regulated genes (upper panels) and down-regulated genes (lower panels) of P. leucopus (left panels) and M. musculus (right panels) treated with LPS in comparison with untreated controls of each species. The scale for the x-axes for the panels was determined by the highest -log10 p values in each of the 4 sets. The horizontal bar color, which ranges from white to dark brown through shades of yellow through orange in between, is a schematic representation of the -log10 p values.”

      • Results paragraph "Targeted RNA seq analysis"

      o In the third paragraph, an R2 of 0.75 is not close enough to 1 to call it "~1"

      What the reviewer is referring to is no longer in either R1 and R2, as detailed in the authors' response to public comments.

      o In the 4th paragraph, where are your stats?

      We have replaced terms like "substantially" and "marginally" with simple descriptions of relationships in the graphs.

      "For the LPS-treated animals there was, as expected for this selected set, higher expression of the majority genes and greater heterogeneity among P. leucopus and M. musculus animals in their responses for represented genes. In contrast to the findings with controls, Ifng and Nos2 had higher transcription in treated mice. In deermice the magnitude of difference in the transcription between controls and LPS-treated was less."

      • Figure 4: The colors are hard to see, I suggest making all the up regulated reads one color, the down regulated reads a different color, and the reads that aren't different black or gray.

      This is now Figure 5 in R1 and R2. The selected genes that are highlighted in the panels are denoted not only by color but also by type of symbol. We do not think that readers will have a problem telling one from another even if color blind. The purpose of this figure was to provide an overview and a visual representation with calling out of selected genes, some of which will be evaluated in more detail later. We thought that this was necessary before diving deeper into the data of Table 2. We do not think further discriminating between transcripts in the categorical way that the reviewer suggests is warranted at this point. So, we respectfully decline to follow this suggestion.

      • Results paragraph " Alternatively- activated macrophages...."

      o Include a brief description of Nos2 and Arg1

      We have defined what enzymes these are genes for in R2.

      o How do you explain the lack of a difference in P. leucopus Arg1? Your text says the RT-qPCR confirms the RNA-seq findings.

      There was a difference in P. leucopus Arg1 by RT-qPCR between control and LPS treated by about 3-fold. By both RNA-seq and RT-qPCR Arg1 transcription is higher in P. leucopus than in M. musculus under both conditions. But we have modified the sentence so that does not imply more than what the data and analysis of the table reveal.

      "While we could not type single cells using protein markers, we could assess relative transcription of established indicators of different white cell subpopulations in whole blood. The present study, which incorporated outbred M. musculus instead of an inbred strain, confirmed the previous finding of differences in Nos2 and Arg1 expression between M. musculus and P. leucopus (Figure 5; Table 2). Results similar to the RNA-seq findings were obtained with specific RT-qPCR assays for Nos2 and Arg1 transcripts for P. musculus and M. musculus (Table 3)."

      • Figure 5: reorganize the panels to make the text description and label with letters, where are the stats?

      We thought the figure (now Figure 6) was self-explanatory, but agree that further explanation in the legend was indicated. We prefer to use descriptions of locations (“upper left”) over labels, like “panel C”, which do not obviously indicate the location of the panel. Of course, if the journal’s style mandates the other format we will do so. Our response about “stats” for boxplot figures is the same as what we provided above.

      • Results paragraph "Interferon-gamma and interleukin-1 beta..."

      o Either add the numbers or direct the viewer to where Ifng is in Table 2. The table is very big and Ifng is all the way at the bottom!

      We agree that this table is large, but we thought it better to err on the side of inclusiveness by having a single table, rather than have some genes in the main article and other results in a supplementary table. We thought that it would make it easier for reviewers and readers to find a gene of interest, but we also acknowledge the challenge to locate the genes we highlight. We follow for R2 that reviewer's recommendation to provide some guidance for readers trying to locate a featured gene by pointing relative locations. While adding a column of numbers to already complex table seems more than what is called for, we are depositing an Excel spreadsheet of the table at the Dryad repository to facilitate searching by an interested reader for a particular gene.

      • Figure 6: stats? The pink and red are hard to easily distinguish from each other. I also suggest not using red and green together for color blind readers.

      With regard to the box-plots and significance testing, please see response above to an earlier recommendation. We have removed an interpretative adjective (i.e. "marked") from the description of the graph. Different symbols as well as colors are used, so we do not think that this will pose a problem for readers, even those with complete red-green color blindness. For what it’s worth, with regard to the "red" and "pink" issue, according to the figure on our displays the colors of the two symbols appear to be red and purple. They are also applied to different species and different conditions for those species.

      • Figure 8: In the legend it says "... PRRs (yellow) and ISGs (gree)" which is a typo, but don't you mean blue not green anyways?

      See response above to Reviewer #1's recommendation. This has been corrected.

    1. Reviewer #1 (Public Review):

      Summary:<br /> This paper examines patterns of diversity and divergence in two closely related sub-species of Zea mays. While the patterns are interesting, the strength of evidence in support of the conclusions drawn from these patterns is weak overall. Most of the main conclusions are not supported by convincing analyses.

      Strengths:<br /> The paper presents interesting data from sets of sympatric populations of the two sub-species, maize and teosinte. This sampling offers unique insights into the diversity and divergence between the two, as well as the geographic structure of each.

      Weaknesses:<br /> There were issues with many parts of the paper, especially with the strength of conclusions that can be drawn from the analyses. I list the major issues in the order in which they appear in the paper.

      1. Gene flow and demography.<br /> The f4 tests of introgression (Figure 1E) are not independent of one another. So how should we interpret these: as gene flow everywhere, or just one event in an ancestral population? More importantly, almost all the significant points involve one population (Crucero Lagunitas), which suggests that the results do not simply represent gene flow between the sub-species. There was also no signal of increased migration between sympatric pairs of populations. Overall, the evidence for gene flow presented here is not convincing. Can some kind of supporting evidence be presented?

      The paper also estimates demographic histories (changes in effective population sizes) for each population, and each sub-species together. The text (lines 191-194) says that "all histories estimated a bottleneck that started approximately 10 thousand generations ago" but I do not see this. Figure 2C (not 2E, as cited in the text) shows that teosinte had declines in all populations 10,000 generations ago, but some of these declines were very minimal. Maize has a similar pattern that started more recently, but the overall species history shows no change in effective size at all. There's not a lot of signal in these figures overall.

      I am also curious: how does the demographic model inferred by mushi address inbreeding and homozygosity by descent (lines 197-202)? In other words, why does a change in Ne necessarily affect inbreeding, especially when all effective population sizes are above 10,000?

      2. Proportion of adaptive mutations.<br /> The paper estimates alpha, the proportion of nonsynonymous substitutions fixed by positive selection, using two different sampling schemes for polymorphism. One uses range-wide polymorphism data and one uses each of the single populations. Because the estimates using these two approaches are similar, the authors conclude that there is little local adaptation. However, this conclusion is not justified.

      There is little information as to how the McDonald-Kreitman test is carried out, but it appears that polymorphism within either teosinte or maize (using either sampling scheme) is compared to fixed differences with an outgroup. These species might be Z. luxurians or Z. diploperennis, as both are mentioned as outgroups. Regardless of which is used, this sampling means that almost all the fixed differences in the MK test will be along the ancestral branch leading to the ancestor of maize or teosinte, and on the branch leading to the outgroup. Therefore, it should not be surprising that alpha does not change based on the sampling scheme, as this should barely change the number of fixed differences (no numbers are reported).

      The lack of differences in results has little to do with range-wide vs restricted adaptation, and much more to do with how MK tests are constructed. Should we expect an excess of fixed amino acid differences on very short internal branches of each sub-species tree? It makes sense that there is more variation in alpha in teosinte than maize, as these branches are longer, but they all seem quite short (it is hard to know precisely, as no Fst values or similar are reported).

      3. Shared and private sweeps.<br /> In order to make biological inferences from the number of shared and private sweeps, there are a number of issues that must be addressed.

      One issue is false negatives and false positives. If sweeps occur but are missed, then they will appear to be less shared than they really are. Table S3 reports very high false negative rates across much of the parameter space considered, but is not mentioned in the main text. How can we make strong conclusions about the scale of local adaptation given this? Conversely, while there is information about the false positive rate provided, this information doesn't tell us whether it's higher for population-specific events. It certainly seems likely that it would be. In either case, we should be cautious saying that some sweeps are "locally restricted" if they can be missed more than 85% of the time in a second population or falsely identified more than 25% of the time in a single population.

      A second, opposite, issue is shared ancestral events. Maize populations are much more closely related than teosinte (Figure 2B). Because of this, a single, completed sweep in the ancestor of all populations could much more readily show a signal in multiple descendant populations. This is consistent with the data showing more shared events (and possibly more events overall). There also appear to be some very closely (phylogenetically) related teosinte populations. What if there's selection in their shared ancestor? For instance, Los Guajes and Palmar Chico are the two most closely related populations of teosinte and have the fewest unique sweeps (Figure 4B). How do these kinds of ancestrally shared selective events fit into the framework here?

      These analyses of shared sweeps are followed by an analysis of sweeps shared by sympatric pairs of teosinte and maize. Because there are not more events shared by these pairs than expected, the paper concludes that geography and local environment are not important. But wouldn't it be better to test for shared sweeps according to the geographic proximity of populations of the same sub-species? A comparison of the two sub-species does not directly address the scale of adaptation of one organism to its environment, and therefore it is hard to know what to conclude from this analysis.

      4. Convergent adaptation<br /> My biggest concern involves the apparent main conclusion of the paper about the sources of "convergent adaptations". I believe the authors are misapplying the method of Lee and Coop (2017), and have not seriously considered the confounding factors of this method as applied. I am unconvinced by the conclusions that are made from these analyses.

      The method of Lee and Coop (referred to as rdmc) is intended to be applied to a single locus (or very tightly linked loci) that shows adaptation to the same environmental factor in different populations. From their paper: "Geographically separated populations can convergently adapt to the same selection pressure. Convergent evolution at the level of a gene may arise via three distinct modes." However, in the current paper, we are not considering such a restricted case. Instead, genome-wide scans for sweep regions have been made, without regard to similar selection pressures or to whether events are occurring in the same gene. Instead, the method is applied to large genomic regions not associated with known phenotypes or selective pressures.

      I think the larger worry here is whether we are truly considering the "same gene" in these analyses. The methods applied here attempt to find shared sweep regions, not shared genes (or mutations). Even then, there are no details that I could find as to what constitutes a shared sweep. The only relevant text (lines 802-803) describes how a single region is called: "We merged outlier regions within 50,000 Kb of one another and treated as a single sweep region." (It probably doesn't mean "50,000 kb", which would be 50 million bases.) However, no information is given about how to identify overlap between populations or sub-species, nor how likely it is that the shared target of selection would be included in anything identified as a shared sweep. Is there a way to gauge whether we are truly identifying the same target of selection in two populations?

      The question then is, what does rdmc conclude if we are simply looking at a region that happened to be a sweep in two populations, but was not due to shared selection or similar genes? There is little testing of this application here, especially its accuracy. Testing in Lee and Coop (2017) is all carried out assuming the location of the selected site is known, and even then there is quite a lot of difficulty distinguishing among several of the non-neutral models. This was especially true when standing variation was only polymorphic for a short time, as is estimated here for many cases, and would be confused for migration (see Lee and Coop 2017). Furthermore, the model of Lee and Coop (2017) does not seem to consider a completed ancestral sweep that has signals that persist into current populations (see point 3 above). How would rdmc interpret such a scenario?

      Overall, there simply doesn't seem to be enough testing of this method, nor are many caveats raised in relation to the strange distributions of standing variation times (bimodal) or migration rates (opposite between maize and teosinte). It is not clear what inferences can be made with confidence, and certainly the Discussion (and Abstract) makes conclusions about the spread of beneficial alleles via introgression that seem to outstrip the results.

    1. Ay marry is’t; And to my mind, though I am native here, And to the manner born, it is a custom More honour’d in the breach than the observance. This heavy-headed revel east and west Makes us traduc’d and tax’d of other nations: They clepe us drunkards, and with swinish phrase Soil our addition; and indeed it takes From our achievements, though perform’d at height, The pith and marrow of our attribute. So oft it chances in particular men That for some vicious mole of nature in them, As in their birth, wherein they are not guilty, Since nature cannot choose his origin, By their o’ergrowth of some complexion, Oft breaking down the pales and forts of reason; Or by some habit, that too much o’erleavens The form of plausive manners;—that these men, Carrying, I say, the stamp of one defect, Being Nature’s livery or Fortune’s star,— His virtues else,—be they as pure as grace, As infinite as man may undergo, Shall in the general censure take corruption From that particular fault. The dram of evil Doth all the noble substance often doubt To his own scandal.

      During the time that Shakespeare wrote Hamlet, there was a lot of uncertainty in England. With Elizabeth I reign coming to an end, and with no heir named, there was a lot of unease and uncertainty. “Claudius has hastily married the queen in order to secure his claim, and the old kings son, Hamlet, is openly unhappy about it” (Queen Elizabeths Decline). I think we can see this in the way that Hamlet speaks of the unrest of his kingdom after his uncle takes over the reign. “Queen Elizabeths Decline.”Sparknotes,Sparknotes,www.sparknotes.com/Shakespeare/hamlet/context/historical/queen-Elizabeth’s-decline/.

    1. Author Response

      The following is the authors’ response to the original reviews.

      We thank the reviewers for their positive remarks. We have addressed the reviewers’ recommendations in the point-by-point response below to improve our revised manuscript.

      Reviewer #1 (Recommendations For The Authors):

      1. The authors carry out their HDX-MS work on Prestin (and SLC26A9) solubilized in glycol-diosgenin. The authors should carefully rationalize their choice of detergent and discuss how their key findings are also pertinent to the native state of Prestin when residing in an actual phospholipid bilayer. More native membrane mimetic models are available, for instance, nano-discs etc. While I am not insisting that the authors have to repeat their measurements in a more native membrane system, it would be a very nice control experiment, and in any case, a detailed discussion of the limitations of the approach taken and possible caveats should be included - possibly with additional references to other studies.

      Response: We have added a paragraph rationalizing the choice of detergent in lines 174-176. We have also added requested HDX data comparing prestin reconstituted in nanodisc to prestin solubilized in micelle (Fig 5). The HDX for prestin under these two membrane mimetics were indistinguishable, including the anion-binding site, suggesting that our major findings are likely pertinent to prestin residing in a lipid bilayer. The only major HDX difference we observed was that a lipid-facing helix TM6 is more dynamic for prestin in nanodisc compared to in micelles. In our previous structural studies, we identified TM6 as the “eletromotile elbow” that is important for prestin’s mechanical expansion (Bavi et al., Nature, 2021). We are currently conducting a more thorough investigation to understand the role of TM6 in prestin’s electromotility.

      1. As far as I understand, the HEPES state represents the apo-state and thus assumes that HEPES does not bind to Prestin - the authors should support this assumption or include a discussion of the possible effect of HEPES on Prestin. Also, the HEPES state has fewer time-points - this should also be discussed.

      Response: We have included a discussion of the possible effects of HEPES in lines 331-345. In fact, in an attempt to support our assumption that HEPES does not bind to prestin, we set out to determine the structure of prestin in the HEPES-based buffer using single particle cryo-EM. However, we did not find evidence that HEPES binds to prestin. Details are discussed in lines 331-345 and Supporting Information Text 3.

      We employed a denser sampling of HDX labeling times for prestin in Cl- because it is critical for fitting and ∆G calculation. The earlier time points are used mainly to evaluate the dynamics of the less stable cytosolic domain. Since the cytosolic domain does not directly participate in prestin’s voltage-sensing mechanism and electromotility, we only measured the HEPES states with longer time points which mainly probe the dynamics of the transmembrane domain.

      1. Overall, the HDX-MS data provided and the statistical analysis done is in my view sufficiently detailed and well done - the authors are advised to make reference to and include a HDX Summary table and HDX Data Table according to the HDX-MS community-guidelines (Masson et al. Nature Methods 2019).

      Response: An HDX summary table was provided in Table S1 and referred in lines 81 and 388. We have included a reference to Masson et al., Nature Methods, 2019, in line 389.

      1. Figure 5 - I like the detailed analysis of the helix folding - but in my experience, one can provide a great fit of many HDX curves to a 4 -term exponential function - I think the authors would need more time-points to provide a more convincing case. But it does provide a compelling theory - even if the data strictly does not prove it. The authors should discuss this in more detail - including limitations etc.

      Response: We presented a statistical analysis describing the accuracy of the fitting in Fig 6A. We acknowledge that the values of the exponentials may not be precisely determined, but the fundamental result is robust – TM3 exchanges through fraying from the N-terminal end of the helix while TM6 exchanges much more cooperatively. Collecting additional time points may reduce the error on the rates but would not contribute to additional mechanistic insights.

      Reviewer #2 (Recommendations For The Authors):

      1. I suggest toning down more speculative/ hypothetical aspects. Specifically, I believe that the following sentence should not be in the abstract in its present form: "This event shortens the TM3-TM10 electrostatic gap, thereby connecting the two helices such that TM3-anion-TM10 is pushed upwards by forces from the electric field, resulting in reduced cross-sectional area."

      Response: The sentence has been rephrased.

      1. The "nuance" between helix fraying and helix unfolding is an important aspect of the author's hypothesis but this should be explained better. In that regard, have the authors performed HDX-MS analysis of the mutant P136T? That would nicely support their claim regarding the importance of helix fraying as being foundational to allow electromotility.

      Response: More explanation for helix fraying and unfolding has been provided in the main text. We have not performed HDX-MS analysis of the mutant P136T. However, we performed molecular dynamics simulations using Upside, and consistently, showed that a P136T mutation in prestin results in a highly stabilized TM3 (Fig. S4B).

      1. Why do measurements at two pDs? Did the authors observe any differences?

      Response: The purpose of two pDs is to increase the effective dynamic range of the HDX measurement by two orders of magnitude because the intrinsic exchange rate scales with pD & Temp. This allows us to determine the stability of both the highly and minimally stable regions within the protein. We have rephrased lines 83-87 to better rationalize this choice of pDs. With the time points performed in this study, we did not observe noticeable differences for HDX performed under the two pDs when corrected for the changes in the intrinsic rates (Fig. S7A).

      1. I can't help but wonder what is the interest in doing HDX-MS measurements after 27h of incubation. Membrane proteins are known for their instability once purified and a few odd HDX profiles at that specific timepoint (especially in the 80-100 residues area) make one question whether local unfolding preceding aggregation could happen. This actually weakens the author's claims about cooperative unfolding and localized and directional helix fraying. Could they provide some evidence (CD, thermostability measurements such as trp fluorescence quenching, or SEC analysis) that the prestin is still folded after 27h in GDN.

      Response: We appreciate reviewer’s comments on membrane proteins can be unstable once purified. In our system, we did not observe evidence of unfolding or aggregation caused by long-term incubation after purification. This is mostly supported by the fact that our HDX reactions were initiated and injected to MS in random order, yet are still highly reproducible among biological and technical replicates. A specific example included HDX on freshly purified SLC26A9 gave the same deuteration levels as SLC26A9 purified in GDN after 4 days. For prestin, although we don’t have direct comparison between fresh samples and old samples (24-27h post-purification) due to the lack of samples, 30s HDX in SO42- performed 24h post-purification gave a %D that fell between 10s and 90s of labeling done on fresh sample. Additionally, HDX on prestin in Cl- performed on freshly purified sample gave the sample %D as prestin in the presence of 1M urea labeled after 24~48h of purification, suggesting that prestin is relatively resistant to aggregation at least within 48h after purification even in the presence of 1 M urea (data not shown).

      Furthermore, the HDX for prestin in nanodisc are essentially identical to prestin in micelles except for a functionally important helix (TM6), suggesting minimal aggregation or misfolding.

      We think the “a few odd HDX profiles” at 27h time points for residues 80-100 are caused by two reasons. Firstly, TM1 unfolds cooperatively and its stability in HEPES falls within the detection range when long labeling time points were employed (within one log unit of 27h). Secondly, we observed two non-interconverting and structurally distinct populations for TM1 (Supporting Information Text 1 & Fig. S8), and in long labeling times, the two isotope distributions merge and sometimes can skew the %D calculations. Nevertheless, the HDX differences we observed comparing across conditions are clear and such %D calculation skewing, if present, should be minimal and does not change our main conclusions.

    1. Author Response

      The following is the authors’ response to the previous reviews

      Point-to-Point Responses to Reviewers’ Comments

      We are a bit surprised by the comments of Reviewer 1, but that our further responses can help communications with Reviewer 1. We have also responded to comments of Reviewers 2 and 3.

      Public Reviews:

      *Reviewer #1 (Public Review):

      The overall tone of the rebuttal and lack of responses on several questions was surprising. Clearly, the authors took umbrage at the phrase 'no smoking gun' and provided a lengthy repetition of the fair argument about 'ticking boxes' on the classic list of criteria. They also make repeated historical references that descriptions of neurotransmitters include many papers, typically over decades, e.g. in the case of ACh and its discovery by Sir Henry Dale. While I empathize with the authors' apparent frustration (I quote: '...accept the reality that Rome was not built in a single day and that no transmitter was proven by a one single paper') I am a bit surprised at the complete brushing away of the argument, and in fact the discussion. In the original paper, the notion of a receptor was mentioned only in a single sentence and all three reviewers brought up this rather obvious question. The historical comparisons are difficult: Of course many papers contribute to the identification of a neurotransmitter, but there is a much higher burden of proof in 2023 compared to the work by Otto Loewi and Sir Henry Dale: most, if not all, currently accepted neurotransmitter have a clear biological function at the level of the brain and animal behavior or function - and were in fact first proposed to exist based on a functional biological experiment (e.g. Loewi's heart rate change). This, and the isolation of the chemical that does the job, were clear, unquestionable 'smoking guns' a hundred years ago. Fast forward 2023: Creatine has been carefully studied by the authors to tick many of the boxes for neurotransmitters, but there is no clear role for its function in an animal. The authors show convincing effects upon K+ stimulation and electrophysiological recordings that show altered neuronal activity using the slc6a8 and agat mutants as well as Cr application - but, as has been pointed out by other reviewers, these effects are not a clear-cut demonstration of a chemical transmitter function, however many boxes are ticked. The identification of a role of a neurotransmitter for brain function and animal behavior has reasonably more advanced possibilities in 2023 than a hundred years ago - and e.g. a discussion of approaches for possible receptor candidates should be possible.

      Again, I reviewed this positively and agree that a lot of cumulative data are great to be put out there and allow the discovery to be more broadly discussed and tested. But I have to note, that the authors simply respond with the 'Rome was not built in a single day' statement to my suggestions on at least 'have some lead' how to approach the question of a receptor e.g. through agonists or antagonists (while clearly stating 'I do not think the publication of this manuscript should not be made dependent' on this). Similarly, in response to reviewer 2's concerns about a missing receptor, the authors' only (may I say snarky) response is ' We have deleted this sentence, though what could mediate postsynaptic responses other than receptors?' The bullet point by reviewer 3 ' • No candidate receptor for creatine has been identified postsynaptically.' is the one point by that reviewer that is simply ignored by the authors completely. Finally, I note that my reivew question on the K stimulation issues (e.g. 35 neurons that simply did not respond at all) was: ' Response: To avoid the disadvantage of K stimulation, we also performed optogenetic experiments recently and obtained encouraging preliminary results.' No details, not data - no response really.

      In sum, I find this all a bit strange and the rebuttal surprising - all three reviewers were supportive and have carefully listed points of discussion that I found all valid and thoughtful. In response, the authors selectively responded scientifically to some experimental questions, but otherwise simply rather non-scientifically dismissed questions with 'Rome was not built in a day'-type answers, or less. I my view, the authors have disregarded the review process and the effort of three supportive reviewers, which should be part of the permanent record of this paper.

      Response:

      We were very surprised by the tone of Reviewer 1 in the second round of reviewing. The corresponding author has spent some time including a long holiday to cool down and re-read our earlier responses. The following is entirely by the correspond author.

      I have finally checked the term “smoking gun”, and found out that I interpreted it wrongly while I had thought that Reviewer 1 was wrong. This came from a long story in that I was lectured by a native speaker for my English when submitting the first paper from my own paper. In that case, the Reviewer was wrong (in arguing that only adjectives but not nouns can be used to define nouns), I was quite offended and remembered it vividly. In the case of “smoking gun”, I wrongly believed that it meant a hint (while the definite evidence would be “the final nail in the coffin”). By interpreting is as a hint, I was then rebutting Reviewer 1 for negating all our experimental results as “not a single piece of suggestive evidence”.

      For the above, I apologize.

      I have another disagreement about “smoking gun”. For a transmitter, multiple criteria have to be met. For example, finding a receptor for a small molecule would not be definitive for a transmitter because if it is not present in the SVs, it is unlikely to be a typical transmitter. If a molecule has a receptor but they are not even in the nervous system, it is definitely no a transmitter.

      The title of our paper is “Evidence suggesting creatine as a new central neurotransmitter”, not “Evidence proving creatine as a new central neurotransmitter”. In the Abstract, after “Our biochemical, chemical, genetic and electrophysiological results are consistent with the possibility of Cr as a neurotransmitter”, we are adding “though not yet reaching the level of proof for the now classic transmitters”. In the last sentence of the introduction, we have now added “though the discovery of a receptor for Cr would prove it”.

      I do, however, believe that, however strong the wordings are, criticisms and rebuttals in science are normal and should be conducted even when emotions are involved.

      One of my major point of differences with at least two of the reviewers is that the criteria for neurotransmitters should be those listed in major textbooks. While everyone can have one’s own opinions, the textbooks, especially those accepted by readers of the field for more than 40 years, should be the standards. Kandel has listed the 4 criteria not only 40 years ago but also just 2 years ago in their latest 6th edition. The reviewers have asked for more, while discounting Kandel et al. (2021). So, in essence, the Reviewer is not shy in scientific criticisms when stating “The identification of a role of a neurotransmitter for brain function and animal behavior has reasonably more advanced possibilities in 2023 than a hundred years ago”.

      Reviewer 1 raised another new criterion: brain function and behavior, while this is not in any textbook lists. However, lack of Cr caused behavioral problems, as cited by us in the introduction: both humans and mice were defective in brain function with loss of function mutations in the gene for the specific Cr transporter SLC6A8. If the reviewer meant behavioral abnormalities caused by Cr injection, that was unclear. But that criterion may not be met by other transmitters which is the likely reason that it was not a criterion in any textbook.

      Reviewer #2 (Public Review):

      Summary:

      Bian et al studied creatine (Cr) in the context of central nervous system (CNS) function. They detected Cr in synaptic vesicles purified from mouse brains with anti-Synaptophysin using capillary electrophoresis-mass spectrometry. Cr levels in the synaptic vesicle fraction was reduced in mice lacking the Cr synthetase AGAT, or the Cr transporter SLC6A8. They provide evidence for Cr release within several minutes after treating brain slices with KCl. This KCl-induced Cr release was partially calcium dependent and was attenuated in slices obtained from AGAT and SLC6A8 mutant mice. Cr application also decreased the excitability of cortical pyramidal cells in one third of the cells tested. Finally, they provide evidence for SLC6A8-dependent Cr uptake into synaptosomes, and ATP-dependent Cr loading into synaptic vesicles. Based on these data, the authors propose that Cr may act as neurotransmitter in the CNS.

      Strengths: 1. A major strength of the paper is the broad spectrum of tools used to investigate Cr. 2. The study provides evidence that Cr is present in/loaded into synaptic vesicles.

      Weaknesses: 1. There is no significant decrease in Cr content pulled down by anti-Syp in AGAT-/- mice when normalized to IgG controls. Hence, blocking AGAT activity/Cr synthesis does not affect Cr levels in the synaptic vesicle fraction, arguing against a Cr enrichment.

      Response: Evidence for Cr enrichment in the SVS was obtained robustly with wild type mice. When brain Cr is very low in AGAT-/- mutant mice, because there is little Cr, there is also little Cr in the SVs. One does not require that as a criterion: it does not argue against the normal levels of Cr could be transported into the SVs even if when the much reduced levels of AGAT-/- Cr in mutant mice could be enriched in SVs.

      1. There is no difference in KCl-induced Cr release between SLC6A8-/Y and SLC6A8+/Y when normalizing the data to the respective controls. Thus, the data are not consistent with the idea that depolarization-induced Cr release requires SLC6A8.

      Response: This comment of Reviewer 2 was based on Figure 5D. But if one carefully examines Figure 5G, it was clear that the Ca++ dependent component of KCl -induced Cr release was lower in SLC6A8-/Y than that in SLC6A8+/Y.

      1. The rationale of grouping the excitability data into responders and non-responders is not convincing because the threshold of 10% decrease in AP rate is arbitrary. The data do therefore not support the conclusion that Cr reduces neuronal excitability.

      Response: Comparison of the same neuron, before and after Cr did show effects on neuronal excitability though that would have no statistics if one does not group multiple cells into the same categories.

      Reviewer #3 (Public Review):

      SUMMARY:

      The manuscript by Bian et al. promotes the idea that creatine is a new neurotransmitter. The authors conduct an impressive combination of mass spectrometry (Fig. 1), genetics (Figs. 2, 3, 6), biochemistry (Figs. 2, 3, 8), immunostaining (Fig. 4), electrophysiology (Figs. 5, 6, 7), and EM (Fig. 8) in order to offer support for the hypothesis that creatine is a CNS neurotransmitter.

      STRENGTHS:

      There are many strengths to this study. • The combinatorial approach is a strength. There is no shortage of data in this study. • The careful consideration of specific criteria that creatine would need to meet in order to be considered a neurotransmitter is a strength. • The comparison studies that the authors have done in parallel with classical neurotransmitters is helpful. • Demonstration that creatine has inhibitory effects is another strength. • The new genetic mutations for Slc6a8 and AGAT are strengths and potentially incredibly helpful for downstream work.

      WEAKNESSES: • Some data are indirect. Even though Slc6a8 and AGAT are helpful sentinels for the presence of creatine, they are not creatine themselves. Of note, these molecules themselves are not essential for making the case that creatine is a neurotransmitter.

      Response: We agree, but those data are not inconsistent with the possibility.

      • Regarding Slc6a8, it seems to work only as a reuptake transporter - not as a transporter into SVs. Therefore, we do not know what the transporter into the TVs is.

      Response: SLC6A8 is not the transporter on the SVs, but is an excellent candidate for the transporter on the presynaptic cytoplasmic membrane for uptake of Cr into the presynaptic structure.

      • Puzzlingly, Slc6a8 and AGAT are in different cells, setting up the complicated model that creatine is created in one cell type and then processed as a neurotransmitter in another. This matter will likely need to be resolved in future studies.

      Response: We agree.

      • No candidate receptor for creatine has been identified postsynaptically. This will likely need to be resolved in future studies.

      Response: We agree.

      • Because no candidate receptor has been identified, it is important to fully consider other possibilities for roles of creatine that would explain these observations other than it being a neurotransmitter? There is some attention to this in the Discussion.

      Response: We agree.

      There are several criteria that define a neurotransmitter. The authors nicely delineated many criteria in their discussion, but it is worth it for readers to do the same with their own understanding of the data.

      By this reviewer's understanding (and combining some textbook definitions together) a neurotransmitter: 1) must be present within the presynaptic neuron and stored in vesicles; 2) must be released by depolarization of the presynaptic terminal; 3) must require Ca2+ influx upon depolarization prior to release; 4) must bind specific receptors present on the postsynaptic cell; 5) exogenous transmitter can mimic presynaptic release; 6) there exists a mechanism of removal of the neurotransmitter from the synaptic cleft.

      Response: While any of us can come up with a list according to our own understanding, the paper copies lists from textbooks, especially from Kandel et al. (2021), which lists the same 4 criteria as Kandel et al. (1983), providing consistency and consensus.

      For a paper to claim that the published work has identified a new neurotransmitter, several of these criteria would be met - and the paper would acknowledge in the discussion which ones have not been met. For this particular paper, this reviewer finds that condition 1 is clearly met.

      Conditions 2 and 3 seem to be met by electrophysiology, but there are caveats here. High KCl stimulation is a blunt instrument that will depolarize absolutely everything in the prep all at once and could result in any number of non-specific biological reactions as a result of K+ rushing into all neurons in the prep. Moreover, the results in 0 Ca2+ are puzzling. For creatine (and for the other neurotransmitters), why is there such a massive uptick in release, even when the extracellular saline is devoid of calcium?

      Response: Classic transmitters are released in a Ca++ dependent manner when stimulated by KCl, though they also had a Ca++ independent component as also shown in our Figure 5 E and F.

      Condition 4 is not discussed in detail at all. In the discussion, the authors elide the criterion of receptors specified by Purves by inferring that the existence of postsynaptic responses implies the existence of receptors. True, but does it specifically imply the existence of creatinergic receptors? This reviewer does not think that is necessarily the case. The authors should be appropriately circumspect and consider other modes of inhibition that are induced by activation or potentiation of other receptors (e.g., GABAergic or glycinergic).

      Response: Kandel et al. did not list this.

      Condition 5 may be met, because authors applied exogenous creatine and observed inhibition. However, this is tough to know without understanding the effects of endogenous release of creatine. if they were to test if the absence of creatine caused excess excitation (at putative creatinergic synapses), then that would be supportive of the same. Nicely, Ghirardini et al., 2023 study cited by the reviewers does provide support for this exact notion in pyramidal neurons.

      Response: For most commonly accepted transmitters, this criterion has never been met. For example, the simplest case would be ACh at the neuromuscular junction. Howver, we have now found that choline is clearly present in SVs. So, how does anyone be sure that only ACh is released only, or how does anyone rule out effects of choline on postsynaptic cells when cholinergic neurons are stimulated?

      Many synapses are now known to release more than one transmitter, making it difficult to define the effect of one transmitter released endogenously.

      These are perhaps reasons why some textbooks do not emphasize similarities of endogenously released vs exogenously applied molecules.

      For condition 6, the authors made a great effort with Slc6a8. This is a very tough criterion to understand or prove for many synapses and neurotransmitters.

      Response: SLC6A8 is a transporter on the cytoplasmic membrane, thus a good candidate for removal of Cr from the synaptic cleft.

      In terms of fundamental neuroscience, the story should be impactful. There are certainly more neurotransmitters out there than currently identified and by textbook criteria, creatine seems to be one of them taking all of the data in this study and others into account.

      Response: We hope that more will join our lonely efforts in trying to discover more transmitters.

      Recommendations for the authors:

      Reviewer #1 (Recommendations For The Authors):

      Since the authors largely disregarded questions in the review process, I do not see a point in listing recommendation for the authors again.

      Reviewer #2 (Recommendations For The Authors):

      1. The different sections of the manuscript are not separated by headers.

      Response: We do have separate subheadings.

      1. The beginning of the results section either does not reference the underlying literature or refers to unpublished data.

      Response: We have a very long introduction which was criticized for being too long and with too much historical citations. We therefore refrained from citation again in the beginning part of the Results section.

      1. The text contains many opinions and historical information that are not required (e.g., "It has never been easy to discover a new neurotransmitter, especially one in the central nervous system (CNS). We have been searching for new neurotransmitters for 12 years."; l. 17).

      Response: We would like to keep these because most readers are young and do not know the history and difficulties of discovering transmitters.

      1. Almeida et al. (2008; doi: 10.1002/syn.20280) provided evidence for electrical activity-, and Ca2+-dependent Cr release from rat brain slices. This paper should be introduced in the introduction.

      Response: Done.

      1. Fig. 7: A Y-scale for the stimulation protocol is missing.

      Response: Done.

      Reviewer #3 (Recommendations For The Authors):

      The main suggestion by this reviewer (beyond the details in the public review) was to consider the full spectrum of biology that is consistent with these results. By my reading, creatine could be a neurotransmitter, but other possibilities also exist. The authors have highlighted some of those for their Discussion.

    2. Reviewer #1 (Public Review):

      The overall tone of the rebuttal and lack of responses on several questions was surprising. Clearly, the authors did not appreciate the phrase 'no smoking gun' and provided a lengthy repetition of the fair argument about 'ticking boxes' on the classic list of criteria. They also make repeated historical references that descriptions of neurotransmitters include many papers, typically over decades, e.g. in the case of ACh and its discovery by Sir Henry Dale. While I empathize with the authors' apparent frustration (I quote: '...accept the reality that Rome was not built in a single day and that no transmitter was proven by a one single paper') I am a bit surprised at the complete brushing away of the argument, and in fact the discussion. In the original paper, the notion of a receptor was mentioned only in a single sentence and all three reviewers brought up this rather obvious question. The historical comparisons are difficult: Of course many papers contribute to the identification of a neurotransmitter, but there is a much higher burden of proof in 2023 compared to the work by Otto Loewi and Sir Henry Dale: most, if not all, currently accepted neurotransmitter have a clear biological function at the level of the brain and animal behavior or function - and were in fact first proposed to exist based on a functional biological experiment (e.g. Loewi's heart rate change). This, and the isolation of the chemical that does the job, were clear, unquestionable 'smoking guns' a hundred years ago. Fast forward 2023: Creatine has been carefully studied by the authors to tick many of the boxes for neurotransmitters, but there is no clear role for its function in an animal. The authors show convincing effects upon K+ stimulation and electrophysiological recordings that show altered neuronal activity using the slc6a8 and agat mutants as well as Cr application - but, as has been pointed out by other reviewers, these effects are not a clear-cut demonstration of a chemical transmitter function, however many boxes are ticked. The identification of a role of a neurotransmitter for brain function and animal behavior has reasonably more advanced possibilities in 2023 than a hundred years ago - and e.g. a discussion of approaches for possible receptor candidates should be possible.

      Again, I reviewed this positively and agree that a lot of cumulative data are great to be put out there and allow the discovery to be more broadly discussed and tested. But I have to note, that the authors simply respond with the 'Rome was not built in a single day' statement to my suggestions on at least 'have some lead' how to approach the question of a receptor e.g. through agonists or antagonists (while clearly stating 'I do not think the publication of this manuscript should not be made dependent' on this). Similarly, in response to reviewer 2's concerns about a missing receptor, the authors' only (may I say snarky) response is ' We have deleted this sentence, though what could mediate postsynaptic responses other than receptors?' The bullet point by reviewer 3 ' • No candidate receptor for creatine has been identified postsynaptically.' is the one point by that reviewer that is simply ignored by the authors completely. Finally, I note that my reivew question on the K stimulation issues (e.g. 35 neurons that simply did not respond at all) was: ' Response: To avoid the disadvantage of K stimulation, we also performed optogenetic experiments recently and obtained encouraging preliminary results.' No details, not data - no response really.

      In sum, I find this all a bit strange and the rebuttal surprising - all three reviewers were supportive and have carefully listed points of discussion that I found all valid and thoughtful. In response, the authors selectively responded scientifically to some experimental questions, but otherwise simply rather non-scientifically dismissed questions with 'Rome was not built in a day'-type answers, or less. I my view, the authors have disregarded the review process and the effort of three supportive reviewers, which should be part of the permanent record of this paper.

    3. Reviewer #3 (Public Review):

      SUMMARY:

      The manuscript by Bian et al. promotes the idea that creatine is a new neurotransmitter. The authors conduct an impressive combination of mass spectrometry (Fig. 1), genetics (Figs. 2, 3, 6), biochemistry (Figs. 2, 3, 8), immunostaining (Fig. 4), electrophysiology (Figs. 5, 6, 7), and EM (Fig. 8) in order to offer support for the hypothesis that creatine is a CNS neurotransmitter.

      STRENGTHS:

      There are many strengths to this study.

      • The combinatorial approach is a strength. There is no shortage of data in this study.<br /> • The careful consideration of specific criteria that creatine would need to meet in order to be considered a neurotransmitter is a strength.<br /> • The comparison studies that the authors have done in parallel with classical neurotransmitters is helpful.<br /> • Demonstration that creatine has inhibitory effects is another strength.<br /> • The new genetic mutations for Slc6a8 and AGAT are strengths and potentially incredibly helpful for downstream work.

      WEAKNESSES:

      • Some data are indirect. Even though Slc6a8 and AGAT are helpful sentinels for the presence of creatine, they are not creatine themselves. Of note, these molecules themselves are not essential for making the case that creatine is a neurotransmitter.<br /> • Regarding Slc6a8, it seems to work only as a reuptake transporter - not as a transporter into SVs. Therefore, we do not know what the transporter into the TVs is.<br /> • Puzzlingly, Slc6a8 and AGAT are in different cells, setting up the complicated model that creatine is created in one cell type and then processed as a neurotransmitter in another. This matter will likely need to be resolved in future studies.<br /> • No candidate receptor for creatine has been identified postsynaptically. This will likely need to be resolved in future studies.<br /> • Because no candidate receptor has been identified, it is important to fully consider other possibilities for roles of creatine that would explain these observations other than it being a neurotransmitter? There is some attention to this in the Discussion.

      There are several criteria that define a neurotransmitter. The authors nicely delineated many criteria in their discussion, but it is worth it for readers to do the same with their own understanding of the data.

      By this reviewer's understanding (and combining some textbook definitions together) a neurotransmitter: 1) must be present within the presynaptic neuron and stored in vesicles; 2) must be released by depolarization of the presynaptic terminal; 3) must require Ca2+ influx upon depolarization prior to release; 4) must bind specific receptors present on the postsynaptic cell; 5) exogenous transmitter can mimic presynaptic release; 6) there exists a mechanism of removal of the neurotransmitter from the synaptic cleft.

      For a paper to claim that the published work has identified a new neurotransmitter, several of these criteria would be met - and the paper would acknowledge in the discussion which ones have not been met. For this particular paper, this reviewer finds that condition 1 is clearly met.

      Conditions 2 and 3 seem to be met by electrophysiology, but there are caveats here. High KCl stimulation is a blunt instrument that will depolarize absolutely everything in the prep all at once and could result in any number of non-specific biological reactions as a result of K+ rushing into all neurons in the prep. Moreover, the results in 0 Ca2+ are puzzling. For creatine (and for the other neurotransmitters), why is there such a massive uptick in release, even when the extracellular saline is devoid of calcium?

      Condition 4 is not discussed in detail at all. In the discussion, the authors elide the criterion of receptors specified by Purves by inferring that the existence of postsynaptic responses implies the existence of receptors. True, but does it specifically imply the existence of creatinergic receptors? This reviewer does not think that is necessarily the case. The authors should be appropriately circumspect and consider other modes of inhibition that are induced by activation or potentiation of other receptors (e.g., GABAergic or glycinergic).

      Condition 5 may be met, because authors applied exogenous creatine and observed inhibition. However, this is tough to know without understanding the effects of endogenous release of creatine. if they were to test if the absence of creatine caused excess excitation (at putative creatinergic synapses), then that would be supportive of the same. Nicely, Ghirardini et al., 2023 study cited by the reviewers does provide support for this exact notion in pyramidal neurons.

      For condition 6, the authors made a great effort with Slc6a8. This is a very tough criterion to understand or prove for many synapses and neurotransmitters.

      In terms of fundamental neuroscience, the story should be impactful. There are certainly more neurotransmitters out there than currently identified and by textbook criteria, creatine seems to be one of them taking all of the data in this study and others into account.

    1. Author Response

      The following is the authors’ response to the previous reviews

      eLife assessment

      The manuscript offers important findings on the potential influence of maternally derived extracellular vesicles on embryo metabolism. However, while the content is convincing, the title appears to overstate the study's conclusions due to its speculative nature on the DNA transmission and embryo bioenergetics connection. A more measured title would better represent the evidence presented.

      We want to extend our heartfelt appreciation to the editors and reviewers for their invaluable comments on our research. Their feedback has played a crucial role in improving the quality of our manuscript.

      We acknowledge the concern regarding the manuscript's title and are fully open to making modifications. Following the recommendation of Reviewer 2, the proposed new title of the manuscript will be “Vertical transmission of maternal DNA through extracellular vesicles associates with altered embryo bioenergetics during the periconception period.”

      Reviewer #1 (Public Review):

      Q1. Bolumar et al. isolated and characterized EV subpopulations, apoptotic bodies (AB), Microvesicles (MV), and Exosomes (EXO), from endometrial fluid through the female menstrual cycle. By performing DNA sequencing, they found the MVs contain more specific DNA sequences than other EVs, and specifically, more mtDNA were encapsulated in MVs. They also found a reduction of mtDNA content in the human endometrium at the receptive and post-receptive period that is associated with an increase in mitophagy activity in the cells, and a higher mtDNA content in the secreted MVs was found at the same time. Last, they demonstrated that the endometrial Ishikawa cell-derived EVs could be taken by the mouse embryos and resulted in altered embryo metabolism.

      This is a very interesting study and is the first one demonstrating the direct transmission of maternal mtDNA to embryos through EVs.

      A1. Thank you for your kind comments.

      Reviewer #2 (Public Review):

      Q2. In Bolumar, Moncayo-Arlandi et al. the authors explore whether endometrium-derived extracellular vesicles contribute DNA to embryos and therefore influence embryo metabolism and respiration. The manuscript combines techniques for isolating different populations of extracellular vesicles, DNA sequencing, embryo culture, and respiration assays performed on human endometrial samples and mouse embryos.

      Vesicle isolation is technically difficult and therefore collection from human samples is commendable. Also, the influence of maternally derived DNA on the bioenergetics of embryos is unknown and therefore novel. However, several experiments presented in the manuscript fail to reach statistical significance, likely due to the small sample sizes. This manuscript is a good but incomplete start as to the potential function of maternal DNA transfer via vesicles.

      In my opinion the manuscript supports the following of the authors' claims:

      1. Different amounts of nDNA and mtDNA are shed in human endometrial extracellular vesicles during different phases of the menstrual cycle.
      2. Endometrial microvesicles are more enriched for mitochondrial DNA sequences compared to other types of vesicles present in the human samples.
      3. Fluorescently labelled DNA from extracellular vesicles derived from an endometrial adenocarcinoma cell line can be incorporated into hatched mouse embryos.
      4. Culture of mouse embryos with endometrial extracellular vesicles can influence embryo respiration and the effect is greater when cultured with isolated exosomes compared to other isolated microvesicles.

      My main concerns with the manuscript:

      1. Several experiments presented fail to reach statistical significance or are qualitative.
      2. The definitive experiments presented in the manuscript are limited to the transfer of DNA in general not mtDNA. Therefore a strong connection with metabolism is missing, diminishing the significance of the findings.

      A2. We thank you for your detailed feedback. While we acknowledge the reviewer's concerns regarding sample sizes, we emphasize that this study was intentionally designed as a pilot study and was approved by the IRB with a specific sample size to serve as proof of concept. We fully agree that further research is essential for a more comprehensive understanding of the novel biological process described in this manuscript. When this manuscript is finally accepted, we can submit a new IRB application to obtain a larger sample size, allowing us to delve deeper into demonstrating the connection with metabolism

      Recommendations for the authors:

      Reviewer #1 (Recommendations For The Authors):

      Q3. The authors have made significant improvements, and the manuscript now is appropriate for eLife.

      A3. Thank you for your consideration.

      Reviewer #2 (Recommendations For The Authors):

      The authors have made several changes that have improved the manuscript. However, I still have some concerns.

      Q4. The title is still too definitive. Something like "Vertical transmission of maternal DNA through extracellular vesicles is associated with changes in embryo bioenergetics during the periconception period" would be more appropriate.

      A4. As mentioned earlier in the response to the editors, we acknowledge the concerns regarding the manuscript's title.

      Following your recommendation, the proposed new title of the manuscript is “Vertical transmission of maternal DNA through extracellular vesicles associates with altered embryo bioenergetics during the periconception period.”

      Q5. I am confused by the incorporation of the new experiment (supplementary figure 7) where embryos are cultured in free-floating synthesized mtDNA. If these sequences were not encapsulated in vesicles I don't think the experiment is relevant. If they were similarly prepared as in the section "Tagged-DNA production and EV internalization by murine embryos" I stand corrected but please clarify or omit. Otherwise, the new data/figure in response to Q11 showing co-localization of mitochondria and EdU-tagged DNA from MVs from Ishikawa cells is more compelling. However, this doesn't separate the uptake of mtDNA alone from the potential uptake of mitochondria, which this manuscript is not focused on.

      A5. We apologize for any confusion that may have arisen for the reviewer. We conducted this experiment in response to question Q4 posed by the same reviewer, which specifically inquired about the detection of internalized mtDNA by the embryos.

      As previously stated in the revised manuscript, the EdU system does not selectively label mtDNA; instead, it labels any newly synthesized DNA, both nuclear and mitochondrial. We have not found a system that specifically labels mtDNA for subsequent tracing inside EVs or for encapsulation within artificial EVs (which falls outside our expertise). Therefore, we employed labeled mtDNA that we could trace after the embryos' internalization.

      While we acknowledge that this approach is not perfect, it does demonstrate the internalization of mtDNA sequences within the embryo. We have revised the manuscript to eliminate any potential sources of confusion. If the reviewer or editors still have concerns about the experiment's suitability, we are open to removing it from the final version of the manuscript. Please refer to page 9 and lines 234-238 for more details."

    1. Author Response

      The following is the authors’ response to the original reviews.

      General comments:

      To reviewer 1 and 3: The following sentences below were added at the beginning of the result section to clarify that the Gr gene expression analysis was performed using bimodal expression systems and to provide a reference that these expression profiles can generally be expected to represent endogenous Gr expression.

      "Note that this and all previous Gr expression studies were performed using bimodal expression systems, mostly GAL4/UAS, whereby Gr promotors driving GAL4 are assumed to faithfully reproduce expression of the respective Gr genes. Importantly, we analyzed two or more Gr28-GAL4 insertion lines for each transgene, and at least two generated the same expression profiles (Mishra et al., 2018; Thorne and Amrein, 2008) providing evidence that the drivers reflect a fairly accurate expression profile of respective endogenous genes."

      Specific comments:

      Reviewer #1 (Recommendations For The Authors):

      The important chemogenetic behavioral data would benefit from a clearer presentation including a cartoon to explain what the behavior is and how it is scored. Figure 2 is the key figure in this paper and it would be helpful if the figure were reorganized to guide the non-expert reader to the key result. I recommend labeling the positive controls Gr43a as "sweet" and Gr66a as "bitter" and perhaps organize the presentation to have the negative control at the left, then Gr28ba that had no effect, then group Gr28a with Gr43a for positive valence and Gr28bc with Gr66a for negative valence. I'm not sure what the value is of showing both 0.1 mM and 0.5 mM capsaicin, the text does not explain. The experiment in Figure 2B is important but non-experts will not understand what is being done here - can the authors please provide a cartoon like those in Figure 1 showing what cells are being subjected to chemogenetics and how this differs from Figure 2A?

      The reviewer is correct that much can be improved, which we hope to have accomplished with the modifications in Figure 2. We re-organized it to deliver the key result to non-expert readers in an easy way. We added cartoons both explaining how the two-choice preference assays were conducted and indicating which cells express UAS-VR1. The cartoon in Figure 1E and Figure 2A are now directly relatable and should clarify what cells express VR1 (in Figure 2). Positive and negative control experiments using Gr43aGAL4 (a GAL4 knock-in; Miyamoto et al., 2013) and Gr66a-GAL4 are highlighted in the Figure and mentioned upfront in the text to make clear to what the experimental larvae can be compared. We also excluded larvae responses to 0.5 mM capsaicin.

      1. The AlphaFold ligand docking in Figure 8 is conducted with Gr28bc monomers, which are unlikely to be the in vivo relevant structure, given that the related OR/ORCO ancestor structures are tetramers. I recommend that this component of the paper either be removed entirely or that the authors redo the in silico work using the AlphaFold-Multimer package reported by Hassabis and Jumper in 2022 https://www.biorxiv.org/content/10.1101/2021.10.04.463034v2. It will be interesting to see what a tetramer structure looks like with the ligand.

      We tried but were able to use the recommended package. Even if it were, the problem is that we do not know the partner of Gr28b.c. And while it is not clear whether and how extensive changes in the ligand binding pockets occur when using the monomer prediciton vs a multimer package, we followed the reviewer’s suggestion and removed the modeling from the manuscript.

      Minor points:

      1. Line 80: I do not think it is biophysically or biochemically plausible that GRs and IRs would assemble into functional heteromeric channels and suggest that the authors either explain how that would work or remove this speculative comment.

      We have removed this sentence.

      1. Line 246-248: I would tone down the speculation about GR subunit composition - it's still too early days to understand the stoichiometry or the extent that any of the broadly expressed GRs is a co-receptor.

      We did not indulge in the possible stoichiometry of Gr complexes, but merely mention that they are composed in general of two or more Gr subunits, for which clear genetic evidence exists: Up to three different putative bitter Gr genes are necessary to elicit responses to bitter compounds, and at least two putative sugar Gr genes are necessary to restore behavioral responses to any sweet tasting chemicals (sugars). Regardless, we have toned down the language, stating now:

      “Given the multimeric nature of bitter taste receptors (Sung et al., 2017), one possibility is that the absence of a Gr subunit not required for the detection of denatonium (Gr66a) could favor formation of multimeric complexes containing Gr subunits that recognize this compound (Gr28b.a and/or Gr28b.c).”

      1. Line 284: I don't think that co-expression necessarily means that GRs form heteromultimeric channels. It's equally possible that the cell controls subunit assembly to avoid mixing and matching ligand-selective subunits at will. I would tone this down - it's still speculative at this stage. We don't even know yet how this works for OR-Orco, where we do have structures. There is not yet an OR-Orco Cryo-EM structure, so we do not know what the subunit stoichiometry is.

      We are not sure what the reviewer’s concern is. While direct biochemical or biophysical evidence is currently lacking, there is strong genetic evidence for heteromeric composition of Gr complexes, both from studies of bitter and sweet receptors/neurons (see response above). It is likely that intrinsic properties facilitate assembly of certain Grs within a taste receptor complex. We have refrained from any speculation about stoichiometry, though given the relatedness of Grs and Ors, it would not be far-fetched to propose that taste receptor complexes are also tetrameric in nature, which was recently proposed for a homomeric channel of the bombyx mori homolog of Gr43a, BmGr9 (Morinaga et al., 2022).

      1. Line 305: the work of Emily Troemel and Cori Bargmann PMID: 9346234 should be cited in the Discussion. Theirs was the first experiment to show that valence was a feature of the neuron and not the receptor(s) it expresses.

      We have now cited this work in the discussion to acknowledge this important discovery.

      1. Figure 1 - the clarity of the organization of the figure could be improved for non-experts. For instance, can the key for the abbreviations be written out at the right of Figure 1A? Second, it is confusing to talk about DOG/TOG neurons "projecting" to the DO/TO - I think the authors mean dendritic innervation, not axons projecting. Maybe having a diagram that cartoons a closeup of the DOG/TOG neurons and how they innervate the cuticular structures would make this clearer. I struggled to go from the pretty staining at the left of B and C to the schematics at the right that colored in which neurons express which receptors.

      We appreciate these comments regarding clarity and have amended Figure 1 and made necessary changes in the text and the Figure legend.

      1. Figure 3 would benefit from a summary cartoon relating back to the cartoons in Figure 1 to summarize what neurons the authors think are necessary for bitter avoidance.

      We very much appreciate this suggestion and have increased clarity by referring to the carton in Figures 1 and 2.

      1. Figure 4B - the lowercase letters indicating Gr28 subunits that are being expressed under UAS control (bottom row of table "UAS-Gr28") are easily confused for the lowercase letters a, b used throughout to signify significant differences. I recommend that the authors write out the gene names in this figure to clarify the genes in the rescue experiment.

      We changed the text in the Figure accordingly.

      1. For non-experts it would be helpful to have a map of the Gr28 gene locus so that people understand the arrangement of the genes and how the Gal4 driver lines map onto the locus.

      We have now included such a map in Figure 1B.

      Reviewer #2 (Recommendations For The Authors):

      1. In the title and multiple times in the text (e.g. lines 121-122), the authors make the claim that different Gr28 genes mediate opposing behaviors. At first, I was not convinced of this claim, but I now believe it may be warranted if integrating the present results with results from Mishra et al., 2018. In the present study, the authors show that different neurons drive opposing behaviors, but they did not show that the genes themselves mediate opposing behaviors. They show evidence for the role of Gr28bc and Gr28ba in aversion, but not the role of Gr28a in attraction. I was thinking that there could be other receptors in Gr28a-expressing neurons that mediate attraction. However, Mishra et al. showed that mutation of all Gr28 genes abolishes preference for RNA/ribose as well as detection of these compounds by Gr28a+ neurons of the terminal organ, an impairment that could be rescued by expressing Gr28a (although Gr28b genes seem to have similar functions), and the present study shows that the other Gr28 genes are not co-expressed with Gr28a in the terminal organ. Is this the line of reasoning that we must take to come to the conclusion in the title? If so, I don't believe it comes through clearly in the paper.

      We appreciate this observation. We have modified language in the abstract and the introduction to reflect previous reports of Gr28a as an RNA/ribose receptor (Mishra et al., 2018) and its conversation across dipteran insects (Fujii et al., 2023) where we showed that appetitive behavior for RNA can be mediated via the mosquito homologs in transgenic Drosophila larvae. The reviewer is correct in that there are other appetitive neurons, namely those expressing Gr43a, which defines a set distinct from and non-overlapping with Gr28a neurons (Mishra 2018). This additional information is included in the Figure 1, summarizing expression of the Gr28 genes, Gr66a and Gr43a.

      1. The Figure 6 schematic does not show Gr66a+ Gr28- cells as being connected to avoidance behavior. This seems misleading because it seems likely that these cells do promote avoidance (based on known functions of other Gr66a cells). Also, it is not clear what the red dashed line represents.

      The Gr66a neurons are indeed also avoidance mediating, but it is not clear which subgroup of these neurons is necessary. Our analysis in Figure 2 using Gr28b.c driving Kir2.1 suggests that a small subset of Gr66a neurons is sufficient to mediate avoidance. It is, however, possible that other subsets not including Gr28b.c can also mediate avoidance. The figure has been modified accordingly, as has the model in Figure 7.

      1. I would suggest including the description of Figures 7-8 in the Results instead of the Discussion. In Figure 8, it would be helpful to superimpose labels for the transmembrane domains and extracellular/intracellular sides to better interpret the models.

      The modeling was removed from the manuscript (see response above to reviewer 1).

      1. The finding that Gr66a mutants show increased denatonium and quinine avoidance (Figure 4 - figure supplement 1) seems like a non sequitur, as it does not relate to the analysis of Gr28 genes. I support the inclusion of these interesting results, but perhaps it could be stated why this experiment was conducted (e.g. as a positive control).

      We have reworded this section to make clear why Gr66a mutants were tested (possibly being part of a denatonium receptor complex).

      1. An introduction to the nomenclature and gene structure for the Gr28 genes would be helpful. It's not clear how they're all related, e.g. that the Gr28b genes share some exons whereas Gr28a is separate. The Results section alludes to "the high level of similarity between these receptors", and some sort of reference or quantification for this statement would be useful. I also think naming the Gr28b genes with a period (e.g. "Gr28b.c") may be more consistent with the literature.

      We have added the structure of the Gr28 genes in the Figure 1B, which was also a suggestion by reviewer 1, and we have amended the naming of the genes.

      1. Lines 79-80 state "some GRNs express members of both families", but no citation is provided.

      As this sentence was deleted, based on a comment by reviewer 1, this point becomes mute.

      1. There are several typos or grammatical mistakes that the authors may wish to correct (e.g. lines 73, 75, 91, 232, 334, 780, 788).

      We appreciate the reviewer pointing these errors out to us. The mistakes were corrected.

      Reviewer #3 (Recommendations For The Authors):

      • Silencing experiments suggest a role for Gr28bc in the avoidance of quinine (Figure 3), while imaging experiments do not support this role (Figure 5G). An explanation is needed to reconcile these findings.

      The imaging experiments do support a role for Gr28b proteins in quinine detection in the specific TOG GRN used for all live imaging (Figure 5). This GRN in DGr28 larvae has a significantly lower Ca2+ responses to quinine compared to controls. However, the Ca2+ response could not be rescued to wild type levels by supplementing single Gr28b subunits, suggesting multiple Gr28b proteins are present in a quinine specific receptor complex in this GRN. Also note that Ca2+ responses of DGr28 larvae to quinine is not completely abolished, suggesting some redundancy, possible via Gr33a (Apostolopoulou et al., 2014), also supported by DGr28 larvae, which have still a robust avoidance to quinine. We are confident we have been clearer in arguing this point, both the result and especially the discussion section.

      • Silencing experiments specifically targeted neurons expressing Gr28bc and Gr28be (Figure 3). It is important to note why other neurons expressing different members of the Gr28 family were not included in this analysis.

      • Inconsistency is observed in the use of different reagents across the experiments. Specifically, all six Gal4 lines were utilized in the Chemical Activation experiments, while only two lines were employed in the silencing experiments.

      The silencing experiments asked the specific questions as to what neurons are necessary for avoidance of bitter chemicals. Gr28a-GAL4 and Gr28b.a-GAL4 neurons were omitted because the former mediate feeding preference and not avoidance, and the latter is expressed in the same neurons as Gr28b.e (Figure 1). The remaining two Gr28b genes, Gr28b.b-GAL4 and Gr28b.d-GAL4 are not expressed in the larval taste system (Mishra et al., 2018) as we stated in the introduction/result section, and they were therefore not included in the chemogenetic or Kir2.1 inactivation experiments. We included these genes in rescue experiments, simply to test whether or not they can restore function for sensing denatonium.

      As for the chemogenetic activation experiments: two of the GAL4 lines are controls (Gr66a-GAL4 and Gr43GAL4), that were needed to show what can be expected from these experiments.

      • The authors did not acknowledge that neurons expressing members of the GR28 family also express other Gr family members, which could potentially contribute to the detection and behavioral responses to the tested bitter compounds.

      We believe we did, but we have made that much more explicit in the revised manuscript.

      • Gal4 lines from various studies exhibit varying expression patterns, highlighting the necessity for improved reagents. These findings also suggest the importance of employing different Gal4 lines for each receptor to validate the results of the current study.

      See response at the beginning of our rebuttal.

      • Activating or silencing neurons pertains to the function of the neurons rather than the receptors.

      We agree and nothing in the manuscript states otherwise.

    1. Reviewer #2 (Public Review):

      Summary:

      This manuscript describes P. falciparum population structure in Zanzibar and mainland Tanzania. 282 samples were typed using molecular inversion probes. The manuscript is overall well-written and shows a clear population structure. It follows a similar manuscript published earlier this year, which typed a similar number of samples collected mostly in the same sites around the same time. The current manuscript extends this work by including a large number of samples from coastal Tanzania, and by including clinical samples, allowing for a comparison with asymptomatic samples.

      The two studies made overall very similar findings, including strong small-scale population structure, related infections on Zanzibar and the mainland, near-clonal expansion on Pemba, and frequency of markers of drug resistance. Despite these similarities, the previous study is mentioned a single time in the discussion (in contrast, the previous research from the authors of the current study is more thoroughly discussed). The authors missed an opportunity here to highlight the similar findings of the two studies.

      Strengths:

      The overall results show a clear pattern of population structure. The finding of highly related infections detected in close proximity shows local transmission and can possibly be leveraged for targeted control.

      Weaknesses:

      A number of points need clarification:

      It is overall quite challenging to keep track of the number of samples analyzed. I believe the number of samples used to study population structure was 282 (line 141), thus this number should be included in the abstract rather than 391. It is unclear where the number 232 on line 205 comes from, I failed to deduct this number from supplementary table 1.

      Also, Table 1 and Supplementary Table 1 should be swapped. It is more important for the reader to know the number of samples included in the analysis (as given in Supplementary Table 1) than the number collected. Possibly, the two tables could be combined in a clever way.

      Methods<br /> The authors took the somewhat unusual decision to apply K-means clustering to GPS coordinates to determine how to combine their data into a cluster. There is an obvious cluster on Pemba islands and three clusters on Unguja. Based on the map, I assume that one of these three clusters is mostly urban, while the other two are more rural. It would be helpful to have a bit more information about that in the methods. See also comments on maps in Figures 1 and 2 below.

      Following this point, in Supplemental Figure 5 I fail to see an inflection point at K=4. If there is one, it will be so weak that it is hardly informative. I think selecting 4 clusters in Zanzibar is fine, but the justification based on this figure is unclear.

      For the drug resistance loci, it is stated that "we further removed SNPs with less than 0.005 population frequency." Was the denominator for this analysis the entire population, or were Zanzibar and mainland samples assessed separately? If the latter, as for all markers <200 samples were typed per site, there could not be a meaningful way of applying this threshold. Given data were available for 200-300 samples for each marker, does this simply mean that each SNP needed to be present twice?

      Discussion:<br /> I was a bit surprised to read the following statement, given Zanzibar is one of the few places that has an effective reactive case detection program in place: "Thus, directly targeting local malaria transmission, including the asymptomatic reservoir which contributes to sustained transmission (Barry et al., 2021; Sumner et al., 2021), may be an important focus for ultimately achieving malaria control in the archipelago (Björkman & Morris, 2020)." I think the current RACD program should be mentioned and referenced. A number of studies have investigated this program.

      The discussion states that "In Zanzibar, we see this both within and between shehias, suggesting that parasite gene flow occurs over both short and long distances." I think the term 'long distances' should be better defined. Figure 4 shows that highly related infections rarely span beyond 20-30 km. In many epidemiological studies, this would still be considered short distances.

      Lines 330-331: "Polymorphisms associated with artemisinin resistance did not appear in this population." Do you refer to background mutations here? Otherwise, the sentence seems to repeat lines 324. Please clarify.

      Line 344: The opinion paper by Bousema et al. in 2012 was followed by a field trial in Kenya (Bousema et al, 2016) that found that targeting hotspots did NOT have an impact beyond the actual hotspot. This (and other) more recent finding needs to be considered when arguing for hotspot-targeted interventions in Zanzibar.

      Figures and Tables:<br /> Table 2: Why not enter '0' if a mutation was not detected? 'ND' is somewhat confusing, as the prevalence is indeed 0%.

      Figure 1: Panel A is very hard to read. I don't think there is a meaningful way to display a 3D-panel in 2D. Two panels showing PC1 vs. PC2 and PC1 vs. PC3 would be better. I also believe the legend 'PC2' is placed in the wrong position (along the Y-axis of panel 2).

      Supplementary Figure 2B suffers from the same issue.

      The maps for Figures 1 and 2 don't correspond. Assuming Kati represents cluster 4 in Figure 2, the name is put in the wrong position. If the grouping of shehias is different between the Figures, please add an explanation of why this is.

      Figure 2: In the main panel, please clarify what the lines indicate (median and quartiles?). It is very difficult to see anything except the outliers. I wonder whether another way of displaying these data would be clearer. Maybe a table with medians and confidence intervals would be better (or that data could be added to the plots). The current plots might be misleading as they are dominated by outliers.

      In the insert, the cluster number should not only be given as a color code but also added to the map. The current version will be impossible to read for people with color vision impairment, and it is confusing for any reader as the numbers don't appear to follow any logic (e.g. north to south).

      The legend for Figure 3 is difficult to follow. I do not understand what the difference in binning was in panels A and B compared to C.

      Font sizes for panel C differ, and it is not aligned with the other panels.

      Why is Kusini included in Supplemental Figure 4, but not in Figure 1?

      Supplemental Figures 6 and 7: What does the width of the line indicate?

      What was the motivation not to put these lines on the map, as in Figure 4A? This might make it easier to interpret the data.

    1. Note: This response was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reviewer #1:

      Comment: The author investigated the role of the stress sensor pathway in the mechanism of tumor cell survival<br /> They identified a long noncoding RNA as JUNI that regulates antagonizing MAP phosphatase and favors the JUN transcription. JUNI correlated with the survival of several cancer histotypes, particularly in RCC, as a highly specific and correlated prognosis.

      The abstract although not always required from the journal should be divided into methods used to reach the main findings and clear presentation of results

      Response: We do not know yet to which Journal the paper will be sent. The format will be adjusted to the Journal requirements.

      it is unclear whether JUNI is a positive or negative regulator of JUI (I assume the reviewer meant JUN)

      Response: The text in the abstract was changed to” JUNI positively regulates the expression of its neighboring gene JUN, a key transducer of signals that regulate multiple transcriptional outputs.”

      Hope it is clearer now

      When the author indicates that JUNI antagonizes MAP PHOSPHATASE is not correct the term antagonism is related to receptors but the authors did not show any receptor.

      Response: The term "antagonism" does not only refer to receptor drugs. In pharmacology, antagonism generally describes the interaction between a drug (or other molecule) and a receptor or biological target that results in the inhibition or blocking of the receptor's activity. However, this concept can extend beyond receptor drugs and apply to various biological interactions.

      Outside of the realm of drugs and receptors, antagonism can also refer to antagonistic relationships between different biological processes, molecules, or organisms.

      Overall, while antagonism is commonly discussed in the context of receptor drugs, the concept of antagonism can apply to a broader range of interactions in biology and other fields.

      Response: The p values for the prognostic values of JUNI and DUSP14 in RCC were added to the abstract.

      Generally, Jun oncogene correlated with poor overall survival while the table indicates promote survival so good prognosis?

      Response: This manuscript describes for the first time the biological activity and cancer relevance of JUNI. It positively regulates stress induced c-Jun and can be used as prognostic marker in ccRCC.

      The significance of JUNI and its interactome in ccRCC prognosis is unequivocal, according to data analysis of cancer relevant data (TCGA) regardless to its effects on c-Jun. The concern raised by reviewer 1 and 2 is whether the cancer-relevant effects are mediated by c-Jun regulation. We suggest that despite regulating stress induced c-Jun, they are not! This suggestion is based on three points: 1. We show in the manuscript that a large portion of JUNI dependent effects on cellular survival activity is c-Jun independent. 2. We describe many interacting proteins that may, in a JUN-independent manner, affect tumorigenesis. 3. In this study we examined JUNI’s functions which are cell-autonomous. However, neither the non -autonomous effects nor effects on cells that compose the tumor environment were studied. Reports that lncRNAs may have a role in immune responses and high expression of JUNI in CD8 cells may suggest this direction for future investigation (Carpenter, S et al. science, 341(6147), pp.789-792; Mickaël, M. et al https://doi.org/10.1101/2021.12.01.470587)

      Therefore, we assume that direct correlations in every biological activity between JUNI and JUN is an over simplified consumption. Analogy for that can be found with another major regulator of c-Jun, JNK, which is stress induced, c-Jun regulator involved in stress-induced cell death, whereas c-Jun itself is contributing in many cases to drug resistance.

      The introduction contains the main information to follow the role of JUN and renal carcinoma<br /> However, should be improved with background on the key role of stress genes in the pro-survival pathway of tumors during progression and hypoxia condition. Too many references on long noncoding compared to the JUN complex with AP-1 and transformation

      Response: A section describing the major stress pathway in ccRCC, HIF 1 and its role in ccrCC was added. Due to the limitation of word count in most journals we cannot expend this section further

      Results In Figure 1 the authors showed expression levels of JUNI and JUN that are clearly different after UV stimuli. they demonstrate that are both regulated by UV but the amount and the time are different. the author should comment on these data if they want to study the regulative mechanism

      Response: The following comment was added at the end of the first section: Overall, these results suggested that JUNI is a stress-induced gene whose expression pattern resembles that of JUN, therefore, we investigated the potential existence of regulatory effects between the two genes, especially post exposure of cells to stress.

      Figure 1 F the cellular distribution of JUNI which is the rational of this experiment to provide that is into nucleus while normally is into the cytoplasm? What adds this experiment?

      Response: This is the first reported description of JUNI. We attempted to characterize it as much as possible. It’s localization was not described previously and we suggest that it is mainly nuclear. A novel important information that should be presented.

      In Figure 2 the authors provided that the kinase pathway is important for Jun regulation but the effect on JUNI a Luciferase assay needs to be provided

      Response: We respectfully disagree with the reviewer. We believe that examining the expression from a DNA fragment identical to the endogenous one is superior to artificial system, such as luciferase.

      In Figure 3 for Migration assay is necessary to see cells on the other side of the filter by staining not a graphical representation

      Response: The graphical representation is an accumulated result of at least 3 experiment. However, a figure representing a single experiment was added as a supplement figure s1.

      The experiment on kinase does not add any data to what is already known on jun probably should be shifted in Figure 6

      Response: We apologize, this question was not fully understood as there is no experiment on kinase in figure 3. If case the reviewer was referring to kinase inhibition in Fig 2A we do think it is needed as a positive control for the kinases activity.

      Table 1 is cited two times once in the context of Figure 3 and then in Figure 6 indicating that the authors go forward and back on their experimental design

      Response: Table 1 is indeed referred to in two places. It is first mentioned when we investigated the potential relevance of JUNI for human cancer, given its regulatory impact on the neighboring JUN gene and its influence on motility. Later, the types of cancers described in figure 1 were further processed in order to examine relations between JUNI and DUSP14 in human cancer. We do not see it as a flaw in experimental design but rather as further evolution of the story based on data discovered in earlier stages.

      in figure 4 the apoptotic cells are not clearly visible a specific staining marker is necessary to provide the phenomenon

      Response: Two corrections were made to demonstrate apoptosis clearly. The pictures in Figure 4 panel A were replaced with a better-quality image with addition of DNA staining to demonstrate the cell death clearer, appearance of cell blebbing and nuclear fragmentation. Panel B demonstrating increase in cleaved caspase 3 in JUNI silenced cells after all treatment was added.

      Additionally XTT assay should be reported as the percentage of survival cells not staining incorporated compared to untreated cells over time

      Response: We do apologize for the legend omission, but XTT assays, colonies formation and soft agar colonies formation are presented in Figure 4 H-J and Figure S3 for all cell lines

      The data on prognosis and correlation of gene expression are not clearly presented and discussed

      Response: Figure S4 was replaced by table S3 to demonstrate clearer the differences in Medians survival caused by JUNI of DUSP 14. Text was changed in the last section of results.

      The western blot need to be quantified

      Response: All blots were quantified

      Reviewer #2:

      1. While the experimental data showed JUNI, like c-JUN, is pro-survival of cancer cells, the clinical sample analyses correlated it positively with patients' survival. This discrepancy casts doubts in significance of the findings. The authors need to re-evaluate their data and conclusion

      Response: This manuscript describes for the first time the biological activity and cancer relevance of JUNI. It positively regulates stress induced c-Jun and can be used as prognostic marker in ccRCC.

      The significance of JUNI and its interactome in ccRCC prognosis is unequivocal, according to data analysis of cancer relevant data (TCGA) regardless to its effects on c-Jun. The concern raised by reviewer 1 and 2 is whether the cancer-relevant effects are mediated by c-Jun regulation. We suggest that despite regulating stress induced c-Jun, they are not! This suggestion is based on three points: 1. We show in the manuscript that a large portion of JUNI dependent effects on cellular survival activity is c-Jun independent. 2. We describe many interacting proteins that may, in a JUN-independent manner, affect tumorigenesis. 3. In this study we examined JUNI’s functions which are cell-autonomous. However, neither the non -autonomous effects nor effects on cells that compose the tumor environment were studied. Reports that lncRNAs may have a role in immune responses and high expression of JUNI in CD8 cells may suggest this direction for future investigation (Carpenter, S et al. science, 341(6147), pp.789-792; Mickaël, M. et al https://doi.org/10.1101/2021.12.01.470587)

      Therefore, we assume that direct correlations in every biological activity between JUNI and JUN is an over simplified consumption. Analogy for that can be found with another major regulator of c-Jun, JNK, which is stress induced, c-Jun regulator involved in stress-induced cell death, whereas c-Jun itself is contributing in many cases to drug resistance.

      Response: The Western blotting data need at least triplicate biological experiments and quantification. This is particularly important for trivial differences, such as shown in Fig. 6.

      Response: All westerns X=3. Representative experiments are depicted. Quantification was added.

      The identification and gene structure of LINC01135 and its relevance to c-Jun need better clarity

      Response: First result section. “According to ENCODE data, JUNI contains five main exons and has multiple isoforms. Twenty-seven different transcript isoforms were described according to LNCipedia ranging from 213 to 6213 bases {Volders, 2019 #2907}. The relevance to c-Jun was referred to in discussion: Both the effects of JUNI on c-Jun induction and cellular survival were demonstrated using under-expression conditions by targeting, the common, first, exon of JUNI. Nevertheless, this exon was also sufficient for c-Jun induction upon stress exposure, under conditions of overexpression.

      Page 9-10, Line 198-199, there are no results in Fig. 1 showing that JUNI induction was dependent to serum stimulation of starved cells

      Response: “ Similar to JUN, the induction was dose dependent (Fig 1C), and the rapid response to stress (Fig 1D) as well as to serum stimulation of starved cells, identified by others (36), qualifies it as an “immediate early” lncRNA.”

      Serum stimulation is described in reference 36

      What is the Y-axis in figures 2B, 4E-G

      Response: Legend was added to Y-axis of Figures 2B and 4 E-G

      In Fig. 3B, actin image is missing

      Response: Actin was hidden in the graphic process. Corrected.

      In Fig. 4. brightfield images are inaccurate for distinguishing apoptosis and necrosis. Additional molecular markers need to be used, such as caspase-3 cleavage and LDH release

      Response: Two corrections were made to demonstrate apoptosis clearly. The pictures in Figure 4 panel A were replaced with a better-quality image with addition of DNA staining to demonstrate the cell death clearer, appearance of cell blebbing and nuclear fragmentation. Panel B demonstrating increase in cleaved caspase 3 in JUNI silenced cells after all treatment was added.

      The inconsistency of using four cell types in each assay. For example, in Fig. 4A, B, E-G and Suppl Fig. 1, HMCB, MDA-MB-231 and CHL1 cells were used to test the short-term effect of JUNI knockdown on cell survival, whereas Hela, MDA-MB-231 and CHL1 cells were chosen to determine the long-term effect of JUNI knockdown. Similar case in other figures.

      Response: Effects on Jun regulation and the effects on long term survival were tested in all four cell lines both by XTT and clonogenic assays whereas effects on short term survival were tested in three out of the four cell lines. It is practically impossible to perform a study of this magnitude were all assays were tested in all cell lines. Using four cell lines was applied to prove the major points.

      In Fig. 5D, no difference of c-Jun expression between NS and siJUN groups

      Response: Correct, the western in 5D was replaced by a more representative one

      Cell survival in Fig. 5 lacked statistical analyses

      Response: Error bars were mistakably omitted. The figure was corrected.

      In Suppl Fig. 2C, there is no figure to show the reduced colonies formation in soft agar in MDA-MB-231 cells, contradicting to that stated in the manuscript

      Response: Indeed Figure 4 J and S3 C presented colonies formation in HMCB and HeLa cells. The text was corrected.

      Reviewer #3: "linc01135" - this is a human gene, should be capitalized

      Response: linc01135 was capitalized

      Please indicate primers in Fig1A and mention this in relevant part of Results

      Response: The following section was added: “Importantly, ENCODE predicts that the first exon is shared by all, therefore, all primers to analyze JUNI’s expression as well as siRNAs to silence it, were targeted for this exon.

      Fig1C-F - please add a legend to explain the colors

      Response: Legend was added into the Figure as well

      Copy number: It is important to establish the approximate copy number of JUNI RNAs in the cell lines tested. FISH would be one appropriate method. This could also be referenced back to the RNA-seq TPM values. Are we talking about <1 copy /cell, or many? Quick inspection of ENCODE RNA-seq in the UCSC browser suggest an intermediate value that varies between cell lines. This value is very important when interpreting mechanistic experiments later on

      Response: The copy number in HMCB and MDA-MB-231 was calculated by comparison of CT values obtained from RNAs from a known number of cells relative to calibration curve of known concentrations of JUNI. The following section was added to the first paragraph of the results: “quantitation of JUNI’s copy number in untreated HMCB and MBA-MD-231 cells revealed the presence of minimal amount of about 8 copies per cell”

      Fig3 - again, no figure legends, difficult for reader

      Response: Legend was added to Fig. 3A

      In general, the figures could be much more clearly annotated and presented with more care. They do not do justice to the quality of the work itself. For example, Fig4E-G why not label each panel with the time course, the cell line tested etc etc to save us the work of digging through the Legends?

      Response: We thank the reviewer for this remark. All figures were corrected, legends and proteins quantification was added.

      Rescue experiments: The rescue experiments in Fig5D are nicely done and the results are interesting. However, I would request the authors to perform similar experiments with JUNI rescue. Specifically, to knock down JUNI with siRNA, and then reintroduce it from an 'immune' expression plasmid, where the siRNA site is mutated. This will further strengthen the claim that JUNI siRNA is acting through the intended target to cause observed effects on cell viability

      Response: As the effects on survival are strongest in the longer term, 14 days after silencing, rescue experiments were performed to test the rescue in the survival of HMCB and HeLa cells using clonogenic assays. Results are presented in figure 4 L

      IncPrint data: was Jun protein found to be an interactor? This might be mentioned in the text, whether it is yes or no

      Response: c-Jun was screened and did not interact with JUNI. The text was changed as following” Interestingly, c-Jun itself does not interact with JUNI (Table S2, Normalized luciferase intensity MS2, RLU =0.44). By contrast, the dual specificity protein phosphatase 14….”

      Expression: A key issue is the expression of JUNI in healthy and diseased cells and organs. Is JUNI ubiquitous (and essential to both healthy and tumor cells), or is it specific to tumor cells? Which tumor types? This would be straightforward to find out from public data. I would suggest a main figure panel. Also, is JUNI upregulated across tumors? Could find this out from GEPIA2 or other databases.

      Response: Figure 7E describing the levels of JUNI in variety of normal and tumor samples was added.

      Non-tumor cells: Like many studies, this one focusses on effect of LOF in transformed cells. However, therapeutic relevance is tied to specific effect in transformed cells. Therefore I believe the paper would be vastly strengthened, if knockdowns+viability assays were also performed in some non-transformed cells. Eg HEK293, immortalised fibroblasts, RPE1 etc

      Response: Indeed discrimination between Normal and cancer cells is an essential point for further research and translation. We examined the affects of silencing on spontaneously immortalized keratinocytes, HaCat cells, and the results are depicted in Figure 4 K.

      Alternative reagents: The siRNA experiments are well performed with two independent sequences. An important additional experiment would be to replicate these experiments with antisense oligonucleotides. This would both further strengthen the confidence in experiments, and open more lines of potential therapies. This experiment I would consider optional

      Response: Stable CRISPR can not be formed. We are currently constructing inducible CRISPR but the construction consumes longer time than the scope of this revision.

      Advanced models: All the present experiments are performed in monolayer cell lines. The authors will no doubt be aware that the paper would be substantially strenghtened if functional experiments could be replicated in more advanced models: spheroids, PDX, explants, mice...

      Response: We examined the protective role of JUNI in Doxorubicin treated spheroids of HMCB and CHL1 cells. The results are depicted in figure 4 D and E.

    1. For an example of public shaming, we can look at late-night TV host Jimmy Kimmel’s annual Halloween prank, where he has parents film their children as they tell the parents tell the children that the parents ate all the kids’ Halloween candy. Parents post these videos online, where viewers are intended to laugh at the distress, despair, and sense of betrayal the children express. I will not link to these videos which I find horrible, but instead link you to these articles:

      It may be just a prank for parents to take away their children's candy, but it can be devastating to a child's young mind and heart, and I don't think it's ethical for adults to use methods used to please adults to be applied to small children

    1. Author Response

      The following is the authors’ response to the original reviews.

      Thank you for the e-mail of 27th September that includes the eLife assessment and reviewers comments on manuscript eLife-RP-RA-2023-91861. We have considered these, added additional data and made various changes to the text as detailed below. We now submit a modified version that we would be happy to view as the ‘Version of Record’.

      We are very pleased to note the highly positive reports from the reviewers. The major change we have made is to alter the Introduction to include further consideration of the development of the ‘bar-code’ hypothesis. As highlighted by reviewer 2 the Lefkowitz/Duke University Group have been major proponents of this concept. However, as with many topics their views did not emerge in isolation. Indeed we (specifically Tobin) were developing similar ideas in the same period (see Tobin et al., (2008) Trends Pharmacol Sci 29, 413-420). Moreover, other groups, particularly that of Clark and collaborators at University of Texas, were developing similar ideas using the beta2-adrenoceptor as a model at least as early as this (e.g. Tran et al., (2004) Mol Pharmacol 65, 196-206). As such we have re-written parts of the Introduction to reflect these early studies whilst retaining information on more recent studies that have greatly expanded such early work. This has resulted in the addition of extra references and re-numbering of the Reference section. We have also provided statistical analysis of agonist-induced arrestin interactions with the receptor as requested by a reviewer and performed additional studies to assess the effect of the GRK2/3 inhibitor in agonist-regulation of phosphorylation of the hFFA2-DREADD receptor. This has led to an additional author (Aisha M. Abdelmalik) being added to the paper.

      To address first the ‘public reviews’

      Reviewer 1

      1. We agree that we do not at this point explore the implications of the tissue specific barcoding we observe and report. However, as noted by the reviewer these will be studies for the future.

      2. The question of why these are only 2 widely expressed arrestins and very many GPCRs is not one we attempt to address here and groups using various arrestin ‘conformation’ sensors are probably much better placed to do so than we are.

      Reviewer 2

      1. It is difficult to address the potential low level of ‘background’ staining in some of the immunocytochemical images versus the ‘cleaner’ background in some of the immunoblotting images. The methods and techniques used are very distinct. However, it should be apparent that the immunoblotting studies are performed (both using cell lines and tissues) post-immunoprecipitation and this is likely to reduce such background to a minimum. This is obviously not the case in the immunocytochemical studies. It is also likely, even though the antisera are immune-selected against the peptide target, there may be some level of immune-recognition this is not limited to the phosphorylated residues.

      2. Whilst this reviewer has commented in detail in the ‘recommendations’ section on the use of English, the other reviewers have not, and we do not find the manuscript challenging to follow or read.

      Reviewer 3

      1. We agree that the mass-spectrometry presented is not quantitative. The intention was for the mass spec to be a guide for the development of the antisera used in the study. We have re-written the initial part of the Results section (page 7) to state that phosphorylation of Ser297 was evident in the basal and agonist-stimulated receptor whilst phosphorylation of Ser296 was only evident following agonist addition.

      2. Immunoblotting is intrinsically variable as parameters of antiserum titre in re-used samples is not assessed and although we are aware that FFA2 displays a degree of constitutive activity (see for example Hudson et al., (2012) J Biol Chem. 287(49):41195-209) we did not make any specific effort to supress this by, for example, including an inverse agonist ligand. Agonist-regulation of phosphorylation of the receptor, as detected in cell lines by the anti- pThr306/pThr310antiserum, is exceptionally clear cut in all the images displayed, and as we note for the pSer296/pSer297 antiserum this was always, in part, agonist-independent.

      The point about compound 101 not being tested directly in the immunoblotting studies performed on the cell line-expressed receptor is a good one. We have now performed such studies which are shown as Figure 2E. These illustrate that the GRK2/3 inhibitor compound 101 does not reduce substantially agonist-induced phosphorylation of the receptor at least as detected by the pThr306/pThr310antiserum or by the pSer296/pSer297 antiserum. Equally this compound had little effect on recognition of the receptor. As the PD2 mutations which correspond to the targets for the pThr306/pThr310antiserum have no significant effect on recruitment of arrestin 3 in response to MOMBA (please see additional statistical analysis in modified Figure 2C) this is perhaps not surprising. Moreover, the PD1 mutations that correspond to the pSer296/pSer297antiserum also, in isolation, only have a partial effect of MOMBA-induced interactions with arrestin 3.

      1. The use of phosphatase inhibitors is an integral part of these studies. As noted in Materials we used PhosSTOP (Roche, 4906837001). However, we failed to make it sufficiently clear that this reagent was present throughput sample preparation for both cell lines and tissue studies. This had been specified previously by two of us (SS, FN, see Fritzwanker S, Nagel F, Kliewer A, Stammer V, Schulz S. In situ visualization of opioid and cannabinoid drug effects using phosphosite-specific GPCR antibodies. Commun Biol. 6, 419 (2023)) but we agree this was insufficient and we now correct this oversight by making this explicit in Results.

      Recommendations

      Reviewer 1

      Competing interest: We apologise for this typographic error. It is now corrected.

      Figures: We have upgraded the figure images to 300dpi and this markedly improves readability

      Reviewer 2

      Revisiting writing: We thank the reviewer for their assessment of the text. However, we do not feel that ‘every sentence in the entire manuscript could be clarified’ is a reasonable statement. Neither of the other reviewers commented on this. Each of the authors read and approved the manuscript.

      Figures: see response to Reviewer 1. We have greatly enhanced image quality at this part of the process.

      Statistics on Figure 2: We apologise for this oversight. Although there were no significant differences in potency for MOMBA to promote interactions with arrestin-3 to each of the PD mutants versus wild type receptor, there were in terms of maximal effect. Statistical analysis was performed via one-way ANOVA followed by Dunnett’s multiple comparisons test. This is now detailed directly in Figure 2C and its associated legend. As noted by the reviewer there was indeed a highly significant effect of the GRK2/3 inhibitor compound 101 and this is now also noted in Figure 2D and its associated legend.

      Units on page 9: pEC50 is considered as Molar by default but we have now specified this. PD1-4: It would be cumbersome to write out (and to read) 8 mutations that make up PD1-4 and hence we think this is specified appropriately in the Figure.

      Reviewer 3

      1. Mass spec: Please see comment point 1 to reviewer 3.

      2. Immunoblotting and compound 101: We have done so.

      3. Phosphatase inhibition: see public comments, reviewer 3.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1 (Public Review):

      The paper offers some potentially interesting insight into the allosteric communication pathways of the CTFR protein. A mutation to this protein can cause cystic fibrosis and both synthetic and endogenous ligands exert allosteric control of the function of this pivotal enzyme. The current study utilizes Gaussian Network Models (GNMs) of various substrate and mutational states of CFTR to quantify and characterize the role of individual residues in contributing to two main quantities that the authors deem important for allostery: transfer entropy (TE) and cross correlation. I found the TE of the Apo system and the corresponding statistical analysis particularly compelling. I found it difficult, however, to assess the limitations of the chosen model (GNM) and thus the degree of confidence I should have in the results. This mainly stems from a lack of a proposed mechanism by which allostery is achieved in the protein. Proposing a mechanism and presenting logical alternatives in the introduction would greatly benefit this manuscript. It would also allow the authors to place the allosteric mechanism of this protein in the broader context of protein allostery.

      As detailed below, we went to great lengths to address these concerns, with an emphasis on the limitations of the model and a proposed mechanism. These revisions should hopefully warrant a re-evaluation of our manuscript.

      Reviewer #1 (Recommendations For The Authors):

      1. It would greatly benefit the paper to state a proposed mechanism by which allostery is achieved in this protein. Is this through ensemble selection, ensemble induction, or a purely dynamic mechanism? What is the rationale for choosing the proposed mechanism and what are reasonable alternative mechanisms? How does this mechanism fit in the broader context of protein allostery?

      Following this comment, we added a VERY extensive description of the proposed mechanism by which allostery is achieved in CFTR and present the rationale for choosing this mechanism (lines 445-97 and Figure 7). Briefly, based on previous experimental results and our results we propose that no single model can explain allostery in CFTR, and that its allosteric mechanism is a combination of induced fit, ensemble selection, and a dynamic mechanism.

      1. With a proposed mechanism in place, the choice of a GNM to investigate the mechanism and eliminate alternative mechanisms should be rationalized.

      The rational for choosing GNM (and ANM-LD) to study the proposed mechanism is now given in lines 498-510. Please note however, that as mentioned in the response to point 1 (and detailed in lines 445-97), the choice of allosteric mechanism, and ruling out other alternatives was not based solely on GNM and ANM-LD, but also on previous experimental results.

      1. A discussion of the strengths and limitations of the GNM are pivotal to understanding the limitations of the results shown. How sensitive are the results to specific details of the model(s)?

      a. A discussion of the strengths and limitations of the GNM have been added to the introduction. Please see lines 107-122.

      b. Sensitivity of the results to the specific details of GNM:

      GNM uses two parameters: the force constant of harmonic interactions and the cutoff distance within which the existence of the interactions is considered. The force constant is uniform for all interactions and is taken as unity. Its value affects only the absolute values of the fluctuations (i.e., their scale) but not their distribution. As we are only looking at fluctuations in relative terms our results are insensitive to its value. GNM uses a cutoff distance of 7-10 Å in which interactions are considered (10 Å used in this study). To test the sensitivity of the results to the cutoff distance we repeated the calculations using 7 Å. As now discussed in lines 170-73 and shown in Figure S2 the results remained largely unchanged.

      c. Sensitivity of the results to the specific details of TE: To identify cause-and-effect relations TE introduces a time delay (τ) between the movement of residues. The choice of τ is important: when τ is too small, only local cause-and-effect relations (between adjacent amino acids) will be revealed. if τ is too big, few (if any) cause-and-effect relations will manifest. This is analogous to the effects of a stone throne into a lake: look too soon, before the stone hits the water, and you’ll see no ripples. Look too late, the ripples will have already subsided. In a previous work (PMID 32320672), we studied in detail the effects of choosing different τ values and found that an optimal value of τ which maximizes the degree of collectivities of net TE values is in most cases 3× τopt (τopt is the time window in which the total TE of residues is maximized). Details of how τ was chosen were added to the methods section.

      In general, the limitations of the chosen model(s) is difficult to determine from the current manuscript because it is devoid of details of the model. While I understand that GNMs have been widely used to study protein systems, the specifics of the model are central to the current work and thus should be provided somewhere in the manuscript.

      a. As mentioned in our response above, the limitations of GNM are now presented (lines 107-122).

      b. The specifics of the model are now given in more detail in the methods section.

      c. In addition, as mentioned above, the results are largely independent of the values of the model’s parameters.

      b. Would changing the force constants to a more anisotropic model qualitatively change the results?

      a. GNM assumes isotropic fluctuations, and the calculations are based on this assumption. Therefore, GNM is inherently an isotropic model.

      b. Importantly, we complement the GNM-TE calculations with ANM-LD simulations, which predict the normal modes in 3D using an anisotropic network model.

      1. How repeatable is the difference between no ATP bound and ATP bound CFTR? I worry that the differences in TE in Figures 1 and 3A are mainly due to two different crystallization conditions. Is there evidence that two different structures of the same protein in the same ligand state lead to small changes in TE?

      To address this concern, we repeated the calculations using the structures of the ATP-free and bound forms of zebrafish CFTR. As now explained in text (lines 298-303) and shown in Figure S8 the effects of ATP are highly repeatable.

      1. Collective modes - why should we expect allostery to be in the most collective modes? Let alone the 10 most? Why not do a mode by mode analysis? Why, for example, were two modes removed page 9 first full paragraph?

      a. Collective modes: We have erroneously referred to the slow modes as collective modes. This has now been corrected throughout the manuscript.

      b. Let alone the 10 most?

      c. why should we expect allostery to be in the most collective modes? Residues that are allosterically coupled are expected to display correlated motions. The slow modes (formerly referred to as “collective modes”) are generally the most collective ones, i.e., display the greatest degree of concerted motions. We therefore expect these modes to contain the allosteric information.

      d. Furthermore, as now explained in the text (lines 163-69) and in Figure S1 the Eigenvalue decays of ATP-free and -bound CFTR demonstrate that the 10 slowest GNM modes sufficiently represent the entire dynamic spectrum (the distribution converges after the 10th slow mode).

      e. Why not do a mode by mode analysis? It is entirely possible to do a mode-by-mode analysis. However, our view is that the allosteric dynamics of a protein is best represented by an ensemble of modes, rather than by individual ones. We found (as detailed here PMID 32320672) that it is more informative to first use the complete set of modes that encompasses the dynamics (the 10 slowest modes in our case) and then gradually remove the dominant modes.

      f. As explained in text (lines 254-7) and more elaborately in our previous work (PMID 35644497), the large amplitude of the slowest modes may hide the presence of “faster” modes that may nevertheless be of functional importance. Removal of the 1-2 slowest modes often helps reveal such modes.

      g. Why, for example, were two modes removed page 9 first full paragraph? As explained for the ATP-free form (lines 257-60), removal of these two slowest modes allowed the “surfacing” of dynamic features which were hidden before. We propose that these dynamic features are functionally relevant (see lines 304-19). Removal of other modes did not provide additional insight.

      Minor issues:<br /> 1. Statements like "see shortly below" should be made more specific (or removed completely).

      Corrected as suggested

      1. "interfered" should be "inferred" page 10 middle of the first full paragraph

      Corrected as suggested

      1. End parenthesis after "(for an excellent explanation about the correlation between TE and allostery see (41)." Page 4 middle of first full paragraph

      Corrected as suggested

      Reviewer #2 (Public Review):

      In this study, the authors used ANM-LD and GNM-based Transfer Entropy to investigate the allosteric communications network of CFTR. The modeling results are validated with experimental observations. Key residues were identified as pivotal allosteric sources and transducers and may account for disease mutations.

      The paper is well written and the results are significant for understanding CFTR biology.

      Reviewer #2 (Recommendations For The Authors):

      Technical comments:

      p4 Please explain how is the time delay parameter tau chosen (ie. three times the optimum tau value...)? It seems this unknown time should depend on the separation between i and j. Is the TE result sensitive to the choice of tau? How does the choice of cutoff distance of GNM affect the TE result?

      a. The choice of τ is important: when τ is too small, only local cause-and-effect relations (between adjacent amino acids) will be revealed. if τ is too big, few (if any) cause-and-effect relations will manifest. This is analogous to the effects of a stone throne into a lake: look too soon, before the stone hits the water, and you’ll see no ripples. Look too late, the ripples will have already subsided. In a previous work (PMID 32320672), we studied in detail the effects of choosing different τ values and found that an optimal value of τ which maximizes the degree of collectivities of net TE values is in most cases 3× τopt (τopt is the time window in which the total TE of residues is maximized). Details of how τ was chosen were added to the methods section.

      b. To test the sensitivity of the results to the cutoff distance we repeated the calculations using 7 Å. As now discussed in lines 170-173 and shown in Figure S2 the results remained largely unchanged.

      It would be nice to directly validate the causal prediction by GNM-based TE. For example, is it in agreement with direct causal observation of MD simulation? If the dimer is too big for MD, perhaps MD is more feasible for the monomer (NBD1+TMD1).

      a. The causality we determined using GNM-based TE is in good agreement with conclusions drawn from single channel electrophysiological recordings and rate-equilibrium free-energy relationship analysis (Sorum et al; Cell 2015, and see lines 8691, and 364-70).

      b. To the best of our knowledge, causality relations in CFTR are yet to be determined by MD simulations (This is likely because the protein is too big and the conformational changes are very slow). We cannot therefore compare the causality.

      c. Conducting MD simulations on half of CFTR (NBD1+TMD1) is not likely to be very informative: the ATP binding sites are formed at the interface of NBD1 and NBD2, and the ion translocation pathway at the interface of the TMDs.

      p5 How are the TE peak positions different from other key positions as predicted by GNM, such as the hinge positions with minimal mobility of the dominant GNM modes?

      Following this comment, we compared the positions of the GNM-TE peaks and the hinge positions as determined by GNM. As now discussed in lines 173-178 and shown in Figure S3 we observed partial overlap which was nevertheless statistically significant (Figure S3).

      p7 How to select the 10 most collective GNM modes? Why not use the 10 slowest GNM modes?

      We have actually used the 10 slowest GNM modes, but in an attempt to cater for the non-specialist reader, we referred to them as the most collective ones. This has now been corrected throughout the manuscript and the terminology that is now used is “10 slowest modes”

      p9 There exist other ANM-based methods for conformational transition modeling. So it would be nice to discuss their similarity and differences from ANM-LD, and compare their predictions.

      Alternative ANM (and other elastic network models) -based methods are now mentioned and referenced in lines 144-50. These methods are different from ANM-LD in the details of the all atom simulations and in their integration with the elastic network model. It is not trivial to reanalyze CFTR’s allostery using these methods and is beyond the scope of this work.

      Regarding the prediction of order of residue motions, can one directly observe such order by superimposing some intermediate conformation of ANM-LD with the initial and end structure?

      This would indeed be very attractive approach to visualize the order of events and following this comment we have tried to do just so. Unfortunately, we failed: Superimposing pairs of frames provided little insight, and we therefore compiled a video comprising all frames, or videos based on averages of several time delayed frames. We found that it is next to impossible to discern (using the naked eye) the directionality of the fluctuations and follow the order of conformational changes. Therefore, at this point, we have abandoned this endeavor.

      Reviewer #3 (Public Review):

      This study of CFTR, its mutants, dynamics, and effects of ATP binding, and drug binding is well written and highly informative. They have employed coarse-grained dynamics that help to interpret the dynamics in useful and highly informative ways. Overall the paper is highly informative and a pleasure to read.

      The investigation of the effects of drugs is particularly interesting, but perhaps not fully formed.

      This is a remarkably thorough computational investigation of the mechanics of CFTR, its mutants, and ATP binding and drug binding. It applies some novel appropriate methods to learn much about structure's allostery and the effects of drug bindings. It is, overall, an interesting and well written paper.

      There are only two main questions I would like to ask about this quite thorough study.

      Reviewer #3 (Recommendations For The Authors):

      1. Is it possible that the relatively large exothermic ATP hydrolysis itself exerts a force that causes the observed transitions? Jernigan and others have explored this effect for GroEL and some other structures. The effects of ATP binding and hydrolysis are likely often confused, and both are likely to be important.

      It is well established by many studies that ATP hydrolysis is not required to drive the conformational changes or to open the channel, and that ATP binding per-se is sufficient (e.g., We have clarified this point in lines 521-30.

      1. For the case of ivacaftor, would a comparison of the motion's directions show that ivacaftor might be compensating simply by its mass being located in a site to compensate for the mass changes from the mutations (ENMs with masses needed to address this). We have observed such cases on opposite sides of a hinge.

      We do not think that this is the case, from the following reasons:

      a. Ivacaftor corrects many gating mutations (e.g., G551D, G178R, S549N, S549R, G551S, G970R, G1244E, S1251N, S1255P, G1349D) which are spread all over the protein. Ivacaftor binds to a single site in CFTR, and it is therefore unlikely that its mass contribution corrects all these diverse mass changes.

      b. The residues that comprise the Ivacaftor binding were identified as allosteric “hotspots” in both the ATP-free and -bound forms (Figures 2B, 3B, and 6A), also in the absence of the drug. This indicates that the dynamic traits of this site is intrinsic to it, and that once bound, the drug acts by modulating these dynamics

      The Abstract does not repeat some of the more interesting points made in the paper and would benefit from a substantial revision.

      Corrected as suggested

      There are just a few minor points (just words):

      P 3 line 2 of first full ¶: "effects" should be "affects"

      Corrected as suggested

      P 6 first lilne "per-se" should be "per se"

      Corrected as suggested

      Further down that page "two set" should be "two sets"

      Corrected as suggested

      Even further down that same page "testimony" should be "support"

      Corrected as suggested

      P 10, 5 lines from the bottom "impose that" is awkward

      Changed to “define”

    1. Author Response

      The following is the authors’ response to the original reviews.

      Response to Reviewers

      To whom it may concern, Thank you for your constructive feedback on our manuscript. I appreciate the time and effort that you and the reviewers have dedicated to providing your valuable feedback. We are grateful to the reviewers for their insightful comments and suggestions for our paper. I have been able to incorporate changes to reflect the majority of these suggestions provided. I have updated the analysis scripts (at https://github.com/neurogenomics/reanalysis_Mathys_2019) and have listed these changes in blue below:

      eLife assessment:

      This work is useful as it highlights the importance of data analysis strategies in influencing outcomes during differential gene expression testing. While the manuscript has the potential to enhance awareness regarding data analysis choices in the community, its value could be further enhanced by providing a more comprehensive comparison of alternative methods and discussing the potential differences in preprocessing, such as scFLOW. The current analysis, although insightful, appears incomplete in addressing these aspects.

      We thank the reviewing editors for this note. We agree that the differences in preprocessing will affect the results and conceal which step in our reanalysis resulted in the discrepancies we noted. To address this, we have split out our reanalysis into two separate parts - In the main body of the text we discuss the differences resulting from just changing the differential expression approach where we use the same processed data as the authors to enable a fair comparison. Secondly, we still provide the reprocessed data and perform differential expression analysis on it and discuss the cause and impact the differences in the processing steps made to the results.

      Reviewer 1:

      I think readers would be interested to learn more about the genes that were found "significant" by the original paper but sorted out by the authors. Did they just fall short of the cutoffs? If so, how many more samples would have been required to ascertain significance? This would yield a recommendation for future studies and an overall more positive/productive spirit to the manuscript. On the other hand, I suspect a fraction of DEGs were false positives due to differences in the proportions of cells from different individuals compared to the original analysis. Which percentage of DEGs does this apply to? Again, this would raise awareness of the issue and support the use of pseudobulk approaches.

      To investigate the relationship between the genes and how they differ across our analysis we have added a correlation analysis between our different DE approaches (using the same processed data), see paragraph 5 in the manuscript and supplementary table 3. In short, we find that there is a high correlation in the genes’ fold change values across our pseudobulk analysis and the author’s pseudoreplication analysis on the same dataset (pearson R of 0.87 for an adjusted p-value of 0.05) which is somewhat expected given the DE approaches are applied to the same dataset. However, the p-values, which pertain to the likelihood that a gene’s expressional changes is related to the case/control differences in AD, and resulting DEGs vary considerably due to the artificially inflated confidence of the author’s approach (Fig. 1c-e). Despite there being a correlation between the pseudoreplciation and pseudobulk approaches here, we do not think it makes sense to consider how many more samples would have been required to ascertain significance. The differences in results between the two approaches is not negatable with sample size as many DEGs identified by pseudoreplication will be false positives as highlighted in previous work1,2,3,4. However, perhaps we are misinterpreting the reviewer, who may have meant a power analysis which we have not conducted. Such an undertaking would require analysing a multitude of snRNA-Seq of large sample sizes to garner a confident estimate for power calculations based on pseudobulk approaches. Although we agree with the reviewer that this would be beneficial to the field, we do not believe it is in scope for this work. On the reviewer’s note regarding a fraction of DEGs being false positives due to differences in the proportions of cells from different individuals compared to the original analysis - We have analysed the same processed data the authors used to negate the differences caused by the differing processing steps. We thank the reviewer for this suggestion. We also give more insight into the cause of these differences, namely on filtering our nuclei with large proportions of mitochondrial reads and discuss their effect in paragraph 3 (also see Supplementary Figure 2).

      Given there are only a few DEGs, it would be good to show more data about these genes to allow better assessment of the robustness of the results, i.e., boxplots of the pseudobulk counts in the compared groups and perhaps heatmaps of the raw counts prior to aggregation. This could rule out concerns about outliers affecting the results.

      In Supplementary Figure 3, we have added boxplots of the sum pseudobulked, trimmed mean of M-values (TMM) normalised counts for three of our identified DEGs (b) and three of the authors’ DEGs which they discuss in their manuscript (a) to show the differences in counts across AD pathology and controls for these genes. We hope this gives some insight into the transcriptional changes highlighted by the differing approaches. In our opinion, there is a clear difference in the transcriptional signal in the genes identified from pseudobulk which is not present for the genes identified from the authors approach.

      Overall, I believe the paper would deliver a clearer message by mainlining the QC from the original study and only changing the DE analysis. However, if keeping the part about QC/batch correction:

      • Assess to which degree changes in cell type proportion are indeed due to batch correction (as suggested in the text) and not filtering by looking at the annotated cell types in the original publication and those in your analysis.

      • Also perform the analysis without changing QC and state the # of DEGs in both cases, to at least allow some disentanglement of the effect of different steps of the analysis.

      • Please state the number of cells removed by each QC step in the supplementary note.

      We thank the reviewer for this suggestion. We agree with performing the DE analysis on the same processed data as the original authors and have split out our reanalysis into two separate parts, primarily focussing on the discrepancies caused by the choice of differential expression (DE) approach. By splitting our analysis in this manner, we can identify the substantial differences in results caused by differing the DE approach in the study. Secondly, we can see how differences in preprocessing affects the DE results in isolation too – see paragraph 8 but in short, the fold change correlation between pseudobulk DE analyses on the reprocessed data vs authors processed data only had a moderate correlation (Pearson R of 0.57).

      In regards to the number of cells removed by each QC step, we have added an aggregated view for all samples in supplementary table 3 and also give the full statistics per sample in our Github repository: https://github.com/neurogenomics/reanalysis_Mathys_2019. Moreover, we investigated the root cause in the differences in nuclei numbers, uncovering filtering down to mitochondrial read proportions as the main culprit (Supplementary Figure 2).

      I recommend the authors read the following papers, assess whether their methodology agrees with them, and add citations as appropriate to support statements made in the manuscript.

      We thank the reviewer for this comprehensive list. We have updated our manuscript and supplementary file and main text throughout to cite many of these where appropriate. We believe this helps add context to our decisions for the differing tools and approaches used as part of the processing pipeline with scFlow and the differential expression approach.

      I believe the authors' intention was to show the results of their reanalysis not as a criticism of the original paper (which can hardly be faulted for their strategy which was state-of-the-art at the time and indeed they took extra measures attempting to ensure the reliability of their results), but primarily to raise awareness and provide recommendations for rigorous analysis of sc/snRNA-seq data for future studies.

      We thank the reviewer for this note, this was exactly our intent. Furthermore, we are based in a dementia research institute and our aim is to ensure that ensure that the Alzheimer’s disease research field does not focus on spuriously identified genes.We have updated the text of the manuscript (start paragraph 2) to explicitly state this so our message is not misconstrued.

      In my opinion, the purpose of the paper might be better served by focusing on the DE strategy without changing QC and instead detailing where/how DEGs were gained/lost and supporting whether these were false positives.

      We agree that the differences in preprocessing will affect the results and conceal which step in our reanalysis resulted in the discrepancies we noted. To address this, we have split out our reanalysis into two separate parts - In the main body of the text we discuss the differences resulting from just changing the differential expression approach where we use the same processed data as the authors to enable a fair comparison. Secondly, we still provide the reprocessed data and perform differential expression analysis on it and discuss the impact the differences in the processing steps made to the results. As previously mentioned, we have also added further investigation into the DEGs identified, looking at the correlation across the differing approaches and plotting the counts for selected genes.

      For instance, removal with a mitochondrial count of <5% seems harsh and might account for a large proportion of additional cells filtered out in comparison to the original analysis. There is no blanket "correct cutoff" for this percentage. For instance, the "classic" Seurat tutorial https://satijalab.org/seurat/articles/pbmc3k_tutorial.html uses the 5% threshold chosen by the authors, an MAD-based selection of cutoff arrived at 8% here https://www.sc-best-practices.org/preprocessing_visualization/quality_control.html, another "best practices" guide choses by default 10% https://bioconductor.org/books/3.17/OSCA.basic/quality-control.html#quality-control-discarded, etc. Generally, the % of mitochondrial reads varies a lot between datasets.

      Apologies, the 5% cut-off was a misprint – the actual cut-off used was 10% which, as the reviewer notes, is on the higher side of what is recommended. We have updated our manuscript to rectify this mistake and discuss the differences in the number of cells caused by the two approaches to mitochondrial filtering in the manuscript (paragraph 3). We found that over 16,000 nuclei that were removed in our QC pipeline were kept by the author’s (Supplementary Fig. 2), explaining the discrepancy in the number of nuclei after QC. Based on Supplementary Fig. 2, it is clear the author’s approach was ineffective at removing nuclei with high proportions of mitochondrial reads which is indicative of cell death5,6. We hope this alleviates the reviewer’s concerns around our alternative processing approach. Moreover, as mentioned, we swapped to compare the differences by DE approaches on the same data to avoid any effect by this.

      Reviewer 2:

      The paper would be better if the authors merged this work with the scFLOW paper so that they can justify their analysis pipeline and show it in an influential dataset.

      We thank the reviewer for this note. We would like to clarify that the purpose of our work was not to show the scFlow analysis pipeline on an influential dataset but rather to raise awareness and provide recommendations for rigorous analysis of single-cell and single-nucleus RNA-Seq data (sc/snRNA-Seq) for future studies and to help redirect the focus of the Alzheimer’s disease research field away from possible spuriously identified genes. We have updated our manuscript text to highlight this (see start paragraph 2). Furthermore, we are aware our original approach reprocessing the data with scFlow will affect the results and conceal which step in our reanalysis resulted in the discrepancies we noted. Thus, we have split out our reanalysis into two separate parts - In the main body of the text we discuss the differences resulting from just changing the differential expression approach where we use the same processed data as the authors to enable a fair comparison. Secondly, we still provide the reprocessed data so that the community can benefit from it and perform differential expression analysis on it and discuss the impact the differences in the processing steps made to the results. We have also added further references supporting the choice of steps and tools used in scFlow in the supplementary text which should address the reviewer’s concerns about justifying the analysis pipeline. Moreover, we identified the cause of the nuclei count differences caused by the two processing approaches, namely on filtering our nuclei with large proportions of mitochondrial reads and discuss their effect in paragraph 3 (also see Supplementary Figure 2).

      A major contribution is the use of the authors' own inhouse pipeline for data preparation (scFLOW), but this software is unpublished since 2021 and consequently not yet refereed. It isn't reasonable to take this pipeline as being validated in the field.

      We believe our answer to the previous point addresses these concerns - We have added references supporting the choice of steps and tools used in scFlow in the supplementary text which should address the reviewer’s concerns about justifying the analysis pipeline. Moreover, as a result of the pipeline we identified that 16,000 of the nuclei kept by the authors are likely of low quality and indicative of cell death with high mitochondrial read proportions5,6.

      They also worry that the significant findings in Mathys' paper are influenced by the number of cells of each type. I'm sure it is since power is a function of sample size, but is this a bad thing? It seems odd that their approach is not influenced by sample size.

      We thank the reviewer for highlighting this point. As they noted, we conclude that the original authors number of DEGs is just a product of the number of cells. However, the reviewer states that ‘It seems odd that their approach is not influenced by sample size’. An increase in the number of cells is not an increase in sample size since these cells are not independent from one another - they come from the same sample. Therefore, an increase in the number of cells should not result in an increase in the number of DEGs whereas an increase in the number of samples would. This point is the major issue with pseudoreplication approaches which over-estimate the confidence when performing differential expression due to the statistical dependence between cells from the same patient not being considered. See these references for more information on this point1,2,7,8. We have added a discussion of this point to our manuscript in paragraph 6.

      Moreover, recent work has established that the genetic risk for Alzheimer’s disease acts primarily via microglia9,10. Thus, it would be reasonable to expect that the majority of large effect size DEGs identified would be found in this cell type. This is what we found with our pseudobulk differential expression approach – 96% of all DEGs were in microglia. We have updated the text of our manuscript (paragraph 5) to highlight this last point.

      References 1. Murphy, A. E. & Skene, N. G. A balanced measure shows superior performance of pseudobulk methods in single-cell RNA-sequencing analysis. Nat. Commun. 13, 7851 (2022).

      1. Squair, J. W. et al. Confronting false discoveries in single-cell differential expression. Nat. Commun. 12, 5692 (2021).

      2. Crowell, H. L. et al. muscat detects subpopulation-specific state transitions from multi-sample multi-condition single-cell transcriptomics data. Nat. Commun. 11, 6077 (2020).

      3. Soneson, C. & Robinson, M. D. Bias, robustness and scalability in single-cell differential expression analysis. Nat. Methods 15, 255–261 (2018).

      4. Ilicic, T. et al. Classification of low quality cells from single-cell RNA-seq data. Genome Biol. 17, 29 (2016).

      5. Heumos, L. et al. Best practices for single-cell analysis across modalities. Nat. Rev. Genet. 24, 550–572 (2023).

      6. Zimmerman, K. D., Espeland, M. A. & Langefeld, C. D. A practical solution to pseudoreplication bias in single-cell studies. Nat. Commun. 12, 738 (2021).

      7. Lazic, S. E. The problem of pseudoreplication in neuroscientific studies: is it affecting your analysis? BMC Neurosci. 11, 5 (2010).

      8. Skene, N. G. & Grant, S. G. N. Identification of Vulnerable Cell Types in Major Brain Disorders Using Single Cell Transcriptomes and Expression Weighted Cell Type Enrichment. Front. Neurosci. 0, (2016).

      9. McQuade, A. & Blurton-Jones, M. Microglia in Alzheimer’s disease: Exploring how genetics and phenotype influence risk. J. Mol. Biol. 431, 1805–1817 (2019).

    1. Author Response

      The following is the authors’ response to the current reviews.

      eLife assessment

      The findings of this article provide valuable information on the changes of cell clusters induced by chronic periodontitis. The observation of a new fibroblast subpopulation, named AG fibroblasts, is interesting, and the strength of evidence presented is solid.

      We thank the Reviewing Editor and the Senior Editor for the positive assessment and strong support for our study.

      Public Reviews:

      Reviewer #1 (Public Review):

      In this article, the authors found a distinct fibroblast subpopulation named AG fibroblasts, which are capable of regulating myeloid cells, T cells and ILCs, and proposed that AG fibroblasts function as a previously unrecognized surveillant to orchestrate chronic gingival inflammation in periodontitis. Generally speaking, this article is innovative and interesting.

      We truly appreciate this public review.

      Reviewer #2 (Public Review):

      This study proposed the AG fibroblast-neutrophil-ILC3 axis as a mechanism contributing to pathological inflammation in periodontitis. In this study single-cell transcriptomic analysis was performed. But the signal mechanism behind them was not evaluated.

      The authors achieved their aims, and the results partially support their conclusions.

      We agree that we must conduct future studies to evaluate our hypothesis.

      The mouse ligatured periodontitis models differ from clinical periodontitis in human, this study supplies the basis for future research in human.

      This is an important subject. We have previously expressed a concern on the mouse ligature model that the microbial composition of the mouse ligature did not mirror the human oral microbial composition. Therefore, we developed the maxillary topical application (MTA) model, in which human oral biofilm was directly applied to the maxillary gingiva. In this study, the newly developed MTA model was further dissected by single cell RNA seq, which revealed that the extracellular substances of human oral biofilm might be an important trigger of gingival inflammation. RESULT has been revised.

      Recommendations for the authors:

      Reviewer #1 (Recommendations For The Authors):

      I appreciate the authors' efforts. I think it would be much better to simplify INTRODUCTION.

      INTRODUCTION has been simplified as suggested.

      Reviewer #2 (Recommendations For The Authors):

      1. Many host cells participate in immune responses, such as gingival epithelial cells. AG fibroblast is not the only cell involved in the immune response, and the weight of its role needs to be clarified. So the expression in the conclusion should be appropriate.

      RESPONSE: We agree with this comment. Our study identified the AG fibroblast–neutrophil–ILC3 axis as a previously unrecognized mechanism which could play an additional role in the complex interplay between oral barrier immune cells.

      1. The main results should be included in the Abstract.

      Abstract has been revised.


      The following is the authors’ response to the original reviews.

      We thank all reviewers for constructive critiques. We plan to perform new experiments and revise our manuscript accordingly. The text and Figures are currently undergoing the revision process. Below highlights our revision plan.

      eLife assessment

      The findings of this article provide valuable information on the changes of cell clusters induced by chronic periodontitis. The observation of a new fibroblast subpopulation, which was named as AG fibroblasts, was quite interesting, but needs further evidence. The strength of evidence presented is incomplete.

      We discovered a new subpopulation of gingival fibroblasts, named AG fibroblasts, using non-biased single cell RNA sequencing (scRNA-seq) of mouse gingival samples undergoing the development of ligature-induced periodontitis. AG fibroblasts exhibited a unique gene expression profile: [1] constitutive expression of type XIV collagen; and [2] ligatureinduced upregulation of Toll-Like Receptors and their downstream signals as well as chemokines such as CXCL12. Thus, we have hypothesized that AG fibroblasts initially sense the pathological stress including oral microbial stimuli and secrete inflammatory signals through chemokine expression.

      The current manuscript examined the relationship between AG fibroblasts and oral barrier immune cells focusing on the chemokines and other ligands derived from AG fibroblasts and their putative receptors in those immune cells. Using scRNA-seq data mining programs, our data demonstrated the compelling evidence that AG fibroblasts should play a critical role in orchestrating the oral barrier immunity, at least at the early stages of periodontal inflammation.

      We agree that it is important to explore the functional/pathological role of AG fibroblasts. In this revision, we further investigated the role of TLRs in the pathogen sensing mechanism of AG fibroblasts. To accomplish this goal, we applied a newly developed mouse model in which mice were exposed to the maxillary topical application (MTA) of oral microbial pathogens without the ligature placement. With 1 hr exposure with human oral biofilm, not with planktonic microbiota, the mice maxillary tissue exhibited measurable degradation as evidenced by the activation of cathepsin K. To dissect the role of TLRs, we applied the putative stimulants of TLR9 and TLR2/4 using the discrete MTA model. The scRNA-seq from the MTA model revealed that the application of unmethylated CpG oligonucleotide and P. gingivalis lipopolysaccharide (LPS), respectively, induced the activation of chemokines by AG fibroblast.

      The revised manuscript reported this critical data with the detailed information. As such the additional figures and corresponding results, discussion and materials & methods were included.

      Public Reviews:

      Reviewer #1 (Public Review):

      In this article, the authors found a distinct fibroblast subpopulation named AG fibroblasts, which are capable of regulating myeloid cells, T cells and ILCs, and proposed that AG fibroblasts function as a previously unrecognized surveillant to orchestrate chronic gingival inflammation in periodontitis. Generally speaking, this article is innovative and interesting, however, there are some problems that need to be addressed to improve the quality of the manuscript.

      We appreciate this comment. As suggested, we further investigated the surveillant function of AG fibroblasts by reanalyzing the scRNA-seq data for stress sensing receptors such as Toll-Like Receptors (TLR). In the revision, we addressed the role of TLR in the activation of AG fibroblasts using a newly developed mouse model employing the maxillary topical application (MTA) of putative TLR stimulants. The new information clearly demonstrated that AG fibroblasts play a pivotal role as the surveillant and translating the pathogenic stimulants to oral barrier inflammation through chemokine expression.

      Reviewer #2 (Public Review):

      This study proposed the AG fibroblast-neutrophil-ILC3 axis as a mechanism contributing to pathological inflammation in periodontitis. However, the immune response in the vivo is very complex. It is difficult to determine which is the cause and which is the result. This study explores the relevant issue from one dimension, which is of great significance for a deeper understanding of the pathogenesis of periodontitis. It should be fully discussed.

      We appreciate this comment. We expanded the current understanding of oral immune signal communication in Discussion and highlight how AG fibroblast may fit to it. To address this question, we expanded our investigation in the pathological signal detection by AG fibroblasts by employing the newly developed maxillary topical application (MTA) model. The revised manuscript contains the new information and expanded the discussion in the context of complex immune response.

      Reviewer #1 (Recommendations For The Authors):

      Detailed comments are listed below:

      Abstract:<br /> I am confused about the expression of "human periodontitis-like phenotype". How does the authors define this concept? Periodontitis is a complex disease, despite that alveolar bone resorption is a typical manifestation of periodontitis, its characteristics remain to be further studied. I hope the authors can provide some detailed information about this concept or describe it in another way.

      This is an important comment. Radiographically, human periodontitis is diagnosed by alveolar bone resorption from the cervical region, not from root apex. To highlight this, we present dental radiographs of human periodontitis as supplementary information. However, we agree with this comment, our statement should be limited to alveolar bone resorption pattern in Rag2KO and Rag2gcKO mice. Abstract be revised accordingly.

      Introduction:<br /> It is recommended to simplify the first to third paragraphs, and briefly explain the functions of various types of cells in different stages of periodontitis, as well as the role of different cluster markers play across the time course of periodontal inflammation development.

      Following this recommendation, INTRODUCTION has been simplified.

      Results:<br /> 1. It is recommended to add HE staining and immunohistochemistry staining to observe the inflammation, tissue damage, and repair status from 0 to 7 days, so that readers can understand cell phenotype changes corresponding to the periodontitis stage. The observation index can include inflammation and vascular related indicators.

      As recommended, representative histological figures were included. We further performed new immunohistochemistry experiment of mouse gingival tissue (D0, D1, D3, D7) highlighting the infiltration of CD45+ immune cells. We found that inflammatory vascular formation in the H&E histology, which was highlighted. To characterize the tissue damage, the histological sections were stained by picrosirius red to highlight the change in collagen connective tissue of PDL and gingiva.

      1. Figure 1A-1D can be placed in the supplementary figure.

      Combining the new data above, Figure 1 was revised as suggested.

      1. I suggest the authors to put the detection of the existence of AG fibroblasts before exploring its relationship with other types of cells.

      2. The layout of the picture should be closely related to the topic of the article. It is recommended to readjust the layout of the picture. Figure 1 should be the detection of AG cells and their proportion changes from 0 to 7 days. In other figures, the authors can separately describe the proportion changes of myeloid cells, T cells and ILCs, and explored the association between AG fibroblasts and these cell types.

      As suggested, the presentation order of Figures and text was revised to bring the information about AG fibroblasts first. The chemokine-receptor analysis was moved below.

      1. Please provide the complete form of "KT" in Line 162.

      KT fibroblasts (fibroblasts keeping typical phenotype) was described in the text.

      Methods:<br /> It is recommended to separately list the statistical methods section. The statistical method used in the article should be one-way ANOVA.

      A separate statistical method section is created. As pointed out, we used one-way ANOVA with post-hoc Tukey test (when multiple groups were compared).

      Discussion:<br /> I suggest the authors remove Figures 3-6 from the discussion section. For example, in Line 283, "(Figure 3 and 4)" should be removed.

      Revised as suggested.

      Reference:<br /> Some information for the references is missing. For example, "Lin P, et al. Application of Ligature-Induced Periodontitis in Mice to Explore the Molecular Mechanism of Periodontal Disease. Int J Mol Sci 22, (2021)" should be "Lin P, et al. Application of Ligature-Induced Periodontitis in Mice to Explore the Molecular Mechanism of Periodontal Disease. Int J Mol Sci 22, 8900 (2021)". It is necessary to recheck all references.

      The reference has been checked for the accuracy and the omission pointed out was corrected. Although we used EndNote program, we found some more inaccuracy in the references that were manually corrected. We appreciate your suggestion.

      Reviewer #2 (Recommendations For The Authors):

      1. Many host cells participate in immune responses, such as gingival epithelial cells. AG fibroblast is not the only cell involved in the immune response, and the weight of its role needs to be clarified. So the expression in the conclusion should be appropriate.

      Following this critique, we revised INTRODUCTION, DISCUSSION and CONCLUSION, to highlight how AG fibroblasts function within a comprehensive immune response network.

      1. This study cannot directly answer the issue of the relationship between periodontitis and systemic diseases.

      We agree with this critique. We either deleted or de-emphasized the relationship between periodontitis and systemic diseases throughout the text.

    1. Note: This response was posted by the corresponding author to Review Commons. The content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      _We have underlined the important points in the reviewer's comments. All responses have been read and authorized by all authors of this manuscript. Authors would like to thank the reviewers and the editor for their valuable time. We believe that the comments and suggestions from both reviewers will significantly improve SMorph and the manuscript. _

      Reviewer #1 (Evidence, reproducibility and clarity (Required)):

      First of all, I want to apologize the authors and editor for my delay. Secondly, for clarity, I want to disclose that I am the author of the Fiji's 'Sholl Analysis' plugin, that the authors cite extensively (Ferreira et al, Nat Methods, 2014).

      In this study, Sethi et al introduce a software tool - SMorph - for bulk morphometric analysis of neurons and glia (astrocytes and microglia), based on the Sholl technique. The authors compare it to the state-of-the-art in a series of validation experiments (stab wound injury), to conclude that it is 1000 times faster that existing tools. Empowered by the tool, the authors show that chronic administration of a tricyclic antidepressant (DMI) leads to structural changes of astrocytes in the mouse hippocampus. The paper is well written, the description of the tool is clear, and the authors make all of the source code available, as well as most of the imagery analyzed in the manuscript. The latter on its own, makes me really appreciative of the authors work.

      We thank reviewer #1 for their careful reading of the manuscript and their comments.

      **Major comments:**

      A major strength of SMorph is that it leverages the Python ecosystem, which allow the authors take advantage of powerful python packages such as sklearn, without the need for external packages or tools. However, I have strong criticisms for the claims that are made in terms of speed and broad-applicability of the software, including PCA.

      Speed:

      The 1000x speed gains, assumes - for the most part -- that the processing in Fiji cannot be automated. This is false. I read the source code of SMorph, and with exception of the PCA analysis, all aspects of SMorph can be automated in Fiji, using any of Fiji's scripting languages to make direct calls to the Fiji and Sholl Analysis plugin APIs (See https://javadoc.scijava.org/) . Now, perhaps the authors do not have experience with ImageJ scripting, or perhaps we Fiji developers failed to provide clear tutorials and examples on how to do so. Or perhaps, there is something inherently cumbersome with Fiji scripting that makes this hard (e.g., there is a current limitation with the ImageJ2 version of 'Sholl Analysis' that does not make it macro recordable). It such limitations do exist, it is perfectly fine to mention them, but do contact us at https://forum.image.sc, if something is unclear. We do strive to make our work as re-usable as possible. Unfortunately our own research does not always allow us the time required to do so. Case in point, our scripting examples (e.g., https://github.com/tferr/ASA/blob/master/scripting-examples/3D_Analysis_ImageStack.py; https://github.com/tferr/ASA/blob/master/scripting-examples/3D_Analysis_ImageStack.py) are not well advertised. That being said, I am still surprised that in their side-by-side comparisons the authors were not able to automate more the processing steps (e.g., the ImageJ1 version of 'Sholl Analysis' remains fully functional and is macro recordable). If I misunderstood what was done, please provide the ImageJ macros you used. Also, I wanted to mention that i) semi-manual tracing with Simple Neurite Tracer (now "SNT"), can also be scripted (see https://doi.org/10.1101/2020.07.13.179325); and that ii) Fiji commands and plugins can also be called in native python using pyimagej (https://pypi.org/project/pyimagej/), see e.g., https://github.com/morphonets/SNT/tree/master/notebooks#snt-notebooks). Arguably, the fact that SMorph handles blob detection and skeletonization-based metrics directly is more advantageous from a user point of view. In Fiji, blob detection, skeletonization and Strahler analysis (https://imagej.net/Strahler_Analysis) of the skeleton are handled by different plugins. However, those are also fully scriptable, and interoperate well. The point that topographic skeletonization in Fiji can originate loops is valid, however the authors should know that such cycles can be detected and pruned programmatically using e.g., pixel intensities (see https://imagej.net/AnalyzeSkeleton.html#Loop_detection_and_pruning and the original publication (https://pubmed.ncbi.nlm.nih.gov/20232465/)

      We completely agree with the reviewer’s assertion that most parts of the functionality of SMorph can be automated within imageJ as well, and in such comparison, the speed gains with SMorph will not be >1000X.

      However, automating the analysis in imageJ is beyond the scope of the present manuscript. In fact, imageJ analysis comparison was not a part of our original manuscript at all. Upon presubmission inquiry to one of the affiliate journals of Review Commons, we were specifically asked to include a side-by-side comparison with “already available” methods. So, we decided to use ImageJ as it is, and automation, if any, was limited to simple macros to run a series of commands sequentially on batches of images. Although it is true that this analysis could be done much more efficiently with additional scripting, it would not have met the definition of “already available” tools. The imageJ analysis was performed in a way an average biologist with no programming experience would perform it, since that group will find SMorph most useful. In no way do we intend to imply that imageJ analysis can’t be made more efficient and automated. Perhaps it was not clear from the way the text was framed in the initial version of the manuscript. We will add additional text to make this point clearer.

      On a side-note, in response to reviewer #2’s comments, we will perform the speed comparison on a per-image basis, so the speed gain (1080X) may change a little in the new comparison.

      Broad applicability:

      In our work, we made a significant effort to ensure that automated Sholl could be performed on any cell type: e.g., By supporting 2D and 3D images, by allowing repeated measures at each sampled distance, and by improving curve fitting. For linear profiles, we implemented the ability to perform polynomial fits of arbitrary degree, and implemented heuristics for 'best degree' determination. For normalized profiles, we implemented several normalizers, and alternatives for determining regression coefficients. We did not tackle segmentation of images directly (we did provide some accompanying scripts to aid users, see e.g. https://imagej.net/BAR) because in our case that is handled directly by ImageJ and Fiji's large collection of plugins. However, in SMorph, several of these parameters are hard-wired in the code. They may be suitable to the analyzed images, but they can be hardly generalized to other datasets. In detail: In terms of segmentation, SMorph is restricted to 2D images, scales data to a fixed 98 percentile, and uses a fixed auto-threshold method (Otsu). These settings are tethered to the authors imagery. They will give ill results for someone else using a different imaging setup, or staining method. In terms of curve fitting, the polynomial regression seems to be fixed at a 3rd order polynomial, which will not be suitable to different cell types (not even to all cells of 'radial morphology').

      We have indeed hard-coded the parameters that the reviewer mentions, and we agree that we can perhaps give all options to the end-users to choose from. The decision was made to hard-code the parameters so that SMorph becomes very easy and minimalistic to use for the end-users. But the reviewer is right to point out that this may compromise the broad applicability and accuracy. We will update the code in the revised version of the manuscript to give the users control over choosing these parameters.

      PCA:

      The idea of making PCA analysis of Sholl-based morphometry accessible to a broader user base has merit and is welcomed. However, it has to be done carefully in a self-critic manner as opposed to a black-box solution. E.g., in the text it is mentioned that 2 principal components are used, in the tutorial notebook, 3. Why not provide intuitive scree plots that empower users with the ability to criticize choice? Also, it would be useful for users to understand which metrics correlate with each other, and their variable weights.

      Reviewer #1’s suggestions would indeed make the PCA analysis more useful to the users. In the revised version of the code, we will provide additional data/plots to the user for making an informed choice of the significant principal components e.g. the elbow method, Ogive or Pareto plots, variable weights of different features in the principal components and correlation/covariance matrices.

      When we showcased the utility of PCA to distinguish closely related morphology groups (as in Type-1 and Type-2 PV neurons), we had been unable to base the distinction on individual metrics, at least not in a robust manner (see Fig. S4 in Ferreira et al, 2014). A minor conundrum of the paper, is that it does not directly highlight the advantages of "analyzes in a multidimensional space". The differences between groups in the stab wound and DMI assays are such, that PCA is hardly needed: I.e., the differences depicted Fig2F,G are already significant, and already convey changes in "size and branch complexity" (as per PC1). The same argument applies to Fig. 5. The paper would profit from having this discussed.

      PCA data indeed is not required to make any of the inferences we make in the paper and is superfluous. However, as mentioned in the discussion section of this manuscript, the low-dimensional PCA data can be used in future for other applications, e.g to cluster the astrocytes into morphometrically-defined subpopulations. SMorph can be further developed to perform real-time classification of these cells into morphometric clusters, which will allow the researchers to investigate clusters-specific gene expression, electrophysiology etc. Preliminary results from our lab do suggest that such clusters are differentially altered by stress and antidepressant treatments. However, these results are preliminary and are a part of a long-term future study. The data is really premature to publish at this stage, since it will require a lot of experimentation to show that these astrocyte subpopulations are indeed physiologically and functionally different. Nevertheless, we think that the utility of SMorph for such analyses may help others to come up with additional innovative ways to use the PCA data. Hence, we do believe that the community will benefit from the current release of SMorph having PCA. PCA data was shown in the figures just to demonstrate the functionality of SMorph. We will add additional text to make these points clearer.

      Other:

      - All metrics and parameters should be expressed in physical units (e.g.," radii increasing by 3 pixels", axes in Figure 2, 3, 5, S2) so that readers can directly interpret them.

      In the revised manuscript, we will convert all units into actual physical distances.

      - The paper would profit from the insights provided by Bird & Cuntz (https://pubmed.ncbi.nlm.nih.gov/31167149/)

      We thank the reviewer for suggesting this paper. We will include this in the discussion of the manuscript.

      **Minor comments:**

      - Usage of RGB images (8-bit per channel) seems hardly justifiable. Aren't you loosing dynamic range of GFAP signal?

      We agree that we could have captured the images at a higher dynamic range. However, for the changes we observe between treatment groups using GFAP immunoreactivity signal as presented in the manuscript, we do not see an advantage of using higher dynamic range. However, as the reviewer rightly pointed out, under certain conditions, imaging using a higher dynamic range may help and hence, we will include this recommendation in the materials and methods section.

      - Please explain how MaxAbsScaler "prevents sub-optimal results"

      Since morphometric features extracted from cell images either have different units or are scalar, we had to perform normalization before PCA. We will add further explanation in the methods section of the manuscript.

      - The fact that automated batch processing can stall on a single bad 'contrast ratio' image seems rather cumbersome to deal with

      This problem has been resolved in the current version of SMorph, which will be uploaded with the revised version of the manuscript.

      - Please add a license to https://github.com/parulsethi/SMorph/. Without it, other projects may shy away from using SMorph

      We will add a ____GPLv3 license

      - "mounted on stereotax" should be "mounted on a stereotaxis device"?

      We will make this change

      - Ensure Schoenen is capitalized

      We will make this change

      Reviewer #1 (Significance (Required)):

      I find the Desipramine results interesting. However, given the existing claims that DMI can modulate LTP, I regret that the authors did not look at structural modifications in hippocampal neurons (e.g., by performing the experiments in Thy1-M-eGFP animals). I understand, that doing so at this point would be a large undertaking.

      Another manuscript from our lab__1, as well as work from other labs have shown that stress causes significant degenerative changes in hippocampal astrocytes__2,3__. In the light of these observations, we do believe that our observation of chronic antidepressant treatment inducing structural plasticity in astrocytes is significant. Structural alterations in neurons after DMI treatment are of interest. But in our experience, we have not seen gross morphological (dendritic arborization) changes in hippocampal neurons as a result of antidepressant drug treatments. Such changes are restricted to spine morphology and axonal varicosities, which is beyond the capabilities of SMorph. __

      Reviewer #2 (Evidence, reproducibility and clarity (Required)):

      This paper addresses the challenge of automatic Sholl analysis of large dataset of multiple cell types such as neurons, astrocytes and microglia. The developed approach should improve the speed of morphology analysis compared to the state of the art without compromising on the accuracy. The authors present an interesting application of their tool to the morphological analysis of astrocytes following chronic antidepressant treatment. The paper is well written, and the tool presented could be beneficial for different applications and context. However, some major aspects should be addressed by the author concerning the description of the algorithms used and the quantification of the results.

      We thank reviewer #2 for their careful reading of the paper and their comments.

      **Major comments/Questions:**

      1. In the Results and/or Methods sections, the author should better describe how their approach is different from state-of-the-art approaches in terms of algorithms used and how these difference impacts on the speed and accuracy of the analysis.

      We will add these descriptions in the methods section in response to this comment as well as some comments from reviewer #1.

      Imaging was performed on a Zeiss LSM 880 airyscan confocal microscope. Is this method robust to other types of imaging techniques, other microscopes, variable levels of signal-to-noise? This should be tested and quantified.

      We will demonstrate the results obtained from images taken using different microscopes and imaging techniques, and quantify the outcome.

      Manual cropping of the cells with ImageJ was used. However, in the methods section, the authors mention that other machine learning tools could be used for this task. Why were these tools not implemented in this paper in order to propose a fully automated analysis approach in combination with SMorph?

      We have tried both the machine learning tools cited in this paper (one for DAB images and other for confocal images). However, in our experience, we do not get robust performance from these tools with our datasets, and these tools will perhaps need more optimization for broad applicability. We are developing an auto-cropping tool in-house, but that is beyond the scope of the current study. Another point is that these tools are tailor-made for astrocytes, and their integration into SMorph will restrict its applicability to just one cell type.

      In the methods section you state that cropped cells need to have a good contrast ratio for automated batch processing. Could you define what a good contrast ratio is and characterize the performance of your approach for different contrast ratio?

      In the revised manuscript, we will compare the images taken from multiple microscopes and quantify the outcome. We will change the text accordingly. As such, the comment on rejected cells referred to really poor quality images. In the revised manuscript, we will make specific recommendations on imaging parameters so that this should not be an issue at all.

      It is mentioned that the analysis routine can be interupted by a cell with lower contrast ratio. This is a major drawback of the approach (but I think that it could be easily improved), as such interruptions may not be= practicable for many applications that need to rely on automated processing.

      We have already rectified this problem and the updated version of SMorph will be uploaded with the revised manuscript.

      Also, you should precise how the contrast ratio should be enhanced without modifying raw data in order to be processed with your approach. You suggest removing cells with lower contrast ratio from the analysis, but can this impact on the findings especially if some treatments impact on the detected fluorescence signal? Can you propose ways to improve the robustness of your approach to variable signal ratios?

      It is indeed possible that removing cells from analysis, may in certain cases, affect the results. To rectify this, we are testing the method on images obtained from different microscopes and under different imaging conditions. From these analyses, we will deduce minimum recommendations for imaging conditions so that images don’t have to be edited/altogether removed from analysis for the software to work. In the materials and methods section, we will add these recommendations to the users on the optimal range of imaging parameters. This way, rejection/modification of images should not be an issue.

      In the Results section, you describe the time necessary to perform different analysis. However, giving a total time in hours is not very informative as this will likely vary a lot depending on the size of the dataset, complexity of the images, etc. You should compare the average time per image for both methods and types of analysis.

      We compared the total time required for the entire dataset, since SMorph is meant for batch-processing all the images at once. However, we can change the comparisons to time taken per image. We can divide the total time taken by SMorph by the number of images analysed. However, in our opinion, the time taken to initiate SMorph will make these comparisons inaccurate.

      You state that for the number of branch point, the lower value of the measured slope when comparing SMorph and ImageJ was related to a constant overestimation of this parameter with ImageJ. How was this quantified? I think you should stress out more the comparison of both approaches with the manually annotated dataset.

      In the revised version of this manuscript, we will include some examples of skeletonized images that overestimate the number of forks. We have observed this to be a recurring problem with the skeletonization tools we have tried in imageJ. This can be rectified in imageJ itself as pointed out by reviewer #1. However, that’s beyond the scope of the present study and will not fit the definition of comparison with “already available” methods.

      How can you explain the differences in the 2D-projected Area, total skeleton length and convex hull between SMorph and ImageJ, which all show a slope around 0.83? Can you quantify the performance of both methods by comparing them with your manually annotated dataset?

      In the revised version, we will include the correlation data between completely manual and SMorph comparisons. We will discuss these comparisons further in the manuscript and make specific conclusions about the accuracy.

      In the introduction and discussion, you mention that you present a method that works on neurons, astrocytes and microglia. However, I don't see in the paper the comparison between the accuracy for all these cell types as you seem to have analyzed only the morphology of astrocytes.

      In the revised manuscript, we will include the Sholl analysis comparison (imageJ vs SMorph) from images of neurons and microglia.

      You mention that your method is quite sensitive to variation in contrast ratio. You should quantify the contrast ratio throughout the experiments and ensure that this is not biasing the SMorph analysis for some of the treatments.

      We thank both reviewers for highlighting this issue in the initial version of SMorph. As mentioned in our response to point #6, we will perform additional analyses to make specific recommendations to the end users regarding imaging parameters so that SMorph can work on images as they are. As such, our comments on contrast ratio applied only to very poor quality images. If images are acquired conforming to the imaging parameters we will recommend in the revised manuscript, images can be analysed without any issues.

      **Minor Points :**

      1. Precise the exact inclusion and exclusion criteria for Soma detection and rephrase: "The high-intensity blobs were detected as a position of soma..." & "Boundary blobs coming from adjacent cells...".

      We will add a complete explanation of blob detection and the exclusion criterion in the methods section.

      Throughout the text, make sure to always refer to an analysis time per image or per cell and not only include absolute duration values without reference to the task at hand (e.g. in the discussion : SMorph took 40 second to complete the analysis... please state to which analysis you are exactly referring to and if applicable if it varies from cell to cell).

      We will change all comparisons to time taken per cell. Text will be added to mention which datasets were used when any claims of speed are made.

      When you state in the discussion that "Although some methods do allow Sholl analysis without manual neurite tracing, they still work on one cell at a time", please precise if the only aspect that is missing from this type of analysis is batch processing (looping through the data) or if there is a major obstacle to automate this technique. This is important a SMorph does proceed with the analysis one cell at a time but can work in a loop/batch.

      We will elaborate further on our assertion regarding the challenges of using imageJ plugins for sholl analysis in large batches of cells.

      Reviewer #2 (Significance (Required)):

      This tool could very useful to researchers in the field of cellular neuroscience working with high-throughput analysis of microscopy data. The authors show some interesting improvements over existing methods. An improved quantitative characterization of the robustness of their approach would be of great importance to ensure the significance of this tool to a large community of researchers using different types of microscopes or studying different cell types.

      My expertise is in the field of optical microscopy and high-throughput (automated) image analysis for neuroscience. My expertise to evaluate the biological findings in this study is very limited.

      We thank reviewer #2 for their careful reading of the manuscript and their insightful comments. Growing evidence (clinical and preclinical) shows a significant reduction in astrocyte density in key limbic brain regions as a result of depression. We believe that the structural plasticity induced by chronic antidepressant treatment, as demonstrated in this manuscript, is an interesting novel plasticity mechanism that can negate deleterious effects of stress on astrocytes.

      The improvements suggested by both reviewers will help us to greatly improve SMorph in the revised version of this manuscript.

      References:

      1. Virmani, G., D’almeida, P., Nandi, A. & Marathe, S. Subfield-specific Effects of Chronic Mild Unpredictable Stress on Hippocampal Astrocytes. doi:10.1101/2020.02.07.938472.
      2. Czéh, B., Simon, M., Schmelting, B., Hiemke, C. & Fuchs, E. Astroglial plasticity in the hippocampus is affected by chronic psychosocial stress and concomitant fluoxetine treatment. Neuropsychopharmacology 31, 1616–1626 (2006).
      3. Musholt, K. et al. Neonatal separation stress reduces glial fibrillary acidic protein- and S100beta-immunoreactive astrocytes in the rat medial precentral cortex. Dev. Neurobiol. 69, 203–211 (2009).
    1. Note: This response was posted by the corresponding author to Review Commons. The content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Overall, we were pleased that the reviewers found our study carefully designed and interesting. We have addressed their comments below.

      Reviewer #1 (Evidence, reproducibility and clarity (Required)):

      The manuscript by Kern, et al., demonstrates that phagocytosis in macrophages is regulated in part by the intermolecular distance of phagocytosis-promoting receptors engaging phagocytic targets. Cells expressing chimeric receptors containing cytosolic domains of Fc receptors (FcR) and defined ligand-binding DNA domains were used to drive phagocytosis of opsonized glass beads coated with complementary DNA ligands of defined spacing and number. These so-called origami ligands allowed manipulation of receptor spacing following engagement, which allowed the demonstration that tight spacing of ligands (7 nm or 3.5 nm) optimized signaling for phagocytosis. The study is carefully performed and convincing. I have a few technical concerns and minor suggestions.

      1. __ It is assumed that the origami preparations were entirely uniform. How much variation was there? Is that supported by TIRF microscopy of origami preparations? Was the TIRF microscopy calibrated for uniformity of fluorescence (ie., shade correction)?__ Our laboratory, Dong et al., has extensively characterized the origami uniformity and robustness of these exact pegboards. This paper was just posted on bioRxiv (Dong et. al, 2021). We have also cited this paper in our revised manuscript in reference to the characterization of the DNA origami (Line 117).

      We did not use any shade correction. Instead we only collected data from a central ROI in our TIRF field. To check for uniformity of illumination, we plotted the origami pegboard fluorescent intensity along the x and y axis. We observed very modest drop off in signal - the average signal intensity of origamis within 100 pixels of the edge is 76 ± 6% the intensity of origamis in a 100 pixel square in the center of the ROI. Fitting this data with a Gaussian model resulted in very poor R values. While this may account for some of the variation in signal intensity at individual points, we expect the normalized averages of each condition to be unaffected. We have amended the methods to describe this strategy (Lines 851-854).

      (Image could not be uploaded)

      __ Likewise, how much variation was there in the expression of the chimeric receptors? Large variation in receptor numbers per cell could significantly alter the quantitative studies. Aside from the flow sorting for cells expressing two different molecules, how were cells selected for analysis?__

      We thank the reviewer for bringing up this point. We confirmed comparable receptor expression levels at the cell cortex of the DNA CAR-𝛾 and the DNA CAR-adhesion used throughout the paper. We also have confirmed that receptor levels at the cell cortex were similar for the large DNA CAR constructs used in Figure 6C-D. This data is now included in Figures S5 and S7. We have also altered the text to include this (lines 169-172):

      Expression of the various DNA CARs at the cell cortex was comparable, and engulfment of beads functionalized with both the 4T and the 4S origami platforms was dependent on the Fc𝛾R signaling domain (Figure S5).

      When quantifying bead engulfment, cells were selected for analysis based on a threshold of GFP fluorescence, which was held constant throughout analysis for each individual experiment. We have amended the “Quantification of engulfment” methods section to convey this (lines 921-923).

      __ The scale of the origami relative to the cells is difficult to discern in Figures 2C and D. Additional text would be helpful to indicate, for example, that the spots on the Fig. 2D inset indicate entire origami rather than ligand spots on individual origami particles.__

      Thank you for pointing this out, we see how the legend was unclear and have corrected it (lines 453-454), including specifically noting “Each diffraction limited magenta spot represents an origami pegboard.” We have also outlined the cell boundary in yellow to make the cell size more clear.

      __ Figure 5 legend, line 482: How was macrophage membrane visualized for these measurements?__

      We have added the following clarification (line 535-536): “The macrophage membrane was visualized using the DNA CAR𝛾, which was present throughout the cell cortex.”

      __ line 265: "our data suggest that there may be a local density-dependent trigger for receptor phosphorylation and downstream signaling". This threshold-dependent trigger response was also indicated in the study of Zhang, et al. 2010. PNAS.__

      The Zhang et al. study was influential in our study design, and we wish to give the appropriate credit. Zhang et al. found that a sufficient amount of IgG is necessary to activate late (but not early) steps in the phagocytic signaling pathway. In contrast, our study addresses IgG concentration in small nanoclusters. We find that this nanoscale density affects receptor phosphorylation. Thus, we think these two studies are distinct and complementary.

      Lines 283-287 now read:

      While this model has largely fallen out of favor, more recent studies have found that a critical IgG threshold is needed to activate the final stages of phagocytosis (Zhang et al., 2010). Our data suggest that there may also be a nanoscale density-dependent trigger for receptor phosphorylation and downstream signaling.

      __ line 55: Rephrase, “we found that a minimum threshold of 8 ligands per cluster maximized FcgR-driven engulfment.” It is difficult to picture how a minimum threshold maximizes something.__

      We now state “we found that 8 or more ligands per cluster maximized FcgR-driven engulfment.”

      __ line 184: Rephrase, "we created... pegboards with very high-affinity DNA ligands that are predicted not to dissociate on a time scale of >7 hr". Remove "not".__

      Thank you for pointing this out, it is now correct.

      Reviewer #1 (Significance (Required)):

      This study provides a significant advance in understanding about the molecular mechanisms of signaling for particle ingestion by phagocytosis.

      --

      Reviewer #2 (Evidence, reproducibility and clarity (Required)):

      The manuscript on “Tight nanoscale clustering of Fcg-receptors using DNA origami promotes phagocytosis" studies how clustering and nanoscale spacing of ligand molecules for a chimeric Fcg-receptors influence the phagocytosis of functionalized silicon beads by macrophage cell lines. The basis of this study is the design of a chimeric Fc-receptor (DNA-CARg) comprising an extracellular SNAP-tag domain that can be loaded with single-stranded (ss) DNA, the transmembrane part of CD86 and the cytosolic part of the Fc-receptor g-chain containing an immunoreceptor tyrosine-based activation motif (ITAM) as well as a C-terminal green fluorescent protein (GFP). As control the authors used a similar designed DNA-CAR that is lacking the intracellular ITAM-containing FCg tail. The chosen target for this chimeric DNA-CAR, are silicon beads covered by a lipid bilayer that contains biotin-labelled lipids that, via Neutravidin, can be loaded with a biotinylated DNA origami pegboard displaying complimentary ss-DNA as ligand for the DNA-CAR. The DNA origami pegboard contains four ATTO647N fluorescence for visualization and the ssDNA ligand in different quantities and spacing. Using these principles, the authors study how ligand affinity, concentration and spacing influence the activation of the DNA-CARg and the engulfment of the loaded beads.

      The authors show that bead engulfment is increased between 2 till 8 ssDNA ligands on the pegboard. After this, ligand numbers do not play a role anymore in the engulfment. They then study the role of the ligand spacing using pegboards that either contain 4 single strand DNA ligands in close (7nm/3,5nm) proximity or a more spaced version using 21/17,5 nm or 35/38,5 nm. The authors find that the bead engulfment is maximally and positively affected by the close spacing of the ssDNA ligands. In their final experiments the authors vary the design of the DNA-CARs by tetramerization of the ITAM-containing Fcg-signaling subunit. In their discussion the authors mention different possibilities for the effect of spacing on the engulfment process.

      I think that, in general, this is an interesting study. However, it has some caveats and open issues that should be clarified before its publication.

      **Major comments**

      1. __ As a general comment, it is somewhat a pity that the authors did not use the endogenous FcR as a control. It would have been quite easy for the authors to place the SNAP-tag domain on the Fcg extracellular domain which would allow to do all their experiments in parallel, not only with the DNA-CAR, but also with a DNA-containing wild type receptor. Such a control would be important because, by using a CD86 transmembrane domain, the authors do not know whether the nanoscale localization of their chimeric receptors is reflecting that of the endogenous Fcg receptor.__

      We agree with the reviewer completely. We have repeated experiments shown in Figure 4A with a DNA-CAR containing the Fc𝛾 transmembrane domain instead of CD86 as the reviewer suggests. We also included a DNA-CAR version of the Fc𝛾R1 alpha chain, although this construct was not expressed as well as the others. These data are now included in Figure S5, and referenced in lines 167-168.

      __ An important issue that is discussed by the authors but not addressed in this manuscript is whether the different amount and spacing of the ligand is only impacting on signaling or also on the mechanical stress of the cells. Indeed, mechanical stress on the cytoskeleton arrangement could influence the engulfment process. For this, it would be very important to test that the different bead engulfment, for example, those shown in Fig. 4, is strictly dependent on signaling kinases. The authors should repeat the experiment of Fig. 4 a and b in the presence or absence of kinase inhibitors such as the Syk inhibitor R406 or the Src inhibitor PP2 to show whether the different phase of engulfment is dependent on the signaling function of these kinases. This crucial experiment is clearly missing from their study.__

      We agree this is an interesting point. We find that ligand spacing affects receptor phosphorylation; however this does not preclude effects on downstream aspects of the signaling pathway. We will clarify this by adding the following comment to the manuscript (line 299-301):

      While our data pinpoints a role for ligand spacing in regulating receptor phosphorylation, it is possible that later steps in the phagocytic signaling pathway are also directly affected by ligand spacing.

      The DNA-CAR-adhesion in Figure 1 strongly suggests that intracellular signaling is essential for phagocytosis. We have now included additional controls using this construct as detailed in our response to point 3 below. Unfortunately, Src and Syk inhibitors or knockout abrogate Fc𝛾R mediated phagocytosis (for example, PMIDs 11698501, 9632805, 12176909, 15136586) and thus would eliminate phagocytosis in both the 4T and 4S conditions. This precludes analysis of downstream steps in the phagocytic signaling pathway.

      __ Another problem of this study is that the authors show in Fig. 1A the control DNA-CAR-adhesion but then hardly use it in their study. For example, the crucial experiments shown in Fig. 4 should be conducted in parallel with DNA-CAR-adhesion expressing macrophage cells. This study could provide another indication whether or not ITAM signaling is important for the engulfment process.__

      We have added this control. It is now included in Figure S5 and S7. Figure 3D also shows that the DNA-CAR-adhesion combined with the 4T origami pegboards does not activate phagocytosis and we have amended the text to make this more clear (line 152).

      __ Another important aspect is how the concentration of the loaded origami pegboard is influencing the engulfment process. In particular, it would be interesting to show the padlocks with different spacings such as the 4T closed spacing versus 4s large spacing show a different dependency on the concentration of this padlock loading on the beads. This would be another important experiment to add to their study.__

      We agree that this is an interesting question. We suspect that at a very high origami density, 4S signaling would improve, and potentially approach the 4T. However, we are currently coating the beads in saturating levels of origami pegboards. Thus we cannot increase origami pegboard density and address this directly.

      **Minor comments:**

      1. __ The definition of the ITAM is Immunoreceptor Tyrosine-based Activation Motif and not "Immune Tyrosine Activation Motif" as stated by the authors.__ We have corrected this.

      __ The authors discuss that it is the segregation of the inhibitory phosphatase CD45 from the clustered Fc receptors is the major mechanism explaining their finding that 4T closed spacing is more effective than 4s large spacing. With the event of the CRISPR/Cas9 technology it is trivial to delete the CD45 gene in the genome of the RAW264.7 macrophage cell line used in this study and I am puzzled why they author are not conducting such a simple but for their study very important experiment (it takes only 1-2 month to get the results).__

      This experiment may be informative but we have two concerns about its feasibility. First, CD45 is a phosphatase with many different roles in macrophage biology, including activating Src family kinases by dephosphorylating inhibitory phosphorylation sites (PMID 8175795, 18249142, 12414720). Second, CD45 is not the only bulky phosphatase segregated from receptor nanoclusters. For example, CD148 is also excluded from the phagocytic synapse (PMID 21525931). CD45 and CD148 double knockout macrophages show hyperphosphorylation of the inhibitory tyrosine on Src family kinases, severe inhibition of phagocytosis, and an overall decrease in tyrosine phosphorylation (PMID 18249142). CD45 knockout alone showed mild phenotypes in macrophages. We anticipate that knocking out CD45 alone would have little effect, and knocking out both of these phosphatases would preclude analysis of phagocytosis. Because of our feasibility concerns and the lengthy timeline for this experiment, we believe this is outside of the scope of our study.

      In our discussion, we simplistically described our possible models in terms of CD45 exclusion, as the mechanisms of CD45 exclusion have been well characterized. This was an error and we have amended our discussion to read (lines 335-343):

      As an alternative model, a denser cluster of ligated receptors may enhance the steric exclusion of the bulky transmembrane proteins like the phosphatases CD45 and CD148 (Bakalar et al., 2018; Goodridge et al., 2012; Zhu, Brdicka, Katsumoto, Lin, & Weiss, 2008).

      Reviewer #2 (Significance (Required)):

      The innovative part of this study is the combination of SNAP-tag attached, chimeric Fc-receptor with the DNA origami pegboard technology to address important open question on receptor function.

      **Referees cross-commenting**

      I find most of my three reviewing colleagues reasonable

      I also agrée to Reviewer #1 comments 2

      Likewise, how much variation was there in the expression of the chimeric receptors? Large variation in receptor numbers per cell could significantly alter the quantitative studies. Aside from the flow sorting for cells expressing two different molecules, how were cells selected for analysis?

      But I want to add it is not only the amount of receptors but ils the nanoscale location that is key to receptor function

      We have ensured that all receptors are trafficked to the cell surface. We have also measured their intensity at the cell cortex as discussed in response to Reviewer 1.

      Reviewer #3 (Evidence, reproducibility and clarity (Required)):

      This is a very nicely done synthetic biology/biophysics study on the effect of ligands spacing on phagocytosis. They use a DNA based recognition system that the group has previously use to investigate T cell signaling, but express the SNAP tag linked transmembrane receptor in a macrophage cell line and present the ligands using DNA origami mats to control the number and spacing of complementary ligands that are designed to be in the typical range for low or high affinity FcR, a receptor that can trigger phagocytosis. The study offers some very nice quantitative data sets that will be of immediate interest to groups working in this area and, in the future, for design of synthetic receptors for immunotherapy applications. Other groups are working on similar platform for TCR. I don't feel there is any need for more experiments, but I have some questions and suggestions. Answering and considering these could clarify the new biological knowledge gained.

      We thank the reviewer for their support of our manuscript. Given the reviewer’s statement that no new experiments are required, we have answered their questions to the best of our ability given the current data. Should the editor decide that any of these topics require experimental data to enhance the significance of the paper, we are happy to discuss new experiments.

      Reviewer #3 (Significance (Required)):

      I think the significance would be increased by addressing these questions, that would help understand how the synthesis system described related to other system directed as similar questions and more natural settings.

      1. __ The densities of the freely mobile DNA ligands required to trigger phagocytosis is quite high. Was the length of the DNA duplexes optimized? The entire complex for both the intermediate and high affinity duplexes seems quite short, perhaps The extracellular domain of the DNA-CAR (SNAP tag and ssDNA strand) are approximately 10 nm (PMID 28340336). The biotinylated ligand ssDNA is attached to the bilayer via neutravidin, resulting in a predicted 14 nm intermembrane spacing. The endogenous IgG FcR complex is 11.5 nm. Bakalar et al (PMID 29958103) tested the effect of antigen height on phagocytosis and found that the shortest intermembrane distance tested (approximately 15 nm) was the most effective. As the reviewer notes, the optimal distance between macrophage and target may be larger than our DNA-CAR. However we think the intermembrane spacing in our system is within the biologically relevant range.

      We saw robust phagocytosis at 300 molecules/micron of ssDNA, which is similar to the IgG density used on supported lipid bilayer-coated beads in other phagocytosis studies (PMID 29958103, 32768386). As the reviewer noticed, this is significantly higher than ligand density necessary to activate T cells (PMID 28340336). We have added a comment on ligand density to lines 96-97.

      __ Are the origami mats generally laterally mobile on the bilayers. If so, what is the diffusion coefficient? Can one detect the mats accumulating in the initial interface between the bead and cell, particularly in cased where there is no phagocytosis? Would immobility of the mats make them more efficient at mediating phagocytosis compared to the monodispersed ligands, which I assume are highly mobile and might even be "slippery".__

      We have confirmed that our bead protocol generally produces mobile bilayers, where his-tagged proteins can freely diffuse to the cell-bead interface (see accumulation of a his-tagged FRB binding to a transmembrane FKBP receptor at the cell-bead synapse below). We can qualitatively say that the origamis appear mobile on a planar lipid bilayer (see Dong et. al 2021 and images below). Directly measuring the diffusion coefficient on the beads is extremely difficult because the beads themselves are mobile (both diffusing and rotating), and cannot be imaged via TIRF. We do not see much accumulation of the origami at cell-bead synapses. This could reflect lower mobility of the origamis, or could be because the relative enrichment of origamis is difficult to detect over the signal from unligated origamis.

      Overall, we expect the origami pegboards (tethered by 12 neutravidins) are less mobile than single strand DNA (tethered by a single neutravidin, supported by qualitative images below). We are uncertain whether this promotes phagocytosis. At least one study suggests that increased IgG mobility promotes phagocytosis (PMID 25771017). However, the zipper model would suggest that tethered ligands may provide a better foothold for the macrophage as it zippers the phagosome closed (PMID 14732161). Hypothetically, ligand mobility could affect signaling in two ways - first by promoting nanocluster formation, and second by serving as a stable platform for signaling as the phagosome closes. Since our system has pre-formed nanoclusters, the effect of ligand mobility may be quite different than in the endogenous setting.

      (Image could not be uploaded)

      In the above images, a 10xHis-FRB labeled with AlexaFluor647 was conjugated to Ni-chelating lipids in the bead supported lipid bilayer. The macrophages express a synthetic receptor containing an extracellular FKBP and an intracellular GFP. Upon addition of rapamycin, FRB and FKBP form a high affinity dimer, and FRB accumulates at the bead-macrophage contact sites.

      (Image could not be uploaded)

      In the above images, single molecules were imaged for 3 sec. The tracks of each molecule are depicted by lines, colored to distinguish between individual molecules. The scale bar represents 5 microns in both panels.

      __ Breaking down the analysis into initiation and completion is interesting. When using the non-signalling adhesion constructs, would they get to the initiation stage or would that attachment be less extensive than the initiation phase.__

      This is an interesting question. While we did not include the DNA-CAR-adhesion in our kinetic experiments, we have now quantified the frequency of cups that would match our ‘initiation’ criteria in 3 representative data sets where macrophages were fixed after 45 minutes of interaction with origami pegboard-coated beads. We found that an average of 16/125 of 4T beads touching DNA-CAR-adhesion macrophages met the ‘initiation’ criteria and an average of 2/125 were eaten (14% total). In comparison, we examined 4T beads touching DNA CAR𝛾 macrophages and found that on average 23/125 met the ‘initiation’ criteria, and 45/125 were already engulfed (54%). This suggests that the DNA-CAR-adhesion alone may induce enough interaction to meet our initiation criteria, but without active signaling from the FcR this extensive interaction is rare. We have added this data in a new Figure S6 and commented on this in lines 213-215.

      __ It would be interesting to put these results in perspective of earier work on spacing with planar nanoarrays, although these can't be applied to beads. For integrin mediated adhesion there was a very distinct threshold for RGD ligand spacing that could be related to the size of some integrin-cytoskeletal linkers (PMID: 15067875). On the other hand, T cell activation seemed more continuous with changes in spacing over a wide range with no discrete threshold (PMID: 24117051, 24125583) unless the spacing was increased to allow access to CD45, in which case a more discrete threshold was generated (PMID: 29713075). The results here for phagocytosis with the very small ligands that would likely exclude CD45 seems to be more of a continuum without a discrete threshold, although high densities of ligand are needed. This issue of continuous sensing vs sharp threshold is biologically interesting so would be good assess this by as consistent standards are possible across systems.__

      We agree that this is an interesting body of literature worth adding to our discussion. We have added a paragraph that puts our study in the context of prior work on related systems, including these nanolithography studies (Line 364-382):

      How does the spacing requirements for Fc𝛾R nanoclusters compare to other signaling systems? Engineered multivalent Fc oligomers revealed that IgE ligand geometry alters Fcε receptor signaling in mast cells (Sil, Lee, Luo, Holowka, & Baird, 2007). DNA origami nanoparticles and planar nanolithography arrays have previously examined optimal inter-ligand distance for the T cell receptor, B cell receptor, NK cell receptor CD16, death receptor Fas, and integrins (Arnold et al., 2004; Berger et al., 2020; Cai et al., 2018; Deeg et al., 2013; Delcassian et al., 2013; Dong et al., 2021; Veneziano et al., 2020). Some systems, like integrin-mediated cell adhesion, appear to have very discrete threshold requirements for ligand spacing while others, like T cell activation, appear to continuously improve with reduced intermolecular spacing (Arnold et al., 2004; Cai et al., 2018). Our system may be more similar to the continuous improvement observed in T cell activation, as our most spaced ligands (36.5 nm) are capable of activating some phagocytosis, albeit not as potently as the 4T. Interestingly, as the intermembrane distance between T cell and target increases, the requirement for tight ligand spacing becomes more stringent (Cai et al., 2018). This suggests that IgG bound to tall antigens may be more dependent on tight nanocluster spacing than short antigens. Planar arrays have also been used to vary inter-cluster spacing, in addition to inter-ligand spacing (Cai et al., 2018; Freeman et al., 2016). Examining the optimal inter-cluster spacing during phagosome closure may be an interesting direction for future studies.

      --

      Additional experiments performed in revision

      In addition to these reviewer comments, we have added additional controls validating the DNA-CAR-4x𝛾 used in Figure 6c,d. We compared the DNA-CAR-4x𝛾 to versions of the DNA-CAR-1x𝛾-3x𝛥ITAM construct with the functional ITAM in the second and fourth positions (see the schematics now included Figure S7). We found that four individual receptors with a single ITAM each were able to induce phagocytosis regardless of which position the ITAM was in. However the DNA-CAR-4x𝛾 construct, which also contains 4 ITAMs, was not. This further validates the experiment presented in 6c,d. We also fixed minor errors we discovered in the presentation of data for Figures 1C and S1A.

    1. Note: This response was posted by the corresponding author to Review Commons. The content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      __Reviewer #1: __ __ **Major concerns:**

      1) This manuscript has some overlap with another manuscript from the same group recently submitted to EMBO Reports. Although I believe both manuscripts have sufficient elements to justify publication of two papers, I strongly recommend that these publications are made back-to-back and they should be discussed in context with one-another.

      __

      We agree that this manuscript is distinct from but highly complementary to our manuscript on innate immunity in the long-lived mitochondrial mutants, which has been invited for revision at EMBO Reports. According to this suggestion, we have arranged for these papers to be considered for publication at the same time in EMBO Reports and Life Science Alliance. We have updated the discussions of both manuscripts to incorporate the findings of the other manuscript.

      __ 2) How is ATFS-1 function regulated in long-lived worms or under multiple stress conditions? Is there a common regulator such as oxidative stress or mitochondrial dysfunction? Both manuscripts would benefit from a clear understanding on how ATFS-1 is controlled under conditions where mitochondrial function is altered. Is mitoUPR required for this activation? If so, is mitoUPR upregulated in all interventions where ATFS-1 has been shown to play a role in stress response. __

      We have previously used a reporter strain to determine which external stressors activate ATFS-1. The reporter strain has a transgene that links the promoter of the ATFS-1 target gene hsp-6 to GFP (Phsp-6::GFP) such that these worms exhibit increased fluorescence whenever ATFS-1 is activated. After exposing these worms to heat, cold, osmotic stress, anoxia, oxidative stress, starvation, ER stress and bacterial pathogens, we only observed increased fluorescence after exposure to oxidative stress (Dues et al. 2016, Aging). Here, we show that constitutive activation of ATFS-1 results in increased resistance not only to oxidative stress but also ER stress, osmotic stress, anoxia and bacterial pathogens (fast kill assay). Thus, ATFS-1 activation does not just protect against stresses that lead to its activation. Notably, the constitutively active atfs-1 mutants (et15 and et17) exhibit activation of the mitoUPR under unstressed conditions (e.g. upregulation of hsp-6 in Fig. 1A; increased fluorescence of hsp-6 and hsp-60 reporter strains in Rauthan et al. 2013, PNAS; upregulation of many other stress pathway target genes Fig. 2). It is likely that the activation of the mitoUPR and downstream stress response pathways under unstressed conditions results in the increased resistance to stress that we observe. We have included these points in the revised manuscript.

      __Is there any intervention that controls longevity and does not trigger ATFS-1 response?

      __

      When we compared RNA-seq data on a panel of long-lived mutants representing multiple pathways of lifespan extension to ATFS-1 target genes (defined as genes that are upregulated by spg-7 RNAi in an ATFS-1 dependent manner from Nargund et al. 2012, Science), we found that seven of the nine long-lived mutants that we examined showed enrichment of ATFS-1 target genes (clk-1, isp-1, nuo-6, daf-2, glp-1, ife-2) while two did not (eat-2, osm-5) (Fig. 5). Interestingly, in six of these seven strains (all except ife-2), there is an increase in reactive oxygen species (ROS) that contributes to their longevity (treatment with antioxidants decreases their lifespan; Yang and Hekimi 2010, PLoS Biology; Zarse et al. 2012, Cell Metabolism; Wei and Kenyon 2016, PNAS). This observation is consistent with the idea that ROS/oxidative stress is sufficient to activate ATFS-1/mitoUPR. We have previously shown that exposure to a mild heat stress (35°C, 2 hours) or osmotic stress (300 mM, 24 hours) can extend lifespan but does not increase expression of the ATFS-1 target gene hsp-6 (Dues et al. 2016, Aging). Thus, there are multiple examples in which a genetic mutation or intervention increases longevity but does not trigger upregulation of ATFS-1 target genes. We have updated the manuscript to include these points.

      __3) In Fig. 3, some of these genes appear to be unspecifically associated with different stressors. Therefore, it is difficult to rule out the participation of ATFS-1 in specific stress responses without looking at specific stress-responsive genes or a wider range of genes. For example, the conclusion that ATFS-1 does not control osmotic stress gene expression response comes from looking at 3 genes: sod-3, gst-4 and Y9C9A.8. gst-4 does not appear to be directly controlled by ATFS-1 regardless of the stressor. sod-3 is also upregulated by oxidative stress and Y9C9A.8 by anoxia. On the other hand, somewhat contradicting the authors' conclusions that ATFS-1 does not participate in osmotic stress response based on these 3 genes, ATFS-1 appears to be required for osmotic stress resistance.

      __

      In this experiment, we treated wild-type and atfs-1 deletion mutants with six different stressors (oxidative stress, bacterial pathogens, heat stress, osmotic stress, anoxia, and ER stress), isolated mRNA and then examined the expression of 14 different stress response genes. To select these genes, we chose a combination of the most established target genes of the stress response pathways that we examined in Figures 1/2, and genes that we had previously shown to be upregulated by specific stresses using fluorescent reporter strains (Dues et al. 2016, Aging). These genes included hsp-6, hsp-4, hsp-16.2, sod-3, gst-4, nhr-57, Y9C9A.8, trx-2, ckb-2, gcs-1, sod-5, T24B8.5, clec-67 and dod-22. To determine if ATFS-1 is required for gene upregulation in response to any of the six different stressors, we first identified which of these stress genes is significantly upregulated in response to each stressor and then looked to see if this upregulation is reduced or prevented by atfs-1 mutation. We found that there were multiple examples of this for both oxidative stress and bacterial pathogen stress, but not for other stresses. We selected three representative genes to display in Figure 3. Nonetheless, it is possible that there are genes that we didn’t examine that are upregulated by the other four stressors in an ATFS-1-dependent manner. To definitively address this question, one would have to do RNA sequencing on wild-type and atfs-1(gk3094) worms comparing untreated and stressed, but this is beyond the scope of the current manuscript. We have updated the manuscript to include these points, and noted the possibility that there are genes, which we didn’t measure, that are upregulated by the other four stressors in an ATFS-1-dependent manner. We have also included the qPCR data for all 14 genes for each of the six external stressors in Supplemental Figures S3-S8.

      __ **Minor concerns:**

      1) The paragraph starting in line 107 is confusing. They write that "Constitutive activation of ATFS-1 in atfs-1(et 15) and atfs-1(et17) mutants resulted in upregulation of most of the same genes that are upregulated in nuo-6 mutants, except for gst-4" and later they state that "Activating the mitoUPR through the nuo-6 mutation, or through the constitutively-active ATFS-1 mutants did not significantly increase the expression of target genes from the ER-UPR (hsp-4; Fig. 1B) or the cyto-UPR (hsp-16.2; Fig. 1C)." I understand the upregulation of ER-UPR and cyto-UPR is not statistically significant (isn't it for hsp-16.2?), but the first sentence is not accurate if statistics is considered.

      __

      To clarify this, we have modified the first sentence to describe which genes are significantly upregulated in atfs-1(et15) mutants, and separately describe the findings for atfs-1(et17) mutants in the second sentence. The results for hsp-16.2 are not significant because this gene shows highly variable expression between replicates and can be induced 60-fold. We have noted this in the text as well.

      __ 2) The authors should discuss why they think atfs-1(et15) gain-of-function mutant exhibited decreased resistance to chronic oxidative stress, while it is protected from acute oxidative stress. In fact, the et15 allele differs in many aspects in relation to the et17 and in some cases it behaves similarly to the gk3094 loss-of-function allele.

      __

      While atfs-1(et15) and atfs-1(et17) mutants generally show similar results, they also exhibit differences. We previously used RNA sequencing to examine gene expression in these two strains. We found that atfs-1(et15) mutants have far more extensive changes in gene expression than atfs-1(et17) mutants (6227 differentially expressed genes versus 958 differentially expressed genes). It is possible that the et15 mutation is more disruptive to the mitochondrial targeting sequence than et17, thereby resulting in increased nuclear localization and more gene expression changes. The additional gene expression changes in the atfs-1(et15) mutant may contribute to their decreased resistance to chronic oxidative stress. We have included these points in the revised manuscript.

      __ 3) Fig 4I is very similar to Fig. 6A of the other manuscript which strengthen the notion that ATFS-1 is not required (it is rather detrimental) for bacterial pathogen response when no underlying stress (most likely oxidative) occurs.

      __

      Yes, our results indicate that ATFS-1 is not required for wild-type survival of bacterial pathogen exposure. This is consistent with our findings in the other manuscript that baseline expression of innate immunity genes does not depend on ATFS-1 (innate immunity gene expression is similar between wild-type and atfs-1(gk3094) mutants). We have updated the manuscript to emphasize these points.

      __ 4) In the paragraph starting in line 213, the authors conclude that "ATFS-1 is sufficient to protect against oxidative stress, osmotic stress, anoxia, and bacterial pathogens but not heat stress". The results do not unequivocally support a participation of ATFS-1 in oxidative stress or bacterial pathogen response, given the responses vary depending on the allele or condition.

      __

      We have modified this sentence by replacing “activation of ATFS-1 is sufficient to protect” with “activation of ATFS-1 can protect” to indicate that we didn’t observe protection in all cases.

      __ 5) "Combined, this indicates that ATFS-1 does not play a major role in lifespan determination in a wild-type background despite having an important role in stress resistance." It actually does, since ATFS-1 gain-of-function decreases lifespan.

      __

      We have rewritten this sentence to say that constitutive activation of ATFS-1 does not extend lifespan, despite increasing resistance to multiple stresses.

      __

      __

      __ __

      __6) Paragraph starting in line 359 needs to be discussed in light of the results of the other manuscript submitted by the authors to EMBO.

      __

      Combined these two manuscripts indicate that baseline levels of innate immunity are dependent on the p38-mediated innate immune signaling pathway, and not dependent on ATFS-1. This idea is supported by the fact that deletion of atfs-1 does not decrease resistance to bacterial pathogens and does not reduce the expression of innate immunity genes. In contrast, disrupting genes involved in the p38-mediated innate immune signaling pathway does decrease resistance to bacterial pathogens and does decrease the expression of innate immunity genes. We have updated this paragraph to include these points and reference the findings from our manuscript on innate immunity in the long-lived mitochondrial mutants.

      __ 7) In Fig. 1C, it appears that atfs-1 loss of function increases hsp-16.2. Is that significant?

      __

      While there is a strong trend towards increased hsp-16.2 expression in atfs-1(gk3094) mutants, this difference did not reach significance because this gene shows highly variable expression and can be induced 60-fold.

      __ 8) In Fig. 2, 5 and S1, it would be interesting to build one single Venn Diagram with all the lists of genes to see if there are common genes associated with multiple pathways and if there are many ATFS-1 target genes not associated with these classical stress or longevity pathways.

      __

      While we would be very interested in performing this type of visualization, weighted Venn diagrams with more than 3 or 4 groups are challenging to generate and more challenging to interpret. Instead, we have generated an UpSetR plot to demonstrate the number of overlapping genes between each of the stress response pathways, as well as how many ATFS-1 target genes are not involved in stress response. We have included this plot in Figure 2, Panel I. We have also generated simpler figure to show the overlap between pairs of stress response pathways (Figure S1). In addition, we have also added Table S4 with these gene lists.

      __ 9) In Fig. 2, 5 and S1: What are the p values referred to?

      __

      The p-values indicate the significance of the difference between the observed number of overlapping genes between the two gene sets, and the expected number of overlapping genes if the genes were picked at random. We have clarified this in the manuscript.

      __ 10) In paragraph starting in line 85, the authors should include references that evidence the genes are bona fide markers of the stress response pathways.

      __

      We have added references for each of the genes that we examined to link it to the associated stress response pathway.

      __ 11) Tables S2 and S3 are missing. __

      Tables S2 and S3 were uploaded as Excel spreadsheets, not included with the supplemental figures as the other supplementary Tables were. We apologize that these were difficult to locate. In the revision, Table S1 is in the manuscript file, while Table S2 to S6 will be uploaded as separate files.

      __ __

      __Reviewer #2:

      **Major comments:**

      The only major conclusion that I would qualify is "ATFS-1 serves a vital role in organismal survival of acute stresses through its ability to activate multiple stress response pathways"-the data, as presented, does not make clear whether ATFS-1 directly activates these pathways (ie, by binding response elements in genes in those pathways), or indirectly influences them by altering the physiology of the worm).

      __

      We agree that our data does not determine precisely how ATFS-1 acts to modulate the expression of the different stress response pathways. To determine the extent to which ATFS-1 might be able to bind directly to the target genes of other stress response pathways, we have compared the ChIP-seq results for ATFS-1 to ChIP-seq studies for other stress responsive transcription factors (DAF-16, SKN-1, HSF-1, HIF-1, ATF-7). We found that in each case there are sets of genes that can be bound by both transcription factors. This suggests that ATFS-1 may be direct regulating at least some of the target genes from other stress response pathways. We have updated our manuscript to include these points and included the ChIP-seq data comparisons in Figure S2.

      __ **Minor comments:**

      In abstract, consider broadening/re-wording "Gene expression changes resulting from the activation of the mitoUPR are mediated by the transcription factor ATFS-1/ATF-5." Because a naïve reader may understand this to suggest that ATFS-1 is activated only by mitochondrial protein misfolding.

      __

      In this sentence we are describing the role of ATFS-1 in mediating the gene expression changes resulting from the activation of the mitoUPR. We would be happy to modify the sentence if this is unclear.

      __Please indicate whether strains were outcrossed, and how often.

      __

      We have added these details to our materials and methods.

      __ How was "young adult" defined? Were worms synchronized, and if so, how?

      __

      Young adult worms are picked on day 1 of adulthood before egg laying begins. The worms were not synchronized, but picked visually as close to the L4-adult transition as possible. We have added these details to our method section.

      __ For the gene expression experiments, do I understand correctly that FUDR was used only for oxidative stress and adult day 2 experiments? Please clarify.__

      Yes, that is correct. FUdR was used for these samples because (1) with the 2-day duration of this stress, worms can produce progeny which would complicate the collection of the experimental worms; and (2) 4 mM paraquat often results in internal hatching of progeny when FUdR is absent, which might have affected the results. The control worms for the 48-hour 4 mm paraquat stress were also treated with FUdR. We have clarified this in the manuscript and noted that the presence of FUdR has the potential to alter gene expression.

      __ Important: Please make clear how many replicates were performed for each experiment, and where relevant, how many worms were measured per replicate (e.g., stress survival and lifespan). __

      We have added a spreadsheet (Table S6) to include the number of replicates and number of worms per replicate for all experiments.__

      For 2-way ANOVA analyses, please specify p values of both main factors as well as interaction terms and posthoc analyses where relevant.

      __

      We have included these additional details from our statistical analyses in Table S6.

      __ In the second paragraph of the introduction, I suggest broadening slightly the description of why normal mitochondrial function is required for ATFS-1 important and degradation, because this helps the reader understand that any one of many perturbations to mitochondrial function (decreased bioenergetics, membrane potential, protein degradation, protein import; increased ROS; etc.) could prevent or reduce ATFS-1 import and degradation.

      __

      We have added these additional factors that might prevent ATFS-1 import and degradation in paragraph one of our introduction and broadened the description in paragraph two.

      __ For Figure 1: The authors present their choice of genes to analyze as if, and interpret their results assuming, that each of these gene is ONLY regulated by the indicated stress response pathways. I think this is very unlikely. For example: is it certain that sod-3 and trx-2 are not also skn-1 regulated? How is "antioxidant" distinguished from the skn-1 pathway? Further clouding the water is the likelihood that nuo-6 and atfs-1 manipulations alter physiology in such a way that there are secondary/indirect stress pathways activated (for example: the authors show that ATFS-1 overexpression shortens lifespan. Perhaps this is why it appears that ATFS-1 overexpression also appears to cause a strong, although variable, upregulation of the cytosolic UPR?). The likelihood (in my opinion) that these genes are in fact regulated by more than one type of response element, and that the manipulations used to study these relationships have pleiotropic effects, do not invalidate the general conclusion that these pathways interact-but they do mean that the results should be discussed with more caveats regarding HOW they interact.

      __

      These are excellent points. The genes that we selected for Figure 1 are the genetic targets that in our reading of the literature have been most often used to represent a particular stress response pathway. We have added references to justify the association of each gene with the indicated stress response pathway. We have also noted that in at least some cases the stress response genes that have been typically used to represent a specific pathway can be activated by multiple pathways. We agree that the selection of genes for Figure 1 is not a comprehensive approach, and that it is possible that if we chose a different gene from each of these pathways, the results might be different. We have updated our manuscript to specifically note these limitations. To avoid these limitations, we examined the overlap between all of the genes significantly upregulated by ATFS-1 activation and all of the genes significantly upregulated by the different stress response pathways in Figure 2. In addition, to gain a better understanding of the overlap between these different stress response pathways globally, we have compared gene expression between each of the stress response pathways studied in Figure S1.

      __Figure 1 also illustrates why a more detailed description of sample size and statistical analysis should be provided. What was the "n"? What were the main effects and interaction terms of each 2-way ANOVA? The design is not full factorial and therefore does not permit a simple 2-way ANOVA (i.e., not all condition combinations are performed)-which responses precisely were compared to which? Were 2 2-way ANOVAs performed per mRNA?

      __

      For Figure 1 we used a one-way ANOVA to compare all of the groups to wild-type with a Bonferroni’s Multiple Comparison post-hoc test. We have updated the manuscript to include the sample size and statistical details in Table S6.

      __ The work shown in Figure 2 is a very nice way to leverage previous data to further explore this idea of cross-talk. I would suggest including a bit more meta-data in the supplemental data files related to each dataset. For example, what lifestages were used (were they all young adult?), was FUDR used, etc.

      __

      We have added these details to Table S3, which includes the lists of target genes from each stress response pathway.

      __ However, again, I don't understand how the authors can reach this conclusion: "Combined, this indicates that activation of ATFS-1 is sufficient to upregulate genes in multiple stress response pathways." (lines 152-153 but similar phrasing occurs multiple times) Could it not simply be that one form of cellular stress often eventually triggers broader cellular dysfunction, thus activating other cell stress pathways? Ie-how do we know whether these genes are directly regulated by atfs-1 binding regulatory elements, as implied by this phrasing?

      __

      This conclusion is derived from our data showing that constitutively active ATFS-1 mutants have significant upregulation of target genes from multiple stress response pathways (Figure 2). As the worms in those experiments were not exposed to stress, we don’t have reason to believe that they are experiencing cellular stress or dysfunction. We think it is more plausible that activation of ATFS-1, which normally occurs in response to stress, leads to the activation of other stress response pathways, either directly or indirectly, and that these pathways are recruited to help regain mitochondrial homeostasis. We don’t mean to imply that activated ATFS-1 binds directly to the target genes of other stress response pathways. We have clarified this in the revised manuscript.

      __ The stress response experiments are very nicely done and very interesting. I appreciate that the authors did not shy away from describing counterintuitive results (eg et15 mutants showing increased sensitivity to chronic oxidative stress), and think that these results should also be briefly considered in the Discussion.

      __

      We have updated our manuscript to discuss the observation that atfs-1(et15) mutants have increased sensitivity to chronic oxidative stress.

      __

      __

      __ __

      __Figure 3: please report ANOVA interaction terms-these are what tell whether the inductions are in fact dependent on atfs-1 (not the post-hoc analyses). Again, it also appears that in some cases, there is an upregulation of certain genes with atfs-1 knockdown-please report all p-values (because there will be many, I recommend a supplemental table with all main and interaction and posthoc analyses). Again, the "n" also needs to be specified.

      __

      We have added Table S6 to include all of these statistical details.

      __ Figure 4 A-C appear to be lacking error bars? Please add. Perhaps relatedly-the effect size for 4A looks much larger than for 4B, but this does not come across in the text.

      __

      We have added error bars to Figure 4A-C. We think the difference in effect size might result from the fact that 4A is an acute assay and 4B is a chronic assay. We speculate that the negative effect of the et15 and et17 mutations on lifespan might be a stronger factor in the chronic assay. We have updated the text to comment on the relative effect sizes.

      __ For Figures 4 and 6, please indicate sample size-number of independent experimental replicates, and number of worms per replicate (or range per replicate).

      __

      We have added the number of replicates and sample size in Table S6.

      __ Lines 224-225 re. sod-2 mutants: these may also act by decreasing ROS signaling (less conversion of superoxide anon to hydrogen peroxide); also, why would this strain not be considered another long-lived mitochondrial mutant (like clk-1, isp-1 and nuo-6, to which it is contrasted)?

      __

      We think the sod-2 mutation extends lifespan by increasing ROS signaling, as treatment with antioxidants decreases their lifespan. The increased superoxide from the loss of sod-2 may be converted to H2O2 by sod-3 or sod-1, which are also present in the mitochondria. We don’t include sod-2 with the mitochondrial mutants because the mutation does not directly impact the mitochondrial electron transport chain, but may do so secondarily due to elevated ROS.

      __ The confirmation that atfs-1 overexpressing strains are short-lived is very interesting. However, I think this statement "Combined, this indicates that ATFS-1 does not play a major role in lifespan determination in a wild-type background despite having an important role in stress resistance." (lines 265-267 and similar in several places throughout the Discussion, eg line 279) should be altered to indicate that this was observed under controlled laboratory conditions. Eg, "...this indicates that ATFS-1 does not play a major role in lifespan determination in a wild-type background under optimized laboratory conditions..."

      __

      This is an interesting point. It is possible that constitutive activation of ATFS-1 may be beneficial for lifespan in an environment where worms are exposed to external stressors. We have noted that our lifespan results were obtained under lab conditions, which are believed to be relatively unstressful.

      __

      __

      __ __

      __Discussion: consider adding in a consideration of dose-response, both of knockdown of mitochondrial genes (eg, k/d of many mitochondrial genes promotes lifespan at low levels, but decreases lifespan with greater knockdown) and of stressors (chemicals, heat, etc; for chemicals, at the least, dose-response is very important, with low levels not infrequently triggering apparently beneficial stress responses, and higher levels causing toxicity).

      __

      It is possible that the magnitude of ATFS-1 activation will impact its effect on stress resistance and lifespan. Perhaps, a milder activation of ATFS-1 will be more beneficial with respect to lifespan. The degree of ATFS-1 activation may also account for differences that we observe between atfs-1(et15) and atfs-1(et17) mutants. atfs-1(et15) has more differentially expressed genes than atfs-1(et17) suggesting the possibility that it has more ATFS-1 activation. We have updated our manuscript to include these points.

      __ Section beginning on line 384 "ATFS-1 upregulates target genes of multiple stress response pathways"-again, please revise to make clear that this work does not demonstrate direct regulation.

      __

      We have clarified that our results don’t demonstrate direct regulation. In addition, we have examined published ChIP-seq datasets to determine if there is evidence of direct regulation.

      __ It seems to me that our reviews are in pretty good agreement. I agree with Reviewers 1 and 3 where they commented on things that I did not. While I did not consider the manuscripts as overlapping in the sense of being redundant, I very much like Reviewer 1's suggestion that they be published back to back and that the Discussion of each incorporate consideration of the Results of the other.

      __According to this suggestion, we have arranged for these papers to be considered for publication at the same time in EMBO Reports and Life Science Alliance. We have updated the discussions of both manuscripts to incorporate the findings of the other manuscript.

      __ Reviewer #3:

      **Major comments**

      1.The authors mention that activation of the UPRmt by nuo-6 mutants or atfs-1(gf) do not activate the ER UPR or cyto-UPR gene expression targets (lines 111-113). However, they also find that atfs-1(gf) animals have 25% overlap with the ER UPR pathway (line 146-147). Is 25% overlap not substantial?

      __

      The genes that we are referring to in lines 111-113 are the genetic targets that in our reading of the literature have been most often used to represent the ER-UPR or Cyto-UPR. This is not a comprehensive approach, and it is possible that if we chose a different gene from each of these pathways, the result might be different. We have updated our manuscript to include this limitation. To avoid this limitation, we examined the overlap between all of the genes significantly upregulated by ATFS-1 activation and all of the genes significantly upregulated by the ER-UPR or Cyto-UPR in Figure 2. In both cases, we find the overlap is significant, indicating that activation of ATFS-1 leads to activation of ER-UPR and Cyto-UPR target genes.

      __

      __

      __ __

      __To determine whether ATFS-1 mediates any protective effect during ER stress, authors should test atfs-1(gf) and atfs-1(lf) animals' resistance to ER stress.

      __

      To examine the effect of ATFS-1 on resistance to ER stress, we exposed wild-type, atfs-1(gk3094), atfs-1(et15) and atfs-1(et17) worms to 50 µM tunicamycin beginning at young adulthood and monitor survival daily. We found that both constitutively active atfs-1 mutants, et15 and et17, have increased resistance to ER stress compared to wild-type worms, while atfs-1 deletion mutants have a similar survival to wild-type. We have added this new data to Figure 4.

      __ Authors should comment on the difference in outcomes with atfs-1(et17) and atfs-1(et15) animals to chronic oxidative stress (line 184-187).

      __

      We have updated our manuscript to discuss the observation that atfs-1(et15) mutants have increased sensitivity to chronic oxidative stress.

      __ Lines 258-260. The authors should make clear in this section that a previous study had already measured lifespans of atfs-1(gf) animals and found that it was reduced (PMID 24662282). Also, an elaboration on why this experiment was repeated would be warranted.

      __

      We have referenced the lifespan results from this previous study in our introduction (line 53-54, Bennett et al), in our results section (lines 342-343; “which is consistent with a previous study finding shortened lifespan in atfs-1(et17) and atfs-1(et18) worms”) and in our discussion (lines 429-431; “as well as previous results using constitutively active atfs-1 mutants (et17 and et18) show that constitutive activation of ATFS-1 in wild-type worms results in decreased lifespan”). The reasons that we repeated this result are (1) because the lifespan of the atfs-1(et15) mutant had not been measured and this was the allele that we used in our paper; and (2) because the shortened lifespan is a surprising result given the beneficial effect of ATFS-1 on stress resistance, we thought it was important to repeat this experiment under the same conditions that we measured stress resistance.

      __ The authors find that atfs-1(gk3094) animals lived longer during infection with PA14 (line 208-211). Another study found that atfs-1(gk3094) animals died faster on PA14 (PMID 28283579), which should be mentioned and commented on.

      __

      We have added this finding to our discussion. We have also compared the protocols used by Jeong et al. (who observed decreased survival in atfs-1(gk3094) deletion mutants), Pellegrino et al. (who observed wild-type survival in atfs-1(tm4919) deletion mutants and our manuscript (in which we observed slightly increased survival in atfs-1(gk3094) deletion mutants), to see which parameters might account for the observed differences.

      __**Minor comments**

      Line 38: "Inside the mitochondria, ATFS-1 is degraded by the Lon protease CLPP-1/CLP1". The phrasing suggests that CLPP-1/CLP1 is a Lon protease, when in fact they are independent proteases.

      __

      We have removed the word “Lon” to clarify this.

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      Summary:

      The authors carried out experiments, and mine published datasets, to further characterize the role of the ATFS1 transcription factor in mediating survival and lifespan in laboratory or stressed conditions. The role of ATFS-1 was assessed by using a loss-of-function deletion and two constitutive gain-of function mutants in which the mitochondrial leader sequence is not functional, resulting in continual nuclear translocation. The effect of ATFS1 loss or constitutive activation was assessed in both wild-type and mutant (mitochondrial function and long-lived mutants) strains, and either under standard laboratory conditions or in the context of a variety of physical, chemical, and pathogen stressors. Constitutive ATFS-1 activation upregulated genes from a number of stress-response pathways, and the loss of atfs-1 blocked upregulation of some stress-response genes by a variety of exogenous stressors, with little or no effect on baseline expression of those genes. Loss of atfs-1 also increased sensitivity to many exogenous stressors (not all mitochondria-targeting), and overexpression was generally protective. However, overexpression also decreased lifespan in the absence of exogenous stressor.

      Major comments:

      • Are the key conclusions convincing? Mostly, assuming sample size was adequate (see below). The only major conclusion that I would qualify is "ATFS-1 serves a vital role in organismal survival of acute stresses through its ability to activate multiple stress response pathways"-the data, as presented, does not make clear whether ATFS-1 directly activates these pathways (ie, by binding response elements in genes in those pathways), or indirectly influences them by altering the physiology of the worm).
      • Should the authors qualify some of their claims as preliminary or speculative, or remove them altogether? No.
      • Would additional experiments be essential to support the claims of the paper? Request additional experiments only where necessary for the paper as it is, and do not ask authors to open new lines of experimentation. No.
      • Are the suggested experiments realistic in terms of time and resources? It would help if you could add an estimated cost and time investment for substantial experiments. N/A
      • Are the data and the methods presented in such a way that they can be reproduced? Mostly; see below.
      • Are the experiments adequately replicated and statistical analysis adequate? Unclear; see below.

      Minor comments:

      • Specific experimental issues that are easily addressable:

      In abstract, consider broadening/re-wording "Gene expression changes resulting from the activation of the mitoUPR are mediated by the transcription factor ATFS-1/ATF-5." Because a naïve reader may understand this to suggest that ATFS-1 is activated only by mitochondrial protein misfolding. Please indicate whether strains were outcrossed, and how often.

      How was "young adult" defined? Were worms synchronized, and if so, how?

      For the gene expression experiments, do I understand correctly that FUDR was used only for oxidative stress and adult day 2 experiments? Please clarify. Important: Please make clear how many replicates were performed for each experiment, and where relevant, how many worms were measured per replicate (e.g., stress survival and lifespan).

      For 2-way ANOVA analyses, please specify p values of both main factors as well as interaction terms and posthoc analyses where relevant. - Are prior studies referenced appropriately? Yes. - Are the text and figures clear and accurate? Yes. - Do you have suggestions that would help the authors improve the presentation of their data and conclusions?

      Yes:

      In the second paragraph of the introduction, I suggest broadening slightly the description of why normal mitochondrial function is required for ATFS-1 important and degradation, because this helps the reader understand that any one of many perturbations to mitochondrial function (decreased bioenergetics, membrane potential, protein degradation, protein import; increased ROS; etc.) could prevent or reduce ATFS-1 import and degradation.

      For Figure 1: The authors present their choice of genes to analyze as if, and interpret their results assuming, that each of these gene is ONLY regulated by the indicated stress response pathways. I think this is very unlikely. For example: is it certain that sod-3 and trx-2 are not also skn-1 regulated? How is "antioxidant" distinguished from the skn-1 pathway? Further clouding the water is the likelihood that nuo-6 and atfs-1 manipulations alter physiology in such a way that there are secondary/indirect stress pathways activated (for example: the authors show that ATFS-1 overexpression shortens lifespan. Perhaps this is why it appears that ATFS-1 overexpression also appears to cause a strong, although variable, upregulation of the cytosolic UPR?). The likelihood (in my opinion) that these genes are in fact regulated by more than one type of response element, and that the manipulations used to study these relationships have pleiotropic effects, do not invalidate the general conclusion that these pathways interact-but they do mean that the results should be discussed with more caveats regarding HOW they interact.

      Figure 1 also illustrates why a more detailed description of sample size and statistical analysis should be provided. What was the "n"? What were the main effects and interaction terms of each 2-way ANOVA? The design is not full factorial and therefore does not permit a simple 2-way ANOVA (i.e., not all condition combinations are performed)-which responses precisely were compared to which? Were 2 2-way ANOVAs performed per mRNA?

      The work shown in Figure 2 is a very nice way to leverage previous data to further explore this idea of cross-talk. I would suggest including a bit more meta-data in the supplemental data files related to each dataset. For example, what lifestages were used (were they all young adult?), was FUDR used, etc.

      However, again, I don't understand how the authors can reach this conclusion: "Combined, this indicates that activation of ATFS-1 is sufficient to upregulate genes in multiple stress response pathways." (lines 152-153 but similar phrasing occurs multiple times) Could it not simply be that one form of cellular stress often eventually triggers broader cellular dysfunction, thus activating other cell stress pathways? Ie-how do we know whether these genes are directly regulated by atfs-1 binding regulatory elements, as implied by this phrasing?

      The stress response experiments are very nicely done and very interesting. I appreciate that the authors did not shy away from describing counterintuitive results (eg et15 mutants showing increased sensitivity to chronic oxidative stress), and think that these results should also be briefly considered in the Discussion.

      Figure 3: please report ANOVA interaction terms-these are what tell whether the inductions are in fact dependent on atfs-1 (not the post-hoc analyses). Again, it also appears that in some cases, there is an upregulation of certain genes with atfs-1 knockdown-please report all p-values (because there will be many, I recommend a supplemental table with all main and interaction and posthoc analyses). Again, the "n" also needs to be specified.

      Figure 4 A-C appear to be lacking error bars? Please add. Perhaps relatedly-the effect size for 4A looks much larger than for 4B, but this does not come across in the text.

      For Figures 4 and 6, please indicate sample size-number of independent experimental replicates, and number of worms per replicate (or range per replicate).

      Lines 224-225 re. sod-2 mutants: these may also act by decreasing ROS signaling (less conversion of superoxide anon to hydrogen peroxide); also, why would this strain not be considered another long-lived mitochondrial mutant (like clk-1, isp-1 and nuo-6, to which it is contrasted)?

      The confirmation that atfs-1 overexpressing strains are short-lived is very interesting. However, I think this statement "Combined, this indicates that ATFS-1 does not play a major role in lifespan determination in a wild-type background despite having an important role in stress resistance." (lines 265-267 and similar in several places throughout the Discussion, eg line 279) should be altered to indicate that this was observed under controlled laboratory conditions. Eg, "...this indicates that ATFS-1 does not play a major role in lifespan determination in a wild-type background under optimized laboratory conditions..."

      Discussion: consider adding in a consideration of dose-response, both of knockdown of mitochondrial genes (eg, k/d of many mitochondrial genes promotes lifespan at low levels, but decreases lifespan with greater knockdown) and of stressors (chemicals, heat, etc; for chemicals, at the least, dose-response is very important, with low levels not infrequently triggering apparently beneficial stress responses, and higher levels causing toxicity).

      Section beginning on line 384 "ATFS-1 upregulates target genes of multiple stress response pathways"-again, please revise to make clear that this work does not demonstrate direct regulation.

      Significance

      • Describe the nature and significance of the advance (e.g. conceptual, technical, clinical) for the field. The mitoUPR has generally been viewed and tested as an isolated mitochondrial stress-specific response; the authors have built upon previous work to convincingly show that it is integrated with a variety of other stress response pathways. This is an important contribution to the field.
      • Place the work in the context of the existing literature (provide references, where appropriate). The authors have done a nice job of this in their discussion.
      • State what audience might be interested in and influenced by the reported findings. Researchers interested in stress response in general, and mitochondrial homeostasis and stress response in particular, as well as the relation of these to lifespan.
      • Define your field of expertise with a few keywords to help the authors contextualize your point of view. Indicate if there are any parts of the paper that you do not have sufficient expertise to evaluate. Mitochondrial response to exogenous stressors, particularly pollutants.

      Referees cross-commenting

      It seems to me that our reviews are in pretty good agreement. I agree with Reviewers 1 and 3 where they commented on things that I did not. While I did not consider the manuscripts as overlapping in the sense of being redundant, I very much like Reviewer 1's suggestion that they be published back to back and that the Discussion of each incorporate consideration of the Results of the other.

    1. Note: This response was posted by the corresponding author to Review Commons. The content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reviewer comments:

      Reviewer #1 (Evidence, reproducibility and clarity (Required)):

      In this paper, the authors examine the relationship between the transcription factor Ribbon, its ribosomal protein gene (RPG) targets, and cell growth during the process of salivary gland tubulogenesis in the Drosophila embryo. This study builds upon previous work they published in 2016 (Loganathan et al., 2016). While the previous study identified RPGs as potential targets of Ribbon from ChIP-Seq analysis, they did not delve into the role of these targets in salivary gland morphogenesis. Here, the authors demonstrate that mutation of ribbon results in decreased cell volumes via immunostaining and image analysis. They identify and confirm RPGs as ribbon transcriptional targets using ChIP-SEQ, Microarray data, in situ hybridization, and qRT-PCR. They analyze these targets in an effort to identify a Rib consensus binding sites by MEME and find that Rib binding is not specific using EMSA. They suggest specificity arises from association with transcriptional cofactors. Binding with cofactors was confirmed by CO-IP and in vivo RNAi experiments demonstrated the requirement of these cofactors in mediating changes in cell volume during salivary gland tubulogenesis. They demonstrate that Ribbon regulation of cell growth via transcription of RPGs is not a universal mechanism for Ribbon function, as Ribbon regulates transcription of other genes in the context of tracheal development.

      **Major comments:**

      Results of all experiments are conclusive, and significant numbers of samples were noted for most figure panels. For a few panels the sample number/number of replicates was not noted, and it is recommended that the authors add this information (Figure 1F; 5B,C; 7B).

      Additional experiments are not needed to support the conclusions presented in this work. The data and methods are presented clearly and the statistical analyses performed were appropriate.

      In regard to microarray data, Figure 4E shows fold change as log2 values, but it is unclear if this is the case for Table S2. This should be clarified. The authors note in the text on page 7 that few targets show a greater than 1.5-fold change. Based on Figure 4E, this is a log2 value, and should be specified as such.

      As the Rib antibody was generated in this study, it would be helpful to include data illustrating a confirmation of antibody specificity. This could include Rib antibody staining on rib mutant embryos, or showing a lack of band for ribbon in ribbon mutants on a Western blot. If the specificity has been published elsewhere, please add a reference.

      **Minor Comments:**

      As the microarray data was previously published in Loganathan et al 2016, as mentioned in the results section, this citation should also be included in the Methods section describing the Microarray data.

      In the discussion section on page 15, a list of factors in the gene network are listed. What is viz.?

      Reviewer #1 (Significance (Required)):

      •As described in the introduction, the role of cell growth during embryonic tissue morphogenesis is a relatively unexplored topic. The authors point out that most previous studies describing regulation of tissue growth have focused on the role of mitosis and increased polyploidy, as in the gut (https://doi.org/10.1016/S0925-4773(00)00512-8 ), as primary mechanisms. In the case of the salivary gland, only a single endocycle occurs during embryogenesis and cells are post-mitotic, suggesting another mechanism is at play. This study identifies Ribbon as a mediator of cell growth and demonstrates that Ribbon mediates this function through transcriptional regulation of RPGs. In addition, they identify Ribbon cofactors that are important for salivary gland cell growth and tissue morphogenesis. Interestingly, they find that this mechanism for cell growth may be tissue specific, as Ribbon appears to regulate different genes in the trachea.

      •This work has implications for the regulation of cell growth in other tissues and organisms and would be of broad interest to those studying organ development.

      •In order to contextualize my review, I am a developmental biologist that works with Drosophila.

      **Referees cross-commenting**

      In regard to the comments by reviewer #2: I agree that point # 2 should be addressed to more thoroughly describe the method, but as the authors have looked at DNA Amplification at a time point following the normal endocycle, which occurs at stage 12, and DNA content is not significantly different, I don't think analysis of earlier stages would influence their conclusions.

      Given that the authors do include some RNAi data for RPGs and Trf2, it would enhance the paper further to include M1BP and Dref RNAi data if quality reagents are available as described in point 5. Point 6 can be easily addressed. In regard to point 8, the effects of rib overexpression alone would be interesting to see given the ability of this construct to rescue the phenotype.

      While I think points 3 and 7 are excellent ideas for a follow up study, I think they are outside of the scope of this paper. I do not view point 4 as essential to this study, as the study focuses on the regulation of transcription of the RPGs by Rib.

      In regard to the comments by reviewer #3, I agree that points 1 and 2 should be addressed. It would be extremely difficult to address point #3 by dissecting out the tissue, but it could be addressed via further explanation in the text, as could point #4. I don't think minor points 4-6 need to be addressed, but the minor points 1-3 should addressed to improve the paper. For minor point #3, I would suggest the number of genes be included in Supplementary Table 1.

      As reviewer #1, I think my comments should be addressed to improve the quality and clarity of the paper.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)):

      This paper reported a role for the BTB/POZ-domain transcription factor rib in mediating early cell growth of embryonic salivary gland (SG) cells. the authors show that during tubulogenesis of the salivary glands, rib binds the transcription start site of almost all SG-expressed ribosomal protein gene (RPG) and promotes their transcription, thus providing a material foundation for cell growth. Interestingly, in embryo trachea cells, rib targets do not include RPGs, which indicates that rib may use different mechanisms to regulate cell growth of different organs. In general, this is a well-written, well designed research article with many conclusions well-supported by experimental evidence. Listed below are a few issues (mostly minor/unessential) for the authors to consider.

      **Major comments:**

      1.Although in Figure 1G, the nucleus size is indistinct in rib mutant and wt cells at stage 15 and 16, Figure 1C appeared to look like that the rib mutant nuclei at stage 11, 13 and 14 are significantly smaller than those in wild type cells. The authors need to make sure that the rib phenotype has nothing to do with DNA amplification.

      2.Please describe the details on calculating DNA volume by DAPI staining in the method session.

      3.The authors have demonstrated weak DNA binding ability of Rib, and physical interactions between Rib with the known regulators of RPG transcription (Trf2, M1BP, and Dref), but what is the functional relationships between Rib and the known RPG regulators? e.g., does Rib function to promote DNA binding and transcriptional activity of Trf2, M1BP, and Dref, or vice versa?

      4.To confirm the rib function on RPG translation, it is recommended to examine ribosomal proteins by western, and comparing the total protein content would also be helpful.

      5.As Trf2, M1BP and Dref are physically interacted with Rib, it would be helpful to determine Whether M1BP and Dref knockdown can phenocopy the cell growth deficit observed in rib mutant SGs.

      6.Page12, paragraph 3, "Thus, despite the shared requirement for Rib in embryonic cell growth of both tubular organs, Rib-dependent growth in the trachea is likely through regulation of alternative growth-promoting factors." Please list the potential growth-promoting factors targeted by Rib according to the Chip-seq data, if possible.

      7.It would be interesting to determine whether rib mutation differently affect the secretory function of salivary gland at embryo, larva, pupa or adult stage.

      8.Does Rib overexpression have any effects to SG development? Considering the authors adopted GAL4-UAS system to rescue Rib under Rib-KO, it would be interesting to see if Rib overexpression could cause an opposite overgrowth phenotype.

      Reviewer #2 (Significance (Required)):

      This paper discovered a new mechanism underlying organ-specific cell growth regulation during a specific time-window of animal development, which should be of interest to the field of cell and developmental biology.

      Drosophila genetics; Developmental biology

      **Referees cross-commenting**

      I agree with all the other referees that the comments raised by reviewer #1 should be addressed entirely.

      In regard to the comments by reviewer #3, all of the 4 major points are excellent and should be addressed, but it is okay to address points #3 and 4 by simple explanation or re-wording. I find the minor point #6 is nice to have but not essential, the rest should be addressed.

      In case of my comments (reviewer 2), points #1,2,5,8 should be addressed, others are nice to have.

      Reviewer #3 (Evidence, reproducibility and clarity (Required)):

      In the manuscript "The Ribb-osome: Ribbon boosts ribosomal protein gene expression to coordinate organ form and function" the authors show evidence that Ribbon mediates early cell growth in Drosophila embryonic salivary gland through direct interaction with ribosomal protein genes. The manuscript is well written while presenting novel and solid data. The data could be strengthened by some further analysis and clarification, but none of the issues raised represent major flaws.

      **Key points:**

      1.Cell segmentations: The way the cell segmentations / volume quantifications are presented it is impossible to judge their quality. The authors should provide the extracted geometries as Supplementary Data. The methods could be clearer on how the segmentations for cell and DNA volume were done; were the surfaces done manually, were there any image preprocessing steps etc.? In Figure 7C, it is not clear from the images whether cells or nuclei were segmented. Also, it would strengthen the work if the authors analysed the cell shapes (in particular cell height, and apical cell shape bias), considering that they mention it to be different in the Rib mutant. In addition, it would add to the manuscript if the authors could quantify the volume of the luminal space, of the epithelial layer in wt and mutant, and the bias in tube outgrowth.

      2.The authors show nicely that the rib mutants have a smaller overall cell size, can this be the reason why the secretory tube in figure is smaller? In addition, if the overall size of the mutant and the WT is the same as suggested in figure 1H then why does the mutant larvae in figure 1f appear so much smaller than the WT in the same panel?

      3.In figure 4f the authors see 4 out of 7 RPGs been significantly down-regulated, do they have an explanation for that? Why are not all 7 tested RPGs significantly down-regulated? Can it be that the results will be significantly improved by dissecting the tissue of interest instead of using whole embryos? Finally with what criteria were these 7 genes selected?

      4.The authors state in their manuscript the limitations of the chip-seq and the fact that the 11 unbound RPGs are essentially a technical artifact. I suggest that the authors either perform ChIP on some of these RPGs to prove their point or that they ton down their statements about chip-seq limitations and Rib binding all SG-expressed RPGs

      **Minor points**

      The authors need to clarify in the text what is early and late stage of tubulogenisis.

      In figure 1c the Mipp1 staining is of low quality and although the white lines help the reader on where to focus, noise vs signal is almost indistinguishable. Furthermore, the authors claim that they only take under consideration SG cells that show uniform membrane staining but Figure 1c does not show such uniform staining.

      Figure 1d needs the addition of statistical analysis WT vs rib mutant st12 look very similar.

      In their ChIP-seq data the authors identify 436 peaks that correspond to 413 genes. It is worth to add a pie chart depicting how many of those 413 are RPGs and how may are non-ribosomal.

      Throughout the manuscript the authors exhibit nicely the effects of rib mutants. What happens to the tested genes in panel 4f when rib is overexpressed?

      RPls are known to be involved in size regulation. If the authors use another driver than fkh to express Rib, Rpl19 etc will they still see similar phenotypes or not?

      Figure 7b is hard to follow, the IP panels should be in agreement with the order that they appear in the text e.g., first experiment then controls

      Reviewer #3 (Significance (Required)):

      In the manuscript "The Ribb-osome: Ribbon boosts ribosomal protein gene expression to coordinate organ form and function" the authors show evidence that Ribbon mediates early cell growth in Drosophila embryonic salivary gland through direct interaction with ribosomal protein genes. As I am only vaguely familiar with the field, I would leave it to someone who is closer to judge the advance and relevance. But with the additional quantifications, the paper should be of interest more generally to developmental biologists who are interested in tubulogenesis, and if the authors make the 3D cell geometries available, the work should also be of interest to computational modellers with an interest in epithelial organization as segmented 3D cell geometries are still rare.

      **Referees cross commenting**

      Looking at all 3 referee reports, I find all points made by referee 1 either essential and/or easy to fix. As such, I would insist on all points made.

      With regard to referee 2, I see points 1,5,8 as essential, and point 2 is too easy to do to not request it. The others I would consider nice-to-have, but not essential.

      In case of my own report, I would insist on points 1 & 2. Among the minor points, points 4 & 6 are NOT essential. The others are either important or easy enough to fix.

      I look forward to the views of my colleagues.

      Our response to reviewer comments

      We thank the reviewers for their very positive comments regarding the importance of this paper and for the constructive feedback they have provided. Indeed, we would be delighted to address every suggestion raised, but since we would also like to have this work published in a timely manner, it is quite helpful to have consensus among the three reviewers regarding which changes and experiments are the most important to include. Since all three reviewers felt it important to address all of the comments from Reviewer #1, we will do so. For the comments raised by reviewers #2 and #3, we will follow the consensus opinion and address those comments by changes in the text or by including more experiments. In this revision plan, we also address the comments that were considered to be beyond the scope of the current study.

      Points raised by Reviewer #1

      Include N values for all the figure panels: We will provide sample number information for those panels currently missing that information: Figures 1F; 5B, C; and 7B.

      Microarray fold-change clarification: We will clarify that we are reporting the fold-change values in Table S2. As is standard with Volcano plots for reporting microarray data, Figure 4E is plotted as Log2 data.

      Antibody validation: We will provide a supplemental figure with information about the Rib antiserum and its specificity.

      Add citation regarding the microarray data: We will add the citation referring to the microarray data to the Methods section.

      Uncommon word usage pg 15: We will remove “viz.”—contraction of a Latin phrase “videre licet” to mean “namely” or “specifically”—from the discussion of factors in the gene network, since it was clearly distracting.

      Points raised by Reviewer #2

      Appearance of Nuclei and Calculation of DNA volume: The rib mutant nuclei shown in Fig. 1C depict CrebA staining and were used only for identification of SG secretory cells – we did not measure nuclear volume in these samples. To eliminate any potential confusion, we have re-labelled the last column “3D cell volume”. All of the calculations of nuclear size (as a measure of DNA amplification) were carried out with DAPI-staining as shown In Fig 1G, which revealed no difference between WT and rib mutant SG secretory cells. Measurement of entire nuclear volume is critical, since, in any single focal plane, how much of the nucleus is captured varies. We will provide information detailing how DNA volume was obtained in the methods section.

      SG cell size phenotypes of M1BP and Dref RNAi Knockdowns: We agree with the reviewers that determining if M1BP and Dref SG-specific RNAi also phenocopy the cell growth deficit observed in the rib mutant SGs is a meaningful experiment and could strengthen our conclusions. We will, therefore, perform this experiment. It should be noted, however, that whereas rib and Trf2 do not have significant levels of maternal mRNA or protein, both M1BP and Dref have high levels of both [based on ModEncode data; Flybase]. Thus, it may be challenging to deplete these genes with only SG driven expression of the RNAi constructs.

      List of potential Rib-dependent growth promoting factors in the trachea: In the revised version, we provide the list of candidate growth genes bound by Rib from the tracheal Chip-Seq data as requested by reviewer #2 (and agreed upon by reviewer #1 as important) in the supplement.

      Effects of Rib overexpression on SG cell growth: All of the reviewers agree that testing for a SG secretory cell over-growth phenotype with Rib overexpression is worthwhile and we will do this experiment. Nonetheless, we recognize that we may not see overgrowth phenotypes based on a few observations. Our ChIP-Seq data indicate that Rib binds neither the promoters of ribosomal RNAs [rRNAs; the other essential component of ribosomes] nor the promoters of known rRNA transcription factors. Based on a study from another group, it seems likely that Myc upregulates rRNA expression (Grewal et al., 2005). Correspondingly, myc is transcriptionally upregulated in the embryonic SG (supplemental panel 7C) and myc expression in the SG is independent of rib (i.e. Rib does not bind the myc gene based on the SG ChIP-Seq and myc levels in the embryonic SG do not change in rib null embryos based on microarray and whole mount in situs). Also based on ChIP-Seq, Rib binds its own promoter and, based on qRT-PCR experiments, represses its own expression (Loganathan et al., 2016). Thus, over-expression of Rib with GAL4:UAS driven expression may reduce rib transcription from the endogenous locus. Nonetheless, this experiment is still worth doing.

      Points raised by Reviewer #3

      Information on cell segmentations: In the revised manuscript, we will provide sample 3D views of cell volume quantifications as movie files. In the methods section, we will also make it clear that the surfaces were manually segmented and that no image preprocessing steps were performed. We will also provide the excel spread sheets on size calculations in a supplement. We will provide information in the legend for figure 7 that whole secretory cells were segmented for the calculations done for panel C. The information on cell shapes, apical membrane dynamics, and luminal volumes (including the assessment of developmental dynamics of tube elongation based on live-imaging construction of computational elastic and analytical viscoelastic models) has been presented in previous publications from our lab (Cheshire et al., 2008; Loganathan et al., 2016) and from work in other labs (Blake et al., 1998). We will include this information in the revised discussion and will include the appropriate citations.

      Panel 1F and comment on the apparent smaller size of the rib mutant shown: rib mutant embryos show characteristic head invagination defects along with amioserosa and dorsal closure defects [Bradley and Andrew, 2001]. The partial embryo image in Panel 1F captures the head invagination defect making the embryo appear smaller. We will include images of whole embryos in the revised version to clarify that whole embryo volumes of rib mutants are comparable to WT for the representations shown in Fig. 1F.

      Clarify early vs. late Tubulogenesis: Early SGs are stage 11, 12 – when the SG cells are internalizing. Late SGs are stages 13 – 16, when the glands are fully internalized. We will clarify this in the figure legend.

      Statistics on Panel 1D: We will perform statistical analysis of growth profiles shown in Fig 1D as suggested by the reviewer and include the results in the figure or figure legend.

      Pie-chart for RPG fraction: Given how crowded the figures currently are, instead of providing pie charts, we simply provide the fraction of the bound genes that are RP genes in the text. Using our set cut-off of 4.0: 12.9% of genes bound by Rib (with both drivers) were RP genes. Using the IDR platform for peak calling, 12.8% of bound genes were RP genes. In Fig 4A, we also include genes above the cut-off with one GAL4 driver, but not the other, as described in the legend.

      Effects of Rib Overexpression: As discussed earlier, we will perform this experiment (please also see our response to the last comment by reviewer #2)

      Order of presentation of co-IP results in Panel 7B: As requested, we will reorder the IP results in Fig. 7B as suggested by the reviewer to present first the results from the experiments and then the results from controls in accord with how we discuss the data in the results section.

      Testing the functional relationships between Rib and known RPG regulators: We will not determine if Rib promotes DNA binding and transcriptional activity of Trf2, M1BP, and Dref, as this experiment was considered to not be critical for this paper by any of the three reviewers.

      Panel 4F and tissue-specific RT-qPCR: We agree that it would be ideal to have tissue-specific qRT-PCR, but it is not technically feasible to dissect out enough embryonic SGs for analysis (as acknowledged by Reviewer 1). In future studies, we do plan to get that kind of information from single cell RNA sequencing (scRNA-Seq) of WT and rib mutant embryos, but there are a few hurdles to overcome before those experiments. In selecting the RP genes for qRT-PCR, we chose sample RpL and RpS genes, making sure to include at least one gene (RpS9) that was “not bound” by Rib based on ChIP-Seq criteria.

      Determine Rib function on RPG translation: We will not examine levels of RP proteins by Western since this experiment was deemed be unnecessary for the current study by the three reviewers.

      Effects of rib on the secretory function of the SG at the embryo, larva, pupa, or adult stage: We agree with the reviewer that these data would be interesting to have; as pointed out by reviewer #1, however, it’s a question for a future follow-up study.

      Chip-Seq technical artifact / limitations: We don’t think we are incorrect in suggesting that the failure to detect Rib binding to all RP genes could be a technical artifact because of the following: (1) a direct examination of the binding tracts associated with every RP gene reveals a peak at/near the TSS. The values associated with those peaks do not always reach the cut-off, but when the peak values are lower than the cut-off, the signals in the flanking DNA are often also much lower than average (for details, see Supplemental Figure 1). (2) Among the RP genes whose expression went down significantly by qRT-PCR is RpS9 – an RP gene “not bound” by Rib, based on the cut-offs we followed.

      Using another SG driver: We agree with reviewer #1 that the results obtained using the fkh-GAL4 driver for RNAi of RP regulators and RP genes are robust and sufficient to support the conclusion that Rib binds RPGs to regulate SG secretory cell size. Thus, we will not redo these experiments using another SG driver.

    1. Note: This response was posted by the corresponding author to Review Commons. The content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Manuscript number: RC-2023-02157

      Corresponding author(s): Satish, Mishra

      1. General Statements [optional]

      We thank the editor and reviewers for their helpful comments. We have successfully addressed most of the comments. We are performing some additional experiments as suggested by the reviewers and will be included if considered further. We attempted to pulldown the S14 interacting partner using anti-mCherry antibody from S14-3XHA-mCherry transgenic sporozoites and then further tried to identify interactome using mass spectrometry but failed. So, accordingly, we have toned down the conclusion.

      The point-by-point response to the reviewer’s comments is given as follows.

      2. Description of the planned revisions

      Reviewer #1:

      Figure 1F You have not formally shown that this signal corresponds to palmitoylated S14. Could be heavy chain. Response: The possibility of a heavy chain is negligible because we have used sporozoite samples and probed it with an anti-rabbit antibody conjugated to HRP. Also, the size of the S14 bands does not correspond to heavy chain. However, we have toned down the conclusion. Currently, we are performing the depalmitoylation experiment, and data will be included in the next round of revision.

      Reviewer #2

      Line 149: To definitively state S14 is a membrane protein, biochemical assays proving such should be performed. (or perhaps genetic mutation of the predicted palmitoylation site?) Otherwise, this should be rephrased. Response: We are performing the depalmitoylation assay, and the data will be included during the second round of revision. However, we have rephrased the sentence in the current version of the manuscript.

      Lines 257-258: for yeast 2-hybrid, the controls of expressing S14, GAP45 and MTIP together with control proteins where no interaction would be predicted are absent. Response: We are performing experiments with additional controls, and data will be included in the next round of revision.

      Reviewer #3

      Conclusions that S14 knockout does not impact the expression and organization of two surface proteins, CSP and TRAP, and two IMC rely on a qualitative analysis only. However, quantitative analysis to support their observations is missing. Response: We are quantifying the IFA images and data will be included in the next round of revision.

      3. Description of the revisions that have already been incorporated in the transferred manuscript

      Reviewer #1 (Evidence, reproducibility and clarity (Required)):

      Summary: The authors have identified a sporozoite gliding motility protein through bioinformatic analysis. From the main text I do not know how, or what bioinformatic analysis was performed, in order to focus on this protein which is called S14. The authors then go on to tag the protein, produce a KO and show its involvement in gliding motility. The KO shows that parasites lacking S14 fail to invade the mosquito salivary glands. This is due to a motility defect. Y2H and docking studies are used to define an interaction with MTIP and GAP45, two known components of the glideosome. Response: We identified this gene from the Kaiser et al., 2004 paper (DOI: 10.1046/j.1365-2958.2003.03909.x). The S14 was found to be highly upregulated in salivary gland sporozoites but lacked signal sequence and transmembrane domain. Next, we looked into other sporozoite proteins lacking signal sequence and transmembrane domain and found several gliding-associated proteins with similar properties. By using the guilt-by-association principle (DOI: 10.1186/gb-2009-10-4-104), we studied the following properties of existing glideosome components along with S14: (1) Classical pathway secretion using the signal peptide (SignalP, https://services.healthtech.dtu.dk/services/SignalP-5.0) (http://dx.doi.org/10.1016/j.jmb.2004.05.028). (2) Nonclassical pathway secretion (SecretomeP , https://services.healthtech.dtu.dk/services/SecretomeP-1.0/) (10.1093/protein/gzh037). (3) Presence of transmembrane domains (TMHMM , https://services.healthtech.dtu.dk/services/TMHMM-2.0/) (10.1006/jmbi.2000.4315). (4) Presence of a potential palmitoylation site (CSS-Palm, http://bioinformatics.lcd-ustc.org/css_palm) (Ren et al, 2008). This is a similar association prediction method as employed by the STRING database. However, mentioning that we identified a gliding motility protein by bioinformatic analysis was wrong, and we modified the sentence.

      Major comments: The paper is sometimes hard to follow and lacks clarity. The reason: important information is omitted, or explained at the end of a section rather than at first mention; experimental details that are of essence need to be mentioned or explained in the main text; there is ample use of the word 'bioinformatic' without explaining what kind of analysis was performed in the main text. I cite from the abstract: 'In silico analysis of a novel protein, S14, which is uniquely upregulated in salivary gland sporozoites, suggested its association with glideosome-associated proteins.' I cite from the introduction: 'A study comparing transcriptome differences between sporozoites and merozoites using suppressive subtraction hybridization found several genes highly upregulated in sporozoites and named them 'S' genes (Kaiser et al, 2004). We narrowed it down to a candidate named S14, which lacked signal peptide and transmembrane domains.' From reading the main text, I do not know why Plasmodium berghei S14 was chosen in this manuscript. S14 is one of 25 transcripts identified by Kappe et al in Plasmodium yoelii (https://doi.org/10.1046/j.1365-2958.2003.03909.x) to be upregulated in sporozoites. The material and methods section does not explain either why S14 was chosen. Perhaps the authors could update Figure 2 from Kappe et al with the most recent annotations from plasmodb. Response: We have edited the manuscript for clarity and mentioned the name of the bioinformatic analysis performed. We chose S14 from Kaiser et al., 2004 (https://doi.org/10.1046/j.1365-2958.2003.03909.x) that identified transcripts in P. yoelii. We work on the rodent malaria parasite P .berghei and validated S14 transcripts by qPCR which showed its upregulation in sporozoites.

      Rodent malaria parasites P. berghei and P. yoelii have been used extensively as models of human malaria. Both species have been widely used in studies on the biology of Plasmodium sporozoites and liver stages due to the availability of efficient reverse genetics technologies, and the ability to analyze these parasites throughout the life cycle stages have made these two species the preferred models for the analysis of Plasmodium gene function. A genetic screen and phenotype analysis were performed in P. berghei (DOI: 10.1016/j.cell.2017.06.030 and DOI: 10.1016/j.cell.2019.10.030) that makes in-depth characterization easier due to the availability of reagents and preliminary gene-phenotype like its dispensability in the blood. As suggested by this reviewer, we have updated the most recent annotations from PlasmoDB.

      Reproducibility: None of the main Figures or Figure legends define ' N = '. For example I cite: 'The S14 KO clonal lines were first analyzed for asexual blood-stage propagation, and for this, 200 µl of iRBCs with 0.2% parasitemia was intravenously injected into a group of mice.' There are 2 mentions of 'N=' in the supplementary figures. I have not found any others.

      I'm not sure what the convention is. Should unpublished data for this gene (PBANKA_0605900) found in pberghei.eu (a database for mutant berghei parasites) be cited? After all it confirms their findings.

      The authors need to use more recent references for some of their statements; see some comments below. __Response: __We have mentioned N in the figures legends of the revised manuscript and also mentioned the unpublished data of RMGM. We have also added recent references in the revised manuscript.

      Minor comments:

      line 1-2 Add the Plasmodium species of this study.

      Response: Added.

      abstract Which species do you work with?

      Response: We have mentioned P. berghei in the abstract of the revised manuscript.

      29 mosquito salivary glands and human host hepatocytes

      Response: Corrected.

      30 to the glideosome, a protein complex containing [...]

      Response: Corrected.

      32-33 What kind of in silico analysis suggested S14 is part of the glideosome? S14 is not uniquely upregulated; there are other S-type genes identified by Kappe and Matuschewski. 25 I believe.

      Response: Mentioning that in silico analysis suggested S14 is part of the glideosome was a wrong statement, and we have modified the sentence for clarity in the revised manuscript.

      32 Please point out he species were S genes were identified. SGS of which species?

      Response: The S genes were identified in the transcriptomic study of Plasmodium yoelii.

      34 expression: change to transcription

      Response: Changed.

      39 What kind of in silico analysis was used here? and therefore malaria transmission

      __Response: __In silico, protein-protein docking interaction analysis was used.

      55 A single zygote transforms into a single ookinete, which establishes a single oocyst, which in turn can produce thousands of midgut sporozoites. Please correct the life cycle passage.

      Response: Corrected. located or anchored in the IMC? And located between the IMC and plasma membrane?

      Response: Glideosome is located between the plasma membrane and IMC, and the same has been corrected in the revised manuscript.

      61-63 Refer to Table S1 and its contents here 64 Name the known GAPs. Response: Done.

      65-67 Which transmembrane domain proteins? Please add more recent references than King 1988.

      Response: We have added TRAP as a transmembrane domain protein and updated the reference.

      71-72 TRAP was the first protein found to be ...

      Response: Corrected.

      74-76 Add additional, more recent references: for example search Frischknecht and TRAP

      Response: Added.

      76 S6 (TREP) is also [...]

      Response: Done.

      88 Some of these proteins are also expressed in ookinetes.

      Response: Corrected.

      89-91 The sentence needs a verb.

      Response: Added.

      88-96 Please add some more recent glideosome papers. After 2013.

      Response: Added.

      91 Why do you call it a peripheral protein?

      Response: Because the GAP45 was detected at the periphery of the merozoite in P. falciparum. As there are no such reports in sporozoites hence we have removed peripheral in the revised manuscript.

      91-93 There are more recent citations for GAP45 and GAP50. Response: We have added recent citations.

      96 Insert a reference here.

      Response: Added.

      99 Please define the gliding-associated proteins. What are they? Aren't there papers on GAP40, 45 and 50? DOI: 10.1016/j.chom.2010.09.002

      Response: Done.

      99 .... What prompted you to identify a novel GAP? And why is S14 classified as a GAP?

      Response: This was a wrong statement, which we removed in the revised manuscript.

      99-102 What kind of bioinformatic study? Why was S14 chosen? Please outline how you ended up with S14. Any other proteins that came out of the bioinformatic screen from the list of S genes?

      Response: We identified S14 from the Kaiser et al., 2004 paper and analyzed its properties using the “guilt-by-association” principle. The analysis showed that S14 had properties similar to GAP45 and MTIP. The S14 upregulation in sporozoites and its properties similar to known GAPs, we were prompted to study this gene's function.

      How many proteins were identified in the screen for sporozoite upregulated proteins by Kappe and Matuschewski?

      Response: 25 genes were identified in that paper, including the two characterized genes CSP and TRAP during that study.

      102-103 Define the nonclassical secretion pathway. Please reference GAP45 and GAP50 data for the nonclassical pathway.

      Response: When proteins are secreted out of the cytosol without predictable or known signal sequences or secretory motifs are classified as non-classically secreted proteins, and the pathway is called a non-classical protein secretory pathway. References: https://doi.org/10.1371/journal.pone.0125191; https://doi.org/10.1016/S0171-9335(99)80097-1; doi: 10.3389/fmicb.2016.00194

      105 Please add P. berghei to the title, the abstract, the introduction.

      Response: Added.

      111 The results section does not outline what bioinformatic analysis was used

      Response: The guilt-by-association principle was used, and it is outlined in the revised manuscript.

      112-114 Please specify the exact number of upregulated in sporozoites genes. I think it was 25. And add the species the study was performed in. Why did you choose the Kappe study but not the uis genes from berghei?

      Response: It was 25, and the species was P. yoellli. The domains of all 25 proteins are shown in Figure 2 of Kappe study. It intrigued us after having a glance at it. Later, we confirmed the upregulation of S14 transcripts in P. berghei sporozoites and chose to study the function of this gene.

      114-115 How did you narrow it down to S14? The Kappe paper lists 25 S-type genes from P. yoelii.

      Response: The domains of all 25 proteins are shown in the Kappe study. Two proteins, S14 and S15, lack signal sequence and transmembrane domain, which intrigued us after glancing at them. We chose S14 because its microarray induction is higher compared to S15.

      118 Plasmodia is not the plural for a group of different Plasmodium species. Use: [...] conserved among Plasmodium spp.

      Response: Corrected.

      118-119 Which proteins did you analyze? And how did you analyze them? Where is the data for this analysis? Outline the amino acids that predict palmitoylation? The nonclassical pathway?

      Response: The proteins we analyzed are given in Table S1. We analyzed them by the guilt-by-association principle. The data for this analysis is shown in Table S1. The amino acids predicted to be palmitoylated are C59 and C228 (S14), C5 (GAP45), C8 and C5 (MTIP). Non-classical pathway secretion was predicted by SecretomeP ( 10.1093/protein/gzh037).

      119-122 Here: do you mean S14 has similar properties as GAP 45 and GAP50? Define the nonclassical pathway? How do you know S14 is in the IMC?

      Response: The similar properties of S14 and GAP45 are Signal Peptide Prediction, Prediction of Non-classical pathway secretion, number of predicted transmembrane domains and prediction of Palmitoylation signal. GAP50 was wrongly mentioned here and has been removed from the revised manuscript.

      When proteins are secreted out of the cytosol without predictable or known signal sequences or secretory motifs are classified as non-classically secreted proteins. The pathway is called a non-classical protein secretory pathway.

      Our colocalization data of S14 with GAP45 and MTIP indicated that S14 is in the IMC.

      122-123 Please reference the bioinformatic analysis plus URL that allows targeting to the IMC to be analyzed.

      Response: All the URLs with references are given in the method section, lines 348-358 in the revised manuscript.

      123-124 Please reference the URLs for TM, palmitoylation, and interactions analyses.

      Response: All URLs with references are given in the method section, lines 348-358 in the revised manuscript.

      125-127 How did you predict that S14 is secreted via the nonclassical pathway?

      Response: We predicted non-classical pathway secretion of S14 using - SecretomeP (https://services.healthtech.dtu.dk/services/SecretomeP-1.0/) (10.1093/protein/gzh037).

      128-130 Define the nonclassical pathway when it first appears in your manuscript.

      The citation Moskes 2004 is not in the reference list

      Response: The nonclassical pathway is defined in lines 105-107. The citation Moskes 2004 has been included in the revised manuscript.

      132 Which membrane?

      Response: Live S14-mCherry localization on the membrane does not differentiate between the outer membrane or IMC. Hence, only membrane is mentioned. Next, in Figure 4A, we confirmed S14 localization on IMC by treating sporozoites with Triton X-100 and colocalizing with IMC proteins GAP45 and MTIP.

      134-135 In which species?

      Response: We have mentioned P. berghei in the text in the revised manuscript.

      141-142 Please include images of blood stage and liver stage parasites.

      Response: Blood and liver stage images are included in the revised manuscript as Figure S2.

      142-143 Which membrane?

      Response: Live S14-mCherry localization on the membrane does not differentiate between the outer membrane or IMC. Hence, only membrane is mentioned. Next, in Figure 4A, we confirmed S14 localization on IMC by treating sporozoites with Triton X-100 and colocalizing with IMC proteins GAP45 and MTIP.

      148-149 I cannot find the specific figure you refer to; I checked the online version of the Frenal 2010 paper.

      Response: Electromobility shifts of GAP45 due to the palmitoylation have been reported in (Rees-Channer et al, 2006; DOI: 10.1016/j.molbiopara.2006.04.008). Frenal 2010 paper has stated about two bands but experimentally, it was shown in Rees-Channer et al, 2006 in Figures 1 and 2B.

      175 gland, we counted [...]

      Response: Corrected.

      177 Compared to the

      Response: Corrected.

      177-179 Failed to invade (absolutely)? Or invaded in highly reduced numbers?

      Response: Corrected.

      182-186 Please be precise: I think you mean you let all types of mosquitoes take a blood meal; s14 knockout-infected mosquitoes did not infect mice.

      Response: Corrected.

      181-202 Perhaps use paragraphs to indicate the different types of experiments performed here.

      Response: Done.

      204 Please introduce paragraphs to identify the different experiments in this section

      Response: Done.

      208 Outer or inner membrane of what? IMC, the plasma membrane?

      Response: We treated sporozoites with Triton X-100 to analyze whether S14 is present on the outer membrane (plasma membrane) or IMC.

      228 onwards Structural models were obtained from whom? Which species did you use for the docking study? Could you use in one approach 3 berghei proteins, and confirm your docking studies with the falciparum proteins? That would strengthen your model. Should you include a negative control protein in the approach? Response: The structural models were obtained using the trROSETTA server. We used P. berghei for the docking study. In the old annotation and RMGM, the ortholog of P. berghei (PBANKA_0605900) in P.falciparum (PF3D7_1207400) was indicated. However, the updated PlasmodDB does not show PBANKA_0605900 ortholog in P. falciparum. We did try to generate structure models of P. falciparum MTIP, GAP45 and S14 using the trROSETTA server. We successfully reproduced the structure of MTIP, and GAP45 but the quality of S14 structure was unsuitable for the interaction studies. The negative control cannot be included in this kind of study because it gives a false interface, and none of the previous studies have used negative control.

      250-251 Was all of the gene cloned? Please define amino acid range. discussion

      Response: Full-length gene of S14, MTIP and GAP45 was cloned and the same has been mentioned in materials and methods in the revised manuscript.

      Please discuss data from https://elifesciences.org/articles/77447 in relation to your protein Response: Discussed.

      298-300 More recent glideosome papers exist. For example https://doi.org/10.1038/s42003-020-01283-8

      Response: Included.

      340 List the proteins you analysed. Add URL (websites) to the analyses tools.

      Response: They are listed in Table S1. The method section gives all the URLs with references, lines 348-358 in the revised manuscript.

      343 Known association from the literature: how was this done?

      Response: The interactions demonstrated by different groups have been summarized in the review by Boucher & Bosch, 2015 (doi: 10.1016/j.jsb.2015.02.008).

      346-349 A few glideosome components? On what basis were they selected and which are they? Response: The analysis showed that S14 had properties similar to GAP45 and MTIP. Additionally, S14 localized with GAP45 and MTIP, hence selected for interaction studies.

      471 Can AlphaFold Structure Predictions be used in the docking studies?

      Response: Even the Alphafold AI is trained on existing sequence/structure information despite being advertised as a de novo prediction system. That's why it can't produce good quality structures of evolutionarily unique proteins such as S14. We initially started our protein model generation by alphafold2, but the quality of the structure was very low; then we further used the trRosetta server (https://yanglab.nankai.edu.cn/trRosetta/), which shows the quality of all three protein structures above 95 after validation by using UCLA-DOE LAB-SAVES V6.0 (https://saves.mbi.ucla.edu/).

      tr-Rosetta includes inter-residue distance, orientation distribution by a deep-neural network, and homologous template to improve the accuracy of models (DOI: 10.1038/s41596-021-00628-9).

      We have given the model structure generated using alphafold2 for your reference.

      Model generated by using AlphaFold2.ipynb (https://colab.research.google.com/github/sokrypton/ColabFold/blob/main/AlphaFold2.ipynb#scrollTo=kOblAo-xetgx).

      Structure quality assessment by __http://saves.mbi.ucla.edu/.__

      GAP 45

      __S14 __

      MTIP

      487 What parts of theses genes was cloned? Define the amino acid range.

      Response: The full-length protein-encoding gene was cloned.

      714 Please split the table into A Mosquito bite and B haemolymph Sporozoites Response: Done.

      Figure 1 For clarity, maybe write S14::mCherry

      Response: Done.

      Figure 1 It would be useful to show blood stage parasite images.

      Response: Blood stage parasite image is included in the revised manuscript as Figure S2.

      Figure 2G Haemolymph sporozoites ?

      Response: Done.

      Figure 8 You argued that S14 is a membrane-bound protein through palmitoylation. Here the protein is shown to be cytoplasmic. Please update our model with more recent ones. Response: We have shown that S14 colocalizes with GAP45 and MTIP, suggesting its IMC localization. We have updated our model in Figure 8.

      Figure S2B It would be good to include a positive control for these PCRs.

      Response: We have replaced the figure's new gel with a positive control.

      Figure S3 It would be good to include a positive control for these PCRs. Response: We already have positive controls in Figure S3C and S3F for all the primer pairs used.

      Tabel S1 Table S1 is only mentioned twice in the text: lines 124 and 128. There is no mention that the table contains all (??) known gliding motility proteins.

      Response: The table does not contain all the gliding proteins; however, most of the proteins mentioned in the Boucher & Bosch, 2015 paper (doi: 10.1016/j.jsb.2015.02.008) were included.

      Table S1 The algorithms / websites used for bioinformatic prediction need to be listed here.

      Response: Included.

      Table S2 Add the plasmodb gene identifiers here. The table does not show all Plasmodium spp. but a selection. Response: All the orthologs mentioned in Figure S1 and Table S2 are not shown in the updated PlasmoDB. Accordingly, we have removed the Figure S1 and Table S2 in the revised manuscript__.__

      Reviewer #1 (Significance (Required)):

      General assessment: The authors provide an in-depth analyses of the Plasmodium berghei protein S14 and its involvement in gliding motility. Response: Thank you.

      Advance: This paper is the first analysis of the S14 protein. The authors suggest a bridging function for the protein between MTIP and GAP45. Response: Thank you.

      Audience: Gliding motility is of interest to the apicomplexan field. I think this particular proteins is specific to Plasmodium spp. Response: Thank you.

      Reviewer #2

      Summary:

      The authors tag the sporozoite protein S14 in P. berghei and show localization near the sporozoite plasma membrane. They also convincingly show, through the generation of S14 knockout lines, that S14 is required for sporozoite motility and thereby also salivary gland and hepatocyte invasion. Their bioinformatic results support possible interactions between S14 and the inner membrane complex proteins MTIP and GAP45. These analyses were performed with these specific candidate proteins rather than being unbiased searches for potential interaction partners. The yeast 2-hybrid data to support these possible protein interactions need further controls.

      Lines 143-144: Unless the sporozoites were not permeablized prior to staining, it is not clear if the protein is "on" the plasma membrane or just under the plasma membrane. Furthermore, this statement anyway seems contradictory to the authors' interpretation of Figure 4A. Response: Live S14-mCherry localization on the membrane does not differentiate between the outer membrane or IMC. Next, in Figure 4A, we confirmed S14 localization on IMC by treating sporozoites with Triton X-100 and colocalizing with IMC proteins GAP45 and MTIP. Further, we ensured that mCherrey signals were bleached post-fixation and performed IFA with and without permeabilization. We revealed the mCherry and CSP signals using Alexa 488 and Alexa 594, respectively. We observed the mCherrey signal with permeablized sporozoites, not without permeabilization.

      Line 218: "This result indicates that S14 is present within the inner membrane of sporozoites." While this data shows that S14 is not in the plasma membrane of the parasite, how can the authors be sure it is at the IMC? Response: S14 colocalization with MTIP and GAP45 suggested its localization on IMC.

      Line 225-226: This sentence overreaches in its conclusion. There is no indication that this protein provides the power or force behind the sporozoites forward movement. Several proteins are known to be required for gliding motility, but they are not all force-providing factors. Response: We have modified the sentence, and now it states, ‘These data demonstrate that S14 is an IMC protein, essential for the sporozoite's gliding motility.

      Minor comments:

      Line 99: "the role of gliding-associated proteins is unexplored" There are several publications on GAP40, GAP45 and GAP50 (some of which are referenced in the previous paragraph). Response: We have included the reference for studied proteins and modified the sentence for clarity.

      Line 114: "We narrowed it down to a candidate" Narrowed down how? Or rephrase. Response: We identified the S14 gene from the Kaiser et al., 2004 paper (DOI: 10.1046/j.1365-2958.2003.03909.x) and rephrased the sentence in the revised manuscript.

      Lines 120-123 are strangely written, and I don't follow the logic. What "similar properties" do GAP45 and GAP50 have with S14 and are they really indicative of function? Also if palmitoylation and myristylation and nonclassical secretion are present in most eukaryotes, why would they necessarily be evidence of IMC targeting? Response: It was wrongly written, we have modified the sentence for clarity.

      Line 148-149. I did not see examples of this electromobility shift of GAP45 in this publication (although I may have overlooked it).

      Response: Electromobility shifts of GAP45 due to the palmitoylation have been reported in (Rees-Channer et al, 2006; DOI: 10.1016/j.molbiopara.2006.04.008). Frenal 2010 paper has stated about two bands, but experimentally it was shown in Rees-Channer et al, 2006 in Figure 1 and 2B.

      Table 1 legend should preferably specify that hemolymph sporozoites were used for IV infections. Response: Done.

      Line 228: Should be rephrased for accuracy. "revealed the" should be replaced with "suggests" Response: Replaced.

      Lines 305-307: I don't entirely understand the logic laid out here.

      Response: This was written about GAP45 and MTIP coordination; however, it has been removed in the revised manuscript.

      Lines 320-322: "We hypothesize that S14 possibly plays a structural role and maintains the stability of IMC required for the activity of motors during gliding and invasion." The data about the IMC structure shown is fluorescence microscopy - and there no change is observed in the IMC in the knockout line. I suggest removing or rephrasing this point if no extra data is provided to show this. Response: We have removed this sentence in the revised manuscript.

      Reviewer #2 (Significance (Required)):

      The work gives insights into an unstudied, conserved Plasmodium protein, S14, which the authors show is critical for Plasmodium transmission from mosquitoes. The parasite genetics and phenotyping demonstrating this are strong. The conclusions about interactions with glideosome/inner membrane complex components need further experimental support. The work is of interest to the Plasmodium field and may be also of interest to people interested in other protozoan parasites or in cellular motility.

      Reviewer #3 (Evidence, reproducibility and clarity (Required)):

      The manuscript by Gosh and colleagues demonstrates that S14 is a glideosome-associated protein in sporozoites. S14 knockout sporozoites fail to infect mosquito salivary glands and liver cells in the mammalian host. These sporozoites are also defective in gliding motility as S14 localizes to the inner membrane. S14 was shown to interact with the glideosome-associated proteins GAP45 and MTIP using the yeast two-hybrid system. The authors also provide an in-silico prediction on the S14, GAP45 and MTIP interaction.

      Major issues:

      Overall, there is information lacking in the manuscript, including on the figure legends, regarding experiments replication and n analyzed.

      For complementation, the authors engineered an independent S14 knockout line. For this line is clear that parasites failed to infect salivary glands contrarily to the knockout line. Despite not showing it, did the authors confirm that this knockout line has no defects in infecting mosquito midguts and producing sporozoites? Response: We analyzed the midgut for sporozoite formation, which was comparable to the original KO line, and included the data (Figure 2D) in the revised manuscript.

      Did the authors conduct IV injections in mice with a higher number of sporozoites? Hemolymph sporozoites are less infectious than sporozoites collected from the salivary glands and I was wondering whether patent infections with S14 ko sporozoites can be obtained by injecting a higher inoculum. The same applies to the infectivity experiments with HepG2cells. Response: We increased the sporozoites dose and infected mice with 10,000 hemolymph sporozoites, but no infection was observed (Table 1). No EEFs were observed in HepG2 cells infected with 10,000 S14 KO hemolymph sporozoites.

      Please provide information on the number of sporozoites that were analyzed in the trails experiment. Response: We analyzed 210, 225, and 212 sporozoites for WT GFP, S14 KO c1, and S14 KO c2, respectively.

      Minor issues:

      In Figure 1. F) WB on S14-3xHA-mCherry tagged sporozoites showing two bands on the WB. The Palm-band is only inferred thus I suggest correcting the figure to S14-3xHA-mcherry. On 1D all the mcherry signal is detected on the membrane but then on WB, a smaller fraction is palm? What is the explanation for the ratio between the two bands? Why so distinct CSP intensity bands between wt and tagged line? Were very distinct amounts of protein loaded?

      Response: We have corrected the Palm-S14-3xHA-mcherry to S14-3xHA-mcherry.

      This reviewer raises a valid point regarding the discrepancy between IFA and Western blot. The non-palmitoylated S14-mCherrey signal was possibly corrected after deconvolution in image 1D and mainly the membrane signal was prominent. In Figure 1C, many sporozoites show some cytosolic signal, perhaps representing non-palmitoylated S14. Western blot concentrates the protein of interest as a single band, allowing more accurate visualization of protein.

      The distinct CSP intensity bands between wt and the tagged line are due to the loading of a higher amount of parasite lysate in WT lane. To ensure that the western blot signal is specific to S14, we loaded a higher amount of protein in WT.

      Figure 1. A) Statistical analysis is missing. Not clear if the bars represent mean values +/- standard deviation. No information on the material and methods of how the relative expression was calculated. Response: No error bars are shown in Figure 1 because it was performed once.

      In the introduction lines 54 and 58 I suggest replacing humans with mammalian host. Response: Replaced.

      Line 58. Not clear why the ref Ripp et al., 2021 is used for a general sentence to introduce the Plasmodium life cycle. Response: Removed.

      Line 72: I suggest replacing "TRAP mutant" with "TRAP knockouts" (Sultan et al., 1997). More recently there are TRAP mutants with impaired motility and normal invasion of mosquito salivary glands (Klug et al., 2020) Response: Replaced.

      Lines 78 to 86: In this paragraph, authors refer to several proteins involved in sporozoite gliding motility and host cell invasion, however for most of the studies this conclusion comes from the characterization of knockouts defective phenotype and actually a direct role for some of these molecules in the process awaits clear demonstration. Response: We have replaced involved with implicated.

      Line 78: Authors do not consider that maebl knockout sporozoites display reduced adhesion, including to cultured hepatocytes, which could contribute to the defects in multiple biological processes, such as in gliding motility, hepatocyte wounding, and invasion. Response: We have corrected maebl role in the revised manuscript.

      Line 80: I suggest authors reconcile the contradictory reports in the literature on the role of TRSP in sporozoites invasion. Response: We have removed this reference in the revised manuscript.

      Line 82-83: Please revise it. Response: Revised.

      Table 1. Correct table as when sporozoites were transmitted by mosquito bite the term "number of sporozoites injected" does not apply. Please give more details on the bite experiments. Is this the number of mosquitoes for all four animals? For how long the mosquitoes were allowed to bite? Response: For clarity, we have split the table into A Mosquito bite and B haemolymph Sporozoites. We used ten mosquitoes/mice in the bite experiment. Mosquitos were allowed to probe for blood meal for 20 minutes, and the feeding was ensured by observing mosquitoes post-blood meal; approximately 70% of mosquitoes received the blood meal in all the cages.

      Line 288 and 289. There are several publications showing that maebl knockout sporozoites are impaired at invading the mosquito salivary glands and at infecting the vertebrate host contradicting Kariu et al., 2002 findings in the vertebrate host. Response: We have removed maebl from this line.

      Line 290. I suggest "was most likely due to" instead of " due to" as sporozoite adhesion to cells was not evaluated. Response: Corrected.

      Line 291: "Cellular transmigration and host cell invasion are prerequisites for gliding motility" please revise. Response: Revised.

      Line 437: indicate which clone was used.

      Response: Indicated (3D11).

      Line: 463: indicate the % of the gel in the SDS-PAGE Response: We have used 10% SDS-PAGE gel and it is indicated in the revised manuscript.

      Line 499: indicate the version of the GraphPad Prism software. Response: GraphPad Prism version 9.

      Figure S3 legend needs to be corrected. Panels in the figure are from A to F while in legend G and H are included. Response: Corrected.

      4. Description of analyses that authors prefer not to carry out

      Reviewer #2

      Line 39-41: "Using in silico and the yeast two-hybrid system, we showed the interaction of S14 with the glideosome-associated proteins GAP45 and MTIP. Together, our data show that S14 is a glideosome-associated protein" Although these interactions can be speculated based on the results shown, these interactions were not confirmed in this study. Response: We attempted to pulldown the S14 interacting partner using anti-mCherry antibody from S14-3XHA-mCherry transgenic sporozoites and then further tried to identify interactome using mass spectrometry but failed. Hence, we selected two known IMC localized gliding proteins MTIP and GAP45. Performing pull-down from sporozoites is challenging, so we checked this interaction using yeast 2-hybrid assay and bioinformatic analysis for protein-protein interaction.

      In order to claim interaction between S14 and IMC proteins, interaction needs to be shown experimentally. Well-controlled yeast 2-hybrid would be a start - then interaction would be more than just speculative. But immunoprecipitation from sporozoites or other biochemical interactions would give more support to this idea. Response: We attempted to pulldown the S14 interacting partner using an anti-mCherry antibody from S14-3XHA-mCherry transgenic sporozoites and then further tried to identify interactome using mass spectrometry but failed. Hence, we selected two known IMC localized gliding proteins MTIP and GAP45. Performing pull-down from sporozoites is challenging, so we checked this interaction using yeast 2-hybrid assay and bioinformatic analysis for protein-protein interaction.

      Reviewer #3

      The authors provide convincing data on the S14 localization in the inner membrane of sporozoites and interaction with GAP45 and MTIP using the yeast model. Did the authors consider conducting co-IP followed by MS analysis to pull down S14 in the complex with GAP45 and MTIP? Response: We attempted to pulldown the S14 interacting partner using an anti-mCherry antibody from S14-3XHA-mCherry transgenic sporozoites and then further tried to identify the interactome using mass spectrometry but failed. Hence, we selected two known IMC localized gliding proteins, MTIP and GAP45. Performing pull-down from sporozoites is challenging, so we checked this interaction using yeast 2-hybrid assay and bioinformatic analysis for protein-protein interaction.

      __Reviewer #3 (Significance (Required)):____ __ Sporozoite gliding motility is a critical feature of parasite infectivity. Impairment of this important feature has been described for several mutant/knockout parasite lines. This study goes beyond the phenotypic analysis of mutant parasites to infer the role of S14 by providing more mechanistic evidence to show S14 interaction with other glideosome-associated proteins. However, this interaction was investigated using the two-hybrid system in yeast. Still, in sporozoites, no experiments were conducted to evaluate the interaction between these proteins.

      Response: We attempted to pulldown the S14 interacting partner using an anti-mCherry antibody from S14-3XHA-mCherry transgenic sporozoites and then further tried to identify interactome using mass spectrometry but failed. Hence, we selected two known IMC localized gliding proteins, MTIP and GAP45. Performing pull-down from sporozoites is challenging, so we checked this interaction using yeast 2-hybrid assay and bioinformatic analysis for protein-protein interaction.

      Please consider I'm not an expert on the in-silico interaction studies.

    1. Matthew Stone History of Electronic Media MHP Peer Review 11/12/23 The first thing I would like to point out in this peer review is the beginning of your paper. The introduction explaining educating the masses, and how edutainment came to be was a very interesting way to start the paper and definitely works well with your topic of nature documentaries. I thought that the opening paragraph at whole was a great introduction into what exactly nature documentaries are and definitely brings some questions up for the reader to contemplate, such as why are humans drawn to nature documentaries? What about nature documentaries makes them such great forms of both entertainment and educational content? Among other questions the reader may be asking themselves. I really like that right away in the second paragraph you begin answering questions the reader may have with facts backed up by sources, like when you brought up the experiment in which half of the students watched a nature documentary on marine mammals and the other half was given a verbal lesson on marine mammals, and explained how the half that watched the documentary had better attitudes on the subject matter at hand. This example alone gives the reader a better understanding of how impactful nature documentaries can be. One thing that could be improved here in my opinion is doing a bit more to explain how motion pictures create a deeper bond between viewers and the subject matter. While I do like your explanation at the end of the second paragraph, I just personally feel that maybe another sentence or two going more in depth on this explanation may be a good addition. I really have no complaints about the third paragraph, as I feel you do a pretty good job depicting the founding fathers of the nature documentary and crediting each of them for what they did quite well. For the fourth paragraph, I feel you could’ve gone more in depth into the merging of narration alongside film of animals that created the nature documentaries we know today.<br /> Lastly I think what this paper is lacking most is a nice conclusion paragraph to kind of put the reader at ease with what they just read. As it is right now this is a pretty good paper but without any overall statements or ending paragraph, the ending of this paper leaves the reader feeling a bit left off without an overall statement from the paper. I just personally think the paper needs one to two more paragraphs (potentially an extra body paragraph, but for sure an ending paragraph) to neatly wrap the paper up in an informative and entertaining way, kind of like edutainment! However, overall, I liked this paper a lot and as a fan of nature documentaries I love that you picked that as your topic for this paper!

    1. Background Genotyping-by-Sequencing (GBS) provides affordable methods for genotyping hundreds of individuals using millions of markers. However, this challenges bioinformatic procedures that must overcome possible artifacts such as the bias generated by PCR duplicates and sequencing errors. Genotyping errors lead to data that deviate from what is expected from regular meiosis. This, in turn, leads to difficulties in grouping and ordering markers resulting in inflated and incorrect linkage maps. Therefore, genotyping errors can be easily detected by linkage map quality evaluations.Results We developed and used the Reads2Map workflow to build linkage maps with simulated and empirical GBS data of diploid outcrossing populations. The workflows run GATK, Stacks, TASSEL, and Freebayes for SNP calling and updog, polyRAD, and SuperMASSA for genotype calling, and OneMap and GUSMap to build linkage maps. Using simulated data, we observed which genotype call software fails in identifying common errors in GBS sequencing data and proposed specific filters to better handle them. We tested whether it is possible to overcome errors in a linkage map using genotype probabilities from each software or global error rates to estimate genetic distances with an updated version of OneMap. We also evaluated the impact of segregation distortion, contaminant samples, and haplotype-based multiallelic markers in the final linkage maps. Through our evaluations, we observed that some of the approaches produce different results depending on the dataset (dataset-dependent) and others produce consistent advantageous results among them (dataset-independent).Conclusions We set as default in the Reads2Map workflows the approaches that showed to be dataset-independent for GBS datasets according to our results. This reduces the number required of tests to identify optimal pipelines and parameters for other empirical datasets. Using Reads2Map, users can select the pipeline and parameters that best fit their data context. The Reads2MapApp shiny app provides a graphical representation of the results to facilitate their interpretation.

      This work has been peer reviewed in GigaScience (see https://doi.org/10.1093/gigascience/giad092), which carries out open, named peer-review. This review is published under a CC-BY 4.0 license:

      **Reviewer Name: Zhenbin Hu **

      In this MS, the authors tried to develop a framework for using GBS data for downstream analysis and reduce the impact of sequence errors caused by GBS. However, sequence error is an issue not specific to GBS, it is also for whole genome sequences. Actually, I think the major issue for GBS is the missing data. However, in this MS, the authors did not test the impact of missing data on downstream analysis.The authors also mentioned that sequencing error may cause distortion segregation in linkage map construction, however, distortion segregation in linkage map construction can also happen for correct genotyping data. The distortion segregation can be caused by individual selection during the construction of the population. So I don't think it is correct to use distortion segregation to correct sequence errors.The authors need to clear the major question of this MS, in the abstract, the authors highlight the sequence errors, while in the introduction, the authors highlight the package for linkage map construction (the last paragraph). Actually, from the MS, authors were assembling a framework for genotyping-by-sequencing data.Two major reduced-represented sequencing approaches, GBS and RADseq, have specific tools for genotype calling, such as Tassel and Stack. However, the authors used the GATK and Freebayes pipeline for variant calling, authors need to present the reason they were not using TASSEL and Stack.In the genotyping-by-sequencing data, individuals were barcoded and mixed during sequencing, what package/code was used to split the individuals (demultiplex) from the fastq for GATK and Freebayes pipeline?The maximum missing data was allowed at 25% for markers data, how about for the individual missing rate?On page 6, the authors mentioned 'seuqnece size of 350', what that means?

    1. AbstractThe adoption of whole genome sequencing in genetic screens has facilitated the detection of genetic variation in the intronic regions of genes, far from annotated splice sites. However, selecting an appropriate computational tool to differentiate functionally relevant genetic variants from those with no effect is challenging, particularly for deep intronic regions where independent benchmarks are scarce.In this study, we have provided an overview of the computational methods available and the extent to which they can be used to analyze deep intronic variation. We leveraged diverse datasets to extensively evaluate tool performance across different intronic regions, distinguishing between variants that are expected to disrupt splicing through different molecular mechanisms. Notably, we compared the performance of SpliceAI, a widely used sequence-based deep learning model, with that of more recent methods that extend its original implementation. We observed considerable differences in tool performance depending on the region considered, with variants generating cryptic splice sites being better predicted than those that affect splicing regulatory elements or the branchpoint region. Finally, we devised a novel quantitative assessment of tool interpretability and found that tools providing mechanistic explanations of their predictions are often correct with respect to the ground truth information, but the use of these tools results in decreased predictive power when compared to black box methods.Our findings translate into practical recommendations for tool usage and provide a reference framework for applying prediction tools in deep intronic regions, enabling more informed decision-making by practitioners.

      This work has been peer reviewed in GigaScience (see https://doi.org/10.1093/gigascience/giad085 ), which carries out open, named peer-review. The review is published under a CC-BY 4.0 license:

      Reviewer name: Raphael Leman

      Summary: In this work Barbosa et al., presented a benchmarking of several splicing predictors for human intronic variants. Overall, the results of this study shown that deep learning based tools such as SpliceAI outperformed the other splicing predictors to detect splicing disturbing variants and so pathogenic variants.

      The authors also detailed the performances of these tools on several subsets of data according to the collection origins of variants and according to the genomic localization of variants. This work is one of the first large and independent studies about splicing prediction performances among intronic variants and in particular among deep intronic variants in a context of molecular diagnosis. This work also highlights the need to have reliable prediction tools for these variants and that the splicing impact of these variants are often underestimated. However, I estimated that major points should to be solved before considering the article to publication.

      **Major points ** 1 The most important point is that authors shown results in the main text but in following paragraphs they claimed that these results were biased. In addition, the results, taking into account these biases, were only shown in supplementary data and the readers should make the correction themselves to get the "true" results. Indeed, the interpretation of biased results and "true" results changes drastically. The two main biases were: i) the use of ClinVar data already used for the training of CAPICE (see my following comment n°2-), ii) the intronic tags of variants and the relative distance to the nearest splice site were wrong (see my following comment n°5-). Consequently, the authors should remove these biased results and only show results after bias correction.

      2 Importantly, several tools used ClinVar variants or published data to train and/or validate their models. Therefore, to perform a benchmark on true independent collection of variants, the authors should ensure the lack of overlapping between variants used for the tool development and this present study.

      3 As authors shown by the comparison between the ClinVar classification (N = 54,117 variants) and impact on RNA from in vitro studies (N = 162 variants), there was discrepancies between this two information (N = 13/74 common variants, 18%). Consequently, using ClinVar classification to assay the performance of splicing prediction tools is not optimal. To partially fix this point, I think further studying (ex: get minor allele frequency, availability of in vitro RNA studies, …) the intronic variants with positive splicing predictions from two or more tools with a ClinVar classification benign or likely benign and inversely, the intronic variants with negative splicing predictions from two or more tools with a ClinVar classification pathogenic or likely pathogenic could be interesting.

      4 The authors used pre-computed databases for 19 tools, but the most of these databases do not include small insdels and so add artificially missing data in disfavor of the tool although the same tool could score these indels variants in de novo way.

      5 The authors said that "We hypothesized that variability in transcript structures could be the reason [increase in performance in the deepest intronic bins]: despite these variants being assigned as occurring very deep within introns (> 500bp from the splice site of the canonical isoform) in the reference isoform, they may be exonic or near-splice site variants of other isoforms of the associated gene". To solve this transcript structure variability, firstly the authors could use weighted relative distance as following: |(|Pos_(nearest splice site)-Pos_variant |)-Intron_Size |â•„(Intron_Size ). Secondly, the ClinVar data contains the RefSeq transcript ID on which the variant was annotated (except for large duplications/deletions), so the authors should make the correspondence between these RefSeq transcript IDs and the transcripts used to perform splicing predictions.

      6 With respect to the six categories of splice-altering variants, it is unclear how the authors considered cases in which variants alter physiological splice motives (e.g., natural consensus sequences 3'SS/5'SS, branch point, or ESR) but, instead of exon skipping, the spliceosome recruits another distant splice site that is partially or not affected by the variant.

      7 In the table 1 listing the tools considered for this study, please explicit for each tool on which collections of data (ClinVar or splicing altering variants) and for which genomic regions the benchmark was done. This information will facilitate the reading of the article.

      8 Accordingly to my comment n°3-, all spliceogenic variants are not necessary pathogenic. The mutant allele could produce aberrant transcripts without a frame-shift and without impact the functional domains of the protein. In addition, the transcription could also lead to a mix between aberrant transcript and full-length transcript. As a result, the main goal of splicing prediction tools is to detect splicing altering varaints. Considering variants with positive splicing prediction as pathogenic is a dangerous shortcut and only an in vitro RNA study could confirm the pathogenicity of a variant. The discussion section should be update in this sense.

      9 The authors claimed that: "The models [SQUIRLS and SPiP] were frequently able to correctly identify the type of splicing alteration, yet they still fail to propose higher-order mechanistic hypotheses for such predictions.". I think that the authors over-interpreted the results (see my comment n° 21-).

      10 The authors recommended prioritizing intronic variants using CAPICE, It is still true once the bias was corrected (see my comment n°1-).

      **Minor points **

      11 In the introduction the authors could clearly define the canonical splice site regions (AG/GT dinucleotides in 3'SS: -1/-2 and 5'SS: +1/+2) to make the difference with the consensus splice sites commonly define as: 3'SS: -12 (or -18)/+2 and 5'SS: -3/+6. 12 In the introduction, please also add that splice site activation could be also due to disruption of silencer motif. 13 In the ref [17], the authors did not say that the enrichment of splicing related variants within splice site regions was linked to exons and splice sites sequencing. They proved that whole genome sequencing increased the diagnostic rate of rare genetic disease, actually they did not focus on splicing variants. This enrichment was more probably induced by the fact that geneticists mainly studied variants with positive splicing predictions. 14 In the paragraph 'The prediction tools studied are diverse in methodology and objectives', please add that most of prediction tools target consensus splice sites (ex: MES, SSF, SPiCE, HSF, Adaboost, …).

      15 In the paragraph 'The prediction tools studied are diverse in methodology and objectives', the authors claimed that 'sequence-based deep learning models such as SpliceAI, which do not accept genetic variants as input.' but it is wrong as SpliceAI could accept VCF file as input. 16 In the paragraph 'Pathogenic splicing-affecting variants are captured well by deep learning based methods', this is further explained in the section method, but I think a sentence explaining that the 243 variants were from 81 variants described in ref [19] and 162 variants from a new collection will clarify the reading of article 17 In the paragraph 'Pathogenic splicing-affecting variants are captured well by deep learning based methods', among the 13 variants incorrectly classified, please detailed how many variants were classified as benign and VUS. 18 Due to the blue gradient, the Fig 1C is hard to analyze. 19 In the paragraph 'Branchpoint-associated variants', the variant rapported in the ref [79] were studied within tumoral context and so the observed impact could not be the same in healthy tissue. 20 In the paragraph 'Exonic-like variants', the authors changed the parameters of SpliceAI predictions, from the original prarameters used for the precomputed scores, to take into account variants located deep inside the pseudoexon. Please ensure whether other prediction tools have also user-defined optimizable parameters to take into account these variants. 21 In the paragraph 'Assessing interpretability', the authors observed that non-informative SPiP annotations presented a high score level. This could be explained by the fact of the tool report a positive prediction without annotation only because the model score was high without a relation to a particular splicing mechanism. 22 In the paragraph 'Assessing interpretability', the authors could compare the SpliceAI annotations regarding the abolition/creation of splice sites and their relative positions to the variants to the observed effect on RNA. 23 In the paragraph 'Predicting splicing changes across tissues', by my count the analysis of AbSpliceDNA predictions was done on 89 variants (154 - 65 = 89), if true please indicate clearly in the text. 24 In the method section, paragraph "ClinVar", the 13 variants with discordance between the classification and the observed splicing impact, how many did they have confidence stars. 25 In the method section, paragraph "Disease-causing intronic variants affecting RNA splicing", the authors filtered out variants within the 10 pb around the nearest splice site, please explicit why. 26 In the method section, paragraph "Disease-causing intronic variants affecting RNA splicing", the authors used gnomAD variants as control set, however their threshold of variant frequency is too low (1%). Indeed, some pathogenic variants involved in recessive genetic disorders have a high frequency in population. A threshold of 5% is more appropriate. 27 In the method section, paragraph "Variants that affect RNA splicing", the authors should describe how they considered variants leading to multiple aberrant transcripts and variants with partial effect (i.e., allele mutant still producing full length transcript). 28 In the method section, paragraph "Variants that affect RNA splicing", regarding the six categories defined by the authors: How the indels variants were annotated if they overlapped between several categories.

      The new splice donor/acceptor categories included only variants creating new AG/GT or variants occurring within the consensus sequences of cryptic splice sites. Among the category Donor-downstream, please make the distinction between variants located between [+3; +6] bp (i.e. consensus sequence) and variant beyond +6 bp. The exonic-like variants could be variants that did not impact ESRs motives (see my comment n°6-). 29 In the method section, paragraph "Variants that affect RNA splicing", the authors select for the control datasets, variants generating the CAGGT and GGTAAG motives. However, this approach lead to an over-enrichment of false positives. Moreover, it could be also interesting if among the variants creating new splice sites or pseudoexons to identify the presence of GC donor motif or U12-minor spliceosome motif (AT/AC) and how the different splicing tools can detect them. 30 In Fig S3C, scale the gnomAD population frequency in -logₕ₀(P) to make the figure more readable. 31 I saw several times double spaces in the text please correct them. English is not my native language so I am not the best judge, but some sentences seem syntactically incorrect (ex: "The splicing tools with the smallest and largest performance drop between the splice site bin ("1-2") and the "11-40" bin were Pangolin and TraP, with weighted F1 scores decreasing by 0.334 and 0.793, respectively"). Please have the article proofread by someone who is fluent in English.

    1. Bats harbor various viruses without severe symptoms and act as their natural reservoirs. The tolerance of bats against viral infections is assumed to originate from the uniqueness of their immune system. However, how immune responses vary between primates and bats remains unclear. Here, we characterized differences in the immune responses by peripheral blood mononuclear cells to various pathogenic stimuli between primates (humans, chimpanzees, and macaques) and bats (Egyptian fruit bats) using single-cell RNA sequencing. We show that the induction patterns of key cytosolic DNA/RNA sensors and antiviral genes differed between primates and bats. A novel subset of monocytes induced by pathogenic stimuli specifically in bats was identified. Furthermore, bats robustly respond to DNA virus infection even though major DNA sensors are dampened in bats. Overall, our data suggest that immune responses are substantially different between primates and bats, presumably underlying the difference in viral pathogenicity among the mammalian species tested.

      This work has been peer reviewed in GigaScience (see https://doi.org/10.1093/gigascience/giad086 ), which carries out open, named peer-review. This review is published under a CC-BY 4.0 license.

      ** Reviewer name: Urs Greber **

      Hirofumi Aso and colleagues provide a manuscript entitled 'Single-cell transcriptome analysis illuminating the characteristics of species specific innate immune responses against viral infections'. The aim was to describe differences in innate immune responses of peripheral blood mononuclear cells (PBMCs) from different primates and bats against various pathogenic stimuli (different viruses and LPS). A major conclusion from the study is that differences in the immune response between primate and bat PBMCs are more pronounced than those between DNA, RNA viruses or LPS, or between the cell types. The topic is of interest as the immunological basis for how bats appear to be largely disease resistant to some viruses that cause severe infections in humans is not well understood. One notion by others has been that bats have a larger spectrum of interferon (IFN) type I related genes, some of which are expressed constitutively even in unstimulated tissue, and there, trigger the expression of IFN stimulated genes (ISGs). Alongside, enhanced ISG levels may need to be compensated for in bats. Accordingly, bats may exhibit reduced diversity of DNA sensing pathways, as well as absence of a range of proinflammatory cytokines triggered in humans upon encountering acute disease causing viruses. The study here uses single-cell RNA sequencing (scRNA-seq) analysis, and transcript clustering algorithms to explore the profile of different innate immune responses upon viral infections of PBMCs from H sapiens, Chimpanzee, Rhesus macaque, and Egyptian fruit bat. Most commonly referred to cell types were detected in all four species, although naïve CD8+ T cells were not detected in bat PBMCs, which led the authors to focus on B cells, naïve T cells, killer T/NK cells, monocytes, cDCs, and pDCs. The study used three pathogenic stimuli, Herpex simplex virus 1 (HSV1), Sendai virus (SeV), and lipopolysaccharide (LPS). Specific comments The text is well written, concise, and per se interesting, but I have a few questions for clarification.

      1) Can the authors provide quality and purity control data for the virus inocula to document virus homogeneity? E.g., neither the methods, nor the indicated ref 26 specify if or how HSV1 was purified. Same is true for SeV where the provided ref 34 does not indicate if virus was purified or not. If virus inocula were not purified then it remains unclear to what extent the effects on the PBMCs described in the study here were due to virus or some other component in the inoculum. Conditions using inactivated inoculum might help to clarify this issue.

      2) What was the infection period? Was it the same for all viruses?

      3) Upon stimuli application, there was a noteable expansion of B cells and a compression of killer T / NK cells in the bat but not the human samples, as well as compression of monocytes, the latter observed in all four species. Can the authors comment on this observation?

      4) Lines 78-79: I do not think that TLR9 ought to be classified as a cytosolic DNA sensor. Please clarify.

      5) Line 117: please clarify that the upregulation of proinflammatory cytokines, ISGs and IFNB1 was measured at the level of transcripts not protein.

      6) Line 244: DNA sensors. Authors report that bats responded well to DNA viruses, although some of their DNA sensing pathways (e.g., STING downstream of cGAS, AIM2 or IFI16) were attenuated compared to primates (H sapies, Chimpanzee, Macaque). And they elute to the dsRNA PRR TLR3. But I am not sure if TLR3 is the only PRR to compensate for attenuated DNA sensing pathways. The authors might want to explicitly discuss if other RNA sensors, such as RIG-I-like receptors (RIG-I, LGP2, MDA5) were upregulated similarly in bats as in primate cells upon inoculation with HSV1.

      7) Is it known how much TLR3 protein is expressed in bat PBMCs under resting and stimulated conditions? Same question for the DNA and RNA sensor proteins, e.g., cGAS, AIM2 or IFI16, RIG-I, LGP2, MDA5, or effector proteins, such as STING.

      8) Can authors clarify if cGAS is part of the attenuated DNA sensors in the bat samples under study here? And it would be nice to see the attenuated response of DNA sensing pathways in the bat samples, as suspected from the literature, including STING downstream of cGAS, or AIM2 and IFI16.

      9) What are the expression levels of IFN-I and related genes in the bat cells among the different stimuli?

      10) Technical point: where can the raw scRNA-seq data be found?

    1. Reviewer #2 (Public Review):

      Summary:

      We often have prior expectations about how the sensory world will change, but it remains an open question as to how these expectations are integrated into perceptual decisions. In particular, scientists have debated whether prior knowledge principally changes the decisions we make about the perceptual world, or directly alters our perceptual encoding of incoming sensory evidence.

      The authors aimed to shed light on this conundrum by using a novel psychophysical task while measuring EEG signals that have previously been linked to either the sensory encoding or response selection phase of perceptual choice. The results convincingly demonstrate that both features of perceptual decision-making are modulated by prior expectations - but that these biases in neural process emerge over different time courses (i.e., decisional signals are shaped early in learning, but biases in sensory processing are slower to emerge).

      Another interesting observation unearthed in the study - though not strictly linked to this perceptual/decisional puzzle - is that neural signatures of focused attention are exaggerated on trials where participants are given neutral (i.e. uninformative) cues. This is consistent with the idea that observers are more attentive to incoming sensory evidence when they cannot rely on their expectations.

      In general, I think the study makes a strong contribution to the literature and does an excellent job of separating 'perceiving' from 'responding'. More perhaps could have been done though to separate 'perceiving' and 'responding' from 'deciding' (see below).

      Strengths:

      The work is executed expertly and focuses cleverly on two features of the EEG signals that can be closely connected to specific loci of the perceptual decision-making process - the SSVEP which connects closely to sensory (visual) encoding, and Mu-Beta lateralisation which connects closely to movement preparation. This is a very appropriate design choice given the authors' research question.

      Another advantage of the design is the use of an unusually long training regime (i.e., for humans) - which makes it possible to probe the emergence of different expectation biases in the brain over different timecourses, and in a way that may be more comparable to work with nonhuman animals (who are routinely trained for much longer than humans).

      Weaknesses:

      In my view, the principal shortcoming of this study is that the experimental task confounds expectations about stimulus identity with expectations about to-be-performed responses. That is, cues in the task don't just tell participants what they will (probably) see, but what they (probably) should do.

      In many respects, this feature of the paradigm might seem inevitable, as if specific stimuli are not connected to specific responses, it is not possible to observe motor preparation of this kind (e.g., de Lange, Rahnev, Donner & Lau, 2013 - JoN).

      However, the theoretical models that the authors focus on (e.g., drift-diffusion models) are models of decision (i.e., commitment to a proposition about the world) as much as they are models of choice (i.e., commitment to action). Expectation researchers interested in these models are often interested in asking whether predictions influence perceptual processing, perceptual decision, and/or response selection stages (e.g., Feuerriegel, Blom & Hoogendorn, 2021 - Cortex), and other researchers have shown that parameters like drift bias and start point bias can be shifted in paradigms where observers cannot possibly prepare a response (e.g., Thomas, Yon, de Lange & Press, 2020 - Psych Sci).

      The present paradigm used by Walsh et al makes it possible to disentangle sensory processing from later decisional processes, but it blurs together the processes of deciding about the stimulus and choosing/initiating the response. This ultimately limits the insights we can draw from this study - as it remains unclear whether rapid changes in motor preparation we see reflect rapid acquisition of new decision criterion or simple cue-action learning. I think this would be important for comprehensively testing the models the authors target - and a good avenue for future work.

    1. Author Response

      Reviewer #1 (Public Review):

      This paper examines different signaling networks and attempts to give general results for when the network will exhibit biphasic behavior, which is the situation when the output of the network is a non-monotonic function of its inputs. The strength of the paper is in the approach it takes. It starts with the simplest network motifs that produce biphasic behavior and then asks too what happens when these motifs are parts of larger networks. Their approach is in contrast to the usual way in which this question is tackled, which tends to be within the confines of a specific signaling network, where general results like the ones that the authors are after, might be hard to spot.

      We thank the reviewer for the careful reading of the manuscript and for the comments and appreciate the fact the reviewer regards the approach as the strength of the paper.

      The weakness of the paper, in my opinion, is the rather formal description of the results which I am afraid will be of rather limited utility to experimental groups seeking to make use of them. The paper attempts to provide general rules for when to expect biphasic behavior and it was hard to assess to what extent such rules exist as behaviors can change depending on the context of a larger network in which the smaller biphasic one is embedded. The other thing that made assessing the generality of the results difficult is that the input-output functions shown in all the figures are computed for a specific choice of parameters and I was left wondering how different choices of parameters might change the reported behaviors. The lack of specific proposals for how their results should guide future experiments on different signaling networks is another weakness.

      We address these points in a number of ways. Initially our presentation was intended to highlight unambiguously which systems (especially the substrate modification building blocks) were capable of biphasic response and which were not, and highlighting parameter dependence on intrinsic kinetic parameters. Based on both referee comments, we make a number of changes

      (a) We highlight the rationale for choosing the suite of biochemical substrate modification systems: enzyme/substrate sharing is a key driver for the origins of biphasic responses and the suite of systems we employ allows us to systematically explore this (see Response to Essential Revisions). These are building blocks of many pathways,

      (b) Biphasic responses emerge from a built in competing effect. In every instance of substrate modification systems, we now highlight the mechanistic underpinning which gives rise to the competing effect responsible for the biphasic response. This will help experimentalists and modellers alike obtain insights into how such behaviour may arise, and the associated ingredients which facilitate that (which may be relevant in other systems). Similarly, we highlight how altered behaviour at the network level may arise from a biphasic interaction pattern, providing the intuition therein and guide further experimental investigation (also see Response to Essential Revisions).

      (c) With regard to parameters (also see Response to Essential Comments) firstly we emphasize that we completely characterize at the substrate modification level, whether biphasic responses are possible as a function of intrinsic kinetic constants. This is done for every system studied. In Fig 2, we depict this, along with sample biphasic dose responses, for pictorial depiction. However, the essential point is that the parametric dependence on intrinsic kinetic parameters is completely done. We indicate in which cases biphasic responses are impossible irrespective of intrinsic kinetic parameters, where they can be obtained for every value of the intrinsic kinetic parameters, and where there are partial restrictions in the intrinsic kinetic parameter space for obtaining this. In the revision we have performed further parametric analysis to assess the impact of species total amount providing further insights. We have also shown that in all these systems biphasic responses can be obtained in ranges of kinetic parameters similar to those found experimentally (eg Wistel et al 2018) and for reasonable species total amounts in systems and synthetic biology. This is analyzed, and depicted in Figure 2-figure supplement 3 and Figure 2-figure supplement 4.

      (d) Also, in response to another comment (about behaviour changing in networks): we first emphasize that we start at the substrate modification level to uncover drivers of biphasic responses at this level. Biphasic responses arise from an inbuilt competing effect and we demonstrate different ways in which such an inbuilt competing effect arises, through sharing of enzymes or substrates. While it is true that the behaviour can change as part of a network (a) It still remains that there are these in-built competing effects which can generate biphasic responses (both substrate and enzyme) and this can manifest at a pathway or network level under suitable conditions (b) the fact that behaviour at a network level may be altered is exactly why we consider studies at the network level showing both biphasic patterns in interaction (the overall behaviour is determined by the motif and the biphasic pattern of interaction and studies involving interaction of biphasic responses at both the network and substrate modification level!! (subsection: The network level)

      (e) We have also expanded on a paragraph on testable predictions in the conclusions (p10).

      Taken together, we believe that these results should interest both experimentalists and modellers and have intrinsic value as well.

      While I appreciate that the authors adopted a style of presenting their results such that all the mathematics is buried in the figures, I found that it made reading the paper quite difficult, and contributed to my confusion about which results are general and insensitive to parameter choices and which are not. I believe a narrative that integrated the math with some simple intuition might have been more effective. For example, when the authors say in the text that model M0 is incapable of displaying biphasic response, how general is that result? Later on, when discussing model M2, they provide a criterion for biphasic response in terms of products of rate constants satisfying an inequality, but the meaning of this condition is not described. Such things make it hard to learn from the authors' work.

      This has indeed been incorporated, and we agree that presenting the intuition and mechanistic underpinning for the behaviour aids readability. In addition to the points about parameters which are now explained at length in the paper , there are a number of paragraphs providing the mechanistic underpinning and intuition for why the behaviour is obtained. Both these are discussed at length in Response to Essential Revisions. Thus, both the mechanistic intuition and the role of parameters are addressed in detail in the revision.

      When M0 is mentioned to be incapable of yielding biphasic responses we mean just that: irrespective of any parameter choice in the model. The meaning of the criterion in Model M2 is now discussed. We take the point about not being able to learn from the work seriously and have made various changes both on the intuition and clarifying the impact of parameters.

      The text is sprinkled with statements like "this reveals the plurality of information processing behaviors..." where the meaning is quite opaque (for this example, there is no description of "information processing" and what it might mean in this context) and therefore it makes it hard to understand what are the lessons learned from these calculations. Another example is found in the description of Erk regulation where the authors speak of "significant robustness" but what is meant by "significant" is also unclear.

      Yes, we agree that these phrases are distracting and not adding much and so we have removed them.

      Overall, I think this is an interesting attempt to provide a general mathematical framework for analyzing biphasic response of signaling networks, but the authors fall short for the reasons described above. I think a lot can be fixed by improving the way the results are presented.

      We have indeed taken these comments on board and aimed to improve the presentation

      Reviewer #2 (Public Review):

      Biphasic responses are widely observed in biological systems and the determination of general design principles underlying biphasic responses is an important problem. The authors attempt to study this problem using a range of biochemical signaling models ranging from simple enzymatic modification and de-modification of a single substrate to systems with multiple enzymes and substrates. The authors used analytical and computational calculations to determine conditions such as network topology, range of concentrations, and rate parameters that could give rise to biphasic responses. I think the approach and the result of their investigation are interesting and can be potentially useful. However, the conditions for biphasic responses are described in terms of parameter ranges or relationships in particular biochemical models, and these parameters have not been connected to the values of concentrations or rates in real biological systems. This makes it difficult to evaluate how these findings would be applicable in nature or in experiments. It might also help if some general mechanisms in terms of competition/cooperation of time scales/processes are gleaned which potentially can be used to analyze biphasic responses in real biological systems.

      We thank the reviewer for a careful reading of the manuscript and for the various comments and are happy to see the reviewer find the approach interesting. We address these comments in more detail below.

      Reading these comments, we recognized how various analysis and algebraic equations could appear opaque to a reader both in terms of what it conveys and its import. To address this, we made a number of changes.

      1. First and foremost, we provide the mechanistic underpinning and intuition for why a competing effect emerges in the first place. We do this for every substrate modification system we analyze and make further comments in the subsection focussing on the network level as well as ERK This intuition should help a reader where the result is coming from and be then able to see if it might apply in a quite different system. This is discussed in detail in Response to Essential Revisions.

      2. Secondly, we have discussed many aspects of the parameters in more detail. Our goal, especially in substrate modification systems was to be able to completely characterize the role of intrinsic kinetic parameters: whether biphasic responses was impossible irrespective of parameters, whether they were possible for every value of intrinsic kinetic parameters or whether they were possible in a subset of kinetic parameter space. This has been done for every substrate modification system, and has been discussed more explicitly in the revision. Furthermore, when biphasic responses were possible, we aimed to determine the impact of species total amounts which facilitated the response. Here we performed additional analytical and semi-analytical work. Additionally with the semi-analytical work and parameters chosen in ranges very similar to those found experimentally (eg Wistel et al 2018), we are able to show that biphasic responses can indeed be obtained in experimentally feasible ranges. Further aspects of the parameters are discussed in detail in the Response to Essential Revisions. In particular, a number of new paragraphs (p2-3, p6) and plots Figure 2-figure supplement 3 and Figure 2-figure supplement 4 specifically deal with this.

      Taken together these address the reviewers points.

    1. Author Response

      Reviewer #1 (Public Review):

      Due complicated and often unpredictable idiosyncratic differences, comparing fMRI topography between subjects typically would require extra expensive scan time and extra laborious analyzing steps to examine with specific functional localizer scan runs that contrast fMRI responses of every subject to different stimulus categories. To overcome this challenge, hyperaligning tools have recently been developed (e.g., Guntupalli et al., 2016; Haxby et al., 2011) based on aligning in a high-dimensional space of voxels of subjects' fMRI responses to watching a given movie. In the present study, Jiahui and colleagues propose a significantly improved version of hyperaligning functional brain topography between individuals. This new version, based on fMRI connectivity, works robustly on datasets when subjects watched different movies and were scanned with different parameters/scanners at different MRI centers.

      Robustness is the major strength of this study. Despite the fact that datasets from different subjects watching different movies at different MRI centers with different scan parameters were used, the results of functional brain topography from between-subject hyperalignment based on fMRI connectivity were comparable to the golden standard of within-subject functional localizations, and significantly better than regular surface anatomical alignments. These results also support the claim that the present approach is a useful improvement from previous hyperalignments based on time-locked fMRI voxel responses, which would require normative samples of subjects watching a same movie.

      We thank the reviewer for the appreciation of our work.

      Given the robustness, this new version of hyperalignment would provide much stronger statistical power for group-level comparisons with less costs of time and efforts to collect and analyze data from large sample size according to the current stringent standard, likely being useful to the whole research community of functional neuroimaging. That said, more discussions of the limit of the present hyperalignment approach would be helpful to potential eLife readers. For example, to what extend the present hyperalignment approach would be applicable to individuals with atypical functional brain topography such as brain lesion patients with e.g., acquired prosopagnosia? Even in typical populations, while bilateral fusiform face areas can be identified in the majority through functional localizer scans, the left fusiform face area sometimes cannot be found. Moreover, many top-down factors are known to modulate functional brain topography. Due to these factors, brain responses and functional connectivity may be different even when a same subject watched a same movie twice (e.g., Cui et al., 2021).

      We thank the reviewer for the suggestion and agree that it would be fascinating if the predictions can be made with high fidelity in neuropsychological populations. Although we are optimistic that our algorithm is able to generalize across diverse populations, to date, no previous literature has provided empirical evidence to illustrate the effectiveness, including optimizations and special applications beyond typical brains. Besides the neuropsychological population, it would also be valuable to study the generalization across a broad age range, for example, from infants to the elderly. The brain changes across age both anatomically and functionally, so it is a challenge to predict functional topographies based on a normative group that only includes young participants. With all these potential applications in mind, future research is needed to illustrate the efficacy, build the pipeline, and construct the representative normative groups to meet the requirements of accurate individualized predictions in diverse populations.

      In typical populations, although participants have great individual variabilities in their functional topographies, for instance, some participants have distinguishable patches of activations in their left ventral temporal cortex while some participants don’t, our algorithms successfully captured these individualized differences in the prediction. The figure below shows, as an example, the face-selective topographies of two individuals that have markedly different face-selective topographies on the left ventral temporal cortex. The left participant has prominent face-selective areas on the left ventral temporal cortex that are in similar sizes as the right side, while the right participant only has a few scattered small face-selective spots on the left side. No matter what their face-selective areas look like, our algorithm accurately recovered the individualized locations, shapes, and sizes, retaining the individual variability in the functional topographies.

      Functional connectivity profiles based on naturalistic stimuli are very stable across the cortex, even when participants watch different movies. In Figure 4-figure supplement 9, the mean correlations of fine-scaled connectome for most searchlights (r = 15mm) when participants watched The Grand Budapest Hotel and the Raiders of the Lost Ark were generally around 0.8. The mean correlations were about 0.9 between the first and second half of the same movie although the stimuli contents were different between the two halves. Thus, the fine-grained functional connectivity profiles remain highly stable and reliable across movie contents, which contributes to the robustness of cross-movie, time, and other parameters (e.g., scanner models, scanning parameter) predictions using our algorithms.

      We added a paragraph in the discuss section to address the concerns (page 18-19):

      “This study successfully illustrated that accurate individualized predictions are both robust and applicable across a variety of conditions, including movie types, languages, scanning parameters, and scanner models. Importantly, the intricate connectivity profiles remain consistent even when participants view entirely different movies, as evidenced by Figure 4-figure supplement 9, reinforcing the prediction's stability in various scenarios. However, all four datasets in this study only included typical participants with anatomically intact brains. An unanswered question is whether individualized topographies of neuropsychological populations with atypical cortical function (e.g., developmental prosopagnosics) or with lesioned brains (e.g., acquired prosopagnosics) could also be accurately predicted using the hyperalignment-based methods. Up to now, as far as we know, no previous literature has investigated this question. Beyond neuropsychological groups, it is also valuable to investigate how well the predictions will be across a wide range of age, from infants to the elderly. Future research is essential to adapt our algorithms to diverse populations.”

      Reviewer #2 (Public Review):

      Guo and her colleagues develop a new approach to map the category-selective functional topographies in individual participants based on their movie-viewing fMRI data and functional localizer data from a normative sample. The connectivity hyperalignment are used to derived the transformation matrices between the participants according to their functional connectomes during movies watching. The transformation matrices are then used to project the localizer data from the normative sample into the new participant and create the idiosyncratic cortical topography for the participant. The authors demonstrate that a target participant's individualized category-selective topography can be accurately estimated using connectivity hyperalignment, regardless of whether different movies are used to calculate the connectome and regardless of other data collection parameters. The new approach allows researchers to estimate a broad range of functional topographies based on naturalistic movies and a normative database, making it possible to integrate datasets from laboratories worldwide to map functional areas for individuals. The topic is of broad interest for neuroimaging community; the rationale of the study is straightforward and the experiments were well designed; the results are comprehensive. I have some concerns that the authors may want to address, particularly on the details of the pipeline used to map individual category-selective functional topographies.

      We thank the reviewer for the encouragement.

      1) How does the length of the scan-length of movie-viewing fMRI affect the accuracy in predicting the idiosyncratic cortical topography? Similarly, how does the number of participants in the normative database affect the prediction of the category-selective topography? This information is important for the researchers who are interested in using the approach in their studies.

      To investigate the influence of movie-viewing data length and the number of participants in the normative database on prediction performance, we systematically varied these parameters. Specifically, we altered the number of runs utilized in the analysis for both the normative and target data and experimented with varying the number of participants in the normative dataset using the Budapest and the Sraiders datasets. We have included a new Figure 4-figure supplement 5 to present a summary of these findings.

      The results reveal that both within-dataset and between-dataset prediction performances are positively correlated with the length of movie-viewing fMRI data used for both the normative and target groups. A similar trend was observed with respect to the number of participants included in the normative dataset. It is important to highlight, though, that, even when analyzing as little as one run of movie-viewing data—roughly 10-15 minutes, our hyperalignment-based prediction performance was significantly higher than that achieved using traditional surface alignment. This held true even when the normative dataset included as few as five participants.

      In summary, our results show that prediction performance generally improves with longer movie-viewing sessions and larger normative datasets. However, it is noteworthy that even with minimal data—10 minutes of movie-viewing and a small number of participants in the normative dataset—our algorithm still outperforms traditional surface alignment methods significantly.

      We also added sentences in the discussion section (page 15):

      “We investigated the influence of naturalistic movie length and the size of the training group on the prediction accuracy of individualized functional topographies. By incrementally increasing both the number of movie runs in the training and target dataset and the participants in the training group in the Budapest and Sraiders dataset, we observed enhanced prediction accuracy (Figure 4-figure supplement 5). Notably, even with just one movie run in the training or target dataset, or with a mere five participants in the training group, our prediction performance (Pearson r) ranged from about 0.6 to 0.7. This accuracy significantly outperformed results obtained using surface-based alignment.”

      2) The data show that category-selective topography can be accurately estimated using connectivity hyperalignment, regardless of whether different movies are used to calculate the connectome and regardless of other data collection parameters. I'm wondering whether the functional connectome from resting state fMRI can do the same job as the movie-watching fMRI. If it is yes, it will expand the approach to broader data.

      We agree with the reviewer that demonstrating the applicability of the resting state data will expand the application scenarios of this approach. Most previous findings on resting state connectivity, including the comparison between the naturalistic and the resting state paradigms, focused on the macro-scale similarities and differences (e.g., Samara et al., 2023). Very few studies have investigated the fine-scaled connectome based on resting state data. The study on connectivity hyperalignment (Guntupalli et al., 2018) demonstrated a shared fine-scale connectivity structure among individuals that co-exists with the common coarse-scale structure and built the algorithm to successfully hyperalign individuals to the shared fine-scaled space. Another study from our lab (Feilong et al., 2021) revealed that the fine-scaled connectivity profiles in both resting and task states are highly predictive of general intelligence, indicating reliable and biologically relevant fine-scaled resting state connectome structures. Thus, it is highly plausible that our approach is able to be generalized to the resting state data, generating significantly better predictions of individualized functional topographies than traditional surface alignment. However, due to the limitations of the current datasets, we do not have resting state data available in the current datasets to perform this analysis. We are in the process of collecting new data to explore this hypothesis in future work.

      We added sentences to the discussion section to discuss this idea (page 18):

      “Studies comparing movie-viewing and resting state functional connectivity have shown that both paradigms yield overlapping macroscale cortical organizations (29), though naturalistic viewing introduces unique modality-specific hierarchical gradients. However, there remains a gap in research comparing the fine-scaled connectomes of naturalistic and resting state paradigms. Guntupalli and colleagues (14) revealed a shared fine-scale structure that coexists with the coarse-scale structure, and connectivity hyperalignment successfully improved intersubject correlations across a wide variety of tasks. Feilong et al. (13) noted that the fine-scaled connectivity profiles in both resting and task states are highly predictive of general intelligence. This suggests a reliable and biologically relevant fine-scale resting state connectivity structure among individuals. Therefore, it is plausible that individualized functional topography could be effectively estimated using resting state functional connectivity, expanding the applicability of our approach. Future studies are needed to explore this direction.”

      3) The authors averaged the hyper-aligned functional localizer data from all of subjects to predict individual category-selective topographies. As there are large spatial variability in the functional areas across subjects, averaging the data from many subjects may blur boundaries of the functional areas. A better solution might be to average those subjects who show highly similar connectome to the target subjects.

      We appreciate the reviewer’s insightful question about optimizing prediction performance by selecting participants most similar in functional connectivity to the target individuals. This is a promising direction and difficult problem as well. Our approach is based on fine-scale connectome to hyperalign participants, thus different groups of participants may be similar to the target participant in different searchlights. In addition, based on results discussed in the response to Q2, the more participants included in the normative dataset, the better the prediction performance. Thus, there is a trade-off between the number of participants included in the normative dataset for the prediction and the overall similarity of those participants to the target participant.

      To quantitatively explore this idea, we used a searchlight in the right ventral temporal cortex, roughly at the location of posterior fusiform face area (pFFA).We sorted participants by their connectome similarity to each target participant and then examined prediction performance based on either the top nine most similar participants or the bottom nine least similar participants. Our results, presented in Figure 4-figure supplement 8, reveal that hyperalignment consistently outperforms surface alignment regardless of the subset of participants used. Notably, using the nine most similar participants did not significantly alter prediction performance (Tukey Test, z = -0.09, p = 0.996), while using the least similar participants did negatively impact it (Tukey Test, z = 2.492, p = 0.034). Interestingly, the stability of hyperalignment-based predictions remained high even when only a subset of participants was used, contrasting with the variability observed in surface-alignment-based predictions.

      Overall, these findings suggest that while selecting functionally similar participants is a promising avenue for future optimization, the process will require nuanced, searchlight-specific criteria. Each searchlight may necessitate its own set of optimal participants to balance between the performance boost from having more participants and the fidelity gained from participant similarity.

      We added the following to the discussion in the manuscript (page 16):

      “In our study, we used fine-scale connectomes, noting that some participants are more similar to the target participant in specific searchlights. It is an interesting question whether predictions could be enhanced by exclusively selecting those more similar participants for the target participant. To explore this option, we examined a searchlight in the right ventral temporal cortex that was roughly at the location of the posterior fusiform area (pFFA) using the top and bottom nine participants similar to each target participant measured by their fine-scale connectome similarities in the budapest dataset. Generally, using all or part of the participants for the prediction generated similar results (Figure 4-figure supplement 8). Compared to using all the participants, using only the top nine participants who are the most similar to the target participants did not significantly improve the prediction (Tukey Test, z = -0.09, p = 0.996), but using only the bottom nine participants generated significantly lower prediction accuracies (Tukey Test, z = 2.492, p = 0.034). This suggests a trade-off between the number of participants included in the prediction and the similarity of the participants. Future studies are needed to explore the optimal threshold for the number of participants included for each searchlight to refine the algorithm.”

      4) It is good to see that predictions made with hyperalignment were close to and sometimes even exceeded the reliability values measured by Cronbach's alpha. But, please clarify how the Cronbach's alpha is calculated.

      Cronbach’s alpha calculates the correlation score between localizer-based maps across the runs, and it reflects the amount of noise in maps based on individual localizer runs. Traditionally, the reliability was estimated based on split-half correlations. For example, Guntupalli et al. (2016) used correlations of category-selectivity maps between odd and even localizer runs as the measure of reliability. The odd/even split measure underestimated reliability and necessitated recalculation of correlations between maps for only half the data to provide valid comparisons. In contrast, Cronbach’s alpha involves all localizer runs and provides a more accurate statistical estimate of the reliability of the topographies estimated with localizer runs.

      Cronbach’s alpha has been used in many previously published works from our lab (e.g., Feilong et al., 2021; Jiahui et al., 2020, 2023). The code for implementing this metric is publicly accessible on the first author’s Github repository (https://github.com/GUOJiahui/face_DCNN/blob/main/code/cronbach_alpha.py).

      We added the detailed explanation above to the Material and Methods section (page 24):

      “Cronbach’s alpha calculates the correlation score between localizer-based maps across the runs, and it reflects the amount of noise in maps based on individual localizer runs. Traditionally, the reliability was estimated based on split-half correlations. The common odd/even split measure underestimated reliability and necessitated recalculation of correlations between maps for only half the data to provide valid comparisons. In contrast, Cronbach’s alpha involves all localizer runs and provides a more accurate statistical estimate of the reliability of the topographies estimated with localizer runs.”

      5) Which algorithm was used to perform surface-based anatomical alignment? Can the state-ofthe-art Multimodal Surface Matching (MSM) algorithm from HCP achieve better performance?

      We preprocessed our datasets using fMRIPrep, which employs algorithms from FreeSurfer’s recon-all for surface-based anatomical alignment. It is worth noting that different alignment methods can yield varying degrees of performance. For instance, a study by Coalson et al. (2018) compared the localization performance of multiple surface-based alignment methods, including Multimodal Surface Matching (MSM) and FreeSurfer. The study found that MSM outperformed FreeSurfer in terms of peak probabilities and spatial clustering, suggesting better overall localization.

      Additionally, Guntupalli et al. (2018) evaluated intersubject correlations (ISC) of functional connectivity from movie-viewing data using both Connectivity Hyperalignment (CHA) and MSM-All with the Human Connectome Project (HCP) dataset. The study showed that although MSM-All yielded marginally better ISC than traditional surface alignment, CHA’s performance was significantly superior.

      In summary, while using a more advanced alignment algorithm like MSM could marginally improve prediction performance, its advantages may not be substantial when compared to our CHA-based predictions. The combination of MSM and CHA represents an intriguing direction for future research, although it falls outside the scope of our current study.

      6) Is it necessary to project to the time course of the functional localizer from the normative sample into the new participants? Does it work if we just project the contrast maps from the normative samples to the new subjects?

      It is an interesting question and a practical alternative to researchers to know whether time series of the localizer runs are required to obtain reasonable predictions, as in some scenarios, contrast maps may be the only accessible data in the analysis. To quantitatively explore this possibility, we applied transformation matrices derived from the movie data to training participants’s individual pre-calculated contrast maps of all four categories, and evaluated the predictions. We found nearly similar prediction performance between the two flavors within and across datasets (Figure 4-figure supplement 7). However, it is worth noting that applying transformation matrices directly to contrast maps did not get as much improvement in the interactive steps as the other flavor in the advanced CHA, perhaps due to the scale changes when multiple iterations were implemented and the difficulty to properly normalize the t-maps compared to the regular time series.

      Overall, although our algorithm is originally designed to be used on the time course of the functional localizer runs, relatively comparable results can be generated even when the contrast maps are directly projected from the normative group to the target participant. However, to derive the best results with our approach, time series are recommended when the situation permits.

      We have also added the contents into the Discussion section (page 16):

      “Our original algorithm is designed to apply transformation matrices to the time series of localizer data of training participants before generating contrast maps. To explore whether directly applying these matrices to pre-calculated contrast maps yields comparable results, we conducted an additional analysis across the four categories. Our findings indicate that the prediction outcomes were indeed quite similar between the two approaches for both the within- and across-datasets predictions (Figure 4-figure supplement 7). However, it is worth noting that the improvements observed with enhanced CHA were not as pronounced when applied directly to the contrast maps as opposed to the time series.”

      7) Saygin and her colleagues have demonstrated that structural connectivity fingerprints can predict cortical selectivity for multiple visual categories across cortex (Osher DE et al, 2016, Cerebral Cortex; Saygin et al, 2011, Nat. Neurosci). I think there's a connection between those studies and the current study. If the author can discuss the connection between them, it may help us understand why CHA work so well.

      We thank the reviewer for raising this point that provides us with the chance of clarifying how our approach differs with methods previously reported in the literature. The computational logic underlying our approach is that we derived the transformation matrices between the training and the target participants in the high-dimensional space based on functional connectivity calculated from the movie data. Then, we applied these transformation matrices to the training participant’s localizer data to accomplish the prediction. On the other hand, Saygin and colleagues directly used diffusion-weighted imaging (DWI) data and predicted participants’ functional responses based on the anatomical-functional correspondence. They evaluated the prediction by calculating the mean absolute errors (AE) of the difference between the actual and predicted contrast responses. Although AE linearly increases with the quality of the prediction, it is difficult to measure the prediction performance of the shape, size, and location of the functional areas precisely using this mean value. With our algorithm, we were able to predict the general location and size of the areas and recover the individualized shapes, generating more powerful predictions. We also used the searchlight analysis to evaluate the performance across the cortex systematically. In addition, Osher et al. (2016) and Saygin et al. (2012) always have a few participants failing to show better predictions based on the connectivity than the group averaged method. Our algorithm is more stable, as all participants across all four datasets had better predicted performance using our algorithm than using the group average. However, although we did not directly use the anatomical-functional correspondence with DWI, the relationships between individual structural connectivity and cortical visual category selectivity could be one of the biological underpinnings that contribute to this robust and accurate prediction.

      The Connectivity-Based Shared Response Model (cSRM, Nastase et al., 2020) offers an alternative framework for aligning individuals through functional connectivity. While the overarching aim of cSRM and our methodology converges, substantial differences emerge in the respective implementation and application between the two methods that make our approach the more suitable for predicting individualized topographies. The most significant difference between the two is that, instead of focusing on within-individual connectivity profiles, cSRM used inter-subject functional connectivity (ISFC) in the initial step. This design requires that all participants must have time-locked time series, making the algorithm unusable for cross-content prediction and making it incompatible with resting-state data. Our approach, on the other hand, does not require time-locked stimuli, thereby offering a more flexible framework that permits generalization across different types of stimuli and experimental settings and enables bringing data across laboratories across the world together. Secondly, cSRM predominantly focuses on Region of Interest (ROI) analyses, whereas our model employs searchlight-based analyses designed to comprehensively cover the entire cortical sheet. Whole-brain coverage is needed to generate the topography that reflects the patterns across the cortex. Finally, with the optimized 1step method, our approach directly hyeraligns the training and target participants together, avoiding the accumulation of errors from the intermediate common space. cSRM, with an implementation similar to the classic connectivity hyperalignment, creates and hyperaligns all participants to a shared information space. In summary, while our approach and cSRM share a similar theoretical foundation, our approach has been specifically optimized to address the challenges and complexities in predicting individualized whole-brain functional topographies. Moreover, our approach demonstrates a remarkable ability to generalize across a variety of contexts and stimuli, offering a significant advantage in dealing with diverse experimental settings and datasets.

      We have added the contents to the discussion section (page 16-17):

      “By leveraging transformation matrices obtained from hyperaligning participants based on movie-viewing data, we successfully mapped these relationships to the training participants’ localizer data, enabling robust predictions. Prior work employing diffusion-weighted imaging (DWI) has underscored the link between anatomical connectivity and category selectivity across diverse visual fields (22, 23) and has established a notable congruence between structural and functional connectivities (24). These findings suggest that the unique anatomical connectivity patterns of individuals may serve as a foundational mechanism, contributing to the stable finescale functional connectome that underpins our approach. The connectivity-based Shared Response Model (cSRM) proposed by Nastase and colleagues (25) used connectivity to functionally align individuals similar to the connectivity hyperalignment algorithm. While both approaches share overarching goals, they diverge considerably in implementation and application. First and most important, cSRM used inter-subject functional connectivity (ISFC) rather than within-subject functional connectivity to initially estimate the connectome. As a result, cSRM requires participants to have time-locked fMRI time series. Therefore, unlike our algorithm, the cSRM approach does not support cross-content applications and also is not suitable for use with resting-state data. Second, cSRM is implemented based on a predefined cortical parcellation rather than the overlapping, regularly-spaced cortical searchlights applied in our method which are not constrained by areal borders. For the application, cSRM has mainly been used to do ROI analysis rather than the estimation of the whole-brain topography that requires broader coverage of the cortex with a searchlight analysis. Third, our method is specifically designed to work in each individual’s space, while cSRM decomposes data across subjects into shared and subjectspecific transformations, focusing on a communal connectivity space. In summary, although cSRM presents a promising alternative for similar aims, its current implementation precludes it from fulfilling the range of applications for which our method is optimized.”

      Reviewer #3 (Public Review):

      In this paper, Jiahui and colleagues propose a new method for learning individual-specific functional resonance imaging (fMRI) patterns from naturalistic stimuli, extending existing hyperalignment methods. They evaluate this method - enhanced connectivity hyperalignment (CHA) - across four datasets, each comprising between nine (Raiders) and twenty (Budapest, Sraiders) participants.

      The work promises to address a significant need in existing functional alignment methods: while hyperalignment and related methods have been increasingly used in the field to compare participants scanned with overlapping stimuli (or lack thereof, in the case of resting state data), their use remains largely tied to naturalistic stimuli. In this case, having non-overlapping stimuli is a significant constraint on application, as many researchers may have access to only partially overlapping stimuli or wish to compare stimuli acquired under different protocols and at different sites.

      It is surprising, however, that the authors do not cite a paper that has already successfully demonstrated a functional alignment method that can address exactly this need: a connectivitybased Shared Response Model (cSRM; Nastase et al., 2020, NeuroImage). It would be relevant for the authors to consider the cSRM method in relation to their enhanced CHA method in detail. In particular, both the relative predictive performance as well as associated computational costs would be useful for researchers to understand in considering enhanced CHA for their applications.

      We thank the reviewer for raising this point that provides us with the chance of clarifying how our approach differs with methods previously reported in the literature. The computational logic underlying our approach is that we derived the transformation matrices between the training and the target participants in the high-dimensional space based on functional connectivity calculated from the movie data. Then, we applied these transformation matrices to the training participant’s localizer data to accomplish the prediction. On the other hand, Saygin and colleagues directly used diffusion-weighted imaging (DWI) data and predicted participants’ functional responses based on the anatomical-functional correspondence. They evaluated the prediction by calculating the mean absolute errors (AE) of the difference between the actual and predicted contrast responses. Although AE linearly increases with the quality of the prediction, it is difficult to measure the prediction performance of the shape, size, and location of the functional areas precisely using this mean value. With our algorithm, we were able to predict the general location and size of the areas and recover the individualized shapes, generating more powerful predictions. We also used the searchlight analysis to evaluate the performance across the cortex systematically. In addition, Osher et al. (2016) and Saygin et al. (2012) always have a few participants failing to show better predictions based on the connectivity than the group averaged method. Our algorithm is more stable, as all participants across all four datasets had better predicted performance using our algorithm than using the group average. However, although we did not directly use the anatomical-functional correspondence with DWI, the relationships between individual structural connectivity and cortical visual category selectivity could be one of the biological underpinnings that contribute to this robust and accurate prediction.

      The Connectivity-Based Shared Response Model (cSRM, Nastase et al., 2020) offers an alternative framework for aligning individuals through functional connectivity. While the overarching aim of cSRM and our methodology converges, substantial differences emerge in the respective implementation and application between the two methods that make our approach the more suitable for predicting individualized topographies. The most significant difference between the two is that, instead of focusing on within-individual connectivity profiles, cSRM used inter-subject functional connectivity (ISFC) in the initial step. This design requires that all participants must have time-locked time series, making the algorithm unusable for cross-content prediction and making it incompatible with resting-state data. Our approach, on the other hand, does not require time-locked stimuli, thereby offering a more flexible framework that permits generalization across different types of stimuli and experimental settings and enables bringing data across laboratories across the world together. Secondly, cSRM predominantly focuses on Region of Interest (ROI) analyses, whereas our model employs searchlight-based analyses designed to comprehensively cover the entire cortical sheet. Whole-brain coverage is needed to generate the topography that reflects the patterns across the cortex. Finally, with the optimized 1step method, our approach directly hyeraligns the training and target participants together, avoiding the accumulation of errors from the intermediate common space. cSRM, with an implementation similar to the classic connectivity hyperalignment, creates and hyperaligns all participants to a shared information space. In summary, while our approach and cSRM share a similar theoretical foundation, our approach has been specifically optimized to address the challenges and complexities in predicting individualized whole-brain functional topographies. Moreover, our approach demonstrates a remarkable ability to generalize across a variety of contexts and stimuli, offering a significant advantage in dealing with diverse experimental settings and datasets.

      We have added the contents to the discussion section (page 16-17):

      “By leveraging transformation matrices obtained from hyperaligning participants based on movie-viewing data, we successfully mapped these relationships to the training participants’ localizer data, enabling robust predictions. Prior work employing diffusion-weighted imaging (DWI) has underscored the link between anatomical connectivity and category selectivity across diverse visual fields (22, 23) and has established a notable congruence between structural and functional connectivities (24). These findings suggest that the unique anatomical connectivity patterns of individuals may serve as a foundational mechanism, contributing to the stable finescale functional connectome that underpins our approach. The connectivity-based Shared Response Model (cSRM) proposed by Nastase and colleagues (25) used connectivity to functionally align individuals similar to the connectivity hyperalignment algorithm. While both approaches share overarching goals, they diverge considerably in implementation and application. First and most important, cSRM used inter-subject functional connectivity (ISFC) rather than within-subject functional connectivity to initially estimate the connectome. As a result, cSRM requires participants to have time-locked fMRI time series. Therefore, unlike our algorithm, the cSRM approach does not support cross-content applications and also is not suitable for use with resting-state data. Second, cSRM is implemented based on a predefined cortical parcellation rather than the overlapping, regularly-spaced cortical searchlights applied in our method which are not constrained by areal borders. For the application, cSRM has mainly been used to do ROI analysis rather than the estimation of the whole-brain topography that requires broader coverage of the cortex with a searchlight analysis. Third, our method is specifically designed to work in each individual’s space, while cSRM decomposes data across subjects into shared and subjectspecific transformations, focusing on a communal connectivity space. In summary, although cSRM presents a promising alternative for similar aims, its current implementation precludes it from fulfilling the range of applications for which our method is optimized.”

      With this in mind, I noted several current weaknesses in the paper:

      First, while the enhanced CHA method is a promising update on existing CHA techniques, it is unclear why this particular six step, iterative approach was adopted. That is: why was six steps chosen over any other number? At present, it is not clear if there is an explicit loss function that the authors are minimizing over their iterations. The relative computational cost of six iterations is also likely significant, particularly compared to previous hyperalignment algorithms. A more detailed theoretical understanding of why six iterations are necessary-or if other researchers could adopt a variable number according to the characteristics of their data-would significantly improve the transferability of this method.

      In the advanced connectivity hyperalignment implementation, we gradually increased the number of targets. The six steps were not intentionally chosen but were the result of the increase to the maximum number of fine-grained targets, namely single cortical vertices.

      Our datasets were resampled to the cortical mesh with 18,742 vertices across both hemispheres (approximately 3 mm vertex spacing; icoorder 5; 20,484 vertices before removing non-cortical vertices). Step 1 was the classic standard connectivity hyperalignment implementation based on the anatomically-aligned data. Since using dense connectivity targets (e.g., using all 18742 vertices on the surface) with anatomically-aligned data generates poor functional correspondence across participants (Busch et al., 2021), we used 1,284 vertices (icoorder 3, before removing the medial wall) as connectivity targets in step 1. However, it is beneficial to include more targets for calculating connectivity patterns after the first iteration of connectivity hyperalignment and repeated iterations to lead to a better solution by gradually aligning the information at finer scales. To better align across participants, we iterated the alignment for another two times (step 2 and step 3) with the same number of 1,284 coarse connectivity targets to ensure improved alignment before increasing the number of targets in the later steps. In step 4, we increased the number of targets to 5,124 (icoorder 4, before removing the medial wall), and iterated with this number of vertices for two times in total (step 4 & step 5) before using all vertices as targets. In the final step (step 6), all vertices were used as connectivity targets.

      It is true that the multiple iteration steps largely increased the computational complexity compared to the classic connectivity hyperalignment, but the prediction increase was steady across all datasets and became comparable to response hyperalignment performance which requires time-locked stimuli. We did not use an explicit loss function in the algorithm, but followed the natural progression of the number of potential connectivity targets in the implementation. On the other hand, the difference between the performance of the improved and the classic connectivity hyperalignment was relatively small (difference of r < 0.05), which indicates the effectiveness of our classic algorithm. It is up to the researchers’ own options to adopt the number of iterations and the pace of increasing the number of targets in each step. If computational resources are limited or if a shorter total computational time is the primary priority, using the classic connectivity hyperalignment may be the best option to balance the trade-offs.

      The Materials and Methods section had the details of the implementation (page 22-23):

      “Using dense connectivity targets (e.g., using all 18742 vertices on the surface) with anatomically-aligned data usually generates poor functional correspondence across participants (33). It is, however, beneficial to include more targets for calculating connectivity patterns after the first iteration of connectivity hyperalignment and repeated iterations to lead to a better solution by gradually aligning the information at finer scales.

      We used six steps to further improve the connectivity hyperalignment method. Step 1 was the initial connectivity hyperalignment step as described above that was based on the raw anatomically aligned movie data. The resultant transformation matrices were applied to those movie runs, and the hyperaligned data were then used in step 2 to calculate new connectivity patterns and calculate new transformation matrices. We repeated this procedure iteratively six times and derived transformation matrices for each step. In steps 1, 2, and 3, 642 × 2 (icoorder3, before removing the medial wall) connectivity targets were defined with 13 mm searchlights. In step 4 and 5, 2562 × 2 (icoorder 4, before removing the medial wall) connectivity targets were used with 7 mm searchlights to calculate target mean time series. In the final step 6, all 18742 vertices were included as separate connectivity targets, using each vertex’s time series rather than calculating the mean in a searchlight. Each step of this advanced connectivity hyperalignment algorithm increased the prediction performance (Figure 4-figure supplement 2).”

      But to help the readers understand the logic of the advanced connectivity hyperalignment algorithm used in this study, we expanded the discussion section (page 15):

      “Because using dense connectivity targets (e.g., using all vertices as connectivity targets) with anatomically-alignment data often leads to suboptimal alignment across participants (33), we started with coarse connectivity targets and gradually increased the number of connectivity targets to form a denser representation of connectivity profiles. The iterations improved the prediction performance step by step, and at the final step (step 6, all vertices were used as connectivity targets) in this analysis, the enhanced CHA generated comparable performance with RHA (Figure 4-figure supplement 4).”

      Second, the existing evaluations for enhanced CHA appear to be entirely based on imagederived correlations. That is, the authors compare the predicted image from CHA with the ground-truth image using correlation. While this provides promising initial evidence, correlation-based measures are often difficult to interpret given their sensitivity to image characteristics such as smoothness. Including Cronbach's alpha reliability as a baseline does not address this concern, as it is similarly an image-based statistic. It would be useful to see additional predictive experiments using frameworks such as time-segment classification, intersubject decoding, or encoding models.

      We appreciate the reviewer’s concern regarding the stability of local correlations in relation to image characteristics. To address this, we conducted additional analysis using different searchlight sizes (with radii of 10 mm, 15 mm, and 20 mm) to evaluate the predicted categoryselective maps, focusing specifically on the Budapest dataset. The local correlations between the predicted category-selective maps (obtained using enhanced CHA) and participants’ own maps based on classic localizer runs were calculated for each searchlight. We averaged these correlations across participants and plotted the resulting maps, as shown in Figure 4-figure supplement 10. Although using a larger searchlight radius is similar to employing a larger smoothing kernel, the results remained relatively stable across different searchlight sizes, particularly in regions selectively responsive to the specific category. This stability suggests that while the evaluation may be influenced by image-related features, the conclusion would remain consistent under varying parameters.

      As for the use of enhanced CHA, it serves as an optimized version of the classic CHA, specifically designed for predicting individualized functional topographies. Evaluating prediction performance in our study is based on t-value contrast maps for each participant. Given this, it's unclear how time-segment classification or other decoding/encoding models could be appropriately implemented for performance evaluation. However, prior research from our lab has already established the effectiveness of classic CHA. Specifically, Guntupalli et al. (2018) showed that classic CHA significantly improved intersubject correlations (ISC) of connectivity profiles across the cortex. They also revealed that CHA captured fine-scale variations in connectivity profiles for nearby cortical nodes across participants and led to improved betweensubject multivariate pattern classification accuracies (bsMVPC) of movie segments. These findings serve as robust evidence for the effectiveness of classic CHA, laying the groundwork for our enhanced CHA approach.

      We added Figure 4-figure supplement 10 to the supplementary material:

      Addressing these concerns and considering cSRM as a comparison model would significantly strengthen the paper. There are also notable strengths that I would encourage the authors to further pursue. In particular, the authors have access to a unique dataset in which the same Raiders of the Lost Ark stimulus was scanned for participants within the Budapest (SRaiders) dataset as well as non-overlapping participants in the Raiders dataset. Exploring the relative performance for cross-movie prediction within a dataset as compared to a shared movie prediction across datasets is particularly interesting for methods development. I would encourage the authors to explicitly report results in this framework to highlight both this unique testing structure as well as the performance of their enhanced CHA method.

      We appreciate the reviewer's suggestion to examine a shared time-series but non-overlapping participants scenario using the Sraiders and Raiders datasets. However, there are significant differences between the two datasets that preclude such direct comparison. These differences include varying scanning parameters, MRI scanners, localizer types, and data collection procedures. Due to these methodological divergences, the datasets cannot be treated as identical time-series.

      Firstly, the scanning parameters vary considerably. Sraiders were scanned with TR = 1 s (TR/TE = 1000/33 ms, flip angle = 59 °, resolution = 2.5 mm3 isotropic voxels, matrix size = 96 × 96, FoV = 240 × 240 mm, multiband acceleration factor = 4, and no in-plane acceleration), and Raiders were scanned with TR = 2.5 s (TR = 2.5 s, TE = 35 ms, Flip angle = 90°, 80 × 80 matrix, FOV = 240 mm × 240 mm, resolution = 0.938 mm × 0.938 mm × 1.0 mm).

      Secondly, participants in the Sraiders were scanned with a 3 T S Magnetom Prisma MRI scanner with a 32 channel head coil and the Raiders dataset, collected more than 10 years ago, used a 3T Philips Intera Achieva scanner with an eight-channel head coil.

      Thirdly, the stimuli presentations were different. In the Sraiders dataset, the movie Raiders of the Lost Ark was split into eight parts (~15 min each), and the first four parts were watched outside of the scanner prior to the scanning (~56 min). The later four parts were watched in the scanner (57 min) with audio. And in the Raiders dataset, the audio-visual movie was split into eight parts (~15 min each). Participants watched all eight parts in the scanner with audio (one part / per run).

      Fourthly and critically, the two datasets included two types of localizers. The Sraiders dataset included dynamic localizer runs, and the Raiders dataset only contained a static localizer that was similarly designed as in the Forrest dataset.

      With all four points, it is not suitable to treat the two datasets as identical time-series. The difference in the localizer type is a further issue. The topographies generated from the two types of localizers are dissimilar in many ways. For all categories, the dynamic localizer elicited stronger and broader category-selective activations than the static localizer, and the searchlight analysis showed that the dynamic localizer had higher reliabilities across the cortex, especially in regions that were selectively responsive to the target category. Due to these differences, crossdataset predictions yielded lower correlations than within-dataset predictions. This is not indicative of methodological failure but reflects diverging topographies activated by different localizers.

      In the manuscript, we have extensively analyzed cross-dataset predictions (Figure 2-figure supplement 1-Figure 4-figure supplement 4 & 6).

      ● Figure 2-figure supplement 1 demonstrates that, despite the limitations of cross-localizertype evaluation, both R-to-S (Raiders to Sraiders) and S-to-R (Sraiders to Raiders) predictions significantly outperformed surface alignment methods across categories.

      ● Figure Figure 2-figure supplement 2 confirms that the prediction performance remained stable across individual participants, underscoring the robustness of our methodology.

      ● Figure 3-figure supplement 1 & Figure 3-figure supplement 2 display contrast maps generated from both native and alternate localizers, revealing that the maps share similar topographies irrespective of the dataset origin.

      ● Figure 4-figure supplement 1 presents a correlation analysis of local similarities in R-to-S and S-to-R predictions, highlighting particularly strong correlations in the ventral face regions.

      ● Figure 4-figure supplement 2 employs histograms to showcase performance across major cortices and furnishes additional evidence regarding the influence of localizer types on the results.

      ● Figure 4-figure supplement 3 offers a searchlight analysis for other categories, enriching the scope of our investigation.

      ● Figure 4-figure supplement 4 affirms that the advanced CHA is effective in both R-to-S and S-to-R predictions.

      ● Figure 4-figure supplement 6 compares the efficacy of 1-step vs. 2-step prediction methods for R-to-S and S-to-R, showing a clear advantage for the 1-step approach.

      These analyses affirmed that our approach outperforms surface alignment methods. But the inherent limitations in data collection and localizer types preclude a direct exploration of the reviewer’s hypothesis. These complexities necessitate further research to fully validate the proposed scenario.

      Overall, I share the authors' enthusiasm for the potential of cross-movie, cross-dataset prediction, and I believe that methods such as enhanced CHA are likely to significantly improve our ability to make these comparisons in the near future. At present, however, I find that the theoretical and experimental support for enhanced CHA is incomplete. It is therefore difficult to assess how enhanced CHA meets its goals or how successfully other researchers would be able to adopt this method in their own experiments.

      We hope our new analysis and replies addressed the reviewer’s concerns.

    2. Reviewer #2 (Public Review):

      Guo and her colleagues develop a new approach to map the category-selective functional topographies in individual participants based on their movie-viewing fMRI data and functional localizer data from a normative sample. The connectivity hyperalignment are used to derived the transformation matrices between the participants according to their functional connectomes during movies watching. The transformation matrices are then used to project the localizer data from the normative sample into the new participant and create the idiosyncratic cortical topography for the participant. The authors demonstrate that a target participant's individualized category-selective topography can be accurately estimated using connectivity hyperalignment, regardless of whether different movies are used to calculate the connectome and regardless of other data collection parameters. The new approach allows researchers to estimate a broad range of functional topographies based on naturalistic movies and a normative database, making it possible to integrate datasets from laboratories worldwide to map functional areas for individuals. The topic is of broad interest for neuroimaging community; the rationale of the study is straightforward and the experiments were well designed; the results are comprehensive. I have some concerns that the authors may want to address, particularly on the details of the pipeline used to map individual category-selective functional topographies.

      1. How does the length of the scan-length of movie-viewing fMRI affect the accuracy in predicting the idiosyncratic cortical topography? Similarly, how does the number of participants in the normative database affect the prediction of the category-selective topography? This information is important for the researchers who are interested in using the approach in their studies.<br /> 2. The data show that category-selective topography can be accurately estimated using connectivity hyperalignment, regardless of whether different movies are used to calculate the connectome and regardless of other data collection parameters. I'm wondering whether the functional connectome from resting state fMRI can do the same job as the movie-watching fMRI. If it is yes, it will expand the approach to broader data.<br /> 3. The authors averaged the hyper-aligned functional localizer data from all of subjects to predict individual category-selective topographies. As there are large spatial variability in the functional areas across subjects, averaging the data from many subjects may blur boundaries of the functional areas. A better solution might be to average those subjects who show highly similar connectome to the target subjects.<br /> 4. It is good to see that predictions made with hyperalignment were close to and sometimes even exceeded the reliability values measured by Cronbach's alpha. But, please clarify how the Cronbach's alpha is calculated.<br /> 5. Which algorithm was used to perform surface-based anatomical alignment? Can the state-of-the-art Multimodal Surface Matching (MSM) algorithm from HCP achieve better performance?<br /> 6. Is it necessary to project to the time course of the functional localizer from the normative sample into the new participants? Does it work if we just project the contrast maps from the normative samples to the new subjects?<br /> 7. Saygin and her colleagues have demonstrated that structural connectivity fingerprints can predict cortical selectivity for multiple visual categories across cortex (Osher DE et al, 2016, Cerebral Cortex; Saygin et al, 2011, Nat. Neurosci). I think there's a connection between those studies and the current study. If the author can discuss the connection between them, it may help us understand why CHA work so well.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1 (Public Review):

      Soudi, Jahani et al. provide a valuable comparative study of local adaptation in four species of sunflowers and investigate the repeatability of observed genomic signals of adaptation and their link to haploblocks, known to be numerous and important in this system. The study builds on previous work in sunflowers that have investigated haploblocks in those species and on methodologies developed to look at repeated signals of local adaptations. The authors provide solid evidence of both genotype-environment associations (GEA) and genome-wide association study (GWAS), as well as phenotypic correlations with the environment, to show that part of the local adaptation signal is repeatable and significantly co-occur in regions harboring haploblocks. Results also show that part of the signal is species specific and points to high genetic redundancy. The authors rightfully point out the complexities of the adaptation process and that the truth must lie somewhere between two extreme models of evolutionary genetics, i.e. a population genetics view of large effect loci and a quantitative genetics model. The authors take great care in acknowledging and investigating the multiple biases inherent to the used methods (GEA and GWAS) and use a conservative approach to draw their conclusions. The multiplicity of analyses and their interdependence make them slightly hard to understand and the manuscript would benefit from more careful explanations of concepts and logical links throughout. This work will be of interest to evolutionary biologists and population geneticists in particular, and constitutes an additional applied example to the comparative local adaptation literature.

      Some thoughts on the last paragraph of the discussion (L481-497): I think it would be fine to have some more thoughts here on the processes that could contribute to the presence/absence of inversions, maybe in an "Ideas and Speculation" subsection. To me, your results point to the fact that though inversions are often presented as important for local adaptation, they seem to be highly contingent on the context of adaptation in each species. First, repeatability results are only at the window/gene level in your results, the specific mutations are not under scrutiny. Is it possible that inversions are only necessary when sets of small effect mutations are used, opposite to a large effect mutation in other species? Additionally, in a model with epistasis, fitness effects of mutations are dependent on the genomic background and it is possible that inversions were necessary in only certain contexts, even for the same mutations, i.e. some adaptive path contingency. Finally, do you have specific demographic history knowledge in this system that maps to the observations of the presence of inversions or not? For example, have the species "using" inversions been subject to more gene flow compared to others?

      Thank you for the great suggestions and helpful comments. Regarding the question of demography, each of the species actually harbours quite a large number of haploblocks (13 in H. annuus spanning 326Mb, 6 in H. argophyllus spanning 114 Mb, and 18 in H. petiolaris spanning 467 Mb; see Todesco et al. 2020 for more details) so there does not seem to be any clear association with demography. We agree about the complexities that might underly the evolution of inversions that you outline above, and have refined some of the text where we discuss their evolution in the Discussion.

      Reviewer #2 (Public Review):

      In this study the authors sought to understand the extent of similarity among species in intraspecific adaptation to environmental heterogeneity at the phenotypic and genetic levels. A particular focus was to evaluate if regions that were associated with adaptation within putative inversions in one species were also candidates for adaptation in another species that lacked those inversions. This study is timely for the field of evolutionary genomics, due to recent interest surrounding how inversions arise and become established in adaptation.

      Major strengths

      Their study system was well suited to addressing the aims, given that the different species of sunflower all had GWAS data on the same phenotypes from common garden experiments as well as landscape genomic data, and orthologous SNPs could be identified. Organizing a dataset of this magnitude is no small feat. The authors integrate many state-of-the-art statistical methods that they have developed in previous research into a framework for correlating genomic Windows of Repeated Association (WRA, also amalgamated into Clusters of Repeated Association based on LD among windows) with Similarity In Phenotype-Environment Correlation (SIPEC). The WRA/CRA methods are very useful and the authors do an excellent job at outlining the rationale for these methods.

      Thank you!

      Major weaknesses

      The study results rely heavily on the SIPEC measure, but I found the values reported difficult to interpret biologically. For example, in Figure 4 there is a range of SIPEC from 0 to 0.03 for most species pairs, with some pairs only as high as ~0.01. This does not appear to be a high degree of similarity in phenotype-environment correlation. For example, given the equation on line 517 for a single phenotype, if one species has a phenotype-environment correlation of 1.0 and the other has a correlation of 0.02, I would postulate that these two species do not have similar evolutionary responses, but the equation would give a value of (1+0.02)10.02/1 = 0.02 which is pretty typical "higher" value in Figure 4. I also question the logic behind using absolute values of the correlations for the SIPEC, because if a trait increases with an environment in one species but decreases with the environment in another species, I would not predict that the genetic basis of adaptation would be similar (as a side note, I would not question the logic behind using absolute correlations for associations with alleles, due to the arbitrary nature of signing alleles). I might be missing something here, so I look forward to reading the author's responses on these thoughts.

      The reviewer makes a very good point about the range of SIPEC, and we have changed our analysis to reflect this, now reporting the maximum value of SIPEC for each environment (across the axes of the PCA on phenotypes that cumulatively explain 95% of the variance), in Figure 4 and Supplementary Figures S2 and S13. For consistency among manuscript versions and to illustrate the effect of this change, we retain the mean SIPEC value in one figure in the supplementary materials (S12), which shows the small effect of this change on the qualitative patterns. Figure 4 now shows that the maximum SIPEC value is regularly quite strong, which should address the reviewer’s concern that this is not being driven by anomalous and small values. We appreciate this point and think this change now more closely reflects how we are trying to estimate the biological feature of interest – that some axis of phenotypic space is strongly (or not) responding to selection from the environmental variable.

      With respect to the logic behind using absolute value, we still feel this is justified for traits, because if a trait evolves to be bigger or smaller, it may still use the same genes. For example, flowering time may change to be later or earlier, which would result in opposite correlations with a given environment, but might use the same gene (e.g. FT) for this. As such, we think keeping absolute value is more representative as otherwise species with strong but opposite patterns of adaptation would look like they were very different. We have added a statement on line 584 in the methods section to further clarify the reason for this choice.

      An additional potential problem with the analysis is that from the way the analysis is presented, it appears that the 33 environmental variables were essentially treated as independent data points (e.g. in Figure 4, Figure 5). It's not appropriate to treat the environmental variables independently because many of them are highly correlated. For example in Figure 4, many of the high similarity/CRA values tend to be categorized as temperature variables, which are likely to be highly correlated with each other. This seems like a type of pseudo replication and is a major weakness of the framework.

      This is a good point and we fully agree. It is for this reason that we didn’t present any p-values or statistical tests of the overall patterns that are shown in these figures (i.e. the linear relationship between SIPEC and number of CRAs in figure 4 and the tendency for most points to fall above the 1:1 line in figure 5). But to make sure this is even more clear, we have added statements to the captions of these figures to remind readers that points are non-independent. We still feel that in the absence of a formal test, the overall patterns are strongly consistent with this interpretation. A smaller number of non-pseudo-replicated points in Figure 4 would still likely show linear patterns. Similarly, there are almost no significant points falling below the 1:1 line in Figure 5, and it seems unlikely that pseudoreplication would generate this pattern.

      Below I highlight the main claims from the study and evaluate how well the results support the conclusions.

      "We find evidence of significant genome-wide repeatability in signatures of association to phenotypes and environments" (abstract)<br /> Given the questions above about SIPEC, I did not find this conclusion well supported with the way the data are presented in the manuscript.

      We have changed the reporting of the SIPEC metric so that it more clearly reflects whichever axis of phenotypic space is most strongly correlated with environment in both species (using max instead of mean). This shows similar qualitative patterns but illustrates that this happens across much higher values of SIPEC, showing that it is in fact driven by high correlations in each species (or non-similar correlations resulting in low values of SIPEC). While we agree about the pseudo-replication problem preventing formal statistical test of this hypothesis, the visual pattern is striking and seems unlikely to be an artefact, so we think this does still support this conclusion.

      "We find evidence of significant genome-wide repeatability in signatures of association to phenotypes and environments, which are particularly enriched within regions of the genome harbouring an inversion in one species. " (Abstract) And "increased repeatability found in regions of the genome that harbour inversions" (Discussion)<br /> These claims are supported by the data shown in Figure 4, which shows that haploblocks are enriched for WRAs. I want to clarify a point about the wording here, as my understanding of the analysis is that the authors test if haploblocks are enriched with WRAs, not whether WRAs are enriched for haploblocks. The wording of the abstract is claiming the latter, but I think what they tested was the former. Let me know if I'm missing something here.

      We are actually not interested in whether WRAs are enriched for haploblocks; we want to know if WRAs tend to occur more commonly within haploblocks than outside of them. We have tried to clarify that this is our aim in various places in the manuscript. Our analysis for Figure 5 is the one supporting these claims, and it uses the Chi-square test statistic to assess the number of WRAs and non-WRAs that fall within vs. outside of inversions, and a permutation test to assess the significance of this observation, for each environmental variable and phenotype. We don’t think that this test has any direction to it – it’s simply testing if there is non-random association between the levels of the two factors. Thus, we think the wording we have used is consistent with the test result and our aims. Perhaps the confusion arose from the two methods that we present in the Methods (one is used for Figure 5, the other for Figure S6C & D), so we have added clarifications there.

      Notwithstanding the concerns about highly correlated environments potentially inflating some of the patterns in the manuscript, to my knowledge this is the first attempt in the literature to try this kind of comparison, and the results does generally suggest that inversions are more likely capturing, rather than accumulating adaptive variation. However, I don't think the authors can claim that repeated signatures are enriched with haploblock regions, and the authors should take care to refrain from stating the relative importance of different regions of the genome to adaptation without an analysis.

      Actually, we don’t have a strong feeling about whether inversions are capturing vs. accumulating adaptive variation, as these results could be consistent with either. As described above, we do not understand why we can’t claim that repeated signatures are enriched within haploblocks. We thought the reviewer is perhaps referring to the fact that the points are pseudo-replicated in the figures due to environment? We note that a very large number of points are significantly different from random in terms of the distribution of WRAs within vs. outside of haploblocks (light- vs. dark-shaded symbols), and that almost all of them fall above the 1:1 line. While there may be pseudo-replication preventing a test of the bigger multi-environment/multi-species hypothesis across all phenotypes and environments, there is almost a complete lack of significant results in the other direction. This seems like quite strong evidence about enrichment of WRAs within haploblocks, across many environments/species contrasts. We have added some text to the description of patterns in figure 5 to try to clarify this.

      "While a large number of genomic regions show evidence of repeated adaptation, most of the strongest signatures of association still tend to be species-specific, indicating substantial genotypic redundancy for local adaptation in these species." (Abstract)<br /> Figure 3B certainly makes it look like there is very little similarity among species in the genetic basis of adaptation, which leaves the question as to how important the repeated signatures really are for adaptation if there are very few of them. (Is 3B for the whole genome or only that region?). This result seems to be at odds with the large number of CRAs and the claims about the importance of haploblock regions to adaptation, which extend from my previous point.

      Figure 3B is for the whole genome, we have added text to the figure caption to clarify this. We think that both interpretations are possible: that most of the regions of the genome that are driving adaptation are non-repeated, but that a small but significant proportion of regions driving adaptation are repeated above what would be expected at random. Thus, it seems that there is high redundancy, coupled with adaptation via some genes that seem particularly functionally important and non-redundant, and therefore repeated. We added clarifying text on lines 541-548.

      "we have shown evidence of significant repeatability in the basis of local adaptation (Figure 4, 5), but also an abundance of species-specific, non-repeated signatures (Figure 3)"<br /> While the claim is a solid one, I am left wondering how much of these genomes show repeated vs. non-repeated signatures, how much of these genomes have haploblocks, and how much overlap there really is. Finding a way to intuitively represent these unknowns would greatly strengthen the manuscript.

      We agree, and really struggled to find the best way to communicate both the repeated patterns and the large amount of non-repeated signatures. Unfortunately, we have more confidence in the validity of repeated patterns because for the non-repeated patterns, a strong signature of association to environment in only one species could just be the product of structureenvironment correlation, as we didn’t control for population structure. Thus, trying to quantify the proportion of non-repeated signatures is difficult to do with any accuracy and we preferred to avoid putting too much emphasis on the simple calculation of the proportion of top candidate windows that were also WRAs.

      Overall, I think the main claims from the study, the statistical framework, and the results could be revised to better support each other.

      Although the current version of the manuscript has some potential shortcomings with regards to the statistical approaches, and the impact of this paper in its present form could be stifled because the biology tended to get lost in the statistics, these shortcomings may be addressed by the authors.

      With some revisions, the framework and data could have a high impact and be of high utility to the community.

      Thank you for your very helpful comments and suggestions on our paper, we really appreciate it.

      Recommendations for the authors: please note that you control which revisions to undertake from the public reviews and recommendations for the authors

      Editor's comments:

      The reviewers make a series of reasonable suggestions that I echo. I found the paper quite hard to follow, and got fairly lost in the various layers of analyses done. Partially, this represents the complexity of empirical genomic data, which rarely deliver simple stories of convergence at a few genes. However, the properties of the various statistics used to detail local adaptation and convergence are not particularly clear and the figures presented were not intuitive representations of the data. This leaves the reader with an incomplete view of how much weight to put in the various lines of evidence marshaled. I would suggest simplifying the presentation of the results considerably. I add a few additional comments below.

      Great suggestion, we’ve added a schematic overview of the methods and main research questions to Figure S1 in the supplementary materials.

      A figure would help showing some of the signals of SNPs with putative signals of convergent environmental correlations across species, e.g. frequencies plotted against climate variables. This would help readers get a sense of how strong these signals were. These could be accompanied by the statistics calculated for these SNPs, that would allow the reader to start to get some intuitive sense of what the numbers mean.

      Great suggestion, we have added a schematic overview of the methods to Figure S1 that shows some of the values and illustrates how the methods work using visual examples from our data.

      In general, the introduction and some of the discussion of the inversion results feel oddly framed:<br /> Abstract line 36: "This shows that while inversions may facilitate local adaptation, at least some of the loci involved can still make substantial contributions without the benefit of recombination suppression."

      We have changed “some of the loci involved can still make substantial contributions without the benefit of recombination suppression” here to “some of the loci involved can still harbour mutations that make substantial contributions without the benefit of recombination suppression in species lacking a segregating inversion” as it hopefully clarifies that we’re not talking about individual alleles that are present in both species.

      Models of the role of local adaptation in the establishment of inversions (Kirkpatrick & Barton) assume that there are multiple locally adapted alleles already present. It is the load created by these alleles being constantly maintained in the face of migration and subsequent recombination that allow an inversion to be selected for because it keeps together locally adapted alleles. Thus these models predict that there could well be standing local adaptation at these loci in the absence of the inversion in other species, and that these locally adapted alleles while not fixed may be at high frequency. (After establishment, inversions housing locally adapted alleles, can shield more weakly, locally beneficial alleles from migration allow other alleles to build up.) Empirically it's interesting to find signals of local adaptation in other species that don't contain putative inversions. But the logic of the different predictions is not particularly clear from the introduction, and only becomes somewhat clearer in the discussion.

      Thank you for pointing out this murkiness, we have re-written portions of both the Introduction and Discussion to clarify this aspect.

      From the introduction: Inversions have been implicated in local adaptation in many species (Wellenreuther and Bernatchez 2018), likely due to their effect to suppress recombination among inverted and noninverted haplotypes, and thereby maintain LD among beneficial combinations of locally adapted alleles (Rieseberg 2001; Noor et al. 2001; Kirkpatrick and Barton 2006). This has been approached by models studying the establishment of inversions that capture combinations of locally adapted alleles present as standing variation (e.g., Kirkpatrick and Barton 2006), as well as models examining the accumulation of locally adapted mutations within inversions (e.g., Schaal et al. 2022). If there is variation in the density of loci that can potentially contribute to local adaptation, inversions would be expected to preferentially establish and be retained in regions harbouring a high density of such loci (and this expectation would hold for both the capture and accumulation models). We would also expect to see stronger signatures of repeated local adaptation in such high density regions. Despite mounting evidence of their importance in adaptation, it is unclear how inversions may covary with repeatability of adaptation among species. A fundamental parameter of importance in these models is the relationship between migration rate and strength of selection on individual alleles, which may not make persistent contributions to local adaptation without the suppressing effects of recombination if selection is too weak (Yeaman and Whitlock 2011; Bürger and Akerman 2011). If most alleles have small effects relative to migration rate and can only contribute to local adaptation via the benefit of the recombination-suppressing effect of an inversion, then we would expect little repeatability at the site of an inversion – other species lacking the inversion would not tend to use that same region for adaptation because selection would be too weak for alleles to persist. On the other hand, if some loci are particularly important for local adaptation and regularly yield mutations of large effect, with these patterns being conserved among species, repeatability within regions harbouring inversions may be substantial. Thus, studying whether adaptation at the same genomic region harbouring an inversion is observed in other species lacking the inversion can give insights about the underlying architecture of adaptation, and the evolution and maintenance of inversions.

      From the Discussion: The observed repeatability associated with inversions further supports the local adaptation model as an explanation for the long-term persistence of segregating inversions (at least in sunflowers, rather than mechanisms based on dominance or meiotic drive (Rieseberg 2001). If there is variation across the genome in the density of loci with the potential to be involved in local adaptation, then the establishment and maintenance of inversions would be biased towards regions harbouring a high density such loci under this model. If the genomic basis for local adaptation is conserved amongst species, then these same regions are more likely to have high repeatability. Thus, our observation of genomic regions harbouring inversions also being enriched for WRAs is consistent with this general model for inversion evolution. Unfortunately, our observations do not provide much insight into whether inversions evolve through the capture (e.g. Kirkpatrick and Barton 2006) or accumulation (e.g. Schaal et al. 2022) type of model, as either model would be consistent with our results. Most of the sunflower inversions are >1 My old, and therefore predate any current local adaptation patterns, but likely do not predate the genes underlying local adaptation (which appear to be shared among the species we studied). As for the alleles underlying local adaptation, they may be younger than the inversions, but as our work suggests, these regions are prone to harbouring locally adaptive alleles so it is possible that they also harboured other ancestral locally adaptive alleles.

      As a minor comment, there's a fair number of places where a more nuanced view of the field is needed, e.g.:<br /> "Models in evolutionary genetics tend to focus on extremes: population genetic approaches explore cases where strong selection deterministically drives a change in allele frequency" --This seems like a strange strawman. Population genetic models span a huge parameter range. The empirical approaches of looking for sweeps by detecting genome-wide statistical outliers is predicated on strong selection, but there are numerous papers that have looked for signals of weak selection genome-wide.

      Good point, we have changed our wording here.

      Reviewer #1 (Recommendations For The Authors):

      Comments

      My main comment on the manuscript is that the different levels and diversity of analyses are slightly hard to follow on the first, and even second, read. As there are several layers of correlations and comparisons, as well as some independent analyses, I wonder if it might be helpful to have a summary schematic figure of how all analyses fit together.

      Great idea, we have added Figure S1 that summarizes the main flow of the methods and research questions.

      • L169-171: Would it be more accurate to say that SIPEC is maximized when both species have strong correlations for an environmental variable across the same phenotypes? But maybe I misunderstood the index.

      Good point, we have now simplified SIPEC, reporting the max instead of the mean, which we think better reflects when similar patterns are happening in both species for some phenotype.

      • L191: Given the discussion in the introduction and elsewhere about the correction for population structure, which version is used here? Same for Figure 3.

      We have added clarification there.

      • L348: One [environmental] variable?

      Added

      • L353: Maybe add a percentage indication for 387 so that it is comparable to the following 23.3%.

      Good point, added

      -> L388 and paragraph: You mention "significant repeatability" but it is hard from the results at this point to have a broad idea of the amount of signal that is repeatable. Would it be possible to add here some quantitative measure of the proportion of signal repeatable or not, even if approximated?

      I wish we could, but I think the precision implied by such an approximation would involve a huge amount of uncertainty and likely inaccuracy. Because it is so hard to conclusively identify how many loci are significant but non-repeated, we really don’t have a good handle on the denominator here. We are pretty confident that the repeated loci are strongly enriched for true positives, but the non-repeated loci are also almost certainly strongly enriched for false positives. While we really want to be able to quantify this explicitly, we don’t think it’s possible given our data.

      -L415-418: "If there is variation [...] involved in local adaptation", I do not follow this argument, could you rephrase?

      Changed

      -L447-450: As you say in the supplementary methods, your analyses exclude 3/4 of the genome. Do you think this choice has a large impact on the number of outliers observed here as the genome-wide baseline would change?

      This is a very good question, but one that is quite complex and without a clear answer – we chose not to delve into it in the paper to keep the discussion streamlined. My (SY) feeling is that it is unlikely that regions harbouring transposable elements would contribute much to adaptation, but I think we really don’t know if that is true. Even excluding ¾ of the genome harbouring TEs, ¼ of the genome still constitutes a huge amount of sequence and a very large number of genes and it seems plausible that most genes and genic regions would not contribute to adaptation for a given trait, so I don’t think this would change the results too much in a qualitative way – but would almost certainly change the number of windows that are significant, etc.

      • L455-457: "As we are unable [...] potentially important drivers" Could you provide the logical link here between loci of small effect and them being important drivers. I presume you mean that the large effect loci found here only account for a small proportion of the heritability?

      Yes that’s what we meant here, so we’ve added some clarification.

      • L482: "enriched within inversions" should that be 'in genomic regions where there exist inversions in at least one species'? Thanks for catching that, yes. Changed.

      • Methods/SIPEC L512: Compared to the Results section it is unclear here what is referred to as an "environment" Is it a variable or a set of environment variables?

      This is done per environmental variable.

      I find the presence of the PCA for environment variables in Figure 2 misleading as my first interpretation was that PCs for environment were also used.

      Good point, we have clarified this on line 190-193.

      Maybe one potential addition to the formula would be to add an environment variable $j$ notation such that it reads "$SIPEC_j = \sum_i (|r_{ij,1}| + ...) ...$ where ... between environment variable $j$". I had initial difficulties to understand how this SIPEC was computed relating to environmental variables and this might help.

      Given the other changes we made to SIPEC, we felt it was simpler to just present it as a single calculation on a given combination of phenotype and environment for a pair of species, and then discuss taking the mean and maximum of this later.

      Finally, PCA axes explaining 95% of the variance are used, I would find it interesting to see how many PCs are used in comparison to the number of traits being measured.

      We have added the following sentence to the methods describing this:

      "For comparisons including H. argophyllus, 95% of the variance was typically explained by 8-10 PC axes (out of 28 or 29 phenotypes), whereas for comparisons among other taxa this included 21 or 22 PC axes (out of 65 or 66 phenotypes."

      Typos

      L52: --

      Changed

      L254: portions [of] their

      Changed

      L399: additional closing parenthesis

      Changed

      L458: signatures [of] repeated association

      Changed

      L554: performed [on]

      Changed

      L578: 5 ~~kp~~/kb windows

      Changed

      L601: ~~casual~~/causal SNPs

      Changed

      L615: ~~widow~~/window

      Changed

      L732: ~~Banding~~/Banting Postdoctoral Fellowship

      Changed

      L1002 & L960: [Supplementary] Figure

      Changed

      Supplementary: Some figure titles are in bold and others are not.

      Changed

      Reviewer #2 (Recommendations For The Authors):

      Overall I found the writing to be very clear and easy to follow. Despite my comments, it was clear that a lot of thought went into how to conduct the tests and visualize the results. I recommend ending the Discussion on a positive note, rather than an impossible test.

      Thanks for the positive suggestion, we have done this.

      In Figure 5, is the temperature variable missing in the legend and in the plot?

      No, for this plot we just combined the temperature/precipitation variables into one variable called “climate”.

    1. Author Response

      The following is the authors’ response to the previous reviews.

      Our comments on the initial eLife assessment

      “This study presents a useful inventory of the joint effects of genetic and environmental factors on psychotic-like experiences, and identifies cognitive ability as a potential underlying mediating pathway. The data were analyzed using solid and validated methodology based on a large, multi-center dataset. The claim that these findings are of relevance to psychosis risk and have implications for policy changes are partially supported by the results”

      We sincerely appreciate the editor and reviewers for their valuable feedback and their willingness to accommodate our perspectives in the first revision. In this revision, the comments from the reviewers have allowed us to further improve our manuscript. Regarding the eLife assessment, we would like to discuss two points.

      Firstly, regarding your point of our “findings are of relevance to psychosis risk…partially supported…”, we want to address that our study is closely related to psychosis risk. Childhood psychotic-like experiences (PLEs) are closely linked to psychotic risk and have been shown to increase the risk of general psychopathology, as mentioned in our Introduction and Discussion.

      The reviewers asked for clearer differentiation between PLEs and schizophrenia, which we incorporated in this revision (line 100~111; line 419~430). So, this revised version now clearly points out that findings are relevant primarily to psychosis risk, and only partially relevant to schizophrenia risk.

      Secondly, regarding “…implications for policy changes are partially supported…”, we have revised our study’s social contribution more clearly and specifically. Incorporating the comments, we have revised that our study offers an insight to the future studies by showing the importance of integrative approaches, considering multi-factorial neurocognition and psychopathology ranging from genes to environment (line 503~512), rather than offers direct policy implications.

      Our collaboration with eLife and the reviewers has proven satisfactory and enriching. The community, coupled with the innovative system and culture established around eLife, has significantly advanced the progression of scientific research. We are privileged to contribute to this endeavor.

      Recommendations for the authors:

      Reviewer #1 (Recommendations For The Authors):

      I am happy with the revisions provided by the authors and I think most of my concerns have been addressed satisfactorily. One remaining concern is the authors' conflation of PLEs and schizophrenia. They stated, for example, that it is necessary to adjust for schizophrenia PGS. Even though studies have found a statistical relationship between schizophrenia PGS and PLEs, this relationship is not very strong (although statistically significant) and other studies have found no relationship. Similarly, having PLEs increases the risk of developing psychosis, but that does not necessarily mean that this risk is substantial or specific. I think this needs more nuance in the manuscript and the term 'schizophrenia' should be used sparsely and very carefully as the paper has focused on PLEs. Otherwise, great work on the revisions, thank you.

      Thank you for your comment on the use of PLEs and schizophrenia. We clearly understand the differences between the two and we made relevant corrections throughout the manuscript. In particular, we added that PLEs are not a direct predictor of schizophrenia and corrected any expressions that may imply that PLEs are closely related to schizophrenia in the Introduction.

      “Psychotic-like experiences (PLEs), which are prevalent in childhood, indicate the risk of psychosis (van der Steen et al., 2019; Van Os & Reininghaus, 2016). Although they are not a direct precursor of schizophrenia, children reporting PLEs in ages of 9-11 years are at higher risk of psychotic disorders in adulthood (Kelleher & Cannon, 2011; Poulton et al., 2000). PLEs also point towards the potential for other psychopathologies including mood, anxiety, and substance disorders (van der Steen et al., 2019), are linked to deficits in cognitive intelligence (Cannon et al., 2002; Kelleher & Cannon, 2011) and show a stronger association with environmental risk factors during childhood than other internalizing/externalizing symptoms (Karcher, Schiffman, et al., 2021).

      Maladaptive cognitive intelligence may act as a mediator for the effects of genetic and environmental risks on the manifestation of psychotic symptoms (Cannon et al., 2000; Keefe et al., 2006; Reichenberg et al., 2005).” (line 100~111)

      We also revised any expressions that could be perceived as implying relevance to schizophrenia in the Discussion. “Prior research identifying the mediation of cognitive intelligence focused on either genetic (Karcher, Paul, et al., 2021) or environmental factors (Lewis et al., 2020) alone. Studies with older clinical samples have shown that cognitive deficit may be a precursor for the onset of psychotic disorders (Eastvold et al., 2007; Fett et al., 2020; Vorstman et al., 2015). Our study advances this by demonstrating the integrated effects of genetic and environmental factors on PLEs through the cognitive intelligence in 9-11 years old children. Such comprehensive analysis contributes to assessing the relative importance of various factors influencing children's cognition and mental health, and it can aid future studies designed for identifying health policy implications. Considering the directions and magnitudes of the effects, though the effects of PGS remain significant, aggregated effects of environmental factors account for much greater degrees on PLEs.” (line 419~430)

      Reviewer #2 (Recommendations For The Authors):

      I thank the authors for addressing most of my comments. I feel the manuscript has already greatly improved.

      I have a few more comments.

      1) Although I did not make this comment, I find the authors' reply to the following comment by Reviewer #1 unclear: Original comment 'I like that the assessment of CP (cognitive performance) and self-reports PLEs is of good quality. However, I was wondering which 4 items from the parent-reported CBCL (Child Behavior Checklist) were used and how did they correlate with the child-reported PLEs? And how was distress taken into account in the child self-reported PLEs measurement? Which PLEs measures were used?'

      The authors' response refers to correlation coefficients, but I think Reviewer #1's inquiry was on more than these correlations.

      Thank you for your concern. We think that this comment was referring to our previous manuscript submitted elsewhere. In our initial submission to eLife, we already added the details about the four items from the parent-reported CBCL and how distress was considered in the child self-reported PLEs measurement (Appendix S1, page 48).

      2) Regarding the authors' reply that they have 'standardized the use of 'cognitive capacity' - I do not understand what this means. How exactly was this term standardized? In fact, I can find the term 'cognitive capacity' only once and it seemed to have been deleted from the manuscript. This is fine, but it doesn't clearly align with the statement that this term has been standardized.

      We apologize for causing such confusion. What we meant was that throughout our revised manuscript, we used the term “cognitive phenotypes” instead of “cognitive capacity”.

      3) Regarding my initial comment that 'it needs to be described how cognitive performance was defined in Lee 2018.' - I believe this is still not clarified. The authors write 'CP was measured as the respondent's score on cognitive ability assessments', but it remains unclear what exactly these assessments were.

      Thank you for pointing this out. We added that “CP, measured as the respondent's score on cognitive ability assessments of general cognitive function and verbal-numerical reasoning, was assessed in participants from the COGENT consortium and the UK Biobank” (line 204~206).

      4) Regarding the authors' reply to my comment 'In the 'Path Modeling' section, please explain what 'factors and components' concretely refer to. How is this different from a standard SEM with latent factors?'

      I can see that the authors explained 'components' (=the weighted sum of observed variables), but please also add what you mean by 'factors' - and how these are different from 'components' (line 284). Furthermore, I don't think it is correct that SEMs can only model latent factors, but not components (=measured variables). I also cannot see how using a weighted sum of observed variables controls more effectively for bias in estimation than latent factors. However, even though I do have some knowledge on this method, I'm not an expert and would appreciate the authors, other reviewer and/or editor to weigh in on this point.

      Thank you for pointing this out. We added that latent factors are indirectly measured indicators that explain the covariance among observed variables (line 263~271). We also added that standard SEM method using latent factors assumes that observed variables within each construct share a common underlying factor, but if this assumption is not met, then the standard SEM method cannot effectively control for biases. This is the reason why the IGSCA method, which addresses this limitation by allowing for use of both composite and latent factors as constructs.

      “Standard SEM using latent factors (i.e., indirectly measured indicators that explain the covariance among observed variables) to represent indicators such as PGS or family SES relies on the assumption that observed variables within each construct share a common underlying factor. If this assumption is violated, standard SEM cannot effectively control for estimation biases. The IGSCA method addresses this limitation by allowing for the use of composite indicators (i.e., components)—defined as a weighted sum of observed variables—as constructs in the model, more effectively controlling bias in estimation compared to the standard SEM. During estimation, the IGSCA determines weights of each observed variable in such a way as to maximize the variances of all endogenous indicators and components.” (line 263~271)

      5) I overall disagree with the authors' following statement 'It has been suggested from prior studies that these variables (PGS, family SES, neighborhood SES, positive family and school environment, and PLEs) are less likely to share a common factor', but I appreciate the authors' argument.

      Thank you for your comment. To make clarify our statement in the manuscript, we changed the sentence to “Considering that the observed variables of the PGSs, family SES, neighborhood SES, positive family and school environment, and PLEs are evaluated as a composite index by prior research, the IGSCA method can mitigate bias more effectively by representing these constructs as components” (line 274~277).

      6) Regarding 'genetic ethnicity': please describe your methods on how this was defined.

      Genetic ethnicity was defined as the genetic ancestry of participants, which is included as one of observations in the original ABCD Study data. To avoid further confusion, we corrected ‘genetic ethnicity’ to ‘genetic ancestry’ throughout the manuscript.

      7) Regarding 'a more direct genetic predictor of PLEs' - I still don't understand what the contrast is here. More direct than what else?

      The description was unclear; we removed it from our manuscript.

      8) Regarding the factor loadings in Figure 3: I don't understand how deprivation loads positively on 'low neighborhood SES', but poverty loads negatively. Shouldn't they both show the same direction of effect/loading on neighbourhood SES, while 'years of residency' should show the opposite direction (i.e., deprivation and poverty = risk, while years of residency = protective)? Are these unexpected loadings?

      The authors did not yet respond to this point: 'Please also add the autocorrelations between the 3 PLE measures. I assume these were also modelled statistically, given the strong correlations between time points?' Were these correlations not modelled? Why not?

      Figure 3B is still unclear. Was intelligence included here? What is the difference between Figure 3A and B? The legend suggests that 3B shows the indirect effects, but figure 3B looks like a direct effect, while 3A seem to show the indirect effect.

      The reviewer’s confusion resulted from our incorrect description. The factor loadings of low neighborhood SES were marked incorrectly. The loading for ‘years of residence’ and ‘poverty’ should be switched: -0.3648 for ‘years of residence’ and +0.877 for ‘poverty’. This was a mistake when we were applying factor loadings in the Figure. We thank you for pointing this out.

      We apologize for missing your point on autocorrelation. Adding autocorrelations between the three PLEs is unrelated to our research goal. In this paper, we investigated how genetic and environmental factors explain the variations in PLEs between participants, regardless of changes over time. Since we used PLEs of multiple follow-ups to ensure that the results are robust irrespective of the timing of PLE measurements, taking autocorrelation into account is not necessary.

      The decision to add autocorrelation, which involves using the outcome variable at time (t-1) as a predictor for the outcome variable at time t, depends on the research focus. If your interest lies in explaining inter-individual variation in the rate of change in PLEs over a one-year period, then autocorrelation should be controlled for (typically, predictors measured at different time points are used in such cases). However, this was not the focus of this paper, which is why we did not apply autocorrelation in the SEM analysis.

      We apologize for the confusion between Figure 3A and 3B. To clarify, we added titles in the figure images as “Direct effects” and “Indirect effects”. We also changed the legend as well.

      “A. Direct pathways from PGS, high family SES, low neighborhood SES, and positive environment to cognitive intelligence and PLEs. Standardized path coefficients are indicated on each path as direct effect estimates (significance level *p<0.05). B. Indirect pathways to PLEs via intelligence were significant for polygenic scores, high family SES, low neighborhood SES, and positive environment, indicating the significant mediating role of intelligence.” (line 968~973)

      Figure 3A shows direct effects: i.e., the coefficients of paths from PGS, family SES, neighborhood SES, and positive environment to intelligence and PLEs, as well as the coefficient of paths from intelligence to PLEs. This is why Figure 3A shows colored arrows starting from PGS, family and neighborhood SES, and positive environment towards intelligence and PLEs, as well as the arrows from intelligence to PLEs. On the other hand, in Figure 3B, the colored arrows staring from PGS, family and neighborhood SES, and positive environment goes through intelligence, and heads towards PLEs. This was meant to show that the indirect effects shown in Figure 3B indicate the specific effects of PGS, family SES, neighborhood SES, and positive environment on PLEs mediated by intelligence.

      In short, Figure 3 can be seen as a diagram drawn from Table 2: direct effects of the genetic and environmental variables on intelligence and PLEs, and direct effects of intelligence on PLEs are shown in Figure 3A; indirect effects of genetic and environmental variables on PLEs mediated by intelligence are shown in Figure 3B.

      9) Regarding Supporting Information tables: to make these more digestible, I suggest using Excel and adding one table per sheet with a clear title and legend, indicating what each table shows. For example, Table S1 has 9(?) different subsections, all called the same (Linear Mixed Model: Multiethnic). It is not clear how each subsection differs from the others. Separate tables in separate excel sheets might be easier.

      Also, I think two decimal points might be good enough, enhancing readability of these tables.

      Thank you for your suggestion. We moved the supplementary tables into an external Excel file, with each sheet showing different tables, as well as titles, legends, and clear subsections.

      10) Regarding reporting exact p-values in Table 2: I don't understand. At the moment, categorical significance statements are reported. Were these not based on exact p-values (or how else was it decided if a finding was significant at a 0.05 (?) significance level).

      Either remove the significance column completely (as p-values cannot be estimated due to non-normality) or specify exactly/clarify what this column shows and this was derived.

      We apologize for the confusion. In Table 2, we checked the significance of each path using 95% confidence intervals with 5,000 bootstrapping iterations. Since 95% confidence intervals that does not include zero is equivalent to p-values below 0.05 significance level, we believe this is an appropriate alternative for reporting the significance of each path in the SEM model.

      We specified the reason why we were not able to calculate exact p-values (clean copy: line 299~303). “As a trade-off for obtaining robust nonparametric estimates without distributional assumptions for normality, the IGSCA method does not return exact p-values (Hwang, Cho, Jung, et al., 2021). As a reasonable alternative, we obtained 95% confidence intervals based on 5,000 bootstrap samples to test the statistical significance of parameter estimates.”

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1 (Public Review):

      Summary:

      This important study from Godneeva et al. establishes a Drosophila model system for understanding how the activity of Tif1 proteins is modified by SUMO. The authors nicely show that Bonus, like homologous mammalian Tif1 proteins, is a repressor, and that it interacts with other co-repressors Mi-2/NuRD and setdb1 in Drosophila ovaries and S2 cells. They also show that Bonus is SUMOylated by Su(var)2-10 on at least one lysine at its N-terminus to promote its interaction with setdb1. By combining nice biochemistry with an elegant reporter gene approach, they show that SUMOylation is important for Bonus interaction with setdb1, and that this SUMO-dependent interaction triggers high levels of H3K9me3 deposition and gene silencing. While there are still major questions of how SUMO molecularly promotes this process, this study is a valuable first step that opens the door for interesting future experimentation.

      Major Point:

      The RNAseq and ChIPseq data is not available. This is critical for the review of the paper and would help the readers and reviewers interpret the Bonus mutant phenotype and its mechanism of repressing genes.

      The sequencing data have been deposited to the NCBI GEO archive. The accession number for all other RNA-seq and ChIP-seq data reported in this paper is GEO: GSE241375.

      1) The author's conclusion that Bonus SUMOylation is "essential for its chromatin localization" is not supported by the data. Figure 5F shows less 3KR mutant in the chromatin fraction but there is still significant signal.

      We appreciate the reviewer's feedback and agree that the term "essential" was not appropriate in this context. We have revised the manuscript to replace "essential" with "contributes to" to accurately reflect our findings.

      2) The author's conclusion that Bonus is SUMOylated at a single site close to its N-terminus is not necessarily true. In several SUMO and Bonus blots throughout the paper (5B, 6C, S4A), there are >2 differentially migrating species that could represent more than one SUMO added to Bonus. While the single K20R mutation eliminates all of these species in Fig 5C, it is possible that K20R SUMOylation is required for additional SUMOylation events on other residues. One way to determine if Bonus is SUMOylated on multiple sites is to add recombinant SUMO protease to the extract and see if multiple higher molecular weight bands collapse into a single migrating species (implying multiple SUMOs) or multiple migrating species (implying something else is altering gel migration).

      We appreciate the suggestion made by the reviewer. While we acknowledge the presence of occasional multiple bands in SUMO Western blots, the predominant pattern is the presence of unmodified Bon and a single additional band corresponding to SUMO-modified Bon. To investigate the possibility of multi-site SUMOylation, we performed requested experiment where we added SENP2 SUMO protease to the extract and checked Bon's SUMOylation. In the presence of NEM, we observed the unmodified form of Bon, as well as a single additional band representing a SUMO-modified form of Bon. Following SENP2 SUMO protease treatment, SUMOylation form of Bon was completely abolished in all samples, leaving only the unmodified Bon band (Extended Data Fig. 4D). This indicates that Bon is not SUMOylated on multiple sites and that the observed differential migration species likely result from other factors affecting gel migration.

      3) The authors state that most upregulated genes in BonusGLKD are not highly enriched in H3K9me3. The heatmap in figure 3D is not an ideal presentation of this argument. The authors should show an example of what the signal on a highly enriched gene looks like for comparison. The authors also argue that because most upregulated genes in BonusGLKD are not highly enriched in H3K9me3, they must be indirectly repressed. Another possibility is that bonus-mediated H3K9me3 is only important (and present) during early nurse cell differentiation and is later lost and dispensable during the rapid endocycles. After bonus establishes repression though H3K9me3, it might be maintained through bonus-Mi2/Nurd, something else, or nothing at all. The authors could discuss this possibility or perform H3K9me3 ChIP during cyst formation and early nurse cell differentiation rather than in whole ovaries, which are enriched for later stages.

      We thank the reviewer for their thoughtful comments and suggestions. In our revised manuscript we have included the tracks of gene that is highly enriched in H3K9me3 but remain unchanged upon Bon GLKD (Extended Data Fig. 3B). This addition allows for a visual comparison and better supports our argument that majority of genes upregulated in Bon GLKD are not enriched in H3K9me3 mark. We also appreciate the reviewer's suggestion regarding the potential temporal dynamics of Bon-mediated H3K9me3. It is indeed possible that Bon's role in establishing H3K9me3 might be more prominent during early nurse cell differentiation and less critical in later stages. We included discussion of this possibility in revised manuscript. To further explore it would be valuable to perform H3K9me3 ChIP during cyst formation and early nurse cell differentiation. However, given the limitations of our current resources and time limitations, we were unable to perform these experiments for the revised manuscript.

      4) The BonusGLKD RNAseq analysis is underwhelming. The conclusion that "Bonus represses tissue-specific genes" has limited value. Every gene that is not expressed in ovaries is "tissue-specific." What subset of tissue-specific genes does Bonus repress? What common features do these genes have and how do they compare to other sets of tissue-specific genes, such as those reportedly repressed by setdb1, Polycomb proteins, small ovary, l(3)mbt, and stonewall (among others in female germ cells). Comparing these available data sets could help the authors understand the mechanism of Bonus repression and how BonusGLKD leads to sterility. The authors could also further analyze the differences between nos-Gal4 and MT-Gal4 to better understand why nos- but not MT-driven knockdown is sterile.

      We appreciate the reviewer's feedback regarding the RNA-seq analysis and acknowledge the importance of identifying the specific subset of tissue-specific genes. The Figure 2C shows specific tissues where genes derepressed upon Bon GLKD are normally expressed. These are tissues/organs such as the head, digestive system, and nervous system. The reviewer's suggestion to compare our findings with existing datasets are valid and could indeed provide a more comprehensive understanding of Bon repression and its implications in female germ cells. However, many of the published datasets are based on mutant fly lines or use different GAL4 drivers to induce knockdowns, making direct comparisons challenging. We have conducted a preliminary analysis of available data, specifically nos-Gal4>SetDB1KD (GSE109852), and identified an overlap of 135 genes out of the 464 genes upregulated upon nos-Gal4>BonusKD with those affected by SetDB1 knockdown. We have included this result in the revised manuscript.

      Main Study Limitations:

      1) It is unclear which genes are directly vs indirectly regulated by bonus, which makes it difficult to understand Bonus's repressive mechanism. Several lines of experiments could help resolve this issue. 1) Bonus ChIPseq, which the authors mentioned was difficult. 2) RNAseq of BonusGLKD rescued with KR3 mutation. This would help separate SUMO/setdb1-dependent regulation from Mi-2 dependent regulation. Similarly, comparing differentially expressed genes in Su(var)2-10GLKD, setdb1GLKD, 3KR rescue, and MI-2 GLKD could identify overlapping targets and help refine how bonus represses subsets of genes through these different corepressors.

      We appreciate the reviewer's suggestions and agree that discrimination between direct and indirect Bon targets should be the next step in understanding Bon repressive mechanism. We have previously attempted to determine Bon direct targets using ChIP-seq approach. However, despite our multiple efforts using both native Bon antibodies and GFP-tagged Bon fly lines, analysis of ChIP-seq data did not reveal specific enrichment indicating that Bon – similar to many other chromatin-bound proteins – are not amenable to ChIP. The recommendation for RNA-seq analysis of Bon GLKD rescued with the 3KR mutation is valuable, and we will certainly consider it for future investigations.

      We compared differentially expressed genes in Su(var)2-10 GLKD and Mi-2 GLKD and found limited overlap: out of the 231 genes affected by Bon GLKD, 39 genes were affected in Mi-2 GLKD and 42 in Su(var)2-10 GLKD. We acknowledge the importance of understanding which genes are directly or indirectly regulated by Bon and the potential for further experiments to address this question.

      2) The paper falls short in discussing how SUMO might promote repression. This is important when considering the conservation (of lack thereof) of SUMOylation sites in Tif1 proteins in distantly related animals. One piece of data that was not discussed is the apparent localization of SUMOylated bonus in the cytoplasmic fraction of the blot in Figure 5F. Su(var)2-10 is mostly a nuclear protein, so is bonus SUMOylated in the nucleus and then exported to the cytoplasm? Also, setdb1 is a nuclear protein, so it is unlikely that the SUMOylated bonus directly interacts with setdb1 on target genes. Together with Fig 5E (unSUMOylatable Bonus aggregates in the nucleus), one could make a model where SUMO solubilizes bonus (perhaps by disassembling aggregates) and indirectly allows it to associate with setdb1 and chromatin. It is also important to note that in Figure 5I, the K3R mutation appears to lessen but not eliminate Bonus interaction with setdb1. This data again disfavors a model where SUMO establishes an interaction interface between setdb1 and Bonus. To determine which form of Bonus interacts with setdb1, the authors could perform a setdb1 pulldown and monitor the SUMOylation state of coIPed Bonus through mobility shift. If mostly unSUMOylated bonus interacts with setdb1, and SUMO indirectly promotes Bonus interaction with setdb1 (perhaps by disassembling Bonus aggregates), then the precise locations of Bonus SUMOylation sites could more easily shift during evolution, disfavoring the author's convergent evolution hypothesis.

      We appreciate the reviewer's valuable feedback. Regarding the observation of SUMOylated Bon in the cytoplasmic fraction in Figure 5F, we recognize its significance. This finding has prompted us to consider a model in which SUMOylation may play a role in translocating Bon from the nucleus to the cytoplasm, potentially influencing interactions with SetDB1 and chromatin indirectly. Furthermore, Figure 5I which shows only a partial reduction in Bon-SetDB1 interaction with the 3KR mutation, suggests that SUMO may not be the primary mediator of this interaction. We recognize the need for further investigations to clarify SUMO's exact role in this context. In response to the reviewer's suggestion, we conducted SetDB1 pulldown experiments in S2 cells. The results reveal that indeed SetDB1 primarily interacts with unmodified Bon which is by far more abundant compared to SUMOylated form (Extended Data Fig. 5C). We think this experiment presents certain technical challenges, as the signal for Bon, when used as prey in co-IP experiments, is relatively faint, making it inherently difficult to detect the lower levels of SUMO-modified Bon. Additionally, in revised manuscript we have added new result of determining Bon interactors in ovary using mass-spec analysis, which showed that SetDB1 associates with wild-type, but not SUMO-deficient Bon. While our data support the idea that SUMO may contribute to Bon solubilization, possibly by disassembling aggregates, thereby indirectly facilitating its association with SetDB1 and chromatin, we acknowledge that the precise mechanism remains unclear.

      Reviewer #2 (Public Review):

      Summary:

      The authors analyze the functions and regulation of Bon, the sole Drosophila ortholog of the TIF1 family of mammalian transcriptional regulators. Bon has been implicated in several developmental programs; however, the molecular details of its regulation have not been well understood. Here, the authors reveal the requirement of Bon in oogenesis, thus establishing a previously unknown biological function for this protein. Furthermore, careful molecular analysis convincingly established the role of Bon in transcriptional repression. This repressor function requires interactions with the NuRD complex and histone methyltransferase SetDB1, as well as sumoylation of Bon by the E3 SUMO ligase Su(var)2-10. Overall, this work represents a significant advance in our understanding of the functions and regulation of Bon and, more generally, the TIF1 family. Since Bon is the only TIF1 family member in Drosophila, the regulatory mechanisms delineated in this study may represent the prototypical and important modes of regulation of this protein family. The presented data are rigorous and convincing. As discussed below, this study can be strengthened by a demonstration of a direct association of Bon with its target genes, and by analysis of the biological consequences of the K20R mutation.

      Strengths:

      1. This study identified the requirement for Bon in oogenesis, a previously unknown function for this protein.
      2. Identified Bon target genes that are normally repressed in the ovary, and showed that the repression mechanism involves the repressive histone modification mark H3K9me3 deposition on at least some targets.
      3. Showed that Bon physically interacts with the components of the NuRD complex and SetDB1. These protein complexes are likely mediating Bon-dependent repression.
      4. Identified Bon sumoylation site (K20) that is conserved in insects. This site is required for repression in a tethering transcriptional reporter assay, and SUMO itself is required for repression and interaction with SetDB1. Interestingly, the K20-mutant Bon is mislocalized in the nucleus in distinct puncta.
      5. Showed that Su(var)2-10 is a SUMO E3 ligase for Bon and that Su(var)2-10 is required for Bon-mediated repression.

      Weaknesses:

      The study would be strengthened by demonstrating a direct recruitment of Bon to the target genes identified by RNA-seq. Given that the global ChIP-seq was not successful, a few possibilities could be explored. First, Bon ChIP-qPCR could be performed on the individual targets that were functionally confirmed (e.g. rbp6, pst). Second, a global Bon ChIP-seq has been reported in PMID: 21430782 - these data could be used to see if Bon is associated with specific targets identified in this study. In addition, it would be interesting to see if there is any overlap with the repressed target genes identified in Bon overexpression conditions in PMID: 36868234.

      We greatly appreciate the reviewer's suggestion to demonstrate the direct recruitment of Bon to the target genes. As described in our answer to reviewer #1, we attempted to determine Bon direct targets using ChIP-seq approach using both native Bon antibodies and GFP-tagged Bon fly lines. However, analysis of ChIP-seq data did not reveal specific enrichment. Similarly, Bon ChIP-qPCR on individual targets showed the same results suggesting that Bon – similar to many other chromatin-bound proteins – are not amenable to ChIP protocol, at least in standard conditions. To further explore this issue, we have analyzed results of a global Bon ChIP-seq reported in PMID: 21430782. We did not find Bon binding to individual targets, but even more importantly, we did not see clear Bon enrichment elsewhere in the genome confirming a conclusion that Bon targets on chromatin cannot be determined by ChIP. Additionally, we explored the possibility of overlap between target genes repressed by Bon in our study and those observed under Bon overexpression conditions in PMID: 36868234. While we did identify 41 genes in common, it's important to note that the datasets are derived from different tissues (pupal eyes vs. ovaries), making direct comparison problematic.

      The second area where the manuscript can be improved is to analyze the biological function of the K20R mutant Bonus protein. The molecular data suggest that this residue is important for function, and it would be important to confirm this in vivo.

      We appreciate the reviewer's suggestion to analyze the biological function of the K20R mutant Bon protein. While we acknowledge that we did not use single-site K20R mutant for in vivo experiments, we demonstrated that the mutant with the three-residue substitution (3KR) is incapable of inducing repression (Figure 5G). Given that other experiments consistently showed that K20 is the primarily SUMOylation site, this result supports the conclusion that K20 SUMOylation plays an important role in Bon-mediated transcriptional silencing.

      Reviewer #1 (Recommendations for The Authors):

      Make the RNAseq and ChIPseq data publicly available!

      The sequencing data have been deposited to the NCBI GEO archive. The accession number for all other RNA-seq and ChIP-seq data reported in this paper is GEO: GSE241375.

      Reviewer #2 (Recommendations for The Authors):

      It would be interesting to identify the biological basis of aberrant ovary development in Bon depletion conditions. Previous studies (e.g. PMID: 11336699) suggested that Bon loss of function clones are cell lethal, and the developmental defects in oogenesis presented in the current study offer an opportunity to delve more into the causes of cell loss, e.g. by showing that the cells die via apoptosis.

      Thank you for your valuable suggestion. In response to your comment, we performed a TUNEL assay to investigate whether germ cells in nos-Gal4>BonusKD ovaries undergo apoptosis. Our results indeed indicate that germ cells in these ovaries exhibit apoptosis, as evidenced by the TUNEL signal (Extended Data Fig. 1C). This information has been included in the revised manuscript to provide insights into the biological basis of aberrant ovary development in Bon depletion conditions.

      The K20 residue could also be ubiquitinated. This possibility could at least be discussed, particularly given the presence of the RING Ub ligase domain in Bon that might potentially perform self-ubiquitination.

      Indeed, the possibility that Bon can be ubiquitinated is a valid consideration. We have explored this possibility. We did not detect any signals with the Ubiquitin antibody in both wild-type Bon immunoprecipitant and triple-mutant [3KR] ovaries (in which K20 is also mutated) (Extended Data Fig. 4C). This suggests that K20 is more likely responsible for Bon SUMOylation rather than ubiquitination. We appreciate the reviewer's suggestion and have included this information into the revised manuscript.

    1. Note: This response was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Dear Editor,

      Herewith we submit our fully revised peer-reviewed preprint that had been reviewed by Review Commons. We thank the Review Commons team and reviewers for thoroughly commenting on our preprint and providing very useful additional points for consideration and discussion.

      You will find - the revised manuscript (third preprint version uploaded on biorxiv)<br /> - two reviewer letters (through Review Commons), - our rebuttal letter<br /> - a revised manuscript version with highlighted changes.

      Our manuscript reports that an active form of FIT, an essential transcription factor for root iron acquisition in plants, forms dynamic nuclear condensates in response to a blue light stimulus.<br /> A hallmark of our work is the thorough investigation of the nature of the FIT nuclear bodies in plant cells, that we were able to characterize as highly dynamic condensates in which active FIT homo- and heteromeric protein complexes can accumulate preferentially. Through co-localization with nuclear body markers, we found that these FIT condensates are related to speckles, which are a sub-type of nuclear bodies connected with splicing activities. This suggests that FIT condensates are linked with post-transcriptional regulation mechanisms.

      The reviewers highlight that an “impressive set of microscopic techniques” has been combined to study in a unique manner the characteristics and functionalities of FIT nuclear bodies in living plant cells. We show that FIT nuclear bodies can be formed in roots of Arabidopsis thaliana. The microscopic imaging techniques we used to characterize the nature and functionalities of FIT nuclear bodies in plant cells have several constraints related to sensitivity and a required strength of fluorescent protein signal. For technical reasons to be able to apply qualitative and quantitative imaging techniques, we conducted the investigation of FIT condensates in Nicotiana benthamiana, a classical and widely used plant protein expression system.

      As stated in the reviews, the connection between plant nutrition and nuclear bodies is an “unprecedented” new mode of regulation. The significance of our work is underlined by the fact that we report a “very precise cellular and molecular mechanism in nutrition” that is as yet “still largely unexplored in this context”. Therefore, our study “sheds light on the functional role of this membrane-less compartment and will be appreciated by a large audience.”

      We propose that condensate formation is a mechanism that may steer iron nutrition responses by providing a link between iron and light signaling. For sessile plants, it is absolutely essential that environmental signals are sensed and integrated with developmental and physiological programs so that plants can rapidly adjust to a changing environment and potential stress situations. Since iron is a micronutrient that may be toxic when present in excess, e.g. through catalyzing oxidative stress, plants strictly control the acquisition and allocation of iron. Hence, FIT nuclear bodies may be regulatory hubs that integrate at the sub-nuclear level environmental signaling inputs in the control of micronutrient uptake, possibly connected with splicing.

      Our work lays the ground for future studies that can address the proof of concept in more detailed manner in plants exposed to varying environmental conditions to reveal the interconnection of environmental and nutritional signaling.

      We prepared a revised preprint in which we address all reviewer comments. Please find our revision and our detailed response to all reviewer comments.

      With these changes, we hope that our peer-reviewed preprint can receive a positive vote,

      We are looking forward to your response,

      Sincerely

      Petra Bauer and Ksenia Trofimov on behalf of all authors

      Reply to the reviewers

      Reviewer #1 (Evidence, reproducibility and clarity):

      In this paper entitled " FER-LIKE IRON DEFICIENCY-INDUCED TRANSCRIPTION FACTOR (FIT) accumulates in homo- and heterodimeric complexes in dynamic and inducible nuclear condensates associated with speckle components", Trofimov and colleagues describe for the first time the function of FIT in nuclear bodies. By an impressive set of microscopies technics they assess FIT localization in nuclear bodies and its dynamics. Finally, they reveal their importance in controlling iron deficiency pathway. The manuscript is well written and fully understandable. Nonetheless, at it stands the manuscript present some weakness by the lack of quantification for co-localization and absence controls making hard to follow authors claim. Moreover, to substantially improve the manuscript the authors need to provide more proof of concepts in A. thaliana as all the nice molecular and cellular mechanism is only provided in N. bentamiana. Finally, some key conclusions in the paper are not fully supported by the data.<br /> Please see below:

      Main comments:

      1) For colocalization analysis, the author should provide semi-quantitative data counting the number of times by eyes they observed no, partial or full co-localization and indicate on how many nucleus they used.

      Authors:

      We have added the information in the Materials and Method section, lines 731-734:

      In total, 3-4 differently aged leaves of 2 plants were infiltrated and used for imaging. One infiltrated leaf with homogenous presence of one or two fluorescence proteins was selected, depending on the aim of the experiment, and ca. 30 cells were observed. Images are taken from 3-4 cells, one representative image is shown.

      In all analyzed cases, except in the case of colocalization of FIT and PIF4 fusion proteins, the ca. 30 cells had the same localization and/or colocalization patterns. This information has also been added in the figure legends. Each experiment was repeated at least 2-3 times, or as indicated in the figure legend.

      2) Do semi-quantitative co-localization analysis by eyes, on FIT NB with known NB makers in the A. thaliana root. For now, all the nicely described molecular mechanism is shown in N. benthamiana which makes this story a bit weak since all the iron transcriptional machinery is localized in the root to activate IRT1.

      Authors:

      The described approach has been very optimal, and we were able to screen co-localizing marker proteins in FIT NBs in N. benthamiana to better identify the nature of FIT NBs. This has been successful as we were able to associate FIT NBs with speckles. The N. benthamiana system allowed optimal microscopic observation of fluorescence proteins and quantification of FIT NB characteristics in contrast to the root hair zone of Arabidopsis where Fe uptake takes place. FIT is expressed at a low level in roots and also in leaves, whereby fluorescence protein expression levels are insufficient for the here-presented microscopic studies. The tobacco infiltration system is also well established to study FIT-bHLH039 protein interaction and nuclear body markers. We discuss this point in the discussion, see line 489-500.

      3) The authors need to provide data clearly showing that the blue light induce NB in A. thaliana and N. benthamiana.

      Authors:

      For tobacco, see Figure 1B (t = 0, 5 min) and Supplemental Movies S1. For Arabidopsis, please see Figure 1A (t = 0, 90 and 120 min) and Supplemental Figure S1A. We provide an additional image of pFIT:cFIT-GFP Arabidopsis control plants, showing that NB formation is not detected in plants that were grown in white light and not exposed to blue light before inspection (Supplemental Figure S1B). We state, that upon blue light exposure, plants had FIT NBs in at least 3-10 nuclei of 20 examined nuclei in the root epidermis in the root hair zone (in three independent experiments with three independent plants). White-light-treated plants showed no NB formation unless an additional exposure to blue light was provided (in three independent experiments, three independent plants per experiment and with 15 examined nuclei per plant).

      4) Direct conclusion in the manuscript:

      • Line 170: At this point of the paper the author cannot claim that the formation of FIT condensates in the nucleus is due to the light as it might be indirectly linked to cell death induced by photodamaging the cell using a 488 lasers for several minutes. This is true especially with the ELYRA PS which has strong lasers made for super resolution and that Cell death is now liked to iron homeostasis. The same experiment might be done using a spinning disc or if the authors present the data of the blue light experiment mentioned above this assumption might be discarded. Alternatively, the author can use PI staining to assess cell viability after several minutes under 488nm laser.

      Authors:

      As stated in our response to comment 3, we have included now a white light control to show that FIT NB formation is not occurring under the normal white light conditions. Since the formation of FIT NBs is a dynamic and reversible process (Figure 1A), it indicates that the cells are still viable, and that cell death is not the reason for FIT NB formation.

      • Line 273: I don't agree with the first part of the authors conclusion, saying that "wild-type FIT had better capacities to localize to NBs than mutant FITmSS271AA, presumably due its IDRSer271/272 at the C-terminus. This is not supported by the data. In order to make such a claim the author need to compare the FA of FIT WT with FITmSS271AA by statistical analysis. Nonetheless, the value seems to be identical on the graphs. The main differences that I observed here are, 1) NP value for FITmSS271AA seems to be lower compared to FIT-WT, suggesting that the Serine might be important to regulate protein homedimerization partitioning between the NP and the NB. 2) To me, something very interesting that the author did not mention is the way the FA of FITmSS271AA in the NB and NP is behaving with high variability. The FA of those is widely spread ranging from 0.30 to 0.13 compared to the FIT-WT. To me it seems that according to the results that the Serine 271/272 are required to stabilize FIT homodimerization. This would not only explain the delay to form the condensate but also the decreased number and size observed for FITmSS271AA compared to FIT-WT. As the homodimerization occurs with high variability in FITmSS271AA, there is less chance that the protein will meet therefore decreasing the time to homodimerize and form/aggregate NB.

      Authors:

      We fully agree. We meant to describe this result it in a similar way and thank you for help in formulating this point even better. Rephrasing might make it better clear that the IDRSer271/272 is important for a proper NB localization, lines 272-278:

      “Also, the FA values did not differ between NBs and NP for the mutant protein and did not show a clear separation in homodimerizing/non-dimerizing regions (Figure 3D) as seen for FIT-GFP (Figure 3C). Both NB and NP regions showed that homodimers occurred very variably in FITmSS271AA-GFP.

      In summary, wild-type FIT could be partitioned properly between NBs and NP compared to FITmSS271AA mutant and rather form homodimers, presumably due its IDRSer271/272 at the C-terminus.”

      • Line 301: According to my previous comment (line 273), here it seems that the Serine 271/272 are required only for proper partitioning of the heterodimer FIT/BHLH039 between the NP and NB but not for the stability of the heterodimer formation. However, it might be great if the author would count the number of BHLH039 condensates in both version FITmSS271AA and FIT-WT. To my opinion, they would observe less BHLH039 condensate because the homodimer of FITmSS271AA is less likely to occur because of instability.

      Authors:

      bHLH039 alone localizes primarily to the cytoplasm and not the nucleus, and the presence of FIT is crucial for bHLH039 nuclear localization (Trofimov et al., 2019). Moreover, bHLH039 interaction with FIT depends on SS271AA (Gratz et al., 2019). We therefore did not consider this experiment for the manuscript and did not acquire such data, as we did not expect to achieve major new information.

      5) To wrap up the story about the requirements of NB in mediating iron acquisition under different light regimes, provide data for IRT1/FRO2 expression levels in fit background complemented with FITmSS271AA plants. I know that this experiment is particularly lengthy, but it would provide much more to this nice story.

      Authors:

      Data for expression of IRT1 and FRO2 in FITmSS271AA/fit-3 transgenic Arabidopsis plants are provided in Gratz et al. (2019). To address the comment, we did here a NEW experiment. We provide gene expression data on FIT, BHLH039, IRT1 and FRO2 splicing variants (previously reported intron retention) to explore the possibility of differential splicing alterations under blue light (NEW Supplemental Figure S6 and S7, lines 454-466). Very interestingly, this experiment confirms that blue light affects gene expression differently from white light in the short-term NB-inducing condition and that blue light can enhance the expression of Fe deficiency genes despite of the short 1.5 to 2 h treatment. Another interesting aspect was that the published intron retention was also detected. A significant difference in intron retention depending on iron supply versus deficiency and blue/white light was not observed, as the pattern of expression of transcripts with respective intron retentions sites was the same as the one of total transcripts mostly spliced.

      Minor comments

      In general, I would suggest the author to avoid abbreviation, it gets really confusing especially with small abbreviation as NB, NP, PB, FA.

      Authors:

      We would like to keep the used abbreviations as they are utilized very often in our work and, in our eyes, facilitate the understanding.

      Line 106: What does IDR mean?

      Authors:

      Explanation of the abbreviation was added to the text, lines 105-108:

      “Intrinsically disordered regions (IDRs) are flexible protein regions that allow conformational changes, and thus various interactions, leading to the required multivalency of a protein for condensate formation (Tarczewska and Greb-Markiewicz, 2019; Emenecker et al., 2020).”

      Line 163-164: provide data or cite a figure properly for blue light induction.

      Authors:

      We have removed this statement from the description, as we provide a white light control now, lines 157-158:

      “When whole seedlings were exposed to 488 nm laser light for several minutes, FIT became re-localized at the subnuclear level.”

      Line 188: Provide Figure ref.

      Authors:

      Figure reference was added to the text, lines 184-185:

      “As in Arabidopsis, FIT-GFP localized initially in uniform manner to the entire nucleus (t=0) of N. benthamiana leaf epidermis cells (Figure 1B).”

      Line 194: the conclusion is too strong. The authors conclude that the condensate they observed are NB based on the fact the same procedure to induce NB has been used in other study which is not convincing. Co-localization analysis with NB markers need to be done to support such a claim. At this step of the study, the author may want to talk about condensate in the nucleus which might correspond to NB. Please do so for the following paragraph in the manuscript until colocalization analysis has not been provided. Alternatively provide the co-localization analysis at this step in the paper.

      Authors:

      We agree. We changed the text in two positions.

      Lines 176-178__: “__Since we had previously established a reliable plant cell assay for studying FIT functionality, we adapted it to study the characteristics of the prospective FIT NBs (Gratz et al., 2019, 2020; Trofimov et al., 2019).”

      Lines 192-193: “__We deduced that the spots of FIT-GFP signal were indeed very likely NBs (for this reason hereafter termed FIT NBs).”

      Line 214: In order to assess the photo bleaching due to the FRAP experiment the quantification of the "recovery" needs to be provided in an unbleached area. This might explain why FIT recover up to 80% in the condensate. Moreover, the author conclude that the recovery is high however it's tricky to assess since no comparison is made with a negative/positive control.

      Authors:

      In the FRAP analysis, an unbleached area is taken into account and used for normalization.

      We reformulated the description of Figure 1F, lines 212-214:

      “According to relative fluorescence intensity the fluorescence signal recovered rapidly within FIT NBs (Figure 1F), and the calculated mobile fraction of the NB protein was on average 80% (Figure 1G).”

      Line 220-227: The conclusion it's too strong as I mentioned previously the author cannot claim that the condensate are NBs at this step of the study. They observed nuclear condensates that behave like NB when looking at the way to induce them, their shape, and the recovery. And please include a control.

      Authors:

      Please see the reformulated sentences and our response above.

      Lines 176-178: “Since we had previously established a reliable plant cell assay for studying FIT functionality, we adapted it to study the characteristics of the prospective FIT NBs (Gratz et al., 2019, 2020; Trofimov et al., 2019).”

      Lines 192-193: “__We deduced that the spots of FIT-GFP signal were indeed very likely NBs (for this reason hereafter termed FIT NBs).”

      Line 239: It's unappropriated to give the conclusion before the evidence.

      Authors:

      Thank you. We removed the conclusion.

      Line 240: Figure 2A, provide images of FIT-G at 15min in order to compare. And the quantification needs to be provided at 5 minutes and 15 minutes for both FIT-G WT and FIT-mSS271AA-G counting the number of condensates in the nucleus. Especially because the rest of the study is depending on these time points.

      Authors:

      This information is provided in the Supplemental Movie S1C.

      Line 241: the author say that the formation of condensate starts after 5 minutes (line 190) here (line 241) the author claim that it starts after 1 minutes. Please clarify.

      Authors:

      In line 190 we described that FIT NB formation occurs after the excitation and is fully visible after 5 min. In line 241 we stated that the formation starts in the first minutes after excitation, which describes the same time frame. We rephrased the respective sentences.

      Lines 185-188: “A short duration of 1 min 488 nm laser light excitation induced the formation of FIT-GFP signals in discrete spots inside the nucleus, which became fully visible after only five minutes (t=5; Figure 1B and Supplemental Movie S1A).”

      Lines 239-242: “While FIT-GFP NB formation started in the first minutes after excitation and was fully present after 5 min (Supplemental Movie S1A), FITmSS271AA-GFP NB formation occurred earliest 10 min after excitation and was fully visible after 15 min (Supplemental Movie S1C).”

      Line 254: Not sure what the authors claim "not only for interaction but also for FIT NB formation ". To me, the IDR is predicted to be perturbed by modeling when the serines are mutated therefore the IDR might be important to form condensates in the nucleus. Please clarify.

      Authors:

      The formation of nuclear bodies is slow for FITmSS271AA as seen in Figure 2. Previously, we showed that FITmSS271AA homodimerizes less (Gratz et al., 2019.) Therefore, the said IDR is important for both processes, NB formation and homodimerization. We have added this information to make the point clear, lines 253-255:

      “This underlined the significance of the Ser271/272 site, not only for interaction (Gratz et al., 2019) but also for FIT NB formation (Figure 2).”

      Line 255: It's not clear why the author test if the FIT homodimerization is preferentially associated with condensate in the nucleus.

      Authors:

      We test this because both homo- and heterodimerization of bHLH TFs are generally important for the activity of TFs, and we unraveled the connection between protein interaction and NB formation. We state this in lines 228-232.

      Line 269-272: It's not clear to what the authors are referring to.

      Authors:

      We are describing the homodimeric behavior of FIT and FITmSS271AA assessed by homo-FRET measurements that are introduced in the previous paragraph, lines 256-268.

      Line 309: This colocalization part should be presented before line 194.

      Authors:

      We find it convincing to first examine and characterize the process underlying FIT NB formation, then studying a possible function of NBs. The colocalization analysis is part of a functional analysis of NBs. We thank the reviewer for the hint that colocalization also confirms that indeed the nuclear FIT spots are NBs. We will take this point and discuss it, lines 516-522:

      “Additionally, the partial and full colocalization of FIT NBs with various previously reported NB markers confirm that FIT indeed accumulates in and forms NBs. Since several of NB body markers are also behaving in a dynamic manner, this corroborates the formation of dynamic FIT NBs affected by environmental signals.”

      “In conclusion, the properties of liquid condensation and colocalization with NB markers, along with the findings that it occurred irrespective of the fluorescence protein tag preferentially with wild-type FIT, allowed us to coin the term of ‘FIT NBs’.”

      Line 328: add the ref to figure, please.

      Authors:

      Figure reference was added to the text, lines 330-332:

      “The second type (type II) of NB markers were partially colocalized with FIT-GFP. This included the speckle components ARGININE/SERINE-RICH45-mRFP (SR45) and the serine/arginine-rich matrix protein SRm102-mRFP (Figure 5).”

      Line 334: It seems that the size of the SR45 has an anormal very large diameter between 4 and 6 µm. In general a speckle measure about 2-3µm in diameter. Can the author make sure that this structure is not due to overexpression in N. benthamiana or make sure to not oversaturate the image.

      Authors:

      Thank you for this hint. Indeed, there are reports that SR45 is a dynamic component inside cells. It can redistribute depending on environmental conditions and associate into larger speckles depending on the nuclear activity status (Ali et al., 2003). We include this reference and refer to it in the discussion, lines 557-564:

      “Interestingly, typical FIT NB formation did not occur in the presence of PB markers, indicating that they must have had a strong effect on recruiting FIT. This is interesting because the partially colocalizing SR45, PIF3 and PIF4 are also dynamic NB components. Active transcription processes and environmental stimuli affect the sizes and numbers of SR45 speckles and PB (Ali et al., 2003; Legris et al., 2016; Meyer, 2020). This may indicate that, similarly, environmental signals might have affected the colocalization with FIT and resulting NB structures in our experiments. Another factor of interference might also be the level of expression.”

      Line 335: It seems that the colocalization is partial only partial after induction of NB. The FIT NB colocalize around SR45. But it's hard to tell because the images are saturated therefore creating some false overlapping region.

      Authors:

      The localization of FIT with SR45 is partial and occurs only after FIT has undergone condensation, see lines 335-338.

      Line 344-345: It's unappropriated to give the conclusion before the evidence.

      Authors:

      We explain at an earlier paragraph that we will show three different types of colocalization and introduce the respective colocalization types within separate paragraphs accordingly, see lines 314-321.

      Line 353: increase the contrast in the image of t=5 for UAP56H2 since it's hard to assess the colocalization.

      Authors:

      This is done as noted in the figure legend of Figure 6.

      Line 381-382: "In general" does not sound scientific avoid this kind of wording and describe precisely your findings.

      Authors:

      We rephrased the sentence, line 387-388:

      Localization of single expressed PIF3-mCherry remained unchanged at t=0 and t=15 (Supplemental Figure S5A).

      Line 384-385: Provide the data and the reference to the figure.

      Authors:

      We apologize for the misunderstanding and rephrased the sentence, line 389-391:

      After 488 nm excitation, FIT-GFP accumulated and finally colocalized with the large PIF3-mCherry PB at t=15, while the typical FIT NBs did not appear (Figure 7A)

      Line 386: The structure in which FIT-G is present in the Figure 7A t=15 is not alike the once already observed along the paper. This could be explained by over-expression in N. benthamiana. Please explain.

      Authors:

      Thank you for the hint. We discuss this in the discussion part, see lines 555-568.

      Line 393: Explain and provide data why the morphology of PIF4/FIT NB do not correspond to the normal morphology.

      Authors:

      Thank you for the valuable hints. Several reasons may account for this and we provide explanations in the discussion, see lines 555-568.

      Line 396-398: It seems also from the data that co-expression of PIF4 of PIF3 will affect the portioning of FIT between the NP and the NB.

      Authors:

      We can assume that residual nucleoplasm is depleted from protein during NB formation. This is likely true for all assessed colocalization experiments. We discuss this in lines 492-494.

      The discussion is particularly lengthy it might be great to reduce the size and focus on the main findings.

      Authors:

      We shortened the discussion.

      Referees cross-commenting

      All good for me, I think that the comments/suggestions from Reviewer #2 are valid and fair. If they are addressed they will improve considerably the manuscript.

      Reviewer #1 (Significance):

      This manuscript is describing an unprecedent very precise cellular and molecular mechanism in nutrition throughout a large set of microscopies technics. Formation of nuclear bodies and their role are still largely unexplored in this context. Therefore, this study sheds light on the functional role of this membrane less compartment and will be appreciated by a large audience. However, the fine characterization is only made using transient expression in N. Bentamiana and only few proofs of concept are provided in A. thaliana stable line.

      Reviewer #2 (Evidence, reproducibility and clarity):

      The manuscript of Trofimov et al shows that FIT undergoes light-induced, reversible condensation and localizes to nuclear bodies (NBs), likely via liquid-liquid phase separation and light conditions plays important role in activity of FIT. Overall, manuscript is well written, authors have done a great job by doing many detailed and in-depth experiments to support their findings and conclusions.

      However, I have a number of questions/comments regarding the data presented and there are still some issues that authors should take into account.

      Major points/comments:

      1) Authors only focused on blue light conditions. Is there any specific reason for selecting only blue light and not others (red light or far red)?

      Authors:

      There are two main reasons: First, in a preliminary study (not shown) blue light resulted in the formation of the highest numbers of NBs. Second, iron reductase activity assays and gene expression analysis under different light conditions showed a promoting effect under blue light, but not red light or dark red light (Figure 9). This indicated to us, that blue light might activate FIT, and that active FIT may be related to FIT NBs.

      2) Fig. 3C and D: as GFP and GFP-GFP constructs are used as a reference, why not taking the measurements for them at two different time points for example t=0 and t=5 0r t=15???

      Authors:

      Free GFP and GFP-GFP dimers are standard controls for homo-FRET that serve to delimit the range for the measurements.

      3) Line 27-271: Acc to the figure 3d, for the Fluorescence anisotropy measurement of NBs appears to be less. Please explain.

      Authors:

      FA in NBs with FITmSS271AA is variable and the value is lower than that of whole nucleus but not significantly different compared with that in nucleoplasm. We describe the results of Figure 3D in lines 272-275.

      4) Figure 4: For the negative controls, data is shown at only t=0, data should be shown at t=5 also to prove that there is no decrease in fluorescence in these negative controls when they are expressed alone without bhlh39 as there is no acceptor in this case.

      Authors:

      Neither for FIT/bHLH039 nor the FITmSS271AA/bHLH039 pair, there is a significant decrease in the fluorescence lifetime values between t=0 and t=5/15. FIT-G is a control to delimit the range. The interesting experiment is to compare the protein pairs of interest between the different nuclear locations at t=5/15.

      5) Line 300-301: In Figure 4D and 4E. Fluorescence lifetime of G measurement at t=0 seems very similar for both FIT-G as well as FITmSS but if we look at the values of t=0 for FIT-G+bhlh039 it is greater than 2.5 and for FITmSS271AA-G+bhlh039 it is less which suggests more heterodimeric complexes to be formed in FITmSS271AA-G+bhlh039. Similar pattern is observed for NBs and NPs, according to the figure 4d and E.

      Therefore, heterodimeric complexes accumulated more in case of FITmSS271AA-G+bhlh039 as compared to FIT-G+bhlh039 (if we compare measurement values of Fluorescence lifetime of G of FITmSS271AA-G+bhlh039 with FIT-G+bhlh039).

      Please comment and elaborate about this further.

      Authors:

      These conclusions are not valid as the experiments cannot be conducted in parallel. Since the experiments had to be performed on different days due to the duration of measurements including new calibrations of the system, we cannot compare the absolute fluorescence lifetimes between the two sets.

      6) Figure 4: For the negative controls, data is shown at only t=0, data should be shown at t=5 also to prove that there is no decrease in fluorescence in these negative controls when they are expressed alone without bhlh39 as there is no acceptor in this case.

      Authors:

      Please see our response to your comment 4).

      7) Line 439-400: As iron uptake genes (FRO2 and IRT1) are more induced in WT under blue light conditions and FRO2 is less induced in case of red-light conditions. So, what happens to Fe content of WT grown under blue light or red light as compared to WT grown under white light. Perls/PerlsDAb staining of WT roots under different light conditions will add more information to this.

      Authors:

      We focused on the relatively short-term effects of blue light on signaling of nuclear events that could be related to FIT activity directly, particularly gene expression and iron reductase activity as consequence of FRO2 expression. These are both rapid changes that occur in the roots and can be measured. We suspect that iron re-localization and Fe uptake also occur, however, in our experience differences in metal contents will not be directly significant when applying the standard methods like ICP-MS or PERLs staining.

      Minor comments:

      Line 75-76: Rephrase the sentence

      Authors:

      We rephrased the sentence, lines 73-74:

      “As sessile organisms, plants adjust to an ever-changing environment and acclimate rapidly. They also control the amount of micronutrients they take up.”

      Line 119: Rephrase the sentence

      Authors:

      We rephrased the sentence, line 118-119:

      “Various NBs are found. Plants and animals share several of them, e.g. the nucleolus, Cajal bodies, and speckles.”

      Line 235-236: rephrase the sentence

      Authors:

      We rephrased the sentence, line 232-234:

      “In the work of Gratz et al. (2019), the hosphor-mimicking FITmS272E protein did not show significant changes in its behavior compared to wild-type FIT.”

      Line 444: Correct the sentence “Fe deficiency versus sufficiency”

      Authors:

      We corrected that, line 449-451:

      “In both, the far-red light and darkness situations, FIT was induced under iron deficiency versus sufficiency, while on the other side, BHLH039, FRO2 and IRT1 were not induced at all in these light conditions (Figure 9I-P).”

      Referees cross-commenting

      I agree with R1 suggestions/comments and i think manuscript quality will be much better if authors carry out the experiments suggested by R1. I believe this will also strengthen their conclusions.

      Reviewer #2 (Significance):

      Overall, manuscript is well written, authors have done a nice job by doing several key experiments to support their findings and conclusions. However, the results and manuscript can be improved further by addressing some question raised here. This study is interesting for basic scientists which unravels the crosstalk of light signaling in nutrient signaling pathways.

    1. Note: This response was posted by the corresponding author to Review Commons. The content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reviewer #1 (Evidence, reproducibility and clarity (Required)):

      1. EVIDENCE, REPRODUCIBILITY AND CLARITY

      Summary:

      Provide a short summary of the findings and key conclusions (including methodology and model system(s) where appropriate). Please place your comments about significance in section 2.

      This work examines the active compensation of TDH3 by its paralogs TDH1 and TDH2 as a mechanism of robustness against genetic perturbations in yeast. The authors demonstrate that the paralogs compensate in a dose-dependent manner in response to TDH3's absence, mediated by shared transcriptional regulators Gcr1p and Rap1p. Furthermore, other glycolytic genes regulated by Gcr1p and Rap1p show similar changes in expression, indicating that active compensation of TDH3 is part of a greater homeostatic feedback mechanism. Additionally, the authors suggest that the ability of paralogs to actively compensate for each other and contribute to genetic robustness is actively selected for or is simply a side effect of their ancestrally shared regulators with sensitivity to feedback mechanisms.

      Major comments:

      • Are the claims and the conclusions supported by the data or do they require additional experiments or analyses to support them?

      The authors present robust evidence in this paper to substantiate their claims and conclusions. The comprehensive data provided effectively establishes a clear and compelling case for the role of active compensation among the TDH paralogs. I think that the authors' conclusions are well-supported with the data. Further experiments are not warranted at this time.

      • Please request additional experiments only if they are essential for the conclusions. Alternatively, ask the authors to qualify their claims as preliminary or speculative, or to remove them altogether.

      No need for further experiments to support the manuscript's conclusions at this time.

      • If you have constructive further reaching suggestions that could significantly improve the study but would open new lines of investigations, please label them as "OPTIONAL".

      Dear authors, I have a couple of experiments to open further lines of investigation:

      Considering the modest expression level increase resulting from gene duplication of TDH3 (~35%), it may be worthwhile to further explore this phenomenon and its potential relationship with the limited availability of GRC1 and RAP1 transcription factors. It is conceivable that an attenuation mechanism could be involved in regulating TDH3 expression, and an examination of this possibility would provide valuable insights. An experimental approach utilizing a titratable promoter and assessment of mRNA and protein levels would offer a compelling means to probe this inquiry. (OPTIONAL).

      The strain expressing TDH3 at 135% of the wild-type expression level carries two copies of TDH3, but both copies have mutations in their promoter that reduce their individual expression relative to the wild-type alleles. We have clarified the text by adding “reducing expression levels from each promoter” on page 6, line 17.

      The authors' discussion raises the question of whether the active compensation observed between the TDH paralogs is a result of selection or simply a consequence of their shared regulators. To address this question, one potential avenue for future research would be to test the ability of TDH1-2 gene products to compensate for the loss of TDH3 by expressing them under the TDH3 promoter, a stronger or an inducible promoter, and then, measuring the fitness of the resulting strains with a tdh3𝚫 background. This additional line of experimentation has the potential to improve our understanding of the regulatory networks involved and shed light on the selective pressures that contribute to the maintenance of these paralogs over evolutionary time. (OPTIONAL)

      We agree that this question - how selection has acted on the catalytic activity of the three paralogous proteins in concert with their expression levels - is very interesting. In fact, experiments including those described by the reviewer are currently underway in the Wittkopp lab and will be the focus of a future manuscript.

      • Are the suggested experiments realistic in terms of time and resources? It would help if you could add an estimated time investment for substantial experiments.

      Not applicable.

      • Are the data and the methods presented in such a way that they can be reproduced?

      Yes.

      • Are the experiments adequately replicated and statistical analysis adequate?

      Yes.

      Minor comments:

      • Specific experimental issues that are easily addressable.

      In the introduction of the manuscript (pp. 4 para. 1), it would be useful to provide a more comprehensive overview of the gene expression patterns and protein abundances of the three TDH paralogs. Including such information would better enable readers to understand the functional roles of these paralogs.

      We have added a new figure (Figure S1) showing differences in expression levels and patterns across the growth curve for the three paralogs. In addition, we have added some discussion of the differences in the effects of trans-regulatory mutations on protein abundance of each paralog that was recently published by another group and further indicates some level of regulatory divergence, particularly for TDH1 (pp.4, lines 12-19).

      It would be helpful to report the phenotype of the tdh1𝚫/tdh2𝚫 double mutant to provide a clearer understanding of the functional overlap of these paralogs.

      The revised manuscript includes additional information about divergence in expression patterns and differences in the effects of trans-regulatory mutations between TDH1 and the other two paralogs. Specifically, TDH1 is expressed under different conditions, and it is likely involved in different processes, than TDH2 and TDH3 (pp.4, lines 12-19, Figure S1). We have also added a sentence to the introduction stating that the double mutant deleting TDH1 and TDH3 has the same growth rate as TDH3 mutants alone, suggesting that TDH1 does not compensate for loss of TDH3 in the same way that TDH2 does. Because of these observations and because of the stronger overlap in expression profiles of TDH2 and TDH3, we have chosen to focus primarily on the compensation for TDH3 by TDH2 in the revised manuscript. We believe that these changes make the TDH1/TDH2 double mutant phenotype (which has not been studied as closely as the double mutants of TDH1 or TDH2 with TDH3) unnecessary for this study.

      In the results section (pp. 5, para. 2), while it is understandable that the authors have focused on the transcriptional regulation of these paralogs, it would also be insightful to provide data on their respective protein abundances, as posttranslational regulation is often a crucial component of gene expression. This data may already be available in other high-throughput studies.

      We have added new experimental data using fluorescent fusion proteins that shows that the protein abundance of TDH2 increases in response to deletion of TDH3 (Figure 1B). The results of our fluorescence measurements correspond well with transcriptional levels indicated by RNA-seq, indicating that the upregulation of TDH2 expression we saw in TDH3 mutants was controlled primarily at the transcriptional level.

      It would be valuable to include more detailed information on the shared cis-regulatory elements between these genes, as this could provide further insight into their regulation and potential functional divergence.

      According to experimental data compiled in http://www.yeastract.com/ , ChIP-exo data indicates that promoters for TDH1, TDH2, and TDH3 are all directly bound by Gcr1p (and the complex partner Gcr2p), although the evidence for Gcr1p binding is weaker at TDH1 than the other two paralogs, and this study does not identify Gcr1p TFBS motifs in the promoters of either TDH1 or TDH2 (Holland et al. 2019). However, we were able to locate Gcr1p TFBS motifs (CTTCC, Baker 1991) in the TDH2 promoter by manually searching regions annotated as bound by Gcr1’s complex partner Gcr2p in another publicly available ChIP-chip dataset (MacIsaac et al. 2006). We mutated these four motifs in a copy of the TDH2 promoter driving YFP expression to test for their role in upregulation using flow cytometry. We found that mutation or deletion of these putative TFBS reduced the overall activity of the promoter, indicating that these sequences are functional, and also observed that upon mutation or deletion of these putative TFBSs reduced the upregulation of TDH2 when TDH3 was deleted (Figure 3E). A schematic of the TDH2 promoter has been added to Figure 3 describing these experiments.

      • Are prior studies referenced appropriately?

      Yes.

      • Are the text and figures clear and accurate?

      The language used in this manuscript is clear and concise, making the material easily comprehensible to readers of various levels of expertise. The figures have a good quality for the most part and effectively complement the text to aid in the understanding of their findings.

      • Do you have suggestions that would help the authors improve the presentation of their data and conclusions?

      I have a few minor suggestions regarding your manuscript's figures:

      In figures 1-3, it would be helpful to indicate the number of biological or technical replicates used for the statistical analyses displayed in the plots.

      We have added the number of biological replicates for each genotype to our figure legends.

      Please consider adding a sentence to the figure legends indicating that the raw data was generated in a previous study.

      We have added a sentence indicating that the raw data was generated in a previous study to all relevant figure legends.

      Figure 4E may benefit from alternative visualization methods, such as using lines or a different type of plot, to make it easier to distinguish each dataset.

      In response to this and other reviewer comments, we have re-formatted Figure 4 to reduce the number of genes displayed in Figure 4E. We believe this greatly increases the readability of the figure and thank the reviewer for their suggestion.

      Reviewer #1 (Significance (Required)):

      SIGNIFICANCE

      ===============

      • General assessment: provide a summary of the strengths and limitations of the study. What are the strongest and most important aspects? What aspects of the study should be improved or could be developed?

      The study is noteworthy for its comprehensive analysis of previously reported data, offering a new understanding of the mechanisms behind the observed robustness of eukaryotic organisms, in particular the active compensation of TDH3 expression. The evidence presented in support of their conclusions is compelling. However, further research is required to investigate the role of active compensation at different regulation levels, in other paralogs, and under different environmental conditions.

      • Advance: compare the study to the closest related results in the literature or highlight results reported for the first time to your knowledge; does the study extend the knowledge in the field and in which way? Describe the nature of the advance and the resulting insights (for example: conceptual, technical, clinical, mechanistic, functional,...).

      This study provides new insights into the mechanisms of active compensation for the loss of gene expression in yeast. The authors demonstrate that the paralogs TDH1 and TDH2 upregulate in a dose-dependent manner in response to reductions in TDH3, mediated by shared transcriptional regulators Gcr1p and Rap1p. Furthermore, other glycolytic genes regulated by Rap1p and Gcr1p show similar changes in expression, indicating that active compensation of TDH3 by its paralogs is part of a larger homeostatic response. This study provides a mechanistic understanding of active compensation for the loss of gene expression in yeast and has potential implications for other organisms.

      • Audience: describe the type of audience ("specialized", "broad", "basic research", "translational/clinical", etc...) that will be interested or influenced by this research; how will this research be used by others; will it be of interest beyond the specific field?

      This study may attract a broad audience, as it provides insight into the mechanisms of active paralogous compensation. Their findings have potential implications beyond the yeast's specific field, as they may provide insight into the mechanisms of robustness in other genes and organisms. This research may be of interest in the fields of molecular biology and evolution in particular gene regulation.

      • Please define your field of expertise with a few keywords to help the authors contextualize your point of view. Indicate if there are any parts of the paper that you do not have sufficient expertise to evaluate.

      My field of expertise is molecular biology and evolution, specifically in the areas of gene duplication, gene expression and regulation, protein evolution, and interaction networks. I am familiar with some of the topics discussed in the paper, such as gene expression and regulation, and have a good understanding of the research related to these topics.

      We thank the reviewer for their insightful comments and thorough reading of the manuscript. We believe that the revisions, as described in more detail below, improve the manuscript and we greatly appreciate the suggestions.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)):

      The ms uses RNAseq data on S cerevisiae with TDH3 perturbations (cis and trans) from prior publication to look into RNA expression of TDH3 paralogues and genes within the same pathway. Analysis of both cis and trans TDH3 perturbation data suggests that the compensatory mechanisms (via either the paralogues or the upstream/downstream enzymes of the glycolytic pathway) are dependent on GCR1 and RAP1 transcription factors.

      Major comment but OPTIONAL: The RNAseq data presented here convincingly convey the authors claims. Nevertheless, if any of the following data becomes available in the meantime, they will add a lot to the current ms: 1. Protein expression data can independently validate the findings and help support/clarify potential issues emerging from the data on the glycolytic pathway - see 2nd minor comment.

      The revised manuscript includes new data showing increased expression of TDH2 upon deletion of TDH3 at the protein level using a TDH2:CFP fusion protein under the control of the native TDH2 promoter and at the native locus (Figure 1B). These protein-level data do indeed independently validate our RNA-seq findings for TDH2. We have also re-arranged Figure 4 and clarified the section of the manuscript describing changes in expression in the rest of the glycolytic pathway to better communicate that these changes in gene expression may or may not be part of an active compensation mechanism (see further discussion below).

      1. Any data that show expression of TDH3 as a result of TDH1/TDH2 expression changes occurring independently of Gcr1/Rap1 can support the claims on robustness as a consequence of multiple paralogues being around.

      We have RNA-sequencing data for strains in which TDH1 or TDH2 was deleted individually (GSE175398, data from Vande Zande et al., 2022). We saw that in these strains TDH3 expression was not significantly increased. We believe that this finding is most likely due to the difference in basal expression levels between paralogs. TDH3 is expressed at approximately 6x the level of TDH2, and TDH1 is expressed in stationary phase rather than exponential growth as TDH2 and TDH3 are (See new supplementary Figure S1). Deletion or reduction of TDH3 expression represents a much larger change in total GAPDH levels in the cell, and therefore might elicit a much stronger compensation response than deletion of TDH2 or TDH1. We are interested in how the different expression levels, patterns, and enzymatic activity levels have diverged between paralogs and contribute to their relative function in the cell, and, as mentioned above, another member of the Wittkopp lab is currently working on a manuscript addressing these questions in greater detail. For these reasons, we have chosen not to include these data in the current manuscript.

      Minor comments

      1) Introduction and analysis framing: there seems to be two aspects for robustness and compensation that the manuscript focuses on. The one is through paralogues and the other via alteration in the expression of genes in the same pathway. The study shows both, yet there is particular weight on the paralogues.

      The introduction should also mention both in a coherent and organized way. As an example, the second paragraph in the intro refers to 'upregulation of a paralog' in the 1st sentence, then it refers to an example that fits better to compensation through changes in expression of enzymes in the same pathway.

      We have adjusted the language in the second paragraph of the introduction to clarify that the other enzymes that are actively compensating for CLV1 or SlCLV3 loss in arabidopsis and tomato are paralogs (pg.2 line 21- pg.3 line 8). In addition, we have adjusted our wording of the final introduction paragraph (pg. 5, lines 11-18), and the final results section (pg. 13, lines 17-23) to better communicate that the other genes are changing as part of a homeostatic response programmed into the regulatory network and may or may not contribute to fitness gains in a TDH3 mutant.

      2)Figure 4 results/Discussion: Not unexpectedly, PFK1 and PFK2 (in panels 4D and 4B) have very similar expression profiles with respect to TDH3 expression. (Considering that they are part of the same complex, one would expect that their expression levels should correlate at the very least). Yet, PFK1 did not make the significance cutoff. That can be misleading, so it warrants a comment, either on the respective results section or discussion. For that reason and to make easier comparisons expression data should be shown on the same panel (consolidate 4B and 4D) with significance annotations. It would also be nice to see some commentary in terms of pathway output upon changes in TDH3 expression. It seems as if there is a 'diffused signal' through the whole pathway that compensates for TDH3 perturbations, meaning all enzymes may be compensating to different degrees.

      We appreciate these suggestions and have used them to re-arrange Figure 4 to more clearly show the response of genes that function at each step in the glycolytic pathway. As noted in the reviewer’s comment, PFK1 and 2 are nearly identical in their expression profiles. The reason one is not significantly upregulated is that it has a higher variance among replicates than the other, which we now point out explicitly in the figure legend. By grouping these genes together in Figure 4, the similarity of their expression changes is much more obvious.

      Reviewer #2 (Significance (Required)):

      The study demonstrates an example of paralog-dependent changes in gene expression that contribute to phenotypic robustness. The active paralog compensation is transcription factor-dependent, and the same transcription factors are also responsible for compensatory changes in expression levels of genes in the same pathway. I believe that this is an interesting case showing how a negative feedback mechanism in place to maintain pathway output and contribute to phenotypic robustness, receives and integrates signaling from different components of a pathway, including paralogues. The study relies solely on RNAseq data. Although convincing, protein expression data not only could validate the RNAseq data, but also could give a more accurate view of the respective expression profiles. The study describes a molecular mechanism in pathway regulation with broad interest in basic research. It also has particular interest with respect to paralog evolution and brings up questions on the forces that drive paralog divergence.

      We appreciate this reviewer’s comments and suggestions and have added several new figures that use fluorescent fusion proteins to provide a quantitative readout of protein expression levels. Specifically, we have added panels showing increased protein expression of TDH2 fused with CFP upon deletion of TDH3 (Figure 1B). We have also added expression of fluorescent reporter genes driven by the TDH1, TDH2, and TDH3 promoters showing the differences in their expression profiles across population growth stages (Supplementary Figure 1). Finally, we have analyzed fluorescent reporter genes with promoters containing mutated Gcr1p TFBS, which also suggest a dependence of the compensatory upregulation on GCR1p (Figures 2D, 3E).

      Reviewer #3 (Evidence, reproducibility and clarity (Required)):

      In their preprint titled "Active compensation for changes in TDH3 expression mediated by direct regulators of TDH3 in Saccharomyces cerevisiae" Zande and Wittkopp attempt to delineate the molecular mechanism behind compensation. They have chosen 3 paralogs, TDH1, 2 and 3 in Saccharomyces cerevisiae as their system of choice, building on an earlier study where they have used RNA-seq transcriptomics to characterize how global gene expression is affected by strains harbouring regulatory mutations at the TDH3 locus or a TDH3 gene knockout. The major claims made by the authors in this study are as follows:

      1. The TDH1/2/3 system demonstrates compensation, such that changes in levels of expression of TDH3 result in altered expression levels of TDH1 and TDH2
      2. The mechanism of this compensation is "active", that is it involves modulating the transcription of paralogs in response to altered TDH3 in the cell. iii. The transcription factors Gcr1 and Rap1 are likely candidates mediating this compensation. The effects of these regulators on TDH1 and TDH2 differ and produces different profiles of compensatory expression for these two genes.

      3. Since Gcr1 and Rap1 regulate other genes coding for glycolytic enzymes, compensation is related to altered expression of a larger cohort of genes. Major comments:

      4. The authors' claims regarding the roles of Rap1 and Gcr1 as mechanisms of compensation are supported by correlative evidence from RNA seq data. To establish the causal relationships that the authors intend, more directed experiments like the ones listed below are required: i. Monitoring the activity of TDH1 and TDH2 promoters (as YFP-fused reporters) in the various strains

      We have added new experimental data to the manuscript monitoring the activity of the TDH1 and TDH2 promoters driving YFP in different phases of the growth curve, demonstrating the divergence in their gene expression patterns (Supplementary Figure 1). Because of the divergence in expression patterns, we chose to focus additional efforts on TDH2 and have added new data showing an increase in expression of a CFP::TDH2 fusion protein upon deletion of TDH3. These new experiments provide strong evidence of the causal relationship between the deletion of TDH3 and an increase in TDH2 expression.

      ii. Generating mutant promoter reporters for TDH1, 2 and 3 that are unable to bind to Gcr1 and Rap1 and testing their activity in the various mutant strains

      We have added new experimental data to the manuscript demonstrating that increases in the activity of the TDH3 and TDH2 promoters upon deletion of TDH3 are dependent upon Gcr1p transcription factor binding sites, as originally hypothesized. Specifically, the new figure panel 3E consists of flow cytometry data showing that the TDH2 promoter driving YFP expression increases in fluorescence upon deletion of TDH3, but that a comparable increase does not occur when Gcr1p TFBSs in the TDH2 promoter are mutated. In addition, the new figure panel 2D shows that the TDH3 promoter driving YFP no longer increases in activity when a Gcr1 TFBSs is mutated. These new experiments provide strong evidence for the dependence of active compensation by upregulation upon shared transcription factor GCR1.

      1. The authors claim that Gcr1 and Rap1 have similar impact on other glycolytic enzymes. However, these conclusions are also based on RNA -seq data and hence remain correlative. Based on the presented results alone, and lack of a molecular mechanism for why the levels of Rap1 and Gcr1 change in TDH3 mutant strains, it may just as easily be argued that the change in expression of other glycolytic enzymes (and therefore glycolytic flux) may be the cause for altered Rap1/Gcr1 activity and not the consequence. To test which of these possibilities are true, I would recommend the following approaches:

      i. Promoter reporters for glycolytic enzymes of interest, and mutant versions that don't respond to Rap1/Gcr1

      ii. Change glycolytic flux by altering growth conditions (e.g. fermentable/non-fermentable carbon source) and check to see if compensation is altered

      While it is possible that mutations in the TDH3 promoter that change TDH3 expression alter the expression of other glycolytic genes, and this in turn alters Rap1/Gcr1 activity, resulting in the upregulation of the TDH paralogs, we believe it is more likely that changes in the activity of Rap1/Gcr1 are a cause rather than a consequence of altered expression of glycolytic genes because it has previously been shown that these genes are under the control of Rap1 and Gcr1. We have adjusted the wording of the final results section, and throughout the paper, to clarify that we believe the similar expression patterns observed for other glycolytic genes suggest that the increase in paralog expression that results in active compensation is part of a larger regulon, which indeed may be responsive to changes in glycolytic flux. We cannot say, however, whether the upregulation of other glycolytic genes is part of the compensatory response per se. We believe this clarification, in addition to the new experiments showing the dependence of TDH3 and TDH2 upregulation on transcription factor binding sites for GCR1, addresses the issues raised above.

      Reviewer #3 (Significance (Required)):

      This study attempts to address the mechanistic basis for an important homeostatic mechanism, i.e. compensation. Compensation is an almost universal mechanism seen in pathways with genetic redundancy. As pointed out by the authors, compensation ensures that gene regulatory networks produce robust outcomes and are resistant to perturbation. Though compensation is often observed, the mechanistic basis is usually unclear. This study throws light on possible transcriptional mechanisms that orchestrate compensation by altering expression levels of paralogous enzymes. In this regard the study is novel, important, and fills a lacuna in the area. However, in its current form, the study lacks the necessary causal evidence needed to substantiate the claims made by the authors. Further, the mechanism linking transcriptional regulation and metabolic flux is still lacking. As a result, though interesting, the study doesn't provide a complete picture and fails to make an impact.

      We thank the reviewer for their comments and believe that the additional experiments and data added to the revised manuscript, including using fluorescent reporter genes and mutant alleles to measure the activity of promoters and show their dependence on RAP1/GCR1 binding sites, provide the causal evidence necessary to make this an impactful study.

      Since I am not a yeast geneticist, it is possible that several of the concerns raised by me are due to my lack of knowledge of the system and some of the links that I find missing may have been demonstrated by others. If this is the case, I would suggest that the authors provide adequate background to address these concerns in the manuscript itself. It is my opinion, that this study, once shored up, will be of interest to a wide-readership and could also provide important experimental data that could be used for mathematical modeling.

      We appreciate the reviewer’s comments and believe that the changes we’ve made to the manuscript, including the addition of critical new data that complements and supports the RNA-seq data originally presented in the manuscript, does indeed make this a study that will be of interest to a wide readership.

    1. Now, as Trump mounts his third presidential bid and as Florida Republicans have worked to turn the state solidly red, he is looking toward Hialeah to expand his support in Miami-Dade County, which he almost flipped three years ago.

      This is news worthy because this is a large election that we will have to think about in the next year. Seeing that we have to figure out who will be the next president people will want to think about counties that may flip to change who the presidential candidate is.

    1. Note: This response was posted by the corresponding author to Review Commons. The content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      *Reviewer #1 (Evidence, reproducibility and clarity (Required)): *

      *In their study, Yamano et al. dissect the mechanism of TBK1 activation and downstream effects, especially in its relation to mitophagy adaptor OPTN. The authors find that OPTN's interaction with ubiquitin and the autophagy machinery, forming contact sites between mitochondria and autophagic membranes, results in TBK1 accumulation and subsequent autophosphorylation. Based on these findings, the authors propose a self-propagating feedback loop wherein OPTN phosphorylation by TBK1 promotes recruitment and accumulation of OPTN to damaged mitochondria and specifically the autophagosome formation site. This formation site is then involved in TBK1 autophosphorylation, and the activated TBK1 can then further phosphorylate other pairs of OPTN and TBK1. A OPTN monobody investigation strengthens their findings. *

      *Critique: *

      • It would be helpful if the authors could more clearly highlight the previous findings in OPTN-TBK1 relationship and which gaps in the understanding their study addresses.* We thank the reviewer for this comment. As suggested, we have highlighted previous findings and detailed in the Discussion how the study advances our understanding of TBK1 activation.

      • It is not always clear whether experiments have been replicated sufficiently; this should be indicated in the figure descriptions.* In the original manuscript, most of the data shown was derived from duplicated experiments. For the revised version, we repeated experiments as needed to generate the replication necessary (i.e, N = 3) for determining statistical significance. Error bars and statistical significance have been added to the graphs and figure legends accordingly.

      • During the discussion, references to the figures that indicate conclusions should be added where appropriate.* We thank the reviewer for the suggestion. References to figures have been added were appropriate to the Discussion.

      *Figure 1 / Result "OPTN is required for TBK1 phosphorylation and subsequent autophagic Degradation": *

      *o In a) the TBK1 and TOMM20 blots feature an image artefact that makes it appear like the blots are stitched together or there was a problem with the digital imager. The quantification in b) seems to be missing replications. *

      We found that the artifact came from an automatic pixel interpolation process in Adobe Photoshop when the image was rotated by a small angle. We have provided the original immunoblotting data below as evidence that the data were not stitched from separate images. More accurate representations of the images without the artifact are now shown in Fig1 A of the revised manuscript.

      For Fig 1b, the experiment was independently replicated three times with error bars added to each plot on the graph.

      *o g) should feature the wt cell line on the same blot for better comparability as well as quantification and replication like done in f) *

      As suggested, we have included the WT cell line in the immunoblot (See Fig 1g). In addition, Reviewer 2 asked that we provide data for Penta KO cells without exogenous expression of the autophagy adaptors and expressed concern regarding the lower expression of NDP52 relative to OPTN. To address these issues, we repeated the mitophagy experiments and detected phosphorylated TBK1 in six different cell lines: WT, Penta KO, Penta KO stably expressing OPTN at both low and high expression levels, and Penta KO stably expressing NDP52 at low and high expression levels. Immunoblots of phos-TBK1(pS172), TBK1, OPTN, NDP52, TOMM20, and actin were generated under four different conditions (DMSO, valinomycin for 1 hr, valinomycin for 3 hrs, and valinomycin in the presence of bafilomycin for 3 hrs). In addition, phos-TBK1 abundance in the six cell lines was determined in response to val and baf for 3 hrs and the expression levels of NDP52 and OPTN were similarly determined in response to DMSO. Error bars based on three independent experiments have been incorporated into the data, which are shown in Figure 1g and 1h of the revised manuscript.

      *o h) is missing the blots for controls actin and TOMM20 *

      Immunoblots for actin and TOMM20 have been added, please see Fig 1i in the revised manuscript.

      *o In the text to e/f), the authors write that NDP52 KO effect on pS172 are comparable to controls, though the quantitation in f) indicates that pS172 signal is indeed significantly reduced compared to wt *

      The reviewer is correct, the phos-TBK1 (pS172) signal in NDP52 KO cells is reduced compared to that in WT cells, but is only moderately lower in NDP52 KO cells relative to OPTN KO. We regret the error, which has been corrected in the revised manuscript.

      *o In the text to h/i), the authors write "there was a significant increase in the TBK1 pS172 signal in cells overexpressing OPTN", though the quantification in i) does not indicate significance levels *

      We performed statistical analyses on the phos-TBK1 (pS172) levels between cells with or without OPTN overexpression and have added the degree of significance to Fig 1j. As indicated in the original manuscript, there was a significant increase in phos-TBK1 (pS172) levels when OPTN was overexpressed.

      *Figure 2 / Result "OPTN association with the autophagy machinery is required for TBK1 activation": ** o In b), pTBK1 at val 1 hr only features one dot/experiment per cell line *

      Three independent replicates of the experiment (val 1 hr) were performed. The levels of phos-TBK1 (pS172), total TBK1, and actin were quantified, and the graph was remade with error bars and statistical significance incorporated. Please see Fig 2b in the revised manuscript.

      *o In the text to c), the authors claim that the mutants reduce/abolish the recruitment of OPTN to the autophagosome site. A costain for LC3, as done for SupFig 1b, would be necessary to support that specific claim. *

      To address the reviewer’s concern regarding the recruitment of OPTN mutants to the autophagosomal formation site, we performed two different experiments. First, when OPTN WT is recruited to the contact site between the autophagosomal formation site and damaged mitochondria, it should be heterogeneously distributed across mitochondria. In contrast, OPTN mutants that are unable to associate with the autophagosome formation sites should be largely localized to damaged mitochondria since the mutants are still capable of binding ubiquitin. When we examined the mitochondrial distribution of OPTN WT following valinomycin treatment for 1 hr, more than 80% of the Penta KO cells exhibited a heterogeneous distribution, whereas only 10% of the cells showed a similar distribution for OPTN 4LA or OPTN 4LA/F178A (please see Fig 2g in the revised manuscript). Although the OPTN F178A mutant exhibited 50% heterogeneous distribution (Fig 2g), this may be because OPTN F178A retains the ability to interact with ATG9A vesicles. In fact, our previous mitophagy analyses (Keima-based FACS analysis, Yamano et al 2020 JCB), which are strongly correlated with OPTN mitochondrial distribution, showed that the OPTN F178A mutant moderately (~ 60%) induced mitochondrial degradation. This degradation effect was slightly higher (80%) with OPTN WT but significantly lower (9%) with the 4LA/F178A mutant. In the second experiment, Penta KO cells expressing either OPTN WT or the OPTN mutants were immunostained for exogenous FLAG-tagged OPTN, endogenous WIPI2, and HAP60 (a mitochondrial marker) after valinomycin treatment for 1 hr (see Fig 2e and 2f in the revised manuscript). Because LC3B is assembled on the autophagosomal formation site as well as completed autophagosomes, we detected endogenous WIPI2 because WIPI2 is only recruited to autophagosomal formation sites (Dooley et al. 2014 Mol Cell). Confocal microscopy images and their associated quantification data indicate that WIPI2 foci formation during mitophagy was reduced in Penta KO cells expressing the OPTN mutants (4LA, F178A and 4LA/F178A) as compared to Penta KO cells expressing OPTN WT.

      *o d) and g) as simple confirmations of KO/KD efficiency might be better suited for the supplemental part, or blots for FIP/ATG be included with the blots in e) and h) *

      Based on the reviewer comments, we performed additional experiments related to Figure 2 and have incorporated the new data into the revised figure. The original Figure 2d, e, f, g, h, and I have been moved to supplemental Figure 5.

      *o In the text to e), the authors claim that the levels of pS172 in the KO cell lines did not increase during mitophagy, though the blot and quantification in f) seem to indicate an increase. The results therefore don't seem to align completely with the claims that pS172 generation in response to mitophagy requires the autophagy machinery, or that FIP200 and ATG9A rather than ATG5 are critical for TBK1 phosphorylation. *

      Although newly generated pS172 TBK1 was reduced in FIP200 KO and ATG9A KO cells relative to WT cells, the signals gradually increased. In the autophagy KO cell lines (FIP200 KO and ATG9A KO), phos-TBK1 accumulates prior to mitophagy stimulation. Although suggesting it is mitophagy-independent, phos-TBK1 accumulation prior to mitophagy stimulation in autophagy KO cell lines complicated interpretation of the results. To avoid this issue, we used siRNA to transiently knock down FIP200 and ATG9A. As shown in the original manuscript (Fig 2g, h, I in the original manuscript, supplementary Fig 5d, e, f in the revised manuscript), knockdown of FIP200 and ATG9A prior to mitophagy induction allowed us to observe mitophagy-dependent phosphorylation of TBK1. This result strongly suggests that the autophagy machinery does induce TBK1 phosphorylation in response to Parkin-mediated mitophagy. However, TBK1 phosphorylation still increases, albeit very slightly, in the FIP200 and ATG9A knock down cells. Thus, it may be reasonable to assume that OPTN-dependent phosphorylation of TBK1 can occur to a certain degree even in the absence of autophagy components. We have noted this in the Discussion.

      While conducting experiments for the revised manuscript, we determined that TAX1BP1 is responsible for the accumulation of phos-TBK1 in the autophagy KO cell lines under basal conditions. When TAX1BP1 is knocked down in FIP200 KO or ATG9A KO cells, the basal accumulation of phos-TBK1 was eliminated and then we could observe mitophagy-specific TBK1 phosphorylation (please see Fig 2h, i, j, k in the revised manuscript). These results showed that mitophagy-dependent phos-TBK1 is largely attenuated in FIP200KO and was almost completely eliminated in ATG9A KO cells (Fig 2k in the revised manuscript).

      *o f) is missing significance indications. Its description has a typo: "bad" instead of "baf" *

      Newly synthesized pTBK1 (pS172) during mitophagy was quantified and statistical significance incorporated into the figure (please see supplementary Fig 5c). The identified typo has been corrected.

      *Figure 3 / Result "TBK1 activation does not require OPTN under basal autophagy conditions": *

      *o In the text to SupFig2, the authors claim that pS172 levels are significantly elevated, but no significance levels are indicated *

      Statistical significance was determined for all proteins shown in original supplementary Fig 2 and the results have been incorporated into the relevant figure. The original supplementary Fig 2 is now supplementary Fig 6.

      *o In the text to a), NBR1 is claimed to colocalize with Ub, but no costaining with Ub is shown. The claimed lacking colocalization of OPTN with Ub is not obvious from the images; a quantification might be appropriate. *

      Since the anti-NBR1 antibody used in the original manuscript is derived from mouse, we were unable to use it in conjunction with the mouse ubiquitin antibody. Because ubiquitin-positive foci and NBR1-positive foci contain p62 (original Fig 3a) and NBR1 and p62 are known to tightly interact each other (Kirkin et al. 2009 Mol Cell and Sanchez-Martin et al. 2020 EMBO Rep), we stated that "NBR1 colocalizes with Ub". However, the reviewer is correct. To remedy this confusion, we obtained a rabbit anti-NBR1 antibody (a gift from the Masaaki Komatsu group) and used it to co-immunostain with anti-Ub antibodies (please see supplementary Fig 7a of the revised manuscript). NBR1 foci colocalize with both ubiquitin and p62 in FIP200 KO and ATG9A KO cells. Further, based on comments from Reviewer 2, we purchased several anti-TBK1 antibodies and identified one that was able to detect endogenous TBK1 by immunostaining (see Figure 1 for reviewers in our response to Reviewer 2 below). Using this anti-TBK1 antibody, we showed that a part of TBK1 also associates with ubiquitin and p62-positive aggregates.

      *o In the text to b), the authors make reference to significant changes, but replication/ quantification/ significance testing is missing. *

      We independently performed the same experiments three times. The levels of TBK1, phos-TBK1 (pS172), all five autophagy adaptors, and TOMM20 in both the supernatants and pellets have been quantified with error bars and statistical significance indicated. These results have been incorporated into Figure 3c in the revised manuscript.

      *Figure 4b) is missing the pTBK1 data that is referenced in the text. In the text to figure 5 c/d), the authors claim that certain mutants have no significant effect on mitophagy, though d) is missing significance testing *

      *Figure 6 c/d/i) appear to be missing replication. *

      For Figure 4b, phos-TBK1 was immunoblotted (See Fig 4b of the revised manuscript). For Figure 5b and d, statistical significance was determined for the effect of TBK1 mutations on autophosphorylation and OPTN phosphorylation and the effect of the TBK1 mutants on Parkin-mediated mitophagy. For Figure 6 c/d/I, the experiment was repeated; error bars and statistical significance have been added to the associated graphs.

      *Reviewer #1 (Significance (Required)): Removal of damaged mitochondria by the mitophagy pathway provides an important safeguarding mechanism for cells. The Pink1/Parkin mechanism linked to numerous modulators and adaptor proteins ensures an efficient targeting of damaged mitochondria to the phagophore. The Ser/Thr kinase TBK1, in addition of multiple roles in innate immunity, is a major mitophagy regulator as has been revealed by the Dikic and Youle groups in 2016 (Richter et al., PNAS). The mechanistic insights provided by this manuscript add to a growing body of studies of how the autophagy machinery interconnects with cellular signalling networks. Although parts of the results need to be further validated, the data shown is of high quality, revealing an important conceptual advance. The paper is interesting and of general relevance beyond the signalling and autophagy community. *

      We would like to thank Reviewer 1 for the comments and suggestions, many of which improved our manuscript. We hope that the reviewer’s comments have been adequately addressed in the revised manuscript.

      *Reviewer #2 (Evidence, reproducibility and clarity (Required)): Summary In this manuscript, Yamano and colleagues show that as for Sting-mediated TBK1 activation, Optn provides a platform for TBK1 activation by autophosphorylation and that TBK1 is activated after the interaction of Optn with the autophagy machinery and ubiquitin and not before. They show that TBK1 phosphorylation is blocked by bafilomycine A1, an inhibitor of vacuolar ATPases that blocks the late phase of autophagy. Furthermore, they demonstrate that Optn is require for TBK1 phosphorylation since variation of Optn expression regulates TBK1 phosphorylation in response to PINK/Parkin-mediated autophagy. Interestingly, using immunofluorescence microscopy, they show that Optn forms sphere like structures at the surface of damage mitochondria which are more dispersed in the absence of TBK1. In addition, TBK1 is also recruited at the surface of damage mitochondria and as Optn and NDP52 (but not p62) colocalize with LC3B in response to PINK/Parkin-mediated mitophagy. Next, it is demonstrated that the Leucin zipper and LIR domains of Optn (which modulate Optn interaction with autophagosome) play an important role for TBK1 activation. Additionally, the autophagy core is shown to be required for TBK1 activation. Under basal conditions, depletion of the autophagosome machinery leads to an increase in autophagy receptors (except Optn) and TBK1 phosphorylation which colocalize with ubiquitin in insoluble moieties. In contrast, Optn remains cytosolic and is dispensable for TBK1 activation in these conditions. Then, using the fluoppi technic, the authors demonstrate that the generation of Optn-Ubiquitin condensates recruits and activates TBK1. They express in HCT116 TBK1-deficient cells engineered or pathological ALS mutations of TBK1 that affect ubiquitin interaction, structure, dimerization and kinase activity of TBK1. The expression level of TBK1 was only affected by the dimerization-deficient mutations. None of the mutations impaired Optn and TBK1 ubiquitination. Interestingly, some ALS-associated mutations affect TBK1 activity and it is said in the text that the dimerization-deficient mutations of TBK1 affect its activity proportionally to their level of expression, which is not really correct (the expression level of the mutants is very heterogenous and not always correlate to their activity). Regarding their effect on mitophagy, the authors claim that the phosphorylation of TBK1 correlate with mitophagy which is not really the case. By using TBK1 inhibitor or TBK1-depleted cells, the authors conclude that TBK1 is the only kinase phosphorylating Optn. However, BX-795 is not completely specific to TBK1. Finally, the authors use monobodies against Optn effective in inhibiting mitophagy in NDP52 KO cells. Some of the monobodies have been shown to form a ternary complex with Optn and TBK1, while others compete for the interaction between Optn and TBK1 which involves the amino-terminal region of Optn and the C-terminal region of TBK1. Monobodies that compete for the interaction of Optn with TBK1 could alter the cellular distribution of Optn and inactivate TBK1, but they do not alter the ubiquitination of Optn. Finally, these monobodies inhibit 50% of mitophagy. *

      *Major and minor points: Introduction The first paragraph of the Introduction section is confused and difficult to read. First and second paragraphs (page 3 and top of page 4) are dedicated to macroautophagy processes but ended with one sentence on Parkin-mediated autophagy without further introduction, while all processes regarding mitophagy are detailed in the next paragraph. Links between ideas developed are also somewhat missing. For example, in page 6, the three last sequences detailed the phosphorylation of autophagosome component, the fact that Optn and TBK1 genes are involved in neurodegenerative diseases and autophosphorylation of TBK1 as a pre-requirement for TBK1 activation without evident links between them, except "interestingly". *

      In response to the reviewer’s suggestion, we have rewritten the Introduction. The first paragraph focused on introducing the molecular mechanism underlying macroautophagy and the second paragraph focused on Parkin-mediated mitophagy. As the reviewer indicated, the ALS mutations and TBK1 phosphorylation during Parkin-mediated mitophagy are not well related, so we moved the background material on the relationship between OPTN and TBK1 in neurodegenerative diseases to the beginning of the section describing Figure 5. We believe these changes have made the Introduction easier to read and understand.

      *Results *

      *Major points: *

      *1- Results are often over-interpreted regarding data obtained leading to inadequate conclusions (see below for details); *

      We regret the reviewer’s concerns regarding over-interpretation. To address this issue, we have carefully considered the data, performed additional experiments where necessary, and rewritten the results accordingly. Please see our point-by-point responses below.

      *2- Quantification of protein levels detected by western blot are provided as "relative intensities" without referring to specific loading control or to total protein when -phosphorylated forms are quantified (Fig. 1b, 1d, 1f, 1i, 2b, 2f, 2i, 5b, 7b, supplemental figures 2b). *

      For the immunoblots, we loaded the same amount of total cell lysate and the phosphorylated forms were quantified relative to the total protein input. This has been mentioned in the Materials and Methods.

      *3- In western blotting experiments, authors described slower migrating bands as "ubiquitinated" forms of detected proteins, but never provided experimental evidences that it could be the case. Use of non-specific deubiquitinase incubation of extracts prior to western blot could help to correctly identified ubiquitination versus other post-translational modifications such as phosphorylation, glycosylation, acetylation etc... *

      We appreciate the reviewer’s suggestion. The cell lysates after mitophagy induction were incubated in vitro with a recombinant USP2 core domain (non-specific DUB), and then immunoblotted. As shown in supplemental Fig 1 of the revised manuscript, the slower migrating OPTN bands disappeared in a USP2-dependent manner. The slower migrating NDP52 and TOMM20 bands likewise disappeared. These results confirm that the slower migrating OPTN, NDP52, and TOMM20 bands are ubiquitinated.

      *4- Conclusions from data obtained by immunofluorescent imaging are often drawn from only one image presented without further statistical analysis. *

      Statistical significance was determined for the immunofluorescent data (original figures 1j, 2c and 3a). Please see Fig 1l, 2f, 2g, and 3a in the revised manuscript.

      *Page 7: - authors referred to TBK1 phosphorylation induced by mitophagy induction as "TBK1 phosphorylation induced by Parkin-mediated ubiquitination" while mitophagy can be induced independently of Parkin (ex: via mitochondrial receptors) and without any evidence (according to referee's knowledge) of a link between ubiquitination by Parkin and TBK1 phosphorylation. *

      As the reviewer indicated, Parkin-independent and ubiquitination-independent mitophagy pathways are also known (i.e. receptor-mediated mitophagy driven by NIX, BNIP3, BCL2L13, FKBP8, FUNDC1, or Atg32). Therefore, references to "mitophagy" in our manuscript were reworded as "Parkin-mediated mitophagy". Since TBK1 phosphorylation is observed before mitochondria are degraded and is dependent on Parkin-mediated ubiquitin (for example, see Fig 1c), we use the phrase "TBK1 phosphorylation triggered by Parkin-mediated OMM ubiquitination".

      *Fig 1g: Western blots performed in Penta KO cells without exogene expression of any autophagy receptors should be provided as control. Furthermore, lower expression of NDP52 relative to that of Optn (using flag antibodies) should be discussed as it can explained the differential levels in TBK1 phosphorylation observed. *

      As suggested, we repeated the experiment using Penta KO cells in the absence of exogeneous autophagy adaptor expression. Furthermore, we expressed different amounts of NDP52 and OPTN (indicated as low and high in the figure) in Penta KO cells to rule out the possibility that higher TBK1 phosphorylation is induced by simple overexpression of autophagy adaptor (please see Fig 1g and h in the revised manuscript). At high NDP52 expression (2.5-3.0-fold higher than endogenous NDP52), phosphorylated TBK1 was reduced to ~30% the level of that observed in WT cells after 3 hrs with val and baf. In contrast, Penta KO cells with higher OPTN expression (3.0-fold higher than endogenous OPTN) had phosphorylated TBK1 signals that were 2-fold higher than those in WT cells. Based on these results, we concluded that OPTN is an important adaptor for TBK1 activation during Parkin-mediated mitophagy.

      *Page 8: Supplemental Fig 1a: - The inability of authors to observe TBK1 endogenous signal in HeLa cells using commercially available antibodies is surprising as many publications reported successful staining (see Figure 1 of Suzuki et al. 2013 Cell type-specific subcellular localization of phospho-TBK1 in response to cytoplasmic viral DNA. PLoS One. 8:e83639 among others) as well as commercial promotion (see Anti-NAK/TBK1 antibody from Abcam reference: ab235253). *

      For the original manuscript, anti-TBK1 antibodies purchased from abcam (ab235253), CST (#3013S), Proteintech (28397-1-AP), and GeneTex (GTX12116) for immunostaining were unable to yield TBK1-positive signals (please see Fig 1 for reviewers below). WT and TBK1-/- HCT116 cells stably expressing Parkin were treated with valinomycin for 1 hr and immunostained with the indicated antibodies. Anti-phos-TBK1 antibody (CST, #5483) was used as a positive control. Based on these results, we stated in the original manuscript that the "endogenous TBK1 signal could not be observed using commercially available antibodies". At the reviewer’s suggestion, we purchased anti-TBK1 antibodies from abcam (ab40676) and CST (#38066). As shown in the figure below, the immunofluorescent signals generated by these antibodies were detected in WT, but not in TBK1-/- cells. The CST (#38066) antibody yielded a stronger signal, most of which was on damaged mitochondria. Thanks to this suggestion, we repeated the experiment using the new anti-TBK1 antibody. Furthermore, based on a suggestion from Reviewer 3, we detected mitochondrial recruitment of TBK1 during mitophagy stimulation (valinomycin for 30 min or 2 hrs in the presence and absence of bafilomycin; supplemental Fig 2 in the revised manuscript). We also detected association of endogenous TBK1 with ubiquitin-positive condensates in WT, FIP200KO, and ATG9A KO cells (Fig 3a and supplementary Fig 7a in the revised manuscript).

      *- Conclusions of the localization of signal on mitochondria (dispersed, in the periphery or at contact sites) are clearly over-interpreted in the absence of other membrane or autophagosome specific labeling and statistical colocalization analyses of multiple images. It is particularly difficult to assess any difference between Tax1BP1, p62 and NBR1 localization on mitochondria subdomains. *

      We previously expressed each FLAG-tagged autophagy adaptor in Penta KO cells and observed their localization during Parkin-mediated mitophagy and found that exogenous FLAG-tagged OPTN and NDP52, but not p62, colocalized with LC3B (Yamano et al 2020 JCB). No one has assessed and compared the localization of all five endogenous autophagy adaptors. Although we still believe that the results (supplemental Fig1 in the original manuscript) are informative for researchers in the autophagy field, we decided to remove that data from the revised manuscript since they are not the main focus of the study. We will consider publishing those data elsewhere in the future after co-staining with autophagosome markers and assessing the statistical significance of colocalization as the reviewer suggested.

      *Page 9: *

      *- First part of results ended without any conclusions. *

      As detailed in the previous response, we have removed results for mitophagic recruitment of autophagy adaptors (supplementary Figure 1 in the original manuscript).

      *- The observation that "TBK1 phosphorylation was not apparent in the Optn mutant cell lines, even after 3 hrs of valinomycin, ..." is inconsistent with detection of bands with anti-pS172-TBK1 antibodies in Fig 2a detected at 1hr (with F178A) and 3 hrs (4LA, F178A, and 4LA/F178A mutants) of treatment. *

      We apologize for the confusion. This statement was clearly our mistake. We had intended to state when "all autophagy adaptors are deleted" no phosphorylated TBK1 was observed. We have rewritten this part as "TBK1 phosphorylation was not apparent in the Penta KO cells even after 3 hrs with valinomycin".

      *- Similarly, decreased levels of phosphorylated TBK1 stated for F178A mutant was only observed at 1 but not 3hrs or at 3hrs in the presence of bafilomycin. *

      Based on the mitophagy assay previously reported (Yamano et al 2020 JCB), the F178A mutant only moderately inhibited mitophagy (60% mitophagy with the F178A mutant vs 80% mitophagy with OPTN WT). Conversely, the 4LA mutant and 4LA/F178A double mutant had stronger inhibitory effects on mitophagy (35% for 4LA and 9% mitophagy for 4LA/F178A). Therefore, the levels of phos-TBK1 after 1 hr with valinomycin or 3 hrs with valinomycin in the presence of bafilomycin are consistent with mitophagy progression. When mitophagy proceeds efficiently, the amount of phos-TBK1 in the 1 hr val samples is reduced relative to the 3 hr val samples due to autophagic degradation.

      To more clearly observe and compare the levels of mitophagy-dependent phos-TBK1 among Penta KO cells expressing OPTN WT and the mutants, we treated cells with valinomycin in the presence of bafilomycin for 0, 0.5, 1, and 2 hrs and quantified phos-TBK1. The results are shown in Fig 2c and d in the revised manuscript. The phos-TBK1 signal increased over time with val and baf treatment in all OPTN expressing cells. Cells with OPTN WT generated the most phos-TBK1, whereas the signal generated by the F178A mutant was 75% that of the OPTN WT-expressing cells and the 4LA and 4LA/F178A mutants were about 40%. The experiments were independently replicated three times and error bars and statistical significance were incorporated into the associated graph. These results indicate that OPTN association with the autophagy machinery, in particular ATG9A vesicles, is important for TBK1 activation.

      *Page 10: *

      *The results and their repartition between figure 2 d, e, f, g, h, I and figure 3 is a bit confusing. In these experiments, it is shown Figure 2 that the absence or depletion of the autophagy machinery increase the phosphorylation of TBK1 and in Figure 3 it is shown that not only the phosphorylation of TBK1 accumulate but also the expression of NDP52, Tax1BP1 and p62. Is it because their degradation by autophagy is blocked (like for phosphoTBK1)? *

      The reviewer is correct that autophagy adaptors other than OPTN (especially TAX1BP1, p62 and NBR1) are constantly degraded by macro/micro autophagy (Mejlvang et al. 2018 J Cell Biol and Yamano et al. 2021 BBA Gen Subj). Therefore, these adaptors accumulate in autophagy deficient cell lines (original Fig 3). In this study, we found that in the absence of mitophagy stimulation phos-TBK1 accumulates in autophagy deficient cell lines. This suggests that the accumulated autophagy adaptors induce TBK1 phosphorylation under basal conditions. In the original manuscript, we claimed that TBK1 phosphorylation under basal conditions does not require OPTN since in FIP200 KO and ATG9A KO cells it did not accumulate and did not primarily colocalize with ubiquitin- and TBK1-positive foci (original Fig 3). To gain more direct evidence for the revised manuscript, we performed additional experiments and discovered that TAX1BP1 is the adaptor responsible for TBK1 autophosphorylation under basal autophagy. We treated FIP200KO and ATG9A KO cells with siRNAs against OPTN, NDP52, TAX1BP, p62, and NBR1, and immunoblotted total cell lysates with an anti-phos-TBK antibody. As shown in Fig 3f in the revised manuscript, TAX1BP1 siRNA treatment decreased phos-TBK1 levels without affecting total TBK1. This result indicates that the accumulation of TAX1BP1 in the FIP200 KO and ATG9A KO cells induced TBK1 autophosphorylation under basal conditions. Considering this result, we treated WT, FIP200 KO, and ATG9A KO cells with TAX1BP1 siRNA, and then induced Parkin-mediated mitophagy with valinomycin in the presence of bafilomycin. This strategy eliminated the basal accumulation of phos-TBK1 and allowed us to focus on mitophagy-dependent TBK1 phosphorylation. Please see revised Fig 2h, I, j, and k. The results showed that mitophagy-dependent phos-TBK1 is predominantly attenuated in FIP200 KO and ATG9A KO cells. In Figs 2 and 3, we would like to emphasize that OPTN is required for TBK1 phosphorylation in response to Parkin-mediated mitophagy, whereas TAX1BP1 is required for TBK1 phosphorylation in basal autophagy. Since Reviewer 3 commented that interpretation of the data in original Figs 2d, e, and f was challenging, we elected to move those results to the supplemental figures. We have incorporated the newly acquired data (mitophagy using FIP200 KO or ATG9A KO with TAX1BP1 siRNA cells) into the main figure. We believe that this makes the text easier for readers to understand.

      *- Fig 2c: conclusions on *

      *the reduction of recruitment of Optn mutants on autophagosome formation seem over-interpreted as: *

      *1- no labeling with LC3 has been used to identified autophagsome, *

      *2- immunofluorescent signals observed with mutants are dispersed throughout the entire mitochondria network (see the merged images) rendering impossible to distinguish between autophagosome-associated mitochondria and others. *

      *The following conclusive sentence stating that association of Optn to damaged mitochondria is not sufficient for TBK1 activation based solely on IF of figure 2c seems therefore unrelated to the obtained data. *

      To address concerns about the recruitment of OPTN mutants to the autophagosome formation site, we performed additional experiments. Penta KO cells and those expressing OPTN WT and mutants were treated with valinomycin for 1 hr, and FLAG-tagged OPTN, endogenous WIPI2, and HAP60 (mitochondrial marker) were detected by immunostaining. We detected endogenous WIPI2 because WIPI2 is recruited only to autophagosome formation sites (Dooley et al. 2014 Mol Cell), whereas LC3B assembles on autophagosome formation sites and is also associated with completed autophagosomes. Confocal microscopy images showed that cup-shaped OPTN WT that had been recruited to damaged mitochondria colocalized with WIPI2. Quantification further showed that during mitophagy the number of WIPI2 foci seen in cells expressing OPTN WT decreased in Penta KO cells and cells expressing OPTN mutants (4LA, F178A and 4LA/F178A). These data are shown in Fig 2e and f in the revised manuscript. In addition, we quantified the number of cells that either exhibited heterogeneous or homogeneous recruitment of OPTN to damaged mitochondria after treatment with valinomycin for 1 hr. More than 80% of Penta KO cells with OPTN WT had heterogeneous OPTN recruitment, whereas this distribution was only present in 10% of cells expressing either OPTN 4LA or OPTN 4LA/F178A. Although cells expressing the OPTN F178A mutant exhibited 50% heterogeneous recruitment, this may be because the mutant can interact with ATG9A. As mentioned above, our previous mitophagy analyses (Keima-based FACS analysis, Yamano et al 2020 JCB) showed that the OPTN F178A mutant induced ~60% mitochondrial degradation (which is correlated strongly with OPTN distribution), whereas it was 80% with OPTN WT and 9% with 4LA/F178A.

      *- Fig 2d: authors should explain why ATG KO cells displayed lipidated LC3B in the absence of efficient autophagy processes. *

      We thank the reviewer for the suggestion. We added the following sentence to explain the function of ATG5 in LC3B lipidation. "Since LC3B lipidation is catalyzed by ATG5, but not FIP200 and ATG9A, the lipidated form disappears only in ATG5 KO cells (Hanada et al 2007 J Biol Chem). "

      *- Fig 2e: despite authors statement that TBK1 phosphorylation did not increase during mitophagy in ATG KO cells, increased pS172-TBK1 is visible in FIP200 and ATG5 KO cells especially between 1 and 3 hrs of stimulation, leading to inaccurate conclusions that TBK1 phosphorylation requires the autophagy machinery. Therefore, overall assumption that both ubiquitination and autophagy subunits are required for TBK1 autophosphorylation appears erroneous. *

      As the reviewer indicated, phos-TBK1 levels gradually increased in ATG KO cells. The main text was rewritten to more accurately reflect this increase. Based on experiments using the monobodies and those conducted during the revision process, it is apparent that although the autophagy machinery may not be completely essential for TBK1 phosphorylation, it clearly facilitates TBK1 phosphorylation in response to Parkin-mediated mitophagy.

      *Page 12: *

      *- Fig 3a: conclusion that Optn signal is more cytosolic and did not localize with Ub condensates seems speculative as based on: *

      *1- only one immunofluorescence image without statistical analysis *

      *2- Optn and Ub signals are lower in images with Optn is analyzed compared to other images in which NDP52, TAX1BP1 and NBR1 are detected. *

      To address these concerns, we compared and quantified the signal intensities of all endogenous autophagy adaptors in FIP200 KO and ATG9A KO cells. The quantification data are shown in Fig 3a and the immunofluorescence images are shown in supplementary Fig 6a of the revised manuscript.

      *- Fig 3b: interpretation of western blot data is uncertain due to lack of appropriate loading control, especially with pellets (P) extracts. In addition, it is not clear how to conclude from the experiments in Fig 3b that autophagy adaptors other than Optn mediate TBK1 phosphorylation. *

      When autophagy is inhibited, p62 accumulates in the cytosol as aggregates (Komatsu et al. 2007 Cell). Therefore, p62 should be a positive control. Indeed, Fig 3b in the original manuscript (Fig 3b and c in the revised manuscript) showed that the amount of p62 in the pellet fraction was elevated in FIP200 KO and ATG9A KO cells. Furthermore, these aggregates were also observed in the imaging data (Fig 3a and supplementary Fig 7 in the revised manuscript). As the reviewer indicated, the original manuscript did not clarify whether autophagy adaptors other than OPTN mediated TBK1 phosphorylation; however, our revised results clearly demonstrate that TAX1BP1 is the adaptor responsible inducing TBK1 autophosphorylation when basal autophagy is impaired (please see Fig 3f in the revised manuscript).

      *Minor point: reference is missing in the last sentence of the paragraph stating that K48-linked chains dominate when autophagy pathways are impaired. *

      While several autophagy adaptors preferentially interact with K48-linked ubiquitin chains (Donaldson et al. 2003 PNAS etc), TRAF6 is recruited to ubiquitin-condensates via p62-mediated K63-linked ubiquitination (Linares et al. 2013 Mol Cell). Furthermore, K33-linked ubiquitin chains are also present in p62-positive condensates (Nibe et al. 2018 Autophagy). Because it’s not clear which ubiquitin-linkage is dominant in the condensates, we decided to delete the sentence. We regret the confusion.

      *Page 13: *

      *Conversely to Optn, they find that the other autophagic receptors localize in insoluble fractions (what does it mean?) independently of TBK1 expression (experiments with DKO cells) and also independently of Optn (where is this shown?). Altogether, these experiments are far from the message of the manuscript. The title of the paragraph "TBK1 activation does not require Optn under basal autophagy conditions" is not correct because even if the level of expression of autophagic receptors and TBK1 phosphorylation are increase in response to the depletion of the autophagy machinery, it does not increase autophagy. *

      According to the suggestion, we changed the title of the paragraph to "TAX1BP1, but not OPTN, mediates TBK1 phosphorylation when basal autophagy is impaired." In addition, we rewrote this section.

      *- Fig 3d: authors should mention the nature of the upper band observed in Optn western blot and show the same experiment in since solely TBK1 depleted cells since they stated that "electrophoretic migration of Optn was not affected by TBK1 deletion". In addition, suggesting from these sole experiments that "NP52, TAX1BP1, p62, NBR1 and AZI2 form Ub-positive condensates where TBK1 is activated" seems over-interpretated. *

      Reviewer 3 suggested we characterize the upper band in the OPTN blot (Fig 3d in the original manuscript). To determine if the band is genuine OPTN, we used phostag-PAGE to analyze cell lysates from cells treated with control siRNA or OPTN siRNA and found that both the lower and upper bands were OPTN species (please see "Figure 2 for reviewers" in our response to Reviewer 3). The same pattern was reported by the Wade Harper group (Heo et al. 2015 Mol Cell). They showed that the OPTN double band pattern on phos-tag PAGE was not affected by TBK1 deletion. We have cited this literature where appropriate in the revised manuscript. In WT cells, it is difficult to detect phosphorylation of autophagy adaptors by TBK1 because basal autophagy constantly degrades them. That’s why we used autophagy KO cell lines.

      *Page 14: *

      *- Fig 4: TBK1 phosphorylation was analyzed in Fig4d and not in Fig4b as stated. In addition, it is rather difficult to conclude from artificial multimerization experiments, as the authors have done, that interaction between Optn and autophagy components contributes to Optn multimerization in genuine conditions. *

      Detection of phos-TBK1 has been corrected to Fig 4b. Although artificial, the fluoppi assay provides insights into how OPTN activates TBK1 and how the autophagy machinery contributes to TBK1 activation via OPTN. To determine if artificial OPTN multimerization could bypass the autophagy machinery requirement, we used the fluoppi assay. This assay was important for us to conclude that the autophagy machinery and Parkin-mediated ubiquitination allow OPTN to be assembled in close proximity to where TBK1 is activated. The main text was rewritten to better convey the benefits of the fluoppi assay.

      *Page 15: *

      *This work could have therapeutic consequences but the pathological mutants of TBK1 used affect ALS (Figure 5) while in the discussion it is proposed that monobodies could have a therapeutic interest in familial forms of glaucoma due to the E50K mutation of Optn. It should be better to target only one pathology. *

      Both TBK1 and OPTN are causative genes for ALS and many pathogenic mutations are known to impact their function. In this study, we focused on ALS mutations in TBK1 that affect self-dimerization and investigated their impact in response to Parkin-mediated mitophagy. We created the monobodies as a tool to physically inhibit OPTN assembly at the contact site. Although our monobodies inhibit Parkin-mediated mitophagy, they would not be a useful therapeutic strategy for ALS due to the loss of function with the TBK1 mutations. However, because TBK1 E50K is a glaucomatous mutation that causes OPTN-TBK1 to bind more tightly, our monobodies might be applicable to glaucomatous pathology since they could disrupt this interaction. We thus feel that it is appropriate to mention the potential of the monobodies and their future utility in the Discussion.

      *- Fig 5c, d: Authors stated that degree of TBK1 autophosphorylation correlated with OPTN phosphorylation at S177 whereas phosphorylated TBK1 is unaffected by L693Q and V700Q mutants that display decreased phosphorylated Optn In addition, authors interpretation of Figure 5 data is clearly problematic as they stated that: *

      *1- neither 693Q and V700Q mutants had "significant effect on mitophagy", while decreasing efficiency from 78% to 37-51% *

      *2- but conclude that 49.7% mitophagy levels of R357Q mutant is significant mitochondrial degradation. *

      *Overall conclusion that mitophagy efficiency is correlated with phosphorylated TBK1 levels is therefore inaccurate. *

      We regret that this section did not sufficiently describe the data. Reviewer 3 also noted that the text referencing Fig 5 was difficult to interpret. One of the reasons for the complicated data interpretation is the number of TBK1 mutants used. The L693Q and V700Q mutations used by Li et al. (2016 Nat Commun) were expected to inhibit Parkin-mediated mitophagy since those authors reported that the mutations prevented interactions with OPTN. However, our in-cell assay showed that the two mutations only moderately affected Parkin-mediated mitophagy. Furthermore, both the L693Q and V700Q mutations were engineered based on the X-ray structure, rather than being authentic pathogenic ALS mutations. To avoid any potential confusion, we decided to remove the L693Q and V700A data. We have re-evaluated the other data and have rewritten this section accordingly. Please see the revised main text.

      *Discussion *

      *Minor points: *

      *page 20: - reference is missing in the sentence "Optn cannot oligomerize on its own on ubiquitin-decorated mitochondria". *

      We have provided the appropriate reference.

      *Major points: *

      *Authors stated that they showed that Optn recruitment to damaged mitochondria, itself, is insufficient for TBK1 autophosphorylation, but did not show experiment of Optn recruitment to mitochondria and its consequences on TBK1 phosphorylation in the absence of mitophagy induction signal. Authors could for example target HA-Ash-6Ub to mitochondria in order to artificially recruit hAG-Optn to "ubiquitinated" mitochondria in the absence of mitophagy signal. *

      We showed that the efficiency of TBK1 autophosphorylation was reduced in cells expressing the OPTN 4LA/F178A mutant, which cannot interact with the autophagy machinery (Fig 2c and d in the revised manuscript). Cells with FIP200 or ATG9A knockdown also have reduced phos-TBK1 (pS172) as shown in supplementary Fig 5e and f. The rate of phos-TBK1 (pS172) generation in ATG9AKO cells during Parkin-mediated mitophagy is reduced relative to that in WT cells (Fig 2j and k). Since a small amount of phos-TBK1 was generated in both ATG9A knockdown and KO cells (supplementary Fig 5e, f, Fig 2j and k), we concur that it would be premature to conclude that phosphorylation of TBK1 does not occur at all when autophagy core components are absent. A small amount of phos-TBK1 may be generated by OPTN that is freely distributed on the outer mitochondrial membrane. In the revised manuscript, we mention the possibility that TBK1 might be phosphorylated by OPTN independent of the autophagy machinery and were careful to avoid over-interpretation.

      As shown in Fig 4, fusing OPTN with an Azami-Green tag can induce artificial multimerization and trigger the generation of phos-TBK1 (pS172). Therefore, we expect that mitochondria-targeted HA-Ash-6Ub would induce TBK1 phosphorylation in a hAG-OPTN-dependent manner as was observed with cytosolic HA-Ash-6Ub (Fig 4). The accumulation of OPTN at the contact site in Parkin-mediated mitophagy is important for TBK1 phosphorylation. Even if OPTN is forced to anchor to the mitochondria, this would induce isolation membrane formation and subsequent autophosphorylation of TBK1. Therefore, the utility of forcing OPTN to anchor to mitochondria is questionable.

      *Similarly, experimental approaches used by authors lack dynamics parameters to conclude on formation and elongation of isolation membranes and contacts sites that could be probably obtained through video microscopy. *

      Based on the reviewer’s comment, we performed time-lapse microscopy to observe OPTN recruitment to the contact site and followed its movement along with the elongation of isolation membranes during Parkin-mediated mitophagy. HeLa cells stably expressing GFP-OPTN and pSu9-mCherry (a mitochondrial marker) were treated with valinomycin (please see Fig 2l in the revised manuscript). Initial recruitment of GFP-OPTN near mitochondria was evident as small dot-like structures that then elongated over time to become cup-shaped structures and culminated in the formation of spherical structures. Considering the colocalization of OPTN with WIPI1/WIPI2 (markers of autophagosome formation site) in Fig 2e and supplementary Fig 2a, the time-lapse images strongly suggest that OPTN assembles at contact sites followed by elongation in tandem with isolation membranes during Parkin-mediated mitophagy.

      *Finally, the model proposed by the authors does not take into account data showing that Optn basally interacts with ubiquitinated mitochondria and LC3 family members (see Wild et al., Phosphorylation of the autophagy receptor optineurin restricts Salmonella growth. Science. 2011 333:228-33), although at lower levels compared to induced conditions, relativizing the impact of the proposed model. *

      According to the Reviewer 2 comment, we again read the Science paper (Wild et al. 2011) but could not find data showing that OPTN basally interacts with ubiquitinated mitochondria. At least, we think that under steady state conditions without mitophagy induction, mitochondrial ubiquitination and mitochondrial localization of OPTN are undetectable as shown in supplementary Figure 2 in our revised manuscript.

      *In conclusion, this manuscript represents a lot of work but the experiments often lack controls and are over-interpretated. *

      ***Referees cross-commenting** *

      *In my opinion, what emerges from these 3 reviews is that the results lack controls or have not been repeated enough to support the message that the interaction of Optn with ubiquitin and the ubiquitination machinery is sufficient to activate TBK1. In particular, as reviewer 1 says, the phosphorylation kinetics shown in Figure 1a are not consistent with TBK1 phosphorylation following the interaction of Optn with the ubiquitination machinery and ubiquitin. In Figure 1e, there is a decrease in TBK1 phosphorylation in contrast to WTcells as mentioned by Reviewer 1. In agreement with Reviewer 1, we believe that the WT cells are missing in Figure 1g. *

      *With regard to Figure 2c, we agree with reviewer 1 that an LC3 label is missing in order to be able to interpret the data. In Figure 2e and f, we agree with reviewer 1 that it is difficult to understand why TBK1 phosphorylation increases in the absence of the autophagy machinery (FIP200 KO and ATG5KO). In Figure 3, loading controls are missing for 3b and c. The TBK1 KO cells alone are missing in Fig 2d. In Figure 2b, pTBK1 is missing. In agreement with reviewer 3, we believe that the data with fluoppi contradict the message of the manuscript since they show that TBK1 can be phosphorylated by ubiquitin in the absence of the ubiquitination machinery. In agreement with reviewer 3, we believe that the experiments in Figure 5 are very difficult to interpret. The first reviewer is right to ask the question of the replicates for figures 6c and d. *

      We appreciate the summary of the reviewers’ comments. To address their concerns, we have included the appropriate controls and included the results of three independent experiments in the graphs, which now include appropriate error bars and statistical significance. Thus, we believe we have answered the most critical comments concerning the lack of controls.

      In Fig 1a, phos-TBK1 was maximal following 30 min of valinomycin treatment. We confirmed using microscopy-based observations that recruitment of endogenous TBK1 and OPTN and the generation of phos-TBK1 and phos-OPTN at contact sites (marked by WIPI1) near damaged mitochondria was also maximal after 30 min of valinomycin treatment (supplementary Fig 2 and 3). Therefore, the kinetics of phos-TBK1 and phos-OPTN generation are consistent with the recruitment of OPTN-TBK1 to the contact site.

      The data presented in Fig 2 clearly indicate that the autophagy components are involved in phos-TBK1 generation during Parkin-mediated mitophagy. Therefore, the claim that ubiquitination machinery is sufficient for TBK1 activation is incorrect. Although we agree that the autophagy gene deletions cannot completely inhibit TBK1 autophosphorylation, mitophagy-dependent generation of phos-TBK1 is largely impaired by ATG9A KO (Fig 2j and k). Thus, there is no doubt that isolation membrane formation is important for TBK1 activation following Parkin-mediated mitophagy.

      Fig 1e - The reviewer is correct that phos-TBK1 is reduced in the NDP52 knockout. We have rewritten the main text. It is also true that NDP52 has a smaller effect on TBK1 autophosphorylation as compared to OPTN.

      Fig 1g - Immunoblots using total cell lysates prepared from six different cell lines (WT, Penta KO alone, Penta KO stably expressing low or high OPTN or NDP52) under four different conditions (DMSO, valinomycin 1 hr, valinomycin 3 hrs, valinomycin + bafilomycin 3 hrs) showed that OPTN is a rate-limiting factor for TBK1 phosphorylation. Please see Fig 1g and h in the revised manuscript

      Fig 2c - The recruitment of OPTN WT and associated mutants to the contact site was re-examined by immunostaining with WIPI2 labeling. We found that OPTN WT was both efficiently recruited to and formed the contact site. In contrast, the OPTN 4LA/F178A mutant was unable to interact with FIP200/LC3/ATG9A and was uniformly (i.e. homogenously) distributed on damaged mitochondria with the rate of autophagosome site formation reduced. Please see Fig 2e, f, g in the revised manuscript.

      Fig 2e and f - KO of the autophagy core components FIP200 and ATG9A increased phos-TBK1 under basal, non-mitophagy-associated conditions (see Fig 3). The levels of autophagy adaptors other than OPTN also increased in FIP200 KO and ATG9A KO cells. Furthermore, as shown in Fig 3a and supplementary Fig 7, both phos-TBK1 and the autophagy adaptors accumulated in Ub-positive condensates. Based on previous reports (Mejlvang 2018 J Cell Biol), TAX1BP1, p62, and NBR1 have short half-lives and are quicky degraded by macro/micro autophagy. The accumulation of phos-TBK1 in the absence of autophagy occurs because autophagy-dependent degradation of TAX1BP1 (and other adaptors) is inhibited. This allows for the formation of Ub-positive condensates, which brings TBK1 into sufficient proximity for activation. This has been noted in the revised manuscript.

      Fig 3b and 3c - We wonder if the "loading controls are missing for Fig 3b and 3c" statement might be a misinterpretation by the reviewer as TOMM20 was used as the loading control in the original Fig 3b. It was recovered in the supernatant fractions of WT, FIP200 KO, and ATG9A KO cells, indicating that the accumulation of autophagy adaptors in the pellet fractions depends on autophagy gene deletion. Similarly, actin and TOMM20 were used as loading controls in the original manuscript Fig 3c.

      Fig 2d (perhaps meant to be Fig 3d) – A previous study reported that phos-tag PAGE blot of OPTN in TBK1 KO cells alone revealed no differences between WT and TBK1 KO cells (Heo et al 2015 Mol Cell). We cited this reference in the revised manuscript.

      Fig 2b (perhaps meant to be Fig 4b) - Immunoblots of phos-TBK1 have been incorporated into the results of Fig 4b in the revised manuscript.

      Fig 4 - We show in Fig 2 that induction of Parkin-mediated mitophagy promotes OPTN accumulation at contact sites formed by isolation membranes and ubiquitinated mitochondria, and that autophagy core subunits are required for efficient generation of phos-TBK1. Fig 3 shows that phos-TBK1 accumulates in Ub-positive condensates with TAX1BP1, rather than OPTN, and that it is responsible for phos-TBK1 accumulation. Together, these results suggest a model in which TBK1 is activated when OPTN and TBK1 are positioned near each other. We hypothesized that if we could force OPTNs into close proximity the autophagy machinery requirement for TBK1 activation might be bypassed. To assess this model, we designed the fluoppi assay shown in Fig 4. This assay was critical in that it provided an important clue for the molecular mechanism that OPTN and the autophagy machinery use to cooperatively induce TBK1 trans-autophosphorylation. Because the original manuscript may not have sufficiently conveyed our reasoning for the fluoppi analysis, we have rewritten this section. The main point of the fluoppi assay is that engineered OPTN multimerization was able to bypass the autophagy requirement for TBK1 activation.

      Fig 5 - For easier interpretation, the L693Q and V700Q data, which are not related to ALS pathology, have been removed.

      Fig 5d – Statistical significance has been determined for the mitophagy results and the main text has been rewritten for better clarity.

      Fig 6c, d, and I – The experiments were independently replicated more than three times with statistical support and error bars incorporated into the associated graphs.

      *Reviewer #2 (Significance (Required)): *

      *this manuscript represents a lot of work but the experiments often lack controls and are over-interpretated. The manuscript is for a broad audience. *

      For the revised manuscript, additional experiments were carefully performed with appropriate controls and the manuscript was rewritten to address concerns regarding over-interpretation. We hope that we have adequately addressed the reviewer’s comments.

      *Reviewer #3 (Evidence, reproducibility and clarity (Required)): *

      *The authors investigated the mechanisms by which TBK1 is phosphorylated and thus activated in PINK1/Parkin-mediated mitophagy. They show data indicating that OPTN, by interacting both with ubiquitin-coated mitochondria and with the autophagy machinery, provides a platform where OPTN-bound TBK1 can be hetero-autophosphorylated by adjacent TBK1. *

      *According to the prevailing model (prior to this manuscript), TBK1 activation via autophosphorylation leads to TBK1-mediated phosphorylation of OPTN S177 and subsequent pOPTN-mediated recruitment of autophagic isolation membranes to the mitochondria. However, based on the model provided in this manuscript, OPTN needs to interact first with both autophagic membranes and ubiquitin before TBK1 can become activated. *

      *This is an important topic. Overall, the experimental data are of high scientific quality. For the most part, the manuscript is clearly written. The figures have been made with great care. The novel insights are relevant. However, a number of issues need to be addressed or clarified. *

      *Major comments: *

      • Fig. 1a-b shows that pTBK1 (pS172) formation already peaks after 30 min of valinomycin. Even when bafilomycin is added, pTBK1 level already reaches a near maximum after 30 min of valinomycin. If the model proposed by the authors is correct and pTBK1 (pS172) formation requires extensive interaction of OPTN with both ubiquitin and autophagic isolation membranes, they should be able to show (by immunostaining) that OPTN already extensively forms peri-mitochondrial cup/sphere-shaped structures that colocalize with isolation membrane markers after only 30 min of valinomycin. In the present manuscript, they only show formation of such structures after 1-3 h of valinomycin.* We thank the reviewer for the critical comments. Based on the suggestion, we performed immunostaining to observe the recruitment of TBK1 and OPTN to damaged mitochondria as well as the generation of phos-TBK1 (pS172) and phos-OPTN (pS177). HeLa cells stably expressing Parkin and 3HA-WIPI1 were treated with valinomycin for 30 min, and then TBK1, OPTN, phos-TBK1, and phos-OPTN were immunostained along with 3HA-WIPI1 (a marker of the autophagosome formation site) and TOMM20 (a mitochondria marker). Please see supplementary Fig 2a and 3a in the revised manuscript. The TBK1, OPTN, phos-TBK1, and phos-OPTN signals formed dot-like, cup-shaped, and/or spherical structures, most of which were peri-mitochondrial and colocalized with 3HA-WIPI1. In separate experiments, HeLa cells stably expressing Parkin were treated with valinomycin in the presence or absence of bafilomycin for 30 min or 2 hrs and then immunostained. Please see supplementary Fig 2b in the revised manuscript. After 30 min valinomycin in the absence of bafilomycin, many TBK1 and OPTN signals were observed on damaged mitochondria. These signals were quantified from more than 160 cells for each of the four conditions. Each microscopic image generated contained 18-36 cells and corresponds to one dot in supplementary Fig 2c. Based on these results, the abundance of TBK1 and OPTN on mitochondria after 30 min of valinomycin was much higher than that after 2 hrs with valinomycin (supplementary Fig 2c). Similar results were obtained for phos-TBK1 and phos-OPTN (supplementary Fig 3b and c). These results are consistent with the immunoblot data (Fig1a and b).

      Furthermore, we show that Parkin expression levels affect the amount of phos-TBK1 generated during mitophagy. Please see supplementary Fig 4 in the revised manuscript. When PARKIN was integrated into HeLa cells under a CMV promoter via an AAVS1 (Adeno-associated virus integration site 1)-locus, the resultant cell line (referred to as high-Parkin) had higher Parkin levels than HeLa cells in which PARKIN was introduced by retrovirus infection (referred to as low-Parkin). In high-Parkin HeLa cells, phos-TBK1 levels reached a maximum after 30 min with valinomycin, while in low-Parkin HeLa cells, phos-TBK1 levels were comparable after 30 min and 1 hr. High-Parkin HeLa was used for Fig 1a, b, c, and d as well as supplementary Fig 1, 2, 3 and 4. For all other Figs, PARKIN genes were introduced by retrovirus infection. This is one of the reasons why val was used for 30 min in Fig1, but 1-3 hrs for the other Figs. Because 3 hrs valinomycin treatment may be unsuitable for evaluating OPTN recruitment to mitochondria/isolation membrane contact sites, we deleted the original Fig 2c and replaced it with the val 1 hr data (Please see Fig 2e in the revised manuscript).

      • The authors propose that OPTN needs to interact both with ubiquitin on mitochondria and with isolation membrane proteins such as ATG9A to allow TBK1 phosphorylation. However, their fluoppi experiments in Fig. 4 seem to contradict this. In the fluoppi experiments, the authors generate multimeric OPTN-Ub foci and this is apparently sufficient to induced TBK1 phosphorylation at S172 (shown in 4d,f). In this experiment, there is no induction of autophagy or formation of isolation membranes, and TBK1 nevertheless gets activated.*

      Figure 2 demonstrates that both ubiquitin on mitochondria and formation of the isolation membranes are needed to provide a platform for OPTN to assemble in close proximity to each other and subsequently induce TBK1 autophosphorylation. To determine if OPTN proximity is sufficient for TBK1 autophosphorylation (i.e., if engineered OPTN multimerization can bypass the autophagy machinery requirement for TBK1 autophosphorylation), we used the fluoppi assay. The results clearly showed that engineered OPTN multimerization induced TBK1 autophosphorylation without the need for the autophagy machinery. Although this is not a mitophagy experiment, the fluoppi assay provided crucial insights into the molecular mechanism underlying OPTN-mediated TBK1 autophosphorylation. The main text was rewritten to provide more clarity regarding the purpose of the fluoppi experiments.

      • Can the authors be more concrete/specific in the discussion about the molecular mechanisms that explain why this 'platform' that is created by OPTN-autophagy machinery interactions is so crucial for TBK1 activation? If I understand the model in Fig. 7D correctly, the OPTN-autophagy machinery interactions are mainly important because they reduce the distance between OPTN-bound TBK1 molecules so that they can trans-phosphorylate each other. But if TBK1 autophosphorylation was just a matter of proximity between OPTN-bound TBK1 molecules, interaction of OPTN with densely ubiquitinated mitochondria should already be sufficient for TBK1 phosphorylation. When multiple OPTN molecule bind to one ubiquitin chain or to closely adjacent ubiquitin chains (similar to the fluoppi experiments), TBK1 molecules binding to OPTN would be expected to be already closely enough to one another for trans-autophosphorylation.*

      The amount of phos-TBK1 during Parkin-mediated mitophagy was reduced in cells with the OPTN 4LA/F178A mutant, which cannot interact with the autophagy machinery (e.g. FIP200, ATG9A, and LC3) but can be targeted to mitochondria (see Fig 2c, d). ATG9AKO cells also had reduced amounts of phos-TBK1 relative to WT cells (See Fig 2j, k). Therefore, rather than OPTN-ubiquitin freely diffusing laterally on the outer membrane, we suggest that the contact site OPTN forms with ubiquitin and the autophagy machinery provides a more suitable platform for TBK1 autophosphorylation because it maintains TBK1 in a proximal position for a longer period of time.

      The OPTN UBAN domain binds a ubiquitin-chain composed of two ubiquitin molecules (Oikawa et al. 2016 Nat Comm), and during Parkin-mediated mitophagy only shorter length poly-ubiquitin chains are generated on the mitochondrial surface (Swatek et al. 2019 Nature). Based on those findings, it is unlikely that multiple OPTN bind to one ubiquitin chain. Of course, we cannot rule out the possibility that TBK1 autophosphorylation does not occur on mitochondria in the absence of autophagy components. While full activation of TBK1 requires OPTN to associate with the isolation membrane, initial TBK autophosphorylation at the onset of mitophagy may occur based only on the OPTN-ubiquitin interaction. These explanations have been added to the Discussion in the revised manuscript.

      Furthermore, based on comments from Reviewer 2, we performed time-lapse microscopy to observe OPTN dynamics during Parkin-mediated mitophagy (please see Fig 2l). HeLa cells stably expressing GFP-OPTN and pSu9-mCherry (a mitochondrial marker) were treated with valinomycin. GFP-OPTN was initially a peri- mitochondrial dot-like structure that elongated over time to a cup-shaped structure and which eventually ended up forming a spherical structure. The time-laps imaging showed that, at least in WT cells, OPTN is directly recruited to the contact sites and elongates along with the isolation membranes. We thus concluded that TBK1 is activated (autophosphorylated) at the contact site rather than on the outer membrane where OPTN-TBK can move freely.

      • Fig. 5c,d and P. 16: the mitophagy experiments in TBK1-/- cells expressing the different mutant forms of TBK1 are hard to interpret because it is not clear which mitophagy differences are statistically significant. The main text about this part (p. 16) is also confusing.*

      We regret the confusion. Reviewer 2 also noted that the main text for Fig 5 was difficult to interpret. One of the reasons that complicated interpretation of the data is the number of TBK1 mutants used. The L693Q and V700Q mutations used by Li et al. (2016 Nat Commun) were expected to inhibit mitophagy since those authors reported that the mutations prevented interactions with OPTN. However, our in-cell assay showed that the two mutants only moderately affected Parkin-mediated mitophagy. Furthermore, both L693Q and V700Q were engineered based on the X-ray structure and are not ALS pathogenic mutations. To simplify the data and to make data interpretation easier, we decided to delete the L693Q and V700A data. We also determined statistical significance and rewrote this section.

      • Many graphs lack statistics: Fig. 2b (pTBK1), Fig. 2f, Fig. 5b, Fig. 5d, Fig. 6c.*

      We apologize for the lack of statistical analyses. We repeated experiments (if the experiments had not been independently performed more than three times) with statistical significance and error bars incorporated into the relevant figures.

      *Other comments: *

      • Fig. 1a: how do they know that the upper OPTN band is ubiquitinated OPTN? Reviewer 2 raised the same question. To demonstrate that the upper OPTN band is ubiquitinated, cell lysates after mitophagy induction were incubated in vitro* with a recombinant USP2 core domain, and the samples immunoblotted. As shown in supplementary Fig 1 in the revised manuscript, the upper OPTN band disappeared in a USP2-dependent manner. The upper NDP52 and TOMM20 bands similarly disappeared. Therefore, the upper OPTN, NDP52 and TOMM20 bands observed after mitophagy induction are ubiquitinated.

      • Fig. 1a,b: the bafilomycin stabilization of pTBK1, OPTN and pOPTN indicates that these proteins are substantially degraded by autophagy within 30-60 minutes. This seems extremely fast for mitophagy completion. Please discuss.*

      According to Kulak et al. (2014 Nat Methods), autophagy adaptor abundance (OPTN: 2.32E+4 and NDP52: 3.34E+4 in HeLa cell line) is low compared to that of mitochondria (TOMM20: 1.45E+6 in HeLa cell line). This is one of the reasons why autophagic degradation of adaptors is easier to see. Degradation of phos-TBK1 was likewise easy to detect, whereas total TBK1 was not. This discrepancy is likely based on differences in the abundance of phos-TBK1 and total TBK1. In addition, because autophagy adaptors are localized outside of the mitochondrial membrane they may be easier targets for lysosomal degradation than matrix proteins, which are localized inside the outer and inner membranes.

      • Fig. 1a and rest of the manuscript: is there a reason why the authors only looked at S177 phosphorylation of OPTN and not also at OPTN S473, which is also phosphorylated by TBK1?*

      Both mass spectrometry and mutational analyses indicated that OPTN S473 is phosphorylated during Parkin-mediated mitophagy and that OPTN phosphorylated at S473 strongly binds ubiquitin chains (Richter et al. 2016 PNAS and Heo et al. 2015 Mol Cell). However, because a phos-S473 OPTN antibody is, to the best of our knowledge, currently not commercially available, we did not focus on S473 phosphorylation.

      • Fig. 1e-f: the main text states that "NDP52 KO effects on the pS172 signal were comparable to controls", but the blot in 1e and the graph in 1f indicate a difference between NDP52KO and WT (significant difference shown in 1f). This is confusing.*

      We regret the over-interpretation. As the reviewer indicated, the amount of phos-TBK generated in response to mitophagy was reduced in NDP52 KO cells relative to that in WT cells. This has been corrected. We would like to emphasize that, unlike OPTNdeletion, NDP52 deletion has relatively minor effects on TBK1 phosphorylation.

      • P. 9: "TBK1 phosphorylation however was not apparent in the OPTN mutant lines, even after 3 hrs with valinomycin, indicating that autophagy adaptors are essential for TBK1 activation (Fig. 2a)". However, the pTBK1 blot in Fig. 1a does show pTBK1 formation in the OPTN mutant (4LA etc.) lines. This is confusing.*

      We apologize for this error. We intended to state “TBK1 phosphorylation was not apparent in the Penta KO cells without OPTN expression even after 3 hrs with valinomycin, indicating that autophagy adaptors are essential for TBK1 activation”. This sentence has been corrected in the revised manuscript.

      • P. 10: "we subtracted the basal phosphorylation signal from that generated post-valinomycin (1 hr) and bafilomycin (3 hr)". Do they mean "from that generated post-valinomycin (3 hr) and bafilomycin (3 hr)?*

      The reviewer is correct, we have corrected the error.

      • P. 10, same paragraph: "the phosphorylation signal was ~90 but was less than 30 in ATG9A KO cells." Unclear what they mean by 90 and 30. 90% and 30%? 90-fold and 30-fold?*

      The newly generated pTBK1 levels following Parkin-mediated mitophagy were calculated as pTBK1 [val & baf 3 hrs] minus pTBK1 [DMSO]. Since pTBK1 [val & baf 3 hrs] in WT cells is set to 100%, the newly generated pTBK1 in WT cells was 100% - 5% = 95%. The calculated values for pTBK1 [DMSO] and pTBK1 [val & baf 3 hrs] in ATG9A KO cells were ~55% and ~85%, respectively. Consequently, newly generated pTBK1 in the ATG9A KO cells is ~85% - ~55% = 30%. For clarity, we modified the figure to make the meaning of the numbers more apparent.

      • Fig. 3a: Do they have an idea what kind of ubiquitinated substrates are contained in the ubiquitin-positive condensates that accumulate in FIP200 KO and ATG9A KO cells (i.e. without valinomycin treatment)?*

      According to Kishi-Itakura et al. (2014 J Cell Sci), ferritin accumulates in the p62 condensates in FIP200 KO and ATG9A KO cells. However, it is unknown if the ferritin in the condensates is ubiquitinated. In the original manuscript, we confirmed by immunostaining that the p62-NBR1 condensates contain ferritin (Fig 3a in the original manuscript and supplementary Fig 7b in the revised manuscript).

      • P. 12 and Fig. 3a: please explain why they look at ferritin, to improve readability.*

      We thank the reviewer for the suggestion. As mentioned, ferritin is a known substrate that accumulates in p62 condensates, we thus sought to confirm its presence. We have included this explanation in the revised manuscript.

      • Fig. 3a: please also include Ub stain for NBR1.*

      We thank the reviewer for the suggestion. We obtained a rabbit anti-NBR1 antibody that allowed us to co-immunostain with the mouse anti-ubiquitin antibody (please see supplementary Fig 7b in the revised manuscript).

      • Fig. 3d: the OPTN blot shows 2 OPTN bands. What does the upper OPTN band represent here?*

      To determine if the two bands are genuine OPTN, total cell lysates prepared from HeLa cells treated with control siRNA or OPTN siRNA were subjected to phos-tag PAGE followed by immunoblotting with an anti-OPTN antibody. As shown below (Figure 2 for reviewers), the two bands (indicated as blue arrowheads) were absent in the OPTN knock down cells, indicating that both are derived from OPTN. Since phosphorylated species migrate slower in phos-tag PAGE, the upper band might be a phosphorylated form. The specific Ser/Thr phosphorylated in OPTN, however, remains to be determined. Heo et al. (2015 Mol Cell) also reported the two OPTN bands on phos-tag PAGE and that both were unchanged in TBK1 KO cells, suggesting that at least the upper band is not affected by TBK1.

      • P. 14 and Fig. 4b: "Here, we found that phosphorylation of ... TBK1 (S172) was induced by the OPTN-ub fluoppi (Fig. 4b)." However, Fig 4b does not show a pTBK1 blot.*

      We immunoblotted phos-TBK1. Please see Fig 4b in the revised manuscript.

      *Reviewer #3 (Significance (Required)): *

      *The novel insights are relevant. *

      *According to the prevailing model (prior to this manuscript), TBK1 activation via autophosphorylation leads to TBK1-mediated phosphorylation of OPTN S177 and subsequent pOPTN-mediated recruitment of autophagic isolation membranes to the mitochondria. However, based on the model provided in this manuscript, OPTN needs to interact first with both autophagic membranes and ubiquitin before TBK1 can become activated. *

      Based on our time-lapse microscopy observations (Fig 2l), OPTN recruited to the vicinity of mitochondria was visible as a small dot-like structures that likely correspond to contact sites between mitochondria and the isolation membrane since OPTN colocalizes with WIPI1 (please see supplementary Fig 2). These results support our proposed model that OPTN interacts with both isolation membranes and ubiquitin at the onset of mitophagy. Without TBK1 activation, OPTN can interact with ATG9A vesicles, a seed for isolation membrane formation (Yamano et al 2020 JCB), and TBK1 can interact with the PI3K complex (Nguyen et al 2023 Mol Cell). Therefore, OPTN-TBK1 can be recruited to the contact site from the very beginning of mitophagy induction prior to TBK1 being fully activated. Furthermore, the proposed model also includes an OPTN-TBK1 positive feedback loop; however, the earliest reactions in the positive feedback loop are too difficult to observe. For example, it’s widely known that PINK1 and Parkin form a positive feedback loop to generate ubiquitin-chains on damaged mitochondria, but the initial reaction has yet to be observed. It remains unclear if PINK1 is the first to phosphorylate mitochondrial ubiquitin (if this is the case, it remains unknown how ubiquitin comes to mitochondria) or if cytosolic Parkin first adds ubiquitin to the outer membrane albeit with very weak activity. Similarly, in our proposed model, we cannot determine the earliest OPTN-TBK1 reaction. As described in the Discussion in the revised manuscript, it remains possible that in the absence of autophagy machinery OPTN distributed freely on the outer membrane can induce trans-autophosphorylation, albeit weakly, as the earliest reaction.

      We would like to thank Reviewer 3 for the critical comments and suggestions. We have performed several of the suggested experiments, added new data, and rewritten the text. We hope that these changes have sufficiently addressed the reviewer’s concerns.

    1. Author Response

      The following is the authors’ response to the original reviews.

      The authors thank the reviewers for their thoughtful and constructive comments. We address each comment below and have uploaded a revised manuscript.

      Public Reviews

      1) One key point that could use further clarification is how to interpret densities in the reconstruction that do overlap with the template. If the omitted regions can be reliably reconstructed, and the density is smooth throughout, it implies the detected particles are not only (mostly) true positives but also their poses must be essentially correct. Therefore, why cannot the entire reconstruction be trusted, including portions overlapping with the template? In the "Future applications" section, the authors state that in order to obtain a reconstruction that is entirely devoid of template bias, it would be necessary to successively omit parts of the template structure through its entirety. I wonder if that is really necessary and if the presented approach of omitting template portions could be better framed as a "gold-standard" validation procedure.

      Our assumption is indeed that the entire reconstruction can be trusted if the omitted features are faithfully reproduced in the reconstruction. We have added a sentence in the discussion to clarify this. However, we think that assessing template bias will still require the omit test (see also our reply below). Also, as discussed in the manuscript, there is likely a little bias left, even if it is not directly visible in the reconstruction. Therefore, if the goal is an entirely unbiased reconstruction, the only way will be to successively omit parts of the template structure throughout the template.

      2) In other words, given the compelling evidence provided by the reconstructions in the omitted areas, I find it hard to imagine how the procedure would be "hallucinating" features in the rest of the structure, as the entire reconstruction depends on the same pose and defocus parameters. A possible experiment to test this hypothesis would be to go the opposite way, deliberately adding an unrealistic feature to the bait and checking whether it comes up in the reconstruction, while at the same time checking how it behaves in omitted parts.

      Template bias might be generated in different ways. A common situation is the presence of noise, which causes biased deviations of the best template match from their “true” match that would just align the target signal to the template. Another type of bias may occur when there is a mismatch between the template and the detected target. The target may still be detected if there is sufficient structural overlap with the template. Since there might not be a clear “correct” alignment of a mismatching target to the template, the best alignment may again be biased, generating artificial density in the reconstruction. This second case may produce bias that is more pronounced in the mismatching regions. The different origins of bias will have to be investigated more thoroughly in another study. For the present study, however, we maintain that unless there is some assessment of bias in a given location, one cannot completely rule out bias based on the absence of it elsewhere in the reconstruction.

      3) When assessing their approach to in situ data (the yeast ribosome), it is intriguing to see that the resolution downgraded from 3.1 to 8 Å when refinement of the particle poses against the current reconstruction was attempted. The authors do provide some possible explanations, such as the reduced signal of the reconstruction at high resolution and the crowded background, but it leaves one to wonder if this means that a 3.1 Å reconstruction could never be obtained from these data by conventional single-particle analysis procedures.

      The refinement results with our in situ data do indeed appear to be limited to low resolution when using the conventional single-particle pipeline and software. It might be possible to improve refinement by introducing certain priors, filters and masking functions that are optimized for the increased background and spectral properties of in situ data. Also, we have not tested all available software, and some might perform better than others. It is worth noting that in a different study using our data, by Cheng et al (2023) and cited in our manuscript, the resolution of the refined reconstruction using different software was ~7 Å resolution, i.e., close to what we report here. Finally, refinement of the detected targets against a high-resolution template does work but since it involved the template, we regard this as part of the template matching process.

      4) Furthermore, in the section "Quantifying template bias", the authors make the intriguing statement that there can still be some overfitting of noise even in true positives. I understand this overfitting would occur in the form of errors in the pose and defocus estimation, but a clarification would be helpful.

      We have added a sentence in the Discussion to clarify where this bias may come from.

      5) In the Discussion, the claim that "it is not necessary to use tomography to generate high-resolution reconstructions of macromolecular complexes in cells" is a misconception, at least in part. As demonstrated in works by the same group and others (https://doi.org/10.1016/j.xinn.2021.100166, https://doi.org/10.1038/s41467-023-36175-y, https://doi.org/10.1038/s41586-023-05831-0), 2D imaging of native cellular environments does offer a faster and better way to obtain high-resolution reconstructions compared to tomography. However, tomography provides the entire 3D context of the macromolecules, such as their localization to membranes and the cellular architecture, which can be readily visualized in a tomogram even at low resolution, so methods for structure determination from tilt series data such as subtomogram averaging remain of paramount importance. Most likely, a combination of 2D and 3D imaging approaches will be necessary to retrieve both the highest structural resolution and their cellular context to address biological questions.

      We agree and have modified our statement accordingly.

      6) The "Materials and Methods" section lacks a description of transmission electron microscopy data collection.

      We are sorry for this oversight and have added these details.

      7) Finally, the preprint version of this work posted on bioRxiv (https://doi.org/10.1101/2023.07.03.547552) contains the following competing interests statement, which is missing from the submitted version: "The authors are listed as inventors on a closely related patent application named "Methods and Systems for Imaging Interactions Between Particles and Fragments", filed on behalf of the University of Massachusetts."

      This is correct. The statement was missing in the first version of the uploaded manuscript and was added after consultation with the eLife editorial office.

      8) Quantification of the amount of model bias is then performed using omit maps, where every 20th residue is removed from the template and corresponding reconstructions are compared (for those residues) with the full-template reconstructions. As expected, model bias increases with lower thresholds for the picking. Some model bias (Omega=8%) remains even for very high thresholds. The authors state this may be due to overfitting of noise when template-matching true particles, instead of introducing false positives. Probably, that still represents some sort of problem. Especially because the authors then go on to show that their expectation of the number of false positives does not always match the correct number of false positives, probably due to inaccuracies in the noise model for more complicated images. This may warrant further in-depth discussion in a revised manuscript.

      We have added further thoughts regarding the mismatch between expected and actual number of false positives in the Discussion section. A full understanding of the issue likely requires further study, which is currently underway.

      9) The authors evaluate the effect of high-resolution 2D template matching on template bias in reconstructions, and provide a quantitative metric for overfitting. It is an interesting manuscript that made me reevaluate and correct some mistakes in my understanding of overfitting and template bias, and I'm sure it will be of great use to others in the field. However, its main point is to promote high-resolution 2D template matching (2DTM) as a more universal analysis method for in vitro and, more importantly, in situ data. While the experiments performed to that end are sound and well-executed in principle, I fail to make that specific conclusion from their results.

      We do not see 2DTM as a more universal analysis method for in vitro and in situ data, but as simply as another method that can be used. We have added a sentence in the introduction to clarify this.

      10) The authors correctly point out that overfitting is largely enabled by the presence of false-positives in the data set. They go on to perform their in situ experiments with ribosomes, which provide an extremely favorable amount of signal that is unrealistic for the vast majority of the proteome. This seems cherry-picked to keep the number of false-positives and false-negatives low. The relationship between overfitting/false-positive rate and the picking threshold will remain the same for smaller proteins (which is a very useful piece of knowledge from this study). However, the false-negative rate will increase a lot compared to ribosomes if the same high picking threshold is maintained. This will limit the applicability of 2DTM, especially for less-abundant proteins.

      The reviewer is correct that the lower SNR of smaller targets poses a fundamental limit to 2DTM. We have stated this in previous studies and have added a sentence in the introduction of the current manuscript to clarify this.

      11) I would like to see an ablation study: Take significantly smaller segments of the ribosome (for which the authors already have particle positions from full-template matching, which are reasonably close to the ground-truth), e.g. 50 kDa, 100 kDa, 200 kDa etc., and calculate the false-negative rate for the same picking threshold. If the resulting number of particles does plummet, it would be very helpful to discuss how that affects the utility of 2DTM for non-ribosomes in situ.

      The suggested ablation study is a good idea and was reported by Rickgauer et al (2020), cited in our manuscript. We added our own analysis for this dataset in Figure 4-figure supplement 1 and show the proportion of LSUs detected as a function of template mass, indicating detection limit of ~300 kDa. We also added a note in the Results section to explain that the threshold we use to limit false positives means that there are also false negatives, with a rate that depends on their molecular mass.

      12) Another point of concern is the dramatic resolution decrease to 8 A after multiple iterations of refinement against experimental reconstructions described in line 159. Was this a local search from the poses provided by 2DTM, or something more global? While this is not a manifestation of overfitting as the authors have conclusively shown, I think it adds an important point to the ongoing "But do we really need tomograms, or can we just 2D everything?" debate in the field, which is also central to the 2D part of 2DTM. Reaching 8 A with 12k ribosome particles would be considered a rather poor subtomogram averaging result these days. Being in the "we need tilt series to be less affected by non-Gaussian noise" camp myself, I wonder if this indicates 2D images are inherently worse for in situ samples. If they are, the same limitations would extend to template matching. In that case, shouldn't the authors advocate for 3DTM instead of 2DTM? It may not be needed for ribosomes, but could give smaller proteins the necessary edge.

      We have extensively discussed the advantages and disadvantages of both tomography and 2DTM (Lucas et al, 2021) and think it is not useful to talk in terms of “better” and “worse”. Instead, each technique has its areas of application, and we maintain that a combination of the two may give the best results. The limitation of 8 Å does not apply to reconstructions aligned against high-resolution templates, as demonstrated in the present study. Regarding noise models, there is also need for these in 3DTM, as explained in recent publications: Maurer et al (2023), bioRxiv, doi.org/10.1101/2023.09.06.556487; Cruz-León et al (2023), bioRxiv, doi.org/10.1101/2023.09.05.556310; Chaillet et al (2023), Int. J. Mol. Sci. 24, 13375.

      13) Right now, this study is also an invitation to practitioners who do not understand the picking threshold used here and cannot relate it to other template-matching programs to do a lot of questionable template matching and claim that the results are true because templates are "unoverfittable". I think such undesirable consequences should be discussed prominently.

      We have added a discussion of this point in the Discussion section.

      Recommendations for the authors

      1) Lines 58-59: What does "nominally untilted" mean? Has the lamella pre-tilt (milling angle) been taken into account or not? If yes, how?

      The lamella milling angle was not taken into account, so there is a tilt built into the sample of about 8° that was not compensated for by a counter-tilt of the microscope goniometer. We have added a note to explain this in the text of the manuscript.

      2) Lines 113-114: A brief explanation of the threshold calculation method from Rickgauer et al, 2017 to achieve an expected false positive rate of one per micrograph would be helpful here.

      We describe the equation for estimating the false discovery rate later in the manuscript. We have added a note in the text to point the reader to the relevant section of the manuscript.

      3) For consistency, it would be interesting to include a plot of the SNR peaks found by 2DTM in the in situ dataset, that could be directly compared to Figure 1 - figure supplement 1B.

      We have added this to Figure 2 - figure supplement 1A-C, to directly compare to Figure 1 – figure supplement 1A-C.

      4) Showing model-map FSC curves between the density retrieved from the omitted areas and their respective models would provide further evidence not only that they are correct but to what extent.

      An FSC calculation would be challenging for small regions, such as side chains and drugs, due to masking artifacts. Moreover, the model was built into an in vitro determined map and was not fit into the in vivo map calculated here. Therefore, deviations between the map and model may reflect differences between the two conditions and may not reflect the agreement of the map to the in vivo structure.

      5) Lines 128-130: The figure references are wrong. Here, Figure 1B should probably be Figure 1A (or 1B), and Figure 1C clearly refers to Supplementary Figure 1F (FSC curve).

      We have corrected the incorrect figure references.

      6) Line 125: Wrong figure reference, Figure 1A here refers to Supplementary Figure 1B (cross-correlation peaks).

      We have corrected the incorrect figure references.

      7) I haven't been able to find mention of code availability in the manuscript. Given that it is a major outcome of the study, I think it should be provided.

      The code is available from the cisTEM repository, github.com/timothygrant80/cisTEM, and an executable version of the program measure_template_bias has been posted for download on the cisTEM webpage, cistem.org. We have added a note in the Methods section to point the readers to these resources.

      8) Line 50: "An additional complication of subtomogram averaging for in situ imaging is the selection of valid targets" - This is not specific to subtomogram averaging, but to in situ samples.

      We agree and have updated the text to reflect this.

      9) Line 77: "if this is true for high-resolution features, which are more susceptible to noise overfitting" - This is not intuitive to me. High-resolution features require more information to be overfitted with a constant set of model parameters, thus making their overfitting harder.

      The reviewer is correct that there is more information at high resolution, partially compensating for the low SNR. However, the overall refinement behavior is still dominated by overfitting at high resolution, as we have demonstrated in an earlier publication in Stewart & Grigorieff (2004), Ultramicroscopy 102, 67–84.

      10) Line 316: "Baited reconstruction is substantially faster and a more streamlined" - To back this and other similar statements, it would be helpful if the authors provided some time measurements for the execution of their potentially very computationally expensive search.

      The current implementation of 2DTM requires 45 GPU hours per template per K3 image to search 13 defocus planes. However, for a comparison, the manual work for annotation, as well as additional processing to align and classify sub-tomograms to generate high resolution averages should also be considered in this comparison. These are highly project-dependent and can exceed the time required for 3DTM manifold. We have clarified this in our Discussion section.

      11) Line 319: "We expect focused classification to identify sub-populations to further improve the resolution" - How would this work if refining the 2D data without a high-resolution template resulted in significantly worse resolution even for a ribosome? Or is this meant to be done with prior knowledge of every state?

      Classification can be done using existing single particle software. To avoid alignment errors, as described above, particle alignment angles and shifts are fixed during classification. This leaves only the particle occupancy per class to be refined, which appears to lead to good classification. We have added a brief note to explain this strategy. However, since this is not shown in this manuscript, we have not added a more extensive discussion of particle classification.

      12) Line 354: "without requiring manual intervention or expert knowledge" - Previous expert knowledge was arguably provided in the form of a high-resolution structure.

      We agree with the reviewer and have clarified our statement.

    1. I don’t want to be trapped in cycles of connection and disconnection, deleting my social media profiles for weeks at a time, feeling calmer but isolated, re-downloading them, feeling worse but connected again.

      I think this is an interesting point she states as it's a viewpoint I've upheld before. Viewing social media vs the real world in a black and white matter may do more harm than good as in today's world not going on social media is the equivalent of social isolation. Yet having to go on social media and scrolling aimlessly and endlessly will also overstimulate and lead to negative emotions. Rather than either hopping on or off for extended periods of time, I think regulation is key, both with the way in which we scroll and how much.

    2. Some researchers have found that people using social media may enter a dissociation state, where they lose track of time (like what happens when someone is reading a good book).

      It is true and I have similar experience. When I spent time, browsing the social media platforms, the time is extremely "faster" as I imagine. It is also the reason why some people spend "their whole life" on internet. I think to reasonably balance our leisure time and work/study, we should set the time for entertaining at first and stop to study/work at that settled time.

    1. Author Response

      Reviewer #1:

      We thank Reviewer #1 for their review of our manuscript.

      Reviewer #1, comment #1: “The authors of this manuscript are from the Canadian, public interest open-science company YCharos.”.

      It is important to state that none of the authors work for YCharOS. The YCharOS company has created an open ecosystem consisting of antibody manufacturers, knockout cell lines providers, academics, granting agencies and publishers. The Antibody Characterization Group (participating authors are affiliated to the Department of Neurology and Neurosurgery, Structural Genomics Consortium, The Montreal Neurological Institute, McGill University) works in collaboration with YCharOS to have access to commercial antibodies and knockout cell lines donated by YCharOS’ manufacturer partners.

      Reviewer #1, comment #2: In regard to ZENODO antibody characterization reports prepared by this group, Reviewer #1 wrote: “While the results are convincing, they could be more accessible. In the current format, researchers have to download reports for each target and look through all images to identify the most useful antibodies from the images. The reports I reviewed did not draw conclusions on performance. A searchable database that returns validated antibodies for each application seems necessary.”

      After careful consideration and consultation with YCharOS industry partners, we decided not to rate the performance of the antibodies tested. It was determined that antibody selection is best left to the user, who should analyze all parameters, including the type of antibody to be chosen (recombinant-monoclonal, recombinant-polyclonal, monoclonal), the species used to generate the antibody, the species predicted to react with the antibody, performance in a specific application, antigen sequences, and antibody cost.

      Reviewer #1, comment #3: “A key question is to what extent off-target binding was predictable from the WBs provided by the manufacturers. Thus, how often did the authors find multiple bands when the catalogue image showed a single band and vice versa?”

      In many cases, the antibodies were tested on cell lines other than those used by the manufacturers. Given that protein expression is specific to each line, we can't answer this question properly.

      Reviewer #1, comment #4: “Cross-reactive proteins will generally not be detected when blots are stained with an antibody reactive with a different epitope than the one used for IP. Possible solutions to overcome this limitation such as the use of mass spectrometry as readout should be discussed (Nature Methods volume 12, pages 725- 731 (2015)”.

      Our protocols only inform whether an antibody can capture the intended target, without any evaluation of the extend to the capture of unwanted, cross-reactive proteins. Thus, our data can only be used to aid in selection of the best performing antibodies for IP – our data does not inform profiling of non-specific interactions.

      IP/mass spec is an excellent approach for evaluating antibody performance for IP, and authors on this manuscript are experts in proteomics and recognize the importance of this methodology. We have considered implementing IP/mass in our platform. However, there are limitations, such as the cost of the approach and the difficulty of detecting smaller proteins or proteins with a certain amino acid composition (high presence of Cys, Arg or Lys). Fundamentally, we have decided to focus on throughput relative to details in this regard.

      Reviewer #1, comment #5: “Performance in immunofluorescence microscopy was performed on cells that were fixed in 4% paraformaldehyde and then permeabilized with 0.1% Triton-X100. It seems reasonable to assume that this treatment mainly yields folded proteins wherein some epitopes are masked due to cross-linking. The expectation is therefore that results from IP are more predictive for on-target binding in IF than are WB results (Nature Methods volume 12, pages725-731 (2015). It is therefore surprising that IP and WB were found to have similar predictive value for performance in IF (supplemental Fig. 3). It would be useful to know if failure in IF was defined as lack of signal, lack of specificity (i.e. off-target binding) or both. Again, it is important to note the IP/western protocol used here does not test for specificity.”

      The assessment of antibody performance is biased by how antibodies were originally tested by suppliers. Manufacturers primarily validate their antibody by WB. Thus, most antibodies immunodetect their intended target for WB. Thus, in retrospect, we tested a biased pool of antibodies that detect linear epitopes. Still, we observed that a large cohort of antibodies show specificity for their target across all three applications or for specific combinations of applications. This slightly challenges the idea that antibodies are fit-for-purpose reagents and can recognize either linear or native epitopes - a significant number of antibodies can specifically detect both types of epitope.

      Reviewer #1, comment #6: “The authors report that recombinant antibodies perform better than standard monoclonals/mAbs or polyclonal antibodies. Again, a key question is to what extent this was predictable from the validation data provided by the manufacturers. It seems possible that the recombinant antibodies submitted by the manufacturers had undergone more extensive validation than standard mAbs and polyclonals”.

      Our antibody manufacturing partners indicated that the recombinant antibodies are more recent products and have been more extensively characterized relative to standard polyclonal or monoclonal antibodies.

      The main message is that recombinant antibodies can be used in all applications once validated. Although recombinant antibodies are available for many proteins, the scientific community is not adopting these renewable regents as we believe it should. We hope that the data provided will encourage scientists to adopt recombinant technologies when available to improve research reproducibility.

      Reviewer #1, comment #7: “Overall, the manuscript describes a landmark effort for systematic validation of research antibodies. The results are of great importance for the very large number of researchers who use antibodies in their research. The main limitations are the high cost and low throughput. While thorough testing of 614 antibodies is impressive and important, the feasibility of testing hundreds of thousands of antibodies on the market should be discussed in more detail.”

      We thank the reviewer for this comment. One of our challenges is to increase the platform's throughput to succeed in our mission to characterize antibodies for all human gene products. We will continue to test antibodies using protocols agreed upon with our partners, commonly used in the laboratory, to ensure that ZENODO reports can serve as a guide to the wider community.

      In terms of development our marketing efforts have been substantially accelerated by our new partnership with the journal F1000. We have begun to convert our reports into peer-reviewed papers (20 ZENODO reports were converted into F1000 articles). This conversion allows researchers to find our work via PubMed, and easily cite any study. Producing peer-reviewed articles also further enhances the credibility of our research and our project as a whole: https://f1000research.com/ycharos

      Colleagues have published a letter to Nature explaining the problem and our technology platform: (Kahn, et al., Nature, 2023, DOI: https://doi.org/10.1038/d41586-023-02566-w).

      This project has been presented worldwide, with a presence at major antibody conferences, such as the annual Antibody Validation meeting in Bath (PSM attended the meeting in September 2023). The authors are organizing a sponsored mini-symposium on antibody validation at the next American Society for Cell Biology (ASCB) meeting in December 2023 (Boston, USA): https://plan.core- apps.com/ascbembo2023/event/6fb928f06b0d672e088c6fa88e4d77fb

      Colleagues have prepared petitions addressed to various governmental organizations (US, Canada, UK) to support characterization and validation of renewable antibodies: https://www.thesgc.org/news/support- characterization-and-validation-renewable-antibodies.

      Reviewer #2

      We thank Reviewer #2 for the review of the antibody characterization reports we have uploaded to ZENODO. A manuscript describing the full standard operating procedures of the platform, which has been used in all reports is in preparation, and should be available on a preprint server before the end of the year. Our protocols were reviewed and approved by each of YCharOS' manufacturer partners. Moreover, a recent editorial describes the platform used here and gives advice on how to interpret the data: https://doi.org/10.12688/f1000research.141719.1)

      Reviewer #2, comment #1: “A discussion of how the working concentrations of antibodies are selected and validated is required. Based on the dilutions described in the reports, it seems that dilutions suggested by the manufacturer were used - For LRRK2 it seems that antibody concentrations ranging from 0.06 to over 5 µg/ml for WB were used. Often commercial antibody comes in a BSA-containing buffer making it hard to validate the concentration of the antibody claimed by the manufacturer”.

      The concentration recommended by the manufacturer is our starting point. For WB, when the signal is at the level of detectability, we will repeat with a ~5-10 fold increase in antibody concentration. For >80% of the antibody tested, the use of the recommended concentration led to the detection of bands (specific or not to the target protein).

      Reviewer #2, comment #2: “In the authors' experience are the manufacturer's concentrations reliable? Additionally, if the information regarding applications provided by the manufacturers is unreliable how do the authors suggest working concentrations for antibodies to be assessed”?

      We do not evaluate the concentration of antibodies internally. In the immunoprecipitation experiments, we use 2.0 µg of antibody for each IP, based on the concentration provided by the manufacturers. On Ponceau staining of membranes, we can observe the heavy and light chains of the primary antibodies used, giving an indication of the amount of antibodies added to the cell lysate. In most cases, the intensity of the heavy and light chains is comparable.

      Reviewer #2, comment #3: “We understand that it would not be feasible to test every antibody at different concentrations, but this is an issue that should at least be mentioned. An antibody might be put in the wrong performance category solely because of the wrong concentration being used. Ie if an excellent antibody is used at too high a concentration, it may detect non-specific proteins that are not seen at lower dilutions where the antibody still picks up the desired antigen well”.

      We agree with Reviewer #2, we do not use an optimal concentration for all tested antibodies. As mentioned previously, the concentration recommended by the manufacturer is our starting point. By testing multiple antibodies side-by-side against a single target protein, we can generally identify one or more specific and selective antibodies. We leave it to users of our reports to optimize the antibody concentration to suit their experimental needs.

      Reviewer #2, comment #4: “Do the authors check different WB conditions ie 2h primary antibody with BSA or milk vs. overnight at 4 degrees with BSA or Milk”?

      All primary antibodies are always tested in milk overnight at 4 degrees. The overnight incubation is convenient in the timeline of the protocol. All protocols were agreed upon after careful consultation with our partners.

      Reviewer #2, comment #5: “Do the authors provide detailed WB protocols that include the description of the electrophoresis and type of gels used, transfer buffer and transfer method and time used, and conditions for all the primary and secondary blotting including times, buffers and dilutions of all antibodies and other reagents”?

      This information is included in all ZENODO reports.

      Reviewer #2, comment #6: “Do the authors discuss detection approaches- we have noticed for some antibodies there are significant different results using LICOR, ECL and other detection methods, with certain especially weaker antibodies preferring ECL-based methods”.

      We only use ECL-based methods.

      Reviewer #2, comment #7: “For IPs the amount of antibody needed can also vary-for some we can use 1 microgram or less, but for others, we need 5 to 10 micrograms. The amount of antibody needed to get maximal IP should be stated”.

      We use 2.0 ug of antibodies and we have found this to be adequate for lower abundance proteins (e.g. Parkin - https://zenodo.org/records/5747356) and higher abundance proteins (e.g. PRDX6 - https://zenodo.org/records/4730953). Abundance is based on PaxDb.com. For Parkin and PRDX6, we were able to enrich the expected target in the IP and observe depletion in the unbound fraction. Optimization of the IP conditions is left to the antibody users.

      Reviewer #2, comment #8: “Doing IPs with commercial antibodies can be very expensive or infeasible if many micrograms are needed especially if only packages of 10 micrograms for several hundred dollars are provided”.

      This is a major advantage of the side-by-side comparison: the reader is free to choose between high-performance antibodies from different manufacturers, with varying antibody costs. We also work in partnership with the Developmental Studies Hybridoma Band (DSHB), which supplies antibodies on a cost recovery basis.

      Reviewer #2, comment #9: “For IPs it is important to determine the percentage of antigen that is depleted from the supernatant for each IP. We think that this should be calculated and recorded in the Zenodo data. Some antibodies will only IP 10% of antigen whereas others may do 50% and others 80-90%. One rarely sees 100% depletion. For IPs the buffer detergent and salt concentration might also strongly influence the degree of IP and therefore these should be clearly stated”.

      In Box 1, we define criteria of success. For IP, “under the conditions used, a successful primary antibody immunocaptures the target protein to at least 10% of the starting material”. Colleagues have written an editorial on how to interpret and analyze antibody performance https://f1000research.com/articles/12-1344).

      The cell lysis buffer is a critical reagent when considering IP experiments. We use a commercial buffer consisting of 25 mM Tris-HCl pH 7.4, 150 mM NaCl, 1 mM EDTA, 1% NP-40 and 5% glycerol (Thermo Fisher, cat. #87787). This buffer is efficient to extract the target proteins we have studied thus far.

      Reviewer #2, comment #10: “Whether antibodies cross-react with human, mouse and other species of antigens is always a major question. It is always good to test human and mouse cell lines if possible. If antibodies cross-react in WB, in the authors' experience will they also cross-react for IF and IP”?

      The authors started this initiative by focusing on the 20,000 human proteins, defining an end point. We and our collaborators found that most of the cherry-picked selective antibodies for WB for human proteins, which manufacturers claim react with the murine version of the target proteins, were selective for murine tissue lysates.

      Indeed, poorly performing antibodies in WB mostly failed IF and IP. However, selective antibodies for IF or specific for IP were generally (>90%) selective for WB.

      Reviewer #2, comment #11: “Cell lines express proteins at vastly different levels and it is possible that the selected cell line does not express the antigen or expresses it at very low levels - this could be a reason for wrongly assessing an antibody not working. It would be useful to use cell lines in which MS data has defined the copy number of protein per cell and this figure could be included in the antibody data if available. This MS data is available for the vast majority of commonly used cells”.

      We agree with Reviewer #2 that MS data are useful for target protein selection. At the moment, our approach using transcriptomic data provided on DepMap.org proved to be a successful mechanism for cell line selection. We have identified a specific antibody for WB for each target, enabling the validation of expression in the cell line selected.

      For some protein targets, the parental line corresponding to the only commercial or academic knockout line available has weak protein expression. We thus needed to generate a KO clone in a second cell line background with high expression, and indeed found that some antibodies which failed in the first commercial line were successful in the new higher-expressing line (e.g CHCHD10 - https://zenodo.org/records/5259992).

      Reviewer #2, comment #12: “Some proteins are glycosylated, ubiquitylated or degraded rapidly making them hard to see in WB analysis”.

      We used the full gel/membrane length when analyzing antibody performance by WB. Indeed, proteins can show different isoforms and molecular weights compared to that based on amino acid sequence (e.g. SLC19A1 -https://zenodo.org/records/7324605).

      Reviewer #2, comment # 13: “We have occasionally had proteins that appear unstable when heated with SDS- sample buffer before WB. For these, we still use SDS-Sample buffer but omit the heating step. I often wonder how necessary the heating step is”.

      For WB, samples are heated to 65 degrees, then spun to remove any precipitate.

      Reviewer #2, comment # 14: “For IF the methods by which cells are fixed and stained, and the microscope and settings, can significantly influence the final result. It would be important to carefully record all the methods and the microscope used”.

      We agree with Reviewer #2 that many parameters influence antibody performance for imaging purposes. We are progressively implementing the OMERO software to monitor any experimental parameters and information (metadata) about the microscope itself.

      Reviewer #2, comment # 15: “How do the authors recommend antibodies are stored? These should be very stable, but I have had reports from the lab that some antibodies become less good when stored and others that recommend storing at 4 degrees”.

      Antibodies are aliquoted to avoid freeze-thaw cycles and stored at -20 degrees. If it is recommended to store antibodies at 4 degrees, we add glycerol to a final concentration of 50% and store them at -20 degrees.

      Reviewer #2, comment # 16: “Would other researchers not part of the authors' team, be able to add their own data to this database validating or de-validating antibodies? This would rapidly increase the number of antibodies for which useful data would be available for. It would be nice to greatly expand the number of antibodies being used in research and this is not feasible for a single team to undertake”.

      Yes! We believe that only a community effort can resolve the antibody liability crisis. We partner with the Antibody Registry (antibodyregistry.org - led by co-author Anita Bandrowski). In the Registry, each antibody is labelled with a unique identifier, and third-party validation information can be easily tagged to any antibody. Antibody users are invited to upload information about an antibody they have characterized into the Registry.

    1. Author Response

      The following is the authors’ response to the original reviews.

      We were pleased with seeing our work published as a Reviewed Preprint online so swiftly. Now, we would like to take the opportunity to include our responses to the comments made by the reviewers into the Reviewed Preprint and also submit a revised version of the manuscript, in which we have incorporated and addressed the reviewers’ comments.

      We believe that our revisions have significantly improved the quality of the manuscript. Specifically, we have described our results more precisely and explained certain decisions that were made in the analysis pipeline more clearly. For example, Figure 4 was improved substantially, by incorporating a schematic representation of how ERP traces were extracted from neural data. Furthermore, we have added three paragraphs in the Discussion where we elaborate on 1) the two observed interaction effects between attention and drug condition, 2) the relation between behavioral, computational, and neural effects, and 3) the statistical robustness of our findings. As such, we believe our interpretation of the results and their robustness now more faithfully represents our observations.

      Moreover, we have incorporated the Supplementary Information and Figures, initially presented as a separate section of the manuscript, to the main manuscript and its accompanying supplementary figures. Thereby, the structure of the paper now better follows the eLife format. As a result, some of the previously included supplementary figures are now described in text of the main manuscript.

      Reviewer #1 comments:

      In the results section on page 6, the authors conclude that "Attention and ATX both enhanced the rate of evidence accumulation towards a decision threshold, whereas cholinergic effects were negligible." I believe "negligible" is wrong here: the corresponding effects of donepezil had p-values of .09 (effect of donepezil on drift rate), .07 (effect of donepezil on the cue validity effect on drift rate) and .09 (effect of donepezil on non-decision time), and were all in the same direction as the effects of atomoxetine, and would presumably have been significant with a somewhat larger sample size. I would say the effects of donepezil were "in the same direction but less robust" (or at the very least "less robust") instead of "negligible".

      We agree with the reviewer that ‘negligible’ may not properly capture the effects of DNP on DDM parameter estimates. Although we do feel that caution is warranted in interpreting the effects of DNP on computational parameter estimates, we have now described these effects in line with the reviewer’s suggestion: in the same direction as the effects of ATX, but not (or less) statistically robust.

      "In the results section on page 8, the authors conclude that "Summarizing, we show that drug condition and cue validity both affect the CPP, but they do so by affecting different features of this component (i.e. peak amplitude and slope, respectively)." This conclusion is a bit problematic for two reasons. First, drug condition had a significant effect not only on peak amplitude but also on slope. Second, cue validity had a significant effect not only on slope but also on peak amplitude. It may well be that some effects were more significant than others, but I think this does not warrant the authors' conclusion.

      Indeed, we observed that cue validity affected both CPP peak amplitude and slope and some effects were more significant than others. As such, we agree with the reviewer that the conclusion that cue validity and drug condition affect different features of the CPP was too strongly formulated. We have changed this statement in the manuscript to reflect the observed data pattern more appropriately. We would however like to point out that this does not undermine our main conclusion. Spatial attention and drug condition showed only limited interaction effects in terms of behavior and neural data and their effects on occipital activity were separable in terms of timing and spatial profile. Therefore, our conclusion that catecholamines and spatial attention jointly shape perceptual decision-making remains valid.

      In the discussion section on page 11, the authors conclude that "First, although both attention and catecholaminergic enhancement affected centro-parietal decision signals in the EEG related to evidence accumulation (O'Connell et al., 2012; Twomey et al., 2015), attention mainly affected the build-up rate (slope) whereas ATX increased the amplitude of the CPP component (Figure 3D-F)." As I wrote above, I believe it is not correct that "attention mainly affected the build-up rate or slope", given that the effect of cue-validity on CPP slope was also significant. Also, while the authors' data do support the conclusion that ATX increased the amplitude and not the slope of the CPP component, a previous study in humans found the opposite: ATX increased the slope but did not affect the peak amplitude of the CPP (Loughnane et al 2019, JoCN, https://pubmed.ncbi.nlm.nih.gov/30883291). Although the authors cite this study (as from 2018 instead of 2019), they do not draw attention to this important discrepancy between the two studies. I encourage the authors to dedicate some discussion to these conflicting findings.

      We thank the reviewer for spotting this error, we cited the preprint version (from 2018) of Loughnane and colleagues and not the published JoCN paper (from 2019). We have changed this in the updated version of the manuscript. We further thank the reviewer for asking about this interesting discrepancy between our observation that ATX increased CPP peak amplitude in absence of slope effects and the observation by Loughnane et al. (2019, JoCN) that ATX increased CPP slope, but not amplitude. We first would like to point out that the peak amplitude effect in Loughnane et al. (2019) was in the same direction as our reported effect, with numerically higher peak amplitudes for ATX compared to PLC (Figure 2A – right panel in Loughnane et al., 2019). However, as their omnibus main effect of drug condition on CPP peak amplitude was not significant, they did not provide statistics for a pairwise comparison of ATX and PLC in terms of CPP peak amplitude, which makes it hard to compare the effects directly. Regardless, Loughnane et al. (2019) did observe an effect on CPP slope, whereas we did not. Speculatively, this difference could be related to the behavioral tasks that were used in both studies. Below we have added a new paragraph from the Discussion in which we elaborate on this more.

      In Discussion, page 15:

      Here, we demonstrated that response accuracy and response speed are differentially represented in the CPP, with correct vs. erroneous responses resulting in a higher slope and peak amplitude, whereas fast vs. slow responses are only associated with increased slopes (Figure 3A-B). Speculatively, the specific effect of any (pharmacological) manipulation on the CPP may depend on task-setting. For example, Loughnane et al. (2019) used a visual task on which participants did not make many errors (hit rate>98%, no false alarms), whereas we applied a task in which participants regularly made errors (roughly 25% of all trials). Possibly, the effects of ATX from Loughnane et al. (2019) in terms of behavior (RT effect, not accuracy/d’) and CPP feature (slope effect, not peak) may therefore have been different from the effects of ATX we observed on behavior (d’ effect, not RT) and CPP feature (peak effect, not slope). Regardless, when we compared subjects with high and low drift rates (Figure 3C), we observed that both CPP slope and CPP peak were increased for the high vs. low drift group (independent of the drug or attentional manipulation). This indicates that both CPP slope and CPP peak were associated with drift rate from the DDM. Clearly, more work is needed to fully understand how evidence accumulation unfolds in neural systems, which could consequently inform future behavioral models of evidence accumulation as well.

      On page 12 and page 14 the authors suggest a selective effect of ATX on tonic catecholamine activity, but to my knowledge the exact effects of ATX on phasic vs. tonic catecholamine activity are unknown. Although microdialysis studies have shown that a single dose of atomoxetine increases catecholamine concentrations in rodents, it is unknown whether this reflects an increase in tonic and/or phasic activity, due to the limited temporal resolution of microanalysis. Thus, atomoxetine may affect tonic and/or phasic catecholamine activity, and which of these two effects dominates is still unknown, I think.

      We agree with the reviewer that the direct effects of ATX on tonic versus phasic catecholaminergic activity are not clear as initially stated in the manuscript. Equally problematic, previous work has demonstrated that changes in tonic neuromodulation shape evoked neuromodulatory discharge (Aston-Jones & Cohen, 2005, Annu. Rev. Neurosci; Knapen et al., 2016, PLoS ONE). As such, any effect of ATX on tonic neuromodulatory drive would probably have affected phasic catecholaminergic responses as well, although this claim will have to be experimentally addressed. We think that because of the close relation between tonic and phasic neuromodulation, it may indeed be better to refrain from the simplistic interpretation that ATX (and DNP) solely and specifically affects tonic neuromodulation. We have used more neutral language in that regard in the updated version of the manuscript, for example by only mentioning elevated neuromodulator levels (not specifying tonic or phasic). Moreover, we have extended a part of our previous Discussion, to elaborate this issue in more detail. An excerpt of this paragraph, consisting of previous and newly added text, can be seen below.

      In Discussion, page 14:

      In contrast with recent work associating catecholaminergic and cholinergic activity with attention by virtue of modulating prestimulus alpha-power shifts (Bauer et al., 2012; Dahl et al., 2020, 2022) and attentional cue-locked gamma-power (Bauer et al., 2012; Howe et al., 2017), the current work shows that the effects of neuromodulator activity are relatively global and non-specific, whereas the effects of spatial attention are more specific to certain locations in space. Our findings are, however, not necessarily at odds with these previous studies. Most recent work associates phasic (event-related) arousal with selective attention (for reviews see: Dahl et al., 2022; Thiele & Bellgrove, 2018). For example, cue detection in visual tasks is known to be related to cholinergic transients occurring after cue onset (Howe et al., 2017; Parikh et al., 2007). Contrarily, in our work we aimed to investigate the effects of increased baseline levels of neuromodulation by suppressing the reuptake of catecholamines and the breakdown of acetylcholine throughout cortex and subcortical structures. Tonic and phasic neuromodulation have previously been shown to differentially modulate behavior and neural activity (de Gee et al., 2014, 2020, 2021; McGinley et al., 2015; McGinley, Vinck, et al., 2015; van Kempen et al., 2019). Note, however, that it is difficult to investigate causal effects of tonic neuromodulation in isolation of changes in phasic neuromodulation, mostly because phasic and tonic activity are thought to be anti-correlated, with lower phasic responses following high baseline activity and vice versa (Aston- Jones & Cohen, 2005; de Gee et al., 2020; Knapen et al., 2016). As such, pharmacologically elevating tonic neuromodulator levels may have resulted in changes in phasic neuromodulatory responses as well. Concurrent and systematic modulations of tonic (e.g. with pharmacology) and phasic (e.g. with accessory stimuli; Bruel et al., 2022; Tona et al., 2016) neuromodulator activity may be necessary to disentangle the respective and interactive effects of tonic and phasic neuromodulator activity on human perceptual decision-making.

      Reviewer #2 comments:

      The main weakness of the paper lies in the strength of evidence provided, and how the results tally with each other. To begin with, there are a lot of significance tests performed here, increasing the chances of false positives. Multiple comparison testing is only performed across time in the EEG results, and not across post-hoc comparisons throughout the paper. In and of itself, it does not invalidate any result per se, but it does colour the interpretation of any results of weak significance, of which there are quite a few. For example, the effect of Drug on d' and subsequent post-hoc comparisons, also effect of ATX on CPP amplitude and others.

      We agree with the reviewer that the statistical evidence for some of the results presented in this study is limited. This issue mostly concerns the effects of the pharmacological manipulation (effects of attention were strong and robust), which is unfortunately often the case given the high inter-individual variability in responses to pharmaceutical agents. We have added a paragraph to the Discussion in which we discuss this limitation of the current study. Furthermore, we discuss our findings in the context of previous work, thereby showing that - although not always robust- most of the reported drug effects were in the direction that could be expected based on previous literature. We have pasted that paragraph below.

      In Discussion, pages 16:

      Although the effects of the attentional manipulation were generally strong and robust, the statistical reliability of the effects of the pharmacological manipulation was more modest for some comparisons. This may partly be explained by high inter-individual variability in responses to pharmaceutical agents. For example, initial levels of catecholamines may modulate the effect of catecholaminergic stimulants on task performance, as task performance is supposed to be optimal at intermediate levels of catecholaminergic neuromodulation (Cools & D’Esposito, 2011). While acknowledging this, we would like to highlight that many of the observed effects of ATX were in the expected direction and in line with previous work. First, pharmacologically enhancing catecholaminergic levels have previously been shown to increase perceptual sensitivity (d’) (Gelbard-Sagiv et al., 2018), a finding that we have replicated here. Second, methylphenidate (MPH), a pharmaceutical agent that elevates catecholaminergic levels as well, has been shown to increase drift rate as derived from drift diffusion modeling on visual tasks (Beste et al., 2018) in line with our ATX observations. Third, a previous study using ATX to elevate catecholaminergic levels observed that ATX increased CPP slope (Loughnane et al., 2019). Although in our case ATX increased the CPP peak and not its slope, this provide causal evidence that centro-parietal ERP signals related to sensory evidence accumulation are modulated by the catecholaminergic system (Nieuwenhuis et al., 2005). Fourth, we observed that elevated levels of catecholamines affected stimulus driven occipital activity relatively late in time and close to the behavioral response, which resonates with previous observations (Gelbard-Sagiv et al., 2018). Finally, ATX had robust effects on physiological responses (heart rate, blood pressure, pupil size), cue-locked ERP signals and oscillatory power dynamics in the alpha-band, leading up to stimulus presentation. We concur, however, that more work is needed to firmly establish how (various forms of) attention and catecholaminergic neuromodulation affect perceptual decision-making.

      The lack of an overall RT effect of Drug leaves any DDM result a little underwhelming. How do these results tally? One potential avenue for lack of RT effect in ATX condition is increased drift rate but also increased non-decision time, working against each other. However, it may be difficult to validate these results theoretically.

      As the reviewer remarks, an increase in performance/d’ in absence of any RT effects can be algorithmically explained by a combination of increased drift rate and prolonged non-decision time. This is indeed what we observed for ATX. Non-decision time is generally thought to reflect the time necessary for stimulus encoding and motor execution and as such is seen as separate from the evidence-accumulation decision process. We deem it possible that ATX simultaneously prolonged stimulus encoding/motor execution (reflected in changes in non-decision time) and fastened evidence accumulation (reflected in changes in drift rate). Although our neural data did not provide evidence for this claim, previous work has demonstrated that increased baseline (pupil-linked) arousal/neuromodulation is associated with a decreased build-up rate of a neural signal associated with motor execution (β-power over motor cortex, Van Kempen et al., 2019, eLife), potentially linking increased non-decision time under ATX to slowing down of motor execution processes. The same authors also report relationships between baseline (pupil-linked) arousal/neuromodulation and activity over occipital and centroparietal cortices, respectively associated with sensory processing and sensory evidence accumulation, suggesting that baseline neuromodulation may affect all stages leading up to a decision (sensory processing, evidence accumulation and motor execution). Note also that the attentional manipulation seems to simultaneously increase drift rate and shorten non-decision time in our case, as one would expect (Figure 2E, Figure 2 – Supplements 4&5).

      There is an interaction between ATX and Cue in terms of drift rate, this goes against the main thesis of the paper of distinct and non-interacting contributions of neuromodulators and attention. This finding is then ignored. There is also a greater EDAN later for ATX compared to PLA later in the results, which would also indicate interaction of neuromodulators and attention but this is also somewhat ignored.

      There are indeed some interesting interaction effects between ATX and spatial attention (cue), as pointed out by the reviewer. However, we did also observe striking differences in the effects of ATX and attention on stimulus-locked occipital activity (in timing and spatial specificity) as well as independent (main) effects on CPP amplitude and pre-stimulus alpha power. Therefore, throughout the paper we tried to carefully describe the effects of attention and ATX as largely independently and jointly modulating perceptual decision-making, while at the same time highlighting the interaction effects that we observed, where present. We have highlighted the effects the reviewer refers to even more explicitly in a separate paragraph that we added to the discussion, pasted below.

      In Discussion, page 13-14:

      We did observe two striking interaction effects between the catecholaminergic system and spatial attention. First, effects of attention on drift rate were increased under catecholaminergic enhancement (Figure 2D). Although this interaction effect was not reflected in CPP slope/peak amplitude, this does suggest that catecholamines and spatial attention might together shape sensory evidence accumulation in a non-linear manner. Second, the amplitude of the cue-locked early lateralized ERP component (resembling the EDAN) was increased under ATX as compared to PLC. The underlying neural processes driving the EDAN ERP, as well as its associated functions, have been a topic of debate. Some have argued that the EDAN reflects early attentional orienting (Praamstra & Kourtis, 2010) but others have claimed it is mere a visually evoked response and reflects visual processing of the cue (Velzen & Eimer, 2003). Thus, whether this effect reflects a modulation of ATX on early attentional processes or rather a modulation of early visual responses to sensory input in general is a matter for future experimentation.

      The CPP results are somewhat unclear. Although there is an effect of ATX on drift rate algorithmically, there is no effect of ATX on CPP slope. On the other hand, even though there is no effect of DNP on drift rate, there is an effect of DNP on CPP slope. Perhaps one may say that the effect of DNP on drift rate trended towards significance, but overall the combination of effects here is a little unconvincing. In addition, there is an effect of ATX on CPP amplitude, but how does this tally with behaviour? Would you expect greater CPP amplitude to lead to faster or slower RTs? The authors do recognise this discrepancy in the Discussion, but discount it by saying the relationship between algorithmic and CPP parameters in terms of DDM is unclear, which undermines the reasoning behind the CPP analyses (and especially the one correlating CPP slope with DDM drift rate).

      We thank the reviewer for pointing out this dissociation of drug effects in terms of the algorithmic (DDM) and neural (CPP) ‘implementations’ of the evidence accumulating process underlying perceptual decisions. We have added a new paragraph to the discussion where we interpret the effects of ATX on the neural and algorithmic levels of evidence accumulation. Below we have pasted that paragraph:

      In Discussion, page 14-15:

      We reported attentional and neuromodulatory effects on algorithmic (DDM, Figure 2) and neural (CPP, Figure 3) markers of sensory evidence accumulation. Recent work has started to investigate the association of these two descriptors of the accumulation process, aiming to uncover whether neural activity over centroparietal regions reflects evidence accumulation, as proposed by computational accumulation-to-threshold models (Kelly & O’Connell, 2015; O’Connell et al., 2018; O’Connell & Kelly, 2021; Twomey et al., 2015). Currently, the CPP is often thought to reflect the decision variable, i.e. the (unsigned) evidence for a decision (Twomey et al., 2015), and consequently its slope should correspond with drift rate, whereas its amplitude at any time should correspond with the so-far accumulated evidence. As -computationally- the decision is reached when evidence crosses a decision bound (the threshold), it may be argued that the peak amplitude of the CPP (roughly) corresponds with the decision boundary. This seems to contradict our observation that 1) ATX modulated drift rate, but not CPP slope and 2) ATX did not modulate boundary separation, but did modulate CPP peak. Note, however, that previous studies using pharmacology or pupil-linked indexes of (catecholaminergic) neuromodulation have also demonstrated effects on both CPP peak (van Kempen et al., 2019) and CPP slope (Loughnane et al., 2019).

      The posterior component effects are problematic. The main issue is the lack of clarification of and justification for the choice of posterior component. The analysis is introduced in the context of the target selection signal the N2pc/N2c, but the component which follows is defined relative to Cue, albeit post-target. Thus this analysis tells us the effect of Cue on early posterior (possibly) visual ERP components, but it is not related to target selection as it is pooled across target/distractor. Even if we ignore this, the results themselves wrt Drug lack context. There is a trending lower amplitude for ATX at later latencies at temporo-parietal electrodes, and more positive for DNP, relative to PLA. Is this what one would expect given behaviour? This is where the issue of correct component identification becomes critical in order to inform any priors on expected ERP results given behaviour.

      We thank the reviewer for raising this issue with the occipital ERP analysis, allowing us to clarify our decisions regarding the analyses and our interpretations of the results. First, the selection of electrodes was based on, and identical to, previous studies investigating lateralized target selection signals in visual tasks containing bilateral visual stimuli (Loughnane et al., 2016; Newman et al., 2017; Papaioannou & Luck, 2020; van Kempen et al., 2019). Second, the ERPs were defined relative to both the direction of the cue as well as the location of the target. As cue direction and target location were not always congruent (cue validity=80%), we could adopt a 2x2 (cue direction x stimulus identity) design for our ERP analyses (we are ignoring drug condition for explanation purposes). For example, for validly cued target trials we extracted two ERP traces: 1) from the hemisphere contralateral to both the cue and the target stimulus (representing processing of cued target stimulus) and 2) from the hemisphere ipsilateral to the cue and the target stimulus (representing processing of non-cued noise stimulus). However, for invalidly cued trials, ERP traces were extracted from 3) the hemisphere contralateral to cue direction and ipsilateral to the target stimulus (reflecting processing of cued noise stimuli) as well as 4) from the hemisphere ipsilateral to cue direction but contralateral to the target stimulus (reflecting processing of non-cued target stimuli). By defining our ERPs as such, we were able to gauge effects of cue direction (reflecting general shifts in attention), stimulus identity (reflecting target vs. noise selection processes) and their interaction (reflecting cue validity) on activity over occipito-temporal activity. Third, we did not pool data (across target/noise stimuli) for statistical analyses, but only for visualization purposes. To clarify how we extracted ERP traces, we have changed Figure 4 substantially. The updated figure now contains a schematic of how these four distinct ERP traces (cue x stimulus identity) were extracted from neural activity. Moreover, for clarity sake, we now show all 12 ERP traces (3x2x2, drug condition x cue direction x stimulus identity) as well as the three main effects that we observed after performing a 3x2x2 repeated measures (rm)ANOVA over time.

      We observed robust (cluster-corrected) effects of cue direction (not validity) on early occipital activity (Fig. 4C – left panel) and of stimulus identity (target/noise) and drug condition on later occipital activity (Fig. 4C – middle and right panel). These results crucially highlight the different temporal (early/late) and spatial (lateralized/not lateralized) profiles of cue, target and drug effects on occipital activity. Moreover, we observed a specific order of drug effects on late occipital activity (DNP>PLC>ATX). The behavioral relevance of this pattern of effects remains elusive. Although the effects of drug condition coincide in time with those of target selection (i.e. when activity contralateral and ipsilateral to the target stimulus was different), the effects of drug were bilateral, meaning that occipito-temporal activity related to the processing of the target (task-relevant) stimulus and non-target (task-irrelevant) stimulus was equally modulated by these pharmaceutical agents. One might argue that these effects show that neither ATX nor DNP modulated the signal-to-noise ratio (SNR), a feature that describes how well relevant stimulus information (signal) can be discerned from irrelevant information (noise). Although it may be tempting to extrapolate this finding to behavior, by suggesting that on the basis of these drug effect neither ATX nor DNP could have modulated d’ (behavioral measure describing how well signal is separated from noise), we would like to point out that our behavioral task specifically concerned a discrimination task about the (orientation of the) target stimulus in which the difference between signal and noise was only relevant for localization purposes and thus has a less direct relation with task performance. As such it is difficult to grasp how the modulation of late occipito-temporal activity by ATX and DNP relates to their behavioral effects. Moreover, the bilateral effect of both ATX and DNP also suggests an absence of interaction effects between drug conditions and visuo-spatial attention, as the effects of ATX/DNP were similar across all cue and target identity conditions.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Cook, Watt, and colleagues previously reported that a mouse model of Spinocerebellar ataxia type 6 (SCA6) displayed defects in BDNF and TrkB levels at an early disease stage. Moreover, they have shown that one month of exercise elevated cerebellar BDNF expression and improved ataxia and cerebellar Purkinje cell firing rate deficits. In the current work, they attempt to define the mechanism underlying the pathophysiological changes occurring in SCA6. For this, they carried out RNA sequencing of cerebellar vermis tissue in 12-month-old SCA6 mice, a time when the disease is already at an advanced stage, and identified widespread dysregulation of many genes involved in the endo-lysosomal system. Focusing on BDNF/TrkB expression, localization, and signaling they found that, in 7-8 month-old SCA6 mice early endosomes are enlarged and accumulate BDNF and TrkB in Purkinje cells. Curiously, TrkB appears to be reduced in the recycling endosomes compartment, despite the fact that recycling endosomes are morphologically normal in SCA6. In addition, the authors describe a reduction in the Late endosomes in SCA6 Purkinje cells associated with reduced BDNF levels and a probable deficit in late endosome maturation.

      We would like to thank the reviewers for their careful reading of the paper, their feedback has helped us to add information and experiments to the paper that enhance the clarity of the findings.

      Strengths:

      The article is well written, and the findings are relevant for the neuropathology of different neurodegenerative diseases where dysfunction of early endosomes is observed. The authors have provided a detailed analysis of the endo-lysosomal system in SCA6 mice. They have shown that TrkB recycling to the cell membrane in recycling endosomes is reduced, and the late endosome transport of BDNF for degradation is impaired. The findings will be crucial in understanding underlying pathology. Lastly, the deficits in early endosomes are rescued by chronic administration of 7,8-DHF.

      We thank the reviewers for their positive feedback on this work.

      Weaknesses:

      The specificity of BDNF and TrkB immunostaining requires additional controls, as it has been very difficult to detect immunostaining of BDNF. In addition, in many of the figures, the background or outside of Purkinje cell boundaries also exhibits a positive signal.

      We agree with the reviewers that the performance of the BDNF and TrkB antibodies is an important concern. We have ourselves had difficulties with the performance of many antibodies and the images in this paper are the result of many years of optimization. We have therefore added further detail about the antibody optimization to the methods section of this paper, and have carried out new staining experiments with additional controls. We have added 2 new figure panels in supplementary figures 3 and 4 to demonstrate these tests.

      In the case of anti-BDNF antibodies, we have tested several antibodies and staining protocols and found that in our hands, the only antibody that reliably stained BDNF with a good signal to noise ratio was the one used in this paper (abcam ab108319). Even for this antibody, the staining was greatly enhanced by the use of a heat induced epitope retrieval (HIER) step, which allowed the visualization of BDNF within intracellular structures such as endosomes. When we quantified the intensity of this staining in our previous paper, the results were in agreement with those from a BDNF ELISA used to measure levels of BDNF in the cerebellar vermis of WT and SCA6 mice (Cook et al., 2022), which corroborates these results. As the staining was carried out in tissue sections and not dissociated cells, we also see positive signal from the BDNF staining outside of the Purkinje cells, since BDNF acts on cell-surface receptors and is thus released into the extracellular space around cells (Kuczewski et al., 2008) and is detectable in the extracellular matrix (Lam et al., 2019) and presynaptic terminals around neurons (Camuso et al., 2022; Choo et al., 2017). This is in contrast to studies that image BDNF mRNA with in-situ hybridization, which labels BDNF mRNA predominantly found in cells, and cannot tell us about sub-cellular or extracellular localization of BDNF protein. Together, these factors explain why we observe staining that is not cell- limited, but extends into the space around the cells of interest.

      We have added an additional supplemental figure to demonstrate the importance of using HIER when staining slices with anti-BDNF (Supplementary figure 3). We tested HIER protocols that involved heating the slices to 95°C in a variety of buffers. The buffers tested were sodium citrate buffer (10 mM sodium citrate, 0.05% Tween 20, pH 6), Tris buffer (10mM TBS, 0.05% Tween 20, pH 10), EDTA buffer (1mM EDTA, 0.05% Tween 20, pH 8) and neutral PBS. The PBS produced the best result, enhancing the staining of both anti-BDNF and anti-EEA1 antibodies (Supplementary figure 3). Therefore all slices stained using those antibodies were heated to 95°C in PBS using a heat block or thermocycler for 10 minutes, then allowed to cool before staining proceeded.

      The antibody we use (abcam ab108319) has been used in hundreds of other publications, including Javed et al., 2021 who ectopically expressed BDNF and noted colocalization between the antibody staining and the GFP tag of the BDNF construct, and Lejkowska et al., 2019 who overexpressed BDNF and saw a dramatic increase in antibody staining as well. The colocalization between ectopically expressed BDNF and the antibody in these studies demonstrates the specificity of the antibody.

      However, to further validate antibody specificity we used liver tissue as a negative control. In liver tissue from rodents and humans, the majority of the liver contains negligible levels of BDNF (Koppel et al., 2009; Vivacqua et al., 2014), see also the Human Protein Atlas. The exception is some cholangiocytes: epithelial cells that express BDNF at high levels (Vivacqua et al., 2014). We obtained liver tissue from a WT mouse that was undergoing surgery for an unrelated project and fixed and processed the tissue as we did for brain tissue (outlined in methods section). As we would expect, most of the cells in the liver showed BDNF immunoreactivity that was comparable to background levels (Supplementary figure 3). Interestingly, we were also able to detect sparse highly BDNF-positive cells in the liver, presumed cholangiocytes (Supp. Fig. 3). This pattern of liver BDNF expression is as predicted in the literature, and thus acts as a control for our antibody. We therefore believe that in our hands this antibody is able to stain BDNF with an appropriate degree of specificity.

      We also carried out staining experiments using a second anti-TrkB antibody that we had previously used to detect TrkB via Western bloing. We carried out immunohistochemistry as previously described using tissue sections from a WT mouse. The staining with the two different antibodies was carried out at the same time and all other reagents were kept constant. We found that both antibodies labelled TrkB in a similar pattern of localization, including in the early endosomes of the Purkinje cells (Supplementary figure 4). The second antibody however did have a lower signal to noise ratio and so we believe that the original anti-TrkB antibody used in this manuscript (EMD Millipore ab9872) is optimal for staining cerebellar tissue sections in our hands.

      One important concern about the conclusions is that the RNAseq experiment was conducted in 12-month- old SCA6 mice suggesting that the defects in the endo-lysosomal system may be caused by other pathophysiological events and, likewise, the impairment in BDNF signaling may also be indirect, as also noted by the authors. Indeed, Purkinje cells in SCA6 mice have an impaired ability to degrade other endocytosed cargo beyond BDNF and TrkB, most likely because of trafficking deficits that result in a disruption in the transport of cargo to the lysosomes and lysosomal dysfunction.

      We agree with the reviewers that the defects in the endo-lysosomal system may be caused by other events occurring in the course of disease progression. As mentioned by the reviewers, we have noted this possibility in the text. Detailed investigation into the sequence of events and the root causes of signaling disruption in SCA6 merits future study and we aim to address this in future work. We have expanded this explanation in the text.

      Moreover, the beneficial effects of 7,8-DHF treatment on motor coordination may be caused by 7,8-DHF properties other than the putative agonist role on TrkB. Indeed, many reservations have been raised about using 7,8-DHF as an agonist of TrkB activity. Several studies have now debunked (Todd et al. PlosONE 2014, PMID: 24503862; Boltaev et al. Sci Signal 2017, PMID: 28831019) or at the very least questioned (Lowe D, Science 2017: see Discussion: https://www.science.org/content/blog-post/those-compounds-aren-t- what-you-think-they-are Wang et al. Cell 2022 PMID: 34963057). Another interpretation is that 7,8-DHF possesses antioxidant activity and neuroprotection against cytotoxicity in HT-22 and PC12 cells, both of which do not express TrkB (Chen et al. Neurosci Lett 201, PMID: 21651962; Han et al. Neurochem Int. 2014, PMID: 24220540). Thus, while this flavonoid may have a beneficial effect on the pathophysiology of SCA6, it is most unlikely that mechanistically this occurs through a TrkB agonistic effect considering the potent anti-oxidant and anti-inflammatory roles of flavonoids in neurodegenerative diseases (Jones et al. Trends Pharmacol Sci 2012, PMID: 22980637).

      We thank the reviewers for raising this important point. We have noted in our previous paper (Cook et al., 2022) that 7,8-DHF may not be acting as a TrkB agonist in SCA6 mice, and are in agreement that other explanations are possible. We have now added information to the text of this paper to highlight this possibility. We did show in our previous paper that 7,8-DHF administration activates Akt signaling in the cerebellum of SCA6 mice, a signaling event that is known to take place downstream of TrkB activation. Additionally, 7,8-DHF treatment led to the increase of TrkB levels in the cerebellum of SCA6 mice (Cook et al., 2022), implicating TrkB in the mechanism of action, even if mechanistically, this is not via direct TrkB activation alone. However, even if the mechanism is currently incompletely explained, we believe that 7,8- DHF remains a valuable treatment strategy for SCA6. We have tried to rewrite the Discussion to highlight what we think is the most important takeaway: that 7,8-DHF can rescue endosomal and other deficits in SCA6, even if we do not currently know the full mechanism of action. We have therefore amended the text to add more detail about other potential explanations for the mechanism of action of 7,8-DHF.

      References

      Camuso S, La Rosa P, Fiorenza MT, Canterini S. 2022. Pleiotropic effects of BDNF on the cerebellum and hippocampus: Implications for neurodevelopmental disorders. Neurobiol Dis. doi:10.1016/j.nbd.2021.105606

      Choo M, Miyazaki T, Yamazaki M, Kawamura M, Nakazawa T, Zhang J, Tanimura A, Uesaka N, Watanabe M, Sakimura K, Kano M. 2017. Retrograde BDNF to TrkB signaling promotes synapse elimination in the developing cerebellum. Nat Commun 8:195. doi:10.1038/s41467-017-00260-w

      Cook AA, Jayabal S, Sheng J, Fields E, Leung TCS, Quilez S, McNicholas E, Lau L, Huang S, Watt AJ. 2022. Activation of TrkB-Akt signaling rescues deficits in a mouse model of SCA6. Sci Adv 8:3260. doi:10.1126/sciadv.abh3260

      Javed S, Lee YJ, Xu J, Huang WH. 2021. Temporal dissection of Rai1 function reveals brain-derived neurotrophic factor as a potential therapeutic target for Smith-Magenis syndrome. Hum Mol Genet 31:275–288. doi:10.1093/HMG/DDAB245

      Koppel I, Aid-Pavlidis T, Jaanson K, Sepp M, Pruunsild P, Palm K, Timmusk T. 2009. Tissue-specific and neural activity-regulated expression of human BDNF gene in BAC transgenic mice. BMC Neurosci 10:68. doi:10.1186/1471-2202-10-68

      Kuczewski N, Porcher C, Ferrand N, Fiorentino H, Pellegrino C, Kolarow R, Lessmann V, Medina I, Gaiarsa JL. 2008. Backpropagating action potentials trigger dendritic release of BDNF during spontaneous network activity. J Neurosci 28:7013–7023. doi:10.1523/JNEUROSCI.1673-08.2008

      Lam D, Enright HA, Cadena J, Peters SKG, Sales AP, Osburn JJ, Soscia DA, Kulp KS, Wheeler EK, Fischer NO. 2019. Tissue-specific extracellular matrix accelerates the formation of neural networks and communities in a neuron-glia co-culture on a multi-electrode array. Sci Rep 9. doi:10.1038/s41598- 019-40128-1

      Lejkowska R, Kawa MP, Pius-Sadowska E, Rogińska D, Łuczkowska K, Machaliński B, Machalińska A. 2019. Preclinical Evaluation of Long-Term Neuroprotective Effects of BDNF-Engineered Mesenchymal Stromal Cells as Intravitreal Therapy for Chronic Retinal Degeneration in Rd6 Mutant Mice. Int J Mol Sci 2019, Vol 20, Page 777 20:777. doi:10.3390/IJMS20030777

      Vivacqua G, Renzi A, Carpino G, Franchitto A, Gaudio E. 2014. Expression of brain derivated neurotrophic factor and of its receptors: TrKB and p75NT in normal and bile duct ligated rat liver. Ital J Anat Embryol 119:111–129. doi:10.13128/IJAE-15138

    1. Author Response

      The following is the authors’ response to the original reviews.

      We thank the reviewers and editor for their thoughful and careful evaluation of our manuscript. We appreciate your time and effort and have incorporated many of these suggestions to improve our revised manuscript.

      Reviewer #1 (Public Review):

      Summary: Cullinan et al. explore the hypothesis that the cytoplasmic N- and C-termini of ASIC1a, not resolved in x-ray or cryo-EM structures, form a dynamic complex that breaks apart at low pH, exposing a C-terminal binding site for RIPK1, a regulator of necrotic cell death. They expressed channels tagged at their N- and C-termini with the fluorescent, non-canonical amino acid ANAP in CHO cells using amber stop-codon suppression. Interaction between the termini was assessed by FRET between ANAP and colored transition metal ions bound either to a cysteine reactive chelator attached to the channel (TETAC) or metal-chelating lipids (C18-NTA). A key advantage to using metal ions is that they are very poor FRET acceptors, i.e. they must be very close to the donor for FRET to occur. This is ideal for measuring small distances/changes in distance on the scales expected from the initial hypothesis. In order to apply chelated metal ions, CHO cells were mechanically unroofed, providing access to the inner leaflet of the plasma membrane. At high pH, the N- and C- termini are close enough for FRET to be measured, but apparently too far apart to be explained by a direct binding interaction. At low pH, there was an apparent increase in FRET between the termini. FRET between ANAP on the N-and Ctermini and metal ions bound to the plasma membrane suggests that both termini move away from the plasma membrane at low pH. The authors propose an alternative hypothesis whereby close association with the plasma membrane precludes RIPK1 binding to the C-terminus of ASIC1a.

      Strengths: The findings presented here are certainly valuable for the ion channel/signaling field and the technical approach only increases the significance of the work. The choice of techniques is appropriate for this study and the results are clear and high quality. Sufficient evidence is presented against the starting hypothesis.

      Weaknesses: I have a few questions about certain controls and assumptions that I would like to see discussed more explicitly in the manuscript.

      My biggest concern is with the C-terminal citrine tag. Might this prevent the hypothesized interaction between the N- and C-termini? What about the serine to cysteine mutations? The authors might consider a control experiment in channels lacking the C-terminal FP tag.

      While it is certainly possible that the C-terminal citrine tag is preventing the hypothesized interaction between the intracellular termini, there are a few things that mitigate (but not eliminate) this concern. First, previous work looking at the interaction between the intracellular termini used FPs on both the N- and C-termini and concluded that in fact there is an interaction (PMID:31980622). Our channels have only a single FP, and we use a higher resolution FRET approach. Second, we aVach our citrine tag with a 11-residue linker, allowing for enhanced flexibility of the region and hopefully allowing for more space for an interaction that was posited to be between the very proximal part of the C-terminus (near the membrane and away from the tag) and the untagged N-terminus. Third, we previously showed that Stomatin, a much larger protein than the NTD, could bind the distal C-terminus of rASIC3 with a large fluorescent protein connected by the same linker on the C-terminus. In the case of Stomatin, the interaction involved the residues at the distal portion of the C-terminus close to the bulky FP. Interestingly, while we did not publish this, without this flexible linker, Stomatin could not regulate the channel and likely did not bind.

      Despite this, we agree that this is possible and have added a statement in our limitations section explicitly saying this.

      Figure 2 supplement 1 shows apparent read-through of the N-terminal stop codons. Given that most of the paper uses N-terminal ANAP tags, this figure should be moved out of the supplement. Do Nterminally truncated subunits form functional channels? Do the authors expect N-terminally truncated subunits to co-assemble in trimers with full-length subunits? The authors should include a more explicit discussion regarding the effect of truncated channels on their FRET signal in the case of such co-assembly.

      The positions that show readthrough (E6, L18, H515) were not used in the study. We eliminated them largely on the basis of these westerns. We elected to put the bulk of the blots in the supplement simply because of how many there were. We believe this is the best compromise. It allows us to show representative blots for all our positions without making an illegible figure with 7 blots.

      The N-terminally truncated subunits would create very short peptides that are not able to create functional channels. A premature stop at say E8 would create a 7-mer. Our longest N-terminal truncation would only create a protein of 32 amino acids. These don’t contain the transmembrane segments and thus cannot make functional channels.

      As the epitope used for the western blots in Figure 2 and supplements is part of the C-terminal tag, these blots do not provide an estimate of the fraction of C-terminally truncated channels (those that failed to incorporate ANAP at the stop codon). What effect would C-terminally truncated channels have on the FRET signal if incorporated into trimers with full-length subunits?

      Alternatively, C-terminally truncated subunits would be able to form functional channels because they contain the full N-terminus, the transmembrane domains, the extracellular domain and a portion of the C-terminus. We don’t think this is a major contaminant to our experiments. The only two C-terminal ANAP positions we use are 464 and 505. In each of these cases, they are only used for memFRET. The ones that do not contain ANAP are essentially “invisible” to the experiment. Since we are measuring their proximity to the membrane, having some missing should not maVer. However, there is some chance that truncations in some subunits could allosterically affect the position of the CT in other subunits. We have added a discussion of this in the manuscript.

      Some general discussion of these results in the context of trimeric channels would be helpful. Is the putative interaction of the termini within or between subunits? Are the distances between subunits large enough to preclude FRET between donors on one subunit and acceptor ions bound on multiple subunits?

      Thank you for this comment. We did not directly test whether the distances are within or between subunits. We considered using a concatemer to do this, however, the concatemeric channels do not express particularly well. Then, UAA incorporation hurts the expression as well. It was unlikely we would be able to get sufficient expression for tmFRET.

      However, the Maclean group has previously tested this using FRET between concatenated subunits and determined that FRET is stronger within than between subunits. We have updated the manuscript to reflect a more thorough discussion of our results in the context of their trimeric assembly.

      The authors conclude that the relatively small amount of FRET between the cytoplasmic termini suggests that the interaction previously modeled in Rosetta is unlikely. Is it possible that the proposed structure is correct, but labile? For example, could it be that the FRET signal is the time average of a state in which the termini directly interact (as in the Rosetta model) and one in which they do not?

      The proposed RoseVa model does not include the reentrant loop of the channel, so it is probable that this model would change if it were redone to include this new feature of the channel.

      However, we do discuss the limitation of FRET as a method that measures a time average that is weighted towards closest approach in our discussion section. The termini are most certainly dynamic and it is possible that spend some time in close proximity. Given that FRET is biased towards closest approach, we actually think this strengthens our argument that the termini don’t spend a great deal of time in complex. In addition, our MST data suggests that the termini do not bind. We have added some commentary on this to the discussion section for clarity.

      Reviewer #2 (Public Review):

      Summary:

      The authors use previously characterised FRET methods to measure distances between intracellular segments of ASIC and with the membrane. The distances are measured across different conditions and at multiple positions in a very complete study. The picture that emerges is that the N- and C-termini do not associate.

      Strengths:

      Good controls, good range of measurements, advanced, well-chosen and carefully performed FRET measurements. The paper is a technical triumph. Particularly, given the weak fluorescence of ANAP, the extent of measurements and the combination with TETAC is noteworthy.

      The distance measurements are largely coherent and favour the interpretation that the N and C terminus are not close together as previously claimed.

      Weaknesses:

      One difficulty is that we do not have a positive control for what binding of something to either N- or Cterminus would look like (either in FRET or otherwise).

      We acknowledge that this is a challenge for the approach. Having a positive control for binding would be great but we are not sure such a thing exists. You could certainly imagine a complex between two domains where each label (ANAP and TETAC) are pointed away from one other (giving comparatively modest quenching) or one where they are very close (giving comparatively large quenching), both of which could still be bound. This is essentially a less significant version of the problem with using FPs to measure proximity…they are not very good proxies for the position of the termini. These small labels are certainly beVer proxies but still not perfect. Our conclusion here is based more on the totality of the data. We tried many combinations and saw no sign of distances closer than ~ 20A at resting pH. We think the simplest explanation is that they are not close to one another but we tried to lay out the limitations in the discussion.

      One limitation that is not mentioned is the unroofing. The concept of interaction with intracellular domains is being examined. But the authors use unroofing to measure the positions, fully disrupting the cytoplasm. Thus it is not excluded that the unroofing disrupts that interaction. This should be mentioned as a possible (if unlikely) limitation.

      Thank you for your comment. We discuss unroofing as a potential limitation because it exposes both sides of the plasma membrane to changes in pH. We have updated this section to include acknowledgement of the possibility that unroofing disrupts the interaction via washout of other critical proteins.

      Reviewer #3 (Public Review):

      Summary: The manuscript by Cullinan et al., uses ANAP-tmFRET to test the hypothesis that the NTD and CTD form a complex at rest and to probe these domains for acid-induced conformational changes. They find convincing evidence that the NTD and CTD do not have a propensity to form a complex. They also report these domains are parallel to the membrane and that the NTD moves towards, and the CTD away, from the membrane upon acidification.

      Strengths:

      The major strength of the paper is the use of tmFRET, which excels at measuring short distances and is insensitive to orientation effects. The donor-acceptor pairs here are also great choices as they are minimally disruptive to the structure being studied.

      Furthermore, they conduct these measurements over several positions with the N and C tails, both between the tails and to the membrane. Finally, to support their main point, MST is conducted to measure the association of recombinant N and C peptides, finding no evidence of association or complex formation.

      Weaknesses:

      While tmFRET is a strength, using ANAP as a donor requires the cells to be unroofed to eliminate background signal. This causes two problems. First, it removes any possible low affinity interacting proteins such as actinin (PMID 19028690). Second, the pH changes now occur to both 'extracellular' and 'intracellular' lipid planes. Thus, it is unclear if any conformational changes in the N and CTDs arise from desensitization of the receptor or protonation of specific amino acids in the N or CTDs or even protonation of certain phospholipid groups such as in phosphatidylserine. The authors do comment that prolonged extracellular acidification leads to intracellular acidification as well. But the concerns over disruption by unroofing/washing and relevance of the changes remain.

      We acknowledge that unroofing is a limitation of our approach and noted it in the discussion. However, we have updated the section to include the possibility that the act of unroofing and washing could also disrupt the potential interaction between the intracellular domains as well as between these domains and other intracellular proteins. This was the best approach we could use to address our questions and it required that we unroof the cells. However, we look forward to future studies or new techniques that do not require the unroofing of the cells.

      The distances calculated depend on the R0 between donor and acceptor. In turn, this depends on the donor's emission spectrum and quantum yield. The spectrum and yield of ANAP is very sensitive to local environment. It is a useful fluorophore for patch fluorometry for precisely this reason, and gating-induced conformational changes in the CTD have been reported just from changes in ANAP emission alone (PMID 29425514). Therefore, using a single R0 value for all positions (and both pHs at a single position) is inappropriate. The authors should either include this caveat and give some estimate of how big an impact changes spectrum and yield might have, or actually measure the emission spectra at all positions tested.

      This is a reasonable concern and one we considered. Measuring the quantum yield would be quite difficult. However, we have measured spectra at a number of positions and see a relatively minimal shik in the peak. Most positions peak between 481 and 484nm. If you calculate the difference in R0 using theoretical spectra with a blue shik of 20nm, the difference in R0 is only ~1.5A. A shik of 20nm is on the higher side of anything we have seen in the literature (PMID 30038260) and since even with that large a shik, the difference is minimal we do not think measuring spectra for each position would impact the overall conclusions presented. As you noted, though, the quantum yield also changes. Assuming a change in yield from 0.22 to 0.47, the largest we found reported in the literature (PMID:29923827) , the R0 would increase by 2A. This same paper showed that the blue shiked position was the one with the higher extinction coefficient so these changes would be working in opposition to one another making the difference in R0 even smaller. It is important to note, that while tmFRET is a much more powerful measure of distance than standard FRET, these distances, as you point out, are quite challenging to measure precisely. Our conclusions are based less on the absolute distances and more on the observation that no positions show large quenching and that if there is any change upon acidification, it is in the wrong direction.

      Overall, the writing and presentation of figures could be much improved with specific points mentioned in the recommendations for authors section.

      See below.

      The authors argue that the CTD is largely parallel to the plasma membrane, yet appear to base this conclusion on ANAP to membrane FRET of positions S464 and M505. Two positions is insufficient evidence to support such a claim. Some intermediate positions are needed.

      We do not see in the paper where we suggest that the CTD is parallel. However, your point that we could try and determine if this was the case is correct. However, we aVempted to create several other CTD TAG mutants but struggled with readthrough and poor expression of these mutants so we opted to just include S464 and M505. Our point from these data is only that the distal CTD (505) must spend significant time near the membrane to explain our FRET data.

      Upon acidification, NTD position Q14 moves towards the plasma membrane (Figure 8B). Q14 also gets closer to C515 or doesn't change relative to 505 (Figures 7C and B) upon acidification. Yet position 505 moves away from the membrane (Figure 8D). How can the NTD move closer to the membrane, and to the CTD but yet the CTD move further from the membrane? Some comment or clarification is needed.

      This is a reasonable question and one that is hard to definitively answer. Our goal here was to test the hypothesis that the termini are bound at rest. Mapping the precise positions of the termini is difficult for reasons we will enumerate in the question that asks why we didn’t make a model. There are potentially multiple explanations but the easiest one would be that the CTD could move away from the membrane but closer to Q14, for instance, if the distal termini, say, rotated towards the NTD. This would move 505 closer and have no impact on whether or not the NTD and CTD moved away or toward the membrane.

      Reviewer #1 (Recommendations For The Authors):

      Minor concerns

      The authors show the spectrum of ANAP attached to beads and use this spectrum to calculate R0 for their FRET measurements. Peak ANAP fluorescence is dependent on local environment and many reports show ANAP in protein blue-shiked relative to the values reported here. How would this affect the distance measurements reported?

      This is an important point. See above for the answer.

      Could the lack of interaction between the N- and C-terminal peptides in Figure 7 arise from the cysteine to serine mutations or lack of structure in the synthetic peptides. How were peptide concentrations measured/verified for the experiment?

      It is possible that cysteine to serine mutations could prevent the interaction. It is also possible that these peptides are not capable of adopting their native fold without the presence of the plasma membrane or due to being synthetically created. However, the termini are thought to be largely unstructured. We received these peptides in lyophilized form at >95% purity and resuspended to our desired stock concentration (3 mM C-terminus, 1 mM N-terminus). Even if our concentration was off, we see no signs of interaction up to quite a high concentration.

      How was photobleaching measured for correcting the data?

      We executed several mock experiments at various TAG positions using either pH 8 and pH 6, where we performed the experiments as usual but with a mock solution exchange when we would normally add the metal. We normalized the L-ANAP fluorescence to the first image and averaged together these values for pH 8 and pH 6. We then corrected using Equation 2 in the manuscript..

      We have updated the methods to include how we adjusted for bleaching.

      The authors may wish to make it more explicit that their Zn2+ controls also preclude the possibility that a changing FRET signal between ANAP and citrine may affect their data.

      Thank you for this comment. We agree, it would strengthen the manuscript to include this statement. We have now included this.

      It might be useful to the reader if the authors could include (as a supplement) plots of their data (like in Figure 6), in which FRET efficiency has been converted to distance.

      We considered this idea as well but felt like showing the actual data in the figures and the distances in a table would be best.

      Figure 5D is mentioned in the text before any other figures. This is unconventional. Could this panel be moved to Figure 1 or the mention moved to later?

      Changed

      western blot is not capitalized.

      Changed.

      Figure 1, the ANAP structure shown is the methyl ester, which is presumably cleaved before ANAP is conjugated to the tRNA. The authors may wish to replace this with the free acid structure.

      This is a fair point. We originally used the methyl ester structure to indicate the version of ANAP we chose to use. However, you are correct that the methyl ester is cleaved before conjugation to the tRNA. We replaced the methyl ester with the free acid structure to clarify this.

      Figures 1 and 4 should have scale bars for the images.

      Scale bars have been added to figures 1, 4, and 5.

      In Figure 3, the letters in the structures (particularly TETAC) are way too small. Please increase the font size.

      Changed

      In Figure 3 and Figure 3 supplement 1, the axes are labeled "Absorbance (M-1cm-1)." Absorbance is dimensionless. The authors are likely reporting the extinction coefficient.

      Thank you for catching this. We adjusted the axes to extinction coefficient.

      In Figures 5 B and C, it might be clearer if the headers read "Initial, +Cu2+/TETAC, DTT" rather than "Initial, FRET, Recovery."

      Changed

      The panel labels for Figure 8 seem to be out of order.

      Changed

      The L for L-ANAP should be rendered, by convention, in small caps.

      This is a good example of learning something new from the review process. This is the first I have ever heard of small caps. We can find no other papers that use small caps for L-ANAP so I am not 100% sure what convention this is referring to and don’t want to change the wrong thing in the paper. We are happy to change if the editorial staff at eLife agree but have lek this for now.

      Reviewer #2 (Recommendations For The Authors):

      With so many distances measured, why was not even a basic structural model attempted?

      We certainly considered it, but a number of things lead us to conclude that it might imply more certainty about the structure of these termini than we hope to give. 1) Given that the FRET is a time average of positions, these distance constraints would not do much constraining. 2) Given that the termini are likely unstructured and flexible this makes the problem in 1 worse. 3) There is no structural information to use as a starting point for a model. 4) The flexibility of the linkers for each FRET pair also introduces uncertainty. This can, in theory, be modeled as they do in EPR but all of this together made us decide not to do this. What we hope readers take home, is the overall picture of the data is not consistent with the original RIPK1 hypothesis.

      Maybe it would be good to draw a band on the graphs in Figure 6 for the FRET signal expected for interaction (and thus, disfavoured by these data). This would at least give context.

      We agree this could be helpful, but it is not so easy to do. What distance would we choose? We could put a line at ~5Å (the model predicted distance). As we noted above, a number of distances could be compatible with an interaction. However, we think it’s unlikely that if a complex was formed that none of our measurements would show a distance closer than 20Å at rest and that an unbinding event would then lead to a decrease in distance. This, to us, is the take home message.

      Minor points:

      "Aker unroofing the cells, only fluorescence associated with the "footprint", or dorsal surface, of the cell membrane is lek behind."

      The authors use dorsal and ventral in this section to describe parts of an adherent cell. But in the first instance, they remove the dorsal part of the cell, and then in this phrase, the dorsal part is lek behind....I am a bit confused.

      Thank you for pointing out this mistake, we have fixed this. It is indeed the ventral surface lek behind.

      "bind at rest an" - and?

      Changed

      "One previous study used a different approach to try and map the topography of the intracellular termini of ASIC1a comparable to our memFRET experiments." I think a citation is due.

      Citation added

      "great deal of precedent" even if this result is from my own lab, I would prefer that the authors note that it's one study from one lab! I think best just to delete "great deal of".

      “Great deal of” deleted

      I think the column "Significance" in the tables is unnecessary when the P value is given.

      Thank you for this suggestion. We agree and have made the change.

      Figure 7a Q14TAG has a clearly bimodal distribution at pH 8. What could be the meaning of this result? The authors do not mention it that I could find. Perhaps there is no meaning. The authors should state what they think is (or is not) going on.

      This is a good question and we don’t have a good answer. It appears to be experimental variability. The data from the “low fret” in this experimental condition all came from the same days. So something was different that day. We considered that they might be outliers to exclude but thought showing all of our data was the beVer path. We reperformed the ANOVA here separating out the “outlier” day and nothing of substance changed. Both populations were still different with P value less than 0.001.

      Typo: Lumencore

      Changed

      Maybe just a matter of taste but the panel created with Biorender in Figure 8 is not attractive and depicts the channel differently to in Figure 5D, which is again different from Figure 1A. Surely one advantage of using computer-generated artwork could be to have consistency.

      We agree and have used the same cartoon for all of our images with the one exception being the schematics that are just meant to show the positions that are present in each bar graph.

      Figure 4A was squashed to fit (text aspect ratio is wrong).

      Fixed

      Reviewer #3 (Recommendations For The Authors):

      Citrine is used to report incorporation. Yet citrine has a strong tendency to dimerize (PMID 27240257). Did the authors use mCitrine or just Citrine? This is quite important in interpreting their data.

      Thank you for pointing out this important distinction. We use mCitirine which we have added to the methods.

      The manuscript has numerous instances of imprecise language. For example, page 10, last para, first line, "previous studies have looked at..." or page 7, final paragraph "tell a similar story". Related, the figures could be much better. For example, in Figure 1, where the authors depict the anap chemical in red, as opposed to the blue one might expect of a blue emiqng fluorophore. In figure 6, ANAP is also in red with the quenching group in green. This is opposite to how one typically thinks of FRET with the warmer color being the acceptor not the donor. Moreover, the pH 6 condition is also colored the same shade of red as the ANAP. Labels of Cys positions would again be useful here. In Figure 3, the heteroatoms of TETAC and C18-NTA are very small and difficult to see. It would also be good to label these structures, and the spectra below, so the reader can tell at a glance without looking at the caption, what the structures and spectra arise from. Also, how are the absorption spectra normalized? This is not discussed in the methods. The lack of attention to presentation mars an otherwise nice study.

      Thank you for these points. We have made modifications to the manuscript to address these comments.

      Abstract, second last line "Aker prolonged acidification, ...", 'prolonged' could be interpreted as 'it takes a while for the domain to move' or 'the movement only happens aker a while'. This not what the authors intend to convey. Consider modifying to just 'Aker acidification,'

      We updated the main text to indicate that prolonged acidification is intended to describe acidification that occurs over the minutes timescale.

      Pdf page 6, bottom para on Anap incorporation not altering channel function: What is meant by 'steady state pH dependence of activation'? This implies the authors applied a pH stimulus, then waited until equilibrium was achieved ie. until desensitization was complete and measured the current at that point. It seems more likely they simply applied different pH stimuli and measured the peak response and that the use of 'steady state' here is a typo.

      We removed the phrase steady state.

      Same section, controls of electrophysiology allude to 485, 505 and 515 ANAP-containing channels. In fact, the authors have no way of determining what fraction (if any) of the pH evoked currents arise from channels containing Anap in those positions versus from simply having a translation stop but still functioning. This should be mentioned.

      This is correct. We cannot be sure the CTD TAG positions are not a mixture of ANAP-containing channels and truncations. See above for why we do not think this a big concern for the FRET experiments. Functionally, though, you are correct that we cannot tell. We now mention this in the paper.

      Methods, the abbreviation for SBT should be defined somewhere.

      Added.

      Methods, unroofing section, middle paragraph, the authors use nM not nm to list wavelengths of light.

      Changed.

      Figure 3C-D: There's an unexpected blip in the Anap emission spectra at ~500 nm. Are the grating efficiency of the spectrograph and quantum efficiency of the camera accounted for in these spectra?

      This is a good question. The data are not corrected for either camera efficiency or grating efficiency. We don’t have easy access to the actual data (although we can see a pdf version of each). There is a liVle blip in the grating efficiency graph that could partly explain the blip in our spectra.

      Figure 5C, were recovery experiments routinely done? If so, would be good to show more than n = 1 in the plot to get an idea of reproducibility.

      Recovery experiments were done in every experiment but are not shown for simplicity. We have included all FRET and recovery data for position Q14TAG-C469 at pH 6 in figure 5C to show reproducibility of our FRET and recovery data.

      Table 1, considering adding a Δ distance column (pH 8 versus 6) so the magnitude of changes are more easily seen.

      This is a reasonable suggestion but we decided not to include a Δ distance column. The data are whole numbers and people can easily determine the Δ distance. We felt that including that column would bring too much focus on what we think are preVy small changes. Our hope is that readers take away that the data are not consistent with complex formation between the determine and focus less on absolute distances.

      Figure 7A, Q14tag pH 8 condition has a quite a bit of spread and, likely, two populations. These data, as well as G11, are unlikely to be parametric and hence ANOVA is inappropriate. A normality test, and likely Kruskal-Wallis test is called for.

      Aker testing for normality, the data for Q14TAG C485 pH8 are non-normally distributed. However, a Kruskal Wallis is a non-parametric test for a one-way ANOVA and not applicable here. We separated the data out into population 1 and 2 and repeated the two-way ANOVA statistical test. When Q14TAG pH 8 is split into 2 populations, the statistics hardly change. When the data is not separated, Q14TAG pH 8 relative to pH 6 has a p-value <0.0001. When the 2 populations are separated, both populations relative to Q14TAG pH 6 still have a p-value of <0.0001.

    1. Reviewer #1 (Public Review):

      Summary:<br /> These types of analyses use many underlying assumptions about the data, which are not easy to verify. Hence, one way to test how the algorithm is performing in a task is to study its performance on synthetic data in which the properties of the variable of interest can be apriori fixed. For example, for burst detection, synthetic data can be generated by injected bursts of known durations, and checking if the algorithm is able to pick it up. Burst detection is difficult in the spectral domain since direct spectral estimators have high variance (see Subhash Chandran et al., 2018, J Neurophysiol). Therefore, detected burst lengths are typically much lower than injected burst lengths (see Figure 3). This problem can be solved by doing burst estimation in the time domain itself, for example, using Matching Pursuit (MP). I think the approach presented in this paper would also work since this model is also trained on data in the time domain. Indeed, the synthetic data can be made more "challenging" by injecting multiple oscillatory bursts that are overlapping in time, for which a greedy approach like MP may fail. It would be very interesting to test whether this method can "keep up" as the data is made more challenging. While showing results from brain signals directly (e.g., Figure 7) is nice, it will be even more impactful if it is backed up with results obtained from synthetic data with known properties.

      I was wondering about what kind of "synthetic data" could be used for the results shown in Figure 8-12 but could not come up with a good answer. Perhaps data in which different sensory systems are activated (visual versus auditory) or sensory versus movement epochs are compared to see if the activation maps change as expected. We see similarities between states across multiple runs (reproducibility analysis) and across tasks (e.g. Figure 8 vs 9) and even methods (Figure 8 vs 10), which is great. However, we should also expect the emergence of new modes specific to sensory activation (say auditory cortex for an auditory task). This will allow us to independently check the performance of this method.

      The authors should explain the reproducibility results (variational free energy and best run analysis) in the Results section itself, to better orient the reader on what to look for.

      Page 15: the comparison across subjects is interesting, but it is not clear why sensory-motor areas show a difference and the mean lifetime of the visual network decreases. Can you please explain this better? The promised discussion in section 3.5 can be expanded as well.

    1. I'm tempted to say you can look at uh broadscale social organization uh or like Network Dynamics as an even larger portion of that light 00:32:43 cone but it doesn't seem to have the same continuity well I don't you mean uh it doesn't uh like first person continuity like it doesn't like you think it doesn't it isn't like anything to be 00:32:55 that social AG agent right and and we we both are I think sympathetic to pan psychism so saying even if we only have conscious access to what it's like to be 00:33:08 us at this higher level like it's there's it's possible that there's something that it's like to be a cell but I'm not sure it's possible that there's something that there's something it's like to be say a country
      • for: social superorganism - vs human multicellular being, social superorganism, Homni, major evolutionary transition, MET, MET in Individuality, Indyweb, Indranet, Indyweb/Indranet, CCE cumulative cultural evolution, symmathesy, Gyuri Lajos, individual/collective gestalt, interwingled sensemaking, Deep Humanity, DH, meta crisis, meaning crisis, polycrisis

      • comment

        • True, there is no physical cohesion that binds human beings together into a larger organism, but there is another dimension - informational cohesion.
        • This informational cohesion expresses itself in cumulative cultural evolution. Even this very discussion they are having is an example of that
        • The social superorganism is therefore composed of an informational body and not a physical one and one can think of its major mentations as collective, consensual ideas such as popular memes, movements, governmental or business actions and policies
        • I slept on this and this morning, realized how salient Adam's question was to my own work
          • The comments here build and expand upon what I thought yesterday (my original annotations)
          • The main connections to my own sense-making work are:
            • Within our specific human species, the deep entanglement between self and other (the terminology that our Deep Humanity praxis terms the "individual / collective gestalt")
            • The Deep Humanity / SRG claim that the concurrent meaning / meta / poly crisis may be an evolutionary test foreshadowing the next possible Major Evolutionary Transition in Individuality.<br /> - https://jonudell.info/h/facet/?max=100&expanded=true&user=stopresetgo&exactTagSearch=true&any=MET+in+Individuality
              • As Adam notes, collective consciousness may be more a metaphorical rather than a literal so a social superorganism, (one reference refers to it as Homni
              • may be metaphorical only as this higher order individual lacks the physical signaling system to create a biological coherence that, for instance, an animal body possesses.
              • Nevertheless, the informational connections do exist that bind individual humans together and it is not trivial.
              • Indeed, this is exactly what has catapulted our species into modernity where our cumulative cultural evolution (CCE) has defined the concurrent successes and failures of our species. Modernity's meaning / meta / polycrisis and progress traps are a direct result of CCE.
              • Humanity's intentions and its consequences, both intended and unintended are what has come to shape the entire trajectory of the biosphere. So the impacts of human CCE are not trivial at all. Indeed, a paper has been written proposing that human information systems could be the next Major System Transition (MST) that could lead to another future MET that melds biotic and abiotic
              • This circles back to Adam's question and what has just emerged for me is this question:
                • Is it possible that we could evolve in some kind of hybrid direction where we are biologically still separate individuals BUT deeply intertwingled informationally through CCE and something like the theoretical Indyweb/Indranet which is an explicit articulation of our theoretical informational connectivity?
                • In other words, could "collective consciousness be explicitly defined in terms of an explicit, externalized information system reflecting intertwingled individual/collective learning?
            • The Indyweb / Indranet informational laminin protein / connective tissue that informationally binds individuals to others in an explicit, externalized means of connecting the individual informational nodes of the social superorganism, giving it "collective consciousness" (whereas prior to Indyweb / Indranet, this informational laminin/connective tissue was not systematically developed so all informational connection, for example of the existing internet, is incomplete and adhoc)
            • The major trajectory paths that global or localized cultural populations take can become an indication of the behavior of collective consciousness.
              • Voting, both formal and informal is an expression of consensus leading to consensual behavior and the consensual behavior could be a reflection of Homni's collective consciousness
      • insight

        • While socially annotating this video, a few insights occurred after last night's sleep:
          • Hypothes.is lacks timebound sequence granularity. Indyweb / Indranet has this feature built in and we need it for social annotation. Why? All the information within this particular annotation cannot be machine sorted into a time series. As the social annotator, I actually have to point out which information came first, second, etc. This entire comment, for instance was written AFTER the original very short annotation. Extra tags were updated to reflect the large comment.
          • I gained a new realization of the relationship and intertwingularity of individual / collective learning while writing and reflecting on this social annotation. I think it's because of Adam's question that really revolves around MET of Individuality and the 3 conversant's questioning of the fluid and fuzzy boundary between "self" and "other"
            • Namely, within Indyweb / Indranet there are two learning pillars that make up the entirety of external sensemaking:
              • the first is social annotation of the work of others
              • the second is our own synthesis of what we learned from others (ie. our social annotations)
            • It is the integration of these two pillars that is the sum of our sensemaking parts. Social annotations allow us to sample the edge of the sensemaking work of others. After all, when we ingest one specific information source of others, it is only one of possibly many. Social annotations reflect how our whole interacts with their part. However, we may then integrate that peripheral information of the other more deeply into our own sensemaking work, and that's where we must have our own central synthesizing Indyweb / Indranet space to do that work.
            • It is this interplay between different poles that constitute CCE and symmathesy, mutual learning.
            • adjacency between
              • Indyweb / Indranet name space
              • Indranet
              • automatic vs manual references / citations
            • adjacency statement
              • Oh man, it's so painful to have to insert all these references and citations when Indranet is designed to do all this! A valuable new meme just emerged to express this:
                • Pain between the existing present situation and the imagined future of the same si the fuel that drives innovation.
      • quote: Gien

        • Pain between an existing present situation and an imagined, improved future is the fuel that drives innovation.
      • date: 2023, Nov 8
    1. Provide our service to you: The reason we process your information for purposes A, B and C above is to perform the contract that you have with us. For instance, as you go about using our service to build meaningful connections, we use your information to maintain your account and your profile, make it viewable to other members and recommend other members to you and to otherwise provide our free and paid features to you and other members.Legitimate interests: We process your information for purposes D, E and F above, based on our legitimate interest. For instance, we analyze users’ behavior on our services to continuously improve our offerings, we suggest offers we think might interest you and promote our own services, we process information to help keep our members safe and we process data where necessary to enforce our rights, assist law enforcement and enable us to defend ourselves in the event of a legal action.Comply with applicable laws and regulations: We process your information for purpose G above where it is necessary for us to comply with applicable laws and regulations and evidence our compliance with applicable laws and regulations. For example, we retain traffic data and data about transactions in line with our accounting, tax and other statutory data retention obligations and to be able to respond to valid access requests from law enforcement. We also keep data evidencing consents members give us and decisions they may have taken to opt-out of a given feature or processing.Consent: If you choose to provide us with information that may be considered “special” or “sensitive” in certain jurisdictions, such as your sexual orientation, you’re consenting to our processing of that information in accordance with this Privacy Policy. From time to time, we may ask for your consent to collect specific information such as your precise geolocation or use your information for certain specific reasons. In some cases, you may withdraw your consent by adapting your settings (for instance in relation to the collection of our precise geolocation) or by deleting your content (for instance where you entered information in your profile that may be considered “special” or “sensitive”). In any case, you may withdraw your consent at any time by contacting us at the address provided at the end of this Privacy Policy.

      Na przykład analizujemy zachowania użytkowników w naszych usługach, aby stale ulepszać naszą ofertę, sugerujemy oferty, które naszym zdaniem mogą Cię zainteresować i promować nasze własne usługi,

    1. When does annotating books become a distraction? .t3_17pitv9._2FCtq-QzlfuN-SwVMUZMM3 { --postTitle-VisitedLinkColor: #8c8c8c; --postTitleLink-VisitedLinkColor: #8c8c8c; --postBodyLink-VisitedLinkColor: #989898; }

      reply to u/Low-Appointment-2906 at https://www.reddit.com/r/books/comments/17pitv9/when_does_annotating_books_become_a_distraction/

      Through the middle ages, bookmakers would not only leave significant margins for readers to annotate, but they also illuminated books and included drolleries which readers in the know would use in conjunction with the arts of memory (from rhetoric) to memorize portions of texts more easily. I strongly suspect this isn't what booktokkers are doing; their practice is likely more like the sorts of decorative #ProductivityPorn one sees in the Bullet journal and journaling spaces. It's performative content creation.

      Those interested in refining their practices of "reading with a pen in hand", continuing the "great conversation" or having "conversations with their texts" might profitably start with Mortimer J. Adler's essay: “How to Mark a Book” (Saturday Review of Literature, July 6, 1941). In his 1975 KCET series How to Read a Book, which was based on their book of the same name, Adler mentioned to Charles Van Doren that he would buy new copies of books so he could re-annotate them without being distracted by his older annotations.

      Some have solved the problem of distracting annotations by interleaving their books so they've got lots of blank space to write their notes. It's a rarer practice now, but some publishers still print Bibles with blank pages every other page for this practice. Others put their annotations and notes into commonplace books or on index cards for their card index/zettelkasten.

      As some have mentioned, friends and lovers through time have shared books with annotations as a way of sharing their thoughts. George Custer and his wife Elizabeth did this with Tennyson.

      If you're interested in annotating digitally online, perhaps check out Hypothes.is where I've seen teachers and students using social annotation to read and make sense of books [example]. I've also seen groups of people use this tool for hosting online book groups/clubs.

      If you're in it for fun, you might appreciate:

      And those wishing to delve more deeply into the history and power of annotation might look at: Kalir, Remi H., and Antero Garcia. Annotation. The MIT Press Essential Knowledge Series. MIT Press, 2019. https://mitpressonpubpub.mitpress.mit.edu/annotation.

      Good luck annotating! 📝

    1. Others attribute this fall to another cause, which seems to have some relation to the case of Adam, but falsehood makes up the greater part of it. They say that the husband of Aataentsic, being very sick, dreamed that it was necessary to cut down a certain tree from which those who abode in Heaven obtained their food; and that, as soon as he ate of the fruit, [page 127] he would be immediately healed. Aataentsic, knowing the desire of her husband, takes his axe and goes away with the resolution not to make two trips of it; but she had no sooner dealt the first [88] blow than the tree at once split, almost under her feet, and fell to this earth; whereupon she was so astonished that, after having carried the news to her husband, she returned and threw herself after it. Now, as she fell, the Turtle, happening to raise her head above water, perceived her; and, not knowing what to decide upon, astonished as she was at this wonder, she called together the other aquatic animals to get their opinion. They immediately assembled; she points out to them what she saw, and asks them what they think it fitting to do. The greater part refer the matter to the Beaver, who, through courtesy, hands over the whole to the judgment of the Turtle, whose final opinion was that they should all promptly set to work, dive to the bottom of the water, bring up soil to her, and put. it on her back. No sooner said than done, and the woman fell very gently on this Island. Some time after, as she was with child when she fell, she was delivered of a daughter, who almost immediately became pregnant. If you ask them how, you puzzle them very much. At all events, they tell you, she was pregnant. Some throw the blame upon some strangers, [89] who landed on this Island. I pray you make this agree with what they say, that, before Aataentsic fell from the Sky, there were no men on earth. However that may be, she brought forth two boys, Tawiscaron and Iouskeha, who, when they grew up, had some quarrel with each other; judge if this does not relate in some way to the murder of Abel. They came to blows, but with very different [page 129] weapons. Iouskeha had the horns of a Stag; Tawiscaron, who contented himself with some fruits of the wild rosebush, was persuaded that, as soon as he had struck his brother, he would fall dead at his feet. But it happened quite differently from what he had expected; and Iouskeha, on the contrary, struck him so rude a blow in the side, that the blood came forth abundantly. This poor wretch immediately fled; and from his blood, with which the land was sprinkled, certain stones sprang up, like those we employ in France to fire a gun,—which the Savages call even to-day Tawiscara, from the name of this unfortunate. His brother pursued him, and finished him. This is what the greater part believe concerning the origin of these Nations.

      What a crazy story

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1 (Recommendations for The Authors)

      MAJOR CONCERNS

      1) Not addressed, but perhaps relevant, is that most of the postembryonic fish growth results from stem cells located in the ciliary marginal zone that make new neurons and Muller glia throughout the fish's life. Thus, Muller cell heterogeneity may result from the central to the peripheral gradient of Muller glial cell maturation.

      1a. Müller glial cell heterogeneity needs to be confirmed using, for example, in situ hybridization studies with gene-specific probes identified in the scRNAseq that distinguish these 2 populations. An additional approach could be the use of transgenic lines harboring tagged endogenous or transgene that reflects the promoter activity of the Muller glia subtypespecific gene.

      We thank the reviewer for the insightful comments and agree on the importance to substantiate the Müller glia heterogeneity in our manuscript. Our study is not the only study that provides evidence for Müller glia heterogeneity. In particular, we would like to refer to a recent publication (Krylov et al., 2023). Using single cell RNA sequencing, Krylov et al. detect Müller glia heterogeneity in the uninjured retina, as well as upon selective, genetic ablation of distinct subtypes of photoreceptors (e.g. long and short wavelength sensitive cones, as well as rods). They observe six distinct clusters of quiescent Müller glia that show differential spatial distribution along the dorsal/ventral retinal axis. For instance, they report a ventral quiescent Müller glia population that shares some marker genes (aldh1a3, rdh10a, smoc1) with our nonreactive Müller glia 2 (cluster 2, supplementary files 1 and 2). Moreover, the authors report that Müller glia located at different positions along the dorsal/ventral axis exhibit distinct patterns of pcna upregulation as well as subsequent re-activation upon photoreceptor ablation. We have added the supportive information from Krylov et al. in the discussion section (lines: 781-789) of our manuscript.

      2) Most interesting, but also least substantiated, is the authors' report of 2 different quiescent Muller glial cell populations in the uninjured retina and 2 different reactive Muller cell populations in the injured retina. If these populations exist independently of each other, it would be important to investigate if they differentially impacted retina regeneration.

      2a. CRISPR knockdown in F0 of factors thought to be involved in specific Müller glia-derived progenitor trajectories would be important to lend some functional significance to the data.

      We fully agree with the reviewer that addition of functional data would enrich the manuscript with valuable information. However, we don´t believe that the suggested CRISPR knockdown of selected genes in F0 animals (also known as crispants) represents a suitable approach. Crispants have been used successfully to investigate genetic contributions in embryonic-tolarval stages (the first few days) of zebrafish development, as injection of multiple gRNAs targeting the same gene is sufficient to achieve a bi-allelic knockout of the gene of up to 90% (Kroll et al., 2021). However, unless both alleles of the target gene(s) is/are mutated already early on with nearly 100%, it is unlikely that the gRNA inactivation would work equally well during subsequent development into adult stages (several months later, and after exponential growth and volume increase of the animal). Even if biallelic inactivation in the crispants does work early on, it remains unclear whether and how crispants survive to adulthood, which will be necessary in order to address gene function in the context of retina regeneration. Moreover, since we observe that the genetic events during adult retina regeneration are highly similar to the events during retina development, we would rather expect the crispants already display developmental phenotypes, which would further hamper the study of potential regenerationspecific phenotypes in adult animals. We are convinced that only ‘clean’ conditional gene inactivation studies will be suitable to address the impact of Müller glia and derived progenitor trajectories on retina regeneration. In this respect, we have recently developed the new conditional Cre-Controlled CRISPR mutagenesis system (Hans et al., Nature Comm 2021). We are currently establishing stable lines to enable controlled and specific gene inactivation, but have only obtained preliminary results so far; the final analysis will take much more time and is, therefore, beyond the scope of this work.

      3) The discussion should be modified to relate the data here presented with those described in Hoang et al., 2020.

      We followed the suggestions of the reviewer and compared our single cell RNA sequencing dataset to that described in Hoang et al., 2020. As one might expect, the comparison between the two datasets showed similarities but also significant differences due to the different experimental set-ups. We show the results of this comparison in additional main (new Figure 9) and supplementary figures (new Figure 9-figure supplement 1). In order to compare our newly obtained scRNAseq dataset of MG and MG-lineage-derived cells of the regenerating zebrafish retina to the previously published dataset of light-lesioned retina (Hoang et al., 2020), we employed the ingestion method (Scanpy, https://scanpy-tutorials.readthedocs.io/en/latest/ integrating-data-using-ingest.html) and mapped the clusters identified by Hoang and colleagues to our clusters (new Figure 9). While we applied a short-term lineage tracing strategy and only sequenced the enriched population of FAC-sorted MG and MG-derived cells of the regenerating zebrafish retina, Hoang and colleagues sequenced all retinal cells in the light-lesioned retina. Consequently, comparison between the two datasets uncovered similarities, but also significant differences, due to the different experimental set-ups (Figure 9A). Consistently, the cluster annotated as resting MG in Hoang et al. mapped to clusters annotated as non-reactive MG 1 and 2 in our dataset (new Figure 9B). The cluster annotated as activated MG in Hoang et al. mapped to clusters annotated as reactive MG 1 and 2, as well as to the cluster with hybrid identity of MG/progenitors in our dataset. Interestingly, some cells annotated as activated MG in Hoang et al. mapped also to neurogenic progenitor 2 and 3 clusters in our dataset (Figure 9B). The cluster annotated as progenitors in Hoang et al. mapped to the progenitor area in our dataset, which included neurogenic progenitors 2, 3 as well as photoreceptor and horizontal cell precursors (new Figure 9B). Finally, retinal ganglion cells, cones, GABAergic amacrine cells and bipolar cells annotated in Hoang et al. perfectly mapped to retinal ganglion cells, cone, amacrine and bipolar cells in our dataset (new Figure 9B). While we did not detect a mature horizontal cell cluster, Hoang and colleagues annotated a horizontal cell cluster, which cells mapped to reactive MG 2, MG/progenitors 1 and part of progenitors 3 in our dataset (new Figure 9B). Moreover, Hoang and colleagues annotated rod photoreceptors that mapped to progenitors 3, photoreceptor precursors, red and blue cones, horizontal cell precursors and bipolar cells in our dataset (new Figure 9B). Finally, due to the different cell isolation protocol, Hoang and colleagues annotated additional cell clusters that did not map to any cluster in our more selective dataset, and included oligodendrocytes, pericytes, retinal pigmented epithelial cells as well as vascular/endothelial cells (new Figure 9B). Next, we selected representative marker genes per cluster from our scRNAseq dataset and checked their expression in the dataset by Hoang and colleagues (Figure 9-figure supplement 1). The dot plot showing the expression of selected gene candidates per cluster further corroborated the large overlap between clusters annotated in the present study with those annotated in the study by Hoang and colleagues. These novel comparisons to the data of Hoang et al. are now included in the resubmitted version, and are described and discussed in an additional paragraph in the results (lines: 482-517) as well as discussion (lines: 766-807) sections.

      MINOR CONCERNS

      1) Fig 1C is difficult to interpret. I am also confused by the color coding which is not presented in the figure legend - why 3 shades of red and two of blue? Please define each (for example, what's the difference between red, purple, and light red in the 6dpl panel?). What are the white areas outlined by blue and red circles/cells (looks like a topography plot)? It appears that there is a fairly large amount of pcna:EGFP expression in the uninjured retina - what are these cells?

      We have replaced Figure 1C with a better one and rephrased/extended the explanation of the figure in the results (lines: 192-195). Figure 1C depicts contour plots, which represent the relative frequency of data. Each contour line encloses an equal percentage of events (that is, cells), and contour lines that are closely packed indicate a high concentration of events. In flow cytometry, contour plots are used to represent highly frequent events, as this kind of plots are independent on sample size.

      Concerning the observed pcna:EGFP expressing cells in the uninjured retina, we interpret them as proliferating cells coming from the ciliary marginal zone and from Müller glia of the central retina, which represent progenitors and Müller glia that have re-entered the cell cycle to generate rod progenitors, respectively. Consistent with that, we observe pcna:EGFPpositive cells in the ciliary marginal zone as well as central retina using immunofluorescence, as shown in Figure 1-figure supplement 1.

      2) Results, lines 186-188 are not presented clearly: EGFP+ cells may persist for some time after they leave the cell cycle, so stating EGFP+ cells are proliferating may not be correct. How long does PCNA promoter activity and EGFP expression remain after Muller cells exit the cell cycle? mCherry+/EGFP- cells may be non-reactive Muller glia or reactive Muller glia that have not entered the cell cycle. It seems likely that Muller glia start reprogramming before undergoing cell division.

      We agree with the reviewer that EGFP persists for some time after the cells have left the cell cycle, which we actually describe and use to benefit in our study. We do not know for how long exactly the pcna promoter is active within the cell cycle, but EGFP is known to have a half-life of approximately 24 hours (Li et al., 1998). Even though we cannot make a statement about EGFP persistence in Müller glia, we note that previous reports (Lahne et al., 2015; Nagashima et al., 2013; Nelson et al., 2013; Thummel et al., 2008) and our study (Figure 3-figure supplement 2) show PCNA at the protein level in Müller glia cells between 24 and 48 hpl, including our sampled 44 hpl time point (lines: 69-73). We also agree with the reviewer that Müller glia will become reactive to the injury most likely prior (lines: 67-69) to activation of the pcna promoter, meaning that Müller glia are EGFP-negative at this time point due to the immature status of EGFP after translation. However, we are confident that our data also comprises this cell state (early phase of Müller glia activation) because we sampled proliferating (EGFP- and mCherry-double positive cells) as well as non-proliferating Müller glia (mCherry-only positive cells) at all time points (lines: 213-215 and Figure 1C). We interpret that the early phase of Müller glia activation corresponds to Müller glia transitioning from a nonreactive to a reactive state. With respect to our UMAP, we map this cell state in cluster 1 localizing to the top left part of the cluster, abutting cluster 3, the reactive Müller glia 1 (Figure 2B).

      3) I am concerned by the observation that microglia were identified by scRNAseq as a contaminating cell population. Since FACS was based on gfap:mCherry expression, why did microglia end up in the mix? Also, what are the ‘...low-quality cells expressing many ribosomal transcripts...’ and why, if they are low-quality cells, did they pass the sequencing quality control as stated on lines 208-209?

      The reviewer is right that microglia should actually not end up in the sample when using the gfap:mCherry line. However, microglia always displayed a certain level of autofluorescence in our experimental set-up (possibly because they may have ingested some cell debris), which may have contributed to their presence in the FACS samples. In contrast to the reviewer, we were not concerned about this ‘contamination’, because the microglia could be easily identified and sorted out using bioinformatics. This is supported by the presented supplementary figure in which microglia separate from the core of clusters containing Müller glia and Müller gliaderived cells in the UMAP of the full dataset (Figure 2-figure supplement 1).

      We also acknowledge that ‘low quality cells’ is not an appropriate term for cells in the cluster expressing ribosomal mRNAs at high levels, as ribosomal enrichment actually does not give any information concerning their quality. We referred to them as ‘low quality’ because the enrichment in ribosomal transcripts masks their identity considerably. To correct this, we now renamed cells in this cluster descriptively as ‘ribosomal gene-enriched’ cells (Figure 2-figure supplement 1, line: 226).

      4) Fig. 2: please list in the text or fig legend the specific genes used to identify each cell cycle state. Why is cluster 3 considered a reactive Muller population when expressing S phase markers and PCNA? These features seem to distinguish cluster 3 from 4 and may suggest cluster 3 is a progenitor population. Further explanation is necessary to understand the assignments.

      Information about the specific genes used to identify each cell cycle state is provided in the paragraph “Bioinformatic analysis” (lines: 925-934) in the Materials and Methods section. We considered listing all the markers in either the results or the figure legends as well, but decided against it, as it impairs readability in our opinion. Nevertheless, we have now highlighted also in the results (line: 261) that the list of cell cycle markers is available in the Materials and Methods section.

      We understand the reviewer´s point that cluster 3 represents progenitors and not Müller glia, when PCNA expression is considered as a sole marker of progenitors or of Müller glia reprogrammed to a progenitor state (Hoang et al., 2020). However, we disagree with this view for three reasons. First, although PCNA is used as a marker of Müller glia reprogrammed to a progenitor state and of progenitors in Hoang et al., 2020, it should be noted that PCNA-positive, Müller glia cells are present in the central retina already in uninjured conditions, when regeneration-associated, Müller glia-derived progenitors are not detectable. Second, cluster 3 is evident only at 44 hpl, a time point at which Müller glia cells are about to divide or have undergone their first and only cell division. In this regard, we would like to refer to the discussion about Müller glia and Müller glia-derived progenitors as distinct populations in Lenkowski and Raymond, 2014. Third, we have performed in situ hybridization for starmaker (stm), a marker gene highly specific for cells in cluster 3 (supplementary files 1 and 3), combined with immunohistochemistry for GFAP and PCNA. The results of the staining are depicted in a new Figure 3-figure supplement 2. In strong agreement with our sequencing results, we observe stm expression only at 44 hpl, whereas no signal is detected in the uninjured as well as 4 and 6 dpl retina (Figure 3- figure supplement 2). Virtually all stm-positive cells at 44 hpl are also PCNA- and GFAP-double positive cells displaying a clear Müller glia morphology (Figure 3- figure supplement 2). Hence, we interpret cells in cluster 3 as reactive Müller glia, indicating that pcna can be used as a marker of progenitors, but not exclusively of progenitors, prevalently at later stages. At 44 hpl, Müller glia express pcna in order to undergo asymmetric cell division giving rise to the renewed Müller glia and the multipotent progenitor that will continue dividing.

      5) I am confused by the crlf1a scRNAseq data indicating it is associated with proliferating PCNA+ reactive Muller glia Cluster 3 and PCNA- reactive Muller glia Cluster4 at 44 hpl (Fig. 3), yet in Fig. 4 crlf1a in situ signal is exclusively associated with proliferating Muller glia at 44 hpl. Why don't we observe the crlf1a+/PCNA- cell population?

      We highlight that crlf1a expression is actually detected also at 4 dpl (Fig. 3). We also note that immunofluorescence in Fig 3. shows crlf1a mRNA and PCNA protein, whereas single cell RNA sequencing detects crlf1a and pcna transcripts. In this context, it is possible that crlf1a-, PCNAdouble positive cells detected at 4 dpl are still positive for the PCNA protein, but no longer express the pcna transcript. Double in situ hybridization for pcna and crlf1a would be needed to fully address whether crlf1a-positive cells are still pcna-positive at 4 dpl. It is also possible that crlf1a-, GFAP-double positive, PCNA-negative Müller glia are fewer and only masked in the crowd of crlf1a-, PCNA-double positive, GFAP-negative progenitors at 4 dpl (Raymond et al., 2006). We amended the discussion section with this information (lines: 634-654).

      6) scRNAseq cluster 3 is a proliferating population that is assigned "reactive Muller glia", whereas cluster 5 is assigned Muller glia/progenitor and in the Discussion referred to as MG about to go or already underwent asymmetric division to generate a progenitor (lines 568-571). I don't understand why cluster 3 is not referred to as the one harboring reactive MG/progenitors that underwent or are undergoing asymmetric cell division - The timing is right, as are the markers.

      We would like to refer the reviewer to the discussion in point 4, including the changes we introduced in the Materials and Methods (Lines 925-934). As mentioned above, we do not agree that PCNA alone represents an exclusive marker of progenitors, but is rather a marker of cells undergoing proliferation. Moreover, we note that Müller glia first and only division occurs between 31 and 48 hpl. Finally, as mentioned above, expression of stm is a unique marker for cluster 3, which is only evident at 44 hpl, but not of cluster 5, which is evident at 4 dpl.

      It seems cluster 5 might better fit the amplifying progenitor stage where some MG markers are retained but diluted by cell division. Please clarify the reasoning behind the labeling of this cluster. It is not clear why this cluster has to contain self-renewed Muller glia - why wouldn't these Muller cells partition to quiescent MG clusters 1 and 2 or reactive Muller glia in clusters 3 and 4?

      We partially agree with the reviewer that cluster 5 might better fit the amplifying progenitor state, and this is why we indicate this cluster as a “crossroad in the trajectory” in the discussion (lines: 613-631). However, we cannot entirely exclude that cells in cluster 5 contain selfrenewed Müller glia (differential gene expression analysis highlights glial markers too, see Figure 3A, supplementary file 6). Cells that we interpret as self-renewing Müller glia do not partition back to quiescent Müller glia (cluster 1 and 2) because they are on the way to be quiescent Müller glia again, yet they did not reach that point, maybe due to sampling reasons. Unfortunately, our short-term lineage tracing strategy ceases at 6 dpl. We also speculate in the discussion (lines: 679-682) that if we had sampled at later time points (e.g. at 14 dpl), we might have been able to detect the density of the cells in the glial area moving back to clusters 1 or 2 (cell density plots, Figure 2B).

      I also have trouble understanding cluster 4's assignment. The Discussion states it represents cells at the crossroad of glial and neurogenic trajectory containing self-renewed Muller glia as well as first-born MG-derived progenitors. However, it is populated by cells after 44 hpl (Fig. 2B) which is when reactive Muller glia are detected and lacks proliferative markers.

      We think that there is a misunderstanding here. We never refer to cluster 4 as a crossroad in the glial and neurogenic trajectory. We state that cluster 5 is actually the crossroad between the two trajectories (line 629). We further propose that self-renewed MG close the cycle via late reactive MG (cluster 4) and return into non-reactive Müller glia (clusters 1 and 2, red, dashed line in Figure 10) (now described in lines 631-633). The cell density plots support the direction of the cycle closing towards non-reactive Müller glia, in particular at 4 and 6 dpl (Figure 2B).

      Might cluster 4 represent a population of reactive MG remaining at 4 dpl that never entered the cell cycle and therefore would be devoid of Muller glia-derived progenitors?

      As stated in the manuscript, we actually think that marker expression as well as the cell density plots support our assignment of cluster 4 to represent self-renewed Müller glia closing the cycle to non-reactive Müller glia. Our assignment also fits well with the expected events following asymmetric cell division. However, as we cannot rule out the reviewer´s entire idea, we included the suggestion in the updated discussion (lines 651-654).

      7) Results, lines 163-164; Please provide a reference for "..... consistent with the previously described....."

      We thank the reviewer for this observation and we added the appropriate references (Fimbel et al., 2007; Lenkowski and Raymond, 2014; Thummel et al., 2008) in the updated version of the manuscript (lines: 171-172).

      Reviewer #2 (Recommendations For The Authors):

      Overall, this very thorough study provides interesting and unexpected results. The published data set will be useful for many subsequent studies. I have only a few remarks that the authors may consider discussing. Their cluster analysis revealed most of the expected cell clusters with some interesting surprises. One relates to photoreceptors where the authors describe well-separated clusters for red and green cones, while rods, UV and blue cones do not form clusters. For rods, this is discussed, but I miss a brief discussion on the "missing" cone subtypes.

      We thank the reviewer for the insightful comments. It is correct that we indeed detect only red and blue cones, as indicated by their expression of red-sensitive opsin gene (opn1lw2) and the blue-sensitive opsin gene (opn1sw2), respectively. It is possible that missing cone subtypes are born later than 6 dpl. As the reviewer suggested, we amended the discussion and added information about the missing cone subtypes (lines: 724-726).

      I am also intrigued by the two, quite separated amacrine cell clusters, while bipolar cells cluster in one cluster, without separation in (say) ON and OFF bipolar cells. This may also merit a discussion. What are their ideas on the small and quite separated amacrine cell cluster (cluster 14).

      Bipolar cells in cluster 15 are very sparse in our dataset, with only 40 cells in total. Hence, the sample size might be too small to be separated into ON and OFF subtypes. Alternatively, cells might be still immature, as we use 6 dpl as our latest sampled time point. Concerning cells in cluster 14, we think they are starburst amacrine cells, as indicated by their simultaneous expression of gad1b and chata (Figure 8-figure supplement 2B), which is a characteristic feature of starburst amacrine cells in mouse (O´Malley et al., 1992). We added this observation in the discussion (lines: 706-712).

    1. Author Response

      The following is the authors’ response to the previous reviews

      Reviewer #1 (Public Review):

      Comments on the original submission:

      Trypanosoma brucei undergoes antigenic variation to evade the mammalian host's immune response. To achieve this, T. brucei regularly expresses different VSGs as its major surface antigen. VSG expression sites are exclusively subtelomeric, and VSG transcription by RNA polymerase I is strictly monoallelic. It has been shown that T. brucei RAP1, a telomeric protein, and the phosphoinositol pathway are essential for VSG monoallelic expression. In previous studies, Cestari et al. (ref. 24) has shown that PIP5pase interacts with RAP1 and that RAP1 binds PI(3,4,5)P3. RNAseq and ChIPseq analyses have been performed previously in PIP5pase conditional knockout cells, too (ref. 24). In the current study, Touray et al. did similar analyses except that catalytic dead PIP5pase mutant was used and the DNA and PI(3,4,5)P3 binding activities of RAP1 fragments were examined. Specifically, the authors examined the transcriptome profile and did RAP1 ChIPseq in PIP5pase catalytic dead mutant. The authors also expressed several C-terminal His6-tagged RAP1 recombinant proteins (full-length, aa1300, aa301-560, and aa 561-855). These fragments' DNA binding activities were examined by EMSA analysis and their phosphoinositides binding activities were examined by affinity pulldown of biotin-conjugated phosphoinositides. As a result, the authors confirmed that VSG silencing (both BES-linked and MES-linked VSGs) depends on PIP5pase catalytic activity, but the overall knowledge improvement is incremental. The most convincing data come from the phosphoinositide binding assay as it clearly shows that N-terminus of RAP1 binds PI(3,4,5)P3 but not PI(4,5)P2, although this is only assayed in vitro, while the in vivo binding of full-length RAP1 to PI(3,4,5)P3 has been previously published by Cestari et al (ref. 24) already. Considering that many phosphoinositides exert their regulatory role by modulate the subcellular localization of their bound proteins, it is reasonable to hypothesize that binding to PI(3,4,5)P3 can remove RAP1 from the chromatin. However, no convincing data have been shown to support the author's hypothesis that this regulation is through an "allosteric switch".

      Comments on revised manuscript:

      In this revised manuscript, Touray et al. have responded to reviewers' comments with some revisions satisfactorily. However, the authors still haven't addressed some key scientific rigor issues, which are listed below:

      1) It is critical to clearly state whether the observations are made for the endogenous WT protein or the tagged protein. It is good that the authors currently clearly indicate the results observed in vivo are for the RAP1-HA protein. However, this is not as clearly stated for in vitro EMSA analyses. In addition, in discussion, the authors simply assumed that the c-terminally tagged RAP1 behaves the same as WT RAP1 and all conclusions were made about WT RAP1.

      There are two choices here. The authors can validate that RAP1-HA still retains RAP1's essential function as a sole allele in T. brucei cells (as was recommended previously). Indeed, HA-tagged RAP1 has been studied before, but it is the N-terminally HA-tagged RAP1 that has been shown to retain its essential functions. Adding the HA tag to the C-terminus of RAP1 may well cause certain defects to RAP1. For example, N-terminally HA-tagged TERT does not complement the telomere shortening phenotype in TERT null T. brucei cells, while C-terminally GFP-tagged TERT does, indicating that HA-TERT is not fully functional while TERT-GFP likely has its essential functions (Dreesen, RU thesis). Although RAP1-HA behaves similar to WT RAP1 in many ways, it is still not fully validated that this protein retains essential functions of RAP1. By the way, it has been published that cells lacking one allele of RAP1 behave as WT cells for cell growth and VSG silencing (Yang et al. 2009, Cell; Afrin et al. 2020, mSphere). In addition, although RAP1 may interact with TRF weakly, the interaction is direct, as shown in yeast 2-hybrid analysis in (Yang et al. 2009, Cell).

      Alternatively, if the authors do not wish to validate the functionality of RAP1-HA, they need to add one paragraph at the beginning of the discussion to clearly state that RAP1-HA may not behave exactly as WT RAP1. This is important for readers to better interpret the results. In addition, the authors need to tune down the current conclusions dramatically, as all described observations are made on RAP1-HA but not the WT RAP1.

      The results with RAP1-HA are consistent with previous knowledge of RAP1 interactions with telomeric proteins and DNA. Hence, the C-terminal HA-tagged RAP1 seems, by all measures, functional. Nevertheless, to make it clear for the reader, we added a note in the discussion, lines 244-246: “Although we showed that C-terminal HA-tagged RAP1 protein has telomeric localization (Cestari et al. 2015, PNAS) and interactions with other telomeric proteins (Cestari et al. 2019 Mol Cell Biol); we cannot rule out potential differences between HA-tagged and non tagged RAP1.”

      For a similar reason, the current EMSA results truly reflect how C-terminally His6-tagged RAP1 and RAP1 fragments behave. If the authors choose not to remove the His6 tag, it is essential that they use "RAP1-His6" to refer to these recombinant proteins. It is also essential for the authors to clearly state in the discussion that the tagged RAP1 fragments bind DNA, but the current data do not reveal whether WT RAP1 binds DNA. In addition, the authors incorrectly stated that "disruption of the MybL domain sequence did not eliminate RAP1-telomere binding in vivo" (lines 165-166). In ref 29, deletion of Myb domain did not abolish RAP1-telomere association. However, point mutations in MybL domain that abolish RAP1's DNA binding activities clearly disrupted RAP1's association with the telomere chromatin. Therefore, the current observation is not completely consistent with that published in ref 29.

      We stated in line 149-150 “…we expressed and purified from E. coli recombinant 6xHistagged T. brucei RAP1 (rRAP1)”. To clarify to the authors, we replaced rRAP1 with rRAP1-His throughout the manuscript and figures. As for the statement that “disruption of the MybL domain sequence did not eliminate RAP1-telomere binding in vivo" (lines 165-166).”. We removed the statement from the manuscript.

      2) There is no evidence, in vitro or in vivo, that binding PI(3,4,5)P3 to RAP1 causes conformational change in RAP1. The BRCT domain of RAP1 is known for its ability to homodimerize (Afrin et al. 2020, mSphere). It is therefore possible that binding of PI(3,4,5)P3 to RAP1 simply disrupts its homodimerization function. The authors clearly have extrapolated their conclusions based on available data. It is therefore important to revise the discussion and make appropriate statements.

      We did not state that PI(3,4,5)P3 causes RAP1 conformational changes. We discussed the possibility. We stated in lines 199-201: “PI(3,4,5)P3 inhibition of RAP1-DNA binding might be due to its association with RAP1 N-terminus causing conformational changes that affect Myb and MybL domains association with DNA.” This is a reasonable discussion, given the data presented in the manuscript.

      Reviewer #2 (Public Review):

      In this manuscript, Touray et al investigate the mechanisms by which PIP5Pase and RAP1 control VSG expression in T. brucei and demonstrate an important role for this enzyme in a signalling pathway that likely plays a role in antigenic variation in T. brucei. While these data do not definitively show a role for this pathway in antigenic variation, the data are critical for establishing this pathway as a potential way the parasite could control antigenic variation and thus represent a fundamental discovery.

      The methods used in the study are generally well-controlled. The authors provide evidence that RAP1 binds to PI(3,4,5)P3 through its N-terminus and that this binding regulates RAP1 binding to VSG expression sites, which in turn regulates VSG silencing. Overall their results support the conclusions made in the manuscript. Readers should take into consideration that the epitope tags on RAP1 could alter its function, however.

      There are a few small caveats that are worth noting. First, the analysis of VSG derepression and switching in Figure 1 relies on a genome which does not contain minichromosomal (MC) VSG sequences. This means that MC VSGs could theoretically be mis-assigned as coming from another genomic location in the absence of an MC reference. As the origin of the VSGs in these clones isn't a major point in the paper, I do not think this is a major concern, but I would not over-interpret the particular details of switching outcomes in these experiments.

      We agree with the reviewer and thus made no speculations on minichromosomes. The data analysis must rely on the available genome, and the reference genome used is well-assembled with PacBio sequences and Hi-C data (Muller et al. 2018, Nature).

      Another aspect of this work that is perhaps important, but not discussed much by the authors, is the fact that signalling is extremely poorly understood in T. brucei. In Figure 1B, the RNA-seq data show many genes upregulated after expression of the Mut PIP5Pase (not just VSGs). The authors rightly avoid claiming that this pathway is exclusive to VSGs, but I wonder if these data could provide insight into the other biological processes that might be controlled by this signaling pathway in T. brucei.

      We published that the inositol phosphate pathway also plays a role in T. brucei development (Cestari et al. 2018, Mol Biol Cell; reviewed by Cestari I 2020, PLOS Pathogens)

      Overall, this is an excellent study which represents an important step forward in understanding how antigenic variation is controlled in T. brucei. The possibility that this process could be controlled via a signalling pathway has been speculated for a long time, and this study provides the first mechanistic evidence for that possibility.

      Reviewer #1 (Recommendations For The Authors):

      Please see the public review for recommendations.1. It is critical to clearly state whether the observations are made for the endogenous WT protein or the tagged protein. It is good that the authors currently clearly indicate the results observed in vivo are for the RAP1-HA protein. However, this is not as clearly stated for in vitro EMSA analyses. In addition, in discussion, the authors simply assumed that the c-terminally tagged RAP1 behaves the same as WT RAP1 and all conclusions were made about WT RAP1.

      There are two choices here. The authors can validate that RAP1-HA still retains RAP1's essential function as a sole allele in T. brucei cells (as was recommended previously). Indeed, HA-tagged RAP1 has been studied before, but it is the N-terminally HA-tagged RAP1 that has been shown to retain its essential functions. Adding the HA tag to the C-terminus of RAP1 may well cause certain defects to RAP1. For example, N-terminally HA-tagged TERT does not complement the telomere shortening phenotype in TERT null T. brucei cells, while C-terminally GFP-tagged TERT does, indicating that HA-TERT is not fully functional while TERT-GFP likely has its essential functions (Dreesen, RU thesis). Although RAP1-HA behaves similar to WT RAP1 in many ways, it is still not fully validated that this protein retains essential functions of RAP1. By the way, it has been published that cells lacking one allele of RAP1 behaves as WT cells for cell growth and VSG silencing (Yang et al. 2009, Cell; Afrin et al. 2020, mSphere). In addition, although RAP1 may interact with TRF weakly, the interaction is direct, as shown in yeast 2-hybrid analysis in (Yang et al. 2009, Cell).

      Alternatively, if the authors do not wish to validate the functionality of RAP1-HA, they need to add one paragraph at the beginning of the discussion to clearly state that RAP1-HA may not behave exactly as WT RAP1. This is important for readers to better interpret the results. In addition, the authors need to tune down the current conclusions dramatically, as all described observations are made on RAP1-HA but not the WT RAP1.

      The results with RAP1-HA are consistent with previous knowledge of RAP1 interactions with telomeric proteins and DNA. Hence, the C-terminal HA-tagged RAP1 seems, by all measures, functional. Nevertheless, to make it clear for the reader, we added a note in the discussion, lines 244-246: “Although we showed that C-terminal HA-tagged RAP1 protein has telomeric localization (Cestari et al. 2015, PNAS) and interactions with other telomeric proteins (Cestari et al. 2019 Mol Cell Biol); we cannot rule out potential differences between HA-tagged and non tagged RAP1.”

      For a similar reason, the current EMSA results truly reflect how C-terminally His6-tagged RAP1 and RAP1 fragments behave. If the authors choose not to remove the His6 tag, it is essential that they use "RAP1-His6" to refer to these recombinant proteins. It is also essential for the authors to clearly state in the discussion that the tagged RAP1 fragments bind DNA, but the current data do not reveal whether WT RAP1 binds DNA. In addition, the authors incorrectly stated that "disruption of the MybL domain sequence did not eliminate RAP1-telomere binding in vivo" (lines 165-166). In ref 29, deletion of Myb domain did not abolish RAP1-telomere association. However, point mutations in MybL domain that abolish RAP1's DNA binding activities clearly disrupted RAP1's association with the telomere chromatin. Therefore, the current observation is not completely consistent with that published in ref 29.

      We stated in lines 149-150 “…we expressed and purified from E. coli recombinant 6xHistagged T. brucei RAP1 (rRAP1)”. To clarify to the authors, we replaced rRAP1 with rRAP1-His throughout the manuscript text. As for the statement that “disruption of the MybL domain sequence did not eliminate RAP1telomere binding in vivo" (lines 165-166).”. We removed the statement from the manuscript.

      2) There is no evidence, in vitro or in vivo, that binding PI(3,4,5)P3 to RAP1 causes conformational change in RAP1. The BRCT domain of RAP1 is known for its ability to homodimerize (Afrin et al. 2020, mSphere). It is therefore possible that binding of PI(3,4,5)P3 to RAP1 simply disrupts its homodimerization function. The authors clearly have extrapolated their conclusions based on available data. It is therefore important to revise the discussion and make appropriate statements.

      We did not state that PI(3,4,5)P3 causes RAP1 conformational changes. We discussed the possibility. We stated in lines 199-201: “PI(3,4,5)P3 inhibition of RAP1-DNA binding might be due to its association with RAP1 N-terminus causing conformational changes that affect Myb and MybL domains association with DNA.” This is a reasonable discussion, given the data presented in the manuscript.

    1. Author Response

      The following is the authors’ response to the original reviews.

      We greatly appreciate the valuable and constructive review of our manuscript. The reviewers’ comments have helped us to improve the quality of the paper. Here we provide detailed responses to the reviewers’ comments and discuss the new experiments we performed.

      Reviewer #1

      Summary:

      In this study, the authors generate a Drosophila model to assess disease-linked allelic variants in the UBA5 gene. In humans, variants in UBA5 have been associated with DEE44, characterized by developmental delay, seizures, and encephalopathy. Here, the authors set out to characterize the relationship between 12 disease-linked variants in UBA5 using a variety of assays in their Drosophila Uba5 model. They first show that human UBA5 can substitute all essential functions of the Drosophila Uba5 ortholog, and then assess phenotypes in flies expressing the various disease variants. Using these assays, the authors classify the alleles into mild, intermediate, and severe loss-of-function alleles. Further, the authors establish several important in vitro assays to determine the impacts of the disease alleles on Uba5 stability and function. Together, they find a relatively close correlation between in vivo and in vitro relationships between Uba5 alleles and establish a new Drosophila model to probe the etiology of Uba5-related disorders.

      Strengths:

      Overall, this is a convincing and well-executed study. There is clearly a need to assess disease-associated allelic variants to better understand human disorders, particularly for rare diseases, and this humanized fly model of Uba5 is a powerful system to rapidly evaluate variants and relationships to various phenotypes. The manuscript is well written, and the experiments are appropriately controlled.

      Recommendations For The Authors:

      1) It would seem of value to determine what tissue(s) the essential function of Uba5 resides. The authors nicely detail the expression of Uba5 in a subset of neurons and glia, and indicate it is expressed in a variety of other tissues. Null mutants are embryonic lethal, suggesting an essential function. From the mouse study cited, it appears Uba5 functions early in development in the hematopoietic system. The authors can express their UAS-Uba5 rescue construct using a variety of tissue-specific Gal4 lines to determine whether the essential function of Uba5 is in the nervous system or other tissues, which would be of interest in understanding key functions of Uba5.

      We thank the reviewer for the suggestion. We tried to rescue the lethality of the Uba5 mutants by expressing human UBA5 reference protein in different tissues. We found that ubiquitous expression of UBA5 (da-GAL4 or act-GAL4) successfully rescues the lethality, however, expression of UBA5 in neurons (elav-GAL4), glia (repo-GAL4), or both neurons and glia does not. In addition, expression of UBA5 in fat body (SPARC-GAL4) or muscles (Mef2-GAL4) does not rescue the lethality either. These results suggest that Uba5 is required in multiple tissues in flies. These data are included in the revised manuscript.

      2). Do intermediate Uba5 alleles impact synaptic function or growth? The etiology of the disease is linked with epilepsy and neurodevelopmental disorders, and the interesting parallels the authors note between Uba5 and Para expression indicate perhaps shared roles in neurons that drive firing activity. Together, these lines of evidence may suggest the Uba5 alleles may have possible impacts on synaptic growth, morphology, and/or function. It would be of interest to examine the larval neuromuscular junction and assess NMJ growth, morphology, and perform some basic electrophysiology to determine if there are any functional defects.

      Following the reviewer’s suggestion, we tested the morphology of NMJs in the humanized flies. We did not observe any obvious changes in the number or size of the synaptic boutons caused by the Group II variants. Hence, we conclude that the Uba5 variants do not cause an obvious defect in synaptic growth. The results are included in the Figure S3.

      More generally, can the authors comment on the expression pattern of Uba5? One might consider something like Uba5 to be a "housekeeping" gene and expressed/required in most if not all cell types. From the data presented in Fig. 2, it appears expression is more sparse, perhaps, as the authors point out, because of roles in mature neurons that actively fire (like Para). Are neuronal targets of Uba5 known, which might suggest key pathways it modulates?

      We showed that Uba5 is broadly expressed in third instar larvae. FlyAtlas2 and FlyCellAtlas datasets show that Uba5 is broadly expressed but not in all the cells. In the larval CNS and adult brain, Uba5 is not expressed in all cells either. Hence, we cannot say Uba5 is a “housekeeping” gene. Regarding the neuronal targets of Uba5, we do not know which types of neurons express Uba5 and which pathways Uba5 modulates. This could be studied in the future.

      3) Does strong overexpression of the various Uba5 alleles in otherwise wild-type flies cause any phenotypes? This might support possible antimorphic/dominant negative functions of some of the variants. Is it plausible that any of the alleles could impact oligomerization of Uba5?

      We have not observed compromised viability or any obvious phenotype in flies overexpressing human reference UBA5 or UBA5 variants. So, our results do not support a dominant negative effect of any of the variants.

      To our knowledge, people do not have sufficient knowledge on UBA5 dimerization to speculate on whether some variants could play a dominant negative role. There is one variant, V260M, that lies at the dimer interface. We showed that the V260M variant biochemically affects ATP binding as well as UFM1 activation, but we do not have evidence to support that it causes dominant negative effects by affecting UBA5 dimerization.

      Minor points:

      1) Page 5 line 45: It seems a reference is missing about the temperature dependence of Gal4 activity.

      We apologize for the missing reference. We have incorporated a reference to PMID 25824290.

      2) It might be of interest to assay the various transgenic rescue alleles at a higher temperature (say 29C) in addition to the nice work looking at 18/25C survival. Perhaps some of the alleles display temperature sensitivity at low (18) and high (29) temperatures.

      We now include the survival rate data at 29C. The enzyme dead and severe LoF variants fail to rescue the lethality at 29C, while the mild (Group IA and IB) variants fully rescue. For the three Group II variants, the survival rate at 29C is higher than that at 25C and 18C. The results support the dosage sensitive effects of UBA5 overexpression, but do not support any variant to be temperature sensitive within this range.

      Reviewer #2

      Relative simplicity and genetic accessibility of the fly brain make it a premier model system for studying the function of genes linked to various diseases in humans. Here, Pan et al. show that human UBA5, whose mutations cause developmental and epileptic encephalopathy, can functionally replace the fly homolog Uba5. The authors then systematically express in flies the different versions of the gene carrying clinically relevant SNPs and perform extensive phenotypic characterization such as survival rate, developmental timing, lifespan, locomotor and seizure activity, as well as in vitro biochemical characterization (stability, ATP binding, UFM-1 activation) of the corresponding recombinant proteins. The biochemical effects are well predicted by (or at least consistent with) the location of affected amino acids in the previously described Uba5 protein structure. Most strikingly, the severity of biochemical defects appears to closely track the severity of phenotypic defects observed in vivo in flies. While the paper does not provide many novel insights into the function of Uba5, it convincingly establishes the fly nervous system as a powerful model for future mechanistic studies.

      One potential limitation is the design of the expression system in this work. Even though the authors state that "human cDNA is expressed under the control of the endogenous Uba5 enhancer and promoter", it is in fact the Gal4 gene that is expressed from the endogenous locus, meaning that the cDNA expression level would inevitably be amplified in comparison. The fact that different effects were observed when some experiments were performed at different temperatures (18 vs. 25) is also consistent with this. While I do not think this caveat weakens the conclusions of this paper, it may impact the interpretation of future experiments that use these tools, and thus should be clearly discussed in the paper. Especially considering the authors argue that most disease variants of UBA5 are partial loss-of-functions, the amplification effect could potentially mask the phenotypes of milder hypomorphic alleles. If the authors could also show that the T2A-Gal4 expression pattern in the brain matches well with that of endogenous RNA or protein (e.g. using HCR-FISH or antibody), it would help to alleviate this concern.

      We thank the reviewer for pointing out the issue.

      Regarding the humanization strategy we used in the study, we agree that this is a binary system which could induce overexpression of the target protein. However, as the reviewer also points out, this temperature sensitive system also enables us to flexibly adjust the expression level of the target protein (PMIDs 34113007, 35348658, 36206744), which is especially useful to study partial LoF variants. In our study we have successfully compared the relevant allelic strength of most of the variants.

      We agree with the reviewer that a masking effect may exist in our system due to its gene overexpression nature. However, we cannot conclude that this masking effect really affects the three Group IA variants in our tests. The three variants are mild LoF, which is supported by our biochemical assays. Individuals homozygous for one of the Group IA variants, p.A371T, do not have any obvious phenotype, which is also consistent with our findings in flies.

      Regarding the expression pattern of the T2A-GAL4, the Bellen lab has generated T2A-GAL4 lines for more than 3,000 genes. The expression pattern of many GAL4 lines faithfully reflect the expression pattern of the endogenous genes, which has been shown in our previous publications (PMIDs 25824290, 29565247, 31674908).

      Recommendations For The Authors:

      As related to the expression pattern comment in the public review, I think the authors could also take advantage of Fly Cell Atlas or other available scRNA-seq atlases of the fly brain to present a much more detailed description of the Uba5 expression profile with minimal additional effort. If the cells that express it share other features or genes (other than the para that the authors mention), this could lead to further insights about the gene's neuronal or glial functions.

      In response to the reviewer, we show the expression pattern of Uba5 documented in FlyCellAtlas and another adult brain single-cell RNA seq profile (PMID 29909982) in the revised manuscript.

      In addition, one of the mutants (assuming the same one) is referred to as Leu254Pro in some parts of the manuscript while in some other parts (including tables 1-2) it is Lys254Pro.

      We apologize for the mistakes. The variant should be Leu254Pro and we have made these corrections in the revised manuscript.

      Reviewer #3

      Summary:

      Variants in the UBA5 gene are associated with rare developmental and epileptic encephalopathy, DEE44. This research developed a system to assess in vivo and in vitro genotype-phenotype relationships between UBA5 allele series by humanized UBA5 fly models and biochemical activity assays. This study provides a basis for evaluating current and future individuals afflicted with this rare disease.

      Strengths:

      The authors developed a method to measure the enzymatic reaction activity of UBA5 mutants over time by applying the UbiReal method, which can monitor each reaction step of ubiquitination in real time using fluorescence polarization. They also classified fruit fly carrying humanized UBA5 variants into groups based on phenotype. They found a correlation between biochemical UBA5 activity and phenotype severity.

      Weaknesses:

      In the case of human DEE44, compound heterozygotes with both loss-of-function and hypomorphic forms (e.g., p.Ala371Thr, p.Asp389Gly, p.Asp389Tyr) may cause disease states. The presented models have failed to evaluate such cases.

      We agree with the reviewer that our current system has a limitation that it evaluates one variant at a time rather than any combination of variants. However, our biochemical data do show that the three Group IA variants are mild LoF variants rather than benign variants. One of these variants, p.A371T, does not cause any obvious phenotype in homozygous individuals, which is also consistent with our findings in flies. The modeling of variant combinations, especially the Group IA/Group III combinations could be carried out in future studies.

      Recommendations For The Authors:

      Figure 3G. Typo. "ContonS" should be replaced by "CantonS."

      We apologize for the spelling mistake. We correct the typo in the revised manuscript.

      Figure 5. The labels should be in uppercase instead of lowercase.

      We correct the panel labels in the revised manuscript.

      Figure 6A. Is the molecular weight of UBA5~UFM1 intermediate (99 kDa) in model Figure correct? In Fig. 6B, the molecular weight of UBA5~UFM1 intermediate seems to be 70-75 kDa.

      Both are correct. The molecular weight depicted in the schematic of Figure 6A is based on the UBA5 dimer, which dissociates in the SDS-PAGE gel shown in Figure 6B. We have reconfigured the schematic to make this more apparent.

      Figure. 6E, F, H, and I. The time points for quantification in these figures should be specified.

      We apologize for the confusion. The details on data quantification are now more thoroughly explained in the Methods.

    1. Yet, what may be obvious may be also poorly understood. This I think is the case here.  For it seems to me that -- at least in our scientific theories of behavior -- we have failed to accept the simple fact that human relations are inherently fraught with difficulties and that to make them even relatively harmonious requires much patience and hard work. I submit that the idea of mental illness is now being put to work to obscure certain difficulties which at present may be inherent -- not that they need be unmodifiable -- in the social intercourse of persons.  If this is true, the concept functions as a disguise; for instead of calling attention to conflicting human needs, aspirations, and values, the notion of mental illness provides an amoral and impersonal "thing" (an "illness") as an explanation for problems in living

      Brings to light that this is a hard concept to understand and singularly define, however, we shouldn't find the easy way out by just describing this as an illness in a dismissive way that doesn't get to the root of the issue.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Editorial comments:

      Comment 1 - Recommendations for the authors: please note that you control which revisions to undertake from the public reviews and recommendations for the authors.

      We appreciate the feedback from the 3 Reviewers and Editor. We have enumerated each Reviewer comment and provide a detailed response. We endeavoured to include each suggestion into the revised manuscript. All changes in the manuscript are indicated in red font. In instances in which we respectfully disagree with the Reviewer, we have provided a fair rebuttal. We feel the comments from the Reviewers has significantly improved the clarity and quality of the manuscript.

      Comment 2 - The revision process has demonstrated the value of your work, highlighting both its strengths and shortcomings. Importantly, it provides detailed and achievable suggestions for improving the current version of your contribution.

      We thank the Reviewers and Editor for their time and expert input on our manuscript. We feel the suggestions from the Reviewers to address the shortcomings has resulted in a significantly improved manuscript.

      Comment 3 - There is a general consensus among the reviewers on three key aspects. Firstly, the article would greatly benefit from a clearer layout of the experimental design and methodology, potentially including schematics to help readers comprehend the complexity and details of the study.

      We appreciate the feedback from Reviewer 2 in particular. We have added a new schematic for Experiment 3 (see PUBLIC REVIEWS Reviewer #2 Comment 2). We have also revised the Results section by including subheadings and additional text to help explain the methods.

      Comment 4 - Secondly, conducting a more comprehensive analysis of the available dataset, utilizing tools such as WGCNA to explore gene co-expression networks beyond specific genes, is recommended. Additionally, it is advised to exercise greater caution when discussing the limitations of the employed methods.

      The suggestion for the WGCNA is excellent and very much appreciated. The revised manuscript includes WGCNA for both the MBH and pituitary gland. See Figures S3 & Table S6 and lines 166-182; 497-505).

      Comment 5 - Thirdly, expanding the results section to create a more engaging narrative that guides readers through the numerous findings, and extending the discussion and conclusions to emphasize the ecological relevance of learning photoperiodic/seasonal responses and highlighting the presented model, would be valuable.

      These were excellent suggestions that significantly improved the clarity and quality of the manuscript. The results section included several subheadings to help break up of the transitions across experiments. We have also significantly revised the introduction and discussion to include the ecological relevance and importance to consider sex as a factor in the interpretations.

      Comment 6 - Finally, please pay close attention to the comment on the statistical analysis provided by Rev#2.

      It is unclear why the Benjamini-Hochberg’s FDR analyses was suggested. The statistical test is a version of the Bonferroni test but is less stringent. We prefer to use conservative tests (i.e., Bonferroni correction). Moreover, the Bonferroni correction is the commonly used statistical tests in the field. To be consistent with the field and to be careful in our statistical approach, the revised manuscript did not change the post-hoc correction.

      PUBLIC REVIEWS:

      Reviewer #1:

      Comment 1 - The authors investigated the molecular correlates in potential neural centers in the Japanese quail brain associated with photoperiod-induced life-history states. The authors simulated photoperiod to attain winter and summer-like physiology and samples of neural tissues at spring, and autumn life-history states, daily rhythms in transcripts in solstices and equinox, and lastly studies FSHb transcripts in the pituitary. The experiments are based on a series of changes in photoperiod and gave some interesting results. The experiment did not have a control for no change in photoperiod so it seems possible that endogenous rhythms could be another aspect of seasonal rhythms that lack in this study. The short-day group does not explain the endogenous seasonal response.

      We thank the Reviewer for the fair assessment of the manuscript. The statement ‘the experiment did not have a control for no change in photoperiod’ is not clear to us. We think the Reviewer is arguing that prolonged constant photoperiod was not conducted to examine circannual timing in avian reproduction. The constant short photoperiod in Exp3 does provide the ability to examine the initial stages of interval timing. A different endogenous mechanism used by animals. The revised manuscript has clarified the different physiological responses.

      Comment 2 - The manuscript would benefit from further clarity in synthesizing different sections. Additionally, there are some instances of unclear language and numerous typos throughout the manuscript. A thorough revision is recommended, including addressing sentence structure for improved clarity, reframing sentences where necessary, correcting typos, conducting a grammar check, and enhancing overall writing clarity.

      We have incorporated the suggestions from both Reviewer 1 and Reviewer 2 that aimed to increase the clarity of the manuscript. We have provided detailed responses to each comment below and state how each comment was incorporated in the revised manuscript. We also had the manuscript reviewed by a colleague to help identify issues associated with sentence structure, grammar, and spelling.

      Comment 3 - Data analysis needs more clarity particularly how transcriptome data explains different physiological measures across seasonal life-history states. It seems the discussion is built around a few genes that have been studied in other published literature on quail seasonal response. Extending results on the promotor of DEGs and building discussion is an extrapolating discussion on limited evidence and seems redundant.

      A new statistical analysis (ie., WGCNA) was conducted to identify relations between photoperiod, physiology and transcripts. The focus on the few photoperiodic gene was kept in the discussion as the transcript expression is important to highlight the differences from the prevailing hypotheses and novel patterns of expression across seasonal timescales. See Figures S3 & Table S6 and lines 166-182; 497-505).

      Comment 4 - Last, I wondered if it would be possible to add an ecological context for the frequent change in the photoperiod schedule and not take account of the endogenous annual response. Adding discussion on ecological relevance would make more sense.

      This is an excellent suggestion. The introduction and discussion were substantially revised to include the ecological relevance.

      Reviewer #2:

      Comment 1 - This study is carefully designed and well executed, including a comprehensive suite of endpoint measures and large sample sizes that give confidence in the results. I have a few general comments and suggestions that the authors might find helpful.

      We appreciate the Reviewers support for our manuscript. We have endeavoured to incorporate all suggestions in the revised manuscript.

      Comment 2 - I found it difficult to fully grasp the experimental design, including the length of light treatment in the three different experiments (which appears to extend from 2 weeks up to 8 weeks). A graphical description of the experimental design along a timeline would be very helpful to the reader. I suggest adding the respective sample sizes to such a graphic, because this information is currently also difficult to keep track of.

      We have created a new figure panel to address the Reviewer’s concern. See figure S4 panel ‘a’. The new schematic representation was designed to illustrate the similarity in experimental design used in Experiment 1 and Experiment 2. But clearly illustrates the extended short photoperiod manipulation (4 weeks and not 8 weeks). We added the sample sizes to initial drafts but felt the added text hindered the clarity of the schematic representation (particularly for Fig1a). The sample sizes for each experiment and treatment are provided in the raw data provided in the supplementary Table 1. For this reason, we have opted to not add the sample size to each diagram. We hope that the Reviewer will understand our perspective.

      Comment 3 - The authors use a lot of terminology that is second nature to a chronobiologist but may be difficult for the general reader to keep track of. For example, what is the difference between "photoinducibility" and "photosensitivity"? Similarly, "vernal" and "autumnal" should be briefly explained at the outset, or maybe simply say "spring equinox" and "fall equinox."

      This is a very helpful suggestion, and we thank the Reviewer. Two changes were made to the manuscript to address this comment. First, we revised the second introductory paragraph to describe the photoperiodic response and the terms used. Second, we have removed all reference to ‘vernal’ and replaced with ‘spring’. We opted to keep ‘autumn’ as the change to ‘fall’ did not provide the clarity of seasonal state in some statements (as fall is also used as a downward direction).

      Comment 4 What was the rationale for using only male birds in this study? The authors may want to include a brief discussion on whether the expected results for females might be similar to or different from what they found in males, and why.

      We agree with the Reviewer’s position that studies should include, or least describe, male and female biology. We have revised the text to address this comment. In the methods, we provide 2 sentences that state the photoperiodic response is the same for both male and females, and why males were selected. See lines (352-355). Then, in the discussion, we describe why females will be important to study how other supplementary environmental cues impact seasonal timing of reproduction. See lines (312-330; and 334-339).

      Comment 5 - The authors used the Bonferroni correction method to account for multiple hypothesis testing of measures of testes mass, body mass, fat score, vimentin immunoreactivity and qPCR analyses in Study 1. I don't think Bonferroni is ever appropriate for biological data: these methods assume that all variables are independent of each other, an assumption that is almost never warranted in biology. In fact, the data show clear relationships between these endpoint measures. Alternatively, one might use Benjamini-Hochberg's FDR correction or various methods for calculating the corrected alpha level.

      This concern is not clear to us. The Benjamini-Hochberg’s FDR is a slight modification of the Bonferroni correction. Moreover, the FDR is a less-stringent statistical test compared to the Bonferroni correction. We prefer to keep the Bonferroni approach to correct for multiple tests for two reasons. First, this test is commonly used in the field of chronobiology, and second, the Bonferroni correction is more conservative. We hope the Reviewer will appreciate our perspective to be consistent with the research field and higher stringency in our statistical approach.

      Comment 6 - The graphical interpretations of the results shown in Figure 1n and Figure 3e, along with the hypothesized working model shown in Figure S5, might best be combined into a single figure that becomes part of the Discussion. As is, I do not think these interpretative graphics (which are well done and super helpful!) are appropriate for the Results section.

      We appreciate the Reviewer’s suggestion. During the revision we developed a single figure to show the graphical representation for the respective experiments. Unfortunately, we found the single source to be very difficult to provide a clear description and overview of the findings. We feel that the interpretations, (admittedly unusual for Results section) are best placed in the respective figures that correspond to the different experiments.

      Reviewer #3:

      Comment 1a - It is well known that as seasonal day length increases, molecular cascades in the brain are triggered to ready an individual for reproduction. Some of these changes, however, can begin to occur before the day length threshold is reached, suggesting that short days similarly have the capacity to alter aspects of phenotype. This study seeks to understand the mechanisms by which short days can accomplish this task, which is an interesting and important question in the field of organismal biology and endocrinology.

      We thank the Reviewer for their positive feedback.

      Comment 1b - The set of studies that this manuscript presents is comprehensive and well-controlled. Many of the effects are also strong and thus offer tantalizing hints about the endo-molecular basis by which short days might stimulate major changes in body condition. Another strength is that the authors put together a compelling model for how different facets of an animal's reproductive state come "on line" as day length increases and spring approaches. In this way, I think the authors broadly fulfill their aims.

      We thank the Reviewer for the positive support of our research and manuscript.

      Comment 1c - I do, however, also think that there are a few weaknesses that the authors should consider, or that readers should consider when evaluating this manuscript. First, some of the molecular genetic analyses should be interpreted with greater caution. By bioinformatically showing that certain DNA motifs exist within a gene promoter (e.g., FSHbeta), one is not generating robust evidence that corresponding transcription factors actually regulate the expression of the gene in question. In fact, some may argue that this line of evidence only offers weak support for such a conclusion. I appreciate that actually running the laboratory experiments necessary to generate strong support for these types of conclusions is not trivial, and doing so may even be impossible. I would therefore suggest a clear admission of these limitations in the paper.

      We agree with the Reviewer’s position. The transcription binding protein analyses was used as a means to identify potential factors involved in the regulation of transcript expression. We have written a new paragraph to address this comment. In the discussion, we that highlight the links between the well characterised circadian regulation of photoperiodic transcripts (e.g, D- & E-box elements and the photoperiodic control of TSHβ. We also indicate that our bioinformatic approach identified potentially new transcription binding motifs, and provide a clear admission and state that functional analyses are required to determine necessity of these pathways (e.g., MEF2). See lines 293-295.

      Comment 2 - Second, I have another issue with the interpretation of data presented in Figure 3. The data show that FSHbeta increases in expression in the 8Lext group, suggesting that endogenous drivers likely act to increase the expression of this gene despite no change in day length. However, more robust effects are reported for FSHbeta expression in the 10v and 12v groups, even compared to the 8Lext group. Doesn't this suggest that both endogenous mechanisms and changes in day length work together to ramp up FSHbeta? The rest of the paper seemed to emphasize endogenous mechanisms and gloss over the fact that such mechanisms likely work additively with other factors. I felt like there was more nuance to these findings than the authors were getting into.

      We agree with the Reviewer and a similar concern was raised by Reviewer 1. Our aim was to highlight that FSH expression increased in constant short photoperiod. We have revised the manuscript to address the concern raised by the Reviewer. We have added 2 sentences in the results to highlight the additive role of endogenous timing and photoperiodic effects on FSH expression (see lines 223-226). We have kept the text that describes endogenous increases in expression (e.g., FSH/GnRH) in response to short photoperiod in the manuscript as this observation is not influenced by long photoperiod.

      Comment 3 - Third, studies 1 - 3 are well controlled; however, I'm left wondering how much of an effect the transitions in day length might have on the underlying molecular processes that mediate changes in body condition. While the changes in day length are themselves ecologically relevant, the transitions between day length states are not. How do we know, for example, that more gradual changes in day length that occur over long timespans do not produce different effects at the levels of the brain and body? This seemed especially relevant for study 3, where animals experience a rather sudden change in day length. I recognize that these experimental methods are well described in the literature, and they have been used by endocrinologists for a long time; nonetheless, I think questions remain.

      There are two points raised in this comment. First, the effect of transition in day length on body condition. We are investigating the impact of photoperiodic transitions on body condition. The ongoing project has examined the changes in tissue lipid content and conducted transcriptomic analyses of multiple peripheral tissues involved in energy balance. Although we made an initial attempt to combine all the findings into a single manuscript, the large datasets resulted in an overwhelming manuscript that lacked clarity. Instead, we have opted for two manuscripts that focus on the respective physiological systems. Those data should be published shortly. We did expand the discussion by developing a single paragraph that focused on the pattern of POMC expression and changes in quail body mass and adipose tissue. See lines 300-311.

      Second, the Reviewer raised the issue of more gradual changes in day length over longer timespans. The day length and duration of exposure selected was to replicate previously used photoperiod manipulations to ensure reproducibility in research programmes, and to reduce the impact of photoperiod history (see lines 367-369). The present manuscript is the first study in birds to examine multiple intervening (ie within the extreme long- and short-photoperiods) day length conditions and we feel this is a major and novel contribution to the field. We agree that other time points (e.g., 13L:11D), or quicker/longer timespans could provide additional insight into the molecular mechanisms that govern seasonal transitions in reproduction/energy balance. The question raised by the Reviewer requires the types of studies that use natural conditions from wild-caught animals (or semi-natural laboratory settings) and beyond the focus of the current manuscript.

      Recommendations For The Authors:

      Reviewer #1

      Comment 1 - Abstract: Overall abstract needs more clarity in rationale, hypothesis, and result outcomes. How this study advances our knowledge in seasonal/ photoperiodic regulation of reproduction in birds. Particularly what knowledge gap FSHb results fill in.

      We have substantially revised the abstract considering the Reviewer’s suggestions. The abstract has clarified the rationale, hypothesis and results outcomes. We have also added new introductory and concluding statements that place the work into a wider ecological context (as suggested below).

      Comment 2 - In general the introduction needs more clarity and doesn't seem to cover the ecological relevance of learning photoperiodic/seasonal response.

      We agree with the Reviewer the introduction could be improved. We have substantially revised the introduction with an aim to increase the clarity. This involved an addition on the ecological context, clarification of the photoperiodic states in birds, and a description of the general and specific objectives. Note we did not include an introduction to ‘learning’ of the photoperiodic response, as the term implies a cognitive component is involved which is incorrect. See lines (61-67, 71-74, 80-86, and 100-105).

      Comment 3 - Line 58: What does the author mean by "future seasonal environment" Is it to introduce change in climate or future seasonal events? This sentence needs rephrasing and more clarity.

      In response to Comment 2, we have revised the introductory paragraph and the sentence was removed from the text.

      Comment 4 - Line 63: I would recommend the use of circannual rhythms with caution for the kind of experiments authors have proposed. The approach used here is beyond the scope of addressing circannual endogenous rhythms, which can be tested only independent of photoperiod change.

      We agree with the Reviewer’s concern. The use of circannual rhythms was limited to the first paragraph (lines 56-63) only to introduce the concept of endogenous rhythmicity. We were careful to not use the term ‘circannual’ for the rest of the manuscript, as the Reviewer has indicated, would be inappropriate. We have retained the use of ‘endogenous program’ to refer to the molecular and physiological changes that can occur independent of photoperiod change (ie Experiment 3). In this case, the use of endogenous is appropriate as this form of timing adheres to an interval timer. We also provided a definition for interval timer and ecological examples to illustrate the difference between circannual rhythms and annual interval timer (see lines 71-74). We also reviewed the entire manuscript to ensure the distinction for the endogenous program was clear.

      Comment 5 - Another aspect authors missed is that Quail is not an absolute photorefractory (Robinson and Follett, 1982).

      We agree with the Reviewer that quail are not absolute photorefractory (but instead relative photorefractory). As our photoperiod manipulations do not address criterion 1, or criterion 2 of the avian photoperiodic response (MacDougall-Shackelton et al., 2009; see https://doi.org/10.1093/icb/icp048), we feel that adding the type of photorefractory response would be a distraction and reduce the clarity of the concepts/experimental design described in the manuscript.

      Comment 6 - Line 223-234: "Chicks were raised under constant light and constant heat lamp". Constant photoperiod experienced during development raises concern on how this pretreatment would shape the adult seasonal response, which could be different in the seasonal response of birds raised in natural photoperiod. If this is correct, the results shown are not tenable for birds inhabiting the natural environment.

      The light schedule used in our experiment is the most appropriate for laboratory reared chicks. The light schedule, use of an incubator and hatchery is commonly used in research laboratories. The procedure serves to increase the hatch rate and welfare of chicks. Undoubtedly there will be some early developmental programming effects on quail development. However, the gonadal response across all 3 experiments was consistent with the vast scientific literature on the avian photoperiodic response in both laboratory and wild birds. As the robust gonadal response clearly replicated previous studies, we are confident the results are tenable for birds inhabiting natural environments.

      Comment 7 - Numerous studies done in mammals suggest that photoperiod experienced in the early life stage affects the circadian and seasonal response in adults (Ciarleglio et al., 2011, Perinatal photoperiod imprints the circadian clock, Nat Neurosceince; Stetson M., et al., 1986, Maternal transfer of photoperiodic information influences the photoperiodic response of prepubertal Djungarian hamsters).

      We agree with the Reviewer that developmental programming in mammals is important for the photoperiodic response. However, there are vast differences between the avian and mammalian photoperiodic response. Critically, in mammals, the maternal transfer of information to the offspring is achieved via the melatonin hormone. Conversely, in birds, melatonin is not necessary, nor sufficient for photoperiodic time measurement (Juss et al., 1993; see https://doi.org/10.1098/rspb.1993.0121). It is not scientifically tenable to relate the mammalian and avian photoperiodic responses in adulthood based on early developmental programs. For this reason, we did not introduce or discuss developmental programming in our manuscript.

      Comment 8 - Please give details on the month in which these birds were exposed to different short and long photoperiods. It is not clear in the method section. The birds experience long to short day transition and then back to long day in 16 weeks (~ 4 months). The annual cycle is ~12 months long in nature. Again, what is the ecological relevance of such an experimental paradigm. This could give some idea on photoperiodic response, but not on how the endogenous annual cycle would respond.

      Birds were delivered in September 2019 and 2020. (We have added these details to the manuscript (see lines 351-352). We agree with the Reviewer that the ecological relevance of the experimental design is limited. Our focus was to use laboratory conditions and well characterised photoperiodic manipulations to examine the role of the environmental, initial predictive cue to time seasonal transitions in reproduction. The 2-week duration for each photoperiod state in Experiment 1 provides the ability to eliminate the impact of photoperiodic history (see lines 367-369; Stevenson et al., 2012a) and reduce the time necessary for the research project. As described above in Comment #4 – we did not examine the endogenous annual cycle – but instead focused on an endogenous interval timer. Experiment 3 was designed to best examine an endogenous interval timer.

      Comment 9 - Line 251: "A jugular blood sample" Please rephrase this sentence and add 50 ul heparinized tubes

      We thank the Reviewer for identifying this oversight. The text was changed accordingly.

      Comment 10 - Line 259: The scale.....fat pads" - The sentence doesn't read correctly.

      The sentence was revised accordingly.

      Comment 11 - Line 274: Male.....six weeks. It is not clear from this sentence; what photoperiod birds were exposed to before transferring to 2 long days. Is it 16 or 14 LD.

      The birds were held in 16L. The text has been revised accordingly.

      Comment 12 - Line 276: It is not clear what is Home Office approved schedule 1. This may be a commonly used term for animal sacrifice protocol in UK and Europe. But it is not familiar jargon for the rest of the globe.

      We apologise for the jargon. The text was revised to include the exact methods (decapitation followed by exsanguination).

      Comment 13 - Line 277-284: Birds under SD for 4 weeks (8 Lext) is a bit confusing and particularly in the context of studying endogenous rhythm. Needs more clarity.

      The text was revised to improve the clarity. The manuscript now states: ‘A subset of birds (n=6) was maintained in short day photoperiods for four more weeks (8Lext). This group of birds provided the ability to examine whether an endogenous increase in FSHβ expression would occur in constant short day photoperiod condition.’

      Comment 14 - Line 322-323: Give RIN number (RNA integrity number) here which is a very common parameter to determine RNA degradation in RNAseq experiments. I guess, the MiniON is a portable sequencer and sequences one sample at a time. If this is true authors should consider any batch effect in sequencing and use it as a covariate in the model.

      The RIN values from our extraction protocol reliably produce RIN values >9.0. The text now states: Isolated RNA reliably has RIN values >9.0 for both the mediobasal hypothalamus and pituitary gland. Our RIN values are well above the recommended 7.0 limit. The Reviewer is correct that MinION is portable, however, more than one sample can be run at a time. We stated in the text (lines 454-460) that birds were counterbalanced across Flow cells so that each sequencing run had 9 samples, one from each treatment group. Our counterbalancing approach and quality control steps prevented batch effects.

      Comment 15 - Line 397-398: Adding quail or chicken-specific vimentin peptide pre-incubation with primary Ab will serve more confirming control. Omitting primary Ab doesn't address cross-reactive/ nonspecific binding issues.

      We agree that a positive control (ie primary Ab) is the gold standard to support specificity of the antibody. Unfortunately, we have not found a supplier of the epitope for quail/chicken vimentin. We have conducted another in silico analysis an established that the sequences for the vimentin antibody is specific for vimentin. The next closest sequence alignment is only 68% for a protein that is not expressed in the brain. The immunoreactive pattern observed in our histology reproduces work from mammalian models in which the epitope is available. Therefore, we are confident that our immunoreactive signal for vimentin is specific. We have added the in silico analysis in the manuscript on lines 535-538.

      Comment 16 - Line 430: Was the GLM model used for testing all variables? Running a statistical model to explain Differentially expressed genes, photoperiod, and physiological variables together will give a more conclusive outcome to explain the photoperiod effect and seasonal state.

      A similar comment was raised by Reviewer 2. We have conducted a WGCNA analyses to examine the relationship between photoperiod, physiological variables and DEG. See Figures S3 & Table S6 and lines 166-182; 497-505).

      Comment 17 - It is a bit unclear why the author used cherry-picking approach by talking about only a few genes that have been studied as key regulators of photoperiodic response in quail. What was the purpose of transcriptome? A better approach would have been to use a model to reduce the data (PCA) and explain the physiological response by regression against different PCs.

      We agree with the Reviewer that other statistical approaches could be conducted, and other genes could be discussed. However, we focussed on the key regulators of the photoperiodic response in quail as these are the well characterised genes. It is important that our discussion focused on these transcripts as most do not conform to the predicted patterns of expression. We feel it is best that we keep the focus on these genes.

      Comment 18 - TSHb result is inconsistent with past studies, where TSHb is the first responder gene on photoinduction. The author did not pay attention to explaining it further in the discussion.

      We respectfully disagree with the Reviewer. Our results are consistent with past studies and show that TSHβ expression is a molecular marker of long day photoperiod. Our study does not examine photoinduction; which does not provide the ability to compare between our study and previous work (eg., Nakao et al., 2008; see doi: 10.1038/nature06738). We have revised the text in consideration of the concern raised by the Reviewer. The text now states ‘Previous reports established that TSHβ expression is significantly increased during the period of photoinducibility in quail (Nakao et al., 2008). Although the present study did not directly examine photoinduction, TSHβ expression was consistently elevated in long day photoperiod (i.e., 16L).’. (see lines 262-265).

      Comment 19 - PRL result seems interesting and there could be more discussion in relation to the rise in PRL transcripts levels termination of breeding. Elaborating on PRL expression and breeding termination can add more information to the discussion.

      This comment is not clear to us, and we would incorporate a clarified comment in a revised manuscript. The increased expression of prolactin does not occur during the termination of breeding. The increase in prolactin occurs during the vernal increase in photoperiod (ie 14L) but does not have a clear link with gonadal growth.

      Comment 20 - Line 217-219: Based......respectively. Sounds like a big claim with less evidence.

      We have removed the sentence from the discussion.

      Comment 21 - Line 220-223: The .....Bird. The sentence is not clear about how this study would add to ecological studies. Need more clarity on the importance of such data.

      The sentence was removed from the text.

      Comment 22 - I think that it would be helpful to add a couple of caveats to provide more ecological context. First, the model is only based on males, and responses in females could be different.

      We agree with the Reviewer there are undoubtedly sex differences in timing seasonal biology. However, the photoperiodic response (growth and regression) is similar in both males and females. Sex differences exist in response to supplementary environmental cues (e.g., temperature). Males were used in these studies as the gonadal response to changes in photoperiod manipulations are much larger compared to ovarian changes in females. The focus on males allows for fewer animals to be used in the experiments and greater statistical power. To address the Reviewers concern, we have added a paragraph in the discussion that describes the similarity in photoperiodic responses in males and females, and the importance of supplementary cues for full reproductive development in female birds. We also provide a couple sentences in the methods that describe the justification for only males in the present study. See lines (Methods 352-355; Discussion 312-330; and 334-339).

      Comment 23 - Last, I wondered if it would be possible to add an ecological context for the frequent change in the photoperiod schedule and not take account of the endogenous annual response. Would the procedure simulate a similar kind of underlined molecular response for a bird under natural conditions responding to changing daylight cycles on an annual time frame?

      The discussion was considerably revised to address the ecological relevance of the study, and findings. We have added a sentence at the beginning of the discussion to highlight that the laboratory-based approach and photoperiodic manipulations reliable replicate previous findings using semi-natural conditions (Robinson and Follett, 1982) (See lines 248-250). We have already reduced the focus on the endogenous annual response.

      Reviewer #2:

      Comment 1 - The writing is very terse and could benefit from a more narrating style, which would make it a lot easier for the reader to get through some of the very data-heavy text. Breaking up the Results with subheadings would also be helpful.

      We appreciate the suggestion to add subheadings to the Results. We added 3 descriptive headings for each other studies conducted in the manuscript. We feel the added revision (e.g., ecological) has improved the narrative and made the manuscript accessible to the wider readership.

      Comment 2 - The transcriptome analyses could be developed a bit more. First, using the limma package would allow the authors to apply a more complete model to the DEG analyses, which would likely be superior to EdgeR. Second, the authors may want to consider WGCNA or a similar approach to discover gene co-expression modules, and then examine whether any of the resulting module eigengenes co-vary with any morphological or physiological measures and/or vary rhythmically.

      This is an excellent suggestion, and the new analyses was incorporated into the revised manuscript. Using the Langfelder and Horvath 2008 WCGNA package we conducted module-trait analyses to examine co-variation in our findings. These data are presented in Figure S# and lines 476-484. We agree that other DEG analyses would be useful; our main objectives was to use BioDare2.0 to identify rhythmic transcription in the seasonal transcriptomes. EdgR provides an excellent approach to identify transcripts and commonly used.

      Comment 3 - In the Data and code availability statement (lines 226ff) the authors state that "all raw data are available in Extended data Table 1." However, they should be submitted to the GEO database or a similar public repository along with all relevant metadata. Also, and maybe I overlooked this, I did not see anywhere that the "R code used in Study 1 is freely available" (I was not sure what "the methods reference list" was supposed to refer to). Instead of stating that "the full R code used is available upon request" I suggest making all scripts available via GitHub or Dataverse, along with all non-omics data. The advantage of the latter platform is that a citable DOI is assigned to each upload.

      The data are now available in the GEO database and can be accessed see GSE241775. We have added this information to the text. The R code is now provided as a Table S11 so that the reader can directly access the script.

      Comment 4 - Line 191: Delete the extra "that"

      We thank the Reviewer for identifying the oversight. We have revised the text accordingly.

      Comment 5 - Line 24f: What does "pseudo-randomly" mean? Maybe "haphazardly" would be more appropriate here?

      The term pseudo-randomly is used to describe the organized manner in which subjects are assigned to each treatment group. The aim is to ensure that a particular physiological variable, such as body mass, is evenly distributed across treatment groups. (Note although the term derived from the field of psychology). The aim is to reduce bias in the experiment due to an initial bias established when assigning treatment group. We are reluctant to replace pseudorandomly with haphazardly as the latter does not imply a logical organization. We have added text to help clarify the reason. The text now state: At the end of each photoperiodic treatment a subset of quail (n=12) body mass was used as a measure to pseudo randomly select birds for tissue collection and served to reduce the potential for unintentional bias.

      Comment 6 - Figure 1e,j: The text indicates that 398 and 130 genes were "rhythmically expressed" in the MBH and pituitary, respectively, but considerably fewer genes are shown in the heatmaps in Figure 1e,j. How were these genes selected, and what was the rationale for doing so? Also, some autumnal and vernal expression patterns show some strong similarities (e.g., 16a and 16v in the MBH), which could be discussed. Consider showing the two heatmaps with the columns also hierarchically clustered in a supplementary figure.

      We agree with the Reviewer that the full heatmap for the transcripts should be provided. The heat maps in Figure 1 are based on the transcripts with the most significant change; and were selected to provide a graphical representation that would be easily digested by the wide readership. We have created a new figure (ie. Fig. S1) that provides all the transcripts in heat maps for both the MBH and pituitary gland.

      Reviewer #3:

      Comment 1 I do not have too much to add to this section of my review. Broadly speaking, I would suggest that the authors address some of the concerns I highlight above, and integrate their thoughts into the paper more than they currently do. I think this is particularly important with respect to the limitations of many of the bioinformatic analyses.

      We thank the reviewer for their input and time assessing the manuscript. We have revised the manuscript in many sections incorporating the suggestions by Reviewer 3 above, and Reviewers 1 and 2.

      Comment 2 Some of the methods are also a little scant. For example, the qPCR analyses are not described in sufficient detail to replicate the study. What are the efficiencies? Were samples run in duplicate? What was the housekeeping control gene used? Was there only one, or were multiple housekeeping genes used?

      We apologise for the oversight, the absence of information was a mistake that missed our previous early revisions. The revised manuscript includes all the requested information. Line 333 states that all samples were run in duplicate. The efficiency for each transcript was within the MIQE guidelines (indicated on line 342) and were within the 0.7 to 1.0 range. Actin and glyceraldehyde 3-phosphate dehydrogenase were used as the reference transcripts. The most stable reference transcript was used to calculate fold change in target gene expression (lines 343-345).

    1. Author Response

      The following is the authors’ response to the original reviews.

      eLife assessment

      In this important paper, the authors report a link between brumation and tissue size in frogs, summarizing convincing evidence that extended brumation is associated with smaller brain size and increased investment in reproduction-related tissues. The research will be of broad interest to ecologists, evolutionary biologists, and those interested in global change biology. While the dataset involves significant field work and advanced statistical analyses, the manuscript would benefit from more explanation of the models, including why frogs are a good model in which to address these questions, and from general improvement in the structure and conciseness.

      We highly appreciate your positive assessment and that you considered our paper important and convincing.

      Reviewer #1 (Public Review):

      The authors have conducted lots of field work, lab work and statistical analysis to explore the effect of brumation on individual tissue investments, the evolutionary links between the relative costly tissue sizes, and the complex non-dependent processes of brain and reproductive evolution in anuran. The topic fits well within the scope of the journal and the manuscript is generally written well. The different parameters used in the present study will attract a board readership across ecology, zoology, evolution biology, and global change biology.

      Thank you for your positive and supporting feedback.

      Reviewer #2 (Public Review):

      The authors set out to show how hibernation is linked to brain size in frogs. If there were broader aims it is hard to decipher them. The authors present an extremely impressive dataset and a thorough set of cutting-edge analyses. However not all details are well explained. The main result about hibernation and brain size is fairly convincing, but it is hard to think of broader implications for this study. Overall, the manuscript is very confusing and hard to follow.

      Thank you for your compliments on our paper. As for your concerns, we have greatly revised our paper and, as we hope, improved its clarity. We have also added a few sentences to the conclusions to draw attention to potentially broader implications. Specifically, we describe how the focal traits of our study may all be affected by climate change. Differential constraints in necessary investments could be one of several reasons for the varying resilience to climate change between species in the same habitat.

      Reviewer #1 (Recommendations For The Authors):

      There are no issues on the availability of data and code.

      Thank you.

      Line 15: in the author contribution section, it seems that C.L.M. and J.P.Y are not in the author list.

      These two authors are not part of this study. This was a mistake.

      Line 24: I don't think it is vital or logical to address or compare too much on birds or mammals, which are not the focused taxa of the present study. Instead, it is better to clarify the reason why frogs and toads are ideal model taxon to this study.

      The reason for comparisons with birds and mammals was that all hypotheses related to the various trade-offs tested here had been developed in these taxa. One of the points of our paper was that these needed validation beyond the two taxa, in addition to being tested against one another (each prediction had been developed in a specific group and typically in isolation of all other hypotheses).

      Line 25-26: as the authors are shooting for eLife, as a general journal, it is not essential to provide the detailed methods in the abstract. But I think the authors need to strengthen the novelty of the work in the field here.

      The strength of our study was that all traits were measured directly in our species, including estimates of hibernation duration. Prior studies used various proxies, categorial classification or datasets assembled from multiple sources. To us, this seemed like a sufficiently important advance in the field to mention it, but considering the reviewer’s comment, we have now removed it.

      Line 28: "protracted brumation reduces brain size and instead promotes reproductive investments", as a correlative study, it is much more precise to change this sentence to a similar description as "protracted brumation is negatively correlated with brain size but is positively correlated with reproductive investments" here and related statements throughout the whole text.

      We agree that, strictly speaking, a path analysis can only point toward possible causality and not provide hard evidence as experimental manipulation might. The wording may have been a bit too strong here in our attempt to minimize wordiness and because all our analyses combined very strongly pointed in this direction. However, we have now changed this as suggested even though it now reads almost as if we had done no more than conducting a simple correlation. We have further paid attention to the wording of our interpretations throughout the paper.

      Line 32-33: it needs a bigger ending linking your main findings with the implication in understanding species response to the sustained environment change.

      We have reworded the ending of the abstract to: “Our results provide novel insights into resource allocation strategies and possible constraints in trait diversification, which may have important implications for the adaptability of species under sustained environmental change.”

      Line 63-68: this sentence is too long to understand and please simplify it.

      We have split the sentence into two sentences.

      Line 125-130: it is known that there are various frog reproductive modes (Crump et al. 2015) such as trade-offs between clutch size and egg size, different number of breeding during one year, etc. These different reproductive forms may also influence the brain size evolution with food availability and seasonal variations. Please clarify it.

      Yes, anurans do have varying reproductive modes, but to us, there is no a priori reason to assume that such variation would have a direct effect on brain evolution. Rather, in our opinion, different reproductive modes would have indirect effects by affecting the environment in which reproduction occurs. For example, larvae developing under different environmental conditions (substrate, larval density, egg provisioning etc.) might affect developmental trajectories that could influence how resources are available and allocated to different organs, including the brain. Alternatively, reproductive modes could influence the choice of environment for reproduction, thereby possibly affecting mating strategies and ultimately trait investments associated with these strategies. Given we were asked to shorten our paper, we believe that ‘environmental effects’ remains broad enough to encompass such variation, thereby not necessitating disentangling the different, and likely primarily indirect, ways that reproductive modes could be linked to brain evolution. However, if the reviewer would find it important to go into such detail in the paper, we will be happy to do so.

      Line 186-187: it is necessary to mention here that the authors also conducted sensitivity analyses to apply 2{degree sign}C or 4{degree sign}C below their experimentally derived as thresholds to test the robustness of the results to data uncertainty.

      We have added “(details on methodology and various sensitivity analyses for validation in Material and Methods)” to indicate the different types of sensitivity analyses, which included more than simply 2 or 4°C difference.

      Line 188: please change "In phylogenetic regressions" to "after controlling for phylogenetic autocorrelation/pseudo-replication" or similar sentence here.

      Our focus here was the phylogenetically informed GLS model rather than phylogenetic control itself. In the latter case, it would still not be clear what type of model was conducted with such phylogenetic control. To avoid any shorthand, we have reworded for more precision: “We employed phylogenetic generalized least-squares (PGLS) models, …”

      Line 177-287: please provide the exact variance explained by different predictor variables in brumation duration, individual tissue investments, and brain evolution. I also suggest that the authors need consider conducting multi-model inference-based model averaging analysis to test the relative importance of different variables. In addition, the present analyses did not include the interaction terms among variables, which may be more important than the effect of each individual factor.

      There may be some misunderstanding as these models represent separate analyses for each predictor as indicated by the associated λ values (never more than one value per model). We conducted separate models to determine which variables might even play a role in explaining variation in the corresponding response variables. Based on relevant predictors, we then conducted path analyses rather than general multi-predictor analyses. The relative effect sizes are represented by the correlation coefficients (r values) in the tables.

      Reviewer #2 (Recommendations For The Authors):

      Why exactly are the pairwise comparisons positively correlated (fig. S5) and then negatively correlated (fig. 3). What is actually driving this difference? For the phylogenetic path analyses 26 candidate models are chosen without explanation. What theory or hypotheses are these based on?

      We assume the reviewer is referring to the brain-body fat association. The two ‘pairwise’ analyses they mention were not the same. The correlation in Fig. S5 was a standard (albeit phylogenetically informed) partial correlation between the two focal tissues, controlling for SVL. By contrast, as described when introducing the analyses, negative associations were derived when additionally controlling for testes and hindlimb muscles, all of which deviated from isometry against body size. Here, the total mass of the four main tissues was divided by their proportional contribution to that mass in each species, then standardized for comparison across species. Since the total mass of these four tissues scaled directly with body size, larger-bodied species did not invest a proportion of their body to these tissues than smaller-bodied species, thus essentially rendering body size irrelevant for this analysis. However, the relative representation of the four traits changed between species such that more resources devoted to body fat was associated with a smaller brain, hence a negative relationship. Similarly, the multivariate analysis as well as the PCA also suggested similar trends when all four tissues were considered rather than purely pairwise comparisons.

      Regarding the second comment: We indeed used 28 pre-defined predictions for our larger path analysis.

      The authors haven't really provided much additional context either, and the discussion is almost entirely a rehash of the results section. I can't see the analysis code but this may be of use to people performing similar analyses.

      It is true that the traits and core message of the Discussion relate directly to our results, but we believe that our Discussion provides the essential biological context to our findings and to how they are connected. We tried not to go on tangents or too much speculation as the many results provided enough material to discuss, with several different ways that we expanded the prior state-of-the-art in the field. However, we have now expanded the concluding paragraph to place our findings in the context of climate change, given that this could affect anurans and the different traits examined in many ways that are directly related to the current study. Yet, we decided to keep this short because such extrapolation of our findings

      We indeed held off making the code available to the public in case dramatic changes to the paper were requested by the reviewers. However, it will be published.

      Additional recommendations from the Reviewing Editor:

      • One of the reviewers and I found the text a little difficult to follow. I suggest simplifying the paper by being more concise. For example, the introduction could be shortened into a 3-4 paragraphs of relevant text without overwhelming the reader. One of the reviewers wanted a better explanation of statistical models and I agree. The discussion could benefit from some structure - consider adding subheadings that would guide the reader as to the topic. Finally, the figures are difficult to see and should be made larger. For example, the graphs in Figure 1c could be on a panel below A and B so that readers can interpret the graph. In Figure 3 - the legend is far too small - please put above or below the graphs. In summary - I hope you consider a major re-write that would strengthen the accessibility of your paper to a broad audience.

      We have substantially shortened the paper despite adding further details on models and a broader context to the Discussion. We also condensed the Introduction to about two thirds of the original word count. However, we did not think that shortening it even further or splitting it into 3-4 paragraphs would improve readability. We still considered it important to introduce with sufficient context all major hypotheses that were tested against one another, provide at least some information on what was or was not known about the evolution of the focal traits and their links to one another or the environmental variables. We also found it important to touch on the differences between our study organisms and those typically studied in the context of hibernation or brain evolution, as this could affect the predictions. Given the number of hypotheses and traits, cutting the number of paragraphs would have meant merging some of them into very long ones, which we did not consider helpful.

      We further added short subheadings to the Discussion and adjusted the figures as requested.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1 (Public Review):

      Summary:

      The precise mechanism of how tetraspanin proteins engage in the generation of discs is still an open question in the field of photoreceptor biology. This question is of significance as the lack of photoreceptor discs or defects in disc morphogenesis due to mutations in tetraspanin proteins is a known cause of vision loss in humans. The authors of this study combine TEM and mouse models to tease out the role of tetraspanin proteins, peripherin, and Rom1 in the genesis of the photoreceptor discs. They show that the absence of Rom1 leads to an increase in peripherin and changes in disc morphology. Further rise in peripherin alleviates some of the defects observed in Rom1 knockout animals leading to the conclusion that peripherin can substitute for the absence of Rom1.

      Strengths:

      A mouse model of Rom1 generated by the McInnes group in 2000 predicted a role for Rom1 in rim closure. They also showed enlarged discs in the absence of Rom1. This study confirmed this finding and showed the compensatory changes in peripherin, maintaining the total levels of tetraspanin proteins. Lack of Rom1 leads to excessive open disks demonstrated by darkly stained tannic acid-accessible areas in TEM. Interestingly, increased peripherin expression can rescue some morphological defects, including maintaining normal disc diameters and incisures. Overall, these observations lead authors to propose a model that ROM1 can be replaced by peripherin.

      Thank you for your kind summary of our work.

      Weaknesses:

      The compensatory increase in peripherin and morphological rescue in the absence of ROM1 is expected, given the previous work from authors showing i) absence of peripherin showing increased ROM1 and ii) "Eliminating Rom1 also increased levels of Prph2/RRCT: mean Prph2/RRCT levels in P30 Prph2+/R retinas were 34% of WT, while levels in Prph2+/R/Rom1−/− retinas were 59% of WT" from Conley, 2019. The current study provides a comprehensive quantitative analysis. However, the mechanism behind the mechanism is unclear and warrants discussion.

      We referenced the result from the 2019 paper by Conley and colleagues in revision. As noted by the reviewer, new information in the current study consists of the precise quantification of the compensatory increase by a technique more accurate than semi-quantitative Western blotting. The nature of these compensatory increases is currently unknown and beyond the scope of experiments described in the current study. While this is an intriguing area for future investigation, we prefer not to speculate on the underlying mechanisms to avoid any appearance of data overinterpretation.

      Photoreceptor morphology appears better when peripherin is overexpressed. Is there a rescue of rod function (assessed by ERG or equivalent measures) in peripherin OE/Rom1-/- mice? Given the extensive work in this area and the implications the authors allude to at the end, it is important to investigate this aspect.

      It is indeed an interesting and potentially translationally relevant direction to address whether PRPH2 overexpression can rescue the long-term degeneration and functional defects of the loss of ROM1. Unfortunately, our work in this direction remains severely hindered by the fact that the current line of ROM1 knockout mice are notoriously poor breeders, allowing us to get only a handful of animals for each year of breeding. Therefore, we decided to limit our current study to addressing the structural roles of ROM1 and PRPH2 in supporting disc formation.

      Reviewer #1 (Recommendations For The Authors):

      Line 210: "ROM1 is able to form disc rims in the absence of PRPH2" is not demonstrated. The data shows that the tetraspanin domains are interchangeable similar to Conley, 2019. Similar concern for lines 225-226.

      We agree with the point regarding the interchangeable tetraspanin domains and clarified it in the text by referring to the tetraspanin body of PRPH2 where applicable. However, the 2019 paper by Conley and colleagues did not show any ultrastructural images of disc rims in a mouse without at least one copy of WT PRPH2 being expressed. The presence of normally looking disc rims in the complete absence of the tetraspanin body of PRPH2 is an original observation of the present study.

      Line 234: it is unclear what is meant by .."they are normally processed in the biosynthetic membranes" How does lack of ER localization lead to this conclusion?

      We clarified this point by replacing “normally processed” with “not trapped”.

      Lines 306-308: it is difficult to follow the rationale. How will a shift in the trafficking pathway affect disulfide bonds since these are formed in ER?

      The reviewer makes a good point that at least the bulk of S-S bridge formation takes place during protein maturation in the ER and the ability of additional intramolecular S-S bond formation in the Golgi is questionable. We, therefore, removed this speculation from Discussion.

      Given the poor development of OS, the authors could provide an estimate of how many OS-like structures were observed, with and without rims, in RRCT animals.

      The gross development of outer segment structures in RRCT homozygous mice was part of the 2019 paper by Conley and colleagues. We prefer to limit repeating experiments from the previous study, but instead wanted to focus specifically on disc rim formation, which was not analyzed in RRCT homozygous mice in the previous study.

      The term "function" is loosely defined throughout this manuscript. Specifically, the excess peripherin can resolve some of the morphological defects observed in Rom1 -/-, and these functional changes in morphology are the focus of this work.

      We removed the word “function” in three occasions where there may be an ambiguity in its meaning, as noted by the reviewer.

      Lines 115/116: Reference is missing for the statement that photoreceptor cell degeneration begins at P30.

      These lines reference Figures 1A,B, which include quantification of the number of photoreceptor nuclei. These results show that ROM1 knockout retinas exhibit a modest but statistically significant degeneration at P30. The text is modified to eliminate any ambiguity.

      Lines 143-144 are speculation and could be moved to the discussion section. "Prolonged delivery of disc membrane delivery to each disc" Any reference or experiments to support this statement?

      We respectfully disagree with moving this short speculative sentence to Discussion. We believe that it helps the reader to follow the flow of the data, while being clearly presented as a potential explanation rather than a conclusion.

      Line 245-246: Results explained in the following paragraph (247-254) do not answer the question "whether disc rim formation in PRPH2 2C150S/C150S knockin mice was driven by disulfide-linked ROM1 molecules", which is a valid and intriguing question. However, the results explained in 247-254 answer the question "if C150S PRPH2 can form discs in the absence of ROM1".

      We changed the text to replace “To address this question” with “To explore whether disc rims can be formed in the absence of any disulfide-linked tetraspanin molecules”, which precisely reflects what was addressed.

      Reviewer #2 (Public Review):

      In this study, Lewis et al seek to further define the role of ROM1. ROM1 is a tetraspanin protein that oligomerizes with another tetraspanin, PRPH2, to shape the rims of the membrane discs that comprise the light-sensitive outer segment of vertebrate photoreceptors. ROM1 knockout mice and several PRPH2 mutant mice are reexamined. The conclusion reached is that ROM1 is redundant to PRPH2 in regulating the size of newly forming discs, although excess PRPH2 is required to compensate for the loss of ROM1.

      This replicates earlier findings while adding rigor using a mass spectrometry-based approach to quantitate the ratio of ROM1 and PRPH2 to rhodopsin (the protein packed in the body of the disc membranes) and careful analysis of tannic acid labeled newly forming discs using transmission electron microscopy.

      In ROM1 knockout mice PRPH2 expression was found to be increased so that the level of PRPH2 in those mice matches the combined amount of PRPH2 and ROM1 in wildtype mice. Despite this, there are defects in disc formation that are resolved when the ROM1 knockout is crossed to a PRPH2 overexpressing line. A weakness of the study is that the molar ratios between ROM1, PRPH2 and rhodopsin were not measured in the PRPH2 overexpressing mice. This would have allowed the authors to be more precise in their conclusion that a 'sufficient' excess of PRPH2 can compensate for defects in ROM1.

      Thank you for these kind comments about our work. Regarding the stated weakness that we did not measure the molar ratios between PRPH2, ROM1 and rhodopsin in the ROM1 knockout line with PRPH2 overexpression: this is one experiment that we really hoped to do but were limited by the poor breeding of the ROM1 knockout line described above. With the current breeding rate, we estimate that we would need to wait for another year to get enough material to do this experiment, which we cannot do in the context of this manuscript revision. We hope, however, that eventually this may be a part of one of our future papers.

      Reviewer #2 (Recommendations For The Authors):

      The p-value for statistical significance is not listed, readers will assume the most commonly used 0.05 value was used but this should still be defined, especially since only asterisks summarizing the p-value range are provided in place of the actual p-values.

      The definitions of various numbers of asterisks of significance (including p<0.05 as a minimal measure of significance) are provided in the Methods section, whereas the exact p-values are stated in figure captions.

      There are 3 phrasing issues that are potentially misleading.

      1) While PRHP2 and ROM1 are the most abundant tetraspanins in photoreceptors they are not the only ones. It would be more precise if for example the Table 1 title was changed to 'molar ratio of outer segment tetraspanins and rhodopsin'.

      We have changed the title of Table 1 to “Quantification of molar ratios between PRPH2, ROM1 and rhodopsin in WT and Rom1-/- outer segments” to be more accurate.

      2) The protein expressed in RRCT mice is described as the 'tetraspanin core' while the cartoon (and original paper) shows the protein as simply being ROM1 with a different cytoplasmic C-terminus (from PRHP2). Tetraspanin core in other places is used to mean just the transmembrane bundle or that bundle with the EC loops.

      We agree that the term “tetraspanin core” may be confusing. We modified the text to not use this term and, when needed, refer to this main part of the tetraspanin molecule as a “body”.

      3) Line 203-205, the 'somewhat restored' qualifier should be removed. If the authors think there is an effect that is different from chance, they should use a different alpha and justify that choice.

      We removed this line, as suggested.

      Reviewer #3 (Public Review):

      In this manuscript, Lewis et al. investigate the role of tetraspanins in the formation of discs - the key structure of vertebrate photoreceptors essential for light reception. Two tetraspanin proteins play a role in this process: PRPH2 and ROM1. The critical contribution of PRPH2 has been well established and loss of its function is not tolerated and results in gross anatomical pathology and degeneration in both mice and humans. However, the role of ROM1 is much less understood and has been considered somewhat redundant. This paper provides a definitive answer about the long-standing uncertainty regarding the contribution of ROM1 firmly establishing its role in outer segment morphogenesis. First, using an ingenious quantitative proteomic technique the authors show PRPH2 compensatory increase in ROM1 knockout explaining the redundancy of its function. Second, they uncover that despite this compensation, ROM1 is still needed, and its loss delays disc enclosure and results in the failure to form incisures. Third, the authors used a transgenic mouse model and show that deficits seen in ROM1 KO could be completely compensated by the overexpression of PRPH2. Finally, they analyzed yet another mouse model based on double manipulation with both ROM1 loss and expression of PRPH2 mutant unable to form dimerizing disulfide bonds further arguing that PRPH2-ROM1 interactions are not required for disc enclosure. To top it off the authors complement their in vivo studies by a series of biochemical assays done upon reconstitution of tetraspanins in transfected cultured cells as well as fractionations of native retinas. This report is timely, addresses significant questions in cell biology of photoreceptors, and pushes the field forward in a classical area of photoreceptor biology and mechanics of membrane structure as well. The manuscript is executed at the top level of technical standard, exceptionally well written, and does not leave much more to desire. It also pushes standards of the field- one such domain is the quantitative approach to analysis of the EM images which is notoriously open to alternative interpretations - yet this study does an exceptional job unbiasing this approach.

      According to my expertise in photoreceptor biology, there is nothing wrong with this manuscript either technically or conceptually and I have no concerns to express.

      Thank you for these incredibly kind comments.

      Reviewer #3 (Recommendations For The Authors):

      I have no recommendations to make.

    1. Author Response

      The following is the authors’ response to the current reviews.

      We thank Reviewer 1 for their time reviewing our revised manuscript and appreciate their thoughtful suggestions for further clarity. In regard to the public review statement, "However, parts of the methods (e.g. assessment of blanks and data filtering) and results (e.g. visualization of plant community data) could still be polished, and the figures should be improved to increase the clarity of the manuscript", we have made small modifications in the text and figures during production of the Version of Record to address these important suggestions.


      The following is the authors’ response to the original reviews.

      Reviewer #1 (Public Review):

      This manuscript compiles the colonization of shrubs during the Late Pleistocene in Northern America and Europe by comparing plant sedimentary ancient DNA (sedaDNA) records from different published lake sediment cores and also adds two new datasets from Island. The major findings of this work aim to illuminate the colonization patterns of woody shrubs (Salicaceae and Betulaceae) in these sediment archives to understand this process in the past and evaluate its importance under future deglaciation and warming of the Arctic.

      We greatly appreciate the time and detailed consideration of our manuscript by Reviewer 1. Our responses to individual comments are highlighted in blue, with the original comments provided by the reviewer in black.

      The strength of evidence is solid as methods (sedimentary DNA) and data analyses broadly support the claims because the authors use an established metabarcoding approach with PCR replicates (supporting the replicability of PCR and thereby proving the occurrence of Salicaeae and Betulaceae in the samples) and quantitative estimation of plant DNA with qPCR (which defines the number of cycles used for each PCR amplification to prevent overamplification). However, the extraction methods need more explanation and the bioinformatic pipeline is not well-known and needs also some further description in the main text (not only referring to other publications).

      Thank you for bringing this to our attention. We have now provided greater detail on our extraction methods and bioinformatic pipeline.

      The authors compare their own data with previously published data to indicate the different timing of shrubification in the selected sites and show that Salicaceae occurs always like a pioneer shrub after deglaciation, followed by Betaluaceae with a various time lag. The successive colonization of Salicaceae followed by Betulaceae is explained by its differences in environmental tolerance, the time lag of colonization in the compared records is e.g. explained by varying distance to source areas.

      However, there are some weaknesses in the strength of evidence because full sedaDNA plant DNA assessment, quality of the sedaDNA data (relative abundance and richness of sedaDNA plant composition) and results from Blank controls (for sedaDNA) are not fully provided. I think it is important to show how the plant metabarcoding in general worked out, because it is known that e.g. poor richness can be indicative of less preserved DNA and a full plant assessment (shown in the supplement) would be more comprehensive and would likely attract a larger readership.

      Thank you for bringing these important points to our attention. The DNA dataset including the full taxa assemblage will be included with the manuscript upon publication and apologize for not including it during the review process. This dataset will also include information on positive and negative blanks used for quality control. Following suggestions from Reviewer 2, we have now also calculated some recently proposed DNA quality metrics (Rijal et al., 2021), which collectively support our earlier conclusions that our record is of sufficient quality to draw the current conclusions. We hope that the inclusion of the complete DNA dataset will indeed draw a larger readership.

      Further, it would allow us to see the relative abundance in changes of plants and would make it easier to understand if the families Salicaeae and Betulaceae are a major component of the community signal. Further, the possibility to reach higher taxonomic resolution with sedaDNA compared to pollen or to facilitate a continuous record (which is different from macrofossils) is not discussed in the manuscript but should be added. Also, the taxonomic resolution within these families in the discussed datasets would be of interest, also on the sequence type level if tax. assignments are similar.

      Thank you for these suggestions. We have focused on these two families as it is known from numerous pollen records and floras that they are the major component of the vascular plant communities in the regions investigated. Betula (birch) and Salix (willow) are indeed the most dominant woodland shrubs of the tundra biome, which covers expansive areas of the Arctic. For example, in Iceland natural woodlands, which cover 1.5% of the total land area, are composed of 80% birch shrubs (Snorrason et al. 2016, Náttúrufræðingurinn 86). Salix mixes in with Betula, especially around wet sites. Species from both genera are common and wide-spread throughout Iceland, but dwarf and cold tolerant species thrive best on the highland or at glacial sites, while shrub-like species are more common on the lowland, coastal area and in sheltered valleys. Flora of Iceland (http://www.floraislands.is/PDF-skjol/Checklist-vascular.pdf) lists Betula as the only genus of Betulaceae native to Iceland (page 79/80) and Salix as the major genus of Salicaceae (page 82-85), although Populus tremula (Salicaceae) exists in the wild but is rare (perhaps just a countable number of trees/shrubs in the whole country). The point is that, for Iceland, Betulaceae is Betula and Salicaceae is Salix, meaning that our sedaDNA method has the taxonomic resolution at the genus level. And with the help of pollen analysis of the site near Stóra Viðarvatn (the novel sedaDNA work of the present paper), i.e., Ytri-Áland site (Karlsdóttir et al. 2014), it is possible to interpret our results even to the species level, which we have only mention in the discussion. It has been suggested that matching sedaDNA results with botanical knowledge about the study site and the vegetation history (local reference database) is one way to increase taxonomic resolution of the sedaDNA approach (e.g. Elliott et al. 2023, Quaternary 6,7). In the same way we find our sedaDNA analysis having sufficient resolution to answer the questions asked in the present study. For the future, although we do not include it in the discussion this time, it should be possible to increase the taxonomic resolution of plant metabarcoding by priming multiple genes simultaneously like that is described as a proof of concept by Foster et al. (2021, Front Ecol Evol 9: 735744). In the revised version of the manuscript, we have now expanded on the power of sedaDNA in terms of increased taxonomic resolution and application in continuous lake sediment records in the introduction of the manuscript. Following Reviewer 2’s suggestion, we have now included the sequences used for taxonomic assignment in the supplement information.

      Another important aspect is how the abundance/occurrence of Salicaceae is discussed. Many studies on sedaDNA confirm an overrepresentation of this family due to better preservation in the sediment, far-distance transport along rivers, or preferences of primers during amplification etc. As this family is the major objective of this study, such discussion should be added to the manuscript and data should be presented accordingly.

      Thank you for raising this point. The reviewer is indeed correct that Salicaceae is typically overrepresented in read abundance compared to other vascular plant taxa in sedaDNA studies. However, as we mention in the Results and Interpretation section for Stóra Viðarvatn “As PCR amplification results in sequence read abundances that may not reflect original relative abundances in a sample (Nichols et al., 2018), we focus our discussion on taxa presence/absence,” we do not place weight on the indeed greater relative abundance of Salicaceae in our own dataset. As such, this different relative abundance of plant taxa reads should not influence the conclusions drawn in the manuscript.

      I also miss more clarity about how the authors defined the source areas (refugia) of the shrubs. If these source areas are described in other literature I suggest to show them in a map or so. Further, it should be also discussed and explained more in detail which specific environmental preferences these families have, this is too short in the introduction and too unspecific. Also, it would be beneficial to show relative abundances rather than just highlighted areas in the Figures and it would allow us to see if Salicaeae will be replaced by Betulaceae after colonizing or if both families persist together, which might be important to understand future development of shrubs in these areas.

      Thank you for allowing us to clarify. As the regions studied with the lake sediment records shown in this manuscript were all covered by extensive ice sheets during the Last Glacial Maximum (LGM, Fig. 1), plant refugia and source areas must have been located somewhere south of the ice sheet margins. Thus, we calculate our distance to source as the minimum distance from a lake site to land beyond the extent of the ice sheet during the LGM. This has now been clarified in the text and highlighted in Fig. 1. We have also added in the discussion molecular results from Thórsson et al. (2010, J Biogeogr 37) on possible source origins of Betula in Iceland. Details on taxa environmental preferences have now been expanded upon in the Discussion section where we explore the various trait-based factors that may influence the relative differences in colonization timing between Salicaceae and Betulaceae. We have now also edited Figs. 3 and 4 to include PCR replicates instead of highlighted bars to better compare the DNA and pollen datasets from Iceland.

      The author started a discussion about shrubification in the future, but a more defined evaluation and discussion of how to use such paleo datasets to predict future shrubification and its consequences for the Arctic would give more significance to the work.

      Thank you for this suggestion and allowing us to expand on potential future changes. We have now edited this final section of the paper to provide a little more detail on how we envision these records being used to predict future shrubification and climate change.

      Reviewer #1 (Recommendations For The Authors):

      I list some more specific details here.

      You speak about "read counts", I guess you used relative abundance of read counts, you should state it like this.

      Thank you for allowing us to clarify. The data that we refer do in terms of read counts is from the previously published studies in the circum North Atlantic. The data provided from these studies is raw read counts, and not relative abundance.

      Line 100: What do you mean here: "temperature changes in prior warm periods"?

      Thank you for allowing us to clarify. We have rephrased to sentence to “higher temperature in prior warm periods”, which we hope is clearer for the reader.

      Line 134: How is DNA diluted by minerogenic sediment? Did the sedimentation rate increase? Typically minerogenic input should be beneficial for DNA preservation.

      Thank you for allowing us to clarify. These samples were primarily comprised of tephra glass with minimal organic content. While we agree that minerogenic sediment is generally beneficial for DNA preservation, the predominance of inorganics (tephra) that fell from the sky, rather than being washed into the lake from the landscape, would not carry organic sediment with it. We have rephrased the sentence to make this clearer.

      I would suggest adding more citations to the text (for example statements in lines 106, 110, 368)

      Thank you for the suggestion. The manuscript has been edited accordingly.

      Better divide your discussion part: discussion about dispersal mechanisms occur in both sections. Maybe you could divide it into environmental factors for colonization and traitbased factors (only an idea).

      Thank you for the suggestion. We have now edited the second dispersal section to “Environmental dispersal mechanisms” to be clearer about our focus on factors such as wind, sea ice, and birds that may transport the seeds across the North Atlantic. The previous section retains the trait-based factors that may influence relative timing in colonization between Salicaceae and Betulaceae.

      Which type of sequencing did you use, paired-end 76bp is unknown to me.

      Methods have now been edited to clarify this, along with details related to extraction methods as requested in the Public Review.

      Reviewer #2 (Public Review):

      Harding et al have analysed 75 sedaDNA samples from Store Vidarvatn in Iceland. They have also revised the age-depth model of earlier pollen, macrofossil, and sedaDNA studies from Torfdalsvatn (Iceland), and they review sedaDNA studies for first detection of Betulaceae and Salicaceae in Iceland and surrounding areas. Their Store Vidarvatn data are potentially very interesting, with 53 taxa detected in 73 of the samples, but only results on two taxa are presented. Their revised age-depth model cast new light on earlier studies from Torfdalsvatn, which allows a more precise comparison to the other studies. The main result from both sedaDNA and the review is that Salicaceae arrives before Betulaceae in Iceland and the surrounding area. This is a well-known fact from pollen, macrofossil, and sedaDNA studies (Fredskild 1991 Nordic J Bot, Birks & Birks QSR 2014, Alsos et al. 2009, 2016, 2022) and as expected as the northernmost Salix reach the Polar Desert zone (zone A, 1-3oC July temperature) whereas the northernmost Betula rarely goes beyond the Southern Tundra (zone D, 8-9 oC July temperature, Walker et al. 2005 J. Veg. Sci., Elven et al. 2011 http://panarcticflora.org/ ).

      We greatly appreciate the time and detailed consideration of our manuscript by Reviewer 2. Our responses to individual comments are highlighted in blue, with the original comments provided by the reviewer in black.

      While we agree that previous studies have indeed indicated a relative delay in Betula colonization relative to Salix, most of these have relied on pollen and macrofossil evidence, which are complicated to use as proxies for the first appearance of a given taxa (see our Introduction in the main manuscript). A few studies have shown this also with sedaDNA (e.g., Alsos et al., 2022), which is a more robust proxy for a plant taxa’s presence, but these have been limited geographically (e.g., northern Fennoscandia). In our study, we show that this pattern is reflected in 10 different lakes across the North Atlantic, emphasizing the broad nature of Betula’s delayed colonization relative to other woody shrubs, such as Salix.

      My major concern is their conclusion that lag in shrubification may be expected based on the observations that there is a time gap between deglaciation and the arrival of Salicaceae and between the arrival of Salicaceae and Betulaceae. A "lag" in biological terms is defined as the time from when a site becomes environmentally suitable for a species until the species establish at the site (Alexander et al. 2018 Glob. Change Biol.). The climate requirement for Salicaceae highly depends on species. In the three northernmost zones (A-C), it appears as a dwarf shrub, and it only appears as a shrub in the Southern Tundra (D) and Shrub Tundra (E) zone, and further south it is commonly trees. Thus, Salicaceae cannot be used to distinguish between the shrub tundra and more northern other zones, and therefore cannot be used as an indicator for arctic shrubification. Betulaceae, on the other hand, rarely reach zone C, and are common in zone D and further south. Thus, if we assume that the first Betulaceae to arrive in Iceland is Betula nana, this is a good indicator of the expansion of shrub tundra. Thus, if they could estimate when the climate became suitable for B. nana, they would have a good indicator of colonisation lags, which can provide some valuable information about time lags in shrub expansion (especially to islands). They could use either independent proxy or information from the other species recorded in sedaDNA to reconstruct minimum July temperature (see e.g. Parducci et al. 2012a+b Science, Alsos et al. 2020 QSR).

      We appreciate the reviewer’s insight into the implications of our use of the word “lag”. Indeed, as we do not have site-specific climate timeseries for each lake record, we have adjusted our wording to “delay”, which we believe is more general and descriptive of our observations. We recognize the importance of independent paleotemperature records for each lake, but these are not yet available for all records, so we prefer to keep our study focused on the delay instead. In addition, we prefer not to derive temperature records from the vegetation sedaDNA records, as these are not independent and will incorporate changes driven by additional factors, such as soil and light (e.g., Alsos et al., 2022). We have added some text to the final section on Future Outlook that elaborates on the need for complimentary records of past climate to pair with paleoecological records of colonization. We hope that this motivates the community to pursue these lines of research that we agree are needed.

      The study gives a nice summary of current knowledge and the new sedaDNA data generated are valuable for anyone interested in the post-glacial colonisation of Iceland. Unfortunately, neither raw nor final data are given. Providing the raw data would allow re-analysing with a more extensive reference library, and providing final data used in their publication will for sure interest many botanists and palaeoecologist, especially as 73 samples provide high time resolution compared to most other sedaDNA studies.

      Finally, the raw and final data, including blank controls, used in our study for Stóra Viðarvatn will ultimately be provided with the manuscript’s publication. We apologize for not including it with the original submission.

      Reviewer #2 (Recommendations For The Authors):

      Line 112-113: Difference in northward expansion rate is not the same as lag. Thus, your conclusion "As a result, the biospheres role in future high latitude temperature amplification may be delayed." does not derive directly from the data you present.

      Thank you for allowing us to clarify our wording. We have rephrased the sentence to align with our results more closely as stated in the Abstract of the manuscript.

      .Line 133: From Figure S3, it looks like three or possibly four samples failed.

      Thank you for pointing this out. First, we realized that the DNA reads originally included in Figure S3 were from after filtering. We have now updated the figure to include the total raw reads, which is a better indicator of DNA reliability (Rijal et al., 2021). Based on the total raw reads, only two samples failed with total reads of 2 and 5.

      Line 141: You say you focus on presence/absence, but you do show quantitative results for Salix and Betula (0-5 PCR repeats) in Figure 2.

      Thank you for allowing us to clarify. Fig 2 shows the number of replicates that meet our criteria for taxa presence, where a higher number of replicates corresponds to a higher likelihood of presence.

      Line 142: Where are the other 51 taxa shown?

      We are providing the full DNA record in the supplement, which will be published alongside the main manuscript. We have also now included a plot of species richness against sample depth in Fig. S2.

      Line 178-179: Note that the revised date of first detection is close to what has been previously published (Salix ~10300 vs. 10227, Betula ~9500 vs 9680), so it does not make any changes to previous interpretation.

      Yes, this is true. However, we still believe it is important to always consider improvements in age models to best correlate the timing of events between different paleo records.

      Line 191-194 and Figure S2: I leave the evaluation of revised age-depth model to the geologist.

      As this aspect was not commented on, we assume that both reviewers are satisfied.

      Line 197: "Delay" is a more correct word than "lag".

      Thank you, edited.

      Line 210: Where do 1700 and 2500 come from? If your revised age of ice retreat is 11 800, and your revised date of Salix and Betula arrival are ~10 300 and ~9500, I make this 1500 and 2300.

      Yes, this is correct. Thank you for pointing out this error.

      Line 215-217: To be more certain about any bias caused by low DNA quality, I suggest you explore your data using the tools presented in Rijal et al. 2021 Science Advances. As you do not provide your data, I cannot evaluate the quality of them.

      Thank you for the suggestion. We have now calculated the various DNA quality indices developed by Rijal et al. (2021). This has been added to the methods and results section for the Stóra Viðarvatn record, as well as in Fig. S3. The MTQ and MAQ scores are known to correlate with species richness when richness is low (n<30, Rijal et al., 2021), which is likely an artifact of the requirement that the 10 best represented barcode sequences are required to calculate these scores. As this correlation is observed in our dataset and given that our species richness is low (n<30, Fig. S2), the low MTQ and MAQ score are not likely indicative of low-quality DNA. We therefore judge the quality of our DNA on total raw reads and CT values, which remain relatively constant through time (Fig. S2).

      Line 226: Do you mean TDV?

      We intended to omit unnecessary abbreviations throughout the manuscript, such as lake names, in our original manuscript. We have now changed TORF, which we use as the lake’s abbreviation, to the full lake name, Torfdalsvatn.

      Line 282-283: Given that the basal sediments of Nordivatnet are marine (Brown et al. 2022 PNAS Nexus), even a low detection may be a strong indication of local presence.

      Thank you for this point. However, to standardize the records and compare across a wide range of geographical and depositional settings, we prefer to apply the same criteria for the taxa’s presence to each lake as outlined in our Methods.

      Line 289: See the definition of "lag"

      Changed to “delayed” per your earlier suggestion. Thank you.

      Line 298-303: I agree that the late appearance of Betula at Langfjordvatnet (10 000 cal BP) is anomalously long and a bit unexpected given that it is found at five other lakes in the region 13000-10200 cal BP (Alsos et al. 2022). However, a likely explanation is the lack of area with stable soil - B. nana requires a greater degree of soil development compared to other heath shrubs (Whittaker 1993) and Langfjordvatnet is surrounded by steep scree slopes (Otterå 2012 master thesis Univ. Bergen). At Jøkelvatnet, Salix appears in the four available samples from 10453 to 9811 whereas Betula arrives 9663. Here, the arrival of Betula is just at the drop of local glacier activity and at the temperature rise, suggesting that it arrives immediately after the climate becomes suitable (Elliott et al. 2023 Quaternary). Thus, based on N Fennoscandia where we have more data available, it does not show lags and does not support delayed shrubification (which contrasts with what we have shown for many other species including common dwarf shrubs, see Alsos et al. 2022). Would be very interesting to have similar data from Iceland, which has a large dispersal barrier.

      Thank you for these further considerations. We have incorporated those related to Langfjordvannet into the manuscript accordingly. We also appreciate the point regarding Jøkelvatnet. However, as stated in our Methods section for “Published sedaDNA datasets”, we do not include Jøkelvatnet in our comparison due to the impact of glacier activity as the reviewer notes: “Finally, both Jøkelvatnet and Kuutsjärvi were impacted by glacial meltwater during the Early Holocene when woody taxa are first identified (Wittmeier et al., 2015; Bogren, 2019), and thus the inferred timing of plant colonization is probably confounded in this unstable landscape by periodic pulses of terrestrial detritus.” Due to the glacier’s presence in the lake catchment, it is not possible to discern whether delay in Betulaceae would have occurred if the glacier were not present. Therefore, we prefer to keep this record excluded from our comparisons.

      Line 316-319 and 344: Based on contemporary genetic patterns, Alsos et al. analyse the relative importance of adaptation to dispersal compared to other factors.

      Thank for you bringing up this important point. We have now expanded our discussion to include these analyses from Alsos et al. (2022).

      Line 342+350: Original publication is Alsos et al. 2007 Science

      Thank you, edited.

      Line 343: Alsos et al. 2009 Salix study is the wrong citation here. Eidesen et al. 2015 Mol. Ecol. shows phylogeography of Greenland population but not Baffin - I am not aware of any contemporary genetic studies of Betula from Baffin.

      Thank you for pointing this out. We will also include the Eidesen et al. (2015) citation for reference to Greenland. However, there is one data point included for southern Baffin Island in Alsos et al. (2009), so we will retain this citation here as well.

      Line 351-353: See comment about Betula from Baffin above. Also, I am not sure I follow here - what do you mean by "these populations" - the Svalbard ones or Iceland? Eidesen et al. 2015 is the wrong citation for Salix - use Alsos et al. 2009. Alsos et al. 2009 suggest Iceland (and E Grenland) was colonized from north Scandinavia, although this was uncertain as no data were available from Faroe/Shetland. Svalbard was colonized from N Fennoscandia (Alsos et al. 2007).

      Regarding Baffin Island sources, we refer the reviewer to our response to their previous comment. We have clarified the wording of our sentence from “these populations” to “the modern populations from these locations [Baffin Island, Greenland, and Svalbard]”. We have removed reference to Eidesen et al. (2015), as this is for Betula rather than Salix. Finally, we have added a citation for Alsos et al. (2007) here for Svalbard.

      Line 354-355: AFLP suggest that Baffin and W Greenland were colonised from a refugia south of the Wisconsin Ice Sheet, see Alsos et al. 2009.

      Yes, we are aware, thank you. Our reference to “mid-latitude North America” in the sentence acknowledges this refugia, but we have now added “south of the Laurentide Ice Sheet” for further clarification.

      Line 363-381: See comment above; your Store Vidarvatn data do currently not demonstrate a lag between environmental suitability and climate, but using the rest of the DNA record, potentially it could. Would also be good to reflect on the distance to the source area for shrubs Late Glacial/Early Holocene compared to now.

      Thank you for these suggestions. We have edited this section of the manuscript to elaborate on the need for independent climate reconstructions as well as the fact that distances to plant refugia are shorter now than during the last postglacial period.

      Line 396-416: I am not an expert on tephra so I will not comment on this part.

      As this aspect was not commented on, we assume that both reviewers are satisfied.

      Line 459-457: Please provide results of how much data is lost at each step of filtering.

      We added the read loss following each filtering step as a table in the supplemental information (Table S4).

      Throughout the manuscript, you go only to species level although DNA in most cases is able to distinguish to genus level within Salicaceae and Betulaceae - which sequences did you identify?

      Sequences are now provided in the supplemental for Salicaceae and Betulaceae. Based on our bioinformatic pipeline, reference library and requirement for 100% match between sequence and taxonomy, we were only able to distinguish between species level.

      Figure 2: The detection of Betulaceae is very sporadic in Stóra Vidarvatn with occurrence in only seven samples and hardly ever in all 5 repeats, suggesting that if you apply a statistical model to estimate first arrival (see Alsos et al. 2022), you will have a large confidence interval. Thus, these uncertainties should be considered when estimating the delayed arrival of Betula compared to Salix. The data from Torfdalsvatn (which I assume are from Alsos et al. 2021 although not specified in the figure legend), shows detection in all samples from the first appearance and mostly in 8 of 8 repeats (shown in the original publication - you could to the same here), thus providing a more accurate estimate for the time gap between arrival of Salix and Betula.

      Thank you for bringing up this important point. The detection of Betulaceae is indeed sporadic, but we believe it reflects the genuine nature of its presence/absence during the Holocene in Northeast Iceland. This is supported by Betula pollen from a nearby peat record that shows a similar history (Fig. 4, Karlsdóttir et al., 2014), which we have now elaborated on in the Results and Interpretation section. As for the timing of Betulaceae colonization at this site, the first appearance in the DNA record should be a close minimum estimate as shown with modern DNA and plant survey comparisons (e.g., Sjögren et al., 2017; Alsos et al., 2018). The true first appearance could be biased by small amounts of plants being present in the early stages of colonization and not registering the sedimentary record until enough dead plant material is transported to the depocenter of the lake. However, this is likely less than age model uncertainties and therefore not likely relevant on geologic timescales as in this study. In this sense, our age models and those published for the other records indicate this is generally on the order of several hundred years. In addition, we have now added the Alsos et al. (2021) reference for Torfdalsvatn. Unfortunately, this Torfdalsvatn study does not provide number of PCR repeats so we will keep the figure as is as it best represents the available data.

      Figure 5: I suggest adding lake names to the figure. Is there a dot missing for lake 5 for Salicaceae?

      Thank you for the suggestion, we have added lake names to the figure. There is a dot marked for Salicaceae for lake 5, however, not for Betulaceae as this taxon was not identified. We refer the reviewer to the Discussion Section “Postglacial sedaDNA records from the circum North Atlantic” and the lake’s original publication (Volstad et al., 2020).

      Figure 6: I find it more relevant to plot colonization time versus distance to LGM sheetice margin - lake number is just an arbitrary number.

      We appreciate the suggestion and have modified the figure accordingly.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1 (Public Review):

      In the present manuscript, Abele et al use Salmonella strains modified to robustly induce one of two different types of regulated cell death, pyroptosis or apoptosis in all growth phases and cell types to assess the role of pyroptosis versus apoptosis in systemic versus intestinal epithelial pathogen clearance. They demonstrate that in systemic spread, which requires growth in macrophages, pyroptosis is required to eliminate Salmonella, while in intestinal epithelial cells (IEC), extrusion of the infected cell into the intestinal lumen induced by apoptosis or pyroptosis is sufficient for early pathogen restriction. The methods used in these studies are thorough and well-controlled and lead to robust results, that mostly support the conclusions. The impact on the field is considered minor as the observations are somewhat redundant with previous observations and not generalizable due to cited evidence of different outcomes in other models of infection and a relatively artificial study system that does not permit the assessment of later time points in infection due to rapid clearance. This excludes the study of later effects of differences between pyroptosis and apoptosis in IEC such as i.e. IL-18 and eicosanoid release, which are only observed in the former and can have effects later in infection.” We thank the reviewer for their time and effort in assessing our manuscript.

      We agree with the reviewer’s overall assessment. One minor clarification is that the engineering used does not express the proteins in “all growth phases”, but rather only when the SPI2 T3SS is expressed; we used the sseJ promoter, which is a SPI2 effector.

      Reviewer #2 (Public Review):

      In this study, Abele et al. present evidence to suggest that two different forms of regulated cell death, pyroptosis and apoptosis, are not equivalent in their ability to clear infection with recombinant Salmonella strains engineered to express the pro-pyroptotic NLRC4 agonist, FliC ("FliC-ON"), or the pro-apoptotic protein, BID ("BID-ON"). In general, individual experiments are well-controlled, and most conclusions are justified. However, the cohesion between different types of experiments could be strengthened and the overall impact and significance of the study could be articulated better. ”

      We thank the reviewer for their time and effort in assessing our manuscript. We agree with the reviewer’s overall assessment.

      Reviewer #1 (Recommendations For The Authors):

      Abstract: While new terms are sometimes useful for the visualization of concepts and I appreciate the "bucket list" analogy, it is not yet an accepted term in cell death research, and using it twice in the abstract seems out of order. ”

      We opted to keep the term, but reduce its use to once in the abstract with a specific comment on the recent coining of the term: “We recently suggested that such diverse tasks can be considered as different cellular “bucket lists” to be accomplished before a cell dies.” We recently coined this term in a review in Trends in Cell Biology, where three reviewers had quite positive comments about the concept. Time will tell whether this is a useful term for the cell death field or not.

      “In figure 2C-F Caspase 1 and Gsdmd deficient animals have higher levels of vector control strain than WT or Nlrc4. Could this be due to the redundancy with Nlrp3 in systemic infection described by Broz et al? Please mention in the description of the results.”

      The reviewer correctly points out a trend in the data. However, our experiments are not powered to show that this difference is statistically significant. Nevertheless, we now make note of the trend, and cite prior papers that have observed NLRC4 and NLRP3 redundancy against non-engineered S. Typhimurium strains.

      “The observation that apoptosis does not affect Salmonella systemically would be strengthened if the experiments using the BIDon strain could be taken out to a later time point, i.e. 72 or 96 h.”

      Indeed, we wanted to extend our studies to these timepoints. However, although expression of the SspH1 translocation signal is benign for 48 h, by 72 h this causes mild attenuation (regardless of whether the BID-BH3 domain is attached as cargo). We think that the degree of difficulty for SPI2 effectors to reprogram the vacuole increases over time, and that only beyond 48 h does SPI2 need to function at peak efficiency. This observation will be reported in a second manuscript that is written and will be submitted within this month. We are happy to supply this manuscript to reviewers if they would like to see the results. We also added text to the discussion to alert the reader to the caveats of engineering S. Typhimurium at later timepoints.

      “Discussion: The authors claim that pyroptotic and apoptotic signaling in IEC have the same outcome and IEC only has extrusion as a task. However, upon pyroptosis, IEC also releases IL-18 and eicosanoids, which is not the case during apoptosis. While the initial extrusion makes all the difference in early infection, Mueller et al 2016 showed that lack of IL-18 has an effect on salmonella dissemination at a 72h time point. The FlicON model can not test later time points as the bacteria will be cleared by then, but this caveat should be discussed.”

      We revised the text in the discussion to make it clear that extrusion is not the only bucket list item for IECs, and that IL-18 and eicosanoids are included in the bucket list for IECs after caspase-1 activation, and add the citation to Muller et al.

      Reviewer #2 (Recommendations For The Authors):

      1) The manuscript is written in a rather colloquial style. Additional editing is recommended. ”

      We edited the abstract to limit the use of the bucket list term and to make more clear that this is a new term that our lab has proposed in a recent review in Trends in Cell Biology. The managing editor for the current manuscript at eLife commented that the prose was lively and thoughtful. We would be happy to make edits if the reviewer has more specific suggestions.

      2) It is not obvious from the Results section that all mouse infections were, in fact, mixed infections. This should be stated more clearly. Additionally, there is a minor concern regarding in vivo plasmid loss over time.

      We added text to the results to make this clearer at the beginning of each in vivo figure in the paper. Our experiments are intentionally blind to any Salmonella that have lost the plasmid. These bacteria essentially convert to a wild type phenotype, and thus are no longer representative of FliCON or BIDON bacteria. We also verify the long established equal competition between pWSK29 (amp) and pWSK129 (kan) in Supplemental Figure 2A-B. Prior experiments from the laboratory of Sam Miller and others in the 1990s showed that plasmid loss occurs at a rate of less than 1%.

      3) Results shown in Figure 4 are difficult to interpret. Essentially, the experiment is aimed at comparing the two engineered Salmonella strains (FliC-ON and BID-ON). However, these strains are very different from one another, which may have a confounding effect on the interpretation of the data.”

      The reviewer has interpreted the experiment correctly. We wanted to make clear to the reader that the two strains induce apoptosis under different kinetics. Indeed, it would be very surprising if two different engineering methods created strains that caused apoptosis with identical kinetics. We make two text edits to the results to make this clearer, concluding with “Overall, both ways of achieving apoptosis are successful in vitro, but with slightly different kinetics.”.

      4) What new insights into mechanisms of bacterial pathogenesis and host response are gained by using recombinant Salmonella (over)expressing a pro-apoptotic protein is not clearly stated.”

      We modify the introduction to make this more clear, stating: “Here, we investigate whether apoptotic pathways could be useful in clearing intracellular infection. Because S. Typhimurium likely evades apoptotic pathways, we again use engineering in order to create strains that will induce apoptosis. This allows us to study apoptosis in a controlled manner in vivo.”

      5) The Discussion section, while provocative, seems speculative and should be revised. Concepts of "backup apoptosis" and crosstalk between pyroptosis and apoptosis are intriguing, but it seems implausible to this reviewer that a cell might "know" that it will die, might "choose" how to die, and might aim to complete a "bucket list" before it loses all functional capacity. The usage of these types of terms does not help bolster the authors' central conclusions. ”

      We agree that cells do not “choose” pathways for regulated cell death. We had over-anthropomorphized the concepts surrounding these interconnected cell death pathways that are created by evolution. We edited the introduction and discussion to remove the “choose” term. However, we kept the second phrase using “know” in the discussion with an added clarifier: “Once a cell initiates cell death signaling, it “knows” that it will die (or rather evolution has created signaling cascades that are predicated upon the initiation of RCD).”. Sometimes anthropomorphizing scientific concepts can be a useful tool to facilitate understanding of complex scientific concepts. For example, the “Red Queen hypothesis” clearly anthropomorphizes the concept of continuous evolution to maintain an evolutionary equilibrium. We have found that scientists in the cell death field often think that modes of cell death are or should be interchangeable. We hope that the idea of the “bucket list” will help to crystalize the idea that distinct processes leading up to different types of regulated cell death can have very different consequences during infection.

      Additional Comments from the Reviewing Editor:

      1) The authors show that FliC-ON is not cleared from the spleen of Casp1 KO or Gsdmd KO mice. The conclusion is that the backup apoptosis pathways that should be present in these mice are insufficient to clear the bacteria from the spleen. However, although it is shown that bone marrow macrophages undergo apoptosis in vitro, I believe it is not shown that the apoptotic pathways are actually activated in the spleen. This seems like an important caveat. Could it be shown (or has it previously been shown) that the cells infected in the spleens of Casp1 KO or Gsdmd KO are activating apoptosis? If not, it seems possible that the reason the bacteria are not cleared is due to a lack of apoptosis activation rather than an ineffectiveness of apoptosis, and the authors could consider explicitly acknowledging this.”

      We agree, and added to the discussion “A final possibility is that our engineered strains are not successfully triggering apoptosis within splenic macrophages. This could be due to intrinsic differences between BMMs and splenic macrophages or could be due to bacterial virulence factors that fail to suppress apoptosis only in vitro. It is quite difficult to experimentally prove that apoptosis occurs in vivo due to rapid efferocytosis of the apoptotic cells.”

      2) Both reviewers were somewhat unhappy about some of the new terminology/metaphors that are introduced in the manuscript. I understand the reviewers' concerns but also feel that the writing is lively and thoughtful. It is up to the authors to decide whether to retain their new terminology, but the response of two expert reviewers might give the authors some pause. At a minimum, to address the concern about an unfamiliar term being used in the abstract, perhaps explicitly state that you are introducing "bucket list" as a new concept to help explain the results. The introduction of this concept may indeed be one of the novel contributions of the manuscript.”

      We opted to keep the term, but reduce its use to once in the abstract with a specific comment on the recent coining of the term: “We recently suggested that such diverse tasks can be considered as different cellular “bucket lists” to be accomplished before a cell dies.” We recently coined this term in a review in Trends in Cell Biology, where three reviewers had quite positive comments about the concept. Time will tell whether this is a useful term for the cell death field or not.

      3) Perhaps this is implied in the discussion already, but it might make sense to state the obvious difference between IECs and splenic macrophages which is that the death of the former results in the removal of the cell and its contents (i.e., Salmonella) from the tissue, whereas the death of the latter does not. This seems like the simplest explanation for why apoptosis restricts bacterial replication in IECs but not macrophages, and I am not sure if introducing the concept of a "bucket list" improves the explanation or not.”

      We agree that this narrative nicely distills the differences between these cell types. We edited the final paragraph of the discussion to include this narrative.

      4) Lastly, some minor comments

      -- p.2 "hyperactivate" instead of "hyperactive"?”

      Corrected.

      -- the authors may also want to mention Shigella, as it might provide another example that apoptotic C8dependent backup protects IECs”

      Yes, indeed, this is a good comparison to make. We added this to the discussion.

      -- p.8, in case readers are unfamiliar with the concept of a PIT, the authors should perhaps cite their own work when they first mention this concept (at the top of the page)”

      Indeed, citation added.

    1. There are concerns that echo chambers increase polarization, where groups lose common ground and ability to communicate with each other. In some ways echo chambers are the opposite of context collapse, where contexts are created and prevented from collapsing

      Echo chambers are interesting as I think they are one of many factors that form someones opinion. I think it is mainly based on the people you grow up around (family, friends, etc..). Now that we are becoming more online echo chambers may become more prevalent in how people think. This is scary due to all the misinformation and untrustworthy people online.

  2. Oct 2023
    1. Author Response

      The following is the authors’ response to the original reviews.

      We appreciate the critical review of our manuscript. We believe that we have addressed the questions and concerns raised by the reviewers to the best of our ability. As part of the revision, we conducted two new experiments to enhance the rigor of the conclusions and to provide more insights into the mechanism of STEAP proteins, and we reorganized the Results section, as suggested by the reviewers, following to a clearer logical thread. The new data are briefly summarized below.

      1) Reduction of L230G STEAP1 by reduced FAD. We made Leu230Gly STEAP1 mutant and measured the rate of heme reduction by reduced FAD. We found that the rate of heme reduction in L230G STEAP1 is slower than that in the wild type STEAP1. Since Leu230 is solvent accessible only from the intracellular side, this result supports the conclusion that reduced FAD binds to STEAP1 on the intracellular side and reduces the heme. This result also indicates that leucine, which is found at the equivalent position in STEAP1, 2 and 3, and Phe359 in STEAP4, has a significant role in mediating electron transfer from FAD to the bound heme.

      2) Reduction of STEAP2 by reduced FAD. We showed that STEAP2 can be reduced when supplied with reduced FAD, and that the rate of heme reduction is significantly slower than that of reduction of STEAP1 by reduced FAD. This result is consistent with presence of the oxidoreductase domain (OxRD)† in STEAP2, which hampers direct entrance of the isoalloxazine ring of FAD to its binding pocket in the transmembrane domain (TMD). On the other hand, the rate of heme reduction by reduced FAD is much faster than that of heme reduction in the presence of NADPH and FAD, indicating that reduction of FAD by NADPH is rate-limiting in the electron transfer chain in STEAP2.

      †: To be consistent with literature, we adopted the nomenclature “oxidoreductase domain (OxRD)” for the N-terminal soluble domain in STEAP proteins. We used the term “reductase domain (RED)” in the previous version of our manuscript.

      Reviewer #1 (Public Review):

      This important study reveals the structure of human STEAP2 for the first time and suggests the electron transport pathway, but some questions remain regarding the interpretation of the in vitro electron transport experiments, the lack of available redox couples, and potential alternative hypotheses that would if addressed, strengthen the claims in the manuscript.

      Strengths

      One of the clear strengths of the manuscript that stands out is the determination of the structure of human STEAP2. The structures of some other homologs are known, but STEAP2's structure was not, and STEAP2 seems to have an unusually low activity towards certain metal chelates. The approach of producing the human STEAP2 in insect cells with the supplementation of cofactor biogenesis components nicely results in cofactor-replete protein. The structure of STEAP2 reveals a domain-swapped trimer, with the NADPH-binding domain of the neighboring protomer within electron-transport distance of the FAD-heme axis. The FAD has an interesting and somewhat unusual extended conformation and abuts a Leu residue that may regulate electron transport. Another strength of the manuscript is the demonstration that STEAP1, which does not have the internal NADPH binding domain, can interact modestly and shuttle electrons to the heme in STEAP1 through FAD. These experiments nicely expand information on the function of STEAP1 and provide a structural basis for electron transport in STEAP2.

      Weaknesses

      A major weakness in the manuscript lies with the kinetics data and how the data, as presented, are unclear to the reader regarding their impact and their connection to the purported electron transport scheme. While multiple sets of data are reported, the analysis in all cases is simply the reduction of a hexacoordinate heme and its related spectra and kinetic parameters. In most cases, it's unclear to the reader which part of the electron pathway is being tested in which experiment. Simple diagrams would be helpful in each case. However, it's also unclear if all of the potential order of addition experiments were actually performed; i.e., flavin but no NADPH; NADPH but no flavin; flavin before NADPH; flavin after NADPH, etc. As there are multiple permutations that should be tested to demonstrate the electron transport pathway, presenting the data in a way that makes it clear to the reader is challenging. Particularly missing are the determined redox potentials of the hemes in both STEAP1 and STEAP2. Could differences in these heme redox potentials be drivers of the difference in metal reduction rates?

      We re-structured the manuscript to follow a clearer logical thread. We provided explanations for which electron transfer steps are being examined in each experiment.

      We cannot reliably determine EM due to insufficient amount of purified proteins. We are inclined to think that the bound heme on STEAP1 and STEAP2 have similar EM, based on their similar coordination geometry and nearly identical UV-Vis and MCD spectra. Thus, different rates of Fe3+-NTA reduction by STEAP1 and STEAP2 are likely due to differences in substrate binding site rather than different EM.

      Also, the text indicates that STEAP2 does not show a reduction rate dependence on the [Fe3+NTA], but Figure 1A shows a difference in rates dependent on [Fe3+-NTA], and the shape of the reduction curve also changes based on [Fe3+-NTA]. This discrepancy should be rectified.

      We fixed this error. The reduction of Fe3+-NTA by ferrous STEAP2 shows multiple phases and the reaction rates within the initial 2 seconds are weakly dependent on [Fe3+-NTA].

      A second major weakness is the lack of any verification of the relevance of the STEAP2 oligomerization to its in vivo function. Is the same domain-swapped trimer known to exist in vivo? If the protein were prepared in other detergents, is the oligomerization preserved? It is alluded to in the text that another STEAP protein is also a trimer. Was this oligomerization verified in vivo?

      The domain-swapped assembly is an interesting phenomenon, and it seems to provide a solution for bringing the FAD closer to heme. The same domain swapped trimeric assembly is also observed in the structure of STEAP4, which was purified in a different detergent (Nat Commun (2018), 9, page 4337). It is likely that this feature is shared by STEAP2, 3, and 4, and preserved during the purification process.

      Could this oligomerization be disrupted to impede or abrogate electron transport to underscore the oligomerization relevance? This point is germane, as it would further suggest that the domain-swapped trimer observed in the STEAP2 cryo-EM structure is physiologically relevant, especially given how far the distance between the NADPH and the FAD would otherwise be to support electron transport.

      We agree with the reviewer’s reasoning that the oligomeric assembly is required for proper function of STEAPs and thus could potentially be utilized for functional regulation. However, we are not aware of any physiologically relevant stimuli or treatment that would allow regulation of STEAP functions by inducing or forming different oligomeric states. Our experience with STEAP proteins is that the trimeric assembly is stable and well-preserved during the purification process and can only be disrupted under denaturing conditions such as SDS-PAGE.

      Beyond these two areas in which the manuscript could be improved there are a couple of minor considerations. First, the modest resolution of the STEAP2 structure prevents assigning the states of NADP+/NADPH and FAD/FADH2 with confidence. An orthogonal measure would be useful for modeling the accurate states in the structure.

      We agree. We clarified the ambiguity and stated in the main text that the cryo-EM structure of STEAP2 was determined in the presence of NADP+ and FAD.

      Finally, the BLI b5R/STEAP1 binding/unbinding fits seem somewhat poor, especially at high concentrations of b5R in the dissociation regime, which likely influences the derived value of Kd. A different fitting equilibrium might yield better agreement between the experimental and theoretical results. Moreover, whether this binding strength is influenced by the reduction state of the NADPH would be helpful in understanding and contextualizing the weak binding affinity.

      We think that non-specific binding likely causes deviations from the simple binding model at higher b5R concentrations. We made a comment on this in the main text. We agree with the reviewer that the interactions between b5R and STEAP1 could be redox dependent, for example, a reduced FAD on b5R may enhance the affinity. We could implement this by performing the binding experiments in an anaerobic chamber, but this is beyond the scope of the current study.

      Reviewer #2 (Public Review):

      The manuscript provides new insight into a family of human enzymes. It demonstrates that STEAP2 can reduce iron and STEAP1 can be promiscuous regarding the source of electron donors that it can use. The quality of the kinetics experiment and the structural analysis is excellent. I am less enthusiastic about the interpretation of data and the take-home message that the manuscript intends to deliver. Above all, the work combines data on STEAP2 and STEAP1 and it remains unclear which questions are ultimately addressed. A second critical point is about the interpretation of the experiment demonstrating that STEAP1 can be reduced by cytochrome b5 reductase. The abstract states that "We show that STEAP1 can form an electron transfer chain with cytochrome b5 reductase" whereas the main text discusses the data by suggesting that "we speculate that FAD on b5R may partially dissociate to straddle between the two proteins". The two statements seem to be partly contradictory. Cytochrome b5 reductases do not easily release FAD but rather directly donate electrons to heme-protein acceptors (PMID: 36441026). According to the methods section, no FAD was added to the reaction mix used for the cytochrome b5 reductase experiment. Overall, the data seem to indicate that the reductase might reduce the heme of STEAP1 directly. Would it be possible to check whether FAD addition affects the kinetics of the process?

      We agree with the reviewer on this point. We do not have evidence indicating that FAD fully or partially dissociates from b5R to interact with STEAP1. We removed the statement in the revision.

      We have not tried to add free reduced FAD to the mixture of STEAP1/b5R/NADH, because we feel that this would increase the complexity of the system and complicate data interpretation. We are working on determining the structure of b5R in complex with STEAP1 to visualize the electron transfer pathway, and we hope that such a structure would provide a framework for understanding electron transfer between the two proteins.

      And to perform a control experiment to check that NAD(P)H does not directly reduce the heme of STEAP1 (though unlikely)?

      We did the control experiment and included data in Fig. S3A. No reduction of heme by NADH alone.

      A final point concerns the "slow Fe3+-NTA reduction by STEAP2". The reaction is not that slow as the initial phase is 2 per second. The reaction does not show dependence on the substrate concentration suggesting "poor substrate binding". I am not convinced by this interpretation. Poor substrate binding would give rise to substrate dependency as saturation would not be achieved. A possible interpretation could be that substrate binding is instead tight and the enzyme is saturated by the substrate. Can it be that the reaction is limited by non-productive substrate-binding and/or by interconversions between active and non-active conformations? We re-analyzed the data and revised the Results and Discussion.

      We agree with the reviewer on this point. We re-analyzed the data and found that the reaction rates within the first 2 seconds are weakly dependent on [Fe3+-NTA] while the rates beyond 2 seconds do not show dependence on [Fe3+-NTA]. More studies are required to unravel the mechanism that leads to the complicated kinetic data.

      Reviewer #3 (Public Review):

      The six-transmembrane epithelial antigen of the prostate (STEAP) family comprises four members in metazoans. STEAP1 was identified as integral membrane protein highly upregulated on the plasma membrane of prostate cancer cells (PMID: 10588738), and it later became evident that other STEAP proteins are also over expressed in cancers, making STEAPs potential therapeutic targets (PMID: 22804687). Functionally, STEAP2-4 are ferric and cupric reductases that are important for maintaining cellular metal uptake (PMIDs: 16227996, 16609065). The cellular function of STEAP1 remains unknown, as it cannot function as an independent metalloreductase. In the last years, structural and functional data have revealed that STEAPs form trimeric assemblies and that they transport electrons from intracellular NADPH, through membrane bound FAD and heme cofactors, to extracellular metal ions (PMIDs: 23733181, 26205815, 30337524). In addition, numerous studies (including a previous study from the senior authors) have provided strong implications for a potential metalloreductase function of STEAP1 (PMIDs: 27792302, 32409586).

      This new study by Chen et al. aims to further characterize the previously established electron transport chain in STEAPs in high molecular detail through a variety of assays. This is a wellperformed, highly specialized study that provides some useful extra insights into the established mechanism of electron transport in STEAP proteins. The authors first perform a detailed spectroscopic analysis of Fe3+-NTA reduction by STEAP2 and STEAP1, confirming that both purified proteins are capable of reducing metal ions. A cryo-EM structure of STEAP2 is also presented. It is then established that STEAP1 can receive electrons from cytochrome b5 reductase, and the authors provide experimental evidence that the flavin in STEAP proteins becomes diffusible.

      The specific aims of the study are clear, but it is not always obvious why certain experiments are performed only on STEAP2, on STEAP1, or on both isoforms. A better justification of the performed experiments through connecting paragraphs and proper referencing of the literature would improve readability of the manuscript. Experimentally, the conclusions are appropriate and mostly consistent with the experimental data, although one important finding can benefit from further clarification. Namely, the observation that STEAP1 can form an electron transfer chain with cytochrome b5 reductase in vitro is an exciting finding, but its physiological relevance remains to be validated. The metalloreductase activity of STEAP1 in vitro has been described previously by the authors and by others (PMIDs: 27792302, 32409586). However, when over expressed in HEK cells, STEAP1 by itself does not display metal ion reductase activity (PMID: 16609065), and it was also found that STEAP1 over expression does not impact iron uptake and reduction in Ewing's sarcoma (cancer) cells (PMID: 22080479). Therefore, the physiological relevance of metal ion reduction by STEAP1 remains controversial. The current work establishes an electron transfer chain between STEAP1 and cytochrome b5 reductase in vitro with purified proteins. However, the conformation of this metalloreductase activity of the STEAP1-cytochrome b5 complex will be required in a cell line to prove that the two proteins indeed form a physiological relevant complex and that the results are not just an in vitro artefact from using high concentrations of purified proteins.

      The work will be interesting for scientists working within the STEAP field. However, some of the presented data are redundant with previous findings, moderating the study's impact. For instance, the new structural insights into STEAP2 are limited because the structure is virtually identical to the published structures of STEAP4 and STEAP1 (PMIDs: 30337524, 32409586), which is not surprising because of the high sequence similarity between the STEAP isoforms. Moreover, the authors provide experimental evidence to prove the previous hypothesis (PMID: 30337524) that the flavin in STEAP proteins becomes diffusible, but the molecular arrangement of a STEAP protein, in which the flavin interacts with NADPH, remains unknown. Based on the manuscript title, I would also expect the in-depth characterization of STEAP1/STEAP2 hetero trimers (first identified by the authors), but this is only briefly mentioned. When taken together, this study by Chen et al. strengthens and supports previously published biochemical and structural data on STEAP proteins, without revealing many prominent conceptual advances.

      We thank the reviewer for information and the broader context. We have revised the manuscript to have a clearer logical thread.

      Reviewer #1 (Recommendations For The Authors):

      Please see the "Public Review" for recommendations.

      Reviewer #2 (Recommendations For The Authors):

      Specific suggestions

      -The introduction should more clearly state which questions are being addressed and why STEAP1 and STEAP2 are investigated.

      We have revised the Introduction to make that clearer.

      -The manuscript should discuss more extensively and provide possible explanations for the substrate-independent kinetics of iron-reduction by STEAP2.

      We re-analyzed the data and found the rate constants of the reactions before 2 s are weakly [Fe3+NTA]-dependent. We ascribe the weak [Fe3+-NTA]-dependence to the partial rate-limiting by substrate binding. However, we do not have a good interpretation for the reaction kinetics after 2 s which does not show [Fe3+-NTA]-dependence.

      -"The rate of STEAP1(Fe(II)) oxidation by Fe3+-NTA is similar to those by Fe3+-EDTA or Fe3+-citrate, but the rates are significantly faster than STEAP2(Fe(II)) re-oxidation by Fe3+NTA (Fig. 1B)." The rates for STEAP1 should be given to substantiate this statement.

      We added Table S1 in the supplementary materials that includes the 2nd order association (kon) and the 1st order dissociation rate constants (koff) of iron substrates in STEAP1 and STEAP2. Data on Fe3+-EDTA or Fe3+-citrate by STEAP1 are from our previous study (Biochemistry, 2016). We also calculated the KDs of different iron substrates for STEAP1 and STEAP2.

      • "Our results indicate that STEAP2 can supply reduce FAD to initiate electron transfer in STEAP1." As discussed above, this statement should be discussed and analyzed

      We mixed 0.9 μM STEAP1, 1.1 μM STEAP2, and 2.2 μM FAD and added 60 μM NADPH to the system and found that the heme on both STEAP1 and STEAP2 are reduced. Since adding NADPH to STEAP1 plus FAD alone does not reduce the heme (Fig. S3B), we reasoned that reduction of the heme on STEAP1 is achieved by the reduced FAD produced on STEAP2. The reduced FAD likely dissociates from STEAP2 and then bind to STEAP1.

      -Experiments on "STEAP1 reduction by STEAP2" The experiments show that "STEAP2 can supply reduce FAD to initiate electron transfer in STEAP1." Could these results be explained by heterotrimer formation in agreement with the previous data published by the authors?

      In our experience, STEAP1 and STEAP2 homotrimers are stable and do not form heterotrimers when mixed. STEAP1/2 heterotrimers form only when the two proteins are co-expressed in cells (Biochemistry (2016) 55, 6673-6684).

      Reviewer #3 (Recommendations For The Authors):

      Major points:

      1) As a very general point: the order in which the results are presented could be greatly improved to increase the readability for non-experts. To elaborate: The manuscript starts with the spectroscopic characterization of STEAP2, then suddenly the reductase activities of STEAP1 and STEAP2 are compared; subsequently, experiments are described involving STEAP1 and cytochrome b5 reductase; then the cryo-EM structure of STEAP2 is presented etc. As a non-expert reader, this presentation of the results is confusing, especially because the paragraphs are not always connected well, and there is a lot of switching between STEAP1 and STEAP2 data. A more logical order would be to first present the STEAP2 spectroscopy and structural data, then write a connecting paragraph on why it is important to also study the electron transfer chain in STEAP1, followed by the comparison of the STEAP isoforms and the data on STEAP1 alone. The authors should include sentences on why they performed each experiment. For example, why did they determine the structure of STEAP2. What were they after that they could not retrieve from the homologous STEAP4 and STEAP1 structures? Justification of the performed experiments will make it easier for the reader, and will establish a better connection between the paragraphs.

      We reorganized the data presentation in Results per the reviewer’s suggestions.

      2) The physiological relevance of metal ion reduction by STEAP1 remains controversial. Because the current work establishes an electron transfer chain between STEAP1 and cytochrome b5 reductase, could the authors perform an easy experiment where they over express both STEAP1 and cytochrome b5 reductase in a cell line? If such an experiment would reveal STEAP1-dependent metal-ion reduction, it would greatly improve this part of the manuscript. If no activity is observed, the established electron transfer chain could just represent an in vitro artifact from using high concentrations of purified proteins.

      This is an excellent point. We are not set up to perform the proposed experiment but will do so in the future.

      3) The manuscript states that metal ion reduction of purified STEAP2 is slow, and the authors explain this by the absence of density for the extracellular region between helices 3 and 4 that are present in the structures of STEAP4 and STEAP1, resulting in a less-well defined substratebinding site. Can the authors exclude that the less-well defined substrate-binding site is a result of the detergent extraction of STEAP2? Would it be possible to measure the reductase activity of STEAP2 in purified membranes?

      Detergent mostly interacts with the transmembrane domains and since the TMD region of STEAP2 aligns well with those of STEAP1 and STEAP4, we do not think that the disordered substrate binding region in STEAP2 is a consequence of detergent solubilization. It is difficult to conduct pre-steady state kinetic experiments using STEAP2 in membrane fractions.

      4) The manuscript would greatly benefit from citing the literature more comprehensively to acknowledge insightful findings from authors in the field; for example, the important work by the Lawrence lab from 2015 (PMID: 26205815), which biochemically proved that STEAPs bind a single heme and that FAD bridges the TMD and RED, is not cited. The authors also mention that STEAP proteins belong to the same family as NOX proteins and cite some NOX structure papers. However, they fail to cite the first NOX structure paper (PMID: 28607049), as well the manuscript that structurally compares NOXs and STEAPs (PMID: 32815713). Similarly, the authors use SerialEM for their cryo-EM data collection but cite an old paper instead of the more recent (and relevant) SerialEM publication (PMID: 31086343).

      We agree and added the references.

      5) Generally, the data presented in the manuscript appear of good technical quality. However, a 'Table 1' with all relevant cryo-EM data collection and refinement statistics is completely missing as far as I can see. The authors should definitely add this to allow for the judgement of structural data quality. Without it, the manuscript is not suitable for publication.

      We added Table S2 that includes relevant cryo-EM statistics.

      Minor points:

      6) The authors write in the abstract: 'STEAP2 - 4, but not STEAP1, have an intracellular domain that binds to NADPH and FAD'. This is not correct, because it has clearly been established that FAD also majorly binds to the transmembrane domain (this is even shown by the authors in the current manuscript as well).

      Agree, we corrected that in the revision.

      7) Sentence from the abstract and introduction state: 'It is also unclear whether STEAP1 has metal ion reductase activity' and 'it is unclear whether STEAP1 can form a competent electron transfer chain from NADPH'. The authors should definitely add "physiologically relevant" to these sentences. Namely, the senior authors themselves concluded in their 2016 Biochemistry paper (PMID: 27792302) that STEAP1 is capable of reducing metal ion complexes. Further indications that the transmembrane domain of STEAP1 displays metalloreductase activity was published by the Gros lab (PMID: 32409586), and it was also shown that fusing the RED of STEAP4 to the TMD of STEAP1 yields a functional protein in cells that reduces metal ions.

      Good point and we revised the text and included the references.

      8) Why is scheme 1 not just a summarizing figure?

      We could change Scheme 1 to a Figure if required by the copy editor.

      9) What is the purpose of Fig. 6? A larger depiction of Fig. 5e would likely be more relevant and should be considered as a replacement. Alternatively, the structure of STEAP1 (pdb 6y9b) could be shown in combination with Fig. 7, as the mutation is performed in STEAP1.

      We agree and made changes to the structural figures to enhance clarity.

      10) The manuscript now contains many, single panel figures. Certain main figures could easily be combined, for example, Fig. 1 and 2 and/or Fig. 3 and 4.

      We agree and made changes to reduce single panel figures.

      11) In Fig. 2, 3 and 4, the spectra show changes in peak heights as a result of the ferric to ferrous heme transition. However, a time component is missing in the legend. How long do these transitions take?

      We added the reaction times to the figure legends.

      12) The last part of the discussion states: 'The assembly of an intracellular RED with a membrane-embedded TMD observed in NOX, DUOX, and STEAPs naturally led to the notion that NADPH, FAD, and heme form an uninterrupted rigid electron-transfer chain that shuttles electron from the intracellular cellular NADPH to the extracellular substrates. While this may be true for NOX and DUOX, in which rapid supply of electrons to their extracellular substrates are essential to their biological functions, it may not apply similarly to STEAPs since it has only one heme in the TMD, and their electron transfer relies on shuttling of FAD.' The authors should mention here that the activity of NOX and DUOX is tightly regulated by accessory proteins, Ca2+ etc. Similarly, do the authors expect that the large distance between NADPH and FAD in the structures could represent a way to regulate/dampen the metal ion reduction rates of STEAPs in vivo?

      We agree. We mentioned the regulation of NOX and DUOX in Discussion. We remain puzzled by the large distance between NADPH and FAD in STEAPs and are in pursuit of a structure in which the two cofactors are “in touch” for electron transfer.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1 (Public Review):

      This manuscript represents an elegant bioinformatics approach to addressing causal pathways in vascular and liver tissue related to atherosclerosis/coronary artery disease, including those shared by humans and mice and those that are specific to only one of these species. The authors constructed co-expression networks using bulk transcriptome data from human (aorta, coronary) and mouse (aorta) vascular and liver tissue. They mapped human CAD GWAS data onto these modules, mapped GWAS SNPs to putatively causal genes, identified pathways and modules enriched in CAD GWAS hits, assessed those shared between vascular and liver tissues and between humans and mice, determined key driver genes in CAD-associated supersets, and used mouse single-cell transcriptome data to infer the roles of specific vascular and liver cell types. The overall approach used by the authors is rigorous and provides new insights into potentially causal pathways in vascular tissue and liver involved in atherosclerosis/CAD that are shared between humans and mice as well as those that are species-specific. This approach could be applied to a variety of other common complex conditions.

      The conclusions are largely supported by the analyses. Some specific comments:

      1) It appears that GWAS SNPs were mapped to genes solely through the use of eQTLs. Current methods involve a number of other complementary approaches to map GWAS SNPs to effector genes/transcripts and there is the thought that eQTLs may not necessarily be the best way to map causal genes.

      We agree with the reviewer that multiple approaches can be used to map GWAS SNPs to genes, and eQTLs is only one way to do so. We focused on eQTLs mainly because we aim to address tissue-specificity of eQTLs and the relative higher abundance of eQTLs compared to other tissue-specific functional genomics data, such as pQTLs and epiQTLs. We now acknowledge this limitation in the discussion section in our revised manuscript and point to future studies utilizing other approaches to map GWAS signals to downstream effectors.

      2) Given the critical causal role of circulating apoB lipoproteins in atherosclerosis in both mice and humans and the central role of the liver in regulating their levels, perhaps the authors could use the 'metabolism of lipids and lipoproteins' network in Fig 3B as a kind of 'positive control' to illustrate the overlap between mice and humans and the driver genes for this network.

      We appreciate the reviewer’s excellent suggestion and now elaborate the findings in Fig 3B as a positive control in the results section.

      3) Is it possible to infer the directionality of effect of key driver genes and pathways from these analyses? For example, ACADM was found to be a KD gene for a human-specific liver CAD superset pathway involving BCAA degradation. Are the authors able to determine or predict the effect of genetically increased expression of ACADM on BCAA metabolism and on CAD? Or the directionality of the effect of the hepatic KD gene OIT3 on hepatic and plasma lipids and atherosclerosis.

      The Bayesian networks only have information on which genes likely regulate the others but not the up or down-regulation direction, and the network key driver analysis only considers the enrichment of GWAS candidate genes in the neighborhood of each key driver. Therefore, it is not possible to directly infer whether increasing or decreasing a key driver will lead to up or downregulation of the downstream pathways based on our current analysis. We could, however, examine correlations of key driver genes with downstream genes, or disease traits in relevant datasets. For instance, we checked the mouse atherosclerosis HMDP datasets for the correlations between select key drivers and clinical traits and found various key drivers shared and species-specific in aorta and liver significantly correlate with aortic lesion area and other traits of interest such as LDL levels, and inflammatory cytokines. We have added these new findings into the results section and supplemental tables.

      4) While likely beyond the scope of this manuscript, the substantial amount of publicly available plasma proteomic and metabolomic data could be incorporated into this multiomic bioinformatic analysis. Many of the pathways involve secreted proteins or metabolites that would further inform the biology and the understanding of how these pathways relate to atherosclerosis.

      We appreciate the reviewer’s valuable suggestion. Here we focused on liver and aorta gene regulatory networks to understand the tissue-specific mechanisms at the gene level. Indeed, plasma proteomic and metabolomic data could be further incorporated in future studies to understand the pathways captured in the circulation that can capture cross-tissue interactions mediated by secreted proteins and metabolites from different tissues. We have addressed this as a future direction in the discussion section.

      The findings here will motivate the community of atherosclerosis investigators to pursue additional potential causal genes and pathways through computational and experimental approaches. It will also influence the approach around the use of the mouse model to test specific pathways and therapeutic approaches in atherosclerosis. In addition, the computational approach is robust and could (and likely will) be applied to a variety of other common complex conditions.

      Reviewer #2 (Public Review):

      Summary:

      Mouse models are widely used to determine key molecular mechanisms of atherosclerosis, the underlying pathology that leads to coronary artery disease. The authors use various systems biology approaches, namely co-expression and Bayesian Network analysis, as well as key driver analysis, to identify co-regulated genes and pathways involved in human and mouse atherosclerosis in artery and liver tissues. They identify species-specific and tissue-specific pathways enriched for the genetic association signals obtained in genome-wide association studies of human and mouse cohorts.

      Strengths:

      The manuscript is well executed with appropriate analysis methods. It also provides a compelling series of results regarding mouse and human atherosclerosis.

      Weaknesses:

      The manuscript has several weaknesses that should be acknowledged in the discussion. First, there are numerous models of mouse atherosclerosis; however, the HMDP atherosclerosis study uses only one model of mouse atherosclerosis, namely hyperlipidemic mice, due to the transgenic expression of human apolipoprotein ELeiden (APOE-Leiden) and human cholesteryl ester transfer protein (CETP). Therefore, when drawing general conclusions about mouse pathways not being identified in humans, caution is warranted. Other models of mouse atherosclerosis may be able to capture different aspects of human atherosclerosis.

      We appreciate the reviewer’s valuable insight! Indeed, the specific HMDP atherosclerosis model may miss important mouse pathways that could have overlapped with the human pathways. We have added this important point to the limitations section under the discussion to caution the interpretation of the human-specific pathways, as they could be present in mice but are missed by the specific HMDP atherosclerosis dataset used.

      Second, the mouse aorta tissue is atherosclerotic, whereas the atherosclerosis status of the GTEX aorta tissues is not known. Therefore, it is possible that some of the human or mouse-specific gene modules/pathways may be due to the difference in the disease status of the tissues from which the gene expression is obtained.

      We agree with the reviewer that GTEx vascular tissues have unclear atherosclerosis status. However, in addition to GTEx, we also included the human STARNET dataset which contains vascular tissues from human patients with CAD. Therefore, we believe the comparability of the human and mouse vascular tissue datasets is reasonable.

      Third, it is unclear how the sex of the mice (all female in the HMDP atherosclerosis study and all male in the baseline HMDP study) and the sex of the human donors affected the results. Did the authors regress out the influence of sex on gene expression in the human data before performing the co-expression and preservation studies? If not, this should be acknowledged.

      We acknowledge that the effect of sex in the mouse and human datasets were not regressed out in our analysis. We have added this under the limitations section.

      Fourth, some of the results are unexpected, and these should be discussed. For example, the authors identify that the leukocyte transendothelial migration pathway and PDGF signaling pathway are human-specific in their vascular tissue analysis. These pathways have been extensively described in mouse studies. Why do the authors think they identified these pathways as human-specific? Similarly, the authors identified gluconeogenesis and branched-chain amino acid catabolism as human and mouseshared modules in the vascular tissue. Is there evidence of the involvement of these pathways in atherosclerosis in vascular cells?

      We agree with the reviewer that these unexpected findings warrant further discussion. As pointed out by this reviewer, it is possible that the mouse HMDP atherosclerosis dataset cannot fully represent all mouse atherosclerosis biology and therefore missed the leukocyte migration and PDGF pathways that were identified in the human datasets. Regarding the surprising findings of pathways such as BCAA catabolism in vascular tissues, we acknowledge that future studies will need to further investigate such pathway predictions but also highlight that these pathway terms have many shared genes with more commonly known pathways such as the TCA cycle, which may indicate the involvement of energy metabolism in vascular tissues in CAD development. We have added these points to the discussion section under limitations and concluding remarks.

      Overall, acknowledging these drawbacks and adding points to the discussion will strengthen the manuscript.

      Reviewer #1 (Recommendations For The Authors):

      1) Could the authors comment on why MEGENA produces so many more co-expression modules per tissue than WCGNA?

      As described in the methods section, MEGENA uses a multi-scale clustering structure to generate network modules at different scales, with each scale representing a different compactness level of the modules. At lower compactness scales larger modules are generated; at higher compactness scales, smaller modules are generated. By using all modules obtained from different scales, the total number of modules is much larger than WGCNA which only generates a network at one scale.

      2) Much of the results section involves repeating in the text lists of pathways, modules, and genes that are also listed in Figures 2 and 3. The text in this part of the results could be used more productively to focus on illustrative examples or potential new biology.

      We have revised the results section to reduce repeating long lists of pathways, modules, and genes as suggested.

      Reviewer #2 (Recommendations For The Authors):

      In addition to the weaknesses I mentioned in the public review comments, there are a few minor issues that I outline below:

      1) The authors should introduce atherosclerosis as the underlying cause of CAD in the Introduction. In fact, I believe there are many places in the manuscript where the authors mean atherosclerosis instead of coronary artery disease, especially when presenting and discussing mouse results since the HMDP study did not examine the coronary arteries of mice. I believe the authors should make the appropriate changes throughout the manuscript.

      We have made the changes as suggested.

      2) The authors state in the introduction, "For example, mice tend to develop atherosclerotic lesions in the aorta and carotids, while humans often develop lesions in coronary arteries (Ma et al., 2012)." This is not entirely correct, so this sentence should be revised. Several models of mice show coronary artery atherosclerosis development, but most researchers study lesions in larger aortas. Further, humans develop lesions throughout the arterial tree, but perhaps what the authors meant was the most consequential plaque development is in the coronary arteries. Please rephrase.

      We have rephrased the statement as suggested.

      3) Last line of page 5 should read "...which will drive modules and pathways that are more likely..." not "derive"

      Typo corrected.

    1. Author Response

      Reviewer #1 (Public Review):

      Assessment:

      The manuscript titled 'Rab7 dependent regulation of goblet cell protein CLCA1 modulates gastrointestinal 1 homeostasis' by Gaur et al discusses the role of Rab7 in the development of ulcerative colitis by regulating the lysosomal degradation of Clca1, a mucin protease. The manuscript presents interesting data and provides a potential molecular mechanism for the pathological alterations observed in ulcerative colitis. Gaur et al demonstrate that Rab7 levels are lowered in UC and CD. However, a similar analysis of Rab7 levels in ulcerative colitis (UC) and Crohn's disease (CD) patient samples was conducted recently (Du et al, Dev Cell, 2020) which showed that Rab7 levels are found to be elevated under these conditions. While Gaur et al have briefly mentioned Du et al's paper in passing in the discussion, they need to discuss these contradictory results in their paper and clarify these differences. Additionally, Du et al are not included in the list of references.

      Strengths:

      The manuscript used a multi-pronged approach and compares patient samples, mouse models of DSS, and protocols that allow differentiation of goblet cells. They also use a nanogel-based delivery system for siRNAs, which is ideal for the knockdown of specific genes in the gut.

      Weaknesses:

      Du et al, Dev Cell 2020 (https://doi.org/10.1016/j.devcel.2020.03.002) have previously shown that Rab7 levels are elevated in a similar set of colonic samples (age group, number etc) from UC and CD patients. Gaur et al have not discussed this paper or its findings in detail, which directly contradicts their results. Clarification regarding this should be provided.

      We thank and appreciate the reviewer for bringing this point.

      The results shown by Du et al, Dev Cell, 2020 depict elevated expression of Rab7 in UC and CD patients compared to controls. In first occurrence, these results appear contradictory, but there may be a few possible explanations for this.

      Firstly, Rab7 expression levels may fluctuate in the tissue depending on the degree of the gut inflammation. This can be concluded from our observations in DSS-mice dynamics model and the human patient samples with mild and moderate UC. Furthermore, Du et al provide no information of the severity of the condition among the patients employed in the study. Our motive, in the current work, was to emphasise this aspect. This point was mentioned in the discussion section of the manuscript. However, in view of the reviewer’s concern, we now intend to add a detailed comment on this in the main text of the revised version of the manuscript.

      Secondly, the control biopsies in our investigation were acquired from non-IBD patients, and not what was done by Du et al., wherein biopsies from the normal para-carcinoma region of the colorectal cancer patients was used. One can not overlook the fact that physiological and molecular changes are apparent even in non-inflamed regions in the gut of an IBD or CRC patient. It is possible that the observed discrepancy arises due to the differences in the sample type used for comparing the Rab7 expression.

      Finally, the main sub-tissue region showing a decrease in Rab7 expression in UC samples, appeared to be the Goblet cells which was not covered by Du et al.

      Keeping these points in mind we do not think that there is a contradiction in our findings with that of Du et al., 2020. In the revised submission some of these explanations will be incorporated. Include Du et al in the reference list and add the comment in main text.

      This was an oversight from our side. We have actually mentioned Du et al., 2020 in the discussion (line number 338) but somehow the reference was missing in the main list. We will ensure that the reference is included in the revised version and that their findings are included both in main text and in the discussion.

      Reviewer #2 (Public Review):

      Summary:

      In this work, the authors report a role for the well-studied GTPase Rab7 in gut homeostasis. The study combines cell culture experiments with mouse models and human ulcerative colitis patient tissues to propose a model where, Rab7 by delivering a key mucous component CLCA1 to lysosomes, regulates its secretion in the goblet cells. This is important for the maintenance of mucous permeability and gut microbiota composition. In the absence of Rab7, CLCA1 protein levels are higher in tissues as well as the mucus layer, corroborating with the anticorrelation of Rab7 (reduced) and CLCA1 (increased) from ulcerative colitis patients. The authors conclude that Rab7 maintains CLCA1 level by controlling its lysosomal degradation, thereby playing a vital role in mucous composition, colon integrity, and gut homeostasis.

      Strengths:

      The biggest strength of this manuscript is the combination of cell culture, mouse model, and human tissues. The experiments are largely well done and in most cases, the results support their conclusions. The authors go to substantial lengths to find a link, such as alteration in microbiota, or mucus proteomics.

      Weaknesses:

      There are also some weaknesses that need to be addressed. The association of Rab7 with UC in both mice and humans is clear, however, claims on the underlying mechanisms are less clear. Does Rab7 regulate specifically CLCA1 delivery to lysosomes, or is it an outcome of a generic trafficking defect? CLCA1 is a secretory protein, how does it get routed to lysosomes, i.e. through Golgi-derived vesicles, or by endocytosis of mucous components? Mechanistic details on how CLCA1 is routed to lysosomes will add substantial value.

      We thank the reviewer for the insightful comment. We would like to bring forth the following explanation for each these concerns:

      (a) Our immunofluorescence imaging experiments revealed co-localization of Rab7 protein with CLCA1 and the lysosomes (Fig 7I). In addition, the absence of Rab7 affects the transport of CLCA1 to lysosomes (Fig 7J). This demonstrates that Rab7 may be involved in regulation of CLCA1 transport (presumably along with other cargo), to lysosomes selectively. However, we do recognise that the point raised by the reviewer about possible effect of a generic trafficking defect is valid. (b) As mentioned in the manuscript, the trafficking of CLCA1 protein or CLCA1-containing vesicles within the goblet cell is unknown, with no information on the proteins involved in its mobility. The switching of CLCA1 containing vesicles from the secretory route to lysosomes needs extensive investigation involving overall trafficking of the protein. Taken together, the complete answer to both these important questions will need a series of experiments and those may be interesting avenues for future research.

      (a) Why does the level of Rab7 fluctuate during DSS treatment (Fig 1B)? (b) Does the reduction seen in Rab7 levels (by WB) also reflect in reduced Rab7 endosome numbers?

      This is a very thoughtful point from the reviewer. We detected a distinct pattern of Rab7 expression fluctuation in intestinal epithelial cells after DSS-dynamics treatment in mice. Perhaps, these changes are the result of complex cellular signalling in response to the DSS treatment. Rab7, being a fundamental protein involved in protein sorting pathway, is expected to undergo alteration based on cells requirement. Presently there are no reports suggesting the regulatory mechanisms that govern Rab7 levels in the gut. (b) We observed reduction in Rab7 expression both at RNA and protein levels. To confirm whether this alteration will lead to reduced Rab7 positive endosome numbers may require detailed investigations.

      Are other late endosomal (and lysosomal) populations also reduced upon DSS treatment and UC? Is there a general defect in lysosomal function?

      There are no direct evidences showing reduction in the late endosomal and lysosomal population during gut inflammation, but few studies link lysosomal dysfunction with risk for colitis (doi: 10.1016/j.immuni.2016.05.007).

      The evidence for lysosomal delivery of CLCA1 (Fig 7 I, J) is weak. Although used sometimes in combination with antibodies, lysotracker red is not well compatible with permeabilization and immunofluorescence staining. The authors can substantiate this result further using lysosomal antibodies such as Lamp1 and Lamp2. For Fig 7J, it will be good to see a reduction in Rab7 levels upon KD in the same cell.

      We used Lysotracker red in live cells followed by fixation. So, permeabilization issues were resolved. Lamp1, as suggested by the reviewer, is definitely a better marker for lysosomes in immunofluorescence studies, but is also shown to mark late endosomes (doi: 10.1083/jcb.132.4.565). As Rab7 protein also marks the late endosomes, using Lamp1 may leave the ambiguity of CLCA1 in Rab7 positive late endosomes versus lysosomes. Nevertheless, we will be carrying out this experiment and the data will be shared in revised version of the work.

      In this connection, Fig S3D is somewhat confusing. While it is clear that the pattern of Muc2 in WT and Rab7-/- cells are different, how this corroborates with the in vivo data on alterations in mucus layer permeability -- as claimed -- is not clear.

      The data in Fig. S3D suggest the involvement of Rab7 in packaging of Muc2. The whole idea for doing this experiment was to support our observation in the Rab7KD-mice model where mucus layer was seen to be loose and more permeable in Rab7 deficient mice.

      Overall, the work shows a role for a well-studied GTPase, Rab7, in gut homeostasis. This is an important finding and could provide scope and testable hypotheses for future studies aimed at understanding in detail the mechanisms involved.

      We thank the reviewer for this comment.

    1. Reviewer #3 (Public Review):

      Summary:<br /> In this study, the authors used patch-clamp to characterize the implication of various voltage-gated Na+ channels in the firing properties of mouse nociceptive sensory neurons. They report that depending on the culture conditions NaV1.3, NaV1.7, and NaV1.8 have distinct contributions to action potential firing and that similar firing patterns can result from distinct relative roles of these channels. The findings may be relevant for the design of better strategies targeting NaV channels to treat pain.

      Strengths:<br /> The paper addresses the important issue of understanding, from an interesting perspective, the lack of success of therapeutic strategies targeting NaV channels in the context of pain. Specifically, the authors test the hypothesis that different NaV channels contribute in a plastic manner to action potential firing, which may be the reason why it is difficult to target pain by inhibiting these channels. The experiments seem to have been properly performed and most conclusions are justified. The paper is concisely written and easy to follow.

      Weaknesses:<br /> 1) The most critical issue I find in the manuscript is the claim that different combinations of NaV channels result in equivalent excitability. For example, in the Abstract it is stated that: "...we show that nociceptors can achieve equivalent excitability using different combinations of NaV1.3, NaV1.7, and NaV1.8". The gating properties of these channels are not identical, and therefore their contributions to excitability should not be the same. I think that the culprit of this issue is that the authors reach their conclusion from the comparison of the (average) firing rate determined over 1 s current stimulation in distinct conditions. However, this is not the only parameter that determines how sensory neurons convey information. For instance, the time dependence of the instantaneous frequency, the actual firing pattern, may be important too. Moreover, the use of 1 s of current stimulation might not be sufficient to characterize the firing pattern if one wants to obtain conclusions that could translate to clinical settings (i.e., sustained pain). A neuron in which NaV1.7 is the main contributor is expected to have a damping firing pattern due to cumulative channel inactivation, whereas another depending mainly on NaV1.8 is expected to display more sustained firing. This is actually seen in the results of the modelling.

      2) In Fig. 1, is 100 nM TTX sufficient to inhibit all TTX-sensitive NaV currents? More common in literature values to fully inhibit these currents are between 300 to 500 nM. The currents shown as TTX-sensitive in Fig. 1D look very strange (not like the ones at Baseline DIV4-7). It seems that 100 nM TTX was not enough, leading to an underestimation of the amplitude of the TTX-sensitive currents.

      3) Page 8, the authors conclude that "Inflammation caused nociceptors to become much more variable in their reliance of specific NaV subtypes". However, how did the authors ensure that all neurons tested were affected by the CFA model? It could be that the heterogeneity in neuron properties results from distinct levels of effects of CFA.

    1. Reviewer #2 (Public Review):

      Summary<br /> This paper expands on the literature on spatial metamers, evaluating different aspects of spatial metamers including the effect of different models and initialization conditions, as well as the relationship between metamers of the human visual system and metamers for a model. The authors conduct psychophysics experiments testing variations of metamer synthesis parameters including type of target image, scaling factor, and initialization parameters, and also compare two different metamer models (luminance vs energy). An additional contribution is doing this for a field of view larger than has been explored previously.

      General Comments<br /> Overall, this paper addresses some important outstanding questions regarding comparing original to synthesized images in metamer experiments and begins to explore the effect of noise vs image seed on the resulting syntheses. While the paper tests some model classes that could be better motivated, and the results are not particularly groundbreaking, the contributions are convincing and undoubtedly important to the field. The paper includes an interesting Voronoi-like schematic of how to think about perceptual metamers, which I found helpful, but for which I do have some questions and suggestions. I also have some major concerns regarding incomplete psychophysical methodology including lack of eye-tracking, results inferred from a single subject, and a huge number of trials. I have only minor typographical criticisms and suggestions to improve clarity. The authors also use very good data reproducibility practices.

      Specific Comments

      Experimental Setup<br /> Firstly, the experiments do not appear to utilize an eye tracker to monitor fixation. Without eye tracking or another manipulation to ensure fixation, we cannot ensure the subjects were fixating the center of the image, and viewing the metamer as intended. While the short stimulus time (200ms) can help minimize eye movements, this does not guarantee that subjects began the trial with correct fixation, especially in such a long experiment. While Covid-19 did at one point limit in-person eye-tracked experiments, the paper reports no such restrictions that would have made the addition of eye-tracking impossible. While such a large-scale experiment may be difficult to repeat with the addition of eye tracking, the paper would be greatly improved with, at a minimum, an explanation as to why eye tracking was not included.

      Secondly, many of the comparisons later in the paper (Figures 9,10) are made from a single subject. N=1 is not typically accepted as sufficient to draw conclusions in such a psychophysics experiment. Again, if there were restrictions limiting this it should be discussed. Also (P11) Is subject sub-00 is this an author? Other expert? A naive subject? The subject's expertise in viewing metamers will likely affect their performance.

      Finally, the number of trials per subject is quite large. 13,000 over 9 sessions is much larger than most human experiments in this area. The reason for this should be justified.

      Model<br /> For the main experiment, the authors compare the results of two models: a 'luminance model' that spatially pools mean luminance values, and an 'energy model' that spatially pools energy calculated from a multi-scale pyramid decomposition. They show that these models create metamers that result in different thresholds for human performance, and therefore different critical scaling parameters, with the basic luminance pooling model producing a scaling factor 1/4 that of the energy model. While this is certain to be true, due to the luminance model being so much simpler, the motivation for the simple luminance-based model as a comparison is unclear.

      The authors claim that this luminance model captures the response of retinal ganglion cells, often modeled as a center-surround operation (Rodieck, 1964). I am unclear in what aspect(s) the authors claim these center-surround neurons mimic a simple mean luminance, especially in the context of evidence supporting a much more complex role of RGCs in vision (Atick & Redlich, 1992). Why do the authors not compare the energy model to a model that captures center-surround responses instead? Do the authors mean to claim that the luminance model captures only the pooling aspects of an RGC model? This is particularly confusing as Figures 6 and 9 show the luminance and energy models for original vs synth aligning with the scaling of Midget and Parasol RGCs, respectively. These claims should be more clearly stated, and citations included to motivate this. Similarly, with the energy model, the physiological evidence is very loosely connected to the model discussed.

      Prior Work:<br /> While the explorations in this paper clearly have value, it does not present any particularly groundbreaking results, and those reported are consistent with previous literature. The explorations around critical eccentricity measurement have been done for texture models (Figure 11) in multiple papers (Freeman 2011, Wallis, 2019, Balas 2009). In particular, Freeman 20111 demonstrated that simpler models, representing measurements presumed to occur earlier in visual processing need smaller pooling regions to achieve metamerism. This work's measurements for the simpler models tested here are consistent with those results, though the model details are different. In addition, Brown, 2023 (which is miscited) also used an extended field of view (though not as large as in this work). Both Brown 2023, and Wallis 2019 performed an exploration of the effect of the target image. Also, much of the more recent previous work uses color images, while the author's exploration is only done for greyscale.

      Discussion of Prior Work:<br /> The prior work on testing metamerism between original vs. synthesized and synthesized vs. synthesized images is presented in a misleading way. Wallis et al.'s prior work on this should not be a minor remark in the post-experiment discussion. Rather, it was surely a motivation for the experiment. The text should make this clear; a discussion of Wallis et al. should appear at the start of that section. The authors similarly cite much of the most relevant literature in this area as a minor remark at the end of the introduction (P3L72).

      White Noise:<br /> The authors make an analogy to the inability of humans to distinguish samples of white noise. It is unclear however that human difficulty distinguishing samples of white noise is a perceptual issue- It could instead perhaps be due to cognitive/memory limitations. If one concentrates on an individual patch one can usually tell apart two samples. Support for these difficulties emerging from perceptual limitations, or a discussion of the possibility of these limitations being more cognitive should be discussed, or a different analogy employed.

      Relatedly, in Figure 14, the authors do not explain why the white noise seeds would be more likely to produce syntheses that end up in different human equivalence classes.

      It would be nice to see the effect of pink noise seeds, which mirror the power spectrum of natural images, but do not contain the same structure as natural images - this may address the artifacts noted in Figure 9b.

      Finally, the authors note high-frequency artifacts in Figure 4 & P5L135, that remain after syntheses from the luminance model. They hypothesize that this is due to a lack of constraints on frequencies above that defined by the pooling region size. Could these be addressed with a white noise image seed that is pre-blurred with a low pass filter removing the frequencies above the spatial frequency constrained at the given eccentricity?

      Schematic of metamerism:<br /> Figures 1,2,12, and 13 show a visual schematic of the state space of images, and their relationship to both model and human metamers. This is depicted as a Voronoi diagram, with individual images near the center of each shape, and other images that fall at different locations within the same cell producing the same human visual system response. I felt this conceptualization was helpful. However, implicitly it seems to make a distinction between metamerism and JND (just noticeable difference). I felt this would be better made explicit. In the case of JND, neighboring points, despite having different visual system responses, might not be distinguishable to a human observer.

      In these diagrams and throughout the paper, the phrase 'visual stimulus' rather than 'image' would improve clarity, because the location of the stimulus in relation to the fovea matters whereas the image can be interpreted as the pixels displayed on the computer.

      Other<br /> The authors show good reproducibility practices with links to relevant code, datasets, and figures.

    1. Reviewer #1 (Public Review):

      Summary:<br /> In this report, Yu et al ascribe potential tumor suppressive functions to the non-core regions of RAG1/2 recombinases. Using a well-established BCR-ABL oncogene-driven system, the authors model the development of B cell acute lymphoblastic leukemia in mice and found that RAG mutants lacking non-core regions show accelerated leukemogenesis. They further report that the loss of non-core regions of RAG1/2 increases genomic instability, possibly caused by increased off-target recombination of aberrant RAG-induced breaks. The authors conclude that the non-core regions of RAG1 in particular not only increase the fidelity of VDJ recombination, but may also influence the recombination "range" of off-target joints, and that in the absence of the non-core regions, mutant RAG1/2 (termed cRAGs) catalyze high levels of off-target recombination leading to the development of aggressive leukemia.

      Strengths:<br /> The authors used a genetically defined oncogene-driven model to study the effect of RAG non-core regions on leukemogenesis. The animal studies were well performed and generally included a good number of mice. Therefore, the finding that cRAG expression led to the development of more aggressive BCR-ABL+ leukemia compared to fRAG is solid.

      Weaknesses:<br /> In general, I find the mechanistic explanation offered by the authors to explain how the non-core regions of RAG1/2 suppress leukemogenesis to be less convincing. My main concern is that cRAG1 and cRAG2 are overexpressed relative to fRAG1/2. This raises the possibility that the observed increased aggressiveness of cRAG tumors compared to fRAG tumors could be solely due to cRAG1/2 overexpression, rather than any intrinsic differences in the activity of cRAG1/2 vs fRAG1/2; and indeed, the authors allude to this possibility in Fig S8, where it was shown that elevated expression of RAG (i.e. fRAG) correlated with decreased survival in pediatric ALL. Although it doesn't mean the authors' assertions are incorrect, this potential caveat should nevertheless be discussed.

      Some of the conclusions drawn were not supported by the data.<br /> 1. I'm not sure that the authors can conclude based on μHC expression that there is a loss of pre-BCR checkpoint in cRAG tumors. In fact, Fig. 2B showed that the differences are not statistically significant overall, and more importantly, μHC expression should be detectable in small pre-B cells (CD43-). This is also corroborated by the authors' analysis of VDJ rearrangements, showing that it has occurred at the H chain locus in cRAG cells.

      2. The authors found a high degree of polyclonal VDJ rearrangements in fRAG tumor cells but a much more limited oligoclonal VDJ repertoire in cRAG tumors. They concluded that this explains why cRAG tumors are more aggressive because BCR-ABL induced leukemia requires secondary oncogenic hits, resulting in the outgrowth of a few dominant clones (Page 19, lines 381-398). I'm not sure this is necessarily a causal relationship since we don't know if the oligoclonality of cRAG tumors is due to selection based on oncogenic potential or if it may actually reflect a more restricted usage of different VDJ gene segments during rearrangement.

      3. What constitutes a cancer gene can be highly context- and tissue-dependent. Given that there is no additional information on how any putative cancer gene was disrupted (e.g., truncation of regulatory or coding regions), it is not possible to infer whether increased off-target cRAG activity really directly contributed to the increased aggressiveness of leukemia.

      4. Fig. 6A, it seems that it is really the first four nucleotide (CACA) that determines fRAG binding and the first three (CAC) that determine cRAG binding, as opposed to five for fRAG and four for cRAG, as the author wrote (page 24, lines 493-497).

      5. Fig S3B, I don't really see why "significant variations in NHEJ" would necessarily equate "aberrant expression of DNA repair pathways in cRAG leukemic cells". This is purely speculative. Since it has been reported previously that alt-EJ/MMEJ can join off target RAG breaks, do the authors detect high levels of microhomology usage at break points in cRAG tumors?

      6. Fig. S7, CDKN2B inhibits CDK4/6 activation by cyclin D, but I don't think it has been shown to regulate CDK6 mRNA expression. The increase in CDK6 mRNA likely just reflects a more proliferative tumor but may have nothing to do with CDKN2B deletion in cRAG1 tumors.

      Insufficient details in some figures. For instance, Fig. 1A, please include statistics in the plot showing a comparison of fRAG vs cRAG1, fRAG vs cRAG2, cRAG1 vs cRAG2. As of now, there's a single p-value (0.0425) stated in the main text and the legend but why is there only one p-value when fRAG is compared to cRAG1 or cRAG2? Similarly, the authors wrote "median survival days 11-26, 10-16, 11-21 days, P < 0.0023-0.0299, Fig. S2B." However, it is difficult for me to figure out what are the numbers referring to. For instance, is 11-26 referring to median survival of fRAG inoculated with three different concentrations of GFP+ leukemic cells or is 11-26 referring to median survival of fRAG, cRAG1, cRAG2 inoculated with 10^5 cells? It would be much clearer if the authors can provide the numbers for each pair-wise comparison, if not in the main text, then at least in the figure legend. In Fig. 5A-B, do the plots depict SVs in cRAG tumors or both cRAG and fRAG cells? Also in Fig. 5, why did 24 SVs give rise to 42 breakpoints, and not 48? Doesn't it take 2 breaks to accomplish rearrangement? In Fig. 6B-C, it is not clear how the recombination sizes were calculated. In the examples shown in Fig. 4, only cRAG1 tumors show intra-chromosomal joins (chr 12), while fRAG and cRAG2 tumors show exclusively inter-chromosomal joins.

      Insufficient details on certain reagents/methods. For instance, are the cRAG1/2 mice of the same genetic background as fRAG mice (C57BL/6 WT)? On Page 23, line 481, what is a cancer gene? How are they defined? In Fig. 3C, are the FACS plots gated on intact cells? Since apoptotic cells show high levels of gH2AX, I'm surprised that the fraction of gH2AX+ cells is so much lower in fRAG tumors compared to cRAG tumors. The in vitro VDJ assay shown in Fig 3B is not described in the Method section (although it is described in Fig S5b). Fig. 5A-B, do the plots depict SVs in cRAG tumors or both cRAG and fRAG cells?

    1. A disability is an ability that a person doesn’t have, but that their society expects them to have.1 For example: If a building only has staircases to get up to the second floor (it was built assuming everyone could walk up stairs), then someone who cannot get up stairs has a disability in that situation. If a physical picture book was made with the assumption that people would be able to see the pictures, then someone who cannot see has a disability in that situation. If tall grocery store shelves were made with the assumption that people would be able to reach them, then people who are short, or who can’t lift their arms up, or who can’t stand up, all would have a disability in that situation. If an airplane seat was designed with little leg room, assuming people’s legs wouldn’t be too long, then someone who is very tall, or who has difficulty bending their legs would have a disability in that situation. Which abilities are expected of people, and therefore what things are considered disabilities, are socially defined. Different societies and groups of people make different assumptions about what people can do, and so what is considered a disability in one group, might just be “normal” in another. There are many things we might not be able to do that won’t be considered disabilities because our social groups don’t expect us to be able to do them. For example, none of us have wings that we can fly with, but that is not considered a disability, because our social groups didn’t assume we would be able to. Or, for a more practical example, let’s look at color vision: Most humans are trichromats, meaning they can see three base colors (red, green, and blue), along with all combinations of those three colors. Human societies often assume that people will be trichromats. So people who can’t see as many colors are considered to be color blind, a disability. But there are also a small number of people who are tetrachromats and can see four base colors2 and all combinations of those four colors. In comparison to tetrachromats, trichromats (the majority of people), lack the ability to see some colors. But our society doesn’t build things for tetrachromats, so their extra ability to see color doesn’t help them much. And trichromats’ relative reduction in seeing color doesn’t cause them difficulty, so being a trichromat isn’t considered to be a disability. Some disabilities are visible disabilities that other people can notice by observing the disabled person (e.g., wearing glasses is an indication of a visual disability, or a missing limb might be noticeable). Other disabilities are invisible disabilities that other people cannot notice by observing the disabled person (e.g., chronic fatigue syndrome, contact lenses for a visual disability, or a prosthetic for a missing limb covered by clothing). Sometimes people with invisible disabilities get unfairly accused of “faking” or “making up” their disability (e.g., someone who can walk short distances but needs to use a wheelchair when going long distances). Disabilities can be accepted as socially normal, like is sometimes the case for wearing glasses or contacts, or it can be stigmatized as socially unacceptable, inconvenient, or blamed on the disabled person. Some people (like many with chronic pain) would welcome a cure that got rid of their disability. Others (like many autistic people), are insulted by the suggestion that there is something wrong with them that needs to be “cured,” and think the only reason autism is considered a “disability” at all is because society doesn’t make reasonable accommodations for them the way it does for neurotypical people. Many of the disabilities we mentioned above were permanent disabilities, that is, disabilities that won’t go away. But disabilities can also be temporary disabilities, like a broken leg in a cast, which may eventually get better. Disabilities can also vary over time (e.g., “Today is a bad day for my back pain”). Disabilities can even be situational disabilities, like the loss of fine motor skills when wearing thick gloves in the cold, or trying to watch a video on your phone in class with the sound off, or trying to type on a computer while holding a baby. As you look through all these types of disabilities, you might discover ways you have experienced disability in your life. Though please keep in mind that different disabilities can be very different, and everyone’s experience with their own disability can vary. So having some experience with disability does not make someone an expert in any other experience of disability. As for our experience with disability, Kyle has been diagnosed with generalized anxiety disorder and Susan has been diagnosed with depression. Kyle and Susan also both have: near sightedness: our eyes cannot focus on things far away (unless we use corrective lenses, like glasses or contacts) ADHD: we have difficulty controlling our focus, sometimes being hyperfocused and sometimes being highly distracted and also have difficulties with executive dysfunction. 1 There are many ways to think about disability, such as legal (what legally counts as a disability?), medical (what is a problem to be cured?), identity (who views themselves as “disabled”), etc. We are focused here more on disability as it relates to design and who things in our world are designed for. 2 Trying to name the four base colors seen by tetrachromats is not straightforward since our color names are based on trichromat vision. It seems that for tetrachromats blue would be the same, but they would see three different base colors in the red/green range instead of two.

      In my opinion, this article points out that disability does not solely focus on individual impairment, but also includes social expectations and accommodations. A building without ramps effectively disables someone using a wheelchair - an example that shows how structures create barriers for specific individuals.

    2. As you look through all these types of disabilities, you might discover ways you have experienced disability in your life. Though please keep in mind that different disabilities can be very different, and everyone’s experience with their own disability can vary. So having some experience with disability does not make someone an expert in any other experience of disability.

      There are usually two types of disabilities in society, one is invisible and the other is visible. Some disabilities are so accepted that they are not considered a disability, such as color blindness. Some disabilities that are physically obvious may sometimes be looked at differently by society. However, in today's society, there are always people who want to judge these people with disabilities and don't think that they can get some preferential treatment, and this behavior is immoral. We have not experienced the pain of others, and we cannot judge others arbitrarily.

    3. Some people (like many with chronic pain) would welcome a cure that got rid of their disability. Others (like many autistic people), are insulted by the suggestion that there is something wrong with them that needs to be “cured,” and think the only reason autism is considered a “disability” at all is because society doesn’t make reasonable accommodations for them the way it does for neurotypical people.

      This quotation emphasizes a significant difference in the perspectives of various challenged cultures about their disability. Some people may be looking for a "cure," but others accept their disability as a part of who they are. It's a complex topic, so we have to be careful not to assume that everyone with a disability feels the same way about it.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Thank you for reviewing and assessing our paper. Reviewer2 had only posive comments. Reviewer 1 also had posive comments but included a list of suggesons. The revised version includes text edits to address the suggesons.

      Reviewer 1:

      … First, it is unclear whether the experiments and analyses were set up to be able to rule out more specific candidate funcons of the ZI.

      The list of possible funcons performed by the ZI is broad. Nevertheless, our study considers a rather long list of neural processes related to the behaviors listed below.

      Second, many important details of the experiments and their results are hard to decipher given the current descripons and presentaons of the data.

      The procedures used in the present study have all been used and described in our previous studies (cited). We used the same descripons and presentaons as in the prior studies. We have gone over the Methods and figures to ensure that all details required to understand the experiments are provided, but we also added further details following the suggesons noted below.

      The paper could be significantly strengthened by including more details from each experiment, stronger jusficaons for the limited behaviors and experimental analyses performed, and, finally, a broader analysis of how the recorded acvity in the ZI relates to behavioral parameters.

      The paper studied several behaviors including: 1) spontaneous movement of head-fixed mice on a spherical treadmill, 2) tacle (whisker, and body parts) and auditory (tones and white noise) smuli applied to head fixed mice, 3) spontaneous movement iniaon, change, and turns in freely moving mice, 4) auditory tone (frequency and SPL) mapping in freely behaving mice, 5) auditory-evoked orienng head movements (responses) in the context of several behavioral tasks, 6) signaled acve avoidance responses and escapes (AA1), 7) unsignaled/signaled passive avoidance responses (AA2ITI/AA3-CS2), 8) sensory discriminaon (AA3), 9) CS-US interval ming discriminaon (AA4), and 10) USevoked unsignaled escape responses.

      In freely moving experiments, the behavior is connuously tracked and decomposed into translaonal and rotaonal movement components. Discrete responses are also evaluated (e.g., acve avoids, escapes, passive avoids, errors, intertrial crossings, latencies, etc.). These behavioral procedures evaluate many neural processes, including decision making (Go/NoGo in AA1-3), response control/inhibion (unsignaled and signaled passive avoidance in AA2/3), and smulus discriminaon (AA3). The applied smuli, discrete responses, and tracked movement are always related to the recorded ZI acvity using a variety of techniques (e.g., cross-correlaons, PSTHs, event-triggered me extracons, etc.), which relate the discrete and me-series parameters to the neural acvity. We do not think all this qualifies as, “limited behaviors”.

      (1) Anatomical specificaon: The ZI contains many disnct subdivisions--each with its own topographically organized inputs/outputs and putave funcons. The current manuscript doesn't reference these known divisions or their behavioral disncons, and one cannot tell exactly which poron(s) of the ZI was included in the current study. Moreover, the elongated structure of the ZI makes it very difficult to specifically or completely infect virally. The data could be beter interpreted if the paper included basic informaon on the locaons of recordings, the extent of the AAV spread in the ZI in each viral experiment, and what fracon of infected neurons were inside versus outside ZI.

      Our experiments employed Vgat-Cre mice to target ZI neurons. In this line, GABAergic neurons from the enre ZI express Cre, including the dorsal and ventral subdivisions (see (Vong et al., 2011; Hormigo et al., 2020)). Consequently, AAV injecons in Vgat-Cre mice produce restricted expression in the ZI that can fully delineate the nucleus as shown in the papers referenced above (including ours). There is nil expression in structures above or below ZI because they do not express Cre in these mice (e.g., thalamus and subthalamic nucleus), which allows for selecve targeng of ZI. Our optogenec manipulaons and photometry recordings were not aimed at specific ZI subdivisions. We targeted the area of ZI indicated by the stereotaxic coordinates (see Methods), which are aimed at the center of the structure to maximize success in recording/manipulang neurons within ZI. While all the animals included in the study expressed opsins and GCaMP within ZI that in many animals fully delineated the nucleus, there was normal variability in the locaon of opcal fibers, but we did not detect any differences in the results related to these variaons.

      Fiber photometry and optogenecs experiments are performed with rather large diameter opcal probes, which record/manipulate relavely large areas of the targeted structure. This is useful because our goal was to idenfy funconal roles of the enre ZI, which could then be parsed. In the present study, we did not perform experiments to target specific ZI populaons (e.g., retrograde Cre expression from target areas), which may have revealed differences atributed to their projecon sites. However, in the last experiment, we selecvely excited ZI fibers targeng three different areas (midbrain tegmentum, superior colliculus, and posterior thalamus), which revealed clear differences on movement. Thus, future experiments should explore these different populaons (e.g., using retrograde/anterograde expression systems), which may be in different subdivisions.

      We have enhanced the Methods secon to clarify these points, including the addion of these references.

      (2) Electrophysiological recording on the treadmill: The authors are commended for this technically very difficult experiment. The authors do not specify, however, how they knew when they were recording in ZI rather than surrounding structures, parcularly given that recording site lesions were only performed during the last recording session. A map of the locaons of the different classes of units would be valuable data to relate to the literature.

      We have added details about this procedure in the Methods secon. These recordings are performed based on coordinates, and categorizing neurons as belonging to ZI is obviously an esmate based on the final histological verificaon. Nevertheless, the marking lesions revealed that the electrodes were on target, which likely resulted from the care taken during the surgical procedure to define reference points used later during the recording sessions (see Methods). Regarding a map of the unit locaons, we performed several analyses that did not reveal clear differences based on site. For example, we compared depth vs cell class, “There was no difference in recording depth between the four classes of neurons (ANOVA F(3,337)= 1.06 p=0.3676)”. Future experiments that employ addional methods (labelling, opto-tagging, etc.) would be more appropriate to address mapping quesons. Finally, as we state in the paper, “However, these recordings do not target GABAergic neurons and may sample some neurons in the tissue surrounding the zona incerta. Therefore, we used calcium imaging fiber photometry to target GABAergic neurons in the zona incerta”.

      (3) The raonale of the analysis of acvity with respect to “movement peak”: It is unclear why the authors did not assess how ZI acvity correlates with a broad set of movement parameters, but rather grouped heterogeneous behavioral epochs to analyze firing with respect to “movement peaks”.

      The reviewer is referring to movement peaks on the spherical treadmill. On the treadmill, we used the forward locomotor movement of the animal because this is the main acvity of the mice on the treadmill. We considered “all peaks” (or movements) and “>4 sec peaks”, which select for movement onsets. Compared to the treadmill, in freely movement condions during various behavioral tasks, there is a richer behavioral repertoire, which was analyzed in more detail (i.e., translaonal, and rotaonal components during spontaneous ongoing movement and movement onsets, movement related to various behaviors such as orienng, acve and passive avoidance, escape, sensory smulaon, discriminaon, etc.). Thus, we focused on a broader set of movement parameters in the Cre-defined ZI cells of freely behaving mice.

      (4) The display of mean categorical data in various figures is interesng, however, the reader cannot gather a very detailed view of ZI firing responses or potenal heterogeneity with so litle informaon about their distribuons.

      The PCA performs the heterogeneity classificaon in an unbiased manner, which we feel is a thoughul approach. The firing rates and correlaons with movement for each category of neurons are detailed in the results. Furthermore, the sensory responses for these neurons are also detailed. Together, we think this provides a detailed view of the units we recorded in awake/head-fixed mice. As already stated, further study would benefit from an addional level of cell site verificaon.

      (5) Somatosensory firing responses in ZI: It is unclear why the authors chose the specific smuli used in the study. How oen did they evoke reflexive motor responses? What was the latency of sensory-evoked responses in ZI acvity and the latency of the reflexive movement?

      These are broad quesons, and we assume that the reviewer is asking about somatosensory evoked responses on the spherical treadmill. We used air-puffs applied to the whiskers and on the back (le vs right) because the whiskers represent an important sensory representaon for mice, and the back is a part of the body (trunk), which we oen use to movate the animals to move forward on the treadmill. Regarding the latency of the somatosensory evoked responses, in this case, we did not correct them based on the me it takes the air-puff to travel to the whiskers or body part, and therefore we did not provide latencies. Moreover, air-puffs are not a very good method to quanfy whisker-evoked latencies, which are beter measured using other methods (whisker deflecons of single/mulple whiskers using piezo-devices or other mechanical devices, as we and others have done in many studies). We are not sure what the reviewer means by “reflexive behavior”; we did not measure any reflexive behavior under these condions. We have gone over the Methods and Results to ensure that sufficient details are provided about these experiments.

      (6) It would be valuable to see example traces in Figure 3 to get a beter sense of the me course and contexts under which Ca signals in ZI tracks movement. What is the typical latency? What is the typical range of magnitudes of responses? Does the Ca signal track both fast and slow movements? How are the authors sure that there are no movement arfacts contribung to the calcium imaging? It seems there is more informaon in the dataset that could be valuable.

      As is well known, fiber photometry calcium imaging is a slow populaon signal. We do not think it would be valuable to get into ming issues beyond what is already detailed in the study (i.e., magnitudes measured as areas or peaks, and ming as me-to-peaks). Regarding “movement arfacts”, these signals are absent (flat) in animals that do not express GCAMP. We agree that there must be addional valuable informaon in our datasets (as in most me-series). However, the current paper is already rather extensive. We will connue to peruse our datasets and report addional findings in new papers.

      (7) Figure 4: The raonale for quanfying the F/Fo responses over a 6-second window, rather than with respect to discrete movement parameters, is not well explained. What types of movement are binned in this approach and might this broad binning hinder the ability to detect more specific relaonships between acvity and movement?

      Figure 4 is focused on characterizing the relaonship between turns (ipsiversive and contraversive) during movement and ZI acvity. We tested different binning windows to find differences, including the 6 sec window in figure 4 for populaon measures (-3 to 3 sec around the turns). This binning approach is effecve at revealing differences where they exist (e.g., superior colliculus) as shown in our previous studies (e.g. (Zhou et al., 2023)). Moreover, the turns in the different direcons can be considered discrete responses at their peak, and the ming of the related acvaons (e.g., me to peaks), which we evaluated, are rather sensive and would have revealed differences, but we did not find them.

      (8) Separaon of sensory and motor responses in Figure 5: The current data do not adequately differenate whether the responses are sensory or motor given the high correlaon of the sensory inputs driving motor responses. Because isoflurane can diminish auditory responses early in the auditory pathway, this reviewer is not convinced the isoflurane experiments are interpretable.

      The reviewer is referring to Fig. 5C,D. Indeed, the point of this experiment was to show that it is difficult to differenate whether neural responses are sensory or motor in awake and freely moving condions. As we stated in the Results secon, “Although arousal and movement were not dissected in the present experiment (this would likely require paralyzing and ventilating the animal), the results indicate that activation of zona incerta neurons by sensory stimulation is primarily associated with states when sensory-evoked movement is also present”. This is followed in the Discussion by, “…as already noted, the suppression of sensory responses may be due to changes in arousal (Castro-Alamancos, 2004; Lee and Dan, 2012) and not caused by the abolishment of the movements per se”.

      (9) Given the broad duraon of the mean avoidance response (Fig. 6 C, botom), it would be useful to know to what extent this plot reflects a prolonged behavior or is the result of averaging different animals/trials with different latencies. Given that the shapes of the F/Fo responses in ZI appear similar across avoids and escapes (Fig. 6D), despite their apparent different speeds and movement duraons (Fig 6C), it would be valuable to know how the ming of the F/Fo relates to movement on a trial-by-trial basis.

      The duraon of the avoidance response cannot be ascertained from CS onset (panel 6C botom) and avoids are not wide but rather sharp. We have now made this clearer when Fig. 6C is first menoned (“note that since avoids occur at different latencies after CS onset they are best measured from their occurrence as in Fig. 6D”). Like other related condioned and uncondioned responses, avoids and escapes are similar, varying in the noted parameters. Regarding ming, as already menoned above, we think that the characteriscs of the populaon calcium signal make it unsuitable for further ming consideraons than what we included, parcularly for movements occurring at the fast speeds of avoids and escapes.

      (10) Lesion quanficaon: One cannot tell what rostral-caudal extent of ZI was lesioned and quanfied in this experiment. It would be easier to interpret if also ploted for each animal, so the reader can tell how reliable the method is. The mean ablaon would be beter shown as a normalized fracon of cells. Although the authors claim the lesions have litle impact on behavior, it appears the incompleteness of the lesions could warrant a more conservave interpretaon.

      The lesion experiment was a complement to the optogenecs inacvaon experiments we performed in our preceding ZI paper and in the present paper. Thus, the finding that the lesions had litle impact on behavior is supporve of the optogenecs findings. Regarding cell counts, we did not select any parts of the ZI to quanfy the number of neurons in either control or lesion mice. We considered the full rostrocaudal extent in our measurements. We are not sure what “fracon” the reviewer is suggesng, considering that these counts are from two different groups of mice (control vs lesion). Note that the red-marked neurons, as shown in Fig. 8A, reveal healthy non-Vgat-Cre neurons outside ZI that mark the extent of the AAV diffusion, which as shown spanned the full extent of the ZI in the coronal plane (and in other planes as the AAV spreads in all direcons).

      (11) Optogenecs: the locaon of infected neurons is poorly described, including the rostral-caudal extent and the fracon of neurons inside and outside of ZI. Moreover, it is unclear how strongly the optogenec manipulaons in this study are expected to affect neuronal acvity in ZI.

      We discussed the first point in (1) above. Regarding, how optogenec manipulaons are expected to affect neuronal acvity in ZI and its targets, we have conducted extensive electrophysiological recordings in slices and in vivo to detail the effects of our manipulaons on GABAergic neurons (e.g. (Hormigo et al., 2016; Hormigo et al., 2019; Hormigo et al., 2021a; Hormigo et al., 2021b), including ZI neurons (Hormigo et al., 2020). In fact, we never use an opsin we have not validated ourselves using electrophysiology. Moreover, our experiments employ a spectrum of optogenec light paterns (including trains/cont at different powers) that trate the optogenec effects within each session/animal. As shown in fig. 11 and 12, these paterns produce different behavioral effects related to the different levels of neural firing they induce. For ChR2-expressing neurons in ZI, firing is frequency dependent and maximal during Cont blue light (at the same power). For Arch-expressing neurons only Cont is used, and inhibion is a funcon of the green light power. When blue light is applied in ZI fibers targeng different areas, this relaonship changes. Blue light trains (1-ms pulses) at 40-66 Hz become the most effecve means of inducing sustained postsynapc inhibion compared to Cont or low frequencies.

      References

      Castro-Alamancos MA (2004) Dynamics of sensory thalamocorcal synapc networks during informaon processing states. Progress in Neurobiology 74:213-247.

      Hormigo S, Vega-Flores G, Castro-Alamancos MA (2016) Basal Ganglia Output Controls Acve Avoidance Behavior. J Neurosci 36:10274-10284.

      Hormigo S, Zhou J, Castro-Alamancos MA (2020) Zona Incerta GABAergic Output Controls a Signaled Locomotor Acon in the Midbrain Tegmentum. eNeuro 7.

      Hormigo S, Zhou J, Castro-Alamancos MA (2021a) Bidireconal control of orienng behavior by the substana nigra pars reculata: disnct significance of head and whisker movements. eNeuro. Hormigo S, Vega-Flores G, Rovira V, Castro-Alamancos MA (2019) Circuits That Mediate Expression of Signaled Acve Avoidance Converge in the Pedunculoponne Tegmentum. J Neurosci 39:45764594.

      Hormigo S, Zhou J, Chabbert D, Shanmugasundaram B, Castro-Alamancos MA (2021b) Basal Ganglia Output Has a Permissive Non-Driving Role in a Signaled Locomotor Acon Mediated by the Midbrain. J Neurosci 41:1529-1552.

      Lee SH, Dan Y (2012) Neuromodulaon of brain states. Neuron 76:209-222.

      Vong L, Ye C, Yang Z, Choi B, Chua S, Jr., Lowell BB (2011) Lepn acon on GABAergic neurons prevents obesity and reduces inhibitory tone to POMC neurons. Neuron 71:142-154.

      Zhou J, Hormigo S, Busel N, Castro-Alamancos MA (2023) The Orienng Reflex Reveals Behavioral States Set by Demanding Contexts: Role of the Superior Colliculus. J Neurosci 43:1778-1796.

    1. Author Response

      The following is the authors’ response to the original reviews.

      We thank the editor and the reviewers for their very useful and constructive comments. We went through the list and gladly received all their suggestions. The reviewers mostly pointed to minor revisions in the text, and we acted on all of those. The one suggestion that required major work was the one raised in point 13, about the processing pipeline being unconvincingly scattered between different tools (R → Python → Matlab). I agree that this was a major annoyance, and I am happy to say we have solved it integrating everything in a recent version of the ethoscopy software (available on biorxiv with DOI https://www.biorxiv.org/content/10.1101/2022.11.28.517675v2 and in press with Bioinformatics Advances). End users will now be able to perform coccinella analysis using ethoscopy only, thus relying on nothing else but Python as their data analysis tool. This revised version of the manuscript now includes two Jupyter Notebooks as supplementary material with a “pre-cooked” sample recipe of how to do that. This should really simplify adoption and provides more details on the pipeline used for phenotyping.

      Please find below a point-by-point description of how we incorporated all the reviewers’ excellent suggestions.

      Recommendations for the authors: please note that you control which, if any, revisions, to undertake

      1) Line 38: "collecting data simultaneously from a large number of individuals with no or limited human intervention" is a bit misleading, as the entire condition the individuals are put in are highly modified by humans and most times "unnatural". I understand the point that once the animals are placed in these environments, then recording takes place without intervention, but it would be nice to rephrase this so that it reflects more accurately what is happening.

      We have now rephrased this into the following (L39):

      Collecting data simultaneously from a large number of individuals, which can remain undisturbed throughout recording.

      2) Line 63: please add a reference to the Ethoscopes so that readers can easily find it.

      Done.

      2b) And also add how much they cost and the time needed to build them, as this will allow readers to better compare the proposed system against other commercially available ones.

      This information is available on the ethoscope manual website (http://lab.gilest.ro/ethoscope). The price of one ethoscope, provided all necessary tools are available, is around ~£75 and the building time very much depends on the skillset of the builder and whether they are building their first ethoscope or subsequent ones. In our experience, building and adopting ethoscopes for the first time is not any more time-expensive than building a (e.g.) deeplabcut setup for the first time. We have added this information to L81

      Ethoscopes are open source and can be manufactured by a skilled end-user at a cost of about £75 per machine, mostly building on two off-the-shelf component: a Raspberry Pi microcomputer and a Raspberry Pi NoIR camera overlooking a bespoke 3D printed arena hosting freely moving flies.

      3) Line 88: The authors describe that in the current setting, their system is capable of an acquisition rate of 2.2 frames per second (FPS). Would reducing the resolution of the PiCamera allow for higher FPS? I raise this point because the authors state that max velocity over a ten second window is a good feature for classifying behaviors. However, if animals move much faster than the current acquisition rate, they could, for instance, be in position X, move about and be close to the initial position when the next data point is acquired, leading to a measured low max velocity, when in fact the opposite happened. I think it would be good to add a statement addressing this (either data from the literature showing that the low FPS does not compromise data acquisition, or a test where increasing greatly FPS leads to the same results).

      We have previously performed a comparison of data analysed using videos captured at different FPSs, which is published in Quentin Geissman’s doctoral Thesis (2018, DOI: https://doi.org/10.25560/69514 ) in chapter 2, section 2.8.3, figure 2.9 ). We have now added this work as one of the references at L95 (reference 19).

      4) Still on the low FPS, would a Raspberry Pi 4 help with the sampling rate? Given that they are more powerful than the RPi3 used in the paper?

      It would, but it would be a minor increase, leading from 2.2 to probably 3-5 FPS. A significantly higher number of FPSs would be best achieved by lowering the camera’s resolution, as the reviewer’s suggested, or by operating offline. I think the interesting point being implied by the reviewers is that, for Drosophila, the current limits of resolution are more than sufficient. For other animals, perhaps moving more abruptly, they may not. The reviewer is right that we should add a line of caveat about this. We now do so in the discussion, lines 215-224.

      Coccinella is a reductionist tool, not meant to replace the behavioural categorization that other tools can offer but to complement it. It relies on raspberry PIs as main acquisition devices, with associated advantages and limitations. Ethoscopes are inexpensive and versatile but have limitations in terms of computing power and acquisition rates. Their online acquisition speed is fast enough to successfully capture the motor activity of different species of Drosophilae28, but may not be sufficient for other animals moving more swiftly, such as zebrafish larvae. Moreover, coccinella cannot apply labels to behaviour (“courting”, “lounging”, “sipping”, “jumping” etc.) but it can successfully identify large behavioural phenotypes and generate unbiased hypothesis on how behaviour – and a nervous system at large – can be influenced by chemicals, genetics, artificial manipulations in general.

      5) Along the same line of thought, would using a simple webcam (with similar specs to the PiCamera - ELP has cameras that operate on infrared and are quite affordable too) connected to a more powerful computer lead to higher FPS? - The reason for the question about using a simple webcam is that this would make your system more flexible (especially useful in the current shortage of RPi boards on the market) lowering the barrier for others to use it, increasing the chances for adoption.

      Completely bypassing ethoscopes would require the users to setup their own tracking solution, with a final result that may or may not match what we describe here. If a greater temporal resolution is necessary, the easiest way to achieve more FPSs would be to either decrease camera resolution or use the Pis to take videos offline and then process those videos at a later stage. The combination of these two would give FPS acquisition of 60 fps at 720p, which is the maximum the camera can achieve. We now made this clear at lines 83-92.

      The temporal and spatial resolution of the collected images depends on the working modality the user chooses. When operating in offline mode, ethoscopes are capable to acquire 720p videos at 60 fps, which is a convenient option with fast moving animals. In this study, we instead opted for the default ethoscope working settings, providing online tracking and realtime parametric extraction, meaning that images are analysed by each raspberry Pi at the very moment they were acquired (Figure 1b). This latter modality limits the temporal resolution of information being processed (one frame every 444 ms ± 127 ms, equivalent to 2.2 fps on a Raspberry Pi3 at a resolution of 1280x960 pixels with each animal being constricted in an ellipse measuring 25.8 ± 1.4 x 9.85 ±1.4 pixels - Figure 1a) but provides the most affordable and high-throughput solution, dispensing the researcher from organising video storage or asynchronous video processing for animals tracking.

      6) One last point about decreasing use barrier and increasing adoption: Would it be possible to use DeepLabCut (DLC) to simply annotate each animal (instead of each body part) and feed the extracted data into your current analysis with coccinella? This way different labs that already have pipelines in place that use DLC would have a much easier time in testing and eventually switching to coccinella? I understand that extracting simple maximal velocity this way would be an overkill, but the trade-off would again be a lowering of the adoption barrier.

      It would certainly be possible to calculate velocity from the whole animal pose measurement and then use this with HCTSA or Catch22, thus mimicking the coccinella pipeline, but it would be definitely overkilled, as the reviewers correctly points out. Given that we are trying to make an argument about high-throughput data acquisition I would rather not suggest this option in the manuscript.

      7) Line 96: The authors state that once data is collected, it is put through a computational frameworkthat uses 7700 tests described in the literature so that meaningful discriminative features are found. I think it would be interesting to expand a bit on the explanation of how this framework deals multiple comparison/multiple testing issues.

      We always use the full set of features on aggregate to train a classifier (e.g., TS_Classify in HCTSA) and that means no correction is necessary because the trained classifier only ever makes a single prediction (only one test is performed), so as long as it is done correctly (e.g., proper separation of training and test sets, etc.) then multiple hypothesis correction is not appropriate. This has been confirmed with the HCTSA/Catch22 author (Dr Ben Fulcher, personal communication). We have added a clarifying sentence about this to the methods (L315-318)

      8) It would be nice to have a couple of lines explaining the choice of compounds used for testing and also why in some tests, 17 compounds were used, while in others 40, and then 12? I understand how much work it must be in terms of experiment preparation and data collection for these many flies and compounds, but these changes in the compounds used for testing without a more detailed explanation is suboptimal.

      This is another good point. We have now added this information to the methods, in a section renamed “choice, handling and preparation of drugs” L280-285, which now reads like this:

      The initial preliminary analysis was conducted using a group of 12 compounds “proof of principle” compounds and a solvent control. These compounds were initially used to compare both the video method and ethoscope method. After testing these initial compounds, it was found that the ethoscope methodology was more successful, and then the compound list was expanded to 17 (including the control) only using the ethoscope method. As a final test, we included additional compounds for a single concentration, bringing up the total to 40 (including control), also for the ethoscope method.

      9) Line 119 states: "A similar drop in accuracy was observed using a smaller panel of 12 treatments (Supplementary Figure 2a)". It is actually Supplementary Figure 1c.

      Thank you for noticing that! Now corrected. The Supplementary figures have also been renamed to obey eLife’s expected nomenclature (both Figure 1 – Figure supplements)

      10) In some places the language seems a little outlandish and should either be removed or appropriately qualified. a- Lines 56-59 pose three questions that are either rhetorical or ill-posed. For example, "...minimal amount of information...behavior" implies there is a singular response but the response depends on many details such as to what degree do the authors want to "classify behavior".

      Yes, those were meant as rhetorical questions indeed, but we prefer to keep them in, because we are hoping to generate this type of thoughts with the readers. These are concepts that may not be so obvious to someone who is just looking to apply an existing tool and may spring some reflection about what kind of data do they really want/need to acquire.

      b) Some of the criticisms leveled at the state-of-the-art methods are probably unwarranted because the goals of the different approaches are different. The current method does not yield the type of rich information that DeepLabCut yields. So, depending on the application DeepLabCut may be the method of choice. The authors of the current manuscript should more clearly state that.

      In the introduction and discussion we do try to stress that coccinella is not meant to replace tools like DLC. We have now added more emphasis to this concept, for instance to L212:

      [tools like deeplabcut] are ideal – and irreplaceable – to identify behavioural patterns and study fine motor control but may be undue for many other uses.

      And L215:

      Coccinella is a reductionist tool not meant to replace the behavioural categorization that other tools can offer but to complement it

      11) The application to sleep data appears suddenly in the manuscript. The authors should attempt to make with text change a smoother transition from drug screen to investigation into sleep.

      I agree with this observation. We have now tried to add a couple of sentences to contextualise this experiment and hopefully make the connection appear more natural. Ultimately, this is a proof-ofprinciple example anyway so hopefully the reader will take it for what it is (L169).

      Finally, to push the system to its limit, we asked coccinella to find qualitative differences not in pharmacologically induced changes in activity, but in a type of spontaneous behaviour mostly characterised by lack of movement: sleep. In particular, we wondered whether coccinella could provide biological insights comparing conditions of sleep rebound observed after different regimes of sleep deprivation. Drosophila melanogaster is known to show a strong, conserved homeostatic regulation of sleep that forces flies to recover at least in part lost sleep, for instance after a night of forceful sleep deprivation.

      11b) Additionally, the beginning section of sleep experiments talks about sleep depth yet the conclusion drawn from sleep rebound says more about the validity of the current 5 min definition of sleep than about sleep depth. If this conclusion was misunderstood, it should be clarified. If it was not, the beginning text of the sleep section should be tailored to better fit the conclusion.

      I am afraid we did not a good job at explaining a critical aspect here: the data fed to coccinella are the “raw” activity data, in which we are not making any assumption on the state of the animal. In other words, we do not use the 5-minutes at this or any other point to classify sleep and wakening. Nevertheless, coccinella picks the 300 seconds threshold as the critical one for discerning the two groups. This is interesting because it provides a full agnostic confirmation of the five minutes rule in D. melanogaster. We recognise this was not necessarily obvious from the text and now added a clarification at L189-201:

      However, analysis of those same animals during rebound after sleep deprivation showed a clear clustering, segregating the samples in two subsets with separation around the 300 seconds inactivity trigger (Figure 3d). This result is important for two reasons: on one hand, it provides, for the third time, strong evidence that the system is not simply overfitting data of nought biological significance, given that it could not perform any better than a random classifier on the baseline control. On the other hand, coccinella could find biologically relevant differences on rebound data after different regimes of sleep deprivation. Interestingly enough, the 300 seconds threshold that coccinella independently identified has a deep intrinsic significance for the field, for it is considered to be the threshold beyond which flies lose arousal response to external stimuli, defining a “sleep quantum” (i.e.: the minimum amount of time required for transforming inactivity bouts into sleep bouts23,24,28). Coccinella’s analysis ran agnostic of the arbitrary 5-minutes threshold and yet identified the same value as the one able to segregate the two clusters, thus providing an independent confirmation of the fiveminutes rule in D. melanogaster.

      12) Line 227: (standard food) - please add a link to a protocol or a detailed description on what is "standard food". This way others can precisely replicate what you are using. This is not my field, but I have the impression that food content/composition for these animals makes big changes in behaviour?

      Yes, good point. We have now added the actual recipe to the methods L240:

      Fly lines were maintained on a 12-hour light: 12-hour dark (LD) cycle and raised on polenta and yeast-based fly media (agar 96 g, polenta 240 g, fructose 960 g and Brewer’s yeast 1,200 g in 12 litres of water).

      13) Data acquisition and processing: please add links to the code used.

      Both the code and the raw data used to generate all the figures have been uploaded on Zenodo and available through their repository. Zenodo has a limit of 50GB per uploaded dataset so we had to split everything into two files, with two DOIs, given in the methods (L356, section “code and availability” - DOIs: 10.5281/zenodo.7335575 and 10.5281/zenodo.7393689). We have now also created a landing page for the entire project at http://lab.gilest.ro/coccinella and linked that landing page in the introduction (L64).

      13b) Also your pipeline seems to use three different programming languages/environments... Any chance this could be reduced? Maybe there are R packages that can convert csv to matlab compatible formats, so you can avoid the Python step? (nothing against using the current pipeline per se, I am just thinking that for usability and adoption by other labs, the smaller amount of languages, the better?

      This is a very important suggestion that highlights a clear limitation of the pipeline. I am happy to say that we worked on this and solved the problem integrating the Python version of Catch22 into the ethoscopy software. This means the two now integrate, and the entire analysis can be run within the Python ecosystem. HCTSA does not have a Python package unfortunately but we still streamlined the process so that one only has to go from Python to Matlab without passing through R. To be honest, Catch22 is the evolution of HCTSA and performs really well so I think that is what most users will want to use. We provide two supplementary notebooks to guide the reader through the process. One explains how to go from ethoscope data to an HCTSA compatible mat file. The other explains how ethoscope data integrate with Catch22 and provides many more examples than the ones found in the paper figures.

      14) There are two sections named "References" (which are different from each other) on the manuscript I received and also on BioRxiv. Should one of them be a supplementary reference? Please correct it. I spent a bit of time trying to figure out why cited references in the paper had nothing to do with what was being described...

      The second list of references actually applied only to the list of compounds in the supplementary table 1. When generating a collated PDF this appeared at the end of the document and created confusion. We have now amended the heading of that list in the following way, to read more appropriately:

    1. Links are made by readers as well as writers. A stunning thing that we forget, but the link here is not part of the author’s intent, but of the reader’s analysis. The majority of links in the memex are made by readers, not writers. On the world wide web of course, only an author gets to determine links. And links inside the document say that there can only be one set of associations for the document, at least going forward.

      So much to unpack here...

      What is the full list of types of links?

      There are (associative) links created by the author (of an HTML document) as well as associative (and sometimes unwritten) mental links which may be suggested by either the context of a piece and the author's memory.

      There are the links made by the reader as they think or actively analyze the piece they're reading. They may make these explicit in their own note taking or even more strongly explicit with tools like Hypothes.is which make these links visible to others.

      tacit/explicit<br /> suggested mentally / directly written or made<br /> made by writer / made by reader<br /> others?

      lay these out in a grid by type, creator, modality (paper, online, written/spoken and read/heard, other)

    1. Author Response

      The following is the authors’ response to the original reviews.

      Thank you for reviewing our manuscript. We do find that the reviews are constructive and meaningful. Accordingly, we incorporated most suggestions into our revision. We provided a point-by-point responses to the reviews below.

      Reviewer #1 (Public Review):

      The evolution of dioecy in angiosperms has significant implications for plant reproductive efficiency, adaptation, evolutionary potential, and resilience to environmental changes. Dioecy allows for the specialization and division of labor between male and female plants, where each sex can focus on specific aspects of reproduction and allocate resources accordingly. This division of labor creates an opportunity for sexual selection to act and can drive the evolution of sexual dimorphism.

      In the present study, the authors investigate sex-biased gene expression patterns in juvenile and mature dioecious flowers to gain insights into the molecular basis of sexual dimorphism. They find that a large proportion of the plant transcriptome is differentially regulated between males and females with the number of sex-biased genes in floral buds being approximately 15 times higher than in mature flowers. The functional analysis of sex-biased genes reveals that chemical defense pathways against herbivores are up-regulated in the female buds along with genes involved in the acquisition of resources such as carbon for fruit and seed production, whereas male buds are enriched in genes related to signaling, inflorescence development and senescence of male flowers. Furthermore, the authors implement sophisticated maximum likelihood methods to understand the forces driving the evolution of sexbiased genes. They highlight the influence of positive and relaxed purifying selection on the evolution of male-biased genes, which show significantly higher rates of nonsynonymous to synonymous substitutions than female or unbiased genes. This is the first report (to my knowledge) highlighting the occurrence of this pattern in plants. Overall, this study provides important insights into the genetic basis of sexual dimorphism and the evolution of reproductive genes in Cucurbitaceae.

      Thank you for your positive comments. Greatly appreciated.

      There are, however, parts of the manuscript that are not clearly described or could be otherwise improved.

      • The number of denovo-assembled unigenes seems large and I would like to know how it compares to the number of genes in other Cucurbitaceae species. The presence of alternatively assembled isoforms or assembly artifacts may be still high in the final assembly and inflate the numbers of identified sex-biased genes.

      The majority of unigenes were annotated by homologs in species of Cucurbitaceae (63%), including Momordica charantia (16.3%), Cucumis melo (11.9%), Cucurbita pepo (11.9%), Cucurbita moschata (11.5%), Cucurbita maxima (10.1%) and other species of Cucurbitaceae (Fig. S1C). We admit that in the final assembly, transcripts may be still overestimated due to the unavoidable presence of isoforms, although we have tried our best to filter it by several strategies of clustering methods. Additionally, we assessed the transcripts using BUSCOv5.4.5 and embryophyta_odb10 database with 1,614 plant orthologs assessment. Some 95.0% of these orthologs were covered by the unigenes, in which 1447 (89.7%) BUSCO genes were “Complete BUSCOs”, 85 (5.3%) were “Fragmented BUSCOs”, and only 82 (5.0%) were “Missing BUSCOs” (Table S2). Overall, our assessment suggested that we have generated high-quality reference transcriptomes in the absence of a reference genome. Subsequently, we revised the manuscript (lines 175-181).

      • It is interesting that the majority of sex-biased genes are present in the floral buds but not in the mature flowers. I think this pattern could be explored in more detail, by investigating the expression of male and female sex-biased genes throughout the flower development in the opposite sex. It is also not clear how the expression of the sex-biased genes found in the buds changes when buds and mature flowers are compared within each sex.

      Thank you for your advice for further understanding of this interesting pattern. In the near future, we would like to study these issues through more development stages of flowers in each sex, probably with the aid of single-cell techniques and a reference genome. We have revised the manuscript to reflect these in Results, in the section "Tissue-biased/stage-biased gene expression" (lines 202216).

      • The statistical analysis of evolutionary rates between male-biased, female-biased, and unbiased genes is performed on samples with very different numbers of observations, therefore, a permutation test seems more appropriate here.

      Thank you for your suggestion. However, all comparisons between sex-biased and unbiased genes were tested using Wilcoxon rank sum test in R software, which is more commonly used. Additionally, we tested some datasets, which were consistent with Wilcoxon rank sum test.

      • The impact of pleiotropy on the evolutionary rates of male-biased genes is speculative since only two tissue samples (buds and mature flowers) are used. More tissue types need to be included to draw any meaningful conclusions here.

      Thank you for your advice for further understanding of the impact of pleitropy. In the near future, we would like make further investigations through more development stages of flowers and new technologies in each sex to consolidate the conclusion.

      Reviewer #2 (Public Review):

      Summary:

      This study uses transcriptome sequence from a dioecious plant to compare evolutionary rates between genes with male- and female-biased expression and distinguish between relaxed selection and positive selection as causes for more rapid evolution. These questions have been explored in animals and algae, but few studies have investigated this in dioecious angiosperms, and none have so far identified faster rates of evolution in male-biased genes (though see Hough et al. 2014 https://doi.org/10.1073/pnas.1319227111).

      Strengths:

      The methods are appropriate to the questions asked. Both the sample size and the depth of sequencing are sufficient, and the methods used to estimate evolutionary rates and the strength of selection are appropriate. The data presented are consistent with faster evolution of genes with male-biased expression, due to both positive and relaxed selection.

      This is a useful contribution to understanding the effect of sex-biased expression in genetic evolution in plants. It demonstrates the range of variation in evolutionary rates and selective mechanisms, and provides further context to connect these patterns to potential explanatory factors in plant diversity such as the age of sex chromosomes and the developmental trajectories of male and female flowers.

      Weaknesses:

      The presence of sex chromosomes is a potential confounding factor, since there are different evolutionary expectations for X-linked, Y-linked, and autosomal genes. Attempting to distinguish transcripts on the sex chromosomes from autosomal transcripts could provide additional insight into the relative contributions of positive and relaxed selection.

      Thank you for your meanful suggestions. We agree that the identification of chromosome origins for transcripts would greatly improve the insights of selection, and we will investigate these issues, probably with a reference genome in the near future.

      Reviewer #3 (Public Review):

      The potential for sexual selection and the extent of sexual dimorphism in gene expression have been studied in great detail in animals, but hardly examined in plants so far. In this context, the study by Zhao, Zhou et al. al represents a welcome addition to the literature.

      Relative to the previous studies in Angiosperms, the dataset is interesting in that it focuses on reproductive rather than somatic tissues (which makes sense to investigate sexual selection), and includes more than a single developmental stage (buds + mature flowers).

      The main limitation of the study is the very low number of samples analyzed, with only three replicate individuals per sex (i.e. the whole study is built on six individuals only). This provides low power to detect differential expression. Along the same line, only three species were used to evaluate the rates of non-synonymous to synonymous substitutions, which also represents a very limited dataset, in particular when trying to fit parameter-rich models such as those implemented here.

      A third limitation relates to the absence of a reference genome for the species, making the use of a de novo transcriptome assembly necessary, which is likely to lead to a large number of incorrectly assembled transcripts. Of course, the production of a reference transcriptome in this non-model species is already a useful resource, but this point should at least be acknowledged somewhere in the manuscript.

      Each of these shortcomings is relatively important, and together they strongly limit the scope of the conclusions that can be made, and they should at least be acknowledged more prominently. The study is valuable in spite of these limitations and the topic remains grossly understudied, so I think the study will be of interest to researchers in the field, and hopefully inspire further, more comprehensive analyses.

      We acknowledged that our sample size was relatively small. We will investigate these issues at the population level, probably with a reference genome in the near future. We acknowledged in the revised manuscript that there may be some incorrectly assembled transcripts. We assessed the transcripts using BUSCOv5.4.5 and the latest embryophyta_odb10 database with 1,614 plant orthologs assessment. As mentioned, 95.0% of these orthologs were covered by the unigenes, which of 1447 (89.7%) BUSCO genes were “Complete BUSCOs”, 85 (5.3%) were “Fragmented BUSCOs”, and only 82 (5.0%) were “Missing BUSCOs” (Table S2). In short, the quality of transcriptome was high in the absence of a reference genome.

      Reviewer #1 (Recommendations For The Authors):

      My main criticism of this manuscript is that it refers to gene names and orthogroups throughout the text, however, the assembled transcripts are not accessible. The reference trascriptome, orthology data, and alignments used for evolutionary analysis should be made available through a public repository to support reproducibility and efficient use of produced resources in this study.

      We have uploaded these datasets in Researchgate (https://www.researchgate.net/publication/373194650_Trichosanthes_pilosa_datasets Positive_selection_and_relaxed_purifying_selection_contribute_to_rapid_evolution of_male-biased_genes_in_a_dioecious_flowering_plant).

      Comments to the authors:

      1) I have an issue with the tissue-biased gene expression analysis. Looking at Fig.3, it seems to me there are 3,204 male-biased genes that are expressed at the same level in male buds and mature flowers (same for 5,011 female-biased genes in female buds and flowers), however, only a handful of genes show sex bias between mature male and female flowers. Taking the male-biased genes as an example, if the 3,204 M1BGs experience the same expression levels in mature male flowers and are no longer male-biased when mature male vs female flowers are compared, why there are not found as female tissue biased (F2TGs)? I may be wrong, but one scenario would be that the M1BGs increase their expression in female flowers and become unbiased. However, that increase in expression (low expression in the female buds → higher expression in the female flowers) should classify them as female tissue-biased genes (F2TGs). Can you please clarify how are the M1BGs and F1BGs expressed in the flowers of the opposite sex?

      As to Fig. 3A, 3,204 male-biased genes expressed in male floral buds are part of all male-biased genes (3204+286+724=4214), as shown in Fig.2A. However, only 233 male-biased genes (88+1+144=233, Fig.2B and Fig.3B) expressed in male mature flowers. So, they are not expressed at the same level between male floral buds and mature flowers. Only 288 genes are sex-biased (M1BGs), as well as tissue/stage-biased (M1TGs) in male floral buds. M1BGs (4,214 male-biased genes) and F1BGs (5,096 female-biased genes) are 0 overlaps, except for 44,326 unbiasedgenes shown in Fig.2A. That is, F1BGs (5,096 female-biased genes) are low expression or no expression in M1BGs (4,214 male-biased genes). The expression levels of some genes have been shown in Table S14.

      2) Paragraph (407-416) describes the analysis of duplicated genes under relaxed selection but there is no mention of this in the results.

      In fact, these results have been shown in Table S13. It is not necessary for us to describe them in detail in the results.

      3) How did the authors conclude that the identified functions in male flowers make them more adapted to biotic and abiotic environments (line 347-350)? In the paragraph above (line 338-342) the authors describe that female buds are better equipped against herbivores, which are a biotic factor?

      Following your concerns, we have revised the manuscript as follows: For line 338-342, we revised the text as “Indeed, functional enrichment analysis in chemical pathways such as terpenoid backbone and diterpenoid biosynthesis indicated that relative to male floral buds, female floral buds had more expressed genes that were equipped to defend against herbivorous insects and pathogens, except for growth and development (Vaughan et al., 2013; Ren et al., 2022) (Fig. S7A and Table S11).” For line 347-350, we revised text as “We also found that male-biased genes with high evolutionary rates in male buds were associated with functions to abiotic stresses and immune responses (Tables S12 and S13), which suggest that male floral buds through rapidly evolving genes are adapted to mountain climate and the environment in Southwest China compared to female floral buds through high gene expression.”

      4) Line 417-418: decreasing codon usage bias is linked to decreasing synonymous substitution rates, should this be the opposite?

      No. Codon usage bias was positively related to synonymous substitution rates. That is, stronger codon usage bias may be related to higher synonymous substitution rates (Parvathy et al., 2022).

      5) Figures and Tables are not standalone and are missing details in the legends. - Fig.2C, which genes are plotted on the heatmap and what is the color scale corresponding to?

      • All Supplementary figures are missing the descriptions of individual panels (A, B, C,etc.) in the legends. In addition, please add the numbers of observations under boxplots.

      • Supplementary Fig.5 and 6: Panel B is not a Venn diagram, I suggest removing it from the figures.

      • Supplementary Fig.7: Should be 'sex-biased genes'. What is the x-axis on the plot?

      • Supplementary Fig.8: Please add the description of the abbreviations in the legend. - Supplementary Tables S4, S5, S6: Please add information about the foreground and background branches.

      • Supplementary Table S6, S7, S8, S9, S10: Please add more details about the column headers (what is Model-A, background ω 2a, Unconstrained_1.p, K, which was the foreground branch etc.).

      • Supplementary Table S11: Please add gene IDs for each KEGG category.

      We have revised/fixed these issues following your concerns and suggetions.

      Minor comments:

      Line 28: 'algae' in place of 'algas'

      Line 53-56: Please provide more recent references.

      Line65: 'most' instead of 'almost'

      Line 86-87: It is not clear from the sentence if the sex-biased expression was detected in flowers compared to leaves, or were the sex-biased genes detected between male and female leaves? Please clarify.

      Line 107-108: positive selection is referred to as adaptive evolution, please choose one or the other.

      Line 109: 'force' instead of 'forces'

      Line 110: 'algae' instead of 'alga'

      Line 132: '..mainly distributed from Southwest,' the country is missing.

      Line 202: 'protein sequence evolution'?

      Line 232: what does the 'number of evolutionary rates' refers to?

      Line 253: please provide a reference for the RELAX model.

      Line 274: 'relaxed selective male-biased genes' should be 'male-biased genes under relaxed purifying selection'?

      Line 318: Please add a sentence explaining why the Cucurbitaceae family is a great model to study the evolution of sexual systems.

      Line 321: 'genes' instead of 'gene'.

      Line 366: male-biased genes experience 'higher' or 'more rapid' evolutionary rates. line 377: in the present study and in the case of Ectocarpus alga, positive selection plays an important role in male-biased genes evolution, but does not account for the majority of evolutionary change. Therefore, I would not call it a 'primary' force.

      Line 477: missing reference for DESeq2 package.

      Line 480: 'used'.

      Line 498: 'coding sequences'.

      Line516: 'to' instead of 'by'.

      Line 553: 'the' is repeated twice.

      Sorry for the typos and grammatical issues. We have revised them accordingly.

      Reviewer #2 (Recommendations For The Authors):

      There are two areas for improvement, one empirical and one theoretical.

      Empirically, the analyses could be expanded by an attempt to distinguish between genes on the autosomes and the sex chromosomes. Genotypic patterns can be used to provisionally assign transcripts to XY or XX-like behavior when all males are heterozygous and all females are homozygous (fixed X-Y SNPs) and when all females are heterozygous and males are homozygous (lost or silenced Y genes). Comparing such genes to autosomal genes with sex-biased expression would sharpen the results because there are different expectations for the efficacy of selection on sex chromosomes. See this paper (Hough et al. 2014; https://www.pnas.org/doi/abs/10.1073/pnas.1319227111), which should be cited and does in fact identify faster substitution rates in Y-linked genes (and note that pollenexpressed genes, at least, are concentrated on the sex chromosome in this system: https://academic.oup.com/evlett/article/2/4/368/6697528, https://royalsocietypublishing.org/doi/10.1098/rstb.2021.0226).

      We have cited Hough et al. 2014 and noticed that several species have been observed to exhibit rapid evolutionary rates of sequences on sex chromosomes compared to autosomes, which has been related to the evolutionary theories of fast-X or fast-Z (lines 482-484).

      On the theoretical side, this study is making a very specific intervention, namely identifying more rapid evolutionary rates in genes with male-biased than femalebiased expression in a dioecious plant. The writing in the introduction and the discussion needs to be improved to differentiate between this comparison and similar comparisons, e.g. sex-biased expression in other dioecious plants (76-81), between Xlinked and Y-linked genes (Hough et al. 2014), sex chromosomes and autosome (several studies already cited), gametophytic and sporophytic tissue, and male and female reproductive tissue in hermaphroditic plants. Setting out this distinction early in the introduction will make the specific goals and novelty of this work clearer.

      Thank you for your constructive suggestions. We have revised the relevant part of the Introduction accordingly (lines 74-107).

      Specific comments by line:

      Sorry for the typos or wording issues. We have revised them.

      26 - driven not driving

      28 - check house style (algae vs algas)

      28-29 - consider clarifying the antecedent of "them" (evolutionary forces, not algas) 35 - maybe, but don't the signalling genes involved in stress responses function in many capacities, not just stress? Also, there's evidence that reproductive recognition machinery in plants may ultimately derive from immune function (e.g. https://doi.org/10.1111/j.1469-8137.2008.02403.x), so the GO category "biotic stress" may be too vague

      39 - maybe clarify that "for the first time" refers to male rather than female, since there have been other studies in dioecious plants

      66-68 - asserting that something is "essential" after describing how rare it is doesn't quite follow, since diecious plants - especially with sex chromosomes - are basically an exception. I agree that understanding the evolution of dioecious plants is important, but this isn't the most compelling way to make that case - perhaps try something else.

      137ff - this sentence can be consolidated and streamlined

      142 - "floral tissue" rather than "flowers tissue," here and elsewhere

      144 - divergence (singular)

      235 - "evidence for the contributions of" = "evidences" is unidiomatic 250 - efficiency or efficacy?

      300 - why is "inositol" capitalized here and elsewhere?

      300ff - are these typical patterns in male tissue in other species?

      308 - is that interesting? It seems like exactly what I'd expect. Perhaps start with the unsurprising but reassuring observation (anther and pollen development genes are indeed expressed in male buds) before moving on to the more surprising findings.

      319 - remove "the"

      321 - genes (plural)

      330 - replace "these differences" with "the differences" 336 - perhaps recap proportions / percents here?

      340 - unnecessary comma after diterpenoid

      341 - this seems like a big leap from the evidence, especially in the absence of supporting information about the chemical defenses of these species and how they differ by sex. Don't terpenoids have a diverse array of functions, not just defense? Here's a review: https://link.springer.com/chapter/10.1007/10_2014_295

      We have revised the text as “Indeed, functional enrichment analysis in chemical pathways such as terpenoid backbone and diterpenoid biosynthesis indicated that relative to male floral buds, female floral buds had more expressed genes that were equipped to defend against herbivorous insects and pathogens, except for growth and development (Vaughan et al., 2013; Ren et al., 2022) (Fig. S7A and Table S11)” (lines 373-378).

      349 - as mentioned in line 35, this is a big speculative leap. The discussion is the place for speculation, but consider other explanations too. How does the development of flowers work? Are male flowers suppressing or resorbing female primordial organs? Do male flowers in fact senesce faster? perhaps spell out the logic in more detail.

      We have revised the text as “In addition, the enrichment in regulation of autophagy pathways could be associated with gamete development and the senescence of male floral buds (Table S14) (Liu and Bassham, 2012; Li et al., 2020; Zhou et al., 2021). In fact, it was observed that male flowers senesced faster (Wu et al., 2011). We also found that homologous genes of two male-biased genes in floral buds (Table S14) that control the raceme inflorescence development (Teo et al., 2014) were highly expressed compared to female floral buds. Taken together, these results indicate that expression changes in sex-biased genes, rather than sex-specific genes play different roles in sexual dimorphic traits in physiology and morphology (Dawson and Geber, 1999).” (lines 390-402).

      351 - senescence of, not senescence for

      363 - but Hough et al. 2014 did show rapid evolution of Y-linked genes, and those are by definition sex biased ...

      391 - perhaps reiterate here that while some sex-BIASED genes did, sex-SPECIFIC genes did not, to avoid confusion

      We also revised them accordingly.

      Reviewer #3 (Recommendations For The Authors):

      1- lines 56-57 : « have facilitated » : this wording confounds correlation with causation. Consider rephrasing as « is associated with »

      2- lines 58-60 : vague wording : what are these variations ? e.g. which tissues and stages are generally enriched?

      3- line 63 : this sentence is a bit misleading: consider changing it to « Most dioecious plants possess homomorphic sex-chromosomes » [and explain what homomorphic means in this context].

      4- line 68 : a reference is missing here. Also perhaps, allude to the fact that sexual selection in plants has long been considered a contentious issue (e.g. https://doi.org/10.1016/j.cub.2010.12.035)

      5- lines 72-76 : beyond simply describing the pattern, say what evolutionary processes are revealed by these observations.

      6- line 92 : remind the reader what these 5 studies are.

      7- line 94-95 : explain why the comparison of vegetative vs vegetative and vegetative vs reproductive tissues is a problem.

      The published studies only compared gene expression in vegetative versus vegetative tissues and vegetative versus reproductive tissues. Because it limited our understanding of sexual selection at different floral development stages. Revised accordingly (lines 103-104). We are very interested in flower development stage for sex-biased genes. The datasets could investigate sexual selection using two developmental stage (buds + mature flowers).

      8- line 100 « Evolutionary dynamic analyses » : this wording is vague

      9- line 110 : brown algae are NOT plants

      10- line 137-140 or in M&M : needs to describe somewhere how the male flowers differ from the female flowers and vice-versa: are the whole morphological structures related to female (male) reproduction entirely missing, or is their development arrested later on and they are still present but simply not producing gametes? This has consequences for the interpretation of the genes they express.

      We have revised the typos or wording issues accordingly. However, because the sampled floral buds were equal or less than 3 mm in size, we did not observe much morphological structural difference. Indeed, the male and female flowers at antheses were markedly different in this dioecious plant as shown in Fig. 1. Additionally, we found that dioecy is the ancestral state of Trichosanthes, and transitions to monoecy (Guo et al., 2020) based on our analysis (not shown in this study), which suggest that in the early stages of flower development, female floral buds may tend to masculinize, and vice versa (Fig. 2C).

      11- line 152 : it is important to be very transparent on the sample sizes here: « from three females and three males of the dioecious ... »

      12- line 153 : along the same line, explain here why a de novo transcriptome had to be generated here: « In the absence of an assembled reference genome for this nonmodel species, we de novo assembled ... »

      13- line 164-165 : « we have generated high-quality reference trancriptomes » : I am not entirely convinced of the quality of the transcriptome obtained without a reference genome, so I suggest simply removing this subjective sentence.

      Our assessment suggested that we have generated high-quality reference transcriptomes in the absence of a reference genome, which will be the next step of our work.

      14- line 169 : briefly explain the criteria used to call differentially expressed genes. Given the threshold (log-fold change >=1.3 if I read the figure correctly, but the M&M says >=1), explain how it was chosen.

      Sorry, you may have misunderstood the X, Y coordinates. The value of y coordinate represents -log10(FDR), and the value of x coordinate represents log2 (Fold Change).

      15- line 174 : Not clear to me how Fig2C is « revealing strong sexual dimorphism », since genes cluster neither by sex nor by tissue. This should be explained more clearly.

      16- line 174-177 : The fact that more ex-biased genes were identified in early buds than in mature flowers is an interesting observation that could be given more prominence in the manuscript, but it is not really explained. Could it reflect the fact that more genes are expressed in early buds because meiotic processes happen early in flower development? Also, the genes involved in male and female organ cell fate determination might also be expected to be expressed early, with mostly organ growth genes being expressed in the mature flower.

      17- line 181 : a wrap-up sentence might be useful here to drive the point home that sex-bias is more prevalent in buds than mature flowers.

      18- line 184 : « tissue-biased » : a more appropriate wording here would be « stagebiased », no ? These are indeed the same tissues but at different developmental stages.

      19- line 183-195 : this section could benefit from setting clear expectations in a hypothesis testing framework laying out the reasons to expect a different bias between stages and between sexes. How does that fit with the level of morphological divergence between sexes (relates to my point 10 above).

      20- line 197-204. A number of essential pieces of information are missing here: how many species, how divergent, say that one other is dioecious, and precise their relative phylogenetic placement (which is important to understand the models used below). Maybe adding a phylogeny of these species in Figure 4 could be useful. Also, briefly explain the « two-ratio » and « free-ratio » models here.

      21- line 196 and following: In these analyses, I could not understand the rationale for keeping buds vs mature flowers as separate analyses throughout. Why not combine both and use the full set of genes showing sex-bias in any tissue? This would increase the power and make the presentation of the results a lot more straightforward.

      As you pointed earlier (in the public review, paragraphy 2), “the dataset is interesting in that it focuses on reproductive rather than somatic tissues (which makes sense to investigate sexual selection), and includes more than a single developmental stage (buds + mature flowers)”, we totally agree with your points and were very interested in floral development stages for sex-biased genes.

      22- line 216 : say explicitly that the reason for not detecting a significant difference in spite of a relatively large effect size is probably related to the low number of genes, conferring low statistical power to detect a difference. An important feature also not highlighted here is that the trend (though not significant) is in the opposite direction than in the buds, and that both the 2-ratio and the free-ratio models agree on these inverted trends. This could be the basis for an interesting comparison.

      Thank you for your suggestions.

      23- line 220 : needs to explain more clearly how this « free-ratio » differs from the « two-ratio » model.

      24- line 232-234 : I don't see why this is necessary. Why not combine both? See also my comment 21 above.

      25- line 237 : the «A-model » was not defined before.

      26- line 237 : « male-biased » is missing after 343.

      27- line 253-258 : briefly explain what these other models are based on and how they are not redundant and instead complement the previous analyses and each other. 28- line 266-268 : the use of a more precise set of codons for male-biased genes than the others (if I understood correctly) could also be interpreted as another sign of stronger selective constraint, no?

      Codon usage bias is influenced by many factors, such as levels of gene expression. Highly expressed genes have a stronger codon usage bias and could be encoded by optimal codons for more efficient translation (Frumkin et al., 2018; Parvathy et al., 2022).

      29- line 269-291 : removing genes on a post-hoc basis seems statistically suspicious to me. I don't think your analysis has enough power to hand-pick specific categories of genes, and it is not clear what this brings here. I suggest simply removing these analyses and paragraphs.

      30- line 325 : say whether this patterns parallels / or not those in animals.

      31- line 335 : yes, these biological pieces of information are important and should be given in the introduction already.

      32- the discussion should focus at some point on the observation that more femalebiased genes are found in general, but that male-biased genes seem to be under greater selection. How do you reconcile these two apparently contradictory observations?

      We found that male-biased genes with high evolutionary rates in male floral buds were associated with functions to abiotic stresses and immune responses (Tables S12 and S13), which suggests that male floral buds through rapidly evolving genes are adapted to mountain climate and the environment in Southwest China compared to female floral buds through high gene expression (lines 387-390).

      33- line 355 : not clear how this follows from the previous sentences.

      34- line 356-358 : vagiue. not clear what the message of this sentence is.

      35- line 378-383 : say that these conclusions rely on the quality of gene annotation in this non-model species, which is probably pretty low (just like any other non-model species).

      36- line 403 : this conclusion seems far-fetched. Explain how exactly you reached this conclusion.

      37- line 406-416: these speculations on the role of paralogs seem unnecessary, in particular since the de novo transcriptome onto which all analyses are based cannot distinguish orthologs from paralogs.

      38- line 417-424. The discussion should not contain new results.

      39- line 510 : why were genes with dN/dS >2 discarded here? This might strongly bias the comparison, no? This needs to be properly justified.

      40- lines 516-523 : references to the models are missing.

      41- line 527: « omega = 1.5 » : why/how was this arbitrary threshold chosen?

      42- Fig 2 : write out « buds » and « mature flowers » on top of the graphs

      43- Fig 4 : add a phylogeny of the species showing the branch being compared. Also, add the number of genes in each category on each plot.

      Thanks, we revised/fixed these issues accordingly.

    1. Author Response

      The following is the authors’ response to the original reviews.

      We thank the reviewers and editors for their thoughtful assessment and critiques. As detailed below in the point-by-point replies, we have modified the text and figures to clarify points of ambiguity and to document statistical significance in places where we had inadvertently neglected to do so. The manuscript is clearer and more rigorous as a result of the review process.

      Reviewer #1 (Public Review):

      This study addresses the fundamental question of how the nucleotide, associated with the beta-subunit of the tubulin dimer, dictates the tubulin-tubulin interaction strength in the microtubule polymer. This problem has been a topic of debate in the field for over a decade, and it is essential for understanding microtubule dynamics.

      McCormick and colleagues focus their attention on two hypotheses, which they call the "self-acting" model and the "interface-acting" model. Both models have been previously discussed in the literature and they are related to the specific way, in which the GTP hydrolysis in the beta-tubulin subunit exerts an effect on the microtubule lattice. The authors argue that the two considered models can be discriminated based on a quantitative analysis of the sensitivity of the growth rates at the plus- and minus-ends of microtubules to the concentration of GDP-tubulins in mixed nucleotide (GDP/GMPCPP) experiments. By combing computational simulations and in vitro observations, they conclude that the tubulin-tubulin interaction strength is determined by the interfacial nucleotide.

      The major strength of the paper is a systematic and thorough consideration of GDP as a modulator of microtubule dynamics, which brings novel insights about the structure of the stabilizing cap on the growing microtubule end.

      I think that the study is interesting and valuable for the field, but it could be improved by addressing the following critical points and suggestions. They concern (1) the statistical significance of the main experimental finding about the distinct sensitivity of the plus- and minus-ends of microtubules to the GTP-tubulin concentration in solution, and (2) the validity of the formulation of the "self-acting" model with an emphasis solely on the longitudinal bonds.

      We thank the reviewer for the comment about statistical significance, and we regret our oversight to have not included that analysis in the original manuscript. We have now included an analysis of statistical significance for the main experimental results supporting the interface-acting model (Fig. 2C and the replotting of those data against a different abscissa in Fig. 3C,D), and more broadly we have ensured that all figure legends contain information about the number of measurements and whether error bars indicate SD or SEM.

      The reviewers comment about the sole emphasis on longitudinal bonds helped us realize that a change to Fig. 1 (where we illustrate the two models) would improve clarity. We had originally chosen to illustrate Figure 1 using ‘pure’ longitudinal interactions (with no lateral contacts), and this may be what triggered the reviewer’s comment. We have now revised the figure to show ‘corner’ (longitudinal + lateral) interactions. There are two main reasons for this decision. First, the corner interactions are more long-lived and therefore more important for the phenomena under study. Second, because illustrating corner interactions provides a better basis for us to discuss what is a subtle aspect of our model – that the ‘GDP penalty’ affecting longitudinal or lateral interactions in a corner site is completely equivalent. Thus, our model is not quite as narrow/exclusive as the reviewer suggested. We appreciate having had the chance to clarify this.

      Reviewer #2 (Public Review):

      McCormick, Cleary et al., explore the question of how the nucleotide state of the tubulin heterodimer affects the interaction between adjacent tubulins.

      (1) The setup of the authors' model, which attributes the dynamic properties of the growing microtubule only to the differences in interface binding affinities, is unrealistic. They excluded the influence of the nucleotide-dependent global conformational changes even in the 'Self-Acting Nucleodide' model (Fig. 1A). As the authors have found earlier, tubulin in its unassembled state may be curved irrespective of the species of the bound nucleotide (Rice et al., 2008, doi: 10.1073/pnas.0801155105), but at the growing end of microtubules, the situation could be different. Considering the recently published papers from other laboratories, it may be more appropriate to include the nucleotide-dependent change in the tubulin conformation in the Self-Acting Nucleotide model.

      We understand the reviewer’s perspective, which may be summarized as: “We know conformational changes are happening and that they affect tubulin:tubulin interactions, so why isn’t your model trying to account for that?” In text added to the revised manuscript, we address this critique in the following ways. First, there is not a consensus in the field about how to parameterize the different conformations of tubulin and how they influence tubulin:tubulin interactions. Second, any attempt to explicitly account for different conformations of tubulin would substantially increase the number of adjustable model parameters, which in turn makes the fitting to growth rates more complicated. Third, compared to traditional ‘dynamics’ assays that use GTP, using mixtures of GMPCPP and GDP simplifies the biochemistry by eliminating GTPase. This results in a more uniform composition of nucleotide state in the body of the microtubule polymer, which diminishes the importance of explicitly modeling nucleotide-influenced changes in conformation. Fourth, it seems likely that different conformations of tubulin will modulate both longitudinal interactions (as tubulin becomes straighter the longitudinal contact area grows larger) and lateral interactions (as tubulin becomes straighter, the lateral contact areas on α- and β-tubulin come into better alignment). Our model treats longitudinal and corner (defined as longitudinal + lateral) interactions as independent, so in principle it could be implicitly capturing some of these conformational effects. By refining the strengths of the longitudinal and corner interactions independently, the model effectively allows the strength of longitudinal contacts to be different for pure longitudinal and corner interactions, which might implicitly capture some variations in longitudinal contacts for different tubulin conformations. Our model treats ‘bucket’-type sites (one longitudinal and two lateral interactions) as simply having an additional lateral interaction of equal strength as the first, but because bucket sites have such a high affinity, they rarely dissociate and this small oversimplification is unlikely to have a substantial effect. We have introduced text in several places (bottom of p. 7 and elsewhere) to cover these points.

      (2) The result that the minus end is insensitive to GDP (Fig. 2) was previously published in a paper by Tanaka-Takiguchi et al. (doi: 10.1006/jmbi.1998.1877). The exact experimental condition was different from the one used in Fig. 2, but the essential point of the finding is the same. The authors should cite the preceding work, and discuss the similarities and differences, as compared to their own results.

      Thank you for reminding us of this paper! We agree that it is an ‘on target’ citation, and have cited and discussed it in the revised manuscript (last paragraph of Introduction, third paragraph of Discussion).

      Reviewer #1 (Recommendations For The Authors):

      1) In my opinion, the way in which the authors have depicted their "self-acting" model in Fig. 1 and in Supplementary Figure 1, makes the model look intuitively implausible. The drawings seem to imply that at the plus-end the GTP hydrolysis in the beta-tubulin subunit somehow allosterically affects the alpha-tubulin subunit of the same dimer to weaken its longitudinal bond with adjacent tubulin dimer. Conversely, at the minus end, the same reaction now affects the very same beta-tubulin subunit, and modulates its longitudinal interaction with the next dimer.

      However, a more realistic formulation of the "self-acting" model would be that the exchangeable nucleotide affects the lateral bonds, formed by the same beta-tubulin with its lateral neighbors. Although the experimental data in this regard are controversial, at least some supporting evidence for this idea comes from structural arguments, e.g. [Manka, S.W., Moores, C.A. Nat Struct Mol Biol 25, 607-615 (2018).] This "lateral selfacting", but not the "longitudinal self-acting" hypothesis, seems more natural, and it was the one previously implemented in the seminal paper by [Vanburen et al, 2002 Proceedings of the National Academy of Sciences 99.9 (2002): 6035-6040.] and later by other some other models as well.

      This point has been addressed above, in part by modifying the cartoon in Fig. 1.

      2) To better clarify, which exact models are considered in this manuscript, it would be helpful if the authors provided a detailed table with all simulation parameters, including, k_off_loner, k_off_bucket and k_off_corner, for both nucleotide states, in both the selfacting and the interface-acting models.

      Thank you for the suggestion. We have added tables that show all simulation parameters, as well as the corresponding calculated on- and off-rates for each interaction.

      3) I am not sure that using some 'arbitrarily chosen' parameters is very helpful in Chapter 1 of Results. In fact, the results, obtained with an unconstrained set of parameters may be misleading or provide ambiguous answers. In other words, how reliable are the conclusions, based on the arbitrary parameter set? For example, could the dependences of the microtubule growth rate on the GDP-tubulin content be more or less pronounced with a different set of arbitrarily chosen parameters, compared to the graphs in Fig. 1BC?

      This is a fair criticism. In response, we have added three new sets of simulations that each test different choices of the biochemical parameters used in Figure 1. With respect to the original parameters, we tested a weaker and stronger choice for the longitudinal interaction (KDlong, a 100-fold range), the corner interaction (KDcorner, a 25-fold range), and the GDP weakening factor (a 100-fold range). The predicted supersensitivity of plus-end growth rates to GDP in the self-acting vs interface-acting mechanisms is robust across the range of different choices for the above parameters (Figure 1 Supplements 1 and 2). Parameters for these new simulations are shown in Tables 3 and 4.

      4) It took me some time to comprehend why the minus-end growth rate is assumed to be dependent only on the concentration of the GMPCPP-tubulin (in section 2 of Results). It would be great if the authors simply plotted the simulated dependence of the growth rate on the GMPCPP-tubulin concentration in the case when no GDP-tubulin was added. As I understand, that curve should almost exactly match the dependence observed in Fig 1B, correct? Otherwise, it does not seem obvious, why GDP-tubulin does not impede the minus-end growth. Again, is this conclusion model- and parameterdependent? This question is related to point 3 above.

      The minus-end growth rates decrease in proportion to the concentration of GMPCPPtubulin. We have added a note on minus-end growth rates in the Figure 1 legend.

      5) I was not quite convinced by the evidence for distinct sensitivities of the plus- and minus-end growth rates to GDP-tubulin concentration (Figure 2C and Fig 3C, D). These are the key experimental measurements in the paper. Therefore, I suggest that the authors try to strengthen this point by additional measurements to increase statistics. Or at least, please, explain the data points, the error bars, and provide some information on the number of independent measurements and the statistical significance between the curves. Maybe, they could be directly compared after normalizing by the "all GMPCPP growth rate"? How was the "1.5-fold" ratio obtained in Fig 2C? Does that number refer only to a certain GDP-tubulin concentration or does that value somehow characterize the whole range of the concentrations measured?

      This has been addressed above.

      Reviewer #2 (Recommendations For The Authors):

      These look identical to above and were addressed there.

      (1) The setup of the authors' model, which attributes the dynamic properties of the growing microtubule only to the differences in interface binding affinities, is unrealistic. They excluded the influence of the nucleotide-dependent global conformational changes even in the 'Self-Acting Nucleodide' model (Fig. 1A). As the authors have found earlier, tubulin in its unassembled state may be curved irrespective of the species of the bound nucleotide (Rice et al., 2008, doi: 10.1073/pnas.0801155105), but at the growing end of microtubules, the situation could be different. Considering the recently published papers from other laboratories, it may be more appropriate to include the nucleotide-dependent change in the tubulin conformation in the Self-Acting Nucleotide model.

      (2) The result that the minus end is insensitive to GDP (Fig. 2) was previously published in a paper by Tanaka-Takiguchi et al. (doi: 10.1006/jmbi.1998.1877). The exact experimental condition was different from the one used in Fig. 2, but the essential point of the finding is the same. The authors should cite the preceding work, and discuss the similarities and differences, as compared to their own results.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Response to Public Reviews

      Reviewer #1:

      We thank this reviewer for their comments on our paper. We have adjusted the methods secon to ensure it is clear, including an updated descripon of the stascs and in some cases updated stascal methods to ensure uniformity in analyses across datasets. The discussion has been modified so that the message regarding our results is set appropriately in the literature.

      Reviewer #2:

      We are grateful to this reviewer for their insight. We have modified the text of the discussion to address the points of this reviewer, including providing a greater focus on the significance of our results without overgeneralizing. We have addionally reframed our argument regarding the detecon of pescides by Bombus terrestris to more carefully consider conflicng results from other papers.

      Response to Recommendaons For The Authors

      Response to Reviewer #1

      We thank this reviewer for their thoughul comments and ideas. We have made several changes to the text of the manuscript to improve the clarity of our wring, and we are grateful to the reviewer for raising several important points that we had not sufficiently discussed in the paper previously. We feel the paper has been improved with the inclusion of a more thorough discussion and clarified methods. Please see below our responses to the points they raised.

      A few general thoughts that I had when reading your manuscript: I assume you have only tested the acve pescide ingredients, but not the formula generally applied in the field. Given that these formulas contain addional compounds but the acve ingredients, might it not be possible that they could be perceived by bees?

      For this study, we were interested specifically with the taste of acve pescide compounds, although we agree it could be interesng to explore the taste of other formula compounds, it was not within the scope of this paper to test these.

      Is there an alternave to quinine as a negave control? As you state, quinine is generally used in studies and likely oen in concentraons which are beyond what can be seen in e.g. floral nectar, which might explain its aversive effect. I would like to see it tested in natural concentraons and ideally in combinaon with other potenally toxic plant secondary metabolites (PSMs).

      The purpose of including quinine in our study was to provide an in-depth characterizaon of “biter” taste responses using the sensilla on bumblebee labial palps and galea (i.e., through the atenuaon of GRN firing). This was not to show how bumblebees may interact with plants containing quinine in the field, or other PSMs. It would indeed be interesng to explore other plant secondary metabolites, however this was beyond the scope of our paper.

      L177-187 AND 233-238 Could you, please, provide a photo or schemac drawing to illustrate your assay? I have a very hard me picturing the actual set-up.

      We have provided a labeled diagram of the bumblebee mouthparts and sensillum types (Fig 1A), as well as an image of the bumblebee feeding from a capillary in the behavioural assay (Fig 1G). Further details about the feeding assay (including a JoVe video) can be found with the Ma 2016 paper that we cite throughout our methods secon.

      L219 Why did you choose 5 sec here?

      This feeding bout duraon was selected based on the criteria defined in Ma et al 2016. We have added a citaon to that sentence.

      L221-224 How precisely was the behavior scored? Just length of bouts or also repeated short contacts? Please, specify.

      We used the first bout duraon and the cumulave bout duraon in our analyses. A sentence has been added to specify this.

      L231/233 Please, provide some brief details here, as many readers may find it annoying to find and read another study for methods' details.

      We have added three sentences in the methods to further explain the electrophysiological method.

      L238-245 See also my general methods comment: concentraons used for pescides and quinine differ quite substanally, which may explain their different effects on the bees' percepon. Are the concentraons used for quinine realisc? If not that is totally fine for a negave control, but it would be interesng to see a comparison of effects conducted for similar concentraons.

      The concentraons used of quinine were selected so that they would elicit a known “biter response” – these concentraons are not meant to be field-realisc, and our data (and others, e.g., Tiedeken et al 2014) show that lower concentraons of quinine are not detected by bumblebees.

      L277-301 I assume that this is a standard stascal approach to analyze electrophysiological data. However, I am really struggling with fully understanding what you did here. It might be good to add some addional explanaon/detail, e.g. on why you constructed firing rate histograms or how you derived slopes (aren't smulus and bin categorical variables?).

      Firing rate histograms are indeed very commonly used for visualizing neuron spikes over me. We have changed the text somewhat in an effort to make it more clear. Likewise, the “slopes” were derived from the LMEs, and in this case “bin” is a connuous me variable – any me variable will involve some binning depending on the resoluon used but should not be considered categorical.

      L291-295 As you were averaging and normalizing your data, could you, please, provide some informaon on variaon within animals?

      We have now included informaon on the coefficient of variaon for spike rates across sensilla for a given animal/smulus (CV range, median, and IQR).

      L295 I assume t-SNE represent a mulvariate approach for ordinaon, correct? Can you explain why you chose to use this approach? Did you use Euclidean Distance?

      Yes, t-SNE is a mulvariate technique for dimensionality reducon. It is parcularly well-suited for the visualizaon of high-dimensional datasets, as it can reveal the underlying structure of the data by embedding it in a lower-dimensional space (e.g., 2D) while preserving the local structure of the data as much as possible. We used t-SNE because it has been shown to be effecve in visualizing clusters of similar data points in high-dimensional data. Euclidean distance was used as the distance metric for the t-SNE embedding. Euclidean distance is the default distance metric for most implementaons of t-SNE and is appropriate for connuous data like the spike counts in this study. We have adjusted the methods to clarify this.

      L304 Why did you not always use LMEs?

      We have adjusted the text to show that we used LME for all comparisons, and the stascs have been updated accordingly in the results secon. None of the outcomes changed with the implementaon of LME for all tests.

      L306 Would it not make sense to also include the interacon between smulus and concentraon in your models?

      We have now included a sentence to explain that the interacon term was removed due to it being nonsignificant, and the models without the interacon term having beter model fit (determined by having lower AIC and BIC values).

      Results:<br /> L337, 339 and more: I would prefer to see actual p-values, not just "p > 0.05".

      This has been adjusted on L337 and 339. As far as we are aware, there are no other instances where exact p-values were not given (except when p < 0.0001).

      Discussion:<br /> L470 This is true, but the bees' behavior changed significantly, indicang that they may respond to this small change in firing paterns already?

      It is true that the bees’ behaviour changed significantly with 0.1mM QUI, but this was not the case with the pescides. Bees drank less overall of 0.1mM QUI than OSR because of the rapid posngesve effects of this compound. It’s important that the duraon of the first bout was not affected (i.e., they didn’t directly avoid it by taste upon first encountering it, as they do with 1mM QUI), but just that they drank less of the 0.1mM QUI over 2 minutes. Post-ingesve effects may occur as quickly as 30s aer inial consumpon. For the pescides, the small changes in GRN firing were not associated with any effects on consumpon or our other measures of feeding behaviour, and we suggest this results from a lack of rapid negave posngesve consequences. We now include further discussion of these important points.

      L481 But they consumed significantly less of the 0.1 mM QUI!?

      This is true, but they did not reject it (i.e., not drink it at all), and there were no changes in the amount of me the bees spent in contact with the 0.1mM QUI soluon compared to OSR. We have adjusted the text for clarificaon.

      L504/505 AND 520/521 AND 533-536 I see your point, but I am wondering whether the bees may need some me but are generally able to learn the taste of pescides, which may explain why e.g. Arce et al. only saw an effect over me. For example, learning to 'focus' on the pescide taste may require some internal feedback (bees not feeling well) or larvae feedback. If I understood right, you tested workers only, which might be less sensive than queens or larvae. I think these aspects should be discussed.

      In our study, we invesgated the mechanism of taste detecon of pescides. We agree that bees likely use posngesve mechanisms to learn to associate the locaon (or another cue) of a food source with posive or negave posngesve cues. ‘Focus’ is a higher-order process that involves increased atenon to sensory smuli but does not affect sensaon at the level of the receptor. We show that bees are unable to taste pescides using the gustatory receptors on their mouthparts, so post-ingesve learning would not be able to associate the pescides with any taste cue. Indeed, there may be caste-specific differences with foraging queens, however a discussion of this would be beyond the scope of our paper.

      I also recommend broadening the scope of your discussion. For example, you only focus on nectar, while the story might be different for pollen, which is also contaminated with pescides but represents a different chemical matrix with potenally different taste properes. Also, unlike nectar, pollen is collected with tarsae and hence on contact with other bee body parts.<br /> I would also like to see a discussion of your study's implicaons for other bee species and other potenally toxic compounds (e.g. PSMs).

      We do not include any data in this paper regarding tarsal or antennal taste or other potenally toxic compounds. In this paper we present one mechanism of biter taste percepon (i.e., of quinine) and specifically show that the buff-tailed bumblebee is unable to taste certain pescides using their mouthparts. To avoid overgeneralizing, we have not included discussions about other species or compounds, which may or may not share similaries with our study.

      Response to Reviewer #2

      We thank this reviewer for their comments. We have adjusted the text to avoid overgeneralizaons with our conclusions, and atempted to soen language in the discussion that may have been construed as combave towards the Arce et al (2018) paper. We hope this reviewer finds these adjustments to be in line with their expectaons.

      1) In two parts of the manuscript, the authors made broad predicons and conclusions beyond what the evidence in the paper can support and wrote "Future studies will be necessary to confirm this." (Lines 508-509) and " Future studies that survey a greater variety of compounds will be necessary to confirm this." (563-564). Instead of making conclusions based on what experimental data in future studies may support, I would ask the authors instead to make conclusions that their current study can support based on experimental evidence in this paper.

      We have removed these predicons that extend beyond the scope of the paper.

      2) Line 315 "GRNs encode differences in sugar soluon composion". The logic of the tle is wrong.

      This has been fixed.

      3) Since this study is only performed in one bumblebee species, then I would suggest that the tle be more specific e.g., "Mouthparts of the bumblebee Bombus terrestris exhibit poor acuity for the detecon of pescides in nectar".

      We have made this change.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      [The “revision plan” should delineate the revisions that authors intend to carry out in response to the points raised by the referees. It also provides the authors with the opportunity to explain their view of the paper and of the referee reports.

      1. General Statements [optional]

      In this paper we describe the new finding that the epicardial deposits the extracellular matrix component laminin onto the apical ventricular surface during cardiac development. We identify a novel role for the apicobasal polarity protein Llgl1in timely emergence of the epicardium and deposition of this apical laminin, alongside a requirement for Llgl1 in maintaining integrity of the ventricular wall at the onset of trabeculation.

      We thank the reviewers for their very positive appraisal of our manuscript, and for their helpful suggestions for useful revisions. In particular we would like to highlight the broad interest they feel this manuscript holds, not only contributing conceptual advances to our understanding of multiple aspects of cardiac development, but also to cell and developmental biologists working in epithelial polarity and extracellular matrix function. We also note their positive appraisal of the rigor of the study and quality of the manuscript.

      2. Description of the planned revisions

      Reviewer 1

      1a) It is mentioned that llgl1 CRISPR/Cas9 mutants are viable as adults on pg. 3 of the Results section. Have the authors examined heart morphology in these mutants in juvenile or adult fish?

      We have some historical data on adult llgl1 mutant survival that we plan to include in the study.

      Reviewer 2

      2a) The authors note an interesting observation with apical and basal laminin deposition dynamics surrounding cardiomyocytes, and that Llg1 has a role in apical Laminin deposition (however, highly variable at 80 hpf as Figure 3M shows). They carry out a very nice study in which they overexpress Llgl1 tagged with mCherry in the myocardium and show that there is no rescue of the extruding cardiomyocyte defect or Laminin deposition. However, there is still a possibility that the tagged Llgl1 in the transgene Tg(myl7:Llg1-mCherry)sh679 might not be functional due to improper protein folding or interference by the mCherry tag. The authors should supplement their approach with a transplantation experiment to generate mosaic llgl1 mutant animals and assess whether llgl1 mutant cardiomyocytes extrude at a higher rate than the control. This would provide definitive evidence that Llg1l acts in a cell non-autonomous manner.

      We agree with the reviewer, and propose to perform transplant experiments, transplanting cells from llgl1 mutants into wild type siblings, and quantify cell extrusion to determine whether llgl1 mutant cells are extruded more frequently than wild type.

      2b) The data in this manuscript appears to point that Llgl1 regulates Laminin deposition mainly in epicardial cells to regulate their dissemination/migration across the ventricular myocardial surface. It would be important to test this cell-autonomous function with the transplant experiment (above point) and examine whether llgl1 mutant epicardial cells fail to migrate and deposit Laminin. It might be possible to perform a rescue experiment through overexpression of Llgl1 in epicardial cells (if possible, there is a tcf21:Gal4 line available).

      Similar to above, we propose to perform transplant experiments, transplanting cells from llgl1 mutants or wild type siblings into wild type siblings or llgl1 mutants, respectively, and in this instance quantify contribution of transplanted cells to epicardial coverage.

      2c) In the Discussion, the authors propose that Llgl1 acts in two ways: Laminin deposition in epicardial cells that suppress cell extrusion and polarity regulation in cardiomyocytes to promote trabeculation. It would be important to test the second hypothesis on trabeculation and polarity regulation by using the myocardial-specific overexpression/rescue of Llgl1 in llgl1 mutants, and then quantifying the trabeculating cardiomyocytes and analyze Crb2a localization. This experiment can distinguish whether this trabeculation phenotype is rescued independently of the apical Laminin deposition that has been included in Figure S5.

      To help address the second part of our hypothesis laid out in the discussion, we propose to quantify trabecular organisation and Crb2a localisation in llgl1 mutants either carrying the myl7:llgl1-mCherry construct, or mCherry-negative controls.

      2d) The potential mis-localization of Crb2a in the llgl1 mutants is interesting, but this effect appears to be quite mild, and as the authors note, resolve by 80 hpf. Considering the role of Lgl in Drosophila in shifting Crb complex localization during early epithelial morphogenesis, it would be worth performing the analysis at earlier timepoints (between 55 and 72 hpf) to determine whether Llgl1 is indeed important for the progressive apical relocalization of Crb2a.

      We will expand our description of this in the mutants by performing analysis of Crb2a at earlier timepoints in the llgl1 mutant (55hpf and 60hpf).

      2e) OPTIONAL: It might be worth testing other antibodies that could mark the apical (particularly aPKC which is known to phosphorylate and regulate the Crb complex) and basolateral domains (Par1, Dlg) of the cardiomyocytes to definitively conclude that the epithelial integrity of the cells is affected. Although there are no reports of working antibodies marking the basal domain in zebrafish, there is at least a Tg(myl7:MARCK3A-RFP) line published (Jimenez-Amilburu et al. (2016)) - which the authors can inject to examine the localization in mosaic hearts.

      We plan to assess localisation of aPKC (see section 4 for response to other suggested polarity protein analyses).

      2f) Have the authors quantified the numbers of total cardiomyocytes in llgl1 mutants to correlate how many cells are lost as a consequence of extrusion? What is the physiological impact of this extrusion (ejection fraction, total cardiac volumes, sarcomere organization)?

      We have some of this data already which we will include in the manuscript (cell number, myocardial volume). We agree that the analysis of cardiac function could be more extensive, and we will perform more detailed analysis of cardiac function, including e.g. ejection fraction. Sarcomere organisation has been previously described in llgl1 mutants by Flinn et al, 2020, so we do not plan to replicate this data.

      2g) The lamb1a and lamc1 mutant phenotypes were nicely analyzed. However, there is basement membrane deposition on both the apical and basal sides of the cardiomyocytes. Therefore, it is unclear whether the cardiomyocyte extrusion is completely caused by loss of apical basement membrane, or whether the loss of basal basement membrane could compromise the myocardial tissue integrity. The authors should clarify this conclusion in the text.

      We will address this further in the text, but will also include 55hpf Laminin staining data for llgl1 mutants to reinforce our message.

      2h) The authors note that Llgl1-mCherry in the Tg(myl7:Llg1-mCherry)sh679 line localizes to the basolateral domain of the cardiomyocytes, which is valuable confirmation that Llgl1 protein is spatially restricted. However, only 1 timepoint (55 hpf) is noted. It would be important to perform Llgl1 localization across different developmental timepoints (at least until 80 hpf) to examine the dynamics of this protein during trabeculation and apical extrusion, and potentially correlate it with Crb2a localization for a better understanding of the apicobasal machinery in cardiomyocytes.

      We already have some of this data and will include extra timepoints in a revised version of the manuscript

      2i) The phenotypes of llgl1 mutants described here differ compared to the previous study by Flinn et al. (2020). In particular, whereas the mutants generated in this study have only mild pericardial edema and are adult viable, approximately one third of llgl1mw3 (Flinn et al. (2020)) died at 6 dpf. Is this caused by the different natures of the mutations in the llgl1 gene? Is there a possibility that the llgl1sh598 is a hypomorphic allele since the targeted deletion is in a more downstream sequence (in exon 2) compared to the llgl1mw3 (deletion in exon 1) allele?

      We thank the reviewer for noticing these subtle differences between the two llgl1 mutants. Indeed, while we occasionally see llgl1sh598 mutants with the severe phenotype described by Flinn et al, this is a small minority which we did not quantify. Our mutation is indeed slightly further downstream than that described by Flinn et al, however we believe that this will have a neglible effect on Llgl1 function. Our llgl1sh589 mutation results in truncation shortly into the WD40 domain, and importantly completely lacks the Lgl-like domain, which is responsible for the specific function of Llgl1 likely through its ability to interact with SNAREs to regulate cargo delivery to membranes (Gangar et al, Current Biology 2005).

      Interestingly, Flinn et al report no increased phenotypic severity in their maternal-zygotic llgl1 mutants when compared to zygotic mutants. Conversely, we often observed very severe phenotypes in MZ llgl1sh589 mutants, including failure of embryos during blastula stages, apparently through poor blastula integrity. We did not include this information in the manuscript due to space constraints. However, we argue that together these differences between the two alleles may not be due to hypomorphism of our llgl1sh589 allele, but rather differences in genetic background that may amplify specific phenotypes. We plan to include a short sentence summarising the above in combination with planned experiments described below to address the reviewer’s next comment.

      2j) Suggested experiment: qPCR of regions downstream of the deletion to make sure that the transcript is absent/reduced in the llgl1sh598 mutants. Alternatively, immunostaining or Western blot would be an even better option to ensure there is no Llgl1 protein production - there is an anti-Llgl1 antibody available that works for Western blots in zebrafish (Clark et al. (2012)).

      We plan to analyse llgl1 expression in llgl1 mutants using qPCR.

      Reviewer 3

      3a) Major - the authors describe that llgl1 mutants exhibit transient cardiac edema at 3 dpf, which is resolved by 5 dpf, and claim that the mutants are viable. This statement needs to be better supported - What is the proportion of mutants that survive to adulthood? The embryonic phenotypes are pretty variable - are the mutants that survive the ones with a less severe phenotype? Is there a gross defect in the adult heart of these animals?

      In line with comments from Reviewers 1 and 2 above, we will include a description of the data we have from adult animals (historical data, not generation of new animals).

      3b) Major - Many of the phenotypes described here -most importantly, the defects on epicardial development- could result from hemodynamic defects in llgl1 mutants. The authors claim that function is unaffected in these animals, but this has only been addressed by measuring heartbeat. The observation that the cardiac function in these animals is normal would conflict with a previous description (PMID: 32843528) that demonstrates that llgl1 mutant animals show significant hemodynamic defects, which would cause epicardial defects. Thus, this aspect of the work needs to be better addressed.

      In line with our comments to point 2f) from Reviewer 2, we will perform a more in-depth functional analysis on llgl1 mutant larvae.

      3c) The phenotypes related to forming multiple layers in the heart (Fig. 1) could be more convincing. In some figures, the authors use a reporter that labels the myocardial cell membrane, but in Figure 1 this is not used. Showing a myocardial membrane marker (for example, the antibody Alcama, Zn-8) would significantly strengthen this observation.

      We will describe trabecular phenotypes in more detail using the suggested antibody to highlight membranes.

      3d) The analysis of Crumbs redistribution (Fig. 2) is quite interesting. Still, given that the authors have a transgenic model to rescue llgl1 expression in cardiomyocytes, they could move from correlative evidence to experimental demonstration of the role of llgl1 in Crumbs localization.

      Similar to our response to comment 2c) from Reviewer 2, we plan to address this

      3. Description of the revisions that have already been incorporated in the transferred manuscript

      Reviewer 1:

      Although information is provided in the introduction and discussion on the role of the Llgl1 homolog in Drosophila and speculation on LLGL1 contributing to heart defects in SMS patients in the discussion, have Llgl1 homologs been examined in other vertebrate animal models during heart development or regeneration?

      With the exception of the Flinn et al paper, we find no published studies assessing the role of Llgl1 in heart development or regeneration in other vertebrates, and have updated the introduction to highlight this fact:

      ‘Zebrafish have two Lgl homologues, llgl1 and llgl2, and llgl1 has previously been shown to be required for early stages of heart morphogenesis (Flinn et al. 2020). However, although Llgl1 expression has also been reported in the developing mouse heart and both adult mouse and human hearts (Uhlén et al. 2015; Klezovitch et al. 2004), whether llgl1 plays a role in ventricular wall development has not been examined.’

      In Fig. 4J-M', there is no Cav1 signals after wt1a MO but still laminin signals. Where these laminins come from?

      The residual laminin staining observed in wt1a morphants is located at the basal surface of cardiomyocytes (while the apical laminin signal is lost, in line with the epicardial deposition of laminin at the apical ventricle surface). This basal laminin is likely deposited earlier during heart tube development by either the myocardium, endocardium or both, and thus unaffected by later formation of the epicardium. We reason this since a) it is present at the basal cardiomyocyte surface at 55hpf (see Fig 2); b) we have previously identified both myocardial and endocardial expression of laminin subunits at 26hpf and 55hpf (Derrick et al, Development, 2021); c) sc-RNA-seq analysis of hearts at 48hpf demonstrates that laminin subunits, e.g. lamc1 are expressed in myocardial and endocardial cells (Nahia et al, bioRxiv, 2023), also in line with our previous ISH analysis. We have included a sentence to reflect this in the results section:

      Conversely, *wt1a* morphants retain deposition of laminin at the basal CM surface, likely from earlier expression and deposition of laminin by either myocardial or endocardial cells (Derrick et al. 2021; Nahia et al. 2023), which is unaffected by later epicardial development.

      On page 3 of the manuscript, Fig. 1A should be included with Fig. 1B in the first sentence of paragraph 2 of the Results subsection "Llgl1 regulates ventricular wall integrity and trabeculation".

      Amended

      It would be beneficial to readers to briefly describe what cell type the transgenic reporters label when mentioned in the Results section to help readers unfamiliar with zebrafish.

      We have updated the text to read:

      We further analysed heart morphology using live lightsheet microscopy of *Tg(myl7:LifeActGFP);Tg(fli1a:AC-TagRFP)* double transgenic wild-type and *llgl1* mutant embryos, allowing visualisation of myocardium (green) and endocardium (magenta) respectively. Comparative analysis of overall heart morphology between 55hpf and 120hpf when looping morphogenesis is complete, revealing that *llgl1* mutants continue to exhibit defects in heart morphogenesis (Fig S1S-X).

      Reviewer 3

      (Optional) There is laminin in the luminal side of the heart before there is any epicardial invasion. What is the source of this laminin? The techniques the authors have used (i.e., chromogenic ISH) are fine, but a more detailed analysis using fluorescent ISH (i.e., RNAScope) would be much more definitive.

      This is related to our response to Reviewer 1 (above) – where we have included the following text included in manuscript: Conversely, *wt1a* morphants retain deposition of laminin at the basal CM surface, likely from earlier expression and deposition of laminin by either myocardial or endocardial cells (Derrick et al. 2021; Nahia et al. 2023), which is unaffected by later epicardial development. We hope this clarifies our proposed origins for the earlier laminin deposition.

      4. Description of analyses that authors prefer not to carry out

      Reviewer 1:

      As pan-epicardial transgenes like tcf21 reporters have been widely used, the authors should use such reporters to verify the expression of laminin gene expression in epicardial cells, and the efficacy and efficiency of depleting epicardial cells after wt1 MO injection.

      Several studies have demonstrated that the epicardium is not a heterogeneous population – for example, tcf21 is not expressed in all epicardial cells and thus not a pan-epicardial reporter (Plavicki et al, BMC Dev Biol, 2014, Weinberger et al, Dev Cell, 2020) – the suggested analysis would not necessarily be conclusive, and more detailed study would require acquisition of three new transgenic lines. Furthermore, we believe the evidence we present in the paper supports our claim: 1) We show expression of two laminin subunits in a thin mesothelial layer directly adjacent to the myocardium, specifically in the location of the epicardium; 2) sc-RNA seq analyses have also identified laminin expression in epicardial cells at 72hpf (where lamc1a is identified as a marker of the epicardium); 3) We demonstrate 100% efficacy of our wt1a knockdown as assayed by Cav1 expression, an established epicardial marker (Grivas et al, 2020, Marques et al, 2022) which in sc-RNA seq data is expressed at high levels broadly in the epicardial cell population (Nahia et al, 2023), representing a good assay for presence of epicardium. However, we propose to perform ISH analysis of laminin subunit expression in wt1a MO to investigate whether the mesothelial laminin-expressing layer we observe adjacent to the myocardium is absent upon loss of wt1a.

      Reviewer 2:

      The data in this manuscript appears to point that Llgl1 regulates Laminin deposition mainly in epicardial cells to regulate their dissemination/migration across the ventricular myocardial surface. It would be important to test this cell-autonomous function with the transplant experiment (above point) and examine whether llgl1 mutant epicardial cells fail to migrate and deposit Laminin. It might be possible to perform a rescue experiment through overexpression of Llgl1 in epicardial cells (if possible, there is a tcf21:Gal4 line available).

      We do not propose to perform this experiment using a tcf21:Gal4 line, as this would likely require at least 6 months to either import and quarantine, or generate the necessary stable lines. Furthermore, as mentioned above, tcf21 is not a pan-epicardial marker, and the extent and timing of the Gal4:UAS system may make this challenging to determine whether llgl1 has been expressed early or broadly enough. We will instead attempt transplantation experiments.

      OPTIONAL: It might be worth testing other antibodies that could mark the apical (particularly aPKC which is known to phosphorylate and regulate the Crb complex) and basolateral domains (Par1, Dlg) of the cardiomyocytes to definitively conclude that the epithelial integrity of the cells is affected. Although there are no reports of working antibodies marking the basal domain in zebrafish, there is at least a Tg(myl7:MARCK3A-RFP) line published (Jimenez-Amilburu et al. (2016)) - which the authors can inject to examine the localization in mosaic hearts.

      We will assess localisation of aPKC, but we do not plan to analyse the other components. Analysis of basolateral domains (Par1, Dlg, Mark3a-RGP), will not necessarily assess epithelial integrity, as suggested, but rather apicobasal polarity – which we already assess using Crb2a, and additionally plan to assess aPKC to accompany the Crb2a analysis. Since the reviewer suggests this as an optional experiment we prioritise their other suggested experiments that we think more directly address the main messages of the manuscript.

      OPTIONAL: Gentile et al. (2021) found that reducing heartbeat led to decreased cardiomyocyte extrusion in snai1b mutants. The authors could look into the contribution of mechanical pressure through contraction in the apical cardiomyocyte extrusion, and test whether reducing contraction (tnnt2 morpholino, chemical treatments) partly rescues the llgl1 mutant phenotypes.

      The relationship between cardiac function and myocardial wall integrity appears to be complex. The paper referred to by the reviewer indeed finds that reduction in heartbeat leads to decreased CM extrusion upon loss of the EMT-factor Snai1b. Previous studies have also found that endothelial flow-responsive genes klf2a/b are required to maintain myocardial ventricular wall integrity at later stages in a contractility-dependent manner (Rasouli et al, 2018). However, contractility is also required early for pro-epicardial emergence, but plays a lesser role in expansion of the epicardial layer on the myocardial surface (Peralta, 2013). Unpicking the relationship between the forces induced by mechanical contraction of the ventricular wall, contractility-based induction of e.g klf2 expression, and the impact of contractile forces on proepicardial development or epicardial expansion will be complex. We therefore think the proposed experiment will be difficult to interpret whatever the outcome, and argue that dissecting this relationship is beyond the scope of revisions for this paper.

      Reviewer 3

      How llgl1 relates to epicardial biology is left entirely unexplored in this work. Do proepicardial cells show any defect in cell polarization related to llgl1 absence?

      We agree with the reviewer that we do not delve into the mechanisms underlying regulation of epicardial development by llgl1, and that this is an interesting question. Our scope for this manuscript was to understand the mechanisms by which llgl1 regulates integrity of the ventricular wall, and feel that uncovering the molecular mechanisms by which llgl1 regulates timely epicardial emergence is a larger question that would require substantial investigation (for example, if and when llgl1 PE cells do exhibit apicobasal defects, how this impacts timing of cluster release etc). We think these are important questions that would be better answered in detail in a separate manuscript.

    1. Author Response

      eLife assessment

      Building on their own prior work, the authors present valuable findings that add to our understanding of cortical astrocytes, which respond to synaptic activity with calcium release in subcellular domains that can proceed to larger calcium waves. The proposed concept of a spatial "threshold" is based on solid evidence from in vivo and ex vivo imaging data and the use of mutant mice. However, details of the specific threshold should be taken with caution and appear incomplete unless supported by additional experiments with higher resolution in space and time.

      We thank the reviewers and editors for the positive assessment of our work as containing valuable findings that add to our understanding of cortical astrocytes. We also appreciate their positive appraisal of the proposed concept of a spatial threshold supported by solid evidence.

      Regarding their specific comments, we truly appreciate them because they have helped to clarify issues and to improve the study. Provisional point-by-point responses to these comments are provided below. Regarding the general comment on the spatial and temporal resolution of our study, we would like to clarify that the spatial and temporal resolution used in the current study (i.e., 2 - 5 Hz framerate using a 25x objective with 1.7x digital zoom with pixels on the order of 1 µm2) is within the norm in the field, does not compromise the results, nor diminish the main conceptual advancement of the study, namely the existence of a spatial threshold for astrocyte calcium surge.

      We respect the thoughtfulness of the reviewers and editors and look forward to improving the paper to fully answer both public and private comments with a revised manuscript.

      Reviewer #1 (Public Review):

      Lines et al., provide evidence for a sequence of events in vivo in adult anesthetized mice that begin with a footshock driving activation of neural projections into layer 2/3 somatosensory cortex, which in turn triggers a rise in calcium in astrocytes within "domains" of their "arbor". The authors segment the astrocyte morphology based on SR101 signal and show that the timing of "arbor" Ca2+ activation precedes somatic activation and that somatic activation only occurs if at least {greater than or equal to}22.6% of the total segmented astrocyte "arbor" area is active. Thus, the authors frame this {greater than or equal to}22.6% activation as a spatial property (spatial threshold) with certain temporal characteristics - i.e., must occur before soma and global activation. The authors then elaborate on this spatial threshold by providing evidence for its intrinsic nature - is not set by the level of neuronal stimulus and is dependent on whether IP3R2, which drives Ca2+ release from the endoplasmic reticulum (ER) in astrocytes, is expressed. Lastly, the authors suggest a potential physiologic role for this spatial threshold by showing ex vivo how exogenous activation of layer 2/3 astrocytes by ATP application can gate glutamate gliotransmission to layer 2/3 cortical neurons - with a strong correlation between the number of active astrocyte Ca2+ domains and the slow inward current (SIC) frequency recorded from nearby neurons as a readout of glutamatergic gliotransmission. This is interesting and would potentially be of great interest to readers within and outside the glia research community, especially in how the authors have tried to systematically deconstruct some of the steps underlying signal integration and propagation in astrocytes. Many of the conclusions posited by the authors are potentially important but we think their approach needs experimental/analytical refinement and elaboration.

      We thank the reviewer for her/his positive appraisal and comments that has helped us to improve the study. In response to their insights, we aim to address the key points raised below:

      1. Sequence of Events: We acknowledge the reviewer's interest in our findings regarding the sequence of events. We will provide a more detailed description of the methods and results to clarify the temporal relationships between neural activation, astrocyte calcium dynamics, and astrocyte morphology segmentation.

      2. Spatial Threshold: The reviewer accurately identifies our characterization of a spatial threshold (≥22.6% activation) with temporal characteristics as a crucial aspect of our study. We will expand upon this concept by offering a clearer illustration of how this threshold relates to somatic and global activation.

      3. Intrinsic Nature of Spatial Threshold: The reviewer's insightful observation regarding the inherent quality of the spatial threshold, regardless of its dependence on neuronal stimuli is noteworthy. We will provide additional details to substantiate this claim, shedding more light on the fundamental nature of this phenomenon.

      4. Physiological Implications: The reviewer rightly highlights the potential physiological significance of our findings, particularly in relation to gliotransmission in cortical neurons. We will enhance our discussion by elaborating on the implications of these observations.

      The primary issue for us, and which we would encourage the authors to address, relates to the low spatialtemporal resolution of their approach. This issue does not necessarily compromise the concept of a spatial threshold, but more refined observations and analyses are likely to provide more reliable quantitative parameters and a more comprehensive view of the mode of Ca2+ signal integration in astrocytes.

      We agree with the reviewer that our spatial-temporal resolution (2 – 5 Hz framerate using a 25x objective and 1.7x digital zoom with pixels on the order of 1 µm) does not compromise the proposed concept of the existence of a spatial threshold for the intracellular calcium expansion.

      For this reason, and because their observations might be perceived as both a conceptual and numerical standard in the field, we believe that the authors should proceed with both experimental and analytical refinement. Notably, we have difficulty with the reported mean delays of astrocyte Ca2+ elevations upon sensory stimulation. The 11s delay for response onset in "arbor" and 13s in the soma are extremely long, and we do not think they represent a true physiologic latency for astrocyte responses to the sensory activity. Indeed, such delays appear to be slower even than those reported in the initial studies of sensory stimulation in anesthetized mice with limited spatial-temporal resolution (Wang et al. Nat Neurosci., 2006) - not to say of more recent and refined ones in awake mice (Stobart et al. Neuron, 2018) that identified even sub-second astrocyte Ca2+ responses, largely preserved in IP3R2KO mice. Thus, we are inclined to believe that the slowness of responses reported here is an indicator of experimental/analytical issues. There can be several explanations of such slowness that the authors may want to consider for improving their approach: (a) The authors apparently use low zoom imaging for acquiring signals from several astrocytes present in the FOV: do all of these astrocytes respond homogeneously in terms of delay from sensory stimulus? Perhaps some are faster responders than others and only this population is directly activated by the stimulus. Others could be slower in activation because they respond secondarily to stimuli. In this case, the authors could focus their analysis specifically on the "fast-responding population". (b) By focusing on individual astrocytes and using higher zoom, the authors could unmask more subtle Ca2+ elevations that precede those reported in the current manuscript. These signals have been reported to occur mainly in regions of the astrocyte that are GCaMP6-positive but SR101-negative and constitute a large percentage of its volume (Bindocci et al., 2017). By restricting analysis to the SR101-positive part of the astrocyte, the authors might miss the fastest components of the astrocyte Ca2+ response likely representing the primary signals triggered by synaptic activity. It would be important if they could identify such signals in their records, and establish if none/few/many of them propagate to the SR-101-positive part of the astrocyte. In other words, if there is only a single spatial threshold, the one the authors reported, or two or more of them along the path of signal propagation towards the cell soma that leads eventually to the transformation of the signal into a global astrocyte Ca2+ surge.

      We thank the reviewer for these excellent and important comments. The qualm with the mean delays of astrocyte activation is indeed a result of averaging together astrocyte responses to a 20 second stimulus. Indeed, astrocyte responses are heterogeneous and many astrocytes respond much quicker, as can be seen in example traces in Figs. 1D, 1G, and 3C. Indeed, with any biological system variability exists, however here we take the averaged responses in order to identify a general property of astrocyte calcium dynamics: the existence of the concept of a spatial threshold for astrocyte calcium surge.

      Further, we used a lower stimulus frequency (2Hz) than Stobart et al. (90 Hz) to assess subthreshold activities. We found that stronger stimuli decreased response delays and will include this result in the revised manuscript. Interestingly, from Fig 4F, higher stimulus did not significantly alter the spatial threshold. In the revised version of the manuscript, we will provide a more detailed analysis and the consequent discussion of this analysis.

      In this context, there is another concept that we encourage the authors to better clarify: whether the spatial threshold that they describe is constituted by the enlargement of a continuous wavefront of Ca2+ elevation, e.g. in a single process, that eventually reaches 22.6% of the segmented astrocyte, or can it also be constituted by several distinct Ca2+ elevations occurring in separate domains of the arbor, but overall totaling 22.6% of the segmented surface? Mechanistically, the latter would suggest the presence of a general excitability threshold of the astrocyte, whereas the former would identify a driving force threshold for the centripetal wavefront. In light of the above points, we think the authors should use caution in presenting and interpreting the experiments in which they use SIC as a readout. Their results might lead some readers to bluntly interpret the 22.6% spatial threshold as the threshold required for the astrocyte to evoke gliotransmitter release. Indeed, SIC are robust signals recorded somatically from a single neuron and likely integrate activation of many synapses all belonging to that neuron. On the other hand, an astrocyte impinges in a myriad of synapses belonging to several distinct neurons. In our opinion, it is quite possible that more local gliotransmission occurs at lower Ca2+ signal thresholds (see above) that may not be efficiently detected by using SIC as a readout; a more sensitive approach, such as the use of a gliotransmitter sensor expressed all along the astrocyte plasma-membrane could be tested to this aim.

      The reviewer raised an excellent point. Whether the spatial threshold of 22.6% occur in the segmented astrocyte or may be reached occurring in separate domains of the arbor, is an important question and we aim to address this by novel analysis that will be provided in the revised version of the manuscript.

      Regarding comments on SIC, we fully agree with the reviewer. In the revised version of the manuscript, we will include text in the discussion to ensure the correct interpretation of the results, i.e., the observed 22.6% spatial threshold for the SIC does not necessarily indicates an intrinsic property of gliotransmitter release; rather, since SICs have been shown to be calcium-dependent, it is not surprising that their presence, monitored at the whole-cell soma, matches the threshold for the intracellular calcium extension.

      Additional considerations are that the authors propose an event sequence as follows: stimulus - synaptic drive to L2/3 - arbor activation - spatial threshold - soma activation - post soma activation - gliotransmission. This seems reminiscent of the sequence underlying neuronal spike propagation - from dendrite to soma to axon, and the resulting vesicular release. However, there is no consensus within the glial field about an analogous framework for astrocytes. Thus, "arbor activation", "soma activation", and "post soma activation" are not established `terms-of-art´. Similarly, the way the authors use the term "domain" contrasts with how others have (Agarwal et al., 2017; Shigetomi et al., 2013; Di Castro et al., 2011; Grosche et al., 1999) and may produce some confusion. The authors could adopt a more flexible nomenclature or clarify that their terms do not have a defined structural-functional basis, being just constructs that they justifiably adapted to deal with the spatial complexity of astrocytes in line with their past studies (Lines et al., 2020; Lines et al., 2021).

      We agree there is no consensus within the glial field about this event sequence. One major difference between this sequence of events and neuronal spike propagation is directionality from dendrite to soma to axon. It is unknown whether directionality of the calcium signal exists in astrocytes. The term “microdomain” is used in the references above to define distal subcellular domains in contact with synapses, and in order to dissociate from this term we adopt the nomenclature “domain” to define all subcellular domains in the astrocyte arborization. These items will be discussed and clarified in the revised version of the manuscript.

      Our previous points suggest that the paper would be significantly strengthened by new experimental observations focusing on single astrocytes and using acquisitions at higher spatial and temporal resolution. If the authors will not pursue this option, we encourage them to at least improve their analysis, and at the same time recognize in the text some limitations of their experimental approach as discussed above. We indicate here several levels of possible analytical refinement.

      We believe our spatial (25x objective and 1.7x digital zoom with pixels on the order of 1µm) and temporal (2 – 5 Hz framerate) resolution is within the range used in the glial field. In any case the existence of a spatial threshold for astrocyte calcium surge is not compromised with the use of this imaging resolution.

      The first relates to the selection of astrocytes being analyzed, and the need to focus on a much narrower subpopulation than (for example) 987 astrocytes used for the core data. This selection would take into greater consideration the aspects of structure and latency. With the structural and latency-based criteria for selection, the number of astrocytes to analyze might be reduced by 10-fold or more, making our second analytical recommendation much more feasible.

      We agree that individual differences exist, however, establishing a general concept requires the sampling of many astrocytes. Nevertheless, we aim to further address this issue in the revised version of the manuscript by analyzing the calcium dynamics in individual domains.

      For structure-based selection - Genetically-encoded Ca2+ indicators such as GCaMP6 are in principle expressed throughout an astrocyte, even in regions that are not labelled by SR101. Moreover, astrocytes form independent 3D territories, so one can safely assume that the GCaMP6 signal within an astrocyte volume belongs to that specific astrocyte (this is particularly evident if the neighboring astrocytes are GCaMP6negative). Therefore, authors could extend their analysis of Ca2+ signals in individual astrocytes to the regions that are SR101-negative and try to better integrate fast signals in their spatial threshold concept. Even if they decided to be conservative on their methods, and stick to the astrocyte segmentation based on the SR-101 signal, they should acknowledge that SR101 dye staining quality can vary considerably between individual astrocytes within a FOV - some astrocytes will have much greater structural visibility in the distal processes than others. This means that some astrocytes may have segmented domains extending more distally than others and we think that authors should privilege such astrocytes for analysis. However, cases like the representative astrocytes shown in Figure 4A or Figure S1B, have segmented domains localized only to proximal processes near the soma. Accordingly, given the reported timing differences between "arbor" and "soma" activation, one might expect there to be comparable timing differences between domains that are distal vs proximal to the soma as well. Fast signals in peripheral regions of astrocytes in contact with synapses are largely IP3R2-independent (Stobart et al., 2018). However, the quality of SR101 staining has implications for interpreting the IP3R2 KO data. There is evidence IP3R2 KO may preferentially impact activity near the soma (Srinivasan et al., 2015). Thus, astrocytes with insufficient staining - visible only in the soma and proximal domains - might show a biased effect for IP3R2 KO. While not necessarily disrupting the core conclusions made by the authors based on their analysis of SR101-segmented astrocytes, we think results would be strengthened if astrocytes with sufficient SR101 staining - i.e. more consistent with previous reports of L2/3 astrocyte area (Lanjakornsiripan et al., 2018) - were only included. This could be achieved by using max or cumulative projections of individual astrocytes in combination with SR101 staining to construct more holistic structural maps (Bindocci et al., 2017).

      We agree with the ideas concerning SR101, and indeed there could be variability in the origins of the astrocyte calcium signal. Astrocyte territory boundaries can be difficult to discern when both astrocytes express GCaMP6. Here we take a conservative approach to constrain ROIs to SR101-positive astrocyte territory outlines without invading neighboring cells in order to reduce error in the estimate of a spatial threshold. The effect of IP3R2 KO preferentially impacting activity near the soma is interesting, and in line with our conclusions. We agree that the findings from SR101-negative pixels would not necessarily disrupt the core conclusions of the study, and the additional analysis suggested would further strengthen results.

      For latency-based selection - The authors record calcium activity within a FOV containing at least 20+ astrocytes over a period of 60s, during which a 2Hz hindpaw stimulation at 2mA is applied for 20s. As discussed above, presumably some astrocytes in a FOV are the first to respond to the stimulus series, while others likely respond with longer latency to the stimulus. For the shorter-latency responders <3s, it is easier to attribute their calcium increases as "following the sensory information" projecting to L2/3. In other cases, when "arbor" responses occur at 10s or later, only after 20 stimulus events (at 2Hz), it is likely they are being activated by a more complex and recurrent circuit containing several rounds of neuron-glia crosstalk etc., which would be mechanistically distinct from astrocytes responding earlier. We suggest that authors focus more on the shorter latency response astrocytes, as they are more likely to have activity corresponding to the stimulus itself.

      We agree that different times of astrocyte calcium increases may be due to different mechanisms outside of the astrocyte. We believe the spatial threshold will be intrinsic to these external variables; yet we believe that longer latency responses are physiological and may carry important information to determining the astrocyte calcium responses.

      The second level of analysis refinement we suggest relates specifically to the issue of propagation and timing for the activity within "arbor", "soma" and "post-soma". Currently, the authors use an ROI-based approach that segments the "arbor" into domains. We suggest that this approach could be supplemented by a more robust temporal analysis. This could for example involve starting with temporal maps that take pixels above a certain amplitude and plot their timing relative to the stimulus-onset, or (better) the first active pixel of the astrocyte. This type of approach has become increasingly used (Bindocci et al., 2017; Wang et al., 2019; Ruprecht et al., 2022) and we think its use can greatly help clarify both the proposed sequence and better characterize the spatial threshold. We think this analysis should specifically address several important points:

      We agree that the creation of temporal maps from our own data will be interesting. We will provide the results of the suggested analysis in the revised version of the manuscript.

      1) Where/when does the astrocyte activation begin? Understanding the beginning is very important, particularly because another potential spatial threshold - preceding the one the authors describe in the paper - could gate the initial activation of more distal processes, as discussed above. This sequentially earlier spatial threshold could (for example) rely on microdomain interaction with synaptic elements and (in contrast) be IP3R2 independent (Srinivasan et al., 2015, Stobart et al., 2018). We would be interested to know whether, in a subset of astrocytes that meet the structure and latency criteria proposed above and can produce global activation, there is an initial local GCaMP6f response of a minimal size that must occur before propagation towards the soma begins. The data associated with varying stimulus parameters could potentially be useful here and reveal stimulus intensity/duration-dependent differences.

      This is a very important point. It is difficult to pinpoint the beginning of the signal, which is why we rely on the average of responses.

      2) Whether the propagation in the authors' experimental model is centripetal? This is implied throughout the manuscript but never shown. We think establishing whether (or not) the calcium dynamics are centripetal is important because it would clarify whether spatially adjacent domains within the "arbor" need to be sequentially active before reaching the threshold and then reaching the soma. More broadly, visualizing propagation will help to better visualize summation, which is presumably how the threshold is first reached (and overcome). The alternative hypothesis of a general excitability threshold, as discussed above, would be challenged here and possibly rejected, thereby clarifying the nature of the Ca2+ process that needs to reach a threshold for further expansion to the soma and other parts of the astrocyte.

      We agree that our view is centripetal. Indeed, we have found arborization activity precedes soma activity. However, whether this is intrinsic or due to the fact that synapses are more likely to occur in the periphery requires further studies.

      3) In complement to the previous point: we understand that the spatial threshold does not per se have a location, but is there some spatial logic underlying the organization of active domains before the soma response occurs? One can easily imagine multiple scenarios of sparse heterogeneous GCaMP6f signal distributions that correspond to {greater than or equal to}22.6% of the arborization, but that would not be expected to trigger soma activation. For example, the diagram in Figure 4C showing the astrocyte response to 2Hz stim (which lacks a soma response) underscores this point. It looks like it has {greater than or equal to}22.6% activation that is sparsely localized throughout the arborization. If an alternative spatial distribution for this activity occurred, such that it localized primarily to a specific process within the arbor, would it be more likely to trigger a soma response?

      This is an interesting point and an analysis of spatial clustering on pre-soma domain activation may be useful to answer it.

      4) Does "pre-soma" activation predict the location and onset time of "post-soma" activation? For example, are arbor domains that were part of the "pre-soma" response the first to exhibit GCaMP6f signal in the "post-soma" response?

      This is another interesting analysis that can be done with a spatial clustering analysis.

      Reviewer #2 (Public Review):

      Lines et al investigated the integration of calcium signals in astrocytes of the primary somatosensory cortex. Their goal was to better characterize the mechanisms that govern the spatial characteristics of calcium signals in astrocytes. In line with previous reports in the field, they found that most events originated and stayed localized within microdomains in distal astrocyte processes, occasionally coinciding with larger events in the soma, referred to as calcium surges. As a single astrocyte communicates with hundreds of thousands of synapses simultaneously, understanding the spatial integration of calcium signals in astrocytes and the mechanisms governing the latter is of tremendous importance to deepen our understanding of signal processing in the central nervous system. The authors thus aimed to unveil the properties governing the emergence of calcium surges. The main claim of this manuscript is that there would be a spatial threshold of ~23% of microdomain activation above which a calcium surge, i.e. a calcium signal that spreads to the soma, is observed. Although the study provides data that is highly valuable for the community, the conclusions of the current version of the manuscript seem a little too assertive and general compared with what can be deduced from the data and methods used.

      The major strength of this study is the experimental approach that allowed the authors to obtain numerous and informative calcium recordings in vivo in the somatosensory cortex in mice in response to sensory stimuli as well as in situ. Notably, they developed an interesting approach to modulating the number of active domains in peripheral astrocyte processes by varying the intensity of peripheral stimulation (its amplitude, frequency, or duration).

      We thank the reviewer for their kind and thoughtful review of our study.

      The major weakness of the manuscript is the method used to analyze and quantify calcium activity, which mostly relies on the analysis of averaged data and overlooks the variability of the signals measured. As a result, the main claims from the manuscript seem to be incompletely supported by the data. The choice of the use of a custom-made semi-automatic ROI-based calcium event detection algorithm rather than established state-of-the-art software, such as the event-based calcium event detection software AQuA (DOI: 10.1038/s41593-019-0492-2), is insufficiently discussed and may bias the analysis. Some references on this matter include: Semyanov et al, Nature Rev Neuro, 2020 (DOI: 10.1038/s41583-020-0361-8); Covelo et al 2022, J Mol Neurosci (DOI: 10.1007/s12031-022-02006-w) & Wang et al, 2019, Nat Neuroscience (DOI: 10.1038/s41593-019-0492-2). Moreover, the ROIs used to quantify calcium activity are based on structural imaging of astrocytes, which may not be functionally relevant.

      Unfortunately, there is no general consensus for calcium analysis in the astrocyte or neuronal field, and many groups use custom made software made in lab or custom software such as GECIquant or AQuA. While AQuA is an event-based calcium event detection software, it may be that not including inactive domains that are SR101 positive could underestimate the spatial threshold for calcium surge. Our data is not based on the functional events but is based on calcium with structural constraints within a single astrocyte. This is crucial to properly determine the ratio of active vs inactive pixels within a single astrocyte.

      For the reasons listed above, the manuscript would probably benefit from some rephrasing of the conclusions and a discussion highlighting the advantages and limitations of the methodological approach. The question investigated by this study is of great importance in the field of neuroscience as the mechanisms dictating the spatio-temporal properties of calcium signals in astrocytes are poorly characterized, yet are essential to understand their involvement in the modulation of signal integration within neural circuits.

      We thank the reviewer for their suggestions to benefit the conclusions and discussion.

      Reviewer #3 (Public Review):

      Summary:

      The study aims to elucidate the spatial dynamics of subcellular astrocytic calcium signaling. Specifically, they elucidate how subdomain activity above a certain spatial threshold (~23% of domains being active) heralds a calcium surge that also affects the astrocytic soma. Moreover, they demonstrate that processes on average are included earlier than the soma and that IP3R2 is necessary for calcium surges to occur. Finally, they associate calcium surges with slow inward currents.

      Strengths:

      The study addresses an interesting topic that is only partially understood. The study uses multiple methods including in vivo two-photon microscopy, acute brain slices, electrophysiology, pharmacology, and knockout models. The conclusions are strengthened by the same findings in both in vivo anesthetized mice and in brain slices.

      We thank the reviewer for the positive assessment of the study and his/her comments.

      Weaknesses:

      The method that has been used to quantify astrocytic calcium signals only analyzes what seems to be a small proportion of the total astrocytic domain on the example micrographs, where a structure is visible in the SR101 channel (see for instance Reeves et al. J. Neurosci. 2011, demonstrating to what extent SR101 outlines an astrocyte). This would potentially heavily bias the results: from the example illustrations presented it is clear that the calcium increases in what is putatively the same astrocyte goes well beyond what is outlined with automatically placed small ROIs. The smallest astrocytic processes are an order of magnitude smaller than the resolution of optical imaging and would not be outlined by either SR101 or with the segmentation method judged by the ROIs presented in the figures. Completely ignoring these very large parts of the spatial domain of an astrocyte, in particular when making claims about a spatial threshold, seems inappropriate. Several recent methods published use pixel-by-pixel event-based approaches to define calcium signals. The data should have been analyzed using such a method within a complete astrocyte spatial domain in addition to the analyses presented. Also, the authors do not discuss how two-dimensional sampling of calcium signals from an astrocyte that has processes in three dimensions (see Bindocci et al, Science 2017) may affect the results: if subdomain activation is not homogeneously distributed in the three-dimensional space within the astrocyte territory, the assumptions and findings between a correlation between subdomain activation and somatic activation may be affected.

      In order to reduce noise from individual pixels, we chose to segment astrocyte arborizations into domains of several pixels. As pointed out previously, including pixels outside of the SR101-positive territory runs the risk of including a pixel that may be from a neighboring cell, and we chose to avoid this source of error. We agree that the results have limitations from being acquired in 2D instead of 3D, but it is likely to assume the 3D astrocyte is homogeneously distributed and that the 2D plane is representative of the whole astrocyte. Indeed, no dimensional effects were reported in Bindocci et al, Science 2017. We plan to include a paragraph in the discussion to address this limitation in our study.

      The experiments are performed either in anesthetized mice, or in slices. The study would have come across as much more solid and interesting if at least a small set of experiments were performed also in awake mice (for instance during spontaneous behavior), given the profound effect of anesthesia on astrocytic calcium signaling and the highly invasive nature of preparing acute brain slices. The authors mention the caveat of studying anesthetized mice but claim that the intracellular machinery should remain the same. This explanation appears a bit dismissive as the response of an astrocyte not only depends on the internal machinery of the astrocyte, but also on how the astrocyte is stimulated: for instance synaptic stimulation or sensory input likely would be dependent on brain state and concurrent neuromodulatory signaling which is absent in both experimental paradigms. The discussion would have been more balanced if these aspects were dealt with more thoroughly.

      Yes, we agree that this is a limitation, and we will acknowledge this is in the discussion.

      The study uses a heaviside step function to define a spatial 'threshold' for somata either being included or not in a calcium signal. However, Fig 4E and 5D showing how the method separates the signal provide little understanding for the reader. The most informative figure that could support the main finding of the study, namely a ~23% spatial threshold for astrocyte calcium surges reaching the soma, is Fig. 4G, showing the relationship between the percentage of arborizations active and the soma calcium signal. A similar plot should have been presented in Fig 5 as well. Looking at this distribution, though, it is not clear why ~23% would be a clear threshold to separate soma involvement, one can only speculate how the threshold for a soma event would influence this number. Even if the analyses in Fig. 4H and the fact that the same threshold appears in two experimental paradigms strengthen the case, the results would have been more convincing if several types of statistical modeling describing the continuous distribution of values presented in Fig. 4E (in addition to the heaviside step function) were presented.

      We agree with the reviewer that we should add to the paper a discussion for our justification on the use of the Heaviside step function, and plan to include this. We chose the Heaviside step function to represent the on/off situation that we observed in the data. We agree with the reviewer that Fig. 4G is informative and demonstrates that under 23% most of the soma fluorescence values are clustered at baseline. We agree that a similar graph should be included in Fig. 5 as well. We agree that a different statistical model describing the data would be more convincing and also confirmed the spatial threshold with the use of a confidence interval in the text.

      The description of methods should have been considerably more thorough throughout. For instance which temperature the acute slice experiments were performed at, and whether slices were prepared in ice-cold solution, are crucial to know as these parameters heavily influence both astrocyte morphology and signaling. Moreover, no monitoring of physiological parameters (oxygen level, CO2, arterial blood gas analyses, temperature etc) of the in vivo anesthetized mice is mentioned. These aspects are critical to control for when working with acute in vivo two-photon microscopy of mice; the physiological parameters rapidly decay within a few hours with anesthesia and following surgery.

      We will increase the thoroughness of our methods section. Especially including that body temperature and respiration were indeed monitored throughout anesthesia.

    2. Reviewer #1 (Public Review):

      Lines et al., provide evidence for a sequence of events in vivo in adult anesthetized mice that begin with a foot-shock driving activation of neural projections into layer 2/3 somatosensory cortex, which in turn triggers a rise in calcium in astrocytes within "domains" of their "arbor". The authors segment the astrocyte morphology based on SR101 signal and show that the timing of "arbor" Ca2+ activation precedes somatic activation and that somatic activation only occurs if at least {greater than or equal to}22.6% of the total segmented astrocyte "arbor" area is active. Thus, the authors frame this {greater than or equal to}22.6% activation as a spatial property (spatial threshold) with certain temporal characteristics - i.e., must occur before soma and global activation. The authors then elaborate on this spatial threshold by providing evidence for its intrinsic nature - is not set by the level of neuronal stimulus and is dependent on whether IP3R2, which drives Ca2+ release from the endoplasmic reticulum (ER) in astrocytes, is expressed. Lastly, the authors suggest a potential physiologic role for this spatial threshold by showing ex vivo how exogenous activation of layer 2/3 astrocytes by ATP application can gate glutamate gliotransmission to layer 2/3 cortical neurons - with a strong correlation between the number of active astrocyte Ca2+ domains and the slow inward current (SIC) frequency recorded from nearby neurons as a readout of glutamatergic gliotransmission. This is interesting and would potentially be of great interest to readers within and outside the glia research community, especially in how the authors have tried to systematically deconstruct some of the steps underlying signal integration and propagation in astrocytes. Many of the conclusions posited by the authors are potentially important but we think their approach needs experimental/analytical refinement and elaboration.

      The primary issue for us, and which we would encourage the authors to address, relates to the low spatial-temporal resolution of their approach. This issue does not necessarily compromise the concept of a spatial threshold, but more refined observations and analyses are likely to provide more reliable quantitative parameters and a more comprehensive view of the mode of Ca2+ signal integration in astrocytes. For this reason, and because their observations might be perceived as both a conceptual and numerical standard in the field, we believe that the authors should proceed with both experimental and analytical refinement. Notably, we have difficulty with the reported mean delays of astrocyte Ca2+ elevations upon sensory stimulation. The 11s delay for response onset in "arbor" and 13s in the soma are extremely long, and we do not think they represent a true physiologic latency for astrocyte responses to the sensory activity. Indeed, such delays appear to be slower even than those reported in the initial studies of sensory stimulation in anesthetized mice with limited spatial-temporal resolution (Wang et al. Nat Neurosci., 2006) - not to say of more recent and refined ones in awake mice (Stobart et al. Neuron, 2018) that identified even sub-second astrocyte Ca2+ responses, largely preserved in IP3R2KO mice. Thus, we are inclined to believe that the slowness of responses reported here is an indicator of experimental/analytical issues. There can be several explanations of such slowness that the authors may want to consider for improving their approach: (a) The authors apparently use low zoom imaging for acquiring signals from several astrocytes present in the FOV: do all of these astrocytes respond homogeneously in terms of delay from sensory stimulus? Perhaps some are faster responders than others and only this population is directly activated by the stimulus. Others could be slower in activation because they respond secondarily to stimuli. In this case, the authors could focus their analysis specifically on the "fast-responding population". (b) By focusing on individual astrocytes and using higher zoom, the authors could unmask more subtle Ca2+ elevations that precede those reported in the current manuscript. These signals have been reported to occur mainly in regions of the astrocyte that are GCaMP6-positive but SR101-negative and constitute a large percentage of its volume (Bindocci et al., 2017). By restricting analysis to the SR101-positive part of the astrocyte, the authors might miss the fastest components of the astrocyte Ca2+ response likely representing the primary signals triggered by synaptic activity. It would be important if they could identify such signals in their records, and establish if none/few/many of them propagate to the SR-101-positive part of the astrocyte. In other words, if there is only a single spatial threshold, the one the authors reported, or two or more of them along the path of signal propagation towards the cell soma that leads eventually to the transformation of the signal into a global astrocyte Ca2+ surge. In this context, there is another concept that we encourage the authors to better clarify: whether the spatial threshold that they describe is constituted by the enlargement of a continuous wavefront of Ca2+ elevation, e.g. in a single process, that eventually reaches 22.6% of the segmented astrocyte, or can it also be constituted by several distinct Ca2+ elevations occurring in separate domains of the arbor, but overall totaling 22.6% of the segmented surface? Mechanistically, the latter would suggest the presence of a general excitability threshold of the astrocyte, whereas the former would identify a driving force threshold for the centripetal wavefront. In light of the above points, we think the authors should use caution in presenting and interpreting the experiments in which they use SIC as a readout. Their results might lead some readers to bluntly interpret the 22.6% spatial threshold as the threshold required for the astrocyte to evoke gliotransmitter release. Indeed, SIC are robust signals recorded somatically from a single neuron and likely integrate activation of many synapses all belonging to that neuron. On the other hand, an astrocyte impinges in a myriad of synapses belonging to several distinct neurons. In our opinion, it is quite possible that more local gliotransmission occurs at lower Ca2+ signal thresholds (see above) that may not be efficiently detected by using SIC as a readout; a more sensitive approach, such as the use of a gliotransmitter sensor expressed all along the astrocyte plasma-membrane could be tested to this aim.

      Additional considerations are that the authors propose an event sequence as follows: stimulus - synaptic drive to L2/3 - arbor activation - spatial threshold - soma activation - post soma activation - gliotransmission. This seems reminiscent of the sequence underlying neuronal spike propagation - from dendrite to soma to axon, and the resulting vesicular release. However, there is no consensus within the glial field about an analogous framework for astrocytes. Thus, "arbor activation", "soma activation", and "post soma activation" are not established `terms-of-art´. Similarly, the way the authors use the term "domain" contrasts with how others have (Agarwal et al., 2017; Shigetomi et al., 2013; Di Castro et al., 2011; Grosche et al., 1999) and may produce some confusion. The authors could adopt a more flexible nomenclature or clarify that their terms do not have a defined structural-functional basis, being just constructs that they justifiably adapted to deal with the spatial complexity of astrocytes in line with their past studies (Lines et al., 2020; Lines et al., 2021).

      Our previous points suggest that the paper would be significantly strengthened by new experimental observations focusing on single astrocytes and using acquisitions at higher spatial and temporal resolution. If the authors will not pursue this option, we encourage them to at least improve their analysis, and at the same time recognize in the text some limitations of their experimental approach as discussed above. We indicate here several levels of possible analytical refinement.

      The first relates to the selection of astrocytes being analyzed, and the need to focus on a much narrower subpopulation than (for example) 987 astrocytes used for the core data. This selection would take into greater consideration the aspects of structure and latency. With the structural and latency-based criteria for selection, the number of astrocytes to analyze might be reduced by 10-fold or more, making our second analytical recommendation much more feasible.

      For structure-based selection - Genetically-encoded Ca2+ indicators such as GCaMP6 are in principle expressed throughout an astrocyte, even in regions that are not labelled by SR101. Moreover, astrocytes form independent 3D territories, so one can safely assume that the GCaMP6 signal within an astrocyte volume belongs to that specific astrocyte (this is particularly evident if the neighboring astrocytes are GCaMP6-negative). Therefore, authors could extend their analysis of Ca2+ signals in individual astrocytes to the regions that are SR101-negative and try to better integrate fast signals in their spatial threshold concept. Even if they decided to be conservative on their methods, and stick to the astrocyte segmentation based on the SR-101 signal, they should acknowledge that SR101 dye staining quality can vary considerably between individual astrocytes within a FOV - some astrocytes will have much greater structural visibility in the distal processes than others. This means that some astrocytes may have segmented domains extending more distally than others and we think that authors should privilege such astrocytes for analysis. However, cases like the representative astrocytes shown in Figure 4A or Figure S1B, have segmented domains localized only to proximal processes near the soma. Accordingly, given the reported timing differences between "arbor" and "soma" activation, one might expect there to be comparable timing differences between domains that are distal vs proximal to the soma as well. Fast signals in peripheral regions of astrocytes in contact with synapses are largely IP3R2-independent (Stobart et al., 2018). However, the quality of SR101 staining has implications for interpreting the IP3R2 KO data. There is evidence IP3R2 KO may preferentially impact activity near the soma (Srinivasan et al., 2015). Thus, astrocytes with insufficient staining - visible only in the soma and proximal domains - might show a biased effect for IP3R2 KO. While not necessarily disrupting the core conclusions made by the authors based on their analysis of SR101-segmented astrocytes, we think results would be strengthened if astrocytes with sufficient SR101 staining - i.e. more consistent with previous reports of L2/3 astrocyte area (Lanjakornsiripan et al., 2018) - were only included. This could be achieved by using max or cumulative projections of individual astrocytes in combination with SR101 staining to construct more holistic structural maps (Bindocci et al., 2017).

      For latency-based selection - The authors record calcium activity within a FOV containing at least 20+ astrocytes over a period of 60s, during which a 2Hz hindpaw stimulation at 2mA is applied for 20s. As discussed above, presumably some astrocytes in a FOV are the first to respond to the stimulus series, while others likely respond with longer latency to the stimulus. For the shorter-latency responders <3s, it is easier to attribute their calcium increases as "following the sensory information" projecting to L2/3. In other cases, when "arbor" responses occur at 10s or later, only after 20 stimulus events (at 2Hz), it is likely they are being activated by a more complex and recurrent circuit containing several rounds of neuron-glia crosstalk etc., which would be mechanistically distinct from astrocytes responding earlier. We suggest that authors focus more on the shorter latency response astrocytes, as they are more likely to have activity corresponding to the stimulus itself.

      The second level of analysis refinement we suggest relates specifically to the issue of propagation and timing for the activity within "arbor", "soma" and "post-soma". Currently, the authors use an ROI-based approach that segments the "arbor" into domains. We suggest that this approach could be supplemented by a more robust temporal analysis. This could for example involve starting with temporal maps that take pixels above a certain amplitude and plot their timing relative to the stimulus-onset, or (better) the first active pixel of the astrocyte. This type of approach has become increasingly used (Bindocci et al., 2017; Wang et al., 2019; Ruprecht et al., 2022) and we think its use can greatly help clarify both the proposed sequence and better characterize the spatial threshold. We think this analysis should specifically address several important points:

      1. Where/when does the astrocyte activation begin? Understanding the beginning is very important, particularly because another potential spatial threshold - preceding the one the authors describe in the paper - could gate the initial activation of more distal processes, as discussed above. This sequentially earlier spatial threshold could (for example) rely on microdomain interaction with synaptic elements and (in contrast) be IP3R2 independent (Srinivasan et al., 2015, Stobart et al., 2018). We would be interested to know whether, in a subset of astrocytes that meet the structure and latency criteria proposed above and can produce global activation, there is an initial local GCaMP6f response of a minimal size that must occur before propagation towards the soma begins. The data associated with varying stimulus parameters could potentially be useful here and reveal stimulus intensity/duration-dependent differences.

      2. Whether the propagation in the authors' experimental model is centripetal? This is implied throughout the manuscript but never shown. We think establishing whether (or not) the calcium dynamics are centripetal is important because it would clarify whether spatially adjacent domains within the "arbor" need to be sequentially active before reaching the threshold and then reaching the soma. More broadly, visualizing propagation will help to better visualize summation, which is presumably how the threshold is first reached (and overcome). The alternative hypothesis of a general excitability threshold, as discussed above, would be challenged here and possibly rejected, thereby clarifying the nature of the Ca2+ process that needs to reach a threshold for further expansion to the soma and other parts of the astrocyte.

      3. In complement to the previous point: we understand that the spatial threshold does not per se have a location, but is there some spatial logic underlying the organization of active domains before the soma response occurs? One can easily imagine multiple scenarios of sparse heterogeneous GCaMP6f signal distributions that correspond to {greater than or equal to}22.6% of the arborization, but that would not be expected to trigger soma activation. For example, the diagram in Figure 4C showing the astrocyte response to 2Hz stim (which lacks a soma response) underscores this point. It looks like it has {greater than or equal to}22.6% activation that is sparsely localized throughout the arborization. If an alternative spatial distribution for this activity occurred, such that it localized primarily to a specific process within the arbor, would it be more likely to trigger a soma response?

      4. Does "pre-soma" activation predict the location and onset time of "post-soma" activation? For example, are arbor domains that were part of the "pre-soma" response the first to exhibit GCaMP6f signal in the "post-soma" response?

    1. "They wake war's semblance" and practise military exercises

      This is one of those things that makes me feel really connected to people of the past. We are more similar than we are different. It's funny to know that children in twelfth century London were playing dress up and pretending to be knights when I did the same thing with other children in elementary school. The text says that the older boys had real weapons while the younger ones had altered, less-dangerous ones. It reminds me of kids pretending large sticks were swords. The more things change the more they stay the same. Some things do change for the better though, like the end of deadly "gladiatorial combat and wild animal hunts" (Milliman 588). When I was young, a lot of kids would pretend to be knights, soldiers, cops, cowboys, pirates, you name it...so it's kind of funny to think about kids pretending to be knights in front of actual real life knights. Of course their games and costume were probably a lost more accurate to real knights than kids of the 21st century. I'm sure people back in the twelfth century had a problem with kids playing "violently" just as people do nowadays. How much have we heard about video games making kids violent, or that Nerf shouldn't make guns, and so on and so forth. Regardless if you agree or disagree with these sentiments, it's clear this train of thought is not new. I also like how the younger boys had spears with no tips. Even though one day they may have grown up to be real knights or gone off to fight in a war, their parents still made sure to keep them safe as they possibly could which I find adorable. Nowadays parents put a helmet or knee pads on their young athletes. I hate when people spout the rhetoric that no one loved their kids back then, because they often died of disease so they had a bunch just in case. This idea couldn't be further from the truth. People back then were so much like people today.

    1. One famous example of reducing friction was the invention of infinite scroll. When trying to view results from a search, or look through social media posts, you could only view a few at a time, and to see more you had to press a button to see the next “page” of results. This is how both Google search and Amazon search work at the time this is written. In 2006, Aza Raskin invented infinite scroll, where you can scroll to the bottom of the current results, and new results will get automatically filled in below. Most social media sites now use this, so you can then scroll forever and never hit an obstacle or friction as you endlessly look at social media posts. Aza Raskin regrets what infinite scroll has done to make it harder for users to break away from looking at social media sites.

      Aza Raskin introduction of the infinite scroll in 2006, completely reshaped and changed how we navigate the internet for content. With the infinite scroll. You can finally scroll down smoothly and fresh content will load immediately, saving you the trouble of clicking to turn to the next page. Making it easier and more accessible for more people to locate content online, wherever it may be. Although it provides a seamless experience, its extensive usage in social media has come under fire for making it more difficult for users to leave these platforms. While constant scrolling can lead to prolonged usage of online platforms, I also think that you have the freedom to put down your phone. making it less dangerous than it would seem.

    1. Author Response

      Reviewer #1 (Pulic Review):

      The authors aimed to understand whether the superficial, retinorecipient layers of the mouse superior colliculus (sSC) participate in figure-ground segregation and object recognition. To address this question, they use a combination of optogenetic perturbations of sSC and recordings. These data are consistent with SC being causally involved in object recognition. This would be useful information for the field and likely to be cited.

      Thank you for your positive evaluation.

      However, I have several concerns regarding their conclusions.

      A significant limitation of this study is methodological. The major novelty is the effect of optogenetic silencing, because the recordings are largely correlative, but the optogenetic silencing approach lacks appropriate controls for the effects of the optogenetic excitation light. The authors acknowledge that the optogenetic light is a potential confound, but attempt to address this by shielding the fiber to eliminate light leak and strobing a blue led in the arena. The former does not account for the effects of excitation light scattering intracerebrally--during optogenetic experiments, intracerebral scattering causes the eyes to light up--and for the latter, there is no way to compare the intensity or qualia of the externally strobed LED and the intracerebral light. The proper control would be a cohort of mice lacking channelrhodopsin expression in sSC. Regardless, it is essential to acknowledge this potential confound.

      This is a good point. We have added discussion of this in lines 90-95. The proposed experiment was done in Kirchberger et al. (Sci Adv 2021, Suppl Figure 3). In mice without expression of channelrhodopsin trained on the same task as in our study, blue laser light in the cortex did not affect accuracy. Although the exact location of these fibers is different from ours, the distance from the fiber to the eye is very similar. Furthermore, in answer to this comment, we have done a new set of experiments with 4 wild type mice, in which we recorded neural activity in the sSC while delivering optogenetic light stimulation. The procedure was similar to our previous experimental animals except that they did not receive a virus injection. In these mice, we did not see any response in the superior colliculus to the laser light, but we noticed a 5% reduction in response to the visual stimuli (new Figure 1—figure supplement 3). This small reduction could be a small reduction of contrast of the visual stimulus due to the laser light hitting the retina, but given that we did not see any response to the laser alone, it is more likely to come from the known inhibiting effects of light on neural activity (e.g. through heat, see Owen et al. Nat Neurosci 2019). Because our aim was to silence sSC, this particular effect is not a strong confound for our study.

      Relatedly, as the authors note, there are GABAergic projection neurons in sSC that may be driving these effects via gain of function. This is a significant concern that has limited the widespread adoption of this approach in sSC despite its popularity in studies in cortex. Indeed, one recently published study of behavioral functions of deep SC found that activating inhibitory neurons actually caused paradoxical behavioral effects consistent with gain of function in the targeted hemisphere, due to the effects of long-range inhibitory projections on the other SC hemisphere. Given the presence of inhibitory projections in sSC, it would be preferable to use an orthogonal method for silencing and at least to thoroughly acknowledge these concerns and cite these recent studies.

      This is a valid point. When we started our study, we had some experience with inhibitory opsin (archaerhodopsin and halorhodopsin) and were not confident that we could widely inhibit the sSC reversibly, repeatedly and consistently for an extended period. Other labs have now shown this is feasible with improved inhibitory opsins, so this would now be our preferred option too. The method of silencing sSC by inhibition of GABAergic neurons, however, is still the most common optogenetic method to silence sSC for an extended period (e.g. Hu et al. Neuron 2019, Brenner et al. Neuron 2023) .

      We thank the reviewer pointing us to recently published paradoxical behavioral effects. These effects, that we found in Essig et al. (Comm. Biol. 2021) are very interesting, but are not really a concern for the interpretation of our results, partially because as the reviewer pointed out, the GABAergic neurons activated there were in the deep and intermediate layers of the SC, below the sSC that we targeted. The paradoxical effects in that manuscript were attributed to direct inhibition of the contralateral superior colliculus. In our case, we activated the inhibitory neurons bilaterally, and this interhemispheric GABAergic connectivity, if it extends to sSC, only strengthened the bilateral silencing of the sSC. However, we have now discussed the possibility of our transfection of these deeper GABAergic neurons (lines 272-278). The more general point that activating GABAergic neurons in the sSC may also cause inhibition in other structures is indeed a concern. GABAergic neurons in the sSC project to the PBG and the LGN (in particular the vLGN) (Gale & Murphy, 2014; Whyland et al., 2019; Li et al., 2023). Although the primary effect of our manipulation is silencing of the superior colliculus, including the GABAergic neurons (see our answer further below), we cannot exclude the possibility that activating these extracollicular GABAergic projections has an effect. We have edited our discussion of this and updated the references (lines 268-272). However, our measurements in anesthetized (previous submission) and in awake mice (new Figure 1—figure supplement 2) show that apart from a short period directly after the onset of the laser, also almost all putative GABAergic neurons are reduced in their response (see also our answer to the next comment).

      A minor point is that although activation of GABAergic neurons in sSC is expected to cause inhibition of neighboring neurons, I would expect channelrhodopsin-expressing GABAergic cells to show an increase in firing during optogenetic excitation. However, it seems that none of the cells plotted (assuming each point in Supplementary Fig 4D is a cell, which the legend does not specify) had such an increase. Do these extracellular recordings not detect inhibitory neurons well?

      This is indeed an intriguing observation. The data in the original figure (Supp Fig 1D) was spiking data from 15 recording sites and not from sorted units. This was mentioned in panel C, but not in the caption. For the purpose of the amount of silencing, there was no need to sort single units. Still, it is surprising to see the reduction on almost all channels. The data of Supp Fig 1D came from experiments in anesthetized mice. Prompted by a question from another reviewer, we have now redone these experiments in head-fixed awake mice. The new Figure 1—figure supplement 2 shows these results, for single- and multi-unit clusters. In response to a short laser pulse (50 ms), we find that many units significantly increase their firing rate (Figure 1—figure supplement 2A-B). However, almost all activated then reduce there firing rate and again, we see an overall reduction of responses to visual stimuli. Only one unit fires significantly more when the laser is on during the period of visual stimulation compared to when the laser is off, and the overall firing rate is strongly reduced (Figure 1—figure supplement 2C-E). It appears that optogenetically activating the inhibitory neurons in the sSC for a longer period also reduces the activity of these neurons. The effect that we are seeing might be similar to the paradoxical effects that may occur in visual cortex, where additional excitation of inhibitory neurons leads also leads to their reduced activity due to network dynamics (see e.g. Sadeh & Clopath, Nat Neurosci Rev 2021). However, the effect may also be due to a few inhibitory neurons having a strong inhibitory effect on other inhibitory neurons. This is an interesting point worthy of more investigation, but it falls out to scope of this manuscript.

      Finally, the relationship between these stimuli and objects is not entirely clear. The authors acknowledge this but it would be worthwhile to devote more attention to this point. In effect, as the authors note, the gray screen and sinuisoidal grating do not have any sharp edges on the screen, whereas each of the behaviorally relevant stimuli will create a sharp, step-like edge on the screen. Whether edge detection is truly object detection or simply a variant of more general visual detection is unclear.

      Indeed, the task can be solved by detection of texture edges, and it is not necessary to integrate the edge components into an object to successfully perform the task. A linear decoder fed with simple cell-like inputs is able to do the orientation task (Luongo et al., 2023). The same network failed to learn the phase task, but also the image of a phase-defined figure contains features that are not present in the background image, and could be solved by learning only local features. Even the texture-defined figures used in Kirchberger et al. (2021) and in earlier monkey studies (Lamme, 1995) which do not contain any sharp stimulus edges can be detected without integrating the local edges into objects and segregation the figure from the background. Several monkey studies show that late neuronal responses in V1 are enhanced for neurons with receptive fields on what we, humans, perceive as the figure. This effect has also been seen in mouse V1, even in the case where there are no local features distinguishing the figure from the background (Fig 7. in Kirchberger et al. 2021). Interfering with activity in V1 in this late phase reduces the ability to detect the figure in human (by TMS) and mouse (by optogenetics). This is suggestive that this figure-ground modulation is used in solving the task, but not a proof. To understand if mice solve the tasks by detecting a figure or by detecting specific features, we can look at generalization. Mice were previously shown to generalize to some degree for size, position and spatial phase of the figure grating patch (Schnabel et al., 2018), suggesting that the mice did not train to detect specific features at specific locations. Rats trained on a similar task had difficulty generalizing from a luminance-defined object to an orientation-defined object (De Keyser et al., 2015), as do mice (Khastkhodaei et al., 2016), but once the rats were acquainted with one set of oriented figures, they immediately generalized to other texture-orientations above chance. On a slightly different figure-detection task mice also showed generalization for different orientations once the initial task was learned (Luongo et al. 2023). This suggests that at least some generalization to object detection occurs in this task. We have added these observation to the discussion (line 301-305).

      Reviewer #2 (Public Review):

      The goal of this study is to show that the superficial superior colliculus (sSC) of mouse signals figure-ground differences defined by contrast, orientation, and phase, and that these signals are necessary for the animal to detect such figure-ground differences. By inhibiting sSC while the animals perform a figure-ground detection task, the study shows that detection performance decreases when sSC activity is suppressed during the onset of the visual stimulus. The study then intends to show that sSC neurons exhibit surround suppression based on orientation differences, and that surround suppression is stronger when the animal detects the correct location of the figure on the background.

      The major strength of this study is the use of a behavioural paradigm to test detection performance of figure-ground stimuli while manipulating neural activity in the sSC during different times after stimulus onset. This paradigm would show whether activity in the sSC is relevant for performing the task. Secondly, the study collected data to confirm previous findings: sSC neurons exhibit orientation specific surround suppression. Additionally, it is impressive that the authors were able to train mice to generalize their task performance across different stimulus categories (figure-ground differences in orientation and phase). This should be highlighted as it may inform future studies.

      Thank you for your positive evaluation. We have extended our discussion on the generalization in object detection tasks in mice.

      The study has, however, methodological and analytical weaknesses so that the stated conclusions are not supported by the presented results.

      1) Optogenetic inhibition is not limited to sSC (even expression may not be limited) About 30% of inhibitory neurons in the sSC project to other areas, e.g. ventral LGN, parabigeminal nucleus and pretectum (Whyland et al, 2019, see ref in manuscript). This means that these areas receive direct inhibition when inhibitory sSC neurons are optogenetically stimulated. This fact is mentioned in the discussion but the consequences and implications for the results are ignored. This is a major flaw of the optogenetic experiments of this study. Additionally, no evidence is given that opsin expression was limited to the superficial layers (except for one histological slice), which the authors acknowledge in line 285. Deeper layers may have other inhibitory neurons with long-range projections.

      The finding that sSC neurons show no figure-ground modulation for phase while the optogenetic manipulation has behavioural effects may be an indication for other areas being affected by the optogenetic manipulation.

      This is a valid point, also raised by reviewer 1. Although the primary effect of activating the GABAergic neurons in the sSC is a strong reduction of activity in the sSC (see also new figure S1), we cannot rule out that we also activate GABAergic neurons below the sSC and that there are some effects of activating GABAergic connections to the LGN and PBG. We have extended our discussion of this point in lines 269-277. However, as shown in new Figure 1—figure supplement 2, the effect of optogenetically activating Gad2-positive neurons appears to lead to a counter-intuitive reduction of their activity. This effect has previously been observed in cortex.

      2) Could other behavioural variables explain the results?

      a) Are there any task events other than the visual stimuli that the mice could use to make their decisions? The authors state the use of a custom made lick spout but it is not clear how this spout works, i.e. how do mechanics of the spout deliver water to the right versus the left output and could the mouse perceive these mechanics?

      We believe there were no task events besides the visual stimuli that the mice could use to make their decisions. The lick spout was Y-shaped (see Figure 1B) to facilitate the two-alternative forced choice task. Each side of the lick spout was connected to a separate water tube. The water flow in each tube was controlled using a valve. Also, each side of the lick spout was connected to its own lick detector wire. The two valves and the two detector wires were connected to an Arduino which was controlled by our MATLAB task script. The task script was coded such that, when the lick of the mouse had been on the correct side, the valve controlling the water flow on the correct side would briefly open to deliver the water reward. To summarize, the water would only flow after the mouse had licked and if the first lick had been on the correct side. Hence, the water reward did not produce additional cues. We have edited the description of the lick spout in the Methods section to make the functioning of the lick spout more clear (lines 511-513).

      b) Could the different neural responses to figure versus ground shown in Fig 2I-J and Fig 3B be explained by behaviours varying between the trial types, e.g. by early lick movements (which are conceivable even if the spout is not present), eye movements or changes in pupil-linked arousal? A behavioural difference seems even more likely to occur between hit and error/miss trials (Fig 4). If these behaviours were not measured, the possibility of behavioural modulation should be discussed.

      In the awake behaving electrophysiology experiments, the lick spout was not present until 500 ms after stimulus onset, so the mouse could not lick the spout. We did not record whisking or other face and jaw movements, hence we cannot say for sure whether the mice performed early ‘licks’ in the absence of the lick spout. We did, however, add a supplementary figure showing the licking behavior of the mice in the optogenetic interference experiments (see Figure 1—figure supplement 5). In this experiment, the lick spout was present at all times so all early licks would be recorded. Any licks before 200 ms after stimulus onset were disregarded as this would be too early for the decision to include knowledge about the stimulus. Figure 1—figure supplement 5B shows that the mice indeed only performed very few early licks as they probably knew this would not yield reward. The mice that performed the awake electrophysiology experiments were trained on the same task as these mice before introducing the lick spout delay of 500 ms. So although we cannot rule out early licks during electrophysiology, we think early licks would be an unlikely explanation for the neural response differences.

      We have added a new supplementary figure (Figure 2—figure supplement 2) showing data for eye movements and pupil dilation during the tasks. We had excluded all trials where the mice performed eye movements between 0-450 ms after stimulus onset, and indeed we saw no eye movements during the peak of the visual response (0-250 ms). Furthermore, the pupil dilation of the mice also did not change in this period.

      All in all, we view it as unlikely that the differences in neural activity in sSc were caused by either licking, eye movements or pupil-linked arousal.

      3) What is the behavioural strategy of the animals? Only licks beyond 200 ms after stimulus onset determine the choice of the animal because "mice made early random licks" from 0 to 200 ms. To better understand the behavioural strategies of the animals we need to see their behavioural data, i.e. left and right licks aligned to stimulus onset. It would be particularly interesting to see how number and latency of licks changes during optogenetic manipulation.

      Based on these suggestions, we investigated the licking behavior of the mice during the optogenetic experiments in more detail. Our new Figure 1—figure supplement 5 taught us several things:

      1) The fully trained mice hardly perform any early licks; they seem to understand that early licks cannot yield reward.

      2) The mice typically only lick one side of the lick spout during one trial. In correct trials the fluid reward is given directly after a correct lick, which causes the mouse to lick the correct side of the spout even more. However, even if the first lick is incorrect (bottom rows), the mouse generally does not lick the other (correct) side afterward. They seem to know that correct licks after an incorrect lick do not yield reward.

      3) The maximum licking rates were not significantly affected by laser onset.

      4) The latency of the first lick (reaction time) was not significantly affected by laser onset. (Please also see our response to question 2b).

      4) Data relating to misses should be included in analyses to provide a complete picture of behaviour and neural responses

      a) In the optogenetic manipulations, an increase in misses seems to dominate the decreased accuracy (please, explain when a response was counted as a miss). A separate analysis of miss trials may be more robust than of error trials and also offers a different interpretation of the data, namely that the mouse did not see the stimulus rather than perceiving the figure on the opposite side. However, if the mice reduced their lick rate in general during optogenetic stimulation, this begs the question whether their motor performance was affected by optogenetic manipulation. Can this possibility be excluded?

      Trials were counted as follows: A trial was counted as a hit when the first lick after 200 ms after stimulus onset was on the correct side. A trial was counted as an error, when the first lick after 200 ms after stimulus onset was on the incorrect side. A trial was counted as a miss, when the mouse did not lick in the window between 200 and 2000 ms after stimulus onset. We have clarified this in the methods section (line 517-526).

      Our previous text may not have been sufficiently clear but the decrease in accuracy during optogenetic trials is not dominated by an increase in missed trials. As we have now indicated explicitly in its caption, in figure 1, missed trials are excluded from the analysis. Hence, the significant effects shown in figure 1 are not driven by an increase in missed trials but rather by an increase in erroneous licks. When comparing figure 1 vs figure S3, where the missed trials are added to the analysis as if they were error trials, we can see an overall downward shift of the performances. Indeed, mice miss more trials when the laser is on. The increase in number of missed trials is lower than the increase in number of wrong choices. Furthermore, the range between the performances at early laser onset and late laser onset is still very similar. This indicates that the mice on average do not have higher miss rates when laser onset is early.

      Finally, nor maximum licking rate, nor the reaction time is affected by the laser onset (see the new figure S2)

      Related to Fig 4, it would be equally interesting to see how FGM changes during misses. Do the changes support the observations for error trials?

      We are not convinced that the neural data from missed trials can be interpreted in a simple way. Mice may have various reasons to miss a trial: they may be tired or not paying attention, they may not have seen the stimulus well, they may not feel thirsty enough, they might be distracted by some sensory input that humans might not be aware of, etc. This is why we specifically opted to not use a go-no/go task but instead opted to use a 2-alternative forced choice task.

      5) Statistical tests do not support the conclusions, are missing or inadequate

      a) In Fig 1E, accuracy is significantly affected at only 1-2 time points in each task, specifically either the 1st and 3rd or the 2nd time point. How do the authors interpret these results? If inhibition starting at the 2nd time point has no significant effects, why would it be significant when inhibition starts later (at the 3rd time)? Furthermore, given that all other starting points of laser stimulation have no significant effects, there is no reason to trust the latency of inhibition effects based on mostly insignificant data points. This analysis in its current form should be removed, including a comparison of latencies between tasks, which was not tested for significance. It may be more meaningful to analyse accuracy for each animal separately. This may reduce variability.

      We can understand that the reviewer may have concerns regarding the post-hoc analysis of Fig 1E, but we feel these concerns stem from a misinterpretation of our goal with this analysis. In Figure 1E, we use a 1-way repeated-measures ANOVA. By using this test, we ask whether the performance of the animals is affected by the laser onset. More specifically “does the performance increase or decrease with increasing laser onset?” The test is significant, so indeed the performance goes up as laser onset goes up. This indicates that the performance of the mice is affected by the inhibition of sSC. For the sake of completeness we had included the post-hoc tests for each latency in the statistics table. Indeed, some individual latencies are not significantly different to the no-laser condition. However, this does not invalidate the conclusion of the main test: a repeated measures ANOVA can only be performed on data with 3 or more groups, so the conclusion of the repeated measures ANOVA could not have been drawn from simply those laser onset(s) that is/are significantly different from the no-laser condition. The main effect of higher performance with higher latencies is significant, even if some individual comparisons are non-significant. The difference in significance of the post-hoc tests does not indicate a significant difference between the groups, but insufficient power to do six individual tests.

      We have changed the wording in the reporting of the statistics of Figure 1E to hopefully more precisely indicate the conclusions we drew from the statistics. We do not draw conclusions from the post hoc tests. We have considered removing them from the statistics table 1, but believe that some readers might be interested. We can remove them if the reviewer believes that would be better.

      b) Analyses regarding the difference in neural response to figure and ground (Fig 2I-J, Fig 3B, Fig 4B, Fig 5C) would be more convincing and informative if the differences were analysed on the level of single neurons in response to the same orientation within their RF (or at the location where the figure is presented, for edge-RF neurons). A histogram of these differences would show how many neurons are affected and how large the effect is in single neurons.

      We fully appreciate this idea, but the way we set up the behavioural task does not quite allow for this type of statistical analysis. This is because we tested all three of the tasks during single sessions (contrast/orientation/phase), and on top of that, we varied the orientations of the stimuli (0/90deg), as well as the phase of the gratings (60 different phases). This all was done with the idea that it would prevent the mice from memorizing the individual stimuli of the task. This also had the effect that only very few trials per session contained the exact same stimulus type, figure-ground condition, orientation and phase. For example, if a mouse would perform around 120 trials in a session. 25% of those were contrast-stimulus-trials, 37.5% of those were orientation-stimulus-trials and 37,5% were phase trials. If we look into 120*0.375 = 45 orientation-stimulus-trials, half of those were figure trials, half were ground trials: 22 trials each. If we split these trials up by their individual orientations, we are left with only about 11 trials per condition to analyse for figure-ground effects, each of which would probably have a different grating phase. Given the firing rate variations that the individual neurons show in awake mice, this amount of trials would not provide enough statistical power to test the significance of modulation in single neurons.

      Although we feel the study design would not allow analysis of individual neurons in response to the same orientation within their RF, we did perform an aggregated analysis on orientation selectivity. For this analysis, we included all the trials where the RF of the recorded neurons was on the background-half of the screen. We then computed the responses of each neuron to the trials where the background orientation was 0 and 90, respectively. This analysis showed that most neurons had no preference for either of the two tested orientations of the other. Only 4 out of 64 (6%) neurons showed a significant preference. We therefore believe that splitting the data by orientation preference would not be very informative.

      c) All statistical tests performed across neurons should account for dependencies due to simultaneous recordings (dependency on session) and due to recordings in the same animal (dependency on animal). This can be done in most cases by using linear mixed-effects models.

      We agree with the reviewer and have changed the analysis for figure 2I, 3B and 3E to an LME analysis (see also Table 1).

      d) There was no significant difference between model weights (Fig 3D), so the statement in line 210 (RF-edge neurons had higher weights) should be removed.

      In answer to previous we question changed the analysis for what is now Figure 3E to an LME. This shows that relative weights were significantly higher for the orientation compared to the phase task. We have adapted our conclusion accordingly (line 214-218).

      e) Fig 4B compares FGM during correct and error trials. This comparison has to be performed with the same set of neurons in correct and error trials (not the case for orientation). Again, the most compelling and informative comparison would be on the level of single neurons: response difference between figure and ground (same visual features at figure position) during hits versus errors.

      As described above, we feel the study design does not allow analysis on the level of individual neurons. The analysis in 4B was actually performed using the same set of neurons, we have removed the typo.

      f) There is no evidence that FGM for phase was different between hit and error trials as stated in line 234.

      Indeed, we had phrased this incorrectly. Since we recorded all task during single recording sessions, we have data for each task for most neurons. We were therefore able to pool the results from the different tasks, and the main d-prime difference between hit vs. error was significant. Post-hoc tests showed that this is mainly driven by the difference in the orientation task. We have edited the wording to be more accurate (line 239-242).

      g) It is not clear why and how the mixed linear effects model was used pooling data across tasks (Fig 4C and Fig 5D). Different neurons were recorded for each task, so the sample points (neurons) are not affected by both task effects (orientation and phase). Each task should be analysed separately.

      Since we recorded all three task versions during single behavioral sessions, we have data for multiple tasks from each neuron. This is why the linear mixed effects model pools the data across the tasks. We have added a note in the main text for clarity (line 238-242)

      h) Bonferroni correction in Fig 1E should correct multiple comparisons across time points, not across tasks (see Table 1).

      The multiple time points all belong to the same one-way repeated measures ANOVA, so there’s no need to correct the post-hoc analysis. We did run the ANOVA for three tasks, which is why we corrected the p-values of each task. We think that this is best way, but can also present uncorrected p-values if needed.

      i) What is the reason to perform some tests one-tailed, others two-tailed?

      Following the reviewer comments, we changed some analyses to LME models. The remaining tests that require definition of the tails are all two-tailed.

      6) The results relating to "multisensory neurons" are ambiguous regarding their interpretation (if significant at all) and seem unrelated to the goal of the study. It is particularly likely that behaviours like licking or other movements cause the response differences between figure and ground.

      We agree with the reviewer that finding these neurons was not the aim of the study. We did not include enough type of tests in our paradigm to fully determine the properties of these neurons. Furthermore, we note that we have recorded too few of these neurons to draw strong conclusions. The data shown in new Figure 2—figure supplement 1H suggest that the responses of these neurons or not as strongly time-locked to the first lick as they are to the trial onset. We presented the behavior of these neurons in our manuscript, because, whatever their exact behavior, they are clearly distinct from the visually responsive cells that show a short latency response to the visual stimulus (Figure 2—figure supplement 1). We still feel that it is useful for the reader to know there are cells in the sSC that show such a distinct behavior, but we have moved the figure and the accompanying text to a figure supplement to avoid distraction from the main message of the manuscript.

      7) What depth were neurons recorded from (Fig 3 and 4)?

      The depths of the recorded visually responsive neurons is now shown in Figure 2—figure supplement 1E.

      Reviewer #3 (Public Review):

      The authors used optogenetic manipulations and electrophysiology recordings to study a causal role and the coding of superficial part of the mouse Superior Colliculus (SCs) during figure detection tasks.

      Authors previously reported that figure-ground perception relies on V1 activity (Kirchberger et al. 2021) and pointed out that silencing of V1 reduced the accuracy of the mice but still the performance was above the chance level. Therefore, visual information necessary in this task, could be processed via alternative pathways. In this study, authors investigated specifically SCs and used similar approach and analysis as in Kirchberger et al. 2021. Optogenetic silencing of the activity of visual neurons in SCs impaired the accuracy in all 3 versions of the figure detection task: contrast, orientation, and phase. Electrophysiology recordings revealed that SCs neurons are figure-ground modulated, but only by contrast- and orientation-based figures. They show SCs visually responsive neurons reflect behavioral performance in orientation-based figure task. The authors conclusion is that SCs is involved in figure detection task.

      Overall, this study provides evidence that mouse SCs is involved in a figure detection task, and codes for task-related events. Authors heroically compared results between 3 different versions of the figure-based detection task. The logic of the study flows through the manuscript and authors prepared a detailed description of methods.

      Thank you for your positive comments.

      However, my main concern is with 1) the amount of data used to make the key arguments, and 2) the interpretation of results. The key findings of this study (figure-ground modulations in SCs) could be a result of the visual cortical feedback in SCs during the task, or pupil diameter changes. Unfortunately, the authors did not rule out these possibilities.

      Still, this study can be relevant to a general neuroscience audience, and results could be more convincing if the authors could clarify:

      1) Optogenetic inactivation

      a) The impact of laser stimulation on neural activity is not satisfactory (Supplementary Figure 1). The method seems to be insufficient to fully salience neurons. Electrophysiology control recordings of inactivation are performed in anesthetized mice, which is not a fair estimation of the effect in awake state. Therefore, it rises a major question how effective the inactivation is during the task?

      We have conducted new control experiments for the impact of laser stimulation on neural activity, now in awake animals (see Figure 1—figure supplement 2). The reviewer was right to ask for these experiments. We had not expected much difference in the effect of silencing in the awake and anesthetized state. To minimize the animal discomfort, we had therefore done these control experiments in terminal experiments under anesthesia. However, these new set of experiments showed that the impact of laser stimulation was much stronger in awake mice than anesthetized mice. We see an average spike rate reduction of 90% when the laser is on. Although it is not full silencing, we think this reduction is sufficient to draw some conclusions on the role of sSC in the behavioral tasks.

      b) Could authors provide more details if laser stimulation has an effect only on visual, or all sampled units? How many of units were recorded, and how many show positive and negative laser modulation?

      We defined visually responsive units as units that have an evoked rate of at least 2 spikes/s. In the new figure 1—figure supplement 2D from the new set of control experiments, we plotted, for every unit, the mean rate in laser ON and OFF trials - also including the non-visually responsive units. It is evident that the spiking activity of most units – including those that were not classified as ‘visual’ – is reduced in the laser ON compared to OFF trials. We observed 1 unit that showed strong positive laser modulation over the entire duration (figure 1—figure supplement 1D). Many units were activated by shorter laser pulses directly after laser onset (Figure 1—figure supplement 2A-B), but these also reduced in activity as the stimulation continued.

      c) How local the inactivation effect is? Where was the silicon probe placed in relation to AAV expression and optical fiber position?

      The AAV was injected at 0.3 mm anterior and 0.5 mm lateral to the lambda cranial landmark. With this injection location we aimed to focus the expression at low/nasal receptive fields, in front of the mouse, because that is where the visual stimulation would take place. From there, the expression did spread laterally across sSC (see Figure 1C). The silicon probe was placed roughly in the same location as the viral injection. The optical fiber was positioned such that the tip would shine on the surface of the sSC at a slight angle, from a lateral distance of ~200 µm from the silicon probe. We have edited the methods section to make this more clear (line 583-585). This procedure allowed us to record only relatively local effects of the inactivation. Although we did not record neural activity across the entirety of sSC, we did record from multiple electrode penetrations per mouse, each time slightly varying the recording location with up to ~300µm and ~500µm in the anterior and lateral directions, respectively. In these variations of recording location the optogenetic effect was always present (see new Figure 1—figure supplement 2G). Moreover, the suppressive effect of optogenetic stimulation of GAD2+ neurons was observed across the entire depth of the sSC (new Figure 1—figure supplement 2H).

      2) Number of sessions and units

      a) The inactivation effect on behavior (Figure 1E) during phase-task has a significantly larger effect at 66ms after stimulus onset. How can authors explain this? Could this result be biased by one animal/session, or low number of trials for this condition? There is no information about number of trials, or sessions from individual animals. Adding a single example of animal's performance, and sessions for individual mice could clarify results in Figure 1.

      The criterium for each mouse to be included in the analysis for one of the tasks was to have 100 trials where optogenetics were used (aggregated across the latencies). So at minimum, we would have about 100 trials/6 latencies = 17 trials per latency per mouse. For most mice though, the number of trials per latency was closer to about 40. We have added more information about this to the methods section (lines 567-570). Despite these inclusion criteria, the 66 ms effect is present for multiple mice (we have now added data visualizations for the individual mice in Figure 1—figure supplement 4). To address the reviewer’s concerns, we can only speculate as to why this happens. It might be random variation. A more speculative conclusion would be that perhaps this 66ms laser onset is particularly disturbing to the visual processing and/or decision-making of the mouse. But we feel that we do not have enough evidence to conclude this.

      b) Figure 2H shows an example of neuron with an effect in the figure detection task based on phase difference, but Figure 2I/J (population response) shows there is no effect. Overall, the conclusion is that SCs neurons are not modulated by a phase-defined object. It seems that number of mice and hence units are smaller in phase-detection task comparing to two other tasks. How many of single units are modulated in each version of the task? How big is the FGM effect on single neuron response (could authors provide values in spikes/s)? One task is dropped from analysis which it is one of the main points of the paper: to compare responses across different versions of the figure detection task in SCs. But Figures 3-5 only focuses on two tasks, because there is not enough of data for figure-based contrast task.

      We have updated Figure 2H to show spikes/s of the example single neuron response. For the population responses, we explicitly normalized the individual neurons because they all have different baseline and peak firing rates. This normalization was important for the decoding, so we decided to print the data such that the data from Figures 2I and 3B went into the decoding as printed. If we look at the non-normalized values, the maximum amplitude of the average FGM effect is 22.3, 5.9 and 2.9 sp/s respectively for the three tasks (for neurons with RF on stimulus center).

      We have furthermore updated the FGM analysis such that the clustered statistic is now based on linear mixed effects statistics instead of T-test statistics. The results based on this new analysis are largely the same (see statistics table T1). We checked the significance of individual neurons in the time window where the grouped LME analysis was significant. For the phase task (n.s. in grouped analysis), we used the significant window from the orientation task. For this analysis, we want to stress that the number of trials for each version of the task for each individual neurons is quite limited as we recorded all three of the tasks during each recording session. Individually, 7/23 neurons were significant for the contrast task, 1/49 were significant for the orientation task, 0/32 were significant for the phase task (after Bonferroni-holm correction).

      To address the final part of this comment on dropping the contrast task: we indeed have recorded too few data points to draw conclusions on decoding (Fig. 3) and discriminability (Fig. 4) for the contrast task. However, we do not see the contrast detection task as the main point of the paper. As earlier work had already shown involvement of the sSC in visually-evoked behaviours based on objects that are clearly isolated from the background, the main focus in this work is to show involvement of sSC in complex object detection, where the visual contrast and luminance is the same across object and background.

      3) Figure-ground modulation in SCs

      a) How is neural activity correlated with pupil size, movement (eg. whisking, or face), or jaw movement (preparation to lick)? Can activity of FGM neurons in SCs be explained by these behavioral variables?

      We did not record whisking or other face and jaw movements. We did record the eye of the mice, so have included a new Figure 2—figure supplement 2 which shows eye position and pupil dilation during the task. For the analysis in the originally submitted paper, trials with substantial eye movement (Z-score of eye speed > 2.5) between 0 and 450 ms had already been removed from the analysis. This way, we could exclude effects of eye movements (but not pupil dilation) on the visual responses in sSC. The additional figures and analyses have been done using the same inclusion criteria. Indeed, in the included trials mice did not move their eyes during the peak of the visual response (0-250 ms). The pupil dilation also did not change in this period.

      b) Could authors describe in more detail how they measure a pupil position and diameter, by showing raw data, pupil size aligned to task events?

      We have added a new Figure 2—figure supplement 2 to show the pupil position and diameter aligned to task onset.

      c) How does pupil diameter change between tasks? Small pupil changes can affect responses of visual neurons, and this could be an explanation of FGM effect in SCs. Can authors rule out this possibility, by for example showing pupil size and changes in position at stimulus onset in different tasks?

      Our new Figure 2—figure supplement 2B shows that pupil dilation changes and differences in pupil dilation between figure/ground trials do occur, but only after ~300 ms, so after the peak of the visual response and after the FGM is present in sSC.

      d) Authors in discussion mentioned that the modulation of V1 could be transferred to SCs through the direct projection. Moreover, animals perform above chance in both inactivation experiments (V1 and SC), which could be also an effect of geniculate projections to HVAs (eg. Sincich et al. 2004). Could authors discuss different possibilities?

      The direct geniculate projection to HVAs is an interesting possibility that we had not considered yet. The dLGN in the mouse projects (apart from V1) mostly to the medial HVAs (Bienkowski et al. 2018). The lateral extrastriate regions receive only very sparse input from the dLGN. The medial HVAs, however, could be silenced without drop in performance in a simple visual detection task (Goldback et al., 2020). Therefore, it does not seem likely that this geniculate to HVAs projections would be important in the figure detection task.

      4) Interpretation of multisensory neurons is not clear. In Figure 5B, there is an example of neuron with two peaks of response. Authors speculate about the activity (pre-motor) but there is lack of clear measurement showing "multisensory" response of these neurons. Could these responses be related to the movement of the lick spout towards the mouth of the mouse (500 ms after the presentation of the stimulus)? Moreover, the number of "multisensory" units is very low (5 units, and 8 units).

      We have not done definitive test to show what these putative multisensory neurons exactly respond to. Because of their response was after the appearance of the lick and time locking to the trial start, rather than to the licking response, we think that is likely that these neurons responded to the appearance of the spout. There might have been visual, auditory, vibrational or touch clues to which these neurons respond. We believe it is interesting for the reader to know that there is class of neurons in the sSC that did not show a visual stimulus but was time locked to the trial. This was the reason that we had included this figure in the manuscript. However, given the reviewers comments we have decided to move the figure and accompanying text to a figure supplement (Figure 2—figure supplement 1) in order to not distract from the main message of the manuscript.

    1. Reviewer #1 (Public Review):

      Ps observed 24 objects and were asked which afforded particular actions (14 action types). Affordances for each object were represented by a 14-item vector, values reflecting the percentage of Ps who agreed on a particular action being afforded by the object. An affordance similarity matrix was generated which reflected similarity in affordances between pairs of objects. Two clusters emerged, reflecting correlations between affordance ratings in objects smaller than body size and larger than body size. These clusters did not correlate themselves. There was a trough in similarity ratings between objects ~105 cm and ~130 cm, arguably reflecting the body size boundary. The authors subsequently provide some evidence that this clear demarcation is not simply an incidental reflection of body size, but likely causally related. This evidence comes in the flavour of requiring Ps to imagine themselves as small as a cat or as large as an elephant and showing a predicted shift in the affordance boundary. The manuscript further demonstrates that ChatGPT (theoretically interesting because it's trained on language alone without sensorimotor information; trained now on words rather than images) showed a similar boundary.

      The authors also conducted a small MRI study task where Ps decided whether a probe action was affordable (graspable?) and created a congruency factor according to the answer (yes/no). There was an effect of congruency in the posterior fusiform and superior parietal lobule for objects within body size range, but not outside. No effects in LOC or M1.

      The major strength of this manuscript in my opinion is the methodological novelty. I felt the correlation matrices were a clever method for demonstrating these demarcations, the imagination manipulation was also exciting, and the ChatGPT analysis provided excellent food for thought. These findings are important for our understanding of the interactions between action and perception, and hence for researchers from a range of domains of cognitive neuroscience.

      The major elements that limit conclusions and I'd recommend to be addressed in a revision include justification of the 80% of Ps removed for the imagination analysis, and consideration that an MRI study with 12 P in this context can really only provide pilot data. I'd also encourage the authors to consider theoretically how else this study could really have turned out and therefore the nature of the theoretical progress.

      Specifics:<br /> 1. The main behavioural work appears well-powered (>500 Ps). This sample reduces to 100 for the imagination study, after removing Ps whose imagined heights fell within the human range (100-200 cm). Why 100-200 cm? 100 cm is pretty short for an adult. Removing 80% of data feels like conclusions from the imagination study should be made with caution.

      2. There are only 12 Ps in the MRI study, which I think should mean the null effects are not interpreted. I would not interpret these data as demonstrating a difference between SPL and LOC/M1, but rather that some analyses happened to fall over the significance threshold and others did not.

      3. I found the MRI ROI selection and definition a little arbitrary and not really justified, which rendered me even more cautious of the results. Why these particular sensory and motor regions? Why M1 and not PMC or SMA? Why SPL and not other parietal regions? Relatedly, ROIs were defined by thresholding pF and LOC at "around 70%" and SPL and M1 "around 80%", and it is unclear how and why these (different) thresholds were determined.

      4. Discussion and theoretical implications. The authors discuss that the MRI results are consistent with the idea we only represent affordances within body size range. But the interpretation of the behavioural correlation matrices was that there was this similarity also for objects larger than body size, but forming a distinct cluster. I therefore found the interpretation of the MRI data inconsistent with the behavioural findings.

      5. In the discussion, the authors outline how this work is consistent with the idea that conceptual and linguistic knowledge is grounded in sensorimotor systems. But then reference Barsalou. My understanding of Barsalou is the proposition of a connectionist architecture for conceptual representation. I did not think sensorimotor representation was privileged, but rather that all information communicates with all other to constitute a concept.

      6. More generally, I believe that the impact and implications of this study would be clearer for the reader if the authors could properly entertain an alternative concerning how objects may be represented. Of course, the authors were going to demonstrate that objects more similar in size afforded more similar actions. It was impossible that Ps would ever have responded that aeroplanes afford grasping and balls afford sitting, for instance. What do the authors now believe about object representation that they did not believe before they conducted the study? Which accounts of object representation are now less likely?

    2. Reviewer #3 (Public Review):

      Summary:<br /> Feng et al. test the hypothesis that human body size constrains the perception of object affordances, whereby only objects that are smaller than the body size will be perceived as useful and manipulable parts of the environment, whereas larger objects will be perceived as "less interesting components."

      To test this idea, the study employs a multi-method approach consisting of three parts:

      In the first part, human observers classify a set of 24 objects that vary systematically in size (e.g., ball, piano, airplane) based on 14 different affordances (e.g., sit, throw, grasp). Based on the average agreement of ratings across participants, the authors compute the similarity of affordance profiles between all object pairs. They report evidence for two homogenous object clusters that are separated based on their size with the boundary between clusters roughly coinciding with the average human body size. In follow-up experiments, the authors show that this boundary is larger/smaller in separate groups of participants who are instructed to imagine themselves as an elephant/cat.

      In the second part, the authors ask different large language models (LLMs) to provide ratings for the same set of objects and affordances and conduct equivalent analyses on the obtained data. Some, but not all, of the models produce patterns of ratings that appear to show similar boundary effects, though less pronounced and at a different boundary size than in humans.

      In the third part, the authors conduct an fMRI experiment. Human observers are presented with four different objects of different sizes and asked if these objects afford a small set of specific actions. Affordances are either congruent or incongruent with objects. Contrasting brain activity on incongruent trials against brain activity on congruent trials yields significant effects in regions within the ventral and dorsal visual stream, but only for small objects and not for large objects.

      The authors interpret their findings as support for their hypothesis that human body size constrains object perception. They further conclude that this effect is cognitively penetrable, and only partly relies on sensorimotor interaction with the environment (and partly on linguistic abilities).

      Strengths:<br /> The authors examine an interesting and relevant question and articulate a plausible (though somewhat underspecified) hypothesis that certainly seems worth testing. Providing more detailed insights into how object affordances shape perception would be highly desirable. Their method of analyzing similarity ratings between sets of objects seems useful and the multi-method approach is quite original and interesting.

      Weaknesses:<br /> The study presents several shortcomings that clearly weaken the link between the obtained evidence and the drawn conclusions. Below I outline my concerns in no particular order:

      1) Even after several readings, it is not entirely clear to me what the authors are proposing and to what extent the conducted work actually speaks to this. In the introduction, the authors write that they seek to test if body size serves not merely as a reference for object manipulation but also "plays a pivotal role in shaping the representation of objects." This motivation seems rather vague motivation and it is not clear to me how it could be falsified.<br /> Similarly, in the discussion, the authors write that large objects do not receive "proper affordance representation," and are "not the range of objects with which the animal is intrinsically inclined to interact, but probably considered a less interesting component of the environment." This statement seems similarly vague and completely beyond the collected data, which did not assess object discriminability or motivational values.<br /> Overall, the lack of theoretical precision makes it difficult to judge the appropriateness of the approaches and the persuasiveness of the obtained results. This is partly due to the fact that the authors do not spell out all of their theoretical assumptions in the introduction but insert new "speculations" to motivate the corresponding parts of the results section. I would strongly suggest clarifying the theoretical rationale and explaining in more detail how the chosen experiments allow them to test falsifiable predictions.

      2) The authors used only a very small set of objects and affordances in their study and they do not describe in sufficient detail how these stimuli were selected. This renders the results rather exploratory and clearly limits their potential to discover general principles of human perception. Much larger sets of objects and affordances and explicit data-driven approaches for their selection would provide a far more convincing approach and allow the authors to rule out that their results are just a consequence of the selected set of objects and actions.

      3) Relatedly, the authors could be more thorough in ruling out potential alternative explanations. Object size likely correlates with other variables that could shape human similarity judgments and the estimated boundary is quite broad (depending on the method, either between 80 and 150 cm or between 105 to 130 cm). More precise estimates of the boundary and more rigorous tests of alternative explanations would add a lot to strengthen the authors' interpretation.

      4) Even though the division of the set of objects into two homogenous clusters appears defensible, based on visual inspection of the results, the authors should consider using more formal analysis to justify their interpretation of the data. A variety of metrics exist for cluster analysis (e.g., variation of information, silhouette values) and solutions are typically justified by convergent evidence across different metrics. I would recommend the authors consider using a more formal approach to their cluster definition using some of those metrics.

      5) While I appreciate the manipulation of imagined body size, as a way to solidify the link between body size and affordance perception, I find it unfortunate that this is implemented in a between-subjects design, as this clearly leaves open the possibility of pre-existing differences between groups. I certainly disagree with the authors' statement that their findings suggest "a causal link between body size and affordance perception."

      6) The use of LLMs in the current study is not clearly motivated and I find it hard to understand what exactly the authors are trying to test through their inclusion. As noted above, I think that the authors should discuss the putative roles of conceptual knowledge, language, and sensorimotor experience already in the introduction to avoid ambiguity about the derived predictions and the chosen methodology. As it currently stands, I find it hard to discern how the presence of perceptual boundaries in LLMs could constitute evidence for affordance-based perception.

      7) Along the same lines, the fMRI study also provides very limited evidence to support the authors' claims. The use of congruency effects as a way of probing affordance perception is not well motivated. What exactly can we infer from the fact a region may be more active when an object is paired with an activity that the object doesn't afford? The claim that "only the affordances of objects within the range of body size were represented in the brain" certainly seems far beyond the data.

      Importantly (related to my comments under 2) above), the very small set of objects and affordances in this experiment heavily complicates any conclusions about object size being the crucial variable determining the occurrence of congruency effects.

      I would also suggest providing a more comprehensive illustration of the results (including the effects of CONGRUENCY, OBJECT SIZE, and their interaction at the whole-brain level).

      Overall, I consider the main conclusions of the paper to be far beyond the reported data. Articulating a clearer theoretical framework with more specific hypotheses as well as conducting more principled analyses on more comprehensive data sets could help the authors obtain stronger tests of their ideas.

    1. Author Response

      Reviewer #1 (Public Review):

      I believe it is important for the authors to clarify how the time frames to test for group differences of ERP components were defined. Were the components defined based on a grand average across lesions and controls or based or on the maximum range for both groups? As the paper is written currently this is unclear to me. It is also unclear why the group comparisons between controls and lateral PFC group were based only on the control group. To ensure no inadvertent biases towards the larger control group were introduced and ensure the studies findings were reliable, it would be appreciated if the authors could clarify this.

      We thank the reviewer for the helpful comment. We recognize the need for a clearer definition of time frames for testing group differences in the ERP components and apologize for any ambiguity in the previous version of the manuscript.

      Regarding the time frames to test for group differences of ERP components for the OFC and control groups, they were determined based on the combined maximum range for both groups. The time range for each group and each ERP component was derived from the statistical analysis of the condition contrasts run for each group. For instance, for the Local Deviance MMN, the condition contrast (i.e., Control condition versus Local Deviance condition) for the CTR group revealed a MMN component from 67 to128 ms, while the same condition contrast for the OFC group revealed a MMN from 73 to131 ms. The time frame used for the group comparison on the MMN time window was 50 to 150 ms to capture component activity for both groups. In the same way, for the Local Deviance P3a, the condition contrast (i.e., Control condition versus Local Deviance condition) for the CTR group revealed a P3a component ranging from 141 to 313 ms, while the same condition contrast for the OFC group revealed a P3a from 145 to 344 ms. The time frame used for the group comparison on the P3a time window encompassed 140 to 350 ms to capture component activity for both groups.

      In the “Results” section of the main manuscript, together with the results from the cluster-based permutation independent samples t-tests, we provide the time frames in which the latter were computed for each ERP component. These segments have been highlighted with yellow in the revised manuscript. Moreover, in the section “Materials and methods - Statistical analysis of event-related potentials” of the main manuscript [page 37, paragraph 2], we provide a revised description of how the time frames for group differences of ERPs were defined. The revised description states: “In a second step, to check for differences in the ERPs between the two main study groups, we ran the same cluster-based permutation approach contrasting each of the four conditions of interest between the two groups using independent samples t-tests. The cluster-based permutation independent samples t-tests were computed in the latency range of each component, which was determined based on the maximum range for both groups combined. The latency range for each group and component was based on the time frames derived from the statistical analysis of task condition contrasts.”

      Regarding the comparisons between the lateral PFC and control groups, they were not based solely on the control group condition contrast. This was miswritten. The approach to define time frames to test for ERP differences between the CTR and the lateral PFC group was the same as the one used to test differences between CTR and OFC groups. We apologize for any confusion this may have caused. We have revised the erroneous statements in the Supplementary File 1 [highlighted text, page 9-10].

      An additional potential weakness of the paper, and one that if addressed would increase our confidence that neural differences arise because of the specific lesion effect, is the lack of evidence that the lesion and control groups do not differ on measures that could inadvertently bias the neural data. For example, while the groups did not differ on demographics and a range of broad cognitive functions, were there any differences between the number or distribution of bad/noisy channels in each subject between the two groups? Were there differences in the number of blinks/saccades or distribution of blinks or saccades across the conditions in each subject across the two groups.

      We thank the reviewer for this suggestion. We have completed a number of measurements and tests to ensure that the OFC lesion group and the control group did not differ on measures that could affect the neural data. First, we computed the number of bad/noisy channels for each subject and group, and found that the two groups did not differ significantly. Second, we computed the number of trials remaining after removing the noisy segments across conditions for each subject and group, and found no significant differences between the groups. Third, the number of blinks/saccades across conditions for each subject and group showed no significant group differences. Altogether, the results indicate that the neural differences observed in our study arose because of the specific lesion effect.

      These additional EEG measures and the statistical test results are included in the Supplementary File 1 [page 15-16] and Supplementary File 1g. We have also added text in the section “Materials and methods - EEG acquisition and pre-processing” of the main manuscript [page 35, paragraph 3], which states: “To ensure the validity of the neural data analysis, potential sources of bias were assessed between the healthy control participants and the OFC lesion patients. Specifically, no significant differences were observed between the two groups in terms of the number of noisy channels, the number of noisy trials, or the number of blinks across the task blocks and the experimental conditions.”

      On a similar note, while I appreciate this is a well established task could the authors clarify whether task difficulty is balanced across the different conditions? The authors appear to have used the counting task to ensure equal attention is paid across conditions although presumably the blocks differ in the number of deviant tones and therefore in the task difficulty. Typically, tasks to maintain attention are orthogonal to the main task and equally challenging across the different blocks. Is there a way to reassure readers that this has not affected the neural results?

      Thank you for pointing this out. Indeed, the experimental blocks differ in the number of deviant tones and therefore in the task difficulty. Thus, it is a very good suggestion to look for behavioral performance differences across the different blocks. In the present set of analyses, two block types were used: Regular (xX) and Irregular (xY). In regular blocks, where the repeated sequence is xxxxx, participants were required to count the rare/uncommon sequences, i.e., xxxxy and xxxxo. In irregular blocks, where the repeated sequence is xxxxy, participants were required to count the rare/uncommon sequences, i.e., xxxxx and xxxxo. We have now updated the behavioral analysis. First, by excluding the omission block’s counting performance, and second, by calculating the counting performance separately for the two blocks. The new behavioral analysis revealed that participants from both groups performed better in the irregular block compared to the regular block. However, there was no statistically significant difference between the counting performances of the two groups.

      The new results are reported on page 5 of the main manuscript, section “Results - Behavioral performance”, paragraph 1: “Participants from both groups performed the task properly with an average error rate of 9.54% (SD 8.97) for the healthy control participants (CTR) and 10.55% (SD 6.18) for the OFC lesion patients (OFC). There was no statistically significant difference between the counting performance of the two groups [F(24) = 0.11, P = 0.75]. Participants from both groups performed better in the irregular block (CTR: 8.39 ± 8.24%; OFC: 7.50 ± 7.34%) compared to the regular block (CTR: 10.69 ± 11.36%; OFC: 13.60 ± 10.97%) [F(24) = 3.55, P = 0.07]. There was no block X group interaction effect [F(24) = 0.73, P = 0.40].”

      As with many patient lesion studies, while the comparison directly against the healthy age matched controls is critical it would have strengthened the authors claims if they could show differences between the brain damaged control group. Given the previous literature that also links lateral PFC with prediction error detection, I understand that this region is potentially not the clearest brain damaged control group and therefore another lesion group might have strengthened claims of specificity. Furthermore, the authors do not offer an explanation for why no differences between lateral PFC and control groups were found when others have previously reported them. Identifying those differences would strengthen our understanding of the involvement of different structures in this task/function.

      We thank the reviewer for raising this crucial issue. We recognize the importance of addressing the lack of neurophysiological differences between the lateral PFC lesion group and the control group. First, it is important to clarify that the lateral PFC lesion control group was initially included not as a control for specific lateral PFC lesions but rather a broader control group to account for potentially general effects of frontal brain damage. However, considering that previous studies have implicated specific areas of the lateral PFC (e.g., inferior frontal gyrus; IFG) in predictive processing, we also think that a more thorough justification of these null findings is needed.

      Intracranial EEG studies examining local and global level prediction error detection pointed to the role of inferior frontal gyrus (IFG) as a frontal source supporting top-down predictions in MMN generation (Dürschmid et al., 2016; Nourski et al., 2018; Phillips et al., 2016; Rosburg et al., 2005). However, other intracranial studies reported unclear (Bekinschtein et al., 2009) or weak (Dürschmid et al., 2016) frontal MMN effects. El Karoui et al. (2015) observed late ERP responses in the lateral PFC related to global deviants but no MMN to local deviants, and it was not clear where in the PFC these responses occurred, not showing responses in the IFG. Additionally, studies employing dynamic causal modeling of MMN consistently modeled frontal sources in the IFG region (Garrido et al., 2008; Garrido et al., 2009; Phillips et al., 2015). A review by Deouell (2007) highlighted the potential contributions of both IFG and middle frontal gyrus to MMN generation, suggesting that the specific source might vary depending on characteristics of the deviant stimuli, such as pitch or duration.

      In Alho et al. (1994) lesion study, diminished MMN to local-level deviants was found after lesion to the lateral PFC, with the lesion cohort exhibiting a hemisphere ratio of 7/3 for left and right hemispheres, respectively, which is different from our cohort's ratio of 4/6. Furthermore, all individuals in that study had infarcts in the middle cerebral artery, resulting in a more uniform lesion location compared to our cohort. Notably, the lesions observed in our lateral PFC group appeared to be situated in more superior brain regions and towards the MFG compared to the predominantly reported involvement of the IFG in previous studies. Another factor that might contribute to the lack of significant effects is the heterogeneity of the lesions in our lateral PFC group (see Supplementary Figures 2, 3 and 4). Especially for the left hemisphere cohort, the individual lesions did not share a consistent anatomical location. The right hemisphere cohort had a greater lesion overlap, but overall, the lesions were not centered in the IFG area with highest overlap being in the MFG area. This distinction in lesion location might contribute to the absence of effects observed in our study.

      Regarding the global effect, often reflected in the P300 component, it appears that the neural sources responsible for processing global deviance exhibit a more distributed pattern. This means that the brain regions involved in detecting and processing global deviations may not be as localized or concentrated as those implicated in local deviance processing. Given that the neural mechanisms underlying global deviance detection and processing are likely to involve a wider network of brain regions, they may be less susceptible to disruptions caused by focal lesions in the lateral PFC.

      In response to your comment, we have expanded the “Discussion” to address this point by adding a new section titled “Lack of findings in the lateral PFC lesion group” [page 21]. In this section, we first present some of the findings implicating specific areas of the lateral PFC in the generation of MMN and in predictive processing, and then offer an account of the potential reasons behind the lack of neurophysiological differences between the lateral PFC and control groups.

      Finally, while the authors have already cited widely across multiple fields, again speaking to the likely large impact the study will make, there does appear to be an unexplored conceptual link between the conclusions here that the OFC supports "the formation of predictions that define the current task by using context and temporal structure to allow old rules to be disregarded so that new ones can be rapidly acquired" and that lesions of the lateral portions of the OFC disrupt the assignment of credit or value to a stimuli that occurred temporally close to the outcome (Walton et al 2010, Noonan et al 2010, PNAS, Rudebeck et al 2017 Neuron, Noonan et al 2017, JON, Wittmann et al 2023 PlosB, note the wider imaging literature in line with this work Jocham et al 2014 Neuron and Wang et al bioRxiv). Without the OFC monkeys and humans appear to rely on an alternative, global learning mechanism that spreads the reinforcing properties of the outcome to stimuli that occurred further back in time. Could the authors speculate on how these two strains of evidence might converge? For example, does the OFC only assign credit in the event of a prediction error or does one mechanism subsume another?

      We thank the reviewer for this comment regarding the unexplored conceptual link between our study’s conclusion, which suggests that the OFC facilitates the detection of prediction errors, and the findings of other research that delves into the OFC’s role in assignment of credit to stimuli. We find this comment very interesting and appreciate the opportunity to speculate on the potential functional convergence of these two processes within the OFC.

      The OFC is a critical neural hub implicated in learning, decision-making, and adaptive behavior. The detection of prediction errors and the assignment of credit to stimuli are mechanisms linked with the OFC, which play an important role in all these functions (Noonan et al., 2012; Schultz & Dickinson, 2000; Sul et al., 2010; Tobler et al., 2006; Walton et al., 2010; Walton et al., 2011). Prediction errors involve recognizing discrepancies between expected and actual outcomes, which engages the OFC in rapidly updating stimulus valuations to align with newfound information (Holroyd & Coles, 2002; Kakade & Dayan, 2002). Signaling of errors provides a powerful mechanism whereby OFC facilitates adaptive learning and enables the brain to adjust its expectations based on novel experiences (Schultz, 2015; Seymour et al., 2004). Credit assignment, on the other hand, refers to properly identifying the causes of prediction errors. Without proper credit assignment, one might have intact error signaling mechanisms, but lose the ability to learn appropriately. This is especially true when multiple possible antecedents may be related to the error or when past choices have been unpredictable. In such situations, it is important to assign credit to the most recent choice and not get distracted by previous alternatives (Stalnaker et al., 2015).

      These mechanisms within the OFC appear interrelated yet distinct. While prediction errors could trigger credit assignment, the OFC's ability to continually assess stimuli's values extends beyond instances of prediction errors. The OFC is involved in continuously evaluating and updating the values of stimuli based on ongoing experiences (Padoa-Schioppa & Assad, 2006; Tremblay & Schultz, 1999). This process enables the brain to learn from both unexpected outcomes and regular, predictable interactions with the environment. In situations where outcomes are not solely determined by prediction errors, the assignment of credit remains important. Complex decision-making involves considering a variety of factors beyond just prediction errors, such as contextual information and long-term consequences. Clarifying the convergence of these mechanisms within the OFC holds profound implications for understanding the intricacies of learning dynamics and the orchestration of adaptive responses to the environment.

      While we recognize the value of this discussion, we believe it extends beyond the primary focus of our study. Consequently, we have made the decision not to incorporate it into the current manuscript.

      One remaining weakness, which plagues all patient studies, is that of anatomical specificity. The authors have analysed what is, for the field, a large group of patients, and while the lesions appear to be relatively focused on the OFC the individuals vary in the degree to which different subregions within the OFC are damaged. This is increasingly important as evidence over the last 10 years has identified functional roles of these specific structures (Rushworth et al 2011, Neuron, Rudebeck et al 2017 Neuron). It would be important to ultimately know whether the detection of prediction errors was specific to a particular OFC subregion, a general mechanism across this area of cortex, or whether different subregions were more involved during different contexts or types of stimuli/contexts/tasks etc. Some comments on this would be appreciated.

      The reviewer raised an important point here. It would have been interesting to explore this aspect. However, one challenge with focal lesion studies is to establish large patient cohorts. The group size of our study, which is relatively large compared to other studies of focal PFC lesions, does not allow us to perform any exploratory lesion-symptom mapping analyses. A larger patient sample will provide a stronger basis for drawing conclusions about the critical role of a particular OFC subregion to the detection of prediction errors and allow statistical approaches to lesion subclassification and brain-behavior analysis (e.g., voxel-based lesion-symptom mapping (Bates et al., 2003; Lorca-Puls et al., 2018)).

      Considering the average percentage of damaged tissue in our study, the medial part of OFC or Brodmann area 11 is affected more by the lesion (approx. 33%), followed by the anterior-most region of the prefrontal cortex or Brodmann area 10 (approx. 25%), and the lateral portions of the OFC or Brodmann area 47 (approx. 12%). From our analysis, it is difficult to conclude whether the detection of prediction errors in our study was specific to a certain OFC area, or whether different subregions were involved more than others during different types of stimuli/contexts processing.

      To provide a more balanced interpretation of our findings, we incorporated a section in the “Discussion”, titled “Limitations and future directions” [page 24-25], which delves into the limitations of our study and lesion studies generally with respect to anatomical specificity and the challenge to establish large patient cohorts.

      Reviewer #2 (Public Review):

      The current version of the manuscript is overall very long and verbose, for example, the introduction is 5 pages long and includes up to 102 references. In my view this is way too much. I suppose authors wish to be very detailed, but somehow they get an opposite effect, the main message of the introduction and aims get diluted.

      We thank the reviewer for the feedback on our manuscript's length and content. This prompted us to carefully reconsider the balance between providing necessary context and ensuring the clarity of our main message. Our intention was to establish a strong foundation for our research by presenting relevant literature and setting the stage for our aims. In our revised manuscript, we have condensed the Introduction while retaining the key elements necessary to understand the context and motivations behind our research. Specifically, the current version of the “Introduction” is three pages long and includes 83 references.

      I wonder if the presentation rate used, SOA; 150 is too fast and the stimuli too short 50 ms. Please prove a rationale for this.

      We appreciate the reviewer's thoughtful consideration of the stimulus duration and presentation rate (SOA) used in our study. We understand the importance of providing a rationale for our choices to ensure the validity of our experimental design. The decision to use a SOA of 150 ms and stimuli of 50 ms duration was grounded in established practices and relevant literature in the field. Similar presentation rates and stimulus durations were employed in previous studies using similar auditory oddball paradigms, investigating rapid cognitive processes in combination with event-related potentials (ERPs). For instance, Bekinschtein et al. (2009) first introduced the task by using a SOA of 150 ms and stimulus duration of 50 ms, demonstrating that this combination is sensitive to detecting auditory deviations and eliciting early and late ERP components. Additionally, Wacongne et al. (2011), Chennu et al. (2013), Uhrig et al. (2014), and El Karoui et al. (2015) employed similar task designs with the same SOA and stimulus duration in combination with scalp EEG, fMRI and intracranial recordings, further supporting the validity of this approach. Other studies, employing the same paradigm, such as Chao et al. (2018) and Doricchi et al. (2021), used a SOA of 200 ms but kept the same stimulus duration of 50 ms.

      One of the conditions is 'omissions', but results are not reported, so either authors do not mention this at all, or they report these data, which would be probably interesting.

      We thank the reviewer for the nice reminder. The “omissions” condition is indeed an integral part of our study, and we acknowledge its potential significance. However, we have decided to publish the detailed analysis of the 'omissions' condition in a separate paper, because we think that such analysis and discussion would make the current paper quite dense and complicated. We apologize for any confusion that might arise from the absence of the 'omissions' results in this manuscript. On page 33 of the main manuscript, we state the reason for not including the “omissions” condition in the current analysis: “In the present set of analyses, the Omission blocks were not further examined, because such analysis and discussion would make the current paper overly dense and complicated.”

      The Discussion is very long and in some aspect even too speculative. For example, in the conclusions authors claim that the OFC contributes to a top-down predictive process that modulates the deviance detection system in the primary auditory cortices and may be involved in connecting PEs at lower hierarchical areas with predictions at higher areas. I am not sure the current data support this. This would-be probably more appropriate if they could compare results from OFC and AC etc. so it is a more dynamic study.

      We thank the reviewer for this observation. We have made revisions to shorten and refine the discussion, with a primary focus on presenting and interpreting the key results in a more concise and straightforward manner (See tracked changes in the revised manuscript).

      However, the overall length of the Discussion has not been reduced significantly because we have introduced two additional sections within the Discussion (i.e., “Lack of findings in the lateral PFC lesion group” and “Limitations and future directions”) in response to reviewers’ request to address the lack of finding in the lateral PFC lesion group and certain limitations associated with the employed lesion method.

      We also agree that the claim mentioned by the reviewer is overly too speculative and therefore revised the sentence as follows [page 38, “Conclusion”]: “We suggest that the OFC likely contributes to a top-down predictive process that modulates the deviance detection system in lower sensory areas.”

      At the beginning of Discussion, the authors mention that overall, these findings provide novel information about the role of the OFC in detecting violation of auditory prediction at two levels of stimuli abstraction/time scale. I think this needs to be detailed more specifically rather than mention they provide novel results.

      We understand the importance of providing readers with precise descriptions about the novelty of our study. Therefore, we have revised the statement to provide more detailed information about the novel contributions offered by our study. The revised text states as follows [“Discussion”, page 18,]: “These findings indicate that the OFC is causally involved in the detection of local and local + global auditory PEs, thus providing a novel perspective on the role of OFC in predictive processing.”

      I am not sure I like to have a section as a general discussion within the discussion itself, probably this heading should be reformatted to be more specific to what is discussed.

      As suggested by the reviewer, we reformatted the heading to “OFC and hierarchical predictive processing” [page 22-24] to better capture the essence of the content covered in this section of the “Discussion”. Here, we discuss the functional relevance of our EEG findings under the umbrella of the predictive coding framework and the potential role of OFC in predictive processes (See tracked changes in the revised manuscript).

      Reviewer #3 (Public Review):

      The central claim of the study is that hierarchical predictive processing is altered in OFC patients. However, OFC patients were able to identify global deviants as well as controls. Thus, hierarchical predictive processing itself seems to be unaltered, even though its neural correlates were different. This begs the question of what exactly the functional meaning of the EEG findings is. From the evidence presented this is difficult to determine for three reasons (See comments below).

      We thank the reviewer for the detailed observations and valuable comments. The reviewer points out that hierarchical predictive processing is unaltered even though the neural correlates were altered, because OFC patients were able to identify global deviants as accurately as control participants. We respectfully disagree with the reviewer’s claim for two reasons: 1) The primary purpose of the behavioral data in this study was not to measure the participants’ deviant detection performance, but to confirm that they were paying attention to the global rule of each block. However, we agree that an effect of lesion on behavioral performance would strengthen the claim of altered high-level predictive processing. Your point highlights the importance of looking more carefully at our behavioral results. In a follow up study, which we are currently running, we explore the behavioral nuances of our task by measuring reaction times of correct deviant detections. 2) Earlier lesion studies reported typical performance on simple oddball tasks for patients with focal frontal lesions that did not significantly differ from control participants. However, despite normal task execution and neuropsychological profiles, patients with LPFC and OFC lesions present distinct neurophysiological evidence of alterations in novelty processing (Knight, 1984, 1997; Knight & Scabini, 1998; Løvstad et al., 2012; Yamaguchi & Knight, 1991).

      Regarding the central claim of our study being that hierarchical predictive processing is altered in OFC patients, we have tried not to make strong claims about our results showing altered hierarchical predictive processing. For example, the conclusion of the abstract states: “the altered magnitudes and time courses of MMN/P3a responses after lesions to the OFC indicate that the neural correlates of detection of auditory regularity violation is impacted at two hierarchical levels of stimuli abstraction.” Thus, we do not claim that detection of regularity violation is directly impaired (e.g., OFC patients were able to identify global deviants as well as healthy controls) but that the neural correlates of deviants’ detection are altered, and therefore impaired.

      Finally, we have gone through all the comments/reasons, which the reviewer believes are difficult to determine the functional meaning of our EEG findings, and addressed them one by one (see comments below). We hope that the revised manuscript has been improved accordingly and provides a more critical view on the extent to which the findings support hierarchical predictive coding.

      It is possible that the shifts in scalp potentials are due to volume conduction differences linked to post-lesion changes in neural tissue and anatomy rather than differences in information processing per se.

      We appreciate your comment regarding the potential influence of volume conduction differences on the observed shifts in scalp potentials in our study. We acknowledge that there are special challenges in interpreting ERP findings in brain lesion populations (Kutas et al., 2012; Rugg, 1995). To reliably interpret changes in the ERPs in lesion patients as reflecting impairments in certain cognitive processes, it is necessary to identify factors that might possibly affect the results and to apply the appropriate control measures. As noted by the reviewer, structural pathology, and the replacement of neural tissue by cerebrospinal fluid following tumor resection, likely causes inhomogeneities in the volume conduction of electrical activity and resulting changes in current flow patterns. Moreover, post-craniotomy skull defects can cause local inhomogeneities in the resistive properties of the skull (Løvstad & Cawley, 2011; Rugg, 1995). Both types of biophysical changes might alter the amplitude levels and/or topography (by altering the configuration of the generators) of surface-recorded ERPs (e.g., Swick (2005)). Consequently, caution is warranted when comparing the ERPs and their scalp distributions of intact and brain-lesioned groups. It is difficult to directly quantify the consequences of brain lesions on tissue conductivity. To conclude that ERP differences between patients and controls reflect functional abnormalities in particular cognitive processes, and not primarily nonspecific effects of structural brain damage, it is helpful to demonstrate that they are specific to certain ERP components/stages of information processing and task conditions. Changes confined to one or a subset of ERP components, that additionally may not manifest across all task conditions, can give some indication concerning the specificity of ERP changes (Kutas et al., 2012; Swaab, 1998). In our study, group differences pertaining to ERP amplitudes were limited to specific task conditions and not across all data. This condition-dependent pattern suggests that the observed shifts are related to the specific cognitive processes engaged during those task conditions rather than being a global artifact of volume conduction. If volume conduction was the main driver, we would expect these group differences to be more uniformly present across task conditions. Another piece of evidence against volume conduction effects is the scalp potentials’ latency differences between the two groups observed for the Local + Global deviance detection. Group differences in the latencies of ERPs, such as the MMN and P3a, cannot be attributed to volume conduction alone (Hämäläinen et al., 1993). These differences in the timing of neural responses strongly indicate genuine variations in cognitive processing.

      To provide a more balanced interpretation of our findings, we have incorporated a section in the “Discussion” that delves into the limitations of our study and lesion studies generally with respect to volume conduction and amplitude changes, titled “Limitations and future directions” [page 24-25].

      It is unclear from the analyses whether the P3a amplitude differences are true amplitude differences or a byproduct of latency differences. The reason is that the statistical method used (cluster based permutations) might yield significant effects when the latency of a component is shifted, even if peak amplitudes are the same. Complementary analyses on mean or peak amplitudes could resolve this issue.

      We thank the reviewer for raising an important concern about the use of cluster-based permutation tests and their potential to yield significant effects when the latency of a component is shifted. We acknowledge this concern and recognize the need for complementary analyses to address this issue. To provide a clearer understanding of the nature of the observed ERP amplitude differences, we conducted complementary analyses on mean amplitudes of the MMN and P3a components on the midline sensors for the conditions where significant group differences were observed. For the MMN component elicited by the Local Deviance, we found group amplitude differences on the electrodes AFz (p = 0.021), Fz (p = 0.008), CPz (p = 0.015), and Pz (p < 0.001). Surprisingly, we also found amplitude differences for the P3a component elicited by the Local Deviance on the electrodes AFz (p < 0.001), Fz (p < 0.001), FCz (p < 0.001), and Cz (p = 0.002) that were not observed previously with the cluster-based permutation analysis. For the MMN component elicited by the Local+Global Deviance, our analysis showed group amplitude differences on the electrodes AFz (p = 0.007), FCz (p = 0.051), Cz (p = 0.004), CPz (p = 0.002), and Pz (p < 0.001). However, as the reviewer rightly pointed out, the group differences for the P3a elicited by the Local + Global Deviance seem to be a byproduct of latency differences, as we did not find amplitude differences on any of the midline electrodes. Overall, this complementary analysis shows that the OFC patients had an attenuated MMN/P3a to local level prediction violation, and an attenuated and delayed MMN followed by a delayed P3a to the combined local and global level prediction violation. The new analysis is added in the Supplementary File 1 [page 5-7] and Supplementary File 1c and 1d.

      The MMN, P3a and P3b components are difficult to map to the hierarchical PC theory. Traditionally, the MMN is ascribed to lower level processing while P3a and P3b are ascribed to higher level processing. However, the picture is more complicated. For example, the current results show that the MMN is enhanced in local + global surprise while the P3a is elicited by local surprise. Furthermore, the P3a is classically interpreted as reflecting attention reorientation and the P3b as reflecting the conscious detection of task-relevant targets. How attention and conscious awareness fit in hierarchical PC is not entirely clear.

      Indeed, the relationships between MMN, P3a and P3b components and the predictive coding (PC) framework can be intricate. However, numerous studies employed the PC theory to interpret these common electrophysiological signatures as prediction error (PE) signals (Garrido et al., 2007, 2009; Lieder et al., 2013) and dissociations between these ERPs supported that there are successive levels of predictive processing (Chennu et al., 2013; El Karoui et al., 2015; Wacongne et al., 2011).

      In terms of hierarchical PC (Friston, 2005), the temporally constrained MMN has been traditionally linked with first-level predictive processing, known as the local effect of short-term stimulus deviance. PE signals at this level feed forward to a temporally extended, attention-dependent system that extracts longer-term patterns. PE signals at the higher level are usually indexed by the P300, identified as the global effect of longer-term stimulus deviance. The P300 reflects a more attention-driven process, emerging in response to novel or low-probability “target” stimuli that violate broader contextual expectations (Polich, 2007), such as those that form over multiple trials. Because the MMN, P3a and P3b also appear to exhibit varying degrees of sensitivity to preconscious and conscious perceptual predictions (Sculthorpe et al., 2009), they could serve as measures for examining the concept of a predictive neural hierarchy.

      Indeed, the MMN has been viewed as sensitive to local violation and essentially blind to higher-order regularities. However, this is a simplified view. For example, Wacongne et al. (2011) showed that violating a low-level perceptual expectation triggers the MMN, violating contextual expectations triggers the higher-level P3, and when both expectations are simultaneously violated, a larger response is evoked compared to either one alone. These findings, which are consistent with the results of our study, show that the local and global effects are not fully independent but interact in an early time window, indexed by enhanced and temporally extended MMN responses. They provide support not just for a hierarchical model, but for a predictive rather than a feedforward one. Moreover, the MMN has been found to be relatively insensitive to attention, because it is elicited in situations in which the subjects’ attention is directed away from the stimuli and there are no task demands (Chennu et al., 2013). Given that early MMN is a pre-attentive automatic ERP component (Näätänen et al., 2001; Pegado et al., 2010; Tiitinen et al., 1994), and given that it has been observed in comatose and vegetative state patients (Bekinschtein et al., 2009; Fischer et al., 2004; Naccache et al., 2004), the finding that even early MMN is impaired in OFC patients indicate that patients may suffer from a deficit in sensory predictive processing that is independent of attention and conscious awareness.

      The picture is more complicated when it comes to the predictive roles of P3a and P3b components. Following the MMN, a positive polarity P300 complex, sensitive to the detection of unpredicted auditory events, has been reported (Chennu et al., 2013; Doricchi et al., 2021; Kompus et al., 2020; Liaukovich et al., 2022). However, the two types of P300 (P3a and P3b) have not been clearly fitted into the hierarchical PC theory. The P3a is considered to be part of the brain's mechanism for detecting PEs (Wessel et al., 2012; Wessel et al., 2014) and may indicate that the brain is reallocating attentional resources to process and learn from these unexpected events. The P3a is typically interpreted as reflecting an involuntary attentional reorienting process (Escera & Corral, 2007; Ungan et al., 2019), which may relate to the operations of the ventral attention network (Corbetta et al., 2008; Corbetta & Shulman, 2002; Nieuwenhuis et al., 2005). Predictive coding emphasizes the role of contextual information in generating predictions with P3a being influenced by the context in which an unexpected event occurs (Schomaker et al., 2014). In the hierarchy of predictive processing, the P3a may reflect PEs at different hierarchical levels, depending on the complexity of the prediction and the degree to which it deviates from the sensory input. On the other hand, the P3b is linked to higher-level cognitive processes that involve updating long-term predictions based on incoming sensory information. It is highly dependent on attention, conscious awareness and active engagement with the task (Bekinschtein et al., 2009; Del Cul et al., 2007; Sergent et al., 2005; Strauss et al., 2015). It is thought to play a role in integrating the unexpected sensory input into the current context, potentially leading to updates of predictions in working memory (Chao et al., 1995; Donchin & Coles, 1988; Polich, 2007).

      Hierarchical PC theory is continually evolving, and the relationship between these ERP components and attention or conscious awareness remains an active area of research. We acknowledge the need for further investigation to better understand how attention and conscious awareness fit within this framework. In light of your comment, we provide a more comprehensive discussion about the functional meaning of the EEG findings in our “Discussion - OFC and hierarchical predictive processing” [page 22-24].

      The fact that lateral PFC patients show unaltered neural responses contradicts prominent views from PC identifying this region as a generator of the MMN and a source of predictions sent to temporal auditory areas.

      We appreciate the reviewer's comment and want to acknowledge that another reviewer raised this concern previously. We have provided a detailed response to this issue in our previous response (see Response to Reviewer #1 Comment 4). We have expanded the “Discussion” to address this point by adding a new section titled “Lack of findings in the lateral PFC lesion group” [page 21]. In this section, we first present some of the findings implicating specific areas of the lateral PFC in the generation of MMN and in predictive processing, and then offer an account of the potential reasons behind the lack of neurophysiological differences between the lateral PFC and control groups.

      For these reasons, a more critical view on the extent to which the findings support hierarchical predictive coding is needed.

      By responding to the reviewer’s previous comments (i.e., the reasons why the reviewer thinks it is difficult to determine the functional meaning of the EEG findings), we believe that we have offered a more critical view on this matter.

      References

      Alho, K., Woods, D. L., Algazi, A., Knight, R., & Näätänen, R. (1994). Lesions of frontal cortex diminish the auditory mismatch negativity. Electroencephalography and clinical neurophysiology, 91(5), 353-362.

      Bates, E., Wilson, S. M., Saygin, A. P., Dick, F., Sereno, M. I., Knight, R. T., & Dronkers, N. F. (2003). Voxel-based lesion–symptom mapping. Nature neuroscience, 6(5), 448-450.

      Bekinschtein, T. A., Dehaene, S., Rohaut, B., Tadel, F., Cohen, L., & Naccache, L. (2009). Neural signature of the conscious processing of auditory regularities. Proceedings of the National Academy of Sciences, 106(5), 1672-1677.

      Chao, L., Nielsen-Bohlman, L., & Knight, R. (1995). Auditory event-related potentials dissociate early and late memory processes. Electroencephalography and Clinical Neurophysiology/Evoked Potentials Section, 96(2), 157-168.

      Chao, Z. C., Takaura, K., Wang, L., Fujii, N., & Dehaene, S. (2018). Large-scale cortical networks for hierarchical prediction and prediction error in the primate brain. Neuron, 100(5), 1252-1266. e1253.

      Chennu, S., Noreika, V., Gueorguiev, D., Blenkmann, A., Kochen, S., Ibánez, A., Owen, A. M., & Bekinschtein, T. A. (2013). Expectation and attention in hierarchical auditory prediction. Journal of Neuroscience, 33(27), 11194-11205.

      Corbetta, M., Patel, G., & Shulman, G. L. (2008). The reorienting system of the human brain: from environment to theory of mind. Neuron, 58(3), 306-324.

      Corbetta, M., & Shulman, G. L. (2002). Control of goal-directed and stimulus-driven attention in the brain. Nature reviews neuroscience, 3(3), 201-215.

      Del Cul, A., Baillet, S., & Dehaene, S. (2007). Brain dynamics underlying the nonlinear threshold for access to consciousness. PLoS biology, 5(10), e260.

      Deouell, L. Y. (2007). The frontal generator of the mismatch negativity revisited. Journal of Psychophysiology, 21(3-4), 188-203.

      Donchin, E., & Coles, M. G. (1988). Is the P300 component a manifestation of context updating? Behavioral and brain sciences, 11(3), 357-374.

      Doricchi, F., Pinto, M., Pellegrino, M., Marson, F., Aiello, M., Campana, S., Tomaiuolo, F., & Lasaponara, S. (2021). Deficits of hierarchical predictive coding in left spatial neglect. Brain communications, 3(2), fcab111.

      Dürschmid, S., Edwards, E., Reichert, C., Dewar, C., Hinrichs, H., Heinze, H.-J., Kirsch, H. E., Dalal, S. S., Deouell, L. Y., & Knight, R. T. (2016). Hierarchy of prediction errors for auditory events in human temporal and frontal cortex. Proceedings of the National Academy of Sciences, 113(24), 6755-6760.

      El Karoui, I., King, J.-R., Sitt, J., Meyniel, F., Van Gaal, S., Hasboun, D., Adam, C., Navarro, V., Baulac, M., & Dehaene, S. (2015). Event-related potential, time-frequency, and functional connectivity facets of local and global auditory novelty processing: an intracranial study in humans. Cerebral cortex, 25(11), 4203-4212.

      Escera, C., & Corral, M. (2007). Role of mismatch negativity and novelty-P3 in involuntary auditory attention. Journal of psychophysiology, 21(3-4), 251-264.

      Fischer, C., Luauté, J., Adeleine, P., & Morlet, D. (2004). Predictive value of sensory and cognitive evoked potentials for awakening from coma. Neurology, 63(4), 669-673.

      Friston, K. (2005). A theory of cortical responses. Philosophical transactions of the Royal Society B: Biological sciences, 360(1456), 815-836.

      Garrido, M. I., Friston, K. J., Kiebel, S. J., Stephan, K. E., Baldeweg, T., & Kilner, J. M. (2008). The functional anatomy of the MMN: a DCM study of the roving paradigm. Neuroimage, 42(2), 936-944.

      Garrido, M. I., Kilner, J. M., Kiebel, S. J., & Friston, K. J. (2007). Evoked brain responses are generated by feedback loops. Proceedings of the National Academy of Sciences, 104(52), 20961-20966.

      Garrido, M. I., Kilner, J. M., Kiebel, S. J., & Friston, K. J. (2009). Dynamic causal modeling of the response to frequency deviants. Journal of Neurophysiology, 101(5), 2620-2631.

      Holroyd, C. B., & Coles, M. G. (2002). The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. Psychological review, 109(4), 679.

      Hämäläinen, M., Hari, R., Ilmoniemi, R. J., Knuutila, J., & Lounasmaa, O. V. (1993). Magnetoencephalography—theory, instrumentation, and applications to noninvasive studies of the working human brain. Reviews of modern Physics, 65(2), 413.

      Kakade, S., & Dayan, P. (2002). Dopamine: generalization and bonuses. Neural Networks, 15(4-6), 549-559.

      Knight, R. T. (1984). Decreased response to novel stimuli after prefrontal lesions in man. Electroencephalography and Clinical Neurophysiology/Evoked Potentials Section, 59(1), 9-20.

      Knight, R. T. (1997). Distributed cortical network for visual attention. Journal of Cognitive Neuroscience, 9(1), 75-91.

      Knight, R. T., & Scabini, D. (1998). Anatomic bases of event-related potentials and their relationship to novelty detection in humans. Journal of clinical neurophysiology, 15(1), 3-13.

      Kompus, K., Volehaugen, V., Todd, J., & Westerhausen, R. (2020). Hierarchical modulation of auditory prediction error signaling is independent of attention. Cognitive neuroscience, 11(3), 132-142.

      Kutas, M., Kiang, M., & Sweeney, K. (2012). Potentials and Paradigms: Event‐Related Brain Potentials and Neuropsychology. The handbook of the neuropsychology of language, 1, 543-564.

      Liaukovich, K., Ukraintseva, Y., & Martynova, O. (2022). Implicit auditory perception of local and global irregularities in passive listening condition. Neuropsychologia, 165, 108129.

      Lieder, F., Daunizeau, J., Garrido, M. I., Friston, K. J., & Stephan, K. E. (2013). Modelling trial-by-trial changes in the mismatch negativity. PLoS computational biology, 9(2), e1002911.

      Lorca-Puls, D. L., Gajardo-Vidal, A., White, J., Seghier, M. L., Leff, A. P., Green, D. W., Crinion, J. T., Ludersdorfer, P., Hope, T. M., & Bowman, H. (2018). The impact of sample size on the reproducibility of voxel-based lesion-deficit mappings. Neuropsychologia, 115, 101-111.

      Løvstad, A., & Cawley, P. (2011). The reflection of the fundamental torsional guided wave from multiple circular holes in pipes. Ndt & E International, 44(7), 553-562.

      Løvstad, M., Funderud, I., Lindgren, M., Endestad, T., Due-Tønnessen, P., Meling, T., Voytek, B., Knight, R. T., & Solbakk, A.-K. (2012). Contribution of subregions of human frontal cortex to novelty processing. Journal of Cognitive Neuroscience, 24(2), 378-395.

      Naccache, L., Puybasset, L., Gaillard, R., Serve, E., & Willer, J.-C. (2004). Auditory mismatch negativity is a good predictor of awakening in comatose patients: a fast and reliable procedure. Clinical neurophysiology: official journal of the International Federation of Clinical Neurophysiology, 116(4), 988-989.

      Nieuwenhuis, S., Aston-Jones, G., & Cohen, J. D. (2005). Decision making, the P3, and the locus coeruleus--norepinephrine system. Psychological bulletin, 131(4), 510.

      Noonan, M., Kolling, N., Walton, M., & Rushworth, M. (2012). Re‐evaluating the role of the orbitofrontal cortex in reward and reinforcement. European Journal of Neuroscience, 35(7), 997-1010.

      Nourski, K. V., Steinschneider, M., Rhone, A. E., Kawasaki, H., Howard III, M. A., & Banks, M. I. (2018). Processing of auditory novelty across the cortical hierarchy: An intracranial electrophysiology study. Neuroimage, 183, 412-424.

      Näätänen, R., Pakarinen, S., Rinne, T., & Takegata, R. (2004). The mismatch negativity (MMN): towards the optimal paradigm. Clinical neurophysiology, 115(1), 140-144.

      Näätänen, R., Tervaniemi, M., Sussman, E., Paavilainen, P., & Winkler, I. (2001). ‘Primitive intelligence’in the auditory cortex. Trends in neurosciences, 24(5), 283-288.

      Padoa-Schioppa, C., & Assad, J. A. (2006). Neurons in the orbitofrontal cortex encode economic value. Nature, 441(7090), 223-226.

      Pegado, F., Bekinschtein, T., Chausson, N., Dehaene, S., Cohen, L., & Naccache, L. (2010). Probing the lifetimes of auditory novelty detection processes. Neuropsychologia, 48(10), 3145-3154.

      Phillips, H. N., Blenkmann, A., Hughes, L. E., Bekinschtein, T. A., & Rowe, J. B. (2015). Hierarchical organization of frontotemporal networks for the prediction of stimuli across multiple dimensions. Journal of Neuroscience, 35(25), 9255-9264.

      Phillips, H. N., Blenkmann, A., Hughes, L. E., Kochen, S., Bekinschtein, T. A., & Rowe, J. B. (2016). Convergent evidence for hierarchical prediction networks from human electrocorticography and magnetoencephalography. cortex, 82, 192-205.

      Polich, J. (2007). Updating P300: an integrative theory of P3a and P3b. Clinical neurophysiology, 118(10), 2128-2148.

      Rosburg, T., Trautner, P., Dietl, T., Korzyukov, O. A., Boutros, N. N., Schaller, C., Elger, C. E., & Kurthen, M. (2005). Subdural recordings of the mismatch negativity (MMN) in patients with focal epilepsy. Brain, 128(4), 819-828.

      Rugg, M. D. (1995). Event-related potential studies of human memory. Schomaker, J., Roos, R., & Meeter, M. (2014). Expecting the unexpected: The effects of deviance on novelty processing. Behavioral neuroscience, 128(2), 146.

      Schultz, W. (2015). Neuronal reward and decision signals: from theories to data. Physiological reviews, 95(3), 853-951.

      Schultz, W., & Dickinson, A. (2000). Neuronal coding of prediction errors. Annual review of neuroscience, 23(1), 473-500.

      Sculthorpe, L. D., Stelmack, R. M., & Campbell, K. B. (2009). Mental ability and the effect of pattern violation discrimination on P300 and mismatch negativity. Intelligence, 37(4), 405-411.

      Sergent, C., Baillet, S., & Dehaene, S. (2005). Timing of the brain events underlying access to consciousness during the attentional blink. Nature neuroscience, 8(10), 1391-1400.

      Seymour, B., O'Doherty, J. P., Dayan, P., Koltzenburg, M., Jones, A. K., Dolan, R. J., Friston, K. J., & Frackowiak, R. S. (2004). Temporal difference models describe higher-order learning in humans. Nature, 429(6992), 664-667.

      Stalnaker, T. A., Cooch, N. K., & Schoenbaum, G. (2015). What the orbitofrontal cortex does not do. Nature neuroscience, 18(5), 620-627.

      Strauss, M., Sitt, J. D., King, J.-R., Elbaz, M., Azizi, L., Buiatti, M., Naccache, L., Van Wassenhove, V., & Dehaene, S. (2015). Disruption of hierarchical predictive coding during sleep. Proceedings of the National Academy of Sciences, 112(11), E1353-E1362.

      Sul, J. H., Kim, H., Huh, N., Lee, D., & Jung, M. W. (2010). Distinct roles of rodent orbitofrontal and medial prefrontal cortex in decision making. Neuron, 66(3), 449-460.

      Swick, D. (2005). 13 ERPs in Neuropsychological Populations. Event-related potentials: A methods handbook, 299.

      Swaab, T. Y. (1998). Event-related potentials in cognitive neuropsychology: Methodological considerations and an example from studies of aphasia. Behavior Research Methods, Instruments, & Computers, 30(1), 157-170.

      Tiitinen, H., May, P., Reinikainen, K., & Näätänen, R. (1994). Attentive novelty detection in humans is governed by pre-attentive sensory memory. Nature, 372(6501), 90-92.

      Tobler, P. N., O’Doherty, J. P., Dolan, R. J., & Schultz, W. (2006). Human neural learning depends on reward prediction errors in the blocking paradigm. Journal of Neurophysiology, 95(1), 301-310.

      Tremblay, L., & Schultz, W. (1999). Relative reward preference in primate orbitofrontal cortex. Nature, 398(6729), 704-708.

      Uhrig, L., Dehaene, S., & Jarraya, B. (2014). A hierarchy of responses to auditory regularities in the macaque brain. Journal of Neuroscience, 34(4), 1127-1132.

      Ungan, P., Karsilar, H., & Yagcioglu, S. (2019). Pre-attentive mismatch response and involuntary attention switching to a deviance in an earlier-than-usual auditory stimulus: an ERP study. Frontiers in Human Neuroscience, 13, 58.

      Wacongne, C., Labyt, E., van Wassenhove, V., Bekinschtein, T., Naccache, L., & Dehaene, S. (2011). Evidence for a hierarchy of predictions and prediction errors in human cortex. Proceedings of the National Academy of Sciences, 108(51), 20754-20759.

      Walton, M. E., Behrens, T. E., Buckley, M. J., Rudebeck, P. H., & Rushworth, M. F. (2010). Separable learning systems in the macaque brain and the role of orbitofrontal cortex in contingent learning. Neuron, 65(6), 927-939.

      Walton, M. E., Behrens, T. E., Noonan, M. P., & Rushworth, M. F. (2011). Giving credit where credit is due: orbitofrontal cortex and valuation in an uncertain world. Annals of the New York Academy of Sciences, 1239(1), 14-24.

      Wessel, J. R., Danielmeier, C., Morton, J. B., & Ullsperger, M. (2012). Surprise and error: common neuronal architecture for the processing of errors and novelty. Journal of Neuroscience, 32(22), 7528-7537.

      Wessel, J. R., Klein, T. A., Ott, D. V., & Ullsperger, M. (2014). Lesions to the prefrontal performance-monitoring network disrupt neural processing and adaptive behaviors after both errors and novelty. Cortex, 50, 45-54.

      Yamaguchi, S., & Knight, R. (1991). Anterior and posterior association cortex contributions to the somatosensory P300. Journal of Neuroscience, 11(7), 2039-2054.

    1. Any recommendations on Analog way of doing it? Not the Antinet shit

      reply to u/IamOkei at https://www.reddit.com/r/Zettelkasten/comments/17beucn/comment/k5s6aek/?utm_source=reddit&utm_medium=web2x&context=3

      u/IamOkei, I know you've got a significant enough practice that not much of what I might suggest may be helpful beyond your own extension of what you've got and how it is or isn't working for you. Perhaps chatting with a zettelkasten therapist may be helpful? Does anyone have "Zettelkasten Whisperer" on a business card yet?! More seriously, I occasionally dump some of my problems and issues into a notebook, unpublished on my blog, or even into a section of my own zettelkasten, which I never index or reconsult, as a helpful practice. Others like Henry David Thoreau have done something like this and there's a common related practice of writing "Morning Pages" that you can explore. My own version is somewhat similar to the idea of rubber duck debugging but focuses on my own work. You might try doing something like this in one of Bob Doto's cohorts or by way of private consulting sessions. Another free version of this could be found by participating in Will's regular weekly posts/threads "Share with us what is happening in your ZK this week" at https://forum.zettelkasten.de/. It's always a welcoming and constructive space. There are also some public and private (I won't out them) Discords where some of the practiced hands chat and commiserate with each other. Even the Obsidian PKM/Zettelkasten Discord channels aren't very Obsidian/digital-focused that you couldn't participate as an analog practitioner. I've even found that participating in book clubs related to some of my interests can be quite helpful in talking out ideas before writing them down. There are certainly options for working out and extending your own practice.

      Beyond this, and without knowing more of your specific issues, I can only offer some broad thoughts which expand on some of the earlier discussion above.

      I recommend stripping away Scheper's religious fervor, some of which he seems to have thrown over lately along with the idea of a permanent note or "main card" (something I think is a grave mistake), and trying something closer to Luhmann's idea of ZKII.

      An alternate method, especially if you like a nice notebook or a particular fountain pen, might be to take all of your basic literature/fleeting notes along with the bibliographic data in a notebook and then just use your analog index cards/slips to make your permanent notes and your index.

      Ultimately it's all a lot of the same process, though it may come down to what you want to call it and your broad philosophy. If you're anti-antinet, definitely quit using the verbiage for the framing there and lean toward the words used by Ahrens, Dan Allosso, Gerald Weinberg, Mark Bernstein, Umberto Eco, Beatrice Webb, Jacques Barzun & Henry Graff, or any of the dozens of others or even make up your own. Goodness knows we need a lot more names and categories for types of notes—just like we all need another one page blog post about how the Zettelkasten method works by someone who's been at it for a week. Maybe someone will bring all these authors to terms one day?

      Generally once you know what sorts of ideas you're most interested in, you take fewer big notes on administrivia and focus more of your note taking towards your own personal goals and desires. (Taking notes to learn a subject are certainly game, but often they serve little purpose after-the-fact.) You can also focus less on note taking within your entertainment reading (usually a waste) and focusing more heavily on richer material (books and journal articles) that is "above you" in Adler's framing. You might make hundreds of highlights and annotations in a particular book, but only get two or three serious ideas and notes out of it ultimately. Focus on this and leave the rest. If you're aware of the Pareto principle or the 80/20 rule, then spend the majority of your time on the grander permanent notes (10-20%), and a lot less time worrying about the all the rest (the 80-90%).

      In the example above relating to Marx, you can breeze through some low level introductory material for context, but nothing is going to beat reading Marx himself a few times. The notes you make on his text will have tremendously more value than the ones you took on the low level context. A corollary to this is that you're highly unlikely to earn a Ph.D. or discover massive insight by reading and taking note posts on Twitter, Medium, or Substack (except possibly unless your work is on the cultural anthropology of those platforms).

      A lot of the zettelkasten spaces focus heavily on the note taking part of the process and not enough on the quality of what you're reading and how you're reading it. This portion is possibly more valuable than the note taking piece, but the two should be hand-in-glove and work toward something.

      I suspect that most people who have 1000 notes know which five or ten are the most important to where they're going and how they're growing. Focus on those and your "conversations with texts" relating to those. The rest is either low level context for where you're headed or either pure noise/digital exhaust.

      If you think of ideas as incunables, which notes will be worth of putting on your tombstone? In other words: What are your "tombstone notes"? (See what I did there? I came up with another name for a type of note, a sin for which I'm certainly going to spend a lot of time in zettelkasten purgatory.)

    1. When we don’t think certain messages meet our needs, stimuli that would normally get our attention may be completely lost. Imagine you are in the grocery store and you hear someone say your name. You turn around, only to hear that person say, “Finally! I said your name three times. I thought you forgot who I was!” A few seconds before, when you were focused on figuring out which kind of orange juice to get, you were attending to the various pulp options to the point that you tuned other stimuli out, even something as familiar as the sound of someone calling your name.

      This can be a whole range of both external and internal stimuli. For example, our pain can be blocked out when we are focused on someone or something else that we feel is more important. We can block out our hunger when we are about to give a public presentation or performance. When we truly believe that something is the most important thing at that moment, we can have almost superhuman like abilities to drown out anything that could be keeping us from that one singular thing. First responders and military would be a great example of this.

    1. Author Response

      eLife assessment

      This study uses a multi-pronged empirical and theoretical approach to advance our understanding of how differences in learning relate to differences in the ways that male versus female animals cope with urban environments, and more generally how reversal learning may benefit animals in urban habitats. The work makes an important contribution and parts of the data and analyses are solid, although several of the main claims are only partially supported or overstated and require additional support.

      We thank the Editor and both Reviewers for their time and for their constructive evaluation of our manuscript. We will work to address each comment and suggestion offered by the Reviewers in a revision.

      Reviewer #1 (Public Review):

      Summary:

      In this highly ambitious paper, Breen and Deffner used a multi-pronged approach to generate novel insights on how differences between male and female birds in their learning strategies might relate to patterns of invasion and spread into new geographic and urban areas.

      The empirical results, drawn from data available in online archives, showed that while males and females are similar in their initial efficiency of learning a standard color-food association (e.g., color X = food; color Y = no food) scenario when the associations are switched (now, color Y = food, X= no food), males are more efficient than females at adjusting to the new situation (i.e., faster at 'reversal learning'). Clearly, if animals live in an unstable world, where associations between cues (e.g., color) and what is good versus bad might change unpredictably, it is important to be good at reversal learning. In these grackles, males tend to disperse into new areas before females. It is thus fascinating that males appear to be better than females at reversal learning. Importantly, to gain a better understanding of underlying learning mechanisms, the authors use a Bayesian learning model to assess the relative role of two mechanisms (each governed by a single parameter) that might contribute to differences in learning. They find that what they term 'risk sensitive' learning is the key to explaining the differences in reversal learning. Males tend to exhibit higher risk sensitivity which explains their faster reversal learning. The authors then tested the validity of their empirical results by running agent-based simulations where 10,000 computer-simulated 'birds' were asked to make feeding choices using the learning parameters estimated from real birds. Perhaps not surprisingly, the computer birds exhibited learning patterns that were strikingly similar to the real birds. Finally, the authors ran evolutionary algorithms that simulate evolution by natural selection where the key traits that can evolve are the two learning parameters. They find that under conditions that might be common in urban environments, high-risk sensitivity is indeed favored.

      Strengths:

      The paper addresses a critically important issue in the modern world. Clearly, some organisms (some species, some individuals) are adjusting well and thriving in the modern, human-altered world, while others are doing poorly. Understanding how organisms cope with human-induced environmental change, and why some are particularly good at adjusting to change is thus an important question.

      The comparison of male versus female reversal learning across three populations that differ in years since they were first invaded by grackles is one of few, perhaps the first in any species, to address this important issue experimentally.

      Using a combination of experimental results, statistical simulations, and evolutionary modeling is a powerful method for elucidating novel insights.

      Thank you—we are delighted to receive this positive feedback, especially regarding the inferential power of our analytical approach.

      Weaknesses:

      The match between the broader conceptual background involving range expansion, urbanization, and sex-biased dispersal and learning, and the actual comparison of three urban populations along a range expansion gradient was somewhat confusing. The fact that three populations were compared along a range expansion gradient implies an expectation that they might differ because they are at very different points in a range expansion. Indeed, the predicted differences between males and females are largely couched in terms of population differences based on their 'location' along the range-expansion gradient. However, the fact that they are all urban areas suggests that one might not expect the populations to differ. In addition, the evolutionary model suggests that all animals, male or female, living in urban environments (that the authors suggest are stable but unpredictable) should exhibit high-risk sensitivity. Given that all grackles, male and female, in all populations, are both living in urban environments and likely come from an urban background, should males and females differ in their learning behavior? Clarification would be useful.

      Thank you for highlighting a gap in clarity in our conceptual framework. To answer the Reviewer’s question—yes, even with this shared urban ‘history’, it seems plausible that males and females could differ in their learning. For example, irrespective of population membership, such sex differences could come about via differential reliance on learning strategies mediated by an interaction between grackles’ polygynous mating system and male-biased dispersal system, as we discuss in L254–265. Population membership might, in turn, differentially moderate the magnitude of any such sex-effect since an edge population, even though urban, could still pose novel challenges—for example, by requiring grackles to learn novel daily temporal foraging patterns such as when and where garbage is collected (grackles appear to track this food resource: Rodrigo et al. 2021 [DOI: 10.1101/2021.06.14.448443]). We will make sure to better introduce this important conceptual information in our revision.

      Reinforcement learning mechanisms:

      Although the authors' title, abstract, and conclusions emphasize the importance of variation in 'risk sensitivity', most readers in this field will very possibly misunderstand what this means biologically. Both the authors' use of the term 'risk sensitivity' and their statistical methods for measuring this concept have potential problems.

      Please see our below responses concerning our risk-sensitivity term

      First, most behavioral ecologists think of risk as predation risk which is not considered in this paper. Secondarily, some might think of risk as uncertainty. Here, as discussed in more detail below, the 'risk sensitivity' parameter basically influences how strongly an option's attractiveness affects the animal's choice of that option. They say that this is in line with foraging theory (Stephens and Krebs 2019) where sensitivity means seeking higher expected payoffs based on prior experience. To me, this sounds like 'reward sensitivity', but not what most think of as 'risk sensitivity'. This problem can be easily fixed by changing the name of the term.

      We apologise for not clearly introducing the field of risk-sensitive foraging, which focuses on how animals evaluate and choose between distinct food options, and how such foraging decisions are influenced by pay-off variance i.e., risk associated with alternative foraging options (seminal reviews: Bateson 2002 [DOI: 10.1079/PNS2002181]; Kacelnik & Bateson 1996 [DOI: 10.1093/ICB/36.4.402]). We further apologise for not clearly explaining how our lambda parameter estimates such risk-sensitive foraging. To do so here, we need to consider our Bayesian reinforcement learning model in full. This model uses observed choice-behaviour during reinforcement learning to infer our phi (informationupdating) and lambda (risk-sensitivity) learning parameters. Thus, payoffs incurred through choice simultaneously influence estimation of each learning parameter—that is, in a sense, they are both sensitive to rewards. But phi and lambda differentially direct any reward sensitivity back on choicebehaviour due to their distinct definitions (we note this does not imply that the two cannot influence one another i.e., co-vary on the latent scale). Glossing over the mathematics, for phi, stronger reward sensitivity (bigger phi values) means faster internal updating about stimulus-reward pairings, which translates behaviourally into faster learning about ‘what to choose’. For lambda, stronger reward sensitivity (bigger lambda values) means stronger internal determinism about seeking the non-risk foraging option (i.e., the one with the higher expected payoffs based on prior experience), which translates behaviourally into less choice-option switching i.e., ‘playing it safe’. We hope this information, which we will incorporate into our revision, clarifies the rationale and mechanics of our reinforcement learning model, and why lamba measures risk-sensitivity.

      In addition, however, the parameter does not measure sensitivity to rewards per se - rewards are not in equation 2. As noted above, instead, equation 2 addresses the sensitivity of choice to the attraction score which can be sensitive to rewards, though in complex ways depending on the updating parameter. Second, equations 1 and 2 involve one specific assumption about how sensitivity to rewards vs. to attraction influences the probability of choosing an option. In essence, the authors split the translation from rewards to behavioral choices into 2 steps. Step 1 is how strongly rewards influence an option's attractiveness and step 2 is how strongly attractiveness influences the actual choice to use that option. The equation for step 1 is linear whereas the equation for step 2 has an exponential component. Whether a relationship is linear or exponential can clearly have a major effect on how parameter values influence outcomes. Is there a justification for the form of these equations? The analyses suggest that the exponential component provides a better explanation than the linear component for the difference between males and females in the sequence of choices made by birds, but translating that to the concepts of information updating versus reward sensitivity is unclear. As noted above, the authors' equation for reward sensitivity does not actually include rewards explicitly, but instead only responds to rewards if the rewards influence attraction scores. The more strongly recent rewards drive an update of attraction scores, the more strongly they also influence food choices. While this is intuitively reasonable, I am skeptical about the authors' biological/cognitive conclusions that are couched in terms of words (updating rate and risk sensitivity) that readers will likely interpret as concepts that, in my view, do not actually concur with what the models and analyses address.

      To answer the Reviewer’s question—yes, these equations are very much standard and the canonical way of analysing individual reinforcement learning (see: Ch. 15.2 in Computational Modeling of Cognition and Behavior by Farrell & Lewandowsky 2018 [DOI: 10.1017/CBO9781316272503]; McElreath et al. 2008 [DOI: 10.1098/rstb/2008/0131]; Reinforcement Learning by Sutton & Barto 2018). To provide a “justification for the form of these equations'', equation 1 describes a convex combination of previous values and recent payoffs. Latent values are updated as a linear combination of both factors, there is no simple linear mapping between payoffs and behaviour as suggested by the reviewer. Equation 2 describes the standard softmax link function. It converts a vector of real numbers (here latent values) into a simplex vector (i.e., a vector summing to 1) which represents the probabilities of different outcomes. Similar to the logit link in logistic regression, the softmax simply maps the model space of latent values onto the outcome space of choice probabilities which enter the categorial likelihood distribution. We can appreciate how we did not make this clear in our manuscript by not highlighting the standard nature of our analytical approach. We will do better in our revision. As far as what our reinforcement learning model measures, and how it relates cognition and behaviour, please see our previous response.

      To emphasize, while the authors imply that their analyses separate the updating rate from 'risk sensitivity', both the 'updating parameter' and the 'risk sensitivity' parameter influence both the strength of updating and the sensitivity to reward payoffs in the sense of altering the tendency to prefer an option based on recent experience with payoffs. As noted in the previous paragraph, the main difference between the two parameters is whether they relate to behaviour linearly versus with an exponential component.

      Please see our two earlier responses on the mechanics of our reinforcement learning model.

      Overall, while the statistical analyses based on equations (1) and (2) seem to have identified something interesting about two steps underlying learning patterns, to maximize the valuable conceptual impact that these analyses have for the field, more thinking is required to better understand the biological meaning of how these two parameters relate to observed behaviours, and the 'risk sensitivity' parameter needs to be re-named.

      Please see our earlier response to these suggestions.

      Agent-based simulations:

      The authors estimated two learning parameters based on the behaviour of real birds, and then ran simulations to see whether computer 'birds' that base their choices on those learning parameters return behaviours that, on average, mirror the behaviour of the real birds. This exercise is clearly circular. In old-style, statistical terms, I suppose this means that the R-square of the statistical model is good. A more insightful use of the simulations would be to identify situations where the simulation does not do as well in mirroring behaviour that it is designed to mirror.

      Based on the Reviewer’s summary of agent-based forward simulation, we can see we did a poor job explaining the inferential value of this method—we apologise. Agent-based forward simulations are posterior predictions, and they provide insight into the implied model dynamics and overall usefulness of our reinforcement learning model. R-squared calculations are retrodictive, and they say nothing about the causal dynamics of a model. Specifically, agent-based forward simulation allows us to ask—what would a ‘new’ grackle ‘do’, given our reinforcement learning model parameter estimates? It is important to ask this question because, in parameterising our model, we may have overlooked a critical contributing mechanism to grackles’ reinforcement learning. Such an omission is invisible in the raw parameter estimates; it is only betrayed by the parameters in actu. Agent-based forward simulation is ‘designed’ to facilitate this call to action—not to mirror behavioural results. The simulation has no apriori ‘opinion’ about computer ‘birds’ behavioural outcomes; rather, it simply assigns these agents random phi and lambda draws (whilst maintaining their correlation structure), and tracks their reinforcement learning. The exercise only appears circular if no critical contributing mechanism(s) went overlooked—in this case computer ‘birds’ should behave similar to real birds. A disparate mapping between computer ‘birds’ and real birds, however, would mean more work is needed with respect to model parameterisation that captures the causal, mechanistic dynamics behind real birds’ reinforcement learning (for an example of this happening in the human reinforcement learning literature, see Deffner et al. 2020 [DOI: 10.1098/rsos.200734]). In sum, agent-based forward simulation does not access goodness-of-fit—we assessed the fit of our model apriori in our preregistration (https://osf.io/v3wxb)—but it does assess whether one did a comprehensive job of uncovering the mechanistic basis of target behaviour(s). We will work to make the above points on the insight afforded by agent-based forward simulation explicitly clear in our revision.

      Reviewer #2 (Public Review):

      Summary:

      The study is titled "Leading an urban invasion: risk-sensitive learning is a winning strategy", and consists of three different parts. First, the authors analyse data on initial and reversal learning in Grackles confronted with a foraging task, derived from three populations labeled as "core", "middle" and "edge" in relation to the invasion front. The suggested difference between study populations does not surface, but the authors do find moderate support for a difference between male and female individuals. Secondly, the authors confirm that the proposed mechanism can actually generate patterns such as those observed in the Grackle data. In the third part, the authors present an evolutionary model, in which they show that learning strategies as observed in male Grackles do evolve in what they regard as conditions present in urban environments.

      Strengths:

      The manuscript's strength is that it combines real learning data collected across different populations of the Great-tailed grackle (Quiscalus mexicanus) with theoretical approaches to better understand the processes with which grackles learn and how such learning processes might be advantageous during range expansion. Furthermore, the authors also take sex into account revealing that males, the dispersing sex, show moderately better reversal learning through higher reward-payoff sensitivity. I also find it refreshing to see that the authors took the time to preregister their study to improve transparency, especially regarding data analysis.

      Thank you—we are pleased to receive this positive evaluation, particularly concerning our efforts to improve scientific transparency via our study’s preregistration (https://osf.io/v3wxb).

      Weaknesses:

      One major weakness of this manuscript is the fact that the authors are working with quite low sample sizes when we look at the different populations of edge (11 males & 8 females), middle (4 males & 4 females), and core (17 males & 5 females) expansion range. Although I think that when all populations are pooled together, the sample size is sufficient to answer the questions regarding sex differences in learning performance and which learning processes might be used by grackles but insufficient when taking the different populations into account.

      In Bayesian statistics, there is no strict lower limit of required sample size as the inferences do not rely on asymptotic assumptions. With inferences remaining valid in principle, low sample size will of course be reflected in rather uncertain posterior estimates. We note all of our multilevel models use partial pooling on individuals (the random-effects structure), which is a regularisation technique that generally reduces the inference constraint imposed by a low sample size (see Ch. 13 in Statistical Rethinking by Richard McElreath [PDF: https://bit.ly/3RXCy8c]). We further note that, in our study preregistration (https://osf.io/v3wxb), we formally tested our reinforcement learning model for different effect sizes of sex on learning for both target parameters (phi and lambda) across populations, using a similarly modest N (edge: 10 M, 5 F; middle: 22 M, 5 F ; core: 3 M, 4 F) to our actual final N, that we anticipated to be our final N at that time. This apriori analysis shows our reinforcement learning model: (i) detects sex differences in phi values >= 0.03 and lambda values >= 1; and (ii) infers a null effect for phi values < 0.03 and lambda values < 1 i.e., very weak simulated sex differences (see Figure 4 in https://osf.io/v3wxb). Thus, both of these points together highlight how our reinforcement learning model allows us to say that across-population null results are not just due to small sample size. Nevertheless the Reviewer is not wrong to wonder whether a bigger N might change our population-level results (it might; so might much-needed population replicates—see L270), but our Bayesian models still allow us to learn a lot from our current data.

      Another weakness of this manuscript is that it does not set up the background well in the introduction. Firstly, are grackles urban dwellers in their natural range and expand by colonising urban habitats because they are adapted to it? The introduction also fails to mention why urban habitats are special and why we expect them to be more challenging for animals to inhabit. If we consider that one of their main questions is related to how learning processes might help individuals deal with a challenging urban habitat, then this should be properly introduced.

      In L53–56 we introduce that the estimated historical niche of grackles is urban environments, and that shifts in habitat breadth—e.g., moving into more arid, agricultural environments—is the estimated driver of their rapid North American colonisation. We will work towards flushing out how urban-imposed challenges faced by grackles, such as the wildlife management efforts introduced in L64–65, may apply to animals inhabiting urban environments more broadly.

      Also, the authors provide a single example of how learning can differ between populations from more urban and more natural habitats. The authors also label the urban dwellers as the invaders, which might be the case for grackles but is not necessarily true for other species, such as the Indian rock agama in the example which are native to the area of study. Also, the authors need to be aware that only male lizards were tested in this study. I suggest being a bit more clear about what has been found across different studies looking at: (1) differences across individuals from invasive and native populations of invasive species and (2) differences across individuals from natural and urban populations.

      We apologise for not specifying that the review we cite in L42 by Lee & Thornton (2021) covers additional studies on cognition in both urban invasive species as well as urban-dwellers versus nonurban counterparts—we will remedy this omission in our revision. We will also revise our labelling of the lizard species. We are aware only male lizards were tested but this information is not relevant to substantiating our use of this study; that is, to highlight that learning can differ between urban-dwelling and non-urban counterparts. Finally, the Reviewer’s general suggestion is a good one—we will work to add this biological clarity to our revision.

      Finally, the introduction is very much written with regard to the interaction between learning and dispersal, i.e. the 'invasion front' theme. The authors lay out four predictions, the most important of which is No. 4: "Such sex-mediated differences in learning to be more pronounced in grackles living at the edge, rather than the intermediate and/or core region of their range." The authors, however, never return to this prediction, at least not in a transparent way that clearly pronounces this pattern not being found. The model looking at the evolution of risk-sensitive learning in urban environments is based on the assumption that urban and natural environments "differ along two key ecological axes: environmental stability 𝑢 (How often does optimal behaviour change?) and environmental stochasticity 𝑠 (How often does optimal behaviour fail to pay off?). Urban environments are generally characterised as both stable (lower 𝑢) and stochastic (higher 𝑠)". Even though it is generally assumed that urban environments differ from natural environments the authors' assumption is just one way of looking at the differences which have generally not been confirmed and are highly debated. Additionally, it is not clear how this result relates to the rest of the paper: The three populations are distinguished according to their relation to the invasion front, not with respect to a gradient of urbanization, and further do not show a meaningful difference in learning behaviour possibly due to low sample sizes as mentioned above.

      Thank you for highlighting a gap in our reporting clarity. We will take care in our revision to transparently report our null result regarding our fourth prediction; more specifically, that we did not detect meaningful behavioural or mechanistic population-level differences in grackles’ learning. Regarding our evolutionary model, we agree with the Reviewer that this analysis is only one way of looking at the interaction between learning phenotype and apparent urban environmental characteristics. Indeed, in L282–288 we state: “Admittedly, our evolutionary model is not a complete representation of urban ecology dynamics. Relevant factors—e.g., spatial dynamics and realistic life histories—are missed out. These omissions are tactical ones. Our evolutionary model solely focuses on the response of reinforcement learning parameters to two core urban-like (or not) environmental statistics, providing a baseline for future study to build on”. But we can see now that ‘core’ is too strong a word, and instead ‘supposed’, ‘purported’ or ‘theorised’ would be more accurate—we will revise our wording. As far as how our evolutionary results relate to the rest of the paper, these results suggest successful urban living should favour risk-sensitive learning, and our other analyses in our paper reveal male grackles—the dispersing sex in this historically urban-dwelling and currently urban-invading species—show pronounced risk-sensitive learning, so it appears risk-sensitive learning is a winning strategy for urban-invading male grackles and urban-invasion leaders more generally (we note, of course, other factors undoubtedly contribute to grackles’ urban invasion success, as discussed in ‘Ideas and speculation’; see also our first response to R1). We will work to make these links clearer in our revision. Finally, please see our above response on the inferential sufficiency of our sample size.

      In conclusion, the manuscript was well written and for the most part easy to follow. The format of eLife having the results before the methods makes it a bit harder to follow because the reader is not fully aware of the methods at the time the results are presented. It would, therefore, be important to more clearly delineate the different parts and purposes. Is this article about the interaction between urban invasion, dispersal, and learning? Or about the correct identification of learning mechanisms? Or about how learning mechanisms evolve in urban and natural environments? Maybe this article can harbor all three, but the borders need to be clear. The authors need to be transparent about what has and especially what has not been found, and be careful to not overstate their case.

      Thank you, we are pleased to read that the Reviewer found our manuscript to be generally digestible. In our revision, we will work to add further clarity, and to temper our tone.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1 (Public Review):

      This manuscript tried to answer a long-standing question in an important research topic. I read it with great interest. The quality of the science is high, and the text is clearly written. The conclusion is exciting. However, I feel that the phenotype of the transgenic line may be explained by an alternative idea. At least, the results should be more carefully discussed.

      We thank the reviewer #1 for his/her comments that helped to improve the manuscript. We have incorporated changes to reflect the suggestions provided by the reviewer. Here is a point-by-point response to the reviewer's specific and other minor comments.

      Specific comments:

      1) Stability or activity (Fv/Fm) was not affected in PSII with the W14F mutation in D1. If W14F really represents the status of PSII with oxidized D1, what is the reason for the degradation of almost normal D1?

      In this study, we used W14F mutation to mimic Trp-14 oxidation. The W14F mutant did not affect the stability and photosynthetic activity under normal growth conditions. However, the W14F mutant showed increased D1 degradation and reduced Fv/Fm values under high light. These results suggested that the W14F mutant has almost normal D1 protein stability under growth light conditions, as pointed out by the reviewer.

      However, it should be noted that D1 protein in the W14F strain rapidly degraded under high light. In the discussion part, we mentioned the possibility that other OPTMs may have additive effects on D1 degradation. Synergistic effects such as different amino acid oxidations may cause D1 degradation, and among those oxidative damages, W14 oxidation would be a key signal for D1 degradation by FtsH.

      2) To focus on the PSII in which W14 is oxidized, this research depends on the W14F mutant lines. It is critical how exactly the W-to-F substitution mimics the oxidized W. The authors tried to show it in Figure 5. Because of the technical difficulty, it may be unfair to request more evidence. But the paper would be more convincing with the results directly monitoring the oxidized D1 to be recognized by FtsH.

      We agree that confirming the direct interaction of oxidized D1 protein with FtsH provides more robust evidence. However, since FtsH progressively degrades the trapped substrate, it would be quite a challenging attempt to capture that moment. There are also technical limitations to obtaining sufficient substrate using Co-IP to compare its oxidation state. We included your suggested point in the discussion part. Thank you for your valuable suggestion.

      3) Figure 3. If the F14 mimics the oxidized W14 and is sensed by FtsH, I would expect the degradation of D1 even under the growth light. The actual result suggests that W14F mutation partially modifies the structure of D1 under high light and this structural modification of D1 is sensed by FtsH. Namely, high light may induce another event which is recognized by FtsH. The W14F is just an enhancer.

      Our results indicated that W14 oxidation is one of the keys to D1 degradation. On the other hand, we agree with the possibility that the reviewer points out. There is the possibility that factors other than W14 may act synergistically to promote D1 degradation. High light triggered more D1 degradation in W14F, suggesting that unknown factor(s) may be required for D1 degradation, e.g., oxidative modification at other sites and/or conformational changes of PSII under the high light. However, the current data that we have cannot reveal. We have incorporated the reviewer's comment and discussed it in the discussion part.

      Reviewer #2 (Public Review):

      In their manuscript, Kato et al investigate a key aspect of membrane protein quality control in plant photosynthesis. They study the turnover of plant photosystem II (PSII), a hetero-oligomeric membrane protein complex that undertakes the crucial light-driven water oxidation reaction in photosynthesis. The formidable water oxidation reaction makes PSII prone to photooxidative damage. PSII repair cycle is a protein repair pathway that replaces the photodamaged reaction center protein D1 with a new copy. The manuscript addresses an important question in PSII repair cycle - how is the damaged D1 protein recognized and selectively degraded by the membrane-bound ATP-dependent zinc metalloprotease FtsH in a processive manner? The authors show that oxidative post-translational modification (OPTM) of the D1 N-terminus is likely critical for the proper recognition and degradation of the damaged D1 by FtsH. Authors use a wide range of approaches and techniques to test their hypothesis that the singlet oxygen (1O2)-mediated oxidation of tryptophan 14 (W14) residue of D1 to N-formylkynurenine (NFK) facilitates the selective degradation of damaged D1. Overall, the authors propose an interesting new hypothesis for D1 degradation and their hypothesis is supported by most of the experimental data provided. The study certainly addresses an elusive aspect of PSII turnover and the data provided go some way in explaining the light-induced D1 turnover. However, some of the data are correlative and do not provide mechanistic insight. A rigorous demonstration of OPTM as a marker for D1 degradation is yet to be made in my opinion. Some strengths and weaknesses of the study are summarized below:

      We thank reviewer #2 for his/her comments that helped to improve the manuscript. We have incorporated changes to reflect the suggestions pointed out as weaknesses by reviewer #2. Other minor comments were also answered in a point-by-point response.

      Strengths:

      1) In support of their hypothesis, the authors find that FtsH mutants of Arabidopsis have increased OPTM, especially the formation of NFK at multiple Trp residues of D1 including the W14; a site-directed mutation of W14 to phenylalanine (W14F), mimicking NFK, results in accelerated D1 degradation in Chlamydomonas; accelerated D1 degradation of W14F mutant is mitigated in an ftsH1 mutant background of Chlamydomonas; and that the W14F mutation augmented the interaction between FtsH and the D1 substrate.

      2) Authors raise an intriguing possibility that the OPTM disrupts the hydrogen bonding between W14 residue of D1 and the serine 25 (S25) of PsbI. According to the authors, this leads to an increased fluctuation of the D1 N-terminal tail, and as a consequence, recognition and binding of the photodamaged D1 by the protease. This is an interesting hypothesis and the authors provide some molecular dynamics simulation data in support of this. If this hypothesis is further supported, it represents a significant advancement.

      3) The interdisciplinary experimental approach is certainly a strength of the study. The authors have successfully combined mass spectrometric analysis with several biochemical assays and molecular dynamics simulation. These, together with the generation of transplastomic algal cell lines, have enabled a clear test of the role of Trp oxidation in selective D1 degradation.

      4) Trp oxidative modification as a degradation signal has precedent in chloroplasts. The authors cite the case of 1O2 sensor protein EXECUTER 1 (EX1), whose degradation by FtsH2, the same protease that degrades D1, requires prior oxidation of a Trp residue. The earlier observation of an attenuated degradation of a truncated D1 protein lacking the N-terminal tail is also consistent with authors' suggestion of the importance of the D1 N-terminus recognition by FtsH. It is also noteworthy that in light of the current study, D1 phosphorylation is unlikely to be a marker for degradation as posited by earlier studies.

      Weaknesses:

      1) The study lacks some data that would have made the conclusions more rigorous and convincing. It is unclear why the level of Trp oxidation was not analyzed in the Chlamydomonas ftsH 1-1 mutant as done for the var 2 mutant. Increased oxidation of W14 OPTM in Chlamydomonas ftsH 1-1 is a key prediction of the hypothesis.

      We thank the reviewer for this valuable comment. We agree with the reviewer that the analysis of oxidized Trp level will reinforce the importance of Trp oxidation in the N-terminal of D1. In our preliminary experiment, we observed a trend toward increase of the kynurenine in Trp-14 in Chlamydomonas ftsH1-1 strain. However, we found large errors, and we could not conclude that this trend is significant. A possible reason for the large error was that the signal intensity of oxidized Trp was insufficient for quantification in a series of Chlamydomonas experiment. In addition, the fact that the amount of D1 in each culture was not stable also might be one reason. On the other hand, we keep note of a previous result that more fragmentation of D1 protein was observed in the Chlamydomonas ftsH1-1 mutant compared to that in Arabidopsis (Malnoë et al., Plant Cell 2014). This result suggests that an alternative D1 degradation pathway involving other proteases is more active in the Chlamydomonas ftsH1-1 mutant than in Arabidopsis var2 mutant. Furthermore, the Chlamydomonas ftsH1-1 mutant, caused by an amino acid substitution, still has a significant FtsH1/FtsH2 heterohexamer, and the level of FtsH1 and FtsH2 proteins increases significantly under high light irradiation. This is a significant difference from the Arabidopsis var2 mutant lacking FtsH2 subunit and showed reduced protein accumulation. These factors may explain to the lower detection levels of oxidized Trp in Chlamydomonas. We believe that improved sensitivity for detection of oxidized Trp peptides and more sophisticated experimental systems could solve this issue in the future.

      It is also unclear to me what is the rationale for showing D1-FtsH interaction data only for the double mutant but not for the single mutant (W14F).

      We thank the reviewer for the comment. As suggested by the reviewer, the analysis of the mutant crossing ftsH and W14F single mutation will provide more convincing evidence. Fig.3 showed that the photosensitivity in both W14F and W14FW317F was caused by the enhanced D1 degradation observed, which was due to the W14F mutation. Therefore, we crossed the ftsH mutant with W14FW317F, which has a more severe phenotype, to confirm whether FtsH is involved in this D1 degradation.

      Why is the FtsH pulldown of D2 not statistically significant (p value = {less than or equal to}0.1). Wouldn't one expect FtsH pulls down the RC47 complex containing D1, D2, and RC47. Probing the RC47 level would have been useful in settling this.

      For the immunoblot result of D2 and its statistical analysis, we answered in the following comment; No.2 in the reviewer's comment in Recommendations For The Authors.

      We agree with the reviewer's suggestion that further immunoblot analysis for CP47 protein would help our understanding of FtsH and RC47 interaction. Indeed, we attempted the immunoblot analysis of CP47 after the FtsH Co-IP experiment. However, the detection of CP43 protein was not sensitive enough. This reason may be due to the lower titer of the CP47 antibody compared to the D1 and D2 antibodies.

      A key proposition of the authors' is that the hydrogen bonding between D1 W14 and S25 of PsbI is disrupted by the oxidative modification of W14. Can this hypothesis be further tested by replacing the S25 of PsbI with Ala, for example?

      It is an interesting question whether amino acid substitution in PsbI-S25 affects the stability of D1-N-term and its degradation by FtsH. We would like to analyze the possibility in the future. We thank the reviewer for this helpful suggestion.

      2) Although most of the work described is in vivo analysis, which is desirable, some in vitro degradation assays would have strengthened the conclusions. An in vitro degradation assay using the recombinant FtsH and a synthetic peptide encompassing D1 N-terminus with and without OPTM will test the enhanced D1 degradation that the authors predict. This will also help to discern the possibility that whether CP43 detachment alone is sufficient for D1 degradation as suggested for cyanobacteria.

      In vitro experimental systems are interesting. However, FtsH is known to function as a hexamer, which has not yet been successfully reconstituted in vitro. Therefore, it would not be easy to perform an in vitro experimental system using the N-terminal synthetic peptide of D1 as a substrate. Thank you for your valuable suggestions.

      3) The rationale for analyzing a single oxidative modification (W14) as a D1 degradation signal is unclear. D1 N-terminus is modified at multiple sites. Please see Mckenzie and Puthiyaveetil, bioRxiv May 04 2023. Also, why is modification by only 1O2 considered while superoxide and hydroxide radicals can equally damage D1?

      We agree with the possibility that oxidative modifications in other amino acids are also involved in the D1 degradation, as pointed out by the reviewer. We also thank the reviewer for pointing us to the interesting article of Mckenzie and Puthiyaveetil et al. that showed additional oxidations occurred in the D1-Nterminus, which we had yet to be aware of when we submitted our manuscript. It will be interesting to see how these amino acid oxidations work with W14 oxidation on D1 degradation in the future. The oxidation of Trp by 1O2 can serve as a substrate for FtsH, as in the case of EX1, so we focused on the analysis of Trp oxidation. Single oxygen is believed to be the potential reactive species of Trp oxidation. However, the detected oxidative modifications in this study were not exactly sure depended on singlet oxygen. Thus, we changed several sentences that mention tryptophan oxidation by single oxygen.

      4) The D1 degradation assay seems not repeatable for the W14F mutant. High light minus CAM results in Fig. 3 shows a statistically significant decrease in D1 levels for W14F at multiple time points but the same assay in Fig. 4a does not produce a statistically significant decrease at 90 min of incubation. Why is this? Accelerated D1 degradation in the Phe mutant under high light is key evidence that the authors cite in support of their hypothesis.

      In Fig. 4a, the p-value comparing the D1 level at 90 min between control and W14F was 0.1075. This value is slightly larger than 0.1. The result that one of the control experiments showed a decrease in D1 level relative to 0 h might cause this value. Given that the D1 level of the remaining three of the four replicates was unchanged in the control experiments, it can be considered an outlier. We believe the results do not affect our hypothesis that the earlier D1 degradation is occurred in W14F.

      5) The description of results at times is not nuanced enough, for e.g. lines 116-117 state "The oxidation levels in Trp-14 and Trp-314 increased 1.8-fold and 1.4-fold in var2 compared to the wild type, respectively (Fig. 1c)" while an inspection of the figure reveals that modification at W314 is significant only for NFK and not for KYN and OIA.

      In this sentence, we described the result that is compared with the oxidized peptide levels calculated from all Trp-oxidized derivatives. However, as pointed out by the reviewer, it was not correct to explain the result of Fig.1C. We corrected the sentence following the reviewer's suggestion as below;“The levels of Trp-oxidized derivatives, OIA, NFK, and KYN in Trp-14 and the level of KYN in Trp-314 were significantly increased in var2 compared to the wild type, respectively (Fig. 1c). "

      Likewise, the authors write that CP43 mutant W353F has no growth phenotype under high light but Figure S6 reveals otherwise. The slow growth of this mutant is in line with the earlier observation made by Anderson et al., 2002.

      As pointed out by the reviewer, the growth of W353F seems to be a little slow under HL. We have changed our description of the result part. However, we still conclude that CP43 had little impact on the PSII repair, because the impaired growth in W353F is not as severe as those in W14F and W14F/W317F under HL

      In lines 162-163, the authors talk about unchanged electron transport in some site-directed mutants and cite Fig. 2c but this figure only shows chl fluorescence trace and nothing else.

      We agreed with the reviewer's suggestion and changed the sentence. In this study, we did not perform detailed photosynthetic analysis. Based on the analysis of phototrophic growth, oxygen-evolving activity, and Chl fluorescence, we concluded that overall photosynthetic activity was not a significant difference in the mutants.

      6) The authors rightly discuss an alternate hypothesis that the simple disassembly of the monomeric core into RC47 and CP43 alone may be sufficient for selective D1 degradation as in cyanobacteria. This hypothesis cannot yet be ruled out completely given the lack of some in vitro degradation data as mentioned in point 2. Oxidative protein modification indeed drives the disassembly of the monomeric core (Mckenzie and Puthiyaveetil, bioRxiv May 04 2023).

      Thanks for your suggestion. We added a discussion of PSII disassembly by ROS-induced oxidation to the discussion part, and the reference is added.

      Reviewer #3 (Public Review):

      Light energy drives photosynthesis. However, excessive light can damage (i.e., photo-damage) and thus inactivate the photosynthetic process. A major target site of photo-damage is photosystem II (PSII). In particular, one component of PSII, the reaction center protein, D1, is very suspectable to photo-damage, however, this protein is maintained efficiently by an elaborate multi-step PSII-D1 turnover/repair cycle. Two proteases, FtsH and Deg, are known to contribute to this process, respectively, by efficient degradation of photo-damaged D1 protein processively and endoproteolytically. In this manuscript, Kato et al., propose an additional step (an early step) in the D1 degradation/repair pathway. They propose that "Tryptophan oxidation" at the N-terminus of D1 may be one of the key oxidations in the PSII repair, leading to processive degradation of D1 by FtsH. Both, their data and arguments are very compelling.

      The D1 protein repair/degradation pathway in its simplest form can be defined essentially by five steps: (1) migration of damaged PSII core complex to the stroma thylakoid, (2) partial PSII disassembly of the PSII core monomer, (3) access of protease degrading damaged D1, (4) concomitant D1 synthesis, and (5) reassembly of PSII into grana thylakoid. An enormous amount of work has already been done to define and characterize these various steps. Kato et al., in this manuscript, are proposing a very early yet novel critical step in D1 protein turnover in which Tryptophan(Trp) oxidation in PSII core proteins influences D1 degradation mediated by FtsH.

      Using a variety of approaches, such as mass-spectrometry (Table 1), site-directed mutagenesis (Figures 2-4), D1 degradation assays (Figures 3, and 4), and simulation modeling (Figure 5), Kato et al., provide both strong evidence and reasonable arguments that an N-terminal Trp oxidation may be likely to be a 'key' oxidative post-translational modification (OPTM) that is involved in triggering D1 degradation and thus activating the PSII repair pathway. Consequently, from their accumulated data, the authors propose a scenario in which the unraveling of the N-terminal of the D1 protein facilitated by Trp oxidation plays a critical 'recognition' role in alerting the plant that the D1 protein is photo-damaged and thus to kick start the processive degradation pathway initiated possibly by FtsH. Coincidently, Forsman and Eaton-Rye (Biochemistry 2021, 60, 1, 53-63), while working with the thermophilic cyanobacterium, Thermosynechococcus vulcanus, showed that when the N-terminal DE-loop of the D1 protein is photo-damaged that occurs which may serve as a signal for PSII to undergo repair following photodamage. While the activation of the processive degradation pathways in Chlamydomonas versus Thermosynechococcus vulcanus have significant mechanistic differences, it's interesting to note and speculate that the stability of the N-terminal of their respective D1 proteins seems to play a critical role in 'signaling' the PSII repair system to be activated and initiate repair. But it's complicated. For instance, significant Trp oxidation also occurs on the lumen side of other PSII subunits which may also play a significant role in activating the repair processes as well. Indeed, Kato et al.,( Photosynthesis Research volume 126, pages 409-416 (2015)) proposed a two-step model whereby the primary event is disruption of a Mn-cluster in PSII on the lumen side.

      A secondary event is damage to D1 caused by energy that is absorbed by chlorophyll. But models adapt, change, and get updated. And the data provided by Kato et al., in this manuscript, gives us a unique glimpse/snapshot into the importance of the stability of the N-terminal during photo-damage and its role in D1-turnover. For instance, the author's use site-directed mutagenesis of Trp residues undergoing OPTM in the D1 protein coupled with their D1 degradation assays (Figure 3 and 4), provides evidence that Trp oxidation (in particular the oxidation of Trp14) in coordination with FtsH results in the degradation of D1 protein. Indeed, their D1 degradation assays coupled with the use of a ftsh mutant provide further significant support that Trp14 oxidation and FtsH activity are strongly linked. But for FstH to degrade D1 protein it needs to gain access to photo-damaged D1. FtsH access to D1 is achieved by having CP43 partially dissociate from the PSII complex. Hence, the authors also addressed the possibility that Trp oxidation may also play a role in CP43 disassembly from the PSII complex thereby giving FtsH access to D1. Using a site-directed mutagenesis approach, they showed that Trp oxidation in CP43 appeared to have little impact on the PSII repair (Supplemental Figure S6). This result shows that D1-Trp14 oxidation appears to be playing a role in D1 turnover that occurs after CP43 disassembly from the PSII complex. Alternatively, the authors cannot exclude the possibility that D1-Trp14 oxidation in some way facilitates CP43 dissociation. Further investigation is needed on this point. However, D1-Trp14 oxidation is causing an internal disruption of the D1 protein possibly at the N-terminus of the protein. Consequently, the role of Trp14 oxidation in disrupting the stability of the N-terminal domain of the D1 protein was analyzed computationally. Using a molecular dynamics approach (Figure 5), the authors attempted to create a mechanistic model to explain why when D1 protein Trp14 undergoes oxidation the N-terminal domain of D1protein becomes unraveled. Specifically, the authors propose that the interaction between D1 protein Trp14 with PsbI Ser25 becomes disrupted upon oxidation of Trp14. Consequently, the authors concluded from their molecular dynamics simulation analysis that " the increased fluctuation of the first α-helix of D1 would give a chance to recognize the photo-damaged D1 by FtsH protease". Hence, the author's experimental and computational approaches employed here develop a compelling early-stage repair model that integrates 1) Trp14 oxidation, 2) FtsH activation and 3) D1- turnover being initiated at its N-terminal domain. However, a word of caution should be emphasized here. This model is just a snapshot of the very early stages of the D1 protein turnover process. The data presented here gives us just a small glimpse into the unique relationship between Trp oxidation of the D1 protein which may trigger significant N-terminal structural changes of the D1 protein that both signals and provides an opportunity for FstH to begin protease digestion of the D1 protein.

      However, the authors go to great lengths in their discussion section to not overstate solely the role of Trp14 oxidation in the complicated process of D1 turnover. The authors certainly recognize that there are a lot of moving parts involved in D1 turnover. And while Trp14 oxidation is the major focus of this paper, the authors show in Supplemental Fig S4 the structural positions of various additional oxidized Trp residues in the Thermosynecoccocus vulcans PSII core proteins. Indeed, this figure shows that the majority of oxidized Trps are located on the luminal side of PSII complex clustered around the oxygen-evolving complex. So, while oxidized Trp14 may be involved in the early stages of D1 turnover certainly oxidized Trps on the lumen side are also more than likely playing a role in D1 turnover as well. To untangle this complex process will require additional research.

      Nevertheless, identifying and characterizing the role of oxidative modification of tryptophan (Trp) residues, in particular, Trp14, in the PSII core provides another critical step in an already intricate multi-step process of D1 protein turnover during photo-damage.

      We thank reviewer #3 for all the helpful comments and their supportive review of the manuscript.

      We thank the reviewer for raising this interesting study that ROS might disrupt the interaction between the PsbT and D1 in Thermosynechococcus vulcanus. The stroma-exposed DE-loop of D1 is one of the possible cleavage sites by Deg protease. Because the D1 cleavage by Deg facilitates the effective D1 degradation by FtsH under high-light conditions, it is interesting to elucidate Deg and FtsH cooperative D1 degradation further. We added this discussion in the manuscript. Other minor comments were also answered in a point-by-point response.

      Reviewer #1 (Recommendations For The Authors):

      Other minor points

      4) L227. How do you eliminate the possibility of reduced stability under high light?

      D1 synthesis under HL as pointed out by the reviewer was not tested in this study. Therefore, we can not rule out the possibility of a reduced D1 synthesis rate under HL in the mutant. However, the rate of D1 turnover(coordinated degradation and synthesis) is increased under HL. Since the pulse-labeling experiment is affected D1 degradation as well as D1 synthesis, even if there is a difference in the rate of D1 synthesis under HL, we can not clearly distinguish whether the cause of reduced labeling is the increased D1 degradation seen in the W14F mutant or the delay in D1 synthesis. We thank the reviewer for this valuable comment.

      5) Ls25-26. It would be quite rare that P680 directly absorbs light energy.

      We changed the sentence.

      6) L28. intrinsic antenna? Is this commonly used? core antenna?

      Corrected to “core antenna”

      7) Ls4143. Because the process is described as step iii), it is curious to mention it again as other critical steps.

      We removed the sentence.

      8) L75. Is it correct? Do you mean damage is caused by inhibition?

      We changed the sentence to “…the disorder of photosynthesis…”

      9) Figure 1c. +4, +16 and +32 should be explained in the legend.

      We added the explanation in the legend.

      10) Supplementary Figures S1 and S2. Title. Is it true that oxidation depends on singlet oxygen? This is a question. If it is not experimentally proved, modify the expression.

      In general, singlet oxygen (1O2) is believed to contribute in vivo oxidation of Trp. However, as suggested, these detected oxidative modifications were not exactly sure depends on singlet oxygen. Thus, we changed the title of Fig S1 and S2.

      11) Figure 3. Correct errors in + or - in the Figure.

      Corrected

      12) L328. Cyc > Cys.

      Corrected

      Reviewer #2 (Recommendations For The Authors):

      1) A few suggestions on typos and style:

      • Lines 2-3, please rephrase the sentence. The meaning is unclear.

      rephased the sentence to “Photosynthesis is one of the most …”

      • Lines 28-29, "Despite its orchestrated coordination...". Tautology.

      We changed the sentence.

      • Line 31, "...one, known as the PSII repair...". Please rewrite.

      We followed the reviewer suggestion and changed the sentence to “…synthesized one in the PSII repair.”

      • Line 49, "Their family proteins...". Rephrase.

      Rephrased the words.

      • Lines 64-66, please rewrite. I am not sure what the authors imply here. Are they talking about FtsH turnover or regulation of FtsH at the protein or gene level?

      FtsH itself is also degraded under high-light stress. To compensate for this, ftsH gene expression is upregulated and contributes to the proper FtsH level in thylakoid membranes. We rewrote the sentence as follows “increased turnover of FtsH is crucial for their function under high-light stress. That is compensated by upregulated FtsH gene expression”.

      • Line 68, "...to dislocate their substrates..."

      We changed the sentence to “to pull their substrates and push them into the protease chamber by ATPase activity”

      • Line 86, N-formylkymurenine => N-formylkynurenine

      Corrected

      • Lines 111-112, "Consistent with previous results...". Please specify which studies are being referred to and cite them if relevant.

      We added references.

      • Line 114, "...in extracts Arabidopsis..." => "...in extracts of Arabidopsis...".

      Corrected

      • Line 171, "influences in high-light sensitivity." Please rephrase.

      We rephrased the sentence.

      • Line 192, Fv/Fm. "v" and "m" should be subscripts.

      Corrected

      • Line 210, "...encounters...". Unclear meaning.

      We rephrased the sentence.

      • Line 358, hyphen usage. "fine-tuned". This sentence should be rewritten to make the role of phosphorylation clear. "Fine-tuning" is vague.

      We changed the sentence to “…spatiotemporal regulation of D1 degradation”

      • Fig. 6 legend, luminal => lumenal

      Changed to luminal

      2) The statistical notation used for some results is confusing. In Fig. 6b, "*" stands for p = {less than or equal to}0.1 while in fig. 4 it denotes p = {less than or equal to}0.05. If this is not a typo, this usage deviates from the standard one. How is a D2 change in Fig. 6b significant given its p value of {less than or equal to}0.1? The Fig. 6b key for D2 does not correspond with the histogram pattern.

      Thank you for your comments and suggestions. The asterisk in the Figure 6b is not a typo. We revised p value sign for less than 0.05 with a single asterisk to avoid confusion. While the case of p value in less than 0.1, we applied section sign “§” instead of the single asterisk sign to avoid confusion. Generally accepted p value to indicate statistically difference is less than 0.05. We found that D1 was p = 0.03322 and D2 was p = 0.07418. As we suspect these p value differences, the results for D2 protein detection were somewhat fluctuating while not in D1 protein detection as you commented. Still the reason of the fluctuating result of D2 signal intensity is not clear yet, we found the p value was between 0.05 and 0.10. We also rewrite the description in the corresponding result part.

      3) There are no error bars in Fig. 5d while the error bars in Fig. 5e show that there are no significant differences between Cβ distances of W14F and W14ox with WT contrary to the authors' assertion in the text (lines 254-255).

      The reason that there are no error bars in Fig. 5d. is because the fluctuation value in Fig. 5d was calculated from the entire trajectory (i.e., all snapshots) of the MD simulation. In contrast, the Cβ-Cβ distance value can be obtained at each individual snapshot of the simulation. Thus, Fig. 5e shows the averaged distances with the standard deviations (the error bars) over all these snapshots. To prevent any confusion for the reader, we have explicitly described “averaged Cβ-Cβ distance” and added an explanation of the error bars in the caption of Fig. 5e. It is important to note that our focus in the text (lines 254-255) was not on comparing the Cβ-Cβ distance of W14F with that of W14ox but the distance of W14F or W14ox with that of WT.

      4) Figure 3 legends and figure labels do not correspond. Fig. 3b should be labeled as High light - Chloramphenicol and likewise, fig 3c should read growth light + Chloramphenicol to be consistent with the legend.

      Corrected

      5) How are OPTM levels of D1 Trp residues normalized? Is it against unmodified peptides or total proteins?

      Oxidation levels of three oxidative variants of Trp in Trp14 and Trp317 containing peptides were obtained by label-free MS analysis. Fig.1 shows the intensity values of oxidized variants of Trp14 and Trp317. In this analysis, the levels of unoxidized peptides were not significantly changed between var2 and WT.

      6) Fig. 1a cartoon might need work. It looks like the oxygen atom in OIA is misplaced.

      Corrected

      Reviewer #3 (Recommendations For The Authors):

      In regard to Table 1, the sequence of the mass spectra fragment listed for Trp14 (i.e., ENSSL(W)AR ) in Table 1 is different from the sequence of the mass spectra fragment of Trp14 shown in Supplemental Figure S1 (i.e., ESESLWGR). Likewise, the sequence of the mass spectra fragment listed for Trp317 (i.e., VLNT(W)ADIINR ) in Table 1 is different from the sequence of the mass spectra fragment of Trp14 shown in Supplemental Figure S2 (i.e., VINTWADIINR). This discrepancy, I think can be simply explained.

      Table 1 shows the newly detected peptide of Trp oxidation in PSII core protein in Chlamydomonas. On the other hand, Figures S1 and S2 are the results of MS analysis used for the level of Trp oxidation analysis in Arabidopsis var2 mutant, as shown in Fig. 1C. To avoid confusion, we added in the supplemental figure title that it was detected in Arabidopsis.

      Labeling: In Figure 3, the figure legend states that b, high-light in the absence of CAM; but panel b, shows +CAM conditions. I think this labeling is incorrect and needs to be -CAM. Likewise, the figure legend states that c, growth-light in the presence of CAM. I think this labeling is incorrect and needs to be +CAM.

      Corrected

      This reviewer has a few comments/suggestions on the presentation of the sequence alignments showing the various positions of oxidized Trps within the D1(Figure 1), D2 and CP43 (Supplemental Figure S3) and CP47 (Supplemental Figure S3):

      The authors should consider highlighting in red all the various Trps shown in Table 1 with the corresponding alignments shown in Figure 1 for D1 protein and corresponding alignments in Supplemental Figure S3 (for D2 and CP43) and Supplemental Figure S3 continued (For CP47). Highlighting the locations of oxidized Trps across various species is very informative but as presented here the red labeling somewhat is haphazard, confusing and thus these figures lose some of their impact factor. For instance, in Supplementary Fig. S4, the reader can visualize the structural positions of oxidized Trp residues in the Thermosynecoccocus vulcanus PSII core proteins. When one then looks at the various alignments presented by the authors, one can see that other species have a similar arrangement of oxidized Trp residues as well. Consequently, when you now collectively look at the data presented in Table 1, Figure 1, Supplemental Figure S3 and Supplemental Figure S4, a picture emerges that illustrates how common the phenomenon of overall Trp oxidation is and more specifically how oxidized Trp14 across species is playing a similar role in possibly activating D1 turnover. I think these Figures, if presented in a more comprehensive and unified fashion, will really add to the paper.

      Thank you for your suggestion. In this study, we tried to show the identified oxidized Trp by the MS-MS analysis, the residue conservation in the sequences, and its position in the structure. Since we have to show a lot of information, combining them into one figure is difficult. We hope you understand the reason for this.

    1. Author Response

      The following is the authors’ response to the previous reviews.

      We are grateful for the helpful comments of both reviewers and have revised our manuscript with them in mind.

      One of the main issues raised was that readers may by default assume that our models are correct. We in fact made it very clear in our discussion that the models are merely hypotheses that will need testing by “wet” experiments and we do not therefore agree that even readers unfamiliar with AF would assume that the models must be correct. It was also suggested that readers could be reassured by including extensive confidence estimates such as PAE plots. As it happens, every single model described in the manuscript had reasonably high PAE scores and more crucially the entire collection of output files, including PAE data, are readily accessible on Figshare at https://doi.org/10.6084/m9.figshare.22567318.v2, a fact that the reviewers appear to have overlooked. The Figshare link is mentioned three times in the manuscript. Embedding these data within the manuscript itself would in our view add even more details and we have therefore not included them in our revised manuscript. Likewise, it is rather simple for any reader to work out which part of a PAE matrix corresponds to an interaction observed in the corresponding pdb prediction. Besides which, it is our view that the biological plausibility and explanatory power of models is just as important as AF metrics in judging whether they may be correct, as is indeed also the case for most experimental work.

      Another important point was that the manuscript was too long and not readable. Yes, it is long and it could well be argued that we could have written a different type of manuscript, focusing entirely on what is possibly the simplest and most important finding, namely that our AF models suggest that in animal cells Wapl appears to form a quarternary complex with SA, Pds5, and Scc1 in a manner suggesting that a key function of Wapl’s conserved CTD is to sequester Scc1’s Nterminal domain after it has dissociated from Smc3. For right or for wrong, we decided that this story could not be presented on its own but also required 1) an explanation for how Scc1 is induced to dissociate from Smc3 in the first place and 2) how to explain that the quarternary complex predicted for animal cells was not initially predicted for fungi such as yeast. The yeast situation was an exception that clearly needed explaining if the theory was to have any generality and it turned out that delving into the intricate details of the genetics of releasing activity in yeast was eventually required and yielded valuable new insights. We also believe that our work on the recruitment of Eco/Esco acetyl transferases to cohesin and the finding that sororin binds to the Smc3/Scc1 interface also provided important insight into how releasing activity is regulated. We acknowledge that the paper is indeed long but do not think that it is badly written. It is above all a long and complex story that in our view reveals numerous novel insights into how cohesin’s association with chromosomes is regulated and have endeavoured to eliminate any excessive speculation. We feel it is not our fault that cohesin uses complex mechanisms.

      Notwithstanding these considerations, we have in fact simplified a few sections and removed one or two others but acknowledge that we have not made substantial cuts.

      It was pointed out that a key feature of our modelling, namely the predicted association of Wapl’s C-terminal domain with SA/Scc3’s CES is inconsistent with published biochemical data. The AF predictions for this interface are universally robust in all eukaryotic lineages and crucially fully consistent with published and unimpeachable genetic data. We note that any model that explains all findings is bound to be wrong for the very simple reason that some of these findings will prove to be incorrect. There is therefore an art in Science of judging which data must be explained and accommodated and which should be ignored. In this particular case, we chose to ignore the biochemistry. Time will tell whether our judgement proves correct.

      Last but not least, it was suggested that we might provide some experimental support for our proposed SA/Scc3-Pds5-Scc1-WaplC quaternary complex. We are in fact working on this by introducing cysteine pairs (that can be crosslinked in cells) into the proposed interfaces but decided that such studies should be the topic of a subsequent publication. It would be impossible with the resources available to our labs to follow up all of the potential interactions and we therefore decided to exclude all such experiments.

      We are grateful for the detailed comments provided by both reviewers, many of which were very helpful, and in many but not all cases have amended the manuscript accordingly.

      With regard to the more specific comments:

      Reviewer #1 (Recommendations For The Authors):

      1) One concern is that observed interfaces/complexes arise because AF-multimer will aim to pack exposed, conserved and hydrophobic surfaces or regions that contain charge complementarity. The risk is that pairwise interaction screens can result in false positive & non-physiological interactions. It is therefore important to report the level of model confidence obtained for such AF calculations:

      A) The authors should color the key models according to pLDDT scores obtained as reported by AF. This would allow the reader to judge the estimated accuracy of the backbone and side chain rotamers obtained. At least for the key models and interactions it would be important to know if the pLDDT score is >90 (Correct backbone and most rotamers) or >70 (only backbone is correct).

      B) It would also be important to report the PAE plots to allow estimation of the expected position error for most of the important interactions. pLDDT coloring and PEA plots can be shown side-by-side as shown in other published data (e.g. https://pubmed.ncbi.nlm.nih.gov/35679397/ (Supplementary data)

      C) The authors should include a Table showing the confidence of template modeling scores for the predicted protein interfaces as ipTM, ipTM+pTM as reported by AlphaFold-multimer. Ideally, they would also include DockQ scores but this may not be essential. Addition of such scores would help classification into Incorrect, Acceptable or of high quality. For example, line 1073 et seq the authors show a model of a SCC1SA and ESCO1 complex (Fig. 37). Are the modeling scores for these interfaces high? It does not help that the authors show cartoons without side chains? Can the authors provide a close-up view of the two interfaces? Are the amino acids are indeed packed in a manner expected for a protein interface? Can we exclude the possibility that the prediction is obtained merely because the sequence segments (e.g. in ESCO1 & ESCO2) are hydrophobic and conserved?

      We do not agree that including this level of detail to the text/figures of the manuscript would be suitable. All the relevant data for those who may be sceptical about the models are readily available at https://doi.org/10.6084/m9.figshare.22567318.v2. In our view, the cartoon versions of the models are easier for a reader to navigate. Anyone interested in the molecular details can look at the models directly.

      Importantly, no amount of statistical analysis can completely validate these models. What is required are further experiments, which will be the topic of further work from our and I dare from other laboratories.

      D) When they predict an interaction between the SA2:SCC1 complex and Sororin's FGF motif, they find that only 1/5 models show an interaction and that the interaction is dissimilar to that seen of CTCF. Again, it would be helpful to know about modeling scores. Can they show a close-up view of the SORORIN FGF binding interface to see if a realistic binding mode is obtained? Can they indicate the relevant region on the PAE plot?

      Given that AF greatly favours other interactions of Sororin’s FGF motif over its interaction with SA2-Scc1, we do not agree that dwelling on the latter would serve any purpose.

      2) Line 996: AF predicts with high confidence an interaction between Eco1 & SMC3hd. What are the ipTM (& DockQ if available) scores. Would the interface score High, Medium or Acceptable?

      As mentioned, see https://doi.org/10.6084/m9.figshare.22567318.v2.

      3) Line 1034 et seq: Eco1/ESCO1/ESCO2 interaction with PDS5. Interface scores need to be shown to determine that the models shown are indeed likely to occur. If these interactions have low model confidence, Fig. 36 and discussion around potential relevance to PDS5-Eco1 orientation relative to the SMC3 head remains highly speculative and could be expunged.

      See https://doi.org/10.6084/m9.figshare.22567318.v2. It should be clear that the predictions are very similar in fungi and animals. Crucially, we know that Pds5 is essential for acetylation in vivo, so the models appear plausible from a biological point of view.

      4) Considering the relatively large interface between ECO1 and SMC3, would the author consider the possibility that in addition to acetylating SMC3's ATPase domain, ECO1 remains bound to cohesin-DNA complex, as proposed for ESCO1 by Rahman et al (10.1073/pnas.1505323112)?

      This is certainly possible but we would not want to indulge in such speculation.

      5) E.g. Line 875 but also throughout the text: As there is no labeling of the N- and C-termini in the Figures, is frequently unclear what the authors are referring to when they mention that AF models orient chains in a certain manner.

      Good point. This has been amended. However, the positions of N- and C- is all available at https://doi.org/10.6084/m9.figshare.22567318.v2.

      6) Fig19B: PAE plots: authors should indicate which chains correspond to A, B, C. Which segment corresponds to the TYxxxR[T/S]L motif? Can they highlight this section on the PAE plot?

      Good point and amended in the revised manuscript.

      Minor comments:

      1) Line 440: the WAPL YSR motif is not shown in Fig. 14A

      2) Line 691: Scc3 spelling error.

      3) Line 931: Sentence ending '... SCC3 (SCC3N).' requires citation.

      4) Line 1008: Figure reference seems wrong. It should read: Fig. 34A left and right. Fig. 34B does not contain SCC1.

      Many thanks for spotting these. Hopefully, all corrected.

      5) Fig. 41 can be removed as it shows the absence of the interaction of Sororin with SMC1:SCC1. Sufficient to mention in the text that Sororin does not appear to interact with SMC1:SCC1.

      This is possible but we decided to leave this as is.

      Reviewer #2 (Recommendations For The Authors):

      Minor points

      (1) Are there any predicted models in which one of the two dimer interfaces of the hinge is open when the coiled coils are folded back, as seen in the cryo-EM structure of human cohesin-NIPBL complex in the clamped state?

      No AF runs ever predicted half opened hinges. It is possible that the introduction of mutations in one of the two interfaces might reveal a half-opened state and we ought to try this. However, it would not be appropriate for this manuscript, we believe.

      (2) Structures of the SA-Scc1 CES bound to [Y/F]xF motifs from Sgo1 and CTCF have been reported, suggesting that a similar motif could interact with SA/Scc3. Surprisingly, AF did not predict an interaction between Scc3/SA and Wapl FGF motifs, which only bind to the Pds5 WEST region. On the other hand, AF predicted interactions of the Sororin FGF motif with both Pds5 WEST and SA CES. Can the authors comment on this Wapl FGF binding specificity? What will happen if a Wapl fragment lacking the CTD is used in the prediction?

      This seems to be an academic point as the CTD is always present.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1 (Public Review):

      The study as a concept is well designed, although there are two issues I see in the methodology (these may be just needing further explanation or if I am correct in my interpretation of what was done, may need reanalysis to take into account). Both issues relate to the data that was extracted from the published literature on zoonotic malaria prevalence in the study area.

      1) No limit was set on the temporal range

      With no temporal limit on the range of studies, the landscape in many cases will have changes between the study being conducted and the spatial data. This will be particularly marked in areas where there has been clearing since the zoonotic malaria prevalence study. Also, population changes (either through population growth, decline or movement) will have occurred. All research is limited in what it can do with the available data, so I realise that there may not be much the authors can do to correct this. One possible solution would be to look at the land use change at each site between the prevalence study and the remote sensing data. I'm not sure if this is feasible, but if it is I would recommend the authors attempt this as it will make their results stronger.

      Thank you for the comments. We agree that matching the date of remote sensing data to samples is particularly important for environmental variables that change rapidly (such as forest loss). To clarify, no limit was set on the date range of the studies identified from the literature to ensure no articles were excluded due to arbitrary date restrictions. We have edited the manuscript to clarify this (line 422). Regarding landscape and environmental features, remote sensing data was extracted annually for every year for the full date range of the data (see Table 1 and S11, annual temporal resolution from 2006 to 2020). Forest was then matched contemporaneously (see lines 467–473) meaning that, insofar as it was possible, forest data was extracted for the same year as the data was collected. Where a date range was given for the primate data, the mean year was used. For human population density, covariate data were extracted for multiple years but were found to be relatively stable over the time period for the sites covered, so median year was used (see Supplementary Information, Appendix E and Table S11). Elevation is stable and typically only one time point is used as reference (in this instance the SRTM 90m Digital Elevation model, 2003).

      2) Most studies only gave a geographic area or descriptive location.

      The spatial analysis was based on a 5km and 20km radius of the 'study site' location, but for many of the studies the exact site is not known. Therefore the 'study site' was artificially generated using a polygon centroid. Considering that the polygon could be an administrative boundary (i.e., district/state/country), this is an extremely large area for which a 5km radius circle in the middle of the polygon is being taken as representative of the 'study site'. This doesn't make sense as it assumes that the landscape is uniform across the district, which in most cases it will not be (in rural areas it is going to be a mixture of villages, forest, plantation, crops etc which will vary across the landscape). This might just be a case of misunderstanding what was done (in which case the text needs rewording to make it clearer) or if I have interpreted it correctly the selection of the centroid to represent the study area does not make sense. I am not sure how to overcome this as it probably not possible to get exact locations for the study sites. One possibility could be to make the remote sensing data the same scale as the prevalence data ie if the study site is only identifiable at the polygon level, then the remote sensing data (fragmentation, cover and population) is used at the polygon level.

      Both these issues could have an impact on the study's findings. I would think that in both cases it might make the relationship between the environmental variables and prevalence even clearer.

      We would like to thank the reviewer for their concerns and provide some clarification on the methods used to extract environmental variables:

      • Centroid was initially explored, but not pursued for the same concerns raised by the reviewer. Taking the centroid would be arbitrary and the central point of a large polygon is not likely to be representative of habitat across the entire sampling area and introduces error so this was not pursued(Cheng et al., 2021). We have clarified the wording in the manuscript with reference to centroids to avoid confusion on this point (line 491).

      • We demonstrate a method to account for the lack of precise geolocation by taking 10 ‘pseudo-sampling’ points instead of a single random location, with environmental variables extracted at 5, 10 and 20km for each site (lines 487-500). By including 10 environmental realisations, surveys conducted in smaller or more uniform landscapes will have more consistent covariates and this will lend more weight to the model. Conversely, samples taken from large administrative polygons are likely to be highly variable, and these associations will have less representation in the final model. This approach was used to demonstrate an alternative to using a single arbitrary site to represent the area.

      To further support the validity of this technique:

      • Figures illustrating the variance of the environmental variables across the 10 sampling sites at 5, 10 and 15km for GADM administrative classifications at country level (GID0), state (GID1), district (GID2) and exact coordinates (GPS) are now included in the SI (Figure S12).

      • Sensitivity analyses were conducted, in which final GLMM models were fit again but using only acceptable levels of variance in environmental variables and/or acceptable size of administrative boundary (Table S15 and S16). In sensitivity analyses, forest cover and fragmentation retained a significant effect on prevalence of P. knowlesi in macaques, suggesting this effect is robust to spatial uncertainty.

      We would also like to highlight that the main finding of this research is the novel synthesis of regional prevalence of P. knowlesi in simian reservoirs across Southeast Asia, which was formerly assumed to be ubiquitous high prevalence, and which can now be used to inform regionally specific transmission modelling, better estimate spatial risk and parameterise early warning systems for P. knowlesi malaria in countries approaching elimination of human malarias. The risk factor analysis here is provided to begin to understand what may be driving this geographic heterogeneity in P. knowlesi prevalence at finer scales and demonstrate methods that could be used to accommodate spatial uncertainty in secondary data. We appreciate that this may not have been clear and have edited the manuscript accordingly.

      Reviewer #2 (Public Review):

      This is the first comprehensive study aimed at assessing the impact of landscape modification on the prevalence of P. knowlesi malaria in non-human primates in Southeast Asia. This is a very important and timely topic both in terms of developing a better understanding of zoonotic disease spillover and the impact of human modification of landscape on disease prevalence.

      This study uses the meta-analysis approach to incorporate the existing data sources into a new and completely independent study that answers novel research questions linked to geospatial data analysis. The challenge, however, is that neither the sampling design of previous studies nor their geospatial accuracy are intended for spatially-explicit assessments of landscape impact. On the one hand, the data collection scheme in existing studies was intentionally opportunistic and does not represent a full range of landscape conditions that would allow for inferring the linkages between landscape parameters and P. knowlesi prevalence in NHP across the region as a whole. On the other hand, the absolute majority of existing studies did not have locational precision in reporting results and thus sweeping assumptions about the landscape representation had to be made for the modeling experiment. Finally, the landscape characterization was oversimplified in this study, making it difficult to extract meaningful relationships between the NHP/human intersection on the landscape and the consequences for P. knowlesi malaria transmission and prevalence.

      Thank you for the feedback on the manuscript. We agree that the data was not originally intended for spatial assessment of landscape impact nor represents a full range of landscape conditions across the region. However, we would like to highlight the first set of results from the meta-analysis. Here, the synthesis of all available data allows for the detection of regional disparities and geographic heterogeneity of prevalence in host species, which individual small-scale opportunistic studies are not powered to do, and which had not been identified before this investigation.

      In this context, the risk factor analysis is an exploratory analysis to understand what may be driving the observed geographic variation at broad scales as well as provide a framework for dealing with spatial uncertainty. Landscape data was extracted at a level deemed appropriate given the limitations of the data. The majority were geolocated to district level and sensitivity analysis showed a reasonable consistency of landscape features at our chosen scales (Table S8, Figure S12A). To address some of these concerns, we conducted further analysis to explore the deviation of environmental covariates in each sampling area and ran sensitivity analysis by removing extremely variable datapoints (Table S15 and Table S16). When removing highly uncertain data and/or countrylevel data, effects of canopy cover on non-human primate malaria prevalence is retained, supporting the original findings.

      Despite many study limitations, the authors point to the critical importance of understanding vector dynamics in fragmented forested landscapes as the likely primary driver in enhanced malaria transmission. This is an important conclusion particularly when taken together with the emerging evidence of substantially different mosquito biting behaviors than previously reported across various geographic regions.

      Another important component of this study is its recognition and focus on the value of geospatial analysis and the availability of geospatial data for understanding complex human/environment interactions to enable monitoring and forecasting potential for zoonotic disease spillover into human populations. More multi-disciplinary focus on disease modeling is of crucial importance for current and future goals of eliminating existing and preventing novel disease outbreaks.

      Reviewer #1 (Recommendations For The Authors):

      A couple of minor points

      1) Was the human density and forest cover correlated? If so was this taken into account

      Human density and forest cover at selected scales were not found to be strongly correlated (Spearman’s rank values -0.38 and -0.45 within 5km and 20km buffer radii for human population density respectively).

      In selecting variables for inclusion in the final model, we examined variance inflation factors (VIF) to detect and minimise multicollinearity in the model. VIF measures the correlation and strength of correlation between independent predictors. VIF of each predictor variable was examined starting with a saturated model and sequentially excluding the variable with the highest VIF score from the model. Stepwise selection continued until the entire subset of explanatory variables in the global model satisfied a conservative threshold of VIF ≤6 (Rogerson, 2001), which ensures that the remaining variables included in the final model have minimal correlation. Spearman’s correlation matrices for all variables at all scales and final selected variables (below VIF threshold) are included in the Supplementary Information (Figure S13 and Figure S14).

      2) Reference (Speldewinde et al., 2019) is down as Davidson et al. in the reference list

      Thank you for the thoroughness in this review. There are two similar but separate references, both published in 2019 with the same co-authors, and the (Speldewinde et al, 2019) was incorrectly referenced. They should be (Davidson et al., 2019a) and Davidson et al., 2019b) respectively. This has now been corrected in the manuscript.

      Davidson, G., Chua, T.H., Cook, A. et al. Defining the ecological and evolutionary drivers of Plasmodium knowlesi transmission within a multi-scale framework. Malar J 18, 66 (2019). https://doi.org/10.1186/s12936-019-2693-2

      Davidson G, Chua TH, Cook A, Speldewinde P, Weinstein P. The Role of Ecological Linkage Mechanisms in Plasmodium knowlesi Transmission and Spread. Ecohealth. 2019;16(4):594-610. https://doi:10.1007/s10393-019-01395-6

      Reviewer #2 (Recommendations For The Authors):

      Line 143: "We hypothesise that higher prevalence of P. knowlesi in primate host species is driven by landscape change..." without specifying here the kind of landscape change (e.g. "forest degradation and fragmentation") it is virtually impossible to confirm or reject this hypothesis.

      We agree that the wording of the hypotheses needed to be more specific. We have edited lines 142 – 145 to specify forest fragmentation as our landscape variable of interest, and to more explicitly include the regional meta-analysis of P. knowlesi prevalence.

      Table 1 vs Table S11 discrepancy regarding spatial resolution of Forest cover and fragmentation variables. The original dataset resolution is 30m but I don't think one can compute a PARA index at 30 m since it really requires a polygon that is larger than the single value pixel. Table S11 indicates a 30 km gridcell with some postprocessing of the original datasets.

      We appreciate this being identified. The resolution refers to the input layer (tree canopy cover, 30m). PARA was calculated from the binary forest cover layer (30m resolution) within each buffer radii 5, 10 and 20km. We have edited both Table 1 and Table S11 to help clarify this.

      It would be very helpful if you provided justification for selecting specific metrics to represent the key landscape variables. How are these particular landscape variables relevant? Why not other land cover/land use components?

      We have now included a paragraph in the Supplementary Information (Appendix D) to explain the choice of environmental covariates. Elevation was chosen as an important proxy for vector distribution (but was not retained in model selection). Human population density was chosen as a measure of proximity to human settlement, rather than relying on qualitative assessment of rural/peri-urban/urban. Tree canopy cover and fragmentation indices are key determinants of primate habitat selection and of vector breeding habitat, and justification for the use of perimeter: area ratio is included in the methods section (section beginning line 462).

      I think the other issues present substantial weaknesses that you cannot address without redoing the study. I will list those below just for reference.

      1) If the forest is so dominant (which I would agree with based on my understanding of macaque ecology), how does it make sense to select completely random points (especially at the country or even state level) to represent landscape covariates? At a minimum, I would suggest getting random points within the forest or better yet forest edge habitat. But even then, I doubt that these points would be at all representative of the conditions of a specific study. The geospatial uncertainty is just too large. The dataset simply doesn't support the analysis that is attempted here.

      On the point of selecting from only within forest: forest is a dominant habitat, but Long-tailed macaques are anthropophilic and not exclusively found in forest (Stark et al., 2019), and a proportion of the more opportunistic and nuisance samples caught were found in areas more associated with human activity (Li et al., 2021). As such, random points only within forested areas is also unlikely to capture the true habitat of the primates sampled and selecting only from forested areas would bias the results.

      Whilst fully georeferenced samples would be the ideal scenario, the idea behind selecting random points from the sampling polygon is that for smaller areas (with higher spatial certainty), habitat would be more consistent between random points and lend more weight to the final model, whereas large polygons with high uncertainty are likely to vary and lend less weight to the final model. In response to these comments, we have further supported this by running regression models only on samples within a reasonable administrative boundary size and on samples within reasonable threshold of uncertainty (i.e., data points are removed if the deviation of environmental covariates across the 10 random points is so high that the sample is uninformative, or if datapoints can only be geolocated to country-level). In these sensitivity analyses, forest cover and species are retained as factors associated with higher malarial prevalence in non-human primates (Table S15S16).

      2) Hansen et al. dataset reflects "tree cover" - which is not the same as "forest cover" since it would also include plantations that are very widely distributed across Southeast Asia. If the animal use of plantations differs from that of natural forests, it will present a large issue for the study.

      In this analysis the feature of interest was habitat configuration (fragmentation) and deforestation (forest loss) rather than specific land class. We have defined forest as >50% canopy cover, which considers canopy density given historical forest loss and has precedence in other work (Fornace et al.,, 2016). In addition to importance to macaque ecology, forest (canopy) cover, forest loss and forest edge are noted to be key determinants of vector breeding and vector habitat (Byrne et al., 2021, Chua et al., 2019). For this reason, these are important variables to include in analyses. More specific landscape variables were explored, but the temporal and spatial range of the data precluded fine-scale land classification data. To investigate preliminary links to landscape configuration and habitat fragmentation at broad scales this is felt to be sufficient. We have also amended the manuscript to be more discerning with the use of ‘forest’ to avoid confusion throughout.

      3) Tree regrowth in the ecosystems of monsoonal Asia is very rapid. Based on the study description, tree regrowth was not accounted for in the study which could potentially lead to a very large underestimation of tree cover if only tree loss since 2000 was monitored. Again unless there is a reason to assume that macaques do not use young successional forests or use it at a highly reduced rate. Both of these points are acknowledged as limitations at the end of the discussion section but in my opinion they have a very strong impact on the study, making the results non-significant.

      This is an interesting suggestion. Macaques do forage in plantations and cultivated landscapes to supplement food, but preferentially roost and range in forest edges and interior forest, though ranging behaviour will be complex and vary across Southeast Asia. In this study the primary interest was in deforestation (forest loss) and fragmentation of old growth forested landscapes, which are key variables both for macaque ecology and for vector breeding sites. Therefore, it was felt that forest loss (transition from >50% canopy cover to <50% canopy cover since 2000) was sufficient to capture this. Ranging behaviour of individual animals and macaque troops would not be captured at this scale, and higher spatial and temporal resolution would be required to characterise relationships with tree regrowth and young plantations which is outside the scope of this study. In all regions, purposeful fine scale follow-up studies would be required to unpick fine scale relationships across a habitat gradient.

      I am not 100% sure I understand the geospatial design fully. The pieces are distributed between different subsections and it was challenging to string together the processing chain between subsections of the manuscript and the supplemental information. I would help to add a figure (a flowchart, perhaps?) to the supplemental section that walks through the entire geospatial covariates assembly. E.g.

      • GPS location create 5, 10, and 20 km buffers mean elevation, mean population, %(?) Forest, PARA(?) for each buffer - I still don't understand the 30m or 30 km spatial resolution reference for forest and PARA in this context.

      This was an error in the table in the Supplementary Information and has been corrected – the forest cover raster has a resolution of 30m, and the perimeter: area ratio is calculated within 5, 10 and 20km buffers.

      • landscape covariates receive the full weight (1) in the model. - This is defensible even though not ideal

      This is equivalent, but we felt more intuitive, to sampling GPS points x10 and inputting with equal weights to the areal data.

      • No GPS location assign to the best identifiable administrative unit (country, state, or district) generate 10 random points within the administrative unit create 5, 10, and 20 km buffers mean elevation, mean population, %(?) Forest, PARA(?) for each buffer landscape covariates from each point receive the proportional weight (0.1) in the model. I do not believe that this approach is representative of macaque habitat/macaque human interaction characterization.

      In other examples dealing with spatial uncertainty, the centroid is taken to be representative of an area. This method generates considerable bias and uncertainty – particularly if the uncertainty is not then accounted for by weighting subsequent models (Cheng, 2021). In this exploratory analysis, pseudo-sampling from 10 random sites generates a more realistic generalised environmental realisation than taking a centroid/random point. This was used as an exploratory analysis to explain broad regional trends in prevalence between, which can be used to guide further investigation on fine scale studies which are required to completely describe disease dynamics in specific macaque habitats.

      Thank you for this useful suggestion – we have taken this advise and added a flowchart of data processing to the Supplementary Information (Appendix D, Figure S8).

      Discussion:

      Based on information in Table S4, sampled NHPs were predominantly from human-dominated (peridomestic, agricultural, and urban) landscapes. In forested landscapes, only macaques that live in forest edge habitats were likely sampled in the first place just simply due to extreme challenges in getting to macaques in remote inaccessible areas. There is a very substantial spatial bias in sampling will undoubtedly reflect that fragmented habitat is a key landscape component impacting the prevalence of Pk in NHP, especially as the authors point out in the later part of the discussion, the critical vectors for transmission are also associated with forest edge habitats. High forest fragmentation is also linked to the presence/ increase in migrant human workers (logging or plantation activities) - a population also strongly associated with higher malaria prevalence for a variety of P spp (although I am not aware of studies that are specific to Pk malaria). However, the living conditions for migrant workers have frequently been implicated in higher rates of malaria transmission and thus those could, hypothetically, also contribute to Pk infection rates in NHP. Ultimately, the discussion appears to suggest that the biggest gap in our understanding is within vector ecology and understanding the NHP-vector-human dynamics within local landscape settings. It is an interesting finding. However, my overall conclusion would be that the sampling strategy (both for NHP and geospatial covariates) renders this study as "exploratory" at maximum and that all findings would need to be tested and verified through independent and more rigorously designed studies.

      Thank you to the reviewer for a comprehensive assessment. We would first like to highlight the regional meta-analysis, which was one of the main findings. This is a novel result for P. knowlesi literature; being the first demonstration of regional differences in prevalence that correlate to regional hotspots of human incidence, the force of infection from NHP may drive hotspots of P. knowlesi in human populations.

      We include a risk factor analysis that suggests a method for dealing with high spatial uncertainty, and an exploratory analysis that finds landscape complexity may be a contributory factor to broad regional heterogeneity. These associations are robust to sensitivity analysis where data with extreme variability in environmental variables is removed (Table S15-S16).

      Habitat descriptions in original studies are qualitative, likely subjective, and whilst there is likely to be an important sampling bias there was also evident differences in prevalence between the NHP sampled in different environments from the available data that we have further characterised. Risk factors for human P. knowlesi do include forest loss (reduction in canopy cover) within 5 years and within 2km, as well as contact with macaques and occupations in plantations (Fornace et al., 2014; Fornace et al., 2016). Reverse spillover from humans to NHP is an interesting suggestion, but outside the scope and scale of the study. Given known links of deforestation (forest loss) with human incidence of P. knowlesi and also with increased vector breeding sites (Byrne et al., 2021), this analysis explores whether deforestation is linked to prevalence in reservoir species thus contributing to the force of infection at broad scales.

    1. Reviewer #1 (Public Review):

      Summary:<br /> The work of Muller and colleagues concerns the question of where we place our feet when passing uneven terrain, in particular how we trade-off path length against the steepness of each single step. The authors find that paths are chosen that are consistently less steep and deviate from the straight line more than an average random path, suggesting that participants indeed trade-off steepness for path length. They show that this might be related to biomechanical properties, specifically the leg length of the walkers. In addition, they show using a neural network model that participants could choose the footholds based on their sensory (visual) information about depth.

      Strengths:<br /> The work is a natural continuation of some of the researchers' earlier work that related the immediately following steps to gaze [17]. Methodologically, the work is very impressive and presents a further step forward towards understanding real-world locomotion and its interaction with sampling visual information. While some of the results may seem somewhat trivial in hindsight (as always in this kind of study), I still think this is a very important approach to understanding locomotion in the wild better.

      Weaknesses:<br /> The manuscript as it stands has several issues with the reporting of the results and the statistics. In particular, it is hard to assess the inter-individual variability, as some of the data are aggregated across individuals, while in other cases only central tendencies (means or medians) are reported without providing measures of variability; this is critical, in particular as N=9 is a rather small sample size. It would also be helpful to see the actual data for some of the information merely described in the text (e.g., the dependence of \Delta H on path length). When reporting statistical analyses, test statistics and degrees of freedom should be given (or other variants that unambiguously describe the analysis). The CNN analysis chosen to link the step data to visual sampling (gaze and depth features) should be motivated more clearly, and it should describe how training and test sets were generated and separated for this analysis. There are also some parts of figures, where it is unclear what is shown or where units are missing. The details are listed in the private review section, as I believe that all of these issues can be fixed in principle without additional experiments.

    1. Reviewer #1 (Public Review):

      Overall, the experiments are well-designed and the results of the study are exciting. We have one major concern, as well as a few minor comments that are detailed in the following.

      Major:<br /> 1. The authors suggest that "Visuomotor experience induces functional and structural plasticity of chandelier cells". One puzzling thing here, however, is that mice constantly experience visuomotor coupling throughout life which is not different from experience in the virtual tunnel. Why do the authors think that the coupled experience in the VR induces stronger experience-dependent changes than the coupled experience in the home cage? Could this be a time-dependent effect (e.g. arousal levels could systematically decrease with the number of head-fixed VR sessions)? The control experiment here would be to have a group of mice that experience similar visual flow without coupling between movement and visual flow feedback. Either change would be experience-dependent of course, but having the "visuomotor experience dependent" in the title might be a bit strong given the lack of control for that. We would suggest changing the pitch of the manuscript to one of the conclusions the authors can make cleanly (e.g. Figure 4).

      Minor:<br /> 2. "ChCs shape the communication hierarchy of cortical networks providing visual and contextual information." We are not sure what this means.

      3. "respond to locomotion and visuomotor mismatch, indicating arousal-related activity" This is not clear. We think we understand what the authors mean but would suggest rephrasing.

      4. 'based on morphological properties revealed that 87% (287/329) of labeled neurons were ChCs" Please specify the morphological properties used for the classification somewhere in the methods.

      5. We may have missed this - in the patch clamp experiment (Fig.1 H-K), please add information about how many mice/slices these experiments were performed in.

      6. "These findings suggest that the rabies-labeled L1-4 neurons providing monosynaptic input to ChCs are predominantly inhibitory neurons". We are not sure this conclusion is warranted given the sparse set of neurons labelled and the low number of cells recorded in the paired patch experiment. We would suggest properly testing (e.g. stain for GABA on the rabies data) or rephrasing.

      7. Figure 2E. A direct comparison of dF/F across different cell types can be subject to a problematic interpretation. The transfer function from spikes to calcium can be different from cell type to cell type. Additionally, the two cell populations have been marked with different constructs (despite the fact that it's the same GECI) further reducing the reliability of dF/F comparisons. We would recommend using a different representation here that does not rely on a direct comparison of dF/F responses (e.g. like the "response strength" used in Figure 3B). Assuming calcium dynamics are different in ChCs and PyCs - this similarity in calcium response is likely a coincidence.

      8. If ChCs are more strongly driven by locomotion and arousal, then it's a bit counterintuitive that at the beginning of the visual corridor when locomotion speed consistently increases, the activity of ChCs consistently decreases. This does not appear to be driven by suppression by visual stimuli as it is present also in the first and last 20cm of the tunnel where there are no visual stimuli. How do the authors explain this?

      9. The authors mention that "ChC responses underwent sensory-evoked plasticity during the repeated visual exposure, even though the visual stimuli were different from those encountered during training in the virtual tunnel". How would this work? And would this mean all visual responses are reduced? What is special about the visual experience in the virtual tunnel? It does not inherently differ from visual experience in the home cage, given that the test stimuli (full field gratings) are different from both.

      10. Just as a point to consider for future experiments: For the open-loop control experiments, the visual flow is constant (20cm/s) - ideally, this would be a replay of the running speed the mouse previously generated to match statistics.

      11. We would recommend specifying the parameters used for neuropil correction in the methods section.

      12. If we understand correctly, the F0 used for the dF/F calculation is different from that used for division. Why is this?

      13. Authors compare neuronal responses using "baseline-corrected average". Please specify the parameters of the baseline correction (i.e. what is used as baseline here).

    1. Every “we” implies a not-“we”. A group is constituted in part by who it excludes. Think back to the origin of humans caring about authenticity: if being able to trust each other is so important, then we need to know WHICH people are supposed to be entangled in those bonds of mutual trust with us, and which are not from our own crew.

      This idea of 'trolling' as a signifier of an in-group identity raises questions regarding the ethics of the action as it relates to socio-economic status. If a privileged group in society behaves in these way, it is arguably far more reprehensible than if an oppressed group behaved similarly as a means of protest due to the innate power one group may hold.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Please see below for the detailed description of the changes made in response to the reviewers’ comments.

      Reviewer #1 (Evidence, reproducibility and clarity (Required)):

      The manuscript investigated the composition of the plastid proteomes of seven distantly-related kareniacean dinoflagellates, including newly-sequenced members of three genera (Karenia, Karlodinium, and Takayama). Using a custom plastid-targeting predictor, automatic single-gene tree building and phylogenetic sorting of plastid-targeted proteins for plastid proteome construction, the authors suggest that the haptophyte order Chrysochromulinales is the closest living relative of the fucoxanthin plastid donor. Interestingly, the N-terminal targeting sequences of kareniacean plastid signal peptides, reveal a high sequence conservation. Moreover, ecological and mechanistic factors are suggested that may have driven the endosymbiotic acquisition of the fucoxanthin plastid. Overall, this is a comprehensive and interesting analysis.

      Other comments.

      1. For analyses of N-terminal targeting sequences, why did the authors not consider to employ Predalgo as an additional tool? Author response: We thank the reviewer for their suggestion. To our understanding, PredAlgo is a targeting predictor trained on primary green algae, which have two-membrane bound plastids and purely hydrophilic N-terminal plastid targeting sequences. It thus would be expected to perform poorly for the prediction of N-terminal targeting sequences in complex plastids such as those of the Kareniaceae bound by three or more membranes, who are located within endomembrane-derived compartments and which utilise plastid-targeting sequences based on an N-terminal hydrophobic signal peptide for ER import.

      We considered the application of PredAlgo for the identification of downstream hydrophilic transit peptide regions in Kareniacean presequences, but note that the specific residue positioned after the signal peptidase cleavage site is typically a much better predictor than transit peptide hydrophobicity for identifying plastid-targeting sequences (Gruber et al., Plant J 2015, and citing references). We found that other targeting prediction tools based primarily on hydrophobicity (e.g., HECTAR) performed poorly in identifying probable plastid-targeting sequences in our control Kareniacean dataset, and therefore chose to prioritise a modified version of ASAFind that takes into account the residue context of Kareniacean signal peptidase cleavage site for our targeting predictor, which works with high sensitivity and specificity on our control dataset. We summarise these observations in Fig. S15.

      Given the fact that peridinin or fucoxanthin pigment binding is in the focus of the paper, a more detailed introduction of the peridinin and fucoxanthin light-harvesting systems should be given.

      Author response: A brief introduction to the pigment-binding proteins in dinoflagellates was added, “These include a unique carotenoid pigment… massively paralogized and synthesized as polyproteins” (lines 86-89).

      The authors state "It is also possible that there has been a direct niche competition between the peridinin and fucoxanthin plastid that may have coexisted in the same host for a period of time with possibly different selective pressure on retention of their respective proteins based on their interaction with plastid-encoded components, e.g., extrinsic photosystem subunits not assembling correctly with their intrinsic haptophyte-like counterparts." It is tempting to ask, whether peridinin light-harvesting systems have left traces in the fucoxanthin plastid, possibly due to mistargeting of peridinin light-harvesting systems into the fucoxanthin plastid? Are some photosynthetic subunits "in-between" peridinin and fucoxanthin plastids?

      Author response: We did not identify any other peridinin-like photosystem subunits than the ones visualized in the map schematic (i.e., ferredoxin/PetF in both Karenia and Karlodinium and PsaD of Karlodinium micrum) and discussed in the supplementary text. PetF is the only consistently retained peridinin-like photosystem protein, likely due to the fact that it is not strictly linked to photosynthesis: it is expressed in plant leucoplasts, and plastid-encoded in some non-photosynthetic chrysophytes. We have added a sentence in Supporting Text 6.4 that “we detect no possible homologues of peridinin-chlorophyll binding proteins (PCP) in any kareniacean transcriptome” (line 91).

      Figure 3 is difficult to understand, e.g. for PSI and PSII which subunits are shown, why has PSI "more" contribution from dinoflagellates as compared to PSII?

      Author response: The photosystem subunits are ordered numerically in the schematic, and detailed information on each protein and the corresponding sequences with their origin are included in the supplementary table S3. A single subunit of photosystem I (PsaD) was determined to be of plastid-early (peridinin-like) origin in Karlodinium (while the same protein is plastid-encoded in Karenia and undetermined in Takayama). We believe this may be simply due to an evolutionarily neutral differential loss / non-adaptive retention of photosynthesis-related proteins in a secondarily non-photosynthetic host before the acquisition of a replacement plastid. We note that there are only two (incomplete) kareniacean plastid genomes available so we cannot rule out the possibility of this subunit being plastid-encoded in Karlodinium as well (which would mean that both plastid-late and plastid-early homologs co-occur in this genus).

      Fig. 3 is necessarily complex due to the size and multiplicity of the dataset considered. To facilitate reader navigation, we have added the following text to the figure legend (lines 1128-1140) text “Plastid proteins are arranged by major metabolic pathway or biological process, with each protein shown as rosettes … Proteins of plastid-late (haptophyte) origin, such as are concentrated in photosystem and ribosomal processes, are coloured red; and proteins of plastid-early (dinoflagellate) origin, such as are concentrated in carbon and amino acid metabolism are coloured blue. … In certain cases (shown as rosettes with multiple colours), homologues from different species have different evolutionary origins, e.g. Karenia possessing plastid-late and Karlodinium/ Takayama plastid-early”.

      Data shown in figure 4, is there experimental evidence for signal peptide cleavage site(s). Could these data been used to predict mature plastid targeted protein sequence?

      Author response: We were able to determine the conserved motives in signal peptide, including its cleavage site (GRR) which we exploited in the design of kareniaceae-specific matrix for ASAFind. We show these residues in Fig. 4. We note that these motifs were identified based on homology to known signal processing peptidase recognition sites, as opposed to experimentally determined protein N-termini.

      Consistent with previous studies (e.g. Yokoyama et al., J Phycol 2011) we see limited evidence for consensus plastid transit peptide cleavage motifs in kareniacean presequences, and do not discuss this further as a result.

      The authors state "Partial Least Square (PLS) analysis shows a set of environmental variables (salinity, silicate, iron) positively correlated with abundances of both Karenia and Takayma and also haptophytes as a whole, but at the same time negatively correlated to Karlodinium (Figure S8), further illustrating that the latter genus is quite distant from the rest in its biogeographical pattern." How could this be interpreted in the light of the plastid proteomes

      Author response: We believe that this may be due to the more cosmopolitan distribution of Karlodinium, and possibly also a result of bias stemming from our strategy of grouping the organisms at the genus level (as not enough data was available at species level) which may obscure the potential outlier status of only some species/ subpopulations. This is particularly true for the haptophytes, where in the absence of specific ancestry for individual kareniacean plastids we are only able to consider distributions at the levels of entire orders. We now acknowledge this in the Discussion: “specific ecological interactions between the progenitors … via ancestral niche reconstruction for each lineage” (lines 473-475).

      Please note, that the results might have changed slightly from the previous version due to the re-calculation following additional normalization of the data (see below).

      Reviewer #1 (Significance (Required)):

      The current manuscript gives insights into the endosymbiotic acquisition of the fucoxanthin plastids.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)):

      This is a well done, detailed bioinformatic analysis of genomic and transcriptomic data from an important lineage of dinoflagellates that have undergone serial substitution of their plastid. On the whole I am enthusiastic about the paper; it presents valuable new insights, and is rigorously performed. However, I have to object to the way the term "proteome" is used in the paper; the manuscript is talking about the predicted proteome, not a measured proteome. This is something of a technical distinction, but it is an important one because the transcriptome and the proteome don't necessarily track each other, and there is little or no actual proteomic data available from dinoflagellates. We assume that transcript abundance has something to do with proteome abundance, but this is often violated. What this paper is really addressing is the potential proteome, because if a given gene is completely absent from the genome and the transcriptome we can be confident it will not be present in the proteome. The converse is not true. For this reason I feel it is important to be clear on the distinction. I would be satisfied in this regard by minor modifications, using the term "predicted proteome" in the title, and being more direct in the introduction about the distinction.

      Author response: We agree that the usage of the word proteome for in silico predictions is not entirely correct, and have used the term “predicted proteome” where possible in the text to clarify this.

      We have also, as described in our response to Reviewer 1 above, included a statement in the Discussion that our largely bioinformatic results will be transformed by an experimentally realised kareniacean plastid proteome, which we nonetheless feel goes beyond the scope of our manuscript.

      Overall the analyses are impressive. I do have to squirm a little when I see automated analyses generating alignments where the threshold is less than 75% gaps and at least 100 nucleotides aligned. I looked at the supplementary data and the figshare files and could not find the alignments themselves, so I don't know what fraction of the sequences are in that territory. Because phylogenetic analysis (as performed here) treats the alignments as an observation, and because the alignments include sequences with more than 50% gaps, it is entirely possible that some taxa, or even whole segments of the tree, are based on non-overlapping data.

      Author response: We thank the reviewer for their comment and have added in three new supplementary figures (S16-S18) providing statistics on alignment size, length, and average gap percentage distribution. We report that most of the alignments contained relatively little gaps: 90% of the alignments contained between 1.1 and 24.5% of gaps with median value of 6.6%.

      Mind you, we have done similar analyses, and I don't think this invalidates the results, but it does open up the possibility of some dramatic artifacts. Consequently, I would recommend a) making the alignments available (or more obvious where to find them), and b) providing more detail on the alignments, including, if possible, to add a figure (probably in the supplementary data) that visualizes them. It is not given in the text itself, but according to the figure 2 caption there are 22 sequences thought to be "plastid late", and 241 in the pan-eukaryotic dataset. This is a scale that is feasible to put in a figure showing, for example, each aligned residue as a color and indels as grey. Such a figure is readable even when the individual residues are only a few pixels in size (less than a millimeter when printed). I also recommend describing the final alignments more fully in the text. Most of the summary statistics are presented in normalized form, and that can obscure patterns that come from poorly sampled taxa. Better clarify on the characteristics of the alignments will make it easier to interpret the findings overall. Although this is critical to interpreting the results, gappy alignments are not uncommon in analyses of this sort, and setting that aside the analyses presented are comprehensive and thorough. The discussion does a good job of addressing the significance of the work, and potential causes of error are addressed adequately (aside from the matter of the alignments).

      Author response: We thank the reviewer for their comment and have provided alignments for all single-gene trees, in a dedicated online supporting repository (https://figshare.com/articles/dataset/all-automatically-generated-alignments_rar/24347032). The datasets and alignments used for PhyloFisher and plastid-encoded gene trees are included directly in the supplementary files (phylofisher_files.tar, plastid_genome_phylogeny_files.tar and plastid_protein_phylogeny_files.tar).

      We have additionally included three new supporting figures (S16-S18) showing the distributions of lengths, gaps and homologues in each single-gene tree. These data project largely completion of individual alignments, with only 5% containing > 20% gapped positions (see Fig. S18), for example. We have additionally clarified in the Methods that “The trimmed alignments were then filtered by a custom python script that discarded sequences comprising of more than 75% gaps and then rejected alignments shorter than 100 positions or containing fewer than 10 taxa.” (lines 571-573).

      For the two concatenated trees presented, we have clarified in the Methods the alignment lengths (PhyloFisher: 72, 162 positions; plastid genes: 2,404 positions), and that we removed sequences containing >66% of gaps from the final alignment. Reflecting on the congruency assumptions required to concatenated alignments, we have chosen to replace the plastid-late concatenated tree (which may group proteins with multiple phylogenetic signals) with a new main text figure 2 providing an overview of the plastid signals we observe across the entire dataset (see comments below to Reviewer 3).

      Reviewer #2 (Significance (Required)):

      I find the paper to be exciting and important. These organisms are economically important, particularly as potential nuisance organisms, but also because of their role in primary productivity. They also have extremely complex evolutionary histories and similarly complex genomes. performing any bioinformatic analysis of these organisms is a substantial challenge because almost every gene exists in high copy number and with complex and often obscure patterns of homology. The manuscript brings forward these challenges, and makes a substantial step forward in elucidating the evolution of a group that is fascinating and important, but remarkably difficult to work with. I feel that it is an important analysis, and should be of interest to a broad audience.

      Reviewer #3 (Evidence, reproducibility and clarity (Required)):

      Summary

      This manuscript entitled "Divergent and diversified proteome content across a serially acquired plastid lineage" by Novak Vanclova et al. proposes the origin and evolution of plastids in kareniacean dinoflagellates. The authors generated new transcriptome data from Karenia mikimotoi, Karenia papilionacea, Karlodinium micrum, Karlodinium armiger, and Takayama helix. Combining them to the previously published transcriptome data from kareniacean dinoflagellates, they constructed the pan-kareniacean transcriptome library. They surveyed plastid-targeted protein-coding transcripts in the dataset, and consequently they estimated ~14.5% of the transcriptome data were of plastid-targeted ones. Of them, 65-80% were derived from a peridinin-containing dinoflagellate ancestor while ~15% were derived from EGTs from a haptophyte endosymbiont of the current plastid origin. By using the plastid-targeted transcript dataset, they investigated 1) origins of the plastid-targeted protein-coding transcripts by single gene-trees, 2) the plastid origin and evolution by the multigene dataset of 22 conserved plastid-targeted protein-coding transcripts and of 3) plastid genome-derived transcripts, 4) plastid functions, 5) diversity of plastid-targeted signals in kareniacean dinoflagellates, and 6) the distributions of kareniacean species by using the Tara Oceans database. On the basis of their results, they proposed many hypotheses regarding kareniacean dinoflagellate evolution, such as i) the chrysochromulinales-origin of the plastids, ii) more recent acquisition of the plastid than previously thought, iii) a plastid replacement within kareniaceae evolution, iv) the strict selection of signal peptides but non-conserved transit peptides in the kareniacean plastid-targeted proteins, and v) correlated or non-correlated distribution patterns of kareniaceaen dinoflagellates to specific haptophyte lineages.

      Although their proposals are interesting, I have many concerns to be addressed. Especially, their analyses on which the above proposals are based seem to be still preliminary and inconclusive. To support their proposals more confidently, I also suggest some additional analyses.

      Major comments

      1. seemingly inconsistency between the authors' claims The most striking is inconsistency of the authors' claims proposed in this manuscript. Their proposals include a) the common ancestor of kareniaceans has not possessed a fucoxanthin plastid but the plastid has been acquired more recently, b) an ancestor of Takayama and Karlodinium has gained a fucoxanthin plastid from a (chrysochlomulinales) haptophyte, c) an ancestor of Karenia has gained a fucoxanthin plastid from Karlodinium. However, they also demonstrate a higher proportion of plastid-late proteins in Karenia than Karlodinium and Takayama. If I understand correctly, "a higher proportion of plastid-late proteins in Karenia than Karlodinium and Takayama" would seemingly be inconsistent to and challenge two of the authors' claims: no haptophyte-derived plastid in the common ancestor of kareniacean dinoflagellates and a Karlodinium-to-Karenia plastid transfer (Fig. 7). If the Karenia plastid is derived from Karlodinium, I have no idea why haptophyte-derived plastid proteome of Karenia is larger than that of Karlodinium. After the plastid acquisition in Karenia, Karenia might have gained more genes for plastid-targeted proteins from haptophytes by LGTs. If this is true, many single gene trees would suggest different origins of plastid-targeted proteins between Karenia and Karlodinium/Takayama. Can we see it in the single gene analyses? I would like authors to rationalize the inconsistency in the main text.

      Author response: We agree with the reviewer that the evolutionary origins and dynamics of the kareniacean plastid proteome are complex, and thank them for their suggestion.

      First, to take into account the different evolutionary scenarios that could explain the present-day distribution of the kareniacean plastids, including the new plastid genome sequences identified in response to the reviewer’s suggestions, we have made a revised version of Fig. 8 evaluating three different hypotheses (see below). Nonetheless, we feel that the Karlodinium-to-Karenia model we propose is plausible, based on the following observations:

      • We identify 1,418 plastid protein gene trees in which at least two of the three studied genera (Karenia, Karlodinium, Takayama), and 748 in which all three resolve as monophyletic, and with a haptophyte sister-group (i.e., a common plastid-late origin; Fig. S2). This points to a common haptophyte ancestry in all three groups, as opposed to independent endosymbiotic consumptions of free-living haptophytes in Karenia and Karlodinium micrum.

      • We see no such shared signal with the RSD, which shares only 42 proteins with at least two other kareniacean genera (Fig. S4). Thus, and consistent with previous studies (Hehenberger et al., PNAS 2019) we cannot invoke an ancestral presence of a fucoxanthin plastid shared with the RSD in the last common kareniacean ancestor. This discrepancy thus likely points to a serial transfer of the kareniacean plastid from either Karlodinium into Karenia or vice versa (Fig. 8).

      • Concerning the direction of this transfer, among 1,059 gene trees of plastid-late origin found in both Takayama, Karenia and Karlodinium, 873 place Takayama as basal to a monophyletic clade of Karenia and Karlodinium, i.e. support a specific plastid transfer between the latter two genera. The most parsimonious explanation for this is the origin of the fucoxanthin plastid in the common Takayama/ Karlodinium ancestor, which was subsequently transferred into Karenia. It is true that Karenia contains both a greater absolute proportion of predicted plastid-targeted proteins (Fig. 1) and greater number of unique KO number annotations (Table S4) of plastid-late origin than either Karlodinium or Takayama. That said, this signal may be influenced by multiple other factors beyond how old the given endosymbiosis is (i.e., longer coexistence implies more EGT). For example, the number of plastid-late gene in a host genome may depend on the frequency of duplication of plastid-late genes and the receptiveness of the host nuclear genome to incoming horizontally derived genes. It may further be influenced by the presence and relative selective advantage or disadvantage of competing genes of host nuclear origin (i.e. plastid-early genes) that may be differentially selected over plastid-late genes, which might vary between Karenia and Karlodinium due to differential retention of the ancestral peridinin-type plastid in each lineage.

      We have elaborated on this point in the Discussion, noting that there may have been “a direct niche competition between the peridinin and fucoxanthin plastid … with possibly different selective pressure on retention of individual imported proteins” (lines 370-372), “relatively recent origin and spread throughout the kareniacean genome, e.g., via gene duplications” (line 459), and finally that precedent for divergent evolutionary trajectories in different Kareniaceae exists from the Karenia and Karlodinium plastid genomes that “contain partially non-overlapping sets of genes that suggest independent post-endosymbiotic plastid genome reduction” (lines 403-404). Nonetheless, we acknowledge that the evolutionary model we propose is not definitive, and that alternative explanations may find more favour with increased genome data.

      Signal peptide prediction I think the modified ASAFind would be greatly helpful for future studies on automatic prediction of plastid proteomes in kareniacean dinoflagellates. However, I found no data on selection criteria for the signal peptide prediction program SignalP5.0 used. I believe such data would be very important to interpret the previously published paper by Gruber et al. in which prediction methods for plastid-targeting sequences are compared to each other to see how sensitively and specifically they can capture the plastid proteomes.

      Gruber et al. 2020. Comparison of different versions of SignalP and TargetP for diatom plastid protein predictions with ASAFind.

      According to Gruber et al. (2020), signalP5.0 is not suitable for prediction of signal peptides for diatoms, in consistent with the authors' claim for kareniacean dinoflagellates. This inconsistency would be difference of the nature in signal peptides between diatoms and kareniacean dinoflagellates. Even if so, it would be useful to see quantitatively how much different their signal peptides are in terms of their suitable prediction programs.

      Author response: In our preliminary benchmarking using only the previously published transcriptomes (see additional sheet in Supplementary tables), SignalP 5.0 performed substantially better in terms of specificity than SignalP 3.0 (i.e., 22 versus 34/ 728 retrieved positive hits of proteins with uniquely non-plastidial functions), with comparable sensitivity in the correct prediction of positive control proteins. Given the size of our dataset, and the substantial risk of false positive detection in the highly expanded and redundant dinoflagellate transcriptomes we have used, we feel that the greater specificity of SignalP 5.0 is important to integrate in our model selection. We have clarified this position in the Methods, stating “First, the relative effectiveness of two SignalP versions … SignalP 5.0 was used for all subsequent analysis.” (lines 525-529).

      I also have a concern about use of the combination of PrediSI and ChloroP, combination which is suitable for the plastid proteome prediction in Euglena gracilis. The authors should rationalize why the method for Euglena plastids can be applicable without any modification to the plastid proteome prediction in kareniacean dinoflagellates. Although Euglena plastids are enclosed by three membranes, kareniacean plastids are by four. Therefore, from the side of molecular mechanisms in protein import, the method suitable for Euglena plastids is not necessarily suitable for kareniacean dinoflagellate plastids.

      By using PrediSI and ChloroP, they detected additional "candidate plastid proteomes" including several proteins not detectable by SignalP5.0 and the modified ASAFind. That seems great. However, they did not seem to consider false positives since there is no mention on it. Although the additional candidates predicted by PrediSI and ChloroP included true plastid proteins of kareniacean dinoflagellates, many might not be. Nevertheless, the authors suggest 7.5 to 14.5% in K. micrum and K. brevis, respectively, are of plastid-targeted ones. I am so afraid if the proportions would be highly overestimated due to false positives by PrediSI and ChloroP. To rationalize the use of PrediSI and ChloroP, the authors should show sensitivity and specificity by quantitative analyses with a benchmark dataset.

      Author response: We thank the author for this comment. The reasoning behind using the parallel PrediSI+ChloroP strategy was the previously reported similarity of the plastid signal structure between euglenids and peridinin dinoflagellates (c.f., Lukes et al., PNAS, 2009) and the previous observation that some kareniaceae posses plastid-targeting sequences resembling those of peridinin dinoflagellates (c.f., Hehenberger et al., PNAS, 2019). Per the reviewers’ suggestion, we present a modified sensitivity/ specificity testing PrediSI+ChloroP, alongside other alternative targeting predictors in Figure S15. While the PrediSI+ChloroP sensitivity is very low, its specificity is comparable with the modified ASAFind, and in this regard outperforms other targeting predictor tools, thus rationalising the use of both targeting prediction tools together.

      Origin and evolution of kareniacean plastids The authors suggest the chrysochromulinales origin of the kareniacean dinoflagellate plastids and the Karlodinium-to-Karenia plastid transfer, on the basis of phylogenetic analyses using the concatenated datasets with the 22 conserved plastid-targeted proteins and with plastid-genome derived transcripts. It is very interesting that those plastid-targeted proteins in kareniacean dinoflagellates might be phylogenetically closely related to chrysochromulinales haptophyte I have suggestions on the analyses and interpretation

      As the 22 analyzed genes are nuclear-encoded plastid targeted genes, they are a quite small portion of entire plastid proteins. I am not convinced by that evolution of the small number of genes reflects evolution of fucoxanthin plastids of which proteomes are comprised of >1000 proteins. How many genes for haptophyte-derived plastid-targeted proteins suggest the monophyly of kareniaceaen dinoflagellates and chrysochromulinales haptophytes should be investigated by, for example, a coalescence-based analysis such as Astral for all the detected haptophyte-derived plastid-targeted proteins including the 22 genes. This is because the monophyly could be reconstructed only by one or few, limited number of proteins even if the concatenated dataset is analyzed.

      Relevant to this, plastid-targeted proteins derived from a peridinin-containing ancestor might still have phylogenetic signals of host evolution. I am interested in whether such analyses with peridinin plastid-derived plastid-targeted proteins reconstruct Takayama and Karlodinium as monophyletic but separate Karenia from them, as suggested in the phylogenomics with non-plastid proteins.

      Author response: We agree with the reviewer concerning the problematic nature of concatenations with small numbers of genes, particularly if the underlying gene trees are not phylogenetically congruent to one another, and have chosen to replace the concatenation with a more global evaluation of the different plastid protein origins across our entire dataset. Using automated sorting approaches, we have evaluated the support for our evolutionary model across hundreds of gene trees. We feel that this approach supercedes coalescence-based techniques, as it enables us to treat each gene topology as an independent event, and to consider multiplicity in the origin of the kareniacean plastid proteome. We present these data in a new Fig. 2 and S2.

      As stated above, these data strongly support monophyly of all three Kareniacean genera. Concerning the potential Chrysochromulinalean plastid signal in our dataset, we have reanalysed our data and quantify a substantial number of trees (220/ 1,418 of plastid-late origin) that specifically place multiple kareniacean genera within the Chrysochromulinales. This figure is more than twice the number (91) that place the kareniaceae with the next most occurrent haptophyte group in our dataset, Isochrysidales. We nonetheless have chosen to no longer present this as a cryptic plastid endosymbiosis, in the absence of clear examples of extant kareniaceae still possessing this plastid, saying purely in the Discussion that “a common ancestor of the studied organisms either possessed a stable plastid or had a long-term symbiotic relationship (e.g., kleptoplastidic) with a haptophyte lineage related to the extant Chrysochromulinaceae” (lines 363-365).

      Concerning the phylogenetic placement of each karenicean genus, the majority of our plastid-late trees specifically recover the monophyly of Karenia and Karlodinium. Remarkably, we find that Takayama and Karlodinium only resolve together in 69/ 1,039 plastid-late gene trees in which all three genera are represented, strongly refuting a vertical origin of the haptophyte-derived components of their plastid proteome. This is not due to the Phaeocystales origin of the current Takayama plastid genome, which is found in only 21 of our plastid protein trees. Nonetheless, as the reviewer suggests, the opposite trend (1,505/ 2,804 gene trees grouping Takayama and Karlodinium as monophyletic) was observed amongst plastid-early gene trees, which might reflect a cryptic peridinin plastid shared between these groups. We expand on these results in the Discussion, stating “Many of the plastid-early gene trees copy the organismal topology …this awaits structural confirmation via microscopy” (lines 383-386).

      Finally, to enable reviewer comprehension of the relationships shown, we have presented some exemplar topologies of some of the trees previously displayed in the concatenation, provided in a new Fig. S5.2.

      For the phylogenetic analysis of plastid genome-derived transcripts, I might be wrong, but I could not find any information on dataset sizes (i.e., the numbers of sites) and evolutionary models for the analyses in the main text nor supplementary document. Although one may see the dataset sizes when looking at the original datasets in the supplementary files, such information is substantial and thus is to be described in the materials and methods section. I am afraid if this analysis was performed with a small dataset size. I would like to know total lengths of the concatenated sequences and especially that for Takayama. The phylogenetic position of Takayama, distantly related to the other kareniaceans, in this tree might be caused by a larger portion of gaps in the Takayama sequences than in the other kareniaceans.

      Author response: As noted in our response to Reviewer 2, we have included three new supplementary figures (S16-S18) with statistics on alignment size, length, and average gap percentage distribution. The average and median values of these three measurements do not differ significantly when calculated separately for different organisms. We have clarified in the Methods that the concatenated alignments retained (PhyloFisher, and plastid-encoded genes) were “constructed by IQ-TREE with the LG+C60+F model for the plastid matrices and posterior mean site frequency (PMSF) model (LG+C60+F+G with a guide tree constructed with C20) for PhyloFisher matrix” (lines 630-632).

      Moreover, due to lack of the plastid genome sequence of Takayama, no one could confidently identify plastid genome-derived transcripts: some of those could be derived from second, nuclear copies that might be pseudogenes. Otherwise, even if they are plastid-derived, no one can evaluate whether they are transcripts after or prior to RNA editing. I am afraid if the dataset used is comprised of a mixture of edited and non-edited sequences in kareniacean sequences. Either of sequences after or prior to RNA editing, latter of which are identical with DNA sequences, should be consistently used for the phylogenetic analysis. In any case, the plastid genomes are necessary for this analysis, and the authors can easily obtain them by DNAseq as they have the cultures.

      Author response: We thank the Reviewer for their insightful response. We agree that understanding the evolution of kareniacean plastid genomes are crucial to understanding their evolutionary history.

      We have accordingly, as described above, integrated a new main text Fig. 5 building a concatenated tree of plastid marker genes (psbA, psych, psbD, psaA, rbcL, and 16S rDNA) historically and commonly used to assess the evolutionary origins of fucoxanthin plastids (e.g., Takishita et al., Phycol Res 1999; Dorrell and Howe, PNAS 2012). These sequences were amplified cryopreserved stocks of total RNA and specific primers, amplified by RT-PCR. We have chosen here to use RNA sequences, to account for the presence of plastid RNA editing, which has been shown to play an important role in maintaining sequence identity between kareniaceaen plastids and haptophyte relatives despite a high DNA mutation rate in the former (Jackson et al., MBE 2013; Klinger et al., GBE 2018), rather than DNA sequences for this analysis.

      Additionally, we would like to note that while plastid genomes are generally relatively simple to sequence and assemble, this is not the case in Kareniaceae. The existing plastid genome assemblies are partially incomplete and suggest more complex and possibly unstable structures (e.g., involving at least some minicircles in Karlodinium micrum, Espelund et al., PLoS One 2012; Richardson et al., MBE 2014). From personal communication with our colleagues, we are aware of some efforts to sequence additional kareniacean plastid genomes that unfortunately have not yielded satisfactory results and publications to this day. This strongly invites a separate project focused on kareniacean plastid genomes but is vastly out of scope of this study.

      As described above, we have obtained striking new results which we are happy to report in the revised manuscript and which suggest even more, so far unnoticed, plastid replacements in the kareniacean lineage. In light of these finding, parts of the Results and Discussion sections have been extensively rewritten, and the schematic models presented in Fig. 8 has been updated to account for the distinct evolutionary origins of the Karlodinium armiger and Takayama helix plastids.

      In addition, although I might be wrong, the phylogenomic analysis for plastid-encoded transcripts might be performed with their nucleotide sequences according to the figure title and legend of Figure S4 mentioning "nucleotide phylogenetic matrix" and the file name "plastid_coded_nt_concatenation_files.tar". If so, translated amino acid sequences should be subjected to phylogenetic analysis, to avoid a well-known artifact that is caused by saturation of substitutions at the 3rd codon.

      Author response: With the exception of our 16S rDNA trees (in supporting data), all of our trees were generated with conceptual amino acid translations using a standard codon translation table, in accordance with previous studies (e.g., Klinger et al. GBE 2018). We have revised the file and figure names accordingly.

      Duplication of an ATP synthase subunit Duplication and relocation of ATP synthase subunit delta seems interesting. In figure S6.4.1, could you clarify why the possible extensions containing signal peptides lack the initiation methionine at N-termini? I wonder they are 5′ UTRs but artifactually detected as signal peptides, if they all indeed lack Met. To evaluate this point, I recommend 5′ RACE followed by transformation into a model organism as performed in previous studies by some of the authors.

      Author response: We reinvestigated these sequences more thoroughly using raw nucleotide data and conclude that the evidence for their retargeting to plastids is very weak and the reported extensions more likely represent untranslated regions some of which were falsely predicted as signal peptides. This section was removed from the new version of the manuscript, although we have noted in Supplementary Text 6.4 that: “A targeted HMMER search for possible distant homologs revealed that the distantly related functional analog of this protein in mitochondrial F-type ATP synthase (ATP5D, K02134) is duplicated in all species except Takayama. The additional copies, however, do not possess a detectable plastid-targeting signal and the specific functions of this duplicated subunit remain to be determined” (lines 107-111).

      Comparison of transit peptides Amino acid compositions in transit peptides would vary when targeted compartments are different. In complex plastids, there are functionally distinct compartments: lumen, stroma, periplastidal compartment (PPC). Comparison should therefore be conducted separately for lumen-targeted, stroma-targeted and PPC-targeted proteins in order to claim their transit peptides are not conserved.

      Author response: We acknowledge that this question was not explored in our analysis. We therefore re-analyzed our datasets taking the inferred sub-plastidial (thylakoid vs other, based on function) localization of the proteins into account. Our results showed no notable differences between these subsets and are reported in supplementary figure S10.

      RDS never possessed a stable fucoxanthin plastid Although the authors cite Hehenberger et al. 2019 for that RDS never possessed a stable fucoxanthin plastid, as far as I know, that paper seems not to mention it. Could you let me know where that is mentioned in the paper? Hehenberger et al. instead proposed the retention of non-photosynthetic peridinin plastid.

      Author response: We have modified the Results text, noting that we only identify 42 plastid-late proteins shared between RSD and other Kareniaceae, and in the Discussion that these data provide only limited support for a shared fucoxanthin plastid. We further clarify in the Introduction that “In some cases, the co-existence of a new organelle or endosymbiont with a remnant of the ancestral plastid has been proposed” (lines 106-108) and “It has previously been suggested that the RSD retains a non-photosynthetic form of peridinin plastid” (lines 378-379) with regard to the Hehenberger paper.

      Regardless of whether Hehenberger et al. mentioned or not, Novák Vanclová et al. propose that RDS never possessed a stable fucoxanthin plastid because, if I understand correctly, they detected no or few haptophyte-derived RDS genes for plastid-targeted proteins of which origins are shared with those of Karlodinium, Karenia, and Takayama. What about the possibility that the last common ancestor of kareniacean dinoflagellates possessed a fucoxanthin plastid in addition to peridinin plastid followed by almost complete losses of those haptophyte-derived genes after loss of a fucoxanthin plastid in evolution leading to RSD? Free living eukaryotes were appeared to have lost a plastid in recent studies and they have only a few or no genes showing evidence of a plastid previously retained. We cannot rule out that an ancestor of kareniacean dinoflagellates possessed both of peridinin and fucoxanthin plastids, as the authors mention in the main text, and either plastid was inherited to each lineage by differential losses. Accordingly, I would say Fig. 7 is a too much strong proposal as alternative hypotheses are still present. They should be introduced equally.

      Author response: We thank the reviewer for this comment. As discussed above, we evaluate the possibility of a cryptic peridinin plastid shared in different kareniaceae, which is suggested at a genetic level by our data but awaits structural confirmation.

      We agree that alternative hypotheses may be invoked for the origins of the current kareniacean plastids, and have modified our Fig. 8 to present three alternative possibilities: serial transfer, independent acquisition, and coexistence of an ancestral peridinin and fucoxanthin plastid, as the reviewer suggests. The presence of an ancestral fucoxanthin plastid that was subsequently replaced in Takayama and Karlodinium armiger is strongly suggested by the monophyly of the plastid-late signal across all kareniacean species studied, except RSD. We nonetheless feel that the frequent monophyletic placement of the Karenia and Karlodinium micrum plastids to the exclusion of Takayama in our plastid-late gene trees strongly argues against a vertical inheritance of this plastid from the common kareniacean ancestor, and more likely reflects a serial transfer between the Karenia and Karlodinium / Takayama branches. We have evaluated the evidence for and against each hypothesis in the Discussion and in the Fig. 8 legend.

      rRNA copy numbers in dinoflagellates It is known that the rRNA gene copy number varies among populations or strains in dinoflagellates; some possess several dozens of times as many rRNA gene copies as others (Galluzzi et al. 2010). Is it informative to see the ocean wide rRNA gene amplicon data for the kareniacean dinoflagellates? The numbers of rRNA gene-derived reads would not necessarily reflect the cell abundance of dinoflagellates.

      Galluzzi et al. 2010. Analysis of rRNA gene content in the Mediterranean dinoflagellate Alexandrium catenella and Alexandrium taylori: implications for the quantitative real-time PCR-based monitoring methods. J Appl Phycol 22:1-9

      Author response: We thank the reviewer for raising this point. The exploration of Kareniaceae distribution was intended primarily to investigate their respective ecological relevance in terms of niche diversity, in particular compared with the well-known cosmopolitan patterns of haptophytes, rather than comparing their abundance patterns. We feel that our approach, treating each Kareniacean genus independently, is sufficient for this, but have now clarified in the Results that the different abundances observed “may be biased by the different ribosomal DNA copy numbers in different genera” (lines 330-331) and have cited the reference the reviewer has kindly supplied.

      We further note in the Discussion that “It will therefore be worthwhile in the future to assess the distributions of other more recently developed marker genes (Penot et al., 2022; Pierella Karlusich et al., 2023)” (lines 371-372).

      Minor points

      1. the dataset size for the 241 protein-based host phylogeny should also be described in the main text. Author response: The information (72,162 positions241 genes, removal of sequences with >66% gaps) has been included in the Materials and Methods.

      The authors mention in Discussion "Thus, our results illuminate the mechanistics of a fundamental process that may under pin vast tracts of chloroplast evolution". If I understand correctly, I think this is based on "shopping bag model" when considering plastid replacements in dinoflagellates. It is helpful to add more details to clarify why the authors would like to claim so. "Chloroplast" should be replaced with "plastid".

      Author response: We agree that the term plastid is more appropriate in this context, and have used it globally throughout the manuscript. We have mentioned once in the Introduction “primary plastids, i.e. chloroplasts” to orient the non-specialist reader.

      We have elaborated on our definition of the Shopping Bag model, and the specific importance of the Kareniaceae, in the Discussion: “The idea that individual genes encoding plastid-targeted proteins may exhibit evolutionary affiliation with other groups than the plastid donor, typifying the “shopping bag” model (Larkum et al., 2007), is well-established in many plastid lineages” (lines 350-352).

      Nonetheless, we feel that our data are in many ways different to those previously observed in other plastid lineages. This may reflect that the kareniacean plastid has undergone one, and potentially multiple, recent replacement events. Nonetheless, the predominant contribution of the host to the plastid proteome is striking, which we elaborate in the Discussion: “Our data show that the dinoflagellate host was the principal contributor of nucleus-encoded proteins supporting the kareniacean plastid proteome” (lines 352-353).

      Supplementary document S6.6 I found the term nitrogen fixation, but should this be replaced with "nitrogen assimilation"?

      Author response: We have corrected the text as requested.

      Figure S5 For those LGTs, all the trees should be shown in supplementary text as they are only 11 or 12 trees. Especially, please add the chlorophyllide b reductase and chlorophyllase in the figure.

      Author response: Trees for all laterally transferred genes mentioned in the text have been provided among supplementary figures (S7.1-10).

      References I am not picky about a format of the reference list, but I think it should be consistent throughout the list. I recommend adding journals, volumes, and pages precisely for cited papers. I found lack of them at least in Novak Vanclova et al. and Pierella Karlusich et al.

      Author response: We corrected the incomplete citations and will perform a complete reformatting of the references to comply with the requirements of a concrete affiliate journal.

      Figures In figure 3, I strongly recommend adding RDS data, while distinguishing them by another color if they are derived from different origins from those of Karenia, Karlodinium, and Takayama. This would make the authors claim clearer that there are few haptophyte-derived genes for plastid targeted proteins of which origins are shared with those of the other kareniacean dinoflagellates.

      Author response: We believe the comparison to RSD is not among the main stories of our study and adding this dimension to the already complex discussion and metabolic map schematic would compromise the overall clarity. This point is already noted by Reviewer 1 (above). However, this question may indeed be asked by some readers, therefore we decided to include the results for RSD as an additional column in the supplementary table S3 and as an additional graphical element in the supplementary version of the map schematic (figure S8). Per the reviewer’s comments above, we have further stated the number of plastid-late trees shared (42) between the RSD and other kareniaceae in the Results text.

      In figures S5.1-2 showing LGTs, I found two paralogs of kareniacean dinoflagellates. What does "CP" mean? If "CP" means ChloroPlast-targeted, both paralogs of K. brevis in HARS and those of K. micrum are of plastid-targeted in TARS and they do not have cytosolic ones. I am afraid if these cases are caused by false positives of detection for plastid-targeted proteins by PredSI and ChloroP. Similarly, in figure S5.4, I found two distant paralogs of heam oxygenase in the tree and the taxon names for both types in kareniaceans include "CP." Are both targeted to the plastids or of false positives?

      Author response: The annotation with “CP” and darker colour denotes proteins that were predicted as plastid-targeted by our pipeline. We have clarified in supporting text 6.8 that we investigated our aminoacyl-tRNA synthetases for possible dual targeting to both plastid and mitochondria but found no evidence for it.

      We have searched the K. brevis SP3 HARS sequence (CAMPEP-0189291366) by CD-search and note that the conserved domain (underlined) starts at residue 24 after the first predicted methionine (bold), which is inconsistent with the probable length a plastid-targeting sequence, and we have noted in the figure legend that this is likely to represent a false positive.

      CAMPEP_0189291366_Karenia-brevis-SP3-20130916

      SWLVLLAFALTTPGPVVAVSATILRGLLVGLQRPCAAALRLSCCAATRALPLPGASELGSRFAAAAASSAR__M__GKEGKKKEDGKKKKDETKTEKLIGLEPPSGTRDFFPAEMRQQRYIFNKFRETANLYGFQEYDAPVLEHQELYIRKQGEEITDQMYSFDDKEGAKVTLRPEMTPTLARMVLNLMRVETGEMAAQLPLKWFSIPQCWRFETTQRGRKREHYQWNMDIVGVTSIYAEAELLSAICNFFESVGITSKDVGLRVNSRKVLNAVTKLAGVPDDRFAETCVIIDKLDKIGAEAVKTEMREKIGLPEEVGERIVKATGAKSLEEFADLAGVGQNNPEVLELKHLFELAEDYGYGDWLIFDASVVRGLGYYTGVVFEGFDRAGVLRAICGGGRYDRLLTKFGSPKEIPCVGFGFGDCVIAELLKEKGVTPSLPEHIDFVVAAFNSEMMGKAMNAARRLRLGGKSVDIFTEPGKKVGKAFNYADRVGADMVAFIAPDEWAKGLVRIKALRMGQDVPDDQKQKDVPLEDLANVDSYFGLAPAAAPVMSAAPAASTVKSTAPALAVPAAAKASAPKAAAPSGTGADVEAFLVDHPYVGGFRPCARDRTLFDELRLTSGRPSTPALGRWYDHIDSFPAVVRASWC

      The green HARS sequences (including that of Karenia brevis SP1) in contrast typically have conserved domains starting after residues 50-60, and are likely to be genuinely plastid-targeted. Reflecting that the automated prediction approach used within our dataset may contain other such false positive results (c.f., Fig. S18), we have chosen for tree-sorting and pathway reconstruction analyses to only consider genes in which we can identify plastid-targeted homologues of the same inferred phylogenetic origin in at least two distinct Kareniacean genera (Figs. 2, 3).

      For the Karlodinium micrum TARS sequence we have identified a second TARS sequence (CAMPEP_0200847158) that is of apparent dinoflagellate origin and lacks a credible targeting sequence, and have updated the tree accordingly.

      In the case of heme oxygenases, we are convinced that (at least) two paralogs of distinct origins are indeed plastid targeted. The presence of multiple copies of this enzyme has been noticed in other organisms including some plants (e.g., Dammeyer and Frankenberg-Dinkel, Photochemical & Photobiological Sciences, 2008) and may be reflective of functional specialization or regulation / expression under different conditions. We have discussed this in the supporting text 6.1: “Two evolutionarily distinct versions of the biliverdin-producing haem oxygenase seem to be present …the specific metabolic functions of the green- and haptophyte-like haem oxygenases in the fucoxanthin plastid await experimental characterisation.” (lines 52-58).

      Reviewer #3 (Significance (Required)):

      Significance

      General assessment: provide a summary of the strengths and limitations of the study. What are the strongest and most important aspects? What aspects of the study should be improved or could be developed?

      This study by Novak Vanclova et al. provide new transcriptome datasets from multiple species in kareniacean dinoflagellates including harmful and toxic species. Their transcriptome datasets would help understand their biology, evolution, and ecology. The authors also provide a program that predicts plastid proteomes in those dinoflagellates, which would be useful for future studies to focus on kareniacean dinoflagellate plastids, after further refinement. The most important aspect of this study is that many plastid-targeted proteins might be derived from a particular haptophyte lineage, although it is still not sure whether they are derived from LGTs or EGTs. Phylogenetic analyses performed in this study should be improved by adding some plastid genomes, in order to gain more conclusive results. In addition to methods, interpretation of the current results and proposals on plastid evolution should be toned-down.

      Advance: compare the study to the closest related results in the literature or highlight results reported for the first time to your knowledge; does the study extend the knowledge in the field and in which way? Describe the nature of the advance and the resulting insights (for example: conceptual, technical, clinical, mechanistic, functional,...).

      Although there are technical issues, this study improves our conceptual understanding the plastid proteome evolution in Kareniacean dinoflagellates. The plastid proteomes are comprised of proteins with more various origins in those dinoflagellates, suggesting more complex plastid proteome evolution than previously thought.

      Audience: describe the type of audience ("specialized", "broad", "basic research", "translational/clinical", etc...) that will be interested or influenced by this research; how will this research be used by others; will it be of interest beyond the specific field?

      This study seems to be "basic research".

      Please define your field of expertise with a few keywords to help the authors contextualize your point of view. Indicate if there are any parts of the paper that you do not have sufficient expertise to evaluate.

      algal evolution, eukaryotic evolution, mitochondrial metabolisms, plastid metabolisms, phylogenomics

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      Summary

      This manuscript entitled "Divergent and diversified proteome content across a serially acquired plastid lineage" by Novak Vanclova et al. proposes the origin and evolution of plastids in kareniacean dinoflagellates. The authors generated new transcriptome data from Karenia mikimotoi, Karenia papilionacea, Karlodinium micrum, Karlodinium armiger, and Takayama helix. Combining them to the previously published transcriptome data from kareniacean dinoflagellates, they constructed the pan-kareniacean transcriptome library. They surveyed plastid-targeted protein-coding transcripts in the dataset, and consequently they estimated ~14.5% of the transcriptome data were of plastid-targeted ones. Of them, 65-80% were derived from a peridinin-containing dinoflagellate ancestor while ~15% were derived from EGTs from a haptophyte endosymbiont of the current plastid origin. By using the plastid-targeted transcript dataset, they investigated 1) origins of the plastid-targeted protein-coding transcripts by single gene-trees, 2) the plastid origin and evolution by the multigene dataset of 22 conserved plastid-targeted protein-coding transcripts and of 3) plastid genome-derived transcripts, 4) plastid functions, 5) diversity of plastid-targeted signals in kareniacean dinoflagellates, and 6) the distributions of kareniacean species by using the Tara Oceans database. On the basis of their results, they proposed many hypotheses regarding kareniacean dinoflagellate evolution, such as i) the chrysochromulinales-origin of the plastids, ii) more recent acquisition of the plastid than previously thought, iii) a plastid replacement within kareniaceae evolution, iv) the strict selection of signal peptides but non-conserved transit peptides in the kareniacean plastid-targeted proteins, and v) correlated or non-correlated distribution patterns of kareniaceaen dinoflagellates to specific haptophyte lineages.

      Although their proposals are interesting, I have many concerns to be addressed. Especially, their analyses on which the above proposals are based seem to be still preliminary and inconclusive. To support their proposals more confidently, I also suggest some additional analyses.

      Major comments

      1. seemingly inconsistency between the authors' claims The most striking is inconsistency of the authors' claims proposed in this manuscript. Their proposals include a) the common ancestor of kareniaceans has not possessed a fucoxanthin plastid but the plastid has been acquired more recently, b) an ancestor of Takayama and Karlodinium has gained a fucoxanthin plastid from a (chrysochlomulinales) haptophyte, c) an ancestor of Karenia has gained a fucoxanthin plastid from Karlodinium.

      However, they also demonstrate a higher proportion of plastid-late proteins in Karenia than Karlodinium and Takayama. If I understand correctly, "a higher proportion of plastid-late proteins in Karenia than Karlodinium and Takayama" would seemingly be inconsistent to and challenge two of the authors' claims: no haptophyte-derived plastid in the common ancestor of kareniacean dinoflagellates and a Karlodinium-to-Karenia plastid transfer (Fig. 7). If the Karenia plastid is derived from Karlodinium, I have no idea why haptophyte-derived plastid proteome of Karenia is larger than that of Karlodinium. After the plastid acquisition in Karenia, Karenia might have gained more genes for plastid-targeted proteins from haptophytes by LGTs. If this is true, many single gene trees would suggest different origins of plastid-targeted proteins between Karenia and Karlodinium/Takayama. Can we see it in the single gene analyses? I would like authors to rationalize the inconsistency in the main text. 2. Signal peptide prediction I think the modified ASAFind would be greatly helpful for future studies on automatic prediction of plastid proteomes in kareniacean dinoflagellates. However, I found no data on selection criteria for the signal peptide prediction program SignalP5.0 used. I believe such data would be very important to interpret the previously published paper by Gruber et al. in which prediction methods for plastid-targeting sequences are compared to each other to see how sensitively and specifically they can capture the plastid proteomes.

      Gruber et al. 2020. Comparison of different versions of SignalP and TargetP for diatom plastid protein predictions with ASAFind.

      According to Gruber et al. (2020), signalP5.0 is not suitable for prediction of signal peptides for diatoms, in consistent with the authors' claim for kareniacean dinoflagellates. This inconsistency would be difference of the nature in signal peptides between diatoms and kareniacean dinoflagellates. Even if so, it would be useful to see quantitatively how much different their signal peptides are in terms of their suitable prediction programs.

      I also have a concern about use of the combination of PrediSI and ChloroP, combination which is suitable for the plastid proteome prediction in Euglena gracilis. The authors should rationalize why the method for Euglena plastids can be applicable without any modification to the plastid proteome prediction in kareniacean dinoflagellates. Although Euglena plastids are enclosed by three membranes, kareniacean plastids are by four. Therefore, from the side of molecular mechanisms in protein import, the method suitable for Euglena plastids is not necessarily suitable for kareniacean dinoflagellate plastids. By using PrediSI and ChloroP, they detected additional "candidate plastid proteomes" including several proteins not detectable by SignalP5.0 and the modified ASAFind. That seems great. However, they did not seem to consider false positives since there is no mention on it. Although the additional candidates predicted by PrediSI and ChloroP included true plastid proteins of kareniacean dinoflagellates, many might not be. Nevertheless, the authors suggest 7.5 to 14.5% in K. micrum and K. brevis, respectively, are of plastid-targeted ones. I am so afraid if the proportions would be highly overestimated due to false positives by PrediSI and ChloroP. To rationalize the use of PrediSI and ChloroP, the authors should show sensitivity and specificity by quantitative analyses with a benchmark dataset. 3. Origin and evolution of kareniacean plastids The authors suggest the chrysochromulinales origin of the kareniacean dinoflagellate plastids and the Karlodinium-to-Karenia plastid transfer, on the basis of phylogenetic analyses using the concatenated datasets with the 22 conserved plastid-targeted proteins and with plastid-genome derived transcripts. It is very interesting that those plastid-targeted proteins in kareniacean dinoflagellates might be phylogenetically closely related to chrysochromulinales haptophyte I have suggestions on the analyses and interpretation

      As the 22 analyzed genes are nuclear-encoded plastid targeted genes, they are a quite small portion of entire plastid proteins. I am not convinced by that evolution of the small number of genes reflects evolution of fucoxanthin plastids of which proteomes are comprised of >1000 proteins. How many genes for haptophyte-derived plastid-targeted proteins suggest the monophyly of kareniaceaen dinoflagellates and chrysochromulinales haptophytes should be investigated by, for example, a coalescence-based analysis such as Astral for all the detected haptophyte-derived plastid-targeted proteins including the 22 genes. This is because the monophyly could be reconstructed only by one or few, limited number of proteins even if the concatenated dataset is analyzed.

      Relevant to this, plastid-targeted proteins derived from a peridinin-containing ancestor might still have phylogenetic signals of host evolution. I am interested in whether such analyses with peridinin plastid-derived plastid-targeted proteins reconstruct Takayama and Karlodinium as monophyletic but separate Karenia from them, as suggested in the phylogenomics with non-plastid proteins.

      For the phylogenetic analysis of plastid genome-derived transcripts, I might be wrong, but I could not find any information on dataset sizes (i.e., the numbers of sites) and evolutionary models for the analyses in the main text nor supplementary document. Although one may see the dataset sizes when looking at the original datasets in the supplementary files, such information is substantial and thus is to be described in the materials and methods section. I am afraid if this analysis was performed with a small dataset size. I would like to know total lengths of the concatenated sequences and especially that for Takayama. The phylogenetic position of Takayama, distantly related to the other kareniaceans, in this tree might be caused by a larger portion of gaps in the Takayama sequences than in the other kareniaceans. Moreover, due to lack of the plastid genome sequence of Takayama, no one could confidently identify plastid genome-derived transcripts: some of those could be derived from second, nuclear copies that might be pseudogenes. Otherwise, even if they are plastid-derived, no one can evaluate whether they are transcripts after or prior to RNA editing. I am afraid if the dataset used is comprised of a mixture of edited and non-edited sequences in kareniacean sequences. Either of sequences after or prior to RNA editing, latter of which are identical with DNA sequences, should be consistently used for the phylogenetic analysis. In any case, the plastid genomes are necessary for this analysis, and the authors can easily obtain them by DNAseq as they have the cultures.

      In addition, although I might be wrong, the phylogenomic analysis for plastid-encoded transcripts might be performed with their nucleotide sequences according to the figure title and legend of Figure S4 mentioning "nucleotide phylogenetic matrix" and the file name "plastid_coded_nt_concatenation_files.tar". If so, translated amino acid sequences should be subjected to phylogenetic analysis, to avoid a well-known artifact that is caused by saturation of substitutions at the 3rd codon. 4. Duplication of an ATP synthase subunit Duplication and relocation of ATP synthase subunit delta seems interesting. In figure S6.4.1, could you clarify why the possible extensions containing signal peptides lack the initiation methionine at N-termini? I wonder they are 5′ UTRs but artifactually detected as signal peptides, if they all indeed lack Met. To evaluate this point, I recommend 5′ RACE followed by transformation into a model organism as performed in previous studies by some of the authors. 5. Comparison of transit peptides Amino acid compositions in transit peptides would vary when targeted compartments are different. In complex plastids, there are functionally distinct compartments: lumen, stroma, periplastidal compartment (PPC). Comparison should therefore be conducted separately for lumen-targeted, stroma-targeted and PPC-targeted proteins in order to claim their transit peptides are not conserved. 6. RDS never possessed a stable fucoxanthin plastid Although the authors cite Hehenberger et al. 2019 for that RDS never possessed a stable fucoxanthin plastid, as far as I know, that paper seems not to mention it. Could you let me know where that is mentioned in the paper? Hehenberger et al. instead proposed the retention of non-photosynthetic peridinin plastid. Regardless of whether Hehenberger et al. mentioned or not, Novák Vanclová et al. propose that RDS never possessed a stable fucoxanthin plastid because, if I understand correctly, they detected no or few haptophyte-derived RDS genes for plastid-targeted proteins of which origins are shared with those of Karlodinium, Karenia, and Takayama. What about the possibility that the last common ancestor of kareniacean dinoflagellates possessed a fucoxanthin plastid in addition to peridinin plastid followed by almost complete losses of those haptophyte-derived genes after loss of a fucoxanthin plastid in evolution leading to RSD? Free living eukaryotes were appeared to have lost a plastid in recent studies and they have only a few or no genes showing evidence of a plastid previously retained. We cannot rule out that an ancestor of kareniacean dinoflagellates possessed both of peridinin and fucoxanthin plastids, as the authors mention in the main text, and either plastid was inherited to each lineage by differential losses. Accordingly, I would say Fig. 7 is a too much strong proposal as alternative hypotheses are still present. They should be introduced equally. 7. rRNA copy numbers in dinoflagellates It is known that the rRNA gene copy number varies among populations or strains in dinoflagellates; some possess several dozens of times as many rRNA gene copies as others (Galluzzi et al. 2010). Is it informative to see the ocean wide rRNA gene amplicon data for the kareniacean dinoflagellates? The numbers of rRNA gene-derived reads would not necessarily reflect the cell abundance of dinoflagellates.

      Galluzzi et al. 2010. Analysis of rRNA gene content in the Mediterranean dinoflagellate Alexandrium catenella and Alexandrium taylori: implications for the quantitative real-time PCR-based monitoring methods. J Appl Phycol 22:1-9

      Minor points

      1. the dataset size for the 241 protein-based host phylogeny should also be described in the main text.
      2. The authors mention in Discussion "Thus, our results illuminate the mechanistics of a fundamental process that may under pin vast tracts of chloroplast evolution". If I understand correctly, I think this is based on "shopping bag model" when considering plastid replacements in dinoflagellates. It is helpful to add more details to clarify why the authors would like to claim so. "Chloroplast" should be replaced with "plastid".
      3. Supplementary document S6.6 I found the term nitrogen fixation, but should this be replaced with "nitrogen assimilation"?
      4. Figure S5 For those LGTs, all the trees should be shown in supplementary text as they are only 11 or 12 trees. Especially, please add the chlorophyllide b reductase and chlorophyllase in the figure.
      5. References I am not picky about a format of the reference list, but I think it should be consistent throughout the list. I recommend adding journals, volumes, and pages precisely for cited papers. I found lack of them at least in Novak Vanclova et al. and Pierella Karlusich et al.
      6. Figures In figure 3, I strongly recommend adding RDS data, while distinguishing them by another color if they are derived from different origins from those of Karenia, Karlodinium, and Takayama. This would make the authors claim clearer that there are few haptophyte-derived genes for plastid targeted proteins of which origins are shared with those of the other kareniacean dinoflagellates. In figures S5.1-2 showing LGTs, I found two paralogs of kareniacean dinoflagellates. What does "CP" mean? If "CP" means ChloroPlast-targeted, both paralogs of K. brevis in HARS and those of K. micrum are of plastid-targeted in TARS and they do not have cytosolic ones. I am afraid if these cases are caused by false positives of detection for plastid-targeted proteins by PredSI and ChloroP. Similarly, in figure S5.4, I found two distant paralogs of heam oxygenase in the tree and the taxon names for both types in kareniaceans include "CP." Are both targeted to the plastids or of false positives?

      Significance

      General assessment: provide a summary of the strengths and limitations of the study. What are the strongest and most important aspects? What aspects of the study should be improved or could be developed?

      This study by Novak Vanclova et al. provide new transcriptome datasets from multiple species in kareniacean dinoflagellates including harmful and toxic species. Their transcriptome datasets would help understand their biology, evolution, and ecology. The authors also provide a program that predicts plastid proteomes in those dinoflagellates, which would be useful for future studies to focus on kareniacean dinoflagellate plastids, after further refinement. The most important aspect of this study is that many plastid-targeted proteins might be derived from a particular haptophyte lineage, although it is still not sure whether they are derived from LGTs or EGTs. Phylogenetic analyses performed in this study should be improved by adding some plastid genomes, in order to gain more conclusive results. In addition to methods, interpretation of the current results and proposals on plastid evolution should be toned-down.

      Advance: compare the study to the closest related results in the literature or highlight results reported for the first time to your knowledge; does the study extend the knowledge in the field and in which way? Describe the nature of the advance and the resulting insights (for example: conceptual, technical, clinical, mechanistic, functional,...).

      Although there are technical issues, this study improves our conceptual understanding the plastid proteome evolution in Kareniacean dinoflagellates. The plastid proteomes are comprised of proteins with more various origins in those dinoflagellates, suggesting more complex plastid proteome evolution than previously thought.

      Audience: describe the type of audience ("specialized", "broad", "basic research", "translational/clinical", etc...) that will be interested or influenced by this research; how will this research be used by others; will it be of interest beyond the specific field?

      This study seems to be "basic research".

      Please define your field of expertise with a few keywords to help the authors contextualize your point of view. Indicate if there are any parts of the paper that you do not have sufficient expertise to evaluate.

      algal evolution, eukaryotic evolution, mitochondrial metabolisms, plastid metabolisms, phylogenomics

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      We would like to thank all reviewers for their careful evaluation of our manuscript and their thoughtful feedback, which we could use to improve its quality significantly.

      Reviewer #1 (Evidence, reproducibility and clarity):

      Summary: This study addresses the problem of what is the optimal ribosome composition in terms of relative RNA and protein content, to ensure optimal growth rate and minimal energy waste. The RNA-world hypothesis suggests that primitive ribosomes were RNA-only objects, and in fact this would appear to be very advantageous from an energetic point of view, since RNA synthesis requires a much lower energy expenditure than protein synthesis. Yet a large fraction of present-day ribosome mass is protein, ranging from 30% to nearly 70% depending on the organism. The authors hypothesize that one of the main functions of ribosomal proteins is to stabilize the RNA and to protect it against degradation. According to their idea, the fast degradation of a protein-free rRNA would offset the energetic advantage given by its cheaper synthesis. To test the hypothesis, they developed a mathematical model whereby to evaluate the optimal ribosome composition under a number of different conditions.

      Major comments: The paper is well-written and very readable. I am not an expert of mathematical modelling, so I cannot go into the details of the model presented. As a biologist, I can say that the conclusion arrived at are reasonable and well-justified.

      We thank the reviewer for the positive evaluation.

      Perhaps the point of view is rather narrow, since ribosomal proteins are known to be important not only for RNA protection and ribosome stability, but also to ensure the accuracy of decoding and, in certain contexts, to allow the ribosomes to interact with other cellular ligands. The authors make only very slight reference to these questions, so it would be worthwhile to further comment on them.

      Thank you for your suggestion. To address it, we expanded the discussion as follows:<br /> "Finally, we need to consider that ribosomal proteins may play other roles in the cells, especially in eukaryotic organisms. Ribosomal proteins participate in translation processes, for example, binding of translation factors, release of tRNA, and translocation. They may also affect the fidelity of translation (Nikolay et al., 2015). Furthermore, they play roles in various cellular processes such as cell proliferation, apoptosis, DNA repair, cell migration and others (Kisly and Tamm, 2023). These additional functions might have conferred evolutionary fitness advantages. Nevertheless, the primary role of ribosomal proteins seems to be stabilization and folding of rRNA (Nikolay et al., 2015; Kisly and Tamm, 2023)."

      Furthermore, their explanation of why ribosome composition should be so different in different organisms (e.g. protein-poor bacterial ribosomes versus protein-rich archaeal ones) is not entirely convincing. For instance, they suggest that archaea may have protein-richer ribosomes than bacteria because they live in extreme environments, thus needing a further aid to stabilize the organelle. While this may be a factor, one must point out that non-extremophilic archaea (e.g. methanogens) have protein-rich ribosomes, making it obvious that other factors must be at play.<br />

      We appreciate the reviewer's feedback. Ribosome composition is indeed complex and influenced by various factors. While extreme environments (may) contribute to protein-rich ribosomes in archaea, it's important to note that not all archaea share this characteristic. Some, like Halobacteriales, Methanomicrobiales, and Methanobacteriales, have ribosomes with protein content similar to bacteria.

      Furthermore, there are species in both archaea and bacteria with low protein content in their ribosomes despite extreme habitats. This suggests that alternative strategies, possibly involving specific sequence variants in the rRNA (Nissley et al., 2023), play a role in stabilizing ribosomes. In our model, these findings would correspond to a decreased kdegmax. However, these sequence variants are not universal.

      Amils et al. (1993) suggest that protein-rich ribosomes in archaea are (more) ancient and proteins may have been lost in some species, possibly to favor higher growth rates (and in agreement with our theoretical analysis). An intriguing avenue for further research would be a phylogenetic analysis of archaeal evolution to investigate the emergence of different ribosome compositions.

      To address your concerns, we added the following paragraph to the discussion:<br /> "Additionally, some extremophilic organisms, such as the bacteria Chloroflexus aurantiacus or Fervidobacterium islandicum, exhibit ribosomes with lower protein content (approximately 40%) compared to extremophilic archaea (50%). It has been suggested that protein-rich ribosomes can be traced back to the oldest phylogenetic lineages, with some ribosomal proteins being lost over time (Amils et al., 1993; Acca et al., 1993). Organisms with lower protein content in their ribosomes may have evolved alternative strategies to thrive in extreme conditions. Examples of such strategies include the presence of specific rRNA sequence variants or base modifications, as recently discussed by Nissley et al. (2023).

      Moreover, certain archaeal species, such as those from Methanobacteriales or Halobacteriales, have transitioned to milder environmental conditions and subsequently shed unnecessary ribosomal proteins (Acca et al., 1993; Amils et al., 1993).

      To gain a comprehensive understanding of ribosome evolution in response to changing conditions, a thorough phylogenetic analysis is warranted. This analysis should be complemented by measurements of growth rate, translation rate, RNA degradation rate, among other parameters, to delineate the order of protein loss or gain, and the emergence of sequence variations and base modifications."

      Minor comments: none in particular. Referencing is adequate, text is clear and the figures are clear and well-organized.

      Thank you.

      Reviewer #1 (Significance):

      As I stated above, the main weakness of this study may be that it concentrates overwhelmingly on a single problem, i.e. the energetic cost of adding proteins to an RNA-only ancestral ribosome. On the other hand, this is a question seldom addressed when talking about ribosome composition, which indeed makes this paper valuable and interesting. The authors expand and advance a previous study of the same kind (to which they make ample reference).

      Although rather specialized, I think this paper, in its general conclusions, may be of interest to most of those working in the field of protein synthesis and ribosome evolution.

      Referee's keywords: archaea, ribosome evolution, translation, translation initiation

      Reviewer #2 (Evidence, reproducibility and clarity):

      The authors explore a mathematical model to rationalize the variable RNA content in ribosomes across species. The mathematical model particularly considers the idea that the protein-to-RNA ratio in ribosomes emerges as a consequence of faster rRNA than r-protein synthesis coupled with a faster degradation of rRNA. This is an interesting analysis. The idea is well explained and the math of the model is overall well explained. Overall, I thus support publication of this analysis.

      We thank the reviewer for the positive evaluation.

      However, while reading the manuscript I was continuously wondering about two major aspects which, I suggest, should be considered more prominently in the text:

      1. How clear is it that rRNA is more unstable than r-protein?
      2. Why should the translation rate (the speed with which ribosomes assemble new proteins) not be highly dependent on the ribosome-to-protein ratio (with some intermediate ratio ensuring efficient synthesis and efficient translation?

      Currently these points are considered briefly in the discussion part. I suggest that these points should at least be discussed more prominently in the introduction. I further appreciate any more detailed thoughts the authors have on these questions.

      Finally, I think the discussion section would benefit strongly from a more detailed consideration of possible future experiments. Which data is needed to probe the idea? What types of experiments could be performed to probe the model.

      We added a paragraph to the discussion with suggestions for experiments:<br /> "There are still many open questions about ribosome biogenesis and evolution. Our model could guide future experiments. There are a few studies that assessed the effect of individual rP deletions in E. coli, for example mutation in S10 increased RNA degradation (Kuwano et al., 1977), and mutation in L6 lead to disrupted ribosomal assembly (Shigeno et al., 2016). A systematic knock-out screen of all ribosomal proteins could be done (as in Shoji et al. (2011)), complemented with quantification of RNA degradation and misfolding.

      In case of extremophilic organisms with protein-rich ribosomes, temperature sensitivity could also be assessed. We would expect that deletion of the extra proteins would cause growth defects only at high temperatures.

      Furthermore, after removal of proteins from archaeal protein-rich ribosomes, laboratory evolution could be performed to see whether growth rate increases beyond wild-type.

      Comprehensive datasets, akin to the work of Bremer and Dennis in 2008 for E. coli, should be generated for non-standard organisms by measuring various parameters such as transcription and translation rates, ribosome and RNAP activities, and other relevant factors.

      Finally, as mentioned earlier, phylogenetic analysis or ribosome evolution across different species and environments could be done."

      More detailed comments:

      Regarding i: rRNA is pretty stable compared to other RNA types in the cell. The authors argue it is unstable. The specific question then seems to become how stable rRNA is compared to r-protein? Generally, proteins are also stable, but what data is available to support that r-proteins are more stable than rRNA?

      While rRNA that is already integrated into a ribosome is stable, nascent RNA may be susceptible to degradation (Jain, 2018). It has been observed that even during exponential growth, some rRNA is degraded (Gausing, 1997; Jain 2018) and the degradation rate increases if ribosome assembly is delayed (Jain, 2018). This suggests that rRNA that is synthesized in excess cannot be stored and used later. Furthermore, when rRNA is overexpressed in excess of rPs, it is rapidly degraded (half life 15-70 min) (Siehnel and Morgan, 1985).

      On the other hand, the turnover of proteins is negligible (Bremer and Dennis 2008), and most ribosomal proteins can exist in a free form without RNA. For example, under starvation/in stationary phase, rRNA is degraded, but most proteins are stable and can be reused later (Reier et al., 2022; Deutscher, 2003).

      The precise mechanisms of the rRNA instability are not clear. The simplest explanation is that rRNA that is not protected by rPs is attacked by RNases. Another option is that rRNA without proteins is difficult to fold and can get trapped in misfolded states. These are then degraded as a part of quality control. The model developed in this paper allows for both of these mechanisms.

      We added these references to the discussion:<br /> "In order to explain a mixed (RNA+protein) ribosome, we consider rRNA degradation in our extended model, thereby increasing the costs for RNA synthesis. While rRNA that is already integrated into a ribosome is stable, nascent RNA may be susceptible to degradation (Jain, 2018). Indeed, it has been experimentally observed that even at maximum growth rate, 10% of newly synthesized rRNA is degraded (Gausing, 1977), and the degradation rate increases if ribosome assembly is delayed (Jain, 2018). Furthermore, when rRNA is overexpressed in excess of rPs, it is rapidly degraded (Siehnel and Morgan, 1985). Due to the extremely high rates at which rRNA is synthesized, errors become inevitable, necessitating the action of quality control enzymes such as polynucleotide phosphorylase (PNPase) and RNase R to ensure ribosome integrity (Dos Santos et al., 2018). The absence of the RNases results in the accumulation of rRNA fragments, ultimately leading to cell death (Cheng and Deutscher, 2003; Jain, 2018).

      In contrast, protein turnover is negligible (Bremer & Dennis, 2008), and most ribosomal proteins can exist without rRNA and can be reused (Reier et al., 2022; Deutscher, 2003). Therefore, we do not consider protein degradation in our model."

      Regarding ii: Building on their model results, the authors rationalize the highly varying RNA-to-protein ratio in ribosomes across species. The model considers a non-varying rate with which ribosomes synthesize new proteins. This is briefly discussed in the discussion section. However, this appears to be a major assumption that, I think, should be stated clearly stated earlier in the text, including the abstract and introduction. Second, I wonder how the authors then rationalize variations in translation rate across species. Translation rates and the speeds with which ribosomes are varying strongly across species (indicated for example well by the change in the slope between ribosome content/rRNA and growth rate - slope in Fig. 2A). Why could the rRNA-to-protein ratio not be important in playing a role here?

      We decided not to consider the effect of rRNA/protein ratio in ribosomes on translation rate mainly because it is not clear in what way it affects it. Proteins are better catalysts than rRNA. Yet, eukaryotic ribosomes which have higher protein content, have lower translation rates. For archaea and mitochondria, we were not able to find data but it is unlikely that the translation rates are faster because the growth rates are not faster.

      We added a paragraph to the introduction that explains our assumption:<br /> "We focus on the primary role of ribosomal proteins, which is stabilizing rRNA (by preventing its degradation or misfolding).

      Ribosome protein content might also affect other parameters, such as translation rate. Proteins are generally better catalysts than RNA (Jeffares et al., 1998), but the ribosome's catalytic core is formed by rRNA (Tirumalai et al., 2021) and operates at a relatively slow catalytic rate compared to typical enzymes. This suggests that there is little evolutionary pressure to increase the catalytic rate. Furthermore, ribosomes with the lowest protein content, like the E. coli ribosome, exhibit the highest translation rates (Bonven and Gulløv, 1979; Hartl and Hayer-Hartl, 2009; Bremer and Dennis, 2008). Therefore, we do not consider the impact on translation rate in this study."

      And a sentence to the abstract:<br /> "In this study, we develop a (coarse-grained) mechanistic model of a self-fabricating cell and validate it under various growth conditions. Using resource balance analysis (RBA), we examine how the maximum growth rate varies with ribosome composition, assuming that all kinetic parameters remain independent of ribosome composition."

      More minor point, but I was also not sure about the justification that ribosome mass is constant (line 111). The mass of an amino acid and a nucleotide is quite different. Why should overall mass matter, and not for example the number of amino acids and proteins. I think it also would be good here to motivate the assumption better early on instead of commenting on it in the discussion section.

      Thank you for your suggestion. We agree with the reviewer that we should make our assumption of keeping the ribosome mass constant, which we used for simplicity, clearer from the beginning. Therefore, we have added the following statement to the introduction:<br /> "For simplicity, we assume a constant ribosome mass."

      Reviewer #2 (Significance):

      Protein synthesis by ribosomes is a major determinant of the rate with which microbes and other fast growing cells accumulate biomass. To better understand cell growth it is thus essential to better understand the makeup of ribosomes. Széliová et al present a mathematical model to entertain the idea that the varying RNA content in ribosomes across species is a consequence of RNA degradation. The model makes clear predictions which can guide future experiments.

      Reviewer #4 (Evidence, reproducibility and clarity):

      Summary

      In this manuscript, Széliová et al. used a simple self-replicating cell model to study why the ribosome consists of both RNA and protein from an economic point of view. Their base model predicts an RNA-only ribosome, which is not surprising since the smaller RNAP has a higher turnover number compared to the larger ribosome. When rRNA instability is included, the model predicts an "RNA+Protein" ribosome. In particular, the predicted ribosome composition is comparable to the measured ribosome composition when strong cooperative binding of ribosomal proteins to rRNA is considered. The authors conclude that the maximal growth rate is achieved by the real ribosome composition when rRNA instability is taken into account.

      Major comments:

      1. The authors modeled the rRNA degradation rate as a function of the concentration of fully assembled ribosomes (equation 5). However, only partially assembled ribosomes are susceptible to RNase, and they make up only a small fraction of total ribosomes. The majority of ribosomes are fully assembled. In addition, the turnover number obtained from Fazal et al. (2015) and used here is the degradation rate of double-stranded RNA, not the fully assembled ribosomes, which have a stable tertiary structure. In my opinion, the rRNA degradation rate should be modeled as a function of the concentration of partially assembled ribosomes (i.e., pre-R in Figure 7) rather than the concentration of fully assembled ribosomes.

      We agree with the reviewer that the way we model the process is not entirely biologically accurate. The problem is that even if we add the assembly intermediates, their concentration would be zero as they do not catalyze any reaction (similarly to the metabolites). Therefore, the degradation rate would also always be zero. Given the current modeling setup, the obvious proxy for the intracellular rRNA concentration is the rRNA concentration in the (assembled) ribosome, c_R*(1-x_rP).

      1. Compared to the work by Kostinski and Reuveni (2020), the authors have made an improvement by avoiding the use of constant ribosome allocation to ribosomal protein (Φ_rP^R) and RNAP (Φ_RNAP^R), allowing these parameters to vary with predicted growth rates (by changing 𝑥_rP). This is indeed important, as bacteria are very likely to adjust these parameters in response to different growth conditions. However, certain other growth rate-dependent parameters are still treated as constants (or treated as nutrient-specific parameters) across predicted growth rates under given conditions. For example, experiments have shown that the fraction of active RNAP (f_RNAP^act) and the ribosome elongation rate (k_R^el) are growth rate-dependent (Bremer and Dennis, 1996). In contrast, when the authors predict the maximum growth rate by changing 𝑥_rP, f_RNAP^act and k_R^el are held constant regardless of the predicted growth rates.

      The fraction of active RNAP (f_RNAP^act) was growth-rate dependent in all our simulations (see Table 2), only the fraction of active ribosomes (f_R^act) was kept constant according to Bremer and Dennis, 1996 & 2008.

      We decided to keep the elongation rate (k_R^el) constant similar to Scott et al. 2010 (their explanation is in the supplementary material “Correlation [1] and the control of ribosome synthesis”).

      We reran the simulations with variable k_R^el. It has no impact on the predictions of optimal ribosome composition. However, the linear dependence of RNA/protein ratio is less steep and predicts an offset at zero growth rate.

      We added the results to the supplementary material and the following text to the results section (for the base model):<br /> "…the base model correctly recovers the well-known linear dependence of the RNA to protein ratio and growth rate (Scott et al. 2010), see Figure 2a, but not the offset at zero growth rate, since our model does not contain any non-growth associated processes and we assume constant translation elongation rate kelR as in Scott et al. (2010). At low growth rate, kelR decreases, most likely because of the lower availability of the required substrates (Bremer and Dennis, 2008; Dai et al., 2016). Interestingly, when we use variable kelR, we observe a nonzero offset (Appendix 1, Figure 2)."

      and in a later section:<br /> "Using variable or constant kelR has no impact on the predicted optimal ribosome composition. As in the base model, variable kelR leads to predicted non-zero offset of RNA/protein ratio at zero growth rate (Appendix 1, Figure 6)."

      1. _If amino acids or nucleotides are provided in the media, the cell does not have to synthesize all of them de novo. However, the model assumes that the cell always synthesizes all amino acids or nucleotides de novo for growth on growth on amino acid-supplemented media or on LB. This problem could in principle be solved by assuming very fast kinetics of the metabolic reactions in these media, but that should be discussed in the manuscript. Furthermore, why does the turnover number for EAA depend on the growth rate while that of ENT is constant?<br /> > _

      We focused on the “enzyme” EAA because it forms a significant fraction of the proteome. However, for consistency, we now also made ENT turnover number depend on growth rate. It made no significant impact on the simulation results.

      We agree with the reviewer that the model is currently very simplified and the enzymes ENT and EAA are used even in the media supplemented with AAs/NTs. However, these enzymes represent lumped pathways that aim to take into account not only AA/NT synthesis but also the different ‘nutrient efficiencies’ of the carbon sources (as in Scott et al. 2010). Therefore, to approximate these effects we increase the kcat of EAA (and now also ENT) with growth rate.

      We added a paragraph to the results section to explain these simplifications:<br /> "We used parameters from E. coli grown in six different media. Three of them are rich media (Gly+AA, Glc+AA, LB) where amino acids (and nucleotides) are provided so cells only have to express the corresponding transporters instead of the synthesis pathways. In our model, the enzymes ENT and EAA represent lumped pathways for glycolysis and nucleotide / amino acid synthesis, and we only consider one type of transporter. Therefore, to model the changing `nutrient quality' of the different media (inspired by Scott et al. 2010), we assume that turnover numbers of EAA and ENT increase with growth rate."

      1. All parameters related to transcription (RNAP) and translation (ribosome) used in this manuscript are adopted from Kostinski and Reuveni (2020), which are slightly modified based on Bremer and Dennis' research (1996, 2008). However, the authors changed some of the original parameters or data points, but did not provide explanations for these changes:

      (a) The original data depicted a growth rate-dependent translation elongation rate, but Table 2 presents it as a constant value.

      Please see the reply to point 2 above.

      (b) Figure 2b displays five experimental data points, as opposed to the six data points in the original dataset and other figures in this manuscript.

      The values for the transcription rate were taken from Bremer and Dennis’s paper from 1996 which only contains five growth rates. We updated the Figure 2b – it now displays data from Bremer and Dennis 2008 for six growth rates.

      (c) The model does not consider the fraction of RNAP transcribing rRNA (Φ_rRNA^RNAP), except in Appendix Figure 4. In the original data (Bremer and Dennis 1996), the fraction of RNAP transcribing rRNA increases dramatically with growth rate; however, in this study, it remains constant at 1.

      Our goal was to keep the model as simple as possible and keep the number of required parameters to a minimum. We only included the figure in the supplementary material because it does not change the conclusions, even though it makes the predictions quantitatively better. In the future we would like to achieve this improvement by expanding the model (with mRNA, tRNA, non-specific RNAP binding to DNA etc.). We added a sentence to the discussion to point out again how the results are affected if Φ_rRNA^RNAP is included, and how this parameter could be mechanistically included in the model in the future.

      "Furthermore, incorporating other types of RNA (mRNA, tRNA) and energy metabolism, or even constructing a genome-scale RBA model (Hu et al., 2020), will likely lead to more quantitative predictions of fluxes and growth rate. A strong indication of this is that including a variable RNAP allocation into the model leads to quantitatively better predictions (see Appendix 1, Figure 5). Therefore, in the future, we aim to model RNAP allocation mechanistically. This will involve for example adding other RNA species (mRNA, tRNA), and considering non-specifically bound RNAP which is a significant fraction of RNAP (Klumpp and Hwa, 2008)."

      Furthermore, Φ_rRNA^RNAP was first introduced in line 205 but was not explained until line 337.

      We added an explanation to the sentence in line 205:<br /> "If we consider RNAP allocation to rRNA (k_RNAP^el^bar = k_RNAP^el f_act^RNAP Φ_rRNA^RNAP, where Φ_rRNA^RNAP is the fraction of RNAP allocated to the synthesis of rRNA), the results get closer to the experimental data (Appendix 1, Figure 5)."

      The value(s) of Φ_rRNA^RNAP for Appendix Figure 4 are also missing from this manuscript.

      We added the missing values to the figure caption.

      1. How, exactly, is the unit of flux converted to mmol g-1 h-1?

      We are not exactly sure what the reviewer means by this question. As an example of unit conversion, we provide an explanation for the conversion of literature RNAP fluxes. The RNAP fluxes predicted by the model are in mmol g^-1 h^-1. The RNAP fluxes in Bremer and Dennis (2008) were in nt min^-1 cell^-1. To convert them to mmol g^-1 h^-1, we used the values of dry mass/cell from Bremer and Dennis (2008) and the number of nucleotides in rRNA (the stoichiometric coefficient n_rRNA). The code for the conversion is available on GitHub (https://github.com/diana-sz/RiboComp) in the script fluxes_vs_growth_rate.py.

      1. What is the (dry) mass constraint and how is it defined? In the manuscript, both the second equation in line 101 and the bottom row of Table 1 are dry mass constraint(s). Why are they different? Furthermore, why is the right-hand side of the second equation in line 101 a dimensionless 1, and how does the last row of Table 1 result in the unit of growth rate, time^(-1)?

      These are two forms of the same constraint. We added a paragraph to the methods section that explains how to convert the equations (capacity constraints, dry mass constraint) into the form in Table 1.

      In the first form of the equation, Tc = 1, the units of are g/mmol, and the units of c are mmol/g, so they cancel out.

      The rows in Table 1 are multiplied by the vector of fluxes, so we get ⍵C [g/mmol] * vIC [mmol/gh] = μ [1/h].

      1. The concentrations of all components that serve as "substrates" will be zero when growth rate is maximized, as these molecules do not catalyze any reactions, nor do they influence reaction kinetics in the model. These "0" concentration components are C, AA, NT, rP, and rRNA. Why are these concentrations even included in the model?

      The reviewer is correct in pointing out that these species have zero concentrations at maximum growth, and it would be possible to simplify the model accordingly. However, we have chosen not to merge these reactions to maintain clarity in distinguishing between metabolic and macromolecular synthesis processes. Additionally, while we currently use the model to predict optimal behavior, it is not inherently limited to this purpose, as it can equally describe sub-optimal states (as in Figure 2b). Finally, if needed, we can easily introduce minimum concentration constraints (e.g. obtained from measurements) for any of these species without affecting our overall arguments.

      Minor comments:

      1. Questions regarding Figure 2:

      (a) The explanation of Figure 2a is unclear. Intuitively, I assumed that it was a comparison between model predictions and experimental data, with the points representing experimental data and the line representing predictions; and the authors wrote in the figure legend "The points represent maximum growth rates in six experimental conditions". However, the growth rates shown in the figure do not match the original experimental data. Are all the data in the figure predictions?

      Yes, the points are predictions and the line is a linear fit. We changed the figure caption as follows:<br /> "The model predicts a linear relationship between RNA to protein ratio and growth rate. The points represent the predicted maximum growth rates in six experimental conditions (Table 2). The line is a linear fit."

      (b) Figure 2b is difficult to understand. This figure shows the non-optimal solutions of the model. It is unclear how these solutions are achieved and why there are three lines in the figure.

      We expanded the figure caption to make it clearer:<br /> "Alternative RNAP fluxes at different non-optimal growth rates in glucose minimal medium. These are obtained by varying the growth rate step by step from zero to maximum and enumerating all solutions (elementary growth vectors as defined in Müller et al. (2022)) for each growth rate. The grey and blue lines are the alternative solutions. The blue line corresponds to solutions, where rRNA and ribosomes do not accumulate (constraints rRNA' andcap R' in Table 1 are limiting)."

      1. Table 1 is also difficult to understand. While the stoichiometric constraints can be easily derived, the capacity constraints and the dry mass constraint cannot be easily derived from related equations from the text.

      We added a paragraph into the methods section that explains how to convert the equations (capacity constraints, dry mass constraint) into matrix form.

      1. As the authors ask a question in the title, they should provide an explicit answer in the abstract.

      We added a sentence to the abstract:<br /> "Our model highlights the importance of RNA instability. If we neglect it, RNA synthesis is always ``cheaper' than protein synthesis, leading to an RNA-only ribosome at maximum growth rate. However, when we account for RNA turnover, we find that a mixed ribosome composed of RNA and proteins maximizes growth rate."

      1. The authors should cite a seminal modeling paper, which was the first to examine resource allocation in simplified self-replicating cell systems (Molenaar et al. 2009, Molecular Systems Biology 5:323).

      The citation was added.

      1. The meaning of v is not consistently defined throughout the manuscript. It refers to the fluxes of enzymatic reactions in some instances, but in other contexts, it refers to the fluxes of the entire network of enzymatic reactions and protein synthesis reactions (Figure 1, Equation 1, and Line 386).

      We have made the notation more consistent. When we refer to the fluxes of the entire network we now use v_tot instead of v.

      1. Line 85, it might be difficult to interpret "RNAP fluxes" as the flux of rRNA synthesis without reading the subsequent text.

      _We added the explanation in brackets.<br /> "_We validate the model by predicting RNAP fluxes (rRNA synthesis fluxes)."

      1. Typo in line 102-103. "...protein fluxes 𝒘" → "...protein synthesis fluxes 𝒘".

      Thank you for spotting that, we added the missing word.

      1. Line 104, f_RNAP^act and f_R^act are not explained in the text; and their biological significance cannot be understood from their names in Table 2 ("RNAP activity" and "Ribosome activity").

      We added a sentence that explains these parameters:<br /> "f_RNAP^act is the fraction of actively transcribing RNAPs, and f_R^act is the fraction of actively translating ribosomes."

      1. Notion "**" in Table 2. The coupling between transcription and translation means the coupling of "mRNA" transcription and translation, not rRNA. At least in E. coli, the transcription rate of rRNA is faster than that of mRNA.

      The transcription rate of the archaeal RNAP was determined in vitro. To our knowledge, data for transcription rates of rRNA vs. mRNA in vivo are not available. Therefore, the translation rate is only a very rough estimate.

      1. Is the citation correct in line 136? I didn't find related information in Bremer and Dennis' paper after a quick scan.

      We corrected the citation. Additionally, we added references that indicate that if rRNA is transcribed in excess of available r-proteins, it gets rapidly degraded:<br /> "In fact, the accumulation of free rRNA in a cell is biologically not realistic as it is bound by rPs already during transcription (Rodgers and Woodson, 2021). Furthermore, if rRNA is expressed in excess of rPs, it is rapidly degraded (Siehnel and Morgan, 1985)."

      1. Lines 136-138. The statement is not accurate, as the fraction of inactive ribosomes increases with decreasing growth rate in E. coli (Dai et al. 2016, Nat Microbiol 2, 16231). If the studied growth rates are relatively high, it is acceptable to use a constant active ribosome fraction as an approximation, but this approximation should be made explicit.

      We used the fractions of active ribosomes as reported in Bremer and Dennis, 2008 which are constant between growth rates of 0.4-2.1 1/h. In Dai et al. 2016, it was similarly observed that above the growth rate of ~0.5 1/h, the active fraction is quite constant. We rephrase the text to make it more accurate:<br /> "For the growth rates studied here (0.4-2.1 1/h), the fraction of inactive ribosomes stays roughly constant at 15-20% (Bremer and Dennis, 1996, 2008; Dai et al., 2016). In our model, we have already incorporated this fraction using the effective translation elongation rate (k_R^el^bar = k_R^el*f_R^act). However, below the growth rate of ~0.5 1/h, the fraction of active ribosomes rapidly decreases (Dai et al. 2016)."

      1. The citation in line 142 is not accurate. It should be (Bremer and Dennis, 1996).

      We corrected the citation.

      1. Lines 192-193: "six" different growth media, not five.

      Thank you for pointing that out, we corrected it.

      1. Line 287: The statement "... translation rate does not increase in ribosomes with a higher protein content" could be misinterpreted as discussing translation elongation rate changes with different protein content in ribosomal protein mutant strains in a given species. It should be rephrased to remove ambiguity.

      We rephrased the sentence as follows:<br /> "…translation rate does not increase in ribosomes from different species which have higher protein content."

      1. Parameters for the three panels in Figure 8 are missing.

      The parameters used for mitochondria are the same as for E. coli in glucose minimal media. The only difference is that a fraction of rPs can be imported. We added a sentence to the figure caption to clarify this:<br /> "The model can be adjusted to predict mitochondrial protein-rich ribosome composition. All parameters used for the simulation of mitochondria are the same as for E. coli in glucose minimal media, except a fraction of rPs can be imported for free from the cytoplasm and does not have to be synthesized. For simplicity, we assumed that 1/3 of rPs are imported. (In reality, almost all rPs are imported, but mitochondria make additional proteins to provide energy for the whole cell.)"

      Reviewer #4 (Significance):

      Strengths: Why the ribosome is composed of RNA and protein parts is a fundamental biological question. This manuscript proposes a very interesting hypothesis, arguing that the mixed ribosome composition results from rRNA instability. To test their hypothesis, the authors parameterize a simplified self-replicating cell model with realistic parameters. The model is first developed/parameterized for E. coli, and it could be easily adapted to other organisms with higher ribosomal protein content.

      Limitations: The main limitations of this manuscript lie in the development of the model, especially the modeling of rRNA degradation and the use of constant values for growth rate-dependent parameters.

      Advances: (1) This manuscript proposes a new hypothesis that rRNA instability is a universal factor that influences the ribosome composition across living organisms. (2) Compared to Kostinski and Reuveni's work, the authors have made certain improvements by including adjustable ribosome allocation to RNA and ribosomal protein when maximizing growth rate, which may lead to more realistic conclusions.

      Audience: This work will be of interest to people in the field of theoretical biology, computational biology, and evolution, as well as to researchers studying ribosome structure and function.

      Areas of expertise: Microbial systems biology, computational biology, and prokaryotic genomics.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      1. General Statements [optional]

      The findings presented in this manuscript are original and have not been previously published, nor is the manuscript under consideration for publication by another journal. The authors of this manuscript declare to have no conflicts of interest.

      1. Description of the planned revisions

      We believe that incorporating the suggested corrections and conducting the additional experiments recommended by the reviewers will significantly enhance the quality of this study. These revisions will not only bolster the current conclusions but also broaden the relevance and applicability of our work to a wider scientific audience, extending beyond the field of virology.

      As outlined in the following sections, we are fully committed to implementing the experiments proposed by the reviewers and making the necessary modifications to the manuscript in line with their suggestions. Our responses to each specific comment are provided below.

      Reviewer #1

      Evidence, reproducibility and clarity

      Summary: Several target cell entry pathways have been described for different viruses, including endocytic/ fusion pathways, some which are dynamin-dependent.

      Here the authors exploited cell lines with multiple dynamin gene disruptions and other cell biological tools, as well as a phenotypic range of previously characterized viruses, to evaluate the relative importance of dynamin and actin for entry of viruses, including SARS-CoV-2.

      In cells that lack the serine protease TMPRSS2, dynamin depletion blocked uptake and infection by SARS-CoV-2. Increasing the input virus partially rescued SARS-CoV-2 infection in the absence of dynamin, and both dynamin-dependent and dynamin-independent entry pathways were inhibited by drugs that disrupt actin polymerization.

      Examination by electron microscopy indicated that the dynamin-independent endocytic process was clathrin-independent, in that, in the absence of dynamin, the majority of Semliki Forrest Virions were detected in bulb-shaped, non-coated pits. When TMPRSS2 was expressed, SARS-CoV-2 infection was rendered dynamin-independent.

      Significance

      Overall, the experiments are expertly performed, the results and conclusions are convincing, the text is clearly written and accurately describes the data, and the manuscript makes an important contribution to a complex and important topic in the cell biology of virus infection. It would be reasonable for the authors to publish the manuscript with the current data.

      That being said, we have two main questions/comments:

      1. The authors point out that SFV differs from SARS-CoV-2 in that it required actin only for the dynamin-independent entry. The EM experiments were done with SFV, not with SARS-CoV-2. This raises the question of the relevance for SARS-CoV-2 of the interesting finding that, in the absence of dynamin, SFV associated with non-coated pits.

      If the authors had the tools to do similar EM experiments with SARS-CoV-2, it would be nice to include those results. Otherwise, it is fine to discuss/speculate about SARS-CoV-2 regarding this issue.

      RESPONSE:As requested by the reviewer, we are currently perform the suggested EM analysis of SARS-CoV-2 entry in the presence and absence of dynamins.

      1. The authors show that TMPRSS2 allows the original Wuhan strain and Delta Variant of SARS-CoV-2 to bypass the need for dynamin. This is presumably because TMPRSS2 allows SARS-CoV-2 to fuse at the plasma membrane, precluding need for endocytosis altogether. The authors also mention literature claiming that Omicron is more dependent upon endocytosis than the Wuhan and Delta variants. If the authors had data with Omicron it would be really nice to include it.

      RESPONSE: We have already conducted this experiment and have incorporated the quantitative results into the updated version of the manuscript, now presented as Figure 8.

      There were some minor typos/grammar/other quoted here:

      • Ultrastructural analysis by electron microscopy showed that this dynamin-independent endocytic processes - cell injests particles and nutrients by encoulfing them - some viruses have been show

      RESPONSE: Thank you for noticing the error. We have modified the text as: “Ultrastructural analysis by electron microscopy showed that this dynamin-independent endocytic processes appeared as 150-200 nm non-coated invaginations that have been shown to be efficiently used by numerous mammalian viruses, including alphaviruses, influenza, vesicular stomatitis, bunya, adeno, vaccinia, and rhinovirus.”.

      • The final step of an endocytic vesicle formation culminates with the pinching of vesicle off from the PM into the cytoplasm

      RESPONSE: We have modified the sentence as: “The concluding stage of endocytic vesicle formation is marked by the vesicle being pinched off from the plasma membrane and released into the cytoplasm.”

      • For other viruses, such as respiratory viruses (This word is a little strange here since influenza was mentioned in the last sentence.)

      RESPONSE: Thank you for noticing the error, we have removed the mention to respiratory viruses: “ For other viruses (including coronaviruses), the fusion is triggered by proteolytic cleavage of the spike proteins that, once cleaved, undergo conformational changes leading first to the insertion of the viral spike into the host membrane and, upon retraction, the fusion of viral and cellular membranes9,10.”.

      • Viruses that use a receptor that is internalized by dynamin-dependent endocytosis (e.g. CPV and the TfR) (just reminding that TfR is not a virus)

      RESPONSE: We have amended the sentence to avoid misunderstandings: “Viruses (e.g. CPV) that use a receptor (e.g. TfR) that are internalized by dynamin-dependent endocytosis cannot efficiently infect cells in the absence of dynamins.”.

      • that appeared surrounded by an electron dense coated

      RESPONSE: We have corrected the typo: “In MEFDNM1,2 DKO cells treated with vehicle control, TEM analysis revealed numerous viruses at the outer surface of the cells (Figure 4 A), as well as inside endocytic invaginations that were surrounded by an electron dense coat, consistent with the appearance of clathrin coated pits47,48 (CCP) (Figure 4 B).”

      • The main virial receptor could be internalized using two endocytic

      RESPONSE: We have corrected the typo: “The main viral receptor could be internalized using two endocytic mechanisms, one mainly available in unperturbed cells (e.g. dynamin-dependent), the other activated upon dynamin depletion (i.e. dynamin independent).”

      • Virus infection was determined by FACS analysis of virial induced EGFP

      RESPONSE: We have corrected the typo: ‘Virus infection was determined by FACS analysis of EGFP (VAVC and VSV), mCherry (SINV) or after immunofluorescence of viral antigens using virus-specific antibodies (IAV X31 and UUKV).”.

      Reviewer #2

      Evidence, reproducibility and clarity

      Summary: Ohja et al. present an interesting study investigating dynamin independent endocytic entry mechanism of viral infection. Using a genetic KO of 2 dynamin isoforms they show impacts on the infection of a range of large and small DNA and RNA viruses.

      They go onto show that SARS-CoV-2 may utilise a dynamin independent mechanism of infection that requires an intact actin cytoskeleton.

      Significance

      This work is of interest to the field of virology and has the potential to answer previously understudied entry mechanisms important for a wide range of viruses. It is a well presented piece of work overall.

      Major Comments:

      • The abstract does not in my opinion reflect the content of the paper and is too 'SARS-CoV-2' centric. The work involves the use of a range of viruses to first define a mechanism that is applicable to SARS-CoV-2 and I think the abstract and title should reflect this.

      RESPONSE: As per the reviewer's request, we will make revisions to the Title and Abstract. As a ‘non SARS-CoV-2-centric’ title we have amended the title to: Multiple animal viruses, including SARS-CoV-2, can infect cells using alternative entry mechanisms.

      • In figure 1H the authors postulate that the reduced impact of dyn1,2 KO on SFV infection may be due to the interaction with heparin sulphate proteoglycans. Have the authors considered performing experiments using Heparin to block infection in their KO cells -/+ tamoxifen treatment?

      RESPONSE: As per the reviewer's request, we will perform the proposed heparin experiments for SFV.

      • In Figure 2 the authors assess infection of a range of viruses in dyn1,2 KO cells showing differential effects in some viruses but not all.

      Have the authors confirmed whether tamoxifen treatment and the subsequent KD of dyn1,2 effect surface expression of the entry receptors for the viruses tested?

      RESPONSE: Although in general blocking receptor endocytosis results in an increase in its cell surface levels, we agree with the Reviewer that the effect of dynamin depletion on receptors levels should be monitored at least for some of the viruses. To address the question raised by the reviewer, we will monitor the surface expression of SFV receptors VLDLR and ApoER2, and of the CPV receptor TfR in the presence and absence of dynamins.

      We have already confirmed that there are no changes in the surface expression of SARS-CoV-2 receptor ACE2 in the absence of dynamin and this new data will be added to Figure 7.

      • Additionally in this setting, dyn1,2 KD may impact on post entry steps in the virus life cycle such as the initial establishment of viral replication.

      Can the authors either provide evidence as to how they have delineated measurement entry over replication or support their findings with psuedotyped virus-like-particles?

      RESPONSE: This is an important point. As suggested by the reviewer, we will perform infection experiments in the presence or absence of Dynamins using VLPs pseudotyped with SFV and VSV spikes.

      In addition, several of our experiments already indicate that upon dynamin depletion, the main block in virus infection is at the step of cell entry: 1) Upon DNM-depletion, the decrease in SARS-CoV-2 infection strongly correlates with a proportional block in spike (Figure 5) and virions (Figure 7) endocytosis; 2) exogenous expression of even low levels of the cell surface protease TMPRSS2 rescued SARS-CoV-2 infection in cells devoid of dynamins, indicating that merely by-passing endocytosis restores virus infection; 3) as shown in Figure 1 H for SFV, and in Figure 2 for multiple viruses, increasing the multiplicity of infection increases the number of infected cells, indicating that when virions access the dynamin-independent entry route, cells can be efficiently infected; 4) the infection of both negative strand (i.e. Uukuniemi virus, UUKV, Figure 2 ) and positive strand (i.e. human Rhino virus, HRVA1, Figure S3 D-E) RNA viruses, as well as DNA viruses (i.e. Vaccinia, Figure 2, and Adenovirus-5, Figure S3 B-C) are not affected by dynamin depletion, arguing against a general negative impact of dynamin depletion on cellular protein synthesis or other basic cell functions required for virus replication.

      • Figure 3, given the unexpected results with the dynamin inhibitors, could this experiment be repeated with the dyn1-3 triple KD presented in figures 5-8?

      RESPONSE: As requested by the reviewer, we will repeat the main inhibitor experiments presented in Figure 3 for SFV also in DNM TKO cells.

      • Statistical analysis of imaging data in figure 4 would help with the conclusions.

      RESPONSE: We have already performed the requested statistical analysis and modified Figure 4 accordingly.

      • Additionally, the authors comment that in the KD cells the viruses were trapped in 'stalled CCPs'. What morphological changes determine this classification?

      RESPONSE: As previously reported by Ferguson et al. (Developmental Cell, 2009), who developed the conditional MEF DNM knock out cell models, all CCPs are stalled at 6 days post induction of dynamin depletion. When observed by electron microscopy, stalled CCPs are readily identified by the presence of elongated, membranous narrow neck structures that connects the vesicle to the plasma membrane. We have clarified this description in the manuscript text and indicated the morphological features typical for a ‘stalled’ clathrin coated pit in Figure 4 F (black asterisk and white arrowheads).

      • Concerning the SARS-CoV-2 work presented in figures 6-8, the use of exogenous expression of the viral entry receptors ACE2 and TMPRSS2 is a concern.

      RESPONSE: While the reviewer appreciates that this is a necessary step to allow entry into their MEF-dyn1-3 KD cells, exogenous receptor expression can result in artificial entry of the virus.

      • To support their findings, can the authors perform experiments in either cell lines endogenously expressing ACE-2/TMPRSS2 such as Calu3 or Caco2 and KD dyn1-3 using transient siRNA?

      RESPONSE: This experiment poses a challenge due to the inherent difficulty of transfecting Caco2 and Calu3 cells and the potential difficulty of achieving a robust (>80%) simultaneous knockdown of all three dynamin isoforms. This is one of the reasons why we chose the conditional knock out approach. Nevertheless, we are committed to attempting this experiment.

      • This approach would also provide more evidence for the role of TMPRSS2 presented in SF5 as the limited expression of this protease limits the robustness of the conclusions one can draw from the data presented.

      RESPONSE: We appreciate the reviewer's observation, and to address this concern, we plan to not only perform siRNA knockdown of dynamins in cells with endogenous ACE2 and TMPRSS2 but also endeavor to elevate the expression levels of TMPRSS2 in our MEF DNM1,2,3 TKO ACE2 cells. It's worth noting, however, that this task presents a unique challenge since expression of TMPRSS2, a trypsin-like cell surface protease, leads to cell detachment even when expressed at moderate levels.

      Minor comments & typo:

      • Introduction paragraph 1 engulfing

      RESPONSE: The sentence has been amended: “To gain access into the host cell's cytoplasm where viral protein synthesis and genome replication take place, most animal viruses hijack cell’s endocytic pathways1 by which the cell engulfs particles and nutrients into vesicular compartments. “.

      • Pg 13 - typo in 'Figurre 6B'

      RESPONSE: The typo has been corrected.

      2. Description of the revisions that have already been incorporated in the transferred manuscript

      • Regarding the Reviewer 1 request on the use of Omicron variants, we have already conducted the requested experiments and have incorporated the quantitative results into the updated version of the manuscript, now presented as Figure 8.
      • Regarding the Reviewer 2 request on the EM data, we have already performed the requested statistical analysis and modified Figure 4 accordingly. We have also clarified the EM descriptions in the manuscript text and indicated the morphological features typical for a ‘stalled’ clathrin coated pit in Figure 4 F (black asterisk and white arrowheads).

      3. Description of analyses that authors prefer not to carry out

      none

    1. Intrapersonal communication also helps build and maintain our self-concept. We form an understanding of who we are based on how other people communicate with us and how we process that communication intrapersonally.

      I think this plays a big factor how we choose to act in most situations. We learn to talk a certain way to babies because we know that speaking with a certain tone or volume or energy can get the best reaction out of a baby. We do this with adults as well by gauging how much attention we get from certain types of humor, topics, words and expressions we use and so forth. Which can lead people to believe they are "funny", simply because they know how to communicate around certain people in a way that will get the most amused result. This can also be to our disadvantage because we may learn to communicate in social settings in a way that we don't actually enjoy or believe is our own true character.

    1. The purpose of a definition essay may seem self-explanatory: the purpose of the definition essay is to simply define something. But defining terms in writing is often more complicated than just consulting a dictionary. In fact, the way we define terms can have far-reaching consequences for individuals as well as collective groups. Take, for example, a word like alcoholism. The way in which one defines alcoholism depends on its legal, moral, and medical contexts. Lawyers may define alcoholism in terms of its legality; parents may define alcoholism in terms of its morality; and doctors will define alcoholism in terms of symptoms and diagnostic criteria. Think also of terms that people tend to debate in our broader culture. How we define words, such as marriage and climate change, has enormous impact on policy decisions and even on daily decisions. Think about conversations couples may have in which words like commitment, respect, or love need clarification. Defining terms within a relationship, or any other context, can at first be difficult, but once a definition is established between two people or a group of people, it is easier to have productive dialogues. Definitions, then, establish the way in which people communicate ideas. They set parameters for a given discourse, which is why they are so important.

    1. Author Response

      The following is the authors’ response to the original reviews.

      We appreciate very much the comments and suggestions on our manuscript "Cylicins are a structural component of the sperm calyx being indispensable for male fertility in mice and human". According to the comments, we performed a series of further experiments, re-worded and re-wrote several paragraphs and re-structured the manuscript according to the reviewers’ comment. We think that the manuscript is now improved and are looking forward to the further evaluations. We provide a point by point response to all comments and have prepared a version.

      Recommendations for the authors:

      Editor’s comment:

      1) As pointed out by all three reviewers, it is critical to show the specificity of the antibodies used. The authors should clarify how the specificity of antibodies is tested. Western blot analysis to show the absence of the protein in the knockout is essential.

      As suggested by all reviewers, we additionally performed Western Blot analysis on cytoskeletal protein fractions to further verify the specificity of generated antibodies and the generation of functional knockout alleles. Results nicely confirm the results of the IF staining, however, both anti-bodies detected the bands lower than the predicted molecular weight. In addition, Mass Spectrometry was performed to search for the presence of peptides in the cytoskeletal protein fractions. The paragraph reads now as follows:

      Line 127-134: Additionally, Western Blot analyses confirmed the absence of CYLC1 and CYLC2 in cytoskeletal protein fractions of the respective knockout (Fig. 1 G), thereby demonstrating i) specificity of the antibodies and ii) validating the gene knockout. Of note, the CYLC1 antibody detects a double band at 40-45 KDa. This is smaller than the predicted size of 74 KDa as, but both bands were absent in Cylc1-/y. Similarly, the CYLC2 Antibody detected a double band at 38-40 KDa instead of 66 KDa. Again, both bands were absent in Cylc2-/-. Next, Mass spectrometry analysis of cytoskeletal protein fraction of mature spermatozoa was performed detecting both proteins in WT but not in the respective knockout samples (Figure 1 – supplement 5; Figure 1 – supplement 6).

      Specificity of antibodies was additionally proven by immunohistochemical staining, showing a specific staining only in testis sections but not in any other organ tested. The section reads now as follows:

      Line 115-117: Specificity of antibodies was proven by immunohistochemical stainings (IHC), showing a specific signal in testis sections only, but not in any other organ tested (Figure 1 – supplement 2)

      2) Re-structuring/streamlining of the figures is recommended. Please consider the flow suggested by reviewer #2 and shorten the evolutionary analysis which takes up more space than it adds to the value of the story.

      We thank the reviewers and editor for the valuable suggestion. We re-structured the figures as suggested and rewrote the results section accordingly. The evolutionary analysis was significantly shortened.

      3) Provide statistics for the imaging analysis such as TEM as only a single representative image is shown.

      We agree that the observed morphological defects require a detailed statistical evaluation. TEM analysis was performed to confirm the results from optical microscopy and representative images with high magnification are shown for a detailed visualization of the defects. For additional quantification, we included statistics for IF stainings against calyx proteins CCIN and CapZa (Fig. 2 I-J). For TEM, we added additional images to the supplement (Figure 3 – supplement 1). Furthermore, we quantified the manchette length of step 10-13 spermatids to prove the increased elongation of the manchette in Cylc2-/- and Cylc1-/y Cylc2-/- spermatids (Fig. 5 A-B).

      4) Please consider other points raised by the reviewers below to improve the manuscript and provide responses on how the authors have addressed them.

      We thank all reviewers for the detailed review of our manuscript and their valuable suggestions, which helped a lot to improve the manuscript. We considered all points raised by the reviewers to the best of our knowledge and hope that the reviewers will approve the manuscript ready for publication. We added a point-by-point discussion of all comments/suggestions hereafter.

      Reviewer #1 (Recommendations For The Authors):

      Major comments:

      (1) Antibody specificity: Fig 1E - there are some unspecific binding in Cylc2-/- for CYLC2 and in Cylc1/y Cylc2+/- for CYLC1 in the testis (and elongating spermatids in Figure 1 – Supplement 4). Could authors elaborate/comment on this? Western blot analysis would be also helpful to further support the antibody specificity.

      The very weak unspecific staining in the testis for CYLC2 (in Cylc2-/-) and CYLC1 (in Cylc1-/y Cylc2+/-) is only present in the lumen of the seminiferous tubules and/or the residual bodies of the testicular sperm cells and can be referred to as background signal. Importantly, the signal is entirely lost in the PT region, proving specificity of the generated antibodies. We added the following paragraph to the results section:

      Line 124-127: The generated antibodies did not stain testicular tissue and mature sperm of Cylc1- and Cylc2-deficient males, except for a very weak unspecific background staining in the lumen of seminiferous tubules and the residual bodies of testicular sperm (Fig. 1 F).

      Specificity of antibodies was additionally proven by immunohistochemical staining, showing a specific staining only in testis sections but not in any other organ tested.

      Line 115-117: Specificity of antibodies was proven by immunohistochemical stainings, showing a specific staining in testis sections only, but not in any other organ tested (Figure 1 – supplement 2)

      To further verify the specificity of generated antibodies and the generation of functional knockout alleles, we additionally performed Western Blot analysis on cytoskeletal protein fractions, confirming the results of the IF staining. No unspecific bands were detected in the Western Blot, further supporting the notion that the weak unspecific signals in IF resemble staining artifacts.

      The paragraph reads now as follows:

      Line 127-132: Additionally, Western Blot analyses confirmed the absence of CYLC1 and CYLC2 in cytoskeletal protein fractions of the respective knockout (Fig. 1 G), thereby demonstrating i) specificity of the antibodies and ii) validating the gene knockout. Of note, the CYLC1 antibody detects a double band at 40-45 KDa. This is smaller than the predicted size of 74 KDa as, but both bands were absent in Cylc1-/y. Similarly, the CYLC2 Antibody detected a double band at 38-40 KDa instead of 66 KDa. Again, both bands were absent in Cylc2-/-.

      (2) Please provide more interpretation of the gene dosage effect of Cylicin 2. It is not common to see a gene dosage effect in the sperm phenotype as transcripts and proteins can be shared between haploids due to syncytium formation during spermatogenesis.

      We agree and we apologize for the misinterpretation. In Cylc2+/- mice expression of Cylc2 was reduced by half but there was no altered phenotype observed. The sentence now reads as follows:

      Line 112: In Cylc2+/- animals expression of Cylc2 was reduced by 50 %.

      (3) Line 194-196 - the authors say that the sperm are smaller, with shorter hooks and increased circularity of the nuclei, and reduced elongation. Are these statistically significant? There seems to be a high variation in the graph in S2D and the statistical analysis is not given.

      We agree, performed statistical analyses, and highlighted significantly altered values for sperm head elongation and circularity in Figure 2 – Supplement 3.

      (4) Line 153-164 It is interesting that the absence of Cylc2 affected many parts of sperm structure. I think some ratios of sperm always have a morphological defect in diverse ways, so it is hard to confirm the finding only with a single sperm image. I think that it will be important to do some statistical analysis or at the minimum show more TEM images from TEM.

      We agree that the observed morphological defects require a detailed statistical evaluation. TEM analysis was performed to confirm the results from optical microscopy and representative images with high magnification are shown for a detailed visualization of the defects. For additional quantification, we included statistics for IF stainings against calyx proteins CCIN and CapZa (Fig. 2 I-J). For TEM, we added additional images to the supplement (Figure 3 – Supplement 1).

      (5) Line 236-242 - I believe that the phenotype described applies to the sperm from Cylc2-/- and Cylc1/y Cylc2-/- animals; however, I think that the Cylc1-/y Cylc2+/- has a more subtle, intermediate phenotype between the WT and the genotypes missing both Cylc-/- alleles.

      We agree and we added a quantification of manchette length at step 10-13 to visualize the differences between the genotypes. The section reads now as follows: Line 268-272: Manchette length was measured starting from step 10 until step 13 spermatids and the mean was obtained, showing that the average manchette length was 76-80 nm in wildtype, Cylc1-/Y and Cylc2+/- while for Cylc2-/- and Cylc1-/Y Cylc2-/- spermatids mean manchette length reached 100 nm (Fig. 5 B). Cylc1-/Y Cylc2+/- spermatids displayed an intermediate phenotype with a mean manchette length of 86 nm.

      (6) Since CYLC1 staining is absent in Fig 5B, does that mean that the mutation resulted in protein degradation/instability? Is RNA present? Additional biochemical studies of Cyclins demonstrating the deleterious nature of the mutations would strengthen the molecular pathogenesis of the human mutations.

      Thank you for raising these important questions. The CYLC1 variant c.1720G>C is predicted to cause the amino acid substitution p.(Glu574Gln). It is, thus, conceivable that the RNA is present but either the protein is degraded or misfolded and, therefore, not detectable by IF. Unfortunately, for personal reasons of the patient, it is currently not possible to receive additional semen samples, preventing additional analyses of the semen, e.g. analysis of Cylicin transcript level.

      (7) Strongly suggest shortening the evolutionary analysis - all the corresponding materials are in supplemental while texts are extensive- or even consider entirely omitting. It does not add a lot to the current study.

      We agree that the evolutionary analysis was very detailed. However, we think that the results are important to understand the role of Cylicins for male reproduction in general. The results obtained from the mouse model might be transferable to other species, including humans. Further, the results present a possible explanation for the subfertility of Cylc1-deficient mice, in contrast to infertility of Cylc2-deficient males. We shortened the section, the paragraph reads as follows:

      Line 287-302: To address why Cylc2 deficiency causes more severe phenotypic alterations than Cylc1deficiency in mice, we performed evolutionary analysis of both genes. Analysis of the selective constrains on Cylc1 and Cylc2 across rodents and primates revealed that both genes’ coding sequences are conserved in general, although conservation is weaker in Cylc1 trending towards a more relaxed constraint (Fig. 6). A model allowing for separate calculation of the evolutionary rate for primates and rodents, did not detect a significant difference between the clades, neither for Cylc1 nor for Cylc2, indicating that the sequences are equally conserved in both clades.

      To analyze the selective pressure across the coding sequence in more detail, we calculated the evolutionary rates for each codon site across the whole tree. According to the analysis, 34% of codon sites were conserved, 51% under relaxed selective constraint, and 15% positively selected. For Cylc2, 47% of codon sites conserved, 44% under neutral/relaxed constraint, and 9% positively selected. Interestingly, codon sites encoding lysine residues, which are proposed to be of functional importance for Cylicins, are mostly conserved. For Cylc1, 17% of lysine residues are significantly conserved and 35% of significantly conserved codons encode for lysine. For Cylc2, this pattern is even more pronounced with 27.9% of lysine codons being significantly conserved and 24.3% of all conserved sites encoding for lysine (Fig. 6).

      Minor comments:

      (1) Line 114, 115, 118 à Figure 1D is already well-described in the previous paragraph and thus redundant. Ref Fig 1D, E; but only figure E shows IF. Maybe supposed to be E and F or just 1E?

      We apologize for the mix-up with the subfigures. The mentioned paragraph refers to Fig. 1 E-F, which was corrected accordingly.

      Line 117-123: Immunofluorescence staining of wildtype testicular tissue showed presence of both, CYLC1 and CYLC2 from the round spermatid stage onward (Fig. 1 E). The signal was first detectable in the subacrosomal region as a cap-like structure, lining the developing acrosome (Fig. 1 E-F, Figure 1 – supplement 3). As the spermatids elongate, CYLC1 and CYLC2 move across the PT towards the caudal part of the cell (Figure 1 – supplement 4). At later steps of spermiogenesis, the localization in the subacrosomal part of the PT faded, while it intensified in the postacrosomal calyx region (Fig. 1 E-F).

      (2) Figure 1F - Arguably, IF images show expression of both CYLC1 and CYLC2 to reach/include the acrosome/hook portion of the sperm head, but the diagram does not reflect that. Why is that?

      We agree and apologize for the inconsistency. The illustration was adjusted according to the experimental data showing localization of Cylicins in the whole ventral part of the sperm.

      (3) Line 124 - PAS staining mentioned on line 124, is not explained (Periodic acid Schiff staining) until line 605

      We agree and introduced the abbreviation accordingly. The PAS staining was moved to Fig. 4. The paragraph reads now as follows:

      Line 220-222: To study the origin of observed structural sperm defects, spermiogenesis of Cylicin deficient males was analyzed in detail. PNA lectin staining and Periodic Acid Schiff (PAS) staining of testicular tissue sections were performed to investigate acrosome biogenesis.

      (4) Some figures are hard to read due to being very small (S1B, 3F).

      We agree and we increased the figure size. For former Figure 3F (now figure 4A), insets with higher magnification of representative sperm were added. Insets are additionally shown in Figure 4 – Supplement 1 in higher resolution.

      (5) Line 139 Please specify whether the sperm was capacitated or not.

      Analysis of the flagellar beat was performed with non-capacitated sperm. We clarified this in the main text:

      Line 203: The SpermQ software was used to analyze the flagellar beat of non-capacitated Cylc2-/- sperm in detail 22.

      As described in the Material and Methods section, sperm were only activated in TYH medium, prior to analysis:

      Line 732-733: Sperm samples were diluted in TYH buffer shortly before insertion of the suspension into the observation chamber.

      (6) Line 142-145; The sentence is interrupted strangely, perhaps the authors meant to write: "Interestingly, we observed that the flagellar beat of Cylc2-/- sperm cells was similar to wildtype cells, however, with interruptions during which midpiece and initial principal piece appeared stiff whereas high-frequency beating occurs at the flagellar tip"

      We corrected the sentence accordingly.

      Line 206-208: Interestingly, we observed that the flagellar beat of Cylc2-/- sperm cells was similar to wildtype cells, however, with interruptions during which midpiece and initial principal piece appeared stiff whereas high frequency beating occurs at the flagellar tip (Fig. 3 C, Video 1, Video 2).

      (7) Line 142 -Wrong Figure number. Figure S4A is a phylogenic analysis.

      We regret the mix up and corrected the Figure reference accordingly. Line 204-205: Cylc2-/- sperm showed stiffness in the neck and a reduced amplitude of the initial flagellar beat, as well as reduced average curvature of the flagellum during a single beat (Figure 3 – supplement 2).

      (8) L146-147 Better placed in Discussion.

      We agree, and we omitted this sentence from the results part.

      (9) Line 154-156 - The white arrowheads are present in both WT and KO sperm, thus it appears they denote the basal plate, not necessarily the dislocation/parallel position as the current text seems to suggest. Furthermore, the position of the WT and KO sperm is somewhat different with the tail coiling differently, so it is hard to see whether the two are comparable.

      We agree and we removed the white arrowhead in the WT sperm picture, and it now depicts only the dislocation of the basal plate in the Cylc2-/- sperm. Due to the morphological anomalies of Cylc2-/- sperm cells, it’s difficult to determine the exact angle of the depicted cell. However, we added more TEM pictures of the sperm cells (3 for WT and 6 for Cylc2-/-) in Figure 3 – Supplement 1.

      (10) Line 164 Please describe in detail what mitochondrial damage the readers expect to see from the TEM image.

      We evaluated the observed mitochondrial damage in more detail. Unfortunately, the defects described initially seem to be an artifact of apoptotic sperm cells and could not be identified in vital sperm cells in either of the knockout mouse models. We apologize for this misinterpretation, and we deleted this section in the manuscript.

      (12) Figure S2A - no WT comparison, difficult to compare without it (mitochondria in Cylc2-/-)

      See (10). We evaluated the observed mitochondrial damage in more detail and in comparison to WT. Unfortunately, the defects described initially seem to be an artifact of apoptotic sperm cells and could not be identified in vital sperm cells in either of the knockout mouse models. We apologize for this misinterpretation and we deleted this section in the manuscript.

      (13) Line 172-173 - Fig 3C denotes quantification of abnormal acrosome only, however, the text mentions sperm coiled tail being quantified within this graph - which is it? Is it both of them? Or only one of them?

      Figure 3 C (now Figure 2G) showed the percentage of abnormal sperm in general comprising acrosomal as well as flagellar defects. We modified the figure and evaluated acrosomal defects and tail defects separately. The results section was changed accordingly and reads now as follows:

      Line 152-159: Loss of Cylc1 alone caused malformations of the acrosome in around 38% of mature sperm, while their flagellum appeared unaltered and properly connected to the head. Cylc2+/- males showed normal sperm tail morphology with around 30% of acrosome malformations. Cylc2-/- mature sperm cells displayed morphological alterations of head and mid-piece (Fig. 2 F-G). 76% of Cylc2-/- sperm cells showed acrosome malformations, bending of the neck region, and/or coiling of the flagellum, occasionally resulting in its wrapping around the sperm head in 80% of sperm (Fig. 2 F). While 70% of Cylc1-/Y Cylc2+/- sperm showed these morphological alterations, around 92% of Cylc1-/YCylc2-/- sperm presented with coiled tail and abnormal acrosome (Fig. 2 F-G).

      (14) Fig 3D - CCIN in the text, cylicin in the figure - this should be consistent. Furthermore, since only the head is being shown, is CCIN ever detected in the WT sperm tail?

      We apologize for the inconsistency, and we added the abbreviation “CCIN” to the figure. CCIN is solely detectable in the sperm head of wildtype sperm as published previously. Irregular staining patterns showing signals in the tail region are only observed upon Cylicin deficiency.

      (15) Line 199-200 - To say that head of Cylc2-deficient sperm appears less concave seems redundant, likely the observed increased circularity is contributed to by sperm head being less concave in this region; unless there is an extra point that the authors are trying to make and if so, this needs to be elaborated on

      We agree and we deleted the sentence from the manuscript.

      (16) Figure legend of Fig S3 is wrong. Only S3A and S3B are present, and in the figure legend S3C corresponds to figure S3B.

      We agree and corrected the Figure legends accordingly. Due to the re-structuring of the manuscript, Figures and Supplementary figures were re-ordered as well.

      (17) Figure 4B - figure legend and/or text should specify that lectin is green and HOOK1 is in red

      We specified the figure legend as well as the main text accordingly: Line: 279-281: Co-staining of the spermatids with antibodies against PNA lectin (green) and HOOK1 (red) revealed that abnormal manchette elongation and acrosome anomalies simultaneously occurred in elongating spermatids of Cylc2-/- male mice (Fig. 5 C).

      Line: 560-562: Co-staining of the manchette with HOOK1 (red) and acrosome with PNA-lectin (green) is shown in round, elongating and elongated spermatids of WT (upper panel) and Cylc2-/- mice (lower panel).

      (18) Line 261-263 - It is difficult to see what is going on with microtubules in these images, as the resolution is low

      We increased the pictures and improved their quality. Microtubules are also depicted with letter ‘m’

      (19) Line 265-266 - It seems that there is a persistence of manchette, rather than elongation. From these images, I cannot see gaps, and I am not sure where to look for them. This needs to be labelled further and higher-resolution images could be included for clarity.

      We agree, although we observed both excessive elongation and persistence of the manchette. The average length of the manchette is now shown in figure 5B.

      The paragraph now reads as follows:

      Line 235-239: Microtubules appeared longer on one side of the nucleus than on the other, displacing the acrosome to the side and creating a gap in the PT (Fig. 4 C). Whereas elongated spermatids at step 14-15 in wildtype sperm already disassembled their manchette and the PT appeared as a unique structure that compactly surrounds nucleus, in Cylc2-/- spermatids, remaining microtubules failed to disassemble.

      The gaps in the perinuclear theca are better visible in TEM micrographs and the description is now in the paragraph describing TEM.

      (20) Line 269 Please include the information of "White arrowhead".

      We added the information accordingly.

      Line 240-242: In addition, at step 16, the calyx was absent, and an excess of cytoplasm surrounded the nucleus and flagellum (Fig. 4 C, white arrowhead).

      (21) Line 276-280 This should be placed in the Discussion.

      We agree, and we deleted this concluding remark from the results section.

      (22) Is Cylc1 and/or Cylc2 conserved/expressed amongst species other than rodents and primates?

      Yes, Cylc1 and Cylc2 homologs were identified in C. elegans for example. We added a schematic to the introduction showing the protein structure of human, mouse and C. elegans CYLC1 and CYLC2 (Figure 1 – supplement 1).

      The section reads now as follows:

      Line 73-78: In most species, two Cylicin genes, Cylc1 and Cylc2, have been identified (Figure 1- supplement 1). They are characterized by repetitive lysine-lysine-aspartic acid (KKD) and lysine-lysine-glutamic acid (KKE) peptide motifs, resulting in an isoelectric point (IEP) > pH 10 14, 15. Repeating units of up to 41 amino acids in the central part of the molecules stand out by a predicted tendency to form individual short α-helices 14. Mammalian Cylicins exhibit similar protein and domain characteristics, but CYLC2 has a much shorter amino-terminal portion than CYLC1 (Figure 1-supplement 1).

      (23) The whole chapter "Cylc2 coding sequence is slightly more conserved among species than Cylc1" references only supplemental figures/tables. I find this unusual.

      We agree, and in order to show the results of the evolutionary analysis more clearly, we moved the panel to main Figure 6.

      Line 286-302: To address why Cylc2 deficiency causes more severe phenotypic alterations than Cylc1deficiency in mice, we performed evolutionary analysis of both genes. Analysis of the selective constrains on Cylc1 and Cylc2 across rodents and primates revealed that both genes’ coding sequences are conserved in general, although conservation is weaker in Cylc1 trending towards a more relaxed constraint (Fig. 6 A). A model allowing for separate calculation of the evolutionary rate for primates and rodents, did not detect a significant difference between the clades, neither for Cylc1 nor for Cylc2, indicating that the sequences are equally conserved in both clades.

      To analyze the selective pressure across the coding sequence in more detail, we calculated the evolutionary rates for each codon site across the whole tree. According to the analysis, 34% of codon sites were conserved, 51% under relaxed selective constraint, and 15% positively selected. For Cylc2, 47% of codon sites conserved, 44% under neutral/relaxed constraint, and 9% positively selected. Interestingly, codon sites encoding lysine residues, which are proposed to be of functional importance for Cylicins, are mostly conserved. For Cylc1, 17% of lysine residues are significantly conserved and 35% of significantly conserved codons encode for lysine. For Cylc2, this pattern is even more pronounced with 27.9% of lysine codons being significantly conserved and 24.3% of all conserved sites encoding for lysine (Fig. 6 B).

      (24) Line 332 - CYCL2 should be CYLC2

      We corrected the typo accordingly.

      (25) Line 340 The ratio of head defects is different from Table 1 (98% here and 99 % in the table). Please check this information.

      We apologize for the inconsistency. We checked the raw data and corrected the table accordingly.

      (26) Line 344-345 From figure 5C it is difficult to determine whether the sperm are "headless" or whether the heads are attached to the highly coiled tails next to them

      We agree and we quantified the percentage of sperm showing abnormal flagella and a headless phenotype. Furthermore, we added an arrowhead to figure 6C to highlight headless sperm. The paragraph reads now as follows:

      Line 335-339: Bright field microscopy demonstrated that M2270’s sperm flagella coiled in a similar manner compared to flagella of sperm from Cylicin deficient mice. Quantification revealed 57% of M2270 sperm displaying abnormal flagella compared to 6% in the healthy donor (Fig. 7 D). Interestingly, DAPI staining revealed that 27% of M2270 flagella carry cytoplasmatic bodies without nuclei and could be defined as headless spermatozoa (Fig. 7 C, white arrowhead; Fig. 7 E).

      (27) L367-368 I agree with the authors' logic of this sentence. Although, it is better to show the co-localization of proteins using multi-channel immunocytochemistry. As you mentioned on L369 this will make your finding more obvious. If it is available, please include the colocalization images of the proteins.

      We performed the multi-channel staining against Cylicin1 and Calicin, as well as Cylicin2 and Calicin on mouse epipidymal sperm and it’s shown in Figure 2 – supplement 4. Unfortunately, we did not manage to obtain stainings of tissue sections since antibodies against Cylicins and Calicin require different sample processing.

      The sentence was added in the section describing calyx integrity:

      Line 168-169: In epididymal sperm, CCIN co-localizes with both CYLC1 and CYLC2 in the calyx (Figure 2 – supplement 4).

      (28) Line 376 Please keep the abbreviation. "Calicin" "CCIN".

      We included the abbreviation accordingly.

      Line 377-378: CCIN is shown to be necessary for the IAM-PT-NE complex by establishing bidirectional connections with other PT proteins.

      (29) Line 377-378 "Based on ~". The authors did not prove the interaction between CCIN and Cylicins in this article. The mislocalization of CCIN might be resulted in the loss of Cylicins, without any "interaction". To reach this conclusion, a more direct result should be provided.

      We agree that we overinterpreted this as we and others did not prove the interaction between CCIN and Cylicins so far. We therefore weakened this statement and formulated it as a hypothesis.

      Line 377-381: CCIN is shown to be necessary for the IAM-PT-NE complex by establishing bidirectional connections with other PT proteins. Zhang et al. found CYLC1 to be among proteins enriched in PT fraction 7. Based on their speculation that CCIN is the main organizer of the PT, we hypothesize that both CCIN and Cylicins might interact, either directly or in a complex with other proteins, in order to provide the ‘molecular glue’ necessary for the acrosome anchoring.

      (30) Line 499 Please specify which is the target of the immunostaining on the Figure legend. (Tubulin à acetylated α-tubulin)

      We specified that α-Tubulin was stained. The figure legend reads now as follow: Line 555-557: Immunofluorescence staining of α-Tubulin to visualize manchette structure in squash testis samples of WT, Cylc1-/y, Cylc2+/-, Cylc2-/-, Cylc1 -/y Cylc2+/- and Cylc1-/y Cylc2-/- mice.

      (31) Line 502 Please specify which color indicates which target protein (not only cellular structure).

      Line 560-562: Co-staining of the manchette with HOOK1 (red) and acrosome with PNA-lectin (green) is shown in round, elongating and elongated spermatids of WT (upper panel) and Cylc2-/- mice (lower panel).

      (32) Line 509 Please include scale bar information in the figure legend like Figure 4 (The magnifications of Figure 5 B, C, and D seem different).

      We included the scale bar information accordingly (now Figure 6).

      Line 575-588: Figure 6: Cylicins are required for human male fertility

      (A) Pedigree of patient M2270. His father (M2270_F) is carrier of the heterozygous CYLC2 variant c.551G>A and his mother (M2270_M) carries the X-linked CYLC1 variant c.1720G>C in a heterozygous state. Asterisks (*) indicate the location of the variants in CYLC1 and CYLC2 within the electropherograms.

      (B) Immunofluorescence staining of CYLC1 in spermatozoa from healthy donor and patient M2270. In donor’s sperm cells CYLC1 localizes in the calyx, while patient’s sperm cells are completely missing the signal. Scale bar: 5 µm.

      (C) Bright field images of the spermatozoa from healthy donor and M2270 show visible head and tail anomalies, coiling of the flagellum as well as headless spermatozoa who carry cytoplasmatic residues without nuclei. Heads were counterstained with DAPI. Scale bar: 5 µm.

      (D-E) Quantification of flagellum integrity (D) and headless sperm (E) in the semen of patient M2270 and a helathy donor.

      (F-G) Immunofluorescence staining of CCIN (F) and PLCz (G) in sperm cells of patient M2270 and a healthy donor. Nuclei were counterstained with DAPI. Scale bar: 3 µm.

      (33) S2A is not clear. Please describe specifically what the left panel and right panel are about to show with a clear indication of what is PM, mitochondria, etc. On the right, in only one cross-section that shows both mitochondria and the 9+2 axoneme, they look both unaltered whereas on the left, there are unpacked, not aligned mitochondria but the tail boundary is not clear to grasp at first sight.

      We apologize for the bad quality of the TEM pictures showing the axonemes and the missing labeling. We recorded and included new images showing an intact 9+2 microtubular structure in Cylc2-/-. Furthermore, we added an image for the wildtype control.

      (34) S2D: colors of the last three plots of each graph are too close to tell apart

      We agree and changed the color scheme for better visualization.

      Reviewer #2 (Recommendations For The Authors):

      However, I find the manuscript a bit messy, and I will propose to reorganize the figures: following figure 1, showing the reproductive phenotype, I would continue with a figure showing the morphology of sperm in optical microscopy and showing the morphological defect of the nucleus (Fig 3B and 3E), followed with one figure focusing on the flagellum, with images obtained with optical and electronic microscopies, allowing to present the abnormalities of the flagellum and finally the impact on sperm motility and flagellum beating (mix of figure 2FG/3A); next, one figure focusing on acrosome. After that, I would present all data concerning spermiogenesis, starting with figure 2C.

      We thank the reviewer for the valuable suggestion, which helps a lot to improve the structure and comprehensibility of the manuscript. We re-organized the figures and the results section accordingly.

      Major remarks

      1) Line 111. The specificity of raised Ab is not clear. Please specify if antibodies are specific: what immune-decorates anti-CYLC1: only CYLC1 or CYLC1 and CYLC2. Same question for anti-CYLC2

      Both antibodies were raised against specific peptides of the CYLC1 or CYLC2 protein, respectively. The antigen peptides used for immunization are depicted in the Material and Methods section (AESRKSKNDERRKTLKIKFRGK and KDAKKEGKKKGKRESRKKR peptides for CYLC1; KSVGTHKSLASEKTKKEVK and ESGGEKAGSKKEAKDDKKDA for CYLC2). The peptides used for immunization are specific as they do not resemble the highly conserved and repetitive KKD/KKE motives present in both, Cylc1 and Cylc2.

      The specificity of raised antibodies was validated by IF staining of wildype and Cylicin-deficient testis sections. The results clearly show, that CYLC1 signal is absent in Cylc1-deficient spermatids and CYLC2 signal being absent in Cylc2 deficient spermatids.

      Specificity of antibodies was additionally proven by immunohistochemical stainings, showing a specific staining only in testis sections but not in any other organ tested.

      Line 115-117: Specificity of antibodies was proven by immunohistochemical stainings, showing a specific staining only in testis sections but not in any other organ tested (Figure 1 - supplement 2)

      To further verify the specificity of generated antibodies and the generation of functional knockout alleles, we additionally performed Western Blot analysis on cytoskeletal protein fractions, confirming the results of the IF staining.

      The paragraph reads now as follows:

      Line 127-134: Additionally, Western Blot analyses confirmed the absence of CYLC1 and CYLC2 in cytoskeletal protein fractions of the respective knockout (Fig. 1 G), thereby demonstrating i) specificity of the antibodies and ii) validating the gene knockout. Of note, the CYLC1 antibody detects a double band at 40-45 KDa. This is smaller than the predicted size of 74 KDa as, but both bands were absent in Cylc1-/y. Similarly, the CYLC2 Antibody detected a double band at 38-40 KDa instead of 66 KDa. Again, both bands were absent in Cylc2-/-. Next, Mass spectrometry analysis of cytoskeletal protein fraction of mature spermatozoa was performed detecting both proteins in WT but not in the respective knockout samples (Figure 1 – supplement 5; Figure 1 – supplement 6).

      2) Line 115 and figure 1D. From the images presented in figure 1D, it is not clear where CYLC1 and CYLC2 are localized in the round and in elongated spermatids. Please make double staining using a second Ab to identify the acrosome such as DPY19L2 (best option) or SP56 and the manchette such as acetylated alpha-tubulin.

      We agree, and we added a double staining of CYLC1/CYLC2 and SP56 to the supplement (Figure 1 - supplement 3), showing co-localization of the developing acrosome and Cylicins. Manchette staining was not performed due to antibodies being available in same species as those against Cylicins (anti-rabbit).

      Line 117-120: Immunofluorescence staining of wildtype testicular tissue showed presence of both, CYLC1 and CYLC2 from the round spermatid stage onward (Fig. 1 E, Figure 1 – supplement 3). The signal was first detectable in the subacrosomal region as a cap like structure, lining the developing acrosome (Fig. 1 E-F, Figure 1 – supplement 3).

      3) Line 118 and figure 1. The drawing showing the localization of Cylicin in mature sperm does not fit with the experimental data. Cylicins are located on the whole ventral face of the sperm.

      We agree and apologize for the inconsistency. The illustration was adjusted according to the experimental data showing localization of Cylicins in the whole ventral part of the sperm.

      4) Figure 1: Change "expression of Cylicin" to "localization of cylicin" (green)

      We changed the legend accordingly.

      5) Line 124 and figure 2C. In the figure provided, the PAS staining seems defective. The acrosomes do not seem stained (in pink as expected for a PAS staining). It may be due to the low quality of the pdf file, nevertheless, it is important to provide in supplementary data, an enlargement of the spermatid region showing the staining of the acrosome.

      We apologize for the bad quality of the PDF file and the low magnification. We restructured the subfigure showing PAS stained spermatids at different steps of spermiogenesis at higher magnification. According to the initial reviewer’s suggestion, the PAS staining was moved to figure 4. The PAS staining in figure 2 was replaced by HE-stained overview testis sections in Figure 3 – supplement 1 showing intact spermatogenesis in all genotypes.

      6) Line 130. Please indicate a reference for the lower limit of 58%. If this lower limit corresponds to human sperm, it should be omitted.

      Indeed, the given reference limit of 58% is only valid for human sperm samples. Therefore, we omitted the reference limit. The paragraph reads now as follows: Line 144-146: Eosin-Nigrosin staining revealed that the viability of epididymal sperm from all genotypes was not severely affected (Fig. 2 D, Figure 2 – supplement 2).

      7) line 152 Sperm morphology. Before showing the ultrastructure of the sperm, it would be important to show sperm morphology observed by optical microscopy. Therefore, I recommend including figure S2 as a principal figure, with a mix of Figures 3B and 3E.

      We thank the reviewer for the suggestion. The results section was re-structured accordingly, first showing results of optical microscopy (Fig. 2), followed by an in-depth ultrastructural investigation of morphological defects and their effects on sperm motility. Brightfield images of epididymal sperm were moved from former Figure S2 to main Figure 2.

      8) Line 164. figure S2A, showing that the 9+2 pattern is normal in KO sperm, is not convincing. Enlargement is required to conclude that the axoneme structure is normal; from the pictures, it rather seems that some doublets are missing.

      We apologize for the bad quality of the TEM pictures showing the axonemes. We recorded and included new images showing an intact 9+2 microtubular structure.

      9) Line 196. I would suggest removing the term "mild globozoospermia". Globozoospermia is rather complete (100% of round sperm heads) or incomplete (<90 % of round sperm heads). The anomalies observed on sperm heads, sperm motility, and the decrease in sperm concentration are rather suggestive of an OAT.

      We agree and we omitted the term “mild globozoospermia”. Instead, we added a concluding remark to the section, summarizing the described defects as OAT syndrome. The section reads now as follows:

      Line 215-217: Taken together, observed anomalies of sperm heads, impaired sperm motility, and the decrease in epididymal sperm concentration show that Cylc deficiency results in a severe OAT phenotype (Oligo-Astheno-Teratozoospermia-syndrome) described in human.

      10) Line 248. It is not clear from the data of figure 4B that "the developing acrosome lost its compact adherence to the nuclear envelope". From this figure, only defective morphologies of the acrosome are observed

      We agree and we omitted the sentence. Furthermore, it does not add additional information to the manuscript, since defects in the attachment of the acrosome to the nuclear envelope have been described in detail in Figure 4C.

      11) line 260-264. Manchette defects appear at stages 9-10. At this stage, the HTCA is already attached to the nucleus of the spermatid. see for instance figure 2 from Shang Y, Zhu F, Wang L, Ouyang YC, Dong MZ, Liu C, Zhao H, Cui X, Ma D, Zhang Z, Yang X, Guo Y, Liu F, Yuan L, Gao F, Guo X, Sun QY, Cao Y, Li W. Essential role for SUN5 in anchoring sperm head to the tail. Elife. 2017 Sep 25;6:e28199. doi: 10.7554/eLife.28199 . Therefore, the hypothesis that "abnormal attachment of the developing flagellum to the basal plate and consequently flipping of the head and coiling of the tail in mature spermatozoa" is unlikely and I suggest modifying this paragraph. In the HOOK paper, the manchette defects occurred earlier.

      We read the suggested literature and we agree to this reviewer’s comment. Manchette defects that we observe appear at later stages and are probably not responsible for the morphological anomalies of the mature sperm. We also re-analyzed all the manchette staining pictures and didn’t find any defects at earlier stages, so we decided to delete the sentence from the manuscript.

      12) Line 344. Please indicate a percentage of headless spermatozoa. Many sperm is too vague.

      We agree and we quantified the percentage of sperm showing abnormal flagella and a headless phenotype. The paragraph reads now as follows:

      Line 335-339: Bright field microscopy demonstrated that M2270’s sperm flagella coiled in a similar manner compared to flagella of sperm from Cylicin deficient mice. Quantification revealed 57% of M2270 sperm displaying abnormal flagella compared to 6% in the healthy donor (Fig. 7 D). Interestingly, DAPI staining revealed that 27% of M2270 flagella carry cytoplasmatic bodies without nuclei and could be defined as headless spermatozoa (Fig. 7 C, white arrowhead; Fig. 7 E).

      13) Any data concerning the success of ICSI for this patient?

      Yes, the outcome of the ICSI were added to the main text. Line 309-311: The couple underwent one ICSI procedure which resulted in 17 fertilized oocytes out of 18 retrieved. Three cryo-single embryo transfers were performed in spontaneous cycles, but no pregnancy was achieved.

      14) Finally, it would be interesting to study the localization of PLCzeta in this model, since its localization in the perinuclear theca has been clearly shown (Escoffier et al, 2015 doi:10.1093/molehr/gau098 )

      We thank the reviewer for the valuable suggestion and performed PLCzeta staining on human sperm, clearly showing an irregular PT staining pattern in sperm of patient M2270 compared to healthy control sperm. Of note, staining was not possible in the mouse due to the antibody being reactive only for human samples.

      The section reads as follows:

      Line 343-349: Testis specific phospholipase C zeta 1 (PLCζ1) is localized in the postacrosomal region of PT in mammalian sperm (Yoon and Fissore, 2007) and has a role in generating calcium (Ca²⁺) oscillations that are necessary for oocyte activation (Yoon, 2008). Staining of healthy donor’s spermatozoa showed a previously described localization of PLCζ1 in the calyx, while sperm from M2270 patient presents signal irregularly through the PT surrounding sperm heads (Fig. 7 G). These results suggest that Cylicin deficiency can cause severe disruption of PT in human sperm as well, causing male infertility.

      Reviewer #3 (Recommendations For The Authors):

      1) Why the Cylc1-/y Cylc2+/- males were infertile? It would be helpful to show the homologue of the two proteins;

      To elaborate more on the homology of CYLC1 and CYLC2, we added a more detailed section about the protein and domain structure to the introduction.

      Line 73-78: In most species, two Cylicin genes, Cylc1 and Cylc2, have been identified (Figure 1supplement 1). They are characterized by repetitive lysine-lysine-aspartic acid (KKD) and lysine-lysineglutamic acid (KKE) peptide motifs, resulting in an isoelectric point (IEP) > pH 10 14, 15. Repeating units of up to 41 amino acids in the central part of the molecules stand out by a predicted tendency to form individual short α-helices (Hess et al., 1993). Mammalian Cylicins exhibit similar protein and domain characteristics, but CYLC2 has a much shorter amino-terminal portion than CYLC1 (Figure 1supplement 1).

      Speculations about the infertility of Cylc1-/y Cylc2+/- males was added to the discussion:

      Line 410-413: Interestingly, Cylc1-/Y Cylc2+/- males displayed an “intermediate” phenotype, showing slightly less damaged sperm than Cylc2-/- and Cylc1-/Y Cylc2-/- animals. This further supports our notion, that loss of the less conserved Cylc1 gene might be at least partially compensated by the remaining Cylc2 allele.

      2) Western blot is important to show the absence of the two proteins in the mouse models;

      To further verify the specificity of generated antibodies and the generation of functional knockout alleles, we additionally performed Western Blot analysis on cytoskeletal protein fractions, confirming the results of the IF staining.

      A paragraph was added to the manuscript and reads as follows:

      Line 127-134: Additionally, Western Blot analyses confirmed the absence of CYLC1 and CYLC2 in cytoskeletal protein fractions of the respective knockout (Fig. 1 G), thereby demonstrating i) specificity of the antibodies and ii) validating the gene knockout. Of note, the CYLC1 antibody detects a double band at 40-45 KDa. This is smaller than the predicted size of 74 KDa as, but both bands were absent in Cylc1-/y. Similarly, the CYLC2 Antibody detected a double band at 38-40 KDa instead of 66 KDa. Again, both bands were absent in Cylc2-/-. Next, Mass spectrometry analysis of cytoskeletal protein fraction of mature spermatozoa was performed detecting both proteins in WT but not in the respective knockout samples (Figure 1 – supplement 5; Figure 1 – supplement 6).

      3) On Page 7, line 227 and line 243, was the acetylated α-tubulin or α-tubulin antibody used?

      For all stainings α-tubulin antibody was used. We corrected this accordingly. Line 257-259: We used immunofluorescence staining of α-tubulin on squash testis samples containing spermatids at different stages of spermiogenesis to investigate whether the altered head shape, calyx structure, and tail-head connection anomalies originate from possible defects of the manchette structure.

      4) Fig. 2S: A cartoon showing the elongation and circularity of nuclei for evaluation is helpful; The TEM images from the control and Cylc1 KO mice are needed;

      Cylc1-/Y TEM picture was added in Figure 3A.

      5) The discussion should be rewritten. The current version is to repeat the experiments/findings. The authors should discuss more about the potential mechanisms.

      We discussed the observed defects of Cylc-deficient animals and discussed this in relation to other published mouse models deficient in Calyx components. Furthermore, we speculated about potential interaction partners of Cylicins and the importance of these protein complexes for male fertility. However, to this point, we think that it is too farfetched to speculate about potential mechanisms without any evidence for Cylc interaction partner or their exact molecular function. This requires further research.

    1. Author Response

      The following is the authors’ response to the original reviews.

      eLife assessment

      This useful manuscript challenges the utility of current paradigms for estimating brain-age with magnetic resonance imaging measures, but presents inadequate evidence to support the suggestion that an alternative approach focused on predicting cognition is more useful. The paper would benefit from a clearer explication of the methods and a more critical evaluation of the conceptual basis of the different models. This work will be of interest to researchers working on brain-age and related models.

      Response: Thank you so much for providing high-quality reviews on our manuscript. We revised the manuscript to address all of the reviewers’ comments and provided full responses to each of the comments below.

      Briefly, regarding clearer explanations of the methods, we added additional analyses (e.g., commonality analyses on ridge regression and on multiple regressions with a quadratic term for chronological age) to address some of the concerns and additional details in text and figures to ensure that the reader can fully understand our methodological procedures. Regarding the critical evaluation of the conceptual basis of the different models, we added discussions to help with interpretations and the scope of the generalisability of our findings. For instance, as opposed to treating Brain Cognition and Brain Age as separate biomarkers and comparing them in the ability to explain fluid cognition, we now treated the capability of Brain Cognition in capturing fluid cognition as the upper limit of Brain Age’s capability in capturing fluid cognition. In other words, we now examined the extent to which Brain Age missed the variation in the brain MRI that could explain fluid cognition (for this particular issue, please see our response to Reviewer 3 Public Review #4).

      Reviewer 1:

      This is a reasonably good paper and the use of a commonality analysis is a nice contribution to understanding variance partitioning across different covariates. I have some comments that I believe the authors ought to address which mostly relate to clarity and interpretation.

      Reviewer 1 Public Review #1:

      First, from a conceptual point of view, the authors focus exclusively on cognition as a downstream outcome. I would suggest the authors nuance their discussion to provide broader considerations of the utility of their method and on the limits of interpretation of brain-age models more generally. Further, I think that since brain-age models by construction confound relevant biological variation with the accuracy of the regression models used to estimate them, there may be limits to the interpretation of (e.g.) the brain-age gap is as a dimensionless biomarker. This has also been discussed elsewhere (see e.g. https://academic.oup.com/brain/article/143/7/2312/5863667). I would suggest that the authors consider and comment on these issues.

      Response: Thank you Reviewer 1 for pointing out these important issues. We addressed them in our response to Reviewer 1 Recommendations For The Authors #1 (see below).

      Reviewer 1 Public Review #2

      Second, from a methods perspective, there is not a sufficient explanation of the methodological procedures in the current manuscript to fully understand how the stacked regression models were constructed. Stacked models can be prone to overfitting when combined with cross-validation. This is because the predictions from the first-level models (i.e. the features that are provided to the second level 'stacked' models) contain information about the training set and the test set. If cross-validation is not done very carefully (e.g. using multiple hold-out sets), information leakage can easily occur at the second level. Unfortunately, there is not a sufficient explanation of the methodological procedures in the current manuscript to fully understand what was actually done. Please provide more information to enable the reader to better understand the stacked regression models. If the authors are not using an approach that fully preserves training and test separability, they need to do so.

      Response: Thank you Reviewer 1. We addressed this issue in our response to Reviewer 1 Recommendations For The Authors #2 (see below). Briefly, we now made it clearer that training models for both non-stacked and stacked models did not involve the test set, ensuring that there was no data leakage between training and test sets.

      Reviewer 1 Public Review #3

      Please also provide an indication of the different regression strengths that were estimated across the different models and cross-validation splits. Also, how stable were the weights across splits?

      Response: Thank you Reviewer 1. We addressed this issue in our response to Reviewer 1 Recommendations For The Authors #3 (see below).

      Reviewer 1 Public Review #4:

      Please provide more details about the task designs, MRI processing procedures that were employed on this sample in addition to the regression methods, and bias-correction methods used. For example, there are several different parameterisations of the elastic net, please provide equations to describe the method used here so that readers can easily determine how the regularisation parameters should be interpreted.

      Response: Thank you Reviewer 1. We addressed this issue in our response to Reviewer 1 Recommendations For The Authors #5-#6. Briefly, we followed your advice and add all of the suggested details.

      Reviewer 2 (Public Review):

      Reviewer 2 Public Review Overall:

      In this study, the authors aimed to evaluate the contribution of brain-age indices in capturing variance in cognitive decline and proposed an alternative index, brain-cognition, for consideration. The study employs suitable data and methods, albeit with some limitations, to address the research questions. A more detailed discussion of methodological limitations in relation to the study's aims is required. For instance, the current commonality analysis may not sufficiently address potential multicollinearity issues, which could confound the findings. Importantly, given that the study did not provide external validation for the indices, it is unclear how well the models would perform and generalize to other samples. This is particularly relevant to their novel index, brain-cognition, given that brain-age has been validated extensively elsewhere. In addition, the paper's rationale for using elastic net, which references previous fMRI studies, seemed somewhat unclear. The discussion could be more nuanced and certain conclusions appear speculative.

      Response Thank you for your encouragement. We have now added discussion of methodological limitations (see below). Regarding potential multicollinearity issues, we addressed this comment using Ridge regressions (see our response to Reviewer 2 Recommendations For The Authors #2). Regarding external validation, we now added discussions about how consistency between our results and several recent studies that investigated similar issues with Brain Age in different populations (see Reviewer 2 Recommendations For The Authors #1). Regarding Brain Cognition, we also added previous studies showing similarly high prediction for cognition functioning (Dubois et al., 2018; Pat, Wang, Anney, et al., 2022; Rasero et al., 2021; Sripada et al., 2020; Tetereva et al., 2022; for review, see Vieira et al., 2022). We added a discussion about Elastic Net (see Reviewer 1 Recommendations For The Authors #6)

      Discussion

      “There are several potential limitations of this study. First, we conducted an investigation relying only on one dataset, the Human Connectome Project in Aging (HCP-A) (Bookheimer et al., 2019). While HCP-A used state-of-the-art MRI methodologies, covered a wide age range from 36 to 100 years old and used several task-fMRI from different tasks that are harder to find in other bigger databases (e.g., UK Biobank from Sudlow et al., 2015), several characteristics of HCP-A might limit the generalisability of our findings. For instance, the tasks used in task-based fMRI in HCP-A are not used widely in clinical settings (Horien et al., 2020). This might make it challenging to translate the approaches used here. Similarly, HCP-A also excluded participants with neurological conditions, possibly making their participants not representative of the general population. Next, while HCP-A’s sample size is not small (n=725 and 504 people, before and after exclusion, respectively), other datasets provide a much larger sample size (Horien et al., 2020). Similarly, HCP-A does not include younger populations. But as mentioned above, a study with a larger sample in older adults (Cole, 2020) and studies in younger populations (8-22 years old) (Butler et al., 2021; Jirsaraie, Kaufmann, et al., 2023) also found small effects of the adjusted Brain Age Gap in explaining cognitive functioning. And the disagreement between the predictive performance of age-prediction models and the utility of Brain Age found here is largely in line with the findings across different phenotypes seen in a recent systematic review (Jirsaraie, Gorelik, et al., 2023).”

      Reviewer 2 Public Review #1:

      The authors aimed to evaluate how brain-age and brain-cognition indices capture cognitive decline (as mentioned in their title) but did not employ longitudinal data, essential for calculating 'decline'. As a result, 'cognition-fluid' should not be used interchangeably with 'cognitive decline,' which is inappropriate in this context.

      Response Thank you for raising this issue. We now no longer used the word ‘cognitive decline’.

      Reviewer 2 Public Review #2:

      In their first aim, the authors compared the contributions of brain-age and chronological age in explaining variance in cognition-fluid. Results revealed much smaller effect sizes for brain-age indices compared to the large effects for chronological age. While this comparison is noteworthy, it highlights a well-known fact: chronological age is a strong predictor of disease and mortality. Has the brain-age literature systematically overlooked this effect? If so, please provide relevant examples. They conclude that due to the smaller effect size, brain-age may lack clinical significance, for instance, in associations with neurodegenerative disorders. However, caution is required when speculating on what brain-age may fail to predict in the absence of direct empirical testing. This conclusion also overlooks extant brain-age literature: although effect sizes vary across psychiatric and neurological disorders, brain-age has demonstrated significant effects beyond those driven by chronological age, supporting its utility.

      Response For aim 1, we focused our claims on cognitive functioning and not on any clinical significance for neurodegenerative disorders. We now made it clearer that the small effects of the Corrected Brain Age Gap in explaining fluid cognition of aging individuals found here are consistent with a study with a larger sample in older adults (Cole, 2020) and studies in younger populations (8-22 years old) (Butler et al., 2021; Jirsaraie, Kaufmann, et al., 2023).

      We believe this issue of the utility of brain age on cognitive functioning vs neurological/psychological disorders requires another consideration, namely the discrepancy in the training and test samples typically used for studies focusing on neurological/psychological disorders. We made this point in the discussion now (see below).

      Discussion

      “There is a notable difference between studies investigating the utility of Brain Age in explaining cognitive functioning, including ours and others (e.g., Butler et al., 2021; Cole, 2020, 2020; Jirsaraie, Kaufmann, et al., 2023) and those explaining neurological/psychological disorders (e.g., Bashyam et al., 2020; Rokicki et al., 2021). That is, those Brain Age studies focusing on neurological/psychological disorders often build age-prediction models from MRI data of largely healthy participants (e.g., controls in a case-control design or large samples in a population-based design), apply the built age-prediction models to participants without vs. with neurological/psychological disorders and compare Brain Age indices between the two groups. This means that age-prediction models from Brain Age studies focusing on neurological/psychological disorders might be under-fitted when applied to participants with neurological/psychological disorders because they were built from largely healthy participants. And thus the difference in Brain Age indices between participants without vs. with neurological/psychological disorders might be confounded by the under-fitted age-prediction models (i.e., Brain Age may predict chronological age well for the controls, but not for those with a disorder). On the contrary, our study and other Brain Age studies focusing on cognitive functioning often build age-prediction models from MRI data of largely healthy participants and apply the built age-prediction models to participants who are also largely healthy. Accordingly, the age-prediction models for explaining cognitive functioning do not suffer from being under-fitted. We consider this as a strength, not a weakness of our study.”

      Reviewer 2 Public Review #3:

      The second aim's results reveal a discrepancy between the accuracy of their brain-age models in estimating age and the brain-age's capacity to explain variance in cognition-fluid. The authors suggest that if the ultimate goal is to capture cognitive variance, brain-age predictive models should be optimized to predict this target variable rather than age. While this finding is important and noteworthy, additional analyses are needed to eliminate potential confounding factors, such as correlated noise between the data and cognitive outcome, overfitting, or the inclusion of non-healthy participants in the sample. Optimizing brain-age models to predict the target variable instead of age could ultimately shift the focus away from the brain-age paradigm, as it might optimize for a factor differing from age.

      Response We discussed the issue regarding the discrepancy between the accuracy of their brain-age models in estimating age and the brain-age's capacity to explain variance in fluid cognition in our response to Reviewer 3 Public Review #9 (see below). This issue is found to be widespread in a recent systematic review (Jirsaraie, Gorelik, et al., 2023). We now provided several strategies to mitigate this issue to improve the utility of Brain Age in explaining other phenotypes based on our current work and others, using different MRI modalities as well as modelling techniques (Bashyam et al., 2020; Jirsaraie, Kaufmann, et al., 2023; Rokicki et al., 2021).

      Regarding potential confounding factors, we are not sure what the reviewer meant by “correlated noise between the data and cognitive outcome”. The current study, for instance, used ICA-FIX (Glasser et al., 2016) to remove noise in functional MRI. It is unclear how much ‘noise’ is still left and might confound our findings. More importantly, we are not sure how to define ‘noise’ as referred to by Reviewer 2 here. As for overfitting, we used nested cross-validation to ensure that training and test sets were separate from each other (see Reviewer 1 Recommendations For The Authors #2). If overfitting happened as suggested, we should see a ‘lower’ predictive performance of age-prediction and cognitive-prediction models since the models would fit well with the training set but would not generalise well to the test set. This is not what we found. The predictive performance of our age-prediction and cognitive-prediction models was high and consistent with the literature. Regarding the inclusion of non-healthy participants in the sample, we discussed this above in our response to Reviewer 2 Public Review #2).

      Reviewer 2 Public Review #4:

      While a primary goal in biomarker research is to obtain indices that effectively explain variance in the outcome variable of interest, thus favouring models optimized for this purpose, the authors' conclusion overlooks the potential value of 'generic/indirect' models, despite sacrificing some additional explained variance provided by ad-hoc or 'specific/direct' models. In this context, we could consider brain-age as a 'generic' index due to its robust out-of-sample validity and significant associations across various health outcome variables reported in the literature. In contrast, the brain-cognition index proposed in this study is presumed to be 'specific' as, without out-of-sample performance metrics and testing with different outcome variables (e.g., neurodegenerative disease), it remains uncertain whether the reported effect would generalize beyond predicting cognition-fluid, the same variable used to condition the brain-cognition model in this study. A 'generic' index like brain-age enables comparability across different applications based on a common benchmark (rather than numerous specific models) and can support explanatory hypotheses (e.g., "accelerated ageing") since it is grounded in its own biological hypothesis. Generic and specific indices are not mutually exclusive; instead, they may offer complementary information. Their respective utility may depend heavily on the context and research or clinical question.

      Response Thank you Reviewer 2 for pointing out this important issue. Reviewer 1 (Recommendations For The Authors #4) and Reviewer 3 (Public Review #4) bought up a similar issue. We agreed with Reviewer 2 that both 'specific/direct' index and Brain Age as a 'generic/indirect' index have merit in their own right. We made a discussion about this issue in our response to Reviewer 3 Public Review #4 (please see this response below).

      Briefly, in the revision, as opposed to treating Brain Cognition and Brain Age as separate biomarkers and comparing them, we treated the capability of Brain Cognition in capturing fluid cognition as the upper limit of Brain Age’s capability in capturing fluid cognition. In other words, we now examined the extent to which Brain Age missed the variation in the brain MRI that could explain fluid cognition. We also made a discussion about using our commonality approach to test for this missing variation in future work:

      Discussion

      “Finally, researchers should test how much Brain Age miss the variation in the brain MRI that could explain fluid cognition or other phenotypes of interest. As demonstrated here, one straightforward method is to build a prediction model using a phenotype of interest as the target (e.g., fluid cognition) and incorporate the predicted value of this model (e.g., Brain Cognition), along with Brain Age and chronological age, into a multiple regression for commonality analyses. The unique effect of this predicted value will inform the missing variation in the brain MRI from Brain Age. If this unique effect is large, then researchers might need to reconsider whether using Brain Age is appropriate for a particular phenotype of interest.”

      Reviewer 2 Public Review #5:

      The study's third aim was to evaluate the authors' new index, brain-cognition. The results and conclusions drawn appear similar: compared to brain-age, brain-cognition captures more variance in the outcome variable, cognition-fluid. However, greater context and discussion of limitations is required here. Given the nature of the input variables (a large proportion of models in the study were based on fMRI data using cognitive tasks), it is perhaps unsurprising that optimizing these features for cognition-fluid generates an index better at explaining variance in cognition-fluid than the same features used to predict age. In other words, it is expected that brain-cognition would outperform brain-age in explaining variance in cognition-fluid since the former was optimized for the same variable in the same sample, while brain-age was optimized for age. Consequently, it is unclear if potential overfitting issues may inflate the brain-cognition's performance. This may be more evident when the model's input features are the ones closely related to cognition, e.g., fMRI tasks. When features were less directly related to cognitive tasks, e.g., structural MRI, the effect sizes for brain-cognition were notably smaller (see 'Total Brain Volume' and 'Subcortical Volume' models in Figure 6). This observation raises an important feasibility issue that the authors do not consider. Given the low likelihood of having task-based fMRI data available in clinical settings (such as hospitals), estimating a brain-cognition index that yields the large effects discussed in the study may be challenged by data scarcity.

      Response Given the use of nested cross-validation, we do not consider the good predictive performance of Brain Cognition found here as overfitting. In fact, we found a similar level of predictive performance of Brain Cognition on another database with younger participants in the past (Tetereva et al., 2022). However, we agreed with Reviewer 2 that the prediction of fluid cognition might be driven by MRI modalities that are different from those that drive the prediction of chronological age. In our own work with other age groups, including young adults (Tetereva et al., 2022) and children (Pat, Wang, Anney, et al., 2022), cognitive functioning seems to be predicted well from task-based functional MRI. And Reviewer 2 is right that task-based fMRI is not commonly used in clinics, making it harder to translate our results. However, given our results, clinicians should be encouraged to use task-based fMRI if their goal is to predict cognitive functioning. Nevertheless, as suggested, we listed data scarcity as one of the limitations of our approach.

      Discussion “For instance, the tasks used in task-based fMRI in HCP-A are not used widely in clinical settings (Horien et al., 2020). This might make it challenging to translate the approaches used here.”

      Reviewer 2 Public Review #6:

      This study is valuable and likely to be useful in two main ways. First, it can spur further research aimed at disentangling the lack of correspondence reported between the accuracy of the brain-age model and the brain-age's capacity to explain variance in fluid cognitive ability. Second, the study may serve, at least in part, as an illustration of the potential pros and cons of using indices that are specific and directly related to the outcome variable versus those that are generic and only indirectly related.

      Response We are thankful for the encouragement. For the discrepancy between the predictive performance of age-prediction models and the utility of Brain Age indices as a biomarker for fluid cognition, we made a detailed discussion in our response to Reviewer 3 Public Review #9. More specifically, to ensure that readers can benefit from our findings, we made suggestions on how to ensure the utility of Brain Age indices as a biomarker for other phenotypes by drawing from our own strategy, as well as strategies used by Rokicki and colleagues (2021), Jirsaraie and colleagues (2023) and Bashyam and colleagues (2020).

      As for the pros and cons between generic vs specific biomarkers, we made a detailed discussion in our response to Reviewer 3 Public Review #4. We also made some suggestions on how to make use of the difference in the ability between generic vs specific biomarkers (see Reviewer 2 Public Review #4, above).

      Reviewer 2 Public Review #7:

      Overall, the authors effectively present a clear design and well-structured procedure; however, their work could have been enhanced by providing more context for both the brain-age and brain-cognition indices, including a discussion of key concepts in the brain-age paradigm, which acknowledges that chronological age strongly predicts negative health outcomes, but crucially, recognizes that ageing does not affect everyone uniformly. Capturing this deviation from a healthy norm of ageing is the key brain-age index. This lack of context was mirrored in the presentation of the four brain-age indices provided, as it does not refer to how these indices are used in practice. In fact, there is no mention of a more common way in which brain-age is implemented in statistical analyses, which involves the use of brain-age delta as the variable of interest, along with linear and non-linear terms of age as covariates. The latter is used to account for the regression-to-the-mean effect. The 'corrected brain-age delta' the authors use does not include a non-linear term, which perhaps is an additional reason (besides the one provided by the authors) as to why there may be small, but non-zero, common effects of both age and brain-age in the 'corrected brain-age delta' index commonality analysis. The context for brain-cognition was even more limited, with no reference to any existing literature that has explored direct brain-cognitive markers, such as brain-cognition.

      Response Regarding Brain Age and negative health outcomes, we addressed this in our response to Reviewer 1 Recommendations For The Authors #1 (see below). Briefly, we now discussed (1) the consistency between our findings on fluid cognition and other recent works on negative health outcomes, (2) the differences between Brain Age studies focusing on negative health outcomes vs. cognitive functioning and (3) suggested solutions to optimise the utility of brain age for both cognitive functioning and negative health outcomes.

      Regarding how Brain Age was used in practice, we addressed this in our response to Reviewer 3 Public Review #2 (see below). Our argument resonates Butler and colleagues’ (2021) suggestion that the common practice for Brain Age analysis should be re-evaluated: “The MBAG and performance on the complex cognition tasks were not associated (r =  .01, p = 0.71). These results indicate that the association between cognition and the BAG are driven by the association between age and cognitive performance. As such, it is critical that readers of past literature note whether or not age was controlled for when testing for effects on the BAG, as this has not always been common practice (e.g., Beheshti et al., 2018; Cole, Underwood, et al., 2017; Franke et al., 2015; Gaser et al., 2013; Liem et al., 2017; Nenadi c et al., 2017; Steffener et al., 2016). (p. 4097).”

      Importantly, we also implemented “brain-age delta as the variable of interest, along with linear and non-linear terms of age as covariates” in our additional analyses along with other implementations (see Reviewer 2 Recommendations For The Authors #3). Of particular note, we found that adding a non-linear term (i.e., a quadratic term for chronological age) barely changed the results of commonality analyses.

      We now wrote this paragraph to recommend how future research should implement Brain Age:

      Discussion

      “First, they have to be aware of the overlap in variation between Brain Age and chronological age and should focus on the contribution of Brain Age over and above chronological age. Using Brain Age Gap will not fix this. Butler and colleagues (2021) recently highlighted this point, “These results indicate that the association between cognition and the BAG are driven by the association between age and cognitive performance. As such, it is critical that readers of past literature note whether or not age was controlled for when testing for effects on the BAG, as this has not always been common practice (p. 4097).” Similar to their recommendation (Butler et al., 2021), we suggest future work focus on Corrected Brain Age Gap or, better, unique effects of Brain Age indices after controlling for chronological age in multiple regressions. In the case of fluid cognition, the unique effects might be too small to be clinically meaningful as shown here and previously (Butler et al., 2021; Jirsaraie, Kaufmann, et al., 2023). “

      Regarding brain cognition, we now expanded our explanation about Brain Cognition on how it might be relevant to Brain Age and on Brain Cognition’s predictive performance found previously.

      Introduction

      “Third and finally, certain variation in the brain MRI is related to fluid cognition, but to what extent does Brain Age not capture this variation? To estimate the variation in the brain MRI that is related to fluid cognition, we could build prediction models that directly predict fluid cognition (i.e., as opposed to chronological age) from brain MRI data. Previous studies found reasonable predictive performances of these cognition-prediction models, built from certain MRI modalities (Dubois et al., 2018; Pat, Wang, Anney, et al., 2022; Rasero et al., 2021; Sripada et al., 2020; Tetereva et al., 2022; for review, see Vieira et al., 2022). Analogous to Brain Age, we called the predicted values from these cognition-prediction models, Brain Cognition. The strength of an out-of-sample relationship between Brain Cognition and fluid cognition reflects variation in the brain MRI that is related to fluid cognition and, therefore, indicates the upper limit of Brain Age’s capability in capturing fluid cognition. Consequently, the unique effects of Brain Cognition that explain fluid cognition beyond Brain Age and chronological age indicate what is missing from Brain Age -- the amount of co-variation between brain MRI and fluid cognition that cannot be captured by Brain Age.”

      Discussion

      “Third, by introducing Brain Cognition, we showed the extent to which Brain Age indices were not able to capture the variation of brain MRI that is related to fluid cognition. Brain Cognition, from certain cognition-prediction models such as the stacked models, has relatively good predictive performance, consistent with previous studies (Dubois et al., 2018; Pat, Wang, Anney, et al., 2022; Rasero et al., 2021; Sripada et al., 2020; Tetereva et al., 2022; for review, see Vieira et al., 2022).”

      Reviewer 2 Public Review #8:

      While this paper delivers intriguing and thought-provoking results, it would benefit from recognizing the value that both approaches--brain-age indices and more direct, specific markers like brain-cognition--can contribute to the field.

      Response Thank you so much for recognising the value of our work. As we mentioned above in our response to Reviewer 2 Public Review #4 and #6, we made some suggestions on how to make use of the difference in the ability between generic vs specific biomarkers.

      Reviewer 3 (Public Review):

      Reviewer 3 Public Review Overall:

      The main question of this article is as follows: "To what extent does having information on brain-age improve our ability to capture declines in fluid cognition beyond knowing a person's chronological age?" While this question is worthwhile, considering that there is considerable confusion in the field about the nature of brain-age, the authors are currently missing an opportunity to convey the inevitability of their results, given how brain-age and the brain-age gap are calculated. They also argue that brain-cognition is somehow superior to brain-age, but insufficient evidence is provided in support of this claim.

      Response We addressed the concerns below. The inevitability of our results is not obvious to many researchers who might be interested in Brain Age. We hope our findings might make many issues surrounding Brain Age more obvious, and we now make many suggestions on how to address some of these issues. We no longer argue that Brain Cognition is superior to Brain Age (Reviewer 3 Public Review #4). Rather, we treated the capability of Brain Cognition in capturing fluid cognition as the upper limit of Brain Age’s capability in capturing fluid cognition. We used the unique effects of Brain Cognition that explain fluid cognition beyond Brain Age and chronological age to indicate how much Brain Age misses the variation in the brain MRI that could explain fluid cognition.

      Specific comments follow:

      Reviewer 3 Public Review #1:

      • "There are many adjustments proposed to correct for this estimation bias" (p3). Regression to the mean is not a sign of bias. Any decent loss function will result in over-predicting the age of younger individuals and under-predicting the age of older individuals. This is a direct result of minimizing an error term (e.g., mean squared error). Therefore, it is inappropriate to refer to regression to the mean as a sign of bias. This misconception has led to a great deal of inappropriate analyses, including "correcting" the brain age gap by regressing out age.

      Response: Thank you so much for raising this issue. We used the word ‘bias’ following many articles in the field. For instance,

      de Lange and Cole (2020) wrote: “brain-age estimation also involves a frequently observed bias: brain age is overestimated in younger subjects and underestimated in older subjects, while brain age for participants with an age closer to the mean age (of the training dataset) are predicted more accurately (Cole, Le, Kuplicki, McKinney, Yeh, Thompson, Paulus, Investigators, et al., 2018, Liang, Zhang, Niu, 2019, Niu, Zhang, Kounios, Liang, 2019, Smith, Vidaurre, Alfaro-Almagro, Nichols, Miller, 2019).”

      Cole (2020) wrote: “As recent research has highlighted a proportional bias in brain-age calculation, whereby the difference between chronological age and brain-predicted age is negatively correlated with chronological age (Le et al., 2018, Liang et al., 2019, Smith et al., 2019), an age-bias correction procedure was used. This entailed calculating the regression line between age (predictor) and brain-predicted age (outcome) in the training set, then using the slope (i.e., coefficient) and intercept of that line to adjust brain-predicted age values in the testing set (by subtracting the intercept and then dividing by the slope). After applying the age-bias correction the brain-predicted age difference (brain-PAD) was calculated; chronological age subtracted from brain-predicted age.”

      Beheshiti and colleagues (2019) used bias in their title: “Bias-adjustment in neuroimaging-based brain age frameworks: a robust scheme”

      More recently, Cumplido-Mayoral and colleagues (2023) wrote: “As recent research has shown that brain-age estimation involves a proportional bias (de Lange et al., 2020a; Le et al., 2018; Liang et al., 2019; Smith et al., 2019), we applied a well-established age-bias correction procedure to our data (de Lange et al., 2020a; Le et al., 2018).”

      Still, we agree with Reviewer 3 that using ‘bias’ might lead to misinterpretation. As Butler and colleagues (Butler et al., 2021) pointed out, ”It is important to note that regression toward the mean is not a failure, but a feature, of regression and related methods.“ We rewrote the paragraph and clarified the “regression towards the mean” issue. We no longer used the word “bias” here:

      Introduction

      “Note researchers often subtract chronological age from Brain Age, creating an index known as Brain Age Gap (Franke & Gaser, 2019). A higher value of Brain Age Gap is thought to reflect accelerated/premature aging. Yet, given that Brain Age Gap is calculated based on both Brain Age and chronological age, Brain Age Gap still depends on chronological age (Butler et al., 2021). If, for instance, Brain Age was based on prediction models with poor performance and made a prediction that everyone was 50 years old, individual differences in Brain Age Gap would then depend solely on chronological age (i.e., 50 minus chronological age). Moreover, Brain Age is known to demonstrate the “regression towards the mean” phenomenon (Stigler, 1997). More specifically, because Brain Age is a predicted value of a regression model that predicts chronological age, Brain Age is usually shrunk towards the mean age of samples used for training the model (Butler et al., 2021; de Lange & Cole, 2020; Le et al., 2018). Accordingly, Brain Age predicts chronological age more accurately for individuals who are closer to the mean age while overestimating younger individuals’ chronological age and underestimating older individuals’ chronological age. There are many adjustments proposed to correct for the age dependency, but the outcomes tend to be similar to each other (Beheshti et al., 2019; de Lange & Cole, 2020; Liang et al., 2019; Smith et al., 2019). These adjustments can be applied to Brain Age and Brain Age Gap, creating Corrected Brain Age and Corrected Brain Age Gap, respectively. Corrected Brain Age Gap in particular is viewed as being able to control for age dependency (Butler et al., 2021). Here, we tested the utility of different Brain Age calculations in capturing fluid cognition, over and above chronological age.”

      Reviewer 3 Public Review #2:

      • "Corrected Brain Age Gap in particular is viewed as being able to control for both age dependency and estimation biases (Butler et al., 2021)" (p3). This summary is not accurate as Butler and colleagues did not use the words "corrected" and "biases" in this context. All that authors say in that paper is that regressing out age from the brain age gap - which is referred to as the modified brain age gap (MBAG) - makes it so that the modified brain age gap is not dependent on age, which is true. This metric is meaningless, though, because it is the variance left over after regressing out age from residuals from a model that was predicting age. If it were not for the fact that regression on residuals is not equivalent to multiple regression (and out of sample estimates), MBAG would be a vector of zeros. Upon reading the Methods, I noticed that the authors use a metric from Le et al. (2018) for the "Corrected Brain Age Gap". If they cite the Butler et al. (2021) paper, I highly recommend sticking with the same notation, metrics and terminology throughout. That would greatly help with the interpretability of the present manuscript, and cross-comparisons between the two.

      Response: We thank Reviewer 3 for pointing out the issues surrounding our choices of wording: "corrected" and "biases". We share the same frustration with Reviewer 3 in that different brain-age articles use different terminologies, and we tried to make sure our readers understand our calculations of Brain Age indices in order to compare our results with previous work.

      We commented on the word “bias” in our response to Reviewer 3 Public Review #1 above and refrained from using this word in the revised manuscript. Here we commented on the use of the word “Corrected Brain Age Gap". And by doing so, we clarified how we calculated it.

      Reviewer 3 is right that we cited the work of Butler and colleagues (2021), but wasn’t accurate to say that we used “a metric from Le et al. (2018) for the "Corrected Brain Age Gap". We, instead, used a method described in de Lange and Cole’s (2020) work. We now added equations to explain this method in our Materials and Method section (see below).

      It is important to note that Butler and colleagues (2021) did not come up with any adjustment methods. Instead, Butler and colleagues (2021) discussed three adjustment methods:

      1) A method proposed by Beheshiti and colleagues (2019). Butler and colleagues (2021) called the result of this method, Modified Brain Age Gap (MBAG). Importantly, Butler and colleagues (2021) discouraged the use of this method due to “researchers misinterpreting the reduced variability of the MBAG as an improvement in prediction accuracy.” Accordingly in our article, we performed methods (2) and (3) below.

      2) A method proposed by de Lange and Cole (2020). We used this method in our article (see below for the equations). Briefly, we first fit a regression line predicting the Brain Age from a chronological age in each training set. We then used the slope and intercept of this regression line to adjust Brain Age in the corresponding test set, resulting in an adjusted index of Brain Age. Butler and colleagues (2021) called this index, “Revised Predicted Age.”, while de Lange and Cole’s (2020) originally called this Corrected Brain Age, “Corrected Predicted Age”. Butler and colleagues (2021) then subtracted the chronological age from this index and called it, “Revised Brain Age Gap (RBAG)”. We would like to follow the original terminology, but we do not want to use the word “Predicted Age” since chronological age can be predicted by other variables beyond the brain. We then settled with the word, "Corrected Brain Age" and “Corrected Brain Age Gap". We listed the terminologies used in the past in our article (see below).

      3) A method proposed by Le and colleagues (2018). Here, Butler and colleagues (2021) referred to one of the approaches done by Le and colleagues: “include age as a regressor when doing follow-up analyses.” Essentially this is what we did for the commonality analysis. Le and colleagues (2018)’ approach is the same as examining the unique effects of Brain Age in a multiple regression analysis with Chronological Age and Brain Age as regressors.

      While indexes from de Lange and Cole’s (2020) and Le and colleagues’ (2018) methods show poor performance in capturing fluid cognition in the current work, we need to stress that many research groups do not believe that these methods are meaningless. In fact, de Lange and Cole’s method (2020) is one of the most commonly implemented methods that can be seen elsewhere (e.g., Cole et al., 2020; Cumplido-Mayoral et al., 2023; Denissen et al., 2022). This index just does not seem to work well in the case of fluid cognition.

      Here is how we described how we calculated Brain Age indexes in the revised manuscript:

      Methods

      “ Brain Age calculations: Brain Age, Brain Age Gap, Corrected Brain Age and Corrected Brain Age Gap In addition to Brain Age, which is the predicted value from the models predicting chronological age in the test sets, we calculated three other indices to reflect the estimation of brain aging. First, Brain Age Gap reflects the difference between the age predicted by brain MRI and the actual, chronological age. Here we simply subtracted the chronological age from Brain Age:

      Brain Age Gapi = Brain Agei - chronological agei , (2)

      where i is the individual. Next, to reduce the dependency on chronological age (Butler et al., 2021; de Lange & Cole, 2020; Le et al., 2018), we applied a method described in de Lange and Cole’s (2020), which was implemented elsewhere (Cole et al., 2020; Cumplido-Mayoral et al., 2023; Denissen et al., 2022):

      In each outer-fold training set: Brain Agei = 0 + 1 chronological agei + εi, (3)

      Then in the corresponding outer-fold test set: Corrected Brain Agei = (Brain Agei - 0)/1, (4)

      That is, we first fit a regression line predicting the Brain Age from a chronological age in each outer-fold training set. We then used the slope (1) and intercept (0) of this regression line to adjust Brain Age in the corresponding outer-fold test set, resulting in Corrected Brain Age. Note de Lange and Cole (2020) called this Corrected Brain Age, “Corrected Predicted Age”, while Butler (2021) called it “Revised Predicted Age.”

      Lastly, we computed Corrected Brain Age Gap by subtracting the chronological age from the Corrected Brain Age (Butler et al., 2021; Cole et al., 2020; de Lange & Cole, 2020; Denissen et al., 2022):

      Corrected Brain Age Gap = Corrected Brain Age - chronological age, (5)

      Note Cole and colleagues (2020) called Corrected Brain Age Gap, “brain-predicted age difference (brain-PAD),” while Butler and colleagues (2021) called this index, “Revised Brain Age Gap”.

      Reviewer 3 Public Review #3:

      • "However, the improvement in predicting chronological age may not necessarily make Brain Age to be better at capturing Cognitionfluid. If, for instance, the age-prediction model had the perfect performance, Brian Age Gap would be exactly zero and would have no utility in capturing Cognitionfluid beyond chronological age" (p3). I largely agree with this statement. I would be really careful to distinguish between brain-age and the brain-age gap here, as the former is a predicted value, and the latter is the residual times -1 (i.e., predicted age - age). Therefore, together they explain all of the variance in age. Changing the first sentence to refer to the brain-age gap would be more accurate in this context. The brain-age gap will never be exactly zero, though, even with perfect prediction on the training set, because subjects in the testing set are different from the subjects in the training set.

      Response: Thank you so much for pointing this out. We agree to change “Brain Age” to “Brain Age Gap” in the mentioned sentence.

      Reviewer 3 Public Review #4:

      • "Can we further improve our ability to capture the decline in cognitionfluid by using, not only Brain Age and chronological age, but also another biomarker, Brain Cognition?". This question is fundamentally getting at whether a predicted value of cognition can predict cognition. Assuming the brain parameters can predict cognition decently, and the original cognitive measure that you were predicting is related to your measure of fluid cognition, the answer should be yes. Upon reading the Methods, it became clear that the cognitive variable in the model predicting cognition using brain features (to get predicted cognition, or as the authors refer to it, brain-cognition) is the same as the measure of fluid cognition that you are trying to assess how well brain-cognition can predict. Assuming the brain parameters can predict fluid cognition at all, it is then inevitable that brain-cognition will predict fluid cognition. Therefore, it is inappropriate to use predicted values of a variable to predict the same variable.

      Response: Thank you Reviewer 3 for pointing out this important issue. Reviewer 1 (Recommendations For The Authors #4) and Reviewer 2 (Public Review #4) bought up a similar issue. While Reviewer 3 felt that “it is inappropriate to use predicted values of a variable to predict the same variable,“ Reviewer 2 viewed Brain Cognition as a 'specific/direct' index and Brain Age as a 'generic/indirect' index. And both have merit in their own right.

      Similar to Reviewer 2, we believe that the specific index is as important and has commonly been used elsewhere in the context of biomarkers. For instance, to obtain neuroimaging biomarkers for Alzheimer’s, neuroimaging researchers often build a predictive model to predict Alzheimer's diagnosis (Khojaste-Sarakhsi et al., 2022). In fact, outside of neuroimaging, polygenic risk scores (PRSs) in genomics are often used following “to use predicted values of a variable to predict the same variable” (Choi et al., 2020). For instance, a PRS of ADHD that indicates the genetic liability to develop ADHD is based on genome-wide association studies of ADHD (Demontis et al., 2019).

      Still, we now agreed that it may not be fair to compare the performance of a specific index (Brain Cognition) and a generic index (Brain Age) directly (as pointed out by Reviewer 3 Public Review #6 below). Accordingly, in the revision, as opposed to treating Brain Cognition and Brain Age as separate biomarkers and comparing them, we treated the capability of Brain Cognition in capturing fluid cognition as the upper limit of Brain Age’s capability in capturing fluid cognition. In other words, the strength of an out-of-sample relationship between Brain Cognition and fluid cognition reflects variation in the brain MRI that is related to fluid cognition. And consequently, the unique effects of Brain Cognition that explain fluid cognition beyond Brain Age and chronological age indicate what is missing from Brain Age -- the amount of co-variation between brain MRI and fluid cognition that cannot be captured by Brain Age. According to Reviewer 2, a generic index (Brain Age) “sacrificed some additional explained variance provided” compared to a specific index (Brain Cognition). Here, we used the commonality analyses to quantify how much scarifying was made by Brain Age. See below for the re-conceptualisation of Brain Age vs. Brain Cognition in the revision:

      Abstract

      “Lastly, we tested how much Brain Age missed the variation in the brain MRI that could explain fluid cognition. To capture this variation in the brain MRI that explained fluid cognition, we computed Brain Cognition, or a predicted value based on prediction models built to directly predict fluid cognition (as opposed to chronological age) from brain MRI data. We found that Brain Cognition captured up to an additional 11% of the total variation in fluid cognition that was missing from the model with only Brain Age and chronological age, leading to around a 1/3-time improvement of the total variation explained.”

      Introduction:

      “Third and finally, certain variation in the brain MRI is related to fluid cognition, but to what extent does Brain Age not capture this variation? To estimate the variation in the brain MRI that is related to fluid cognition, we could build prediction models that directly predict fluid cognition (i.e., as opposed to chronological age) from brain MRI data. Previous studies found reasonable predictive performances of these cognition-prediction models, built from certain MRI modalities (Dubois et al., 2018; Pat, Wang, Anney, et al., 2022; Rasero et al., 2021; Sripada et al., 2020; Tetereva et al., 2022; for review, see Vieira et al., 2022). Analogous to Brain Age, we called the predicted values from these cognition-prediction models, Brain Cognition. The strength of an out-of-sample relationship between Brain Cognition and fluid cognition reflects variation in the brain MRI that is related to fluid cognition and, therefore, indicates the upper limit of Brain Age’s capability in capturing fluid cognition. Consequently, the unique effects of Brain Cognition that explain fluid cognition beyond Brain Age and chronological age indicate what is missing from Brain Age -- the amount of co-variation between brain MRI and fluid cognition that cannot be captured by Brain Age.”

      “Finally, we investigated the extent to which Brain Age indices missed the variation in the brain MRI that could explain fluid cognition. Here, we tested Brain Cognition’s unique effects in multiple regression models with a Brain Age index, chronological age and Brain Cognition as regressors to explain fluid cognition.“

      Discussion

      “Third, how much does Brain Age miss the variation in the brain MRI that could explain fluid cognition? Brain Age and chronological age by themselves captured around 32% of the total variation in fluid cognition. But, around an additional 11% of the variation in fluid cognition could have been captured if we used the prediction models that directly predicted fluid cognition from brain MRI.

      “Third, by introducing Brain Cognition, we showed the extent to which Brain Age indices were not able to capture the variation of brain MRI that is related to fluid cognition. Brain Cognition, from certain cognition-prediction models such as the stacked models, has relatively good predictive performance, consistent with previous studies (Dubois et al., 2018; Pat, Wang, Anney, et al., 2022; Rasero et al., 2021; Sripada et al., 2020; Tetereva et al., 2022; for review, see Vieira et al., 2022). We then examined Brain Cognition using commonality analyses (Nimon et al., 2008) in multiple regression models having a Brain Age index, chronological age and Brain Cognition as regressors to explain fluid cognition. Similar to Brain Age indices, Brain Cognition exhibited large common effects with chronological age. But more importantly, unlike Brain Age indices, Brain Cognition showed large unique effects, up to around 11%. The unique effects of Brain Cognition indicated the amount of co-variation between brain MRI and fluid cognition that was missed by a Brain Age index and chronological age. This missing amount was relatively high, considering that Brain Age and chronological age together explained around 32% of the total variation in fluid cognition. Accordingly, if a Brain Age index was used as a biomarker along with chronological age, we would have missed an opportunity to improve the performance of the model by around one-third of the variation explained.”

      Reviewer 3 Public Review #5:

      • "However, Brain Age Gap created from the lower-performing age-prediction models explained a higher amount of variation in Cognitionfluid. For instance, the top performing age-prediction model, "Stacked: All excluding Task Contrast", generated Brain Age and Corrected Brain Age that explained the highest amount of variation in Cognitionfluid, but, at the same time, produced Brian Age Gap that explained the least amount of variation in Cognitionfluid" (p7). This is an inevitable consequence of the following relationship between predicted values and residuals (or residuals times -1): y=(y-y ̂ )+y ̂. Let's say that age explains 60% of the variance in fluid cognition, and predicted age (y ̂) explains 40% of the variance in fluid cognition. Then the brain age gap (-(y-y ̂)) should explain 20% of the variance in fluid cognition. If by "Corrected Brain Age" you mean the modified predicted age from Butler et al (2021), the "Corrected Brain Age" result is inevitable because the modified predicted age is essentially just age with a tiny bit of noise added to it. From Figure 4, though, this does not seem to be the case, because the lower left quadrant in panel (a) should be flat and high (about as high as the predictive value of age for fluid cognition). So it is unclear how "Corrected Brain Age" is calculated. It looks like you might be regressing age out of brain-age, though from your description in the Methods section, it is not totally clear. Again, I highly recommend using the terminology and metrics of Butler et al (2021) throughout to reduce confusion. Please also clarify how you used the slope and intercept. In general, given how brain-age metrics tend to be calculated, the following conclusion is inevitable: "As before, the unique effects of Brain Age indices were all relatively small across the four Brain Age indices and across different prediction models" (p10).

      Response: We agreed that the results are ‘inevitable’ due to the transformations from Brain Age to other Brain Age indices. However, the consequences of these transformations may not be very clear to readers who are not very familiar with Brain Age literature and to the community at large who think about the implications of Brain Age. This is appreciated by Reviewer 1, who mentioned “While the main message will not come as a surprise to anyone with hands-on experience of using brain-age models, I think it is nonetheless an important message to convey to the community.”

      Note we made clarifications on how we calculated each of the Brain Age indices above (see<br /> Reviewer 3 Public Review #2), including how we used the slope and intercept. We chose the terminology closer to the one originally used by de Lange and Cole (2020) and now listed many terminologies others have used to refer to this transformation.

      Reviewer 3 Public Review #6:

      "On the contrary, the unique effects of Brain Cognition appeared much larger" (p10). This is not a fair comparison if you do not look at the unique effects above and beyond the cognitive variable you predicted in your brain-cognition model. If your outcome measure had been another metric of cognition other than fluid cognition, you would see that brain-cognition does not explain any additional variance in this outcome when you include fluid cognition in the model, just as brain-age would not when including age in the model (minus small amounts due to penalization and out-of-sample estimates). This highlights the fact that using a predicted value to predict anything is worse than using the value itself.

      Response Please see our response to Reviewer 3 Public Review #4 above. Briefly, we no long made this comparison. Instead, we now viewed the unique effects of Brain Cognition as a way to test how much Brain Age missed the variation in the brain MRI that could explain fluid cognition.

      Reviewer 3 Public Review #7:

      "First, how much does Brain Age add to what is already captured by chronological age? The short answer is very little" (p12). This is a really important point, but the paper requires an in-depth discussion of the inevitability of this result, as discussed above.

      Response We agree that the tight relationship between Brain Age and chronological age is inevitable. We mentioned this from the get-go in the introduction:

      Introduction “Accordingly, by design, Brain Age is tightly close to chronological age. Because chronological age usually has a strong relationship with fluid cognition, to begin with, it is unclear how much Brain Age adds to what is already captured by chronological age.”

      To make this point obvious, we quantified the overlap between Brain Age and chronological age using the commonality analysis. We hope that our effort to show the inevitability of this overlap can make people more careful when designing studies involving Brain Age.

      Reviewer 3 Public Review #8:

      "Third, do we have a solution that can improve our ability to capture Cognitionfluid from brain MRI? The answer is, fortunately, yes. Using Brain Cognition as a biomarker, along with chronological age, seemed to capture a higher amount of variation in Cognitionfluid than only using Brain Age" (p12). I suggest controlling for the cognitive measure you predicted in your brain-cognition model. This will show that brain-cognition is not useful above and beyond cognition, highlighting the fact that it is not a useful endeavor to be using predicted values.

      Response This point is similar to Reviewer 3 Public Review #6. Again please see our response to Reviewer 3 Public Review #4 above. Briefly, we no long made this comparison and said whether Brain Cognition is ‘better’ than Brain Age. Instead, we now viewed the unique effects of Brain Cognition as a way to test how much Brain Age missed the variation in the brain MRI that could explain fluid cognition.

      Reviewer 3 Public Review #9:

      "Accordingly, a race to improve the performance of age-prediction models (Baecker et al., 2021) does not necessarily enhance the utility of Brain Age indices as a biomarker for Cognitionfluid. This calls for a new paradigm. Future research should aim to build prediction models for Brian Age indices that are not necessarily good at predicting age, but at capturing phenotypes of interest, such as Cognitionfluid and beyond" (p13). I whole-heartedly agree with the first two sentences, but strongly disagree with the last. Certainly your results, and the underlying reason as to why you found these results, calls for a new paradigm (or, one might argue, a pre-brain-age paradigm). As of now, your results do not suggest that researchers should keep going down the brain-age path. While it is difficult to prove that there is no transformation of brain-age or the brain-age gap that will be useful, I am nearly sure this is true from the research I have done. If you would like to suggest that the field should continue down this path, I suggest presenting a very good case to support this view.

      Response Thank you for your comments on this issue.

      Since the submission of our manuscript, other researchers also made a similar observation regarding the disagreement between the predictive performance of age-prediction models and the utility of Brain Age. For instance, in their systematic review, Jirasarie and colleagues (2023, p7) wrote this statement, “Despite mounting evidence, there is a persisting assumption across several studies that the most accurate brain age models will have the most potential for detecting differences in a given phenotype of interest. As a point of illustration, seven of the twenty studies in this review only evaluated the utility of their most accurate model, which in all cases was trained using multimodal features. This approach has also led to researchers to exclusively use T1-weighted and diffusion-weighted MRI scans when developing brain age models36 since such modalities have been shown to have the largest contribution to a model’s predictive power.2,67 However, our review suggests that model accuracy does not necessarily provide meaningful insight about clinical utility (e.g., detection of age-related pathology). Taken with prior studies,16,17 it appears that the most accurate models tend to not be the most useful.”

      We now discussed the disagreement between the predictive performance of age-prediction models and the utility of Brain Age, not only in the context of cognitive functioning (Jirsaraie, Kaufmann, et al., 2023) but also in the context of neurological/psychological disorders (Bashyam et al., 2020; Rokicki et al., 2021). Following Reviewer 3’s suggestion, we also added several possible strategies to mitigate this problem of Brain Age, used by us and other groups. Please see below.

      Discussion:

      “This discrepancy between the predictive performance of age-prediction models and the utility of Brain Age indices as a biomarker is consistent with recent findings (for review, see Jirsaraie, Gorelik, et al., 2023), both in the context of cognitive functioning (Jirsaraie, Kaufmann, et al., 2023) and neurological/psychological disorders (Bashyam et al., 2020; Rokicki et al., 2021). For instance, combining different MRI modalities into the prediction models, similar to our stacked models, often lead to the highest performance of age-prediction models, but does not likely explain the highest variance across different phenotypes, including cognitive functioning and beyond (Jirsaraie, Gorelik, et al., 2023).”

      “Next, researchers should not select age-prediction models based solely on age-prediction performance. Instead, researchers could select age-prediction models that explained phenotypes of interest the best. Here we selected age-prediction models based on a set of features (i.e., modalities) of brain MRI. This strategy was found effective not only for fluid cognition as we demonstrated here, but also for neurological and psychological disorders as shown elsewhere (Jirsaraie, Gorelik, et al., 2023; Rokicki et al., 2021). Rokicki and colleagues (2021), for instance, found that, while integrating across MRI modalities led to age-prediction models with the highest age-prediction performance, using only T1 structural MRI gave age-prediction models that were better at classifying Alzheimer’s disease. Similarly, using only cerebral blood flow gave age-prediction models that were better at classifying mild/subjective cognitive impairment, schizophrenia and bipolar disorder.

      As opposed to selecting age-prediction models based on a set of features, researchers could also select age-prediction models based on modelling methods. For instance, Jirsaraie and colleagues (2023) compared gradient tree boosting (GTB) and deep-learning brain network (DBN) algorithms in building age-prediction models. They found GTB to have higher age-prediction performance but DBN to have better utility in explaining cognitive functioning. In this case, an algorithm with better utility (e.g., DBN) should be used for explaining a phenotype of interest. Similarly, Bashyam and colleagues (2020) built different DBN-based age-prediction models, varying in age-prediction performance. The DBN models with a higher number of epochs corresponded to higher age-prediction performance. However, DBN-based age-prediction models with a moderate (as opposed to higher or lower) number of epochs were better at classifying Alzheimer’s disease, mild cognitive impairment and schizophrenia. In this case, a model from the same algorithm with better utility (e.g., those DBN with a moderate epoch number) should be used for explaining a phenotype of interest. Accordingly, this calls for a change in research practice, as recently pointed out by Jirasarie and colleagues (2023, p7), “Despite mounting evidence, there is a persisting assumption across several studies that the most accurate brain age models will have the most potential for detecting differences in a given phenotype of interest”. Future neuroimaging research should aim to build age-prediction models that are not necessarily good at predicting age, but at capturing phenotypes of interest.”

      Reviewer #1 (Recommendations For The Authors):

      In this paper, the authors evaluate the utility of brain age derived metrics for predicting cognitive decline using the HCP aging dataset by performing a commonality analysis in a downstream regression. The main conclusion is that brain age derived metrics do not explain much additional variation in cognition over and above what is already explained by age. The authors propose to use a regression model trained to predict cognition ('brain-cognition') as an alternative that explains more unique variance in the downstream regression.

      This is a reasonably good paper and the use of a commonality analysis is a nice contribution to understanding variance partitioning across different covariates. While the main message will not come as a surprise to anyone with hands-on experience of using brain-age models, I think it is nonetheless an important message to convey to the community. With that said, I have some comments that I believe the authors ought to address before publication.

      Reviewer 1 Recommendations For The Authors #1:

      First, from a conceptual point of view, the authors focus exclusively on cognition as a downstream outcome. This is undeniably important, but is only one application area for brain age models. They are also used for example to provide biomarkers for many brain disorders. What would the results presented here have to say about these application areas? Further, I think that since brain-age models by construction confound relevant biological variation with the accuracy of the regression models used to estimate them, my own opinion about the limits of interpretation of (e.g.) the brain-age gap is as a dimensionless biomarker. This has also been discussed elsewhere (see e.g. https://academic.oup.com/brain/article/143/7/2312/5863667). I would suggest the authors nuance their discussion to provide considerations on these issues.

      Response Thank you Reviewer 1 for pointing out two important issues.

      The first issue was about applications for brain disorders. We now made a detailed discussion about this, which also addressed Reviewer 3 Public Review #9. Briefly, we now bought up

      1) the consistency between our findings on fluid cognition and other recent works on brain disorders,

      2) under-fitted age-prediction models from Brain Age studies focusing on neurological/psychological disorders when applied to participants with neurological/psychological disorders because the age-prediction models were built from largely healthy participants,

      and 3) suggested solutions we and others made to optimise the utility of Brain Age for both cognitive functioning and brain disorders.

      Discussion:

      “This discrepancy between the predictive performance of age-prediction models and the utility of Brain Age indices as a biomarker is consistent with recent findings (for review, see Jirsaraie, Gorelik, et al., 2023), both in the context of cognitive functioning (Jirsaraie, Kaufmann, et al., 2023) and neurological/psychological disorders (Bashyam et al., 2020; Rokicki et al., 2021). For instance, combining different MRI modalities into the prediction models, similar to our stacked models, often lead to the highest performance of age-prediction models, but does not likely explain the highest variance across different phenotypes, including cognitive functioning and beyond (Jirsaraie, Gorelik, et al., 2023).”

      “There is a notable difference between studies investigating the utility of Brain Age in explaining cognitive functioning, including ours and others (e.g., Butler et al., 2021; Cole, 2020, 2020; Jirsaraie, Kaufmann, et al., 2023) and those explaining neurological/psychological disorders (e.g., Bashyam et al., 2020; Rokicki et al., 2021). That is, those Brain Age studies focusing on neurological/psychological disorders often build age-prediction models from MRI data of largely healthy participants (e.g., controls in a case-control design or large samples in a population-based design), apply the built age-prediction models to participants without vs. with neurological/psychological disorders and compare Brain Age indices between the two groups. This means that age-prediction models from Brain Age studies focusing on neurological/psychological disorders might be under-fitted when applied to participants with neurological/psychological disorders because they were built from largely healthy participants. And thus, the difference in Brain Age indices between participants without vs. with neurological/psychological disorders might be confounded by the under-fitted age-prediction models (i.e., Brain Age may predict chronological age well for the controls, but not for those with a disorder). On the contrary, our study and other Brain Age studies focusing on cognitive functioning often build age-prediction models from MRI data of largely healthy participants and apply the built age-prediction models to participants who are also largely healthy. Accordingly, the age-prediction models for explaining cognitive functioning do not suffer from being under-fitted. We consider this as a strength, not a weakness of our study.”

      “Next, researchers should not select age-prediction models based solely on age-prediction performance. Instead, researchers could select age-prediction models that explained phenotypes of interest the best. Here we selected age-prediction models based on a set of features (i.e., modalities) of brain MRI. This strategy was found effective not only for fluid cognition as we demonstrated here, but also for neurological and psychological disorders as shown elsewhere (Jirsaraie, Gorelik, et al., 2023; Rokicki et al., 2021). Rokicki and colleagues (2021), for instance, found that, while integrating across MRI modalities led to age-prediction models with the highest age-prediction performance, using only T1 structural MRI gave age-prediction models that were better at classifying Alzheimer’s disease. Similarly, using only cerebral blood flow gave age-prediction models that were better at classifying mild/subjective cognitive impairment, schizophrenia and bipolar disorder. As opposed to selecting age-prediction models based on a set of features, researchers could also select age-prediction models based on modelling methods. For instance, Jirsaraie and colleagues (2023) compared gradient tree boosting (GTB) and deep-learning brain network (DBN) algorithms in building age-prediction models. They found GTB to have higher age-prediction performance but DBN to have better utility in explaining cognitive functioning. In this case, an algorithm with better utility (e.g., DBN) should be used for explaining a phenotype of interest. Similarly, Bashyam and colleagues (2020) built different DBN-based age-prediction models, varying in age-prediction performance. The DBN models with a higher number of epochs corresponded to higher age-prediction performance. However, DBN-based age-prediction models with a moderate (as opposed to higher or lower) number of epochs were better at classifying Alzheimer’s disease, mild cognitive impairment and schizophrenia. In this case, a model from the same algorithm with better utility (e.g., those DBN with a moderate epoch number) should be used for explaining a phenotype of interest. Accordingly, this calls for a change in research practice, as recently pointed out by Jirasarie and colleagues (2023, p7), “Despite mounting evidence, there is a persisting assumption across several studies that the most accurate brain age models will have the most potential for detecting differences in a given phenotype of interest”. Future neuroimaging research should aim to build age-prediction models that are not necessarily good at predicting age, but at capturing phenotypes of interest.”

      The second issue was about “the brain-age gap as a dimensionless biomarker.” We are not so clear on what the reviewer meant by “the dimensionless biomarker.” One possible meaning of the “dimensionless biomarker” is the fact that Brain Age from the same algorithm and same modality can be computed, such that Brain Age can be tightly fit or loosely fit with chronological age. This is what Bashyam and colleagues (2020) did in the article Reviewer 1 referred to. We now wrote about this strategy in the above paragraph in the Discussion.

      Alternatively, “the dimensionless biomarker” might be something closer to what Reviewer 2 viewed Brain Age as a “generic/indirect” index (as opposed to a 'specific/direct' index in the case of Brain Cognition) (see Reviewer 2 Public Review #4). We discussed this in our response to Reviewer 3 Public Review #4.

      Reviewer 1 Recommendations For The Authors #2:

      Second, from a methods perspective, I am quite suspicious of the stacked regression models the authors are using to combine regression models and I suspect they may be overfit. In my experience, stacked models are very prone to overfitting when combined with cross-validation. This is because the predictions from the first level models (i,e. the features that are provided to the second-level 'stacked' models) contain information about the training set and the test set. If cross-validation is not done very carefully (e.g. using multiple hold-out sets), information leakage can easily occur at the second level. Unfortunately, there is not sufficient explanation of the methodological procedures in the current manuscript to fully understand what was done. First, please provide more information to enable the reader to better understand the stacked regression models and if the authors are not using an approach that fully preserves training and test separability, please do so.

      Response: We would like to thank Reviewer 1 for the suggestion. We now made it clearer in texts and new figure (see below) that we used nested cross-validation to ensure no information leakage between training and test sets. Regarding the stacked models more specifically, the hyperparameters of the stacked models were tuned in the same inner-fold CV as the non-stacked model (see Figure 7 below). That is, training models for both non-stacked and stacked models did not involve the test set, ensuring that there was no data leakage between training and test sets.

      Methods:

      “To compute Brain Age and Brain Cognition, we ran two separate prediction models. These prediction models either had chronological age or fluid cognition as the target and standardised brain MRI as the features (Denissen et al., 2022). We used nested cross-validation (CV) to build these models (see Figure 7). We first split the data into five outer folds. We used five outer folds so that each outer fold had around 100 participants. This is to ensure the stability of the test performance across folds. In each outer-fold CV, one of the outer folds was treated as a test set, and the rest was treated as a training set, which was further divided into five inner folds. In each inner-fold CV, one of the inner folds was treated as a validation set and the rest was treated as a training set. We used the inner-fold CV to tune for hyperparameters of the models and the outer-fold CV to evaluate the predictive performance of the models.

      In addition to using each of the 18 sets of features in separate prediction models, we drew information across these sets via stacking. Specifically, we computed predicted values from each of the 18 sets of features in the training sets. We then treated different combinations of these predicted values as features to predict the targets in separate “stacked” models. The hyperparameters of the stacked models were tuned in the same inner-fold CV as the non-stacked model (see Figure 7). That is, training models for both non-stacked and stacked models did not involve the test set, ensuring that there was no data leakage between training and test sets. We specified eight stacked models: “All” (i.e., including all 18 sets of features), “All excluding Task FC”, “All excluding Task Contrast”, “Non-Task” (i.e., including only Rest FC and sMRI), “Resting and Task FC”, “Task Contrast and FC”, “Task Contrast” and “Task FC”. Accordingly, in total, there were 26 prediction models for Brain Age and Brain Cognition.

      Reviewer 1 Recommendations For The Authors #3:

      Third, the authors standardize the elastic net regression coefficients post-hoc. Why did the authors not perform the more standard approach of standardizing the covariates and responses, prior to model estimation, which would yield standardized regression coefficients (in the classical sense) by construction? Please also provide an indication of the different regression strengths that were estimated across the different models and cross-validation splits. Also, how stable were the weights across splits?

      Response For model fitting, we did not “standardize the elastic net regression coefficients post-hoc.” Instead, we did all of the standardisation steps prior to model fitting (see Methods below). For regression strengths across different models and cross-validation splits, we now provided predictive performance at each of the five outer-fold test sets in Figure 1 (below). As you may have seen, the predictive performance was quite stable across the cross-validation splits.

      For visualising feature importance, We originally only standardised the elastic net regression coefficients post-hoc, so that feature importance plots were in the same scale across folds. However, as mentioned by Reviewer 3 (Recommendations for the Authors #7, below), this might make it difficult to interpret the directionality of the coefficients. In the revised manuscript, we refitted the Elastic Net model to the full dataset without splitting them into five folds and visualised the coefficients on brain images (see below).

      Methods

      “We controlled for the potential influences of biological sex on the brain features by first residualising biological sex from brain features in each outer-fold training set. We then applied the regression of this residualisation to the corresponding test set. We also standardised the brain features in each outer-fold training set and then used the mean and standard deviation of this outer-fold training set to standardise the test set. All of the standardisation was done prior to fitting the prediction models.”

      “To understand how Elastic Net made a prediction based on different brain features, we examined the coefficients of the tuned model. Elastic Net coefficients can be considered as feature importance, such that more positive Elastic Net coefficients lead to more positive predicted values and, similarly, more negative Elastic Net coefficients lead to more negative predicted values (Molnar, 2019; Pat, Wang, Bartonicek, et al., 2022). While the magnitude of Elastic Net coefficients is regularised (thus making it difficult for us to interpret the magnitude itself directly), we could still indicate that a brain feature with a higher magnitude weights relatively stronger in making a prediction. Another benefit of Elastic Net as a penalised regression is that the coefficients are less susceptible to collinearity among features as they have already been regularised (Dormann et al., 2013; Pat, Wang, Bartonicek, et al., 2022).

      Given that we used five-fold nested cross validation, different outer folds may have different degrees of ‘’ and ‘l_1 ratio’, making the final coefficients from different folds to be different. For instance, for certain sets of features, penalisation may not play a big part (i.e., higher or lower ‘’ leads to similar predictive performance), resulting in different ‘’ for different folds. To remedy this in the visualisation of Elastic Net feature importance, we refitted the Elastic Net model to the full dataset without splitting them into five folds and visualised the coefficients on brain images using Brainspace (Vos De Wael et al., 2020) and Nilern (Abraham et al., 2014) packages. Note, unlike other sets of features, Task FC and Rest FC were modelled after data reduction via PCA. Thus, for Task FC and Rest FC, we, first, multiplied the absolute PCA scores (extracted from the ‘components_’ attribute of ‘sklearn.decomposition.PCA’) with Elastic Net coefficients and, then, summed the multiplied values across the 75 components, leaving 71,631 ROI-pair indices.”

      Reviewer 1 Recommendations For The Authors #4:

      I do not really find it surprising that the level of unique explained variance provided by a brain-cognition model is higher than a brain-age model, given that the latter is considerably more accurate (also, in view of the comment above). As such I would recommend to tone down the claims about the utility of this method, also because it is only really applicable to one application area for brain age.

      Response Thank you for bringing this issue to our attention. We have now toned down the claims about the utility of Brain Cognition and importantly treated the capability of Brain Cognition in capturing fluid cognition as the upper limit of Brain Age’s capability in capturing fluid cognition. Please see Reviewer 3 Public Review #4 above for a detailed discussion about this issue.

      Reviewer 1 Recommendations For The Authors #5:

      Please provide more details about the task designs and MRI processing procedures that were employed on this sample so that the reader is not forced to dig through the publications from the consortia contributing the data samples used. For example, comments such as "Here we focused on the pre-processed task fMRI files with a suffix "_PA_Atlas_MSMAll_hp0_clean.dtseries.nii." are not particularly helpful to readers not already familiar with this dataset.

      Response Thank you so much for pointing out this important point on the clarity of the description of our MRI methodology. We now added additional details about the data processing done by the HCP-A and by us. We, for instance, explained the meaning of the HCP-A suffix “"_PA_Atlas_MSMAll_hp0_clean.dtseries.nii”. Please see below.

      Methods

      “HCP-A provides details of parameters for brain MRI elsewhere (Bookheimer et al., 2019; Harms et al., 2018). Here we used MRI data that were pre-processed by the HCP-A with recommended methods, including the MSMALL alignment (Glasser et al., 2016; Robinson et al., 2018) and ICA-FIX (Glasser et al., 2016) for functional MRI. We used multiple brain MRI modalities, covering task functional MRI (task fMRI), resting-state functional MRI (rsfMRI) and structural MRI (sMRI), and organised them into 19 sets of features.

      Sets of Features 1-10: Task fMRI contrast (Task Contrast)

      Task contrasts reflect fMRI activation relevant to events in each task. Bookheimer and colleagues (2019) provided detailed information about the fMRI in HCP-A. Here we focused on the pre-processed task fMRI Connectivity Informatics Technology Initiative (CIFTI) files with a suffix, “_PA_Atlas_MSMAll_hp0_clean.dtseries.nii.” These CIFTI files encompassed both the cortical mesh surface and subcortical volume (Glasser et al., 2013). Collected using the posterior-to-anterior (PA) phase, these files were aligned using MSMALL (Glasser et al., 2016; Robinson et al., 2018), linear detrended (see https://groups.google.com/a/humanconnectome.org/g/hcp-users/c/ZLJc092h980/m/GiihzQAUAwAJ) and cleaned from potential artifacts using ICA-FIX (Glasser et al., 2016).

      To extract Task Contrasts, we regressed the fMRI time series on the convolved task events using a double-gamma canonical hemodynamic response function via FMRIB Software Library (FSL)’s FMRI Expert Analysis Tool (FEAT) (Woolrich et al., 2001). We kept FSL’s default high pass cutoff at 200s (i.e., .005 Hz). We then parcellated the contrast ‘cope’ files, using the Glasser atlas (Gordon et al., 2016) for cortical surface regions and the Freesurfer’s automatic segmentation (aseg) (Fischl et al., 2002) for subcortical regions. This resulted in 379 regions, whose number was, in turn, the number of features for each Task Contrast set of features.

      HCP-A collected fMRI data from three tasks: Face Name (Sperling et al., 2001), Conditioned Approach Response Inhibition Task (CARIT) (Somerville et al., 2018) and VISual MOTOR (VISMOTOR) (Ances et al., 2009). First, the Face Name task (Sperling et al., 2001) taps into episodic memory. The task had three blocks. In the encoding block [Encoding], participants were asked to memorise the names of faces shown. These faces were then shown again in the recall block [Recall] when the participants were asked if they could remember the names of the previously shown faces. There was also the distractor block [Distractor] occurring between the encoding and recall blocks. Here participants were distracted by a Go/NoGo task. We computed six contrasts for this Face Name task: [Encode], [Recall], [Distractor], [Encode vs. Distractor], [Recall vs. Distractor] and [Encode vs. Recall].

      Second, the CARIT task (Somerville et al., 2018) was adapted from the classic Go/NoGo task and taps into inhibitory control. Participants were asked to press a button to all [Go] but not to two [NoGo] shapes. We computed three contrasts for the CARIT task: [NoGo], [Go] and [NoGo vs. Go].

      Third, the VISMOTOR task (Ances et al., 2009) was designed to test simple activation of the motor and visual cortices. Participants saw a checkerboard with a red square either on the left or right. They needed to press a corresponding key to indicate the location of the red square. We computed just one contrast for the VISMOTOR task: [Vismotor], which indicates the presence of the checkerboard vs. baseline.

      Sets of Features 11-13: Task fMRI functional connectivity (Task FC)

      Task FC reflects functional connectivity (FC ) among the brain regions during each task, which is considered an important source of individual differences (Elliott et al., 2019; Fair et al., 2007; Gratton et al., 2018). We used the same CIFTI file “_PA_Atlas_MSMAll_hp0_clean.dtseries.nii.” as the task contrasts. Unlike Task Contrasts, here we treated the double-gamma, convolved task events as regressors of no interest and focused on the residuals of the regression from each task (Fair et al., 2007). We computed these regressors on FSL, and regressed them in nilearn (Abraham et al., 2014). Following previous work on task FC (Elliott et al., 2019), we applied a highpass at .008 Hz. For parcellation, we used the same atlases as Task Contrast (Fischl et al., 2002; Glasser et al., 2016). We computed Pearson’s correlations of each pair of 379 regions, resulting in a table of 71,631 non-overlapping FC indices for each task. We then applied r-to-z transformation and principal component analysis (PCA) of 75 components (Rasero et al., 2021; Sripada et al., 2019, 2020). Note to avoid data leakage, we conducted the PCA on each training set and applied its definition to the corresponding test set. Accordingly, there were three sets of 75 features for Task FC, one for each task. “

      Reviewer 1 Recommendations For The Authors #6:

      Similarly, please be more specific about the regression methods used. There are several different parameterisations of the elastic net, please provide equations to describe the method used here so that readers can easily determine how the regularisation parameters should be interpreted. The same goes for the methods used for correcting bias, e.g. what is "de Lange and Cole's (2020) 5th equation"?

      Response Thank you. We now made a detailed description of Elastic Net including its equation (see below). We also added more specific details about the methods used for correcting bias in Brain Age indices (see our response to Reviewer 3 Public Review #2 above).

      Methods:

      “For the machine learning algorithm, we used Elastic Net (Zou & Hastie, 2005). Elastic Net is a general form of penalised regressions (including Lasso and Ridge regression), allowing us to simultaneously draw information across different brain indices to predict one target variable. Penalised regressions are commonly used for building age-prediction models (Jirsaraie, Gorelik, et al., 2023). Previously we showed that the performance of Elastic Net in predicting cognitive abilities is on par, if not better than, many non-linear and more-complicated algorithms (Pat, Wang, Bartonicek, et al., 2022; Tetereva et al., 2022). Moreover, Elastic Net coefficients are readily explainable, allowing us the ability to explain how our age-prediction and cognition-prediction models made the prediction from each brain feature (Molnar, 2019; Pat, Wang, Bartonicek, et al., 2022) (see below).

      Elastic Net simultaneously minimises the weighted sum of the features’ coefficients. The degree of penalty to the sum of the feature’s coefficients is determined by a shrinkage hyperparameter ‘’: the greater the , the more the coefficients shrink, and the more regularised the model becomes. Elastic Net also includes another hyperparameter, ‘l_1 ratio’, which determines the degree to which the sum of either the squared (known as ‘Ridge’; l_1 ratio=0) or absolute (known as ‘Lasso’; l_1 ratio=1) coefficients is penalised (Zou & Hastie, 2005). The objective function of Elastic Net as implemented by sklearn (Pedregosa et al., 2011) is defined as: argmin_ ((|(|y-X|)|_2^2)/(2×n_samples )+α×l_1 _ratio×|(||)|_1+0.5×α×(1-l_1 _ratio)×|(|w|)|_2^2 ), (1) where X is the features, y is the target, and  is the coefficient. In our grid search, we tuned two Elastic Net hyperparameters:  using 70 numbers in log space, ranging from .1 and 100, and l_1-ratio using 25 numbers in linear space, ranging from 0 and 1.”

      Additional minor points:

      Reviewer 1 Recommendations For The Authors #7:

      • Please provide more descriptive figure legends, especially for Figs 5 and 6. For example, what do the boldface numbers reflect? What do the asterisks reflect?

      Response Thank you for the suggestion. We made changes to the figure legends to make it clearer what the numbers and asterisks reflect.

      Reviewer 1 Recommendations For The Authors #8:

      • Perhaps this is personal thing, but I find the nomenclature cognition_{fluid} to be quite awkward. Why not just define FC as an acronym?

      Response Thank you for the suggestion. We now used the word ‘fluid cognition’ throughout the manuscript.

      Reviewer #2 (Recommendations For The Authors):

      Suggestions for improved or additional experiments, data or analyses.

      Reviewer 2 Recommendations For The Authors #1:

      • Since the study did not provide external validation for the indices, it is unclear how well the models would perform and generalize to other samples. Therefore, it is recommended to conduct out-of-sample testing of the models.

      Response Thank you for the suggestion. We now added discussions about how consistency between our results and several recent studies that investigated similar issues with Brain Age in different populations, e.g., large samples of older adults in Uk Biobank (Cole, 2020) and younger populations (Butler et al., 2021; Jirsaraie, Kaufmann, et al., 2023), and in a broader context, extending to neurological and psychological disorders (for review, see Jirsaraie, Gorelik, et al., 2023). Please see below.

      Please also noted that all of the analyses done were out-of-sample. We used nested cross-validation to evaluate the predictive performance of age- and cognition-prediction models on the outer-fold test sets, which are out-of-sample from the training sets (please see Reviewer 1 Recommendations For The Authors #2). Similarly, we also conducted all of the commonality analyses on the outer-fold test sets.

      Discussion

      “The small effects of the Corrected Brain Age Gap in explaining fluid cognition of aging individuals found here are consistent with studies in older adults (Cole, 2020) and younger populations (Butler et al., 2021; Jirsaraie, Kaufmann, et al., 2023). Cole (2020) studied the utility of Brain Age on cognitive functioning of large samples (n>17,000) of older adults, aged 45-80 years, from the UK Biobank (Sudlow et al., 2015). He constructed age-prediction models using LASSO, a similar penalised regression to ours and applied the same age-dependency adjustment to ours. Cole (2020) then conducted a multiple regression explaining cognitive functioning from Corrected Brain Age Gap while controlling for chronological age and other potential confounds. He found Corrected Brain Age Gap to be significantly related to performance in four out of six cognitive measures, and among those significant relationships, the effect sizes were small with a maximum of partial eta-squared at .0059. Similarly, Jirsaraie and colleagues (2023) studied the utility of Brain Age on cognitive functioning of youths aged 8-22 years old from the Human Connectome Project in Development (Somerville et al., 2018) and Preschool Depression Study (Luby, 2010). They built age-prediction models using gradient tree boosting (GTB) and deep-learning brain network (DBN) and adjusted the age dependency of Brain Age Gap using Smith and colleagues’ (2019) method. Using multiple regressions, Jirsaraie and colleagues (2023) found weak effects of the adjusted Brain Age Gap on cognitive functioning across five cognitive tasks, five age-prediction models and the two datasets (mean of standardised regression coefficient = -0.09, see their Table S7). Next, Butler and colleagues (2021) studied the utility of Brain Age on cognitive functioning of another group of youths aged 8-22 years old from the Philadelphia Neurodevelopmental Cohort (PNC) (Satterthwaite et al., 2016). Here they used Elastic Net to build age-prediction models and applied another age-dependency adjustment method, proposed by Beheshti and colleagues (2019). Similar to the aforementioned results, Butler and colleagues (2021) found a weak, statistically non-significant correlation between the adjusted Brain Age Gap and cognitive functioning at r=-.01, p=.71. Accordingly, the utility of Brain Age in explaining cognitive functioning beyond chronological age appears to be weak across age groups, different predictive modelling algorithms and age-dependency adjustments.“

      “This discrepancy between the predictive performance of age-prediction models and the utility of Brain Age indices as a biomarker is consistent with recent findings (for review, see Jirsaraie, Gorelik, et al., 2023), both in the context of cognitive functioning (Jirsaraie, Kaufmann, et al., 2023) and neurological/psychological disorders (Bashyam et al., 2020; Rokicki et al., 2021). For instance, combining different MRI modalities into the prediction models, similar to our stacked models, often lead to the highest performance of age-prediction models, but does not likely explain the highest variance across different phenotypes, including cognitive functioning and beyond (Jirsaraie, Gorelik, et al., 2023). “

      “Third, by introducing Brain Cognition, we showed the extent to which Brain Age indices were not able to capture the variation of brain MRI that is related to fluid cognition. Brain Cognition, from certain cognition-prediction models such as the stacked models, has relatively good predictive performance, consistent with previous studies (Dubois et al., 2018; Pat, Wang, Anney, et al., 2022; Rasero et al., 2021; Sripada et al., 2020; Tetereva et al., 2022; for review, see Vieira et al., 2022). We then examined Brain Cognition using commonality analyses (Nimon et al., 2008) in multiple regression models having a Brain Age index, chronological age and Brain Cognition as regressors to explain fluid cognition. Similar to Brain Age indices, Brain Cognition exhibited large common effects with chronological age. But more importantly, unlike Brain Age indices, Brain Cognition showed large unique effects, up to around 11%. The unique effects of Brain Cognition indicated the amount of co-variation between brain MRI and fluid cognition that was missed by a Brain Age index and chronological age. This missing amount was relatively high, considering that Brain Age and chronological age together explained around 32% of the total variation in fluid cognition. Accordingly, if a Brain Age index was used as a biomarker along with chronological age, we would have missed an opportunity to improve the performance of the model by around one-third of the variation explained. “

      “There is a notable difference between studies investigating the utility of Brain Age in explaining cognitive functioning, including ours and others (e.g., Butler et al., 2021; Cole, 2020, 2020; Jirsaraie, Kaufmann, et al., 2023) and those explaining neurological/psychological disorders (e.g., Bashyam et al., 2020; Rokicki et al., 2021). That is, those Brain Age studies focusing on neurological/psychological disorders often build age-prediction models from MRI data of largely healthy participants (e.g., controls in a case-control design or large samples in a population-based design), apply the built age-prediction models to participants without vs. with neurological/psychological disorders and compare Brain Age indices between the two groups. This means that age-prediction models from Brain Age studies focusing on neurological/psychological disorders might be under-fitted when applied to participants with neurological/psychological disorders because they were built from largely healthy participants. And thus, the difference in Brain Age indices between participants without vs. with neurological/psychological disorders might be confounded by the under-fitted age-prediction models (i.e., Brain Age may predict chronological age well for the controls, but not for those with a disorder). On the contrary, our study and other Brain Age studies focusing on cognitive functioning often build age-prediction models from MRI data of largely healthy participants and apply the built age-prediction models to participants who are also largely healthy. Accordingly, the age-prediction models for explaining cognitive functioning do not suffer from being under-fitted. We consider this as a strength, not a weakness of our study.”

      Reviewer 2 Recommendations For The Authors #2:

      • Employ Variance Inflation Factor (VIF) to empirically test for multicollinearity.

      Response Given high common effects between many of the regressors in the models (e.g., between Brain Age and chronological age), VIF will be high, but this is not a concern for the commonality analysis. We showed now that applying the commonality analysis to multiple regressions allowed us to have robust results against multicollinearity, as demonstrated elsewhere (Ray-Mukherjee et al., 2014, Using commonality analysis in multiple regressions: A tool to decompose regression effects in the face of multicollinearity). Specifically, using the multiple regressions by themselves without the commonality analysis, researchers have to rely on beta estimates, which are strongly affected by multicollinearity (e.g., a phenomenon known as the Suppression Effect). However, by applying the commonality analysis on top of multiple regressions, researchers can then rely on R2 estimates, which are less affected by multicollinearity. This can be seen in our case (Figure 5 and 6) where Brain Age indices had the same unique effects regardless of the level of common effects they had with chronological age (e.g., Brain Age vs. Corrected Brain Age Gap from stacked models).

      To directly demonstrate the robustness of the current commonality analysis regarding multicollinearity, we applied the commonality analysis to Ridge regressions (see Supplementary Figures 3 and 5 below). Ridge regression is a method designed to deal with multicollinearity (Dormann et al., 2013). As seen below, the results from commonality analyses applied to Ridge regressions are closely matched with our original results.

      Methods

      “Note to ensure that the commonality analysis results were robust against multicollinearity (Ray-Mukherjee et al., 2014), we also repeated the same commonality analyses done here on Ridge regression, as opposed to multiple regression. Ridge regression is a method designed to deal with multicollinearity (Dormann et al., 2013). See Supplementary Figure 3 for the Ridge regression with chronological age and each Brain Age index as regressors and Supplementary Figure 5 for the Ridge regression with chronological age, each Brain Age and Brain Cognition index as regressors. Briefly, the results from commonality analyses applied to Ridge regressions are closely matched with our results done using multiple regression.”

      Reviewer 2 Recommendations For The Authors #3:

      • Incorporate non-linearities in the correction of brain-age indices, such as separate terms in the regression or statistical analyses.

      Response Thank you for the suggestion. We now added a non-linear term of chronological age in our multiple-regression models explaining fluid cognition (see Supplementary Figure 4 and 6 below). Originally we did not have the quadratic term for chronological age in our model since the relationship between chronological age and fluid cognition was relatively linear (see Figure 1 above). Accordingly, as expected, adding the quadratic term for chronological age as suggested did not change the pattern of the results of the commonality analyses.

      Methods

      “Similarly, to ensure that we were able to capture the non-linear pattern of chronological age in explaining fluid cognition, we added a quadratic term of chronological age to our multiple-regression models in the commonality analyses. See Supplementary Figure 4 for the multiple regression with chronological age, square chronological age and each Brain Age index as regressors and Supplementary Figure 6 for the multiple regression with chronological age, square chronological age, each Brain Age index and Brain Cognition as regressors. Briefly, adding the quadratic term for chronological age did not change the pattern of the results of the commonality analyses.”

      Reviewer 2 Recommendations For The Authors #4:

      • It would be helpful to include the complete set of results in the appendix - for instance, the statistical significance for each component for the final commonality analysis.

      Response Figures 5 and 6 (see above) already have asterisks to reflect the statistical significance of the unique effects. Because of this, we do not believe we need more figures/tables in the appendix to show statistical significance.

      Recommendations for improving the writing and presentation.

      Reviewer 2 Recommendations For The Authors #5:

      • The authors are encouraged to refrain from using terms such as 'fortunately', 'unfortunately', and 'unsettling', as they may appear inappropriate when referring to empirical findings.

      Response We agree with this suggestion and no long used those words.

      Reviewer 2 Recommendations For The Authors #6:

      • It would be helpful to clarify in the methods that you end up with 5 test folds.

      Response We now made a clarification why we chose 5 test folds.

      Methods

      “We used nested cross-validation (CV) to build these models (see Figure 7). We first split the data into five outer folds. We used five outer folds so that each outer fold had around 100 participants. This is to ensure the stability of the test performance across folds.”

      Minor corrections to the text and figures.

      Reviewer 2 Recommendations For The Authors #7:

      • Why use months, not years for chronological age? This seems inappropriate given the age range.

      Response We originally used months since they were units used in our prediction modelling. However, to make the figures easier to understand, we now used years.

      Reviewer 2 Recommendations For The Authors #8:

      • The formatting, especially regarding the text embedded within the figures, could benefit from significant improvements.

      Response Thank you for the suggestion. We made changes to the text embedded within the figures. They should be more readable now

      Reviewer 2 Recommendations For The Authors #9:

      • The legend for the neuroimaging feature labels is missing, and the captions are incomplete.

      Response Please see Figure 2 above. We now revised by adding the letter L and R for the laterality of the brain images. We made some changes to the captions to make sure they are complete.

      Reviewer 2 Recommendations For The Authors #10:

      • Figure 5's caption: SD has a missing decimal point).

      Response The numbers are not SD. The numbers to the left of the figure represent the unique effects of chronological age in %, the numbers in the middle of the figure represent the common effects between chronological age and Brain Age index in %, and the numbers to the right of the figure represent the unique effects of Brain Age Index in %. We now used the same one decimal point for these number

      Reviewer #3 (Recommendations For The Authors):

      The main question of this article is as follows: “To what extent does having information on Brain Age improve our ability to capture declines in fluid cognition beyond knowing a person’s chronological age?” While this question is worthwhile, considering most of the field is confused about the nature of brain age, the authors are currently missing an opportunity to convey the inevitability of their results given how Brain Age and the Brain Age Gap are calculated. They also misleadingly convey that Brain Cognition is somehow superior to Brain Age. If the authors work on conveying the inevitability of their results and redo (or remove) their section on Brain Cognition, I can see how their results would be enlightening to the general neuroimaging community that is interested in the concept of brain age. See below for specific critiques.

      Response Please see our response to Reviewer 3 Public Review Overall. Note we no longer argue that Brain Cognition is superior to Brain Age (Reviewer 3 Public Review #4). Rather, we treated the capability of Brain Cognition in capturing fluid cognition as the upper limit of Brain Age’s capability in capturing fluid cognition. We used the unique effects of Brain Cognition that explain fluid cognition beyond Brain Age and chronological age to indicate how much Brain Age misses the variation in the brain MRI that could explain fluid cognition.

      Reviewer 3 Recommendations For The Authors #1:

      “There are many adjustments proposed to correct for this estimation bias” (p3) → Regression to the mean is not a sign of bias. Any decent loss function will result in over- predicting the age of younger individuals and under-predicting the age of older individuals. This is a direct result of minimizing an error term (e.g., mean squared error). Therefore, it is inappropriate to refer to regression to the mean as a sign of bias. This misconception has led to a great deal of inappropriate analyses, including “correcting” the brain age gap by regressing out age.

      Response Please see our response to Reviewer 3 Public Review#1

      Reviewer 3 Recommendations For The Authors #2:

      “Corrected Brain Age Gap in particular is viewed as being able to control for both age dependency and estimation biases (Butler et al., 2021).” (p3) → This summary is not accurate as Butler and colleagues did not use the words "corrected" and "biases" in this context. All that authors say in that paper is that regressing out age from the brain age gap - which is referred to as the modified brain age gap (MBAG) - makes it so that the modified brain age gap is not dependent on age, which is true. This metric is meaningless, though, because it is the variance left over after regressing out age from residuals from a model that was predicting age. If it were not for the fact that regression on residuals is not equivalent to multiple regression (and out of sample estimates), MBAG would be a vector of zeros. Upon reading your Methods, I noticed that you are using a metric for Le et al. (2018) for your “Corrected Brain Age Gap”. If they cite the Butler et al. (2021) paper, I highly recommend sticking with the same notation, metrics and terminology throughout. That would greatly help with the interpretability of your paper, and cross-comparisons between the two.

      Response Please see our response to Reviewer 3 Public Review #2.

      Reviewer 3 Recommendations For The Authors #3:

      “However, the improvement in predicting chronological age may not necessarily make Brain Age to be better at capturing Cognitionfluid. If, for instance, the age-prediction model had the perfect performance, Brian Age Gap would be exactly zero and would have no utility in capturing Cognitionfluid beyond chronological age.” (p3) → I largely agree with this statement. I would be really careful to distinguish between Brain Age and the Brain Age Gap here, as the former is a predicted value, and the latter is the residual times -1 (predicted age - age). Therefore, together they explain all of the variance in age. If you change the first sentence to refer to the Brain Age Gap, this statement makes more sense. The Brain Age Gap will never be exactly zero, though, even with perfect prediction on the training set, because subjects in the testing set are different from the subjects in the training set.

      Response Please see our response to Reviewer 3 Public Review #3.

      Reviewer 3 Recommendations For The Authors #4:

      “Can we further improve our ability to capture the decline in cognitionfluid by using, not only Brain Age and chronological age, but also another biomarker, Brain Cognition?” → This question is fundamentally getting at whether a predicted value of cognition can predict cognition. Assuming the brain parameters can predict cognition decently, and the original cognitive measure that you were predicting is related to your measure of fluid cognition, the answer should be yes. This seems like an uninteresting question to me. Upon reading your Methods, it became clear that the cognitive variable in the model predicting cognition using brain features (to get predicted cognition, or as you refer to it, Brain Cognition) is the same as the measure of fluid cognition that you are trying to assess how well Brain Cognition can predict. Assuming the brain parameters can predict fluid cognition at all, of course Brain Cognition will predict fluid cognition. This is inevitable. You should never use predicted values of a variable to predict the same variable.

      Response Please see our response to Reviewer 3 Public Review #4.

      Reviewer 3 Recommendations For The Authors #5:

      “We also examined if these better-performing age-prediction models improved the ability of Brain Age in explaining Cognitionfluid.” → Improved above and beyond what?

      Response We referred to if better-performing age-prediction models improved the ability of Brain Age in explaining fluid cognition over and above lower-performing age-prediction models. We made changes to the Introduction to clarify this change.

      Reviewer 3 Recommendations For The Authors #6:

      Figure 1 b & c → It is a little difficult to read the text by the horizontal bars in your plots. Please make the text smaller so that there is more space between the words vertically, or even better, make the plots slightly bigger. Please also put the predicted values on the y-axis. This is standard practice for displaying regression results. To make more room, you can get rid of your rPearson or your R2 plot, considering the latter is simply the square of the former. If you want to make it clear that the association is positive between all of your variables, I would keep rPearson.

      Response Thank you so much for the suggestions.

      1) We now made sure that the text by the horizontal bars in Figure 1b and c is readable.

      2) Note in prediction model/machine-learning literature, it is more common to plot observed/real values on the y-axis. Here is the logic of our practice: values in the x-axis are the predicted values based on the model, and we would like to see if the changes in the predicted values correspond to the changes in the observed/real value in the y-axis.

      3) Regarding Pearson correlation vs R2, please note that we wrote ”for R2, we used the sum of squares definition (i.e., R2 = 1 – (sum of squares residuals/total sum of squares)) per a previous recommendation (Poldrack et al., 2020).” As such, R2 is NOT the square of the Pearson correlation. In fact, in Poldrack and colleages’s “Establishment of Best Practices for Evidence for Prediction” paper (2020), they discourage 1) the use of Pearson correlation by itself and 2) the use of the correlation coefficient square as R2 (as opposed to sum of squares definition):

      “It is common in the literature to use the correlation between predicted and actual values as a measure of predictive performance; of the 64 studies in our literature review that performed prediction analyses on continuous outcomes, 30 reported such correlations as a measure of predictive performance. This reporting is problematic for several reasons. First, correlation is not sensitive to scaling of the data; thus, a high correlation can exist even when predicted values are discrepant from actual values. Second, correlation can sometimes be biased, particularly in the case of leave-one-out cross-validation. As demonstrated in Figure 4, the correlation between predicted and actual values can be strongly negative when no predictive information is present in the model. A further problem arises when the variance explained (R2) is incorrectly computed by squaring the correlation coefficient. Although this computation is appropriate when the model is obtained using the same data, it is not appropriate for out-of-sample testing23; instead, the amount of variance explained should be computed using the sum-of-squares formulation (as implemented in software packages such as scikit-learn).”

      “A further problem arises when the variance explained (R2) is incorrectly computed by squaring the correlation coefficient. Although this computation is appropriate when the model is obtained using the same data, it is not appropriate for out-of-sample testing23; instead, the amount of variance explained should be computed using the sum-of-squares formulation (as implemented in software packages such as scikit-learn).”

      Accordingly, we decided to keep both R2 and Pearson correlation (along with MAE) in our Figure 1.

      Reviewer 3 Recommendations For The Authors #7:

      Figure 2 “We calculated feature importance by, first, standardizing Elastic Net weights across brain features of each set of features from each test fold.” → What do you mean by “standardize” here? Rescale to be mean 0, variance 1? If so, this seems like a misleading transformation, because it gives the impression that the relationships are negative, when they are not necessarily. Also, why did you choose to use elastic net weights in any form as measures of effect size (or importance)? The raw values are inherently penalized, which means they are under-estimates of the true effect size. It would be more meaningful (and less biased) to plot the raw correlations.

      Response For the first question regarding standardisation, we addressed this issue in our response to Reviewer 1 Recommendations For The Authors #3. Briefly, we agreed with Reviewer 3 that standardisation (with mean = 0, SD = 1) might make it difficult to interpret the directionality of the coefficients. For visualising feature importance in the revised manuscript, we refitted the Elastic Net model to the full dataset without splitting them into five folds and visualised the coefficients on brain images (see below).

      For the second question regarding why using Elastic Net coefficients as feature importance (as opposed to correlations), we need to mention the goal of feature importance: to understand how the model makes a prediction based on different brain features (Molnar, 2019). Correlations between a target and each brain feature do not achieve this. Instead, they will show univariate/marginal relationships between a target and a brain feature. What we want to visualise is how the model made a prediction, which in the case of Elastic Net, the prediction is based on the sum of the features’ coefficients. In other words, the multivariate models (including Elastic Net) focus on marginal relationships that take into account all brain features within each set of features.

      Elastic Net coefficients can be considered as feature importance, such that more positive Elastic Net coefficients lead to more positive predicted values and, similarly, more negative Elastic Net coefficients lead to more negative predicted values (Molnar, 2019; Pat, Wang, Bartonicek, et al., 2022). While the magnitude of Elastic Net coefficients is regularised (thus making it difficult for us to interpret the magnitude itself directly), we could still indicate that a brain feature with a higher magnitude weights relatively stronger in making a prediction. Another benefit of Elastic Net as a penalised regression is that the coefficients are less susceptible to collinearity among features as they have already been regularised (Dormann et al., 2013; Pat, Wang, Bartonicek, et al., 2022).

      Reviewer 3 Recommendations For The Authors #8:

      Figure 3 → Again, what exactly do you mean by “standardised” here?

      Response It means mean subtraction followed by the division by an SD. Though we no longer applies standardisation for feature importance. See our response to Reviewer 1 Recommendations For The Authors #3 and Reviewer 3 Recommendations For The Authors #7.

      Reviewer 3 Recommendations For The Authors #9:

      “However, Brain Age Gap created from the lower-performing age-prediction models explained a higher amount of variation in Cognitionfluid. For instance, the top performing age-prediction model, “Stacked: All excluding Task Contrast”, generated Brain Age and Corrected Brain Age that explained the highest amount of variation in Cognitionfluid, but, at the same time, produced Brian Age Gap that explained the least amount of variation in Cognitionfluid.” (p7) → Yes, but you did not need to run any models to show this, considering it is an inevitable consequence of the following relationship between predicted values and residuals (or residuals times -1): 𝑦 = (𝑦 − 𝑦% ) + 𝑦% . Let’s say that age explains 60% of the variance in fluid cognition, and predicted age ( 𝑦% ) explains 40% of the variance in fluid cognition. Then the brain age gap (−(𝑦 − 𝑦% )) should explain 20% of the variance in fluid cognition. If by “Corrected Brain Age” you mean the modified predicted age from the Butler paper, the “Corrected Brain Age” result is inevitable because the modified predicted age is essentially just age with a tiny bit of noise added to it. From Figure 4, though, this does not seem to be the case, because the lower left quadrant in panel a should be flat and high (about as high as the predictive value of age for fluid cognition). So how are you calculating “Corrected Brain Age”? It looks like you might be regressing age out of Brain Age, though from your description the Methods (How exactly do you use the slope and intercept? You need equation of you are going to stick with this terminology), it is not totally clear. I highly recommend using terminology and metrics from the Butler et al. (2021) paper throughout to reduce confusion.

      Response Please see our response to Reviewer 3 Public Review #5

      Reviewer 3 Recommendations For The Authors #10:

      “On the contrary, an amount of variation in Cognitionfluid explained by Corrected Brain Age Gap was relatively small (maximum R2 = .041) across age-prediction models and did not relate to the predictive performance of the age-prediction models.” (p7) → If by “Corrected Brain Age Gap” you mean MBAG from The Butler paper, yes, this is also inevitable, considering MBAG would be a vector of zeros if it were not for regression on residuals (and out of sample estimates), as I mentioned earlier. Also, it is not clear why you used “on the contrary” as a transition here.

      Response Please see our response to Reviewer 3 Public Review #2 for the ‘MBAG’ term. Briefly, we didn’t use Butler and colleagues' (2021) MBAG, but rather we used the method described in de Lange and Cole’s (2020), which was called RBAG by Butler and colleagues.

      de Lange and Cole’s (2020) method, was commonly implemented elsewhere (Cole et al., 2020; Cumplido-Mayoral et al., 2023; Denissen et al., 2022). Accordingly, researchers who use Brain Age do not usually view this method as capturing a meaningless biomarker. Yet, the small effects of the Corrected Brain Age Gap in explaining fluid cognition of aging individuals found here are consistent with studies in older adults (Cole, 2020) and younger populations (Butler et al., 2021; Jirsaraie, Kaufmann, et al., 2023) (see our response to Reviewer 2 Recommendations For The Authors #1).

      “On the contrary” refers to the fact that the other three Brain Age indices (i.e., those that did not account for the relationship between Brain Age and chronological age) showed a much higher amount of variation in fluid cognition explained. As mentioned above (our response to Reviewer 2 Public Review #7), our argument resonates Butler and colleagues’ (2021) suggestion (p. 4097): “As such, it is critical that readers of past literature note whether or not age was controlled for when testing for effects on the BAG, as this has not always been common practice (e.g., Beheshti et al., 2018; Cole, Underwood, et al., 2017; Franke et al., 2015; Gaser et al., 2013; Liem et al., 2017; Nenadi c et al., 2017; Steffener et al., 2016)”.

      Reviewer 3 Recommendations For The Authors #11:

      “As before, the unique effects of Brain Age indices were all relatively small across the four Brain Age indices and across different prediction models.” (p10) → Yes, again, this is inevitable considering how they are calculated. You can show these analyses to demonstrate your results in data, if you want, but ignoring the inevitability given how these variables are calculated is misleading.

      Response Accounting for the relationship between Brain Age and chronological age when examining the utility of Brain Age is not misleading. Similar to previous recommendations (Butler et al., 2021; Le et al., 2018), we believe that not doing so is misleading. That is, without accounting for the relationship between Brain Age and chronological age, Brain Age will likely explain the same variation of the phenotype of interest as chronological age. Please see our response to Reviewer 3 Recommendations For The Authors #18 below.

      Reviewer 3 Recommendations For The Authors #12:

      “On the contrary, the unique effects of Brain Cognition appeared much larger.” (p10) → This is not a fair comparison if you don’t look at the unique effects above and beyond the cognitive variable you predicted (fluid cognition) in your Brain Cognition model. When you do this, you will see that Brain Cognition is useless when you include fluid cognition in the model, just as Brain Age would be in predicting age when you include age in the model. This highlights the fact that using predicted values of a metric to predict that metric is a pointless path to take, and that using a predicted value to predict anything is worse than using the value itself.

      Response Please see our response to Reviewer 3 Public Review #6.

      Reviewer 3 Recommendations For The Authors #13:

      “First, how much does Brain Age add to what is already captured by chronological age? The short answer is very little.” (p12) → This is a really important point, but your paper requires an in-depth discussion of the inevitability of this result, which I have discussed previously in this review.

      Response Please see our response to Reviewer 3 Public Review #7.

      Reviewer 3 Recommendations For The Authors #14:

      “Second, do better-performing age-prediction models improve the ability of Brain Age to capture Cognitionfluid? Unfortunately, the answer is no.” (p12) → You need to be clear that you are talking about above and beyond age here.

      Response Thank you so much for your suggestion. We now made the change to this sentence accordingly.

      Discussion

      “Second, do better-performing age-prediction models improve the utility of Brain Age to capture fluid cognition above and beyond chronological age? The answer is also no.”

      Reviewer 3 Recommendations For The Authors #15:

      “Third, do we have a solution that can improve our ability to capture Cognitionfluid from brain MRI? The answer is, fortunately, yes. Using Brain Cognition as a biomarker, along with chronological age, seemed to capture a higher amount of variation in Cognitionfluid than only using Brain Age.” (p12) → Again, try controlling for the cognitive measure you predicted in your Brain Cognition model. This will show that Brain Cognition is not useful above and beyond cognition, highlighting the fact that it is not a useful endeavor to be using predicted values.

      Response Please see our response to Reviewer 3 Public Review #8.

      Reviewer 3 Recommendations For The Authors #16:

      “Accordingly, a race to improve the performance of age-prediction models (Baecker et al., 2021) does not necessarily enhance the utility of Brain Age indices as a biomarker for Cognitionfluid. This calls for a new paradigm. Future research should aim to build prediction models for Brian Age indices that are not necessarily good at predicting age, but at capturing phenotypes of interest, such as Cognitionfluid and beyond.” (p13) → I whole-heartedly agree with the first two sentences, and strongly disagree with the last. Certainly your results, and the underlying reason as to why you found these results, calls for a new paradigm (or, one might argue, a pre-brain age paradigm). They do not, however, suggest that we should keep going down the Brain Age path. In fact, I think it should be abandoned all together. While it is difficult to prove that there is no transformation of Brain Age or the Brain Age Gap that will be useful, I am nearly sure this is true from the research I have done. Therefore, if you would like to suggest that the field should continue down this path, you need to present a very good case to support this view.

      Response Please see our response to Reviewer 3 Public Review #9.

      Reviewer 3 Recommendations For The Authors #17:

      “Perhaps this is because the estimation of the influences of chronological age was done in the training set.” (p13) → I believe this is the case, and it is testable. Try re-running your analyses where parameters are estimated and performance is evaluated on the same data.

      Response Yes, we agreed with this. Based on the equations we used, this is inevitable.

      Reviewer 3 Recommendations For The Authors #18:

      “Similar to a previous recommendation (Butler et al., 2021), we suggest focusing on Corrected Brain Age Gap.” (p13) → To be clear, the authors did not use the term “Corrected” because it is very misleading. The authors also did not suggest that we proceed with any brain age metric; rather they mentioned that the modified brain age gap is independent of age. Note the following passage: “Further, the interpretability of the modified brain age gap (MBAG) itself is limited by the fact that it is a prediction error from a regression to remove the effects of age from a residual obtained through a regression to predict age. By virtue of these limitations, we suggest that the modified version may not provide useful information about precocity or delay in brain development. In light of this, as well as the complexities associated with interpretations of the BAG and its dependence on age, we suggest that further methodological and theoretical work is warranted.” I recognize that that this statement is hedged, as is often required in the publication process, but I am all but certain that MBAG/BAG/modified predicted age are useless constructs. Therefore, if you are going to suggest that people continue to use them, opposed to suggesting that further methodological or theoretical work is warranted, you need to make a strong case, which you did not try to make here. If anything, your results support abandoning the age- prediction endeavor altogether.

      Response Please see our response to Reviewer 3 Public Review #2 for the term. Briefly, we didn’t use Butler and colleagues’ (2021) MBAG, but rather RBAG. This index was originally described in de Lange and Cole’s (2020), and has now been implemented elsewhere (Cole et al., 2020; Cumplido-Mayoral et al., 2023; Denissen et al., 2022).

      We do not intend to encourage people to abandon the Brain Age endeavour altogether. However, we made main three suggestions for future research on Brain Age to ensure its utility. First, they should account for the relationship between Brain Age and chronological age either using Corrected Brain Age Gap (or other similar adjustments) or, better, examining the unique effects of Brain Age indices after controlling for chronological age through commonality analyses (see below). This is similar to the suggestion made by Le and colleagues (2018) and later rephased by Butler and colleagues (2021). More specifically, Le and colleagues (2018) mentioned (p. 10): “Based on our observations in both real and simulated data, we recommend that the relationship between chronological age and BrainAGE should be accounted for. The two methods proposed in this study are either: (1) regress age on BrainAGE, producing BrainAGER, which is centered on 0 regardless of a participant's actual age or (2) include age as a regressor when doing follow-up analyses.”

      Second, we suggested that researchers should not select age-prediction models based solely on age-prediction performance (see our response to Reviewer 1 Recommendations For The Authors #1).

      Third, we suggested that researchers should test how much Brain Age miss the variation in the brain MRI that could explain fluid cognition or other phenotypes of interest (see our response to Reviewer 2 Public Review #4).

      Discussion

      “What does it mean then for researchers/clinicians who would like to use Brain Age as a biomarker? First, they have to be aware of the overlap in variation between Brain Age and chronological age and should focus on the contribution of Brain Age over and above chronological age. Using Brain Age Gap will not fix this. Butler and colleagues (2021) recently highlighted this point, “These results indicate that the association between cognition and the BAG are driven by the association between age and cognitive performance. As such, it is critical that readers of past literature note whether or not age was controlled for when testing for effects on the BAG, as this has not always been common practice (p. 4097).” Similar to previous recommendations (Butler et al., 2021; Le et al., 2018), we suggest future work should account for the relationship between Brain Age and chronological age, either using Corrected Brain Age Gap (or other similar adjustments) or, better, examining unique effects of Brain Age indices after controlling for chronological age through commonality analyses. Note we prefer using unique effects over beta estimates from multiple regressions, given that unique effects do not change as a function of collinearity among regressors (Ray-Mukherjee et al., 2014). In our case, Brain Age indices had the same unique effects regardless of the level of common effects they had with chronological age (e.g., Brain Age vs. Corrected Brain Age Gap from stacked models). In the case of fluid cognition, the unique effects might be too small to be clinically meaningful as shown here and previously (Butler et al., 2021; Cole, 2020; Jirsaraie, Kaufmann, et al., 2023).”

      Reviewer 3 Recommendations For The Authors #19:

      “To compute Brain Age and Brain Cognition, we ran two separate prediction models. These prediction models either had chronological age or Cognitionfluid as the target.” (p16) → You should make it clear in the main text of your paper that the cognition variable in your Brain Cognition models is the same as what you refer to as Cognitionfluid. Some of your analyses would have been much more reasonable if you had two different measures of cognition.

      Response Thank you so much for the suggestion. We believe, given the re-conceptualisation of Brain Cognition as the main text

      Introduction

      “certain variation in the brain MRI is related to fluid cognition, but to what extent does Brain Age not capture this variation? To estimate the variation in the brain MRI that is related to fluid cognition, we could build prediction models that directly predict fluid cognition (i.e., as opposed to chronological age) from brain MRI data.”

      Reviewer 3 Recommendations For The Authors #20:

      “We controlled for the potential influences of biological sex on the brain features by first residualizing biological sex from brain features in the training set.” (p16) → Why? Your question is about prediction, not causal inference.

      Response While the question is about prediction, we still would like to, as much as possible, be confident about what kind of information we drew from. Here we focused on brain data and controlled for other variables that might not be neuronal. For instance, we controlled for movement and physiological noise using ICA-FIX (Glasser et al., 2016). Following conventional practices in brain-based predictive modelling, we also treated biological sex as another sort of noise (Vieira et al., 2022). The difference between movement/physiological noise and biological sex is that the former varies across TRs, and the latter varies across individuals. Thus we controlled for movement and physiological noise within each participant and controlled for biological sex within a group of participants who belonged to the same training set.

      Reviewer 3 Recommendations For The Authors #20:

      “Lastly, we computer Corrected Brain Age Gap by subtracting the chronological age from the Corrected Brain Age (Butler et al., 2021; Le et al., 2018).” (p17) → The modified brain age gap in that paper is the residuals from regressing BAG on age (see equation 6). I highly recommend using that terminology and notation throughout to provide consistency and interpretability across papers.

      Response Please see our response to Reviewer 3 Public Review #2 for the term.

      Reviewer 3 Recommendations For The Authors #21: Equations (pgs 17-19) → Please use statistical notation instead of pseudo-R code.

      Response We rewrote all of the equations using statistical notations.

      References

      Abraham, A., Pedregosa, F., Eickenberg, M., Gervais, P., Mueller, A., Kossaifi, J., Gramfort, A., Thirion, B., & Varoquaux, G. (2014). Machine learning for neuroimaging with scikit-learn. Frontiers in Neuroinformatics, 8, 14. https://doi.org/10.3389/fninf.2014.00014

      Ances, B. M., Liang, C. L., Leontiev, O., Perthen, J. E., Fleisher, A. S., Lansing, A. E., & Buxton, R. B. (2009). Effects of aging on cerebral blood flow, oxygen metabolism, and blood oxygenation level dependent responses to visual stimulation. Human Brain Mapping, 30(4), 1120–1132. https://doi.org/10.1002/hbm.20574

      Bashyam, V. M., Erus, G., Doshi, J., Habes, M., Nasrallah, I. M., Truelove-Hill, M., Srinivasan, D., Mamourian, L., Pomponio, R., Fan, Y., Launer, L. J., Masters, C. L., Maruff, P., Zhuo, C., Völzke, H., Johnson, S. C., Fripp, J., Koutsouleris, N., Satterthwaite, T. D., … on behalf of the ISTAGING Consortium, the P. A. disease C., ADNI, and CARDIA studies. (2020). MRI signatures of brain age and disease over the lifespan based on a deep brain network and 14 468 individuals worldwide. Brain, 143(7), 2312–2324. https://doi.org/10.1093/brain/awaa160

      Beheshti, I., Nugent, S., Potvin, O., & Duchesne, S. (2019). Bias-adjustment in neuroimaging-based brain age frameworks: A robust scheme. NeuroImage: Clinical, 24, 102063. https://doi.org/10.1016/j.nicl.2019.102063

      Bookheimer, S. Y., Salat, D. H., Terpstra, M., Ances, B. M., Barch, D. M., Buckner, R. L., Burgess, G. C., Curtiss, S. W., Diaz-Santos, M., Elam, J. S., Fischl, B., Greve, D. N., Hagy, H. A., Harms, M. P., Hatch, O. M., Hedden, T., Hodge, C., Japardi, K. C., Kuhn, T. P., … Yacoub, E. (2019). The Lifespan Human Connectome Project in Aging: An overview. NeuroImage, 185, 335–348. https://doi.org/10.1016/j.neuroimage.2018.10.009

      Butler, E. R., Chen, A., Ramadan, R., Le, T. T., Ruparel, K., Moore, T. M., Satterthwaite, T. D., Zhang, F., Shou, H., Gur, R. C., Nichols, T. E., & Shinohara, R. T. (2021). Pitfalls in brain age analyses. Human Brain Mapping, 42(13), 4092–4101. https://doi.org/10.1002/hbm.25533 Choi, S. W., Mak, T. S.-H., & O’Reilly, P. F. (2020). Tutorial: A guide to performing polygenic risk score analyses. Nature Protocols, 15(9), Article 9. https://doi.org/10.1038/s41596-020-0353-1

      Cole, J. H. (2020). Multimodality neuroimaging brain-age in UK biobank: Relationship to biomedical, lifestyle, and cognitive factors. Neurobiology of Aging, 92, 34–42. https://doi.org/10.1016/j.neurobiolaging.2020.03.014

      Cole, J. H., Raffel, J., Friede, T., Eshaghi, A., Brownlee, W. J., Chard, D., De Stefano, N., Enzinger, C., Pirpamer, L., Filippi, M., Gasperini, C., Rocca, M. A., Rovira, A., Ruggieri, S., Sastre-Garriga, J., Stromillo, M. L., Uitdehaag, B. M. J., Vrenken, H., Barkhof, F., … Group, M. study. (2020). Longitudinal Assessment of Multiple Sclerosis with the Brain-Age Paradigm. Annals of Neurology, 88(1), 93–105. https://doi.org/10.1002/ana.25746

      Cumplido-Mayoral, I., García-Prat, M., Operto, G., Falcon, C., Shekari, M., Cacciaglia, R., Milà-Alomà, M., Lorenzini, L., Ingala, S., Meije Wink, A., Mutsaerts, H. J., Minguillón, C., Fauria, K., Molinuevo, J. L., Haller, S., Chetelat, G., Waldman, A., Schwarz, A. J., Barkhof, F., … OASIS study. (2023). Biological brain age prediction using machine learning on structural neuroimaging data: Multi-cohort validation against biomarkers of Alzheimer’s disease and neurodegeneration stratified by sex. ELife, 12, e81067. https://doi.org/10.7554/eLife.81067

      de Lange, A.-M. G., & Cole, J. H. (2020). Commentary: Correction procedures in brain-age prediction. NeuroImage: Clinical, 26, 102229. https://doi.org/10.1016/j.nicl.2020.102229

      Demontis, D., Walters, R. K., Martin, J., Mattheisen, M., Als, T. D., Agerbo, E., Baldursson, G., Belliveau, R., Bybjerg-Grauholm, J., Bækvad-Hansen, M., Cerrato, F., Chambert, K., Churchhouse, C., Dumont, A., Eriksson, N., Gandal, M., Goldstein, J. I., Grasby, K. L., Grove, J., … Neale, B. M. (2019). Discovery of the first genome-wide significant risk loci for attention deficit/hyperactivity disorder. Nature Genetics, 51(1), Article 1. https://doi.org/10.1038/s41588-018-0269-7

      Denissen, S., Engemann, D. A., De Cock, A., Costers, L., Baijot, J., Laton, J., Penner, I., Grothe, M., Kirsch, M., D’hooghe, M. B., D’Haeseleer, M., Dive, D., De Mey, J., Van Schependom, J., Sima, D. M., & Nagels, G. (2022). Brain age as a surrogate marker for cognitive performance in multiple sclerosis. European Journal of Neurology, 29(10), 3039–3049. https://doi.org/10.1111/ene.15473

      Dormann, C. F., Elith, J., Bacher, S., Buchmann, C., Carl, G., Carré, G., Marquéz, J. R. G., Gruber, B., Lafourcade, B., Leitão, P. J., Münkemüller, T., McClean, C., Osborne, P. E., Reineking, B., Schröder, B., Skidmore, A. K., Zurell, D., & Lautenbach, S. (2013). Collinearity: A review of methods to deal with it and a simulation study evaluating their performance. Ecography, 36(1), 27–46. https://doi.org/10.1111/j.1600-0587.2012.07348.x

      Dubois, J., Galdi, P., Paul, L. K., & Adolphs, R. (2018). A distributed brain network predicts general intelligence from resting-state human neuroimaging data. Philosophical Transactions of the Royal Society B: Biological Sciences, 373(1756), 20170284. https://doi.org/10.1098/rstb.2017.0284

      Elliott, M. L., Knodt, A. R., Cooke, M., Kim, M. J., Melzer, T. R., Keenan, R., Ireland, D., Ramrakha, S., Poulton, R., Caspi, A., Moffitt, T. E., & Hariri, A. R. (2019). General functional connectivity: Shared features of resting-state and task fMRI drive reliable and heritable individual differences in functional brain networks. NeuroImage, 189, 516–532. https://doi.org/10.1016/j.neuroimage.2019.01.068

      Fair, D. A., Schlaggar, B. L., Cohen, A. L., Miezin, F. M., Dosenbach, N. U. F., Wenger, K. K., Fox, M. D., Snyder, A. Z., Raichle, M. E., & Petersen, S. E. (2007). A method for using blocked and event-related fMRI data to study “resting state” functional connectivity. NeuroImage, 35(1), 396–405. https://doi.org/10.1016/j.neuroimage.2006.11.051

      Fischl, B., Salat, D. H., Busa, E., Albert, M., Dieterich, M., Haselgrove, C., van der Kouwe, A., Killiany, R., Kennedy, D., Klaveness, S., Montillo, A., Makris, N., Rosen, B., & Dale, A. M. (2002). Whole Brain Segmentation. Neuron, 33(3), 341–355. https://doi.org/10.1016/S0896-6273(02)00569-X

      Franke, K., & Gaser, C. (2019). Ten Years of BrainAGE as a Neuroimaging Biomarker of Brain Aging: What Insights Have We Gained? Frontiers in Neurology, 10, 789. https://doi.org/10.3389/fneur.2019.00789

      Glasser, M. F., Smith, S. M., Marcus, D. S., Andersson, J. L. R., Auerbach, E. J., Behrens, T. E. J., Coalson, T. S., Harms, M. P., Jenkinson, M., Moeller, S., Robinson, E. C., Sotiropoulos, S. N., Xu, J., Yacoub, E., Ugurbil, K., & Van Essen, D. C. (2016). The Human Connectome Project’s neuroimaging approach. Nature Neuroscience, 19(9), 1175–1187. https://doi.org/10.1038/nn.4361

      Glasser, M. F., Sotiropoulos, S. N., Wilson, J. A., Coalson, T. S., Fischl, B., Andersson, J. L., Xu, J., Jbabdi, S., Webster, M., Polimeni, J. R., Van Essen, D. C., & Jenkinson, M. (2013). The minimal preprocessing pipelines for the Human Connectome Project. NeuroImage, 80, 105–124. https://doi.org/10.1016/j.neuroimage.2013.04.127

      Gordon, E. M., Laumann, T. O., Adeyemo, B., Huckins, J. F., Kelley, W. M., & Petersen, S. E. (2016). Generation and Evaluation of a Cortical Area Parcellation from Resting-State Correlations. Cerebral Cortex, 26(1), 288–303. https://doi.org/10.1093/cercor/bhu239

      Gratton, C., Laumann, T. O., Nielsen, A. N., Greene, D. J., Gordon, E. M., Gilmore, A. W., Nelson, S. M., Coalson, R. S., Snyder, A. Z., Schlaggar, B. L., Dosenbach, N. U. F., & Petersen, S. E. (2018). Functional Brain Networks Are Dominated by Stable Group and Individual Factors, Not Cognitive or Daily Variation. Neuron, 98(2), 439-452.e5. https://doi.org/10.1016/j.neuron.2018.03.035

      Harms, M. P., Somerville, L. H., Ances, B. M., Andersson, J., Barch, D. M., Bastiani, M., Bookheimer, S. Y., Brown, T. B., Buckner, R. L., Burgess, G. C., Coalson, T. S., Chappell, M. A., Dapretto, M., Douaud, G., Fischl, B., Glasser, M. F., Greve, D. N., Hodge, C., Jamison, K. W., … Yacoub, E. (2018). Extending the Human Connectome Project across ages: Imaging protocols for the Lifespan Development and Aging projects. NeuroImage, 183, 972–984. https://doi.org/10.1016/j.neuroimage.2018.09.060

      Horien, C., Noble, S., Greene, A. S., Lee, K., Barron, D. S., Gao, S., O’Connor, D., Salehi, M., Dadashkarimi, J., Shen, X., Lake, E. M. R., Constable, R. T., & Scheinost, D. (2020). A hitchhiker’s guide to working with large, open-source neuroimaging datasets. Nature Human Behaviour, 5(2), 185–193. https://doi.org/10.1038/s41562-020-01005-4

      Jirsaraie, R. J., Gorelik, A. J., Gatavins, M. M., Engemann, D. A., Bogdan, R., Barch, D. M., & Sotiras, A. (2023). A systematic review of multimodal brain age studies: Uncovering a divergence between model accuracy and utility. Patterns, 4(4), 100712. https://doi.org/10.1016/j.patter.2023.100712

      Jirsaraie, R. J., Kaufmann, T., Bashyam, V., Erus, G., Luby, J. L., Westlye, L. T., Davatzikos, C., Barch, D. M., & Sotiras, A. (2023). Benchmarking the generalizability of brain age models: Challenges posed by scanner variance and prediction bias. Human Brain Mapping, 44(3), 1118–1128. https://doi.org/10.1002/hbm.26144

      Khojaste-Sarakhsi, M., Haghighi, S. S., Ghomi, S. M. T. F., & Marchiori, E. (2022). Deep learning for Alzheimer’s disease diagnosis: A survey. Artificial Intelligence in Medicine, 130, 102332. https://doi.org/10.1016/j.artmed.2022.102332

      Le, T. T., Kuplicki, R. T., McKinney, B. A., Yeh, H.-W., Thompson, W. K., Paulus, M. P., Tulsa 1000 Investigators, Aupperle, R. L., Bodurka, J., Cha, Y.-H., Feinstein, J. S., Khalsa, S. S., Savitz, J., Simmons, W. K., & Victor, T. A. (2018). A Nonlinear Simulation Framework Supports Adjusting for Age When Analyzing BrainAGE. Frontiers in Aging Neuroscience, 10. https://www.frontiersin.org/articles/10.3389/fnagi.2018.00317

      Liang, H., Zhang, F., & Niu, X. (2019). Investigating systematic bias in brain age estimation with application to post-traumatic stress disorders. Human Brain Mapping, 40(11), 3143–3152. https://doi.org/10.1002/hbm.24588

      Luby, J. L. (2010). Preschool Depression: The Importance of Identification of Depression Early in Development. Current Directions in Psychological Science, 19(2), 91–95. https://doi.org/10.1177/0963721410364493

      Molnar, C. (2019). Interpretable Machine Learning. A Guide for Making Black Box Models Explainable. https://christophm.github.io/interpretable-ml-book/

      Nimon, K., Lewis, M., Kane, R., & Haynes, R. M. (2008). An R package to compute commonality coefficients in the multiple regression case: An introduction to the package and a practical example. Behavior Research Methods, 40(2), 457–466. https://doi.org/10.3758/BRM.40.2.457

      Pat, N., Wang, Y., Anney, R., Riglin, L., Thapar, A., & Stringaris, A. (2022). Longitudinally stable, brain‐based predictive models mediate the relationships between childhood cognition and socio‐demographic, psychological and genetic factors. Human Brain Mapping, hbm.26027. https://doi.org/10.1002/hbm.26027

      Pat, N., Wang, Y., Bartonicek, A., Candia, J., & Stringaris, A. (2022). Explainable machine learning approach to predict and explain the relationship between task-based fMRI and individual differences in cognition. Cerebral Cortex, bhac235. https://doi.org/10.1093/cercor/bhac235

      Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V., Vanderplas, J., Passos, A., Cournapeau, D., Brucher, M., Perrot, M., & Duchesnay, É. (2011). Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research, 12(85), 2825–2830.

      Poldrack, R. A., Huckins, G., & Varoquaux, G. (2020). Establishment of Best Practices for Evidence for Prediction: A Review. JAMA Psychiatry, 77(5), 534–540. https://doi.org/10.1001/jamapsychiatry.2019.3671

      Rasero, J., Sentis, A. I., Yeh, F.-C., & Verstynen, T. (2021). Integrating across neuroimaging modalities boosts prediction accuracy of cognitive ability. PLOS Computational Biology, 17(3), e1008347. https://doi.org/10.1371/journal.pcbi.1008347

      Ray-Mukherjee, J., Nimon, K., Mukherjee, S., Morris, D. W., Slotow, R., & Hamer, M. (2014). Using commonality analysis in multiple regressions: A tool to decompose regression effects in the face of multicollinearity. Methods in Ecology and Evolution, 5(4), 320–328. https://doi.org/10.1111/2041-210X.12166

      Robinson, E. C., Garcia, K., Glasser, M. F., Chen, Z., Coalson, T. S., Makropoulos, A., Bozek, J., Wright, R., Schuh, A., Webster, M., Hutter, J., Price, A., Cordero Grande, L., Hughes, E., Tusor, N., Bayly, P. V., Van Essen, D. C., Smith, S. M., Edwards, A. D., … Rueckert, D. (2018). Multimodal surface matching with higher-order smoothness constraints. NeuroImage, 167, 453–465. https://doi.org/10.1016/j.neuroimage.2017.10.037

      Rokicki, J., Wolfers, T., Nordhøy, W., Tesli, N., Quintana, D. S., Alnæs, D., Richard, G., de Lange, A.-M. G., Lund, M. J., Norbom, L., Agartz, I., Melle, I., Nærland, T., Selbæk, G., Persson, K., Nordvik, J. E., Schwarz, E., Andreassen, O. A., Kaufmann, T., & Westlye, L. T. (2021). Multimodal imaging improves brain age prediction and reveals distinct abnormalities in patients with psychiatric and neurological disorders. Human Brain Mapping, 42(6), 1714–1726. https://doi.org/10.1002/hbm.25323

      Satterthwaite, T. D., Connolly, J. J., Ruparel, K., Calkins, M. E., Jackson, C., Elliott, M. A., Roalf, D. R., Hopson, R., Prabhakaran, K., Behr, M., Qiu, H., Mentch, F. D., Chiavacci, R., Sleiman, P. M. A., Gur, R. C., Hakonarson, H., & Gur, R. E. (2016). The Philadelphia Neurodevelopmental Cohort: A publicly available resource for the study of normal and abnormal brain development in youth. NeuroImage, 124, 1115–1119. https://doi.org/10.1016/j.neuroimage.2015.03.056

      Smith, S. M., Vidaurre, D., Alfaro-Almagro, F., Nichols, T. E., & Miller, K. L. (2019). Estimation of brain age delta from brain imaging. NeuroImage, 200, 528–539. https://doi.org/10.1016/j.neuroimage.2019.06.017

      Somerville, L. H., Bookheimer, S. Y., Buckner, R. L., Burgess, G. C., Curtiss, S. W., Dapretto, M., Elam, J. S., Gaffrey, M. S., Harms, M. P., Hodge, C., Kandala, S., Kastman, E. K., Nichols, T. E., Schlaggar, B. L., Smith, S. M., Thomas, K. M., Yacoub, E., Van Essen, D. C., & Barch, D. M. (2018). The Lifespan Human Connectome Project in Development: A large-scale study of brain connectivity development in 5–21 year olds. NeuroImage, 183, 456–468. https://doi.org/10.1016/j.neuroimage.2018.08.050

      Sperling, R. A., Bates, J. F., Cocchiarella, A. J., Schacter, D. L., Rosen, B. R., & Albert, M. S. (2001). Encoding novel face-name associations: A functional MRI study. Human Brain Mapping, 14(3), 129–139. https://doi.org/10.1002/hbm.1047

      Sripada, C., Angstadt, M., Rutherford, S., Kessler, D., Kim, Y., Yee, M., & Levina, E. (2019). Basic Units of Inter-Individual Variation in Resting State Connectomes. Scientific Reports, 9(1), Article 1. https://doi.org/10.1038/s41598-018-38406-5

      Sripada, C., Angstadt, M., Rutherford, S., Taxali, A., & Shedden, K. (2020). Toward a “treadmill test” for cognition: Improved prediction of general cognitive ability from the task activated brain. Human Brain Mapping, 41(12), 3186–3197. https://doi.org/10.1002/hbm.25007

      Stigler, S. M. (1997). Regression towards the mean, historically considered. Statistical Methods in Medical Research, 6(2), 103–114. https://doi.org/10.1177/096228029700600202

      Sudlow, C., Gallacher, J., Allen, N., Beral, V., Burton, P., Danesh, J., Downey, P., Elliott, P., Green, J., Landray, M., Liu, B., Matthews, P., Ong, G., Pell, J., Silman, A., Young, A., Sprosen, T., Peakman, T., & Collins, R. (2015). UK Biobank: An Open Access Resource for Identifying the Causes of a Wide Range of Complex Diseases of Middle and Old Age. PLOS Medicine, 12(3), e1001779. https://doi.org/10.1371/journal.pmed.1001779

      Tetereva, A., Li, J., Deng, J. D., Stringaris, A., & Pat, N. (2022). Capturing brain‐cognition relationship: Integrating task‐based fMRI across tasks markedly boosts prediction and test‐retest reliability. NeuroImage, 263, 119588. https://doi.org/10.1016/j.neuroimage.2022.119588

      Vieira, B. H., Pamplona, G. S. P., Fachinello, K., Silva, A. K., Foss, M. P., & Salmon, C. E. G. (2022). On the prediction of human intelligence from neuroimaging: A systematic review of methods and reporting. Intelligence, 93, 101654. https://doi.org/10.1016/j.intell.2022.101654

      Vos De Wael, R., Benkarim, O., Paquola, C., Lariviere, S., Royer, J., Tavakol, S., Xu, T., Hong, S.-J., Langs, G., Valk, S., Misic, B., Milham, M., Margulies, D., Smallwood, J., & Bernhardt, B. C. (2020). BrainSpace: A toolbox for the analysis of macroscale gradients in neuroimaging and connectomics datasets. Communications Biology, 3(1), 103. https://doi.org/10.1038/s42003-020-0794-7

      Woolrich, M. W., Ripley, B. D., Brady, M., & Smith, S. M. (2001). Temporal Autocorrelation in Univariate Linear Modeling of FMRI Data. NeuroImage, 14(6), 1370–1386. https://doi.org/10.1006/nimg.2001.0931

      Zou, H., & Hastie, T. (2005). Regularization and variable selection via the elastic net. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 67(2), 301–320. https://doi.org/10.1111/j.1467-9868.2005.00503.x

    1. Author Response

      The following is the authors’ response to the original reviews.

      We would like to thank the reviewers for their helpful comments which we have addressed, point-by-point, below:

      Reviewer #1:

      1) It might be useful to add more details to the methods (especially lines 191-196) to make them a bit more user-friendly for an audience who still may be unfamiliar with the relatively new and complex Mendelian randomisation technique.

      The following information has been included in this section of the methods, to describe the different MR models in more detail:

      “The IVW MR model will produce biased effect estimates in the presence of horizontal pleiotropy, i.e. where one or more genetic variant(s) included in the instrument affect the outcome by a pathway other than through the exposure. In the weighted median model, each genetic variant is weighted according to its distance from the median effect of all genetic variants. Thus, the weighted median model will provide an unbiased estimate when at least 50% of the information in an instrument comes from genetic variants that are not horizontally pleiotropic. The weighted mode model uses a similar approach but weights genetic instruments according to the mean effect. In this model, over 50% of the weight of the genetic instrument can be contributed to by genetic variants which are horizontally pleiotropic, but the most common amount of pleiotropy must be zero (known as the Zero Modal Pleiotropy Assumption (ZEMPA))[Hartwig et al., 2017].”

      2) I was just wondering why MR egger was not carried out as part of this analysis?

      We did consider also employing the MR Egger model as a further sensitivity analysis. However, given we were already employing the weighted median and weighted mode models, and given that MR-Egger suffers from reduced statistical power in comparison to the other models, we reasoned that adding in a further MR model would not add further clarity to our analyses, particularly given the relatively small sample size.

      3) Although it is included in Figure 1 flowchart, I think it is also important to explain clearly in the written text way only n=6,118 of n=13,988 children in ALSPAC study were included in this study and the reason for this.

      The following information has been included in the paragraph describing the ALSPAC study in the methods:

      “Sufficient information was available on 6,221 of these individuals to be included in our analysis, as metabolomics was not performed for all individuals in the ALSPAC study.”

      4) It is mentioned within the discussion 'the NMR metabolomics platform utilised in the analyses outlined here has limited coverage of fatty acids'. I think it might be useful to also add this detail into the methods section to aid readers when they are making their own interpretation whilst reading the results section.

      The following sentence has been included in the methods section:

      “This metabolomics platform has limited coverage of fatty acids.”

      5) However, I feel that the conclusion should be tempered slightly as although this study alongside other similar MR studies provides evidence of an association between genetic liability to CRC and levels of metabolites at certain ages, I do not think there is enough evidence at this stage to say that genetic liability for CRC actually alters the levels of metabolites.

      The first sentence of the conclusion has been changed to:

      “Our analysis provides evidence that genetic liability to CRC is associated with altered levels of metabolites at certain ages, some of which may have a causal role in CRC development.”

      Reviewer #2:

      1) The background is lacking introduction to the different components of the metabolic features tested. For instance, there is a broader discussion about polyunsaturated fatty acids (PUFA) in the discussion, however, this should have been introduced and defined already before that. What metabolites are included in that term (PUFA)? Are there other studies on PUFA and CRC?

      The following information has been included in the background section:

      “In particular, previous work has highlighted polyunsaturated fatty acids (PUFA) as potentially having a role in colorectal cancer development. The term PUFA includes omega-3 and -6 fatty acids. Recent MR work has highlighted a possible link between PUFAs, in particular omega 6 PUFAs, and colorectal cancer risk.”

      2) There seem to be indications for horizontal pleiotropy given the changed estimates when genetic variants in the FADS loci are removed. Could multivariable MR methods have been used to account for pleiotropy and differentiate individual fatty acid effects?

      Multivariable MR can be employed to investigate the effects of horizontal pleiotropy. However, the multiple exposures must have sufficiently distinct underlying genetic architecture in order to instrument each one whilst adjusting for the other, as determined by conditional F-statistics. Given the correlations across metabolite levels, this is unlikely to be the case.

      3) The ALSPAC sample sizes are decreasing across the different age groups, which is not strange given the longitudinal collection. However, does the altered sample composition affect the results? Have sensitivity analyses been done on the complete set of individuals from age 8-25?

      The altered sample composition could be affecting results. The limitations section of the discussion has been amended to reflect this:

      “Secondly, mostly due to the longitudinal nature of the ASLAPC study, our sample at each time point is composed of slightly different individuals. This could be influencing our results, and should be taken into account when comparing across time points.”

      We have not completed any sensitivity analyses to investigate this.

      4) Although beyond the scope of this paper, sex-stratified GWAS analyses on metabolites can easily be done in UK Biobank.

      We thank the reviewer for this suggestion, and agree that this would be an interesting future analysis. We have amended the discussion to mention this:

      “Fourthly, our analysis would benefit from being repeated with sex-stratified data. Although such GWAS results for metabolites are not currently available, the data to perform such GWAS are available in UK Biobank for future analyses.”

      5) Very minor, there is a difference in reporting a number of decimals in ALSPAC results. There is also a difference in reporting the units for the results comparing text and figures (per SD higher CRC liability or per doubling). Please include sample sizes and data sources in the figure legends as they should be stand-alone items.

      We have amended the ALSPAC results to all have two decimal places, reporting units have been altered and figure legends to include sample sizes and data sources.

    1. Author Response

      We thank the reviewers for their suggestions. We are confident in the model that predicts odor vs odor (OCT-MCH) preference using calcium activity, but we acknowledge the relative weakness of the model that predicts odor (OCT) vs air preference. We are preparing an updated manuscript that will prioritize our interpretation of the OCT-MCH results and more fully document uncertainties around our estimates of prediction capacity.

      Reviewer #1 (Public Review):

      Summary: The authors seek to establish what aspects of nervous system structure and function may explain behavioral differences across individual fruit flies. The behavior in question is a preference for one odor or another in a choice assay. The variables related to neural function are odor responses in olfactory receptor neurons or in the second-order projection neurons, measured via calcium imaging. A different variable related to neural structure is the density of a presynaptic protein BRP. The authors measure these variables in the same fly along with the behavioral bias in the odor assays. Then they look for correlations across flies between the structure-function data and the behavior.

      Strengths: Where behavioral biases originate is a question of fundamental interest in the field. In an earlier paper (Honegger 2019) this group showed that flies do vary with regard to odor preference, and that there exists neural variation in olfactory circuits, but did not connect the two in the same animal. Here they do, which is a categorical advance, and opens the door to establishing a correlation. The authors inspect many such possible correlations. The underlying experiments reflect a great deal of work, and appear to be done carefully. The reporting is clear and transparent: All the data underlying the conclusions are shown, and associated code is available online.

      We are glad to hear the reviewer is supportive of the general question and approach.

      Weaknesses: The results are overstated. The correlations reported here are uniformly small, and don't inspire confidence that there is any causal connection. The main problems are

      We are working on a revision that overhauls the interpretations of the results. We recognize that the current version inadequately distinguishes the results that we have high confidence in (specifically, PC2 of our Ca++ data as a predictor of OCT-MCH preference) versus results that are suggestive but not definitive (such as the PC1 of Ca++ data as a predictor of Air-OCT preference).

      It’s true that the correlations are small, with r2 values typically in the 0.1-0.2 range. That said, we would call it a victory if we could explain 10 to 20% of the variance of a behavior measure, captured in a 3 minute experiment, with a circuit correlate. This is particularly true because, as the reviewer notes, the behavioral measurement is noisy.

      1) The target effect to be explained is itself very weak. Odor preference of a given fly varies considerably across time. The systematic bias distinguishing one fly from another is small compared to the variability. Because the neural measurements are by necessity separated in time from the behavior, this noise places serious limits on any correlation between the two.

      This is broadly correct, though to quibble, it’s our measurement of odor preference which varies considerably over time. We are reasonably confident that the more variance in our measurements can be attributed to sampling error than changes to true preference over time. As evidence, the correlation in sequential measures of individual odor preference, with delays of 3 hours or 24 hours, are not obviously different. We are separately working on methodological improvements to get more precise estimates of persistent individual odor preference, using averages of multiple, spaced measurements. This is promising, but beyond the scope of this study.

      2) The correlations reported here are uniformly weak and not robust. In several of the key figures, the elimination of one or two outlier flies completely abolishes the relationship. The confidence bounds on the claimed correlations are very broad. These uncertainties propagate to undermine the eventual claims for a correspondence between neural and behavioral measures.

      We are broadly receptive to this criticism. The lack of robustness of some results comes from the fundamental challenge of this work: measuring behavior is noisy at the individual level. Measuring Ca++ is also somewhat noisy. Correlating the two will be underpowered unless the sample size is huge (which is impractical, as each data point requires a dissection and live imaging session) or the effect size is large (which is generally not the case in biology). In the current version we tried to in some sense to avoid discussing these challenges head-on, instead trying to focus on what we thought were the conclusions justified by our experiments with sample sizes ranging from 20 to 60. We are working on a revision that is more candid about these challenges.

      That said, we believe the result we view as the most exciting — that PC2 of Ca++ responses predicts OCT-MCH preference — is robust. 1) It is based on a training set with 47 individuals and a test set composed of 22 individuals. The p-value is sufficiently low in each of these sets (0.0063 and 0.0069, respectively) to pass an overly stringent Bonferonni correction for the 5 tests (each PC) in this analysis. 2) The BRP immunohistochemistry provides independent evidence that is consistent with this result — PC2 that predicts behavior (p = 0.03 from only one test) and has loadings that contrast DC2 and DM2. Taken together, these results are well above the field-standard bar of statistical robustness.

      In the revision we are working on, we are explicit that this is the (one) result we have high confidence in. We believe this result convincingly links Ca++ and behavior, and warrants spotlighting. We have less confidence in other results, and say so, and we hope this addresses concerns about overstating our results.

      3) Some aspects of the statistical treatment are unusual. Typically a model is proposed for the relationship between neuronal signals and behavior, and the model predictions are correlated with the actual behavioral data. The normal practice is to train the model on part of the data and test it on another part. But here the training set at times includes the testing set, which tends to give high correlations from overfitting. Other times the testing set gives much higher correlations than the training set, and then the results from the testing set are reported. Where the authors explored many possible relationships, it is unclear whether the significance tests account for the many tested hypotheses. The main text quotes the key results without confidence limits.

      Our primary analyses are exactly what the reviewer describes, scatter plots and correlations of actual behavioral measures against predicted measures. We produced test data in separate experiments, conducted weeks to months after models were fit on training data. This is more rigorous than splitting into training and test sets data collected in a single session, as batch/environmental effects reduce the independence of data collected within a single session.

      We only collected a test set when our training set produced a promising correlation between predicted and actual behavioral measures. We never used data from test sets to train models. In our main figures, we showed scatter plots that combined test and training data, as the training and test partitions had similar correlations.

      We are unsure what the reviewer means by instances where we explored many possible relationships. The greatest number of comparisons that could lead to the rejection of a null hypothesis was 5 (corresponding to the top 5 PCs of Ca++ response variation or Brp signal). We were explicit that the p-values reported were nominal. As mentioned above, applying a Bonferroni correction for n=5 comparisons to either the training or test correlations from the Ca++ to OCT-MCH preference model remains significant at alpha=0.05.

      Our revision will include confidence limits.

      Reviewer #2 (Public Review):

      Summary:

      The authors aimed to identify the neural sources of behavioral variation in a decision between odor and air, or between two odors.

      Strengths:

      -The question is of fundamental importance.

      -The behavioral studies are automated, and high-throughput.

      -The data analyses are sophisticated and appropriate.

      -The paper is clear and well-written aside from some strong wording.

      -The figures beautifully illustrate their results.

      -The modeling efforts mechanistically ground observed data correlations.

      We are glad to read that the reviewer sees these strengths in the study. We hope the forthcoming revision will address the strong wording.

      Weaknesses:

      -The correlations between behavioral variations and neural activity/synapse morphology are (i) relatively weak, (ii) framed using the inappropriate words "predict", "link", and "explain", and (iii) sometimes non-intuitive (e.g., PC 1 of neural activity).

      Taking each of these points in turn: i) It would indeed be nicer if our empirical correlations are higher. One quibble: we primarily report relatively weak correlations between measurements of behavior and Ca++/Brp. This could be the case even when the correlation between true behavior and Ca++/Brp is higher. Our analysis of the potential correlation between latent behavioral and Ca++ signals was an attempt to tease these relationships apart. The analysis suggests that there could, in fact, be a high underlying correlation between behavior and these circuit features (though the error bars on these inferences are wide).

      ii) We are working to guarantee that all such words are used appropriately. “Predict” can often be appropriate in this context, as a model predicts true data values. Explain can also be appropriate, as X “explaining” a portion of the variance of Y is synonymous with X and Y being correlated. We cannot think of formal uses of “link,” and are revising the manuscript to resolve any inappropriate word choice.

      iii) If the underlying biology is rooted in non-intuitive relationships, there’s unfortunately not much we can do about it. We chose to use PCs of our Ca++/Brp data as predictors to deal with the challenge of having many potential predictors (odor-glomerular responses) and relatively few output variables (behavioral bias). Thus, using PCs is a conservative approach to deal with multiple comparisons. Because PCs are just linear transformations of the original data, interpreting them is relatively easy, and in interpreting PC1 and PC2, we were able to identify simple interpretations (total activity and the difference between DC2 and DM2 activation, respectively). All in all, we remain satisfied with this approach as a means to both 1) limit multiple comparisons and 2) interpret simple meanings from predictive PCs.

      -No attempts were made to perturb the relevant circuits to establish a causal relationship between behavioral variations and functional/morphological variations.

      We did conduct such experiments, but we did not report them because they had negative results that we could not definitively interpret. We used constitutive and inducible effectors to alter the physiology of ORNs projecting to DC2 and DM2. We also used UAS-LRP4 and UAS-LRP4-RNAi to attempt to increase and decrease the extent of Brp puncta in ORNs projecting to DC2 and DM2. None of these manipulations had a significant effect on mean odor preference in the OCT-MCH choice, which was the behavioral focus of these experiments. We were unable to determine if the effectors had the intended effects in the targeted Gal4 lines, particularly in the LRP experiments, so we could not rule out that our negative finding reflected a technical failure. We are reviewing these results to determine if they warrant including as a negative finding in the revision.

      We believe that even if these negative results are not technical failures, they are not necessarily inconsistent with the analyses correlating features of DC2 and DM2 to behavior. Specifically, we suspect that there are correlated fluctuations in glomerular Ca++ responses and Brp across individuals, due to fluctuations in the developmental spatial patterning of the antennal lobe. Thus, the DC2-DM2 predictor may represent a slice/subset of predictors distributed across the antennal lobe. This would also explain how we “got lucky” to find two glomeruli as predictors of behavior, when were only able to image a small portion of the glomeruli. In analyses we did not report, we explored this possibility using the AL computational model. We are likely to include this interpretation in the revised discussion.

      Reviewer #3 (Public Review):

      Churgin et. al. seeks to understand the neural substrates of individual odor preference in the Drosophila antennal lobe, using paired behavioral testing and calcium imaging from ORNs and PNs in the same flies, and testing whether ORN and PN odor responses can predict behavioral preference. The manuscript's main claims are that ORN activity in response to a panel of odors is predictive of the individual's preference for 3-octanol (3-OCT) relative to clean air, and that activity in the projection neurons is predictive of both 3-OCT vs. air preference and 3-OCT vs. 4-methylcyclohexanol (MCH). They find that the difference in density of fluorescently-tagged brp (a presynaptic marker) in two glomeruli (DC2 and DM2) trends towards predicting behavioral preference between 3-oct vs. MCH. Implementing a model of the antennal lobe based on the available connectome data, they find that glomerulus-level variation in response reminiscent of the variation that they observe can be generated by resampling variables associated with the glomeruli, such as ORN identity and glomerular synapse density.

      Strengths:

      The authors investigate a highly significant and impactful problem of interest to all experimental biologists, nearly all of whom must often conduct their measurements in many different individuals and so have a vested interest in understanding this problem. The manuscript represents a lot of work, with challenging paired behavioral and neural measurements.

      Weaknesses:

      The overall impression is that the authors are attempting to explain complex, highly variable behavioral output with a comparatively limited set of neural measurements…

      We would say that we are attempting to explain a simple, highly variable behavioral measure with a comparatively limited set of neural measurements. I.e. we make no claims to explain the complex behavioral components of odor choice, like locomotion, reversals at the odor boundary, etc.

      Given the degree of behavioral variability they observe within an individual (Figure 1- supp 1) which implies temporal/state/measurement variation in behavior, it's unclear that their degree of sampling can resolve true individual variability (what they call "idiosyncrasy") in neural responses, given the additional temporal/state/measurement variation in neural responses.

      We are confident that different Ca++ recordings are statistically different. This is borne out in the analysis of repeated Ca++ recordings in this study, which finds that the significant PCs of Ca++ variation contain 77% of the variation in that data. That this variation is persistent over time and across hemispheres was assessed in Honegger & Smith, et al., 2019. We are thus confident that there is true individuality in neural responses (Note, we prefer not to call it “individual variability” as this could refer to variability within individuals, not variability across individuals.) It is a separate question of whether individual differences in neural responses bear some relation to individual differences in behavioral biases. That was the focus of this study, and our finding of a robust correlation between PC2 of Ca++ responses and OCT-MCH preference indicates a relation. Because behavior and Ca++ were collected with an hours-to-day long gap, this implies that there are latent versions of both behavioral bias and Ca++ response that are stable on timescales at least that long.

      The statistical analyses in the manuscript are underdeveloped, and it's unclear the degree to which the correlations reported have explanatory (causative) power in accounting for organismal behavior.

      With respect, we do not think our statistical analyses are underdeveloped, though we acknowledge that the detailed reviewer suggestions included the helpful suggestion to include uncertainty in the estimation of confidence intervals around the point estimate of the strength of correlation between latent behavioral and Ca++ response states. We are considering those suggestions and anticipate responding to them in the revision.

      It is indeed a separate question whether the correlations we observed represent causal links from Ca++ to behavior (though our yoked experiment suggests there is not a behavior-to-Ca++ causal relationship — at least one where odor experience through behavior is an upstream cause). We attempted to be precise in indicating that our observations are correlations. That is why we used that word in the title, as an example. In the revision, we are working to make sure this is appropriately reflected in all word choice across the paper.

    1. the role of gender politics adds an additional twist to the controversy over this fragment: the rampant misogyny in the academy which leads woman scholars, like King, to face uphill battles in their careers; androcentric histories which automatically diminish and demote feminist histories as political and "ideological"

      I can understand the frustration that may have lead King to commit such a blunder. As an Arab woman, I have found people who think that I am not apt enough in engaging in the discourse I am participating in. But I do not think that I would risk my ethics in accepting evidence or forgoing provenance for the sole motive of boosting my career. As we have discussed in class, provenance is important. It prevents more colonial exploitation of the Middle East, and it allows native scholars to learn and add to their own great history. This is where my sympathies end with King--- the idea that this text had "tipped over into likelihood" of being a forgery should have been where she exercised her duty as a scholar and disengaged with the text.

    1. Thank you. If you see dear Mrs. Equitone, Tell her I bring the horoscope myself: One must be so careful these days.     Unreal City, Under the brown fog of a winter dawn, A crowd flowed over London Bridge, so many, I had not thought death had undone so many. Sighs, short and infrequent, were exhaled, And each man fixed his eyes before his feet. Flowed up the hill and down King William Street, To where Saint Mary Woolnoth kept the hours With a dead sound on the final stroke of nine. There I saw one I knew, and stopped him, crying: “Stetson! “You who were with me in the ships at Mylae! “That corpse you planted last year in your garden, “Has it begun to sprout? Will it bloom this year? “Or has the sudden frost disturbed its bed? “Oh keep the Dog far hence, that’s friend to men, “Or with his nails he’ll dig it up again! “You! hypocrite lecteur!—mon semblable,—mon frère!”                 II. A Game of Chess   The Chair she sat in, like a burnished throne, Glowed on the marble, where the glass Held up by standards wrought with fruited vines From which a golden Cupidon peeped out (Another hid his eyes behind his wing) Doubled the flames of sevenbranched candelabra Reflecting light upon the table as The glitter of her jewels rose to meet it, From satin cases poured in rich profusion; In vials of ivory and coloured glass Unstoppered, lurked her strange synthetic perfumes, Unguent, powdered, or liquid—troubled, confused And drowned the sense in odours; stirred by the air That freshened from the window, these ascended In fattening the prolonged candle-flames, Flung their smoke into the laquearia, Stirring the pattern on the coffered ceiling. Huge sea-wood fed with copper Burned green and orange, framed by the coloured stone, In which sad light a carvéd dolphin swam. Above the antique mantel was displayed As though a window gave upon the sylvan scene The change of Philomel, by the barbarous king So rudely forced; yet there the nightingale Filled all the desert with inviolable voice And still she cried, and still the world pursues, “Jug Jug” to dirty ears. And other withered stumps of time Were told upon the walls; staring forms Leaned out, leaning, hushing the room enclosed. Footsteps shuffled on the stair. Under the firelight, under the brush, her hair Spread out in fiery points Glowed into words, then would be savagely still.     “My nerves are bad tonight. Yes, bad. Stay with me. “Speak to me. Why do you never speak. Speak.   “What are you thinking of? What thinking? What? “I never know what you are thinking. Think.”     I think we are in rats’ alley Where the dead men lost their bones.     “What is that noise?”                           The wind under the door. “What is that noise now? What is the wind doing?”                            Nothing again nothing.                                                         “Do “You know nothing? Do you see nothing? Do you remember “Nothing?”          I remember Those are pearls that were his eyes. “Are you alive, or not? Is there nothing in your head?”                                                                            But O O O O that Shakespeherian Rag— It’s so elegant So intelligent “What shall I do now? What shall I do?” “I shall rush out as I am, and walk the street “With my hair down, so. What shall we do tomorrow? “What shall we ever do?”                                                The hot water at ten. And if it rains, a closed car at four. And we shall play a game of chess, Pressing lidless eyes and waiting for a knock upon the door.     When Lil’s husband got demobbed, I said— I didn’t mince my words, I said to her myself, HURRY UP PLEASE ITS TIME Now Albert’s coming back, make yourself a bit smart. He’ll want to know what you done with that money he gave you To get yourself some teeth. He did, I was there. You have them all out, Lil, and get a nice set, He said, I swear, I can’t bear to look at you. And no more can’t I, I said, and think of poor Albert, He’s been in the army four years, he wants a good time, And if you don’t give it him, there’s others will, I said. Oh is there, she said. Something o’ that, I said. Then I’ll know who to thank, she said, and give me a straight look. HURRY UP PLEASE ITS TIME If you don’t like it you can get on with it, I said. Others can pick and choose if you can’t. But if Albert makes off, it won’t be for lack of telling. You ought to be ashamed, I said, to look so antique. (And her only thirty-one.) I can’t help it, she said, pulling a long face, It’s them pills I took, to bring it off, she said. (She’s had five already, and nearly died of young George.) The chemist said it would be all right, but I’ve never been the same. You are a proper fool, I said. Well, if Albert won’t leave you alone, there it is, I said, What you get married for if you don’t want children? HURRY UP PLEASE ITS TIME Well, that Sunday Albert was home, they had a hot gammon, And they asked me in to dinner, to get the beauty of it hot— HURRY UP PLEASE ITS TIME HURRY UP PLEASE ITS TIME Goonight Bill. Goonight Lou. Goonight May. Goonight. Ta ta. Goonight. Goonight. Good night, ladies, good night, sweet ladies, good night, good night.                 III. The Fire Sermon     The river’s tent is broken: the last fingers of leaf Clutch and sink into the wet bank. The wind Crosses the brown land, unheard. The nymphs are departed. Sweet Thames, run softly, till I end my song. The river bears no empty bottles, sandwich papers, Silk handkerchiefs, cardboard boxes, cigarette ends Or other testimony of summer nights. The nymphs are departed. And their friends, the loitering heirs of city directors; Departed, have left no addresses. By the waters of Leman I sat down and wept . . . Sweet Thames, run softly till I end my song, Sweet Thames, run softly, for I speak not loud or long. But at my back in a cold blast I hear The rattle of the bones, and chuckle spread from ear to ear.   A rat crept softly through the vegetation Dragging its slimy belly on the bank While I was fishing in the dull canal On a winter evening round behind the gashouse Musing upon the king my brother’s wreck And on the king my father’s death before him. White bodies naked on the low damp ground And bones cast in a little low dry garret, Rattled by the rat’s foot only, year to year. But at my back from time to time I hear The sound of horns and motors, which shall bring Sweeney to Mrs. Porter in the spring. O the moon shone bright on Mrs. Porter And on her daughter They wash their feet in soda water Et O ces voix d’enfants, chantant dans la coupole!   Twit twit twit Jug jug jug jug jug jug So rudely forc’d. Tereu   Unreal City Under the brown fog of a winter noon Mr. Eugenides, the Smyrna merchant Unshaven, with a pocket full of currants C.i.f. London: documents at sight, Asked me in demotic French To luncheon at the Cannon Street Hotel Followed by a weekend at the Metropole.   At the violet hour, when the eyes and back Turn upward from the desk, when the human engine waits Like a taxi throbbing waiting, I Tiresias, though blind, throbbing between two lives, Old man with wrinkled female breasts, can see At the violet hour, the evening hour that strives Homeward, and brings the sailor home from sea, The typist home at teatime, clears her breakfast, lights Her stove, and lays out food in tins. Out of the window perilously spread Her drying combinations touched by the sun’s last rays, On the divan are piled (at night her bed) Stockings, slippers, camisoles, and stays. I Tiresias, old man with wrinkled dugs Perceived the scene, and foretold the rest— I too awaited the expected guest. He, the young man carbuncular, arrives, A small house agent’s clerk, with one bold stare, One of the low on whom assurance sits As a silk hat on a Bradford millionaire. The time is now propitious, as he guesses, The meal is ended, she is bored and tired, Endeavours to engage her in caresses Which still are unreproved, if undesired. Flushed and decided, he assaults at once; Exploring hands encounter no defence; His vanity requires no response, And makes a welcome of indifference. (And I Tiresias have foresuffered all Enacted on this same divan or bed; I who have sat by Thebes below the wall And walked among the lowest of the dead.) Bestows one final patronising kiss, And gropes his way, finding the stairs unlit . . .   She turns and looks a moment in the glass, Hardly aware of her departed lover; Her brain allows one half-formed thought to pass: “Well now that’s done: and I’m glad it’s over.” When lovely woman stoops to folly and Paces about her room again, alone, She smoothes her hair with automatic hand, And puts a record on the gramophone.   “This music crept by me upon the waters” And along the Strand, up Queen Victoria Street. O City city, I can sometimes hear Beside a public bar in Lower Thames Street, The pleasant whining of a mandoline And a clatter and a chatter from within Where fishmen lounge at noon: where the walls Of Magnus Martyr hold Inexplicable splendour of Ionian white and gold.                  The river sweats                Oil and tar                The barges drift                With the turning tide                Red sails                Wide                To leeward, swing on the heavy spar.                The barges wash                Drifting logs                Down Greenwich reach                Past the Isle of Dogs.                                  Weialala leia                                  Wallala leialala                  Elizabeth and Leicester                Beating oars                The stern was formed                A gilded shell                Red and gold                The brisk swell                Rippled both shores                Southwest wind                Carried down stream                The peal of bells                White towers                                 Weialala leia                                 Wallala leialala   “Trams and dusty trees. Highbury bore me. Richmond and Kew Undid me. By Richmond I raised my knees Supine on the floor of a narrow canoe.”   “My feet are at Moorgate, and my heart Under my feet. After the event He wept. He promised a ‘new start.’ I made no comment. What should I resent?”   “On Margate Sands. I can connect Nothing with nothing. The broken fingernails of dirty hands. My people humble people who expect Nothing.”                        la la   To Carthage then I came   Burning burning burning burning O Lord Thou pluckest me out O Lord Thou pluckest   burning                 IV. Death by Water   Phlebas the Phoenician, a fortnight dead, Forgot the cry of gulls, and the deep sea swell And the profit and loss.                                    A current under sea Picked his bones in whispers. As he rose and fell He passed the stages of his age and youth Entering the whirlpool.                                    Gentile or Jew O you who turn the wheel and look to windward, Consider Phlebas, who was once handsome and tall as you.                 V. What the Thunder Said     After the torchlight red on sweaty faces After the frosty silence in the gardens After the agony in stony places The shouting and the crying Prison and palace and reverberation Of thunder of spring over distant mountains He who was living is now dead We who were living are now dying With a little patience   Here is no water but only rock Rock and no water and the sandy road The road winding above among the mountains Which are mountains of rock without water If there were water we should stop and drink Amongst the rock one cannot stop or think Sweat is dry and feet are in the sand If there were only water amongst the rock Dead mountain mouth of carious teeth that cannot spit Here one can neither stand nor lie nor sit There is not even silence in the mountains But dry sterile thunder without rain There is not even solitude in the mountains But red sullen faces sneer and snarl From doors of mudcracked houses                                       If there were water    And no rock    If there were rock    And also water    And water    A spring    A pool among the rock    If there were the sound of water only    Not the cicada    And dry grass singing    But sound of water over a rock    Where the hermit-thrush sings in the pine trees    Drip drop drip drop drop drop drop    But there is no water   Who is the third who walks always beside you? When I count, there are only you and I together But when I look ahead up the white road There is always another one walking beside you Gliding wrapt in a brown mantle, hooded I do not know whether a man or a woman —But who is that on the other side of you?   What is that sound high in the air Murmur of maternal lamentation Who are those hooded hordes swarming Over endless plains, stumbling in cracked earth Ringed by the flat horizon only What is the city over the mountains Cracks and reforms and bursts in the violet air Falling towers Jerusalem Athens Alexandria Vienna London Unreal   A woman drew her long black hair out tight And fiddled whisper music on those strings And bats with baby faces in the violet light Whistled, and beat their wings And crawled head downward down a blackened wall And upside down in air were towers Tolling reminiscent bells, that kept the hours And voices singing out of empty cisterns and exhausted wells.   In this decayed hole among the mountains In the faint moonlight, the grass is singing Over the tumbled graves, about the chapel There is the empty chapel, only the wind’s home. It has no windows, and the door swings, Dry bones can harm no one. Only a cock stood on the rooftree Co co rico co co rico In a flash of lightning. Then a damp gust Bringing rain   Ganga was sunken, and the limp leaves Waited for rain, while the black clouds Gathered far distant, over Himavant. The jungle crouched, humped in silence. Then spoke the thunder DA Datta: what have we given? My friend, blood shaking my heart The awful daring of a moment’s surrender Which an age of prudence can never retract By this, and this only, we have existed Which is not to be found in our obituaries Or in memories draped by the beneficent spider Or under seals broken by the lean solicitor In our empty rooms DA Dayadhvam: I have heard the key Turn in the door once and turn once only We think of the key, each in his prison Thinking of the key, each confirms a prison Only at nightfall, aethereal rumours Revive for a moment a broken Coriolanus DA Damyata: The boat responded Gaily, to the hand expert with sail and oar The sea was calm, your heart would have responded Gaily, when invited, beating obedient To controlling hands                                     I sat upon the shore Fishing, with the arid plain behind me Shall I at least set my lands in order? London Bridge is falling down falling down falling down Poi s’ascose nel foco che gli affina Quando fiam uti chelidon—O swallow swallow Le Prince d’Aquitaine à la tour abolie These fragments I have shored against my ruins Why then Ile fit you. Hieronymo’s mad againe. Datta. Dayadhvam. Damyata.                   Shantih     shantih     shantih Archives October 2023 September 2023 August 2023 Categories Uncategorized Course Info Mystery Text Assignment (Due: 9/26) Syllabus General Info How to annotate Texts Texts Alain Locke Alice Dunbar-Nelson Allen Ginsberg, “Howl” (1956) Charlotte Perkins Gilman, “The Yellow Wallpaper” (1892) Claude McKay Edgar Lee Masters Edna St. Vincent Millay Edwin Arlington Robinson Ernest Hemingway, In Our Time Ezra Pound Georgia Douglas Johnson Gertrude Stein Gwendolyn B. Bennett Helene Johnson Henry Adams, “The Dynamo and the Virgin” John Dos Passos, “The Body of an American” Langston Hughes Langston Hughes, “The Negro Artist and the Racial Mountain” (1926) Lawrence Ferlinghetti Paul Laurence Dunbar Philip Levine, “They Feed They Lion” (1972) Radical Poetry Robert Frost Sterling Brown T.S. Eliot “The Waste Land” (1922) W.E.B. Du Bois, “Of Our Spiritual Strivings” William Carlos Williams

      Has this entire poem been the conversation of the speaker receiving a taro card reading?

    1. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      Summary: Sharma, et al. report the characterization of the polar tube (PT) from the microsporidian species, Vairimorpha necatrix, using a combination of optical microscopy, cryo-ET, and proteomics. The polar tube is a fascinating invasion apparatus which mediates the translocation of the parasite into the inside of a host cell to initiate infection. Similar to results obtained previously in other species, the authors show that PT firing in Vairimorpha necatrix is extremely fast, occurring on the order of 1 sec, and that the extruded PT is over 100 microns long in this species. Using cryo-ET to image the PT at a high resolution, they find that it exists in two major states: both an empty state and a state filled with cargo, and that the thickness of the tube wall changes when cargo is present. Strikingly, the authors observed that one of the cargo components, the ribosomes, are organized ordered array that may have helical symmetry. Finally, the authors took advantage of a naturally occurring "His tag" on PTP3 to affinity purify PTP3-containing protein complexes and analyze the composition using proteomics.

      Major comments

      ln 139-140: The absolute handedness of something can be very tricky to determine by cryo-ET (but certainly is possible). Variable hardware configurations between microscopes and differing conventions between software packages (e.g., for what direction is a positive tilt angle) can lead to inversion of the apparent handedness in the final tomogram. How certain are the authors that the absolute handedness is indeed right handed, as this seems to vary between the various display items in the manuscript? For example, in Fig 1c, my impression is that ribosome helices are left handed, as they are also in the supplemental movie. If this isn't known with certainty, perhaps it would be sufficient to describe the apparent helical symmetry but state that the handedness is ambiguous.

      Minor comments

      ln 39-40: Perhaps also cite the E. cuniculi genome paper?

      ln 97-98: It is interesting that the PT shortens in V. necatrix as well, and while I can pick this out in some of the individual traces in Sup Fig. 1b, it seems to get washed out in the trend line and isn't super obvious. If it isn't to laborious, it could be nice to add a panel showing the quantification of this (e.g., plotting the final length of each PT as a percentage of the maximum length achieved).

      ln 98-100: Strictly speaking, I don't think the referenced figure shows the sporoplasm being transformed into an extended conformation, only that it is spherical upon exit. Simply reword this to make clear that the deformations are inferred to occur but not directly observed.

      Because PT firing is so fast, the probability of trapping a PT in the process of transporting cargo would be pretty low. So then why does the PT still contain cellular cargo like ribosomes inside in the tomograms? Should these not have emerged in the sporoplasm which would enter the host cell? Are these "defective" spores that have failed to complete sporoplasm transport? Perhaps this is worth discussing.

      ln 118: The authors note an apparent correlation between the phase of germination and the thickness of the tube wall but don't specify what this correlation is. Is it thicker in the early phase and thinner in later phase, or vice versa? One could imagine "empty" tubes existing before or after sporoplasm transport, for example, so I'm not sure I follow how the phase is being inferred from the tomograms.

      ln 119-120: What is the evidence that the outer layer is made of PTPs, or that it is even protein (for example, as opposed to cell wall-like carbohydrate polymers)? I think this seems like a very reasonable hypothesis, but I would suggest explaining the logic and ensuring the degree of uncertainty is conveyed clearly. In light of this, I would also suggest changing figure labels, etc, that refer to the PTP layer (e.g., Fig. 3, PTPc and PTPe labels).

      ln 121, 123: "sheathed by a thin layer" and "enveloped by a thick outer layer": is this an additional layer being described? Or is this referring to the putative PTP layer, and that its thickness is variable?

      ln 125-126: While I understand how some features, like ribosomes, proteasomes, and generic membrane compartments could be identified, it is unclear to me how one would recognize the nucleus when inside the PT, nor are any examples shown. If the data is clear, perhaps the authors could show it in a figure? Otherwise, I suggest removing the claim regarding the nucleus.

      The arrangement of the ribosomes in a subset of tubes is really fascinating! While the number of observations is relatively small (n=5), it seems like it should be possible to comment preliminarily on whether there is much variability in their helical arrangement. Do the helical parameters vary much between observations? Does the til, pitch, etc vary much, are the 5 occurrences very similar? Is there any sign that they are associated with a membrane? Also, since the ribosomes form a lattice-like arrangement, it seems like it would be possible to trace ribosome helices in both the left and right handed directions. How did the authors decide between the two possibilities? This doesn't seem to be discussed.

      Fig. 2e: Are the two different colors/orientations meant to represent the two protamers of the ribosome dimer? When refined subvolumes are mapped back onto the original tomogram do the authors observe a similar crystalline arrangement of particles as in their segmentation? Are the orientations of the ribosomes correlated, and do the provide any evidence for the dimeric arrangement mentioned? The PlaceObjects plugin for Chimera can be very helpful for visualizing this: https://www.biochem.mpg.de/7939908/Place-Object

      Supp figure 4(b-d): Perhaps these models could be colored by pLDDT scores (with a key indicating the color scheme), so the reader can assess the quality of the predictions?

      How were the measurements of the membrane thickness and putative PTP layer carried out? On the tomogram projections? STAs? How were the boundaries of the layers established (e.g., map threshholding if STA?)? This information appears to be missing from the methods.

      Some tubes that are labeled as 'PTempty' actually contain cargo and look dense (example supp. Fig 2c, left and middle panels). Is it fair to classify these as empty tubes?

      Fig. 3d: I am not entirely clear on what is being shown here. Are independent reconstructions of PTcargo and PTempty superposed (aligned on membrane)? The description in the figure legend doesn't clearly say what is being displayed. I think it might be more clear to show these side-by-side instead of superposed (i.e., 4 panels instead of 2).

      Sup Fig 1: Define S and SP in legend or just spell out on figure? Missing x-axis label on panel b.

      Fig. 4b and Sup Fig 2a: The depictions of the PT in the spore here are left-handed. In a few species, the coil of the PT was found to form a right-handed helix (Jaroenlak, et al.), and it seems plausible that this may be a general feature that would be conserved across microsporidia. I appreciate that it might not be actually known to be right-handed in V. necatrix, but if there is no strong data either way, perhaps it would make sense for these depictions of the PT to be right-handed.

      I think all three of us are more or less in consensus about this manuscript, and I largely agree with the other reviewers comments. I think after addressing reviewer suggestions, this will be a pretty nice story.

      Significance

      Overall, this manuscript from Sharma, et al. presents interesting new findings about the structure and cargo transport function of the microsporidian PT. Microsporidia infect a wide range of hosts, including humans, and how the PT mediates parasite entry into cells is poorly understood. The approaches used in this study are appropriate for tackling the questions at hand, and appear to be generally well executed and interpreted. The observation that ribosomes assemble into an array within the PT is very unexpected and quite fascinating, and may be of broader interest to researchers working on ribosome structure and function, in addition to researchers studying microsporidia. The approach to investigating proteins interacting with PTP3 was quite elegant, and yielded a list of potential interactors that appears to be of very high quality and is highly plausible based on the literature field. We think this work is a substantial advance in the field and provides important new insights into the organization of the PT. - Please define your field of expertise with a few keywords to help the authors contextualize your point of view:

      Structural biology, microsporidia - Indicate if there are any parts of the paper that you do not have sufficient expertise to evaluate.

      We are not experts in proteomics/mass spectrometry

    1. Reviewer #3 (Public Review):

      Summary:<br /> The study uses structural MRI to identify how the number, degree of experience, and phonemic diversity of language(s) that a speaker knows can influence the thickness of different sub-segments of the auditory cortex. In both a primary and replication sample of adult speakers, the authors find key differences in cortical thickness within specific subregions of the cortex due to either the age at which languages are acquired (degree of experience), or the diversity of the phoneme inventories carried by that/those language(s) (breadth of experience).

      Strengths:<br /> The results are first and foremost quite fascinating and I do think they make a compelling case for the different ways in which linguistic experience shapes the auditory cortex.

      The study uses a number of different measures to quantify linguistic experience, related to how many languages a person knows (taking into account the age at which each was learned) as well as the diversity of the phoneme inventories contained within those languages. The primary sample is moderately large for a study that focuses on brain-behaviour relationships; a somewhat smaller replication sample is also deployed in order to test the generality of the effects.

      Analytic approaches benefit from the careful use of brain segmentation techniques that nicely capture key landmarks and account for vagaries in the structure of STG that can vary across individuals (e.g., the number of transverse temporal gyri varies from 1-4 across individuals).

      Weaknesses:<br /> The specificity of these effects is interesting; some effects really do appear to be localized to the left hemisphere and specific subregions of the auditory cortex e.g., TTG. However because analyses only focus on auditory regions along the STG and MTG, one could be led to the conclusion that these are the only brain regions for which such effects will occur. The hypothesis is that these are specifically auditory effects, but that does make a clear prediction that non-auditory regions should not show the same sort of variability. I recognize that expanding the search space will inflate type-1 errors to a point where maybe it's impossible to know what effects are genuine. And the fine-grained nature of the effects suggests a coarse analysis of other cortical regions is likely to fail. So I don't know the right answer here. Only that I tend to wonder if some control region(s) might have been useful for understanding whether such effects truly are limited to the auditory cortex. Otherwise one might argue these are epiphenomenal or some hidden factor unrelated to auditory experience predicting that we'd also see them in the non-auditory cortex as well, either within or outside the brain's speech network(s).

      The reason(s) why we might find a link between cortical thickness and experience is not fully discussed. The introduction doesn't really mention why we'd expect cortical thickness to be correlated (positively or negatively) with speech experience. There is some discussion of it in the Discussion section as it relates to the Pliatsikas' Dynamic Restructuring Model, though I think that model only directly predicts thinning as a function of experience (here, negative correlations). It might have less to say about observed positive correlations e.g., HG in the right hemisphere. In any case, I do think that it's interesting to find some relationship between brain morphology and experience but clearer explanations for why these occur could help, and especially some mention of it in the intro so readers are clearer on why cortical thickness is a useful measure.

      One pitfall of quantifying phoneme overlap across languages is that what we might call a single 'phoneme', shared across languages, will, in reality, be realized differently across them. For instance, English and French may be argued to both use the vowel /u/ although it's realized differently in English vs. French (it's often fronted and diphthongized in many English speaker groups). Maybe the phonetic dictionaries used in this study capture this using a close phonetic transcription, but it's hard to tell; I suspect they don't, and in that case, the diversity measures would be an underestimate of the actual number of unique phonemes that a listener needs to maintain.

      Discussion of potential genetic differences underlying the findings is interesting. One additional data point here is a study finding a relationship between the number of repeats of the READ1 (a factor of the DCDC2 gene) in populations of speakers, and the phoneme inventory of language(s) predominant in that population (DeMille, M. M., Tang, K., Mehta, C. M., Geissler, C., Malins, J. G., Powers, N. R., ... & Gruen, J. R. (2018). Worldwide distribution of the DCDC2 READ1 regulatory element and its relationship with phoneme variation across languages. Proceedings of the National Academy of Sciences, 115(19), 4951-4956.) Admittedly, that paper makes no claim about the cortical expression of that regulatory factor under study, and so more work needs to be done on whether this has any bearing at all on the auditory cortex. But it does represent one alternative account that does not have to do with plasticity/experience.

      The replication sample is useful and a great idea. It does however feature roughly half the number of participants meaning statistical power is weaker. Using information from the first sample, the authors might wish to do a post-hoc power analysis that shows the minimum sample size needed to replicate their effect; given small effects in some cases, we might not be surprised that the replication was only partial. I don't think this is a deal breaker as much as it's a way to better understand whether the failure to replicate is an issue of power versus fragile effects.

    1. Are links still better than search in the age of semantic search? .t3_175a6tr._2FCtq-QzlfuN-SwVMUZMM3 { --postTitle-VisitedLinkColor: #9b9b9b; --postTitleLink-VisitedLinkColor: #9b9b9b; --postBodyLink-VisitedLinkColor: #989898; } questionHi, I am a beginner Zettelkasten practitioner and also a software engineer, and I just read "Why You Should Set Links Manually and Not Rely on Search Alone" https://zettelkasten.de/posts/search-alone-is-not-enough/.Search capabilities have improved drastically since 2015 though. We can use text embeddings to find the most relevant other Zettels for any particular Zettel (see https://www.deepset.ai/blog/the-beginners-guide-to-text-embeddings)For example, even if you don't use the same keywords in your writing today as you did a year ago, you'll still find the relevant notes with semantic search, because semantic search handles synonyms with a breeze.Does this mean that with modern search tools, we can spend less time building "infrastructure" links, and rely more on (improved) search?Or am I wrong in my analysis here, does the advance in technology not matter?

      reply to u/dotinvoke at https://www.reddit.com/r/Zettelkasten/comments/175a6tr/are_links_still_better_than_search_in_the_age_of/

      The value in the process is making a ratchet of ideas which is highly customized to building your own lines of thought or "associative trails" if you prefer Vannevar Bush's framing.

      If your idea worked, then one could "simply" rely on Google's database and a variety of associated tools to act as your zettelkasten—Bob's your uncle and you're done! In practice, you'll find that this doesn't work well. You can experiment, but I think you'll find that your own limited choices of links will work far better than the infinite number of adjacent possible links that a digital system may create on your behalf. If you're already fighting information overload, you don't want to add link overload to your list of problems.

      Put in a different light, it can be interesting to randomly flip a coin and go left on heads and right on tails to see where you might end up, particularly if you're unsure. But if you actively make your own choices, you're more likely to be happier with what you see along the way and where you end up.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reviewer #1 (Evidence, reproducibility and clarity (Required)):

      The authors describe a broad-scale phylogenetic survey of chemokine-related ligand and receptors from representative vertebrates, invertebrates, and viruses. They collect ligand and receptor sequences from available genome sequences, and use phylogenetic and CLANS analysis to group these into similar gene types. They then overlay these onto a validated species phylogeny in order to evaluate relationships of orthology and paralogy to pinpoint gene duplication and loss events. They carry out these analyses for canonical chemokine ligands receptors and for other closely related protein families. They conclude that the canonical chemokine system is restricted to vertebrates but that closely related ligands and receptors can be found in invertebrate chordates. More divergent but related gene systems are found in more distant invertebrates. They define more limited expansions of some ligand-receptor systems in certain jawed vertebrate groups and specifically in mammals.

      Overall, the paper addresses a complex and important system of signaling proteins with a rigorous and comprehensive set of analyses. The finding will be of interest to a diverse group of scientists. My comments listed below mainly consist of suggestions to help clarify the presentation.

      1. Pg 2, Lns 21-24: The canonical and non-canonical chemokine subclasses are introduced in the abstract without definition. A very brief explanation would be useful.

      We've included a brief description of "non-canonical" components in the abstract (lines 21-24). These non-canonical components fall into at least one of three categories: 1) molecules with sequence similarities to canonical components, 2) those that bind to a canonical component (either ligand or receptor), 3) those involved in chemokine-like functions, such as chemoattraction. More comprehensive explanations and examples of these non-canonical components are provided in the Introduction section.

      1. Some general contexts of chemokine functions are listed, including inflammation and homeostasis. A little more detail of how these signals are used and the molecular consequences of signaling may be useful in the introduction to set the biological context of the analysis (e.g., how do the signals regulate homeostasis?).

      We have added at the beginning of the introduction (lines 39 – 46) some details of how chemokine signalling typically occurs at a mechanistic level. We also provided few examples of homeostatic functions regulated by chemokine signalling and clarified different expression strategies for inflammatory versus homeostatic chemokines.

      It may help to summarize the known chemokine and chemokine-related gene systems in some type of table at the beginning of the results. This could serve as a convenient reference to guide the reader through the more detailed results. The manuscript addresses a complex set of ligands and receptors with names that may be confusing to the non-expert.

      We agree with the reviewer on this and moved Table S1 to the main text (now Table 1). This table contains all the information on ligands, receptors, and relative citations (lines 741-744).

      Pg 5, Ln 98: Fig 1C is introduced before Fig 1B. Can the panels be switched or the descriptions be rearranged?

      We have switched the panels in Figure 1. Now, Figure 1A and 1B refer to CLANS analyses and Figure 1C and 1D refer to phylogenetic trees of ligand groups. We have corrected all the references in the main text and in Figure 1 caption. Now the panels are mentioned in the correct alphabetical order within the text.

      Cytokine and chemokine ligands are small proteins that diverge quickly in different species and are difficult to identify in divergent genomes even within vertebrates. Conclusions about the absence of these types of factors are notorious for being disproven in subsequent analyses. Some discussion of what may have been missed in the survey for homologs (or reasons to think that ligands were not missed) would be useful in the Discussion.

      We concur with the reviewer's observation, and we used three distinct strategies to address the issue:

      1. E-value Threshold Adjustment: Initially, we utilized a relatively low e-value threshold of These three strategies collectively contribute to a more robust and comprehensive approach to address the challenges associated with the bioinformatic identification of canonical and non-canonical chemokines. We briefly mentioned the technical difficulty of working with short sequences in our Introduction (lines 75-76).

      Reviewer #1 (Significance (Required)):

      This paper presents a thorough analysis of chemokines and related gene systems across a wide phylogenetic landscape. The authors have expertise in these gene families and in the techniques that they use to identify and relate family members. The chemokines are an important set of signals that are used across several biological systems. These findings will be of wide interest to immunologists, neurobiologists, developmental and evolutionary biologists.

      We thank reviewer 1 for their comments – they have been very valuable to improve our manuscript.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)):

      This paper applies phylogenetic clustering methods to a large taxonomical sampling to interrogate the relationship between canonical and non-canonical chemokine ligands and receptors. The results suggest that 1) unrelated proteins evolved "chemokine-like" ligand function multiple times independently; and 2) all the canonical and non-canonical chemokine receptors (except ACKR1) originated from a single duplication in the vertebrate stem group, which also gave rise to many GPCRs. In addition, the authors characterized the complement of canonical and non-canonical components in the common ancestor of vertebrates and identified several other ligands and receptors with potential chemokine related properties.

      Comments: 1. There are many places in the paper, too many to list, where the authors refer to chemokine receptors but call them 'chemokines'.

      We have corrected this oversight throughout the manuscript.

      In Figure 1, CX3CL is referred to as 'X3CL'

      We have corrected this. Now CX3CL is referred to correctly in Figure 1. We also found that it was incorrectly spelt in Figure 2 as well and corrected it there too.

      1. CXCL17 was originally reported to be chemokine-like based on sequence threading methods. The authors refer to a 2015 paper indicating that it has chemokine-like activity at GPR35, which had been renamed provisionally CXCR8. To my knowledge that result was not based on direct binding data but inferred from a functional response. Moreover, to my knowledge it has not been independently confirmed. Instead there is a recent paper in JI from the Pease lab showing extensive experimental results that fail to demonstrate CXCL17 activity at GPR35. This uncertainty regarding a potential mistake in the literature should be addressed and integrated in the points made about CXCL17 being an outlier.

      We thank the reviewer for pointing this out. To account for this suggestion, we have modified the text as follows:

      Lines 105-108: “The distinction between CXCL17 and all other canonical chemokines is consistent with our receptor results showing that the potential receptor for CXCL17, GPR35 (41), is also not within the canonical chemokine receptor group (see below). Although it is important to note that recent studies fail to demonstrate CXCL17 activity at GPR35 (42, 43).”

      Lines 240-241: “Another orphan GPCR, GPR35, had been proposed as a potential chemokine receptor (41); however, this was later questioned (42, 43) and GPR35 is still generally considered orphan (55–57).”

      Lines 312-315: “CXCL17 is mammal-specific and likely unrelated to canonical chemokines (similar to its controversial putative receptor, GPR35 (41-43), that is not a canonical chemokine receptor).”

      References: [41] J. L. Maravillas-Montero, et al., Cutting Edge: GPR35/CXCR8 Is the Receptor of the Mucosal Chemokine CXCL17. The Journal of Immunology 194, 29–33 (2015).

      [42] S.-J. Park, S.-J. Lee, S.-Y. Nam, D.-S. Im, GPR35 mediates lodoxamide-induced migration inhibitory response but not CXCL17-induced migration stimulatory response in THP-1 cells; is GPR35 a receptor for CXCL17? British Journal of Pharmacology 175, 154–161 (2018).

      [43] N. A. S. B. M. Amir, et al., Evidence for the Existence of a CXCL17 Receptor Distinct from GPR35. The Journal of Immunology 201, 714–724 (2018).

      [55] S. Xiao, W. Xie, L. Zhou, Mucosal chemokine CXCL17: What is known and not known. Scandinavian Journal of Immunology 93, e12965 (2021).

      [56] S. P. Giblin, J. E. Pease, What defines a chemokine? – The curious case of CXCL17. Cytokine 168, 156224 (2023).

      [57] J. Duan, et al., Insights into divalent cation regulation and G13-coupling of orphan receptor GPR35. Cell Discov 8, 1–12 (2022).

      Can the authors use alpha fold to address whether any of these non-canonical molecules actually is predicted to fold like a chemokine? More generally, based on the paper's analysis, how do the authors propose to define a chemokine? It is well-accepted that chemokines are defined by structure, not function (e.g. limited truncation of any chemokine abrogates activity, but it is still a chemokine structurally, not semantically, folds like a chemokine, aligns with other chemokines).

      In response to the recommendation from reviewer 2 to incorporate AlphaFold data, we leveraged AFDB Clusters (foldseek.com), a recently developed tool that clustered over 200 million Uniprot proteins based on their predicted AlphaFold structures (as described in this Nature paper: https://www.nature.com/articles/s41586-023-06510-w). We utilised this pre-computed dataset of clustered proteins to query with representative human proteins, both canonical and non-canonical chemokine ligands, and the results are summarised in the table below. Notably, we observed that canonical chemokines were distributed across different AlphaFold clusters, each corresponding to different ligand types (e.g., CC and CXC). Interestingly, despite this, all these clusters exhibited similar descriptions (e.g. CC or CXC), indicating that the method effectively recovers well-characterized chemokines. Conversely, when analysing non-canonical chemokine ligands, none of them were classified within the canonical chemokine clusters. This observation strongly suggests that canonical and non-canonical ligands do not share the same protein fold. Additionally, we identified intriguing correlations between these structure-based clusters and the results from our phylogenetic analyses. For instance, CXCL14 was clustered within a CC-type group, consistent with our reconciled tree positioning it within the broader CC-type clade (as shown in Figure 2A). Similarly, CXCL16 formed its own unique cluster, which aligns with our CLANS analysis, where it is the last group to connect with canonical chemokines (illustrated in Figure 1A and Figure S1). Furthermore, TAFA5 was found in a distinct cluster, mirroring our phylogenetic analyses that place it as the most basal TAFA clade (as depicted in Figure 2A and Figure S19). While these findings are intriguing, we acknowledge that additional in-depth analyses, beyond the scope of this paper, will be necessary to confirm these results.

      In response to the reviewer's inquiry regarding how to define a chemokine, it is essential to recognise that many proteins can exhibit similar 3D structures without being considered homologous. A notable example is the opsins, which are present in both bacteria and animals. Despite sharing a common 3D structure that is characterised by seven transmembrane domains (TMDs) and serves similar functions, they are not regarded as homologous, as highlighted in this study (https://doi.org/10.1186/gb-2005-6-3-213). Considering these findings, we propose that, like various other gene families, the primary criterion for assessing protein homology should be rooted in shared evolutionary ancestry and common origin, and this should take precedence over structural similarities.

      Human gene

      Uniprot Accession

      AFDB Cluster

      Accession

      Description

      Canonical CKs

      CXCL14

      O95715

      A0A3Q3M453

      C-C motif chemokine

      CCL24

      O00175

      A0A4X1T574

      C-C motif chemokine

      CX3CL1

      P78423

      A0A7J8CF84

      C-X3-C motif chemokine ligand 1

      CXCL1

      P09341

      A0A1S2ZIJ4

      C-X-C motif chemokine

      CXCL13

      O43927

      A0A1S2ZIJ4

      C-X-C motif chemokine

      CXCL8

      P10145

      A0A1S2ZIJ4

      C-X-C motif chemokine

      CCL20

      P78556

      A0A6P7X7F3

      C-X-C motif chemokine

      XCL1

      P47992

      A0A6P7X7F3

      C-X-C motif chemokine

      CXCL16

      Q9H2A7

      A0A6P8SIS6

      C-X-C motif chemokine 16

      CCL27

      Q9Y4X3

      A0A1L8GBB9

      SCY domain-containing protein

      CCL1

      P22362

      A0A3B4A358

      SCY domain-containing protein

      CCL5

      P13501

      A0A3B4A358

      SCY domain-containing protein

      CCL28

      Q9NRJ3

      A0A3Q0SB19

      SCY domain-containing protein

      CXCL12

      P48061

      A0A401SMI2

      SCY domain-containing protein

      CXCL17

      CXCL17

      Q6UXB2

      No cluster found

      No cluster found

      TAFA

      TAFA1

      Q7Z5A9

      Q96LR4

      Chemokine-like protein TAFA-4

      TAFA2

      Q8N3H0

      Q96LR4

      Chemokine-like protein TAFA-4

      TAFA3

      Q7Z5A8

      Q96LR4

      Chemokine-like protein TAFA-4

      TAFA4

      Q96LR4

      Q96LR4

      Chemokine-like protein TAFA-4

      TAFA5

      Q7Z5A7

      A0A7M4EYY1

      TAFA chemokine like family member 5

      CYTL

      CYTL1

      Q9NRR1

      A0A673GVE4

      Cytokine-like protein 1

      CKLFSF

      CMTM5

      Q96DZ9

      A0A4W2H069

      CKLF like MARVEL transmembrane domain containing 5

      CMTM8

      Q8IZV2

      U3IR50

      CKLF like MARVEL transmembrane domain containing 7

      CMTM7

      Q96FZ5

      A0A6G1PQK5

      CKLF-like MARVEL transmembrane domain-containing protein 7

      CMTM6

      Q9NX76

      A0A814ULI9

      Hypothetical protein

      CKLF

      Q9UBR5

      A0A3M0K8M7

      MARVEL domain-containing protein

      CMTM1

      Q8IZ96

      A0A3M0K8M7

      MARVEL domain-containing protein

      MAL

      P21145

      A0A402F5Z5

      MARVEL domain-containing protein

      CMTM2

      Q8TAZ6

      A0A6G1S7Y0

      MARVEL domain-containing protein

      PLP2

      Q04941

      A0A667IJ27

      Proteolipid protein 2

      CMTM3

      Q96MX0

      A0A3B1ILJ1

      Zgc:136605

      CMTM4

      Q8IZR5

      A0A3B1ILJ1

      Zgc:136605

      PLLP

      Q9Y342

      A0A3B1ILJ1

      Zgc:136605

      Chemokine genes are found on many human chromosomes with large clusters on chromosome 2 and 17. Can the authors address the syntenic relationships phylogenetically?

      There are cases where synteny data have been used to infer the relationship between species (e.g. https://doi.org/10.1038/s41586-023-05936-6); however, to our knowledge, they cannot be used to infer the pattern of gene duplications and losses, as we have done here with gene tree to species tree reconciliations. However, the two approaches are extremely powerful combined and compared as they provide independent evidence. For example, with our phylogenetic analysis of chemokine ligands, we found that CXCL1-10 plus CXCL13 form a monophyletic clade (Figure 2A); this is consistent with their location on the human chromosome 4 (Zlotnik and Yoshie 2012). Similarly, most of the CC-type chemokines, that we find monophyletic in our trees, are located in a locus in human chromosome 17. Likewise, chemokine receptor phylogenetic relationships are largely consistent with macro and micro syntenic patterns. Most of the chemokine receptors are on human chromosome 3 (Zlotnik and Yoshie 2012) and they all belong to a large monophyletic clade in our tree (Figure 4A). Smaller clusters also maintain correspondence, such as the mini cluster of CXCR1 and CXCR2 on human chromosome 2 corresponding to a monophyletic clade in our phylogenetic analysis (Figure 4A).

      We have incorporated the above considerations in our manuscript at the lines:

      • Lines 140-148 (ligands)

      • Lines 256-272 (receptors)

      • Lines 375 – 483 (discussion)

      The authors indicate that 'CXCL8 is present in all jawed vertebrates except in the cartilaginous fishes lineage'. However, they should point out that CXCL8 is not represented in mice. The notion that the repertoire of chemokine and chemokine receptor genes can be different in even closely related species as well as in individuals of the same species is well-documented but not mentioned here.


      We thank the reviewer for these suggestions, and we have modified the text in lines 137-138.

      The analysis suggests that chemokine gene repertoires start small and grow non-linearly to 45 in mammals. However DeVries et al (JI 2005) published that zebrafish have the most chemokines, 63, and chemokine receptors, 24. Do the authors disagree? This should be addressed.

      The significant increase in the number of ligands and receptors in zebrafish, compared to their last common mammalian ancestor, can be attributed to an additional round of whole-genome duplication (WGD) (https://doi.org/10.1016/S0955-0674(99)00039-3).

      Concerning ligands, the count in zebrafish varies from 63 in DeVries et al. 2005 to 111 in Nomiyama et al. 2008, and to 35 in our study. This variation can be attributed to several factors:

      1. Genome Versions: The disparities may arise from the use of different versions of the zebrafish genome. We utilised an improved version known for its higher contiguity and reduced fragmentation (https://www.nature.com/articles/nature12111). It is possible that the additional ligands identified by DeVries, Nomiyama, and others were partial sequences.
      2. Methodology: Methodological differences are at play. DeVries et al. employed tblastN, while we opted for BLASTP. Nomiyama et al. do not specify the type of BLAST performed.
      3. Stringency: We collected our sequences based on a BLASTP search using as query sequences only manually curated sequences from UniProt. This additional precaution allowed us to identify sequences with high-confidence chemokine ligand characteristics.
      4. Sequence Characteristics: Ligands typically have shorter sequences and exhibit less sequence conservation compared to receptors. Zebrafish represents a case in which working with short sequences may lead to missed homologs.
      5. Species-Specific Nature: Our approach successfully recovered the complete set of ligands in other species, such as humans and mice. Zebrafish appears to be an exception rather than the norm. When it comes to receptors, which typically have longer sequences, making it easy to identify distant homologs, our results closely mirror those of DeVries in 2005. In our study, we identified 28 canonical receptors, compared to their count of 24. However, it is worth highlighting that within our dataset, four of these receptors appear as species-specific duplications, potentially indicating that they are actually isoforms or related variants.

      Nonetheless, it is essential to emphasise that our work does not aim to precisely reconstruct the entire complement of ligands and receptors in zebrafish or other species. Achieving this would require further validation, including the expression analysis of potential transcripts.

      Did the authors find any species in which a chemokine/chemokine receptor pair are not found together? That is, if the system is irreducibly complex, requiring both a ligand and receptor, the probability of both genes arising simultaneously is essentially zero. So how do the authors theorize that such a system actually arose, and is there any evidence in their data set for convergence of separately evolved ligand and receptor?

      Our data strongly support the hypothesis that the canonical chemokine system originated within the stem group of vertebrates, likely as a consequence of two rounds of genome duplication. This likely accounts for the simultaneous emergence of both ligands and receptors. While the receptors (both canonical and non) can be traced back to a single-gene duplication event (with the exception of ACKR1), the evolution of ligand families capable of interacting with chemokine receptors occurred independently, although further experiments are required to validate this in vivo in a broader set of organisms. In our study, we successfully identified the complete set of receptors and ligands in well-established model systems like humans and mice. However, when it comes to interactions between ligands and receptors outside these model organisms, the picture becomes less clear. Similarly, the exact pairings of non-canonical components are also not fully clarified (see lines 404-406). As a result, speculating about evolutionary conservation in these contexts requires caution and further investigation. It's worth noting that chemokines and their corresponding chemokine receptors do not necessarily evolve in tandem. Since they are encoded by different genes, they evolved from separate duplication events occurring at different points in evolutionary history. In certain instances, due to the system's flexibility, chemokines binding orthologous receptors may not be orthologous themselves but may have independently acquired the ability to activate the same receptor in various species.

      Line 180, 181 and elsewhere: GPCR1 and GPCR33 should be GPR1 and GPR33

      We have corrected this throughout the manuscript.

      Line 185: ACKR1 exceptionalism is noted, but there is no discussion of the remarkable structure-function paradox that the most distantly related chemokine receptor is also the most highly promiscuous receptor, binding many but not all CC and CXC chemokines with high affinity.

      We added in the discussion section this consideration regarding the wide binding of ACKR1 (Lines 341-343) and its ability to bind both CC and CXC chemokines (DOI: 10.1126/science.7689250 and 10.3389/fimmu.2015.00279), highlighting the intriguing contrast with the fact that it is the most distantly related receptor.

      Line 196: the viral receptors cluster with the vertebrate receptors, suggesting that the viruses captured the receptor gene from the host. Authors might mention this obvious point regarding origins, and discuss how it relates to the monophyly and paraphyly that emerges from the phylogenetic analysis.

      We added a comment to the discussion section (Lines 348-352) regarding the potential origins of the viral chemokine receptors.

      Any discussion of chemokine-like convergent evolution presupposes that the activity is real and actually occurs in vivo. The authors should make clear to what extent the existing literature supports this. As mentioned above, CXCL17 interaction with GPR35 has been challenged in vitro and has never been demonstrated to occur in vivo. To what extent is the same limitation a problem in considering co-evolution of the other non-canonical chemokines? I agree that classification based solely on function is inappropriate, but so is phylogenetic analysis without direct knowledge of in vivo function. It is no feasible to address this in a phylogenetic analysis, but there ought to be at least one species in which the non-canonicals have been rigorously shown to act at specific receptors in vivo before grouping them with the canonicals in a co-evolutionary sense.


      We agree with the referee that evidence of real chemokine-like activity is important to consider the activity in vivo.

      In our work, the molecules examined were chosen based on previous evidence of chemokine-like sequence similarity, ability to bind canonical components and/or chemokine-like function. For example, CKLF (also called CKLF1) has been shown, through calcium mobilisation and chemotaxis assays using the human cell line HEK293, to bind CCR4 and to induce cell migration via CCR4 respectively (https://doi.org/10.1016/j.lfs.2005.05.070). Numerous papers are studying the in vitro and in vivo effects of CKLF in murein and human models (https://doi.org/10.1016/j.cyto.2017.12.002), therefore, we found it compelling to investigate its evolutionary relationship with canonical chemokines. Similarly, CYTL1, that had been predicted to possess an IL8-like fold (https://doi.org/10.1002/prot.22963), has been found to bind CCR2 (https://doi.org/10.4049/jimmunol.1501908) and in vitro and in vivo studies showed chemotactic activity for neutrophils (https://doi.org/10.1007/s10753-019-01116-9). Ongoing research into this molecule are focusing on a wide array of immune functions (https://doi.org/10.1007/s00018-019-03137-x).

      We mentioned these considerations in our introduction to explain why we were interested in investigating these molecules (lines 50-57). We have also added a line in the Discussion (lines 323-324) where we reinforce the idea that in vitro and in vivo experiments for all chemokine-like molecules are required to validate computation predictions.

      The discussion of homeostatic vs inflammatory chemokine/receptors in the last section of the Discussion would be enhanced by pointing out that the chemokine specificities are numerically totally different for these two groupings, homeostatics tending to have monogamous ligand-receptor relationships and inflammatories being highly promiscuous.

      To account for the reviewer’s comment, we have added this consideration in a paragraph of the discussion (see Line 389-394).

      Reviewer #2 (Significance (Required)):



      Much of the paper's results are confirmatory of previous work based on less extensive sequence analysis. One could say more generally that unrelated chemical forms, not just unrelated proteins, have chemokine-like ligand function. For example leukotriene B4 is a powerful leukocyte chemoattractant for neutrophils working through a GPCR. That proteins might also independently evolve common functions does not add insight beyond what is already appreciated. The notion that chemokine receptors have a common ancestor is also generally accepted and that ACKR1 is an outlier is already appreciated. The present work adds phylogenetic and statistical precision to these points.

      Our discoveries clarify various aspects of the chemokine system's evolution, and we are confident that the "phylogenetic and statistical precision" of our findings will provide a solid cornerstone for future research aimed at unravelling the function and evolution of the system. Specifically, our work clarified:

      1. The presence only in Vertebrates: We have confirmed, through a comprehensive taxonomic sampling (we use many more species than previous works), that the chemokine system is exclusive to vertebrates. However, intriguingly, we identified a TAFA chemokine-like family in urochordates.
      2. Relationships between Ligands: We conducted a thorough examination of the relationships between canonical and non-canonical ligands and suggested that several unrelated molecules might have evolved independently their ability to interact with the chemokine receptors. We appreciate the comment of the reviewer regarding the fact that unrelated chemical forms such as leukotriene B4 may have chemokine-like functions. However, in our work all the non-canonical components examined are proteins and as such could have an evolutionary relationship with chemokines. Furthermore, we chose to consider only proteins that showed multiple lines of evidence implicating them in the chemokine system and that are currently the topic of interest in the field (see replies to reviewer 1’s comment #5 and to reviewer 2’s comment #12). Seeing the general interest in the topic, and especially seeing as this had never been clarified before, in this work, we set ourselves the goal to investigate the evolutionary relationship amongst these non-canonical ligands and canonical chemokines.
      3. Duplication Events: We pinpoint the specific gene duplication events responsible for the emergence of chemokine receptors.
      4. Atypical Receptor Paraphyly: Our work highlights the paraphyletic nature of atypical receptors, in contrast to previous research (see https://doi.org/10.1155/2018/9065181).
      5. Viral Receptor Phylogenetics: To our knowledge, this is the first work to investigate the phylogenetic affinities of viral receptors.
      6. GPCR182 and Atypical Receptor Affinities: We clarify the affinity of GPCR182 with atypical receptor 3, offering different insights compared to prior studies (see figure S3C in https://doi.org/10.1038/s41467-020-16664-0).
      7. Additionally, our study represents the first analysis of the chemokine system in the basal vertebrate hagfish and provides insights into the ancestral form of the chemokine system.
      8. Ultimately, our research identifies numerous molecules and receptors with potential chemokine functions. In conclusion, we contribute to resolving uncertainties surrounding the system's origin, including the complex duplication events that have shaped receptor evolution. As evident from the extensive comments provided by the reviewer, our work addresses various controversies in the field (e.g. the inclusion of CXCL17 as a chemokine). Nonetheless, like any new set of findings, our work amalgamates confirmatory results (as highlighted in point 1) with innovative discoveries (as outlined in points 2-8). However, the latter category significantly outweighs the former, underscoring the richness of novel insights.

      Finally, we would like to thank reviewer 2 for their comments, as these have contributed to greatly improve our manuscript.

    1. Now, there are many reasons one might be suspicious about utilitarianism as a cheat code for acting morally, but let’s assume for a moment that utilitarianism is the best way to go. When you undertake your utility calculus, you are, in essence, gathering and responding to data about the projected outcomes of a situation. This means that how you gather your data will affect what data you come up with. If you have really comprehensive data about potential outcomes, then your utility calculus will be more complicated, but will also be more realistic. On the other hand, if you have only partial data, the results of your utility calculus may become skewed. If you think about the potential impact of a set of actions on all the people you know and like, but fail to consider the impact on people you do not happen to know, then you might think those actions would lead to a huge gain in utility, or happiness.

      This passage provides an interesting perspective on utilitarianism and the role of data in the context of making moral decisions. It emphasizes the importance of having all the necessary information when using utilitarianism. Moreover, the text also raises a point about considering the interests of people we may not know personally. In our society, the consequences of our actions extend beyond our immediate circles and failing to account for these broader implications can lead to skewed moral judgments. It serves as a reminder that the moral choices we make based on utilitarianism are only as good as the data we have access to.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1 (Public Review):

      Sun and co-authors have determined the crystal structures of EHEP with/without phlorotannin analog, TNA, and akuBGL. Using the akuBGL apo structure, they also constructed model structures of akuBGL with phlorotannins (inhibitor) and laminarins (substrate) by docking calculation. They clearly showed the effects of TNA on akuBGL activity with/without EHEP and resolubilization of the EHEP-phlorotannin (eckol) precipitate under alkaline conditions (pH >8). Based on this knowledge, they propose the molecular mechanism of the akuBGL- phlorotannin/laminarin-EHEP system at the atomic level. Their proposed mechanism is useful for further understanding of the defensive-offensive association between algae and herbivores. However, there are several concerns, especially about structural information, that authors should address.

      Thank you for reviewing our manuscript. We addressed all comments below.

      1) TNA binding to EHEP

      The electron densities could not show the exact conformations of the five gallic acids of TNA, as the authors mentioned in the manuscript. On the other hand, the authors describe and discuss the detailed interaction between EHEP and TNA based on structural information. The above seems contradictory. In addition, the orientation of TNA, especially the core part, in Fig. 4 and PDB (8IN6) coordinates seem inconsistent. The authors should redraw Fig. 4 and revise the description accordingly to be slightly more qualitative.

      We apologize for the mistake with the PDB file. We forgot to re-upload the final coordinate file of 8IN6, which had been modified according to the requirement of the PDB instructions. We have now re-uploaded the correct PDB file. We carefully checked Fig. 4 (Fig.3 in the revised version), which used the final coordinate file of 8IN6.

      2) Two domains of akuBGL

      The authors concluded that only the GH1D2 domain affects its catalytic activity from a detailed structural comparison and the activity of recombinant GH1D1. That conclusion is probably reasonable. However, the recombinant GH1D2 (or GH1D1+GH1D2) and inactive mutants are essential to reliably substantiate conclusions. The authors failed to overexpress recombinant GH1D2 using the E. coli expression system. Have the authors tried GH1D1+GH1D2 expression and/or other expression systems?

      By referencing other BGLs (six samples were expressed by using E. coli, and one was expressed by using Pichia), we only tried the overexpression of akuBGL, GH1D1, GH1D2, and GH1D1+GH1D2 in E. coli expression system using several different vectors. As the reviewer mentioned that inactive mutants are essential to substantiate our conclusion reliably, it will be tried further to use yeast or cell expression systems to confirm our conclusion. We added these limitations as “Future assay of GH1D2 and inactive mutants is the complement to validate the molecular mechanism of akuBGL” in the discussion (Line 343-345)

      3) Inhibitor binding of akuBGL

      The authors constructed the docking structure of GH1D2 with TNA, phloroglucinol, and eckol because they could not determine complex structures by crystallography. The molecular weight of akuBGL would also allow structure determination by cryo-EM, but have the authors tried it? In addition, the authors describe and discuss the detailed interaction between GH1D2 and TNA/phloroglucinol/eckol based on docking structures. The authors should describe the accuracy of the docking structures in more detail, or in more qualitative terms if difficult.

      Yes, it is possible to try cryo-EM for obtaining the structure of akuBGL complexed with the ligand. However, we didn’t try because 110 kDa akuBGL consists of two 55 kDa GH1Ds linked by along loop, and we worried that ligand may not be visualized using cryo-EM.

      Following the comment, we added the description of the accuracy of the docking structures as “Those docking scores corroborated well with the inhibition activity toward akuBGL, that TNA had a more robust inhibition activity than phloroglucinol, indicating that the docking results are reasonable.” (Line 322-324)

      Reviewer #2 (Public Review):

      In this study the authors try to understand the interaction of a 110 kDa ß-glucosidase from the mollusk Aplysia kurodai, named akuBGL, with its substrate, laminarin, the main storage polysaccharide in brown algae. On the other hand, brown algae produce phlorotannin, a secondary metabolite that inhibits akuBGL. The authors study the interaction of phlorotannin with the protein EHEP, which protects akuBGL from phlorotannin by sequestering it in an insoluble complex.

      The strongest aspect of this study is the outstanding crystallographic structures they obtained, including akuBGL (TNA soaked crystal) structure at 2.7 Å resolution, EHEP structure at 1.15 Å resolution, EHEP-TNA complex at 1.9 Å resolution, and phloroglucinol soaked EHEP structure at 1.4 Å resolution. EHEP structure is a new protein fold, constituting the major contribution of the study.

      We thank you for reviewing our manuscript.

      The drawback on EHEP structure is that protein purification, crystallization, phasing and initial model building were published somewhere else by the authors, so this structure is incremental research and not new.

      We have published the results of protein purification, crystallization, phasing, and initial model building for determining structure but have yet to give the structure since further structural refinement is indispensable. Such published data in [Acta F] is a service for obtaining the structure.

      We believe that the structure of the EHEP holds great importance, and it is the first time to publish.

      Most of the conclusions are derived from the analysis of the crystallographic structures. Some of them are supported by other experimental data, but remain incomplete. The impossibility to obtain recombinant samples, implying that no mutants can be tested, makes it difficult to confirm some of the claims, especially about the substrate binding and the function of the two GH1Ds from akuBGL.

      As mentioned by the reviewer, mutant analysis would be the best way to substantiate our conclusions. However, it is challenging to obtain recombinant samples, although we tried to overexpress them (akuBGL, GH1D1, GH1D2, and GH1D1+GH1D2). So, we did the structural comparison, and docking simulation to propose the molecular mechanism. We added these limitations as “Further assay of GH1D2 and inactive mutants is the complement to validate the molecular mechanism of akuBGL” in the discussion part (Line 343-345).

      The authors hypothesize from their structure that the interaction of EHEP with phlorotannins might be pH dependent. Then they succeed to confirm their hypothesis, showing they can recover EHEP from precipitates at alkaline pH, and that the recovered EHEP can be reutilized.

      A weakness in the model is raised by the fact that the stoichiometry of the complex EHEP:TNA is proposed to be 1:1, but in Figure 1 they show that 4 µM of EHEP protects akuBGL from 40 µM TNA, meaning EHEP sequesters more TNA than expected, this should be addressed in the manuscript.

      The assay experiment in figure1 does not directly provide the stoichiometric ratio of EHEP: TNA because the activity assay system consists of substrate of akuBGL, akuBGL, TNA, and EHEP, which involves multiple equilibration processes: akuBGL⇋ substrate, akuBGL⇋TNA, and EHEP ⇋TNA. To avoid misunderstanding, we added the descriptions of ″As this activity assay system involves multiple equilibration processes: akuBGL⇋substrate, akuBGL⇋TNA, and EHEP ⇋TNA.″(Line 120-121).

      The authors study the interaction of akuBGL with different ligands using docking. This technique is good for understanding the possible interaction between the two molecules but should not be used as evidence of binding affinity. This implies that the claims about the different binding affinities between laminarin and the inhibitors should be taken out of the preprint.

      Following the suggestion, we deleted the descriptions about the difference in binding affinity with docking scores at the last paragraph of [Inhibitor binding of akuBGL].

      In the discussion section there is a mistake in the text that contradicts the results. It is written "EHEP-TNA could not dissolve in the buffer of pH > 8.0" but the result obtained is the opposite, the precipitate dissolved at alkaline pH.

      We apologize for this mistake and corrected it to " EHEP–TNA could dissolve in the buffer of pH > 8.0." (Line 394).

      Solving a new protein fold, as the authors report for EHEP, is relevant to the community because it contributes to the understanding of protein folding. The study is also relevant dew to the potential biotechnological application of the system in biofuel production. The understanding on how an enzyme as akuBGL can discriminate between substrates is important for the manipulation of such enzyme in terms of improving its activity or changing its specificity. The authors also provide with preliminary data that can be used by others to produce the proteins described or to design a strategy to recover EHEP from precipitates with phlorotannin at industrial scales.

      In general methods are not carefully described, the section should be extended to improve the manuscript.

      Following the comment, we added the method descriptions

      1. Recombinant GH1D1 domain expression and purification in [EHEP and akuBGL preparation].

      2. Sections of [recomGH1D1 activity assay], and [N-terminal sequencing of akuBGL]

      3. More details of resolubiliztion of EHEP and activity in [Resolubilization of the EHEP–eckol precipitate].

      Reviewer #3 (Public Review):

      The manuscript by Sun et al. reveals several crystal structures that help underpin the offensivedefensive relationship between the sea slug Aplysia kurodai and algae. These centre on TNA (a algal glycosyl hydrolase inhibitor), EHEP (a slug protein that protects against TNA and like compounds) and BGL (a glycosyl hydrolase that helps digest algae). The hypotheses generated from the crystal structures herein are supported by biochemical assays.

      The crystal structures of apo and TNA-bound EHEP reveals the binding (and thus protection) mechanism. The authors then demonstrate that the precipitated EHEP-TNA complex can be resolubilised at an alkaline pH, potentially highlighting a mechanism for EHEP recycling in the A. kurodai midgut. The authors also present the crystal structures of akuBGL, a beta-glucosidase utilised by Aplysia kurodai to digest laminarin in algae into glucose. The structure revealed that akuBGL is composed of two GH1 domains, with only one GH1 domain having the necessary residue arrangement for catalytic activity, which was confirmed via hydrolytic activity assays. Docking was used to assess binding of the substrate laminaritetraose and the inhibitors TNA, eckol and phloroglucinol to akuBGL. The docking studies revealed that the inhibitors bound akuBGL at the glycone-binding suggesting a competitive inhibition mechanism. Overall, most of the claims made in this work are supported by the data presented.

      We thank you very much for reviewing our manuscript.

      Reviewer #1 (Recommendations For The Authors):

      • Fig. 3 should be moved to the Supplements because acetylation modification at the N-terminus is not essential for the function of EHEP.

      Following the recommendation, we moved Fig.3 to Supplements (Fig. S2).

      • EHEP2 is processed at 1.4 Å resolution, however, the statistics at highest resolution shell indicate you can process at higher resolution. Why 1.4 Å resolution?

      We tried to process this dataset at the higher resolution at 1.35 Å, and the completeness and I/sigma of the highest resolution shell reduced to 88.9% and 2.16, respectively. The parameter of I/sigma is OK, but the completeness reduced seriously. So, we set a cutoff of 1.4 Å.

      • Fig. S1A should be revised to include the gallic acid numbers (1, 2, 3, 4, 6) and the 3.0 σ map. >

      As presented in Fig. S1A, the omitted map (fo–fc map) of the ligand TNA, countered at 2.0 σ, showed that gallic acid 2 has poor density, and gallic acid 4 has weak density. Moreover, the TNA is relatively big to EHEP (7.5 %), and the omitted map countered 3.0 σ could not clearly show gallic acids. So, we keep the map at 2.0 σ in Fig. S3A.

      • The authors should provide more information on "co-cage-1 nucleant".

      Our lab is currently publishing a paper that provides detailed information on the co-cage-1 nucleant, including components, synthesis, nucleation mechanism, and application. Once the paper is published, we will cite it in this manuscript.

      Reviewer #2 (Recommendations For The Authors):

      • Is the word "offence" the appropriate word for referring to the activity of EHEP? Is this word used in the literature for this system? I find it confusing but might be because I am not in the specific topic.

      In the field of prey–predator, the defense–offensive is commonly used.<br /> According to Charles D. Amsler's book ″Algal Chemical ecology″, Herbivore offensive is the traits that allow herbivores to increase feeding rates on algae. Therefore, in our opinion, the offensive is appropriate.

      Taking into consideration that I am not an English language expert I find the writing of the manuscript could be improved in general. Here are some lines as examples of where the grammar could be better:

      Line 193: "decrement of the loop part"

      Following the comment, we corrected it to "decrease of the loop part" (Line 197).

      Line 199: there is a typographical error.

      We apologize for our mistake and corrected it to “EHEP” (Line 202).

      Line 205-206: "only hydrophobically interacted with"

      Following the comment, we modified it to "only interacted hydrophobically with EHEP" (Line 209)

      Line 224: "phlorotannin–precipitate activity"

      Following the comment, we modified it to “phlorotannin-precipitate activity” (Line 227).

      Line 232: "without the N-terminal 25 residues"

      Following the comment, we modified it to "lacked the N-terminal 25 residues" (Line 236).

      Line 353: "bound" should be "bind"

      We apologize for our mistake and modified it (Line 356).

      Line 359: "predator mammals"

      We apologize for our mistake and modified it to "predatory mammals" (Line 363).

      Line 363: "at an alkaline pH of insect midgut"

      Following the comment, we modified it to "at the alkaline pH of the insect midgut" (Line 367).

      Line 370: "nonstructural proteins" means "unstructured proteins"?

      Yes, unfolding proteins, we modified to "unfolding proteins with randomly coils" (Line 374).

      Line 374: "similar strategy with mammals"

      Following the comment, we modified it to "similar strategy to mammals" (Line 379).

      Line 403: "to forming"

      We apologize for our mistake and modified it to "to form" (Line 404).

      Line 404: "considered no binding"

      We apologize for our mistake and modified it to "considered not binding" (Line 405).

      Line 406: "activity pocket" means the active site?

      Yes, we modified it to "active site" (Line 407).

      Line 424: "step purification"

      Following the comment, we corrected it to "one step for purification" (Line 425).

      Line 431

      Following the comment, we corrected it to “To verify whether the chemical modifications which was indicated by previous study affects” (Line 432-433).

      Line 812: there is typographical error

      We apologize for our mistakes, and corrected it to Tris-HCl” for all “Tris–HCl (Line 878~).

      Line 223: eckol is not mentioned in the text and appears for the first time in the figure caption.

      Following the comment, we added “eckol” in the first section of the [Result] (Line 117).

      The paragraph between lines 271 and 280 is disconnected from the previous one and it is not about results, it should be at the discussion section.

      Following the comment, we moved them to the discussion part (Line 335-343).

      Line 324: "the three inhibitors inhibited": this claim should be corrected to "the three inhibitors interacted", since the word inhibited would imply the authors measured activity experimentally.

      We modified it as the comment. (Line 325).

      Line 392: "could not dissolve" is contradicting the result.

      We apologize for our mistake and corrected it to "could dissolve" (Line 394).

      They describe acetylation but they try overexpressing in E. coli, could it be that they needed to express the construct in a system where they would get the acetylation? At least this should be discussed in the text.

      Because our sample of EHEP with acetylation was purified from the natural source of the digestive fluid of A.kurodai, we only need to express EHEP without acetylation. Following the comment, we modified the descriptions to clarify it in the section (Lines 170-173 and 177-179).

      “Consistent with the molecular weight results obtained using MALDI–TOF MS, the apo structure2 (1.4 Å resolution) clearly showed that the cleaved N-terminus of Ala21 underwent acetylation, demonstrating that EHEP is acetylated in A. kurodai digestive fluid.”

      "To explore whether acetylation affects the protective effects of EHEP on akuBGL, we used the E. coli expression system to obtain the unmodified recomEHEP (A21–K229)."

      From the text it is not clear in which biological context the brown algae meet the attack by the hydrolase, the information is spread all over the manuscript, it should be clearly described at the introduction.

      When the brown algae are consumed as food by sea hare A. kurodai, they meet the attack by the hydrolase akuBGL. Following the comment, we clear the descriptions in the introduction part as below (Line 42-45).

      ″In brown algae Eisenia bicyclis, laminarin is a major storage carbohydrate, constituting 20%–30% of algae dry weight. The sea hare Aplysia kurodai, a marine gastropod, preferentially feeds on the E. bicyclis with its 110 and 210 kDa β-glucosidases (akuBGLs), hydrolyzing the laminarin and releasing large amounts of glucose.″

      Affinity ranking based on docking is not reliable, the differences in free energy are in the same order of magnitude. I would recommend erasing this claim since it is not fundamental to the study. Another option would be to determine affinities experimentally.

      We agree with the comment and removed the text about affinity ranking with docking scores.

      Figure 1: relative activity is not defined. HPLC data should be shown as supplementary material.

      Following the comment, we added the definition of relative activity and the HPLC data as Fig. S1 in the revised version.

      Figure 4: Sephacryl resin is mentioned here but not described in the methods.

      Following the comment, we added the description in the methods (Line 515).

      Protein N-terminal sequencing analysis should be described in the methods.

      Following the comment, we added the sequencing analysis in the methods (Line 476-483).

      Figure S1 C: it should be specified how the surface electrostatic potential at different pH was calculated.

      Following the comment, we added the descriptions of how the surface electrostatic potential at different pH was calculated in the figure legend of Fig. S2 of the revised version (Line 876-877).

      Since the authors are capable of producing good amounts of akuBGL and have already conducted glycosidase activity assays using ONPG, it would not be difficult for them to run some kinetics experiments for the enzyme in the presence of the different inhibitors to confirm their hypothesis derived from the docking calculations.

      As mentioned by the reviewer, kinetics experiments are the best way to confirm our hypothesis derived from docking calculations. However, the yield of akuBGL purification from the digestive fluid of sea hare A.kurodai is quite difficult. We could not obtain a sufficient sample of akuBGL to conduct the kinetic experiments. So, we stopped at docking simulation in this study. We added such limitations of ″Future kinetic experiments are required to validate quantitatively the competitive inhibition of phlorotannin against akuBGL″ (Line 359-360).

      Some citations are missing in the discussion section, for example in lines 362, 364 and 396.

      Following the comment, we added the citations.

      Reviewer #3 (Recommendations For The Authors):

      Please see comments/suggestions below for revisions.

      Line 176-178 - Text explains that recombEHEP precipitated after incubation with TNA to a comparable level to natural EHEP. However, figure 3B shows no comparison between recombinant and natural EHEP.

      As the reviewer suggested, we repeated the binding assay of recomEHEP to confirm the precipitation with TNA and added a precipitation result of natural EHEP (Fig. S2B right) for comparing.

      Line 223 - The work presented in Figure S1E goes partway towards demonstrating the activity of resolubilised EHEP. This claim would be strengthened if resolubilised EHEP was used in the akuBGL Galactoside hydrolytic activity assay and is then seen to rescue akuBGL activity in the presence of TNA.

      Yes, our claim would be strengthened by adding resolubilized EHEP to akuBGL assay in the presence of TNA. Since we have obtained and presented the relationship between the precipitating of EHEP with TNA and the rescuing akuBGL activity from TNA, we only used the precipitation to demonstrate the activity of resolubilized EHEP.

      Line 380-384 - Here it is discussed how TNA simultaneously binds to three EHEP molecules thus crosslinking them. It is then proposed that this could be the mechanism of precipitation. However, it is noted that TNA is soaked into crystals, therefore it is likely that this lattice exists whether TNA is present or not (this absolutely needs to be mentioned in the text). It would be possible to test this mechanism through mutagenesis. If the sites where TNA packs in between chains of EHEP were mutated to prevent crosslinking, it could then be determined whether crosslink-null EHEP can still precipitate TNA.

      As the review mentioned, we do not have enough experiments to propose that the TNA-crosslink may cause the EHEP-TNA precipitation. So, we deleted the discussion of the TNA crosslink and the corresponding figure.

      All docked models need to be deposited (perhaps modelarchive.org) and this resource referred to in the text.

      The structures in modelarchive.org site are either homology models or de novo. We think the docked model is out of this site. So, we did not deposit them.

      The x-ray data table contains data previously published in the referenced Acta cryst publication. What is eLife policy on this "double use" of data?

      We apologize for our mistake, and deleted the SAD data in Table 1.

      Minor points

      Line 26 - use "apo akuBGL" so as not to infer a tannic-acid bound form of this also >

      Following the comment, we modified it to “apo akuBGL” (Line 26).

      Line 48 - The sentence currently reads as A. kurodai is being digested.

      Following the comment, we modified it to “by A. kurodai” (Line 48).

      Line 49-50 & Line 65-66 - Both these lines make the same point about the impact of phlorotannin inhibition on the use of brown algae as feedstocks for biofuel, please remove one.

      Following the comment, we deleted the line 49-50.

      Line 115 - This needs attention as its an unusual opening sentence

      Following the comment, we modified it o “Phlorotannin, a type of tannin, is a chemical defense metabolite of brown algae.” (Line 114).

      Line 130 - Should the EHEP concentration be 3.96 µM not 3.36?

      We apologize for our mistake 3.36 is correct, and we corrected the X-axis label in Fig.1B.

      Line 133 - consider using "non-recombinant" rather than "natural"

      To distinguish between non-recombinant and recombinant samples, we used “EHEP” and “akuBGL” as purified from the native source and recomEHEP and recomakuBGL as the samples overexpressed from E. coli in this manuscript. So, we added the definition in [Introduction] (Line 100-101).

      Line 134 - "The residues A21-V227 of A21-K229..." This sentence could be written more clearly.

      Following the comment, we re-wrote it to “The residues A21–V227 in purified EHEP (1–20 aa were cleaved during maturation) were built” (Line 135-136).

      Line 136 - switch "appropriately visualized" for "tracable"?

      Following the comment, we modified it to “built” (Line 136).

      Line 158 - use "70% of backbone in a loop conformation" >

      We modified as the comment (Line 159-160).

      Line 184 - reword "map showed an electron density blob". (Map showed positive electron density)

      Following the comment, we modified it to “map showed the electron density” (Line 188).

      Line 193-194 - Is EHEP really more stable when bound to TNA? It is not shown experimentally? It is difficult to see which loop changes. Is the difference a result of crystal packing? Please switch "decrement" for another term

      The regions with conformation change between EHEP and EHEP–TNA are close to TNA but not at the intermolecular interface. As the reviewer mentioned, we could not clarify the EHEP stability depended on TNA-binding, and deleted the descriptions in the second paragraph of [TNA binding to EHEP].

      Following the comment, we redraw Fig. S1B (Fig. S3B in the revised version) to show the conformation changes clearly. We also modified "decrement" to "decrease" (Line 197).

      Fig S1B - Can an extra figure be added to show the secondary differences more clearly? >

      We redraw this figure (Fig. S3B) using closeup view to show the differences.

      Line 212-213 - There is a slight discrepancy between the text and Figure 4B. Gallic acid 4 interacts with P201 and gallic acid 6 interacts with P77.

      We apologize for our mistake in the text. and corrected it to “gallic acid4 and 6 showed alkyl–π interaction with P201 and P77, respectively” (Line 216).

      Figure 4D - Change x axis from tube number to elution volume. Both chromatograms could also be superimposed for interpretability.

      Since we used raw data from the experiment, we kept the x-axis in tube number with additional “2.7 ml/tube” information (Fig.3D).

      Line 229 - Please change "there was no blob of TNA in the electron density" to there was no electron density for TNA or something similar.

      Following comment, we modified it to “there was no electron density of TNA or something similar in the 2Fo–Fc and Fo–Fc map” (Line 232).

      Line 231 - asymmetric unit is a more standard term (also in Fig S2 legend)

      We modified as the comment (Line 235 and 885).

      Line 234-235 - Reword "the residues L26-P978 of L26-N994" to make it more concise. >

      Following the comment, we deleted “of L26-N994” (Line 239).

      Lines 296-299 could be written more carefully - pi stacking with what? >

      We apologize for our mistake and corrected it to CH–𝜋 (Line 293).

      Line 349 - which putatively enables it to......

      We modified it as the commend (Line 353 in the revised manuscript).

      Line 370 - "nonstructural" is the wrong term because they remain structured - use something akin to non-classical secondary structure

      Following the comment, we modified it to“are unfolding proteins with randomly coils in solution " (Line 374)

      Throughout - use phenix autobuild, not autobuil

      We apologize for our mistakes and corrected them throughout the manuscript.

      Figure 1 - the graphs would be more interpretable with all data points shown overlaid

      The two graphs in Figure 1 showed two experiments with different reaction conditions. Figure 1A presents various TNA concentrations, while Figure 1B maintains a constant concentration of 40 μM for TNA with varying EHEP concentrations. So, overlaying the graphs is not feasible. Therefore, we would like to keep them separated and added the reaction condition in figure legend.

      Figure 4 - in part D add an extra statement outlining what the S-100 analysis demonstrated

      S-100 analysis is using a gel filtration column with Sephacryl S-100 media. We added an extra statement in the method and the legend (Fig. 3, Lines 515 and 879).

      Figure 5 (and elsewhere) - the structures referred to need a PDB code and reference given in legend

      Following the comment, we checked the manuscript carefully and added PDB code to the referred structures.

      Fig S1 - please add an additional panel showing part D but in proper structure form, not schematic shapes

      Since we do not have enough experiments to validate the TNA-crosslink, we deleted the discussion of the TNA crosslink and Fig. S1D.

      Figure sig 4 - Text contains in depth information of side chain hydrogen bonding and π-π interactions between akuBGL and laminarittrose. However, the figure only shows a surface model. Consider adding a figure showing these interactions.

      Following the suggestion, we added a closeup view to show these detailed interactions (Fig. S6B).

    1. But there is no water

      In her annotation, Quisha talks about water as the most purest of substances, though one that isn't "sweet," so to speak. In many ways, the symbol of water reminded me not only of the purity and sweetness of liquid—but of music, specifically as it relates to the hermit-thrush.

      The line preceding this one is "Drip drop drip drop drop drop drop." Before reading TWL, we studied modernism in general—and my group had analyzed and listened to atonal music. This onomatopoeia, which "lacks water," is very atonal in itself. It lacks a concrete framework with which the notes—"drip" and "drop"—arrange themselves, nor does it have a "triad" that the notes "drip" and "drop" must return to. In other words, the sequence of "drip" and "drop" is seemingly random—it's atonal. One may also think of the act of water when it drips—down a faucet or a pipe—as inherently atonal music: water makes notes when it drips, but those notes are not carefully constructed under a key signature or arranged in a manner pleasant to the reader. If anything, atonal music—like water droplets—is not only unpleasant, but unsweet—just like water.

      As Quisha points out, a lack of sweetness doesn't signify a lack of purity or superiority. Water is the basis for human life; It's the most fundamentally pure substance there is. Atonality can't only be connected to water, though—but the hermit-thrush. The hermit-thrush, as described in the Bicknell entry,

      bears high distinction among our song birds. Its notes are not remarkable for variety or volume, but in purity and sweetness of tone and exquisite modulation they are unequaled.

      If anything, hermit-thrush music seems to represent the opposite of music produced by water. Neither water's taste nor sound is sweet, or particularly pleasant. On the contrary, the hermit-thrush song is sweet "in tone" and is distinct in its "modulation"—two elements that are entirely absent in atonal music. Nonetheless, the hermit-thrush bears some resemblance to water: its "tranquil clearness of tone and exalted serenity of expression." Water is certainly "clear in its tone"—both its taste and appearance are clear and refreshing. As for its "serenity of expression," it depends: water can be serene on a calm summer's day at the lake—but in the midst of a storm, it can be anything but serene.

      Ultimately, the change in purity, in serenity—and perhaps in sweetness—of water is what gives it is most distinguished qualities. Water is never constant—it is always in a state of change, such as when it "drips" atonally in the previous line. Perhaps this is the primary resemblance to the hermit-thrush, the voice of which is also dynamic: "While traveling, the hermit-thrush is not in full voice..." When in motion, the clarity, sweetness, and purity of the hermit-thrush isn't "in full"; likewise, the clarity, sweetness, and purity of water isn't apparent when it's in motion: rain, waves, and the like.

    2. Here is no water but only rock Rock and no water and the sandy road

      As the final statement made to the reader, I found it quite interesting that Eliot decides to further dimensionalize his already well-formed metaphor of drowning and water. In it, he utilizes rock—which was firstly represented as a physical representation of struggle and strife, but not death—as a parent of water, as rock and minerals filter water. But now, without the presence of water, what is left is sediment and "[T]he road winding above among the mountains/Which are/mountains of rock without water/If there were water we should stop and drink/Amongst the rock one cannot stop or think..." In this, a mental image of difficulty and great pain is forced onto the reader, dramatizing death further than it once was, which Eliot adds to his commentary on humanity in a post-World War I world, demonstrating the final moments of humans that live according to impulse and without the stronghold of faith and spirituality within them.

      In “What The Thrush Said. Lines From A Letter To John Hamilton Reynolds, ” by John Keats, he assures the reader that through faith in God and trust in His word, "the spring will be a harvest-time," and good fortune is imminent. Not only this but the afterlife in the heavens is promised, so long as the Christian remains faithful: "O thou, whose only book has been the light Of supreme darkness which thou feddest on Night after night when Phoebus was away, To thee the Spring shall be a triple morn."

      Keats supports Eliot's idea of peace through religion, representing the other man's possibility of tranquility, despite hardships that may seem to prevail.

    3. To Carthage then I came

      By this point, I have developed a key interest in the structuring of these kinds of phrases. Every time that a geographical region/location is mentioned, the articles of speech rearrange—the sentence starts with a preposition, and the subject "I" comes after the name of the place. "By Richmond I raised my knees... "On Margate Sands. I can connect..." Of course, there are exceptions to this, but the structure is nevertheless eye-catching. It reminded me of Paradise Lost, which I read last year, where Milton engages with a similar diversion from traditional sentence structure. I am not sure what to make of this—except for the fact that, just as Milton's unconventional language occurred during the Enlightenment, a time of great "political upheaval" (Wikipedia), so might Eliot's language have been written in the context of WW1 and its own societal upheavals.

      According to Wikipedia:

      Carthage, a seaside suburb of Tunisia’s capital, Tunis, is known for its ancient archaeological sites. Founded by the Phoenicians in the first millennium B.C., it was once the seat of the powerful Carthaginian (Punic) Empire, which fell to Rome in the 2nd century B.C.

      The first detail I noticed in searching up Carthage were the "Phoenicians"—of course, this holds relevance to the "drowned Phoenician Sailor" mentioned in Section I. The Phoenicians were colonizers—"sailing" across the Mediterranean to grow a vast and powerful empire. Eventually, however, Carthage fell to the Romans—as did the Phoenicians. Perhaps this loss of power is symbolized the act of "drowning"; on the other hand, it could be the act of "burning" instead.

      We see this line as "To Carthage I came," as the first line in Confessions—except why is the word then added in TWL? It doesn't make sense, unless you think of the "coming to Carthage" as the result, or action following the previous line: "My people humbl[ing] people who expect / Nothing." These "people" may be the ones referenced in Confessions as the ones who, at Carthage, "sang all around me in my ears a cauldron of unholy loves." There are several things to unpack here. First of all, the people are singing, and their music is "unholy." This unholiness is the opposite of what takes place in the "Fire Sermon," where, in escaping the burning of the senses, "he knows... that he has lived the holy life." Secondly, the music is a cauldron. Thinking about what a cauldron itself does, it is a vessel usually where something is cooked in boiling liquid—essentially, being burned and drowned at the same time. Perhaps burning and drowning, in this sense, aren't two disparate means of suffering—but two sides of the same coin. Whereas burning is the suffering derived from desire, drowning is the stifling of power, and of "rest" (going back to Burial of the Dead), as a result of the suffering.

    1. In fact, the grants were as big or bigger than major cities, andwere often located hundreds or even thousands of miles away from theirbeneficiaries.Kalen Goodluck/High Country NewsNiles Canyon Railway, Sunol, California.PARCEL ID: CA210040S0010W0SN020AE½SWALINDIGENOUS CARETAKERS: Chap-pah-sim; Co-to-plan-e-nee; I-o-no-hum-ne; Sage-womnee; Su-ca-ah; We-chil-laOWNERSHIP TRANSFER METHOD: Seized by unratified treaty, May 28, 1851GRANTED TO: State of AlabamaFOR THE BENEFIT OF: Auburn UniversityAMOUNT PAID FOR INDIGENOUS TITLE: $0AMOUNT RAISED FOR UNIVERSITY: $72.01Today, these acres form the landscape of the United States. On Morrill Actlands there now stand churches, schools, bars, baseball diamonds, parkinglots, hiking trails, billboards, restaurants, vineyards, cabarets, hayfields,gas stations, airports and residential neighborhoods. In California, landseized from the Chumash, Yokuts and Kitanemuk tribes by unratifiedtreaty in 1851 became the property of the University of California and isnow home to the Directors Guild of America.In Missoula, Montana, aWalmart Supercenter sits on land originally ceded by the Pend d’Oreille,Salish and Kootenai to fund Texas A&M. In Washington, Duwamish landtransferred by treaty benefited Clemson University and is now home to theFort Lawton Post military cemetery. Meanwhile, the Duwamish remainunrecognized by the federal government, despite signing a treaty with theUnited States.Recent investigations into universities’ ties to slavery provide blueprintsfor institutions to reconsider their histories. Land acknowledgementsfurnish mechanisms to recognize connections to Indigenousdispossession. Our data challenges universities to re-evaluate thefoundations of their success by identifying nearly every acre obtained andsold, every land seizure or treaty made with the land’s Indigenouscaretakers, and every dollar endowed with profits from dispossession.“Unquestionably, the history of land-grant universities intersects with thatof Native Americans and the taking of their lands,” said the Association ofPublic and Land-Grant Universities in a written statement. “While wecannot change the past, land-grant universities have and will continue tobe focused on building a better future for everyone.”Kalen Goodluck/High Country NewsFort Lawton Post Cemetery, Seattle, Washington.PARCEL ID: WA330250N0030E0SN150AN½NESCINDIGENOUS CARETAKERS: Duwamish; SuquamishOWNERSHIP TRANSFER METHOD: Ceded by treaty, Jan. 22, 1855GRANTED TO: State of South CarolinaFOR THE BENEFIT OF: Clemson University and South Carolina State UniversityAMOUNT PAID FOR INDIGENOUS TITLE: $3.91AMOUNT RAISED FOR UNIVERSITY: $58.06A SIMPLE IDEAFew years have mattered more in the history of U.S. real estate than 1862.In May, Abraham Lincoln signed the Homestead Act, which offeredfarmland to settlers willing to occupy it for five years. Six weeks later camethe Pacific Railway Act, which subsidized the Transcontinental Railroadwith checkerboard-shaped grants. The very next day, on July 2, 1862,Lincoln signed “An Act donating Public Lands to the several States andTerritories which may provide Colleges for the Benefit of Agriculture andthe Mechanic Arts.” Contemporaries called it the Agricultural College Act.Historians prefer the Morrill Act, after the law’s sponsor.The legislation marked the federal government’s first major foray intofunding for higher education. The key building blocks were already there; afew agricultural and mechanical colleges existed, as did severaluniversities with federal land grants. But the Morrill Act combined the twoon a national scale. The idea was simple: Aid economic development bybroadening access to higher education for the nation’s farmhands andindustrial classes.“In the North, we are at the heyday of industrializationand the maturing of American capitalism, and the landgrant, like other kind of acts — the Homestead Act orthe creation of the Department of Agriculture — any ofthese type of activities that happen during this time,are really part of an effort in creating this modernapparatus for the state,” said Nathan Sorber, author ofthe book Land-Grant Colleges and Popular Revolt.“Land-grant institutions can be understood as part ofan effort to modernize the economy.”The original mission was to teach the latest inagricultural science and mechanical arts, “so it hadthis kind of applied utilitarian vibe to it,” said Sorber. But the act’s wordingwas flexible enough to allow classical studies and basic science, too. Withthe nation in the midst of the Civil War, it also called for instruction inmilitary tactics.Map by Margaret Pearce for High Country NewsThe act promised states between 90,000 and 990,000 acres, based on thesize of their congressional delegation. In order to claim a share, they had toagree to conserve and invest the principal. Eastern states that had no landin the public domain, as well as Southern and some Midwestern states,received vouchers — known at the time as scrip — for the selection ofWestern land. Western states chose parcels inside their borders, as didterritories when they achieved statehood. The funds raised were eitherentrusted to universities or held by states.Like so many other U.S. land laws, the text of the Morrill Act left outsomething important: the fact that these grants depended ondispossession. That went without saying: Dubiously acquired Indigenousland was the engine driving the growing nation’s land economy.“You can point to every treaty where there’s some kind of fraud, wherethere’s some kind of coercion going on, or they’re taking advantage of someextreme poverty or something like that so they can purchase the land atrock bottom prices,” said Jameson Sweet (Lakota/Dakota), assistantprofessor in the Department of American Studies at Rutgers University.“That kind of coercion and fraud was always present in every treaty.”Hundreds of treaties, agreements and seizuresbulked up the U.S. public domain. Aftersurveyors carved it up into tidy tracts of realestate, settlers, speculators, corporations andstates could step in as buyers or grantees,grabbing pieces according to various federallaws.The first to sign on for a share of the MorrillAct’s bounty was Iowa in 1862, assigning theland to what later became Iowa StateUniversity. Another 33 states followed during that decade, and 13 more didso by 1910. Five states split the endowment, mostly in the South, whereseveral historically Black colleges became partial beneficiaries.Demonstrating its commitment to the separate but equal doctrine,Kentucky allocated 87% of its endowment to white students at theUniversity of Kentucky and 13% to Black students at Kentucky StateUniversity.Not every state received land linked to the Morrill Act of 1862. Oklahomareceived an agricultural college grant through other laws, located primarilyon Osage and Quapaw land cessions. Alaska got some agricultural collegeland via pre-statehood laws, while Hawai‘i received a cash endowment fora land-grant college.HCN tracked down and mapped all of the grants tied to the Morrill Act andoverlaid them on Indigenous land-cession areas in a geographicinformation system. The results reveal the violence of dispossession onland-grant university ledgers.Kalen Goodluck/High Country NewsDirectors Guild of America, West Hollywood, Los Angeles, California.PARCEL ID: CA270010S0140W0SN080ASECAINDIGENOUS CARETAKERS: Buena Vista; Car-I-se; Cas-take; Hol-mi-uk; Ho-lo-cla-me; Se-na-hu-ow; So-ho-nut; Te-jon; To-ci-a; UvaOWNERSHIP TRANSFER METHOD: Seized by unratified treaty, June 10, 1851GRANTED TO: State of CaliforniaFOR THE BENEFIT OF: University of CaliforniaAMOUNT PAID FOR INDIGENOUS TITLE: $0AMOUNT RAISED FOR UNIVERSITY: $786.74Kalen Goodluck/High Country NewsCornfields, Adams, Nebraska.PARCEL ID: NE060050N0080E0SN290ANEOHINDIGENOUS CARETAKERS: Kansas (Kaw Nation)OWNERSHIP TRANSFER METHOD: Ceded by treaty, June 3, 1825GRANTED TO: State of OhioFOR THE BENEFIT OF: Ohio State UniversityAMOUNT PAID FOR INDIGENOUS TITLE: $0.93AMOUNT RAISED FOR UNIVERSITY: $88.79Kalen Goodluck/High Country NewsPrivate residence in Merced, California.PARCEL ID: CA210070S0130E0SN250ANEMAINDIGENOUS CARETAKERS: Ko-ya-te; New-chow-we;Pal-wis-ha; Po-ken-well; Wack-sa-che; Wo-la-si; Ya-wil-chineOWNERSHIP TRANSFER METHOD: Seized by unratified treaty, May 30, 1851GRANTED TO: State of MassachusettsFOR THE BENEFIT OF: University of Massachusetts and MITAMOUNT PAID FOR INDIGENOUS TITLE: $0AMOUNT RAISED FOR UNIVERSITY: $103.09We reconstructed approximately10.7 million acres taken fromnearly 250 tribes, bands andcommunities through over 160violence-backed land cessions, alegal term for the giving up ofterritory.MENU SUBSCRIBE THE MAGAZINE DONATE NOW TWITTERINSTAGRAMFACEBOOKSEARCH

      I think sometimes its hard to see the differential impacts of these land grants. For these grants to be larger than major cities but farther from their beneficiaries I think it kind of creates this dissonance from the grant and the beneficiaries themselves.

    1. Plex is my very life - and has been all along, I suspect. From a creative and in-quisitive childhood, sampling all the arts, crafts, and sciences, through a strongliberal-arts background, to pure mathematics and electrical engineering - I foundmyself swept into the very exciting dawn of the computer age in my first graduate-student summer job, in 1952. Just as my marriage to Pat in the January breakof my senior year at Oberlin had been the perfect choice, my change to part-timeSpecial Student status, while embarking on my full-time professional career atMIT, can be seen as inevitable, when viewed from today's vantage point. Thereis an exquisite economy in the doings of nature, and for a long time, now, I havebeen firmly convinced that, whoever I may really be, my role in the scheme ofthings has been to initiate the discovery of Plex, not by chance, but as what Ido, simply because I'm me

      I can see him struggling with this concept at this point I dont think we had greb the concept of arts as not something you do but a part of expressing what you have to say

      There are many techinical people that are into arts and we think of that as an oddity but art is technology

    1. We studied large carnivore conflicts in a 23,700 km² area ofsouthwestern Alberta (Fig. 1) that was bounded by the HighwoodRiver to the north, British Columbia to the west, and

      1) Where is the exact location of the study AND why do you think there are complex human dimensions of wildlife conflicts higher here than other locations in North America? The location of the study is southwestern Alberta in Canada (Morehouse and Boyce, 2017). I think that the wildlife conflicts are high in this area for a number of reasons. The article stated that agriculture grazes on public lands in this area as well as there being private land that some individuals use for raising cattle and other agricultural animals. This alone would make it so that there is more conflict because there are also many wild animals trying to survive in the area. The specific area was stated to be surrounded by varying habitats from mountains to flat lands, and the weather ranges from cold winters to hot summers. With The range of weather, it may be especially important for the wildlife to try to feed during the summers to hibernate during the winters. Morehouse, A. T. & M. S. Boyce (2017). Troublemaking carnivores: conflicts with humans in a diverse assemblage of large carnivores. Ecology and Society 22(3):4. https://doi.org/10.5751/ES-09415-220304

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Response to Reviewers

      We are grateful to the Reviewers for their insightful thoughts and suggestions for improving the manuscript for publication. We have addressed all Reviewers’ comments, and detailed responses have been provided below (in blue font). We have uploaded a revised manuscript version, and have made a few small improvements to the text to improve readability. Line and figures numbers refer to the revised version of the manuscript.

      ‘Reviewer #1 (Evidence, reproducibility and clarity (Required)):

      In this study, Wenner et al. used various in vitro methods, including transposon mutagenesis, screening of known regulatory proteins and isolation of spontaneous mutants to discover 11 mutations in genes that promote bacterial growth under succinate-mediated inhibition. Through additional experiments, the manuscript provides evidence for factors that underlie several layers of succinate regulation. These layers include sRNAs, OxyRS, succinate transport antibiotics and rRNA. The study then characterized the molecular mechanisms regulating succinate utilization by these mutations, revealing a RpoS-independent mechanism for succinate uptake via the dctA transporter and mechanisms for RpoS regulation.

      Overall, the manuscript is very unfocused and uneven in the level of details of each of these factors and could be much more compelling if more focus was given to several factors and providing more mechanistic insight of these factors.

      We thank Reviewer #1 for the constructive criticism and suggestions. We do recognize the limitations of our study, clearly more work is required to unravel the complex phenomenon of the inhibition of succinate utilisation by Salmonella. We welcome Reviewer #1’s suggestions to shorten the manuscript, which has allowed us to focus the paper on our key findings.

      Major comments

      1. The authors discuss virulence-mediated succinate but disregard some important features of succinate utilization, only referring to dctA and disregarding the overlap with other C4-dicaroxy transporters (Spiga, wolf, PMID). Furthermore, the study found that a mutation in the IscR binding site on the DctA promoter region reversed the effects of succinate-dependent growth inhibition generated under aerobic conditions but other succinate transporters are expressed under different physiological conditions (Janausch et al. 2002, Spiga et al. 2017). Does the IscR binding site motif can be found in promoters of other succinate transporters? Analysis of IscR in aerobic/ anaerobic conditions can be useful. Do mutations in IcsR lead to increased expression of other succinate transporters in aerobic or anaerobic conditions?

      The Reviewer’s question of the regulatory role of IscR on anaerobic C4-dicarboxylate transporters is particularly relevant in the context of the role of succinate catabolism in pathogenesis and could be studied in a follow-up investigation. However, further analysis of the influence of mutations that modulate the expression or activity of IscR are beyond the scope of our study. Here, we have focused on succinate utilisation under in vitro, aerobic conditions: under these conditions, growth upon succinate is robustly repressed, allowing the selection of Succ+ mutants. To emphasise that our study was done under aerobic conditions, we have rephrased the Introduction (line 93).

      Transposon screen - There is no comprehensive description of the results and it is not clear why mutations found in the evolution experiments or regulatory proteins that were shown to allow bacteria growth under succinate treatment were not detected in the transposon screening?

      Different selection protocols were used to isolate the Succ+ mutants and the experimental approaches are detailed in the Methods and in the strain list for each mutant (Supplementary_Resource_Table S1). Selection was performed in liquid M9+Succ for Tn5 mutagenesis (in the rpoS2X background), or in solid and liquid M9+Succ media for the spontaneous mutants (the mutations are all listed and detailed in Table 1).

      Therefore, the different selection conditions and the presence of an extra rpoS copy may have favored certain mutants, especially when the pools of Tn5 mutants were grown with succinate together (mutants in competition).

      We recognize that our experimental approach had limitations, and that a Tn-seq methodology would have been more comprehensive. However, the robustness of the phenotypes of the mutants (all re-constructed and complemented, when possible) demonstrated that the genes of interest had direct impact upon the control of succinate metabolism with novel implications for the field.

      Figure 4: The authors claim: "that the fast growth of the Δhfq and Δpnp strains reflected both the dysregulation of the sRNA-mediated repression of sdh and the activation of rpoS translation". However, they provide no evidence for SDH regulation. The experiment is correlative, the activity of pnp regulating rpoS was done with overexpression without the proper controls. The authors should look at rpoS expression in Δpnp. It does not seem reasonable that transcription of SDH mRNA can explain lack of succinate utilization. What about the SDH protein? is it at all changed? The authors claim "none of the sRNA mutants tested displayed the same fast-growing pattern of the Δhfq mutant" but they action can involve completely different mechanisms, that the authors do not study. This part does not seem to contribute any novel information on Δhfq and Δpnp on Succ+ with the sRNAs seem not to provide any clear mechanism. The authors should consider removing this part or moving to supplementary.

      We appreciate this comment, and agree that this section does not provide critical novel insight. However, our findings provide valuable data concerning the role that Hfq, PNPase and sRNAs play in succinate utilisation. Therefore, we have briefly mentioned the role of Hfq, PNPase and sRNAs in the main text (Lines 333-338) and moved the original Figure 4 to the Supplementary (Figure S5), with a supplementary text section (Supplementary Text T1).

      If OxyS, an Hfq-binding sRNA, is related to Succ+ in Δhfq, then why all the other sRNAs are relevant? This is not clear. The authors could have focused here on the oxyS instead of other sRNAs. "The same plasmid did not stimulate the growth of the ΔoxyR strain indicating that a functional OxyR is required for growth in M9+Succ (Fig 5D)" - is it because of other targets of OxyR?

      The reviewer’s interpretation is correct. To clarify this point, we have rephased the sentence (Lines 274-276) to “The same plasmid did not stimulate the growth of the ∆oxyR strain indicating that other OxyR-dependent genes are required to grow under this condition”

      It seems that an RNA-seq analysis in the conditions of succinate growth with OxyRmut vs. WT could hint towards this.

      Indeed, it would be very interesting to compare the transcriptomic landscape of the WT and of the oxyRmut mutant and other Succ+ mutants in succinate minimal medium. However, the lack of growth of S. Typhimurium WT in M9+Succ, would make these experiments unlikely to succeed.

      "We previously showed that Hfq inactivation boosted succinate utilization (Fig 4A), but in the oxyRmut genetic background the same Hfq inactivation dramatically reduced growth and extended the duration of lag time in M9+Succ (Fig 5 E)"

      The reviewer is correct, we had hypothesised that Hfq is necessary to stimulate succinate utilisation by OxyS. Therefore, we have rephrased to: “We previously showed that Hfq inactivation boosted succinate utilisation, but in the oxyRmut genetic background the same Hfq inactivation dramatically reduced growth and extended the duration of lag time in M9+Succ (Fig 4E). Collectively, our findings show that the OxyS sRNA orchestrates the de-inhibition of succinate utilisation in concert with Hfq” (Lines 278-281)

      • this seems like an interesting finding, but the authors don't offer any follow-up? Is it related to oxyS activity?

      The role of Hfq on succinate utilisation appeared to be dual, we have added a sentence to this effect (Lines 335-338).

      Figure 6: "OxyS acts as an indirect repressor of RpoS expression, probably via the titration of Hfq". the yobF::sfgfp activity was significantly lower in the oxyRmut strain (~2-fold repression), confirming that OxyS represses the expression of the yobF cspC operon in Salmonella - can the authors show this directly with oxyS in succinate?

      Because Salmonella WT and ∆oxyS strains do not grow in succinate media (M9+Succ), we had to investigate the regulation of yobF-cspC operon with a translational gene fusion in non-selective LB media.

      Why use OxyRmut here? This is indirect.

      In Figure 5C we first used the oxyRmut Succ+ strain to demonstrate that this mutation leads to the repression of yobF-cspC. In Figure 6F, we used the oxyRmut allele to allow a constitutive expression of oxyS WT or oxySGG : allele oxySGG was introduced into the chromosome and relies on an active OxyR to be transcribed. The direct role of OxyS is demonstrated in Figure 5 E &F.

      The authors already show that OxyRmut does not act solely via Oxys...can the authors directly show RpoS and SDH levels by qRT-PCR in ΔcspC? Again - the appropriate control for RpoS overexpression in the WT was not done (Fig. 6G). Furthermore, expression analysis of the sdhCDAB operon over the background of the oxyR mutant will confirm the author suggestion for the mechanism by which the OxyS-driven inhibition of CspC expression impacts upon the catabolism of succinate.

      The reviewer’s comments are valid, more work is required to understand how OxyS stimulates succinate utilisation via the repression of cspC. The fact that Salmonella WT does not grow with succinate as a sole carbon source makes such comparisons technically challenging. Yes, the repressive role of CspC remains enigmatic. However, RNA-seq data following growth in LB media have already been provided by others, suggesting that CspEC may repress TCA cycle genes in Salmonella (PMID: 28611217), consistent with the repression of succinate catabolism by CspC.

      The fact that the plasmid-borne overexpression of rpoS completely represses growth upon succinate in the ∆rpoS background (Figure S3 B) validated the usage of the prpoS plasmid in other genetic backgrounds, in order to reveal whether the other Succ+ mutations were stimulating succinate utilisation via rpoS repression or not. Because WT Salmonella does not grow in M9+Succ, presenting the growth curve of the WT strain carrying the prpoS plasmid would not be informative here, and would make the figure overly complex.

      Figure 7: the authors check growth in M9+succ in the absence of DctA - but the experiment duration should be carried out for longer, as previous experiments with WT (intact dctA in Fig. 2A) and check if in the absence of dctA there are mutations that allow succinate growth.

      We agree with the reviewer’s comment and we have performed a new growth curve (over 65 hours) of the ∆dctA strain to clarify that DctA is the only succinate transporter involved in Salmonella growth under our experimental conditions (Figure S8).

      It seems that the results here contradict some of the previous - if succinate uptake through dctA is intact then there is no repression of SDH? rpoS? In figure 7E - is this difference only through dctA activity?

      The reviewer is raising an important point and it is possible that the de-repression of succinate uptake via DctA could impact upon the expression of the succinate catabolic genes and more work is required to understand this phenomenon. We have discussed this possibility in the main text (Lines 424-432) and in Figure 8C.

      It seems that icsR is not repressing dctA expression to WT levels - are there other factors? Can the authors show that dctA repression by IscR is direct?

      We agree with the reviewer, we have not shown that IscR represses dctA directly. Electrophoretic mobility shift assays could be performed to prove that IscR interacts with the dctA promoter region, but this would be beyond the scope of the paper. We have clearly stated in the discussion that indirect effects of iscR on dctA expression cannot be ruled out (Lines 419-422).

      Figure 9 is very descriptive and does not provide any evidence to support the authors hypothesis. The authors should either provide more substantial evidence connecting ribosomal RNA levels and succinate utilization and similarly Cm concentrations or either remove this part or move it to the supplementary.

      We agree that the data do not conclusively support the hypothesis, but we believe that the impact of anti-SD mutation and chloramphenicol on Salmonella carbon metabolism are valuable observations for the community. Therefore, we have moved the data to supplementary Figures S11 and S12 in the revised version, with a supplementary text section (Supplementary Text T2). We also removed this aspect from the model Figure (Figure 8) and only mentioned the phenomenon briefly in the main text, Lines 482-485.

      Can any of the mutations characterized in this work be found in the genome of Newport or LT2 strains that can grow with succinate as a sole carbon source? (Fig 1)

      Very good questions. Yes, S. Typhimurium strain LT2 has an altered rpoS allele that attenuates virulence of the strain in the murine infection model (PMID: 8975913) and promotes growth with succinate (PMID: 33593945). We have added a sentence and cited the reference at Lines 129-131.

      To address the S. Newport question, we performed an analysis of the genome of the S. Newport strain LSS-48, and did not identify any mutations in regulatory or catabolic genes that could explain the faster growth on M9+succinate. However, in comparison with fast-growing enteric bacteria (i.e. E. coli MG1655) or Succ+ S. Typhimurium mutants, S. Newport LSS-48 grows much slower on succinate and has an intermediate growth phenotype. It remains unclear why S. Newport does grow better than other serovars.

      Although the author suggested that regulation of succinate uptake is critical for Salmonella colonization and virulence in various metabolic conditions, the study lacks sufficient evidence to support these claims and further research is necessary to establish these statements.

      We agree that our findings are not directly linked to Salmonella host colonisation or virulence. However, we do believe that our study will contribute to a better understanding of Salmonella metabolic control, in the context of pathogenesis. To address Reviewer #3’s comment, we have moderated our claims about the likely impact of our findings on the understanding of Salmonella pathogenesis in the Perspective section.

      Minor comments

      1. Table summarizing the growth curves lag phase of the different mutants might help in the data interpretation.

      We appreciate the Reviewer’s suggestion and have prepared a supplementary figure (Figure S4) indicating the average lag time of the Succ+ mutants and of the complemented mutants.

      In lines 245-248 the author describes the eleven novel Succ+ mutations however in this gene list only ten gene names are mentioned. DctA is missing from this list.

      We appreciate the Reviewer’s comment and we have modified the sentences in the revised manuscript (Line 244).

      ** Referees cross-commenting**

      I agree with both reviewer that there is a large amount of data in the paper, and willing to accept their point that asking for further experiments would exceed the scope of the paper. In that case, the authors should address the mechanistic options in the discussion

      Reviewer #1 (Significance (Required)):

      In this work, Wenner et al. characterized the molecular mechanisms regulating Salmonella growth inhibition when succinate is the sole carbon source in the culture. This work revealed new layer of regulations for rpoS activation, the sigma factor previously characterized to control this growth inhibition mechanism. In addition, this work revealed novel RpoS-independent mechanisms for succinate utilization and highlighted the crucial role of succinate processing in Salmonella physiology.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)):

      In the manuscript titled "Salmonella succinate utilisation is inhibited by multiple regulatory systems", Wenner et al., explored how Salmonella regulates the utilization of succinate, an important carbon source for Salmonella gut colonization as well as a molecule that regulates intracellular adaptation in the SCV. As Salmonella exhibits a slow growth rate when succinate is provided as the sole carbon source, the authors explored the underlying genetic regulation by isolating fast-growing mutants (Succ+) using an experimental evolution approach. By combining the screen for mutants lacking key regulatory proteins, an elegantly designed Tn5 transposon mutagenesis, and selection of spontaneous Succ+ mutants, the authored identified a library of mutations that led to the Succ+ phenotype. Using classical bacterial genetics, Wenner et al characterized how Hfq, PNPase and cognate sRNA inhibit succinate utilization. They went on to show, clearly and convincingly, that IscR inhibits growth upon succinate by repressing DctA expression, and succinate utilization can also be repressed by RbsR and FliST via RpoS. Lastly, they provided evidence supporting that anti-Shine-Dalgarno mutations and low concentrations of chloramphenicol can boost succinate utilization. Overall, this paper is well written, and the experiments were rigorously designed and executed. This is a beautiful example of deciphering complex regulatory nodes in the succinate utilization using elegant genetics approaches. Very nicely done!

      We thank the Reviewer #2 for the very positive evaluation of our work and the constructive comments.

      Minor issues:

      1. While rpoS2X strain is an clever way to avoid the selection of Succ+ rpoS mutants, it is unclear why "identified an iraP::Tn5 mutant was an effective validation of the use of the rpoS2X genetic background". IraP stabilizes Rpos, and this mutant could have been selected in the wild-type background (rpoS1X).

      The reviewer’s comment is helpful, we have removed this sentence from the revised manuscript.

      The description between line 356-357 is confusing as it reads like the author constructed a "oxyRmut oxySGG pPL-OxySGG" strain, while the experiments that followed actually used a " ∆oxyS, yobF::sfgf, pPL-OxySGG" strain.

      We have modified these sentences in the revised manuscript (Lines 303-308).

      An alternative explanation for the Succi+ phenotype in aSD mutant and bacteria treated with low Cm is the reduced translation fidelity, which leads to selectively degradation of inhibitors of succinate utilization.

      We thank Reviewer #2 for the suggestion. This phenomenon is really enigmatic and as previously discussed in Reviewer #1’s section, we have now moved Figure 9 to supplementary data. Further discussion of how the aSD mutations and chloramphenicol can affect Salmonella succinate metabolism would require a lot more experimental data.

      ** Referees cross-commenting**

      Most of the comments from Reviewer 1 are valid but excessive. Most of the experiments presented in this paper were rigorously controlled and executed. While some parts of the paper could be more mechanistic but they could also leave room for future studies. Also, some of the points raised, the 1st major concern, for example, may have exceeded the scope of the paper.

      We agree. We have performed a new experiment (Figure S8) to address Reviewer #1’s comments.

      Reviewer #2 (Significance (Required)):

      Overall, this paper is well written, and the experiments were rigorously designed and executed. This is a beautiful example of deciphering complex regulatory nodes in the succinate utilization using elegant genetics approaches.

      We appreciate Reviewer #2’s feedback that the quality of the text and our experiments was viewed so highly.

      Reviewer #3 (Evidence, reproducibility and clarity (Required)):

      In this work, Wenner and colleagues use experimental evolution to define a range of spontaneous mutations in Salmonella that allow it to overcome its aversion to using succinate as a carbon source in vitro.

      This work cites the literature extensively and the scholarship is very very good. I appreciate the effort they put into the manuscript, which made it easy to read. Quite a relief to get a paper in this good of shape compared to most.

      We appreciate Reviewer #3’s positive comments on our work and the constructive suggestions.

      Shortcomings - although I don't think they are necessary for *this* paper to be published include:

      • not defining what could be 'bad' about eating succinate in the wrong place. The fact that succinate import is a problem (dctA is what is being regulated ant its a transporter) suggests one of the following: (1) excess succinate would block the utilization of fumarate by fumarate reductase, (2) succinate is a powerful buffer and, if protonated, would acidify the cytoplasm of Salmonella if it were brought in - note that there is a lot of work on RpoS controlling cytoplasmic acidification, (3) a drop in succinate (because Salmonella eats it) would allow more flux by macrophages or the microbiota in a bad way...maybe the Salmonella 'wants' macrophages to have lots of succinate *because* its pro-inflammatory (and therefore more tetrathionate for its friends...etc), (4) it could be the transporter that also bring in antimicrobial itaconate?...so the succinate phenotype is a red herring and really this is about preventing taconite from getting into the cell?

      We thank the reviewer for all these suggestions and for highlighting the reasons why the avoidance of Salmonella utilising succinate is a key point. We have emphasized this key question to conclude our manuscript (Lines 500-501). Whilst all the hypotheses are valid, we believe that further speculation should not be added to the “Perspective” section.

      • no proof that any of this is relevant in infection except citing old papers. Again - this work is already VERY expansive and we could propose experiments until the end of time. Next paper should take the dctA and other mutations and put them into mice to see if they fail in either germ free mice (no microbial produced succinate around) or in systemic infections.

      The reviewer’s comment is welcomed. As discussed in our response to Reviewer #1, we have scaled back our discussion of the impact of our findings for the understanding of Salmonella pathogenesis*. *

      Most of the mutations they find are 'regulatory' and the only proximal effector of succinate utilization seems to be dctA...suggesting that dctA expression is the 'rate limiting' or 'blocked' step that decides whether succinate is being used or not.

      We agree that dctA regulation is a central element of the story. As discussed in Reviewer #1 comments, it is not clear how de-repression of dctA leads to the increased catabolism of succinate in the presence of RpoS (particularly because RpoS represses several succinate catabolic genes, PMID: 24810289 and PMID: 25578965). We also discovered other Succ+ mutants that did not affect DctA expression but stimulated growth on succinate as a sole carbon source. Consequently, it is uncertain whether the uptake of succinate is really the limiting factor. We have added sentences about this paradox, Lines 424-432.

      The data is extensive and generally well controlled. Where appropriate they either complement mutations or reconstruct them denovo. The findings of the various genes range in novelty but many are new.

      ** Referees cross-commenting**

      I agree that the work was valid and well controlled. The 'story' was a bit disjointed at times primarily because the range of mutations identified were diverse and pleiotropic. Given the large amount of data already in the paper and the nature of the mutations identified I worry about embarking on an endless cycle of new experiments. I think it's at a publishable stopping point.

      In response to Reviewer #3 & #1’s comments, we have now improved the flow of the manuscript.

      Reviewer #3 (Significance (Required)):

      This seemingly mundane phenotype (Salmonella 'choosing' to not use succinate even though it's perfectly capable of doing so) has been known for years but only recently has its potential relevance become more clear in the context of infection and microbiota metabolism.

      The authors propose that succinate utilization is to be used at the right time and right place.

      I sympathize with the authors that they keep hitting very pleiotropic regulators (RpoS has ten million upstream inputs and outputs. The ribosome? How is that going to be figured out in one or two simple experiments?). My money is on figuring out exactly how dctA is regulated and whether there's differences in the dctA regulation between E. coli and Klebsiella/Salmonella.

      So I think the work is extensive and generally well done. I think the paper will be well cited...and I think it's importance will grow over time and it will continue to be relevant years from now. I can't say that about most work in the field.

      We agree with Reviewer #3’s assessment that other scientists in the Salmonella field are likely to cite our paper, and to perform experiments that will build on our findings in the future.

    1. Author Response

      The following is the authors’ response to the previous reviews

      Reviewer #2 (Public Review):

      DeKraker et al. propose a new method for hippocampal registration using a novel surface-based approach that preserves the topology of the curvature of the hippocampus and boundaries of hippocampal subfields. The surface-based registration method proved to be more precise and resulted in better alignment compared to traditional volumetric-based registration. Moreover, the authors demonstrated that this method can be performed across image modalities by testing the method with seven different histological samples. This work has the potential to be a powerful new registration technique that can enable precise hippocampal registration and alignment across subjects, datasets, and image modalities.

      We thank the Reviewer, and feel this is an accurate summary of our work.

      Reviewer #3 (Public Review):

      Summary:

      In the current manuscript, Dekraker and colleagues have demonstrated the ability to align hippocampal subfield parcellations across disparate 3D histology samples that differ in contrast, resolution, and processing/staining methods. In doing so, they validated the previously generated Big-Brain atlas by comparing across seven different ground-truth subfield definitions. This is an impressive effort that provides important groundwork for future in vivo multi-atlas methods.

      Strengths:

      DeKraker and colleagues have provided novel evidence for the tremendously complicated curvature/gyrification of the hippocampus. This work underscores the challenge that this complicated anatomy presents in our ability to co-register other types of hippocampal data (e.g. MRI data) to appropriately align and study a structure in which the curvature varies considerably across individuals.

      This paper is also important in that it highlights the utility of using post-mortem histological datasets, where ground truth histology is available, to inform our rigorous study of the in vivo brain.

      This work may encourage readers to consider the limitations of the current methods that they currently use to co-register and normalize their MRI data and to question whether these methods are adequate for the examination of subfield activity, microstructure, or perfusion in the hippocampal head, for example. Thus the implications of this work could have a broad impact on the study of hippocampal subfield function in humans.

      Weaknesses:

      As the authors are well aware, hippocampal subfield definitions vary considerably across laboratories. For example, some neuroanatomists (Ding, Palomero-Gallagher, Augustinack) recognize that the prosubiculum is a distinct region from subiculum and CA1 but others (e.g. Insausti, Duvernoy) do not include this as a distinct subregion. Readers should be aware that there is no universal consensus about the definition of certain subfields and that there is still disagreement about some of the boundaries even among the agreed upon regions.

      We thank the Reviewer, and feel this is an accurate summary of our work that also provides useful scientific context.

      Reviewer #2 (Recommendations For The Authors):

      The authors have done a great job with the revisions and have addressed all my concerns. They have clarified aspects of the method and procedure and have included a helpful walk-through explanation of an example subject. The authors have also expanded the discussion and addressed the motivation and justification for certain steps of the procedure.

      We thank the Reviewer.

      Reviewer #3 (Recommendations For The Authors):

      The authors have addressed my previous comments and I believe the impact and take home message of the paper is more clear.

      We thank the Reviewer.

      In Figure 1, is the proximal-distal label reversed for panel B? I think P (proximal) should be closer to CA4/DG and D (distal) should be closer to subiculum. Am I misreading the graph?

      We thank the Reviewer for this consideration, but the label is as intended. The terms proximal/distal in the hippocampal literature are sometimes relative to the dentate gyrus and sometimes relative to the rest of the cortex. In our case, we use the terms relative to the neocortex, following Ding and Van Hoesen (2015). We have now added the following to clarify this point at the first use of these terms (p.5):

      “The current work, however, defined this tessellation as a regular mesh grid in unfolded space consisting of 256×128 points across the anterior-posterior (A-P) and proximal-distal (P-D) (relative to the neocortex) axes of the unfolded hippocampus, respectively.”

    1. Author Response

      The following is the authors’ response to the original reviews.

      We thank the reviewers for their thoughtful assessment of our work and their valuable critiques which we will address in the “Recommendations for the authors” section below. In particular, we appreciate Reviewer #3 noting the value of the C. elegans model system and our efforts to bridge models with our study. We agree with the reviewer that there is a need to clarify the rationale, presentation and interpretation of our results. We have substantially revised the text in our manuscript and Figure legend to address this issue, and provided extensive new commentary and citations to lay out the logic behind our experiments. Indeed, it was our oversight not being more thorough about this initially. We have further adjusted our conclusions to be less unequivocal. Finally, we added an RPM-1 signaling diagram (Fig. 8A) to more clearly annotate the players in the RPM-1/MYCBP2 signaling network that were evaluated genetically in Fig. 8. Importantly, we provide clearer commentary on how genetic enhancer effects with known RPM-1 binding proteins and the absence of genetic suppression in vab-1/Eph receptor double mutants with components of the RPM-1/FSN-1 ubiquitin ligase complex are consistent with the biochemical finding that MYCBP2 stabilizes but does not degrade EphB2. Text edits reflecting these points are in the abstract, the C. elegans results section starting on line 411, and the discussion on lines 499, 502-504 and 541.

      Following extensive discussions between the three reviewers, all three agree that the C. elegans data, as presented, does not add to, and in fact might harm, your bottom line. Our combined suggestion is to take this data out unless you plan to improve it substantially. All reviewers are perplexed by Figure 2F and the presumed interactions of cytosolic proteins with the extracellular domain of EPHB2. At the very least, please provide some suggestions/model/interpretation.

      We have adjusted our manuscript substantially to address this. Please see detailed comments in the individual Reviewer sections below.

      We would like to thank the reviewers for their thorough examination of our manuscript, constructive criticisms, and helpful suggestions.

      Reviewer #1 (Recommendations For The Authors):

      The work is extensive in my view, and mostly of high quality. See minor comments on some of the figures below.

      Thank you very much.

      Two more major comments :

      • I don't think the C. elegans work adds to - in fact I think it hurts - the statement that this regulatory mechanism is specific to EphB2. I would advise the authors to take it out.

      We agree that C. elegans has a sole Eph receptor called VAB-1 and is therefore not a specific model for EPH2B. However, testing MYCBP2 specificity for EPHB2 was not the goal or our perceived value for the C. elegans experiments. We now clarify this in the text of the Results section.

      Rather, we are providing evidence that the C. elegans ephrin receptor interacts genetically with known MYCBP2/RPM-1 binding proteins. Moreover, we now provide an extensive array of citations to note that genetic enhancer interactions between different RPM-1/MYCBP2 binding proteins is well established. The reviewer has nicely highlighted for us that we handled the C. elegans genetics in too cursory a fashion in our original manuscript. We appreciate this being noted and have now aimed to make this substantially clearer. We hope the reviewer agrees that our revised C. elegans section accomplishes this goal.

      Furthermore, we extensively revised the text of the Results to emphasize a key point: our observation that axon termination defects are not suppressed in vab-1; fsn-1 and vab-1; rpm-1 double mutants excludes the possibility that the VAB-1 Eph receptor is a substrate that is inhibited or degraded by the RPM-1/FSN-1 ubiquitin ligase complex. If the VAB-1 Eph receptor were ubiquitinated and degraded by the RPM-1/FSN-1 complex, we would have observed a suppression of phenotype in vab-1; rpm-1 double mutants. The precedent for this genetic relationship between the RPM-1 ubiquitin ligase and its substrates that are degraded has been established by several prior studies (PMID: 15707898; PMID: 31676756; PMID: 35421092). We now more clearly note that the absence of genetic suppression in vab-1; rpm-1 double mutants and vab-1; fsn-1 double mutants is consistent with the non-canonical stabilizing role of MYCBP2 on EPHB2 that was observed in our biochemical experiments with mammalian cells.

      We also adjusted the text of the manuscript to stress that we are testing genetic interactions between the VAB-1 Eph receptor and known RPM-1 binding proteins. This is a key point, as genetic enhancer interactions are consistent with the Eph receptor functioning in the RPM-1 signaling network. This concept has been well established for RPM-1 binding proteins as now noted in our revised text with an extensive number of additional citations to published work.

      Based on the above arguments, we respectfully disagree with the reviewer that our C. elegans data should be removed from the paper. To re-iterate, we are not trying to evaluate specificity for MYCBP2 and EPHB2 in C. elegans. Rather, our goals are twofold: 1) To ask whether there is an evolutionarily conserved functional genetic link between Eph receptors and known RPM-1 binding proteins. 2) To provide further in vivo genetic evidence invalidating the hypothesis that Ephrin receptors could be ubiquitination substrates that are inhibited/degraded by MYCBP2.

      Text edits reflecting these points are in the abstract, the C. elegans results section starting on line 411, and the discussion on lines 499, 502-504 and 541.

      • The cellular responses are not robust and the effects of MYCBP2 KO - although significant - are minor in most cases. But I don't think more experiments will help here.

      We interpret the comment about the robustness to mean that the extent to which a given cellular response is affected by the loss of MYCBP2 is minor. First, the cellular responses themselves are typical of previous studies and depend on the cellular biology underlying them. For example, a growth collapse of ~50-60% over a background of 10% (Fig. 7) is typical for these sorts of assays (PMID: 37369692; PMID: 33972524; PMID: 17785182). A decrease of cell area by ~25% (Fig. 3) is quite substantial if one considers how much of a cell’s volume is taken up by the nucleus and organelles. Second, the phenotypes elicited by the loss of MYCBP2 are likely brought on by a decrease in EphB2 protein levels, but not its complete absence, as suggested by our biochemical experiment. Given that EphB2 complete loss only affects the cellular responses to a limited extent, the minor effects are not a surprise (e.g. for GC collapse: PMID: 23143520). Nevertheless, the subtle changes in cellular phenotypes, elicited by EPHB2 signaling are often sufficient to achieve proper cell positioning and cell response to guidance cues. For instance, regulation of the growth cone collapse of the outgrowing axons requires delicate changes that are dynamic and temporal.

      Minor:

      Fig 1C - EPHA3 and EPHB2 seem to run in different sizes, is this the case? In 2A they run at the same size.

      We believe this size discrepancy is due to different percentages of SDS-PAGE gels used to resolve proteins. In Fig. 1C, we used a 6% gel for a Western blot analysis of both EPHA3/-B2-FLAG (~130 kDa) and MYCBP2 (~510 kDa). In Fig. 2A however, we performed Western blot analysis using 10% resolving gel to separate and detect EPHA3/-B2-FLAG along with MYC-FBXO45 (~30 kDa). We have reviewed the results obtained from additional biological replicates of this experiment, and observed a similar pattern in gel migration of EPHA3/-B2-FLAG across all replicates.

      Fig1F - I can't trust the MYCBP2 blot.

      Indeed, the MYCBP2-EPHB2 co-IP with endogenous proteins was not convincing. We now repeated this experiment using rat cortical neurons, and the results replace the previous Fig. 1F panel as mentioned on line 158.

      In Fig2b the authors claim that there is enhancement in the binding of MYCBP2 and EPHB2 upon FBXO45 expression. For this type of statement quantification is required.

      The quantification is now included in Fig. 2C and its significance is mentioned on line 180. Our conclusion about the enhancement stands.

      Fig2G - it remained unclear to me where the binding site to MYCBP2 is, how long is the cytoplasmic tail in the DeltaICD protein?

      Based on our experimental observations from Fig. 2E-H, we concluded that the fragment encompassing the extracellular domain(s) and/or transmembrane (TM) domain of EPHB2 is necessary for the protein complex formation with MYCBP2. We would like to accentuate that the EPHB2-MYCBP2 interaction might not be direct, and might involve other transmembrane protein(s) acting as a scaffold for EPHB2 and MYCBP2 binding. We did not pursue experiments to determine the exact region of the extracellular-TM portion of EPHB2 that is required for the interaction with MYCBP2.

      The cytoplasmic tail in ΔICD protein consists of 25 aa of the N-terminal fragment of EPHB2 juxtamembrane (JM) region, which is adjacent to the TM helix, and followed by the 8 aa FLAG tag (EPHB2 ΔICD domain composition: extracellular domains – TM domain – 25 aa fragment of JM region – FLAG). We have determined the TM and JM sequences based on Hedger et al. (PMID: 25779975) and included the N-terminal portion of the JM region to facilitate proper ΔICD protein localization within the plasma membrane (PMID: 35793621). We modified the schematic in Fig. 2G to better visualise the EPHB2 truncations and now provide information on their size in the figure legend.

      Always good to have a model of how all these proteins work together.

      While we acknowledge that this would be helpful, we do not have a clear answer on how the EPHB2-MYCBP2 complex formation occurs. This requires further elucidation of the putative proteins involved in this ternary complex or testing the possibility that a MYCBP2 fragment is extruded extracellularly. Without these experiments there are too many possibilities to summarise into a clear model figure. We thus did not make any edits regarding these possibilities in the section starting on line 195.

      Reviewer #2 (Recommendations For The Authors):

      Overall, the experiments are classical experiments of co-immunoprecipitations, swapping experiments, collapse assays, and stripe assays which all are well carried out and are convincing.

      Thank you for your encouraging comments.

      Controls for the stripe assay may include Fc / Fc stripe assays.

      We have performed these control experiments and now include their quantifications in the results sectioning concerning Fig. 3, starting on line 249, and those concerning Fig. 6 on line 381.

      It is not clear to me why SD and not SEM has been used here for presentations.

      Standard deviation (SD) measures the dispersion of a dataset relative to its mean. The standard error of the mean (SEM) measures how much discrepancy is likely in a sample’s mean compared with the population mean. Thus, SEM includes a statistical inference about the sampling distribution while SD is a less “processed” measurement that by definition is larger than SEM. SEM might make the data look less dispersed and many journals encourage the use of SD in bar graphs (PMID: 16223828).

      Fig 7A: it is rather difficult to see 'branches' in Fig. 7A, better pictures and close-ups should be provided. How are branches defined? This piece of work needs more attention.

      To remedy this shortcoming, we now provide inverted images with GFP signal in dark pixels overlaid on Fc (white) / eB2 (pink) stripes next to the original images.

      Reviewer #3 (Recommendations For The Authors):

      1) My most important suggestion to the authors would be to more carefully describe the results and their interpretation of the results. Sometimes, the distinction is not clear.

      We modified the text throughout the manuscript to address this.

      2) There are several cases, when the authors report on trends that are not statistically significant (1D, for example), or report no change, when it is clear that the addition of one more sample could have dramatically made a difference (4M - see point 12).

      We agree that some of the nonsignificant differences could become significant if we added more Ns. But we prefer not to move our experimental design towards N-chasing and p-hacking (PMID: 25768323). The number of biological replicates is normally pre-determined before the onset of the experiment. Of course, some replicates can be discarded if there is a valid reason, such as a technical issue with the experiment or a positive control not working but this is not relevant for the dataset we have provided.

      3) Data in 1F is very difficult to interpret.

      As in response to Reviewer #1: Indeed, the MYCBP2-EPHB2 co-IP with endogenous proteins was not convincing. We now repeated this experiment using rat cortical neurons, and the improved results are in revised Fig. 1F.

      4) Figure 2 puts Figure 1 in a strange perspective. If I understand correctly, fig 2 claims that EPHB2 interaction with MYCBP2 depends on FBXO45 - if that is the case then how does the binding in Figure 1 occur?

      Indeed, we propose that the EPHB2-MYCBP2 interaction depends on FBXO45. In Fig. 2, we reveal that FBXO45 enhances the formation of the EPHB2-MYCBP2 complex. Thus, we suspect that the endogenous FBXO45 present in HeLa cells and neurons would mediate the interaction between EPHB2 and MYCBP2 in Fig. 1 experiments. We were unable to show this by Western blotting due to lack of reliable commercial antibodies against FBXO45, the complex containing endogenous FBXO45 and EPHB2 is also implied by our AP-MS data (Fig. 1B) and published databases.

      5) I am still trying to wrap my mind around the results in 2G-H. So do MYCBP2 and FBXO45 bind the extracellular domain of EPHBP2? What does that mean?

      (see also our response to Reviewer #1, end of their section) Based on our experimental observations from Fig. 2G-H, we conclude that the fragment encompassing the extracellular domain(s) and/or transmembrane domain of EPHB2 is necessary for the protein complex formation with MYCBP2 and FBXO45. Although there is a possibility that MYCBP2 directly binds the extracellular portion of EPHB2, we have not formally tested this hypothesis. MYCBP2 has been previously shown to interact with the extracellular portion of transmembrane N-cadherin (CDH2) via BioID proximity labeling and AP-MS proteomics approaches (PMID: 32341084).

      Considering the results in Fig. 2A-B, we suspect that EPHB2-MYCBP2 interaction is indirect, as FBXO45 enhances this association. Secretion of FBXO45 and direct binding of FBXO45 to the extracellular cadherin (EC1-2) domains of N-cadherin has been documented (PMID: 25143387; PMID: 32341084). Although, not tested, this is also a possibility for EPHB2-FBXO45 mode of interaction. Nevertheless, we also cannot rule out the possibility that an unknown transmembrane protein binds EPHB2 extracellularly and the same unknown protein binds MYCBP2/FBXO45 intracellularly. Resolving this model is beyond the scope of this study and will require us to pursue extensive new lines of investigation.

      6) I don't understand the stable Hela cell line CRISPR - is this a stable MYCBP2 deletion? In which case why is there only a reduction, not complete elimination of the protein? Or, is this a stable integration of a plasmid generating gRNA against MYCBP2? In which case, I would expect a homozygous null to emerge at some point. In any case, this is not well explained.

      These lines are not derived from single cells infected with the CRISPR sgRNA-carrying viruses, therefore they are not clonal and probably contain some cells that express normal levels of MYCBP2, hence its detection on a Western. This is now clarified starting on line 221 and on line 608.

      7) In 3C - is this the right statistical analysis?? I would say you want to claim the different effect of the control +/- eB2 compared to the effect in the mutant +/- eB2. Still should be significant but I think a more correct analysis.

      We now include this comparison in Fig. 3C as well in the results section starting on line 234.

      8) The robustness of the assay in Figure 3D is underwhelming – how was the area measured?

      This is a live imaging experiment. Fig. 3D plots cell area at 60 minutes after ephrin-B2 addition as a fraction of the same cell’s area at 0 minutes (ephrin-B2 addition). For control cells that is a decrease of ~25%. If one considers that a cell’s nucleus and organelles like the Golgi Apparatus take up most of its volume, the magnitude is not that surprising.

      9) Figure 3F – did you try to plot the relative area of overlap divided by the total cellular area? You might get a more striking phenotype. Also – claiming that this confirms that MYCBP2 is REQUIRED for EPHB2 function is a bit overstated, especially given that we don’t know (do you?) the EPHB2 mutant phenotype in this assay.

      We preferred to stay with the original method of image quantification which we use for other assays. With respect to the requirement of MYCBP2 for EPHB2 function in the stripe assay, our logic is rooted in the observation that native HeLa cells do not respond to ephrin-B2 stripes (45.46 ± 7.62% of cells on eB2 stripes v. Fc; data not shown). When they are transfected with EPHB2 expression plasmids they do, therefore we assume that EPHB2 expression endows them with a sensitivity to eB2 stripes. A loss of MYCBP2 attenuates this sensitivity. We clarified this starting on line 246 and on line 251.

      10) I didn't quite get the difference between 4A and 4B.

      We apologize for the confusion. In Fig 4A, we used a stable HeLa cell line that has tetracycline-inducible expression of EPHB2-FLAG. Using these cells, we subsequently generated CTRLCRISPR or MYCBP2CRISPR cells. In these cells we then induced EPHB2 expression with tetracycline and observed that deletion of MYCBP2 resulted in the reduction of EPHB2 protein levels. To confirm this observation and to rule out the possibility that EPHB2 protein reduction is an effect of the CRISPR lines generation, we tested whereas MYCBP2 deletion reduces EPHB2, which has been transiently overexpressed (Fig. 4B). We hence conclude that loss of MYCBP2 decreases EPHB2 that was either expressed from a stable locus (Fig. 4A) or from transient transfection (Fig. 4B). We modified the Results section starting on line 262 to make this point clear.

      11) The entire link to lysosomal degradation should be strengthened. Perhaps I am confused, but if the reduced EPHB2 levels in MYCBP2 mutant cells result from impaired lysosomal degradation then inhibiting the lys-deg should bring the protein levels back to normal (i.e. CRISPR control) - no? As currently presented, I do not understand nor do I think the claim is strongly supported by the data.

      Before treatment with inhibitors, EPHB2 levels in MYCBP2CRISPR cells are already 40% lower than they are in CTRLCRISPR cells and in all our attempts, inhibitors can only rescue/restore EPHB2 in MYCBP2CRISPR cells to a level that is lower than in CTRLCRISPR cells. But this restoration is greater in MYCBP2CRISPR than in MYCBP2CTRL cells (BafA1: 19% increase in CTRL cells and 40% in MYCBP2CRISPR cells; CoQ: 10% comparing to 35%). This indicates that EPHB2 degradation through the lysosomal pathway in MYCBP2CRISPR cells is stronger, explaining why EPHB2 degradation is promoted in MYCBP2CRISPR cells, compatible with reduced EPHB2 levels and enhanced EPHB2 ubiquitination.

      12) 4M, O - reporting ns based on these data seems a bit strange to me... Add one point and it will be strongly significant.

      See our response to point (2), above. We prefer not to invoke potential p-hacking.

      13) 7d - so what are you claiming? That the cellular response to eB1 but not eB2 is affected by the addition of FBD1? this is almost the opposite of what you wrote in the text...

      We treated the cells with two different ephrin-B ligands to make a stronger conclusion. When using ephrin-B1, growth cone collapse in FBD1 WT is not significant comparing to Fc treatment. When using ephrin-B2, growth cone collapse in FBD1 WT is not as significant as it is in FBD1 mut group (* versus ). We interpret this as meaning that the EPHB2-mediated growth cone collapse to both ligands is dampened, when we disrupt the EPHB2-MYCBP2 association. The difference between these two ligands might be due to their different affinities for the receptor or signalling kinetics.

      14) By far the weakest link in this paper is the worm part. I think it's a pity because strengthening this would affect the significance of the finding. First, the authors mention new genes without introducing their relationship to the signaling pathway tested. Second, the textual logics should be strengthened. Finally and most importantly, when the difference between the phenotypic severity is so strong (vab-1 and rpm-1) then I think it's impossible to say anything from the double mutant.

      We appreciate the reviewer noting that they appreciate the value and importance of the C. elegans model. The goals of our C. elegans experiments were twofold:

      1) To evaluate genetic interactions between the VAB-1 Eph receptor and known RPM-1 binding proteins. This was not clearly explained in the original manuscript nor was the published precedent for these types of genetic enhancer experiments provided. We have now rectified this by substantially revising the text of the Results C. elegans section starting on line 431 and by adding several citations.

      2) Our C. elegans genetics confirmed that the VAB-1 Eph receptor is not inhibited/degraded by the RPM-1/MYCBP2 ubiquitin ligase complex. We have now revised the text to draw this point out more clearly.

      To further address the reviewer’s concerns, we have added a new schematic (Fig. 8A) to show the relationship between the RPM-1 and the RPM-1 binding proteins (FSN-1/FBXO45 and GLO-4/SERGEF) we are testing. We chose FSN-1 because it is part of the RPM-1 ubiquitin ligase complex and we chose GLO-4 because it functions outside the context of RPM-1 ubiquitin ligase signaling via the GLO-1 Rab GTPase to influence late endosomal/lysosomal biogenesis.

      Regarding the reviewer’s concern that different penetrance/frequency of defects between rpm-1 mutants and vab-1 mutants means outcomes with vab-1; rpm-1 double mutants cannot be interpreted. We respectfully disagree. An extensive number of published studies have demonstrated that RPM-1 binding proteins have milder phenotypes than rpm-1 mutants and display genetic enhancer effects as double mutants with one another (PMID:17698012, PMID: 22357847, PMID: 25010424, PMID: 24810406). We now make this point much more clearly. While the frequency of axon termination defects in rpm-1 mutants is high it is not completely saturated as the defect is not 100%. Moreover, a major point of the vab-1; rpm-1 double mutants is that they do not have a significant reduction in phenotypic penetrance/frequency. Thus, our system is fully capable of resolving genetic suppression, which did not occur. We now make this point much more carefully and clearly.

      To further address the reviewer’s concern, we have softened language about the VAB-1/Eph receptor functioning in the same pathway as RPM-1 throughout the manuscript. While we think this is still the case, because the frequency of axon termination defects is not fully saturated in rpm-1 mutants and defects could potentially become more severe (i.e. the hook might occur closer to the head of the animal rather than in the midbody). Nonetheless, this is not a critical point and we think it is more important to be clear about the two major goals and objectives of our C. elegans experiments. We hope the reviewer agrees that our rationale, logic and conclusions are more clearly and accurately drawn in the revised paper.

    1. Reviewer #3 (Public Review):

      Summary:

      This manuscript develops a new method termed MINT for decoding of behavior. The method is essentially a table-lookup rather than a model. Within a given stereotyped task, MINT tabulates averaged firing rate trajectories of neurons (neural states) and corresponding averaged behavioral trajectories as stereotypes to construct a library. For a test trial with a realized neural trajectory, it then finds the closest neural trajectory to it in the table and declares the associated behavior trajectory in the table as the decoded behavior. The method can also interpolate between these tabulated trajectories. The authors mention that the method is based on three key assumptions: (1) Neural states may not be embedded in a low-dimensional subspace, but rather in a high-dimensional space. (2) Neural trajectories are sparsely distributed under different behavioral conditions. (3) These neural states traverse trajectories in a stereotyped order.

      The authors conducted multiple analyses to validate MINT, demonstrating its decoding of behavioral trajectories in simulations and datasets (Figures 3, 4). The main behavior decoding comparison is shown in Figure 4. In stereotyped tasks, decoding performance is comparable (M_Cycle, MC_Maze) or better (Area 2_Bump) than other linear/nonlinear algorithms (Figure 4). However, MINT underperforms for the MC_RTT task, which is less stereotyped (Figure 4).

      This paper is well-structured and its main idea is clear. The fact that performance on stereotyped tasks is high is interesting and informative, showing that these stereotyped tasks create stereotyped neural trajectories. The task-specific comparisons include various measures and a variety of common decoding approaches, which is a strength. However, I have several major concerns. I believe several of the conclusions in the paper, which are also emphasized in the abstract, are not accurate or supported, especially about generalization, computational scalability, and utility for BCIs. MINT is essentially a table-lookup algorithm based on stereotyped task-dependent trajectories and involves the tabulation of extensive data to build a vast library without modeling. These aspects will limit MINT's utility for real-world BCIs and tasks. These properties will also limit MINT's generalizability from task to task, which is important for BCIs and thus is commonly demonstrated in BCI experiments with other decoders without any retraining. Furthermore, MINT's computational and memory requirements can be prohibitive it seems. Finally, as MINT is based on tabulating data without learning models of data, I am unclear how it will be useful in basic investigations of neural computations. I expand on these concerns below.

      Main comments:

      1. MINT does not generalize to different tasks, which is a main limitation for BCI utility compared with prior BCI decoders that have shown this generalizability as I review below. Specifically, given that MINT tabulates task-specific trajectories, it will not generalize to tasks that are not seen in the training data even when these tasks cover the exact same space (e.g., the same 2D computer screen and associated neural space).

      First, the authors provide a section on generalization, which is inaccurate because it mixes up two fundamentally different concepts: 1) collecting informative training data and 2) generalizing from task to task. The former is critical for any algorithm, but it does not imply the latter. For example, removing one direction of cycling from the training set as the authors do here is an example of generating poor training data because the two behavioral (and neural) directions are non-overlapping and/or orthogonal while being in the same space. As such, it is fully expected that all methods will fail. For proper training, the training data should explore the whole movement space and the associated neural space, but this does not mean all kinds of tasks performed in that space must be included in the training set (something MINT likely needs while modeling-based approaches do not). Many BCI studies have indeed shown this generalization ability using a model. For example, in Weiss et al. 2019, center-out reaching tasks are used for training and then the same trained decoder is used for typing on a keyboard or drawing on the 2D screen. In Gilja et al. 2012, training is on a center-out task but the same trained decoder generalizes to a completely different pinball task (hit four consecutive targets) and tasks requiring the avoidance of obstacles and curved movements. There are many more BCI studies, such as Jarosiewicz et al. 2015 that also show generalization to complex real-world tasks not included in the training set. Unlike MINT, these works can achieve generalization because they model the neural subspace and its association to movement. On the contrary, MINT models task-dependent neural trajectories, so the trained decoder is very task-dependent and cannot generalize to other tasks. So, unlike these prior BCIs methods, MINT will likely actually need to include every task in its library, which is not practical.

      I suggest the authors remove claims of generalization and modify their arguments throughout the text and abstract. The generalization section needs to be substantially edited to clarify the above points. Please also provide the BCI citations and discuss the above limitation of MINT for BCIs.

      2. MINT is shown to achieve competitive/high performance in highly stereotyped datasets with structured trials, but worse performance on MC_RTT, which is not based on repeated trials and is less stereotyped. This shows that MINT is valuable for decoding in repetitive stereotyped use-cases. However, it also highlights a limitation of MINT for BCIs, which is that MINT may not work well for real-world and/or less-constrained setups such as typing, moving a robotic arm in 3D space, etc. This is again due to MINT being a lookup table with a library of stereotyped trajectories rather than a model. Indeed, the authors acknowledge that the lower performance on MC_RTT (Figure 4) may be caused by the lack of repeated trials of the same type. However, real-world BCI decoding scenarios will also not have such stereotyped trial structure and will be less/un-constrained, in which MINT underperforms. Thus, the claim in the abstract or lines 480-481 that MINT is an "excellent" candidate for clinical BCI applications is not accurate and needs to be qualified. The authors should revise their statements according and discuss this issue. They should also make the use-case of MINT on BCI decoding clearer and more convincing.

      3. Related to 2, it may also be that MINT achieves competitive performance in offline and trial-based stereotyped decoding by overfitting to the trial structure in a given task, and thus may not generalize well to online performance due to overfitting. For example, a recent work showed that offline decoding performance may be overfitted to the task structure and may not represent online performance (Deo et al. 2023). Please discuss.

      4. Related to 2, since MINT requires firing rates to generate the library and simple averaging does not work for this purpose in the MC_RTT dataset (that does not have repeated trials), the authors needed to use AutoLFADS to infer the underlying firing rates. The fact that MINT requires the usage of another model to be constructed first and that this model can be computationally complex, will also be a limiting factor and should be clarified.

      5. I also find the statement in the abstract and paper that "computations are simple, scalable" to be inaccurate. The authors state that MINT's computational cost is O(NC) only, but it seems this is achieved at a high memory cost as well as computational cost in training. The process is described in section "Lookup table of log-likelihoods" on line [978-990]. The idea is to precompute the log-likelihoods for any combination of all neurons with discretization x all delay/history segments x all conditions and to build a large lookup table for decoding. Basically, the computational cost of precomputing this table is O(V^{Nτ} x TC) and the table requires a memory of O(V^{Nτ}), where V is the number of discretization points for the neural firing rates, N is the number of neurons, τ is the history length, T is the trial length, and C is the number of conditions. This is a very large burden, especially the V^{Nτ} term. This cost is currently not mentioned in the manuscript and should be clarified in the main text. Accordingly, computation claims should be modified including in the abstract.

      6. In addition to the above technical concerns, I also believe the authors should clarify the logic behind developing MINT better. From a scientific standpoint, we seek to gain insights into neural computations by making various assumptions and building models that parsimoniously describe the vast amount of neural data rather than simply tabulating the data. For instance, low-dimensional assumptions have led to the development of numerous dimensionality reduction algorithms and these models have led to important interpretations about the underlying dynamics (e.g., fixed points/limit cycles). While it is of course valid and even insightful to propose different assumptions from existing models as the authors do here, they do not actually translate these assumptions into a new model. Without a model and by just tabulating the data, I don't believe we can provide interpretation or advance the understanding of the fundamentals behind neural computations. As such, I am not clear as to how this library building approach can advance neuroscience or how these assumptions are useful. I think the authors should clarify and discuss this point.

      7. Related to 6, there seems to be a logical inconsistency between the operations of MINT and one of its three assumptions, namely, sparsity. The authors state that neural states are sparsely distributed in some neural dimensions (Figure 1a, bottom). If this is the case, then why does MINT extend its decoding scope by interpolating known neural states (and behavior) in the training library? This interpolation suggests that the neural states are dense on the manifold rather than sparse, thus being contradictory to the assumption made. If interpolation-based dense meshes/manifolds underlie the data, then why not model the neural states through the subspace or manifold representations? I think the authors should address this logical inconsistency in MINT, especially since this sparsity assumption also questions the low-dimensional subspace/manifold assumption that is commonly made.

      References

      Weiss, Jeffrey M., Robert A. Gaunt, Robert Franklin, Michael L. Boninger, and Jennifer L. Collinger. 2019. "Demonstration of a Portable Intracortical Brain-Computer Interface." Brain-Computer Interfaces 6 (4): 106-17. https://doi.org/10.1080/2326263X.2019.1709260.

      Gilja, Vikash, Paul Nuyujukian, Cindy A. Chestek, John P. Cunningham, Byron M. Yu, Joline M. Fan, Mark M. Churchland, et al. 2012. "A High-Performance Neural Prosthesis Enabled by Control Algorithm Design." Nature Neuroscience 15 (12): 1752-1757. https://doi.org/10.1038/nn.3265.

      Jarosiewicz, Beata, Anish A. Sarma, Daniel Bacher, Nicolas Y. Masse, John D. Simeral, Brittany Sorice, Erin M. Oakley, et al. 2015. "Virtual Typing by People with Tetraplegia Using a Self-Calibrating Intracortical Brain-Computer Interface." Science Translational Medicine 7 (313): 313ra179-313ra179. https://doi.org/10.1126/scitranslmed.aac7328.

      Darrel R. Deo, Francis R. Willett, Donald T. Avansino, Leigh R. Hochberg, Jaimie M. Henderson, and Krishna V. Shenoy. 2023. "Translating Deep Learning to Neuroprosthetic Control." BioRxiv, 2023.04.21.537581. https://doi.org/10.1101/2023.04.21.537581.

    1. Author Response

      We outline reviewer/editor queries, our responses are indicated below we thank the reviewers for their suggestions that we address below and with minor edits (that do not appreciably change the content such as figure lettering and methods information).

      Reviewer #1 (Public Review):

      The paper by Dongsheng Xiao, Yuhao Yan and Timothy H Murphy presents a timely approach to record neuronal activity at multiple temporal and spatial scales. Such approaches are at the forefront of system neuroscience and a few examples include, among others, fMRI alongside electrophysiology (Logothetis et al, 2021. Nature) or widefield calcium imaging (Lake et al, 2020. Nat Meth) , or functional ultrasound imaging and multi unit recording (Claron et al, 2023 Cell Reports), The method presented here combines "low resolution" (i.e. cortical regions) widefield calcium imaging across most of the dorsal portions of the murine cortex combined with electrical recording of single neurons in specific cortical and subcortical locations (as a matter of fact, this later components can be used everywhere in the murine brain).

      The method presented here is straightforward to implement and very well documented. Examples of novel insights that this approach can generate are well presented and demonstrate the strength of the presented approach, some aspects of the analysis require clarification.

      For example, the author reveal Spike-Triggered average cortical activation Maps (STMs) linked to the activity of single neurons (Figs 4 and 5) This allows to directly asses the functional connectivity between cortical and sub-cortical areas. It nevertheless unclear what is the stability of the established relationships. The nature of the "recordings" in Fig 4. is unclear. It looks like these are imaging sessions on the same day, the length of these recordings as well as the interval between them is not stated. It will be fundamental to build a metric to compare STMs variability across sessions/recordings/days; a root-mean-square from an average map across all recordings could provide a starting point.

      Our goal was to present a well-documented protocol for implanting electrodes (tetrodes and peripheral nerve) that do not impede cortical mesoscale imaging and support chronic investigation of spike trains. We do provide examples of repeated spiking measurements across days from the same electrodes and animals. Unfortunately, due to the pandemic interrupting data collection and other factors, this dataset does not contain a thorough analysis of response longevity using these electrodes, but we do show examples in the figures. In Figure 1F, G, we showed that the single unit activity was relatively stable during one week, two weeks, and two months of recordings after implantation. In Figure 4B we showed spiking activity in the hippocampus was stable across day 8 and day 9. We also showed that the STM of the hippocampus neuron was consistently associated with the RSP, BCS, and M2 region for 10 recording sessions across days. In Figure 4D, We showed that the STMs of a midbrain neuron were relatively stable over 2 months. The spiking activity of the neuron on different days was consistently correlated with the lower limb, upper limb, and trunk sensorimotor areas on both hemispheres of the cortex.

      Also with respect to the STMs analysis, the data-driven choice of 10 clusters might need a bit more explorations. While the silhouette clustering accuracy peaks at 10 (Fig 5A), this metrics comes without a confidence intervals making it difficult to know if a difference of less than 10% (i.e. 11 or 13 clusters) should be deemed different. Maybe a bootstrapping approach could be used here to build such confidence intervals. Another approach to reach the number of cluster to use could be based on "consensus" between different partitioning algorithms (e.g. Strehl, A. & Ghosh, J. itions. J. Mach. Learn. Res. 3, 583-617 (2001). A much stronger argument should be provided to use the 0.3 correlation cutoff value which seems to be arbitrarily low. The main point here is that the authors should show that their conclusions hold within a range of parameter values (number of clusters and correlation threshold).

      Thank you for the interesting suggestions regarding cluster numbers. We agree that the number (10 clusters) could be taken as an arbitrary value. However, we have done previous work examining cortical connectivity maps in Mohajerani et al. 2013 Nature Neurosci. and found that cortical mesoscale activity has a degree of freedom (number of unique elements) in the range of 10-15. This number is also supported by major structural networks found by the Allen Brain Connectivity Atlas and within functional imaging data. In other work using unsupervised methods Xiao et al. 2021 Nature Comm a similar number of clusters were identified so these numbers are without some basis.

      Reviewer #1 (Recommendations For The Authors):

      I enjoyed very much reading the manuscript!

      Minor comments (aesthetics and typos)

      Please clarify how the hemodynamic correction was performed. The text refers to "substracted". This usually involves the computation of a general of per-pixel weight. Is this correction constant along the longitudinal imaging session (i.e. over weeks)?

      The hemodynamic correction was calculated based on the results of each daily session. Typically these corrections have minimal impact on overall values and are not expected to appreciably change over time.

      In Figure 3, authors might reconsider scaling down the size of panel A and enlarging the data presented in D. Also, with respect to panel D, what does the gray band represent, confidence intervals, standard dev? Please clarify.

      The gray bands correspond to the standard deviation of random trigger average traces.

      Lines in 4E could be made thicker.

      In the caption of fig6, panel D is mentioned twice (should be E).

      Thanks for catching this mistake we have changed the caption in the online version.

      Reviewer #2 (Public Review):

      The article presents 'Mesotrode,' a technique that integrates chronic widefield calcium imaging and electrophysiology recordings using tetrodes in head-fixed mice. This approach allows recording the activity of a few single neurons in multiple cortical/subcortical structures, in which the tetrodes are implanted, in combination with widefield imaging of dorsal cortex activity on the mesoscale level, albeit without cellular resolution. The authors claim that Mesotrode can be used to sample different combinations of cortico-subcortical networks over prolonged periods of time, up to 60 days post-implantation. The results demonstrate that the activity of neurons recorded from distinct cortical and subcortical structures are coupled to diverse but segregated cortical functional maps, suggesting that neurons of different origins participate in distinct cortico-subcortical pathways. The study also extends the capability of Mesotrode by conducting electrophysiological recordings from the facial motor nerve. It demonstrates that facial nerve spiking is functionally associated with several cortical areas( PTA, RSP, and M2), and optogenetic inhibition of the PTA area significantly reduced the facial movement of the mice.

      Studying the relationship between widefield cortical activity patterns and the activity of individual neurons in cortical and subcortical areas is very important, and Murphy's lab has been a pioneer in the field. However, the choice of low-yield recording methods (tetrode) instead of more high-yield recording techniques, such as silicon probes, makes the approach presented in this study somewhat less appealing. Also, the authors claim that a tetrode-based approach can allow chronic recordings of single neural activity over days - a topic that is very controversial. In terms of results, I was under the impression that most of the conclusions presented in the bulk of the paper ( Figures 1-5) are very similar to what previous work from Murphy's lab and other labs has shown using acute preparation. In this respect, the paper can benefit from a more in-depth analysis of the heterogeneity of single-neuron functional coupling. The last part of the facial nerve recording is interesting (Figure 6), but I think it can be integrated better into the rest of the paper.

      Reviewer #2 (Recommendations For The Authors):

      Major Comments:

      1) The methodology described in the paper is based on chronic tetrode recordings combined with widefield calcium imaging. The authors emphasize the advantages of using tetrodes in that they are 1) easy to implant 2) have a small footprint, and 3) allow to record the same neurons over days.

      I agree regarding the first advantage, however, the ability to reliably record the activity of the same neurons over days using electrophysiological recordings is controversial. The authors claim that:

      'We found that the single unit activity was relatively stable, during one week, two weeks, and two months of recordings after implantation (Figure 1F, G)',

      The only 'proof' the authors show for recording stability are waveforms of one neuron on one channel (out of presumably four channels), which seem to differ in amplitude over days. Two-dimensional plots of the neuron waveform for all channel combinations could be a more convincing way to make this claim. But, as I already mentioned - the ability to record from the same neurons chronically with electrophysiological methods is rather controversial, especially with tetrodes that don't allow for laminar profiling of neuronal response to account for a potential drift over time.

      We now make it more clear that examples of mesotrode stability are indicated in the figures. Furthermore, we acknowledge caveats that spike sorting experiments required to more conclusively identify single neurons would be improved with larger format silicon probes. Our work employs compact tetrode electrodes that permit simultaneous resolution of single units and mesoscale GCAMP activity. It is conceivable that improvements in spike sorting fidelity could be made by switching to more densely spaced silicon probes. While this is an obvious advantage, these probes do not have a compact footprint and would interfere with regional imaging.

      2) The authors present little analysis justifying the advantage of conducting chronic electrophysiological recordings instead of acute recordings with their data. In fact, throughout the paper, the authors mention that the results were consistent with their previous work with acute recordings. The only longitudinal analysis in this paper is qualitative and suggests that cortical maps were stable over days. I believe this was also shown in the past already. More in depth analysis of across days dynamics or showcase of an experiment centered on across days dynamics will strengthen the appeal of this approach. Generally speaking, there is very little quantitative analysis of longitudinal maps/functional coupling of single neurons over days. The paper will benefit from at least some quantification of this part.

      To our knowledge data showing the persistence of spike-associated maps longer than an acute experiment is novel. However, due to a low yield of recorded single neurons, we have not been able to follow these maps over a longer period in a population that would permit group statistics. We suggest that future experiments could be done using silicon probes with larger yields which would help to better align electrophysiological features with mesoscale GCAMP maps.

      3) Recording with tetrodes gives very low yields compared to silicon probe recordings. While silicon probes have a larger footprint and may occlude the widefield imaging on the side of the silicon probe implant, it is unclear why not to use denser electrode arrays on one side of the brain and image from the other hemispheres, given that the maps are very correlated across hemispheres

      Taking advantage of mirrored activity in the opposite hemisphere is a great idea. Future studies could include experiments that would take advantage of bilateral symmetry by placing high-resolution silicon probes in one hemisphere and then reading out mesoscale maps in the other.

      4) The advantage of the electrophysiological recordings is in providing access to single-neuron activity at high temporal resolution. The authors could add more quantifications regarding individual neuron functional coupling diversity. For instance, in the per-area distributions in Figure 5D -- did all neurons from a given area participate in the same functional maps, or did different neurons show diversity in the functional coupling. Did simultaneous recordings of neurons from the same tetrode show more similar maps, than recordings of other neurons from the same area conducted on different days/in different animals? Did the map differ when the neurons were bursting/were at specific phases of the LFP, etc.

      Unfortunately the yield of neurons was not enough to investigate some of the interesting state-dependent phenomena the reviewer describes. In previous work we have examined heterogeneity between single neuron responses in more detail Xiao et al. 2027 in acute work.

      5) Facial nerve stimulation. This part feels detached from the rest of the paper and is not explained/discussed in sufficient detail. For example, there is no description of the surgical procedure or the electrode used for facial nerve recordings in the Methods (in the Results section, the authors mention 'micro-wires', but the Method section only contains information about tetrodes).

      Thank you for bringing up the issue of surgical details for facial nerve experiments are now in the methods. This information is also available by contacting the authors and below.

      For facial nerve recordings, peripheral nerve activity was measured by fine wire recording directly from the nerves subserving the whisker. During surgery, mice will be anesthetized and positioned on a warming pad connected to a rectal probe, and the temperature maintained at 37 °C. A skin incision was made, exposing a small part of the buccal branch of the left facial nerve. Magnification of the surgical field with a dissecting microscope allowed a careful dissection of a nerve branch with minimum disruption of the tissues and blood supply surrounding the nerve. The appropriate site of exposure was determined by using two projection lines: a vertical line running downward, posterior from the outer corner of the eye, and a horizontal line running in the caudal direction, starting at the whisker E-row. Then two insulated fine wires (about 25 µm tips) were hooked and placed around the nerve separated about 2 mm from one another. The insulation at the ends of the wires was removed and a knot was made on each wire to prevent it from slipping. The opposite ends of each wire were soldered to a mini connector attached by dental cement to the skull. Finally, 6-0 silk sutures were used to close the skin incisions.

      The functional maps associated with facial nerve spiking show different patterns from the optogenetic stimulation maps that led to significant facial nerve responses. Specifically, the STM maps show responses in the posterior parts of the cortex, but the photostimulation map showed almost an opposite pattern, where the effects were observed in the anterior parts. The authors do not discuss this mismatch in sufficient detail. Further, the authors refer to area PTA but use partitions based on the Allen Institute, which does not indicate this area.

      The posterior parietal area location is based on our previous work Mohajerani et al. 2013 and using the Allen Institute Brain Atlas for guidance.

      Minor comments

      6) The authors mention that "on average, we obtained 3-5 neurons per tetrode implanted, and this yield was consistent across regions (Figure 2C). " -- for how long, on average, could the authors record single-neuron activity from each tetrode?

      The 3-5 neurons obtained per tetrode were recorded 1 week after tetrode implantation.

      7) Figure 4B - it is unclear what the labels "recording 1, ...5, " correspond to. Are these different recording sessions within the same day "day 8"?

      The labels "recording 1, ...5, " correspond to different recording sessions within the same day.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      __Reviewer #1 (Evidence, reproducibility and clarity (Required)): __

      The manuscript investigates the role of PAT1 gene family in Arabidopsis thaliana. Though the PAT1 protein has been previously investigated and displayed immune-related and developmental phenotypes, the other two members of the family, PATH1 and PATH2, have not been well studied. The authors set out to understand the role of these proteins in relation to the role of PAT1. They thus generated single, double, and triple mutants of the possible combinations of PAT1 genes and examined their phenotypes. As the study focused on the developmental effects of PAT1, the mutants were generated on the background of the summ2 mutant to avoid phenotypes related to immune response. The authors notice a developmental difference between the pat1 mutant combinations, suggesting that PAT1 acts differently than PATH1 and PATH2 and that the PATH proteins serve a redundant function. They also performed RNA-seq analysis to identify differentially-regulated genes in the mutant combinations. The study is interesting and well-executed, yet I believe some questions should still be addressed:

      __Our response: __We thank the reviewer for acknowledging the significance of our findings. Please see our detailed answers to the reviewer’s suggestions in the following.

      1. The research mainly focuses on the developmental phenotype of pat mutants but also tests the interaction of PATH proteins with RNA decapping enzymes to check their function and localization during different treatments. I found it a bit confusing since Figure 1 also shows the developmental phenotype of the mutants. I think editing the order of the figures would make the overall story more coherent.

      __Our response: __We agree with the reviewer thus we moved old Fig 1C to new Fig 3A, we believe the new figure orders make the overall story more coherent.

      My main concern is the correlation between the developmental phenotype of the mutants and the gene expression. Leaf samples for RNA extraction were taken when the plants were 6 weeks old, and the developmental phenotype is very evident. It is thus not possible to tell whether the differences in gene expression are a cause or effect of the developmental phenotype. I think performing qPCR of selected candidates at earlier developmental times might help solve this issue, as well as the characterization of younger plants for the developmental phenotypes (such as leaf number).

      __Our response: __We followed the reviewer’s suggestions and performed qRT-PCR on IAA19, IAA29, SAUR23 and PIL2 in pats mutants under different developmental stages (Line 162, 169; Fig S4), we also characterized leaf number of pats mutants from younger stages (Line 109; new Fig 3C).

      Overall, the manuscript is missing data regarding replicate numbers in the IP and confocal microscopy experiments.

      __Our response: __We thank the reviewer for pointing this it out, the replicate numbers are provided now in our new figure legends.

      Minor comments:

      1. Figure 1C - the authors should add a picture of Col0 plants as well as the mutants.

      Our response: To be reader friendly, the picture of Col-0 plant is added in Fig S1A. For the reviewer’s information, plant pictures in FigS1A and old Fig1C (new Fig 3A) were taken at the same time. 2.

      Figure 3 - Calculating the leaf-to-petiole ratio in the different mutants would be good.

      Our response: We now calculate PBR (petiole blade ratio) of all pats mutants in Fig3F (Line 121).

      Figure 4 - the details in the figure are very unclear, especially in the PCA. It would be good to display the data in 2D for PC1 and PC3 and change the colors a bit.

      Our response: We agree with the reviewer; thus, we remade the PCA plot from RNA-seq reads data in a 2D style and also changed the colors for each mutant (Fig 4A). We need to point out that the PCs number also changed because the old PCA plot were made by mistake from expression data.

      Reviewer #1 (Significance (Required)): Both PATH proteins have been less investigated than PAT1, and in that sense, the work is novel. However, it seems that most of the phenotype is attributed to PAT1 rather than the other family members, limiting the interest to the broad plant science community.

      Our response: We appreciate the reviewer think our work is novel. We agree that PAT1 plays the main role during plant development (old Line 171), however the pat triple mutant exhibit the most severe dwarfism as well as the most mis-regulated genes compared to any single or double mutants, indicating all 3 PATs are essential for development.

      __Reviewer #2 (Evidence, reproducibility and clarity (Required)): __

      Zuo et al., characterize the role of three cytoplasmic mRNA-decay activator proteins PAT1, PATH1 and PATH2 in the context of plant development and leaf morphology in Arabidopsis thaliana and Nicotiana benthamiana. The authors show that the triple pat mutant displays the most severe dwarfism of all combinatorial mutants. Through treatment with different stimulants the authors found that only IAA treatment induces the three homologues to form condensates (possibly PBs), while PAT1 forms condensates upon every tested stimulus. An extensive RNA seq experiment revealed miss-regulation of several hundred genes in the higher order mutants, several of which were involved in auxin responsive and leaf morphology determinant genes.

      __Our response: __We thank the reviewer for the peer review. Please see our detailed answers to the reviewer’s suggestions in the following.

      Major points: 1.Title is not meaningful as is and, in my opinion, does not reflect the main findings in the manuscript.

      Our response: We now changed our title into “PAT mRNA decapping factors are required for proper development in Arabidopsis”.

      The results section could benefit from improved flow between the paragraphs and more reasoning for the next steps taken to help readers understand the aims of the authors.

      Our response: We followed the reviewer’s suggestion and modified the wording in our result part(Line 79,81,94,146-151).

      L46: "So far little is known about the functions of these three PATs in plant development.", The authors themselves have studied these proteins in the context of seed germination and ABA control, as well as apical hook formation and auxin responses. Should at least be mentioned and the results discussed in this context.

      Our response: We thank the reviewer for noticing our other work and we now included this information in the new introduction and discussion part (Line56&237).

      What are the expression levels and patterns of PATH1 and PATH2 compared to PAT1? Is anything known about spatial or temporal regulation of these proteins?

      Our response: All three PATs are expressed in roots, stems, leaves, flowers, siliques, and seeds during the whole developmental stages, PAT1 has higher expression level in leaves but lower expression levels in petals. (Klepikova et al., 2016;

      https://www.arabidopsis.org/servlets/TairObject?id=138009&type=locus for PAT1; https://www.arabidopsis.org/servlets/TairObject?id=38646&type=locus for PATH1 and https://www.arabidopsis.org/servlets/TairObject?id=128694&type=locus for PATH2).

      Figure 1:

      o I do not agree that the authors have shown that "PATH1 and PATH2 are also mRNA decapping factors", rather that these proteins can co-localize (and possibly interact) with LSM1. Decapping assays for example with the known PAT1 de-capping targets from their previous work and their extensive mutant collection could be used to test this.

      Our response: We thank the reviewer for pointing it out and reminding us about the characterized mRNA decapping target from our previous work, we now include the decapping assays in new Fig5 (Line 197).

      From the BiFC experiment (Figure 1B) it looks like PATs are mostly soluble in the cytoplasm (like LSM1) and might be stress-induced components of PBs (like LSM1). Do PATs co-localize with other canonical PB markers that are more prone to condensation, like DCPs or VCS? BiFC could be performed after IAA treatment to confirm that the cytoplasmic foci are indeed LSM1-positive PBs.

      Our response: We agree with the reviewer that PATs behave more like LSM1. Given time limit of the project, we unfortunately are not able to check the colocalization of PATs with DCPs or VCS. However, we performed BIFC after IAA treatment, and the cytoplasmic foci are indeed LSM1-positive foci (new Fig1B).

      A: please provide uncropped images of all Western blots in supplemental data.

      Our response: To be reader friendly, we decide to show the original western blots here (see in the file named "RC-Full-revision"), instead of in supplemental data. However, we will leave the final decision to the editor.

      I applaud the authors for establishing this great higher order mutant collection that will be very useful for researchers in the field. However, I am confused about the description of these mutants. If I understood it correctly, these mutants were already used in a previous study by the authors, namely “Zuo, Z., et al., Molecular Plant-Microbe Interactions, 35(2), 125-130.” & Zuo, Z., et al., (2021). FEBS letters, 595(2), 253-263.” In this study the authors refer to a BioRxiv “Zuo, Z., et al., (2019).” As the reference for these Arabidopsis lines. Is this current manuscript a continuation of the BioRxiv? Please elaborate whether these lines have been used and described In previous studies.

      Our response: We truly appreciate the reviewer for acknowledging the significance of our work. These pats mutants have been used in the FEBS letters paper (2021), MPMI paper (2022), and the new published paper in Life Science Alliance (2023, but preprinted in BioRxiv 2019 and 2022). However, they have not been fully described or characterized in any of the mentioned published stories. Characterization of these pats mutants were originally only included in preprint 2019 which was cited in FEBS letters paper (2021) and MPMI paper (2022).

      L72: Is the strong developmental phenotype of the higher order mutants persistent under long day conditions? Considering the strong developmental phenotypes of the mutants, the flowering transition and morphology could be an interesting trait to study. Why did you choose short day conditions for this study?

      Our response: The pat triple mutant also has strong developmental phenotype under long day condition and exhibits early flowering phenotype. We are currently preparing a manuscript regarding mRNA decay and flowering. We did not “choose” short day condition, we just started with short day condition and observed phenotypical differences hence we kept this condition.

      L78: This statement is hard to see in Figure 1C and best described for Figure 3A.

      Our response: We now change this statement for Fig 3.

      L82: Please include a reasoning for testing PATs localization after hormone treatment. Do you have any indication that other PB proteins behave similar to either PAT1 or the PATHs after hormone treatment to substantiate that these foci observed are indeed PBs? What is known about PBs after hormone treatment in planta?

      Our response: We were interested in investigating if all three PAT proteins may also form PBs in Arabidopsis thus we tested PATs localization with/without hormone treatment (old Line 84, new line 81). For the reviewer’s interest we also observe LSM1 localization after hormone treatment (Fig 2). PBs have been published to respond to light, cold treatment, PAMPs, ABA, ACC and auxin (Line 39-42).

      Figure 2:

      o How does the localization of LSM1 change under the same treatments? Does ist behave like PAT1 or the homologues?

      Our response: Please see our new Fig 2 for LSM1 localization, and it behaves more like PAT1.

      Which part of the root was imaged for this experiment? Is it possible that the observed foci are ARF-condensates as reported by Jing et al., 2022? Do you observe a gradual change in numbers or morphology along the root?

      Our response: We use root elongation zone for this experiment. We don’t know if the foci are ARF-condensates, but it’s possible to study in the future. If the reviewer is interested, we are happy to share our materials. We do observe more foci in the cell division zone and less in the mature zone.

      How did the authors decide on the concentrations for the stimulant treatments? Have you tried different doses, and could the responses be dose-dependent?

      Our response: We did not try different doses; we searched for and applied the commonly used concentrations for different hormones.

      A representative image is not sufficient for quantitative responses, like RNA granule condensation. Please provide a quantification of stimulant-induced foci after the different treatments.

      Our response: Please see the quantification in our new Fig 2.

      L91: Does that mean that most co-precipitated signal comes from the soluble fraction and not PB-localized? Would an RNAse treatment step eliminate the co-precipitation (optional)?

      Our response: We believe it means LSM1 and PATs are in the same complex regardless of PB localization.

      L92/93: Or alternatively that PAT1 localizes to PBs independent of the stress, while PATHs are signal-specific PB components?

      Our response: We think PAT1 aggregates upon broad stimuli/stress, while PATHs respond to specific/limited stimuli, for example, auxin.

      Figure 3:

      o I wonder if these results fit better in conjunction with Figure 1, either as a combined figure or move before Figure 2.

      Our response: We agree with the reviewer thus we moved old Fig 1C into Fig 3.

      It is interesting that path2/pat1, while being dwarfed, is less serrated compared to pat1 or path1/pat1. Can you find any indications in your RNAseq set which genes might be involved?

      Our response: ANAC016 might be involved, but more research needs to be done to confirm it and this is not the focus of the current project.

      Indicate statistical test used to determine p-value

      Our response: We now indicate the statistic test in Materials and Methods part (Line 369).

      L116/L117: Doesn't the result in Figure 3E indicate that PATH1 and PATH2 are not fully redundant, but that PATs have specific and narrow roles in leaf development? L116 goes against your statement in L150 & L160. What is known about the expression patterns of PAT1, PATH1 and PHATH2?

      Our response: We agree and thus modified our statement (Line 137). All three PATs are expressed in roots, stems, leaves, flowers, siliques, and seeds during the whole developmental stages. Please also see our answer to major comment #4.

      L123: PC3 only explains 0.55% of the variance, so differences along this axis will be overinflated. In my interpretation the pat1/path2 mutant is clustering apart from the other higher order mutants, which is also reflected in the leaf phenotypes. A 2D PCA would be sufficient to describe most of the variation.

      Our response: We agree and thus we changed the PCA plot into a 2D style, please also see our response to reviewer 1 minor comment #3.

      Figure 4: o A: The 3D-PCA inflates the differences between higher order mutants along PC3, even though this axis explains only 0.55% of the variance, maybe a 2D-PCA would more intuitively cluster the samples together?

      Our response: Please see our new PCA plot in Fig4A.

      B: Please explain the scale in the figure legend and which genes were included? Only DEGs between triple mutant and summ2-8 or DEGs that were different in at least one higher order mutant?

      Our response: We now explained more details in the figure legends. The genes which were included in Fig4B were DEGs that were differently expressed in at least one of the pat mutants.

      C: several comparisons are missing from the upset-plot. Please show the complete plot, also is there a white box laid over the second bar in the upper graph? It would help the reader, if the results section would explain the plots and the comparisons took. Which differences are the authors interested in?

      Our response: We covered all the comparisons we wanted to show, but we thank the reviewer for suggesting a more detailed explanation and we therefore explain Fig4C more in detail in Line 146. There is no white box over the second bar, it’s only 1 gene mis-regulated specifically by PATH1 (mis-regulated in plants with path1 mutation).

      From Figure 4B, the triple mutant has an almost inverted expression of mis-regulated genes. High expression genes are now lowly expressed and vice-versa. Has this been reported for other RNA decay mutants before?

      Our response: Our RNA-seq data indicate the pat tripe mutant has more than 1000 mis-regulated genes and based on microarray data on 2-week-old lsm1alsm1b plants (Perea-Resa et al, 2012), more than 600 genes are misregulated in lsm1alsm1b mutant.

      How do you explain that mutants in RNA decay have a large group of repressed transcripts and a large group of enriched transcripts? Wouldn't you suspect a general higher expression in RNA decay mutants or which kind of feedback loop would you propose is happening here? Also, since both kinds of expression changes are recorded in your RNA seq can you speculate on the specificity? Why are some genes up- and others downregulated? Would you suspect that transcription factors are under PATs control?

      Our response: We assume that the mRNA decapping machinery target genes should accumulate in mRNA decapping mutants, pat mutants in our case. On the other hand, the down-regulated genes could be target genes of other mRNA degradation pathways such as exosome pathway (Line 257); We agree with the reviewer that the down regulated genes in pat triple could also be negatively regulated by the mRNA decapping targets which could be transcription factor genes. For example, our previous research indicates the transcription factor gene ASL9/LBD3 is mRNA decapping targets under PATs control.

      Where is the sequencing data deposited? This dataset can be of great value for researchers in the field, but the raw data needs to be made commonly available.

      Our response: We thank the reviewer for acknowledging the significance of our work. The raw data has been submitted to NCBI, accession number is PRJNA1006171(Line 307)

      Minor points:

      1. Check order and nomenclature for protein / gene names in Abstract and Introduction

      Our response: We now carefully double check the order and nomenclature for protein / gene names in abstract and introduction (Line 8,11,14,18,19,24)

      L26 / L83 "aggregate" implies non-functionality, I would use "concentrate", "condensate" or "accumulate".

      Our response: We thank the reviewer for pointing it out, we now use “concentrate” (Line 29&80)

      L35, L45 & L54 all state the same. Maybe remove at least one mention to reduce redundancy?

      Our response: We modified these statements hopefully in a satisfactory way. (Line 56)

      L211: Did you use the same imaging settings for all lines?

      Our response: We used the same settings for all the lines and treatment (Line 284)

      L217: RNA quality "control" word missing?

      Our response: The word “control” is added in Line 296

      L477: Authors should cite the newest version of their BioRxiv: Zuo, Z., Roux, M. E., Chevalier, J. R., Dagdas, Y. F., Yamashino, T., H�jgaard, S. D., ... & Petersen, M. (2022). The mRNA decapping machinery targets LBD3/ASL9 to mediate apical hook and lateral root development in Arabidopsis. bioRxiv, 2022-07.

      Our response: The latest version is cited in our new manuscript (Line 42)

      Figure 3B-F, Figure 4C: check spelling on the axis titles.

      Our response: We carefully checked the spelling on the axis titles in our new manuscript.

      Reviewer #2 (Significance (Required)):

      This manuscript represents a continuation of the author's characterization of the 3 PAT1s in Arabidopsis development after Zuo et al., 2021; Zuo et al., 2022a; Zuo et al., 2022b. The mutants and the corresponding RNA sequencing experiments are of value to the community working on RNA regulation and degradation or plant development. While the initial findings are interesting, the authors do not explore the stimulus-induced condensation differences between the homologues or try to link the extreme differences in expression profiles mechanistically or functionally. I think the manuscript could greatly benefit from contextualizing their work within the frame of their previous studies and what is known about PBs in terms of plant development. While the RNA seq is a comprehensive data set, a closer examination and a better representation of the results would help readers to access the findings.

      __Our response: __We thank the reviewer for the constructive criticism. We hope the reviewer is satisfied by our modified manuscript.

      Reviewer expertise: RNA granule biology, Arabidopsis, molecular biology

      __Reviewer #3 (Evidence, reproducibility and clarity (Required)): __

      Summary:

      In the study "PAT mRNA decapping factors function specifically and redundantly during development in Arabidopsis" authors investigate potential specific functions of Arabidopsis PAT1 orthologs in plant development. Authors observe differences in rosette phenotypes (leaf size, serration and number) of single and multiple mutants of PAT1 gene family, show variation in translocation of the corresponding PAT1 proteins to processing bodies under a set of stress conditions and perform transcriptomics on the established mutants to elucidate the impact of individual PATs on posttranscriptional regulation of plant gene expression. Authors conclude that PAT1 orthologs have both overlapping and specific roles in plant development.

      __Our response: __We thank the reviewer for the peer review. Please see our detailed answers to the reviewer’s suggestions in the following.

      Major comments:

      1. The study contains intersting transcriptomics data that will be of use for the scientific community. However, analysis of the transcriptomics results could be discussed a bit more in depth. Authors could express their opinion about what gene expression changes might be caused by direct degradation via PAT1-dependent decapping mechanism and what changes are more likely to have occurred indirectly via other factors.

      __Our response: __We followed the reviewer’s suggestion and thus we analysed and discussed more in depth about the transcriptomic data (Line145, 220 &232)

      The intersting phenotypic observations are currently poorly linked to the transcriptomics/qPCR data provided, resulting in a somewhat fragmented story flow.

      __Our response: __We appreciate the reviewer thought the pat mutants’ phenotype are interesting, however we disagre with the reviewer on the statement of “poorly linked to the transcriptomics/ qPCR data”. For instance, downregulation of developmental and auxin responsive genes could explain the stunt growth phenotype in the pat triple mutant. Furthermore, the published petiole elongation regulator genes XTR7/XTH15 and PIL2/PIF6 exhibit decreased expression level only in mutants with shorter petioles. Nevertheless, we hope our new data and analysis will satisfy the reviewer.

      The transcriptomics was performed on the 6-weeks old plants. It would be helpful to learn more about authors reasoning for choosing this developmental stage for sampling. Why did authors decide against sampling at the earlier stages, before the observed leaves phenotypes were established?

      __Our response: __The pat mutants growth phenotypes showed bigger difference among each other at the late stage, therefore we performed RNA-seq on these samples. But we agree with the reviewer (also reviewer 1, major comment #2), transcriptomic shift at earlier stage could also be responsible for the observed phenotype, thus we performed qRT-PCR on the pat mutants at earlier stages for certain genes to examine this (Line 162 &169)

      Authors obtained intriguing results on specific translocation of PAT1, PATH1 and PATH2 to processing bodies in the root cells upon various stresses. Perhaps root transcriptomics of single PAT1, PATH1 and PATH2 knockouts under control conditions, treatment that translocate all three proteins to PBs(IAA) and selectively translocate only PAT1 (e.g. cytokinin) could shed more light on the redundancy an specificity of these proteins as the mRNA decapping factors.

      __Our response: __We appreciate the reviewer found our findings interesting. The specific translocation of PAT1, PATH1 and PATH2 to PBs in the root cells upon various stimuli indicates functional specificity and redundancy in cellular level which correlates with mutants’ growth phenotype. However, we agree with the reviewer that root transcriptomic data on pat mutants are very interesting, we are more than willing to share these mutants with peers who want to persue this in more detail.

      Do authors consider PAT1, PATH1 and PATH2 to be localized to different PBs sub-populations? It could be intersting to check co-localization of PAT1, PATH1 and PATH2 under various stress conditions. Could authors elaborate on their view of PBs composition and fate to which different PAT1s are recruited?

      __Our response: __We agree with the reviewer that it’s interesting to check co-localization of PAT1, PATH1 and PATH2. We observed partial localization of CFP-PATH2(in blue) and Venus-PAT1(in yellow) when transiently expressed in Benthmiana. But for permanent lines, we failed at observing separate CFP-PATH2(Blue) signal due to too much signal leakage from Venus-PAT1(Green). Given the fact that PATs function redundantly, we would assume they are partially co-localized in cellular level.

      Could authors speculate what features in the PAT1 protein might cause it being recruited to PBs more efficiently (or better to say, under a broader range of stresses) in comparison to PATH1 and 2?

      __Our response: __The release of ribosome-free mRNPs induces PB formation (Brengues et al., 2005). We suspect PAT1 could bind broader mRNAs compared to PATH1 and PATH2, therefor PAT1-mRNPs could form PBs more efficiently. Moreover, Sachdev et al found yeast PAT1 enhances the condensation of Dhh1 and RNA and PAT1-DHH1 interaction is essential for PB assembly (Sachdev et al., 2019), we assume PAT1 might have better interaction with DHH1 compared to PATH1 and PATH2 thus promote PB formation more efficiently. Please see our discussion part (Line 252)

      Are all three Arabidopsis PAT paralogs co-expressed in the same tissues /developmental stages?

      __Our response: __Please see our response to reviewer 2 major comment #4.

      Could authors elaborate a bit more why the triple pat1 knockout has a much more severe phenotype in comparison to a single pat1 loss-of-function mutant or any of the double pat1 mutants. Do authors observe complementary changes in the PAT1 genes expression in the mutant lines, e.g. is PATH1 expressed at a higher level in the absence of PAT1 and PATH2?

      __Our response: __We now elaborate more about the reason why triple pat1 knockout has the most severe phenotype in the multiple pat mutants (Line 210). We do see higher transcriptional level of PAT1 in path1-4path2-1summ2-8 and also higher transcriptional level of PATH1 in pat1-1path2-1summ2-8 but the same PATH2 transcriptional level in pat1-1path1-4summ2-8 compared to summ2-8 (Fig S1C, Line 104)

      Please provide the name of the used statistical test in all figure legends.

      __Our response: __We now provide the statistical test in “Material and Methods” part (Line 367).

      Minor comments:

      1. Authors might want to reconsider the title as it is somewhat too vague in its current form.

      __Our response: __We now changed our title into “ PAT mRNA decapping factors are required for proper developmental in Arabidopsis

      Line 9: explanation of PAT1 and PATH1 and 2 abbreviations is best placed at the first mentioning of the name.

      __Our response: __We carefully followed the reviewer’s suggestion (Line 10)

      Line 10: mRNA degradation is rather a posttranscriptional regulation of gene expression.

      __Our response: __We agree and changed our statement in the new ms (Line 9).

      Lines 11 and 12: path1 and path2 abbreviation are not explained. Please note that on the Figure 1A the same proteins are labelled as PAT1H1 and PAT1H2

      __Our response: __We thank the reviewer for pointing it out, we now have PATH1 and PATH2 abbreviations explained in Line 10 and also correct the labels in Fig 1A.

      Lines 22-25: Would you be so kind to rephrase or elaborate on what yoPBu mean. LSM1-7/PAT1 complex are known to bind oligoadenylated transcripts indeed and even stabilize their 3' ends, it is not clear what "engage transcripts containing deadenylated tails" means in this context.

      __Our response: __We hope we now rephrase the statement in a clear way (Line 25)

      Line 29: for the sake of clarity, it might be beneficial to list the known activators of the decapping DCP2 enzyme, including the VCS. Generally the introduction could benefit from a bit more in depth review of the decapping mechanism.

      __Our response: __We hope the more detailed introduction will satisfy the reviewer (Line 27).

      Line 51:"other 2 PATs" => "other two PATs". Generally the text is quite well written, but might need a bit of polishing.

      __Our response: __The text is corrected now (Line 64).

      Authors are absolutely correct in their attempt to provide full information about mutant backgrounds. However, for the sake of comprehension, it would be great to grant the double and triple mutants in the summ2 background shorter and more legible names. For example, the pat1-1path1-4path2-1summ2-8 mutant could be named as pat1/h1/h2/s.

      __Our response: __We originally used pat1/h1/h2/s for the triple but a colleague pointed out “h1” or “h2” are not proper gene names and suggested us to rename them. But we agree that the double and triple pat names are comprehensive, to compromise we change the triple pat mutants into pat triple.

      Figure 1B:

      • it would be intersting to have authors opinion on why PBs are formed in this case under non-stress(?) conditions.

      __Our response: __Forming PBs is a dynamic process, and we assume that even under normal conditions, there is still ongoing mRNA decay and translational repression which should be seen as some background level of PBs (Line 85).

      Please note that expressing only the N-terminal part of CFP is a weak negative control for BiFC. No restoration of CFP can occur in such case and thus it is a given that no fluorescence can be observed in these samples. For example, co-expression of nCFP-PAT1 with cCFP-GUS, would be a more rigorous negative control, better aligned with the coIP experiments.

      __Our response: __We had nCFP-Gus with cCFP-LSM1 as real negative control in old Fig 1B (bottom lane). We also agree with the reviewer that only the N-terminal part of CFP is a weak negative control for BiFC, therefore we removed the weak control and only left the rigorous negative control (new Fig 1B).

      Please note that some arrows point at a structure that seems to be not discernible a signal.

      __Our response: __It’s due to the poor quality of the picture from the PDF file, arrows in the original high-resolution figure do point at discernible foci.

      Figure 1C: It might be helpful to also include a Col-0 WT plant

      __Our response: __Col-WT plant is now included in Fig S1A.

      It is not clear how qPCR data and complementation lines help to characterize the established PATH1 and PATH2 loss-of-function mutants. There is no immunodetection of the corresponding proteins in the knockouts, qPCR shows no dramatic decrease in the transcript level of PATH1 and H2 and the phenotypes of complemented lines presented in the Fig S1E at a glance look quite similar to the phenotypes of the corresponding knockout mutants. Complementation lines are not used for any other experiments in this study and it is not clear why authors decided to include this material into the article.

      __Our response: __To characterize the path1 and path2 mutants, we first did qRT-PCR to check the transcriptional level expression, but like the reviewer mentioned, there was no dramatic decrease indicating the mutations of path1-4 and path2-1 did not change PATH1 and PATH2 transcriptional level expression. We also tried to raise antibodies against PATH1 and PATH2, however the antibodies failed to recognize any PAT proteins. Therefore, we used the complementation lines to characterize the mutations in PATH1 and PATH2. Since path1 and path2 single mutants don’t have obvious growth phenotype and the dwarf pat triple is barely possible to transform, we had to complement the pat1path1 and pat1path2 double mutants. If the reviewer takes a closer look, the growth phenotype of the complementation lines Venus-PATH1/ pat1-1path1-4summ2-8 and Venus-PATH2/ pat1-1path2-1summ2-8 are similar to pat1-1summ2-8 but not the background pat double mutants. The complementation lines were also used to study PATH1 and PATH2 cellular localization.

      Figure S1C misses labels indicating what detection of what gene is shown on what chart.

      __Our response: __We thank the reviewer for pointing it out, the gene names are indicated now in new FigS1C.

      Experiments to visualize PBs under various stress stimuli were conducted on roots for the Figure 2 while coIP was performed on the green tissue. Could authors elaborate on whether PB formation could be expected to be the same in different plant organs? Somewhat related to the same topic, Figure 2 contains micrographs obtained on meristematic, transition and elongation root zones, in which epidermal cells are present at various developmental stages. Since PAT proteins are suggested to impact plant development, it might be prudent to obtain observations for all samples at the same developmental stage. Could authors provide their opinion about how representative the provided micrographs are for all root zones? Furthermore, Venus-PATH2 under ACC treatment shows punctate localization only in a single cell out of the three-ish cells visible on the micrograph, potentially indicating differences in PAT2 recruitment to PBs in trichoblasts and atrichoblasts. This in itself could be an intersting observation helpful for elucidating the specific roles of PAT1 orthologs.

      __Our response: __CoIP results from Benthamiana leaves indicate Arabidopsis PATs and LSM1 are in the same complex, and PB visualization in root area suggests PATs respond to different hormone treatments. flg22 treatment has been published to induce PB formation in Arabidopsis root but dissemble PBs in Arabidopsis protoplasts, indicating a tissue specific manner of PB formation. We randomly chose 1 picture/treatment from 9 (3 plants * bio-triplicates) which showed the same. However, we thank the reviewer for pointing out the confocal pictures we chose were not all from elongation zone, we now carefully checked all our confocal pictures and made sure they are from the same developmental stages. We also discuss more of PATH2 localization in response to ACC (Line 251).

      Figure 4C would greatly benefit from a more detailed description in the main text and figure legend of what authors show/conclude.

      __Our response: __We thank the reviewer for the suggestion hence we describe Fig 4C in more detail in our new manuscript (Line 146).

      Figure 5, please avoid using the same color for the bars for the triple pat knockout and the control summ2-8 line

      __Our response: __We changed the colour scheme for all the mutants (new Fig 4E).

      Figure 5B legend should include the name of the statistical test.

      __Our response: __We now include the name of the statistical test in “Material and Methods” (Line 367).

      Figure S2: The coIP experiment is a bit difficult to interpret due to the extremely low protein quantities in some of the input samples. Perhaps a repetition with more balanced input quantities would be beneficial. The figure legend does not contain information on how normalized intensity values were obtained.

      __Our response: __We used the same amount of total protein for each sample (3mg) for each IP, PATH1 and PATH2 don’t express as high as PAT1. The numbers indicate the comparative ratio between PAT-HA protein signal and LSM1-GFP signal, and PAT1-HA/LSM1-GFP under non-treatment condition is normalized as 1.

      Line 130: Fig S2 is referenced but Fig S3 is meant

      __Our response: __We thank the reviewer for pointing out our mistake, the correct figure is now referenced.

      Reviewer #3 (Significance (Required)):

      Strength:

      Regulation of gene expression by mRNA decay is an extremely intersting topic and is highly relevant in plant stress and developmental biology. This study provides a more in depth view on the potential specific roles of the three PAT1 orthologs in Arabidopsis plants. Authors established loss-of-function mutants of the corresponding genes and performed transcriptomics analysis that will be a valuable source for future studies. Furthermore, microscopy analysis of PATH1 and PATH2 translocation to PBs indicates their potential specific roles in plant stress response.

      Weakness: The current version of this study suffers from vague presentation of the results. Starting from the title and ending with discussion authors provide a "general" view on their results and do not go into detailed interpretations. Thus, no mechanistic insight has been derived or at least suggested from the wealth of the transcriptomics, phenotypic and microscopy data.

      The introduction should provide more detailed information on what is known on the PAT1 role in the mRNA decapping pathway and its relevance for plant stress response and development.

      Please note, that the above mentioned suggestion of different sampling for transcriptomics analysis is not meant as a request for this particular study, but rather as an illustration of an expectation a reader would built while following the current version of the text. A thorough description of the strategy for transcriptomics and a more in depth analysis might significantly strengthen the study's coherence and impact.

      Advance:

      At this stage, the study looks more like an incremental advance of the work from the same laboratory performed for the single PAT1 protein. However, as mentioned in the comments above, the study might be made significantly stronger by elaborating the results analysis and highlighting potential discoveries.

      Audience:

      The topic of this study is of a significant interest to a broad audience performing research in plant stress biology and also developmental plant biology.

      __Our response: __We thank the reviewer for acknowledging the significance of our work and the structural criticism. We hope our detailed answers to the reviewer’s suggestions and the additional data we included in the manuscript will satisfy the reviewer.

      Reviewer's and co-reviewer's fields of expertise:

      Molecular Biology, Plant cell biology, Plants Stress response, Autophagy, Stress granules

      __Reviewer #4 (Evidence, reproducibility and clarity (Required)): __

      PAT1 (Protein Associated with Topoisomerase II) are RNA-binding proteins involved in the control of mRNA decay in the cytoplasm. Plants possess multiple PAT1 family members, three in Arabidopsis, PAT1, PATH1 and PATH2. According to the literature, the pat1 mutant shows dwarfism and de-repressed immunity. In this paper, Zou et al. describe the function of PATH1 and PATH2. Two pieces of evidence are consistent with their role in the control of mRNA decay. First, Co-IP and bimolecular Fluorescence Complementation assays in tobacco indicate physical interaction and co-localization of PAT1, PATH1 or PATH2 with LSM1 (Fig. 1), which is a protein present in decapping complexes that form the cytoplasmic foci involved in mRNA decay. Second, PAT1, PATH1 and PATH2 are present in these cytoplasmic Processing Bodies (Fig. 2). Zou et al. generated path1 and path2 mutants, double mutants with pat1 and the triple mutant using independent alleles and the summ2 background to avoid autoimmunity interference. The mutants show leaf growth (Fig. 3) and gene expression (Fig. 4) phenotypes that are not exactly similar among the different family members, but there is significant redundancy revealed by these phenotypes.

      __Our response: __We thank the reviewer for the peer review. Please see our detailed answers to the reviewer’s suggestions in the following.

      1. The conclusions are straight forward and, apparently, well supported by the data. However, the authors should confirm that when they provide the number of replicates (n) in the legends to the figures, this actually refers to the number of biological replicates. The statements should be based on true biological replicates (not technical replicates). The statistical tests should also be explicitly indicated (including that used to identify DEG in the RNAseq experiment).

      __Our response: __We carefully went through our figures and made sure the number of replicates (n) were correctly stated in figure legends and the statistical tests were indicated (Line 367)

      Reviewer #4 (Significance (Required)):

      The results are useful but mainly descriptive. Personally, I am interested in the mechanisms involved in the control of growth and the manuscript does not mechanistically link the action of PAT1, PATH1 and PATH2 to the transcriptome and the latter to the growth patterns.

      __Our response: __We thank the reviewer for acknowledging the significance of our work of characterizing PATs and we hope our new data could satisfy the reviewer in regarding to “mechanistical link”.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1 (Recommendations For The Authors):

      1) In general given several of the "equivalence groups" were distinguished from each other in Packer et al's annotation, can the authors comment more on why they aren't able to distinguish them? Are the markers listed for those cell states in Packer not expressed appropriately in these data? Or are they expressed but the states are not different enough to form discrete clusters? I suggest the possibility that the analysis choices of 20 "initial dimensions" or 1000 most variable genes filtered out some of these differences which may be encoded in later principle components, or that the use of t-SNE projection is not sufficient to resolve these distinct states.

      2) I was a bit confused by the spatial gene expression analysis. Several distinct ideas appear to be posed in the text. These ideas aren't really supported by any quantitative analysis, just the visual patterns in Figure 4B/C which I'm not sure I always agree with.

      For example, ceh-43 expression is mentioned as having "physically proximate" expression. But it is well established that different lineages form specific spatial territories (e.g. Schnabel et al 1997). Thus it seems logical that genes with specific lineage patterns will have specific spatial patterns as well. If the claim is that the observed patterns are more clustered along the A-P axis than expected by chance given their lineal complexity then I'm not sure this is shown. Maybe some comparison with control lineage patterns of similar complexity of non-TFs or non-HD TFs could get whether these genes specifically are more spatially patterned? Visually it looks to me like some patterns are more like "blobs" or even lateral or D-V specific patterns than they are like "stripes."

      In addition there is a long history in the literature discussing the origin of position-specific patterns in C. elegans - most I'm aware of support the idea that positional information arises primarily from intrinsic lineage mechanisms (e.g. Cowing and Kenyon 1996). Perhaps the authors are making this same argument here, but if so this isn't clear from the text.

      Or maybe the authors are trying to make the argument that combinations of TFs encode more precise position than individual TFs? This seems more likely to me from the images presented still not well-supported without quantitative or statistical analyses.

      3) The comparison with Drosophila is interesting but also under-developed. I think all I would feel comfortable claiming from the data as shown is that genes that are spatially patterned in early fly development are also usually patterned in the C. elegans lineage. But to even say this is an enrichment over expectation would require more analysis.

      Minor comments:

      Methods: some statement about temperature control during cell isolation would be useful. In other words were embryos continuing to develop or put at low temperature such as in a cold room to prevent temporal differences between the first and last cells collected from a given embryo?

      Current links to data at GEO are incorrect and link to Levin et al 2016 instead. I was not able to access the raw single cell data, just the processed data in Table S6.

      The standardization of expression in embryos isn't well explained - would be good to expand a little on the types of batch effects being addressed and how this approach was chosen or a relevant citation.

      Page 2: Including P0 and cell deaths there are 1,341 branches in the hermaphrodite lineage (2n-1 for 671 terminal cells including deaths).

      -"as their each have" (grammar error)

      -"very large nuclear hormone receptor domain" (add "family")

      Page 3: As noted Packer et al largely missed cells prior to the 50-cell stage as described - but the reason for this is likely that the use of 10 micron filters or centrifugation to remove undissociated embryos also removes early stage cells.

      -"few new expressions occur" (grammar). Also, in both Tintori and Hashimshony datasets there well over 1000 newly expressed genes detectable (see for example Sivaramakrishnan et al 2021 biorxiv).

      Figure S1 would be easier to interpret with a legend explaining what fates are represented by each color

      Some genes listed as markers in Figure S2 are not included in the marker table such as flh-3, oma-2, sma-9.

      "New markers were required" - this is plural but only F19F10.1 is mentioned. Were other markers examined this way or should it be singular?

      In Figure S2 the lower ("robustness") plots are nice but could be explained more clearly. What is the nature of the "cell similarity score"? How many (if any) cells were excluded due to not being most similar to their own cluster?

      "transcriptomically very similar shortly after division" - can the authors comment on any information they have about how long after division the cells were collected?

      GFP reporter lineaging - the methods are minimally described (what brand of microscope, which strains/transgene/CRISPR configurations etc). And data are not presented. If these embryos are all incorporated into Ma et al 2021, that is fine, but should be clearly cited. Otherwise it is important in my view to include some way to access the quantitative values from the lineaging and understand these details.

      "as illustrated for ceh-43, dmd-4 and unc-30" - were there other examples as suggested from this wording? I'd also note that similar fluorescent reporter imaging data have been published previously for all three genes listed (Walton et al 2015 for UNC-30, Ma et al 2021 for DMD-4 and CEH-43 protein reporters, Murray et al 2012 for dmd-4 and ceh-43 promoter reporters).

      Zacharias and Murray are cited as promoting "continuous symmetry breaking" but actually that review argued for a "non-monophyletic" architecture similar to that supported by the data .

      The text and figure don't always agree. For example mec-3 expression is listed in the text as part of one of the stripes, but mec-3 is not labeled on the figures.

      The stage of each embryo in figure 4B/C should be explicitly labeled (and maybe also given specific figure panel designations to clarify what statements in the text correspond to which figures).

      In the discussion it is unclear what the numbers "97 to 104" refer to

      The scRNA-seq reads were mapped to a relatively old genome build and annotation set (WS230) - thus current users may find discrepancies with current gene names in WormBase. Also, since the CEL-seq data are 3' biased, it is worth noting that Packer et al found that a substantial number of genes (~1000) in a slightly later annotation set (WS260) were undercounted (sometimes dramatically) with the similarly biased 10x data due to incomplete 3'UTR annotations. While I would be reluctant to ask for a requantification for the purposes of the manuscript given the challenges of repeating the various analyses, it is worth explicitly mentioning whether this was dealt with.

      Reviewer #2 (Recommendations For The Authors):

      The writing was otherwise good, at least to my eye, and the data was presented very well and made freely available to other researchers. I am not as well-versed in the statistical methods and will leave comments on these to a better-equipped reviewer(s).

      Fig. 1 legend 'P' should be P4 (subscript 4).

      p. 9 'ceh-51' should be italicized. Only one factor seems to have been confirmed by smFISH, F19E10.1. There are available reporters, did they show a similar pattern? From CGC website: RW12347 F19F10.1(st12347[F19F10.1::TY1::EGFP::3xFLAG]) V endogenous tagged reporter; RW11620 unc-119(tm4063) III; stIs11620 [F19F10.1::H1-wCherry + unc-119(+)] array reporter.

      Reviewer #3 (Recommendations For The Authors):

      Typo: on page 11, where it says nanog it should read nanos.

      Reviewer #4 (Recommendations For The Authors):

      I found some sentences and paragraphs to be a bit unclear. There are no page or line numbers in the manuscript, so I point in the general direction, and hope the authors find what I am referring to.

      • 2nd paragraph of the Introduction - "their" should be "they", but the sentence as a whole is not clear.

      • 3rd para. of the Intro. - The last sentence of this paragraph doesn't make sense. Please rephrase and/or break up into shorter sentences.

      • 1st Para. of Results - "the maternal deposit" is not clear. Perhaps "maternally deposited transcripts" or something similar.

      • 1st Para. after Figure 3. The last sentence "Thus, continuous symmetry breaking..." is unclear. What is "continuous symmetry breaking"? Please define and expand.

      • Fig. 4 - the genes seem to be listed from posterior to anterior. The common way of presenting Hox gene lists and other regionally expressed genes is from anterior to posterior.

      • For the benefit of the non-C. elegans crowd, please give names of Drosophila homologs where relevant (e.g., when comparing to Drosophila expression patterns)

      In a few places there are citations of popular science books or general textbooks (e.g., Carrol et al., 2004; Wolpert et al., 2019) . I think it would be better to cite review papers from the scientific literature or relevant primary papers.

      I am very happy to submit the revised manuscript. We were very happy to have received reports from four reviewers!

      We have decided not to prepare a separate response to the public comments of the reviewers, as we did not undertake any further major revisions.

      We did address most of the minor editorial suggestions.

    1. Reviewer #1 (Public Review):

      The overall tone of the rebuttal and lack of responses on several questions was surprising. Clearly, the authors took umbrage at the phrase 'no smoking gun' and provided a lengthy repetition of the fair argument about 'ticking boxes' on the classic list of criteria. They also make repeated historical references that descriptions of neurotransmitters include many papers, typically over decades, e.g. in the case of ACh and its discovery by Sir Henry Dale. While I empathize with the authors' apparent frustration (I quote: '...accept the reality that Rome was not built in a single day and that no transmitter was proven by a one single paper') I am a bit surprised at the complete brushing away of the argument, and in fact the discussion. In the original paper, the notion of a receptor was mentioned only in a single sentence and all three reviewers brought up this rather obvious question. The historical comparisons are difficult: Of course many papers contribute to the identification of a neurotransmitter, but there is a much higher burden of proof in 2023 compared to the work by Otto Loewi and Sir Henry Dale: most, if not all, currently accepted neurotransmitter have a clear biological function at the level of the brain and animal behavior or function - and were in fact first proposed to exist based on a functional biological experiment (e.g. Loewi's heart rate change). This, and the isolation of the chemical that does the job, were clear, unquestionable 'smoking guns' a hundred years ago. Fast forward 2023: Creatine has been carefully studied by the authors to tick many of the boxes for neurotransmitters, but there is no clear role for its function in an animal. The authors show convincing effects upon K+ stimulation and electrophysiological recordings that show altered neuronal activity using the slc6a8 and agat mutants as well as Cr application - but, as has been pointed out by other reviewers, these effects are not a clear-cut demonstration of a chemical transmitter function, however many boxes are ticked. The identification of a role of a neurotransmitter for brain function and animal behavior has reasonably more advanced possibilities in 2023 than a hundred years ago - and e.g. a discussion of approaches for possible receptor candidates should be possible.

      Again, I reviewed this positively and agree that a lot of cumulative data are great to be put out there and allow the discovery to be more broadly discussed and tested. But I have to note, that the authors simply respond with the 'Rome was not built in a single day' statement to my suggestions on at least 'have some lead' how to approach the question of a receptor e.g. through agonists or antagonists (while clearly stating 'I do not think the publication of this manuscript should not be made dependent' on this). Similarly, in response to reviewer 2's concerns about a missing receptor, the authors' only (may I say snarky) response is ' We have deleted this sentence, though what could mediate postsynaptic responses other than receptors?' The bullet point by reviewer 3 ' • No candidate receptor for creatine has been identified postsynaptically.' is the one point by that reviewer that is simply ignored by the authors completely. Finally, I note that my reivew question on the K stimulation issues (e.g. 35 neurons that simply did not respond at all) was: ' Response: To avoid the disadvantage of K stimulation, we also performed optogenetic experiments recently and obtained encouraging preliminary results.' No details, not data - no response really.

      In sum, I find this all a bit strange and the rebuttal surprising - all three reviewers were supportive and have carefully listed points of discussion that I found all valid and thoughtful. In response, the authors selectively responded scientifically to some experimental questions, but otherwise simply rather non-scientifically dismissed questions with 'Rome was not built in a day'-type answers, or less. I my view, the authors have disregarded the review process and the effort of three supportive reviewers, which should be part of the permanent record of this paper.

    2. Reviewer #3 (Public Review):

      SUMMARY:

      The manuscript by Bian et al. promotes the idea that creatine is a new neurotransmitter. The authors conduct an impressive combination of mass spectrometry (Fig. 1), genetics (Figs. 2, 3, 6), biochemistry (Figs. 2, 3, 8), immunostaining (Fig. 4), electrophysiology (Figs. 5, 6, 7), and EM (Fig. 8) in order to offer support for the hypothesis that creatine is a CNS neurotransmitter.

      STRENGTHS:

      There are many strengths to this study.<br /> • The combinatorial approach is a strength. There is no shortage of data in this study.<br /> • The careful consideration of specific criteria that creatine would need to meet in order to be considered a neurotransmitter is a strength.<br /> • The comparison studies that the authors have done in parallel with classical neurotransmitters is helpful.<br /> • Demonstration that creatine has inhibitory effects is another strength.<br /> • The new genetic mutations for Slc6a8 and AGAT are strengths and potentially incredibly helpful for downstream work.

      WEAKNESSES:<br /> • Some data are indirect. Even though Slc6a8 and AGAT are helpful sentinels for the presence of creatine, they are not creatine themselves. Of note, these molecules themselves are not essential for making the case that creatine is a neurotransmitter.<br /> • Regarding Slc6a8, it seems to work only as a reuptake transporter - not as a transporter into SVs. Therefore, we do not know what the transporter into the TVs is.<br /> • Puzzlingly, Slc6a8 and AGAT are in different cells, setting up the complicated model that creatine is created in one cell type and then processed as a neurotransmitter in another. This matter will likely need to be resolved in future studies.<br /> • No candidate receptor for creatine has been identified postsynaptically. This will likely need to be resolved in future studies.<br /> • Because no candidate receptor has been identified, it is important to fully consider other possibilities for roles of creatine that would explain these observations other than it being a neurotransmitter? There is some attention to this in the Discussion.

      There are several criteria that define a neurotransmitter. The authors nicely delineated many criteria in their discussion, but it is worth it for readers to do the same with their own understanding of the data.

      By this reviewer's understanding (and combining some textbook definitions together) a neurotransmitter: 1) must be present within the presynaptic neuron and stored in vesicles; 2) must be released by depolarization of the presynaptic terminal; 3) must require Ca2+ influx upon depolarization prior to release; 4) must bind specific receptors present on the postsynaptic cell; 5) exogenous transmitter can mimic presynaptic release; 6) there exists a mechanism of removal of the neurotransmitter from the synaptic cleft.

      For a paper to claim that the published work has identified a new neurotransmitter, several of these criteria would be met - and the paper would acknowledge in the discussion which ones have not been met. For this particular paper, this reviewer finds that condition 1 is clearly met.

      Conditions 2 and 3 seem to be met by electrophysiology, but there are caveats here. High KCl stimulation is a blunt instrument that will depolarize absolutely everything in the prep all at once and could result in any number of non-specific biological reactions as a result of K+ rushing into all neurons in the prep. Moreover, the results in 0 Ca2+ are puzzling. For creatine (and for the other neurotransmitters), why is there such a massive uptick in release, even when the extracellular saline is devoid of calcium?

      Condition 4 is not discussed in detail at all. In the discussion, the authors elide the criterion of receptors specified by Purves by inferring that the existence of postsynaptic responses implies the existence of receptors. True, but does it specifically imply the existence of creatinergic receptors? This reviewer does not think that is necessarily the case. The authors should be appropriately circumspect and consider other modes of inhibition that are induced by activation or potentiation of other receptors (e.g., GABAergic or glycinergic).

      Condition 5 may be met, because authors applied exogenous creatine and observed inhibition. However, this is tough to know without understanding the effects of endogenous release of creatine. if they were to test if the absence of creatine caused excess excitation (at putative creatinergic synapses), then that would be supportive of the same. Nicely, Ghirardini et al., 2023 study cited by the reviewers does provide support for this exact notion in pyramidal neurons.

      For condition 6, the authors made a great effort with Slc6a8. This is a very tough criterion to understand or prove for many synapses and neurotransmitters.

      In terms of fundamental neuroscience, the story should be impactful. There are certainly more neurotransmitters out there than currently identified and by textbook criteria, creatine seems to be one of them taking all of the data in this study and others into account.

    1. Why do you think social media platforms allow bots to operate?

      Bots could be helpful to today’s life. Automation is useful to use. For example, we use bots to block spam, archive out dated threads. Bots make the platform programable, which extends the possibility of the platform. With bots, platform may have more functionality than it designed. Platform get benefits from content on it and the user traffic. Bots help both improve the quality of content, and may also attract more user traffic. And so it benefits the platform. It is hard to blocking bots. Introducing more captcha could be a bad idea to stopping bots as it also harm experience of real people. And as we discussed before, attacker may still use more complex technology or even a real human (as discussed in 3.1) to bypass the restriction. So, disallowing all bots won’t help much if attackers may get benefits from their actions. But it also blocks friendly bots too.

    2. Why do you think social media platforms allow bots to operate?

      Bots could be helpful to today’s life. Automation is useful to use. For example, we use bots to block spam, archive out dated threads. Bots make the platform programable, which extends the possibility of the platform. With bots, platform may have more functionality than it designed. Platform get benefits from content on it and the user traffic. Bots help both improve the quality of content, and may also attract more user traffic. And so it benefits the platform. It is hard to blocking bots. Introducing more captcha could be a bad idea to stopping bots as it also harm experience of real people. And as we discussed before, attacker may still use more complex technology or even a real human (as discussed in 3.1) to bypass the restriction. So, disallowing all bots won’t help much if attackers may get benefits from their actions. But it also blocks friendly bots too.

    1. The best collaborative practices of the past ten years address this contradictory pull between autonomy and social intervention, and reflect on this antinomy both in the structure of the work and in the conditions of its reception. It is to this art—however uncomfortable, exploitative, or confusing it may first appear—that we must turn for an alternative to the well-intentioned homilies that today pass for critical discourse on social collaboration. These homilies unwittingly push us toward a Platonic regime in which art is valued for its truthfulness and educational efficacy rather than for inviting us—as Dogville did—to confront darker, more painfully complicated considerations of our predicament.

      SP5: The criteria of socially engaged art sees the self-sacrifice of the artist as successful. Through the self-sacrifice, the artists are expected to renunciate control of the aesthetic and focus merely on the social praxis of the work. However, according to Jacques Rancière, the system of art is based on a confusion between art’s autonomy and heteronomy, and the authorial presence is integral to the autonomy. The authorial aesthetic plays a crucial role to think of the contradiction between autonomy and social change and doesn’t need to be sacrificed for social change as it contains the promise of amelioration. In reference to Lars von Trier’s film, Dogville, Claire Bishop addresses a terrifying implication of self-sacrifice. The good intention of artist is not a reason to avoid critical analysis. A good socially collaborative art project should be able to address the contradiction between autonomy and social intervention, and reflect it through authorial aesthetics and the participants, more importantly, it should lead us to the serious thinking of our issues and predicaments.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reviewer #1 (Evidence, reproducibility and clarity (Required)):

      The study largely focuses on the use of a 293 cell line that lacks a functional Dicer gene originally identified by the Cullen group. Baldaccini use this cell line, referred to as NoDice cells, to reconstitute various Dicer isoforms that have thus far been described in a variety of settings (e.g., stem cells and oocytes). Collectively, these data demonstrate the capacity of certain N-terminal truncations of Dicer to inhibit Sindbis virus and reduce the presence of viral dsRNA, supporting some of the observations made thus far concerning an antiviral role for mammalian Dicer. For other viruses, this impact was significantly more modest (SFV reduction is less than a log) or was not observed at all (VSV and SARS-CoV-2). The authors then go on to characterize the nature of the observed antiviral activity and ultimately implicate PKR and the induction of NF-kB in priming the cell's antiviral defenses. Importantly, the group also found that this antiviral activity neither required the nuclease activity of Dicer nor the kinase activity of PKR - providing evidence against antiviral RNAi in mammals. In all, the data would seem to suggest that Dicer can act as a dsRNA sensor and can mediate the activation of an NF-kB response - akin to what is observed in response to NOD or some TLR engagement. In all, it is the opinion of this reviewer that this work brings additional clarity to a concept that remains controversial in the field and therefore embodies something meaningful for the community.

      With that said, there are a few issues that require additional attention. The first of these is textual. The introduction of the paper accurately describes the evidence in support of mammalian RNAi but does not invest the same time in discussing the data to the contrary. For example, Seo et al demonstrated that virus infection results in poly-adp-ribosylation of RISC preventing RNAi activity (PMID: 24075860), Uhl et al showed that IFN-induced ADAR1 resolves dsRNA in the cell and prevents RNAi (PMID: 37017521), and Tsai et al showed that virus-derived small RNAs are not loaded into the RISC in a manner that would enable antiviral activity (PMID 29903832). None of this work is referenced in this manuscript and it generates an unbalanced introduction as it relates to the controversy surrounding the idea of RNAi in mammals.

      Reply: We thank the reviewer for their positive comments and suggestions. In the revised version of this manuscript, we will rewrite the introduction to take into account the published data that are not in favor of an antiviral role of RNAi in mammals and we will add the suggested references

      The second issue that would further strengthen this paper relates to the fact that the authors spend a considerable amount of time discussing the data of Figure 6 and 7 as conditions that are defined by a Dicer that can not be processive in its nuclease activity (WT) vs. one that can (N1). However, there seems to be little consideration about the fact that the introduction of WT Dicer into these cells also restores miRNA biology whereas N1 appears to remain only partially functional (based on the data of Fig 3E). Given this, it seems the authors should verify that the high baseline of NFkB signaling that is being observed when comparing WT to N1 is not a product of restored miRNA function in WT cells, in contrast to the hypotheses outlined in the manuscript. This could be addressed by silencing Drosha or DGCR8 in the Dicer knockout cells prior to their reconstitution of Dicer. In the opinion of this reviewer, this experimental control would significantly strengthen the conclusions the authors are making here.

      Reply: This would indeed be an ideal experiment to rule out the contribution of miRNAs in the observed phenotype. We believe however that this particular experiment would prove difficult to realize given that we reconstitute Dicer expression by lentiviral transduction and keep the cells under selection for a couple of weeks before using them for further experiments. This time frame is therefore not compatible with the use of siRNA to knock-down Drosha or DGCR8. Alternatively, we could knock them out by CRISPR-Cas9, but this would take too long and is not feasible in the frame of this work.

      We can however address the concern regarding the role played by miRNAs in the observed phenotype of the Dicer N1 cells. Indeed, we can determine the miRNA profile from our small RNA sequencing data and compare them between the Dicer WT and Dicer N1 cells. We have done this comparison and could not find striking differences in miRNA expression between the two cell lines. We will add this additional piece of evidence in our revised manuscript.

      Reviewer #1 (Significance (Required)):

      In the manuscript entitled, "Canonical and non-canonical contributions of human Dicer helicase domain in antiviral defense" Baldaccini et al. describe their findings concerning the ability of certain N-terminal deletion variants of Dicer in contributing to mammalian antiviral activity. The concept of a functional antiviral RNAi system in mammals is a contentious one with many publications including data both in support of its existence and opposing this idea. In this manuscript, Baldaccini et al. perform a wide range of well-controlled experiments to specifically address aspects of those reports to both provide clarity in what has been documented thus far and to expand on those concepts further.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)):

      Summary

      Whether RNAi is used as an antiviral mechanism in mammals has been a hotly debated issue. The research team previously published several papers on the roles of Dicer in siRNA/miRNA biogenesis and in antiviral responses. They have recently reported that the helicase domain of human Dicer specifically interacts with several proteins that are involved in the IFN response, including PKR. In this study, Baldaccini et al. investigated the involvement of Dicer in antiviral response using various mutants of human Dicer. They showed that deletion mutants of helicase domain exhibit antiviral activity that requires the presence of PKR. They further demonstrated that one of the mutants, N1-Dicer showed antiviral activity in an RNAi-independent manner but depending on the presence of either native PKR or kinase deficient mutants. Transcriptomic analysis revealed that numerous genes involved the IFN and inflammatory response were upregulated in the cells that express N1-Dicer, which is likely due to an increased activation of the NFκB pathway. Based on these findings, the authors propose that Dicer may act as antiviral molecule using its helicase domain, which representing a novel non-canonical function of Dicer.

      Major comments:

      1.The results from experiments with SARS-CoV2 are intriguing (Fig.2). The authors speculated that NFkb activation is in favor of the replication of this virus. It would be interesting to see the infection and replication of SARS-CoV2 in PKR deficient cells and cells expressing PKR mutants (as described in Fig.5). The results may prove/disapprove the authors' speculation and yield additional findings.

      Reply: We thank the reviewer for this suggestion. We have cells that are double knock-out for Dicer and PKR (NoDice/∆PKR) that were transduced to stably express Dicer WT or Dicer N1 and further transduced to express ACE2. We will infect those cell lines with SARS-CoV-2, which will allow us to see whether the difference in viral accumulation can still be observed in the absence of PKR. However, it might prove more difficult to reconstitute PKR expression (WT or mutants) in these cells since they are already transduced twice with two different constructs (Dicer and ACE2).

      Western blot analysis. In the method section, it is stated that proteins were quantified with Bradford method and equal loading was verified by Ponceau S staining. The members of also probed with gamma-tubulin (It was stated that antibodies against alpha-tubulin was used in the method section) as a loading control, however, the bend intensity of tubulin shows great variations among different lanes in several figures while Ponceau S staining is similar (Fig.s, 4, 5, and 8). The differences compromise the accuracy of the results.

      Reply: We apologize for the difference in Tubulin signal in some of our western blots. There are several possibilities to explain those inconsistencies between Ponceau staining and Tubulin blotting, including an effect of viral infection on Tubulin expression. To remove ambiguities around this issue, we could quantify the signal across several blot replicates and provide the quantification after normalization. In addition, we would like to stress that regarding quantification of the infection, we think that the plaque assay experiments are more reliable than quantification of western blot signals.

      3.RNA-seq analysis revealed that Dicer N1 cells have significantly increased expression levels of signaling molecules in type I IFN response even in uninfected cells. While this provides a potential explanation for the antiviral phenotype of N1-Dicer cells. I wonder why the expression levels of type I IFNs (probably the most potent antiviral molecules) were not analyzed in WT and Dicer N1 cells. Measurement of the levels of IFNα and IFNβ by ELISA in the cells before and after infection could provide the important and direct data to support their conclusion.

      Reply: This an interesting suggestion but unfortunately, we do not believe that it would possible to quantify IFNα and IFNβ by ELISA in the cell line that we used in our experiments. Indeed, the level of expression might just be too low to be able to measure something meaningful. We could measure the induction of IFNβ expression at the mRNA level by RT-qPCR though. However, we do not believe that the observed increased expression of genes that belong to the type I IFN response is solely the effect of an increased production of IFN. These genes are also under the control of other transcription factors, including NF-kB for some of them, and it might prove difficult to make a direct link with IFNα or IFNβ production.

      4.While the data presented in Fig. 5 provides convincing evidences that the antiviral activity of mediated by PKR against SINV is independent of its kinase activity in N1-Dicer cells. An interesting question is that whether antiviral activity associated with PKR is N1-Dicer dependent, which could be addressed by comparing the viral infection of NoDice∆PKR and NoDicer expressing PKR mutants.

      Reply: Yes indeed, we have generated NoDice/∆PKR cells expressing PKR WT or mutant and we will infect them with SINV to confirm whether the presence of Dicer N1 is needed for the observed phenotype.

      5.In the concluding paragraph of the discussion, the authors presented an oversimplified discerption of a complex model that involves a crosstalk between IFN-I and RNAi and Dicer-PKR interaction, which is difficult for the reader to compose a clear picture of mechanisms involved. It could be helpful to use a schematic illustration to summarize the action model of PKR incorporated with the canonical and non-canonical Dicer functions.

      Reply: We will add a schematic model in the revised version of our manuscript to summarize our main findings.

      Minor comments:

      1.It stated that NoDice FHA-Dicer WT #4 and NoDice FHA:Dicer N1 110 #6 are referred to as Dicer WT and Dicer N1 cells (p.6). For simplicity, Dicer WT and Dicer N1 cells should be used throughout manuscript, including in all figures. The labels in the figures are difficult to read and are confusing in some cases.

      Reply: This will be changed in the revised version to increase the clarity of the figures.

      2.It is to note that p-PKR was only detected at in N1-Dicer cells at 24 hpi (Fig.8A). This is an interesting observation that was not discussed. It appears that this could be due to a delayed viral replication since these cells are already in an elevated antiviral state. This possibility could be tested by examining viral replication and dsRNA accumulation at more time points in the experiments described in Fig.1.

      Reply: We have performed a kinetic of infection at more time points and we will incorporate these experiments in the revision.

      3.The authors may point out the limitations of the studies. For examples, all cells used in the study are engineered HEK cell lines and were tested with limited number of viruses. As such, the observations may reflect Dicer-PKR interaction under artificially overexpressed conditions, but how the model established from the current study applies to primary cells require further investigation.

      Reply: This is indeed important, we will add a sentence about this in the discussion.

      Reviewer #2 (Significance (Required)):

      The findings reported in this study shed some new light on a long-debated issue regarding the potential roles of RNAi as physiologically relevant antiviral mechanism in mammals. Identification of a new antiviral function of Dicer helicase domain via interaction with PKR is a new advancement of the field, and it also adds a new dimension to a complex subject that overlaps of innate immunity , RNA biology, and developmental biology associated with Dicer.

      Field of expertise: Innate immunity, cell signaling, cytokine biology

      Areas that that I do not have sufficient expertise to evaluate: Small RNA cloning, sequencing and, analysis.

      Reviewer #3 (Evidence, reproducibility and clarity (Required)):

      This work by Baldaccini et al. explores the interplay between Dicer and the antiviral protein PKR in the context of viral infection. It builds on a previous publication of the team which demonstrates that the Dicer helicase interacts with multiple RNA binding proteins, including PKR (see Montavon et al.). In this work from 2021, they demonstrate that an artificially-truncated form of Dicer (Dicer-N1) lacking part of the helicase is antiviral against RNA viruses in a PKR-dependent fashion. This was an interesting finding because the field largely assumed that Dicer-N1 performs its antiviral function via canonical dicing of dsRNA, as part of an antiviral RNAi pathway. The present manuscript follows up on this initial discovery and deciphers the specifics of Dicer-N1 antiviral phenotype, as well as delineates the interplay between Dicer's helicase and PKR. The authors main claims are as follow:

      1. i) Dicer-N1 antiviral effect does not require its catalytic activity, therefore is completely RNAi-independent.
      2. ii) Neither does it require canonical PKR activation, but relies instead on NF-kB-driven inflammation. The origin of this inflammation is not studied.
      3. ii) Truncated Dicers other than Dicer-N1 are antiviral through RNAi, but are also PKR-dependent. The authors claims are mostly supported by the data, although I suggest below some improvements regarding experimental approaches and data presentation. This work details in an interesting manner the interplay between the machinery of RNAi and the classical pathway of innate immunity (PKR). As explained by the authors, there is solid data in the literature demonstrating the mutual exclusivity of IFN and antiviral RNAi in differentiated cells. This mostly goes through the receptors LGP2, which inhibits dsRNA dicing by Dicer. The authors data suggest that, conversely, Dicer may play a role in preventing the unwanting activation of PKR (a non-canonical activation leading to inflammation). Given that PKR activation does not depend on virus, the authors discuss potential mechanisms of PKR triggering. This is an interesting topic that deserves further investigation (not necessarily within the frame of this work - it can be a follow-up). Another interesting piece of information is that different truncated Dicers behave differently with respect to implementing antiviral RNAi. Whilst Dicer-N1 isn't proficient in doing so, the other forms are. It shows that lab-generated truncations do not fully recapitulate what is observed with existing truncated Dicers (DicerO and aviD).

      Experimental design and data interpretation

      1. The authors should compare infection between different cell lines across a range of time points (ie, a virus growth curve). In Fig 4E for example, I worry that cells expressing or not PKR will reach the plateau of viral particle accumulation at different time points. One could imagine that cells lacking PKR do not show any differences in particle production at 24h, but do at earlier time points.

      Reply: This is an interesting suggestion, we can perform a kinetic experiment by looking at more time points to address this point. This will allow us to determine the time needed for every cell line to reach the plateau of infection.

      Western blots should be accompanied with proper quantifications plotted as bar graph with biological replicates (p-PKR, p-eIF2a and capsid).

      Reply: We have biological replicates for our western blot experiments, and we will quantify those to better determine the observed changes. However, in the case of p-eIF2a, we do not think it is pertinent to measure it since there are other kinases than PKR that are known to induce eIF2a phosphorylation upon SINV infection. It might therefore not prove very informative to precisely quantify this particular signal.

      Microscopy images should be properly quantified across biological replicates (Fig 1&2 for the J2 staining, for example).

      Reply: We could do a proper quantification of the J2 signal across replicates, but we do not think it would bring much to our message. Here, we mostly used J2 staining as a qualitative indication that the infection was impacted or not. We have a proper quantification of the effect with our plaque assay experiments, which are way more robust to determine the levels of infection between conditions.

      Confounding factors hinder the interpretation of siRNA accumulation (Suppl Fig 2): i) the efficiency of dsRNA dicing from different Dicers will generate different amounts of siRNAs from a given amount of dsRNA and ii) the higher antiviral response translates into decreased infection, so decreased dsRNA substrate. I suggest that the authors normalise the amount of viral siRNAs over the total amount of viral genomes. This should allow to assess if Dicer-N1 is better at dicing dsRNA than WT in these conditions.

      Reply: This is a valid concern and we agree that it is important to be able to normalize small RNA reads between conditions before reaching a conclusion. The problem is that there is no easy way to do this since we do not get a direct measurement of viral genomes accumulation from our small RNA sequencing data. To better compare the two conditions, we could normalize the individual viral siRNA to the total number of viral reads. Another problem that we face is that we are looking here at the AGO-loaded small RNAs, which makes it more difficult to assess dicing efficiency since not every generated siRNA might be loaded into an Argonaute protein. In fact, this has been proposed by the Cullen laboratory in a paper published in 2018 (Tsai et al. doi: 10.1261/rna.066332.118). They showed that although viral siRNAs were generated during IAV infection, those were inefficiently loaded and thus did not significantly impacted the infection.

      In Fig 8, the authors should verify that phospho-p65 increase depends on PKR by repeating the experiment in PKR KO cells.

      Reply: Yes, good point. We will check what happens to phosphorylation of p65 in PKR KO cells. In addition, we can also measure the effect on a known NF-kB target by RT-qPCR (e.g. PTGS2).

      Data representation

      1. Levels of phospho-PKR and eIF2a need to be normalised on the total amount of PKR and eIF2a, respectively. The authors should quantify the blots and present bar graphs with biological replicates and statistics.

      Reply: As mentioned above in our reply to point 2, we can add the quantification for phospho PKR, but we do not think it is pertinent to do it for eIF2a.

      Could the authors add the names of representative genes on the volcano plots of Fig 7?

      Reply: Yes, this will be done.

      Points of discussion

      1. In Fig 4C, catalytically-dead mutants of truncated Dicers (other than N1) do not display an antiviral effect. Presumably, such proteins implement canonical antiviral RNAi. Is there a reason why the authors interpret this data as Dicers being "partially" antiviral through RNAi (l. 92). This data instead suggest that is it totally dependent on RNAi.

      Reply: Indeed, and we do not say the contrary. It seems that some of this helicase-truncated Dicer proteins can act through RNAi. However, they also depend on PKR, so in the end it might be a combination of the two that allows their antiviral effect.

      Gurung et al. demonstrate that PKR is activated in Dicer KO mouse ES cells, which results in phosphorylation of eIF2a at steady-state. This is different from the authors' data, in which PKR activation does not affect eiF2a phosphorylation. Could the authors discuss this discrepancy?

      Reply: The problem that we face here is that SINV is known to also activate GCN2 and therefore eIF2a phosphorylation does not strictly rely on PKR in our experimental conditions. In addition, we did not check eIF2a phosphorylation in Dicer KO cells, but we always compare Dicer WT and Dicer N1 expressing cells.

      Do the authors expect that truncated Dicers other than N1 trigger an inflammatory response such as the one described for N1? Would it be possible to have this antiviral inflammatory response in conjunction with antiviral RNAi?

      Reply: This goes back to Point 1 mentioned previously. We think indeed that there might be a dual action of Dicer and that it will be important to check whether in other cellular systems or animal model such a phenomenon can be observed as well. This is a point that we did address in the discussion of our manuscript (line 522-525).

      Reviewer #3 (Significance (Required)):

      This is a study that conceptually advances the field of antiviral RNAi in mammals, including its interplay with the machinery of innate immunity. It is of interest for virologists and immunologists. My expertise is centered on the mechanisms of innate immunity in mammalian cells, including antiviral RNAi.

    1. Author Response

      We would like to express our gratitude to the Editors and Reviewers for their thoughtful and helpful comments. We sincerely appreciate the opportunity to submit our revised manuscript titled “Predicting Ventricular Tachycardia Circuits in Patients with Arrhythmogenic Right Ventricular Cardiomyopathy using Genotype-specific Heart Digital Twins” to eLife. We are delighted that our research in ARVC has garnered the interest of the three reviewers. Below, we provide our point-by-point responses to the reviewers’ comments. We have also incorporated the suggestions provided by the reviewers in our revised manuscript.

      Comments from Reviewer 1

      We thank Reviewer 1 for their positive assessment and thoughtful suggestions. Here are the responses to the comments of reviewer 1:

      Comment 1: One addition that could add more insight is to predict the effect of structural remodeling alone well, considering only normal electrophysiological models.

      We thank the reviewer to give this thoughtful suggestion to our experiment design. We would like to highlight that this suggestion was indeed taken into consideration in our study as all the patients’ hearts were modeled using the gene-elusive cell model before the structural-EP mismatch was implemented. The gene-elusive cell model is a baseline ten Tusscher (TT2) human ventricular model described in the “Cell-level modeling” of our Methods. Therefore, we have already examined the impact of structural remodeling alone in the study.

      Comment 2: Another interesting approach would be a sensitivity analysis, to determine how sensitive the VT circuits are to the specific geometry of the patient and remodeling that occurs during the disease, such an approach could also be used to determine how sensitive the outputs are to electrophysiological model inputs.

      We think this suggestion is of great value and could benefit our future ARVC studies. The reviewer pointed out the importance of investigating how sensitive the VT circuits are to the specific geometry/remodeling of the patient during disease progression. To achieve this, for each patient, a sequence of LGE-CMR images at different stages of this disease is required for model reconstruction; unfortunately, our cohort for this study does not incorporate such data.

      Comments from Reviewer 2

      We thank Reviewer 2 for the positive assessment, and here are the responses to the comments:

      Comment 1: I appreciate that the types of computational models detailed in this paper take enormous time to develop. However, to identify bottlenecks in the clinical workflow (and thus targets for future research), it may be nice for the authors to discuss the time taken to generate and run the models for each patient?

      We sincerely appreciate the valuable feedback from the reviewer. We recognize the importance of considering model generation and run time. In the introduction, we have highlighted the clinical challenge in managing ARVC ablation procedures, which is the inability to capture all the VT due to an incomplete understanding of VT mechanisms. We acknowledge the reviewer’s concern regarding the potential time taken by the model to predict VT circuits and whether this could hinder the integration into the current ablation procedure. However, it is important to clarify that our model is primarily based on clinical images obtained in advance of the procedure. As a result, there is sufficient time available to generate the results required for ablation planning.

      Comment 2: In the Materials and Methods section, some references are underlined? Is this a typo or meant to convey some particular information?

      We thank the reviewer for pointing this typo out and we have removed the underlining of references in our revised manuscript.

      Comment 3: The authors state that the cellular models are available from the CellML model repository. This is an excellent practice. However, the URL that is given points to the entire CellML website. It will be more useful for URLs that point to the specific models used in the study so that readers can be sure they are looking at the correct model.

      We appreciate the reviewer for this suggestion, and we have edited the URL in Data Availability to link to a specific cell model on the CellML website.

      Comment 4: In the abstract, the authors report the sensitivity, specificity, and accuracy of their computer models but fail to comment in the abstract that they are comparing against recordings from the patient during a previous EPS study. To assist further readers who are scanning the abstract, the authors may wish to add a sentence or two to detail what they are comparing their model results to.

      We thank the reviewer for the suggestion. This is a retrospective study. We recognize the importance of wording clarity in the abstract; in response, we have added a sentence in the abstract to clarify that we compared VT locations of Geno-DT with the ones recorded during clinical EPS to obtain sensitivity, specificity, and accuracy.

      Comment 5: In Table 1 some of the data is discrete e.g., the number of patients on a beta-blocker. The authors give a p-value for comparing the GE and PKP2 data and state in the caption that a Student's t-test has been used. Strictly speaking, a t-test is not really appropriate for the population proportion with non-parametric data. That said, the size (n) of the data here makes the p-values from any statistic very unreliable. Perhaps the authors might like to reconsider if p-values add anything to such data? If so, then the statistical test should be reconsidered.

      We truly appreciate the reviewer for pointing out this typo in the caption of Table 1. For the non-parametric discrete data, we used z-test, a common statistical method used to compare percentages, to get the p values, but we mistakenly only mentioned t-test in our caption. We acknowledge the limitation of our sample size and we have corrected this typo in our revision.

      Comment 6: I found Table 1 and its caption a little confusing. The authors put the range in [] brackets and then abbreviated standard deviation with () brackets. On initial reading, I incorrectly assumed that the numbers in the table in () brackets were standard deviations when, in fact, they are percentages. Perhaps the authors could consider changing the caption so that the percentage is in, say, {} brackets and make the caption say that values are given as n {%} etc.

      We appreciate the reviewer for pointing this out and we recognize that certain expression in the Table 1 caption is confusing. In our revised manuscript, we used n {%} to replace n (%) and deleted the abbreviated standard deviation which has not been used.

      Comment 7: In the caption for Figure 2 the authors present action potentials "at steady state". Adding the pacing frequency (or cycle length) for the steady state would be useful.

      We thank the reviewer for pointing this out. We agree that showing pacing frequency is important and we have made the edit in our revision.

      Comment 8: In Table 2 the VT locations are compared between the EPS and the Geno-DT model. The comparison metrics listed in the table should be better described in the table caption. It is unclear if the authors compare VT locations in the AHA segments or if the specific geometric location is used. If it is a geometric location, then I would have expected to see information on the mean error distance or similar information? If it is a comparison of AHA segments, there could be a problem if a VT location was very close to the border between segments. The predicted VT location might be very close to the measured VT location but may end up in a different segment? The authors may like to clarify the methodology and/or discuss these issues.

      We thank the reviewer for this comment. We recognize the need for clarification on the comparison metrics of Table 2. In the text related to Table 2, we used the wording “anatomical location” to avoid excessive repetition of mentioning AHA segments. However, we agree that reverting it back to the “AHA segment” will reduce confusion. Regarding the point of comparing exact locations the reviewer mentioned, in clinical settings, clinicians primarily rely on AHA segments to describe the VT locations during ablation and descriptions in the EP report, rather than using exact coordinates. As such, a match between our predicted AHA segments and clinical AHA segments is a direct comparison. This alignment provides a meaningful comparison and is sufficient for assisting ablation procedures.

      Comment 9: In Figure 7, activation maps are shown, and the row is labelled as Induced VTs/Geno-DT. Are the colour maps from the model or the EPS measurements? The last sentence of the caption indicates they are from the measurements, but such detailed full-wall maps seem to be from a model. The authors may like to clarify what the figure shows.

      We thank the reviewer for this comment. We understand the reviewer’s concern regarding the clarity of Figure 7’s caption. While we believe that the first bold sentence in the caption adequately clarifies that the results in Figure 7 are derived from the Geno-DT model, we agree with the reviewer that it is needed to further enhance the wording clarity. In response, we have made the necessary edits to the caption in our revised manuscript.

      Comments from Reviewer 3

      We thank Reviewer 3 for giving the positive assessment. Here are the responses to the comments.

      Comment 1: The small sample size is a limitation but has already been acknowledged and documented by the authors.

      We thank the author for this comment, and we acknowledged the small sample size as a limitation in our manuscript.

      Comment 2: Another limitation is the consideration of only two of the possible genotypes in developing the cell membrane kinetics, but again has been acknowledged by the authors.

      We thank the author for this comment, and we acknowledged the consideration of only two genotypes as a limitation in our manuscript. We hope to enlarge the genotype groups in our future ARVC studies.

    1. Others are also made by well-intentioned and conscientious people who fear that harm will come to some segment of the community if a particular text is read or recommended.

      I am curious about the idea that as generations pass and ideologies change, if the banned book list will see a shift in reasoning. I think undoubtedly it has to, for example, 40 years ago a book may have been banned due to having tones of homosexuality or transgender people, but now, or maybe in the near future, I could see books being banned for having themes of homophobia or transphobia. This is a very base line example, and I think if we look at the list of banned books and the culture of the time, we will be able to find out a lot of what was considered right and wrong in those time periods.

    2. first, any text is potentially open to attack by someone, somewhere, sometime, for some reason

      I really enjoy how they make argue this point. Someone, somewhere will always be able to find something wrong with a text you have selected - because the world is imperfect and we as humans are imperfect and often sensitive, we cannot satisfy every single human being. That being said, I think it is important to challenge students to read books that may challenge beliefs or bring new perspectives to light for them.

    1. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      Summary

      In this study, the authors conducted a multi-omics analysis comparing cells from the long-lived bat, Pteropus alecto, and human cells. Their findings revealed that bat cells express higher levels of mitochondrial complex I components and exhibit a lower rate of oxygen consumption. Moreover, computational modeling suggested that the activity of complex II in bat cells might be low or even reversed, similar to the conditions observed during ischemia. The decrease in central metabolites and the increased ratio of succinate to fumarate in bat cells might indicate an ischemia-like metabolic state. Despite having high mitochondrial ROS levels, bat cells exhibit higher levels of total glutathione and a higher ratio of NADPH to NADP. Additionally, bat cells showed resistance to glucose deprivation and induction of ferroptosis.

      Major comments

      1. Regarding Figure 1A, the authors mention 'n = 3' for a single cell line. Does this refer to three different passages or three independent experiments? Please provide a more detailed description to clarify.
      2. In relation to Figures 1C and 1D, the authors state in the figure legend that the 'GSEA analysis identifies Respiratory electron transport and Cellular response to hypoxia as the top metabolic pathways that are differentially regulated between PaLung and WI-38 cells.' (Lines 140-144). However, the criteria for selecting these terms as the top metabolic pathways is not clear. In the lists in Supplementary Tables 2 and 3, the authors' proposed term, 'Respiratory electron transport,' is ranked 126th, and 'Cellular response to hypoxia' is ranked 79th. Conversely, terms related to the TCA cycle are ranked 66th and 82nd, and another term that seems to be related to hypoxia, 'OXYGEN-DEPENDENT PROLINE HYDROXYLATION OF HYPOXIA-INDUCIBLE FACTOR ALPHA,' is ranked 62nd. Could the authors please provide a clarification for their choice of 'Respiratory electron transport' and 'Cellular response to hypoxia' as the top metabolic pathways?
      3. In the Materials and Methods section (lines 419-421), the authors mention, 'GSEA was run against the complete Gene ontology biological process (GO BP) gene set list (containing 18356 gene sets).' However, they narrow down the gene dataset for analysis (lines 136-138, 'we filtered our gene dataset to contain only genes listed under the Gene ontology category Cellular Metabolic Process (GO ID:0044237), resulting in a truncated list of 4794 genes.'). I'm concerned that this selective approach might introduce bias into the resultant pathways. Is this selective approach commonly employed in this type of analysis? And isn't there a need for adjustments to avoid potential bias?
      4. The authors noted that the number of differentially expressed genes (DEGs) is quite high (6,247 out of 14,986) as per lines 134-135, stating that "The number of differentially expressed genes (6,247) was extremely high, suggesting that multiple pathways are differentially regulated between the two species." However, this large number of DEGs could indicate either an improper correction procedure or a need for a more stringent threshold. The authors should address this issue to avoid potential misinterpretation of the results.
      5. In Figure 2B, the samples labeled as W1 and P1 appear to be outliers. This raises questions about the integrity of the sampling or analysis process. Please describe about this.
      6. Regarding the GSEA analysis of Fig. 2, they are using the full set of GSEA. However, this reviewer is wondering if this is appropriate when analyzing mitochondrial fractions, as I believe using the entire GSEA set could introduce a bias. Is this a common approach? Shouldn't the authors be focusing on mitochondrial-related sets within the GSEA, and then determining the upregulated and downregulated pathways from there?
      7. The authors describe in lines 195-197, "GSEA-flagged upregulation in OxPhos was driven mostly by the upregulation of Complex I subunits, for both the proteomic and transcriptomic data (Figure 2G, Supplementary Figure S1D)." However, within this analysis, the number of genes composing each subgroup of the mitochondrial Complexes are 44 for Complex I, 4 for Complex II, 10 for Complex III, and 19 for Complex IV (https://www.genenames.org/data/genegroup/#!/group/639). The authors mention that the genes of Complex I were dominant in the ETC, but, might this just be reflecting the original difference in the number of genes? As this reviewer believes this could have a significant impact on the authors' current claims, this reviewer suggest the authors to carefully reconsider this point, comparing the actual results with the proportion expected from the difference in gene numbers. (Even in Fig. S1D, it appears to correlate with the number of genes: C1 39.3%, C3 10.7%, C4 10.7%, C2 3.5%)
      8. As pointed out in Major Point 7, if the authors' claim of enrichment in Complex I is indeed due to the large number of genes included in the Complex I subgroup (https://www.genenames.org/data/genegroup/#!/group/639), can the assumption of High Complex I flux truly be considered valid? In that case, this constraints model would become inappropriate, and the validity of the inferred low or reverse activity of Complex II would be diminished. Therefore, a careful re-examination is desirable.
      9. (option, takes about 1-2 months). This reviewer believes that the authors' most important claim, concerning the high activity of Complex I and the low activity of Complex II, lacks strong evidence as no biochemical data of the activities of each mitochondrial complex are presented to substantiate this. Unless additional biochemical experimental data is provided, the assertions should be toned down. While the abstract mentions "complex II activity may be low or reversed," it is stated with certainty in line 108 of the introduction, "associated with the low or reverse activity of Complex II." Based on the present data, this reviewer believes that the claim remains speculative. Therefore, I suggest moderating the overall argument or adding the biochemical data. While the results from metabolomics are supportive, they do not serve as direct evidence.
      10. Regarding Figure 5, the title of the figure states "lower antioxidant response", but it doesn't seem that the data in the figure actually shows a lower antioxidant response.
      11. In lines 109-110 of the Introduction, the authors state, "we confirmed our prediction of ischemic-like basal metabolism in PaLung cells by characterizing the response of bat cells to cellular stresses such as oxidative stress, nutrient deprivation, and a type of cell death related to ischemia, viz. ferroptosis." However, can the assertion that the cells are in an ischemic-like state be confirmed simply because they are resistant to several types of cellular stress?

      Minor points:

      1. The authors mention the use of cufflinks/Tophat for mapping/quantification. However, support for these software programs has ended and the creators of these programs themselves recommend using the successor programs. I recommend re-analysis using a more current pipeline (such as HISAT2/StringTie, STAR/RSEM, etc.). Furthermore, the transcriptomics section of the methods should also include the program used for cleaning and trimming.
      2. As for the Oxygen Consumption Rate (OCR) data presented in Figure 2F, it makes sense that it's low at the basal level. However, it's perplexing that it is also low even under uncoupled conditions, especially considering the high energy demand associated with flight in this species. Could the authors provide their interpretation on this apparent contradiction?
      3. In line 156, the authors mention that 'Profiling detected a total of 1,469 proteins.' Please provide more details in the explanation. Specifically, does this total of 1,469 proteins represent a combined count from both humans and bats, or is this the number of proteins for which orthologs could be identified in both species, just like the authors did with the transcript results.
      4. In Supplementary Table 4, only 127 mitochondrial proteins are listed out of the 405 proteins mentioned in "Of these 405 proteins, we identified 127 to be core mitochondrial proteins (lines 161-163)". As there is no explanation for this within Supplementary Table 4, it would be better to include one.
      5. In line 472, the phrase "GO BB gene set list" is used. Could this potentially be a typographical error, and should it instead be "GO BP gene set list"?
      6. In the volcano plot of Fig. S3B, it appears that the side with lower P/W values generally corresponds with lower p-values. I wonder if there might have been any oversight or mistake in the data analysis process that could explain this observation?
      7. In lines 249-252, it is stated, "The low or negative flux values for Complex II in our PaLung simulations indicate that the electrons obtained from Complex I may accumulate at Complex II or potentially even get consumed by Complex II operating in reverse (bypassing the rest of the ETC) in PaLung cells." However, isn't the basic process of electron transfer done through Complex I-III-IV, independent of Complex II?
      8. Regarding Figure 4F, the authors state, 'PaLung cells displayed higher viability than WI-38 cells after glucose deprivation (Figure 4F).' However, in addition to the cell images, it would be beneficial to perform experimental quantification of cell death to provide more rigorous data. Additionally, the cells appear to be over-confluent, which might influence the results. Also, scale bars should be included in all photos, including Fig. 6.
      9. Regarding Figure 5B, it is stated that 'the expression levels of differentially expressed antioxidant genes' are shown, but it includes those that are not significant. It would be helpful if the authors could clarify how this gene set was selected.
      10. Regarding Figure 6C, the values for total glutathione seem to significantly differ from those in Figure 5C. An explanation for this discrepancy would be appreciated to ensure the consistency and reliability of the data.

      Referees cross-commenting

      I think the comments from the other reviewers are appropriate.

      Significance

      Collectively, these intriguing results from the interspecies comparison provide novel insights into the differences in metabolism and cellular characteristics between bat and human cells. However, the study has some limitations, notably certain weaknesses in the data and potential overstating of certain interpretations. Addressing these issues would enhance the overall quality and robustness of the manuscript. Furthermore, if feasible, conducting a biochemical analysis of each mitochondrial complex activity would solidify the authors' main conclusions.

    1. Author Response

      Reviewer #1 (Public Review):

      The current manuscript by Liu et al entitled "Discovery and biological evaluation of a potent small molecule CRM1 inhibitor for its selective ablation of extranodal NK/T cell lymphoma" reports the identification of a novel CRM1 inhibitor and shows its efficiency against extranodal natural killer/T cell lymphoma cells (ENKTL).

      This is a very timely and very original study with potential impact in a variety of pathologies not only in ENKTL. However, the main conclusions of the work are not supported by experimental evidence.

      Many thanks for your very kind words about our work. We are excited to hear that you think our manuscript is original with considerable translational impact to the field. We are grateful for your valuable time and efforts you have spent to provide your very insightful comments, which are of great help for our revision.

      The study claims that LFS-1107 reversibly inhibits the nuclear export receptor CRM1 but the authors only show that the compound binds to CRM1 and that the CRM1 substrate IκBα accumulates in the cell nucleus upon LFS-1107 treatment. The evidence is indirect and alternative scenarios are certainly possible.

      Many thanks for this critical comment. We have conducted extra experiments to demonstrate that LFS-1107 can reversibly inhibit the nuclear transport machinery mediated by CRM1. Namely, culturing the medium for two hours after LFS-1107 treatment restored the transport of IκBα from the nucleus to the cytoplasm. Please see Figure 2 -Figure Supplement 3 for more details.

      On the other hand, the manuscript is not always well-written and insufficiently referenced.

      Thanks for this critical comment. This has been fixed. We have checked through the manuscript with extensive language editing. Moreover, we have added more references to the manuscript.

      The nuclear translocation in figure 2G is not convincing. The western blot in figure 2G shows that LFS-1107 treatment induces IκBα expression, and both cytoplasmic and nuclear amounts increase in a dose-dependent manner. Together, these data do not support nuclear IκBα accumulation upon LFS-1107 treatment.

      Thanks for this critical comment. This has been fixed. We have reconducted the Western experiments and our results revealed that only nuclear IκBα amount was increased upon the treatment of LFS-1107. In contrast, cytoplasmic IκBα amount was decreased after the treatment of LFS-1107. Please see Figure 2J for more details.

      Reviewer #2 (Public Review):

      Indeed, ENKTL is a rather deadly tumor with unmet medical needs. The work is novel in the sense that they designed and identified a very potent inhibitor homing at CRM1 via a deep-reinforcement learning model to suppress the overactivation of NF-κB signaling, an underlying mechanism of ENKTL pathogenesis. The authors demonstrated that LFS-1107 binds more strongly with CRM1 (approximately 40-fold) as compared to KPT-330, an existing CRM1 inhibitor. Another merit of the small-molecule inhibitor is that LFS-1107 can selectively eliminate ENKTL cells while sparing normal blood cells. Their animal results clearly demonstrated that the small-molecule inhibitor was able to extend mouse survival and eliminate tumor cells considerably. Overall, the manuscript may provide a possible therapeutic strategy to treat ENKTL with a good safety profile. The manuscript is also well-written. The weakness of the manuscript is that some details for the design and evaluation of the small-molecular inhibitor are missing.

      We are truly grateful for your very kind words about our work. It is very encouraging to know that you think our work is relatively novel and of significance for the field. We sincerely appreciate the valuable time and kind efforts that you have spent on the thorough review of our manuscript.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reviewer #1 (Evidence, reproducibility and clarity):

      In this study, the authors made a two-component homing modification gene drive in Anopheles coluzii with a different strategy than usual. The final drive itself targets and disrupts the saglin gene that is nonessential for mosquitoes, but important for the malaria parasite. The drive uses several gRNAs, and some of these target the Lp gene where an anti-malaria antibody is added, fused to the native gene (this native gene is also essential, removing nonfunctional resistance alleles at this locus). In general, the system is promising, though imperfect. Some of the gRNAs self-eliminate due to recombination of repetitive elements, and the fusion of the antimalaria gene had a modest fitness cost. Additionally, the zpg promoter was unable to operate at high efficiency, requiring use of the vasa promoter, which suffers from maternal deposition and somatic expression (the latter of which increased fitness costs at the Lp target). The manuscript has already undergone some useful revisions since its earliest iteration, so additional recommended revisions are fairly modest.

      Line 43-45: The target doesn't need to be female sterility. It can be almost any haplosufficient but essential target (female sterility works best, so it has gotten the most study, but others have been studied too).

      --- We agree. However, this paragraph focused on previous achievements in malaria mosquitoes, for which suppression gene drives spreading lethality rather than female sterility have not been reported to our knowledge. Even the targeting of doublesex, which is a sex determination rather than female fertility gene, results in female sterility (Kyrou et al. 2018). However, we inserted the possibility of female killing by X-shredder GD (Simoni et al., 2020).

      Line 69: A quick motivation for studying Anopheles coluzii should be added here (since gambiae is discussed immediately before this).

      ---Thank you for drawing our attention to this point. We modified the sentence to:

      _Here, we present the engineering of the Lipophorin (Lp) essential gene in Anopheles coluzzii, a prominent member of the A. gambiae species complex and a major malaria vector in sub-Saharan Africa.

      _

      Introduction section: It might be helpful to break up the introduction into additional paragraphs, rather than just two.

      --- We followed this suggestion and broke up the introduction into 5 paragraphs to make it more breathable.

      Introduction last part: The last part of the introduction reads more like an abstract or conclusions section. Perhaps a little less detail would fit better here, so the focus can be on introducing the new drive components and targets

      --- We have followed this suggestion and substantially shortened this last part of the introduction.

      Line 207-213: This material could go in the methods section. There are some other examples in the results that could be similarly shortened and rearranged to give a more concise section.

      --- We moved the long description from lines 207-213 to the Methods as suggested, and summarized it simply as:

      Only mosquitoes displaying GFP parasites visible through the cuticle were used to infect mice.

      We emphasize this point because in subsequent experiments using Saglin knockout mosquitoes, this enrichment for infected mosquitoes will probably attenuate the Plasmodium-blocking phenotype caused by Saglin KO, since mosquitoes lacking Saglin tend to be less infected (Klug et al., 2023). Elsewhere in the Results, we still provide detailed descriptions of procedures because we believe they aid understanding and assessing the quality of the experiments.

      Line 283-287: I couldn't find the data for this.

      --- Indeed we only summarized the data about the progeny of the [zpg-Cas9; GFP-RFP] line crossed to WT, as we didn’t judge these results worth detailing. Here is our record from one such cross:

      GFP-RFP females x WT males  486 (50.7%) GFP+ and 472 (49.3%) GFP- larvae

      GFP-RFP males x WT females  1836 (48.9%) GFP+ and 1925 (51.1%) GFP- larvae

      This shows no significant gene drive. However in these progenies, a few GFP+ and non-RFP larvae, and a few RFP+ non-GFP larvae were noted by visual examination under the fluorescence microscope, without counting them precisely. Their existence testified to some weak homing activity mediated by zpg-Cas9 in the Lp locus.

      We modified the sentence as follows to support our conclusion, and we propose to leave these detailed numbers here in our response, which will be published along with the paper.

      In spite of the presence of the zpg-Cas9 and gRNA-encoding cassettes in the GFP-RFP allele, it was inherited in about 50% of male or female progenies, demonstrating little homing activity of the GFP-RFP locus after crosses to WT, except for the appearance of rare GFP-only or RFP-only progeny larvae, …

      Line 291: Replace "lied" with "was".

      ----done.

      Line 356: Homing in the zygote would be considered very unusual and is thus worthy of more attention. While possible (HDR has been shown for resistance alleles in the zygote/early embryo), this would be quite distinct from the mechanism of every other reliable gene drive that has been reported. Is the flow cytometry result definitely accurate? By this, I mean: could the result be explained by just outliers in the group heterozygous for EGFP, or perhaps some larvae that hatched a little earlier and grew faster? Perhaps larvae get stuck together here on occasion or some other artifact? Was this result confirmed by sequencing individual larvae?

      ---- We agree with your skepticism, especially given that the same is not seen in Suppl Fig 2A with a similar genotype setup, i.e., the vasa gene drive at the Lp locus, or in the G1 of populations 6 or 8 at the Saglin locus (Suppl. File 2). Unfortunately, it would take too much time at this point to re-create this line (which has been discarded) to re-examine this issue. Therefore, we acknowledge that another explanation than homing in the zygote may account for this result. Based on our empirical experience COPAS outputs are reliable: such outliers from the heterozygous population are usually not seen, and we always sort neonate larvae a few hours from hatching. Those 6% homozygous-looking larvae may come from a contamination with male pupae when female pupae were manually sorted for the cross to WT males, a human error that we cannot exclude. In this case, the true GFP inheritance would be closer to 79% than to 85%. For these reasons, we must back up from our initial statement as follows:

      The progeny of these triple-transgenic females crossed to WT males showed markedly better homing rates (>79% GFP inheritance)

      And edit the figure legend of Figure 4B to account for the alternative possibility of a contamination with males:

      6% of individuals appeared to be homozygous, revealing either unexpected homing in early embryos due to maternal Cas9 deposition, or accidental contamination of the cross with a few transgenic males.

      Results in general: Why is there no data for crosses with male drive heterozygotes? Even if some targets are X-linked, performance at others is important (or did I miss something and they are all X-linked). I see some description near line 400, but this sort of data is figure-worthy (or at least a table).

      --- For the only example of functioning split gene drive at the Lipophorin locus on chromosome III, we do show homing results from heterozygous GD males in Suppl. Fig. 2A (91.2% homing in males inferred from ((40.7+53.1+1.8)-50)x2). We added this calculation of the homing rates in the figure legend. For full drive constructs in the Saglin locus on chromosome X (our final functional design), in addition to the data described in the text near line 400, male data showing “teleguided” homing at the Lipophorin locus on chromosome II is shown in Suppl. File 2 (see G2 of population 7, showing close to 100% homing at the GFP locus); the same data (less easy to assess) being converted into the G2 point of the graphs in Figure5.

      Lines 362-367: What data (figure/table) does this paragraph refer to?

      --- We apologize for the fact that this sentence was misleading. In this population, the genotype frequencies were not tracked at each generation but measured once after 7 generations. We rephrased (now lines 401-403) and now provide the measured values directly in the text:

      We maintained one mosquito population of Lp::Sc2A10 combined with SagGDzpg (initial allele frequencies: 25% and 33%, respectively) and measured genotype frequencies after 7 generations. This showed an increase in the frequency of both alleles (G7: GFP allelic frequency = 59.2%, phenotypic expression of DsRed in >90% of larvae, n=4282 larvae),

      Lines 405-406: There may be a typo or miscalculation for the DsRed inheritance and homing rate here. Should DsRed inheritance be 90.7%?

      --- Thank you for spotting this. You are right, DsRed inheritance would be 90.7% if the homing rate were 81.4% as we mistakenly wrote. Actually DsRed inheritance was really 80.7% so our mistake was in calculating the homing rate: 61.4% is the correct value ((80.7-50)x2), now corrected in the manuscript.

      Figure 5: The horizontal axis font size for population 8 is a little smaller than the others.

      --- True. Corrected.

      Line 454: In addition to drive conversion only occurring in females and the somatic fitness costs, embryo resistance from the vasa promoter would prevent the daughters of drive females from doing drive conversion. This means that drive conversion would mostly just happen with alleles that alternate between males and females.

      --- We agree with this idea, although the impact of this phenomenon will depend on the extent of resistance allele formation in early embryos. We observed (Fig. 6) that failed homing mutagenesis in Saglin is not that intense, the sequenced non-drive alleles that were exposed 1-4 times to mutagenic activity in females either being mostly wild-type, or carrying mutations that often still left one or two gRNA target sites intact and vulnerable to another round of Cas9 activity. Therefore, alleles passed on from female to female may still undergo drive conversion to a large extent, that future experiments may be able to quantify.

      Line 481: Deletions between gRNAs certainly happen, but I wouldn't necessarily expect this to be the "expectation". In our 2018 PNAS paper, it happened in 1/3 of cases. There were less I think in our Sciences Advances 2020 and G3 2022 paper. All of these were from embryo resistance from maternal Cas9 (likely also the case with your drive due to the vasa promoter). When looking at "germline" resistance alleles, we have recently noticed more large deletions.

      --- We agree that the early embryo with maternally deposited Cas9 is probably the most prominent source of mutations at gRNA target sites. Perhaps naïvely we imagined that it would be easier for cells to repair two closely spaced DNA breaks by eliminating the intervening sequence, rather than stitching each break individually. Given that we sequenced many alleles carrying a single mutation, the lack of larger deletions may be explained by lower rates of Cas9 activity in Saglin, with mostly a single break at a time, due to limiting Cas9 amounts and their partial saturation with Lp gRNAs, and/or lesser accessibility of the Saglin locus compared to Lipophorin… We deleted the phrase “Contrarily to our expectation”.

      Figure 6C: It may be nice to show the wild-type and functional resistance sequence side-by-side.

      --- done

      Lines 642-644: This isn't necessarily the case. At saglin, the nonfunctional resistance alleles may still be able to outcompete the drive allele in the long run. This wasn't tested, but it's likely that the drive allele has at least some small fitness costs.

      --- We agree. We inserted this comment in a parenthesis in the text (now lines 644-645):

      Unlike the first approach, this design may allow Cas9 and gRNA-coding genes to persist indefinitely within the invaded mosquito population (unless nonfunctional resistance alleles outcompete the drive allele in the long run).

      A few comments on references to some of my studies:

      Champer, Liu, et al. 2018a and 2018b citations are the same paper.

      --- Duplicate in our reference library. Corrected.

      For Champer, Kim, et al. 2021 in Molecular Ecology, there was a recent follow-up study in eLife that shows the problem is even worse in a mosquito-specific model (possibly of interest as an alternate or supporting citation): https://elifesciences.org/articles/79121

      --- Citation added (line 68).

      One of my other previous studies was not cited, but is quite relevant to the manuscript: https://www.science.org/doi/10.1126/sciadv.aaz0525<br /> This paper demonstrates multiplexed gRNAs and also models them, showing their advantages and disadvantages in terms of drive performance. Additionally, it models and discusses the strategy of targeting vector genes that are essential for disease spread but not the vectors themselves (the "gene disruption drive"), showing that this can be a favorable strategy if gene knockout has the desired effect (nonfunctional resistance alleles contribute to drive success).

      --- your 2020 study will indeed now be useful to inform the design of multiplex gRNAs for various gene drives designs, in terms of number of gRNAs, distribution of their target sites, necessity to generate loss-of-function rather than functional resistance allele in the target gene (such as our Lp and Saglin pro-parasitic genes)… The notion of Cas9 saturation with increasing gRNA numbers is also important. When we initiated this project in 2018, we only had intuitive notions that multiplex gRNAs could improve the durability of GD and increase the chances of resistance alleles to be loss-of-function. We thus arbitrarily maximized the number of gRNAs for each of the two targets: 3 for each target in one design, 3 and 4 in another, which, according to your modelling, is luckily close to the optimal numbers for each locus. We now cite your paper as a GD design tool in the discussion about pathways to optimizing our system:

      To further optimize GD design, modeling studies can now aid in determining the optimal number of gRNAs in a multiplex, depending on the specific GD design and purpose (Champer et al., 2020)__.

      In addition to this and to the stabilization of multiplex gRNA arrays, other paths to improvement (…)

      This one is less relevant, but is still a "standard" homing modification rescue type drive that could be mentioned (and owes its success to multiplexing): https://www.pnas.org/doi/abs/10.1073/pnas.2004373117<br /> The recoded rescue method was also used in mosquitoes (albeit without gRNA multiplexing) by others, so this may be a better one to mention: https://www.nature.com/articles/s41467-020-19426-0

      --- We added the two references on what is now Line 663:

      Lp::Sc2A10 depends on SagGD for its long-term persistence and spread in a population, and SagGD depends on Lp::Sc2A10 as a rescue allele of the essential Lp target for its survival. This design can be seen as a two-locus variation of rescue-type GDs (Adolfi et al., 2020; Champer et al., 2020)

      Sincerely,<br /> Jackson Champer

      Referees cross-commenting<br /> Other comments look good. One thing that I forgot to mention: for the 7-gRNA construct with tRNAs, the authors mentioned that it was harder to track, but it sounds like they obtained some data for it that showed similar performance. Even if this one is not featured, perhaps they can still report the data in the supplement?

      --- This GD required examination of the mosquitoes at late developmental stages, such as the pupa, to score red fluorescence under control of the OpIE2 promoter, that is unfortunately late-active when expressed from the Lp locus. We precisely scored only the first 128 pupae arising from the progeny of the first obtained G1 [SagGD/+ ; Lp-2A10/+] females crossed to WT males. Among these:

      • 115 were GFP+, DsRed+ (89.8%)

      • 12 were GFP+, DsRed- (9.3%)

      • 1 was GFP-, DsRed- (<1%)

      This allowed us to roughly estimate the homing rates at 98.2% at the Lipophorin locus and 79.7% at the Saglin locus, which is similar to the other construct without tRNA spacers.

      These approximate rates were confirmed by visual examination of progenies in two subsequent generations of [SagGD/+; Lp-2A10/+] males and females backcrossed to WT.

      Reviewer #1 (Significance):

      Overall, this study represents a useful advance. Aside from being the first report for gene drive in A. coluzii, it also is the first that investigates the gene disruption strategy and is the first report of gRNA multiplexing in Anopheles. The study can thus be considered high impact. There are also other aspects of the study that are of high interest to gene drive researchers in particular (several drives were tested with some variations).

      --- We are grateful for your positive, constructive and in-depth analysis of our study!

      Reviewer #2 (Evidence, reproducibility and clarity):

      The authors initially created a transgenic mosquito colony expressing the Sc2A10 antibody fused to the lipid transporter Lipophorin, and tested the transmission-blocking activity of this transgene. Building off of previous findings that the Sc2A10 antibody inhibits sporozoite infectivity when expressed in mosquito salivary glands, the authors showed that found it was also efficient at inhibiting sporozoite infectivity when secreted into the hemolymph expressed under the lipophorin endogenous promoter in An. coluzzii. They then designed and tested two different gene drives utilizing the Sc2A10-Lipophorin fusion protein. In the first, the authors used a recoded allele of Lp-Sc2A10 while simultaneously utilizing gRNAs that targeted endogenous Lp in an effort to select for mosquitoes that expressed transgenic Lp-Sc2A10 due to the essential nature of Lp. However, this drive was unsuccessful because recoded Lp is necessarily heterozygous while the GD is entering the population, and Lp proved to be largely haploinsufficient. Further, the zpg promoter expressing cas9 was not effective in promoting homing of the gRNAs. In the second gene drive that was tested, authors made use of the endogenous Saglin locus, which expresses a natural agonist for Plasmodium, and is thus desirable to target for disruption in a gene drive that aims to reduce vector competence for Plasmodium. This gene drive also uses recoded Lp-Sc2A10 to replace the wild-type Lp allele, thus selecting for Sc2A10 expression, however this drive is not dependent on fitness of individuals with only one functional copy of Lp.<br /> The authors discovered that the efficacy of the zpg promoter to drive homing of cas9 is locus-dependent, limiting the success of their gene drive designs. They do show, however, that the Saglin gene drive succeeds at reaching high frequencies in mosquito populations using instead the vasa promoter to express cas9, and that these transgenic mosquitoes are able to reduce infectivity of sporozoites in a bite-back mouse model. However, they observe gene drive refractory mutations in the Lp gene, despite its highly conserved nature, showcasing the difficulty of avoiding drive resistance even in small populations of mosquitoes, and also observed deletions of gRNAs targeting both Lp and Saglin, further highlighting possible shortcomings in gene drive approaches. Together, these findings are useful to the field in walking the readers through an interesting and promising approach for a novel gene drive, and illustrating the challenges in engineering an efficacious and long-lasting drive.

      Major comments:

      As the authors are able to observe Plasmodium within mosquitoes, it would be useful to have these data in the manuscript pertaining to the prevalence and intensity of infection in mosquitoes prior to bite-back assays. If there are data or images that the authors could include, it would be helpful to show if there is a possibility that infection intensity is a variable that contributes to whether or not mice develop an infection. It would also be interesting to note whether there is a different in infection (oocysts or sporozoites) between transgenic mosquitoes and wild type mosquitoes.

      --- This is a valuable suggestion. Please note that, in order to evaluate the transmission-blocking properties of the Lp-2A10 allele (acting at the sporozoite level), we discarded non-infected mosquitoes prior to bite-back experiments, so that infection prevalence was 100% in the mosquitoes retained for the bite-back. We have not systematically compared parasite loads between transgenic and control mosquitoes. In some experiments comparing Lp-2A10 mosquitoes and their control, we dissected a subset of the mosquito midguts after bite-back to visually ascertain that they showed roughly equivalent oocyst numbers between transgenic and controls. However, we have not precisely recorded these data. It is possible that slightly decreased lipid availability in Lp::2A10 mosquitoes (their lipophorin allele producing slightly less Lp than the WT) negatively affects the parasite, as suggested by previous studies highlighting the role of host lipophorin-derived lipids for parasite development in the mosquito (Costa et al, Nat Commun 2018; Werling et al. Cell 2019; Kelsey et al. PLoS Path 2023).

      In the case of Lp-2A10 mosquitoes additionally containing a GD in Saglin, it is expected that they should carry lower parasite numbers than their controls, an effect of the Saglin knockout mutation alone (Klug et al., PLoS Path 2023). Re-inforcing the transmission blocking effect of the 2A10 antibody by reducing parasite loads via the Saglin KO was indeed our intention. Hence, having selected the most infected mosquitoes for our bite-back experiments likely attenuated this desired effect, but we still observed a 90% transmission decrease when the two modifications were combined, compared to a 70% decrease with Lp-2A10 alone. We do not plan to perform additional infections experiments for the current manuscript on Plasmodium berghei expressing Pf-CSP, but we do intend to record parasite counts in a follow-up study with an optimized SagGD transgene and Plasmodium falciparum infections. This will be of high relevance for potential future applications in malaria control.

      The authors also go into significant detail in the discussion exploring ideas of how to optimize or improve this specific gene drive design. The authors should also stress further the applicability of their discoveries in other gene drive designs, and emphasize the lessons they learned in the difficulties encountered in this study and how these findings could guide others in their decision making process when choosing targets or elements to include in a potential gene drive approach.

      --- We feel that we already emphasized these lessons in the manuscript, in the discussion and when justifying the chosen strategies in the Results section. Lessons for future designs include:

      • inserting an antimalarial factor into an essential endogenous gene, preserving its function, can provide many benefits (high expression level, secretion signal that can be hijacked, endogenous introns can be hijacked to host a marker, inactivation by mutagenesis or epigenetic silencing being more difficult…);

      • a distant-locus gene drive (as here in Saglin) could potentially drive several antimalarial cargoes at the same time, inserted in different loci;

      • non-essential mosquito genes agonistic to Plasmodium are attractive host loci for a GD, an already old idea illustrated here by the case of Saglin;

      • multiplex gRNAs are a viable approach to reduce the formation of GD-resistant alleles in essential genes and/or to increase the frequency of loss-of-function alleles, which will either disappear if the gene is essential or decrease vector competence if the gene is pro-parasitic. Hence gRNAs targeting intron sequences should be avoided in order to preserve this benefit, as illustrated by one of our Lp gRNAs targeting the first intron and that contributed to generate the only Lp viable resistance allele identified in this study;

      • To increase long-term stability of the GD construct, repeats should be minimized in gRNA multiplexes through the use of a single promoter and various spacers (tRNAs, ribozymes?) – it remains to be seen if the 76-nucleotide gRNA constant sequence itself, necessarily repeated, will stimulate unit losses in a gRNA multiplex;

      • The best promoter to restrict Cas9 expression to the germ line may be zpg in some but not all loci; the vasa promoter causing maternal Cas9 deposition may still be envisaged if resistance allele formation can be prevented by other means (targeting hyper-conserved essential sequence, multiplexing the gRNAs against an essential gene…).

      Minor comments:

      Line 44 - female sterility but also female killing approaches to crash pop. like X shredder, if authors would like to expand

      --- Female killing citation of Simoni et al, 2020 added (line 45).

      Lines 48-60 - Authors should add some references from the literature surrounding ethics and ecology studies related to gene drive release

      --- we added: (e.g., National Academies of Science, Engineering, and Medicine, 2016; Courtier-Orgogozo et al., 2017; de Graeff et al., 2021) on lines 49-51.

      Line 114 - Given the only moderate impacts of Saglin's role in Plasmodium invasion, I am not sure this saglin deletion is a convincing benefit for GD as it is probably not impactful enough alone - can the authors soften this statement?

      --- while it’s correct that Saglin KO mosquitoes show a significant decrease only in P. berghei oocyst counts and not in prevalence when mosquitoes are heavily infected, they do show a significant decrease in both counts and prevalence upon infection with P. berghei and, most importantly_, P. falciparum_ when parasite loads are lower —a situation that is more physiological (e.g. prevalence of 65% and 13% in WT and Sag(-)KI mosquitoes, respectively, upon infection with P. falciparum - Klug et al., PLoS Path 2023). Therefore, for human-relevant P. falciparum infections, an impactful decrease in vector competence can be legitimately expected.

      Line 126 -Can the authors provide rationale for expressing Sc2A10 with Lp instead of expressing it from salivary glands?

      --- There are three reasons for this. First, we knew from the cited Isaacs et al. papers that the 2A10 antibody was efficient against transmission when expressed in the fat body, and from unpublished work (Maria Pissarev, Elena Levashina and Eric Marois) that anti-CSP ScFvs expressed in the fat body of transgenic mosquitoes blocked sporozoite transmission as efficiently as when expressed from salivary glands. This is certainly favored by the easy sporozoite accessibility to the antibody when both are in mosquito hemolymph. Of note, the transmission blocking results suggest that the binding of ScFv to CSP withstands the crossing of the salivary gland epithelium by sporozoites. Second, we were looking for a host gene expressed as high as possible to produce high levels of Sc2A10 antibody. Third, the host gene must be essential so that resistance alleles would not be viable.

      We agree that it would also be possible to use a salivary gene instead of Lp as a host for this antimalarial factor. In this case, a same-locus gene drive may have functioned, but the advantages of the host locus being an essential gene would be lost, at least partially, as genetic ablation of the salivary gland, albeit slowing blood uptake, does not prevent mosquito viability and reproduction (Yamamoto et al., PLoS Path 2016).

      Line 140 - Can authors give any comment on why these regions of Lp were chosen to be recoded / targeted with gRNAs?

      --- inserting Sc2A10 just after the cleaved Lp secretion signal, and N-terminally to the rest of the Lp protein, was the goal, so that 2A10 would be secreted together with Lp and separated from both signal peptide and Lp by naturally occurring proteolysis. This constrained the choice of the target site to be at the junction between signal peptide and the remainder of Lp protein. An alternative design could have been to insert it between the two subunits ApoLpI and ApoLpII, with duplication of the protease cleavage site, or on the C-terminal extremity of the protein, but there would have been no intron in the immediate vicinity to knock-in a selection marker at the same time.

      Line 171 - "stoichiometric"

      --- Corrected.

      Line 186 - Can the authors comment or speculate on why the expression levels of the fusion protein are expected to be lower than endogenous Lp?

      --- We did not expect this. It is hard to predict whether and explain how insertion of exogenous sequences in a gene can alter its expression. Possible explanations include: the existence of harder-to-translate mRNA sequences in the Sc2A10 moiety; the addition of seven exogenous amino acids on the N-terminal side of ApoLpII (mentioned in M&M) possibly modifying the stability of the Lp protein; the modification of the intron sequence perturbing efficient intron excision and/or pre-mRNA expression due to the disruption of regulatory elements or to the new presence of the GFP gene in the antisense orientation (albeit expressed in the nervous system and not in the fat body); the presence of the exogenous Tub56D transcription terminator used to arrest GFP transcription possibly possessing bidirectional termination activity and lowering the mRNA level of the Lp allele…

      Line 211 - Why were 6 mosquitoes used for these assays, and 10 mosquitoes used in later assays (Line 223)?

      --- Mice were always exposed to groups of 10 mosquitoes, but not all 10 mosquitoes were necessarily biting the mice. We retained mice bitten by at least 6 mosquitoes for further analysis (M&M, lines 871-873 of the revised file).

      Line 212 - I would also suggest using letters (Suppl. Table 2A,B,C etc) to refer the specific experiments and sections in the Table.

      --- Implemented.

      Line 225- 228 - The authors should mention in the text that homozygotes and heterozygotes do not differ in infection assays.

      --- Added: Therefore, heterozygous mosquitoes showed a transmission blocking activity comparable to that seen in homozygotes.

      Line 249 - Can the author comment on the impacts of population influx / exchange on the idea that the GD cassette need only be transiently in the population?

      --- If Lp::Sc2A10 is fixed in the population and the GD gone, indeed an influx of WT alleles through mosquito immigration will begin to replace the antimalarial factor and drive it to extinction due to its fitness cost. As mentioned in the final paragraph of the discussion, this could be seen as an advantage to restore the original natural state—hopefully after malaria eradication! However, we regard a situation where Lp::2A10 never reaches fixation as more likely, with its spread being re-ignitable by updated GDs (line 741 of the revised file).

      Line 273 - Can the authors comment on why this may have occurred more frequently than the expected integration of the GD cassette?

      --- When a chromosome break is repaired, each side of the cut must recombine with the repair template. A possible explanation for our observation is that one side of the break recombined with the injected repair plasmid, while the other recombined with the intact sister chromosome (physiologically probably the preferred option). Since this situation still leaves truncated chromosomes, another repair event can join the plasmid-bearing chromosome end to the sister chromosome. The observation that complex rearrangement occurred frequently suggests that such events can be very common, but will usually go undetected due to the absence of genetic markers. Here, GFP on the intact sister chromosome served as a genetic marker to betray its unexpected involvement in the repair process.

      Line 314 - Not all fitness costs are apparent through standard laboratory rearing as was performed in Klug et al. Authors could consider "no known fitness cost" instead.

      --- We agree. This is what we meant by “no fitness cost in laboratory mosquitoes”. We changed this to “no fitness cost at least in laboratory conditions (Klug et al., 2023)” to make clear that this was tested.

      Line 407 - don't start new paragraph (same with 409)

      --- we removed these two lines, as we realized they contained an error, and made a correction on line 420 of the revised manuscript.

      Line 408 - I'm not sure it's clear why all these populations were kept for a different number of generations - can the authors clarify?

      --- Populations 1 and 2 were the oldest founder populations, therefore maintained for the longest time. As described in the text, all other populations were derived from populations 1 and 2 later in time by outcrossing a subset of individuals to WT mosquitoes. For these derived populations, we reset the clock of generation counting to 0 as we monitored the homing phenomenon “from scratch” in transgenic males crossed to WT, and in transgenic females crossed to WT. Resetting the clock resulted in an apparent lower number of generations for these derived populations. In addition, some of them were discarded early, usually after reaching a stable state, as it was difficult to maintain so many populations in parallel over a long period of time.

      Line 558 - "10/12 mice" not immediately clear - the authors could be more specific about how data was combined here

      --- Thank you for pointing out this ambiguity. We replaced by: the absence of infection in a total of 10 out of 12 mice showed… (line 561)

      Line 586 - Since there do appear to be some fitness costs associated with the Sc2A10 version of Lp, might it be expected that fitness costs imposed by the transgene itself could lead to selection pressures leading to its loss? Or do the authors think that these fitness costs are prevented from causing selection against Sc2A10 due to the design of the transgene such that its translation is a prerequisite for Lp's translation? Is the fact that its removal occurs more rapidly than Lp's any indication that selection against the persistence of Sc2A10 may occur?

      --- Yes, we believe that Lp::Sc2A10 will progressively disappear, replaced by the WT allele, as shown in Figure 1C, in the absence of a GD stimulating its maintenance and spread. In the Lp::Sc2A10 transgene, translation of Sc2A10 is indeed a prerequisite for Lp translation, imposing a degree of genetic stability of this transgene in terms of sequence integrity, but this does not mean that the locus cannot be outcompeted by the WT under natural selection, so that long-term persistence of Lp::Sc2A10 depends on the presence of the GD, as outlined in lines 669-672. As the GD itself can disappear due to the accumulation of resistance alleles, we expect a progressive lift of its pressure to maintain Lp::Sc2A10 and both loci to be progressively lost, a form of reversibility that may be regarded as desirable (lines 773-776 in v2, 741-743 in v3). Alternatively, both transmission blocking alleles could be maintained by releasing an updated version of the dual GD.

      Line 659 - add some further detail to this - how do you envision this to occur?

      --- We have deleted this paragraph, as it hypothesized that SagGD could frequently be transmitted to the next generation in the absence of Lp::2A10, which is not the case (it would be lethal, and Lp::2A10 homing is anyway extremely efficient). After a putative field release of [SagGD / Y; Lp::2A10/ Lp::2A10] males, both transgenes should rapidly be introgressed in the field’s genetic background.

      Line 635 - Long paragraph, should be broken up or removal of text. Some of these ideas could possibly be made more concise to improve readability. There are many different hypotheticals that are expanded upon in the discussion.

      --- We admit that this paragraph in the discussion was long and dense. We have split it into 4 smaller paragraphs to better separate the concepts that we want to discuss, and have deleted the part mentioned in the above point.

      Line 677 - This scenario seems potentially unrealistic considering the only subtle impacts of Saglin deletion on vector competence, and the potential for population exchange in mosquito populations to dilute out these alleles if the drive begins to fail. Can the author comment or potentially decrease emphasis on such scenarios?

      --- while Saglin KO mosquitoes show a moderate decrease of infection prevalence in the context of high infections, the Saglin KO decreases parasite loads in all cases, and most importantly, also prevalence upon physiological infections with P. falciparum (Klug et al., PLoS Path 2023 and see our response to your comment to line 114 above). This yields a higher proportion of non-infected mosquitoes. Therefore, the impact of Saglin mutations should be stronger for the epidemiology of human infections with P. falciparum than in laboratory models of infections where parasite loads are very high.

      We agree that mosquito migration in natural populations would progressively dilute out the beneficial alleles once the GD effect ceases. The epidemiological impact is difficult to predict and will strongly depend on the durability of the GD and on the intensity of genetic influx from adjacent mosquito populations.

      Line 708 - Can the authors speculate on why zpg is sensitive to local chromatin and elaborate on possible solutions or consequences for other drive ideas? This seems broadly important.

      --- We do not precisely know why the zpg promoter is more sensitive to local influences than the vasa promoter, but this phenomenon seems common for other promoters as well (e.g., the sds3 promoter as opposed to the shu promoter in Aedes aegypti (Anderson et al., Nat Comm 2023)). It is possible that the vasa promoter is better insulated from local repressive influences, perhaps by insulating elements akin to gypsy insulators in Drosophila. Knowledge of genetic insulators active for mosquito genes is lacking as far as we know. Characterization of efficient mosquito insulators, for example if one could be identified within vasa, and their combination with zpg or sds3 promoter elements, could potentially improve the locus-independent activity of such promoters. Alternatively, a natural and ideal promoter may still be found showing both an optimal window of expression of Cas9 in the germline, and little susceptibility to local repression.

      Line 737 - The suggestion of releasing laboratory-selected resistance alleles in the absence of further context may be provocative and unnecessary here.

      --- We didn’t intend to sound provocative, but are interested in the idea of simple resistance alleles with limited sequence alteration that could be selected in the lab, and released to block a gene drive that turned undesirable, so we wanted to share it with the reader. Mutations in the Lp and Saglin loci, preserving their functions, can be limited to one or few nucleotide changes in the gRNA target sites, as illustrated by the mutants we sequenced. Lab population of GD mosquitoes can, therefore, be a source of GD refractory mutants that could be leveraged in recall strategies.

      Line 850 - unnecessary comma

      --- Corrected.

      Line 854 - change to "after infection, moquitoes were "

      --- Changed.

      Figure 1 - Not clear what is intended to be communicated by shapes portraying proteins / subunits - consider more detailed illustration of mosquito fat body cells synthesizing and secreting proteins rather than words in text box with arrow to clearly demonstrate the point of this figure.

      --- We propose a new version of figure 1 to better illustrate the fat body origin of Lp and 2A10. We have also re-worked the graphic design to improve several figures.

      Figure 3 - I recommend rearranging this figure so that B comes before C, visually. The proportions for the design of in B should also match those used for A.

      --- We have followed these recommendations in the new Figure 3, and also used more logical color codes for the gRNAs and their target genes.

      Figure 5 - It is unclear to me why some Populations were maintained for such different lengths of time.

      --- Same point as above for line #408: Populations 1 and 2 are the oldest founder populations, therefore maintained for the longest time. As described in the text, all other populations were derived from populations 1 and 2 later in time by outcrossing to WT mosquitoes, resulting in a lower number of generations for these derived populations. In addition, some of them were discarded earlier, usually after reaching a stable state, as it was not possible to maintain so many populations in parallel for a long period of time.

      Figure 7 - Ladder should be labeled on the gel. It may also be helpful for the author to indicate clearly exactly which mosquitoes were shown by sequencing to have these different deletions, as it is occasionally unclear based on band sizing.

      --- we have added the ladder sizes as well as a numbering of individual mosquitoes on Figure 7. We sequenced 4 gel-purified small -type B- amplicons of Population 1 individually (#1, 2, 4, 6), and a pool of 4 type B amplicons from Population 7 (pooled #2, 4, 5, 6) as well as two samples of several pooled gel-purified large -type A- amplicons from Population 2 (pool of samples #2, 3, 4, 5, 6, 8, 9, 11, 12) and from Population 7 ( pool of #1, 3, 7, 11, 12). This information now also appears in the material and methods section (PCR genotyping of the SagGDvasa gRNA array).

      Line 996 - given that there is a size band on the right line of this gel also, can authors crop the gel image to eliminate unnecessary lanes a and b from this figure without losing information needed to interpret this blot?

      --- we agree that this would make the message easier to understand, but cropping lanes a and b would place WT control and Lp::Sc2A10 homozygotes on two separate images, even if a size marker is present on each. We prefer keeping the raw image to facilitate direct comparison of the band sizes, making clear that this was a single protein gel.

      Line 1070 - 12 out of how many sequenced mosquitoes?

      --- 12 mosquitoes from each of these four populations served as PCR templates to generate figure 7. A subset of amplicons were sequenced individually or pooled, as described above and now in Methods. All sequencing reactions of type A and type B amplicons showed consistent results.

      Line 1078 - Can remove some detail like % of agarose, and replication of results with different polymerase as these are already in methods.

      --- Done.

      Line 1098 - "Unbless"

      --- Corrected

      Reviewer #2 (Significance):

      This study illustrates a wide range of issues pertinent for gene drive implementation for malaria control, and as such is of value to the field of entomologists, genetic engineers, parasitologists and public health professionals. The gene drive designs explored for this study are interesting largely from a basic biology perspective pertinent mostly to specialists in the field of genetic engineering and vector biology, but highlight challenges associated with this technology that could also be of interest to a broader audience. A transmission blocking gene drive has not yet been achieved in malaria mosquitoes, and is thus a novel space for exploration. As a medical entomologist that works predominantly outside of the genetic engineering space, I have appreciated the detail the authors have provided with regard to their rationale and findings, even when these findings were inconsistent with the authors' primary objectives or expectations.

      --- Thank you for your positive assessment and for this in-depth evaluation of our data.

      Reviewer #3 (Evidence, reproducibility and clarity):

      The study by Green et al. generated a gene drive targeting both Saglin and Lipophorin in the Anopheles mosquito, with a view to blocking Plasmodium parasite transmission. This is a highly complex but elegant study, which could significantly contribute to the design of novel strategies to spread antimalarial transgenes in mosquitoes.<br /> Overall, this is a complex study which, for a non-specialist reader gets quite technical and heavy in most parts. Despite this, there are key points showing that suppression gene drive may not be the way forward in this instance. However, I would advise explaining certain elements in more detail for the benefit of the general readers. I only have minor points for the authors to address:<br /> 1) Please point out for the general reader that Anopheles coluzzii belongs to the gambiae complex, since you explain that gambiae are the major malaria spreaders in sub-Saharan Africa.

      --- done in the introduction (lines 71-73) also in response to Rev. 1

      2) The authors pretty much give all results in the last part of the introduction, could the intro be shortened by removing these parts, or just highlighting in a single paragraph the main take home message?

      --- We have condensed this part to highlight the take home messages in the last paragraph, also in response to Rev. 1.

      3) Why is Vg mentioned? It is only mentioned once and doesn't have any other mention through the manuscript.

      --- this introduces the two proteins that are by far the most abundant, and present at similar levels, in the hemolymph of blood-fed females, Vg being also prominent on the Coomassie stained gel of fig.1. We mention Vg also because it represents another excellent candidate locus to host anti-plasmodium factors, as discussed later on lines 600-610 of the Discussion section.

      4) Please make it clearer for non-specialists why Cecropin wasn't used.

      ---On lines 630-636 we explain that we decided to leave out Cecropin to avoid potential additional fitness costs due to expression at all life stages in the fat body, as opposed to solely in the midgut after blood meal (Isaacs et al. PNAS 2012); and to avoid complexifying the anti-Plasmodium Lipophorin locus in a way that could further reduce the functionality of the Lp gene. We also had prior knowledge from unplublished work that Sc2A10 alone was sufficient to block sporozoite infectivity.

      5) Why were homozygous and not heterozygous transgenics transfected if there is such as fitness cost to homozygous mosquitoes?

      --- the fitness cost of homozygous mosquitoes is actually mild, unnoticeable if homozygotes are bred in the absence of competing heterozygotes and wild-types (lines 151-156). Microinjection experiments to obtain the different versions of SagGD were, therefore, performed on either the heterozygous or homozygous line. As for infection assays, the anticipated effect of gene drive is to promote homozygosity at the Lp::Sc2A10 locus. For this reason, it made sense to test the vector competence of homozygotes, in addition to the fact that the Plasmodium-blocking phenotype was expected to be stronger (and thus, easier to document) with two copies of the transgene. Only after obtaining a large dataset from infection assays with homozygotes did we test heterozygotes and found that they actually had a similar phenotype.

      6) Line 211 - what was the average number of infected mosquitoes used per infection for each mosquito strain?

      --- As described in the text (lines 204-206 of v2; 208-212 of the revision) and in the Methods (lines 868-873), non-infected mosquitoes were discarded prior to performing the experiment using 10 infected mosquitoes per mouse, and we discarded mice bitten by fewer than 6 mosquitoes. So at least 6 infected mosquitoes bit each mouse (often 8-9).

      7) Line 219 - please be clearer regarding this being infection detected in the blood.

      --- We replaced « infection » with « detectable parasitemia in the blood »

      8) Line 320 - please clarify why the zpg promoter was used.

      --- The advantages of zpg are mentioned in lines 257-258 and 320-322 (revised file).

      9) Line 375 - what was the rationale for using so many gRNAs?

      --- 3 or 4 gRNAs against Lipophorin and 3 gRNAs against Saglin, amounting to a total of 6 or 7 gRNAs against the two loci. The rationale is explained on lines 249-253 : the goal was to maximize the chance of causing loss-of-function mutations in the essential Lp gene and to favor elimination of GD resistant alleles by natural selection, in case of failed homing. For Saglin which is a non-essential gene, we wanted to ensure loss-of-function of failed homing alleles to achieve a reduction in vector competence, even if GD-resistant alleles accumulate. We sought to make this rationale clearer by adding a sentence on lines 328-332:

      Multiplexing the gRNAs was intended to promote the formation of loss-of-function alleles in case of failed homing at the Lp and Saglin loci: non-functional alleles of the essential Lp gene would be eliminated by natural selection while non-functional Saglin alleles would reduce vector competence.

      Line 555 - please state how long post bite back parasite appears in infected mice.

      --- We changed this sentence to : …two of these six mice developed parasitemia six days after infection<br /> (line 556).

      Reviewer #3 (Significance):

      This is potentially a highly significant study that could provide a vital mechanism for generating efficient gene drives. Although highly technical and complex in most parts, with a little clarification in certain areas this manuscript could be of great value to a general readership.

      --- Thank you for your appreciation and thoughtful evaluation of our manuscript.

      Reviewer #4 (Evidence, reproducibility and clarity):

      The authors hijacked the Anopheles coluzzii Lipophorin gene to express the antibody 2A10, which binds sporozoites of the malaria parasite Plasmodium falciparum. The resulting transgenic mosquitoes showed a reduced ability to transmit Plasmodium.

      The authors also designed and tested several CRISPR-based gene drives. One targets Saglin gene and simultaneously cleaves the wild-type Lipophorin gene, aiming to replace the wildtype version with the Sc2A10 alele while bringing together the Saglin gene drive.

      Drive-resistant alleles were present in population-caged experiments, the Saglin-based gene drive reached high levels in caged mosquito populations though, and simultaneously promoted the spread of the antimalarial Lp::Sc2A10 allele.

      This work contributes to the design of novel strategies to spread antimalarial transgenes in mosquitoes. It also displays issues related to using multiplexing gene-drive designs due to DNA rearrangements that could prevent the efficient spread of the gene drive in the long term.

      This is tremendous work considering how many transgenic lines and genetic crosses are performed using mosquitoes. The conclusions are supported by the data presented, and some modifications regarding the experimental design description through text/figure improvements would facilitate the reading and flow of the paper.

      Here some questions/comments:

      • Line 124-125: Reference?

      --- added

      • Line 133-134: Reference?

      --- added

      • Table 1: It seems the authors have some issues recovering a good amount Sc2A10 from hemolymph samples. Is this a problem of the antibody per se? Is it the Lp endogenous promoter weak? Could this be improved by placing the antibody in a different genomic region? Alternatives could be discussed.

      --- The 2A10 antibody must be initially produced in the same, very high, amounts as the Lp endogenous protein with which it is co-translated. Therefore, its low relative abundance must result from faster turnover or stickiness to tissue, as hypothesised on lines 176-177. We believe that virtually any other endogenous promoter would be weaker than Lp and produce lower Sc2A10 levels.

      • Fig.1B: It would be nice to have a representation of the genome after integration. You could add a B' panel or just another schematic under the current one.

      --- In agreement with this suggestion and that of rev. 3, we added a new panel in 1B.

      • Supplementary Fig.1b: Could the authors explain the origin of the (first) zpg promoter used? Is it from An. Coluzzii? It seems they use a different one in the gene drive designs later (see comments below too).

      --- We initially cloned a PCR-amplified zpg promoter region of the same size as the version published by Kyrou et al., from genomic DNA from our colony of A. coluzzii. The resulting promoter fragment harbored several single nucleotide polymorphisms (SNPs) compared to published sequences, as typically observed when cloning genomic fragments due to high genetic diversity in Anopheles species. Such SNPs are not usually expected to affect promoter activity, but are difficult to distinguish from PCR mutations which, in turn, could decrease or abolish promoter activity if mutating an essential transcription factor binding site. For this reason, our next constructs were based on the validated zpg sequences from Kyrou et al. The first cloning strategy was described in the results section but was missing in the material and method section. This is now corrected (lines 773-779).

      • Fig.3: Please, correct to A, B, C order. Current one is A, C, B.

      --- Done.

      Could the authors include a schematic of the final mosquito genome after integration? I can see they are targeting two different locations (Saglin and Lp). It is unclear though from the figure where the Sc2A10-GFP is coming from. I understand this represents the mosquito genome as you injected heterozygous animals already containing the Sc2A10-GFP. Maybe label the Sc2A10-GFP as mosquito genome or similar? A schematic showing mosquito embryos already carrying this and then the plasmid being injected could help.

      --- Figure 3 does not represent the injection of new transgenic constructs. Instead, it shows the conversion process of chromosomes X and II in a germ cell carrying both transgenes in the heterozygous state, to illustrate how the dual gene drive can spread in a population after WT mosquitoes mated with transgenics carrying both the SagGD and Lp-2A10 alleles. We have re-worked the graphic design of this figure and modified its title to make this more clear.

      • Line 330-331: Do you know the transgenesis efficiency? Did the authors make single or pools for crossing and posterior screening? It would be interesting to know about transgenesis rates to inform the community.

      --- we no longer perform single crosses for transgenesis, as batch crosses ensure higher recovery of transgenics due to the collective reproductive behavior (swarming) in Anopheles. Therefore, we cannot precisely calculate the transgenesis efficiency. However, >60 positive G1s from a pool of 36 G0 males crossed to WT females is indicative of a rather high integration efficiency. We consistently observe high efficiency of transgene integration when using the CRISPR/Cas9 system, that we estimate to be about 5-fold more efficient than docking site transgenesis, and much more efficient than piggyBac mediated transgenesis.

      • Line 357/Fig.4B: Could the authors explain in the text GFP+ vs. GFP++?

      --- GFP++ was meant to indicate higher intensity of GFP fluorescence than GFP+, due to two copies of the transgene versus one, but see our response to reviewer 1’s comment to line 356 about the questionability of homing in the zygote.

      • Line 357: Where is the vasa promoter that made the "rescue" coming from? Is it amplified from Coluzzii? Please, include this explanation for clarification. Why the authors think the zpg from Kyrou et al 2018 works for the cassette integration but not for homing? They discuss positional effects, any references showing that?

      --- We amplified the vasa promoter from A. coluzzii using primers CggtctcaATCCcgatgtagaacgcgagcaaa and CggtctcaCATAttgtttcctttctttattcaccgg (annealing sequence underlined) to have a fragment equivalent to that (vas2) characterized in Papathanos et al, 2009. We have now added this information in the Methods under Plasmid construction. This is the only source of vasa promoter used in this work.

      About zpg promoter activity : we have past experience suggesting that promoters, such as the hsp70 promoter from Drosophila, can be sufficient to express enzymatic activities in embryos injected with helper plasmids, even though the same promoters appear to become inactive once integrated in the genome. This may be due to injected “naked” plasmids being readily accessible to the transcription machinery, unlike organized chromatin. A recent reference showing genomic positional influences on promoter efficiency is Anderson et al., 2023, which we have added on line 710 of the Discussion.

      • Line 362: No reference to figure nor table.

      --- These data (numbers from a COPAS analysis) are provided directly in the text in this sentence (which has been clarified in response to Reviewer 1). See lines 364-369 of the revision.

      • Line 417: The text brings the reader back to Fig.3C. Could the authors move this panel for easier flow of the paper?

      --- We agree that positioning of this panel in Figure 3 is a bit awkward, but this western blot pertains to the characterization of the insertion shown in Fig. 3. Placing it after COPAS analyses would be equally awkward.

      • Line 472-474: How many WT alleles were recovered? It is not stated unless I missed anything, which is possible.

      --- We refrained from providing a quantification of this, and focussed on qualitative results, as we didn't trust the quantitative representativity of our high-throughput amplicon sequencing results in terms of allele frequency in the sampled mosquito population. A large fraction of sequenced reads corresponded to PCR artefacts such as primer dimers and unspecific short amplicons, potentially affecting the relative frequencies of gene-specific amplicons. However, among the sequenced gene-specific amplicons, WT alleles were the majority (lines 474-475).

      • Fig.5. Could the authors discuss why the observed DsRed-gene drive drop in population 1 at ~18 generation? The population gets to the point where only 50% of the population carries the Cas9-DsRed cassette. Considering that the Saglin gene drive only converts through females (inserted into the X chr.), and some indels could be generated by generation 20, how do you explain the great recovery until fully spreading into the population?

      --- We agree that this is somewhat puzzling. We don’t have a satisfactory explanation beyond stochastic effects, possibly promoted by population bottlenecks: although we strived to maintain these populations at a high number of individuals at each generation, we cannot exclude that at a given generation only a relatively small fraction of individuals contributed to the next generation, leading to fluctuations in allelic frequencies. This would be possible particularly for populations 1 and 2, which were not monitored frequently between generations 10 and 18, at which point additional populations 5-8 were established and it was decided that close monitoring of all populations was important.

      It seems to me populations 3-8 are new cage experiments by randomly picking mosquitoes from populations 1 and 2 (at a specific generation) and mixing them with WT individuals. Could the authors explain the reasoning for these experiments? I believe populations 3-8 deserves a different figure (main or supplementary) describing how they were seeded. It is confusing having everything together as these experiments were performed differently way and for a different reason compared to populations 1 and 2. Some cage schematics and drawings would help in understanding the protocol strategy for populations 3-8.

      --- This is correct for populations 3 and 4 that indeed originated from randomly picking mosquitoes from populations 1 and 2 at generation 10 and mixing them with WT individuals. Populations 5, 6, 7 and 8 are crosses between generation 16 transgenic partners of one sex to WT of the other sex, as indicated above the COPAS diagrams provided in Suppl. File 2. We apologize for having insufficiently described how each population was assembled and now provide more details (lines 422-429, in the figure 5 legend, and G0 crosses spelled out on top of each population diagram). In setting up these populations, we wanted to test the effects of various routes by which the transgenes may be introduced into a wild mosquito population: release of unsorted transgenic males + females, or release of one sex only (probably males in the field, but the crosses with transgenic females as with transgenic males also served to re-quantify homing in the second generation of each cross).

      The modified text reads as follows:

      Populations 3 and 4 were established by mixing randomly selected transgenic mosquitoes (both males and females of generation 10) from populations 1 and 2, respectively, with wild-types, to mimic what may occur in a mixed-sex field release. Populations 5-8 were established by crossing single-sex transgenic mosquitoes to WT of the opposite sex, both to mimic a single-sex field release and to re-assess homing efficiency after 16 generations.

      Also, could you add homozygous and heterozygous labels in the figure legend to help understanding the different lines.

      --- As indicated on the side of the figure and in the figure legend, lines don’t represent homozygous vs. heterozygous frequency, but allele frequency (continuous lines), and frequency of mosquitoes carrying the transgene (dotted lines). In the figure legend we now provided the calculation formulas for gene frequency: [ 2 x (number of homozygotes) + (number of heterozygotes)] / 2 x (total number of larvae) for the autosomal Lp::2A10 transgene, and [ 2 x (number of homozygotes) + (number of heterozygotes) ] / 1.5 x (total number of larvae) for the X-linked SagGD transgene.

      • Fig.6: The authors sequenced non-DsRed individuals from generations 3-4. The authors also mentioned they sequenced mosquitoes from generation 32 (Fig.7). Interestingly, they observed that these mosquitoes were missing a piece of the cassette (they contained 2 gRNAs instead of 7). Since the amplicons only cover the gRNA portion, a PCR covering the Zpg-Cas9 portion would be ideal to confirm that only the gRNAs are missing. Sampling DsRed+ mosquitoes from generations 3, 18 and 31 (populations 1 and 2) and carrying out these experiments is recommended. Although unlikely, I would be worried about the Cas9 being deleted due to unexpected DNA rearrangements; in that case, the cassette would contain the DsRed marker alone.

      --- Thank you for this suggestion. We no longer have DNA samples from the earlier generations. Thus, we genotyped 7 DsRed positive male mosquitoes from each of current populations 1, 2 and 7 (generation 41 since transgenesis) for the presence of Cas9. We detected a Cas9-specific amplicon of 1.6 kb in 21/21 sampled DsRed positive mosquitoes, in parallel to the same shortened gRNA arrays detected in earlier generations. This suggests that the Cas9 part of the transgene was not affected by the loss of gRNA units. We made a panel C in Figure 7 showing these results and mentioned them on lines 537-538. Of note, the Cas9 moiety of the gene drive construct shows no repetitive sequence and should therefore not be as unstable as the gRNA multiplex array. The observed excisions of gRNA expression units were strictly due to recombinations between repeated U6 promoter sequences (Fig. 7).

      The authors employ 3 different gRNAs that are 43 and 310 nts apart. It has been shown that only 20 nt lack of homology produces an important reduction on gene drive performance (Lopez del Amo et al 2020, Nat Comms). Also, it has been shown that gRNA multiplexing approaches should be kept with a low number of gRNAs, 2 being maybe the best one depending on the design (Samuel Champer 2020, Sciences Advances). This could be discussed more.

      --- Thank you for this suggestion. These results were not published when this study was initiated, so that our gene drive constructs could only be designed on empirical bases. For gRNA numbers, see the new discussion point and inclusion of a reference to the study by S. Champer et al., on line 700-702. The reduction of drive performance with longer non-homologous stretches is indeed also a very important point, that we now discuss on lines 713-717, citing your study:

      Finally, tighter clustering of gRNA target sites at target homing loci, especially Saglin, should improve gene drive performance by reducing the length of DNA sequences flanking the cut site that bear no homology to the repair template on the sister chromosome and need to be resected by the repair machinery to allow homing (López Del Amo et al., 2020)__.

      Reviewer #4 (Significance):

      There are different novelty aspects from my point of view in this work. While most of the scientists focus on developing CRISPR-based gene drives in An. Stephensi and gambiae, this work employs An. Coluzzii. Some limitations regarding fitness cost associated with the Lp gene were also noted and discussed by the authors.

      --- To be fair, earlier gene drive studies were performed on the G3 laboratory strain, traditionally named A. gambiae, although it is probably itself a hybrid strain from gambiae and coluzzii. Still, the Ngousso strain from Cameroon that was used in this study is thought to be a bona fide A. coluzzii. We have also added a reference to a recent paper (Carballar-Lejarazu et al., 2023) that also describes a population modification GD in A. coluzzii.

      First, they show that An. Coluzzii mosquitoes infect less when containing the antimalarial effector cassette inserted in their genomes. Second, a gene drive is showing super-Mendelian inheritance in An. Coluzzii, which would be the second example of a gene drive in these mosquitoes so far to my knowledge.

      I believe this is the first manuscript experimentally using multiplexing approaches (multiple gRNAs) in mosquitoes (all previous works I saw were performed in flies). While previous gene-drive works employ only one gRNA in mosquitoes, this works explores the use of different gRNAs targeting nearby locations to potentially improve HDR rates and gene drive spread. Although they observe gene drive activity, they also show DNA rearrangements due to the intrinsic nature of multiplexing gene drives that can generate multiple DNA double-strand breaks, impeding proper HDR and clean replacement of the wildtype alleles. This is important from a technical point of view as it shows this approach requires optimization. They included 3 gRNAs targeting the Saglin gene, and trying 2gRNAs instead could be interesting for future investigations.

      --- We now discussed optimization with the help of modeling, in response to Reviewer 1, on lines 701-702.

      This work will be very useful for the CRISPR-based gene drive field, which seeks to develop genome editing tools to control mosquito populations and reduce the impact of vector-borne diseases such as malaria.

      This reviewer intended to understand the work and provide constructive feedback to the best of my abilities. I apologize in advance if I misunderstood anything.

      --- Thank you for your appreciation, insight, and constructive evaluation of our manuscript.

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      In this study, the authors made a two-component homing modification gene drive in Anopheles coluzii with a different strategy than usual. The final drive itself targets and disrupts the saglin gene that is nonessential for mosquitoes, but important for the malaria parasite. The drive uses several gRNAs, and some of these target the Lp gene where an anti-malaria antibody is added, fused to the native gene (this native gene is also essential, removing nonfunctional resistance alleles at this locus). In general, the system is promising, though imperfect. Some of the gRNAs self-eliminate due to recombination of repetitive elements, and the fusion of the antimalaria gene had a modest fitness cost. Additionally, the zpg promoter was unable to operate at high efficiency, requiring use of the vasa promoter, which suffers from maternal deposition and somatic expression (the latter of which increased fitness costs at the Lp target). The manuscript has already undergone some useful revisions since its earliest iteration, so additional recommended revisions are fairly modest.

      Line 43-45: The target doesn't need to be female sterility. It can be almost any haplosufficient but essential target (female sterility works best, so it has gotten the most study, but others have been studied too).

      Line 69: A quick motivation for studying Anopheles coluzii should be added here (since gambiae is discussed immediately before this).

      Introduction section: It might be helpful to break up the introduction into additional paragraphs, rather than just two.

      Introduction last part: The last part of the introduction reads more like an abstract or conclusions section. Perhaps a little less detail would fit better here, so the focus can be on introducing the new drive components and targets

      Line 207-213: This material could go in the methods section. There are some other examples in the results that could be similarly shortened and rearranged to give a more concise section.

      Line 283-287: I couldn't find the data for this.

      Line 291: Replace "lied" with "was".

      Line 356: Homing in the zygote would be considered very unusual and is thus worthy of more attention. While possible (HDR has been shown for resistance alleles in the zygote/early embryo), this would be quite distinct from the mechanism of every other reliable gene drive that has been reported. Is the flow cytometry result definitely accurate? By this, I mean: could the result be explained by just outliers in the group heterozygous for EGFP, or perhaps some larvae that hatched a little earlier and grew faster? Perhaps larvae get stuck together here on occasion or some other artifact? Was this result confirmed by sequencing individual larvae?

      Results in general: Why is there no data for crosses with male drive heterozygotes? Even if some targets are X-linked, performance at others is important (or did I miss something and they are all X-linked). I see some description near line 400, but this sort of data is figure-worthy (or at least a table).

      Lines 362-367: What data (figure/table) does this paragraph refer to?

      Lines 405-406: There may be a typo or miscalculation for the DsRed inheritance and homing rate here. Should DsRed inheritance be 90.7%?

      Figure 5: The horizontal axis font size for population 8 is a little smaller than the others.

      Line 454: In addition to drive conversion only occurring in females and the somatic fitness costs, embryo resistance from the vasa promoter would prevent the daughters of drive females from doing drive conversion. This means that drive conversion would mostly just happen with alleles that alternate between males and females.

      Line 481: Deletions between gRNAs certainly happen, but I wouldn't necessarily expect this to be the "expectation". In our 2018 PNAS paper, it happened in 1/3 of cases. There were less I think in our Sciences Advances 2020 and G3 2022 paper. All of these were from embryo resistance from maternal Cas9 (likely also the case with your drive due to the vasa promoter). When looking at "germline" resistance alleles, we have recently noticed more large deletions.

      Figure 6C: It may be nice to show the wild-type and functional resistance sequence side-by-side.

      Lines 642-644: This isn't necessarily the case. At saglin, the nonfunctional resistance alleles may still be able to outcompete the drive allele in the long run. This wasn't tested, but it's likely that the drive allele has at least some small fitness costs.

      A few comments on references to some of my studies:

      Champer, Liu, et al. 2018a and 2018b citations are the same paper.

      For Champer, Kim, et al. 2021 in Molecular Ecology, there was a recent follow-up study in eLife that shows the problem is even worse in a mosquito-specific model (possibly of interest as an alternate or supporting citation): https://elifesciences.org/articles/79121

      One of my other previous studies was not cited, but is quite relevant to the manuscript: https://www.science.org/doi/10.1126/sciadv.aaz0525<br /> This paper demonstrates multiplexed gRNAs and also models them, showing their advantages and disadvantages in terms of drive performance. Additionally, it models and discusses the strategy of targeting vector genes that are essential for disease spread but not the vectors themselves (the "gene disruption drive"), showing that this can be a favorable strategy if gene knockout has the desired effect (nonfunctional resistance alleles contribute to drive success).

      This one is less relevant, but is still a "standard" homing modification rescue type drive that could be mentioned (and owes its success to multiplexing): https://www.pnas.org/doi/abs/10.1073/pnas.2004373117<br /> The recoded recuse method was also used in mosquitoes (albeit without gRNA multiplexing) by others, so this may be a better one to mention: https://www.nature.com/articles/s41467-020-19426-0

      Sincerely,<br /> Jackson Champer

      Referees cross-commenting<br /> Other comments look good. One thing that I forgot to mention: for the 7-gRNA construct with tRNAs, the authors mentioned that it was harder to track, but it sounds like they obtained some data for it that showed similar performance. Even if this one is not featured, perhaps they can still report the data in the supplement?

      Significance

      Overall, this study represents a useful advance. Aside from being the first report for gene drive in A. coluzii, it also is the first that investigates the gene disruption strategy and is the first report of gRNA multiplexing in Anopheles. The study can thus be considered high impact. There are also other aspects of the study that are of high interest to gene drive researchers in particular (several drives were tested with some variations).

    1. Author Response

      The following is the authors’ response to the original reviews.

      Summary of changes

      I thank the reviewers for their thorough feedback on this paper and providing me with such a detailed list of recommendations. I have been able to incorporate many of their suggestions, which I believe has greatly improved this paper.

      The most important changes:

      • I added comparisons to the lexicon- and rule-based sentiment algorithms TextBlob and VADER to Supplementary Fig. 4. This shows the superiority of ChatGPT in scoring the sentiment of scientific texts compared to existing and already-validated tools for sentiment analysis based on natural language processing. [Suggestion Reviewer 2]

      • I added the measure intra-class correlation to Fig. 3b, emphasizing the inconsistency in sentiment scores across different reviews of the same paper. [Suggestion Reviewer 3]

      • I added Supplementary Fig. 6, in which I directly propose different experiments to test the causes of the observed gender effects on peer review. [Suggestion Reviewer 3]

      • I further studied the issue of variability in responses by ChatGPT (Supplementary Fig. 2), and learned that this has greatly improved in the latest version of ChatGPT (for Version Aug 3, 2023, R2 values of 0.99 (sentiment) and 0.86 (politeness) were reached). I show these findings in Supplementary Fig. 2. [Suggestions Reviewers 1 and 3]

      • Throughout the manuscript (most notably in the Abstract and Discussion), I emphasize that this is a proof-of-concept study, and make suggestions on how to scale this up across journals and fields. I also toned down certain claims given the relatively small sample size of this study, including in the abstract. I also more prominently and elaborately discuss the limitations of the study in the Discussion section. [Suggestions Reviewers 1, 2 and 3]

      • I made many smaller changes to text, figures and references on the basis of the reviewers’ comments. [Suggestions Reviewers 1, 2 and 3]

      Notably, Reviewer 3 has provided me with a very detailed list of recommendations for follow-up experiments. I appreciate their ideas, and I am currently considering different options for future work. Specifically I am looking to team up with a journal to perform the experiments laid out in Supplementary Fig. 6 of the new paper, to study whether I can find evidence of bias across rejected and accepted papers. As suggested by this reviewer, I am also looking into ways to automate data collection using APIs, and by utilizing the rapidly expanding databases for transparent peer review.

      Based on this preprint, I have received messages from academics that are interested in using generative AI to study scientific texts. By revising this manuscript, I hope to provide them with the tools to concurrently expand the analysis of peer review into different scientific disciplines and journals.

      Reviewer #1 (Public review)

      Strengths:

      The innovative method is the biggest strength of this article. Moreover, the method can be implemented across fields and disciplines. I myself would like to see this method implemented in a grander scale. The author invested a lot of effort in data collection and I especially commend that ChatGPT assessed the reviews twice, to ensure greater objectivity.

      I want to thank this reviewer for commending the innovative methodology of this study. I appreciate that this reviewer would like to see this methodology implemented at a grander scale, which is a view that I share. I initially only included Neuroscience papers, because I was uncertain whether I would be able to properly assess the reviews from different scientific disciplines (and thus judge whether ChatGPT was able to provide plausible scores).

      The reviewers have provided me with a list of potential follow-up experiments, and I am currently considering different options for future work. Specifically I am looking to team up with a journal to perform the experiments laid out in (the new) Supplementary Fig. 6 of the new paper, to study whether I can find evidence of bias across rejected and accepted manuscript of a journal. In addition, as suggested by Reviewer #3, I am looking into ways to automate data collection using APIs, and by utilizing the rapidly expanding databases for transparent peer review. Importantly, based on this preprint, I have received messages from academics that are interested in using generative AI to study scientific texts. By revising this manuscript now, I hope to provide them with the tools to concurrently expand the analysis of peer review into different scientific disciplines and journals.

      The comments I received from the different reviewers made me realize that I did not describe the intent of this paper well enough in the original submission. I rewrote much of the Abstract, to emphasize the proof-of-concept nature of this study, and rewrote the Discussion to focus more on the limitations of the study.

      Weaknesses:

      I have several concerns regarding the methodology of the article. The first relates to the fact that the sample is not random. The selection of journal and inclusion and exclusion criteria do not contribute well to the strength of the evidence.

      Indeed, the inclusion of only accepted manuscript from a single journal is the biggest caveat of this paper. I have re-written much of the Abstract to emphasize that this is a proof-of-concept paper, hoping that other researchers concurrently expand this method to larger and more diverse datasets.

      An important methodological fact is that the correlation between the two assessments of peer reviews was actually lower than we would expect (around 0.72 and 0.3 for the different linguistic characteristics). If the ChatGPT gave such different scores based on two assessments, should it not be sound to do even more assessments and then take the average?

      This was a great recommendation by this reviewer, and a point also raised by Reviewer #3. Based on their suggestion, I looked into how each additional iteration of scoring would reduce the variability of scoring for a subset of papers (thus being able to advice users on an optimal number of iterations).

      Interestingly, I observed that ChatGPT has become significantly more reliable in providing sentiment and politeness scores in recent versions. For the latest version (ChatGPT Aug 3, 2023), R2 = 0.992 for sentiment and R2 = 0.859 for politeness were reached for two subsequent iterations of scoring. Unfortunately, OpenAI does not allow access to previous version of ChatGPT, so the current dataset could not be re-scored. Yet, based on these data, there may no longer be a need for people to perform repeated scoring. I show these data in Supplementary Fig. 2, as I believe this is very useful information for people who are interested in using this tool.

      Reviewer #1 (Recommendations to author)

      I had some difficulties reading the article, so it would maybe help to structure the article more (e.g. In the introduction there are three aims stated, so the Statistical Analysis section could be divided in three sections, and instead of the link to figures, the author could state which variables were analysed in a specific manner) to be easier to comprehend the details. Also, I found on one place that the sample consisted of 572 reviews, and on other that it was 558.

      These are very good points. I re-wrote the statistical analysis for clarity (Page 7 of the manuscript). The 558 reviews was a mistake from my part, as I forgot to include the fourth review for the 14 papers that received four reviews in the histograms of Fig. 2b and the accompanying text. This has been updated.

      For figures 1a and 1b it could be considered to enter the table instead of several figures.

      I thank the reviewer for pointing this out. I tried this suggestion, but I found it to reduce the readability of the paper. As an alternative, I now provide an Excel spreadsheet with all the raw data, so people can find all the characteristics of the included papers.

      99.8% of the reviews analysed were assessed as polite. This is, in my opinion, extremely important finding, which shows that reviewers are still holding to certain degree of standards in communication, and it can be mentioned in the abstract.

      I very much agree with this reviewer; this has now been added to the Abstract.

      In results you state that QS World Ranking is "imperfect" measure. When stating that in the results section, it poses the question why it is used in the study, so maybe it is more suitable for the discussion.

      This point is well taken. Even though the QS World Ranking score is imperfect, I still think it can be useful, as a rough proxy of perceived prestige of an institution. I now removed this “imperfect measure” statement from the Results section, and moved it to the Discussion (Page 5).

      In the Results section, instead of using only p values, please add measures of effect (correlations, mean differences), to make it easier to place in the context.

      For the significant effects of Fig. 4, I have added these to the figure legends. Please note that the used statistical tests are non-parametric, so I reported the Hodges-Lehmann differences (which is the median of all possible pairwise differences between observations from the two groups).

      I think the results interpretation should be softened a bit, or the limitations of the study should be placed as the second paragraph in the discussion, since this was only specific journal with specific subfield.

      I agree with this reviewer that the relatively small sample size of this paper demands more careful wording. Throughout the manuscript, I have toned down claims, and emphasized the “proof of concept” nature of this study (for example in the Abstract). I also moved the limitations section to the second paragraph of the Discussion, and elaborate more on the study’s caveats.

      Methods:

      The measure Review time was assessed from submission to acceptance, but this does not need to be review time since it takes a lot of time sometimes to find reviewers. that needs to be stated as the limitation.

      This point is well taken. I changed this to “Paper acceptance time” in Fig. 3 and the accompanying text.

      Gender name determination methods differed between the assessment of the first authors and the last authors, and that needs stronger explanation.

      I appreciate this reviewer raising this point, which has also been raised by Reviewer #3. For this paper, I have carefully weighed the pros and cons of automated versus manual gender determination. Initially, my intention was to rely only on a programmatic method to identify authors' names. However, I came to realize that there were inaccuracies in senior author gender predictions made by ChatGPT/Genderize. This was evident to me due to my personal familiarity with some of these authors, either because they are famous or through personal interactions. It seemed problematic to me to proceed with this analysis knowing that these misclassifications would introduce unnecessary variability to the dataset.

      The advantage of the relatively small sample size in this study was the opportunity to manually perform this task, rather than being fully dependent on algorithms. While I attempted manual gender identification for the first author as well, this was way more challenging due to their limited online presence. The discrepancy in gender identification accuracy between first and senior authors did not go unnoticed, and I acknowledge the issue it presents. I also recognize that, unlike senior authors, reviewers may not necessarily be familiar with the first authors of the papers they evaluate, as indicated in the original submission of this paper. In light of this, I sought input from several PIs who often serve as reviewers. Their feedback confirmed that they typically possess knowledge of senior authors' identities, for example through conferences, whereas the same is not true for first authors. Yet, this may be different for other scientific disciplines, where the pool of reviewers might be bigger.

      Notably, for future studies I may make a different decision, especially when I use larger datasets that require me to automate the process.

      I also realize that my rationale for the different methods of gender determination was not explained well enough in the original submission; I now explain my reasoning more elaborately on Page 7 on the manuscript.

      For sentiment analysis: Please state based on what the GPT made a decision? Which program? (e.g. for gender it used genderize.io)

      This has been added to Page 7.

      Finally, your entire analysis can be made reproducible (since everything is publicly available). You can share ChatGPT chats as online materials with variables entered with the dataset analysed and the code. This would increase the credibility of the findings.

      I will make the entire raw dataset available through the eLife website, including all reviews and their scores.

      Reviewer #2 (Public review)

      Strengths include:

      1) Given the variability in responses from ChatGPT, the author pooled two scores for each review and demonstrated significant correlation between these two iterations. He confirmed also reasonable scoring by manipulating reviews. Finally, he compared a small subset (7 papers) to human scorers and again demonstrated correlation with sentiment and politeness.

      2) The figures are consistently well presented and informative. Figure 2C nicely plots the scores with example reviews. The supplementary data are also thoughtful and include combination of first/last author genders. It is interesting that first author female last author male has the lowest score.

      3) A series of detailed analysis including breaking down reviews by subfield (interesting to see the wide range of reviewer sentiment/politeness scores in computational papers), institution, and author's name and inferred gender using Genderize. The author suggests that peer review to blind the reviewers to authors' gender may be helpful to mitigating the impoliteness seen.

      Thank you.

      Weaknesses include:

      1) This study does not utilize any of the wide range of Natural Language Processing (NLP) sentiment analysis tools. While the author did have a small subset reviewed by human scorers, the paper would be strengthened by examining all the reviews systematically using some of the freely available tools (for example, many resources are available through Hugging Face [https:// huggingface.co/blog/sentiment-analysis-python ]). These methods have been used in previous examinations of review text analysis (Luo et al. 2022. Quantitative Science Studies 2:1271-1295). Why use ChatGPT rather than these older validated methods? How does ChatGPT compare to these established methods? See also: colab.research.google.com/drive/ 1ZzEe1lqsZIwhiSv1IkMZdOtjPTSTlKwB?usp=sharing

      This was a great recommendation by this reviewer, and I have tested ChatGPT against TextBlob and VADER, the two algorithms also used by the Luo et al. study — see Supplementary Fig. 4. Perhaps unsurprisingly, these algorithms performed very poorly at scoring sentiment of the reviews. Please note that I also tested these two algorithms at scoring individual sentences, Tweets and Amazon reviews, which it did very well (i.e., the software package was working correctly). Thus, ChatGPT is better at scoring scientific texts than TextBlob and VADER, likely because these algorithms struggle with finding where in the review the sentiment is conveyed. I now discuss this on Pages 1, 3 and 4 of the manuscript.

      2) The author's claim in the last paragraph that his study is proof of concept for NLP to analyze peer review fails to take into account the array of literature already done in this domain. The statement in the introduction that past reports (only three citations) have been limited to small dataset sizes is untrue (Ghosal et al. 2022. PLoS One 17:e0259238 contains over 1000 peer review documents, including sentiment analysis) and reflects a lack of review on the topic before examining this question.

      I thank this reviewer for pointing me to this very useful study. I regret missing this one in my initial submission; I now discuss this paper in Pages 1 and 5 of the manuscript.

      3) The author acknowledges the limitation that only papers under neuroscience were evaluated. Why not scale this method up to other fields within Nature Communications? Cross-field analysis of the features of interest would examine if these biases are present in other domains.

      I share this reviewer’s opinion that it would be very interesting to expand this analysis to different subfields. I initially only included Neuroscience papers, because I was uncertain whether I would be able to properly assess the reviews from different scientific disciplines (and thus judge whether ChatGPT was able to provide plausible scores). The different reviewers have provide me with a list of potential follow-up experiments, and I am currently considering different options for future work, including expanding into different fields within Nature Communications. Additionally, I am looking to team up with a journal to perform the experiments laid out in (the new) Supplementary Fig. 6 of the new paper, to study whether I can find evidence of bias across rejected and accepted manuscript papers of a journal. I am also looking into ways to automate data collection using APIs, and by utilizing the rapidly expanding databases for transparent peer review. Yet, based on this preprint, I have received messages from academics that are interested in using generative AI to study scientific texts. By revising this manuscript now, I hope to provide them with the tools to concurrently expand the analysis of peer review into different scientific disciplines and journals.

      The comments I received from the different reviewers made me realize that I did not describe the intent of this paper well enough in the original submission. I rewrote much of the Abstract, to emphasize the proof-of-concept nature of this study, and rewrote the Discussion to focus more on the limitations of the study.

      Reviewer #3 (Public review)

      Strengths:

      On the positive side, I thought the use of ChatGPT to score the sentiment of text was novel and interesting, and I was largely convinced by the parts of the methods which illustrate that the AI provides broadly similar sentiment and politeness scores to humans who were asked to rank a sub-set of the reviews. The paper is mostly clear and well-written, and tackles a question of importance and broad interest (i.e. the potential for bias in the peer review process, and the objectivity of peer review).

      Thank you.

      Weaknesses:

      The sample size and scope of the paper are a bit limited, and I have written a long list of recommendations/critiques covering diverse aspects including statistical/inferential issues, missing references, and suggestions for other material that could be included that would greatly increase the usefulness of the paper. A major limitation is that the paper focuses on published papers, and thus is a biased sample of all the reviews that were written, which prevents the paper properly answering the questions that it sets out to answer (e.g. is peer review repeatable, fair and objective).

      I very much appreciate this reviewer taking the time to provide me with such a detailed list of recommendations. Below, I will respond to this list in a point-by-point manner.

      Reviewer #3 (Recommendations to author)

      My main issues with the paper are that it is not very ambitious, and gave me the impression the aim was to write the first paper using ChatGPT to address this question, rather than to conduct the most thorough and informative investigation that would have been feasible (many obvious questions that could be addressed are not tackled, since the sample size is small and restricted). There are also issues with selection bias, and the statistical analysis, that have possibly led to erroneous inferences and greatly limit what conclusions can be drawn from the analysis. I hope my comments of use in further improving the paper.

      The repeatability of ChatGPT when calculating the two linguistic characteristics is low. Taking the average of multiple assessments is one way to deal with this. To verify that taking the average of, say, 5 scores gives a repeatable score, the author could consider calculating 10 scores for a set of 20-30 reviews, calculating two scores for each review using the first 5 and second 5 ChatGPT ratings, and then calculating repeatability across the 20-30 reviews. It is important to demonstrate that ChatGPT is sufficiently repeatable for this new method to be useful.<br /> Also, it might be possible to automate this process a bit to save time - e.g. the author could change the ChatGPT prompt, like "please rate the politeness of this review from -100 to +100, do it 10 times independently, and print your 10 ratings as well as their average". Hopefully the AI is smart enough to provide 10 independently-computed ratings this way, saving the need to copypaste the prompt into the chat box 10 times per review.

      This was a great recommendation by this reviewer, and a point also raised by Reviewer #1. Based on their suggestion, I looked into how each additional iteration of scoring would reduce the variability of scoring for a subset of papers (thus being able to advice users on an optimal number of iterations). I also tested this Reviewer’s suggestion to ask ChatGPT to score many times, and give separate scores for each iteration — this worked very well.

      Interestingly, I observed that ChatGPT has become significantly more reliable in providing sentiment and politeness scores in recent versions. For the latest version (ChatGPT Aug 3, 2023), R2 = 0.992 for sentiment and R2 = 0.859 for politeness were reached for two subsequent iterations of scoring. Unfortunately, OpenAI does not allow access to previous version of ChatGPT, so the current dataset could not be re-scored. Yet, based on these data, there may no longer be a need for people to perform repeated scoring. I show these data in Supplementary Fig. 2, as I believe this is very useful information for people who are interested in using this tool.

      To my mind, the main reason to use an AI instead of one or more human readers to rank the sentiment/politeness of peer reviews is to save time, and thereby allow this study to have a larger sample size than would be feasible using human readers. With this in mind, why did you choose to download only 200 papers, all from the discipline of Neuroscience, and only from Nature Communications? It seems like it would be relatively easy to download papers from many more journals, fields of research, or time periods if using AI-based methods, and in fact it would have been feasible (though fairly laborious) for one person to read and classify the sentiment of the reviews for 200 papers.

      As well as providing more precise estimates of the parameters you are interested in (e.g. the consistency of reviews, and the size of the difference in reviewer sentiment between author genders), expanding the sample beyond this small set of papers would allow you to address other interesting questions. For example, you could ask whether the patterns observed for neuroscience are similar to those in other research disciplines, whether Nature Comms is representative of all journals (given there are other journals with public reviews), and you could test whether the male-female differences have become greater or smaller over time (e.g. by comparing the male-female differences observed in the past to the effect size observed in 2022-23). Additionally, the main analyses in this paper would have higher statistical power - for example, you only include 53 papers with a female senior author, giving you quite low power/ precision to estimate the gender difference in the average sentiment of reviews (given the high variance in sentiment between papers).

      I want to thank this reviewer for taking the time about possible ways to increase the impact of this work. I agree, these are all great suggestions, and there are many possibilities to apply ChatGPTbased natural language processing to scientific peer review. Respectfully, I chose to continue with publishing this work in the form of a proof-of-concept paper, because I currently do not have the resources to perform this (quite labor intensive) study. Below I will explain my reasoning, that I also shared with Reviewers #1 and #2.

      I initially only included Neuroscience papers, because I was uncertain whether I would be able to properly assess the reviews from different scientific disciplines (and thus judge whether ChatGPT was able to provide plausible scores). The different reviewers have provide me with a list of potential follow-up experiments, and I am currently considering different options for future work, including expanding into different fields within Nature Communications. Additionally, I am looking to team up with a journal to perform the experiments laid out in (the new) Supplementary Fig. 6 of the new paper, to study whether I can find evidence of bias across rejected and accepted manuscript papers of a journal. I am also looking into ways to automate data collection using APIs, and by utilizing the rapidly expanding databases for transparent peer review. Yet, based on this preprint, I have received messages from academics that are interested in using generative AI to study scientific texts. By revising this manuscript now, I hope to provide them with the tools to concurrently expand the analysis of peer review into different scientific disciplines and journals. The comments I received from the different reviewers made me realize that I did not describe the intent of this paper well enough in the original submission. I rewrote much of the Abstract, to emphasize the proof-of-concept nature of this study, and rewrote the Discussion to focus more on the limitations of the study.

      Also, if you could include some reviews of papers that were reviewed double-blind, you could test whether the gender-related differences in peer reviews are ameliorated by double-blind reviewing. Nature Comms (and many other journals with open review) do have some double-blinded papers, and there is evidence that that double-blinding is preferentially selected by authors who think they will experience discrimination in the peer review process (DOI: 10.1186/s41073-018-0049-z), and also that double-blinding does ameliorate bias (DOI: 10.1111/1365-2435.14259), so this seems very relevant to the ideas under study here.

      I note that the PLOS journals allow open peer review, and there is an API for PLOS which one can use to download the reviews for a given paper (e.g. try this query to get to the XML file of a paper which has open peer review: http://journals.plos.org/plosone/article/file?id=10.1371/ journal.pone.0239518&type=manuscript). Using an API could allow this project to be scaled up, because you can programmatically search for the papers with open reviews, download those reviews using the API and some code, and then score them using the same ChatGPT-based methods used for Nature Comms. Also, Publons recently merged with Web of Science (Clarivate), and you can now read all the open peer reviews on Web of Science for papers which had open review (e.g. for this paper: https://www-webofscience-com.napier.idm.oclc.org/wos/woscc/fullrecord/WOS:000615934800001). It would be possible to write to Web of Science, request access to their data or search engine, and programmatically download many thousands of papers and their associated reviews, and then use ChatGPT or a similar AI to score them all (especially if you can pass the reviews to ChatGPT for scoring programmatically, instead of manually copy-pasting the reviews into the chat box one at a time as it appears was done in the present study).

      These are great suggestions, and I have different plans for follow-up studies, including the use of APIs to download large batches of peer reviews. The analyses in this paper have been performed in February of this year, even before the ChatGPT API had been released, which did not let me automate the process at that time. As a result, these analyses have been performed manually. I realize that the field is moving rapidly, and that there are now different options to scale this up quickly.

      I plan on using the suggestions from this Reviewer for follow-up experiment in a next paper, and publish this revision as a proof-of-concept paper. In this way, different researchers can optimally use ChatGPT-based sentiment analyses for similar studies without a delay.

      As you acknowledge, there is a selection bias in this study, since you only include papers that were ultimately published in Nature Comms (missing reviews of papers that were rejected). This is a really big limitation on the usefulness of some of your analyses. For example, you found no relationship between author institutional prestige and reviewer sentiment. This could be evidence of a fair and impartial review process (which seems unlikely!), or it could be a direct result of selection bias (specifically a "collider bias", like the famous example involving height and skill among professional basketball players). The likelihood that a paper is published is positively related both to its quality and the prestige held by the authors, we might expect a flatter (or even negative) correlation between prestige and reviewer sentiment among papers that were published than among the whole set of papers (like how the correlation between height and speed/skill is less positive among NBA players than among the general population, since both height and speed/skill provide advantages in basketball).

      I agree with this reviewer that the selection bias is a major limitation of this study. I rewrote much of the Abstract and Discussion to tone down claims, and more prominently discuss the limitations of this study. I also made several suggestions for follow-up experiments.

      In the section "Consistency across reviewers", you write that there was little similarity between review sentiment scores from different reviewers from the same paper, and then write "This surprising result indicates high levels of disagreement between the reviewers' favorability of a paper, suggesting that the peer review process is subjective." However I disagree with this conclusion for three reasons:

      • Firstly, your dataset only includes papers that were published, and thus there is a selection bias against manuscripts where both/all reviewers disliked the paper - the removal of this (probably large) set of reviews will add a (potentially very strong) downward bias to your estimate of how consistent the review process is (since you are missing all those papers where the reviewers agreed). I think that one cannot properly answer the question "are reviewers consistent in their appraisals" without having access to papers that were rejected as well as those that were accepted.

      I agree with this reviewer that there is a selection bias in this study, which I acknowledged throughout the initial submission of this manuscript. Indeed, having access to reviews of rejected papers will greatly increase my confidence in this finding. However, if there is consistency across reviewers in the entire pool of (post-review rejected+accepted) manuscripts, some of that has to trickle down into the pool of accepted papers. The correlation between sentiment scores of the different reviewers is so strikingly low (or even absent) that I simply cannot envision a way in which there is consistency across reviewers in the pre-editioral decision stage. Yet, I realize that this point is debatable. Therefore, I changed the phrasing of the Discussion section, including the following sentence:

      That being said, the extremely low (or even absent) relation between how different reviewers scored the same paper was striking, at least to this author.

      • Secondly, the method used to assess whether the reviews for each paper tend to be similar (shown in Figure 3b) does not fully utilize the information contained in the data and could be replaced with another method. (In the paper 3 univariate regressions compare the sentiment scores for R1 vs R2, R1 vs R3, and R2 vs R3, which needlessly splits up the data in the case of papers with more than 2 reviewers, reducing power.) You could instead calculate the intraclass correlation coefficient (aka 'repeatability'), to determine what proportion of the variance in sentiment scores is between vs within papers (I suggest using the excellent R package rptR for this). Note that the sentiment scores are not normally distributed, and so regular regression (as you used) or one-way ANOVA (which you might be tempted to use for the ICC calculation) are not ideal - consider using a GLM or transformation (the rptR package automates the tricky calculation of repeatability for generalized models).

      I thank this reviewer for pointing me towards this option. I added this analysis to Fig. 3b, which confirmed the inconsistency in sentiment scores for reviews of the same paper (ICC = 0.055). As suggested by this reviewer, I decided to perform the ICC on log-transformed data, as ICC calculation is very sensitive to non-normally distributed data.

      • Thirdly, an alternative and very plausible hypothesis for this lack of similarity (besides peer review being highly subjective) is that ChatGPT is estimating the "true sentiment" of a review (i.e. what the reviewer intended to say) with some amount of error (e.g. due to limitations/biases in the AI, or reviewers struggling to make themselves understood due to issues such as writing in a second language, typos, or writing under time pressure), which dilutes the similarly in the estimated sentiment of the reviews. In other words, if the true sentiment values are strongly correlated, but there is random error in how those values are estimated by ChatGPT, then the correlation between reviewer scores for each paper will tend to zero as the error tends to infinity. Furthermore a nebulous quality like "sentiment" cannot be fully summarised in a single variable running from -100 to +100, and if you had used a more multi-dimensional classification system for the reviews (or qualitative assessment by human readers) you might have found that there is a bit more correspondence (I'm speculating here, but I think you cannot really exclude this and the paper doesn't mention this limitation).

      This point is well taken. I added caveats to the Discussion section on Page 5. Altogether, after taking these caveats into account, I do believe that this analysis convincingly demonstrates subjectivity in the peer review of this subset of papers. That said, I hope that my re-written discussion and additional analysis have added the necessary nuance to this point.

      In Figure 3C, you write "Contribution of paper scores to review time". This strongly implies to the reader that the sentiment scores inferred for the reviews have a causal effect on the review time. This is imprecise writing (since the scores were calculated by you after the papers were published, and thus cannot be causal - you mean that the actual reviews affected the review time, not the scores), but more importantly you cannot infer any causality here since your dataset is observational/correlational. You could fix this by re-phrasing to emphasise this, e.g. "Statistical associations between paper scores and review time".

      This is a very good point raised by this reviewer. I have corrected the phrasing so it no longer implies causality.

      For the analysis shown in Figure 4d and Figure 4e, I am not certain what you mean by "data split per lowest/median/highest sentiment score". This is ambiguous, and I am also not sure what the purpose of this analysis is or what it shows - I suggest re-writing for greater clarity (and ideally providing the code used in all your analyses) and perhaps revising the analysis. Additionally, an important missing piece of information from this analysis (and most analyses in the paper) is the effect size. For example, you don't report what is the difference in politeness score and sentiment score between male and female authors, and what is the SE and 95% CIs for this difference. From eyeballing the figure, it looks like the difference in politeness is about 4 points on your 200point scale - this is small in absolute terms, but might be quite large in relative terms given that "politeness score" usually hovered around a small part of the full 200-point scale. What is this as a standardised effect size (i.e. in terms of standard deviations, as captured by effect sizes like Cohen's d and Hedges' g)? Calculating this (and its 95% CIs) would allow you to say whether the difference between genders is a "big effect", and give an idea of your confidence in your effect size estimate and any inferences drawn from it. You even discuss the effect size in your discussion, so it would help to calculate the standardised effect size. If you're not familiar with effect size and why it's useful, I found this paper very instructive: https://onlinelibrary.wiley.com/ doi/abs/10.1111/j.1469-185X.2007.00027.x

      I agree with this reviewer that this phrasing was ambiguous. I now rephrased this on Page 4 of the manuscript:

      To study whether these more impolite reviews for female first authors were due to an overall lower politeness score, or due to one or some of the reviewers being more impolite, I split the reviews for each paper by its lowest/median/highest politeness score. I observed that the lower politeness scores for first authors with a female name was driven by significantly lower low and median scores (Fig. 4d, bottom panel). Thus, the least polite reviews a paper received were even more impolite for papers with a female first author.

      I also added effect sizes of the significant effects from Fig. 4 to its figure legend. Please note that the used statistical tests are non-parametric, so I reported the Hodges-Lehmann differences (which is the median of all possible pairwise differences between observations from the two groups).

      "Double-blind peer review has been debated before, but has come under scrutiny for various reasons" - this is vague and unhelpful. I think it's worthwhile to properly engage with the debate and the substantial body of evidence in your paper, given your main focus is on potential bias in the review process based on authors' identities (e.g. gender, institutional prestige).

      I thank the reviewer for pointing this out. I rephrased this sentence to indicate that there is evidence that it helps to remove certain forms of bias (Page 5):

      To address this issue, double-blind peer review, where the authors' names are anonymized, could be implemented. Evidence suggests that this is useful in removing certain forms of bias from reviewing8,9, but has thus far not been widely implemented, perhaps because some studies have cast doubt on its merits21,22.

      I have also added a Supplementary Fig. 6 to this paper, in which I lay out how my tool can be used to study bias by applying it to single- and double-blinded reviews (see also my answer to the other question about this topic below).

      On a related note, in the first paragraph, when discussing the potential of single-blind review to allow reviewers to essentially discriminate against papers by women, there is a key missing citation. This year, the first truly experimental test of this hypothesis was published (DOI: 10.1111/1365-2435.14259); a journal conducted a randomised controlled trial in which submitted manuscripts were reviewed either single- or double-blind. They found no effect of author gender on reviewer ratings or editorial decisions (though there was an effect of review type on success rate of authors from different countries). It would be better to cite this instead of reference 6, which as you acknowledge is methodologically flawed. This paper is also worth a read given your focus on Nature journals: DOI: 10.1186/s41073-018-0049-z.

      This point is well taken. I now cite this paper (citation #8) and rephrased this part of the Introduction (Page 1).

      "Another - arguably more simple - solution [compared to double-blind peer review] could be for reviewers to be more mindful of their language use." Here, you seem to be saying that we don't need to blind author names during peer reviewers, because it would simpler if all reviewers were simply nicer! I object to this because A) double-blind review is easy to implement, and greatly reduces the opportunity to tune the review to the author's identity (and there is some experimental evidence that it works in this regard), and B) it seems like wishful thinking to say that we don't need to implement measures that reduce the scope for bias, because all reviewers could instead stop using impolite language.

      This is a very valuable comment. I rephrased this to emphasize that this is an additional measure.

      "reviewers may want to use ChatGPT to extract a politeness score for their review before submitting" Yes, that's an interesting idea, and I can imagine that some (probably small) proportion of reviewers will be interested in doing this. But I think you should think bigger about wholesale changes to the review system that are possible because of AI like ChatGPT. For example, the submission platforms where reviewers submit their reviewers (e.g. ScholarOne, Manuscript Central) could be updated to use AI to pre-screen draft reviews, and issue a warning to reviewers, like "Our AI assistant has indicated that the writing in this review might be impolite (example phrases here) - would you like to edit your review before you submit it?" Also, reviewcredit platforms like Publons could display not only the number of reviews that someone wrote, but an AI-generated assessment of how constructive, detailed, and polite their reviews are (this would help nudge people into writing better reviews, and also give credit where it's due to careful reviewers, which is part of the aim of Publons and similar platforms). This is just off the top of my head - there are many other good ideas about how AI could transform the peer review process. Indeed, AI is already good enough to generate quite useful peer reviews and constructive criticism of draft papers, and will surely get better at this... this surely has lots of implications for science publishing over the coming decades.

      These are great suggestions for implementation of this tool. I now end the first paragraph of the Discussion (Page 4) with the following sentence:

      Such an automated language analysis of peer reviews can be used in different ways, such as afterthe-fact analyses (as has been done here), providing writing support for reviewers (for example by implementation in the journal submission portal), or by helping editors pick the best papers or most constructive reviewers.

      "Further research is required to investigate the reasons behind this effect and to identify in what level of the academic system these differences emerge." Here you could mention what this research would be - I think you'd need the full sample of reviewed papers, not just those that were accepted. Spell out what analyses would be required to test and falsify the various (very plausible and interesting) competing hypotheses that you mention for the male-female difference in sentiment scores.

      Great point. I added a Supplementary Fig. 6, in which I show a visual depiction of the experiments that can be performed to answer these questions.

      "areas of concern were discovered within the academic publishing system that require immediate attention. One such area is the inconsistency between the reviews of the same paper, highlighting the need for greater standardization in the peer review process." I disagree here. I think it is natural for there to sometimes be differences in how two or more reviewers rate the quality of a paper, even if the peer review process were carefully standardised (e.g. via the use of a detailed "peer review form", which helps guide reviewers to comment on all important aspects of the paper - some journals use these). This is because reviewers differ in their experience, expertise, or interests, and so some reviewers will catch mistakes that others miss, or request stylistic changes that others would not. More broadly, it's often not possible to write a version of the paper that satisfies all possible reviewers.

      I re-phrased part of the Discussion on Page 5 to indicate other sources of inter-reviewer variability. Specifically, I mention that some variability in sentiment can be expected based on the different backgrounds of the reviewers:

      Notably, some level of variability may be expected, for example due to different backgrounds, experiences, and biases of the reviewers. In addition, ChatGPT may not always reliably assess a reviews sentiment, adding some spurious inter-reviewer variability.

      Yet, as also mentioned in my response to one of the previous questions, I still find the the extremely low levels of consistency striking, even after taking these possible sources of interreviewer variability into account.

      "the maximum score an institution could receive was 100 (in 2023 this was Massachusetts Institute of Technology)" - this seems unnecessary information (just mention the score runs from 0-100).

      I agree with this reviewer that this was unnecessary information. This has been removed.

      "reviewers are generally familiar with the senior author of papers they review and thus are likely aware of their gender identity." This seems like a strong assumption, and you don't provide any evidence for it Speaking personally, as a reviewer and journal editor I am often not familiar with the senior author, or I am familiar with the first author - I am not sure how often I know the senior author but not the first author or vice versa. It's also not always the case that the first author is a junior scientist and the last author a senior, famous one, as you imply. I suggest that you use the same approach to score the gender of both author positions, namely inferring their gender programmatically from their name (I agree that generally the important thing for the purposes of this study is the gender that reviewers will infer from the name, not the author's actual gender, and so gender estimation from first names is the correct approach).

      I appreciate this reviewer raising this point, and I have carefully weighed the pros and cons of both approaches. Initially, my intention was to rely only on a programmatic method to identify authors' names. However, I came to realize that there were inaccuracies in senior author gender predictions made by ChatGPT/Genderize. This was evident to me due to my personal familiarity with some of these authors, either because they are famous or through personal interactions. It seemed problematic to me to proceed with this analysis knowing that these misclassifications would introduce unnecessary variability to the dataset.

      The advantage of the relatively small sample size in this study was the opportunity to manually perform this task, rather than being fully dependent on algorithms. While I attempted manual gender identification for the first author as well, this was way more challenging due to their limited online presence. The discrepancy in gender identification accuracy between first and senior authors did not go unnoticed, and I acknowledge the issue it presents. I also recognize that, unlike senior authors, reviewers may not necessarily be familiar with the first authors of the papers they evaluate, as indicated in the original submission of this paper. In light of this, I sought input from several PIs who often serve as reviewers. Their feedback confirmed that they typically possess knowledge of senior authors' identities, for example through conferences, whereas the same is not true for first authors. Yet, this may be different for other scientific disciplines, where the pool of reviewers might be bigger.

      Notably, for future studies I may make a different decision, especially when I use larger datasets that require me to automate the process. I now more elaborately explain why I made this decision on Page 7 of the manuscript.

      In the Abstract, you write "suggesting a gender disparity in academic publishing". This part of the sentence contains no information about what you think is the cause of the male/female difference, and no further interpretation of its ramifications, so I think you can just remove it (because "disparity" just means a difference, so you are effectively saying something redundant like "there was a difference between papers with male and female senior authors, suggesting there is a difference")

      I thank the reviewer for pointing this out. I replaced the latter part of this sentence with “(…) for which I discuss potential causes.”, which I think is better than a short summary of potential causes which may lack the nuance that such a topic deserves.

    1. Like nihilism, existentialism starts with a claim that there is no fundamental meaning or morality. But in existentialism, people must create their own meaning and morality.

      I see existentialism as a branch of nihilism, and I think in modern times the two have become somewhat intertwined, many using them somewhat interchangeably. Existentialism seems to be an extension of nihilism, as stated in the text, where it begins with the fundamental idea that morality is not a set definition.

      I personally find Existentialism to be the most "scientific" or "realistic" perspective (though, again, it is perspective) as we know morality is a human construct, and a social construct, which varies based on where you grew up.

      Writing this, I now wonder if Existentialism should be a prefix (or suffix) because you may believe in Existentialism but end up practicing a specific moral principle (ie natural rights or virtue ethics)

    1. Author Response

      The following is the authors’ response to the original reviews.

      First of all, we would like to again thank the reviewers for their work. We appreciate the constructive review comments and useful suggestions to further improve our article. With those comments in mind, we have now revised our manuscript. Please see below for a point-by-point response (our responses in green) to all comments.

      Reviewer #1 (Recommendations For The Authors):

      Sun and colleagues outline structural and mechanistic studies of the bacterial adhesin PrgB, an atypical microbial cell surface-anchored polypeptide that binds DNA. The manuscript includes a crystal structure of the Ig-like domains of PrgB, cryo-EM structures of the majority of the intact polypeptide in DNA-bound and free forms, and an assessment of the phenotypes of E. faecalis strains expressing various PrgB mutants.

      Generally, the study has been conducted with a good level of rigor, and there is consistency in the findings. However, I do have some specific technical concerns relating to the study that necessitate the undertaking of additional experiments. These are summarized as follows:

      1) Recombinant PrgB188-1233 produced in the study purifies as a mixture of monomeric and dimeric species separatable by SEC. There is very limited discussion in the text re. the significance and/or implications of this. Is it feasible that the dimeric form is biologically relevant in the context of the in vivo situation? Or alternatively, is this simply an artifact of protein production?

      Experimental data that we published in 2018 indeed indicates that the dimer is relevant in the in vivo situation. We did not discuss this here since this was discussed in detail in the previous paper: Schmitt et al, 2018. We have now added a bit more information on this in the results section, highlighting this, so that it is clearer to the reader (lines 114-116).

      2) The authors see no evidence of the adhesive domain of PrgB in their PX structure highlighting that this must have been cleaved during crystallisation. Is this claim supported by an inspection of the crystal packing? It could be that this region of the protein is dynamic within the context of the crystal and is thus not observed. This should be clarified in the text either way.

      The crystal packing does not provide any space for the PAD. We have added this to the results section. We have added a sentence describing this in lines 122-124.

      3) The Cryo-EM structures reported are both at ~10-angstrom resolution. Are the authors truly confident in the placement of their crystal structures on these maps? Visual inspection indicates that their positioning of the PrgB domains into the EM envelopes is somewhat questionable. The authors need to provide some quantitative measures of the quality of their domain fitting. The narrative of the manuscript very much hinges on this being correct.

      This is something that the other reviewer also commented on. The fitting of the crystal structures in the maps are indeed not optimal, but was the best we could do with the available data. In line with point #6, we have now constructed new protein variants of the stalk domain (the four Ig-like domains) alone, and have assayed it’s interaction with the PAD in vitro using native gels and size exclusion chromatography. The outcome of these experiments is that the two domains do not interact in any substantial way on their own. Thus, the added experiments do not support the hypothesis that the PAD interacts with the Ig-like domains, at least not without the local high concentration provided by the linker region in the in vivo situation.

      To account for these new experiments, we have moved the cryo-EM structure to the supplement, and rewritten this part of the manuscript to say that the cryo-EM data indicated that there might be an interaction, but that we have not been able to verify this in vitro, indicating that if the interaction at all exists it must have a low affinity and is likely not physiologically relevant. In line with this, we have also further modified the text throughout the manuscript to account for this.

      4) The manuscript would be significantly strengthened if the authors could include confirmatory hydrodynamic data in support of the observed conformational reorganization of PrgB in the presence of DNA. SAXS analysis of the DNA-free and bound complexes would be ideal for this and would also help address the issues raised above in pt 3.

      To analyze PrgB radius with and without DNA, we tried both SEC-MALS and DLS experiments. It proved difficult to obtain precise and reproducible values, but the initial data indicated that no large changes were observed upon DNA binding. As we could also not measure specific interaction between the PAD and the stalk in vitro, we did not perform SAXS experiments. As mentioned in the response to point #3, we have modified the results and discussion regarding the potential interaction of th PAD and Stalk domains.

      5) The authors present binding studies of various PrgB mutant-expressing strains. A number of the mutations generated delete significant portions of the polypeptide. Can the authors confirm that these mutant proteins are correctly folded despite the introduced mutations? It could be that loss of function is simply a consequence of mutation-induced misfolding. I would like to see some confirmatory data (CD, SEC, etc.) in support of the foldedness of the mutant proteins.

      We cannot completely rule out that the folding of some of the variants is affected in E. faecalis. However, CD or SEC experiments would only give indications of the contrary if the overall fold had been majorly affected in an in vitro situation where the protein is not anchored to the E. faecalis cell wall.

      To alleviate this valid concern, we probed if all variants are correctly exported and linked to the cell-wall. Therefore we have now extracted the cell wall of E. faecalis producing wild-type or variant PrgB and performed Western blot . The results of the Western blot with cell wall extract largely matches the whole cell experiments that were in the initial manuscript. If a protein variant was largely misfolded, it would likely not be targeted and linked to the cell-wall, nor would it be stable in vivo. We have added this new data as a new fig 3 – figure supplement 1 and on lines 201-214

      6) The authors suggest a direct interaction between the PAD and the stalk domains in PrgB. The discussion of this is very generic and no evidence to support this is provided other than the 10-angstrom resolution EM map. If they believe this to be the case, then additional evidence should be provided.

      Answer: As mentioned previously, we have now performed additional in vitro experiments to probe this potential interaction, but conclude that this indication from the EM data is likely not a real high affinity interaction. In line with this, we have modified the results and discussion regarding this point, see also response to point #3 and 4.


      Reviewer #2 (Recommendations For The Authors):

      As currently presented, I don't feel that the cryoEM data support the authors' proposed model, largely because the fit of the crystal structures to the EM volumes does not seem entirely reasonable for the apo- dataset and because the EM volume for the ssDNA bound dataset is not even contiguous. For me to believe the model as it is currently built, I would want to see a dataset with the PAD deleted, showing that its proposed density disappears, or a dataset with a PAD-specific antibody as a fiducial marker. It would be nice to see some goodness of fit metric with a comparison to other crystal structures fit such low-resolution data as well. At the very least, the authors must include the standard cryoEM workflow supplementary figure showing representative micrographs, 2Ds, and 3Ds along with particle numbers.

      In line with the comments raised by reviewer #1, we have now added more experiments where we have analyzed the potential interaction between PAD and the stalk domain. From this new data, it looks like they do not interact with any substantial affinity, at least not on their own without any linker region holding them together, and that this interaction if it all exist likely is not physiologically relevant. The cryo-EM data has been moved to the supplement as we agree with both reviewers that the resolution, and the fitted model, is not good enough to draw any hard conclusions. The standard table for the cryoEM workflow was present as supplementary table 2, where eg particle numbers etc are described, but we have now also added a new supplementary fig 2 – figure supplement 2 that shows the EM processing workflow, including representative micrographs, 2D and 3D classes. We debated whether we should remove the EM data, but decided against it in line of transparency and to explain why the interaction studies with the PAD and stalk domains were performed.

      The X-ray crystallographic structure is very nice, but I was a bit surprised by the R factors in Table 1. After downloading the structure factors and coordinates from the PDB (thank you for depositing before submission!) I was able to see quite a few positive peaks in the difference map that could probably use some cleaning up. I realize I may just be a bit of a masochist when it comes to adding/deleting waters and moving around side chains to get things just right, but for such lovely data, I would have liked to see the model polished up a bit more. I was going to say that the isopeptide bond should be modelled, but I can see from a cursory Google that the authors did in fact try to find a way to model this and that it is indeed a bit of a pain.

      The model refinement proved surprisingly recalcitrant with regards to the remaining difference density, so we took the decision to only model what was solidly there (which leads to slightly higher R factors). We did indeed try to model the isopeptide bond, but we did not find a good way to do so (despite trying quite extensively), and ended up determining them as a linker in the PDB file, so that the bond shows up when one opens the structure in eg. Pymol.

      For protein production/purification in general I would have liked to see actual traces for the gel filtration and pure protein on a gel in a supplementary figure. I strongly believe that this type of information is so critical for future researchers looking to replicate or build upon published work so that they have some sense that what they are doing is working in the way it should be.

      We have now added a supplementary figure (as new Fig. 1 – figure supplement 1) that shows SEC and SDS-PAGE for the purification of PrgB188-1233.

      Finally, I think for the in vivo data it only makes sense to show the reader whether any or all the differences measured across your different mutants are statistically significant. Having done the graphing and analysis in GraphPad this should be a simple thing to achieve.

      We have now added statistical test (One way Anova) that show the statistical significance between the mutants, and show that in Fig 3 and Fig 4.

      Overall, I think it's a very nice paper and while I feel that the cryoEM data in its current form doesn't support the model of occlusion from PrgA, I also don't think that removing the cryoEM data and that specific mechanistic idea from the paper detracts from its overall message and impact.

      Thank you for those comments.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1 (Recommendations For The Authors):

      p. 5, l. 87-90: The control of flgM by OmrA/B (PMID 32133913) and the antisense RNA to flhD (PMID 36000733) are other examples of known regulatory RNAs that impact the flagellar regulon.

      We thank the reviewer for pointing out these references and have added citations to them (page 5, lines 87-91).

      p.11/Fig. 3: it is intriguing that ArcZ and RprA, two of the rpoS-activating sRNAs, repress lrhA. I realize that it is outside of the scope of this study, but have the authors considered the possibility that ArcZ or McaS could have a role in the previously reported repression of rpoS by LrhA (PMID 16621809)?

      We agree that it is intriguing that ArcZ and RprA, two of the rpoS-activating sRNAs, repress lrhA, and added mention of this regulatory connection (page 12, lines 247-250).

      p. 13/l. 272: I do not understand why the authors say that "r-proteins were almost exclusively found in chimeras with MotR and FliX and no other sRNAs...", given that several other chimeras between r-prot and other sRNAs are found

      While some r-proteins encoding genes were found with other sRNAs in RIL-seq datasets, MotR and FliX generally had the highest numbers. The text was revised to better describe the RIL-seq data for r-proteins interaction partners (page 14, lines 291-295), and a new panel showing the S10 operon with all the interacting sRNAs was added to Figure 3—figure supplement 1B.

      Fig. 4 and 5: One possible improvement would be to more systematically assess the effect of base-pairing mutants of the sRNAs, such as MotRM1 or FliXM1 on fliC and rps/rpl genes in vivo. This is especially important for the mutants that affected the sRNA effects in the in vitro probing assays, such as UhpU-M2, MotR-M1 and FliX-S-M1 on fliC (Fig. S7)

      As suggested, we examined fliC mRNA levels across growth in motR-M1 and fliX-M1 chromosomal mutants. The results of these northern assays, now shown in Figure 8—figure supplement 1, are consistent with our model as we observed delayed expression of fliC mRNA in motR-M1 background and premature expression in fliX-M1 background (page 21, lines 444446, 449-453).

      Fig. 5: it may be worth including a schematic of the whole S10 operon to highlight its length and its organization?

      As suggested, a schematic representation of the S10 operon was added to Figure 3—figure supplement 1 with a summary of the RIL-seq data for this operon.

      Probing data (Fig. 5, S7 and S9): in general, it is difficult to differentiate the thin and thick brackets, and what is indicated by the dashed brackets is not always clear. Maybe using a color-code instead could help? Highlighting the predicted pairing regions on the different gels could be useful as well.

      We thank the reviewer for this suggestion and color-coded the brackets (Figure 5, Figure 4figure supplement 2, and Figure 5-figure supplement 2). The correspondences to regions of predicted pairing are described in the figures legends.

      Fig. S10: The experimental evidence used to support FliX-dependent degradation of the rpsS mRNA is indirect (primer extension to observe higher levels of cleavage intermediates). It would be nice to be able to observe a decrease in the mRNA levels as well, either by Northern, or primer extension from a region more distant to the FliX pairing site.

      The S10 operon is long (~5 KB). We have tried multiple probes for this mRNA and detect many bands with each, likely due to extensive regulation of this operon. We think teasing out the origin of the different bands to appropriately interpret changes in patterns will require a significant amount of work.

      legend of Fig. S10: from the gel, it seems that only the plasmids differ in the samples, and it is not clear where the data corresponding to the WT strain mentioned in the legend is shown

      The samples shown in this figure are all for the indicated plasmids in the WT strain. We corrected the figure legend.

      Table S1: please define the NOR (normalized odds ratio?)

      The definition of Normalized Odds Ratio was added to the legend of Supplementary file 1.

      Reviewer #2 (Recommendations For The Authors):

      Major comments:

      Figure 1B. Please add a negative control (which could be in the supplementary section) from a large section showing transcripts that are not directly influenced by Hfq.

      We think the flgKLO browser in this figure serves as a negative control; flgK and flgL clearly are not enriched on Hfq in contrast to FlgO. Figure 1B was generated using published datasets that are easily accessible to the readers at a genome browser and show many other examples of transcripts that are not influenced by Hfq: https://genome.ucsc.edu/cgi-bin/hgTracks?hubUrl=https://hpc.nih.gov/~NICHD- core0/storz/trackhubs/ecoli_rilseq/hub.hub.txt&hgS_loadUrlName=https://hpc.nih.gov/~NICHDcore0/storz/trackhubs/ecoli_rilseq/session.txt&hgS_doLoadUrl=submit

      Line 158. MotR* is a more abundant version of [the constitutively overexpressed] MotR. Is there a Northern or qPCR to confirm this? While I understand the relevance of these mutated constructs, their high expression can lead to artefactual effects.

      This is a valuable point and therefore we provided a northern blot to document the relative levels of MotR and MotR* (Figure 2—figure supplement 1A).

      Figure 2. The overexpression of MotR/MotR* from a plasmid is increasing the number of flagella. However, when the MotR gene is deleted, is there a reduction of the number of flagella? Same question with FliX: what happens when the fliX gene is deleted? According to the model described in the manuscript, we should expect fewer flagella in ΔmotR background and an increased number of flagella in ΔfliX background. Both Figure 2 and Figure 8 would benefit from additional experiments with deleted motR and fliX genes.

      We agree that experiments regarding the endogenous effects of endogenous sRNAs are important. We provided such data in Figure 8 and Figure 8—figure supplement 1 for MotR and FliX in a variety of assays: flagella numbers by electron microscopy, motility and competition assays, expression of flagellar genes by RT-qPCR and western analysis. The chromosomallyexpressed MotR-M1 and FliX-M1 base pairing mutants did show the expected phenotypes of reduced and increased numbers of flagella, respectively (Figure 8A-B). As suggested by reviewer 1, we added northern analysis that examined fliC mRNA levels across growth in motRM1 and fliX-M1 chromosomal mutants. The results of these northern assays are consistent with our model as we observed delayed expression of fliC mRNA in motR-M1 background and premature expression in fliX-M1 background. We went to the trouble of constructing strains carrying point mutations in the chromosomal copies of these genes rather than deletions to avoid interfering with the expression of motA and fliC given that MotR and FliX encompass the 5’ and 3’ UTRs, respectively.

      Figure 3 is key to demonstrating the sRNAs pairing with their specific targets and potential effect on bacterial swimming. However, these results would be more relevant with endogenous expression of the sRNAs and demonstration of their effects on the same targets. A Northern blot showing the overproduced sRNA level compared to endogenous sRNA level could help us appreciate the expression ratio.

      The levels of the UhpU, MotR and FliX expressed from the overexpression plasmids are at least 100-fold higher than the endogenous levels. Thus, we agree that assays of chromosomal deletion/point mutants are important experiments. We did construct chromosomal uhpU-M1 and uhpU∆seed sequence mutants. However, under the conditions assayed, the uhpU chromosomal mutations did not result in observable effects on motility or FlhD-SPA protein levels. It is possible we would be able to detect differences between the wild type and uhpU chromosomal mutant strains under different growth conditions or in different assays, but this would require a significant amount of work. For many other sRNA chromosomal mutations have no or only subtle effects, suggesting redundancy between sRNAs or sRNA roles in fine tuning gene expression.

      Figure 4. In panel B, the empty plasmid pZE alone seems to positively affect the flagellin expression when compared to the WT background. This can also be seen in Figure 4C. There is no fliC signal with empty plasmid pBR* but a strong fliC signal with empty plasmid pZE. Maybe the authors can explain this in the manuscript.

      With respect to panel B and Figure 4—figure supplement 1A, we agree that there is some variation between the levels of flagellin in the WT and pZE control samples, possibly due to the addition of antibiotic to the pZE culture. We added quantification of the bands in Figure 4— figure supplement 1 to better document the changes in flagellin levels.

      With respect to panel C, the pBR samples were collected in crl+ background while the pZE samples were collected in crl- background, which explains the lack of fliC signal in the pBR control sample. This is now noted in the figure legend.

      In lines 154-157, the justification for using two plasmids is described. An IPTG-inducible Plac promoter, the pBR*, is used because the constitutive overexpression of UhpU is resulting in mutated UhpU clones. These observations suggest a toxic expression level of UhpU that the cell can only tolerate when the UhpU RNA is somewhat deactivated by mutations. This does not seem like a detail and could be discussed further.

      We agree with the reviewer that this observation is important and now mention that it suggests at a critical UhpU role (page 8, lines 160-163).

      Figure 5E and I. While the bindings of MotR on rpsJ and Flix-S on rpsS are clear, the resolution of both gels in the areas of binding (upper part of both gels) could be improved.

      We found it tricky to choose the mRNA fragments for the in vitro structure probing for the regions of predicted pairing internal to CDSs. Given that we hoped to retain native RNA folding, we chose long fragments; for rpsJ, we started with the +1 of S10 leader and for rpsS, we started 147 nt into the CDS, a region that overlaps the region that was cloned to the rpsS-rplV-gfp fusion. Consequently, the region of base pairing is in the upper part of both gels. The gels were already run for an unusually long time. Thus, we do not think the resolution could be improved further. Nevertheless, we think the region of protection is evident for both mRNAs.

      Minor comments:

      Fig 1B. The promoter symbols are extremely small, please increase the size.

      As suggested, we have enlarged the promoter symbols in Figure 1B as well as in Figure 3A.

      Line 211. "the lrhA mRNA has an unusually long 5´ UTR". How long exactly?

      The 5’ UTR of the lrhA mRNA is 371 nt long. This is now mentioned in the text (page 11, line 224)

      Line 320. Should "Fig 9C" be "Fig S9C" instead?

      We thank the reviewer for noticing this typo. Callouts to supplementary figures have now been renumbered per eLife format.

      Line 384. Something seems to be missing in the sentence "a representative combined class 2 and 3 promoter".

      The sentence has been modified to clarify the designation (page 19, lines 409-411).

      Reviewer #3 (Recommendations For The Authors):

      Recommendation to clarify/strengthen the presentation of science in the paper:

      Lines 102-103: Can the authors provide some more information on how the sRNAs were initially discovered to be potentially sigma-28 dependent and selected?

      As suggested, we expanded the section discussing the discovery and the selection of these sRNAs (page 6, lines 104-109).

      Lines 192-193: It would be helpful to provide a bit more information in the main text about what are the different RIL-seq data sets (18 in total).

      As suggested, we now provide more details about the different RIL-seq datasets we used in the analysis (page 10, lines 202-205).

      It would be helpful to specify the criteria for "top" interactions in targets retrieved from RIL-seq data (Table S1 and text, e.g., line 273): e.g. number of conditions, number of chimeras, etc.

      As suggested, we now more explicitly specify the criteria for selecting targets to characterize (page 10, lines 205-206).

      Fig. 4B/ S6 and line 242: The flagellin amount in the empty vector control (pZE) looks higher than in WT, and the stated effect of MotR/MotR* OE on flagellin is not very clear from the blot. The "cross-reacting band" above flagellin also seems to vary among strains. Could the authors include a quantification of flagellin protein amount and normalize relative to a housekeeping protein (e.g., GroEL), instead of Ponceau S as loading control?

      We agree that there is some variation between the levels of flagellin in the WT and pZE control sample, possibly due to the addition of antibiotic to the pZE culture. We added quantification of the bands in Figure 4—figure supplement 1 to better document the changes in flagellin levels.

      Figure legends: It would be helpful to have a bit more information about the method used/displayed image rather than stating results in the legends.

      As suggested, we now provide a bit more information about the methods used/displayed image in the figure legends to allow for easier comprehension of the data presented in the figures (while trying to balance this with the length of the legends).

      Fig. 2: Please include a scale for all electron microscopy images or, if it is the same for all panels, state it in the figure legend. Moreover, the same image is used for the pZE control in panel C, E and Figure S4A/C. It would be better to show different fields of bacteria for the pZE sample.

      As is now mentioned in the legends to Figure 2, Figure 2—figure supplement 2, and Figure 8, the same scale was used for all panels. We thought it was better to show the same image for the pZE control in the different panels to emphasize that these samples were all analyzed on the same day.

      Fig. 2: The sRNA OE strains seem to show some heterogeneity in cell length (pZE-MotR) or width (pZE-FliX). The authors could, e.g., check whether this is a phenotype correlated to sRNA OE by quantifying these parameters for different fields and comparing to WT or comment on this in the text if this is not consistently seen.

      We also were intrigued by the slightly different sizes and widths of cells in the EM images. However, our statistical analysis did not reveal significant differences between the different samples. We now comment on this (page 53, lines 1178-1179).

      As a follow-up to this study, it would be interesting to assess the impact of MotR and FliX regulation of ribosomal protein synthesis on overall ribosome activity (e.g., via Ribo-seq), also considering that antitermination regulates rRNA transcription. In the case of MotR, the authors suggest that MotR upregulation of S10 protein might not only impact antitermination, but also lead to the formation of more active ribosomes that would increase flagellar protein synthesis (lines 359-362). However, in the RNA-seq performed in OE MotR* several transcripts encoding rRNA and ribosomal proteins are significantly downregulated compared to EVC (Supplementary Table S2). Could the authors comment on this?

      We share the reviewer’s enthusiasm for follow-up work and thank for the suggested experiments. We hope we will be able to decipher the full mechanism of MotR and FliX action on ribosomal protein synthesis in future experiments. The observation that some ribosomal protein-coding gene levels are reduced in the RNA-seq experiment with overexpression of MotR* is interesting but we do not have an explanation other than the fact that the samples were collected early in exponential growth. We now mention the observation in the text (page 19, lines 404-407).

      Considering that OE of the WT MotR appears to increase fliC mRNA abundance but has no strong impact on flagellin protein levels, can the authors speculate what is the physiological relevance of MotR* for flagellin production?

      We agree that while we do see significant increases in the flagella number and fliC mRNA abundance with MotR and MotR* overexpression, the western analysis did not reveal a striking increase in flagellin levels and also wonder how MotR strongly increases the flagella number, which requires flagellin subunits, but only has a weak effect on the intercellular levels of flagellin. One possibility explanation is that it is more difficult to see significant increases for a protein whose levels are high to begin with. These points are now discussed (page 13, lines 264-269).

      Fig. 4C: The pZE samples seem to show variable expression of fliC mRNA although the samples are collected at the same timepoints. Try to clarify in the text.

      The northern membrane on the bottom was exposed for a longer time due to the lower fliC mRNA levels in the samples with FliX overexpression. We now note these differences in the legends to Figure 4 and Figure 4—figure supplement 1.

      Fig. 7/S13: While a volcano plot for MotR is shown in Fig. 7A, quantification of GFP reporter fusion regulation is shown for MotR. Quantifications of MotR are shown in Fig. S13. Maybe swap the figures.

      Given that the data for MotR are in the supplement figures for all other figures we would also like to retain this distribution for Figure 7 (aside from the volcano plot since this experiment was only carried out for MotR).

      Lines 135-136 (Fig. S1B): on the northern blots, only sRNA levels of MotR are comparable between rich and minimal media (excluding M63 G6P and M63 gal). Most other sRNA seem to be more abundantly expressed in minimal media conditions compared to LB. Maybe rephrase.

      As suggested, the text was revised to point out the differences in the sRNA levels for cells grown in different growth media (page 7, lines 140-144).

      Lines 229-234: this paragraph seems not directly connected to the aims of the study (i.e., no effect on motility tested of these other sRNAs) and could be removed (or moved to discussion).

      We appreciate the reviewer’s suggestion but, considering Reviewer 1’s comments, think that showing the regulation of lrhA by other sRNAs has value in highlighting the complexity of the regulatory circuit. We have revised the text to incorporate Reviewer 1’s suggestions and better explain why these results are intriguing (page 12, lines 247-250).

      Line 200 and Fig. S5: For FlgO sRNA only one target was identified in RIL-seq. This gene could be specified and labeled in Fig. S5 and the text. Does FlgO also bind ProQ?

      We now mention the single FlgO target (gatC) detected in four datasets (page 10, lines 213215). In Figure 3—figure supplement 1, we labeled only targets that we followed up with in the current study. Therefore, to be consistent, we prefer not to label gatC in the FlgO plot. FlgO was found to co-immunoprecipitate with ProQ but at much lower levels than with Hfq, and to have very few RNA partners (Melamed et al., 2020).

      Lines 493-498: It is mentioned that the four sRNAs were also detected in recent RIL-seq experiments of Salmonella and EPEC. Are any of the here identified targets also found in other species or was none detected as analyses were carried out under conditions that do not favor flagella expression?

      The targets identified in this study were not detected in the Salmonella and EPEC RIL-seq datasets. However, the Salmonella and EPEC experiments were carried out under different growth conditions. Based on the sequence conservation of the Sigma 28-dependent sRNAs across several bacterial species (Figure 8—figure supplement 2), we do think overlapping targets will be found in other bacterial species under the appropriate growth conditions.

      The strongest evidence of MotR dependent target regulation is the one on rpsJ, which does not necessarily require the additional experiments with MotR. Since the authors were able to show upregulation of the rpsJ-gfp reporter upon OE of MotR WT, it would have strengthened the results if they performed the experiments in Fig. S8C with MotR WT. Similary as an increase of flagella number was seen with OE of MotR WT in Fig. 2A, the effect of the OE S10∆loop could be compared to OE MotR instead of OE MotR (Fig. 6A). At least if would be helpful, to briefly comment on why MotR* was used instead of MotR WT for these experiments.

      As suggested, we state MotR was used in some assays given the stronger effects for some phenotypes (page 10, lines 196-197). We think, given that we established MotR and MotR cause the same effects, with increased intensity for the latter, it is reasonable to use MotR* in some of the experiments.

      p. lines 482-491 and 508-511: The authors discuss that both UhpU sRNAs and RsaG sRNA from S. aureus are derived from the 3'UTR of uhpT, but conclude there is no overlap regarding flagella regulation, suggesting independent evolution of these sRNAs. However, the authors also mention that UhpU sRNA has many additional targets beyond LhrA involved in carbon and nutrient metabolism. Thus, maybe regulation of metabolic traits could be a conserved theme and function for UhpU and RsaG? Maybe try to comment on or better connect these two parts in the discussion.

      As suggested, we now comment on the possibility of the regulation of metabolic traits being a conserved theme and function for UhpU and RsaG (page 24, lines 520-527).

      Check the text for consistency regarding the use of italics for gene names (e.g., legend of Figs. 7 and 8)

      The text was corrected.

      Please introduce abbreviations, e.g., G6P (line 139), REP (line 150), ARN (line 258), NOR/U (Table S1 legend)

      As suggested, we now introduce the abbreviations for G6P (page 7, line 142), REP (page 8, lines 155-156), and NOR (Supplementary file 1 legend). Regarding ARN, these sequences are already written in parentheses in the same sentence. However, we revised this to “ARN motif sequences” (page 13, line 278).

      Fig. S1A: Highlight REP sequence mentioned in text (line 150).

      REP sequences are now highlighted in gray in Figure 1—figure supplement 1A.

      Fig. S1C: It would be helpful to list number nt positions on the sRNAs based on full-length transcripts.

      The corresponding positions based on the full-length transcripts have also been added to this figure.

      Fig. S2: Adjust the position of UhpU-S label.

      UhpU-S label position was adjusted.

      Fig. S6: Include UhpU in the figure title.

      UhpU was added to the title.

      Fig. S10: It would be helpful to indicate on the figure (or state more clearly in the legend) which RNA was extracted from WT or ΔfliCX background.

      The samples shown in the Figure are all in a WT strain. We corrected the figure legend accordingly.

      Line 290: the effect is on flagella number, not motility.

      This typo is now corrected (page 15, line 312).

      Fig. S8: One-way ANOVA (panel A legend)

      This typo is now corrected (page 64, line 1433).

      Line 320: Fig. S9C instead of 9C

      We thank the reviewer for noticing the typo. The numbering of the supplementary figures has now been changed to the eLife format.

      It would be helpful to add reference for statement in line 57.

      A reference to (Fitzgerald et al., 2014) was added as suggested.

      Add PMID:32133913 as reference for post-transcriptional regulation of the flagellar regulon in the introduction (lines 87-91)

      The indicated reference was added as suggested (page 5, lines 87-91).

      Legend Fig. S6: expand view -> expanded view

      This typo is now corrected (page 63, line 1406).

      line 513: sRNA -> sRNAs

      This typo is now corrected (page 25, line 549).

      Fig. 8G: Maybe include lrhA as target of UhpU sRNA at top of the cascade.

      As suggested lrhA has been added as a target of UhpU at the top of the cascade.

  3. Sep 2023
    1. Author Response

      Reviewer #1 (Public Review):

      Like the "preceding" co-submitted paper, this is again a very strong and interesting paper in which the authors address a question that is raised by the finding in their co-submitted paper - how does one factor induce two different fates. The authors provide an extremely satisfying answer - only one subset of the cells neighbors a source of signaling cells that trigger that subset to adopt a specific fate. The signal here is Delta and the read-out is Notch, whose intracellular domain, in conjunction with, presumably, SuH cooperates with Bsh to distinguish L4 from L5 fate (L5 is not neighbored by signal-providing cells). Like the back-to-back paper, the data is rigorous, well-presented and presents important conclusions. There's a wealth of data on the different functions of Notch (with and without Bsh). All very satisfying.

      Thanks!

      I have again one suggestion that the authors may want to consider discussing. I'm wondering whether the open chromatin that the author convincingly measure is the CAUSE or the CONSEQUENCE of Bsh being able to activate L4 target genes. What I mean by this is that currently the authors seem to be focused on a somewhat sequential model where Notch signaling opens chromatin and this then enables Bsh to activate a specific set of target genes. But isn't it equally possible that the combined activity of Bsh/Notch(intra)/SuH opens chromatin? That's not a semantic/minor difference, it's a fundamentally different mechanism, I would think. This mechanism also solves the conundrum of specificity - how does Notch know which genes to "open" up? It would seem more intuitive to me to think that it's working together with Bsh to open up chromatin, with chromatin accessibility than being a "mere" secondary consequence. If I'm not overlooking something fundamental here, there is actually also a way to distinguish between these models - test chromatin accessibility in a Bsh mutant. If the author's model is true, chromatin accessibility should be unchanged.

      I again finish by commending the authors for this terrific piece of work.

      Thanks! It is a crucial question whether Notch signaling regulates chromatin landscape independently of a primary HDTF. We will include this discussion in the text and pursue it in our next project. We think Notch signaling may regulate chromatin accessibility independently of a primary HDTF based on our observation: in larval ventral nerve cord, all motor neurons are NotchON neurons while all sensory neurons are NotchOFF neurons; NotchON neurons share similar functional properties, despite expressing distinct HDTFs, possibly due to the common chromatin landscape regulated by Notch signaling.

      Reviewer #2 (Public Review):

      Summary:

      In this work, the authors explore how Notch activity acts together with Bsh homeodomain transcription factors to establish L4 and L5 fates in the lamina of the visual system of Drosophila. They propose a model in which differential Notch activity generates different chromatin landscapes in presumptive L4 and L5, allowing the differential binding of the primary homeodomain TF Bsh (as described in the co-submitted paper), which in turn activates downstream genes specific to either neuronal type. The requirement of Notch for L4 vs. L5 fate is well supported, and complete transformation from one cell type into the other is observed when altering Notch activity. However, the role of Notch in creating differential chromatin landscapes is not directly demonstrated. It is only based on correlation, but it remains a plausible and intriguing hypothesis.

      Thanks for the positive feedback!

      Strengths:

      The authors are successful in characterizing the role of Notch to distinguish between L4 and L5 cell fates. They show that the Notch pathway is active in L4 but not in L5. They identify L1, the neuron adjacent to L4 as expressing the Delta ligand, therefore being the potential source for Notch activation in L4. Moreover, the manuscript shows molecular and morphological/connectivity transformations from one cell type into the other when Notch activity is manipulated.

      Thanks!

      Using DamID, the authors characterize the chromatin landscape of L4 and L5 neurons. They show that Bsh occupies distinct loci in each cell type. This supports their model that Bsh acts as a primary selector gene in L4/L5 that activates different target genes in L4 vs L5 based on the differential availability of open chromatin loci.

      Thanks!

      Overall, the manuscript presents an interesting example of how Notch activity cooperates with TF expression to generate diverging cell fates. Together with the accompanying paper, it helps thoroughly describe how lamina cell types L4 and L5 are specified and provides an interesting hypothesis for the role of Notch and Bsh in increasing neuronal diversity in the lamina during evolution.

      Thanks for the positive feedback on both manuscripts.

      Weaknesses:

      Differential Notch activity in L4 and L5:

      ● The manuscript focuses its attention on describing Notch activity in L4 vs L5 neurons. However, from the data presented, it is very likely that the pool of progenitors (LPCs) is already subdivided into at least two types of progenitors that will rise to L4 and L5, respectively. Evidence to support this is the activity of E(spl)-mɣ-GFP and the Dl puncta observed in the LPC region. Discussion should naturally follow that Notch-induced differences in L4/L5 might preexist L1-expressed Dl that affect newborn L4/L5. Therefore, the differences between L4 and L5 fates might be established earlier than discussed in the paper. The authors should acknowledge this possibility and discuss it in their model.

      We agree. Historically, LPCs are thought to be homogenous; our data suggests otherwise. We now emphasize this in the Discussion as requested. We are also investigating this question using single cell RNAseq on LPCs to look for molecular heterogeneities. Thanks for the great comment!

      ● The authors claim that Notch activation is caused by L1-expressed Delta. However, they use an LPC driver to knock down Dl. Dl-KD should be performed exclusively in L1, and the fate of L4 should be assessed.

      Dl is transiently expressed in newborn L1 neurons. To knock down Dl in L1, we need to express Dl-RNAi before Dl protein is expressed in newborn L1; the only known Gal4 line expressed that early is the LPC-Gal4 that we used. There is no L1-gal4 line expressed early enough to eliminate L1 expression of Dl.

      ● To test whether L4 neurons are derived from NotchON LPCs, I suggest performing MARCM clones in early pupa with an E(spl)-mɣ-GFP reporter.

      We agree! Whether L4 neurons are derived from NotchON LPCs is a great question. However, MARCM clones in early pupa with an E(spl)-mɣ-GFP reporter will not work because E(spl)-mɣ-GFP reporter is only expressed in LPCs but not lamina neurons. We now mention this in the Discussion.

      ● The expression of different Notch targets in LPCs and L4 neurons may be further explored. I suggest using different Notch-activity reporters (i.e., E(spl)-GFP reporters) to further characterize these. differences. What cause the switch in Notch target expression from LPCs to L4 neurons should be a topic of discussion.

      Thanks! It is a great question why Notch induces Espl-mɣ in LPCs but Hey in new-born neurons. However, it is not the question we are tackling in this paper and it will be a great direction to pursue in future. We will add this to our Discussion.

      Notch role in establishing L4 vs L5 fates:

      ● The authors describe that 27G05-Gal4 causes a partial Notch Gain of Function caused by its genomic location between Notch target genes. However, this is not further elaborated. The use of this driver is especially problematic when performing Notch KD, as many of the resulting neurons express Ap, and therefore have some features of L4 neurons. Therefore, Pdm3+/Ap+ cells should always be counted as intermediate L4/L5 fate (i.e., Fig3 E-J, Fig3-Sup2), irrespective of what the mechanistic explanation for Ap activation might be. It's not accurate to assume their L5 identity. In Fig4 intermediate-fate cells are correctly counted as such.

      Thanks for the comment! We will annotate Pdm3/Ap+ as L4/L5 fate in the corresponding figures.

      ● Lines 170-173: The temporal requirement for Notch activity in L5-to-L4 transformation is not clearly delineated. In Fig4-figure supplement 1D-E, it is not stated if the shift to 29{degree sign}C is performed as in Fig4-figure supplement 1A-C.

      Thank you for catching this. We will correct it in the text.

      ● Additionally, using the same approach, it would be interesting to explore the window of competence for Notch-induced L5-to-L4 transformation: at which point in L5 maturation can fate no longer be changed by Notch GoF?

      Our data show that Bsh with Notch signaling in newborn neurons specifies L4 fate while Bsh without Notch signaling in newborn neurons specifies L5 fate. Therefore, we think the window of fate competence is during newborn neurons. We will include the data to support this.

      L4-to-L3 conversion in the absence of Bsh

      ● Although interesting, the L4-to-L3 conversion in the absence of Bsh is never shown to be dependent on Notch activity. Importantly, L3 NotchON status is assumed based on their position next to Dl-expressing L1, but it is not empirically tested. Perhaps screening Notch target reporter expression in the lamina, as suggested above, could inform this issue.

      Our data show that the L4-to-L3 conversion in the absence of Bsh and in the presence of Notch activity while the L5-to-L1 conversion in the absence of Bsh and in the absence of Notch activity. Therefore, Notch activity is necessary for the L4-to-L3 conversion. Unfortunately, currently we only have Hey as an available Notch target reporter in new-born neurons. To tackle this challenge in the future, we will profile the genome-binding targets of endogenous Notch in newborn neurons. This will identify novel genes as Notch signaling reporters in neurons for the field.

      ● Otherwise, the analysis of Bsh Loss of Function in L4 might be better suited to be included in the accompanying manuscript that specifically deals with the role of Bsh as a selector gene for L4 and L5.

      That is an interesting suggestion, but without knowing that Bsh + Notch = L4 identity the experiment would be hard to interpret. Note that we took advantage of Notch signaling to trace the cell fate in the absence of Bsh and found the L4-to-L3 conversion (see Figure 5G-K).

      Different chromatin landscape in L4 and L5 neurons

      ● A major concern is that, although L4 and L5 neurons are shown to present different chromatin landscapes (as expected for different neuronal types), it is not demonstrated that this is caused by Notch activity. The paper proves unambiguously that Notch activity, in concert with Bsh, causes the fate choice between L4 and L5. However, that this is caused by Notch creating a differential chromatin landscape is based only in correlation. (NotchON cells having a different profile than NotchOFF). Although the authors are careful not to claim that differential chromatin opening is caused directly by Notch, this is heavily suggested throughout the text and must be toned down.e.g.: Line 294: "With Notch signaling, L4 neurons generate distinct open chromatin landscape" and Line 298: "Our findings propose a model that the unique combination of HDTF and open chromatin landscape (e.g. by Notch signaling)" . These claims are not supported well enough, and alternative hypotheses should be provided in the discussion. An alternative hypothesis could be that LPCs are already specified towards L4 and L5 fates. In this context, different early Bsh targets in each cell type could play a pioneer role generating a differential chromatin landscape.

      We agree and appreciate the comment, it is well justified. We have toned down our comments and clearly state that this is a correlation that needs to be tested for a causal relationship. Thank you for requesting it!

      ● The correlation between open chromatin and Bsh loci with Differentially Expressed genes is much higher for L4 than L5. It is not clear why this is the case, and should be discussed further by the authors.

      We agree, and think in L5 neurons, the secondary HDTF Pdm3 also contributes to L5 specific gene transcription during synaptogenesis window, in addition to Bsh. We will include this in the text.

    1. Author Response

      Reviewer #1 (Public Review):

      In this very strong and interesting paper the authors present a convincing series of experiments that reveal molecular mechanism of neuronal cell type diversification in the nervous system of Drosophila. The authors show that a homeodomain transcription factor, Bsh, fulfills several critical functions - repressing an alternative fate and inducing downstream homeodomain transcription factors with whom Bsh may collaborate to induce L4 and L5 fates (the author's accompanying paper reveals how Bsh can induce two distinct fates). The authors make elegant use of powerful genetic tools and an arsenal of satisfying cell identity markers.

      Thanks!

      I believe that this is an important study because it provides some fundamental insights into the conservation of neuronal diversification programs. It is very satisfying to see that similar organizational principles apply in different organisms to generate cell type diversity. The authors should also be commended for contextualizing their work very well, giving a broad, scholarly background to the problem of neuronal cell type diversification.

      Thanks!

      My one suggestion for the authors is to perhaps address in the Discussion (or experimentally address if they wish) how they reconcile that Bsh is on the one hand: (a) continuously expressed in L4/L4, (b) binding directly to a cohort of terminal effectors that are also continuously expressed but then, on the other hand, is not required for their maintaining L4 fate? A few questions: Is Bsh only NOT required for maintaining Ap expression or is it also NOT required for maintaining other terminal markers of L4? The former could be easily explained - Bsh simply kicks of Ap, Ap then autoregulates, but Bsh and Ap then continuously activate terminal effector genes. The second scenario would require a little more complex mechanism: Bsh binding of targets (with Notch) may open chromatin, but then once that's done, Bsh is no longer needed and Ap alone can continue to express genes. I feel that the authors should be at least discussing this. The postmitotic Bsh removal experiment in which they only checked Ap and depression of other markers is a little unsatisfying without further discussion (or experiments, such as testing terminal L4 markers). I hasten to add that this comment does not take away from my overall appreciation for the depth and quality of the data and the importance of their conclusions.

      Great suggestions, we will discuss these two hypotheses as requested.

      Bsh initiates Ap expression in L4 neurons which then maintain Ap expression independently of Bsh expression, likely through Ap autoregulation. During the synaptogenesis window, Ap expression becomes independent from Bsh expression, but Bsh and Ap are both still required to activate the synapse recognition molecule DIP-beta. Additionally, Bsh also shows putative binding to other L4 identity genes, e.g., those required for neurotransmitter choice, and electrophysiological properties, suggesting Bsh may initiates L4 identity genes as a suite of genes. The mechanism of maintaining identity features (e.g., morphology, synaptic connectivity and functional properties) in the adult remains poorly understood. It is a great question whether primary HDTF Bsh maintains the expression of L4 identity genes in the adult. To test this, in our next project, we will specifically knock out Bsh in L4 neurons of the adult fly and examine the effect on L4 morphology, connectivity and function properties.

      Reviewer #2 (Public Review):

      Summary:

      In this paper, the authors explore the role of the Homeodomain Transcription Factor Bsh in the specification of Lamina neuronal types in the optic lobe of Drosophila. Using the framework of terminal selector genes and compelling data, they investigate whether the same factor that establishes early cell identity is responsible for the acquisition of terminal features of the neuron (i.e., cell connectivity and synaptogenesis).

      Thanks for the positive words!

      The authors convincingly describe the sequential expression and activity of Bsh, termed here as 'primary HDTF', and of Ap in L4 or Pdm3 in L5 as 'secondary HDTFs' during the specification of these two neurons. The study demonstrates the requirement of Bsh to activate either Ap and Pdm3, and therefore to generate the L4 and L5 fates. Moreover, the authors show that in the absence of Bsh, L4 and L5 fates are transformed into a L1 or L3-like fates.

      Thanks!

      Finally, the authors used DamID and Bsh:DamID to profile the open chromatin signature and the Bsh binding sites in L4 neurons at the synaptogenesis stage. This allows the identification of putative Bsh target genes in L4, many of which were also found to be upregulated in L4 in a previous single-cell transcriptomic analysis. Among these genes, the paper focuses on Dip-β, a known regulator of L4 connectivity. They demonstrate that both Bsh and Ap are required for Dip-β, forming a feed-forward loop. Indeed, the loss of Bsh causes abnormal L4 synaptogenesis and therefore defects in several visual behaviors. The authors also propose the intriguing hypothesis that the expression of Bsh expanded the diversity of Lamina neurons from a 3 cell-type state to the current 5 cell-type state in the optic lobe.

      Thanks for the excellent summary of our findings!

      Strengths:

      Overall, this work presents a beautiful practical example of the framework of terminal selectors: Bsh acts hierarchically with Ap or Pdm3 to establish the L4 or L5 cell fates and, at least in L4, participates in the expression of terminal features of the neuron (i.e., synaptogenesis through Dip-β regulation).

      Thanks!

      The hierarchical interactions among Bsh and the activation of Ap and Pdm3 expression in L4 and L5, respectively, are well established experimentally. Using different genetic drivers, the authors show a window of competence during L4 neuron specification during which Bsh activates Ap expression. Later, as the neuron matures, Ap becomes independent of Bsh. This allows the authors to propose a coherent and well-supported model in which Bsh acts as a 'primary' selector that activates the expression of L4-specific (Ap) and L5-specific (Pdm3) 'secondary' selector genes, that together establish neuronal fate.

      Thanks again!

      Importantly, the authors describe a striking cell fate change when Bsh is knocked down from L4/L5 progenitor cells. In such cases, L1 and L3 neurons are generated at the expense of L4 and L5. The paper demonstrates that Bsh in L4/L5 represses Zfh1, which in turn acts as the primary selector for L1/L3 fates. These results point to a model where the acquisition of Bsh during evolution might have provided the grounds for the generation of new cell types, L4 and L5, expanding lamina neuronal diversity for a more refined visual behaviors in flies. This is an intriguing and novel hypothesis that should be tested from an evo-devo standpoint, for instance by identifying a species when L4 and L5 do not exist and/or Bsh is not expressed in L neurons.

      Thanks for the appreciation of our findings!

      To gain insight into how Bsh regulates neuronal fate and terminal features, the authors have profiled the open chromatin landscape and Bsh binding sites in L4 neurons at mid-pupation using the DamID technique. The paper describes a number of genes that have Bsh binding peaks in their regulatory regions and that are differentially expressed in L4 neurons, based on available scRNAseq data. Although the manuscript does not explore this candidate list in depth, many of these genes belong to classes that might explain terminal features of L4 neurons, such as neurotransmitter identity, neuropeptides or cytoskeletal regulators. Interestingly, one of these upregulated genes with a Bsh peak is Dip-β, an immunoglobulin superfamily protein that has been described by previous work from the author's lab to be relevant to establish L4 proper connectivity. This work proves that Bsh and Ap work in a feed-forward loop to regulate Dip-β expression, and therefore to establish normal L4 synapses. Furthermore, Bsh loss of function in L4 causes impairs visual behaviors.

      Thanks for the excellent summary of our findings.

      Weaknesses:

      ● The last paragraph of the introduction is written using rhetorical questions and does not read well. I suggest rewriting it in a more conventional direct style to improve readability.

      We agree, and will update the text as suggested.

      ● A significant concern is the way in which information is conveyed in the Figures. Throughout the paper, understanding of the experimental results is hindered by the lack of information in the Figure headers. Specifically, the genetic driver used for each panel should be adequately noted, together with the age of the brain and the experimental condition. For example, R27G05-Gal4 drives early expression in LPCs and L4/L5, while the 31C06-AD, 34G07-DBD Split-Gal4 combination drives expression in older L4 neurons, and the use of one or the other to drive Bsh-KD has dramatic differences in Ap expression. The indication of the driver used in each panel will facilitate the reader's grasp of the experimental results.

      We agree, and will update the figure annotation.

      ● Bsh role in L4/L5 cell fate:

      o It is not clear whether Tll+/Bsh+ LPCs are the precursors of L4/L5. Morphologically, these cells sit very close to L5, but are much more distant from L4.

      Our current data show L4 and L5 neurons are generated by different LPCs. However, currently we don’t have tools to demonstrate which subset of LPCs generate which lamina neuron type. We are currently working on a followup manuscript on LPC heterogeneity, but those experiments have just barely been started.

      o Somatic CRISPR knockout of Bsh seems to have a weaker phenotype than the knockdown using RNAi. However, in several experiments down the line, the authors use CRISPR-KO rather than RNAi to knock down Bsh activity: it should be explained why the authors made this decision. Alternatively, a null mutant could be used to consolidate the loss of function phenotype, although this is not strictly necessary given that the RNAi is highly efficient and almost completely abolishes Bsh protein.

      The reason we chose CRISPR-KO (L4-specific Gal4, uas-Cas9, and uas-Bsh-sgRNAs) is that it effectively removed Bsh expression from majority of L4 neurons. However, it failed to knock down Bsh in L4 neurons using L4-split Gal4 and Bsh-RNAi because L4-split Gal4 expression depends on Bsh. We will include this explanation in the text.

      o Line 102: Rephrase "R27G05-Gal4 is expressed in all LPCs and turned off in lamina neurons" to "is turned off as lamina neurons mature", as it is kept on for a significant amount of time after the neurons have already been specified.

      Thanks; we will make that change.

      o Line 121: "(a) that all known lamina neuron markers become independent of Bsh regulation in neurons" is not an accurate statement, as the markers tested were not shown to be dependent on Bsh in the first place.

      Good point. We will rephrase it as “that all known lamina neuron markers are independent of Bsh regulation in neurons”.

      o Lines 129-134: Make explicit that the LPC-Gal4 was used in this experiment. This is especially important here, as these results are opposite to the Bsh Loss of Function in L4 neurons described in the previous section. This will help clarify the window of competence in which Bsh establishes L4/L5 neuronal identities through ap/pdm3 expression.

      Thanks! We will include Gal4 information in the text for every manipulation.

      ● DamID and Bsh binding profile:

      ○ Figure 5 - figure supplement 1C-E: The genotype of the Control in (C) has to be described within the panel. As it is, it can be confused with a wild type brain, when it is in fact a Bsh-KO mutant.

      Great point! Thank you for catching this and we will update it.

      ○ It Is not clear how L4-specific Differentially Expressed Genes were found. Are these genes DEG between Lamina neurons types, or are they upregulated genes with respect to all neuronal clusters? If the latter is the case, it could explain the discrepancy between scRNAseq DEGs and Bsh peaks in L4 neurons.

      We did not use “L4-specific Differentially Expressed Genes”. Instead, we used all genes that are significantly transcribed in L4 neurons (line 209-210).

      ● Dip-β regulation:

      ○ Line 234: It is not clear why CRISPR KO is used in this case, when Bsh-RNAi presents a stronger phenotype.

      As we explained it above, the reason we chose CRISPR-KO (L4-specific Gal4, uas-Cas9, and uas-Bsh-sgRNAs) is that it effectively removed Bsh expression from majority of L4 neurons. However, it failed to knock down Bsh in L4 neurons using L4-split Gal4 and Bsh-RNAi because L4-split Gal4 expression depends on Bsh. We’ll include this explanation in the text.

      ○ Figure 6N-R shows results using LPC-Gal4. It is not clear why this driver was used, as it makes a less accurate comparison with the other panels in the figure, which use L4-Split-Gal4. This discrepancy should be acknowledged and explained, or the experiment repeated with L4-Split-Gal4>Ap-RNAi.

      I think you mean 6J-M shows results using LPC-Gal4. We first tried L4-Split-Gal4>Ap-RNAi but it failed to knock down Ap because L4-Split-Gal4 expression depends on Ap. We will add this to the text.

      ○ Line 271: It is also possible that L4 activity is dispensable for motion detection and only L5 is required.

      Thanks! Work from Tuthill et al, 2013 showed that L5 is not required for any motion detection. We will include this citation in the text.

      ● Discussion: It is necessary to de-emphasize the relevance of HDTFs, or at least acknowledge that other, non-homeodomain TFs, can act as selector genes to determine neuronal identity. By restricting the discussion to HDTFs, it is not mentioned that other classes of TFs could follow the same Primary-Secondary selector activation logic.

      That is a great point, thank you! We will include this in the discussion.

    1. When we become more aware of the messages we are sending, we can monitor for nonverbal signals that are incongruent with other messages or may be perceived as such.

      My sister is so shy and she tends to aim her head to the ground to avoid eye contact. I think this makes her feel more comfortable but other people probably think she doesn't want to talk to them.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Point-by-point response to reviewers, including our plans for the revision:

      ­­­Review____er #1 (Evidence, reproducibility and clarity (Required)):

      * Summary: In this manuscript by the Sanson group, Lye and colleagues try to definitively answer the question of whether pulling forces from the ventral mesoderm have significant effects on convergent extension in the Drosophila germband (germband extension). While germband extension does occur in mutant embryos lacking mesoderm invagination, it has long been an open question in the field as to whether ventral pulling forces from the mesoderm have significant effects (positive or negative) on cell intercalation during germband extension. To definitely address this question, Lye and colleagues generated high-quality, directly comparable datasets from wild-type and twist mutant embryos, and then systematically assessed nearly all aspects of cell intercalation, myosin recruitment, and tissue elongation over time. They demonstrate that pulling forces from the ventral mesoderm have negligible impacts on the course of germband extension. While there are indeed some interesting differences between wild-type and twist embryos with respect to cell intercalation and myosin recruitment, such differences are relatively minor. They conclude that the events of germband extension neither require nor are strongly affected by external forces from the mesoderm. While this is largely a negative results paper, I believe that it should be published and that it will be an impactful paper within the field. Namely, it will settle once and for all the question of whether mesoderm invagination is required for optimal germband extension in the early Drosophila embryo, and it suggests that tissues are largely autonomous developmental units that are buffered from outside mechanical inputs.*

      • * *Major comments: *

      * It seems to me that the one obvious omission from this paper is a general measure of convergent extension over time. I think it would be useful to the reader to include some measure of change in tissue aspect ratio over time between wild-type and twist embryos. This could be included in Figure 5 or 6. *

      • *

      We are happy to include a graph with what we call “tissue strain rate”, which measures the deformation of the germ-band in the direction of extension (along AP) over time, and propose to add it as a panel in Supplementary Figure 6. Note that in our measures, the “tissue” strain rate is decomposed into contributions from two cell behaviors, the “cell intercalation” strain rate and the “cell shape” strain rate (Blanchard et al., 2009). “Tissue” and “cell shape” strain rate are directly measured, and “cell intercalation” strain rate is what remains when “cell shape” strain rate is removed from “tissue” strain rate. The “cell intercalation” strain rate calculated in that way is a “continuous” measure of cell intercalation, measuring the progressive shearing of cells during convergent extension. We also use a “discrete” measure of cell intercalation, which measures the number of cell neighbor exchanges, also called T1 swaps. We found that both “continuous” and “discrete” measures of cell intercalation are unchanged in twist mutant compared to wild-type embryos (Fig. 6F and 6E, respectively). In contrast, we find that the “cell shape” strain rate is increased in twist mutants (Fig. 5B and Fig. 5S1A). Consistent with this finding, the “tissue” strain rate is also increased in twist mutants (see graph below).

      Otherwise, I have no major comments on the experimental approach or the findings of this manuscript. It seems to me a straightforward and systematic approach for determining whether mesoderm invagination affects germband extension. I do have several minor comments that should be addressed prior to publication (below).

      *Minor comments: *

      *I understand why cells would initially stretch more along the DV axis in wild-type embryos compared with twist embryos, but why do cells become so much more stretched along the AP axis (and become smaller apically) after 10 minutes of GBE in wild type compared with twist (Figure 2C and E). *

      *I think this is an interesting and non-intuitive result that would warrant a bit of explanation/conjecture. *

      This is not what Fig. 2C and E show, and we realize now that our schematics on the graphs might have been confusing. We will work on those to improve their clarity (or remove them), and also review our text.

      Figure 2C shows how cells deform along DV (cell shape strain rate projected onto the DV axis). So the graph does not show that the cells are elongating in AP, as only the DV component of the strain rate is shown in this figure. In the wild type, the DV strain rate is positive (the cells are elongating in DV) at developmental times when the mesoderm invaginate (from about -10 minutes to until 7.5 minutes). The DV strain shows an acceleration until about 5 mins, then decelerates, crossing the x-axis to become negative at 7.5 minutes. From this timepoint and until the end of GBE, the DV strain rate is negative (the cells are contracting along DV). Mirroring the positive section of the curve, the DV contraction of the cells accelerate until about 12 mins and then slows down. The strong rate of DV contraction between 7.5 and 20 mins could in part be due to the endoderm invagination pulling in the orthogonal direction (AP) and helping the cells regaining a more isotropic shape. We could add a mention about this in the discussion.

      In Figure 2E, the rate of change in cell area follows a similar time course in the wild type, showing that the cells are increasing their areas until about 10 mins (positive values) and then reduce their areas again until the end of GBE (negative values). Note that the graph does not show raw (instantaneous) cell areas as suggested by the comment, but rather a rate of change.

      So in wild type, the cells get stretched by the invaginating mesoderm, and once the mesoderm is not pulling anymore, the cells appear to relax back. As there is no stretching in twist mutants, there is no equivalent relaxation of the cells along DV. Note that in twist, there is a milder increase in cell area in the first 15 mins of GBE (Fig. 2E). This could again be caused by the pull from endoderm invagination stretching the cells along AP, which, as we have shown before, increases both cell shape strain rates along AP and cell areas (Butler et al., 2009). So the pull from endoderm invagination (along AP) will have an impact on cell area rates of change and possibly also, indirectly, on DV cell shape strain rates, in both twist and wild type embryos, during most of GBE. Therefore cell area and DV cell shape strain rates are affected by more than one process during GBE. In this paper, we are focusing on the impact of mesoderm invagination, which happens around the start of GBE, so have focused our analysis of the graphs in the results section to this period, and the differences between wildtype and *twist. *

      *I don't understand how you are defining cell orientation in Figure 2G. How are you choosing the cell axis that you are then comparing with the body axis? Is it the long axis, or something more complicated than that? I think you should briefly provide this information in the results section. If it is included in the methods, I wasn't able to locate it. *

      Yes, it is the orientation of the long axis of the cell relative to the antero-posterior embryonic axis. We will clarify this in the text, in particular in the Methods, and also try improve our schematics.

      Figure 2: Since you have the space, it might help the reader if you simply wrote out "strain rate" for panels B, D, and F, rather that used the abbreviation "SR." Thank you for this suggestion, we will reduce use of abbreviations where space permits.

      *Please ensure that all axis labels are fully visible in the final figures. In several figures, the Y-axis labels were cut off (e.g., Fig 2I, 4A, 4D, 6B, 6C). *

      These were visible to us in our submitted version, but of course we will ensure everything is visible on the final version.

      *Where space permits, I would suggest using fewer abbreviations in axis labels to increase readability of the figures (e.g., in Figures 3H or 4D). *

      Thank you for this suggestion, will do.

      * In Figure 7, I would move the wild-type panels to the left and the twist panels to the right. I think it is more conventional to describe the normal wild-type scenarios first, and then contrast the mutant state.*

      Will do.

      To be consistent with the literature, "wildtype" should be hyphenated (wild-type) when used as an adjective, or two separate words (wild type) when used as a noun. Thank you, we will change this.

      Review*er #1 (Significance (Required)): *

      * Advance: The advances in this manuscript are largely methodological, but the experiments and analyses are quite rigorous and allow the authors to make strong conclusions concerning their hypotheses. Their findings are based on a high-quality collection of movies from control and twist mutant embryos expressing a cell membrane marker and knock-in GFP-tagged myosin. Importantly, I think the researchers were correct in choosing to analyze twist single-mutant embryos (as opposed to snail or twist, snail double-mutant embryos), as the overall embryo geometry of these mutants is fairly similar to wild-type embryos, allowing the researchers to directly compare cell behaviors and myosin dynamics during germband extension. This approach also allows them to avoid indirect effects on the germband due to a completely non-internalized mesoderm. *

      *

      Audience: The primary audience for this article will be basic science researchers working in the early Drosophila embryo who are interested in the interplay between the germband and neighboring tissues. Secondary audiences will include developmental biologists more broadly who are interested in biomechanical coupling (or in this case decoupling) of neighboring tissues. *

      *

      Describe your expertise: I have been a Drosophila developmental geneticist for over twenty years, and I have been working directly on Drosophila germband extension for over a decade. I have published numerous papers and reviews in this field, and I am very familiar with the genetic backgrounds and types of experimental analyses used in this manuscript. Therefore, I believe I am highly qualified to serve as a reviewer for this manuscript.*

      ­­

      Review____er #2 (Evidence, reproducibility and clarity (Required)):

      *

      In the present manuscript, Lye et al. describe a highly detailed quantification of cell shape changes during germband extension in Drosophila melanogaster early embryo. During this process, ectodermal tissue contracts along the dorso-ventral axis, simultaneously expanding along the perpendicular antero-posterior direction, migrating from the ventral to the dorsal surface of the embryo as it extends. This important morphogenetic event is preceded by ventral furrow formation when mesodermal tissue (located in the ventral part of the embryo) contracts along the dorso-ventral axis and invaginates into the embryonic interior. The study compares cell shape dynamics in the wildtype Drosophila with that in the twist mutant, which largely lacks mesoderm and does not form ventral furrow. The major motivation of the study is to examine whether cellular behaviors and myosin recruitment in the ectoderm is cell autonomous, or if those cellular behaviors depend on mechanical interactions between mesoderm and ectoderm.*

      • The authors first examine whether transcriptional patterning of key genes involved in germband extension is different between the wildtype and the twist mutant and find no significant difference. Next, the authors thoroughly quantify cellular behaviors and patterns of myosin recruitment in the two genetic backgrounds. A number of different measures are investigated, notably the rate of change in the degree of cellular asymmetry, rate of cell area change, rate of change of cell orientation, differences in myosin recruitment to cell edges of various orientation, as well as the rates of growth, shrinkage, and re-orientation of the various cellular interfaces. It is thoroughly documented how these quantities change as a function of developmental timing and spatial position within the embryo. These data serve basis for quantitative comparison between cellular dynamics in the two genetic backgrounds considered.*

      • Overall, the study shows that cellular behaviors observed in the ectoderm are largely the same during the period of time following ventral furrow formation, as would be expected if those cellular behaviors were predominantly cell autonomous and not dependent on stresses generated in the mesoderm.*

      • The data presented in the manuscript are of excellent quality and presentation is very clear.

      Minor comments: none *

      * Reviewer #2 (Significance (Required)): *

      * I find that the study provides a thorough quantification of cell behaviors in a widely studied important model of morphogenesis. The work may be of particular interest for future model-to-data comparison, perhaps providing a basis for future modeling work. I therefore certainly think that this work warrants publication.*

      • However, the results of the study largely parallel previous findings and do not appear novel or surprising. It is well established that in snail mutant that lack mesoderm entirely, germband extension proceeds largely normally. This well-established fact suggests that since tissue dynamics in complete absence of mesoderm are largely unaffected, behaviors of individual cells are likely to not be affected either*.

      *The work is pretty much entirely observational, and for most part provides a more detailed documentation/quantification of previous findings. I do not think it is appropriate for high profile publication. *

      We are not sure which evidence the reviewer is referring to here specifically. We agree that the single mutants twist or snail, or the double twist snail mutants do extend their germ-band. However, the question we are asking here, is how well do they extend their germband and to answer this question, quantitation is needed. The first quantitation of GBE were performed by (Irvine and Wieschaus, 1994). While they quantified GBE in various mutant contexts, they did not perform quantitation for snail, twist, or twist snail mutants. Instead, they refer to these mutants once in p839, with the following sentence: Additionally, twist and snail mutant embryos, which lack mesoderm, extend their germbands almost normally (Leptin and Grunewald, 1990; Simpson, 1983)*.” *

      Following these earlier qualitative observations, various studies have quantified different aspects of GBE in mesoderm invagination mutants, with contradictory results. For example, some studies, including from our own lab, report a reduction in cell intercalation in the absence of mesoderm invagination (Butler et al., 2009; Wang et al., 2020), but there have also been reports that tissue extension and T1-transistions occur normally (Farrell et al., 2017)(see also introduction of our manuscript). These contradictory results have motivated our present study, and we have implemented rigorous comparison between wild type and mesoderm invagination mutants, being careful i) to check that the regions analyzed were comparable in terms of cell fate, and ii) to control for any confounding effects between experiments (see also response to reviewer 4, main question 2). We have also considered which mesoderm invagination mutants to use. We rejected snail or twist snail mutants because the absence of snail means that the mesodermal cells do not contract and thus stay at the surface of the embryo, which changes the spatial configuration of the embryo considerably and would make a fair quantitative comparison very difficult. Instead, we decided to use twist mutants, as in those, cell contractions still happen so the cells do not take as much space at the surface of the embryo, but the contractions are uncoordinated which means that there is no invagination (and we demonstrate here, no significant pulling on the ectoderm). We note that reviewer 1 highlights the merit of settling the question of the impact of mesoderm invagination on GBE and the pertinence of choosing twist mutants versus the alternatives (see also response to reviewer 4, suggestion 1).

      ­­

      __Review____er #3 (Evidence, reproducibility and clarity (Required)): __

      During morphogenesis, the final shape of the tissue is not only dictated by mechanical forces generated within the tissue but can also be impacted by mechanical contributions from surrounding tissues. The way and extent to which tissue deformation is influenced by tissue-extrinsic forces are not well understood. In this work, Lye et al. investigated the potential influence of Drosophila mesoderm invagination on germband extension (GBE), an epithelial convergent extension process occurring during gastrulation. Drosophila GBE is genetically controlled by the AP patterning system, which determines planar polarized enrichment of non-muscle myosin II along the DV-oriented adherens junctions. Myosin contractions drive shrinking of DV-oriented junctions into 4-way vertices, followed by formation of new, AP-oriented junctions. This process results in cell intercalation, which causes tissue convergence along the DV-axis and extension along the AP-axis. In addition, GBE is facilitated by tissue-extrinsic pulling forces produced by invagination of the posterior endoderm. Interestingly, some recent studies suggest that the invagination of the mesoderm, which occurs immediately prior to GBE, also facilitates GBE. In the proposed mechanism, invaginating mesoderm pulls on the germband tissue along the DV-axis; the resulting strain of the germband cells generates a mechanotransduction effect that promotes myosin II recruitment to the DV-oriented junctions, thereby facilitating cell intercalation. Here, the authors revisited this proposed mechanotransduction effect using quantitative live imaging approaches. By comparing the wildtype embryos with twist mutants that fail to undergo mesoderm invagination, the authors show that although the DV-oriented strain of the germband cells was greatly reduced in the absence of mesoderm pulling, this defect had a negligible impact on junctional myosin density, myosin planar polarity, the rate of junction shrinkage or the rate of cell intercalation during GBE. A mild increase in the rate of new junction extension and a slight defect in cell orientation were observed in twist mutants, but these differences did not cause obvious defects in cell intercalation. The authors conclude that myosin II-mediated cell intercalation during GBE is robust to the extrinsic mechanical forces generated by mesoderm pulling.

      • * *Overall, I found that the results described here are very interesting and of high quality. The data acquisition and analyses were elegantly performed, statistics were appropriately used, and the manuscript was clearly written. However, there are a few points where some further explanation or clarification is necessary, as detailed below: *

      • The main conclusion of the manuscript relies on appropriate quantification of myosin intensity at cell junctions. It is therefore important that the methods of quantification are well justified. Below are a few questions regarding the methods used in the analyses:*
      • -For myosin quantification, the authors state that "Background signal was subtracted by setting pixels of intensities up to 5 percentile set to zero for each timepoint" [Line826]. The rationale for selecting 5 percentile as the threshold for background should be explained. Also, how does this background value change over time? *

      • *

      For our normalization method, we stretched the intensity histogram of images to use the full dynamic range for quantification and enable meaningful comparison of intensities between different movies. The 5th percentile was chosen to set to zero intensity as this removed background signal without removing any structured Myosin signal (i.e., non-uniform, low level fluorescence - this was assessed by eye). We will provide some before and after normalization images at different timepoints to illustrate this (See reviewer 3, minor point 4 below). Since the cytoplasmic signal is uniform, it is difficult to discern from true ‘background’, therefore some cytoplasmic signal might be set to zero with this method, but all medial and junctional Myosin structures will still be visible and have none-zero intensity values. However, since cytoplasm takes up a large majority of pixels in the image, and we only set 5% of pixels to zero, the majority of the cytoplasm will have non-zero pixel values. ‘Background’ changes increases slightly as Myosin II levels increase in general over time, as expected from the embryo accumulating Myosin II as they develop.

      -The authors mention that "Intensities varied slightly between experiments due to differences in laser intensity and therefore histograms of pixel intensities were stretched" [Line828]. The method of intensity justification should be justified. For example, does this normalization result in similar cytoplasmic myosin intensity between control and twist mutant embryos?

      • *

      As stated above, we stretched the intensity histogram of images to enable meaningful comparison of intensities between different movies, as stretching the histograms would bring Myosin II structures of similar intensities into the same pixel value range. We chose to stretch histograms using a reference timepoint (30 minutes, the latest timepoint analyzed), rather than on a per timepoint basis, because we saw a general increase in Myosin II over time, and we wanted to ensure that this increase was preserved in our analysis.

      • *

      Note that we quantify Myosin from 2 µm above to 2 µm below the level of the adherens junctions (see Methods), not throughout the entire cell, and therefore we have no true measure of cytoplasmic Myosin. However, we can plot non-membrane Myosin from this same apicobasal position in the cell. Non-membrane Myosin will include both the cytoplasmic signal and the Myosin II medial web (see above). When plotting these, we find that Myosin II intensities in this pool are similar in wildtype and twist (see graph below, dotted lines show standard deviations), confirming that that we are not inappropriately brightening one set of images compared to the other (e.g., twist versus wildtype).

      Finally, our observations of rate of junction shrinkage and intercalation are consistent with our Myosin II quantification results (see Figures 4A, 4D and 6F). This further validates our methods.

      • *

      • *

      - A previous study demonstrates that the accumulation of junctional myosin is substantially reduced in twist mutant embryos compared to the wild type (Gustafson et al., 2022). In that work, junctional myosin was quantified as (I_junction - I_cytoplasm)/I_cytoplasm. In contrast, the cytoplasmic myosin intensity does not appear to be subtracted from the quantification in this study. How much of the difference in the conclusions of the two studies can be explained by this difference in myosin quantification?

              As explained above, we choose to normalize our data by stretching histograms, rather than subtracting and dividing intensities between different pools of Myosin. The setting pixels of intensities up to 5 percentiles set to zero for each will have a similar effect to subtracting a small fraction of the cytoplasmic pool. We note that the intensity measurements in (Gustafson et al., 2022) are in the apical-top 5µm of the cell, and therefore their ‘cytoplasmic’ signal is likely to also include the apical medial web of Myosin. Also, after subtraction they use division by the cytoplasmic intensity in an attempt to bring pixel intensities between different movies into a comparable range, whereas we do this by stretching the histograms themselves (see above).  We carefully designed our method to preserve the increase in Myosin levels that we see over time in our post-normalization data. This is something that their method of normalization would not be predicted to capture, if their ‘cytoplasmic’ signal increase over time as well as their junctional signal.  Indeed, in FigS6D of their paper, Myosin II levels do not appear to increase over time in these (presumably normalized) images.
      

      Additionally, we note that in (Gustafson et al., 2022), not all Myosin II is fluorescently tagged since they use a sqhGFP transgene located on the balancer chromosome. This means that the line they use will have a pool of exogeneous Myosin tagged with GFP (expressed from the CyO balancer) and a pool of endogenous Myosin (expressed from the sqh gene on the X chromosome. It is not known whether endogenous and exogeneous GFP-tagged Myosin II will be recruited equally to cell junctions when in competition with each other. Therefore, in their genetic background, the ratio of junctional/cytoplasmic sqhGFP might not reflect the true ratio. To avoid this potential caveat, in our study we have used a new knock-in of Myosin, which tags the sqh gene at the endogenous locus (Proag et al., 2019). The line is homozygous viable and thus all the molecules of Myosin II Regulatory Light Chain (encoded by sqh), and thus the Myosin II mini-filaments, are labelled with GFP.

      Additionally, we note that when comparing their images of Myosin II in wildtype and twist (Figure 5D and D’), the overall Myosin signal appears reduced in twist mutants (including in the head and posterior midgut, which is outside the area that they are claiming Myosin II is recruited in response to mesoderm invagination). This suggests that Myosin II is generally reduced in their twist mutants (or images thereof), which is not expected and might indicate issues with their methods.

      Therefore differences in the methods may explain the discrepancies between studies. Importantly, we have quantified junctional shrinkage rates and intercalation, and our analysis of these rates is consistent with our Myosin II quantification results (see above).

      -The authors used the tissue flow data to register the myosin channel and the membrane channel, which were acquired at slightly different times. The accuracy of this channel registration should be demonstrated.

      As stated in our methods: “the channel registration was corrected post-acquisition in order that information on the position of interfaces in the Gap43 channel could be used to locate them in the Myosin channel. Therefore the local flow of cell centroids between successive pairs of time frames in the Gap43 channel is used to give each interface/vertex pixel a predicted flow between frames. A fraction of this flow is applied, equal to the Myosin II to Gap43 channel time offset, divided by the frame interval. Because cells deform as well as flow, the focal cell’s cell shape strain rate is also applied, in the same fractional manner as above.”

      The images in Figure 3C and C’ show the Myosin II, with quantified membrane Myosin superimposed on the image as a color-code. Images in Figure 3B and B’ show the (normalized) Myosin II. Comparison of these images demonstrates that the channel registration is accurate. We will add a reference to these images in the methods.

      • The authors show that cell intercalation is not influenced in twist mutant embryos. However, a previous study demonstrates that the speed of GBE is substantially reduced in twist mutants (Gustafson et al., 2022). It would be interesting to see whether a similar reduction in the speed of GBE was observed in this study. *

      We do not see a reduction in the speed of GBE as reported by (Gustafson et al., 2022), we will add “tissue strain rate” graphs to demonstrate this. On the contrary, we find a slight increase in the “tissue strain rate”, because there is a slight increase in the “cell shape strain rate” contributing to extension (while “cell intercalation strain rate” is unchanged). See also response to Reviewer 1 (major comment) .

      • It has been previously shown that contractions of medioapical myosin in germband cells also contribute to cell intercalation. The authors should explain why medioapical myosin was not included in the comparison between wildtype and twist mutant embryos. *

      • *

      Indeed, it has been shown that there is a flow of medial Myosin towards the junctions (Rauzi et al., 2010). However, and as described in that paper, this flow ‘feeds’ the enrichment of Myosin II at shrinking junctions, and thus the junctional Myosin II can be taken as a readout of polarized Myosin II behavior. Additionally, medial flows are more technically challenging to quantify, especially when quantification is required in a large number of cells as is the case for our study.

      Importantly, our junctional Myosin II and junctional shrinkage rate results are consistent with each other, therefore it is very unlikely that analyzing medial Myosin II would lead us to form a different conclusion. We will add a sentence to explain why we chose to quantify junctional, and not medial, Myosin II.

      *Minor points: *

      1. * Fig. 1-S1 panel C: the number of cyan cells changes non-monotonically. It first decreases from -10 min to 10 min, then increases from 10 min to 20 min. This is confusing since in theory the number of tracked cells should not increase over time if the cells are tracked from the beginning of the movie. *
      2. *

      The cyan cells highlight tracked mesodermal and mesectodermal cells, which are not included in the analysis. The low number of mesodermal cells highlighted at 10mins germband extension is because mesodermal and mesectodermal cells are not always tracked successfully at this time. Note that the legend includes a note that ‘”Unmarked cells are poorly tracked and excluded from the analysis”. Also see Methods: “Note on number of cells in movies, for notes on changes to the number of tracked ectodermal cells throughout the timecourse of the movies.”

      • Fig. 1-S2: the vnd band in panel A appears to be much narrower than in panel B. *

      • *

      These are fixed embryos, therefore this could be (at least partially) due to slight differences in exact developmental age of the embryo. Note that we wanted to check that vnd and ind are expressed in the correct places in the ectoderm. We were motivated to check this because the width of mesoderm is reduced in twist, so we thought it was important to verify that there is not a population of ‘ectodermal’ cells with a strange fate (i.e., negative for both vnd and ind). Our experiments show that vnd abuts the mesoderm/mesectoderm in twist as in wildtype, and that the cells immediately lateral to the vnd cell population express ind as expected.

      It is possible that there is a slight difference in the number of vnd cells in twist mutants compared to wildtype, but we see no differences in Myosin II bipolarity that would coincide with the vnd/ind boundary (Fig3-S1). Therefore, this would not change the interpretation of our results. Counting the number of rows of vnd cells prior to any cell intercalation (the number of rows will reduce as cells intercalate) would be technically challenging as the lateral border of vnd expression is hard to discern at this time due to lower levels of vnd expression laterally within the vnd expression domain.

      • The schematic in Fig. 2J suggests that at the onset of mesoderm pulling the germband cells have a uniform angle of rotation (towards bottom right). Is this the case?*

      • *

      No, this schematic is purely supposed to show that as cells stretch, they also reorient. Note that we will review our schematics in Fig. 2 to increase clarity (see response to reviewer 1, first minor comment).

      • The description of myosin intensity normalization in the Methods section is somewhat difficult to follow [Line 829 - 832]. It would be helpful if the authors can show one or two images before and after intensity normalization as examples. *

      We will add some examples of before and after normalization images to this section. We will also review the Methods to improve the text’s clarity.

      • Line 704: "Z-stacks for each channel were collected sequentially" - the step size in Z-axis should be reported. *

      Thank you for this, the step size was 1µm. We will add this information.

      • Fig. 4C: what are the thin, black lines in the image? *

      This image is a 2D representation of the Gap43Cherry signal at the level of the adherens junctions extracted for tracking, not a simple confocal z-slice. When viewing these representations, you can see lines showing borders between where information from different z-stacks was used for the tracking layer. Unfortunately, our software does not allow us to remove these lines, but they do not affect tracking, quantification etc.

      Reviewer #3 (Significance (Required)):

      While most previous work on tissue mechanics and morphogenesis focuses on tissue-intrinsic mechanical input, recent studies have started to emphasize the contribution of tissue-extrinsic forces. An important challenge in understanding the function of tissue-extrinsic forces lies in the difficulties in properly comparing the wild type and the mutant samples that disrupt extrinsic forces, in particular when cell fate specification is altered in the mutants. In this work, the authors addressed this challenge by employing a number of approaches to warrant a parallel comparison between genotypes, including examining the AP- and DV-patterning of the tissue, selecting sample regions with comparable cell fate for analysis, and carefully aligning the stage of the movies. With these approaches, the authors provide compelling evidence to support their main conclusions. By teasing apart the role of the intrinsic genetic program and the extrinsic tissue forces, the work provides important clarifications on the function of mesoderm pulling in GBE and adds new insights into this well-studied tissue morphogenetic process. This work should be of interest to the broad audience of epithelial morphogenesis, tissue mechanics and myosin mechanobiology.

      • *

      Review____er #4 (Evidence, reproducibility and clarity (Required)):

      *Lye and colleagues investigate the impact of tissue-tissue interactions on morphogenesis. Specifically, they ask how disrupting mesoderm internalization affects convergence and extension of the ectoderm (germband) in Drosophila embryos. Using twi mutants in which mesoderm invagination fails, the authors find that the invagination of the mesoderm deforms germband cells, but does not significantly contribute to patterning, cell alignment, myosin polarization and cell-cell contact disassembly (which drive germband convergence). The authors find modest effects of mesoderm invagination on new junction formation and orientation (which drive extension), but these changes do not have a significant effect on germband elongation. The authors conclude that germband extension is robust to external forces from the invagination of the mesoderm. *

      *MAIN 1. The authors clearly show that myosin density is not different in wild-type and twi mutant embryos, and subsequently argue that the pulling force from the mesoderm does not elicit a mechanosensitive response in early germband extension. But if the cell density is constant, doesn't that mean that the longer, DV-oriented interfaces in the wild type accumulate more total myosin than their shorter counterparts in twi mutants? Assuming that the total number of myosin molecules per cell is not greater in the wild type, wouldn't increased total myosin at the membrane suggest a response to the increased deformation? Certainly the cells are able to maintain the same cell density despite the pulling force from the mesoderm, so can the authors rule out a mechanosensing mechanism? *

      • *

      We do not rule out a mechanosensing mechanism. We agree the total Myosin at stretched interfaces is higher than at unstretched interfaces and proposed a homeostatic mechanism to maintain Myosin II density on the cortex upon rapid stretching (summarized in Fig. 7). Indeed it is possible that this mechanism could itself be due to mechanosensitive recruitment of Myosin II (though there are also other possibilities). We have tried to address this in our discussion (under “Mechanisms regulating Myosin II density at the cortex and consequences for cell intercalation” and “Restoration of DV cell length after being stretched by mesoderm invagination”), but we will amend the wording the make the possibility of mechanosensitive recruitment of Myosin II to maintain cortical density more explicit.

      *What happens to the Gap43mCherry signal? From Figure 2A, it seem to be diluted ventrally in the wild type as compared to twi mutants? Comparing myosin and Gap43 dynamics may shed light on whether myosin accumulates more or less than one would expect simply on the basis of having longer contacts. *

      We quantify the density of Myosin, rather than the total amount. Therefore, the length of the contact should not matter. The suggestion of comparing Myosin density to Gap43Cherry density is in principle a good one, as it would allow us to compare a protein which is not diluted as cell contact length increases (Myosin) to one which appears to be (Gap43). However, it is not essential for the conclusions that we make. However, in practice quantifying the Gap43Cherry signal would not be straightforward on our existing movies due to the imaging parameters used. We capture the Gap43Cherry channel (but not the Myosin channel) with a ‘spot noise reducer’ tuned on in the camera software, due to very occasional bright spot noise, which confuses the tracking software. Therefore, our Gap43Cherry signal is manipulated during acquisition and to quantify from these images would not be appropriate. Therefore, we would have to acquire, track and quantify some new movies, which is not possible within the timeframe of a revision.

      In summary, we think that we have sufficient evidence from our analysis that Myosin II is not diluted upon junctional stretching without comparing to quantification of Gap43Cherry, and the time investment required to quantify the Gap43Cherry would not be worthwhile as it would require more data to be acquired and processed.

      • The authors previously argued that mesoderm invagination was required for the fast phase of cell intercalation [Butler et al., 2009]. However, here the authors interpret that loss of twi does not significantly slow down interface contraction, but accelerates the elongation of junctions and cells along the AP axis, which overall would mean that mesoderm invagination is (slightly) detrimental for axis elongation. The discrepancy between their previous and current results should be discussed. *

      We are happy to add more information about these discrepancies in the discussion. In a nutshell, we think that these discrepancies arise from the challenges of comparing wildtype and twist mutant embryos relative to each other, and as a consequence we have made various improvements to our methods since (Butler et al., 2009). These improvements included using markers that would be expressed at the same levels in wildtype and twist embryos. Additionally, we did not use overexpressed cadherin-FPs (namely, the ubi-CadGFP transgene), which may have confounding effects, and we used a knock-in sqhGFP to ensure we could all Myosin II molecules were labelled by GFP. We also carefully controlled the temperature at which we acquired the movies, standardized the level at which to track cells and quantify Myosin between movies, as well as improving the accuracy of our image segmentation and cell type identification since our previous study (Butler et al., 2009). See also response to reviewer 2.

      • Related to the previous point, it is surprising that the differences shown in Figure 4A-B are not significant. This is particularly troubling when in Figure 5B the authors claim a significant difference in cell elongation rate, which is higher in twi mutants (but only in very short time intervals and actually switches sign at the end of germband extension). These are just two examples, but I think the analysis of significance on a per-time point basis is problematic. *

      *Have the authors considered analyzing their results as time series rather than comparing individual time points? Or perhaps integrating the different metrics over the duration of germband extension (e.g. using areas under the curve)? That way they would not have to arbitrarily decide if significant differences in a few time points should or not be interpreted as significant overall differences. *

      • *

      For graphs plotted against time of germband extension, we do not think it is appropriate to analyze as a time series rather than comparing individual time points, since different developmental events (such as mesoderm invagination) occur at different times. For graphs plotted against time to/from cell neighbor swap, these can also change over time (e.g., ctrd-ctrd orientation, Fig6D). Therefore we do not feel that it appropriate to run statistical analyses as a timeseries for these comparisons either. Statistically cut-offs are by their nature arbitrary. We have tried to highlight non-significant trends throughout the text (including for Fig4A&B), in addition to stating where we see significant differences to highlight where there may be minor (but not significant) differences.


      • While the number of cells analyzed is impressive, the number of embryos is relatively low, particularly for the wild type (only four embryos analyzed). If I understood correctly (if not, please clarify) the authors ran their statistics using cells and not embryos as their measurement unit. But I could not find any evidence that cells from the same embryo can be considered as independent measurements. This could be easily done by demonstrating that the variance of any of the measurements (e.g. elongation, area change rate, etc.) for cells in an embryo is comparable to that calculated when mixing cells from different embryos. *

      • *

      We do not simply use the number of cells as an n for our experiments. We use a mixed effects model for our statistics as previously (Butler et al., 2009; Finegan et al., 2019; Lye et al., 2015; Sharrock et al., 2022; Tetley et al., 2016). This estimates the P value associated with a fixed effect of differences between genotypes, allowing for random effects contributed by differences between embryos within a given genotype. We will make sure that this is clear in the Methods.

      MINOR 1. Figure 4D: the authors show no difference in the proportion of neighbor swaps per minute between wild-type and twi- mutant embryos. But how about the absolute number of neighbour swaps per minute? Does that change in twi mutants (and if so, why?).

      The number of interfaces involved in a T1 swap are expressed as a proportion of the total number of DV-oriented interfaces for all tracked ectodermal germband cells, to take account of differences in the number of tracked cells between different timepoints and different movies. Presenting the absolute number of swaps per minute could lead to misleading interpretations.

      • I was a bit confused about the reason why in Figure 4A the authors measure the rate of interface contraction in units of “proportion/min”, but in Figure 5A they measure interface elongation in units of “um/min”. Unless there is a good reason not to, these two metrics should be reported using the same units. Is there a difference in the rate of interface contraction when measured in absolute units (um/min)? *

      Thank you, we will amend so that both measures are expressed in the same units.

      • The discussion of previous work on cell deformation within the mesoderm (page 16, first paragraph) should probably include recent work from Adam Martin's lab (e.g. [Heer et al., 2017]; or [Denk-Lobnig et al., 2021]). *

      Thank you, and apologies for this oversight, we will add these references__.__

      SUGGESTIONS 1. While I appreciate the arguments that the authors provide to use twi mutants rather than sna mutants or twi sna double mutants, as the authors indicate, in twi mutants there is still contractility in the mesoderm (albeit not ratcheted). Therefore, it is possible that contractile pulses from the mesoderm in twi mutants could still facilitate cell alignment and polarization of myosin in the germband. Given the previous results from the Zallen lab using twi sna double mutants (see above) this is unlikely to be the case, but the findings in this manuscript would be significantly stronger if they included similar analysis in the double mutants.

      We had concerns about using sna or twi sna double mutants due to the large amount of space the un-internalized mesoderm takes up on the exterior of the embryo. This concern is also shared by reviewer 1 “Importantly, I think the researchers were correct in choosing to analyze twist single-mutant embryos (as opposed to snail or twist, snail double-mutant embryos), as the overall embryo geometry of these mutants is fairly similar to wild-type embryos, allowing the researchers to directly compare cell behaviors and myosin dynamics during germband extension. This approach also allows them to avoid indirect effects on the germband due to a completely non-internalized mesoderm.” * In addition to this concern, imaging of snail or twist snail* embryos by confocal imaging to include the ventral midline (which is required to define embryonic axes) is problematic as the un-constricted mesodermal cells occupy virtually all the field of view, leaving very few ectodermal cells to analyze.

      Whilst we acknowledge that there are some (un-ratcheted) contractions of mesodermal cells in twist mutants, we have clearly shown that there is no DV stretch and very little reorientation of cells. Therefore, any residual contractile activity in the mesodermal cells of twist mutants does not appear to have a mechanical impact on the ectoderm. We cannot exclude the possibility that there is some transmission of forces between contracting cells of the mesoderm and the ectoderm in twist mutants. However, our evidence suggests that the large tissue scale force that transmits to the ectoderm from the invaginating mesoderm is missing in twist mutants, and it was the effects of that force that we wished to investigate (See also response to reviewer 2).

      Review*er #4 (Significance (Required)): *

      *This is an interesting study, with careful quantitative analysis of cellular and subcellular dynamics. The results follow previous findings from Jennifer Zallen and the authors themselves. The Zallen lab showed that cell alignment, myosin polarization and germband extension are normal in sna twi mutants [Fernandez-Gonzalez et al., 2009], a result that the authors fail to cite. The results in the present manuscript are similar, but the analysis is much more in depth here, so the findings by Lye and colleagues certainly warrant publication. *

      We did not specifically cite this result from (Fernandez-Gonzalez et al., 2009), because the subject of their study is the formation of multicellular rosettes, not whether a pull from mesoderm affects Myosin II polarity and cell intercalation. The formation of multicellular rosettes occurs later in germband extension, and therefore these results are not directly relevant to our study. Additionally, their measures of alignment are defined as linkage to other approximately DV oriented interfaces, rather than directly measuring orientation compared to the embryonic axes as we do here, as a different question is being addressed. Specifically, the quoted sna twi experiment is interpreted as extrinsic forces from the mesoderm not being required for linkage of Myosin enriched DV-oriented interfaces together. Myosin II quantification is more rudimentary with edges being assigned as Myosin positive or Myosin negative, as opposed to quantifying the density of Myosin on each interface and we cannot see any comparison of Myosin II quantification between wildtype and twist embryos.­

      So, although the results are consistent with each other, they are not directly comparable due to methods used and we are happy that the reviewer acknowledges that our analysis is more in depth, which was necessary to address the specific questions that we investigate in our study.

              In general, there have been inconsistencies in results between previous studies, leading reviewer one to recognize that *“…it should be published and that it will be an impactful paper within the field. Namely, it will settle once and for all the question of whether mesoderm invagination is required for optimal germband extension in the early Drosophila embryo.”  *The high amount of conflicting information in the literature led us to not exhaustively describe individual findings, but we will ensure the results from the Zallen lab are appropriately cited.
      

      However, there are a number of experimental points that I think need to be addressed to solidify the manuscript, particularly in terms of statistical analysis.

      Please see more details above (main points 3 and 4) regarding specific concerns about experimental points and statistics. Additionally, we note that reviewer 3 states “statistics were appropriately used”, and our statistical methods are the same as we have used in previous studies comparing live imaging data (Butler et al., 2009; Finegan et al., 2019; Lye et al., 2015; Sharrock et al., 2022; Tetley et al., 2016).

      • *

      __REFERENCES

      __

      Blanchard, G. B., Kabla, A. J., Schultz, N. L., Butler, L. C., Sanson, B., Gorfinkiel, N., Mahadevan, L. and Adams, R. J. (2009). Tissue tectonics: morphogenetic strain rates, cell shape change and intercalation. Nat Methods 6, 458-464.

      Butler, L. C., Blanchard, G. B., Kabla, A. J., Lawrence, N. J., Welchman, D. P., Mahadevan, L., Adams, R. J. and Sanson, B. (2009). Cell shape changes indicate a role for extrinsic tensile forces in Drosophila germ-band extension. Nat Cell Biol 11, 859-864.

      Farrell, D. L., Weitz, O., Magnasco, M. O. and Zallen, J. A. (2017). SEGGA: a toolset for rapid automated analysis of epithelial cell polarity and dynamics. Development 144, 1725-1734.

      Fernandez-Gonzalez, R., Simoes Sde, M., Roper, J. C., Eaton, S. and Zallen, J. A. (2009). Myosin II dynamics are regulated by tension in intercalating cells. Dev Cell 17, 736-743.

      Finegan, T. M., Hervieux, N., Nestor-Bergmann, A., Fletcher, A. G., Blanchard, G. B. and Sanson, B. (2019). The tricellular vertex-specific adhesion molecule Sidekick facilitates polarised cell intercalation during Drosophila axis extension. PLoS Biol 17, e3000522.

      Gustafson, H. J., Claussen, N., De Renzis, S. and Streichan, S. J. (2022). Patterned mechanical feedback establishes a global myosin gradient. Nat Commun 13, 7050.

      Irvine, K. D. and Wieschaus, E. (1994). Cell intercalation during Drosophila germband extension and its regulation by pair-rule segmentation genes. Development 120, 827-841.

      Leptin, M. and Grunewald, B. (1990). Cell shape changes during gastrulation in Drosophila. Development 110, 73-84.

      Lye, C. M., Blanchard, G. B., Naylor, H. W., Muresan, L., Huisken, J., Adams, R. J. and Sanson, B. (2015). Mechanical Coupling between Endoderm Invagination and Axis Extension in Drosophila. PLoS Biol 13, e1002292.

      Proag, A., Monier, B. and Suzanne, M. (2019). Physical and functional cell-matrix uncoupling in a developing tissue under tension. Development 146.

      Rauzi, M., Lenne, P. F. and Lecuit, T. (2010). Planar polarized actomyosin contractile flows control epithelial junction remodelling. Nature 468, 1110-1114.

      Sharrock, T. E., Evans, J., Blanchard, G. B. and Sanson, B. (2022). Different temporal requirements for tartan and wingless in the formation of contractile interfaces at compartmental boundaries. Development 149.

      Simpson, P. (1983). Maternal-Zygotic Gene Interactions during Formation of the Dorsoventral Pattern in Drosophila Embryos. Genetics 105, 615-632.

      Tetley, R. J., Blanchard, G. B., Fletcher, A. G., Adams, R. J. and Sanson, B. (2016). Unipolar distributions of junctional Myosin II identify cell stripe boundaries that drive cell intercalation throughout Drosophila axis extension. Elife 5.

      Wang, X., Merkel, M., Sutter, L. B., Erdemci-Tandogan, G., Manning, M. L. and Kasza, K. E. (2020). Anisotropy links cell shapes to tissue flow during convergent extension. Proc Natl Acad Sci U S A 117, 13541-13551.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Thank you very much for the kind comments about our manuscript. We have improved the text to address all reviewers’ comments and suggestions. Additionally, we corrected and improved the supplementary tables.

      Reviewer #1 (Public Review):

      This paper provides new evidence on the relationship between genetic/chromosome divergence and capacity for asexual reproduction (via unreduced, clonal gametes) in hybrid males or females. Whereas previous studies have focussed just on the hybrid combinations that have yielded asexual lineages in nature, the authors take an experimental approach, analysing meiotic processes in F1 hybrids for combinations of species spanning different levels of divergence, whether or not they form asexual lineages in nature. As such, the findings here are a substantial advance towards understanding how new asexual lineages form.

      The quality of the work is high, the analyses are sound, and the authors sensibly link their observations to the speciation continuum. I should also add that the cytogenetic work here is just beautiful!

      A key finding is that the precondition for asexual reproduction - the formation of unreduced gametes - is not unusual among hybrid females, so that we have to consider other factors to explain the rarity of asexual species - a major unresolved issue in evolutionary biology. This work also highlights a previously overlooked effect of chromosome organisation on speciation.

      Thank you for the nice comments about our work as well as for appreciating our cytogenetics work and figures.

      Reviewer #2 (Public Review):

      The authors investigate the origin of asexual reproduction through hybridization between species. In loaches, diploid, polyploid, and asexual forms have been described in natural populations. The authors experimentally cross multiple species of loaches and conduct an impressively detailed characterization of gametogenesis using molecular cytogenetics to show that although meiosis arrests early in male hybrids, a subset of cells in females undergo endoreplication before meiosis, producing diploid eggs. This only occurred in hybrids of parental species that were of intermediate divergence. This work supports an expanding view of speciation where asexuality could emerge during a narrow evolutionary window where genomic divergence between species is not too high to cause hybrid inviability, but high enough to disrupt normal meiotic processes.

      Thank you.

      I enjoyed reading this study and I appreciate the amount of work it takes to conduct these types of cytogenetic experiments. But, my main concern with this study is I was left wondering if the sample sizes are large enough to get a sense how variable endoreplication is in these loach species. Most of the hybrids between species are the result of crosses between 1-2 families. Within males and females, meiocyte observations are limited to a handful of pachytene and diplotene stages. I think it would be helpful to be more transparent about the sample sizes in the main text.

      Thank you for raising this point. We have improved the Supplementary Tables S2 and S3 to clarify how many individuals we analyzed from each genetic family and added this information to the main text. In total we obtained 12 combinations with 19 F1 hybrid families. For the combination, C. elongatoides x C. taenia hybrids we obtained three families, for C. elongatoides x C. ohridana, C. elongatoides x C. tanaitica, C. elongatoides x C. bilineata and C. ohridana x C. bilineata, we obtained two families For the rest of the combinations of hybrids we obtained single family. From these families, 79 individuals were used for the analysis of the meiocites. Additionally, 24 parental individuals, males and females, were analysed. For the parental species, we analysed 852 cells, for hybrid males we investigated 244 cells, and 665 cells for hybrid females.

      Along these lines, the authors argue against the possibility that endoreplication may be predisposed to occur at a higher rate in some species (line 291). Instead, they suggest that endoreplication is a result of perturbing the cell cycle by combining the genomes of two different species. Their main argument is based on gonocyte counts from parental females in a previous reference. It is essential to include counts from the parents used in this study to make a clear comparison with the F1s.

      Thank you, we agree with your comment and included the observations of meiocytes from several parental species, i.e. C. elongatoides, C. taenia, C. pontica, C. tanaitica, and C. ohridana. Among 852 cells analyzed, we did not observe cells with duplicated genomes and abnormalities in chromosomal pairing. By contrast, among 665 pachytene cells of F1 hybrid females, we revealed altogether ~1% of endoreplicated ones. We tested these data by binomial GLM and found these differences to be significant, suggesting that sexuals, even if they may have some unnoticed duplication events, clearly have a significantly lower incidence of abnormal pachytene cells. We have now included this information in the main text.

      In the discussion (lines 320-333), the authors postulate the sex-specific clonality they observe could be a result of Haldane's rule. Given these fish do not have known sex chromosomes, I do not find this argument strong. Haldane's rule refers to the exposure of recessive incompatibilities with the sex chromosomes in the hybrid heterogametic sex. This effect would therefore be limited to degenerated sex chromosomes where much of the sequence content on the Y or W has been lost. These species may have homomorphic sex chromosomes, but if this is the case, they likely are not very degenerated. Instead, it seems more plausible that the sex-specific effect the authors observe is due to intrinsic differences of spermatogenesis and oogenesis. Is there any information about sex-specific differences in the fidelity of gametogenesis from other species that would support a higher likelihood of endoreplication?

      Thank you for this important question, however, we think it was a misunderstanding. We do not postulate that our observation conforms to Haldanes’ rule as, by contrast to this rule based on sex chromosomes, our previous publication demonstrated that whatever the gonadal sex differentiation is in our taxa, the ability to overcome sterility by asexual gametogenesis is always confined to female gonadal environment (or oogenesis in general), even in the transplanted spermatogonial cells (Tichopad et al. 2022). What we meant by our text is that our results do not fully conform to Haldane’s rule. We therefore reworded our text to rule out such a misconception.

      Nonetheless, we note that it has been demonstrated that Haldanes’ rule is also applicable to species with little differentiated sex chromosomes (e.g. Presgraves and Orr 1998) and that recessive incompatibilities are not the only explanation as faster male theory or faster X may also apply in such cases (Dufresnes et al. 2016). Therefore, we have kept our remarks about Haldane’s rule here. Moreover, for several parental species, we preliminary found the occurrence of an XY gonadal sex differentiation system, albeit these are unpublished and need further validation.

      The final thing I was left wondering about was this missing link between endoreplication and activating the embryonic development of the diploid egg. In these loach species, a sperm is required to activate egg development, but the sperm genome is discarded (line 100). What is the mechanism of this and how does it evolve concurrently during hybridization?

      Thank you for the comment. There have been many speculations about why gynogens actually need sperm to activate their egg development, but to our knowledge, no explanation has been validated to date. Interestingly, a recent theoretical model by Fyon et al. BiorXiv 2023 suggested that the ability of sperm exclusion may evolve separately from the ability to produce clonal eggs. Hence, this topic is complex and remains unresolved, and we feel that it is out of the scope of the present MS. We have slightly modified the text and added 2 refs., to address your suggestion.

      Reviewer #1 (Recommendations For The Authors):

      The paper is well prepared - though the resolution of Fig 1 on the pdf is rather poor.

      Thank you! We have now provided the high-resolution figures.

      Overall, I have few suggestions for improvements:

      Line 58. How does endoduplication itself "overcome accumulated incompatibilities" other than failure of synapsis? Perhaps by maintaining the F1 state, and so avoiding reduced fitness arising from recombination and disruption of coadapted gene combinations.

      We have added a sentence to the main text “Premeiotic genome endoreplication thus not only ensures clonal reproduction but also allows hybrids to overcome problems in chromosome pairing that would otherwise lead to their sterility 15,17.” that we hope sufficiently addresses this issue.

      Line 118 - please explain the AKD index here - as you have some in SI. Also please be clearer on how you measure genetic divergence as proportion of heterozygous SNPs - presumably this is via exon sequences from F1 females?

      Please note that we have explained the AKD index in the relevant part of the Methods section already. However, we have now also added a brief explanation to the Results section, as suggested. We apologize for imprecise description of the genetic divergence measurements. As described in the Methods section, this is not measured by heterozygosity (as we wrongly stated here), but as p-distance among sequences of coding regions between parental species.

      Lines 126 ff. It is unfortunate that the design of the crosses was not more balanced or extensive. Nonetheless, I do appreciate the effort involved here and think the results are solid as is.

      Thank you.

      Line 142. Please define PS and TB (and other acronyms) at first use.

      We have added the definition for all acronyms at the first use.

      Lines 192-193. What about EP and EN - as shown to have unreduced gametes in Fig. 2?

      Thank you for this question. Based on analyses of the diplotene stage, we showed that EP and EN hybrids produced diploid eggs. However, in pachytene, we did not find duplicated oocytes due to the rarity of endoreplication. Similarly, the low incidence of duplicated pachytene cells was observed in natural as well as F1-hybrids in loaches and reptiles (Newton et al., 2016, Dedukh et al., 2021, 2022).

      Lines 217-219. The observed correlation of chromosome divergence (AKD index) and numbers of bivalents in pachytene makes sense and is an important observation. Did this GLM simultaneously consider the effect of genetic divergence (as implied in methods)?

      Thank you for this comment. We originally tested separately the fit of two models, one with AKD and the other with SNP divergence. Since the AKD model significantly outperformed the SNP-based one, we focused our interpretation on the former. However, as you suggested, we now re-calculated the model taking into account the joint effects of both predictors in a single model and indeed, this model outperformed both single predictors. In conclusion, while AKD is still the strongest single predictor for the observed amounts of bivalents, the additional effect of genetic distance still significantly improves the model fit. We have now included this result into the main text.

      This finding does not alter our conclusions, it just suggests that the effect of chromosomal morphology is probably more complex, involving the role of more subtle sequence divergence or structural variants.

      Line 242. The Discussion is a great read - careful interpretation and a really interesting interpretation in context of the broader literature.

      Thank you for the appreciation. Your positive feedback and evaluation are highly motivating us to expand our work.

      Line 396. Some references from book chapters (18, 52) are incomplete. Please fix.

      We have now corrected these references accordingly.

      Reviewer #2 (Recommendations For The Authors):

      Transparency about meiocyte sample sizes: These counts are all in supplemental table 3. From this table, it is unclear if a majority of these meiocytes are from a single individual or from multiple males or females. Or, in the crosses where there are multiple families, are the meiocytes sampled from all families? I am trying to get a sense whether endoreplication and the fidelity of oogenesis could be influenced by genetic variants segregating within species. If the meiotcytes are only sampled from a single individual from a single cross, you may not see this variation. If this is the case, perhaps the correlation between genetic divergence and the formation of asexual clones may not be as strong. Additional replicates may not be feasible, but at a minimum I think it would be helpful to address whether endoreplication could or could not be variable and if the sample sizes are sufficient.

      Thank you for raising this point. We have improved the Supplementary table to clarify how many individuals we analyzed from each family and added this information to the main text. Unfortunately, additional replicates are not feasible due to the long generation time of the fish. We otherwise agree with your comment and included this point in the Discussion.

      Gonocyte counts from parental females: The authors say they "analysed hundreds of gonocytes of sexual females without a single incidence of genome endoreplication." I could not find a clear count in the references given. They note that the incidence of endoreplication was very low in pachytene cells in this study (0.7%).

      Thank you, we agree with your comment and included the observations of meiocytes from several parental species, i.e. C. elongatoides, C. taenia, C. pontica, C. tanaitica, and C. ohridana. Among 852 cells analyzed, we did not observe cells with duplicated genomes and abnormalities in chromosomal pairing. By contrast, among 665 pachytenic cells of F1 hybrid females, we revealed altogether ~1% of endoreplicated ones. We tested these data by binomial GLM and found these differences to be significant, suggesting that sexuals, even if they may have some unnoticed duplication events, clearly have significantly lower incidence. of abnormal pachytene cells. We have now included this information in the main text.

      They refer to supplemental table 4 (line 196), which does not exist in the supplement. The authors should report these numbers in the revised manuscript.

      Thank you for pointing this out. We have corrected the name of the supplementary table, it actually is supplementary table S3.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1:

      1) Utilization of known AhR ligands as controls will strengthen the interpretation of the conclusions.

      We agree with the reviewer that AhR ligands could be used as controls for delineating structure-activity relationships and cell context-specific effects. However, such studies are beyond the scope of the current manuscript. The AhR has many endogenous ligands, including several tryptophan derived metabolites, that have been shown to elicit different responses depending on the dose and cell type. Our unpublished data show that the expression of AhR target genes such as Cyp1a1, Cyyp2e1, and Tiparp were not modulated by I3A in RAW cells, which suggests that the observed effects may occur independent of the AhR.

      Reviewer #2:

      Specific comments:

      1) The title is misleading "Microbially-derived indole-3-actate" suggests that this article is about the production of I3A by the gut microbiota, in fact this is a dietary supplementation article. The title needs to reflect this fact.

      Our title reflects the natural source of I3A in mice. We used oral supplementation to study the effects of this metabolite. Per suggestion by the reviewer, we changed the title as follows: <br /> “Oral supplementation of gut microbial metabolite indole-3-acetate alleviates diet-induced steatosis and inflammation in mice”

      2). The description of the amount of I3A in the drinking water is not properly described. The actual concentration in the drinking water should be given.

      The concentration of I3A in drinking water was as follows: WD50 = 0.5mg/ml and WD100 = 1mg/ml. We added this information in the revised manuscript.

      3) The serum concentration data of I3A is critical data and should be moved in Figure 1.

      We have now included serum levels of I3A as part of Figure 1.

      4) The authors should have determined the actual concentration of indole-3-actetate in serum by running a standard curve of I3A during the LC-MS analysis. Also, recovery and matrix effects should be determined. Without this information their data will be difficult to compare to other studies.

      We agree with the reviewer that quantification of I3A in serum would be useful. However, we are unable to do so due to limited sample available as well as concerns with sample integrity after long-term storage.

      5) In the data in Figure S1C, there appears to be only 2-3 mice out of nine that exhibit a difference in serum indole-3-acetate levels between the WD-50 and WD-100. Do the authors have an explanation for this small difference compared to the other endpoints assessed?

      The serum I3A measurements at week 16 are a snapshot that may not reflect tissue levels due to differences in water intake, I3A metabolism in the body, and/or elimination of I3A. The other phenotypic assays are physiological measurements that reflect the result of sustained administration of I3A.

      6) Since the Ah receptor may play a role in the results obtained CYP1A1 mRNA levels in the liver and intestinal tract should have been measured.

      We measured alterations in Cyp1a1 mRNA in the liver and no significant change was observed in the WD50 and WD100 groups relative to controls. Also, see response to reviewer 1.

      7) The main mechanistic experiment performed is shown in Figure 6 and the figure legend states that they are examining macrophages, but these are cell lines, they are macrophages models, and this should be clearly stated. The first two panels are liver data, so the title of the figure legend needs to reflect that fact.

      We agree and have changed the title of Figure 6 to “I3A modulates AMPK phosphorylation and suppresses RAW 264.7 macrophage cell inflammation in an AMPK dependent manner”.

      8) In Figure 6, 1 mM I3A is added to the cells, how is this very high concentration relevant to the concentrations observed in vivo? Does adding 1 mM acetate to the cell culture media lower the pH of the media and could this influence the results obtained? Would acetic acid yield the same results? Could treatment with an acid even explain in vivo results?

      It is difficult to match the concentration of I3A in the in vitro experiments to liver tissue concentrations. Addition of 1 mM I3A did not lower the pH of cell culture media or reduce the viability of cultured RAW 264.7 macrophages. As I3A is not known to degrade into acetic acid and indole, we do not expect acetic acid to recapitulate the effects elicited by I3A.

      Reviewer #3:

      My primary concern with the manuscript is the organization and interpretation of the data. It appears that little effort was given by the authors on interpreting the data and digesting it for the reader into a coherent package. Rather, the authors have collected a vast amount of data and organized it without much thought about what the reader would take away from it. Furthermore, it seems the authors have taken this as an opportunity to overload this manuscript with data that are superfluous to the conclusions the authors draw at the end. Based on this, I think the authors need to invest more time into distilled their complex biological data into a unifying scientific interpretation for the readers that advances our understanding of I3A. My suggestions for the authors are described below.

      1) The data lack a rationale behind how they are organized within the manuscript. For example, the authors will combine disparate biological pathways and lump data together without logic as in Figure 2. Why are inflammatory pathways and bile acid synthesis combined in a figure? What was the rationale?

      We respectfully disagree that the data are presented without rationale. Both inflammation and bile acid dysregulation are commonly observed with NAFLD and thus are presented in two separate panels of Figure 2 (A, inflammatory cytokines, and B bile acids).

      2) The authors give very little effort to performing integrative omics analysis even though multi-omics is provided. Example given, the authors provide proteomic data on the fatty acid metabolism pathway, however, no mention of this pathway within the metabolomic dataset. Vice versa, the authors provide in depth investigation in the metabolic changes within the tryptophan pathway, however, no investigation into the proteomic changes that may underlie this phenomenon. It would be recommended that the authors invest more energy into performing more in-depth analysis of their multi-omics data presented.

      We attempted to co-analyze the proteomic and metabolomic data, but this analysis was not informative. Protein and metabolite abundances do not necessarily correlate, and the two types of omics data carry different observation biases. For example, label-free, untargeted proteomics data favor abundant proteins, whereas untargeted metabolomics data are influenced by concentration and ionization efficiency, among other factors. Therefore, we opted to analyze the two datasets independently, and then linked the findings from the two analyses using biological pathways as guides. For example, we describe changes in acyl-carnitine and discuss how this observation is consistent with changes in abundance of fatty acid metabolism enzymes.

      3) Figures 1&2 shows that low dose treatment reduces inflammation but does not alter hepatic TG levels. This is in direct disagreement with the graphical model provided by the authors (Supp. Fig 9). In the author's model, I3A is directing hepatic lipid metabolism through modulation of macrophage inflammation. This interpretation is erroneous and needs to be reevaluated by the authors. Furthermore, the tryptophan pathway and bile acid pathways are not even represented in the model, which begs the question of why that data are included in the manuscript to begin with.

      We would like to respectfully point out that Figure 1D does show a statistically significant (p < 0.05) difference in liver TG between the WD and WD100 groups. Supp. Figure S9 is meant to be a summary of the main biochemical changes elicited by I3A that we have shown in the current study (e.g., the involvement of AMPK) rather an atlas of all the changes detected in the metabolomics and proteomic data. Specifically, we have not included the tryptophan or bile acid pathways as we do not have mechanistic information on how these changes are mediated by I3A.

      4) The authors switch from hepatocytes to macrophages without giving any rationale, The authors need to invest more time into describing a logical flow of thought when assembling the manuscript.

      We mention the rationale for investigating the effect of I3A on macrophages in the introduction (last paragraph of the section): “In vitro, both I3A and TA attenuated the expression of inflammatory cytokines (Tnfα, Il-1β and Mcp-1) in macrophages exposed to palmitate and LPS.”. We also explain why we used an in vitro model, RAW cells, at the beginning of the corresponding Results section: “Since our previous study found that the metabolic effects of I3A in hepatocytes depend on the AhR, we tested if this was also the case in macrophages.” Moreover, the strong effects of I3A on liver inflammatory cytokines also motivates the macrophage experiments.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      1. General Statements

      We thank the editors for sending our manuscript for peer review and the reviewers for careful reading and their critical comments to improve the manuscript. Below, we describe the experiments that have been carried out in response to the reviewers and incorporated in the preliminary revision. We also describe our plan for the revisions that will address the remaining comments of the reviewers. Most of the comments are addressable with additional experiments (some of which are already ongoing) and these experiments will surely strengthen the study reported in this manuscript without affecting the fundamental findings. We would require up to 4-6 weeks to complete these experiments.

      2. Description of the planned revisions

      Insert here a point-by-point reply that explains what revisions, additional experimentations and analyses are planned to address the points raised by the referees.

      Reviewer #1 (Evidence, reproducibility and clarity (Required)):

      ­Summary: The authors used a conditional transgenic mouse model to demonstrate that deletion of serum response factor (SRF) from adult astrocytes provides neuroprotection in various insult/ diseases contexts without promoting any obvious phenotypic deficiencies. The work builds on the group’s previous study where SRF was embryonically deleted from astrocytes and their precursor cells. Given the role of SRF in promoting glial cell differentiation, the adult conditional KO used in the current study was designed to circumvent the limitations of the previous approach. The authors used a variety of complementary approaches (including immunohistochemistry, electrophysiology, transcriptomics, and behavior) to demonstrate the therapeutic potential of their approach. However, I have questions regarding the validity of the behavioral analyses as well as some of the imaging results that dampen my overall enthusiasm.

      Major Comment #1

      The synaptogenic factors probed in Figure 3C (e.g. glypicans, thrombospondins, etc.) are not likely to play major roles in the adult brain in a non-injury context, so I do not know that these analyses provide any significant insight into potential functional changes in the mutant mice. Along the same lines, the analysis of synapse count (Figure 3D-E) seems inconsequential given that SRF was knocked out well after the period of developmental synaptogenesis. It would have been much more interesting to have performed these analyses following insult (such as the kainate injury model used by the authors) or in one of the disease models presented later in the manuscript. As it stands, I don't think they add very much to the study.

      Response: We are grateful to the reviewer for the careful reading of the manuscript. Astrocytes are known to regulate the formation, maintenance, and elimination of synapses. It has been previously shown that LPS-induced reactive astrocytes exhibit reduced expression of several synaptogenic factors, were unable to promote synapse formation and showed reduced phagocytic activity (PMID: 28099414). We wanted to determine whether the SRF-deficient reactive-like astrocytes were likely compromised in their ability to produce pro-synaptogenic factors and/or adversely affect synapse maintenance. We agree with the reviewer that analysis of synapses in the adult brain may not address the role of these mutant astrocytes in synaptogenesis. But our results indicate that the mutant astrocytes are likely not affecting synapse maintenance or exhibit altered phagocytotic activity that would result in increased or decreased synapse numbers. We will make this clearer in the revised manuscript.

      Minor Comment #2:

      The authors should note that the use of GluA1 as a postsynaptic marker will not identify silent synapses (i.e. structurally "normal" but functionally inert).

      Response: We agree with the reviewer that GluA1 will not identify silent synapses. To study silent vs functional synapses, we will stain for Piccolo (presynaptic) and NMDA receptor NR1 subunit (post-synaptic) to label all synapses and compare this with Piccolo/GluA1 co-localized synapses to identify the functional synapses.

      Reviewer #2 (Significance (Required):

      The manuscript addresses the important area of the cellular mechanisms that underlie neuroprotection. The ms adds to our understanding of genetic control of neuroprotection and should be of significant interest to others in the field. The experimental approach systematic and the data presented are generally of high quality and believable. While the ms presents quite a bit of overall cellular data that underlies various areas of neuronal and brain function that may be affected by loss of SRF, it is still somewhat descriptive. It is unclear what aspect of astrocyte reactivity is determinative, how mechanistically in normal cells SRF suppresses reactivity, and how SRF -negative reactive astrocytes confer such broad neuroprotection. While the latter is well beyond the scope of this study, the authors do propose SRF may be involved in regulating oxidative stress and amyloid plaque clearance as a potential pathway to account for SRF's role, however a more systematic discussion based on the gene expression data and known pathways would be welcome. Overall, this is a high quality ms that should be of interest to the field that identifies a SRF as a novel player in neuroprotection.

      Response: We thank the reviewer for the careful reading of the manuscript and for the positive comments. We will include a more detailed discussion on the genes and pathways based on our gene expression data that may provide insights into how SRF may regulate astrocyte reactivity and neuroprotection.

      Additional considerations:

      1. Quantification of the extent of SRF loss in astrocytes in conditional tamoxifen knockout would strengthen the quality of the data.

      Response: We will provide this data in the revised manuscript.

      While the authos did use a Sholl analysis to show hypertophic changes in SRF negative astrocytes, given that SRF is an important regulator of actin and other cytoskeletal related proteins in other cell types, and that cytoskeletal components can play an important role in cell signaling, it is somewhat surprising that the gene array analysis did not include actin and other cytoskeletal proteins, nor did the authors consider a more careful analysis of intracellular cytoskeletal changes and the potential mechanistic implications of this for observed reactivity and neuroprotection.

      Response: We agree with the reviewer that SRF is a well-established regulator of actin cytoskeleton. However, we did not any significant changes in gene expression for actin or actin-regulatory proteins. We would have expected a decrease in astrocyte morphology similar to the neurite/axon defects exhibited by SRF-deficient neurons. It is unclear whether the hypertrophic morphology is due to transcriptional regulation of actin/actin-binding proteins or due to astrocyte reactivity. This would be a very interesting question and we will investigate these aspects in future studies.

      Reviewer #3 (Evidence, reproducibility and clarity (Required):

      Summary: The study by Thumu et al., suggests that astrocytic specific deletion of SRF in mice results in morphological changes in these cells that does not affect neuronal survival, synapse number, plasticity or cognition. However, in in vivo mouse models of excitotoxic damage and neurodegenerative disease, deletion of SRF reduced neurotoxicity. The authors provide sufficient evidence to suggest that astrocytic SRF contributes to neurotoxicity in various models however some claims are made that are currently not supported by evidence.

      Major comments:

      2) The authors claim that SRF KO astrocytes undergo hypertrophy. However, the quantification of the number of intersections gives information about morphology rather than hypertrophy. Quantification of cell size (area of S100B staining) should be provided.

      Response: We will provide the data suggested by the reviewer.

      6) For the RNAseq of isolated astrocytes did the authors confirm that other cell types (e.g microglia) did not contaminate their samples?

      Response: We will provide the information requested by the reviewer.

      Reviewer #3:

      Minor comments:

      1) The authors say that in Figure 1B many astrocytes did not show any SRF expression. However, overall averages of SRF intensity are plotted in Figure 1C. It would support their claim to instead to calculate the percentage of SRF expressing cells above a certain threshold in each condition, rather than plotting the mean intensity. As a control for their method of quantifying SRF intensity in Figure 1B, demonstrating no change in SRF in neurons would provide confidence for the specificity of the knockout.

      Response: We will provide the quantification of the extent of SRF loss in astrocytes (percent astrocytes that are deleted for SRF) as suggested by Reviewer 2. We will also provide SRF intensity from neurons as suggested by the reviewer.

      2) The authors use the term "reactivation" throughout the manuscript. This could be misconstrued as re-activation and so I would suggest using the terms "reactivity" or "reactive transformation". Furthermore, only one region is quantified in Figure 1C while in later figures multiple regions are quantified. The authors should justify this decision or update the figures with data from missing regions.

      Response: We will make this change in using the term “reactivity” as suggested by the reviewer.

      3) In Figure S2 the authors should provide a positive control for their staining.

      Response: We will provide the positive control data for this experiment.

      4) Can the authors explain the large amount of variability in number of synapses in 15 mpi in Figure 3E?

      Response: We will perform more immunostainings and update the data presented in this figure.

      5) Images in Figure 2C are poorly visible and should be improved in terms of either quality or magnification.

      Response: We will provide better quality image for Figure 2C.

      8) The authors should provide a list of differentially expressed genes from RNAseq of SRF KO mice. No information is currently given in the text about the number of differentially expressed genes in the conditional knockout.

      Response: We will include this information in the revised manuscript.

      9) In figure 5A data would be better illustrated as a volcano plot (similar to Fig. S7C).

      Response: We will provide this in the revised manuscript.

      3. Description of the revisions that have already been incorporated in the transferred manuscript

      Please insert a point-by-point reply describing the revisions that were already carried out and included in the transferred manuscript. If no revisions have been carried out yet, please leave this section empty.

      Reviewer #1: Major Comment #2

      There is considerable variability in the behavioral results, particularly the fear conditioning and Barnes maze tasks (Figures 4F-G). Given the extremely low sample size for mouse behavior (n=5 in on group, n=7 in the other), it is highly likely that the behavioral tests were done with a single cohort of animals (which would be far from ideal) and that these experiments are significantly underpowered. Furthermore, it does not appear that the fear conditioning task was properly optimized. For example, in the control mice in context A, there were two animals that were at or very close to 0 percent freezing; these were likely outliers, or even an indication that the foot shock conditioning protocol was not working as it should. The highest percent freezing of either group was ~70%, which would have been an ideal starting place as an average for the control group. In addition, sex of the animals was not reported for these experiments. If the authors combined sexes as they did in other analyses in this paper, it is possible that they missed reaching the appropriate reaction threshold for the foot shock for some of the animals, as sex differences have previously been demonstrated in mice (DOI: 10.1037/bne0000248). Given the age at which the animals are assessed with these tasks, these specific revisions would require greater than 6 months to complete. However, as currently presented, there simply are not enough data points to make any conclusions regarding behavior.

      Response: We have performed the behavioural experiments with an additional cohort of animals for both control and mutant groups and reanalysed the data. We now have n=11 for control and n=9 for mutant group. Only males were used for the behaviour experiments, and we do not see any significant difference in behaviour between the two groups. These results are included in revised Figure 4E-G in the Preliminary Revision of the manuscript. However, we are waiting to perform the remote recall memory for the fear conditioning experiment and will include this date in the revised manuscript.

      Minor Comment #1:

      The representative GFAP images (Figure 1 E/G) do not appear to have been taken at the same magnification. This was particularly apparent in the comparison between the control and CKO hippocampus at 12mpi. It is difficult to say with certainty, due to the lack of fiducial markers in many of the images. Inclusion of a nuclear stain (DAPI) would be highly beneficial to allow the reader to make a more informed comparison.

      Response: These images were taken at the same magnification. We have included the DAPI staining for these images in Suppl. Figure 2 in the Preliminary Revision of the manuscript.

      **Referees cross-commenting**

      After reading the comments of the other reviewer, I think we're in agreement that the cellular and molecular data, while descriptive, is of mostly excellent quality. Moreover, the significance of the study is high, and the potential readership broad. However, I stand by my initial assessment of the behavioral data and find the manuscript quite lacking in this regard. Proper revisions would take at least half a year or more, so the authors may be disinclined to go this route. That being said, if the behavioral data were to be excised, I would be happy to sign off on the rest of the manuscript provided that the other major criticisms are addressed.

      Response: We thank the reviewer for the appreciation of our work. We have increased the number of animals in the behavioural experiments and do not see any significant difference between the two groups. These results are included in revised Figure 4E-G in the Preliminary Revision of the manuscript.

      In response cross-comment of Rev 2:

      Agreed that if properly conducted and presented, the behavioral data would indeed provide a nice functional correlate to the cellular work. In its current state, I'm afraid that it is instead a hindrance to the study and I would recommend that they just remove it if they choose not to address my concerns with the quality (particularly the extreme variability and the complete lack of freezing by several of the animals, especially in the controls).

      Response: We hope that the revised behaviour data would provide a strong functional correlate to the other findings in the study.

      Additional cross-comments:

      I agree with the added criticisms raised by Reviewer #3, and I think that the manuscript would be greatly improved by revisions that address those and the original criticisms from myself and Reviewer #2. I still think that the behavioral data should be omitted, provided that the authors are not capable or willing to appropriately address those concerns within a reasonable time frame.

      Response: We will address all the concerns raised by the reviewers with the required experiments to further strengthen the findings in this study.

      Reviewer #3

      Major Comment

      3) In Figure S1 the authors provide evidence showing lack of B-gal in cell types other than astrocytes (neurons/OPCs). However, microglia are missing, which could be important as later they show that microglia undergo changes in the SRF knockout model. This staining should be provided.

      Response: We have performed double immunostaining for b-gal and IbaI and do not see any overlap between IbaI and b-gal, suggesting that there is no Cre expression in microglia. We have included this data in revised Figure S1F in the Preliminary Revision of the manuscript.

      5) The authors claim in the text that microglia have thicker processes and an amoeboid shape however no evidence of this is provided in Figure S5.

      Response: We have provided data to show larger microglia area and morphology in revised Figure S5 in the Preliminary Revision of the manuscript.

      7) In the text "Enrichment analysis of Gene Ontology terms for Biological Process (GO BP) revealed that Srf deficient astrocytes showed enrichment of pathways related to cellular response to beta amyloid and beta-amyloid clearance." This is not shown in fig 5. It would be more accurate to say that there is a downregulation of genes involved in B amyloid metabolic process.

      Response: We apologize for the omission in showing that this data was presented in Suppl. Fig. S8E. We have now indicated this in the main text.

      Minor Comments:

      4) Figure 1E is missing body weight data noted in the figure legend.

      Response: We apologize for this oversight. This data was actually included in Suppl. Figure S3E and not in Figure 1. We have made the appropriate correction to Figure legend 1.

      6) In Figure 2B figure labels are missing.

      Response: We thank the reviewer for pointing out this omission. We have added the missing labels.

      7) Details of houskeeping gene normalisation are missing from qPCR data.

      Response: We apologize for not providing this information. We have included this in the revised Methods section.

      4. Description of analyses that authors prefer not to carry out

      Please include a point-by-point response explaining why some of the requested data or additional analyses might not be necessary or cannot be provided within the scope of a revision. This can be due to time or resource limitations or in case of disagreement about the necessity of such additional data given the scope of the study. Please leave empty if not applicable.

      Reviewer #3, Major Comment 1:

      1) The title of the manuscript is "SRF-deficient astrocytes provide neuroprotection in mouse models of excitotoxicity and neurodegeneration". It would be more accurate to say that SRF is involved in neurotoxicity in these models. To make a comment on the role of SRF in neuroprotection, experiments should be performed in spinal cord injury or ischaemia, where deficiency of SRF would be hypothesised to worsen recovery.

      Response: We disagree with the reviewer with this assessment. There is no evidence to suggest that SRF is involved in neurotoxicity. What our data suggests is that SRF deficiency results in a reactive astrocyte state that is neuroprotective in these models. We hypothesize that in injury/infection/disease conditions that would result in generation of neuroprotective astrocytes, SRF expression or function may be negatively regulated. It would be interesting to see whether the SRF-deficient astrocytes alleviate or exacerbate pathology and recovery following spinal cord injury and ischaemia.

    1. Reviewer #2 (Public Review):

      This study investigates T-cell repertoire responses in a mouse model with a transgenic beta chain, such that all T-cells in all mice share a fixed beta chain, and repertoire diversity is determined solely by alpha chain rearrangements. Each mouse is exposed to one of a few distinct immune challenges, sacrificed, and T-cells are sampled from multiple tissues. FACS is used to sort CD4 and Treg cell populations from each sample, and TCR repertoire sequencing from UMI-tagged cDNA is done.

      Various analyses using repertoire diversity, overlap, and clustering are presented to support several principal findings: 1) TCR repertoires in this fixed beta system have highly distinct clonal compositions for each immune challenge and each cell type, 2) these are highly consistent across mice, so that mice with shared challenges have shared clones, and 3) induction of CD4-to-Treg cell type transitions is challenge-specific.

      The beta chain used for this mouse model was previously isolated based on specificity for Ovalbumin. Because the beta chain is essential for determining TCR antigen specificity, and is highly diverse in wildtype mice, I found it surprising that these mice are reported to have robust and consistently focused clonal responses to very diverse immune challenges, for which a fixed OVA-specific beta chain is unlikely to be useful. The authors don't comment on this aspect of their findings, but I would think it is not expected *a priori* that this would work. If this does work as reported, it is a valuable model system: due to massively reduced diversity, the TCR repertoire response is much more stereotyped across individual samples, and it is much easier to detect challenge-specific TCRs via the statistics of convergent responses.

      While the data and analyses present interesting signals, they are flawed in several ways that undermine the reported findings. I summarize below what I think are the most substantive data and analysis issues.

      1. There may be systematic inconsistencies in repertoire sampling depth that are not described in the manuscript. Looking at the supplementary tables (and making some plots), I found that the control samples (mice with mock challenge) have consistently much shallower sampling-in terms of both read count and UMI count-compared with the other challenge samples. There is also a strong pattern of lower counts for Treg vs CD4 cell samples within each challenge.

      2. FACS data are not reported. Although the graphical abstract shows a schematic FACS plot, there are no such plots in the manuscript. Related to the issue above, it would be important to know the FACS cell counts for each sample.

      3. For diversity estimation, UMI-wise downsampling was performed to normalize samples to 1000 random UMIs, but this procedure is not validated (the optimal normalization would require downsampling cells). What is the influence of possible sampling depth discrepancies mentioned above on diversity estimation? All of the Treg control samples have fewer than 1000 total UMIs-doesn't that pose a problem for sampling 1000 random UMIs? Indeed, I simulated this procedure and found systematic effects on diversity estimates when taking samples of different numbers of cells (each with a simulated UMI count) from the same underlying repertoire, even after normalizing to 1000 random UMIs. I don't think UMI downsampling corrects for cell sampling depth differences in diversity estimation, so it's not clear that the trends in Fig 1A are not artifactual-they would seem to show higher diversity for control samples, but these are the very same samples with an apparent systematic sampling depth bias.

      4. The Figures may be inconsistent with the data. I downloaded the Supplementary Table corresponding to Fig 1 and made my own version of panels A-C. This looked quite different from the diversity estimations depicted in the manuscript. The data does not match the scale or trends shown in the manuscript figure.

      5. For the overlap analysis, a different kind of normalization was performed, but also not validated. Instead of sampling 1000 UMIs, the repertoires were reduced to their top 1000 most frequent clones. It is not made clear why a different normalization would be needed here. There are several samples (including all Treg control samples) with only a couple hundred clones. It's also likely that the noted systematic sampling depth differences may drive the separation seen in MDS1 between Treg and CD4 cell types. I also simulated this alternative downsampling procedure and found strong effects on MDS clustering due to sampling effects alone.

      It is not made clear how the overlap scores were converted to distances for MDS. It's hard to interpret this without seeing the overlap matrix.

      6. The cluster analysis is superficial, and appears to have been cherry-picked. The clusters reported in the main text have illegibly small logo plots, and no information about V/J gene enrichments. More importantly, as the caption states they were chosen from the columns of a large (and messier-looking) cluster matrix in the supplementary figure based on association with each specific challenge. There's no detail about how this association was calculated, or how it controlled for multiple tests. I don't think it is legitimate to simply display a set of clusters that visually correlate; in a sufficiently wide random matrix you will find columns that seem to correlate with any given pattern across rows.

      7. The findings on differential plasticity and CD4 to Treg conversion are not supported. If CD4 cells are converting to Tregs, we expect more nucleotide-level overlap of clones. This intuition makes sense. But it seems that this section affirms the consequent: variation in nucleotide-level clone overlap is a readout of variation in CD4 to Treg conversion. It is claimed, based on elevated nucleotide-level overlap, that the LLC and PYMT challenges induce conversion more readily than the other challenges. It is not noted in the textual interpretations, but Fig 4 also shows that the control samples had a substantially elevated nucleotide-level overlap. There is no mention of a null hypothesis for what we'd expect if there was no induced conversion going on at all. This is a reduced-diversity mouse model, so convergent recombination is more likely than usual, and the challenges could be expected to differ in the parts of TCR sequence space they induce focus on. They use the top 100 clones for normalization in this case, but don't say why (this is the 3rd distinct normalization procedure).

      Although interpretations of the reported findings are limited due to the issues above, this is an interesting model system in which to explore convergent responses. Follow-up experimental work could validate some of the reported signals, and the data set may also be useful for other specific questions.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      We appreciate the valuable suggestions and the overall highly positive review of our manuscript. We have now included many suggestions provided by the reviewers, which have made our manuscript much stronger and more rigorous. One reviewer acknowledged, “This study uncovers sex-dependent mechanisms underlying cold sensitivity between male and female mice. The detailed IHC analysis of MHCII expression in DRG neurons is a clear strength of this study and supports flow cytometry results as well as existing literature. The specificity of MHCII expression on small diameter is well characterized and supported by conditional knockout mouse models of MHCII in TRVPV1-lineage neurons.”

      R1: It is not, yet, possible to conclude that all experiments are adequately powered as N's for some studies are not provided.

      All experiments include N’s both in the text and in the figure legend.

      R1: It is unclear what is meant by "novel" expression, used throughout the manuscript.

      MHCII is traditionally thought to be constitutively expressed on antigen-presenting cells (APCs) and induced by inflammation on some non-APCs, including endothelial, epithelial, and glial cells (van Velzen et al., 2009). RNA seq data sets (Nguyen et al., 2021, Tavares- Ferreira et al., 2022, Usoskin et al., 2015, Lopes et al., 2017) demonstrate that mouse and human DRG neurons express transcripts for MHCII and MHCII-associated genes. However, there are no reports to date that demonstrate MHCII protein expression in terminally differentiated neurons. To the best of our knowledge, we are the first group to show that MHCII protein is expressed in DRG neurons.

      R1: The statement at the end of the abstract, "and that neuronal MHCII may also contribute to many other neurological disorders" seems premature, beyond the scope of the present study.

      We agree with the reviewer’s comment and have changed the sentence to the following: “Collectively, our results demonstrate expression of MHCII on DRG neurons and a functional role during homeostasis and inflammation” (pg. 1).

      R1: While cold allodynia (hypersensitivity) is a clinically important feature of CIPN, especially in CIPN associated with the platinum based chemotherapeutic agents, it is less so taxane CIPN. Do 60% of patients with PTX CIPN express cold allodynia or does that number refer to CIPN in general?

      This statistic is based on a study that conducted a meta-analysis of CIPN incidence and prevalence with paclitaxel, bortezomib, cisplatin, oxaliplatin, vincristine or thalidomide. However, we now include another reference (PMID: 15082135) that demonstrates patients receiving PTX experience cold hypersensitivity (pg.3).

      R1: Again, the future direction of expanding studies of the role of MHCII in other aspects of the CIPN phenotype might bear mention.

      We have included future directions regarding other aspects of CIPN phenotype in the discussion. We state, “Reducing the expression of MHCII in TRPV1-lineage neurons exacerbated PTXinduced cold hypersensitivity in both male and female mice. Future studies will evaluate the role of MHCII in PTX-induced mechanical hypersensitivity, another prominent feature of CIPN” (pg. 29).

      R1: Is there any evidence that IL-4 and/or IL-10 influence cold sensitivity?

      IL-10 and IL-4 have been shown to suppress spontaneous activity from sensitized nociceptors (Krukowski et al., 2016; Laumet et al., 2020; Chen et al., 2020) and to reduce neuronal hyperexcitability (Li et al., 2018), respectively. In addition, IL-10 has been shown to reduce mechanical hypersensitivity (Krukowski et al., 2016); however, cold sensitivity has not been evaluated. IL-4 KO mice do not have an increase in tactile allodynia or cold sensitivity after CCI; however, there is an increase in anti-inflammatory cytokines, specifically IL-10, and opioid receptors, which may be a compensatory mechanism that protects against enhanced pain after injury (Nurcan Üçeyler et al. 2011).

      R1: Are these experiments run blinded?

      Yes, this is discussed in the materials and methods section (pg. 31).

      R1: The term "directly contacts" is unclear. No synaptic structure is identified. It might be more accurate to estimate the actual proximity between the two cells, especially as direct contact would not be necessary for the type of intercellular communication they are studying. This is not an EM study.

      We agree with the reviewer’s comment and have changed the wording to “in close proximity” (pgs. 1,5, 7, 27).

      R1: Two abbreviations are used for immunohistochemistry, ICC and IHC.

      IHC refers to immunohistochemistry, and ICC refers to immunocytochemistry. We accidently wrote ICC in the immunohistochemistry section in the materials and methods section. We have now corrected it to say IHC (pg. 32).

      R1: In some figure, group sizes are not indicated (e.g., Fig. 4D).

      All group sizes are indicated in the text and figure legends.

      R1: "small non-nociceptive neurons" - seems to refer to TRPV1+ neurons. There are, however, TRPV1-nociceptors. "Therefore, the majority of MHCII+ neurons in the DRG of naïve female mice were not TRPV1- lineage neurons but non-nociceptive C-LTMRs." Could use some clarification here. Are the authors suggesting that being TRPV1- defines a neuron a non-nociceptive?

      We never said small non-nociceptive neurons are TRPV1+ neurons. We crossed TRPV1 lineage mice with td-tomato to label TRPV1 lineage neurons, which include TRPV1 neurons, IB4, and a subset of Aẟ neurons. We found that TRPV1 lineage neurons comprise about 65% of small diameter neurons, so 35% of small diameter neurons are not TRPV1 lineage cells. These non- TRPV1 lineage small diameter neurons are non-nociceptive LTMRs, most likely TH and MrgB4 neurons.

      R2: The most pressing concern regarding this study is a lack of a vehicle control group. It is not appropriate to be comparing paclitaxel treated mice to naïve mice. Please include a vehicle treatment (cremophor:ethanol 1:1 diluted 1:3 in PBS) group for all experiments involving paclitaxel.

      We believe the most appropriate control to paclitaxel treatment is the naïve control because clinically, paclitaxel is always administered to the patient in a formulation of 50% Cremophor and 50% ethanol. In clinical studies, the controls are healthy no-pain individuals and patients receiving paclitaxel without pain. However, the percentage of patients receiving paclitaxel that do not develop CIPN is low, emphasizing the need for healthy individuals not taking paclitaxel.

      R2: Figure 1A only includes representative images of a small number of T cells in presumable contact with DRG neurons in female Day 14 paclitaxel mice but does not include images from other groups. Similarly, B-D show a single CD4+ T cell in contact with DRG neurons in Day 14 paclitaxel and naïve female mice. Please include quantification of the frequency of CD4+ T cells interacting with DRG neurons in the different experimental groups utilized in this study.

      We have now quantified the number of CD4+ T cells per mm2 of DRG tissue, which is found in the text (pg. 5) and figures (Fig. S1 and Fig. 1A). We plan to add the quantification of CD4+ T cells per mm2 of DRG tissue for naïve and day 14 PTX-treated male mice. This data will be included in the text (pg. 5) and in Fig. S1.

      R2: Please include entire blot for Figure 2A (or at least more of the blot). There is plenty of space in the figure and as it currently appears is not free from apparent manipulation.

      We included a larger area of the western blot in Fig 2A (pg. 9).

      R2: The authors conclude that MHCII helps to suppress chemotherapy-induced peripheral neuropathy, resolving cold allodynia following paclitaxel treatment. To support this conclusion, I think it is necessary to include a time-course experiment highlighting whether cKO of MHCII in TRPV1 neurons indeed increases the duration for cold hypersensitivity to resolve following paclitaxel treatment.

      We conclude that neuronal MHCII suppresses cold hypersensitivity in naïve male mice and reduces the severity of PTX-induced cold hypersensitivity at the peak of the response (day 6) (pg. 1-2). In addition, knocking out one copy of MHCII in male TRPV1-lineage mice reduced total neuronal MHCII in naïve and PTX-treated mice (day 7 and 14) (pgs. 21-22; Fig.7). Moreover, knocking out one copy of MHCII in female TRPV1-lineage mice reduced surface- MHCII in female 7 days post-PTX (pgs. 19-20; Fig.6). Future studies will investigate the distinct roles of surface and intracellular neuronal MHCII and the contribution of MHCII to the resolution of CIPN.

      R2: The graphical abstract is misleading. The authors suggest paclitaxel is acting exclusively via TLR4 and that signaling is resolved at Day 14 which their data does not support. Please adjust to reflect findings from the experiments included in this study.

      We have removed TLR4 from our graphical abstract as we do not investigate the role of TLR4 in this manuscript. However, we do not suggest paclitaxel is acting exclusively through TLR4. We modified our wording to indicate both pro-inflammatory cytokines and PTX act on neurons to induce hyperexcitability and neurotoxicity: “Pro-inflammatory cytokines and PTX act on DRG neurons inducing hyperexcitability (Li et al., 2018, Boehmerle et al., 2006, Li et al., 2017) and neurotoxicity (Goshima et al., 2010, Flatters and Bennett, 2006), which manifests as pain, tingling, and numbness in a stocking and glove distribution (Rowinsky et al., 1993)” (pg. 9).

      R2: Figure 4 and 6 MHCII labelling is oversaturated in most of the images, creating a blurry hue in the representative images. This should be fixed.

      The signal intensity of immune cell MHCII is >5 times greater than neuronal MHCII; therefore, in order to visualize neuronal MHCII, the immune cell MHCII is oversaturated. We reference this in the discussion (pg. 26).

      R2: The effects of the PTX cHET group are very mild in both the male and female cohorts, and specific to 1 trial. R3: Furthermore, the behavioral effect is seemingly variable, with only one of the three trials being significantly different between groups. This variable response needs to be discussed further.

      This behavioral assay was developed by the UNE COBRE Behavior Core, under the guidance of Dr. Tamara King, who has extensive experience in using learning and memory measures to determine changes in pain such as development of thermal hypersensitivity (1-3, King et al, Nat Neuro 2009). Methodologically, the process is as follows: In the temperature placed preference assay, mice are placed on the reference plate (25 °C) to begin each 3-minute trial. For the habituation trial, both the test and reference plates are set to 25 °C, and the mice are allowed to explore for 3 minutes. The following 3 trials are the acquisition trials where the reference plate is set to 25 °C and the test plate to 20 °C. If the animals have cold hypersensitivity, modeling cold allodynia, then they will demonstrate faster acquisition of a learned avoidance response compared to the WT controls. For the results, we will clarify our findings, which are outlined below: 1) We will change the axis labels to better distinguish BL/habituation trial from reference trials in the graphs. 2) We will add graphs comparing naïve versus PTX for male and female WT mice. 3) The changes in the graphs will now reflect 3 key findings: First, we note that PTX-treated mice learn to avoid the cold test plate faster than the naive controls in the WT mice reflecting PTX-induced cold hypersensitivity. Of interest, both males and females demonstrate learned avoidance by trial 2 and that the percent of time on the cold plate continued to decline only in the PTX-treated mice. We had not graphed this in the original figure and plan to add graphs for both male and female WT mice. These graphs are important to include as it validates that this TPP can capture the expected PTX-induced cold hypersensitivity in WT mice. Second, in terms of the naïve cHET mice, these data show that both female and male cHET mice demonstrate faster learning to avoid the cold (20 °C) plate compared to the WT mice (Fig. 8A, B. We note that the males demonstrate a more robust effect, (faster learned avoidance of the cold plate) with significant avoidance to the cold plate emerging in the cHET mice by trial 3 compared to trial 4 in the females (sig diff compared to BL trial). Third, we observed that cHET mice treated with PTX demonstrate even more accelerated learning to avoid the cold plate compared to WT mice treated with PTX. This observation suggests that PTX-treated cHET mice have heightened cold allodynia compared to the WT mice.

      R2: The statistical analysis (for the behavior) should also have been a mixed-effects repeated measures between groups ANOVA.

      We agree and re-analyzed our behavior data using repeated measures mixed-effects model (REML) with Dunnett’s multiple comparison test comparing trials 2-4 to trial 1 within same group, and Sidak’s multiple tests for significance between groups at the same trial (pgs. 23-25; Fig. 8)

      R3: Presented in Figure 3, the authors present data to show surface expression of MHCII, along with the ability of MHCII to present OVA peptide, on naïve and PTX-treated DRG neurons. These data are probably the most relevant in terms of expression as they look at the surface expression of MHCII along with the potential of MHCII to function; therefore, it is unclear why the authors only conducted this analysis on female neurons, and not both male and female neurons. Given the claims of the paper in terms of sex differences for MHC expression, I strongly suggest this is done in order to put the other observations into context.

      We completely agree and have added male mice data in Figs. 2 and 3. By western blot, we show that PTX increased the amount of MHCII protein 14 days post-PTX in DRG neurons from female mice, but there’s no change in MHCII protein after PTX in male mice (Fig. 2). In agreement with the western blot, surface-MHCII determined by flow cytometry did not increase after PTX on DRG neurons from male mice (Fig. 3B). Moreover, the frequency of DRG neurons from male mice with surface-MHCII (determined by ICC) and OVA peptide did not change after PTX treatment (Fig. 3D, E). However, the percent area with polarized MHCII on DRG neurons from male mice increased 14 days post-PTX, indicating a modest PTX-induced response in males (Fig. 3F). We have now included the frequency of surface-MHCII on DRG neurons from male and female mice after PTX treatment, and again there was no change in surface-MHCII in male mice (Fig. 6). Collectively, our data demonstrates that neuronal MHCII in male mice is not strongly regulated by PTX treatment.

      R3: Given the data presented in Figure 3, it is not clear what the relevance of investigating the subcellular puncta expression of MHCII neurons is, particularly when considering the sex differences observed, and how this was not been performed for surface expression.

      We now include surface and total MHCII quantification for male and female WT and cHET mice (Figs. 6,7). In the text, we describe the significance of surface versus endosomal MHCII. “While endosomal MHCII can promote TLR signaling events(Liu et al., 2011), expression of MHCII on the cell surface is required to activate CD4+ T cells.” (pg. 10). “Although the major role for surface MHCII is to activate CD4+ T cells, cAMP/PKC signaling occurs in the MHCII-expressing cell(Harton, 2019). In addition, it has recently been shown that endosomal MHCII plays an important role in promoting TLR responses(Liu et al., 2011), and since DRG neurons are known to express TLRs (Lopes et al., 2017, Wang et al., 2020, Cameron et al., 2007, Barajon et al., 2009, Xu et al., 2015, Zhang et al., 2018), this suggests the potential for T-independent responses in MHCII+ neurons. Knocking out one copy of MHCII in TRPV1- lineage neurons (cHET) from female mice did not change total MHCII 7 days post-PTX but reduced surface-MHCII. Accordingly, PTX-treated cHET female mice were more hypersensitive to cold than PTX-treated WT female mice, suggesting a role for neuronal MHCII in CD4+ T cell activation and/or neuronal cAMP/PKC signaling. In contrast, knocking out one copy of MHCII in TRPV1-lineage neurons (cHET) from male mice did not change surface-MHCII in naïve or PTX-treated mice but reduced total MHCII, indicating endosomal MHCII and potentially a role in TLR signaling. Future studies are required to delineate MHCII surface and endosomal signaling mechanisms in naïve and PTX-treated female and male mice.” (pg. 28).

      R3: Furthermore, the authors should provide details of what the abundant non-neuronal structures are within the DRG images that appear positive for MHCII staining.

      We now include an image of the high MHCII+ cells in mouse DRG co-stained with macrophage and dendritic cell markers (CD11b/c), indicating the presence of immune cells (Fig. S6).

      R3: The behavioral data presented in Figure 7 is somewhat confusing. Can the authors confirm how many alleles of MHCII were knocked out from the Trpv1-lineage neurons for these experiments? In Figure 7, it states cKO Het, which suggests that only one allele was deleted within the Trpv1 population. If this is the case, this needs to be clearly outlined within the results section and not simply referred to as "knocking out MHCII in Trpv1-lineage neurons". In addition, an explanation as to why heterozygous cKO were used rather than homozygous cKO needs to be provided. This is particularly relevant when discussing potential sex differences.

      The mouse behavior is performed in wild type and TRPV1lin MHCII+/- heterozygote mice (Fig 8). Instead of saying we knocked out MHCII, we changed the text to “knocking out one copy of MHCII in TRPV1-lineage neurons” (pgs. 23, 29). In the methods section, we state that “cHET×MHCIIfl/fl crosses only yielded 8% cKO mice (4% per sex) instead of the predicted 25% (12.5% per sex) based on normal Mendelian genetics. Thus, cKO mice were only used to validate MHCII protein in small nociceptive neurons” (pg. 30) (Fig 7).

      R3: A significant gap in the current manuscript is the functional assessment of MHCII protein expressed on DRG neurons in terms of T cell activity. I would suggest the authors consider performing a co-culture DRG-T cell (i.e. Treg) assay where anti-inflammatory cytokine release can be measured in the presence and absence of MHCII on DRG neurons.

      The functional implication of MHCII protein on DRG neurons in terms of T cell activity is out of the scope of this manuscript. We currently have another manuscript in progress investigating CD4+ T cell signaling and cytokine production when co-cultured with DRG neurons. R3: Within the first paragraph of the results section, the authors reference Goode et al, 2022, stating that they have previously shown that CD4+ T cells in the DRG secrete anti-inflammatory cytokines. I have read this paper and could not find any data that showed increased secretion of cytokines, only that there is an increase in T-cell populations that contain anti-inflammatory markers. Please consider rewording to reflect the observations made in the original paper. We have changed “secrete” to “produce” (pg. 5) because we detected anti-inflammatory cytokines (IL-10 and IL-4) within CD4+ T cells using intracellular staining and multi-color flow cytometry.

      R3: Figure 1A states that it is "day 14 PTX", however, there is no reference to this in the corresponding text - please state what Figure 1A is showing in the main text and legend regarding PTX treatment.

      We have now included text and Fig. 1. legend that states that the images in Fig1A are of DRG tissue collected from female mice 14 days after PTX treatment (pg. 5).

      R3: Throughout the results section (Figure 3-Figure 6), the authors provide percentage changes in observed difference in expression, however, in addition to this, it would be valuable to have the actual number of neurons analysed for each group and sex.

      We now report in the materials and methods section the number of neurons that were analyzed (pg. 33).

      R3: For Figure 5, can the authors confirm whether this was performed on tissue sections or dissociated cell culture?

      This analysis was performed in DRG tissue sections. The legend now states, “Gaussian distribution of the diameter of MHCII+ DRG neurons in DRG tissue from naïve (pink), day 7 (orange) and day 14 PTX-treated (blue) (A) female and (E) male mice (n=8/sex, pooled neurons).”

      R3: Can the authors comment on why surface expression for MHCII was not performed on the these reporter neurons?

      In the future, we plan to delineate which subsets of neurons express MHCII by co-staining for MHCII and specific neuronal markers. However, these studies are beyond the scope of the current manuscript.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reviewer #1:

      1. If doable, image dynein and dynactin simultaneously in the Halo-DYNC1H1/DCTN4-SNAP iNeurons. Co-movement of dynein and dynactin towards the somatodendritic compartment and their separate movement in the anterograde direction along the axon would provide the most convincing evidence for the key claims of the manuscript.

      Please see the planned revision section for our response

      Reviewer #2:

      Major comment (requires additional experimentation)

      1. While the data presented do certainly suggest that dynein and Lis1 are transported anterogradely on separate vesicular cargoes from dynactin and Ndel1, the study would be much stronger if supported by dual imaging of dynein and dynactin to prove that these proteins do indeed move in association with separate vesicular populations. I would like to see dual-color kymograph traces showing that the proteins move independently. The authors should be able to accomplish this using their dual Halo-DYNC1H1/DCTN4-SNAP hESC line. To acquire and analyze this data might take several months, but it would greatly strengthen this paper. If the authors do this experiment, they may also be able to address the mechanism of reversal of anterograde cargoes which they speculate about in the Discussion, which would add even more interest and insight.

      Please see the planned revision section for our response

      Minor comments (addressable without additional experimentation)

      1. The authors deduce that 1-4 Halo fluorochromes corresponds to 1-2 dynein molecules. This implies that the cells are homozygous for the Halo tag, but I do not see this addressed explicitly. The authors should state explicitly whether the lines generated for their study are heterozygous or homozygous for the tag. If the cells are heterozygous, which would seem most likely, then they may be underestimating the number of dyneins per spot and should take this into account.

      We have added whether lines are homozygous or heterozygous to the manuscript. We also include a new Supplementary Figure panel (Fig S6) showing the genotyping data. In summary, all lines are homozygous except for PAFAH1B1-Halo (hESCs) which is heterozygous.

      1. Why are the moving spots lower in intensity than the NEM-treated static spots. It appears to suggest that they may be associated with different structures. This should be clarified and discussed.

      Our data suggest that the fast-moving spots have fewer dyneins than NEM treated static spots. We suggest this is because the fast-moving cargos are smaller than the average cargo and therefore have fewer dyneins on them. This is also supported by the smaller number of dyneins reported previously on endosomes as compared to the large lysosomes. We have clarified this in the discussion (page 7-8).

      1. The authors state in the Results that most of the dynein spots were diffusing, often along microtubules, but they do not visualize microtubules so how do they know this? They may need to remove the phrase "often along microtubules".

      This has been removed.

      1. At the end of the Introduction the authors state that their data "allow us to understand how the dynein machinery drives long-range transport in the axon". This is an overstatement. The "how" in this sentence is not addressed in this study.

      We have softened the sentence by adding the phrase “better understand”.

      1. The conclusion that dynein binds to cargos stably throughout their transport along the axon is based on measurements of the fastest moving cargoes but the authors do not provide data on the distribution of velocities for the entire population of retrograde cargoes. It is not valid to extrapolate the behavior of a small number of cargoes to the entire population. The average may be much slower than the fastest cargoes. Moreover, even for the fastest organelles the authors cannot say that the dynein is stably bound because they did not track single cargoes and thus do not know that the cargoes moved continuously in one single bout of movement for 500 µm; it is possible that the cargoes moved in multiple consecutive bouts interrupted by brief pauses and dynein motors may have exchanged between bouts.

      We have added a section to the discussion to highlight that other cargos may behave differently from the fastest ones (page 7). We have also clarified the assumptions that lead us to expect a slower arrival time of the first signal (page 5).

      1. The authors say that "it is clear that at least some dyneins remain on cargoes throughout their transport along the axon". As explained above, the data do not prove this so this statement should be removed.

      We have softened this sentence from “it is clear” to “our results suggest” and explained in more detail why we make this conclusion

      1. The authors note that most of the dynein spots were not moving processively and state that this is consistent with prior studies showing that only a subset of dynein is actively involved in transport. However, as they note elsewhere, dynein is both motor and cargo and most axonal dynein is transported at slow average velocities so maybe they should be more explicit about what they mean by "involved in transport".

      We have clarified we mean fast axonal transport and thank the reviewer for highlighting this point.

      1. When the authors note that most of the dynein in axons is transported in the slow component of axonal transport, they should also cite the work of Pfister and colleagues who were the first to show this (PMID 8824315 and 8552592).

      This was an omission on our part. The references have now been added.

      1. The authors propose that dynein and Lis1 are transported together but there were significantly fewer anterogradely transported Lis1 particles than dynein particles. This should be discussed.

      We have added more information to the discussion. Although we cannot rule out this effect being due to the heterozygous tagging of our LIS1 cell line, we do not witness the same decrease in events in the retrograde direction. Therefore, we believe there is a subset of anterogradely moving dynein lacking LIS1. As discussed in the manuscript, this subset may already be bound to dynactin and therefore not require LIS1.

      1. For the statistical analysis, the authors should provide p values in the legends for the comparisons that are judged to be "not significant". The authors should also be consistent in how they label differences that are not significant - they mark them as "ns" in Fig. 1, but in the other figures they do not, leaving some ambiguity about whether particular comparisons were not tested or were found to be not significant. For example, in Fig. 4C the average speed of the dynactin is about 0.5 µm/s greater than for the other proteins and the spread in the data suggest that this could be significant, but no significance is indicated on the plot, implying p>0.05. It is not clear how confident we can be that there is no difference.

      We have now included all p values in the figure legends and have removed the “ns” in Fig 1D. In our revised manuscript, only significant differences are highlighted in the figures.

      Reviewer #3:

      • if I look at the kymographs, trajectories appear rather complex, pausing, standing still, moving and everything mixed. The explanation of how actual trajectories are extracted and on what basis is very short, too short for me. I think the authors should expand this. Furthermore, I think it would be good if the authors would present, in their kymographs examples of the tracked (and also the not included) tracks. Maybe in supplementary info.

      The analysis of this data used the Trackmate Fiji plugin. This tracks spots frame to frame in a movie and then outputs the data of the tracks. No data was extracted from kymographs but they were used as a graphical illustration of the moving spots. To better explain our analysis pipeline, we have expanded our methods section and have added an example of a tracked movie (Video 15) as well as highlighted the tracked spots in one kymograph example (Figure 7S).

      • I found 'velocity' ill defined. I get the impression, judging from the number of points (compared to the other parameters) that the authors determine the average velocity of each individual trajectory. That is an important parameter (but should indeed be called 'trajectory averaged' velocity), but might not be the only one useful to learn from the data, where trajectories do not always appear to have constant speeds (pausing, etc.). Why do the authors not determine point-to-point velocities and plot histograms of those for all the trajectories (simply plot histograms of all the displacements between subsequent data points in trajectories)? This might provide great insight into the actual maximum velocity and the fraction of pausing or moving in opposite direction etc., providing much more molecular detail than currently extracted from the data.

      The reviewer is correct. We have measured the average velocity of the spots from the beginning of the track to the end. We have clarified this in the text. Furthermore, as stated above in the revision plan, we are currently doing the additional analysis and will include it in the final revision

      • I was a bit surprised to read that the authors have gone to the effort to create a dual-color labeled cell line, but did not do actual correlative two-color measurements (or at least show them). It would be so insightful to see dynein and dynactin move separately in the anterograde direction.

      Please see the planned revision section for our response.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reviewer #1 (Evidence, reproducibility and clarity):

      REVIEW COMMENT

      The article titled "The tRNA thiolation-mediated translational control is essential for plant immunity" by Zheng et al. highlights the critical role of tRNA thiolation in Arabidopsis plant immunity through comprehensive analysis, including genetics, transcriptional, translational, and proteomic approaches. Through their investigation, the authors identified a cbp mutant, resulting in the knockout of ROL5, and discovered that ROL5 and CTU2 form a complex responsible for catalyzing the mcm5s2U modification, which plays a pivotal role in immune regulation. The findings from this study unveil a novel regulatory mechanism for plant defense. Undoubtedly, this discovery is innovative and holds significant potential impact. However, before considering publication, it is necessary for the authors to address the various questions raised in the manuscript concerning the experiments and analysis to ensure the reliability of the study's conclusions.

      Response: Thank you very much for your support and suggestions!

      Here is Comments:

      Line 64-65:

      The author mentioned that 'While NPR1 is a positive regulator of SA signaling, NPR3 and NPR4 are negative regulators.' However, several recent discoveries are suggesting that it may not be a definitive fact that NPR3 and NPR4 are negative regulators. Therefore, I recommend the authors to review this section in light of the findings from recent papers and make necessary edits to reflect the most current understanding.

      Response: Thank you for your feedback. Since we mainly focused on NPR1 in this study, we removed this sentence to avoid confusion. We provided additional information about NPR1 in the Introduction section to emphasize the importance of NPR1 (Line 64-68).

      Line 182- & Figure 4:

      The author conducted RNA-seq, Ribo-seq, and proteome analysis. Describing the analysis as "transcriptional and translational" using RNA-seq and proteome data seems not entirely accurate. Proteome data compared with RNA-seq not only reflects translational changes but may also encompass post-translational regulations that contribute to the observed differences. To maintain precision, the title of this section should either be modified to "transcriptional and protein analysis" or, alternatively, compare RNA-seq and Ribo-seq data to demonstrate the transcriptional and translational changes more explicitly.

      Responses: Thank you for your suggestions. We agree with you and thus change the description accordingly throughout the manuscript.

      Line 229-235 and Figure 5C:

      The interpretation of Figure 5C's polysome profiling results is inconclusive. There does not seem to be a noticeable difference in polysomal fractions between the cab mutant and CAM. The observed differences in the overlay of multiple polysome fractions between cab and COM could be primarily influenced by baseline variations rather than a significant decrease in the polynomial fractions in cpg. Therefore, it is necessary to carefully review other relevant papers that discuss polysome fraction data and their analysis. By doing so, the authors can make the appropriate corrections to ensure accurate interpretations.

      Responses: Thank you for your comments. We agree that the difference between cgb and COM was not dramatic visually. This is a common feature of polysome profiling assay (e.g. Extended Data Fig. 1f in Nature 545: 487–490; Fig. 1c in Nature Plants, 9: 289–301). In our case, the difference between polysome fractions was unlikely due to the baseline variation for two reasons. First, baseline variation affects monosome and polysome fractions in the same way. However, our results showed the monosome fraction of cgb is higher than that of COM, whereas the polysome fraction of cgb is lower than that of COM. Second, this result was repeatedly detected. For better visualization, we adjusted the scale of Y axis in the revised manuscript (Figure 5D).

      Line 482 Ion Leakage assay:

      I could not find the ion leakage assay in this manuscript, so I wonder why it is mentioned.

      Response: We are sorry for the mistake. The Ion leakage data were included in previous visions of the manuscript. We removed the data but forgot to remove the corresponding method in the present version.

      Materials and Methods:

      To enhance the reproducibility of the study, the authors should provide a more detailed description of the materials and methods, especially for critical experiments like the Yeast-two-hybrid assays. Clear documentation of specific reagents, strains, and protocols used, along with information on controls, will bolster the validity of the results and facilitate future research in this area.

      Response: Thank you for your suggestions. We provided more details in the methods. For yeast two-hybrid assays, the vector information was included in “Vector constructions” section.

      Minor Point:

      Line 61: There is a space between ')' and '.', which needs to be edited.

      Response: The space was deleted.

      Reviewer #1 (Significance): This study holds significant importance within the field of plant immunity research. The authors have made valuable contributions through their comprehensive analysis, encompassing genetics, transcriptional, translational, and proteomic approaches, to elucidate the critical role of tRNA thiolation in plant immunity. One of the major strengths of this study lies in its ability to shed light on a previously unknown regulatory mechanism for plant defense. By identifying the cbp mutant and investigating the role of ROL5 and CTU2 in catalyzing the mcm5s2U modification, the authors have unveiled a novel aspect of plant immune regulation. This innovative discovery provides a deeper understanding of the intricate molecular processes governing immunity in plants.

      Moreover, the study's findings are not limited to the immediate field of plant immunity but also have broader implications for the scientific community. By employing diverse methodologies, the authors have demonstrated how tRNA thiolation exerts control over both transcriptional and translational reprogramming, revealing intricate links between these processes. This integrative approach sets a precedent for future research in the field of plant molecular biology and opens up new avenues for investigating other aspects of immune regulation.

      In terms of its relevance, the study's findings have the potential to captivate researchers across various disciplines, such as plant biology, molecular genetics, and translational research. The insights gained from this study may inspire researchers to explore further the role of tRNA in other regulation.

      Response: Thank you very much for your positive comments and support!

      Reviewer #2 (Evidence, reproducibility and clarity): The authors presented an intriguing and previously unknown mechanism that the tRNA mcm5s2U modification regulates plant immunity through the SA signaling pathway, specifically by controlling NPR1 translation. The manuscript was well-written and logically structured, allowing for a clear understanding of the research. The authors provided strong and persuasive data to support their key claims. However, further improvement is required to strengthen the conclusion that mcm5s2U regulates plant immunity by controlling NPR1 translation.

      Response: Thank you very much for your positive comments and support!

      Major comments:

      1. NPR1 translation should be examined to verify the Mass Spec (Figure 5B) and polysome profiling data (Figure 5D) by checking the NPR1 protein and mRNA level using antibodies and qPCR, respectively, in the cgb mutant background to establish a concrete confirmation of CGB regulation in NPR1 translation.

      Response: This is a very constructive suggestion. We performed these experiments and found that the transcription levels of NPR1 were similar between COM and cgb both before and after PsmES4326 infection (Figure S2), which is consistent with RNA-Seq data. Consistent with the Mass Spec and polysome profiling data, the NPR1 protein level was much higher in COM than that in cgb(Figure 5C) after Psm ES4326 infection. Together, these data further supported our conclusion that translation of NPR1 is impaired in cgb.

      1. Analyzing the genetic epistasis of CGB and NPR1 to check if CGB regulates plant immunity through the NPR1-dependent SA signal pathway. If the authors' claim is valid, I would expect no addictive effect on bacterial growth in the cgb/npr1 double mutant compared to the single mutants. Due to the broad impact of CGB on plant signaling (Figures 4E and 4F), the SA protection assay, which concentrates on the SA signal pathway, needs to be tested in WT, cgb and npr1 plants as an alternative assay to the genetic epistasis analysis. I expect that the SA-mediated protection is also compromised in cgb mutant background.

      Response: Thank you for your suggestions. We did examine the growth of Psm ES4326 in the cgb npr1_double mutant and found that _cgb npr1 was significantly more susceptible than npr1 and cgb (Figure below). Although the additive effects were observed, this result was not against our conclusion for the following reasons. First, the translation of NPR1 was reduced rather than completely blocked in cgb. In other words, NPR1 still has some function in cgb. But in the cgb npr1 double mutant, the function of NPR1 is completely abolished, which explains why cgb npr1 was more susceptible than cgb. Second, in addition to NPR1, some other immune regulators (such as PAD4, EDS5, and SAG101) were also compromised in cgb(Figure 5B), which explained why cgb npr1 was more susceptible than npr1. Since the result of the genetic analysis was not intuitive, we decided not to include it in the manuscript.

      SA signaling is known to regulate both basal resistance and systemic acquired resistance (SA-mediated protection). We have shown that cgb is defective in the defect of basal resistance, which cgb is sufficient to support our conclusion that the tRNA thiolation is essential for plant immunity. We agree that it is expected that the SA-mediated protection is also compromised in cgb. We will test this in the future study.

      1. Could the authors comment on why using COM instead of WT as a control to perform the majority of the experiments?

      Response: Thank you for your comments. In addition to ROL5, the cgb mutant may have other mutations compared with WT.COM is a complementation line in the cgb background. Therefore, the genetic background between COM and cgb may be more similar than that of WT and cgb.

      1. In Figure 5E, why does ACTIN2 have an enhanced translation while NPR1 shows a compromised one in cgb mutant? How does the mcm5s2U distinguish NPR1 and ACTIN2 codons? Does mcm5s2U modification have both positive and negative roles in regulating protein translation?

      Response: Thank you for raising this question. As previously reported, loss of the mcm5s2U modification causes ribosome pausing at AAA and CAA codons. Therefore, the translation of the mRNAs with more GAA/CAA/AAA codons (called s2 codon) is likely to be affected more dramatically in cgb. We have analyzed the percentage of s2 codon at whole-genome level (Figure below). The average percentage is 8.5%, while NPR1 contains 10.1% s2 codon and actin contains only 4.5% s2 codon. When fewer ribosomes are used for translation of the mRNAs with high s2 codon percentage, more ribosomes are available for translation of the mRNAs with low s2 codon percentage, which may account for the enhanced translation efficiency. To focus on NPR1 and to avoid confusion, we removed the ACTIN data in the revised manuscript.

      1. Specify the protein amount used for the in vitro pull-down assay and agrobacteria concentration used for the tobacco Co-IP assay in the protocol section.

      Response: We added this information in Method section in the revised manuscript.

      4. Delete the SA quantification and Ion leakage assay in the protocol, which are not used in the study.

      Response: We are sorry for the mistake. The SA quantification and ion leakage data were included in previous visions of the manuscript. We removed the data but forgot to remove the corresponding method in the present version. We deleted them in the revised manuscript.

      1. The strain Pst DC3000 avrRPT2 was not used in this study. Please remove it.

      Response: We are sorry for the mistake. The strain Pst DC3000 avrRPT2 was used for ion leakage assay in previous visions of the manuscript. We deleted it in the revised manuscript.

      1. In Figure 5F, did the 59 genes tested overlap with the 366 attenuated proteins in the cgb mutant? Were the 59 genes translationally regulated?

      Response: Thank you for your suggestion. Venn diagram analysis revealed that 12 genes (about 20%) are also attenuated proteins, suggesting that the mcm5s2U modification regulates the translation of some SA-responsive genes.

      Reviewer #2 (Significance): The authors' study is significant as it establishes the first connection between tRNA mcm5s2U modification and plant immunity, specifically by regulating NPR1 protein translation. This research expands our understanding of the biological role of tRNA mcm5s2U modification and highlights the importance of translational control in plant immunity. It is likely to captivate scientists working in this field.

      Response: Thank you very much for your positive comments and support!

      Reviewer #3 (Evidence, reproducibility and clarity):

      In this manuscript, the authors identified a cgb mutant that carries a mutation in the ROL5 gene Both the cgb mutant and the newly created rol5-c mutant are susceptible to the bacterial pathogen Psm. The authors showed that ROL5 interacts with CTU2, the Arabidopsis homologous protein of the yeast tRNA thiolation enzyme NCS2. A ctu2-1 mutant is also susceptible to Psm, suggesting the tRNA thiolation may play a role in plant immunity. Indeed, tRNA mcm5S2U levels are undetectable in rol5-c and ctu2-1 mutants. The authors found that the cgb mutation significantly attenuated basal and Psm-induced transcriptome and proteome changes. Furthermore, it was found that the translation efficiency of a group of SA signaling-related proteins including NPR1 is compromised.

      The manuscript provides solid evidence for the involvement of ROL5 and CTU2 in plant immunity using the rol5 and ctu2 mutants. The authors may consider the following suggestions and comments to improve the manuscript.

      Response: Thank you very much for your support and suggestions!

      1. The function of the Elongator complex in tRNA modification/thiolation has been extensively studied. In Arabidopsis Elongator mutants, mcm5S2U levels are very low, similar to the levels in the rol5 and ctu2 mutants (Mehlgarten et al., 2010, Mol Microbiology, 76, 1082-1094; Leitner et al., 2015 Cell Rep). In elp mutants, the PIN protein levels are reduced without reduced mRNA levels (Leitner et al., 2015), indicating that Elongator-mediated tRNA modification is involved in translation regulation. The Elongator complex plays an important role in plant immunity, though the reduced mcm5S2U levels in elp mutants were not proposed as the exclusive cause of the immune phenotypes. In fact, it would be difficult to establish a cause-effect relationship between tRNA modification and immunity. These results should be discussed in the manuscript.

      Response: Thank you very much for your insightful comment on the role of the ELP complex in tRNA modification and plant immunity. We added a paragraph discussing the ELP complex in the revised manuscript (Line 280-295).

      In addition to tRNA modification, the ELP complex has several other distinct activities including histone acetylation, α-tubulin acetylation, and DNA demethylation. Therefore, it is difficult to dissect which activity of the ELP complex contributes to plant immunity. However, the only known activity of ROL5 and CTU2 is to catalyze tRNA thiolation. Considering that the elp, rol5, and ctu2 mutants are all defective in tRNA thiolation, it is likely the tRNA modification activity of the ELP complex underlies its function in plant immunity.

      1. The interaction between CTU2 and ROL5 in Y2H has previously been reported (Philipp et al., 2014). The same report also showed reduced tRNA thiolation in the ctu2-2 mutant using polyacrylamide gel. These results should be mentioned/discussed in the manuscript.

      Response: Thank you for pointing them out. We added this information in the revised version (Line 146-147).

      1. tRNA modification unlikely plays a unique role in plant immunity. It can be inferred that mutations affecting tRNA modification (rol5, ctu2, elp, etc.) would delay both internal and external stimulus-induced signaling including immune signaling.

      Response: We agree with you that tRNA modification has other roles in addition to plant immunity. In the Discussion section, we have mentioned that “it was found that tRNA thiolation is required for heat stress tolerance (Xu et al., 2020). ……It will also be interesting to test whether tRNA thiolation is required for responses to other stresses such as drought, salinity, and cold.” (Line276-279).

      1. It would be interesting to conduct statistical analyses on the genetic codons used in the CDSs whose translation was attenuated as described in the manuscript. Do these genes including NPR1 use more than average levels of AAA, CAA, and GAA codons? If not, why their translation is impaired?

      Response: Thank you for your suggestion. We called GAA/CAA/AAA codons s2 codon. We have analyzed the percentage of s2 codon at whole-genome level (Figure below). NPR1 does contain more s2 codon (10.1%) than the average level (8.5%). We are preparing another manuscript, which will report the relationship between s2 codon and translation.

      Referees cross-commenting

      It is important to put current research in the context of available knowledge in the field. The digram in Figure 3C shows that the Elongator complex functions upstream of ROL5 & CTU2 in modifying tRNA. The function of Elongator in plant immunity has been well established. The similarities and differences should be discussed. Additionally, it may no be a good idea to claim that the results are novel.

      Response: Thank you for your comments. We added a paragraph discussing the ELP complex in the revised manuscript (Line 280-295). The ELP complex catalyzes the cm5U modification, which is the precursor of mcm5s2U catalyzed by ROL5 and CTU2. In addition to tRNA modification, the ELP complex has several other distinct activities including histone acetylation, α-tubulin acetylation, and DNA demethylation. Therefore, it is difficult to dissect which activity of the ELP complex contributes to plant immunity. However, the only known activity of ROL5 and CTU2 is to catalyze tRNA thiolation. Considering that the elp, rol5, and ctu2 mutants are all defective in tRNA thiolation, it is likely the tRNA modification activity of the ELP complex underlies its function in plant immunity. Therefore, our study improved our understanding of the ELP complex in plant immunity. We have deleted the words “new” and “novel” throughout the manuscript.

      Reviewer #3 (Significance): The manuscript provides solid evidence for the involvement of ROL5 and CTU2 in plant immunity. However, the authors did not acknowledge the existing results about the Elongator complex that functions in the same pathway in modifying tRNA. The involvement of Elongator in plant immunity has been well established. The cause-effect relationship between tRNA modification and plant immunity is difficult to demonstrate.

      Response: We think that the cause-effect relationship between the activities of the ELP complex and plant immunity is difficult to demonstrate because the ELP complex has several distinct activities other than tRNA modification. However, since the only known activity of ROL5 and CTU2 is to catalyze tRNA thiolation, the cause-effect relationship between tRNA thiolation and plant immunity is clear, which indicated that the tRNA modification activity of the ELP complex contributes to plant immunity.

    1. Reviewer #3 (Public Review):

      Summary:<br /> Previous studies suggest that humans may infer objects' stability through a world model that performs mental simulations with a priori knowledge of gravity acting upon objects. In this study, the authors test two alternative hypotheses about the nature of this a priori knowledge. According to the Natural Gravity assumption, the direction of gravity encoded in this world model is straight downwards as in the physical world. According to the alternative Mental Gravity assumption, that gravity direction is encoded in a Gaussian distribution, with the vertical direction as the maximum likelihood. They present two experiments and computer simulations as evidence in support of the Mental Gravity assumption. Their conclusion is that when the brain is tasked to determine the stability of a given structure it runs a mental simulation, termed Mental Gravity Simulation, which averages the estimated temporal evolutions of that structure arising from different gravity directions sampled from a Gaussian distribution.

      Weaknesses:<br /> In spite of the fact that the Mental Gravity Simulation (MGS) seems to predict the data of the two experiments, it is an untenable hypothesis. I give the main reason for this conclusion by illustrating a simple thought experiment. Suppose you ask subjects to determine whether a single block (like those used in the simulations) is about to fall. We can think of blocks of varying heights. No matter how tall a block is, if it is standing on a horizontal surface it will not fall until some external perturbation disturbs its equilibrium. I am confident that most human observers would predict this outcome as well. However, the MSG simulation would not produce this outcome. Instead, it would predict a non-zero probability of the block to tip over. A gravitational field that is not perpendicular to the base has the equivalent effect of a horizontal force applied on the block at the height corresponding to the vertical position of the center of gravity. Depending on the friction determined by the contact between the base of the block and the surface where it stands there is a critical height where any horizontal force being applied would cause the block to fall while pivoting about one of the edges at the base (the one opposite to where the force has been applied). This critical height depends on both the size of the base and the friction coefficient. For short objects this critical height is larger than the height of the object, so that object would not fall. But for taller blocks, this is not the case. Indeed, the taller the block the smaller the deviation from a vertical gravitational field is needed for a fall to be expected. The discrepancy between this prediction and the most likely outcome of the simple experiment I have just outlined makes the MSG model implausible. Note also that a gravitational field that is not perpendicular to the ground surface is equivalent to the force field experienced by the block while standing on an inclined plane. For small friction values, the block is expected to slide down the incline, therefore another prediction of this MSG model is that when we observe an object on a surface exerting negligible friction (think of a puck on ice) we should expect that object to spontaneously move. But of course, we don't, as we do not expect tall objects that are standing to suddenly fall if left unperturbed. In summary, a stochastic world model cannot explain these simple observations.

      The question remains as to how we can interpret the empirical data from the two experiments and their agreement with the predictions of the stochastic world model if we assume that the brain has internalized a vertical gravitational field. First, we need to look more closely at the questions posed to the subjects in the two experiments. In the first experiment, subjects are asked about how "normal" a fall of a block construction looks. Subjects seem to accept 50% of the time a fall is normal when the gravitational field is about 20 deg away from the vertical direction. The authors conclude that according to the brain, such an unusual gravitational field is possible. However, there are alternative explanations for these findings that do not require a perceptual error in the estimation of the direction of gravity. There are several aspects of the scene that may be misjudged by the observer. First, the 3D interpretation of the scene and the 3D motion of the objects can be inaccurate. Indeed, the simulation of a normal fall uploaded by the authors seems to show objects falling in a much weaker gravitational field than the one on Earth since the blocks seem to fall in "slow motion". This is probably because the perceived height of the structure is much smaller than the simulated height. In general, there are even more severe biases affecting the perception of 3D structures that depend on many factors, for instance, the viewpoint. Second, the distribution of weight among the objects and the friction coefficients acting between the surfaces are also unknown parameters. In other words, there are several parameters that depend on the viewing conditions and material composition of the blocks that are unknown and need to be estimated. The authors assume that these parameters are derived accurately and only that assumption allows them to attribute the observed biases to an error in the estimate of the gravitational field. Of course, if the direction of gravity is the only parameter allowed to vary freely then it is no surprise that it explains the results. Instead, a simulation with a titled angle of gravity may give rise to a display that is interpreted as rendering a vertical gravitational field while other parameters are misperceived. Moreover, there is an additional factor that is intentionally dismissed by the authors that is a possible cause of the fall of a stack of cubes: an external force. Stacks that are initially standing should not fall all of a sudden unless some unwanted force is applied to the construction. For instance, a sudden gust of wind would create a force field on a stack that is equivalent to that produced by a tilted gravitational field. Such an explanation would easily apply to the findings of the second experiment. In that experiment subjects are explicitly asked if a stack of blocks looks "stable". This is an ambiguous question because the stability of a structure is always judged by imagining what would happen to the structure if an external perturbation is applied. The right question should be: "do you think this structure would fall if unperturbed". However, if stability is judged in the face of possible external perturbations then a tall structure would certainly be judged as less stable than a short structure occupying the same ground area. This is what the authors find. What they consider as a bias (tall structures are perceived as less stable than short structures) is instead a wrong interpretation of the mental process that determines stability. If subjects are asked the question "Is it going to fall?" then tall stacks of sound structure would be judged as stable as short stacks, just more precarious.

      The RL model used as a proof of concept for how the brain may build a stochastic prior for the direction of gravity is based on very strong and unverified assumptions. The first assumption is that the brain already knows about the force of gravity, but it lacks knowledge of the direction of this force of gravity. The second assumption is that before learning the brain knows the effect of a gravitational field on a stack of blocks. How can the brain simulate the effect of a non-vertical gravitational field on a structure if it has never observed such an event? The third assumption is that from the visual input, the brain is able to figure out the exact 3D coordinates of the blocks. This has been proven to be untrue in a large number of studies. Given these assumptions and the fact that the only parameters the RL model modifies through learning specify the direction of gravity, I am not surprised that the model produces the desired results.

      Finally, the argument that the MGS is more efficient than the NGS model is based on an incorrect analysis of the results of the simulation. It is true that 80% accuracy is reached faster by the MGS model than the 95% accuracy level is reached by the NGS model. But the question is: how fast does the NGS model reach 80% accuracy (before reaching the plateau)?

    1. We’ve chosen to keep highlights private to avoid pages being cluttered by highlights that have no surrounding discussion. We understand that people may want to share highlights with others, and we think there are effective ways we can address that in the future.

      It's important to strike a balance between individual privacy and the desire for social sharing. Privacy concerns are valid, but so is the desire to share valuable or interesting highlights with others. Consider implementing privacy settings that allow users to control who can see their highlights, such as making them visible to specific friends or groups.

    1. At first, as we searched forrelevant studies only in English language, other potential studies written in differentlanguages were not included in our review.

      I think it is important to note a barrier such as this that not is not often thought of. There could be plenty of findings accomplished by research but if barriers are overlooked or disregarded then the most accurate findings may never be found. -CR, CM, KS

    1. Author Response

      The following is the authors’ response to the original reviews.

      We are very grateful to the reviewers for their insightful and detailed analysis of our work, in particular to reviewer 2. We also would like to thank the Elife editorial team for organizing this form of public review and debate, which we believe will be of interest to the science community.

      Reviewer #1 (Public Review):

      Despite durable viral suppression by antiretroviral therapy (ART), HIV-1 persists in cellular reservoirs in vivo. The viral reservoir in circulating memory T cells has been well characterized, in part due to the ability to safely obtain blood via peripheral phlebotomy from people living with HIV-1 infection (PWH). Tissue reservoirs in PWH are more difficult to sample and are less well understood. Sun and colleagues describe isolation and genetic characterization of HIV-1 reservoirs from a variety of tissues including the central nervous system (CNS) obtained from three recently deceased individuals at autopsy. They identified clonally expanded proviruses in the CNS in all three individuals.

      Strengths of the work include the study of human tissues that are under-studied and difficult to access, and the sophisticated near-full length sequencing technique that allows for inferences about genetic intactness and clonality of proviruses. The small sample size (n=3) is a drawback. Furthermore, two individuals were on ART for just one year at the time of autopsy and had T cells compatible with AIDS, and one of these individuals had a low-level detectable viral load (Figure S1). This makes generalizability of these results to PWH who have been on ART for years or decades and have achieved durable viral suppression and immune reconstitution difficult.

      While anatomic tissue compartment and CNS region accompany these PCR results, it is unclear which cell types these viruses persist in. As the authors point out, it is possible that these reservoir cells might have been infiltrating T cells from blood present at the time of autopsy tissue sampling. Cell type identification would greatly enhance the impact of this work. Several other groups have undergone similar studies (with similar results) using autopsy samples (links below). These studies included more individuals, but did not make use of the near-full length sequencing described here. In particular, the Last Gift cohort, based at UCSD and led by Sara Gianella and Davey Smith, has established protocols for tissue sampling during autopsy performed soon after death. https://pubmed.ncbi.nlm.nih.gov/35867351/ https://pubmed.ncbi.nlm.nih.gov/37184401/

      We agree with reviewer 1 that studies to identify specific cell types that harbor intact HIV-1 in individual tissue compartments would be very informative; our group has recently initiated such studies.

      Overall, this small, thoughtful study contributes to our understanding of the tissue distribution of persistent HIV-1, and informs the ongoing search for viral eradication.

      We thank reviewer 1 for these encouraging remarks.

      Reviewer #2 (Public Review):

      The manuscript by Sun et al. applies the powerful technology of profiling viral DNA sequences in numerous anatomical sites in autopsy samples from participants who maintained their antiviral therapy up to the time of death. The sequencing is of high quality in using end-point dilution PCR to generate individual viral genomes. There is a thoughtful discussion, although there are points that we disagree with. This is an important data set that increases the scope of how the field thinks about the latent reservoir with a new look at the potential of a reservoir within the CNS.

      We greatly appreciate the comments by reviewer 2 and would like to thank them for their detailed and very knowledgeable analysis of this paper.

      1) The participants are very different in their exposure to HIV replication and disease progression. Participant 1 appears to have been on ART for most of the time after diagnosis of infection (16 years) and died with a high CD4 T cell count. The other two participants had only one year on ART and died with relatively low CD4 T cell counts (under 200). This could lead to differences in the nature of the reservoir. In this regard, the amount of DNA per million cells appears to be about 10-fold lower across the compartments sampled for participant 1. Also, one might expect fewer intact proviruses surviving after 16 years on ART compared to only 1 year on ART. The depth of sampling may be too limited and the number of participants too few to assess if these differences are features of these participants because of their different exposures to HIV replication. On the positive side, finding similarities across these big differences in participant profiles does reinforce the generalizability of the observations.

      Many thanks for pointing this out. We also noticed that the total number of HIV-1 proviruses is smaller in our study participant 1 (who had been on ART for 16 years), compared to study persons 2 and 3 with more limited treatment durations (1-2 years), however, due to the small number of study persons, we think we cannot use these results for inferring how treatment duration influences viral reservoir size in tissues.

      2) The following analysis will be limited by sampling depth but where possible it would be interesting to compare the ratio of intact to defective DNA. A sanctuary might allow greater persistence of cells with intact viral DNA even without viral replication (i.e. reduced immune surveillance). Detecting one or two intact proviruses in a tissue sample does not lend itself to a level of precision to address this question, but statistical tests could be applied to infer when there is sampling of 5 or more intact proviruses to determine if their frequency as a ratio of total DNA in different anatomical sites is similar or different. This would allow adjustment for the different amount of viral DNA in different compartments while addressing the question of the frequency of intact versus defective proviruses. One complication in this analysis is if there was clonal expansion of a cell with an intact genome which would represent a fortuitous overrepresentation intact genomes in that compartment.

      We have performed the analysis suggested by reviewer 2 and included a diagram reflecting the ratio of intact/defective proviruses as a new supplemental figure (Figure S2). Unfortunately, we do not feel comfortable to draw any real conclusions from this additional analysis; the sample sizes are simply too limited.

      3) The key point of this work is that the participants were on therapy up to the time of death ("enforcing" viral latency). The predominance of defective genomes is consistent with this assumption. Is there data from untreated infections to compare to as a signature of whether the viral DNA population was under selective pressure from therapy or not? Presumably untreated infections contain more intact DNA relative to total DNA. This would represent independent evidence that therapy was in place.

      We agree that an analysis of autopsy samples from untreated persons living with HIV-1 would be of great interest, and are actively collaborating with neuropathologists from multiple sites to obtain such samples. Yet, we are not convinced that selection pressure on reservoir cells during ART can be appropriately identified through quantitative virological assays. Rather, we feel that the selection of proviruses can be best assessed when qualitative parameters, including proviral integration sites and their position relative to host epigenetic chromatin features, are evaluated.

      4) There are several points in Figure 5 to raise about V3 loop sequences. The analysis includes a large number of "undetermined" sequences that did not have a V3 loop sequence to evaluate. We would argue it is a fair assumption that the deleted proviruses have the same distribution of X4 and R5 sequences as the ones that have a V3 sequence to evaluate. In this view it would be possible to exclude the sequences for which there is no data and just look at the ratio of X4 and R5 in the different compartments, specifically does this ratio change in a statistically significant way in different compartments? The authors use "CCR5 and non-CCR5" as the two entry phenotypes. The evidence is pretty strong that the "other" coreceptor the virus routinely uses is CXCR4, and G2P is providing the FPR for X4 viruses. Perhaps the authors are trying to create some space for other coreceptors on microglia, but we are pretty sure what they are measuring is X4 viruses, especially in this late disease state of participant 2. Finally, we have previously observed that the G2P FPR score of <2 is a strong indicator of being X4, FPR scores between 2 and 10 have a 50% chance of being X4, and FPR scores above 10 are reliably R5 (PMID27226378). In addition, we observed that X4 viruses form distinct phylogenetic lineages. The authors might consider these features of X4 viruses in the evaluation of their sequences. Specifically, it would be helpful to incorporate the FPR scores of the reported X4 viruses.

      Many thanks for these thoughts. We have now included FPR scores for all sequences and considered sequences with FPR score <2 as X4-tropic. Among 497 proviral sequences derived from all three participants, only 14 proviral sequences had FPR scores between 2 and 10 and their tropism was classified as CCR5 in the new Figure 5. We agree that viral tropism analysis of proviral sequences from the CNS would be of particular interest for study subject 2; however, most brain-derived sequences from that person had large deletions in the env region, precluding an analysis of viral tropism.

      5) We have puzzled over the many reports of different cell types in the CNS being infected. When we examined these cell types (both as primary cells and as iPSC-derived cells), all cells could be infected with a version of HIV that had the promiscuous VSV-G protein on the virus surface as a pseudotype. However, only macrophages and microglia could be infected using the HIV Env protein, and then only if it was the M-tropic version and not the T-tropic version (PMID35975998). RNAseq analysis was consistent with this biological readout in that only macrophages and microglia expressed CD4, neurons and astrocytes do not. From the virology point of view, astrocytes are no more infectable than neurons.

      We appreciate these comments. As described in our discussion, we agree that the role of astrocytes as target cells for HIV-1 infection is highly controversial; we look forward to future opportunities to evaluate HIV sequences in sorted astrocytes from autopsy tissues.

      6) The brain gets exposed to virus from the earliest stages of infection but this is not synonymous with viral replication. Most of the time there is virus in the CSF but it is present at 1-10% of the level of viral load in the blood and phylogenetically it looks like the virus in the blood, most consistent with trafficking T cells, some of which are infected (PMID25811757). The fact that the virus in the blood is almost always T cell-tropic in needing a high density of CD4 for entry makes it unlikely that monocytes are infected (with their low density of CD4) and thus are not the source of virus found in the CNS. It seems much more likely that infected T cells are the "Trojan Horse" carrying virus into the CNS.

      We appreciate the reviewer’s referral to Greek mythology and agree that the hypothesis of infected T cells acting as “Trojan horses” is more intuitive and better supported by available data. We have adjusted our discussion accordingly.

      7) While all participants were taking antiretroviral therapy at the time of their death, they were not all suppressed when the tissues were collected. The authors are careful not to mention "suppressive ART" in the text, which is appreciated. However, the title should be changed to also reflect this fact.

      Thanks for pointing this out. From our perspective, ART is never fully suppressive, as low-level viremia (below the detection threshold of commercial PCR assays) is detectable in almost all ART-treated persons. As such, it is not clear to us that “suppressive” necessarily implies suppression below the detection limits of commercial PCRs. We argue that ART can also be suppressive when plasma viral loads are in the range of 100 copies/ml, as they are in our study subject 3. Nevertheless, we have changed the title to avoid confusion.

      Reviewer #1 (Recommendations For The Authors):

      I encourage the authors to compare their autopsy and tissue sampling procedures to those used by The Last Gift researchers and consider including references to this ongoing study. If the authors plan to continue in this line of research, the field would greatly benefit from a collaboration that would bring together their excellent and advanced PCR technique with the larger sample size offered by The Last Gift. Lastly, is there some way to simultaneously determine cell type when NFL sequencing is performed?

      We look forward to collaborating with investigators from the Last Gift Cohort in the future and have integrated additional references in the manuscript to acknowledge their work. At the current stage of technology development, we think that sorting of infected cells based on canonical markers of defined cell populations is the preferred approach for identifying phenotypic properties of infected cells; however, expansion of the PheP-Seq assay (Sun et al., Nature 2023), may facilitate this process in the future.

      Reviewer #2 (Recommendations For The Authors):

      1) The authors have chosen to lump all R5 viruses together in terms of their entry phenotype, giving all viruses an equal chance of infecting all potentially susceptible cell types. This ignores the fact that normal HIV is selected to infect cells, requiring a high density of CD4 as is found on T cells. We use the term R5 T cell-tropic to describe "normal" HIV. The ability to efficiently enter cells that have a low density of CD4, such as macrophages and microglia, involves the evolution of a distinct phenotype, termed macrophage tropism (PMID24307580, and work of others). This happens most often in the CNS where T cells are infrequent thus potentiating evolution to infect an alternative cell type. This change in entry phenotype is dramatic and, like X4 viruses, results in phylogentically distinct lineages (PMID22007152). There are no sequence signatures for M-tropic viruses as there are for X4 viruses, but the fact that there are sequences shared between the CNS and lymphoid tissue makes it much more likely that there are T cells migrating around the body, including into the CNS, that are carrying R5 T cell-tropic virus with them, with the cells potentially clonally expanding in situ in the CNS. The persistence of a potential CNS T cell reservoir was the point we were trying to make in our recent paper (ref. 38), not only that these CSF rebound viruses were R5 viruses but they were selected for replication in T cells as seen by their dependence of a high density of CD4 for entry. This is the conclusion one would reach if clonally expanded viral sequences were shared between two lymphoid compartments. It is not necessary to ascribe properties of infection and clonal amplification to microglia cells when a more parsimonious explanation is that there are low levels of T cells in the CNS, especially in the absence of entry phenotype data showing these sequences encode an M-tropic entry phenotype. As is the authors are just adding to the unproven belief that virus in the CNS must be in myeloid cells, which in this case in particular we suspect is the wrong interpretation.

      We are impressed by reviewer 2’s recent work, suggesting the viral reservoir in the CNS may primarily consist of clonally-expanded R5 T-cell tropic viruses. We have adjusted our discussion to emphasize this possibility, and to highlight that viral entry phenotyping data will be informative for better understanding viral persistence in the brain.

      2) The authors noted that the frequency of intact proviruses is highest in the lymph nodes of 2/2 participants for which they had lymph node samples, relative to the other tissues examined. They thus conclude, "Together, these results indicate that intact HIV-1 proviruses are preferentially detected in lymphoid and gastrointestinal (GI) tissues." However, an examination of Figure 2 reveals that the total HIV copy number is highest in the lymph nodes of these two people. Thus, it doesn't seem like HIV is preferentially intact in the lymph nodes as much as they sampled more provirus from that tissue and therefore were able to detect more intact proviruses.

      We have adjusted our manuscript to indicate that the highest numbers of intact HIV-1 proviruses were present in lymph nodes, both in terms of absolute numbers and after normalization to the total numbers of cells analyzed.

      3) In Figure 1A, the legend should be changed so that "PMSC" is spelled out as "premature stop codon" for ease of reading. This is done for Figure 1B.

      We have corrected this issue as suggested by the reviewer.

      4) The pie charts in Figure 5 could be better labeled for ease of interpreting. In Figure 5C, instead of just labeling it as "P2" it could be "Distribution of CXCR4-using proviruses, P2", as an example. As it stands, it is hard to know what the figure is describing without reading the text.

      We have changed this accordingly.

      5) While all participants were taking antiretroviral therapy at the time of their death, they were not all suppressed when the tissues were collected. The authors are careful not to mention "suppressive ART" in the text, which is appreciated. However, the title should be changed to also reflect this fact.

      Thanks for pointing this out. From our perspective, ART is never fully suppressive, as low-level viremia (below the detection threshold of commercial PCR assays) is detectable in almost all ART-treated persons. As such, it is not clear to us that “suppressive” necessarily implies suppression below the detection limits of commercial PCRs. We argue that ART can also be suppressive when plasma viral loads are in the range of 100 copies/ml. Nevertheless, we have changed the title to avoid confusion.

      Editorial comments:

      In addition to the reviewers suggestion, we feel that adding more information on how you define intact proviral sequence, e.g. are only disrupted essential genes or also in accessory genes considered? Previous studies have shown that brain-derived HIV-1 strains are usually CCR5-tropic, show high affinity for the CD4 receptor and frequently contain defective vpu genes. Some information and discussion if the brainderived sequences confirm these previous finding seems of significant interest.

      As described in our previous work (e. g. Lee et al, JCI 2017; Jiang et al, Nature 2020), accessory genes are not considered in our definition of “genome intactness”; this is consistent with approaches other investigators have chosen (e. g. Hiener et al, Cell Reports 2017). Within the genome intact sequences we identified in the CNS in our study persons, we found no evidence for deletions of vpu sequences; this has been emphasized in the revised manuscript.

    1. Author Response

      We thank the reviewers and editors for their deep, thoughtful and constructive assessment of our manuscript. We nevertheless would like to reply to the Reviewers reports.

      Reviewer #1.

      (...) The data can be well described by three components involving a closed state and two open states O1 and O2, in which the second component O2 is the one affected by the mutations and deletions

      This statement is not completely clear to us. What we propose is that O1 is not visible in WT, only in the mutants. What would be affected is the access to O1 and the transition between O1 and O2, but not O2 itself.

      From the beginning, it becomes challenging for non-experts to grasp the structural basis of the perturbations that are introduced (ΔPASCap and E600R), because no structural data or schematic cartoons are provided to illustrate the rationale for those deletions or their potential mechanistic effects. In addition, the lack of additional structural information or illustrations, and a somewhat confusing discussion of the structural data, make it challenging for a reader to reconcile the experimental data and mathematical model with a particular structural mechanism for gating, limiting the impact of the work.

      Thank you very much for pointing this out and our apologies for the missing cartoon. It will be provided in the revised version.

      There are several concerns associated with the analysis and interpretations that are provided. First, the conductance-voltage (G-V) relations for the mutants do not seem to saturate, and the absolute open probability is not quantified for any mutant under any condition. This makes it impossible to quantitatively compare the relative amplitudes of the two components because the amplitude of the second component remains undetermined. […] This reduces confidence in the parameters associated with G-V relations, as the shape and position of both components might change significantly if longer pulses were used.

      We agree that the endpoint of activation is ill-defined in the cases where a steady-state is not reached. This does indeed hamper quantitative statements about the relative amplitude of the two components. However, while the overall shape does change, its position (voltage dependence) would not be affected by this shortcoming. The data therefore supports the claim of the “existence of mutant-specific O1 and its equal voltage dependence across mutants.”

      Further, because the mutant channel currents do not saturate at the most positive potentials and time intervals examined, the kinetic characterization based on reaching 80% of the maximum seems inappropriate, because the 100% mark is arbitrary.

      We agree that the assessment of kinetics by a t80% is not ideal. We originally refrained from exponential fits because they introduce other issues when used for processes that are not truly exponential (as is the case here). To address the concerns, we will add time constants from these fits in the revised version. Please note that in Figure 3, we do provide time constants, and they support the statement made.

      Further, the kinetics for some of the other examined mutants (e.g. those in Fig. 2A) are not shown, making it difficult to assess the extent to which the data could be affected by having been measured before full equilibration.

      This seems to be a misunderstanding. ∆2-10 kinetics is shown in Fig. 2c. ∆-eag is shown in Fig. 3. We will make sure to state this explicitly in the revised version.

      For example, I would expect that the enhanced current amplitudes from Figure 5 are only transient, ultimately reaching a smaller steady-state current magnitude that depends only on the stimulation voltage and is independent of the pre-pulse. The entire time course including the rise-time and decay is not examined experimentally. This raises concern on whether occupancy of state O1 might be overestimated under some experimental conditions if a fraction of the occupancy is only transient. The mathematical model is not utilized to examine some of these slower relaxations - this may be because the model does not reproduce these slow processes, which would represent a serious shortcoming given that the slow kinetics appear to be intrinsic to transitions around state O1.

      Thank you for thinking so deeply about the problem. We identified the same questions and did explore them using the model (Figure 8 c). Your intuition is confirmed there, the slow kinetics leads to a decrease of O1 occupancy after a transient accumulation. We intend to study this experimentally as well in the revised version.

      The significance of the results with the Δ2-10.L341Split is unclear. First, structural as well as functional data has established that the coupling of the voltage sensor and pore does not entirely rely on the S4-S5 linker, and thus the Split construct could still retain coupling through other mechanisms, which is consistent with the prominent voltage dependence that is observed. If both state O1 and O2 require voltage sensor activation, it is unclear why the Split construct would affect state O1 primarily, as suggested in the manuscript, as opposed to decreasing occupancy of both open states.

      Thank you for pointing out the unclear nature of our arguments. We rephrase in the following and will do so in the revised document: If, in non-split mutants, the upward transition of S4 allows entry to O1, it is reasonable to assume that the movement is not transmitted the same way in the split and the transition into O1 is less probable. The observation that, in the split, entry into O1 requires higher depolarization and appears to be less likely, suggests that downstream of S4 (beyond position 342), there is a mechanism to convey S4 motion to the gate of the mutants.

      The figure legends and text do not describe which solutions exactly were utilized for each experiment, [...] Because no zero-current levels are shown on the current traces, it becomes very hard to determine which voltages correspond to each of the currents (see Fig. 1A).

      Will be corrected.

      … the rationale for choosing some solutions over others is not properly explained. […] The reversal potential for solutions used to measure voltage-activation curves falls right at the spot where occupancy of the first component peaks (e.g. see Figure 1B). […] It is unclear whether any artifacts could have been introduced to the mutant activation curves at voltages close to the reversal potential.

      The high potassium extracellular solution was chosen to obtain tail currents of sufficient size, warranting precise determination of the reversal potential for every individual experiment. In this way, we ensured that there were no artifacts introduced to the activation curves. Tail currents were used when closing was reasonably fast (∆PASCapL322H and E600RL322H), but otherwise, we used the amplitude at the end of the pulse to get the reversal potential.

      One key assumption that is not well-supported by the data pertains to the difference in single-channel conductance between states O1 and O2 - no analysis or discussion is provided on whether the data could also be well described by an alternative model in which O1 and O2 have the same conductance. No additional experimental evidence is provided related to the difference in conductance, which represents a key aspect of the mathematical model utilized to interpret the data.

      We agree that the relative conductance of O1 and O2 is a key point. Our proposal mainly stems from the data presented in Fig. 4 and the amplitudes of the two components of the tail at potentials where both states are visible. We also agree that whole cell currents represent a product of occupancy and conductance and that only single channel recordings can produce unambiguous proof for the higher conductance of O1. We have embarked on a series of experiments directly addressing this in the mutants that will be reported in the revised version. Still, we did explore this issue with the model. Following the path of the least number of assumptions, we initially tested models with equal conductance for both states. None of these models was able to reproduce the shape of the tails and the prepulse-dependent increase.

      The CaM experiments are potentially very interesting and could have wide physiological relevance. However, the approach utilized to activate CaM is indirect and could result in additional non-specific effects on the oocytes that could affect the results.

      Thank you for the appreciative comments about the relevance of our results. We are aware of the potential side effects of the use of thapsigargin and ionomycin, but we still used this approach as an established method to raise intracellular Ca2+. This said, we would like to point out that the effects of Ca2+ increase on channel behavior do revert with a time course that mirrors the estimated time course of Ca2+ itself (supplement 1 to figure 7), suggesting that we are monitoring a Ca2+-dependent event.

      The description of the mathematical model that is provided is difficult to follow, and some key aspects are left unclear, such as the precise states from which state O1 can be accessed, and whether there is any direct connectivity between states O1 and O2 - different portions of the text appear to give contradictory information regarding these points.

      This seems to be a misunderstanding: supplement 1 to figure 8 graphically details the model’s layout and explicitly shows the connections to the two open states. It also shows that these are not connected. We will make sure that the text is more clearly stating this fact. We did explore models with one open state connected to more than one other state (loops) and found that none of these models can reproduce the large range of depolarizations for with conductance is reduced as compared to lower and higher depolarization (Figure 1).

      Several rate constants other than those explicitly mentioned to represent voltage sensor activation are also assigned a voltage dependence - the mechanistic basis of that voltage dependence is unclear.

      Some fundamental properties we observed in the mutants can be explained with constant, voltage-independent rate constants into and out of both open states. Specifically, it was possible to achieve behavior very close to that displayed in Figure 8c with constant η, θ, ε, and ζ. We then attempted to also reproduce the strong prepulse-dependence (Figure 6A and B) and found that we needed additional degrees of freedom to incorporate both behaviors with one parameter set. We could either add more states, and thereby rates, or introduce voltage dependence to η and θ. With already 32 states and 10 rates, we decided to adopt the less complex model variant. We agree that this probably reduced the interpretability of the model. As a rule, a transition with a voltage-dependence of the functional form of Eq.1 corresponds to the kinetic properties of two or three transitions, where one is voltage-independent (setting the maximal rate) and one has the classical exponential shape expected from truly molecular transitions.

      We also agree that, conceptually, the transitions between the two layers – tentatively associated with a transition in the ring structure– should be voltage-independent. Interestingly, their voltage dependence is very similar to the voltage dependence of the early activation, i.e. centered at -100 and -120mV, similar to β. We therefore attempted to replace the voltage dependence of κ and λ with a state-dependence. To this end, we introduced a parameter that modified κ and λ depending on the state’s position along the α-β axis. While it seemed possible to include all desired features in a model with state-dependent κ and λ, it proved extremely difficult to tune the parameters. Eventually, we reverted to purely voltage-dependent and not state-dependent transition rates κ and λ. Nevertheless, we believe that their voltage dependence could be replaced by some form of state-dependence, i.e. by rates κ and λ that change systematically from the left-hand side of the scheme to its right-hand side.

      Finally, a clear mechanistic explanation for the full range of effects that the ΔPASCap and E600R mutants have on channel function is lacking, as well as a detailed description of how those newly uncovered transitions would influence the activity of the WT channel.

      We agree. Ultimate mechanistic explanations will have to await data from protein structures of intermediate states and in particular the mutant-specific open state.

      …as well as a detailed description of how those newly uncovered transitions would influence the activity of the WT channel; this latter point is important when considering whether the findings in the manuscript advance our understanding of the gating mechanism of Kv10 channels in general, or are specific to the particular mutants that are studied.

      We still do not know if the transitions to O1 are identical in the mutants and WT, although our data opens the path to dissecting the interplay of intracellular domains and voltage sensor. We think that the results are relevant for KCNH channels in general because we have made visible otherwise invisible states.

      It is unclear, for example, how both the mutation or the deletion at the cytoplasmic gating ring enable conduction by state O1, especially when considering the hypothesis put forward in this study that transition to O1 exclusively involves transitions by the voltage sensor and not the cytoplasmic gating ring.

      The transition to O1 is in our model made possible by a displacement of the voltage sensor. In our view, when this occurs with a properly folded and positioned intracellular ring, permeation (access to O1) is precluded. It is precisely the distortion in the intracellular ring induced by mutation or deletion what allows access to O1.

      It is also not clearly described whether a non-conducting state with the equivalent state-connectivity as O1 can be accessed in WT channels, or if a state like O1 can only be accessed in the mutant channels. Importantly, if a non-conducting state with the same connectivity to O1 were to be accessed in WT channels, it would be expected that an alternating pulse protocol as in Fig. 4 would result in progressively decreasing currents as the occupancy of the non-conducting state equivalent to O1 is increased. Because this is not the case, it means that mutation and deletion cause additional perturbations on the gating energetics relative to WT, which are not clearly fleshed out.

      Thank you for highlighting this important question. Following the arguments in the answer to the previous comment, our experiments cannot provide proof for the existence or accessibility of O1 in WT channels. We favor the interpretation that it is not accessible, because, as you point out, this is supported by the outcome of the alternating pulse on WT (figure 4A) and the paradoxical effect of CaM activation. However, this interpretation hinges on the hypothesis that the kinetics of entry into and departure from O1 would be the same in WT channels, as it is in the mutants. Because transitions into a non-conducting O1 would be only indirectly observable in the WT channel, this assumption would be extremely difficult to test.

      Reviewer #2.

      WT EAG currents are far right shifted compared to previously published data. It is not clear whether it is the recording conditions but at 0 mV very few channels are open. Compare this with recordings reported previously of the same channel hEAG1 by Gail Robertson's lab (Zhao et. al. (2017) JGP). In that case, most of the channels are open at 0 mV. There must be at least 25 mV shift in voltage-dependence. These differences are unusually large.

      G-V curves presented in the literature show a large variability. Depending on the conditions, reported V1/2 values in Xenopus oocytes range from -43 mV (Schönherr et al., 2002 DOI: 10.1016/s0014-5793(02)02365-7) to +16 mV (Lörinczi et al, 2015 DOI: 10.1038/ncomms7672) through +4.1 mV (Lörinczi et al., 2016 DOI: 10.1074/jbc.M116.733576), or +10 mV (in the IUPHAR database). The results in the current manuscript are not significantly different from our previously published results on WT channels. In the report the reviewer is referring to, one source of the difference could be that Zhao et al. had no independent information about the reversal potential. In our experiments, we used solutions with high [K]ext. This places the reversal potential in a voltage range within measurable eag currents and thus allows direct determination of the reversal potential, together with the slow kinetics of the tails and the negative shift in the activation. We would argue that this makes the G-V curves less prone to assumptions, albeit for the price of large error bars around the reversal potential. Additionally, the presence of Mg2+ in the extracellular solutions can change the apparent V1/2 depending on the stimulation protocol.

      In most of the mutants, O2 state becomes more prevalent at potentials above +50 mV. At these potentials, endogenous voltage-dependent currents are often observed in xenopus oocytes. The observed differences between the various mutants might simply be a function of the expression level of the channel versus endogenous currents.

      Because we were aware of the potential issue of endogenous chloride currents in oocytes, we included data recorded in chloride-free solutions. Those show comparable results, and thus we conclude that endogenous currents are not the origin of the differences between mutants. We will clarify which solutions were used in the figure legends of the revised version and also include the argument against sizable endogenous current contributions in the revision. In a separate line of experiments, we expressed some of the mutants in HEK cells. Despite small current amplitudes, we were able to replicate the findings of two components, providing oocyte-independent evidence for the existence of a second open state.

      Voltage-dependence of the kinetics of WT currents appears a bit strange. Why is the voltage-dependence saturated at 0 mV even though very few channels have activated at that point? I cannot imagine any kinetic model that can lead to such unusual voltage-dependence of kinetics.

      The fact that voltage dependence of open probability and voltage dependence of activation time constant do not align reflects the multi-state nature of the underlying gating scheme. More than one of several sequential transitions limit the overall kinetics. In this case, the apparent kinetics can reflect a different “bottleneck” transition at different voltage ranges.

      One of the other concerns I have is that in many cases, it is clear that the pulse is too short to measure steady-state voltage-dependence. For instance, the currents in -160 mV and -100 mV in Figure 6A and 6B are not saturated.

      While we agree that steady-state curves can simplify quantitative evaluation – especially the normalization applied in the I/Imax curves in figure 6 – the conclusion of two components is independent of the absolute amplitude under steady state. The fact that in the raw current traces in Figure 6A, after a -160V prepulse, the same current amplitude is reached for two depolarizations (60 and 90 mV) but not for the intermediate depolarization, can only be explained by an I-V curve that has a minimum. Therefore, the raw data directly support the evidence of finding two components, even if the subsequent analysis is affected by insufficient test pulse durations.

      Reviewer #3

      Although very well established, the experimental conditions used in the present manuscript introduce uncertainties, weakening their conclusions and complicating the interpretation of the results. The authors performed most of their functional studies in Cl-based solutions that can become a non-trivial issue when the range of voltages explored extends to very depolarizing potentials such as +120mV. Oocytes endogenously express Ca2+-activated Cl- channels that will rectify Cl- at very depolarizing potentials -due to an increase in the driving force- and contribute dramatically to the current's amplitude observed at the test pulse in the voltage ranges where the authors identify the second open state.

      As stated above, because we were aware of the potential issue of endogenous chloride currents in oocytes, we performed many of the experiments in chloride-free solutions. We conclude that endogenous currents are not the origin of the differences between mutants because the results were comparable regardless of the presence of chloride. We will clarify which solutions were used in the figure legends of the revised version and also include the argument against sizable endogenous current contributions in the revision. In a separate line of experiments, we expressed some of the mutants in HEK cells. Despite small current amplitudes, we were able to replicate the findings of two components, providing oocyte-independent evidence for the existence of a second open state.

      The authors propose a two-layer Markov model with two open states approximating their results. However, the results obtained with the mutants suggest an inactivated state accessible from closed states and a change in the equilibrium between the close/inactivated/open states that could also explain the observed results; therefore, other models could approximate their data.

      In the process of model development, we tested a large number of configurations. Those included models with a single open state which we connected to two closed (or inactivated) states that were not directly connected to each other and populated at different voltage ranges. In doing so, we attempted to allow access to the single open state from different regions of the “state-space”, reflecting the two voltage ranges of high conductance. However, in our hands, such a “loop” in the state-space inadvertently leads to a weak separation of the two states and a weak effect of prepulse potentials. The underlying reason is that given the short activation and deactivation time constants, a single open state in a loop provides an effective short-cut, linking otherwise separated parts of the state-space. To achieve the clear separation of the two component’s voltage dependence, two open states that are not connected to each other were essential. As we wrote in response to other comments above, the ultimate proof of two different open states cannot come from modeling, but from single channel measurements.

    1. AbstractWhile Bacterial Artificial Chromosomes were once a key resource for the genomic community, they have been obviated, for sequencing purposes, by long-read technologies. Such libraries may now serve as a valuable resource for manipulating and assembling large genomic constructs. To enhance accessibility and comparison, we have developed a BAC restriction map database.

      This work has been published in GigaByte Journal under a CC-BY 4.0 license (https://doi.org/10.46471/gigabyte.93), and has published the reviews under the same license. These are as follows.

      **Reviewer 1. Po-Hsiang Hung **

      Are all data available and do they match the descriptions in the paper?

      No. The dataset in FTP includes all the Bac sequences and the restriction enzyme recognition sites in csv files. However, I could not find the database of pairs of BACs, which have overlaps generated by restriction enzymes that linearize the BACs. The makePairs function gave me an error when I tried running it locally, so I was not able to verify what is in these datasets. Personally, I find this function to be one of the most useful features described in this manuscript.

      Are the data and metadata consistent with relevant minimum information or reporting standards? See GigaDB checklists for examples http://gigadb.org/site/guide

      Yes. This manuscript contains the necessary minimal information (Submitting author, Author list, Dataset title, Dataset description, and Funding information)

      Is there sufficient detail in the methods and data-processing steps to allow reproduction?

      No. The authors provide their code in GitHub such that researchers can download the datasets and analyze the sequences locally. However, I felt that the descriptions in the readme.md file is often insufficient to reproduce the data presented in the manuscript, especially for researchers with little to no programming experience. Detailed information includes examples of how to use each function, the input format, and the location of the output folder/files. I also encountered software version issues during the installation of bacmapping. Please re-test the code in a new environment and describe all the versions of each software. For instance, I found Python version 3.11 is incompatible with this package while Python version 3.7 is compatible.

      Is there sufficient data validation and statistical analyses of data quality?

      No. The author used the BioRestriction class from Biopython to get the digestion site information. No extra validation is conducted in this manuscript. Due to the errors I encountered in re-running the code (see details in Any Additional Overall Comments to the Author), an independent method for checking several digestion sites in some Bac clones is suggested. The suggested independent method is to do enzyme digestion on some Bac clones or upload some Bac sequences to other software and compare the digestion sites.

      In the output files that contain the digestions sites for each enzyme, some of the enzyme digestion sites are either NA or []. What is the difference between the two? If they mean the same thing (no cutting by the enzyme), bugs or other coding errors may cause this inconsistency. Please check the code again and also verify some of them using the independent methods suggested above. Examples of this issue are the files in maps>sequenced>CEPHB. Here I list two enzymes that show different results in each file: 3.csv : Ragl ([]), SchI (NA) 6.csv: EspEI (NA), AccII([]) 13.csv: EcoT22I ([]), Hsp92II (NA) X.csv: PacI ([]), AcIWI (NA)

      Is the validation suitable for this type of data?

      No. No validation in this manuscript. See the answer above.

      Additional Comments: The authors make a database with enzyme digestion site information of Bac clones to help people to use the Bac clones for further usage. I think it is useful to have this information and also have the code to do further analysis locally. Thus, I think providing a very detailed user manual (or readme.md) is very important to help people use this dataset. Below I summarized the issues I encountered in running codes and also some suggestions. Major points: (1) I tested some bacmapping functions, and I discovered that some functions are not working as intended due to typos/bugs - The version of the software is required to help people properly install this package - Refining the code and also providing a better user manual is very helpful for people without a lot of coding experience to use it. The detailed information includes examples of how to use each function, the input format, and the location of the output folder/files. Descriptions for some functions in the readme file are not detailed enough and often do not describe what the input needs to be. For example, getCuts() require ‘row’ as input. But the author never gives a detailed description of what ‘row’ is in the readme file. I had to look in bacmapping.py to understand what ‘row’ is. If a function requires the variable ‘row’, show a few examples of how ‘row’ can be extracted from the proper input file. - mapPlacedClones() requires an input file (‘/home/eamon/BACPlay/longboys.csv’, line 335) that is located in the author’s local computer and is not available through github. - Typo in line 814 in getMap(). Should be: name = cloneLine[‘CloneName’] - Inconsistency in output variable type in getMap() (line 830 and 851). When local == ‘sequenced’, the output variable is a tuple, which causes issues in downstream functions such as getRestrictionMap() (line 869). (2) Add pairs of BACs into the dataset (3) The output file of digestion sites of each enzyme, some of the enzyme digestion sites showed NA or [ ]. Please double-check this and explain the differences (4) Validation of an independent method for the digestion map is suggested

      Minor points: (1) Add a title to each column of sequencedStats.csv is useful for understanding the table easier

      Re-review:

      The authors have addressed majority of my points. The software installation works great after considering version control. The updated read.me provide detailed information for each function and their required input variables, and the examples in jupyter notebook are a great help for running the code. I did, however, encounter two minor errors when I tested the Ch19_bacmapping_example.ipynb on a Mac system. Please check this and update it.

      (1)The .DS_store file that is automatically generated on a Mac system in the bacmapping/Examples/Ch19_example/maps/placed folder causes an error when running bmap.mapPlacedClones(cpustouse=cpus, chunk_size=chunksize). The same problem happened when I ran bmap.mapSequencedClones(cpustouse=cpus). After I deleted .DS_store in the folder, the code worked.

      Here is the error message when I ran bmap.mapSequencedClones(cpustouse=cpus). NotADirectoryError: [Errno 20] Not a directory: '/Users/user_nsame/bacmapping/Examples/Ch19_example/maps/sequenced/.DS_Store'

      (2) The second error is from running bmap.getRestrictionMap(name,enzyme). I got the error message, 'list' object has no attribute 'item'. I was able to run this function after changing maps[enzyme].item() to maps[enzyme] in line 779 of bacmapping.py. I encountered the same error with the drawMap function. I was able to run to run this function after changing line 847 of bacmapping.py from rmap = maps[nenzyme].item() to rmap = maps[nenzyme].item().

      Here is the error message

      AttributeError Traceback (most recent call last) Cell In[20], line 5 3 maps = bmap.getMaps(name) 4 #print(maps) #this is a big dataframe of all the maps, uncomment to check it out ----> 5 rmap = bmap.getRestrictionMap(name,enzyme) 6 print('Sites in ' + name + ' where ' + enzyme + ' cuts: '+ str(rmap)) 7 plt = bmap.drawMap(name, enzyme)

      File ~/miniconda3/envs/bacmapping/lib/python3.11/site-packages/bacmapping/bacmapping.py:779, in getRestrictionMap(name, enzyme) 777 maps = getMaps(name) 778 nenzyme, r = getRightIsoschizomer(enzyme) --> 779 return(maps[nenzyme].item())

      AttributeError: 'list' object has no attribute 'item'

      **Reviewer 2. Wei Dong **

      Is there sufficient data validation and statistical analyses of data quality? Not my area of expertise

      Is the validation suitable for this type of data? I am not sure about this.This is not my specialty.

      Overall comments: This is a great idea, fully exploring, integrating, and utilizing existing data for new research.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Please find enclosed our revised manuscript entitled “An unconventional gatekeeper mutation sensitizes inositol hexakisphosphate kinases to an allosteric inhibitor”. We would like to thank the editorial team and the reviewers for carefully reading the manuscript and for raising a number of valuable points. We have included additional data and discussion to address the questions raised. Please find the point-by-point responses below.

      Reviewer #1:

      1) While I understand that FMP-201300 is a tool (proof-of-concept) compound it would be useful to know if it has activity against IP6K1 (or IP6K2) in cells.

      We were of course curious about this as well. Unfortunately, our attempts to generate cell lines in which IP6K1 or IP6K2 carry the gatekeeper mutation using CRISPR/Cas editing have not been successful so far. Nevertheless, to obtain information on the permeability and cellular activity of FMP-201300, we decided to treat wt cells, since the compound also inhibited IP6K1-wt and IP6K2wt at higher concentrations.

      In a previous study, we could show that reduced intracellular 5PP-InsP5 levels lead to a decrease in rRNA synthesis (https://doi.org/10.1101/2022.11.11.516170). We now repeated this experiment with FMP-201300, along-side the known IP6K inhibitors TNP and SC-919, and could show that FMP-201300 it is able to reproduce this phenotype, strongly suggesting it is capable to diffuse through the cell membrane and act on IP6Ks. We have included this data as a new Figure (Figure S10) and in the discussion part of the manuscript.

      2) Did the authors try docking studies to gain insight into the binding site of FMP-201300?

      The reviewer raises an important point, and we indeed strongly considered docking studies during the progress of the project. However, given that the HDX-MS data show that the region around the αC-helix becomes much more flexible upon introducing the gatekeeper mutation, we were concerned that docking studies (which would be based on the static wt structure) may not accurately reflect the more dynamic state of the mutated IP6K.

      Upon consulting with our colleagues with expertise in docking and molecular dynamics simulations, we believe that MD simulations would need to be performed to obtain a more realistic picture of this protein ligand interaction, which we would like to pursue in the future.

      3) Regarding the SAR, it would be useful to know if both carboxylic acids are required for allosteric inhibition.

      Given the available data, it appears very likely that both carboxylic acids are required for the inhibitor to unfold its potency. Compound A2, which only contained one carboxylate group, showed drastically reduced potency. We have altered the text in the main manuscript to get this point across more clearly.

      4) It would be helpful if the authors presented a model for how they think the Leu210 to Valine mutation sensitizes IP6K1 to FMP-201300.

      We agree that it is important to better visualize the structural factors that play a role in the sensitization towards the compound. We have generated a new Figure 5 (and the old Figure 5 is now Supplementary Figure 9), and added a section to demonstrate how we propose the mutation leads to the sensitization of IP6K1 to FMP-201300. For a better understanding, we have also included a depiction how the mutation already affects the apo structures. Furthermore, we have added some text in the HDX section, to better describe the proposed mechanism.

      Minor:

      1) Figure 4: The authors should use the same units in panels a and b.

      Thank you for pointing this out, the figure was edited accordingly.

      2) In the supplementary Excel file, it would be helpful to include a tab that contains a legend.

      A contents page was added to help describe the layout of the supplementary Excel file.

      Reviewer #2:

      Overall, this is an excellent study of high quality. The identified FMP-201300 has the potential for further compound and probe development. My only minor comment is that the authors could spend more time discussing the proposed allosteric binding mode of FMP-201300 and provide more detailed figures to highlight the proposed interactions with the protein and the conformational changes that must ultimately take place to accommodate the allosteric modulator. I appreciate that the co-crystallization experiments did not yield bound inhibitor structures, but perhaps the authors could consider MD simulations to complete their study. However, that could be a story in itself and should not be a must for the publication of this great work.

      We agree with the reviewer (and also reviewer 1) that it is important to better visualize the structural factors that play a role in the sensitization towards the compound. We have generated a new Figure 5 (and the old Figure 5 is now Supplementary Figure 9), and added a section to demonstrate how we propose the mutation leads to the sensitization of IP6K1 to FMP-201300. For a better understanding, we have also included a depiction how the mutation already affects the apo structures. Furthermore, we have added some text in the HDX section, to better describe the proposed mechanism. In brief, we propose that the mutation leads to increased flexibility of the region in the mutation, allowing accommodation of FMP-201300 and ATP. These same regions are also the regions that have large decreases in deuterium exchange upon addition of the inhibitor.

      We also appreciate the comment about using computational methods, to predict the binding site (also a remark from reviewer 1). We strongly considered docking studies during the progress of the project. However, given that the HDX-MS data show that the region around the αC-helix becomes much more flexible upon introducing the gatekeeper mutation, we were concerned that docking studies (which would be based on the static wt structure) may not accurately reflect the more dynamic state of the mutated IP6K. As the reviewer points out, MD simulations would likely be needed to obtain a more realistic picture of this protein ligand interaction, which we would like to pursue in the future.

    1. Curatorial Activism” is a term I use to designate the practice of organizing art exhibitions with the principle aim of ensuring that certain constituencies of artists are no longer ghettoized or excluded from the master narratives of art. It is a practice that commits itself to counter-hegemonic initiatives that give voice to those who have been historically silenced or omitted altogether—and, as such, focuses almost exclusively on work produced by women, artists of color, non-Euro-Americans, and/or queer artists. The thesis of my forthcoming book, Curatorial Activism: Towards an Ethics of Curating, takes as its operative assumption that the art system—its history, institutions, market, press, and so forth—is an hegemony that privileges white male creativity to the exclusion of all Other artists. It also insists that this white Western male viewpoint, which has been unconsciously accepted as the prevailing viewpoint, “may––and does––prove to be inadequate not merely on moral and ethical grounds, or because it is elitist, but on purely intellectual ones.” THAMES & HUDSON

      Challenge This article sounds an alarm on issues in regards to representation specifically to curators and critical writing. While the author is intending to bring awareness to the readers to me Maura Reilly words start to read as white saviour. The article continuously gives us the facts to back her disapproval but, it lacks in context. Below are some examples that jumped out at me.

      1. The title asks a general question but the author takes a personal view throughout the article.

      2. Curatorial Activism” is a term I use to designate the practice of organizing art exhibitions with the principle aim of ensuring that certain constituencies of artists are no longer ghettoized or excluded from the master narratives of art. The wording " no longer ghettoized or excluded from the master narratives of art' feels performative. Why use the word ghettoized at all?and follow it with the word master? excluded is suffice. Master could be changed to the great.<br /> https://www.cbc.ca/news/canada/ottawa/words-and-phrases-commonly-used-offensive-english-language-1.6252274

      3. "Theirs is not Affirmative Action curating, it’s intelligent curating" Is this to say a show that was a result of affirmative action can't be intelligent? https://hyperallergic.com/831773/affirmative-action-and-the-art-worlds-white-elites/
      4. Exhibitions like theirs, and others like them––Magiciens de la terre, Documenta 11, The Decade Show, Century City, Sexual Politics, Hide/Seek, En Todas Partes (Everywhere), Ars Homo Erotica, Global Feminisms, Africa Remix, Women Artists: 1550–1950, Sexual Politics, Extended Sensibilities, Witnesses, In a Different Light, Queer British Art: 1867-1967––have helped to radically change the course of art history, for the better. It’s no wonder that most of these exhibitions were highly controversial; counter-hegemonic projects are rarely understood. Here is an example of where I think there is an opportunity to tell the reader how and why she feels these exhibitions changed the course of art history. This is also an example of how throughout the article her narrative is made clear but, we aren't given context.<br /> After reading this article I see it as learning tool. A reminder on how as we move forward it is important to constantly be aware of our language, the language we should/could be using and how words have power regardless of intention.
    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1 (Public Review):

      This study provides insights into the early detection of malignancies with noninvasive methods. The study contained a large sample size with external validation cohort, which raises the credibility and universality of this model. The new model achieved high levels of AUC in discriminating malignancies from healthy controls, as well as the ability to distinguish tumor of origin. Based on these findings, prospective studies are needed to further confirm its predictive capacity.

      However, there are several concerns about the manuscript, which needs to be clarified or modified.

      1) The use of "multimodal model" will definitely increase workload of the testing. From the results of this manuscript, the integration of multimodal data did not significantly outperform the EM-based model. Is this kind of integration necessary? Is that tool really cost-effective? The authors did not convince me of its necessity, advantages, and clinical application.

      To provide further evidence supporting the advantages of using multimodal model (stack model) over EM-based model, we performed the DeLong test and provided data in Table S7 and Figure S6. Our data show that the stack model outperformed the EM-based model, with significantly higher AUC (AUC difference = 0.0286, p<0.0001). Moreover, the stack model exhibited significantly higher sensitivity for detecting cancer patients of five cancer types in both discovery (73.8% versus 59.5%, p<0.0001, Figure S6A) and validation cohort (72.4% versus 61.5%, p=0.0002, Figure S6B) at comparable specificity of > 95%. The number of misclassified cases were lower when using stack model as compared to the EM-based model (Figure S6C and S6D). Strikingly, we observed that the stack model significantly improved the sensitivity for detecting lung cancer patients compared to the EM based model in both discovery (78.5% versus 44.1%, Figure S6A) and validation cohort ( 83.7% versus 55.8%, Figure S6B), indicating that other ctDNA signatures are also the important biomarkers for detecting lung cancer. Therefore, we conclude that the combination of multiple signatures of ctDNA, ie. the multimodel approach, could improve the sensitivity of multi-cancer detection.

      Given the same wet lab protocol, the difference in computational time between a single EM-based model and the stack model is about 10-11 minutes per sample, but the real difference in analysis time can be reduced to ~1 min/sample by parallelization. With regards to the wet lab protocol, an important novelty of SPOT-MAS technology is its all-in-one approach that enables simultaneous analysis of different ctDNA signatures using a single blood draw and a single library reaction, greatly reducing the experimental cost. Thus, we strongly argue that our approach improves the detection sensitivity by increasing the breadth of ctDNA analysis while achieving cost effectiveness for sample preparation and sequencing with negligible trade-off of analysis time .

      We have also added the following sentences in the discussion to clarify this point. (Line 618-625)

      “Moreover, this study showed that the feature of EM achieved the highest performance among the five examined ctDNA signatures in discriminating cancer from healthy controls (Figure S6). Importantly, we found that combining EM with other ctDNA signatures in a stack model could further improve the sensitivity for detecting cancer samples, with significant improvement for lung cancer patients (Figure S6A and S6B). These findings highlighted that the multimodal analysis of multiple ctDNA signatures by SPOT-MAS could increase the breadth of ctDNA feature analysis, thus enhancing the detection sensitivity while maintaining the low cost of sample preparation and sequencing.”

      2) The baseline characteristics of part of the enrolled patients are not clear. It seems that some of the cancer patients were diagnosed only by imaging examinations. The manuscript described "staging information was not available for 25.7% of cancer patients, who were confirmed by specialized clinicians to have non-metastatic tumors". I have no idea how did this confirmation make? According to clinicians' experience only?

      Our study only recruited cancer patients with non-systemic-metastatic stages (Stage I-IIIA) in which cancer is localized to the primary sites and has not spread to other organs. We excluded patients who were diagnosed with metastatic stage IIIB and IV cancer. All healthy subjects were confirmed to have no history of cancer at the time of enrollment. They were followed up at six months and one year after enrollment. The majority of cancer patients (74.3%) were confirmed to have cancer by abnormal imaging examination and subsequent tissue biopsy confirmation of tumor staging and metastasis status. For patients with unavailable staging information (25.7%), they initially went to the study hospitals for imaging examination. Upon receiving positive imaging results (MRI scan or CT scan), they moved to another hospital for surgery, leading to missing tumor staging information at the original study hospitals. The metastasis status of these patients were later obtained via communications between the clinicians at the study hospitals and the clinicians at the surgery hospitals, subject to existing data sharing agreement between the two hospitals. For those with metastatic cancer or unclear metastatic status, they were excluded from our study.

      We have added the following sentences in the method (Line 127-135) and discussion section (Line 679-688).

      “Cancer patients were confirmed to have cancer by abnormal imaging examination and subsequent tissue biopsy confirmation of malignancy. Cancer stages were determined by the TNM (Tumor, Node, Metastasis) system classification according to the American Joint Committee on Cancer and the International Union for Cancer Control. Our study only recruited cancer patients with non-systemic-metastatic stages (Stage I-IIIA) in which cancer is localized to the primary sites and has not spread to other organs. We excluded patients who were diagnosed with metastatic stage IIIB and IV cancer. All healthy subjects were confirmed to have no history of cancer at the time of enrollment. They were followed up at six months and one year after enrollment to ensure that they did not develop cancer.”

      “For patients with unavailable staging information, their initial imaging examinations were conducted at the study hospitals. However, subsequent tests and surgical procedures were performed at a different hospital, as per the patients' preferences. Consequently, the original study hospitals lacked access to comprehensive tumor staging data. To address this limitation, the metastasis status of these patients was obtained via communication channels between the clinicians at the study hospitals and those at the surgery hospitals. This enabled the retrieval of limited information, adhering to an established data-sharing agreement between the two institutions. To maintain the robustness of our analysis, patients diagnosed with metastatic cancer or those with indeterminate metastatic status were subsequently excluded from the study.”

      3) It seems that one of the important advantages of this new model is the low depth coverage in comparing to previous screening models for cancer. The authors should discuss more on the reason why the new model could achieve comparable predictive accuracy with an obviously lower sequencing depth.

      We thanked the reviewer for the suggestion. We have added the following sentences in the discussion to explain why our assay could achieve good performance at low depth sequencing. (Line 571-584)

      “However, the low amount of ctDNA fragments in plasma samples of patients with early-stage cancer as well as the molecular heterogeneity of different cancer types are known as the major challenges for liquid biopsy based multi-cancer detection assays. Thus, sequencing at high depth coverages is required to capture enough informative cancer DNA fragments in the finite plasma sample to achieve early cancer detection. In support to this notion, many groups (1-4) have developed assays that exploited high depth coverage of sequencing to detect ctDNA fragments in plasma of early stage cancer patients. However, this strategy might not be cost effective and feasible for population wide screening in developing countries. Alternatively, we argued that increasing breadth of ctDNA analysis could maximize the ability to detect ctDNA fragments with heterogeneous genetic and epigenetic changes at shallow sequencing depth, thus improving the sensitivity for multicancer detection. To demonstrate the feasibility of this approach, we built a stacking ensemble model to combine nine different ctDNA signatures and demonstrated its superior performance on cancer detection in comparison to single-feature models (Figure 7B and 7C).”

      4) The readability of this manuscript needs to be improved. The focus of the background section is not clear, with too much detail of other studies and few purposeful summaries. You need to explain the goals and clinical significance of your study. In addition, the results section is too long, and needs to be shortened and simplified. Move some of the inessential results and sentences to supplementary materials or methods.

      We thank the reviewer for these constructive suggestions. Accrodingly, we have reduced the details of other studies (Line 85-91) as follows:

      “In recent years, there has been considerable interest in exploring the potential of ctDNA alterations for early detection of cancer (5, 6). One such approach is the PanSeer test, which uses 477 differentially methylated regions (DMRs) in ctDNA to detect five different types of cancer up to four years prior to conventional diagnosis (7). The DELFI assay employs a genome-wide analysis of ctDNA fragment profiles to increase sensitivity in early detection (1). Recently, the Galleri test has emerged as a multi-cancer detection assay that analyses more than 100,000 methylation regions in the genome to detect over 50 cancer types and localize the tumor site (8).”

      We have modified the text in the introduction to explain the goals and clinical significance of our study (Line 111-123)

      “In this study, we aimed to expand our multimodal approach, SPOT-MAS, to comprehensively analyze methylomics, fragmentomics, DNA copy number and end motifs of cfDNA and evaluate its utility to simultaneously detecting and locating cancer from a single screening test.” “Our findings demonstrate that the multimodal approach of SPOT-MAS enables profiling of multiple ctDNA signatures across the entire genome at low sequencing depth to detect five different cancer types in their early stages. Beyond detecting the presence of cancer signals, our assay was able to predict the tumor location, which is important for clinicians to fast-track the follow-up diagnostic and guide necessary treatment. Thus, SPOT-MAS has the potential to become a universal, simple, and cost-effective approach for early multi-cancer detection in a large population.”

      Reviewer #2 (Public Review):

      The authors tried to diagnose cancers and pinpoint tissues of origin using cfDNA. To achieve the goal, they developed a framework to assess methylation, CNA, and other genomic features. They established discovery and validation cohorts for systematic assessment and successfully achieved robust prediction power.

      1) Still, there are places for improvement. The diagnostic effect can be maximized if their framework works well in early-stage cancer patients. According to Table 1, about 10% of the participants are stage I. Do these cancers also perform well as compared to late stage cancers?

      We have performed the comparison of SPOT-MAS performance on different stages and provided the data in Supplementary table S8 and Supplementary Figure S4J and S4L. Our data showed that SPOT-MAS achieved lower sensitivity for detecting stage I and II cancers as compared to stage IIIA cancers in both discovery (61.54% and 69.82% for stage I and II respectively versus 78.67% for stage IIIA, Supplementary table 8) and validation cohort (73.91% and 62.32% for stage I and II, respectively versus 88.31% for stage IIIA, Supplementary table 8). This suggested that cancer stages can influence the performance of our models.

      2) Can authors show a systematic comparison of their method to other previous methods to summarize what their algorithm can achieve compared to others.

      We have conducted a systematic comparison of our method with others in the Supplementary Table S11.

      Reviewer #1 (Recommendations For The Authors):

      There are still points for the authors to clarify and consider for incorporation into revision.

      • Please first clarify the issues mentioned in "public review". Several complements are needed.

      We have addressed all of the reviewer’s comments in “public review”.

      1) Line 72-73: Different approaches of early cancer screening assays have different features, application scenarios, and of course, limitations. It's too vague to describe in this way. More importantly, diagnosis of malignancies relies on pathological diagnosis, I don't think the results of unsuccessful screening would be overdiagnosis and overtreatment. That's overstatements.

      We have rewritten the statement as follows (Line 72-75)

      “Although currently guided screening tests have each been shown to provide better treatment outcomes and reduce cancer mortality, some of them are invasive, thus having low accessibility. Importantly, most of them are single cancer screening tests, which may result in high false positive rates when used sequentially.”

      2) Line 115-130: The findings in this study shouldn't be introduced here.

      We have removed this section.

      3) Line 496-498: It surprised me that the model performed even better in independent validation cohort, which is quite different from the usual situations. Please explain it.

      We agree with the reviewer that model performance in independent validation cohort is often lower than in discovery cohort. In our case, we have carefully confirmed our data by utilizing cross-validation (CV). Cross-validation is a widely used process in which the data being used for training the model is separated into folds or partitions and the model is trained and validated for each fold; the performance estimates are then calculated to obtain mean and confidence interval (GraphPad Prism, Wilson/Brown method). To further confirm our findings, we have increased the cross-validation fold into 50, and consistently detected no significant difference in the performance between Discovery and Validation cohorts (p=0.1277, DeLong’s test).

      We have added the following sentence in the discussion to explain this (Line 633-635)

      “Despite a slightly higher AUC value in the validation cohort compared to the discovery cohort, no significant differences in AUC values were observed between the two cohorts at CV of 10 or 50 (p=0.1277, DeLong’s test).”

      4) Line 499-501: For the cut-off value selection, the authors thought that for cancer screening, specificity is more important than sensitivity? It's controversial. The sensitivity is only approximately 70%, I think that a missed diagnosis is even worse.

      We agree with the reviewer that both specificity and sensitivity are important metrics of a cancer detection test. However, there is a trade-off between sensitivity and specificity and the preference for either one of them remains a controversial topic. For a screening test, the preference should be determined by considering the prevalence of the disease, in this case - cancer. The low prevalence of cancers indicates that even a small percentage of false-positive test results due to low specificity of the assay, spread across a national population, would hugely increase the demand for confirmatory imaging as well as biopsy sampling of imaging-detected benign abnormalities (9). Thus, false positives have obvious implications for health-care resources as well as patient well-being. Conversely, higher sensitivities will make sure that more cancer cases are detected and avoid delays in diagnosis. To mitigate the impact of insufficient sensitivity of a cancer screening test, it is important to consult the test-takers that current liquid biopsy tests should only be used as a complementary approach to the available diagnosis tests to increase rates of cancer detection. To be used as a stand-alone test, further work is required to improve its performance, with more focus on increasing sensitivity while maintaining high specificity.

      We have added the following sentences in the discussion to explain why we set a high threshold of specificity (Line 660-671)

      “For an effective screening test, careful consideration of disease prevalence, cancer in this context, is imperative. Given the low prevalence of cancers, even a small proportion of false-positive test results arising from reduced assay specificity, if extrapolated to a national population, could significantly escalate the need for confirmatory imaging and biopsy procedures for benign abnormalities detected during screening. Thus, false-positives can have substantial implications for both healthcare resources and patient well-being. Conversely, a screening test with high sensitivity ensures that most cancer cases are detected and minimizes delays in diagnosis. To address potential limitations posed by low sensitivity in cancer screening tests, we suggest that current liquid biopsy tests should be employed as a complementary approach to existing diagnostic methods to enhance cancer detection rates. To be used a stand-alone test, further work is required to improve its performance, with a particular emphasis on improving sensitivity while preserving high specificity.”

      5) The methylation profiles have been used broadly in ctDNA, while your also integrated the fragmentomics, copy number aberration and end motif into the new model. In the discussion section, it would be better to further compare your new model with several previous models based on conventional ctDNA methylation markers (10, 11) for early detection of malignancies. What are the advantages of adding the other two types of data? Why the new model could achieve comparable predictive accuracy with an obviously lower sequencing depth?

      We thank the reviewer for the suggestion. We have added the following sentences in the discussion to highlight the novelty of our multimodal approach. (Line 587-610)

      “Previous studies have reported that methylation changes at target regions could be exploited for detecting ctDNA in plasma of patients with early-stage cancer (10, 11).”

      “In addition to methylation alterations, recent studies have revealed that the DNA copy number, fragmentomics profile (1) and end motif profile (12) at genome wide scales have been shown as useful features for healthy-cancer classification. Therefore, we propose that the combination of these markers might provide added value to increase the performance of liquid biopsy assays. We demonstrated that the same bisulfite sequencing data could be used to identify somatic CNA (Figure 4), cancer-associated fragment length (Figure 5) and end motifs (Figure 6), highlighting the advantage of SPOT-MAS in capturing the broad landscape of ctDNA signatures without high cost deep sequencing. For cancer-associated fragment length, we pre-processed this data into five different feature tables to better reflect the information embedded within the data. Overall, we integrated multiple features of ctDNA including methylation, fragment length, end motif and copy number changes into a multi-cancer detection model and demonstrated that this approach could distinguish healthy individuals with patients from five popular cancer types. This strategy enables increased breadth of ctDNA analysis at shallow sequencing depth to overcome the limitation of low amount of ctDNA fragments in plasma samples as well as molecular heterogeneity of cancers.”

      Moreover, we have conducted a systematic comparison of our method with others in the Supplementary Table 11.

      6) Line 667-668: The wording should be modest. "Successfully detect and localize" is not appropriate.

      We have rewritten the sentence. (Line 713-716)

      “Our large-scale case-control study demonstrated that SPOT-MAS, with its unique combination of multimodal analysis of cfDNA signatures and innovative machine-learning algorithms, can detect and localize multiple types of cancer with high accuracy at a low-cost sequencing.”

      Reviewer #2 (Recommendations For The Authors):

      1) Are the patients and controls all from Vietnam? If I am not mistaken, it is hard to find demographic information for controls. Also it is not clear if samples from controls were processed simultaneously or at a same institution or using the same protocol etc.

      We thank the reviewer for asking this question. All cancer patients and controls are from Vietnam, who were recruited from five hospitals including Medic Medical Center, University Medical Center Ho Chi Minh City, Thu Duc City Hospital, National Cancer Hospital and Hanoi Medical University. At each research sites, blood samples from both cancer patients and healthy subjects were collected in in Streck Cell-Free DNA BCT tubes and subsequently transported to a central laboratory located in Medical Genetics Institute for cfDNA isolation, library preparation and sequencing. In a recent publication (10), we have investigated the impact of logistic time and hemolysis rates of blood samples collected from different clinical sites on cfDNA concentration and sequencing quality. We did not observe any noticeable impact of such variations on cfDNA concentrations or sequencing library yields. However, future analytical validation studies are required to evaluate the impact of variation in sampling technique across different clinical sites on the robustness or accuracy of assay results.

      We have added the following sentences in the discussion to highlight this important point (Line 696-704)

      “At each research sites, blood samples from both cancer patients and healthy subjects were collected in in Streck Cell-Free DNA BCT tubes and subsequently transported to a central laboratory located in Medical Genetics Institute for cfDNA isolation, library preparation and sequencing. In a recent publication (10), we have investigated the impact of logistic time and hemolysis rates of blood samples collected from different clinical sites on cfDNA concentration and sequencing quality. We did not observe any noticeable impact of such variations on cfDNA concentrations or sequencing library yields. However, future analytical validation studies using a larger sample size are required to evaluate the impact of variation in sampling technique across different clinical sites on the robustness or accuracy of assay results.”

      References

      1. Cristiano S, Leal A, Phallen J, Fiksel J, Adleff V, Bruhm DC, et al. Genome-wide cell-free DNA fragmentation in patients with cancer. Nature. 2019;570(7761):385-9.

      2. Cohen JD, Li L, Wang Y, Thoburn C, Afsari B, Danilova L, et al. Detection and localization of surgically resectable cancers with a multi-analyte blood test. Science. 2018;359(6378):926-30.

      3. Liu MC, Oxnard GR, Klein EA, Swanton C, Seiden MV. Sensitive and specific multi-cancer detection and localization using methylation signatures in cell-free DNA. Ann Oncol. 2020;31(6):745-59.

      4. Stackpole ML, Zeng W, Li S, Liu C-C, Zhou Y, He S, et al. Cost-effective methylome sequencing of cell-free DNA for accurately detecting and locating cancer. Nature Communications. 2022;13(1):5566.

      5. Constantin N, Sina AA, Korbie D, Trau M. Opportunities for Early Cancer Detection: The Rise of ctDNA Methylation-Based Pan-Cancer Screening Technologies. Epigenomes. 2022;6(1).

      6. Phan TH, Chi Nguyen VT, Thi Pham TT, Nguyen VC, Ho TD, Quynh Pham TM, et al. Circulating DNA methylation profile improves the accuracy of serum biomarkers for the detection of nonmetastatic hepatocellular carcinoma. Future Oncol. 2022;18(39):4399-413.

      7. Chen X, Gole J, Gore A, He Q, Lu M, Min J, et al. Non-invasive early detection of cancer four years before conventional diagnosis using a blood test. Nature Communications. 2020;11(1):3475.

      8. Jamshidi A, Liu MC, Klein EA, Venn O, Hubbell E, Beausang JF, et al. Evaluation of cell-free DNA approaches for multi-cancer early detection. Cancer Cell. 2022;40(12):1537-49.e12.

      9. Ignatiadis M, Sledge GW, Jeffrey SS. Liquid biopsy enters the clinic - implementation issues and future challenges. Nat Rev Clin Oncol. 2021;18(5):297-312.

      10. Xu RH, Wei W, Krawczyk M, Wang W, Luo H, Flagg K, et al. Circulating tumour DNA methylation markers for diagnosis and prognosis of hepatocellular carcinoma. Nat Mater. 2017;16(11):1155-61.

      11. Luo H, Zhao Q, Wei W, Zheng L, Yi S, Li G, et al. Circulating tumor DNA methylation profiles enable early diagnosis, prognosis prediction, and screening for colorectal cancer. Sci Transl Med. 2020;12(524).

      12. Jiang P, Sun K, Peng W, Cheng SH, Ni M, Yeung PC, et al. Plasma DNA End-Motif Profiling as a Fragmentomic Marker in Cancer, Pregnancy, and Transplantation. Cancer Discovery. 2020;10(5):664-73.

    1. Vannevar Bush, "As We May Think," Atlantic Month1y, (July 1945).

      As We May Think

      From The Atlantic Monthly, July 1945: 101-108. Reprinted with permission. (c)1945, V. Bush.

      As Director of the Office of Scientific Research and Development, Dr. Vannevar Bush has coördinated the activities of some six thousand leading American scientists in the application of science to warfare. In this significant article he holds up an incentive for scientists when the fighting has ceased. He urges that men of science should then turn to the massive task of making more accessible our bewildering store of knowledge. For many years inventions have extended man's physical powers rather than the powers of his mind. Trip hammers that multiply the fists, microscopes that sharpen the eye, and engines of destruction and detection are new results, but the end results, of modern science. Now, says Dr. Bush, instruments are at hand which, if properly developed, will give man access to and command over the inherited knowledge of the ages. The perfection of these pacific instruments should be the first objective of our scientists as they emerge from their war work. Like Emerson's famous address of 1837 on "The American Scholar," this paper by Dr. Bush calls for a new relationship between thinking man and the sum of our knowledge. - The Editor

      This has not been a scientist's war; it has been a war in which all have had a part. The scientists, burying their old professional competition in the demand of a common cause, have shared greatly and learned much. It has been exhilarating to work in effective partnership. Now, for many, this appears to be approaching an end. What are the scientists to do next?

      For the biologists, and particularly for the medical scientists, there can be little indecision, for their war work has hardly required them to leave the old paths. Many indeed have been able to carry on their war research in their familiar peacetime laboratories. Their objectives remain much the same.

      It is the physicists who have been thrown most violently off stride, who have left academic pursuits for the making of strange destructive gadgets, who have had to devise new methods for their unanticipated assignments. They have done their part on the devices that made it possible to turn back the enemy. They have worked in combined effort with the physicists of our allies. They have felt within themselves the stir of achievement. They have been part of a great team. Now, as peace approaches, one asks where they will find objectives worthy of their best.

      I

      Of what lasting benefit has been man's use of science and of the new instruments which his research brought into existence? First, they have increased his control of his material environment. They have improved his food, his clothing, his shelter; they have increased his security and released him partly from the bondage of bare existence. They have given him increased knowledge of his own biological processes so that he has had a progressive freedom from disease and an increased span of life. They are illuminating the interactions of his physiological and psychological functions, giving the promise of an improved mental health.

      Science has provided the swiftest communication between individuals; it has provided a record of ideas and has enabled man to manipulate and to make extracts from that record so that knowledge evolves and endures throughout the life of a race rather than that of an individual.

      There is a growing mountain of research. But there is increased evidence that we are being bogged down today as specialization extends. The investigator is staggered by the findings and conclusions of thousands of other workers--conclusions which he cannot find time to grasp, much less to remember, as they appear. Yet specialization becomes increasingly necessary for progress, and the effort to bridge between disciplines is correspondingly superficial.

      Professionally our methods of transmitting and reviewing the results of research are generations old and by now are totally inadequate for their purpose. If the aggregate time spent in writing scholarly works and in reading them could be evaluated, the ratio between these amounts of time might well be startling. Those who conscientiously attempt to keep abreast of current thought, even in restricted fields, by close and continuous reading might well shy away from an examination calculated to show how much of the previous month's efforts could be produced on call. Mendel's concept of the laws of genetics was lost to the world for a generation because his publication did not reach the few who were capable of grasping and extending it; and this sort of catastrophe is undoubtedly being repeated all about us, as truly significant attainments become lost in the mass of the inconsequential.

      The difficulty seems to be, not so much that we publish unduly in view of the extent and variety of present-day interests, but rather that publication has been extended far beyond our present ability to make real use of the record. The summation of human experience is being expanded at a prodigious rate, and the means we use for threading through the consequent maze to the momentarily important item is the same as was used in the days of square-rigged ships.

      But there are signs of a change as new and powerful instrumentalities come into use. Photocells capable of seeing things in a physical sense, advanced photography which can record what is seen or even what is not, thermionic tubes capable of controlling potent forces under the guidance of less power than a mosquito uses to vibrate his wings, cathode ray tubes rendering visible an occurrence so brief that by comparison a microsecond is a long time, relay combinations which will carry out involved sequences of movements more reliably than any human operator and thousands of times as fast-- there are plenty of mechanical aids with which to effect a transformation in scientific records.

      Two centuries ago Leibnitz invented a calculating machine which embodied most of the essential features of recent keyboard devices, but it could not then come into use. The economics of the situation were against it: the labor involved in constructing it, before the days of mass production, exceeded the labor to be saved by its use, since all it could accomplish could be duplicated by sufficient use of pencil and paper. Moreover, it would have been subject to frequent breakdown, so that it could not have been depended upon; for at that time and long after, complexity and unreliability were synonymous.

      Babbage, even with remarkably generous support for his time, could not produce his great arithmetical machine. His idea was sound enough, but construction and maintenance costs were then too heavy. Had a Pharaoh been given detailed and explicit designs of an automobile, and had he understood them completely, it would have taxed the resources of his kingdom to have fashioned the thousands of parts for a single car, and that car would have broken down on the first trip to Giza.

      Machines with interchangeable parts can now be constructed with great economy of effort. In spite of much complexity, they perform reliably. Witness the humble typewriter, or the movie camera, or the automobile. Electrical contacts have ceased to stick when thoroughly understood. Note the automatic telephone exchange, which has hundreds of thousands of such contacts, and yet is reliable. A spider web of metal, sealed in a thin glass container, a wire heated to brilliant glow, in short, the thermionic tube of radio sets, is made by the hundred million, tossed about in packages, plugged into sockets--and it works! Its gossamer parts, the precise location and alignment involved in its construction, would have occupied a master craftsman of the guild for months; now it is built for thirty cents. The world has arrived at an age of cheap complex devices of great reliability; and something is bound to come of it.

      II

      A record, if it is to be useful to science, must be continuously extended, it must be stored, and above all it must be consulted. Today we make the record conventionally by writing and photography, followed by printing; but we also record on film, on wax disks, and on magnetic wires. Even if utterly new recording procedures do not appear, these present ones are certainly in the process of modification and extension.

      Certainly progress in photography is not going to stop. Faster material and lenses, more automatic cameras, finer-grained sensitive compounds to allow an extension of the minicamera idea, are all imminent. Let us project this trend ahead to a logical, if not inevitable, outcome. The camera hound of the future wears on his forehead a lump a little larger than a walnut. It takes pictures 3 millimeters square, later to be projected or enlarged, which after all involves only a factor of 10 beyond present practice. The lens is of universal focus, down to any distance accommodated by the unaided eye, simply because it is of short focal length. There is a built-in photocell on the walnut such as we now have on at least one camera, which automatically adjusts exposure for a wide range of illumination. There is film in the walnut for a hundred exposure, and the spring for operating its shutter and shifting its film is wound once for all when the film clip is inserted. It produces its result in full color. It may well be stereoscopic, and record with spaced glass eyes, for striking improvements in stereoscopic technique are just around the corner.

      The cord which trips its shutter may reach down a man's sleeve within easy reach of his fingers. A quick squeeze, and the picture is taken. On a pair of ordinary glasses is a square of fine lines near the top of one lens, where it is out of the way of ordinary vision. When an object appears in that square, it is lined up for its j picture. As the scientist of the future moves about the laboratory or the field, every time he looks at something worthy of the record, he trips the shutter and in it goes, without even an audible click. Is this all fantastic? The only fantastic thing about it is the idea of making as many pictures as would result from its use.

      Will there be dry photography? It is already here in two forms. When Brady made his Civil War pictures, the plate had to be wet at the time of exposure. Now it has to be wet during development instead. In the future perhaps it need not be wetted at all. There have long been films impregnated with diazo dyes which form a picture without development, so that it is already there as soon as the camera has been operated. An exposure to ammonia gas destroys the unexposed dye, and the picture can then be taken out into the light and examined. The process is now slow, but someone may speed it up, and it has no grain difficulties such as now keep photographic researchers busy. Often it would be advantageous to be able to snap the camera and to look at the picture immediately.

      Another process now in use is also slow, and more or less clumsy. For fifty years impregnated papers have been used which turn dark at every point where an electrical contact touches them, by reason of the chemical change thus produced in an iodine compound included in the paper. They have been used to make records, for a pointer moving across them can leave a trail behind. If the electrical potential on the pointer is varied as it moves, the line becomes light or dark in accordance with the potential.

      This scheme is now used in facsimile transmission. The pointer draws a set of closely spaced lines across the paper one after another. As it moves, its potential is varied in accordance with a varying current received over wires from a distant station, where these variations are produced by a photocell which is similarly scanning a picture. At every instant the darkness of the line being drawn is made equal to the darkness of the point on the picture being observed by the photocell. Thus, when the whole picture has been covered, a replica appears at the receiving end.

      A scene itself can be just as well looked over line by line by the photocell in this way as can a photograph of the scene. This whole apparatus constitutes a camera, with the added feature, which can be dispensed with if desired, of making its picture at a distance. It is slow, and the picture is poor in detail. Still, it does give another process of dry photography, in which the picture is finished as soon as it is taken.

      It would be a brave man who would predict that such a process will always remain clumsy, slow, and faulty in detail. Television equipment today transmits sixteen reasonably good pictures a second, and it involves only two essential differences from the process described above. For one, the record is made by a moving beam of electrons rather than a moving pointer, for the reason that an electron beam can sweep across the picture very rapidly indeed. The other difference involves merely the use of a screen which glows momentarily when the electrons hit, rather than a chemically treated paper or film which is permanently altered. This speed is necessary in television, for motion pictures rather than stills are the object.

      Use chemically treated film in place of the glowing screen, allow the apparatus to transmit one picture only rather than a succession, and a rapid camera for dry photography results. The treated film needs to be far faster in action than present examples, but it probably could be. More serious is the objection that this scheme would involve putting the film inside a vacuum chamber, for electron beams behave normally only in such a rarefied environment. This difficulty could be avoided by allowing the electron beam to play on one side of a partition, and by pressing the film against the other side, if this partition were such as to allow the electrons to go through perpendicular to its surface, and to prevent them from spreading out sideways. Such partitions, in crude form, could certainly be constructed, and they will hardly hold up the general development.

      Like dry photography, microphotography still has a long way to go. The basic scheme of reducing the size of the record, and examining it by projection rather than directly, has possibilities too great to be ignored. The combination of optical projection and photographic reduction is already producing some results in microfilm for scholarly purposes, and the potentialities are highly suggestive. Today, with microfilm, reductions by a linear factor of 20 can be employed and still produce full clarity when the material is re-enlarged for examination. The limits are set by the graininess of the film, the excellence of the optical system, and the efficiency of the light sources employed. All of these are rapidly improving .

      Assume a linear ratio of 100 for future use. Consider film of the same thickness as paper, although thinner film will certainly be usable. Even under these conditions there would be a total factor of 10,000 between the bulk of the ordinary record on books, and its microfilm replica. The Encyclopedia Britannica could be reduced to the volume of a matchbox. A library of a million volumes could be compressed into one end of a desk. If the human race has produced since the invention of movable type a total record, in the form of magazines, newspapers, books, tracts, advertising blurbs, correspondence, having a volume corresponding to a billion books, the whole affair, assembled and compressed, could be lugged off in a moving van. Mere compression, of course, is not enough; one needs not only to make and store a record but also be able to consult it, and this aspect of the matter comes later. Even the modern great library is not generally consulted; it is nibbled at by a few.

      Compression is important, however, when it comes to costs. The material for the microfilm Britannica would cost a nickel, and it could be mailed anywhere for a cent. What would it cost to print a million copies? To print a sheet of newspaper, in a large edition, costs a small fraction of a cent. The entire material of the Britannica in reduced microfilm form would go on a sheet eight and one-half by eleven inches. Once it is available, with the photographic reproduction methods of the future, duplicates in large quantities could probably be turned out for a cent apiece beyond the cost of materials. The preparation of the original copy? That introduces the next aspect of the subject.

      III

      To make the record, we now push a pencil or tap a typewriter. Then comes the process of digestion and correction, followed by an intricate process of typesetting, printing, and distribution. To consider the first stage of the procedure, will the author of the future cease writing by hand or typewriter and talk directly to the record? He does so indirectly, by talking to a stenographer or a wax cylinder; but the elements are all present if he wishes to have his talk directly produce a typed record. All he needs to do is to take advantage of existing mechanisms and to alter his language .

      At a recent World Fair a machine called a Voder was shown. A girl stroked its keys and it emitted recognizable speech. No human vocal chords entered into the procedure at any point; the keys simply combined some electrically produced vibrations and passed these on to a loudspeaker. In the Bell Laboratories there is the converse of this machine, called a Vocoder. The loud-speaker is replaced by a microphone, which picks up sound. Speak to it, and the corresponding keys move. This may be one element of the postulated system.

      The other element is found in the stenotype, that somewhat disconcerting device encountered usually at public meetings. A girl strokes its keys languidly and looks about the room and sometimes at the speaker with a disquieting gaze. From it emerges a typed strip which records in a phonetically simplified language a record of what the speaker is supposed to have said. Later this strip is retyped into ordinary language, for in its nascent form it is intelligible only to the initiated. Combine these two elements, let the Vocoder run the stenotype, and the result is a machine which types when talked to.

      Our present languages are not especially adapted to this sort of mechanization, it is true. It is strange that the inventors of universal languages have not seized upon the idea of producing one which better fitted the technique for transmitting and recording speech. Mechanization may yet force the issue, especially in the scientific field; whereupon scientific jargon would become still less intelligible to the layman.

      One can now picture a future investigator in his laboratory. His hands are free, and he is not anchored. As he moves about and observes, he photographs and comments. Time is automatically recorded to tie the two records together. If he goes into the field, he may be connected by radio to his recorder. As he ponders over his notes in the evening, he again talks his comments into the record. His typed record, as well as his photographs, may both be in miniature, so that he projects them for examination.

      Much needs to occur, however, between the collection of data and observations, the extraction of parallel material from the existing record, and the final insertion of new material into the general body of the common record. For mature thought there is no mechanical substitute. But creative thought and essentially repetitive thought are very different things. For the latter there are, and may be, powerful mechanical aids.

      Adding a column of figures is a repetitive thought process, and it was long ago properly relegated to the machine. True, the machine is sometimes controlled by a keyboard, and thought of a sort enters in reading the figures and poking the corresponding keys, but even this is avoidable. Machines have been made which will read typed figures by photocells and then depress the corresponding keys; these are combinations of photocells for scanning the type, electric circuits for sorting the consequent variations, and relay circuits for interpreting the result into the action of solenoids to pull the keys down.

      All this complication is needed because of the clumsy way in which we have learned to write figures. If we recorded them positionally, simply by the configuration of a set of dots on a card, the automatic reading mechanism would become comparatively simple. In fact, if the dots are holes, we have the punched-card machine long ago produced by Hollorith for the purposes of the census, and now used throughout business. Some types of complex businesses could hardly operate without these machines.

      Adding is only one operation. To perform arithmetical computation involves also subtraction, multiplication, and division, and in addition some method for temporary storage of results, removal from storage for further manipulation, and recording of final results by printing. Machines for these purposes are now of two types: keyboard machines for accounting and the like, manually controlled for the insertion of data, and usually automatically controlled as far as the sequence of operations is concerned; and punched-card machines in which separate operations are usually delegated to a series of machines, and the cards then transferred bodily from one to another. Both forms are very useful; but as far as complex computations are concerned, both are still in embryo.

      Rapid electrical counting appeared soon after the physicists found it desirable to count cosmic rays. For their own purposes the physicists promptly constructed thermionic-tube equipment capable of counting electrical impulses at the rate of 100,000 a second. The advanced arithmetical machines of the future will be electrical in nature, and they will perform at 100 times present speeds, or more.

      Moreover, they will be far more versatile than present commercial machines, so that they may readily be adapted for a wide variety of operations. They will be controlled by a control card or film, they will select their own data and manipulate it in accordance with the instructions thus inserted, they will perform complex arithmetical computations at exceedingly high speeds, and they will record results in such form as to be readily available for distribution or for later further manipulation. Such machines will have enormous appetites. One of them will take instructions and data from a whole roomful of girls armed with simple keyboard punches, and will deliver sheets of computed results every few minutes. There will always be plenty of things to compute in the detailed affairs of millions of people doing complicated things.

      IV

      The repetitive processes of thought are not confined, however, to matters of arithmetic and statistics. In fact, every time one combines and records facts in accordance with established logical processes, the creative aspect of thinking is concerned only with the selection of the data and the process to be employed, and the manipulation thereafter is repetitive in nature and hence a fit matter to be relegated to the machines. Not so much has been done along these lines, beyond the bounds of arithmetic, as might be done, primarily because of the economics of the situation. The needs of business, and the extensive market obviously waiting, assured the advent of mass-produced arithmetical machines just as soon as production methods were sufficiently advanced.

      With machines for advanced analysis no such situation existed; for there was and is no extensive market; the users of advanced methods of manipulating data are a very small part of the population. There are, however, machines for solving differential equations--and functional and integral equations, for that matter. There are many special machines, such as the harmonic synthesizer which predicts the tides. There will be many more, appearing certainly first in the hands of the scientist and in small numbers.

      If scientific reasoning were limited to the logical processes of arithmetic, we should not get far in our understanding of the physical world. One might as well attempt to grasp the game of poker entirely by the use of the mathematics of probability. The abacus, with its beads strung on parallel wires, led the Arabs to positional numeration and the concept of zero many centuries before the rest of the world; and it was a useful tool--so useful that it still exists.

      It is a far cry from the abacus to the modern keyboard accounting machine. It will be an equal step to the arithmetical machine of the future. But even this new machine will not take the scientist where he needs to go. Relief must be secured from laborious detailed manipulation of higher mathematics as well, if the users of it are to free their brains for something more than repetitive detailed transformations in accordance with established rules. A mathematician is not a man who can readily manipulate figures; often he cannot. He is not even a man who can readily perform the transformations of equations by the use of calculus. He is primarily an individual who is skilled in the use of symbolic logic on a high plane, and especially he is a man of intuitive judgment in the choice of the manipulative processes he employs.

      All else he should be able to turn over to his mechanism, just as confidently as he turns over the propelling of his car to the intricate mechanism under the hood. Only then will mathematics be practically effective in bringing the growing knowledge of atomistics to the useful solution of the advanced problems of chemistry, metallurgy, and biology. For this reason there will come more machines to handle advanced mathematics for the scientist. Some of them will be sufficiently bizarre to suit the most fastidious connoisseur of the present artifacts of civilization.

      V

      The scientist, however, is not the only person who manipulates data and examines the world about him by the use of logical processes, although he sometimes preserves this appearance by adopting into the fold anyone who becomes logical, much in the manner in which a British labor leader is elevated to knighthood. Whenever logical processes of thought are employed--that is, whenever thought for a time runs along an accepted groove--there is an opportunity for the machine. Formal logic used to be a keen instrument in the hands of the teacher in his trying of students' souls. It is readily possible to construct a machine which will manipulate premises in accordance with formal logic, simply by the clever use of relay circuits. Put a set of premises into such a device and turn the crank, and it will readily pass out conclusion after conclusion, all in accordance with logical law, and with no more slips than would be expected of a keyboard adding machine.

      Logic can become enormously difficult, and it would undoubtedly be well to produce more assurance in its use. The machines for higher analysis have usually been equation solvers. Ideas are beginning to appear for equation transformers, which will rearrange the relationship expressed by an equation in accordance with strict and rather advanced logic. Progress is inhibited by the exceedingly crude way in which mathematicians express their relationships. They employ a symbolism which grew like Topsy and has little consistency; a strange fact in that most logical field.

      A new symbolism, probably positional, must apparently precede the reduction of mathematical transformations to machine processes. Then, on beyond the strict logic of the mathematician, lies the application of logic in everyday affairs. We may some day click off arguments on a machine with the same assurance that we now enter sales on a cash register. But the machine of logic will not look like a cash register, even of the streamlined model.

      So much for the manipulation of ideas and their insertion into the record. Thus far we seem to be worse off than before--for we can enormously extend the record; yet even in its present bulk we can hardly consult it. This is a much larger matter than merely the extraction of data for the purposes of scientific research; it involves the entire process by which man profits by his inheritance of acquired knowledge. The prime action of use is selection, and here we are halting indeed. There may be millions of fine thoughts, and the account of the experience on which they are based, all encased within stone walls of acceptable architectural form; but if the scholar can get at only one a week by diligent search, his syntheses are not likely to keep up with the current scene.

      Selection, in this broad sense, is a stone adze in the hands of a cabinetmaker. Yet, in a narrow sense and in other areas, something has already been done mechanically on selection. The personnel officer of a factory drops a stack of a few thousand employee cards into a selecting machine, sets a code in accordance with an established convention, and produces in a short time a list of all employees who live in Trenton and know Spanish. Even such devices are much too slow when it comes, for example, to matching a set of fingerprints with one of five million on file. Selection devices of this sort will soon be speeded up from their present rate of reviewing data at a few hundred a minute. By the use of photocells and microfilm they will survey items at the rate of a thousand a second, and will print out duplicates of those selected.

      This process, however, is simple selection: it proceeds by examining in turn every one of a large set of items, and by picking out those which have certain specified characteristics. There is another form of selection best illustrated by the automatic telephone exchange. You dial a number and the machine selects and connects just one of a million possible stations. It does not run over them all. It pays attention only to a class given by a first digit, then only to a subclass of this given by the second digit, and so on; and thus proceeds rapidly and almost unerringly to the selected station. It requires a few seconds to make the selection, although the process could be speeded up if increased speed were economically warranted. If necessary, it could be made extremely fast by substituting thermionic-tube switching for mechanical switching, so that the full selection could be made in one one-hundredth of a second. No one would wish to spend the money necessary to make this change in the telephone system, but the general idea is applicable elsewhere.

      Take the prosaic problem of the great department store. Every time a charge sale is made, there are a number of things to be done. The inventory needs to be revised, the salesman needs to be given credit for the sale, the general accounts need an entry, and, most important, the customer needs to be charged. A central records device has been developed in which much of this work is done conveniently. The salesman places on a stand the customer's identification card, his own card, and the card taken from the article sold--all punched cards. When he pulls a lever, contacts are made through the holes, machinery at a central point makes the necessary computations and entries, and the proper receipt is printed for the salesman to pass to the customer.

      But there may be ten thousand charge customers doing business with the store, and before the full operation can be completed someone has to select the right card and insert it at the central office. Now rapid selection can slide just the proper card into position in an instant or two, and return it afterward. Another difficulty occurs, however. Someone must read a total on the card, so that the machine can add its computed item to it. Conceivably the cards might be of the dry photography type I have described. Existing totals could then be read by photocell, and the new total entered by an electron beam.

      The cards may be in miniature, so that they occupy little space. They must move quickly. They need not be transferred far, but merely into position so that the photocell and recorder can operate on them. Positional dots can enter the data. At the end of the month a machine can readily be made to read these and to print an ordinary bill. With tube selection, in which no mechanical parts are involved in the switches, little time need be occupied in bringing the correct card into use--a second should suffice for the entire operation. The whole record on the card may be made by magnetic dots on a steel sheet if desired, instead of dots to be observed optically, following the scheme by which Poulsen long ago put speech on a magnetic wire. This method has the advantage of simplicity and ease of erasure. By using photography, however, one can arrange to project the record in enlarged form, and at a distance by using the process common in television equipment.

      One can consider rapid selection of this form, and distant projection for other purposes. To be able to key one sheet of a million before an operator in a second or two, with the possibility of then adding notes thereto, is suggestive in many ways. It might even be of use in libraries, but that is another story. At any rate, there are now some interesting combinations possible. One might, for example, speak to a microphone, in the manner described in connection with the speech-controlled typewriter, and thus make his selections. It would certainly beat the usual file clerk.

      VI

      The real heart of the matter of selection, however, goes deeper than a lag in the adoption of mechanisms by libraries, or a lack of development of devices for their use. Our ineptitude in getting at the record is largely caused by the artificiality of systems of indexing. When data of any sort are placed in storage, they are filed alphabetically or numerically, and information is found (when it is) by tracing it down from subclass to subclass. It can be in only one place, unless duplicates are used; one has to have rules as to which path will locate it, and the rules are cumbersome. Having found one item, moreover, one has to emerge from the system and re-enter on a new path.

      The human mind does not work that way. It operates by association. With one item in its grasp, it snaps instantly to the next that is suggested by the association of thoughts, in accordance with some intricate web of trails carried by the cells of the brain. It has other characteristics, of course; trails that are not frequently followed are prone to fade, items are not fully permanent, memory is transitory. Yet the speed of action, the intricacy of trails, the detail of mental pictures, is awe-inspiring beyond all else in nature.

      Man cannot hope fully to duplicate this mental process artificially, but he certainly ought to be able to learn from it. In minor ways he may even improve, for his records have relative permanency. The first idea, however, to be drawn from the analogy concerns selection. Selection by association, rather than by indexing, may yet be mechanized. One cannot hope thus to equal the speed and flexibility with which the mind follows an associative trail, but it should be possible to beat the mind decisively in regard to the permanence and clarity of the items resurrected from storage.

      Consider a future device for individual use, which is a sort of mechanized private file and library. It needs a name, and, to coin one at random, "memex" will do. A memex is a device in which an individual stores all his books, records, and communications, and which is mechanized so that it may be consulted with exceeding speed and flexibility. It is an enlarged intimate supplement to his memory.

      It consists of a desk, and while it can presumably be operated from a distance, it is primarily the piece of furniture at which he works. On the top are slanting translucent screens, on which material can be projected for convenient reading. There is a keyboard, and sets of buttons and levers. Otherwise it looks like an ordinary desk.

      In one end is the stored material. The matter of bulk is well taken care of by improved microfilm. Only a small part of the interior of the memex is devoted to storage, the rest to mechanism. Yet if the user inserted 5000 pages of material a day it would take him hundreds of years to fill the repository, so he can be profligate and enter material freely.

      Most of the memex contents are purchased on microfilm ready for insertion. Books of all sorts, pictures, current periodicals, newspapers, are thus obtained and dropped into place. Business correspondence takes the same path. And there is provision for direct entry. On the top of the memex is a transparent platen. On this are placed longhand notes, photographs, memoranda, all sorts of things. When one is in place, the depression of a lever causes it to be photographed onto the next blank space in a section ~_ the memex film, dry photography being employed

      There is, of course, provision for consultation of the record by the usual scheme of indexing. If the user wishes to consult a certain book, he taps its code on the keyboard, and the title page of the book promptly appears before him, projected onto one of his viewing positions. Frequently-used codes are mnemonic, so that he seldom consults his code book; but when he does, a single tap of a key projects it for his use. Moreover, he has supplemental levers. On deflecting one of these levers to the right he runs through the book before him, each page in turn being projected at a speed which just allows a recognizing glance at each. If he deflects it further to the right, he steps through the book 10 pages at a time; still further at 100 pages at a time. Deflection to the left gives him the same control backwards.

      A special button transfers him immediately to the first page of the index. Any given book of his library can thus be called up and consulted with far greater facility than if it were taken from a shelf. As he has several projection positions, he can leave one item in position while he calls up another. He can add marginal notes and comments, taking advantage of one possible type of dry photography, and it could even be arranged so that he can do this by a stylus scheme, such as is now employed in the telautograph seen in railroad waiting rooms, just as though he had the physical page before him.

      VII

      All this is conventional, except for the projection forward of present-day mechanisms and gadgetry. It affords an immediate step, however, to associative indexing, the basic idea of which is a provision whereby any item may be caused at will to select immediately and automatically another. This is the essential feature of the memex. The process of tying two items together is the important thing.

      When the user is building a trail, he names it, inserts the name in his code book, and taps it ~out on his keyboard. Before him are the two items to be joined, projected onto adjacent viewing positions. At the bottom of each there are a number of blank code spaces, and a pointer is set to indicate one of these on each item. The user taps a single key, and the items are permanently joined. In each code space appears the code word. Out of view, but also in the code space, is inserted a set of dots for photocell viewing; and on each item these dots by their positions designate the index number of the other item.

      Thereafter, at any time, when one of these items is in view, the other can be instantly recalled merely by tapping a button below the corresponding code space. Moreover, when numerous items have been thus joined together to form a trail, they can be reviewed in turn, rapidly or slowly, by deflecting a lever like that used for turning the pages of a book. It is exactly as though the physical items had been gathered together from widely separated sources and bound together to form a new book. It is more than this, for any item can be joined into numerous trails.

      The owner of the memex, let us say, is interested in the origin and properties of the bow and arrow. Specifically he is studying why the short Turkish bow was apparently superior to the English long bow in the skirmishes of the Crusades. He has dozens of possibly pertinent books and articles in his memex. First he runs through an encyclopedia, finds an interesting but sketchy article, leaves it projected. Next, in a history, he finds another pertinent item, and ties the two together. Thus he goes, building a trail of many items. Occasionally he inserts a comment of his own, either linking it into the main trail or joining it by a side trail to a particular item. When it becomes evident that the elastic properties of available materials had a great deal to do with the bow, he branches off on a side trail which takes him through textbooks on elasticity and tables of physical constants. He inserts a page of longhand analysis of his own. Thus he builds a trail of his interest through the maze of materials available to him.

      And his trails do not fade. Several years later, his talk with a friend turns to the queer ways in which a people resist innovations, even of vital interest. He has an example, in the fact that the outraged Europeans still failed to adopt the Turkish bow. In fact he has a trail on it. A touch brings up the code book. Tapping a few keys projects the head of the trail. A lever runs through it at will, stopping at interesting items, going off on side excursions. It is an interesting trail, pertinent to the discussion. So he sets a reproducer in action, photographs the whole trail out, and passes it to his friend for insertion in his own memex, there to be linked into the more general trail.

      VIII

      Wholly new forms of encyclopedias will appear, ready-made with a mesh of associative trails running through them, ready to be dropped into the memex and there amplified. The lawyer has at his touch the associated opinions and decisions of his whole experience, and of the experience of friends and authorities. The patent attorney has on call the millions of issued patents, with familiar trails to every point of his client's interest. The physician, puzzled by a patient's reactions, strikes the trail established in studying an earlier similar case, and runs rapidly through analogous case histories, with side references to the classics for the pertinent anatomy and histology. The chemist, struggling with the synthesis of an organic compound, has all the chemical literature before him in his laboratory, with trails following the analogies of compounds, and side trails to their physical and chemical behavior.

      The historian, with a vast chronological account of a people, parallels it with a skip trail which stops only on the salient items, and can follow at any time contemporary trails which lead him all over civilization at a particular epoch. There is a new profession of trail blazers, those who find delight in the task of establishing useful trails through the enormous mass of the common record. The inheritance from the master becomes, not only his additions to the world's record, but for his disciples the entire scaffolding by which they were erected.

      Thus science may implement the ways in which man produces, stores, and consults the record of the race. It might be striking to outline the instrumentalities of the future more spectacularly, rather than to stick closely to methods and elements now known and undergoing rapid development, as has been done here. Technical difficulties of all sorts have been ignored, certainly, but also ignored are means as yet unknown which may come any day to accelerate technical progress as violently as did the advent of the thermionic tube. In order that the picture may not be too commonplace, by reason of sticking to present-day patterns, it may be well to mention one such possibility, not to prophesy but merely to suggest, for prophecy based on extension of the known has substance, while prophecy founded on the unknown is only a doubly involved guess.

      All our steps in creating or absorbing material of the record proceed through one of the senses--the tactile when we touch keys, the oral when we speak or listen, the visual when we read. Is it not possible that some day the path may be established more directly?

      We know that when the eye sees, all the consequent information is transmitted to the brain by means of electrical vibrations in the channel of the optic nerve. This is an exact analogy with the electrical vibrations which occur in the cable of a television set: they convey the picture from the photocells which see it to the radio transmitter from which it is broadcast. We know further that if we can approach that cable with the proper instruments, we do not need to touch it; we can pick up those vibrations by electrical induction and thus discover and reproduce the scene which is being transmitted, just as a telephone wire may be tapped for its message.

      The impulses which flow in the arm nerves of a typist convey to her fingers the translated information which reaches her eye or ear, in order that the fingers may be caused to strike the proper keys. Might not these currents be intercepted, either in the original form in which information is conveyed to the brain, or in the marvelously metamorphosed form in which they then proceed to the hand?

      By bone conduction we already introduce sounds into the nerve channels of the deaf in order that they may hear. Is it not possible that we may learn to introduce them without the present cumbersomeness of first transforming electrical vibrations to mechanical ones, which the human mechanism promptly transforms back to the electrical form? With a couple of electrodes on the skull the encephalograph now produces pen-and-ink traces which bear some relation to the electrical phenomena going on in the brain itself. True, the record is unintelligible, except as it points out certain gross misfunctioning of the cerebral mechanism; but who would now place bounds on where such a thing may lead?

      In the outside world, all forms of intelligence, whether of sound or sight, have been reduced to the form of varying currents in an electric circuit in order that they may be transmitted. Inside the human frame exactly the same sort of process occurs.

      Must we always transform to mechanical movements in order to proceed from one electrical phenomenon to another? It is a suggestive thought, but it hardly warrants prediction without losing touch with reality and immediateness.

      Presumably man's spirit should be elevated if he can better review his shady past and analyze more completely and objectively his present problems. He has built a civilization so complex that he needs to mechanize his records more fully if he is to push his experiment to its logical conclusion and not merely become bogged down part way there by overtaxing his limited memory. His excursions may be more enjoyable if he can reacquire the privilege of forgetting the manifold things he does not need to have immediately at hand, with some assurance that he can find them again if they prove important.

      The applications of science have built man a well-supplied house, and are teaching him to live healthily therein. They have enabled him to throw masses of people against one another with cruel weapons. They may yet allow him truly to encompass the great record and to grow in the wisdom of race experience. He may perish in conflict before he learns to wield that record for his true good. Yet, in the application of science to the needs and desires of man, it would seem to be a singularly unfortunate stage at which to terminate the process, or to lose hope as to the outcome.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      We would like to thank Review Commons for their innovative approach to scientific peer-review and publishing. We thank all the Reviewers for their positive, highly complementary assessment of the manuscript and for highlighting the high quality and reproducibility of the work and the novelty and significance of the results: “The experiments are well-designed and perfectly executed and presented”; “I felt that this is a strong manuscript for peer-review as it serves diversified interests in modern cell biology.”; “The manuscript would be of interest to basic researchers working on epithelial development. Also potentially to basic researchers working on cancer, due to the mitotic errors described.”. We are grateful for the Reviewers’ comments and suggestions that have contributed to improving the revised manuscript. We have addressed all the Reviewers’ concerns, as detailed below in the point-by-point response to the Reviewers. Textual changes in the revised manuscript are marked in Blue.

      __Reviewer #1 (Evidence, reproducibility and clarity (Required)): __

      *The manuscript "Crosstalk between the plasma membrane and cell-cell adhesion maintains epithelial identity for correct polarised cell divisions" by Dr. Hosawi and colleagues reports the characterisation of the mitotic connection between plasma membrane dynamics and division orientation in polarised mammalian epithelial cells in culture. The authors start from the comparison of mitotic events of human mammary MCF10A cells grown at optimal density or at low density. They observed that only at optimal density MCF10A cells polarise by E-cadherin mediated cell-cell contacts, and display uniform membrane enrichment at the cortex, whereas cells grown at low density do not show cortical E-Cadherin enrichment, and distribute aberrantly the plasma membrane at one side and in cytoplasmic vesicles, generating daughter cells with unequal size. Consistently, further analyses revealed that low-density MCF10A cells undergo misoriented mitosis, with chromosome congression and misegregetion defects. Mechanistically, low density MCF10A cells fail to organise a symmetric mitotic spindle and center it in metaphase. This is due to an increased cortical actomyosin thickness coupled to abnormal astral microtubule stability. Building on previous data from the Elias lab, the authors uncover a role of the membrane-associated S100A11 protein in maintaining correct plasma membrane dynamics and E-cadherin localisation in mitosis. Further dissection of the molecular mechanism underlying this mitotic function od S10011A revealed that it enriches at the cortex only in optimal-density MCF10A cells, and promotes spindle orientation by association with LGN and E-cadherin, upstream of E-cadherin. This evidence depicts the plasma membrane and S100A11 proteins as a key mechanical sensors of cell-cell adhesion orchestrating the recruitment of E-cadherin and LGN-dependent force generators to ensure correct division orientation. *

      *Major points: *

      *- Important information is presented in Supplementary Figure S3. I suggest to move these panels in the main figures. Specifically, I would replace figure 4A with S3A showing the distribution of endogenous S100A11 in MCF10A cells, rather than the one of the GFP-tagged version which is over-expressed. *

      __Authors response: __We thank the Reviewer for this suggestion. We have now moved Figure S3A to Figure 4, to replace Figure 4A and show the localisation of endogenous S100A11 during mitosis and included new quantifications in new Figure 4B. We have moved Figure 3A to supplementary figures (new Figure S4A). We have amended the text of the results section and the Source Data file accordingly.

      *- The mechanisms of division orientation governed by S100A11 seems to impinge on the control of cortical F-actin and astral microtubule dynamics. This is illustrated in figure S3C, which in my opinion should be shown in the main figures with some more explanation / experiments. The authors mention the " tight actin F-actin bundles at the cell-cell contacts" that are lost in S100A11-depleted cells, and that interact with astral microtubules. However this is not fully clear in figure S3C. I think the authors should find a way to present better these evidence which is key in supporting their molecular model. *

      __Authors response: __As requested by the Reviewer we have now moved Figure S3C to the main manuscript, as new Figure 5. To clarify further the effect of S100A11 depletion on the tight actin bundle formation at the cell-cell contacts, we have now included a new illustration in new Figure 5C. Additionally, we have clarified further these findings in the results section (page 11). While we agree with the Reviewer that additional experiments, for example using live imaging of MCF-10A cells co-labelled for F-actin and tubulin, would help assess further the crosstalk between cortical actin and astral microtubules, based on our experience these live imaging experiments are challenging and can take up to several months to optimise and may not warrant successful outcome.

      *- I think the discussion would benefit from the addition of a graphical cartoon model illustrating the role of S100A11 in controlling plasma membrane dynamics in mitosis and spindle orientation. *

      __Authors response: __We thank the Reviewer for this suggestion. We have now added a graphical cartoon (new Figure 7), summarising the role of S100A11-mediated regulation of plasma membrane dynamics in polarised cell division orientation, progression and outcome. We hope this new illustration clarifies further the mechanisms described in this study.

      *- Finally, to understand the relevance of S100A11 in the context of 3D polarised mammary epithelia, it would be very interesting to analyse the effect of S100A11 knock-downn in mouse mammary epithelial acini grown in matrigel. This is not essential for the proposed studies, but would add biological relevance to the mechanisms characterised in 2D colture. *

      __Authors response: __We agree with the Reviewer that validating our findings in 3D cultures of mammary epithelial cells will be important to determine the influence of S100A11-mediated regulation of plasma membrane dynamics during mitosis on lumen formation and tissue morphogenesis. This is exactly the direction where the follow-up of these findings will go. While the first author who led this work has graduated and left our lab, we have recently recruited a new PhD student to address this important question, which will need a few years of investigation to provide important insights, similarly to what we did in our previous work (Fankhaenel et al., 2023 Nat Commun).

      *Minor comments: *

      *- It would be preferable to mention the known functions of S100A11 in the introduction rather than at the beginning of the paragraph at pg. 9. *

      __Authors response: __In response to the Reviewer’s suggestion, we have now moved the paragraph describing known functions of S100A11 to the introduction of the revised manuscript (see page 5).

      *- at pg 10, beginning of paragraph, I find it a weird phrasing that "LGN interacts with F-actin". As reported in the reference cited here, this is through Afadin, which binds simultaneously LGN and cortical F-actin. I would rephrase it. *

      __Authors response: __We thank the Reviewer for clarifying this point, which we have now rectified in the revised manuscript (see page 11).

      __Reviewer #1 (Significance (Required)): __

      *The description of cell adhesion as key factor instructing correct mitotic progression and execution of oriented division of vertebrate epithelial cells by controlling plasma membrane dynamics is novel and interesting for scientist in the spindle orientation/polarity field. The experiments are well-designed and perfectly executed and presented. I am in favour of publication of the manuscript, providing that a few points are addressed. *

      Authors response: We thank the Reviewer for their very positive evaluation of our work.

      __Reviewer #2 (Evidence, reproducibility and clarity (Required)): __

      *Establishment and maintenance of cell polarity are fundamental processes for physiology in multi-cellular organism given the fact that more than 380 million epithelial cell renewal for every second in human adults. However, the precise mechanisms linking plasma membrane polarity and cortical cytoskeleton dynamics of epithelial cells during mitotic exit and interphase remain ill-illustrated. Salah Elias and her colleagues experimentally manipulated the density of mammary epithelial cells in culture, which led to several mitotic defects. Specifically, they found that perturbation of cell-cell adhesion integrity impairs the dynamics of the plasma membrane during mitosis, affecting the shape and size of mitotic cells and resulting in defects in mitosis progression and generating daughter cells with aberrant cytoarchitecture. In these conditions, F-actin-astral microtubule crosstalk is impaired leading to mitotic spindle misassembly and misorientation, which in turn contributes to chromosome mis-segregation. Mechanistically, they identified the S100 Ca2+-binding protein A11 as a key membrane-associated regulator that forms a complex with E-cadherin and LGN to coordinate plasma membrane remodelling with E-cadherin-mediated cell adhesion and LGN-dependent mitotic spindle machinery. I felt that this is a strong manuscript for peer-review as it serves diversified interests in modern cell biology. *

      Authors response: We thank the Reviewer for their overall very positive feedback on our manuscript.

      __Reviewer #2 (Significance (Required)): __

      Several key cellular experiments should be repeated using a second line of epithelial cells such as RPE1.

      __Authors response: __We agree with the Reviewer it will be interesting to test our findings in other epithelial cells, including RPE1 cells, a widely used epithelial cell model to study the mechanisms controlling cell division. Nonetheless, we would like to emphasise that while our work demonstrates the importance of the interplay between plasma membrane dynamics and cell-cell adhesion for correct execution of polarised cell divisions in mammary epithelial cells, our aim is not to generalise the role of these S100A11-mediated mechanisms. An elegant study has shown that the mechanisms controlling plasma membrane remodelling and elongation during mitosis to ensure correct positioning of the mitotic spindle and symmetric division differ between HeLa cells and RPE1 cells (Kiyomitsu and Cheeseman, 2013 Cell). Additional experiments in a second cell line will require a thorough characterisation of the expression and localisation of S100A11 during the cell cycle, as well as the use of extensive and time-consuming knockdown and imaging experiments over several months and may lead to different observations requiring further mechanistic investigation, which is beyond the initial scope of this study. Additionally, the PhD student who led this study has graduated and left the lab and presently we don’t have capacity or resources to conduct these suggested experiments. Finally, to precisely address the Reviewer’s concern, we have now amended the revised manuscript to make our statements more specific to mammary epithelial cells throughout the text.

      __Reviewer #3 (Evidence, reproducibility and clarity (Required)): __

      *Summary: your understanding of the study and its conclusions. *

      *The scope of the study is to understand the links between cell-cell adhesion integrity, plasma membrane dynamics and mitotic spindle in mammalian epithelial tissues. To test this, the authors cultured mammary epithelial cells at optimal or low density as a way of perturbing cell-cell adhesion. The authors conclude that perturbing cell-cell adhesion alters plasma membrane dynamics, causing mitotic defects and that S100A11 coordinates this link via E-cadherin. Whilst this is an interesting manuscript, illustrating the differences of mitotic success in optimal density vs. low density cell cultures, I do not think that the conclusions are supported by the evidence presented for the reasons stated below. *

      *Major comments: major issues affecting the conclusions. *

      *- The manuscript clearly shows that culturing cells at a lower density results in a higher incidence of asymmetric division (figure 1) and mitosis defects (figure 2). Cells round more and faster and there is more actin at the cortex during rounding (figure 3). However, whilst differences in cell-cell adhesion are likely to play a role in mediating these effects, I don't think that it is possible to claim from the data presented that these defects are specifically due to cell-cell adhesion differences. This is because the morphology of cells at low density is also very different - cells appear more mesenchymal, with migratory front-rear polarity instead of apical-basal polarity. These cells will therefore have many differences between them, cell-adhesion being just one. The data is also not showing a 'loss' of cell-cell adhesion integrity but are rather illustrating the differences between cells that have formed cell-cell adhesions and those that have not. To really test the specific role of cell-cell adhesions, the authors would need to inhibit adhesions directly but without altering the cell density - for example via chemical or genetic perturbation within a confined environment. I suggest that the authors either need to do these experiments or to requalify what their data is telling us. *

      __Authors response: __We thank the Reviewer for their insightful discussion of the proposed mechanisms described in our manuscript. Several of the Reviewer’s comments pinpoint and exactly match the messages that we would like to convey to the scientific community. Therefore, to address the Reviewer’s comments, we have carefully requalified our statements in several places in the revised manuscript, to ensure they are more clear and more precise.

      We agree with the Reviewer’s comment that our experiments using sub-optimal density of mammary epithelial cells rather prevents the formation of cell-cell adhesions than disturbing them. The Reviewer is right, our experiments in low-density cultures suggest that perturbation of cell-cell adhesion formation impairs mammary epithelial identity, where cells lose their polarity and adopt a more mesenchymal phenotype, associated with plasma membrane remodelling defects. This affects the dynamics and progression of cell division. Nonetheless, our observations suggest an interplay between cell-cell adhesion and the plasma membrane to maintains correct cell shape during mitosis. To test this hypothesis, we explored the function of S100A11 which we have identified in the LGN interactome in mitotic mammary epithelial cells (Fankhaenel et al., 2023 Nat Commun), and which has been shown to interact with E-cadherin at adherens junctions in MDCK cells (Guo et al., 2014 Sci Signal). This, together with the fact that S100A11 controls plasma membrane repair (Jaiswal et al., 2014 Nat Commun), suggested S100A11 as an interesting candidate to investigate the interplay between cell-cell adhesion and membrane remodelling during mitosis. The data presented here suggest that we were right and the perturbation of our membrane-bound target, S100A11, indeed leads to the same mitotic phenotypes. S100A11 RNAi-mediated knockdown (48h) affects E-cadherin localisation at the plasma membrane and impairs cell-cell adhesion formation with effects on plasma membrane dynamics that phenocopy the defects observed in our low-density culture experiments. Remarkably, perturbation of cell-cell adhesions persisted in cell treated with si-S100A11 for 72h (see Figure S3). Of note, all our siRNA experiments have been carried out in cells cultured at optimal density to establish cell-cell adhesions. Thus, S100A11 knockdown allows genetic perturbation of E-cadherin-mediated cell-cell adhesion and recapitulates the plasma membrane and mitotic defects observed in sub-optimal cultures of mammary epithelial cells. Future experiments will be key to dissect these S100A11-mediated mechanisms to further understand how plasma membrane remodelling and cell-cell adhesions are coordinated during mitosis. Finally, as suggested by the Reviewer, we have now requalified our conclusions as appropriate in the revised manuscript.

      *- The current manuscript also demonstrates that cell adhesion is affected when S100A11 is knocked down (figure 4). It shows binding between and colocalization of S100A11 and E-cadherin, and shows that LGN cortical distribution is affected when S100A11 is knocked down (Figure 5). The results presented are suggestive of S100A11 being upstream of E-cadherin. However, I don't understand how the data shows "crosstalk between the plasma membrane, cell-cell adhesion, and the cell cortex during mitosis". For example, on P9: "We observed unequal distribution of CellMaskTM in a vast majority of S100A11-depleted cells (si-S100A11#1: ~79% versus si-Control: ~26%), indicating defects in plasma membrane remodelling (Figures 4B and 4C)." I don't agree that this demonstrates a defect in PM remodelling. Rather the cells in the representative images are less adherent and have adopted a more migratory cell state similar to that seen in figure 1 when seeded at low density. The fluidity of the much larger cells shown in knock down cells in panel F also appears higher, again suggesting an adhesion defect. *

      • *

      __Authors response: __The Reviewer has raised very important points here, which we would like to clarify.

      We agree with the Reviewer that our results in S100A11-depleted cells indicate impaired cell adhesions which generates cells displaying an invasive/migratory behaviour. However, our analysis of S100A11-depleted mitotic cells labelled with CellMaskTM reveals abnormal plasma membrane elongation generating two daughter cells displaying defective geometry as compared to control cells. These defects in the plasma membrane and cell shape were not noticeable upon E-cadherin knockdown (see previous Figures 5K and 5L; now new Figures 6K and 6L). Thus, our results strongly suggest that S100A11 acts as an upstream cue that coordinates plasma membrane dynamics with E-cadherin-mediated cell adhesions, and that additional mechanisms may be regulated by S100A11 to coordinate cell-cell adhesion with plasma membrane remodelling. How S100A11 ensures such a dynamic interplay between the plasma membrane and E-cadherin during mitosis remains a key question that we have not fully addressed in this initial study. An attractive mechanism could be mediated by the function of S100A11 in regulating the dynamic interaction between F-actin and the plasma membrane, as previously reported (Jaiswal et al., 2014 Nat Commun). Increasing evidence shows the importance of the crosstalk between the plasma membrane, the cortex and cell shape for correct execution of mitosis (Rizzelli et al., 2020 Open Biol). In our experiments, we show that impaired plasma membrane remodelling and cell shape are associated with defects in F-actin and astral microtubule organisation. Thus, our findings reinforce a model whereby S100A11 is a key membrane-associated protein that coordinates the crosstalk between the plasma membrane, cell-cell adhesion, and the cell cortex during mitosis. It will be key to characterise the interactome of S100A11 during mitosis to provide important mechanistic insights into this new role of S100A11; it is our intention to investigate this in the future.

      To address the points raised by the Reviewer, we have changed and clarified the statements they highlighted above, in the revised manuscript (pages 10 and 11).

      *- An earlier paper from the same lab this year identified Annexin A1 as directing mitotic spindle orientation via localising LGN at lateral cortex. During this earlier paper they also identified S100A11, which is a partner for Annexin A1. The authors could more clearly explain what S100A11 is in the current manuscript and how the current study builds on this earlier study. *

      __Authors response: __We thank the Reviewer for highlighting our previous work characterising the interactome of LGN in mitotic mammary epithelial cells (Fankhaenel et al., 2023 Nat Comms), and identifying Annexin A1 (ANXA1) as a polarity cue regulating the localisation and function of the evolutionarily conserved mitotic spindle orientation LGN complex. We also showed that ANXA1 direct partner S100A11 co-purifies with LGN and that perturbation of the ANXA1-S100A11 complex impairs the localisation of the LGN complex at the cell cortex during mitosis. Thus, as rightly pointed out by the Reviewer, this work builds on our previous work discussed above, but also on previous studies establishing S100A11 as a key regulator of plasma membrane repair by regulating the dynamic interplay between F-actin and the plasma membrane (Jaiswal et al., 2014 Nat Commun), and studies showing that S100A11 interacts with E-cadherin at adherens junctions (Guo et al., 2014 Sci Signal). To address the Reviewer’s point (also raised by Reviewer 1), we have now included a paragraph in the introduction (page 5) and results (page 10) of the revised manuscript describing these and other functions of S100A11 to provide a strong rational to our decision to investigate this protein.


      *- Based on the data presented, I suggest that the authors should requalify their data. I suggest that the conclusions that can be drawn from the data are that cellular state is important for regulating mitosis orientation and fidelity (i.e. adherent epithelia cells vs. less adherent more migratory cells). S100A11 is important for promoting cell-cell adhesions and might be upstream of the known role of E-cadherin in regulating spindle orientation. Whilst I suggest that more quantified experiments would need to be included in order to assess possible effects on plasma membrane remodelling, the manuscript could be generally improved by a clearer explanation of the open question that they are addressing and what specific advance this manuscript has made in relation to the current literature, including their own. I do not currently feel that the title of the manuscript is appropriate since I don't think that a crosstalk between the plasma membrane and cell-cell adhesion has been shown here. *

      __Authors response: __We would like to reiterate our agreement with the Reviewer’s suggestion about the conclusions drawn from our data. In the initial submission we proposed that perturbation of S100A11-mediated regulation of cell adhesion and plasma membrane impairs the identity of mammary epithelial cells, which affects their shape during mitosis leading to aberrant mitotic progression and outcome. While we have not checked the migratory behaviour of cells not forming cell-cell adhesions, we suggested that the cells adopted a mesenchymal phenotype. Furthermore, we discussed the implication of epithelial-to-mesenchymal transition on chromosome segregation fidelity and execution of mitosis, and how precisely they link with our study (see initial submission’s pages 14 and 19). As suggested by the Reviewer, we have now clarified further these observations in the results (pages 7 and 11) and discussion (pages 15 and 19) of the revised manuscript.

      We have quantified several aspects of the changes in plasma membrane dynamics and remodelling throughout, in the initial manuscript (Figure 1D-H; Figure 4C). To address the Reviewer’s point, we have now added quantifications of membrane blebbing (new Figure 1I).

      We would like to emphasise that the introduction of the initial manuscript has included the open questions that led to this study. These questions have been addressed further in the discussion, where we have also formulated new hypotheses and discussed what we think are the important outstanding questions for future investigations, in light of our findings. In this study we demonstrate that maintaining epithelial identity is essential for correct execution of polarised cell divisions. Our findings indicate that mammary epithelial cells grown at sub-optimal density lose their epithelial identity, which results in several mitotic defects. We propose a novel mechanism in which S100A11 acts as a molecular sensor of external cues coordinating the interplay between plasma membrane dynamics and cell-cell adhesion to maintain epithelial identity and integrity, thereby ensuring correct progression, orientation, and outcome of cell division. As suggested by the Reviewer, we have clarified further the advances made in this study, in the revised Results and Discussion sections.

      To address the Reviewer’s final point, we would like to suggest the following revised title “Interplay between the plasma membrane and cell-cell adhesion maintains epithelial identity for correct polarised cell divisions”, which we hope reflects better the results described in our studies.

      *Minor comments: important issues that can confidently be addressed. *

      - P3: I wouldn't describe the junctional proteins listed as polarity proteins.

      __Authors response: __We have now made this rectification in page 3, as suggested by the Reviewer.

      *- Figure 1 - can the membrane blebbing phenotype by quantified? At the moment this part is observational so can't really be used to determine the role of plasma membrane remodelling. *

      • *

      __Authors response: __We have now included quantifications of blebbing in the revised manuscript, as suggested by the Reviewer (new Figure 1I).

      *- Figure 3. I'm not sure what the 'subcortical actin cloud' measurement is. Figure 3G suggests it may be the distance from the cortex to the spindle pole but how does this relate to actin? *

      __Authors response: __The Reviewer is right, the subcortical actin cloud includes a pool of dynamic subcortical actin that extends from the cortex (excluding the stiff cortical actin) to the cytoplasm, interacting with the centrosomes and concentrating near the retraction fibres. The subcortical actin cloud has been shown to mediate cortical forces and to concentrate force-generating proteins at the retraction fibres acting on centrosome dynamics and pulling on astral microtubules to orient the mitotic spindle (for example, please see Kwon et al., 2015 Dev Cell). We have now included this clarification in the revised manuscript (page 10).

      *- Figure 4A. I can't see GFP-S100A11 accumulating at the cell surface. To me these images suggest that it is relatively ubiquitously expressed throughout the cytoplasm and surface, which is different to the later antibody stains, that show localisation at the cell surface. *

      __Authors response: __A similar point has been raised by Reviewer 1. Although our retroviral-mediated transduction allows to avoid excessive expression of GFP-S100A11, the ectopic S100A11 is expressed at higher levels as compared to its endogenous counterpart. Our live images show an accumulation of the protein at the cell surface, but relatively high levels are also visible in the cytoplasm (previous Figure 4A, new Figure S4A). By contrast immunolabelling for endogenous S100A11 shows an obvious accumulation of the protein at the plasma membrane. This difference could also be due to a dynamic behaviour of the protein translocation of GFP-S100A11 between the cell surface and cytoplasm that is captured in our live imaging. Similar slight differences between immunofluorescence and live imaging of cortical proteins involved in mitosis, such as Dynein, NuMA, LGN and CAPZB, have been reported in several studies (to cite a few: di Pietro et al., 2017 Curr Biol; Elias et al., 2014 Stem Cell Rep; Fankhaenel et al., 2023). To address this point, we have now moved the panel showing S100A11 immunofluorescence in Figure S3A to new Figure 4A (also see response to Reviewer 1 Major Point 1).

      *- Fig 4H doesn't show an active process of translocation of E-Cadherin to the cytoplasm. It shows representative images with slightly higher levels of E-Cadherin in the cytoplasm. This could be due to translocation or it could be to do with lack of E-Cadherin assembly. *

      • *

      __Authors response: __We thank the Reviewer for pointing this out. We have rectified this statement accordingly (page 11).

      *- 4I I don't understand where the line profile is derived from - where is apical and where is basal in the images? Could a diagram be included? *

      __Authors response: __We have now included an illustration of this quantification, in the revised manuscript (new Figure 4J).

      - The discussion could be shortened and more clearly written - perhaps with subheadings of the main findings.

      __Authors response: __We have clarified several ideas and statements, based on the specific points addressed above. While it is challenging to reduce the size of this section, given that the study addresses several mechanisms of mitosis, we have now shortened the discussion in the revised manuscript.

      *- Methods: Why is cholera toxin used in the cell culture medium? *

      • *

      __Authors response: __Cholera toxin is a key component of MCF-10A medium, which has been shown to stimulate cAMP activation promoting cell proliferation in culture. This culture protocol is a gold standard in the field (Debnath et al., 2023 Methods). Given that cholera toxin is a highly regulated chemical and takes several months to purchase, we have tried culturing MCF-10A without the toxin, but this negatively affected proliferation and passage of this cells. Therefore, we concluded that adding it to the culture medium is important.

      __Reviewer #3 (Significance (Required)): __

      *In general, this is an interesting paper about the fidelity of mitosis in cells in adherent monolayers vs. in more migratory, non-adherent states. There is existing literature on this topic (some cited in the manuscript, alongside reviews of the topic). *

      • *

      *The main conceptual advance, as far as I can see, is that S100A11 is important for promoting cell-cell adhesions and might be upstream of the known role of E-cadherin in regulating spindle orientation via LGN. The main limitation is that plating cells at different densities is not a direct 'perturbation' of cell-cell adhesion. This means that the phenotypes seen could be due to many factors, not just cell adhesion. Assessment of plasma membrane and cytoskeletal dynamics are also often observational and not conclusive. *

      • *

      *The manuscript would be of interest to basic researchers working on epithelial development. Also potentially to basic researchers working on cancer, due to the mitotic errors described. *

      • *

      *I have expertise in epithelial cell biology. *

      I estimate the authors would need between 3 and 6 months for revisions if they decide to do further experiments and between 1 and 3 months if they decide to re-qualify their claims.

      • *

      __Authors response: __We thanks the Reviewer for their overall positive feedback on our work and its broader importance for researchers in epithelial development and cancer biology.

      We would like to reiterate our agreement with the Reviewer’s assessment of the conceptual advances of our work. We show that S100A11 complexes with E-cadherin and LGN during mitosis to control cell-cell adhesion assembly and the mitotic spindle machinery, respectively, which in turn ensures faithful chromosome segregation. Our results also suggest that S100A11 lies upstream of E-cadherin in the regulation of the LGN-mediated mitotic spindle machinery. We also agree with the Reviewer that plating epithelial cells at low density does not directly affect cell-cell adhesion, because, in these culture conditions, cells are not dense enough to establish cell-cell contacts necessary to assemble stable adherens junctions. Rather, and as rightly pointed out by the Reviewer, cells grown at low density fail to maintain their epithelial identity and adopt a more mesenchymal and elongated behaviour, which is accompanied by dramatic changes in plasma membrane remodelling throughout mitosis. Interestingly, our results show that both S100A11 and E-cadherin do not localise at the plasma membrane in these sub-optimal culture conditions. This along with our results showing that depletion of S100A11 phenocopies the effect of low-density culture conditions on plasma membrane remodelling and E-cadherin mediated cell-cell adhesion assembly, allow us to propose a mechanism whereby the membrane-associated S100A11 protein acts as a molecular sensor of external cues bridging plasma membrane remodelling to E-cadherin-dependent cell adhesion to coordinate correct progression and outcome of mammary epithelial cell divisions.

      We are grateful for the Reviewer’s insightful discussion of our findings. As we discussed above in our responses to their specific points, we have requalified many of our statements to clarify further our main findings and conclusions throughout the revised manuscript. We have also added new quantifications in response to the Reviewer’s suggestions. We believe, that together, these revisions have advanced further the initial manuscript.

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      Summary: your understanding of the study and its conclusions.

      The scope of the study is to understand the links between cell-cell adhesion integrity, plasma membrane dynamics and mitotic spindle in mammalian epithelial tissues. To test this, the authors cultured mammary epithelial cells at optimal or low density as a way of perturbing cell-cell adhesion. The authors conclude that perturbing cell-cell adhesion alters plasma membrane dynamics, causing mitotic defects and that S100A11 coordinates this link via E-cadherin. Whilst this is an interesting manuscript, illustrating the differences of mitotic success in optimal density vs. low density cell cultures, I do not think that the conclusions are supported by the evidence presented for the reasons stated below.

      Major comments: major issues affecting the conclusions.

      The manuscript clearly shows that culturing cells at a lower density results in a higher incidence of asymmetric division (figure 1) and mitosis defects (figure 2). Cells round more and faster and there is more actin at the cortex during rounding (figure 3). However, whilst differences in cell-cell adhesion are likely to play a role in mediating these effects, I don't think that it is possible to claim from the data presented that these defects are specifically due to cell-cell adhesion differences. This is because the morphology of cells at low density is also very different - cells appear more mesenchymal, with migratory front-rear polarity instead of apical-basal polarity. These cells will therefore have many differences between them, cell-adhesion being just one. The data is also not showing a 'loss' of cell-cell adhesion integrity but are rather illustrating the differences between cells that have formed cell-cell adhesions and those that have not. To really test the specific role of cell-cell adhesions, the authors would need to inhibit adhesions directly but without altering the cell density - for example via chemical or genetic perturbation within a confined environment. I suggest that the authors either need to do these experiments or to requalify what their data is telling us. The current manuscript also demonstrates that cell adhesion is affected when S100A11 is knocked down (figure 4). It shows binding between and colocalization of S100A11 and E-cadherin, and shows that LGN cortical distribution is affected when S100A11 is knocked down (Figure 5). The results presented are suggestive of S100A11 being upstream of E-cadherin. However, I don't understand how the data shows "crosstalk between the plasma membrane, cell-cell adhesion, and the cell cortex during mitosis". For example, on P9: "We observed unequal distribution of CellMaskTM in a vast majority of S100A11-depleted cells (si-S100A11#1: ~79% versus si-Control: ~26%), indicating defects in plasma membrane remodelling (Figures 4B and 4C)." I don't agree that this demonstrates a defect in PM remodelling. Rather the cells in the representative images are less adherent and have adopted a more migratory cell state similar to that seen in figure 1 when seeded at low density. The fluidity of the much larger cells shown in knock down cells in panel F also appears higher, again suggesting an adhesion defect. An earlier paper from the same lab this year identified Annexin A1 as directing mitotic spindle orientation via localising LGN at lateral cortex. During this earlier paper they also identified S100A11, which is a partner for Annexin A1. The authors could more clearly explain what S100A11 is in the current manuscript and how the current study builds on this earlier study.

      Based on the data presented, I suggest that the authors should requalify their data. I suggest that the conclusions that can be drawn from the data are that cellular state is important for regulating mitosis orientation and fidelity (i.e. adherent epithelia cells vs. less adherent more migratory cells). S100A11 is important for promoting cell-cell adhesions and might be upstream of the known role of E-cadherin in regulating spindle orientation. Whilst I suggest that more quantified experiments would need to be included in order to assess possible effects on plasma membrane remodelling, the manuscript could be generally improved by a clearer explanation of the open question that they are addressing and what specific advance this manuscript has made in relation to the current literature, including their own. I do not currently feel that the title of the manuscript is appropriate since I don't think that a crosstalk between the plasma membrane and cell-cell adhesion has been shown here.

      Minor comments: important issues that can confidently be addressed.

      P3: I wouldn't describe the junctional proteins listed as polarity proteins. Figure 1 - can the membrane blebbing phenotype by quantified? At the moment this part is observational so can't really be used to determine the role of plasma membrane remodelling.

      Figure 3. I'm not sure what the 'subcortical actin cloud' measurement is. Figure 3G suggests it may be the distance from the cortex to the spindle pole but how does this relate to actin?

      Figure 4A. I can't see GFP-S100A11 accumulating at the cell surface. To me these images suggest that it is relatively ubiquitously expressed throughout the cytoplasm and surface, which is different to the later antibody stains, that show localisation at the cell surface.

      Fig 4H doesn't show an active process of translocation of E-Cadherin to the cytoplasm. It shows representative images with slightly higher levels of E-Cadherin in the cytoplasm. This could be due to translocation or it could be to do with lack of E-Cadherin assembly.

      4I I don't understand where the line profile is derived from - where is apical and where is basal in the images? Could a diagram be included?

      The discussion could be shortened and more clearly written - perhaps with subheadings of the main findings.

      Methods: Why is cholera toxin used in the cell culture medium?

      Significance

      In general, this is an interesting paper about the fidelity of mitosis in cells in adherent monolayers vs. in more migratory, non-adherent states. There is existing literature on this topic (some cited in the manuscript, alongside reviews of the topic).

      The main conceptual advance, as far as I can see, is that S100A11 is important for promoting cell-cell adhesions and might be upstream of the known role of E-cadherin in regulating spindle orientation via LGN. The main limitation is that plating cells at different densities is not a direct 'perturbation' of cell-cell adhesion. This means that the phenotypes seen could be due to many factors, not just cell adhesion. Assessment of plasma membrane and cytoskeletal dynamics are also often observational and not conclusive.

      The manuscript would be of interest to basic researchers working on epithelial development. Also potentially to basic researchers working on cancer, due to the mitotic errors described.

      I have expertise in epithelial cell biology.

      I estimate the authors would need between 3 and 6 months for revisions if they decide to do further experiments and between 1 and 3 months if they decide to re-qualify their claims.

    1. hypothesis is kind of easy to agree on after a couple deductive guesses so you 01:23:21 guys want to go through it and see if you're a simulation hypothesis that's what Elon Musk is all right first question to silently answer these do you think it's probable that our 01:23:36 descendants will have computational power that is vast compared to ours today presume the answer is probably [Music] 01:23:48 okay next question will that vast ability to simulate worlds result in any of them doing two or more High Fidelity or hyper realistic ancestor or origin 01:24:02 simulations that include fully realistic physics presume the answer is sure it's probably true that at least two out of countless trillions of our 01:24:15 descendants spread across every imaginable region of time and space will use their Advanced abilities to do origin simulations deducted conclusion in Elon musk's words 01:24:28 we're probably living in a simulation in my words it is more probable than not that we are in one of the simulated realities versus being so lucky we happen to be in the one real reality
      • for self-simulation hypothesis
      • comment
        • I agreed with a lot of what he said up to now. In fact, he does a rather good presentation summarizing the contemporary problems we face and emphasizing the acceleration of change in all human spheres, giving rise to our current polycrisis
        • I agree that the mythos of materialism needs to be seriously explored and other perspectives may give us new salient insights, but I don't think it's so obvious that the theory that we are living in a simulation.
          • and quantum gravity theory a highly abstract cultural artefact being used to prove that
        • is going to be the panacea to create a compelling new mythos..
        • If technology alone is insufficient as he earlier claimed, then quantum gravity theory, as part of the entangled STEMS nexus is part of that techno-complex that is insufficient.
        • This claim will have to be proven true by strong and compelling evidence that receives mass acceptance. Without that, it becomes an unjustified claim and the complexity of it will elude most people.
    1. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      This MS contains carefully carried out and well controlled experiments describing a new pFFAT in ELYS. There is a similarly convincing demonstration of functionally relevant colocalisation by proximity ligation assay (PLA), particularly that both ELYS and VAP are nuclear envelope proteins in interphase without interacting (neg control in Fig 4D).

      Major Issue: Functional significance

      A key conclusion is that experiments prove that "ELYS serves as the crucial initiation factor for post-mitotic NPC-assembly" (p5). However, evidence for this is lacking as this would require reconstitution of NPC assembly with a mutant form of ELYS carefully changing the FFAT motif (e.g. 1321A 1324E) and exclusion of other probable VAP targets in experiments with mutant VAP. VAPs are among the proteins with the highest number of documented interactors (see Huttlin 2015/7 etc, e.g. PMID 26186194), so knocking down VAP may have pleiotropic effects and quite indirect read-outs in many aspects of cell function. In addition, for this work specifically there are other NE proteins that are known interactors of VAP: Emerin (EMD) and LBR both interact with VAP (high-throughput data, VAPA and VAPB). EMD has a motif similar to the canonical phospho-FFAT: 98 SYFTTRT 104. LBR has no motif. These findings should not be overlooked in this work. For example, was the interaction with emerin (page 4) sensitive to mutating VAP or ELYS? Could the effect seen in Figure 5 result from interactions with proteins other them ELYS?

      Further experiments should be carried out to justify all statements in the current MS of functional significance. Instead of doing more experiments, an alternative for the authors would be to describe the current set of results more cautiously. However, that would require changing much of the impact of the current MS, from the title onwards.

      Moderate Issue: VAPA

      From the start of the Introduction and some elements of the Discussion, include VAPA in equal measure with VAPB. When describing interactions of ELYS with VAP note that Huttlin et al., reported interactions twice for each of VAPA and VAPB. When describing own results (James et al. 2019) and those of others (Saiz-Ros et al., 2019) that focused on VAPB, clarify if the authors' view is that VAPA would (or would not) have the same interaction.

      Is there any evidence that only VAPB is on NE? Note that some refs in the Introduction relate to VAPA: Mesmin (not VAPB); ACBD5: although article titles refer to VAPB, early work (10.1083/jcb.201607055) showed almost identical involvement of VAPA. Also, this redundancy likely explains "function of VAPB in mitosis is not essential," (in Discussion). The lack of effect of VAPA knock-down may indicate that in these cells VAPB is dominant, but does not exclude a role for VAPA when VAPB is reduced. That might be tested by depleting both. Even following that, there is MOSPD2 to consider

      Other aspects of the writing

      "two amino acid residues are crucial for the interaction (VAPB K87 and M89)." This is wrong. Many residues are critical, these are merely 2 of possibly >10 that were chosen by Kaiser et al (2005) to create their non-binder.. Others have used different mutations to block FFAT binding.

      "They may exhibit a certain binding preference to specific members of the VAP ... family...". I cannot think of any example. I note no citation is given.

      When listing many or all MSP proteins, the text should state that MOSPD2 is uniquely close to VAPA/B. CFAP65 is typically not mentioned in the VAP-like lists as it does not have any of the conserved sequence that binds FFAT. If however the authors wish to include all human MSP domain protein, they should also include Hydin.

      Slightly wrong to cite De Vos et al., 2012 about PTPIP51's FFAT as that paper makes no mention of the motif. Better pick Di Mattia (again)

      On VAPB (and also A) on INM: there are references to be cited esp. relating to intranuclear Scs2 in yeast (Brickner et al 2004, Ptak et al 2021)

      Citations for VAP at ER-mito contacts "De Vos et al., 2012; Gómez-Suaga et al., 2019; Stoica et al., 2014)". These all refer to the same bridging protein, PTPIP51. Reduce to one citation. Then mention other proteins at the same site VPS13A, mitoguardin(MIGA)-2 ...

      "The domain interacts with characteristic peptide sequences ..." add citation to this sentence

      "Several variants of such motifs have been described: (i)" ... "(ii)": (i) and (ii) are entirely unlinked. Delete these and also "Several variants of such motifs have been described." Which is repeated later

      "FFAT-like motifs come in different flavors and may even lack the two phenylalanine residues (Murphy and Levine, 2016)": while motifs can tolerate variation at both positions, this text is misleading as it implies much more variation than is known. The 1st F can only be conservatively substituted (Y).

      Minor aspects in Results:

      ORP1L peptide as positive control: cite Kaiser 2005

      Was phosphoproteomics done in such a way as to find peptides that have both S1314 and S1326?

      Figure 4D, row 2: Comment on intranuclear staining in Prophase (at approx 4 o'clock) of both ELYS & VAP that is PLA positive

      Referees cross-commenting

      I agree with this point from Reviewer #1. We all agree that the main issue can be resolved experimentally to determine the effect of subtle point mutations in ELYS. Both other reviewers have done a good job in finding issues with the experiments that can also be addressed.

      Significance

      This work documents an interaction between the protein ELYS, that is involved in the reformation of nuclear pore complexes after mitosis, and the ER membrane protein VAPB. The interactions was previously known through high-throughput studies, along with many 100's of others for VAP, but here it is studied in detail and with care, identifying how the motif is induced by phosphorylation of ELYS. The two proteins are co-localised using convincing proximity ligation assays. This biochemistry and cell biological localisation is well done.

      Functional experiments then show that VAP (in this case VAPB) knock-down affects mitosis and chromosome segregation. While the result is incontrovertible, it has many possible interpretations, mainly because VAP has hundreds of interactions, including with multiple proteins involved in mitosis beyond just ELYS. This means that there are major limitations on how the interaction and co-localisation should be interpreted, reducing the advance associated with the current manuscript to incremental, and the limiting the audience to specialized.

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      Summary

      The VAP proteins are well established as tail anchored proteins of the ER membrane. VAPs mediates co-operation between the ER and other organelles by creating a transient molecular tether with binding partners on opposing organelles to form a membrane contact site over which lipids and metabolites are exchanged. Proteins which bind VAPs generally contain a short FFAT motif, of varying sequence which binds the MSP domain of VAP. More recently the FFAT motif has been more extensively analysed in multiple different proteins and differential phosphorylation of the FFAT motif has been shown to either enhance or block VAP binding depending on the position of the phosphosite.

      Recent work conducted by the authors demonstrated that a small population of VAPB is not exclusively localised to the ER and can also reach the inner nuclear membrane. They also identified ELYS as a potential interaction partner of VAPB in a screening approach. ELYS is a nucleoporin that can be found at the nuclear side of the nuclear envelope where it forms part of nuclear pore complexes. During mitosis, ELYS serves as an assembly platform that bridges an interaction between decondensing chromosomes and recruited nucleoporin subcomplexes to generate new nuclear pore complexes for post-mitotic daughter cells. In this manuscript, James et al seek to explore this enigmatic potential interaction between ELYS and VAPB to address why VAPB may be found at the inner nuclear membrane.

      Peptide binding assays and some co-immunoprecipitation experiments are used to demonstrate that interactions occur via the MSP-domain of VAPB and FFAT-like motifs within ELYS. In addition, it is demonstrated that, for the ELYS FFAT peptides, the interaction is dependent on the phosphorylation status of serine residues of a particular FFAT-motif that can either promote or reduce its affinity to VAPB. Of most relevance is a serine in the acidic tract (1314) which, when phosphorylated increases VAPB binding. This is completely in line with what is already known about the FFAT motif and so is not surprising, in particular when using a peptide in an in vitro assay.

      The authors then utilise cell synchronisation techniques to provide evidence that both phosphorylation of ELYS and its binding to VAPB are heightened during mitosis. Immunofluorescence and proximity ligation assays are used to demonstrate that the proteins co-localise specifically during anaphase and at the non-core regions of segregating chromosomes.

      The manuscript is concluded by investigating the effect of VAPB depletion on mitosis with some evidence to suggest that transition from meta-anaphase is delayed and defects such as lagging chromosomes are observed.

      Major comments

      Overall, this manuscript is well written and the data presented in Figures 1-3 convincingly show the nature of the interaction between ELYS and VAPB. Clearly the proteins interact via FFAT motifs and this interaction appears to be enhanced during mitosis. However, the work as is, relies heavily on peptide binding assays and would benefit from additional experiments to further support the results. The authors need to more clearly show that this specific phosphorylation happens during mitosis, they may have this data but it is not clearly explained. In addition, the data that VAPB-ELYS interaction contributes to temporal progression of mitosis (as per the title) is not sufficiently clear. VAPB silencing appears to have some impact on mitosis but this is not the same thing. So this section needs to be strengthened before this statement can be made.

      The authors claim that the study "suggests an active role of VAPB in recruiting membrane fragments to chromatin and in the biogenesis of a novel nuclear envelope during mitosis". Given the data presented in Figures 4 and 5, this appears to be rather speculative with little evidence to support it, so data should be provided or this statement toned down. Currently, without additional supporting data the authors may wish to revise the overarching conclusions of the study and change the title.

      Specific points.

      Peptide pull down assays clearly show which FFAT-like motifs are important in facilitating binding. The co-immunoprecipitation systems used in Figure 2 also provide useful information on the interaction in a cell context. The authors should combine these findings by introducing full length ELYS mutants with altered FFAT-like motifs into their stably expressing GFP-VAPB HeLa cell line and then performing Co-IPs to help identify which FFAT motif/s drive the mitotic interaction. Other mutants of ELYS harbouring either phosphomimetic or phospho-resistant residues may also be introduced to further investigate mechanisms of the molecular switch in a cellular environment to support the work currently done with peptides alone. This is an obvious gap in the work which, based on the other data the authors have shown, should presumably be straightforward and would also lead directly into the next major point.

      • Whilst silencing VAPB does appear to delay mitosis, no reference is made to ELYS throughout Figure 5 nor as part of its associated discussion. Given that VAPB has more than 250 proposed binding partners, the observed aberration of mitotic progression could result from a huge number of indirect processes. Further work is needed to link the experiment specifically to the VAPB-ELYS interaction and not just loss of VAPB. We would suggest generating a complementation system where ELYS is either knocked out or silenced and then wild-type ELYS and an ELYS FFAT mutant (which cannot interact with VAPB),and/or a phospho mutant (whose interaction cannot be regulated during mitosis) are introduced. Then the observed effects can be better attributed to the VAPB-ELYS interaction and not just loss of VAPB.
      • The immunofluorescence and PLA results in Figure 4 could be strengthened by including other ER markers. This would show that co-localisation of ELYS at the non-core region is specific to VAPB protein, not any ER protein or rather than an artefact of the ER being pushed out of the organelle exclusion zone during mitosis and therefore 'bunching' at the periphery of the nuclear envelope. It would be worthwhile repeating these experiments with candidates such as VAPA, other ER membrane proteins or at least GFP-KDEL, to make this phenomenon more convincing. As part of this the authors should ideally generate a complemented ELYS KO (see point above) to avoid the residual activity attributed to endogenous background in the PLA Figure 4E.
      • Authors should clarify if the phosphorylation events (in particular S1314) only occur or are increased during mitosis. This may be data they have from the MS experiment in Figure 3 or it could also be shown using a phospho-antibody (although this can be challenging if a suitable antibody cannot be made).
      • The authors should clarify why they need to do these semi in-vitro assays with purified GST-VAPB-MSP on beads and then lysates added and not just a standard co-IP. If this is simply signal intensity due to a very small proportion of VAPB binding to ELYS then this is fine but this should be stated and it should be made clear that ELYS is not a major binding partner - most of VAPB is on the ER. Otherwise, this is misleading.

      I estimate that the suggested alterations above would incur approximately 3-6 months of additional experimental work, depending on if KO cell lines were required.

      Minor comments

      • To show that the observed interactions and potential role of VAPB-ELYS interaction is universal it would be useful to have at least a subset of experiments also shown in another cell line or system - this is now also a requirement for some journals.
      • Consider re-wording the title of the manuscript to better reflect the data presented within the study. Alternatively, provide further evidence that VAPB-ELYS interactions directly affect temporal progression of mitosis to validate this claim, as discussed above.
      • Quantification of blots in Figure 2A could allow measurement of relative binding affinities between VAPB-ELYS throughout the cell cycle. The same could be applied to the effect of phosphorylation on binding affinity in Figure 2D.
      • The cells used are never clearly mentioned in the text - I assume this is always in HeLa but this should be added in all cases for clarity
      • Page 8: "As shown in Fig. 2A,a large proportion of GFP-VAPB was precipitated under our experimental conditions." - I don't understand how this is shown in this figure as the non-bound fraction is not shown?
      • Please provide some controls to demonstrate the extent to which the samples used are asyn, G1/M or M.
      • Page 9 - why are Phos-tag gels not shown as this would make this result more convincing?
      • Figure 3A - I find the SDS-PAGE gel confusing. Why not show the whole gel and why is the band size apparently reduced in the mitotic fraction when previously it was increased (by phosphorylation)? It would also be useful to see if there were any other band shifts.
      • "FFAT-2 of ELYS is regulated by phosphorylation" The way you have setup the experiment leads the reader to think you are going to show which sites are differentially phosphorylated in mitosis, but then this is not the case - so there seems no purpose to doing the experiment this way. If you used TMT MS approach you would be able to potentially quantify the change in phosphorylation at the FFAT motif sites in mitosis. Otherwise what is the purpose of using these 2 samples, mitotic and AS?
      • For all of the antibodies used, in particular for the PLA, please provide evidence of validation of the antibodies.
      • Just a minor point to consider - In the methods for your lysis buffer you use 400mM NaCl - might this slightly reduce the VAPB-FFAT interaction? Worth considering reducing this?
      • "The rather small difference observed between the wild-type and the mutant protein observed in this experiment probably results from the presence of endogenous VAPB in the stable cell lines, which could form dimers with the exogeneous HA-tagged versions." If this is the case then please demonstrate that this is happening, or use the KO approach in the major points above.
      • "we now show that the proteins can indeed interact with each other, without the need for additional bridging factors (Figs. 1 and 3)." You show that the peptides can bind - but this is not the same thing as the peptide in the full context of the protein - so this should be toned down or removed.
      • "Remarkably, this region is highly conserved between species, suggesting that it is important for protein functions (data not shown)". Please show the alignments so the reader can judge for themselves. It is conserved in ALL species and the phosphosites are also conserved??
      • "In our experiments, knockdown of VAPA alone did not lead to a delay in mitosis (data not shown). " Why not show this data - as this is a very interesting and potentially important observation? Also add the validation of knockdown of VAPA.
      • I find the end to the discussion to the paper rather abrupt. It would be interesting to discuss further how VAPB, but not apparently VAPA reaches the INM and if so why this function is required of an ER adaptor and not another more obvious adaptor protein. In short - why would VAPB be performing this role?

      Referees cross-commenting

      I agree with the comments of the other reviewers, and they are very much in line with my own review. We all seem convinced that VAPB binds ELYS via a pFFAT, and that this interaction is enhanced during mitosois. However the role of this interaction in mitotic progression remains unclear and based on this data should not be claimed in the title or discussion of the paper.

      Significance

      Overall, if the manuscript could be improved with the suggested changes, then this could be a considerable conceptual advance in how we understand the VAP proteins, showing functions beyond those as an ER adaptor. This would be significant for the field.

      In the context of the existing literature the work does not advance our knowledge of FFAT-VAP interactions, this has already been shown, but it would give a nice example of how this can be regulated during mitosis and how VAP can contribute beyond just as an ER adaptor at membrane contact sites.

      There would be a wide audience in the cell biology field and more widely as mutations in VAPB cause a form of ALS, and many people are working in this area.

      My field of expertise is in organelle cell biology and membrane contact sites.

    1. Author Response

      Reviewer #1 (Public Review):

      Medwig-Kinney et al perform the latest in a series of studies unraveling the genetic and physical mechanisms involved in the formation of C. elegans gonad. They have paid particular attention to how two different cell fates are specified, the ventral uterine (VU) or anchor cell (AC), and the behaviors of these two cell types. This cell fate choice is interesting because the anchor cell performs an invasive migration through a basement membrane. A process that is required for correct C. elegans gonad formation and that can act as a model for other invasive processes, such as malignant cancer progression. The authors have identified a range of genes that are involved in the AC/VC fate choice, and that imparts the AC cell with its ability to arrest the cell cycle and perform an invasive migration. Taking advantage of a range of genetic tools, the authors show that the transcription factor NHR-63 is strongly expressed in the AC cell. The authors also present evidence that NHR-63 is could function as a transcriptional repressor through interactions with a Groucho and also a TCF homolog, and they also suggest that these proteins are forming repressive condensates through phase separation.

      The authors have produced an extensive dataset to support their two primary claims: that NHR-67 expression levels determine whether a cell is invasive or proliferative, and also that NHR-67 forms a repressive complex through interactions with other proteins. The authors should be commended for clearly and honestly conveying what is already known in this area of study with exhaustive references. But absent data unambiguously linking the formation and dissolution of NHR-67 condensates with the activation of downstream genes that NHR-67 is actively repressing, the novelty of these findings is limited.

      Response 1.1: We thank the reviewer for recognizing the extensive dataset we provide in this manuscript in support of our claims that, (1) NHR-67 expression levels are important for distinguishing between AC and VU cell fates, and (2) NHR-67 interacts with transcriptional repressors in VU cells. We acknowledge that a complete mechanistic understanding of the functional significance of NHR-67 puncta is not possible without knowing direct targets of NHR-67 in the AC. Unfortunately, tools to identify transcriptional targets in individual cells or lineages in C. elegans do not exist, and generation of such tools would be beyond the scope of this work. This is evidenced by the fact that the first successful attempt to transcriptionally profile the AC was only posted as a preprint one month ago (Costa et al., doi: 10.1101/2022.12.28.522136). It is our hope that the findings we present here can be integrated with future AC- and VUspecific profiling efforts to provide a more complete picture of the functional significance of NHR-67 subnuclear organization.

      Reviewer #2 (Public Review):

      Medwig-Kinney et al. explore the role of the transcription factor NHR-67 in distinguishing between AC and VU cell identity in the C. elegans gonad. NHR-67 is expressed at high levels in AC cells where it induces G1 arrest, a requirement for the AC fate invasion program (Matus et al., 2015). NHR-67 is also present at low levels in the non-invasive VU cells and, in this new study, the authors suggest a role for this residual NHR-67 in maintaining VU cell fate. What this new role entails, however, is not clear. The model in Figure 7E shows NHR-67 switching from a transcriptional activator in ACs to a transcriptional repressor in VUs by virtue of recruiting translational repressors. In this model, NHR-67 actively suppresses AC differentiation in VU cells by binding to its normal targets and acting as a repressor rather than an activator. Elsewhere in the text, however, the authors suggest that NHR-67 is "post-translationally sequestered" (line 450) in nuclear condensates in VU cells. In that model, the low levels of NHR-67 in VU cells are not functional because inactivated by sequestration in condensates away from DNA. Neither model is fully supported by the data, which may explain why the authors seem to imply both possibilities. This uncertainty is confusing and prevents the paper from arriving at a compelling conclusion. What is the function, if any, of NHR-67 and so-called "repressive condensates" in VU cells?

      Response 2.1: As the reviewer correctly notes, we present two possible models in this manuscript. The interaction between NHR-67 and the Groucho/TCF complex in the VU cells could (1) switch the role of NHR-67 from a transcriptional activator to a transcriptional repressor, or (2) sequester NHR-67 away from its transcriptional targets. Indeed, we cannot definitively exclude the possibility of either model. In our resubmission, we will attempt to make this more clear in the text and by presenting both possible models in the summary figure (Fig. 7E).

      Below we list problems with data interpretation and key missing experiments:

      1) The authors report that NHR-67 forms "repressive condensates" (aka. puncta) in the nuclei of VU cells and imply that these condensates prevent VU cells from becoming ACs. Fig. 3A, however, shows an example of an AC that also assemble NHR-67 puncta (these are less obvious simply due to the higher levels of NHR-67 in ACs). The presence of NHR-67 puncta in the AC seems to directly contradict the author's assumption that the puncta repress the AC fate program. Similarly, Figure 5-figure supplement 1A shows that UNC-37 and LSY-22 also form puncta in ACs. The authors need to analyze both AC and VU cells to demonstrate that NHR-67 puncta only form in VUs, as implied by their model.

      Response 2.2: The puncta formed by NHR-67 in the AC are different in appearance than those observed in the VU cells and furthermore do not exhibit strong colocalization with that of UNC-37 or LSY-22. The Manders’ overlap coefficient between NHR-67 and UNC-37 is 0.181 in the AC, whereas it is 0.686 in the VU cells. Likewise, the Manders’ overlap coefficient between NHR-67 and LSY-22 is 0.189 in the AC compared to 0.741 in the VU cells. We speculate that the areas of NHR-67 subnuclear enrichment in the AC may represent concentration around transcriptional targets, but testing this would require knowledge of direct targets of NHR-67.

      2) While a pool of NHR-67 localizes to "repressive condensates", it appears that a substantial portion of NHR-67 also exists diffusively in the nucleoplasm. This would appear to contradict a "sequestration model" since, for such a model to work, a majority of NHR-67 should be in puncta. What proportion of NHR-67 is in puncta? Is the concentration of NHR-67 in the nucleoplasm lower in VUs compared to ACs and does this depend on the puncta?

      Response 2.3: The proportion of NHR-67 localizing to puncta versus the nucleoplasm is dynamic, as these puncta form and dissolve over the course of the cell cycle. However, we estimate that approximately 25-40% of NHR-67 protein resides in puncta based on segmentation and quantification of fluorescent intensity of sum Z-projections. We also measured NHR-67 concentration in the nucleoplasm of VU cells and found that it is only 28% of what is observed in ACs (n = 10). We disagree with the notion that the majority of NHR-67 protein should be located in puncta to support the sequestration model. As one example, previously published work examining phase separation of endogenous YAP shows that it is present in the nucleoplasm in addition to puncta (Cai et al., 2019, doi: 10.1038/s41556-019-0433-z). In our system, it is possible that the combination of transcriptional downregulation and partial sequestration away from DNA is sufficient to disrupt the normal activity of NHR-67.

      3) The authors do not report whether NHR-67, UNC-37, LSY-22, or POP-1 localization to puncta is interdependent, as implied in the model shown in Fig. 7.

      Response 2.4: It is difficult to test whether localization of these proteins to puncta is interdependent, as perturbation of UNC-37, LSY-22, and POP-1 result in ectopic ACs. Trying to determine if loss of puncta results in VU-to-AC transdifferentiation or vice versa becomes a chicken-egg argument. It is also possible that UNC-37 and LSY-22 are at least partially redundant in this context. We based our model, shown in Fig. 7E, on known or predicted protein-protein interactions, which we confirmed through yeast two-hybrid analyses (Fig. 7D; Fig. 7-figure supplement 1).

      4) The evidence that the "repressor condensates" suppress AC fate in VUs is presented in Fig. 4D where the authors deplete the presumed repressor LSY-22. First, the authors do not examine whether NHR-67 forms puncta under these conditions. Second, the authors rely on a single marker (cdh-3p::mCherry::moeABD) to score AC fate: this marker shows weak expression in cells flanking one bright cell (presumably the AC) which the authors interpret as a VU AC transformation. The authors, however, do not identify the cells that express the marker by lineage analyses and dismiss the possibility that the marker-positive cells could arise from the division of an ACcommitted cell. Finally, the authors did not test whether marker expression was dependent on NHR-67, as predicted by the model shown in Fig. 7.

      Response 2.5: For the auxin-inducible degron experiments, strains contained labeled AID-tagged proteins, a labeled TIR1 transgene, and a labeled AC marker. Thus, we were limited by the number of fluorescent channels we could covisualize and therefore could not also visualize NHR-67 (to assess for puncta formation) or another AC marker (such as LAG-2). We could have generated an AID-tagged LSY-22 strain without a fluorescent protein, but then we would not be able to quantify its depletion, which this reviewer points out is important to measure. We did visualize NHR-67::GFP expression following RNAi-induced knockdown of POP-1 and observed consistent loss of puncta in ectopic ACs. However, this again becomes a chicken-egg argument as far as whether cell fate change or loss of puncta causes the other.

      5) Interaction between NHR-67 and UNC-37 is shown using Y2H, but not verified in vivo. Furthermore, the functional significance of the NHR-67/UNC-37 interaction is not tested.

      Response 2.6: We attempted to remove the intrinsically disordered region found at the C-terminus of the endogenous nhr-67 locus, using CRISPR/Cas9, as this would both confirm the NHR-67/UNC-37 interaction in vivo and allow us to determine the functional significance of this interaction. However, we were unable to recover a viable line after several attempts, suggesting that this region of the protein is vital.

      6) Throughout the manuscript, the authors do not use lineage analysis to confirm fate transformation as is the standard in the field.

      Response 2.7: The timing between AC/VU cell fate specification and AC invasion (the point at which we look for differentiated ACs) is approximately 10-12 hours at 25 °C. With our imaging setup, we are limited to approximately 3-4 hours of live-cell imaging. Therefore, lineage tracing was not feasible for our experiments. Instead, we relied on visualization of established markers of AC and VU cell fate to determine how ectopic ACs arose. In Fig. 6B,C we show that the expression of two AC markers (cdh-3 and lag-2) turn on while a VU marker (lag-1) get downregulated within the same cell. In our opinion, live-imaging experiments that show in real time changes in cell fate via reporters was the most definitive way to observe the phenotype.

      There are 4 multipotential gonadal cells with the potential to differentiate into VUs or ACs. Which ones contribute to the extra ACs in the different genetic backgrounds examined was not determined, which complicates interpretation. The authors should consider and test the following possibilities: disruption of NHR-67 regulation causes 1) extra pluripotent cells to directly become ACs early in development, 2) causes VU cells to gradually trans-fate to an AC-like fate after VU fate specification (as implied by the authors), or 3) causes an AC to undergo extra cell division(s)?? In Fig. 1F, 5 cells are designated as ACs, which is one more that the 4 precursors depicted in Fig. 1A, implying that some of the "ACs" were derived from progenitors that divided.

      Response 2.8: When trying to determine the source of the ectopic ACs, we considered the three possibilities noted by the reviewer: (1) misspecification of AC/VU precursors, (2) VU-to-AC transdifferentiation, or (3) proliferation of the AC. We eliminated option 3 as a possibility, as the ectopic ACs we observed here were invasive and all of our previous work has shown that proliferating ACs cannot invade and that cell cycle exit is necessary for invasion (Matus et al., 2015; MedwigKinney & Smith et al., 2020; Smith et al., 2022). Specifically, NHR-67 is upstream of the cyclin dependent kinase CKI-1 and we found that induced expression of NHR-67 resulted in slow growth and developmental arrest, likely because of inducing cell cycle exit. For our experiment using hsp::NHR-67, we induced heat shock after AC/VU specification. For POP-1 perturbation, we explicitly acknowledged that misspecification of the AC/VU precursors could also contribute to ectopic ACs (Fig. 6A; lines 368-385). We could not achieve robust protein depletion through delayed RNAi treatment, so instead we utilized timelapse microscopy and quantification of AC and VU cell markers (Fig. 6B,C; see response 2.7 above).

      In conclusion, while the authors report on interesting observations, in particular the co-localization of NHR-67 with UNC-37/Groucho and POP-1 in nuclear puncta, the functional significance of these observations remains unclear. The authors have not demonstrated that the "repressive condensates" are functional and play a role in the suppression of AC fate in VU cells as claimed. The colocalization data suggest that NHR-67 interacts with repressors, but additional experiments are needed to demonstrate that these interactions are specific to VUs, impact VU fate, and sequester NHR-67 from its targets or transform NHR-67 into a transcriptional repressor.

      Response 2.9: We agree that, at this time, we cannot pinpoint the precise mechanism through which NHR-67 puncta function (i.e., by sequestering NHR-67 from DNA or switching the role of NHR-67 from activating to repressing). However, identification of NHR-67 puncta and their colocalization with UNC-37, LSY-22, and POP-1 in VU cells allowed us to discover an undescribed role for the Groucho/TCF complex in maintaining VU cell fate. This, combined with our evidence demonstrating that NHR-67 transcriptional regulation is important for distinguishing between AC and VU cell fate, are the main contributions of our study.

      Reviewer #1 (Recommendations For The Authors):

      I am not a C. elegans researcher and I find this paper fairly hard to follow. One major recommendation I would like to see is to improve the consistency of the labeling of the figures. There are many figures showing many things and I struggled to keep track of everything. For example, the thing that we are looking at in the microscope images (typically GFP tagged to a protein of interest) is sometimes labeled above the image, sometimes to the side, and sometimes within the panel. Experimental conditions are also formatted arbitrarily. As much as they can do so, could the authors try and make their labeling consistent? This would help me follow the data.

      Response 1.2: We thank the reviewer for this suggestion and have reorganized the figures (namely Figure 3, Figure 4, Figure 4–figure supplement 1, Figure 5, and Figure 6) such that the tagged allele or marker is labeled at the top, and the time, stage, and/or perturbation is labeled on the side.

      Is the yeast one-hybrid assay enough to confirm a direct interaction between HLH-2 and NHR-67? Obviously, it supports it, but since this is not a definitive test in C. elegans, I feel the description of this result should be modified to account for this.

      Response 1.3: We agree that the yeast one-hybrid assay identifies sequences that are capable of being bound to a protein and does not prove that a DNA-protein interaction occurs in vivo. We have modified our language describing this result in our resubmission (lines 222-224).

      NHR-67 and POP-1 eventually form two large spots. This observation supports the claims that these are condensates, but it is clearly different from the observations in Ciona where the condensates remain more or less stable until they quickly dissolve at the onset of mitosis. Do the authors have any idea why these condensates are behaving this way? Is it always two spots? This implies it is forming around some sort of diploid nuclear structure.

      Response 1.4: Hes.a puncta observed in Ciona were indeed shown to be dynamic, as puncta were captured fusing together (see Figure 6B of Treen et al., 2021). However, these puncta did not appear to coalesce into two puncta specifically, as is consistently observed with NHR-67 in C. elegans. We agree with the reviewer in that this observation is very interesting and likely correlates to a diploid nuclear structure, however we have yet to identify this.

      In Ciona, for the two examples of repressive condensates, it was shown that the removal of the C-terminal Groucho recruiting repressor domains of HesA end ERF disrupts condensate formation. Have the authors attempted a similar experiment for NHR-67 or Pop1?

      Response 1.5: We agree that this would have been an ideal experiment to perform. We attempted to remove the intrinsically disordered region found at the C-terminus of NHR-67 with CRISPR, but were unable to generate a stable line, suggesting that this region may be critical for NHR-67 function in other developmental stages or tissues.

      Other minor points:

      Fig 4D - I found the labeling of this figure the most confusing.

      Response 1.6: We thank the reviewer for bringing this to our attention. For this panel, in addition to the changes we made reference above (Response 1.2), we simplified the labeling of the TIR1 transgene and instead reference it in the figure legend for simplicity.

      Line 354 - I think this is mislabeled. Is it supposed to be Figure 5H, not 5F, and 5B, not 5C?

      Response 1.7: We thank the reviewer for spotting this error. This reference to Figure 5F has been updated and now correctly references Figure 5H (line 338).

      Reviewer #2 (Recommendations For The Authors):

      The authors use several methods to overexpress NHR-67 including 1) an NHR-67 transgene (Fig. 1), 2) overexpression of the transcriptional activator HLH-2 or 3) removal of a factor that normally degrades HLH-2 in VU cells (Fig. 2). In all cases, the rate of VU AC transformation is either very low (5%) or not reported but presumed to be zero, since other groups have done similar experiments and reported no such conversion (eg. Benavidez et al., 2022). What is the significance of this finding? Does this mean that high levels of NHR-67 are not sufficient to promote AC fate because NHR-67 is sequestered in puncta when expressed in VU cells? Fig. 2A suggests that NHR-67 is in puncta in all VUs where overexpressed. Would the inactivation of GROUCHO in that background result in extra ACs?

      Response 2.10: Indeed, we would expect that overexpression of NHR-67 may not normally be sufficient to induce cell fate transformation if the Groucho/TCF complex is still functional. Unfortunately we were unable to achieve strong depletion of UNC-37 and LSY-22 through RNAi, and thus relied on the auxin-inducible protein degradation system. Since we are limited by the number of fluorescent channels we can co-visualize, it would not be feasible to combine a heat-shock inducible transgene, a TIR1 transgene, an AID-tagged protein, and multiple cell fate markers.

      The data are often presented as numbers of animals with increased or decreased expression of a particular marker, but no quantification of expression is provided. For example, in Figure 1E, 32/35 animals are reported to exhibit ectopic expression of LIN-12 in the AC and reduced expression of LAG-2. What is the range of the increase/decrease in LIN-12/LAG-2 expression and how does this compare to natural variation in wild-type? The same concerns apply to Fig. 4D.

      Response 2.11: For resubmission, we have quantified the data shown in Figure 1E and now report expression levels of LIN-12::mNeonGreen and LAG-2::P2A::H2B::mTurquoise2 in Figure 1–figure supplement 2. We have also quantified the data in Figure 4D and now report expression levels of cdh-3p::mCherry::moeABD in Figure 4E. Quantification methods have been added to the Materials and Methods section (lines 612-617).

      The authors explain that it is difficult to study a repressive role for POP-1 as this protein functions in multiple developmental pathways and POP-1 depletion needs to be carefully timed for the data to be interpretable. The authors then go on to use RNAi to deplete POP-1 but do not describe in the methods how they achieve the needed precise temporal control.

      Response 2.12: We did indeed describe methods for the GFP-targeting nanobody, which we expressed under a uterinespecific promoter expressed after AC/VU specification. However, since the penetrance of phenotypes associated with this perturbation was low, we utilized RNA interference. We separated the cell fate specification and cell fate maintenance phenotypes by visualizing AC markers (Fig. 6A), which we would expect to be expressed at equal levels if ACs adopted their fate at the same time (via misspecification). We also paired these with a marker for VU cell fate and co-visualized them over time (Fig. 6B,C).

      The authors also do not report the efficiency of protein depletion by RNAi or Auxin treatment.

      Response 2.13: Auxin-induced depletion of mNeonGreen::AID::LSY-22 resulted in more than 90% decrease in expression (n > 75 uterine cells). The AID-tagged allele for UNC-37 was labeled with BFP, which was barely detectable by our imaging system and photobleached very quickly, so we did not quantify its depletion. However, considering that UNC37 and LSY-22 are both expressed fairly uniform and ubiquitously, and that LSY-22 is expressed at higher levels than UNC-37 at the L3 stage according to WormBase (31.9 FPKM vs. 23.5 FPKM), we would predict that its auxin-induced depletion would be just as potent if not moreso.

      Some of the work presented repeats previously published observations, and it is difficult at times to keep track of what is confirmatory and what is new. For example, this group already published on the enrichment of HLH-2 and NHR-67 in the AC, as well as the positive regulation of NHR-67 by HLH-2 (Medwig-Kinney et al 2020). Additionally, prior papers have already reported the interaction between HLH-2 and the nhr-67 locus.

      Response 2.14: The work presented in this manuscript does not repeat any previously published experiments. When we introduced the endogenously tagged NHR-67 and HLH-2 strains in previous work (Medwig-Kinney & Smith et al., 2020), we quantified expression of these proteins in the AC over time but did not compare expression between the AC and VU cells. Additionally, we previously showed that HLH-2 positively regulates NHR-67 in the AC (Medwig-Kinney & Smith et al., 2020), but never showed this is the case in the VU cells. Considering that this regulatory interaction was not observed in the AC/VU cell precursors, we believe that determining whether these proteins interact in the context of the VU cells was a valid question to address.

      Treen et al. 2021 are cited as prior evidence for the existence of "repressive condensates", however, that study does NOT experimentally demonstrate a function for these structures.

      Response 2.15: By “repressive condensates” we are referring to condensation of proteins known to be transcriptional repressors. While we agree that we were not able to demonstrate transcriptional repression of specific loci, our data showing that perturbation of the Groucho repressors UNC-37 and LSY-22 results in ectopic ACs is consistent with the hypothesis that these proteins repress the default AC fate. We have modified our title and text to more clearly distinguish our interpretations versus speculations.

    1. Author Response

      The following is the authors’ response to the original reviews.

      We would like to thank you for considering the above manuscript for publication in eLife and for sending it for review. We would like to thank the editors and reviewers for taking the time to read our manuscript and for their expert comments. These comments have been helpful and have improved our manuscript. We would like to address the following comments:

      eLife assessment

      This valuable study advances our knowledge of the effects of anxiety/depression treatment on metacognition, demonstrating that treatment increases metacognitive confidence alongside improving symptoms. The authors provide convincing evidence for the state-dependency of metacognitive confidence, based on a large longitudinal treatment dataset. However, it is unclear to what extent this effect is truly specific to treatment, as there was some improvement in metacognitive confidence in the control group.

      Thank you for this assessment of the paper. As the change in confidence was not significant among the control group, the last sentence is not factually correct – could we suggest that it be amended to the following: “However, it is unclear to what extent this effect is truly specific to treatment, as changes in metacognitive bias in the iCBT group were not statistically different from those in the control group.”

      Reviewer #1 (Public Review)

      1) It has been shown previously that there are relationships between a transdiagnostic construct of anxious-depression (AD), and average confidence rating in a perceptual decision task. This study sought to investigate these results, which have been replicated several times but only in cross-sectional studies. This work applies a perceptual decision-making task with confidence ratings and a transdiagnostic psychometric questionnaire battery to participants before and after an iCBT course. The iCBT course reduced AD scores in participants, and their mean confidence ratings increased without a change in performance. Participants with larger AD changes had larger confidence changes. These results were also shown in a separate smaller group receiving antidepressant medication. A similar sized control group with no intervention did not show changes.

      The major strength of the study is the elegant and well-powered data set. Longitudinal data on this scale is very difficult to collect, especially with patient cohorts, so this approach represents an exciting breakthrough. Analysis is straightforward and clearly presented. However, no multiple comparison correction is applied despite many different tests. While in general I am not convinced of the argument in the citation provided to justify this, I think in this case the key results are not borderline (p<0.001) and many of the key effects are replications, so there are not so many novel/exploratory hypothesis and in my opinion the results are convincing and robust as they are. The supplemental material is a comprehensive description of the data set, which is a useful resource.

      The authors achieved their aims, and the results clearly support the conclusion that the AD and mean confidence in a perceptual task covary longitudinally. I think this study provides an important impact to the project of computational psychiatry.Sspecifically, it shows that the relationship between transdiagnostic symptom dimensions and behaviour is meaningful within as well as across individuals.

      We thank the reviewer for their appraisal of our paper and positive feedback on the main manuscript and supplementary information. We agree with the reviewer that the lack of multiple comparison corrections can also justified by key findings being replications and not borderline significance. We have added this additional justification to the manuscript (Methods, Statistical Analyses, page 15, line 568: “Adjustments for multiple comparisons were not conducted for analyses of replicated effects”)

      Reviewer #2 (Public Review)

      The authors of this study investigated the relationship between (under)confidence and the anxious-depressive symptom dimension in a longitudinal intervention design. The aim was to determine whether confidence bias improves in a state-like manner when symptoms improve. The primary focus was on patients receiving internet-based CBT (iCBT; n=649), while secondary aims compared these changes to patients receiving antidepressants (n=82) and a control group (n=88).

      The results support the authors' conclusions, and the authors convincingly demonstrated a weak link between changes in confidence bias and anxious-depressive symptoms (not specific to the intervention arm)

      The major strength and contribution of this study is the use of a longitudinal intervention design, allowing the investigation of how the well-established link between underconfidence and anxious-depressive symptoms changes after treatment. Furthermore, the large sample size of the iCBT group is commendable. The authors employed well-established measures of metacognition and clinical symptoms, used appropriate analyses, and thoroughly examined the specificity of the observed effects.

      However, due to the small effect sizes, the antidepressant and control groups were underpowered, reducing comparability between interventions and the generalizability of the results. The lack of interaction effect with treatment makes it harder to interpret the observed differences in confidence, and practice effects could conceivably account for part of the difference. Finally, it was not completely clear to me why, in the exploratory analyses, the authors looked at the interaction of time and symptom change (and group), since time is already included in the symptom change index.

      We thank the author for their succinct summary of the main results and strengths of our study. We apologise for the confusion in how we described that analysis. We examine state-dependence., i.e. the relationship between symptom change and metacognition change, in two ways in the paper – perhaps somewhat redundantly. (1) By correlating change indices for both measures (e.g. as plotted in Figure 3D) and (2) by doing a very similar regression-based repeated-measures analysis, i.e. mean confidence ~ time * anxious-depression score change. Where mean confidence is entered with two datapoints – one for pre- and one for post-treatment (i.e. within-person) and anxious-depression change is a single value per person (between-person change score). This allowed us to test if those with the biggest change in depression had a larger effect of time on confidence. This has been added to the paper for clarification (Methods, Statistical Analysis, page 14, line 553-559: “To determine the association between change in confidence and change in anxious-depression, we used (1) Pearson correlation analysis to correlate change indices for both measures and, (2) regression-based repeated-measures analysis: mean confidence ~ time * anxious-depression score change, where mean confidence is entered with two datapoints (one for pre- and one for post-treatment i.e., within-person) and anxious-depression change is a single value per person (between-person change score)”).

      The analyses have also been reported as regression in the Results for consistency (Treatment Findings: iCBT, page 5, line 197-204: ‘To test if changes in confidence from baseline to follow-up scaled with changes in anxious-depression, we ran a repeated measure regression analyses with per-person changes in anxious-depression as an additional independent variable. We found this was the case, evidenced by a significant interaction effect of time and change in anxious-depression on confidence (=-0.12, SE=0.04, p=0.002)… This was similarly evident in a simple correlation between change in confidence and change in anxious-depression (r(647)=-0.12, p=0.002)”).

      2) This longitudinal study informs the field of metacognition in mental health about the changeability of biases in confidence. It advances our understanding of the link between anxiety-depression and underconfidence consistently found in cross-sectional studies. The small effects, however, call the clinical relevance of the findings into question. I would have found it useful to read more in the discussion about the implications of the findings (e.g., why is it important to know that the confidence bias is state-dependent; given the effect size of the association between changes in confidence and symptoms, is the state-trait dichotomy the right framework for interpreting these results; suggestions for follow-up studies to better understand the association).

      Thank you for this comment. We have elaborated on the implications of our findings in the Discussion, including the relevance of the state-trait dichotomy to future research and how more intensive, repeated testing may inform our understanding of the state-like nature of metacognition (Discussion, Limitations and Future Directions, page 10, line 378-380: “More intensive, repeating testing in future studies may also reveal the temporal window at which metacognition has the propensity to change, which could be more momentary in nature.”).

      Reviewer #3 (Public Review):

      1) This study reports data collected across time and treatment modalities (internet CBT (iCBT), pharmacological intervention, and control), with a particularly large sample in the iCBT group. This study addresses the question of whether metacognitive confidence is related to mental health symptoms in a trait-like manner, or whether it shows state-dependency. The authors report an increase in metacognitive confidence as anxious-depression symptoms improve with iCBT (and the extent to which confidence increases is related to the magnitude of symptom improvement), a finding that is largely mirrored in those who receive antidepressants (without the correlation between symptom change and confidence change). I think these findings are exciting because they directly relate to one of the big assumptions when relating cognition to mental health - are we measuring something that changes with treatment (is malleable), so might be mechanistically relevant, or even useful as a biomarker?

      This work is also useful in that it replicates a finding of heightened confidence in those with compulsivity, and lowered confidence in those with elevated anxious-depression.

      One caveat to the interest of this work is that it doesn't allow any causal conclusions to be drawn, and only measures two timepoints, so it's hard to tell if changes in confidence might drive treatment effects (but this would be another study). The authors do mention this in the limitations section of the paper.

      Another caveat is the small sample in the antidepressant group.

      Some thoughts I had whilst reading this paper: to what extent should we be confident that the changes are not purely due to practice? I appreciate there is a relationship between improvement in symptoms and confidence in the iCBT group, but this doesn't completely rule out a practice effect (for instance, you can imagine a scenario in which those whose symptoms have improved are more likely to benefit from previously having practiced the task).

      We thank the reviewer for commenting on the implications of our findings and we agree with the caveats listed. We thank the reviewer for raising this point about practice effects. A key thing to note is that this task does not have a learning element with respect to the core perceptual judgement (i.e., accuracy), which is the target of the confidence judgment itself. While there is a possibility of increased familiarity with the task instructions and procedures with repeated testing, the task is designed to adjust the difficulty to account of any improvements, so accuracy is stable. We see that we may not have made this clear in some of our language around accuracy vs. perceptual difficulty and have edited the Results to make this distinction clearer (Treatment Findings: iCBT, pages 4-5, lines 184-189: “Although overall accuracy remained stable due to the staircasing procedure, participants’ ability to detect differences between the visual stimuli improved. This was reflected as the overall increase in task difficulty to maintain the accuracy rates from baseline (dot difference: M=41.82, SD=11.61) to follow-up (dot difference: M=39.80, SD=12.62), (=-2.02, SE=0.44, p<0.001, r2=0.01)”.)

      However, it is true that there can be a ‘practice’ effect in the sense that one may feel more confident (despite the same accuracy level) due to familiarity with a task. One reason we do not subscribe to the proposed explanation for the link between anxious-depression change and confidence change is that the other major aspect of behaviour that improved with practice did so in a manner unrelated to clinical change. As noted above in the quoted text, participants’ discrimination improved from baseline to follow-up, reflected in the need for higher difficulty level to maintain accuracy around 70%. Crucially, this was not associated with symptom change. This speaks against a general mechanism where symptom improvement leads to increased practice effects in general. Only changes in confidence specifically are associated with improved symptoms. We have provided more detail on this in the Discussion (page 9, lines 324-326: “This association with clinical improvements was specific to metacognitive changes, and not changes in task performance, suggesting that changes in confidence do not merely reflect greater task familiarity at follow-up.”).

      2) Relatedly, to what extent is there a role for general task engagement in these findings? The paper might be strengthened by some kind of control analysis, perhaps using (as a proxy for engagement) the data collected about those who missed catch questions in the questionnaires.

      Thank you for your comment. We included the details of data quality checks in the Supplement. Given the small number of participants that failed more than one attention checks (1% of the iCBT arm) and that all those participants passed the task exclusion criteria, we made the decision to retain these individuals for analyses. We have since examined if excluding these small number of individuals impacts our findings. Excluding those that failed more than one catch item did not affect the significance of results, which has now been added to the Supplementary Information (Data Quality Checks: Task and Clinical Scales, page 5, lines 181-185: “Additionally, excluding those that failed more than one catch item in the iCBT arm did not affect the significance of results, including the change in confidence (=0.16, SE=0.02, p<0.001), change in anxious-depression (=-0.32, SE=0.03, p<0.001), and the association between change in confidence and change in anxious-depression (r(638)=-0.10, p=0.011)”).

      3) I was also unclear what the findings about task difficulty might mean. Are confidence changes purely secondary to improvements in task performance generally - so confidence might not actually be 'interesting' as a construct in itself? The authors could have commented more on this issue in the discussion.

      Thank you for this comment and sorry it was not clear in the original paper. As we discussed in a prior reply, accuracy – i.e. proportion of correct selections (the target of confidence judgements) are different from the difficulty of the dot discrimination task that each person receives on a given trial. We had provided more details on task difficulty in the Supplement. Accuracy was tightly controlled in this task using a ‘two-down one-up’ staircase procedure, in which equally sized changes in dot difference occurred after each incorrect response and after two consecutive correct responses. The task is more difficult when the dot difference between stimuli is lower, and less difficult when the dot difference between stimuli is greater. Therefore, task difficulty refers to the average dot difference between stimuli across trials. Crucially, task accuracy did not change from baseline to follow-up, only task difficulty. Moreover, changes in task difficulty were not associated with changes in anxious-depression, while changes in confidence were, indicating confidence is the clinically relevance construct for change in symptoms.

      We appreciate that this may not have been clear from the description in the main manuscript, and have added more detail on task difficulty to the Methods (Metacognition Task, page 14, lines 540-542: “Task difficulty was measured as the mean dot difference across trials, where more difficult trials had a lower dot difference between stimuli.”) and Results (Treatment Findings: iCBT, pages 4-5, lines 184-186: “Although overall accuracy remained stable due to the staircasing procedure, participants’ ability to detect differences between the visual stimuli improved.”). We have also elaborated more on how improvements in symptoms are associated with change in confidence, not task performance in the Discussion (page 9, lines 324-326: “This association with clinical improvements was specific to metacognitive changes, and not changes in task performance, suggesting that changes in confidence do not merely reflect greater task familiarity at follow-up”).

      4) To make code more reproducible, the authors could have produced an R notebook that could be opened in the browser without someone downloading the data, so they could get a sense of the analyses without fully reproducing them.

      Thank you for your comment. We appreciate that an R notebook would be even better than how we currently share the data and code. While we will consider using Notebooks in future, we checked and converting our existing R script library into R Notebooks would require a considerable amount of reconfiguration that we cannot devote the time to right now. We hope that nonetheless the commitment to open science is clear in the extensive code base, commenting and data access we are making available to readers.

      5) Rather than reporting full study details in another publication I would have found it useful if all relevant information was included in a supplement (though it seems much of it is). This avoids situations where the other publication is inaccessible (due to different access regimes) and minimises barriers for people to fully understand the reported data.

      We agree this is good practice – the Precision in Psychiatry study is very large, with many irrelevant components with respect to the present study (Lee et al., BMC Psychiatry, 2023). For this reason, we tried to provide all that was necessary and only refer to the Precision in Psychiatry study methods for fine-grained detail. Upon review, the only thing we think we omitted that is relevant is information on ethical approval in the manuscript, which we have now added (Methods, Participants, page 11, lines 412-417: “Further details of the PIP study procedures that are not specific to this study can be found in a prior publication (21). Ethical approval for the PIP study was obtained from the Research Ethics Committee of School of Psychology, Trinity College Dublin and the Northwest-Greater Manchester West Research Ethics Committee of the National Health Service, Health Research Authority and Health and Care Research Wales”). If any further information is lacking, we are happy to include it here also.

      Reviewer #1 (Recommendations For The Authors):

      Minor comments

      The first line of the abstract refers to "metacognitive impairments", but the key result is a difference in the mean confidence rating - i.e. could be how participants are using the scale. It's not clear to me that lower mean confidence is necessarily an "impairment" (what's the "right" level of confidence 1-6 for a performance of 70% accuracy). The first line of discussion uses "metacognitive biases" which seems a more accurate description.

      We agree that the term bias is more appropriate to use in the Abstract, given that there is not set level to indicate any level of ‘impairment’ associated with under- or over-confidence. This has been changed to ‘biases’ as per the reviewer’s request (Abstract, page 2, line 49). Thank you for this suggestion.

      Reviewer #2 (Recommendations For The Authors):

      I would suggest being more cautious in the wording relating to the simple effect tests on changes across different treatment arms in the abstract - since no interaction was found it may suggest a difference between arms that is not found significantly. Also since comparison between arms was the secondary aim, first describe interaction effects before simple effects in results.

      Thank you for this suggestion, we agree that the lack of significant interaction effect of time and group on confidence is a key finding, which has now been included in the Abstract (page 2, lines 67-71). Additionally, we have rearranged the order of results so the interaction effects precede the simple effects (Results, Comparing iCBT, Antidepressant and Control Groups, page 7, lines 246 – 292:

      "When comparing the three groups directly, ANOVA analysis predicting anxious-depression scores with group and time as independent variables revealed a main effect of time (F(1, 1632)=62.99, p<0.001), a main effect of group (F(2, 1632)=249.74, p<0.001), and an interaction effect of group and time (F(2, 1632)=9.23, p<0.001). Examining simple effects in the antidepressant arm, there was a significant reduction in anxious-depression from baseline to follow-up (=-0.61, SE=0.09, p<0.001). Among controls, levels of anxious-depression did not significantly change (=0.10, SE=0.06, p=0.096). Further details of transdiagnostic clinical changes for the antidepressant and controls groups are presented in Figure 4A and Table S4.

      Predicting confidence scores using ANOVA analysis with group and time as independent variables revealed a main effect of time (F(1, 1632)=16.26, p<0.001), and no significant main effect of group (F(2, 1632)=2.35, p=0.096). The interaction effect of group and time on mean confidence was not significant (F(2, 1632)=0.60, p=0.550), suggesting that change in confidence did not differ across the three groups. Tests of simple effects revealed that mean confidence significantly increased from baseline (M=3.77, SD=0.88) to follow-up (M=4.07, SD=0.79) in the antidepressant arm (=0.31, SE=0.08, p<0.001) (Figure 4B). Among controls, there was no significant change in confidence from baseline (M=3.68, SD=0.86) to follow-up (M=3.79, SD=0.92) (=0.11, SE=0.07, p=0.103) (Figure 4B).

      With respect to task performance, there was a significant main effect of time (F(1, 1632)=15.17, p=0.001) and group (F(2, 1632)=4.56, p=0.011) on mean dot difference when the three groups were included in the model. The interaction effect of time and group on mean dot difference was not significant (F(2, 1632)=1.91, p=0.148), suggesting no differences across the groups in task difficulty changes. In the antidepressant arm, mean dot difference decreased from baseline (M=41.2, SD=13.3) to follow-up (M=35.3, SD=13.1) (=-5.91, SE=1.25, p<0.001), indicating increased task difficulty. There was no significant change in task difficulty among controls from baseline (M=43.0, SD=11.8) to follow-up (M=41.4, SD=13.6) (=-1.64, SE=1.30, p=0.210) (Figure 4C).

      While our sample was underpowered to examine individual differences, we conducted an exploratory analysis examining the connection between changes in anxious-depression symptoms and changes in confidence in the antidepressant and controls groups. When examining the effects of time, group and anxious-depression change on mean confidence, there was a significant interaction effect of time and anxious-depression change on mean confidence (F(1, 1626)=4.04, p=0.045), suggesting change in confidence is associated with change in anxious-depression. There was no significant three-way interaction of anxious-depression change, time and group on mean confidence when comparing the three groups (F(2, 1626)=0.08, p=0.928), indicating that the significant association between confidence change and anxious-depression change was not specific to any group. Although not significant, the association between change in confidence and change in anxious-depression was in the expected negative direction in the antidepressant arm (r(80)=-0.10, p=0.381), and among controls (r(86)=-0.17, p=0.111) (Figure 4D)."

      Reviewer #3 (Recommendations For The Authors):

      Some minor points:

      Intro

      1) Awkward wording on page 3: 'but little research on how it might impact on metacognition'

      We have amended this sentence to make it more clear that relatively less research has been conducted on metacognitive changes following iCBT. We have also provided more detail on a prior study that examined changes in metacognitive beliefs with iCBT, and how this differs from the current study (Introduction, page 3, lines 137-141: “Additionally, iCBT has demonstrated clinical effectiveness in terms of symptom improvement (22–24). While one study found that iCBT modified self-reported metacognitive beliefs (25), it remains unknown if metacognitive confidence in decision-making improves following successful iCBT”).

      2) On page 3 the authors note 'but studies typically lacked power to detect effects of antidepressants on cognitive abilities (30-33)' - however, surely this is a problem with this study too, and its relatively small sample of those taking antidepressants?

      Thank you for highlighting this. The power comment was in the reference to the larger iCBT arm in this study, but we can appreciate that its placement means that it could be interpreted as being in relation to our smaller antidepressant arm (which we acknowledge is also potentially underpowered). We have reworded this sentence to make it clearer that prior antidepressant studies have not examined the impact of changes in metacognition specifically (Introduction, page 4, lines 147-149: “However, studies examining the impact of antidepressants on cognition have typically focused on cognitive capacities other than metacognition (30–33)”).

      Results

      3) Fig 2 - please clarify what the error bars indicate.

      The error bars represent the standard error around the standardised beta coefficients, which I have added to the description of Figure 2 (page 4, lines 171-172: “The error bars represent the standard error around the standardised beta coefficient”).

      4) Awkward wording: 'though it went in the same direction (Figure 4B)'.

      This part of the sentence was removed to reduce confusion.

      5) This description of the results is somewhat overstated: 'suggesting change in confidence was dependent on change in anxious-depression' (page 7) - this could also be the other way around, or related to a third factor.

      We have changed this from ‘dependent’ to ‘is associated with’, which accounts for the unknown directionality and true dependency of confidence changes on changes in anxious-depression (Results, page 7, line 285: “…suggesting change in confidence is associated with change in anxious-depression”).

      Methods

      6) Please also show how the WSAS in a supplement.

      Although this comment is unclear, we have provided additional information on how each item of the WSAS was scored and the overall score range (Supplemental methods, page 2, lines 53-55: “Each WSAS item was scored from 0 ‘not at all’ to 8 ‘very severely’, with overall scores ranging from 0 to 40. Higher WSAS scores indicating higher levels of functional impairment (11)”.

    1. Reviewer #3 (Public Review):

      This study tackles an interesting topic from a new perspective. The manuscript is well-written, logical, and conceptually clear. The central topic regards the purpose of preparatory activity in motor & premotor cortex. Preparatory activity has long captured the imaginations of experimentalists because it is a window on an unknown internal process - a process that is informed by sensation and related to action but tied directly to neither. Preparatory activity was the first truly 'internal' form of activity to be studied in awake behaving animals. The meaning and nature of the internal preparatory process has long been debated. In the 1960's, it was thought to reflect the priming of reflex circuits and motoneurons. By the 1980's, it was understood to reflect 'motor programming', i.e., the readying of cortical movement-generating machinery. But why programming was needed, and might be accomplished during preparation, remained unclear. By the 2000s, preparatory activity was seen as initializing movement-generating dynamics, much as the initial state of a dynamical system governs its future evolution. This provided a mechanistic purpose for preparation, but didn't answer a fundamental question: why use that strategy at all? Why indirectly influence execution by creating a preparatory state when you could send inputs during execution and accomplish the same thing directly?

      The authors point out that the many neural network models presently in existence do not address this question because they already assume that preparatory inputs are used. Thus, those models show that the preparatory strategy works, and that it matches the data in multiple ways, but they don't reveal why it is the right strategy. An additional issue with existing networks is that they potentially create an artificial dichotomy where inputs are divided into two types: preparation-creating and movement-creating. It would be more elegant if one simply assumed that motor cortex receives inputs that attempt to serve the needs of the animal, with preparation being an emergent phenomenon rather than being baked in from the beginning. In some ways the field is already starting to shift in this direction, with preparation being seen as a special case of a general phenomenon: inputs that arrive in the null-space of network outputs. However, this shift is still nascent, and no paper to date has really addressed this issue. Thus, the present study can be seen as being the first to take a fully modern view of preparation, where it emerges as part of the solution to a more general problem.

      The study is clearly written and clearly presented, and I found both the results and the reasoning to be compelling, with some exceptions noted below. The authors demonstrate that many aspects of the empirical data can be accounted for as natural outcomes of a very simple assumption: that the inputs to motor cortex are optimized to create accurate motor-cortex output while being 'well-behaved' in the sense of remaining modest in magnitude. More broadly, the idea is that preparation emerges as a consequence of constraints on motor-cortex inputs. If upstream areas could magically control motor cortex any way they wanted, then there would be no need for preparation. The necessary patterns of execution activity could just be created directly by inputs at that time. However, when there exist constraints on inputs (i.e., on what upstream areas can do) preparation becomes a useful - perhaps necessary - strategy. By sending inputs early, upstream areas can leverage the dynamics of motor cortex in ways that would be harder to accomplish during movement.

      The authors illustrate how a very simple constraint on inputs - a high 'cost' to large inputs - makes preparation a good strategy. Preparation isn't strictly necessary, but it produces a lower-cost solution (reduced input magnitude for a given level of accuracy). Consequently, preparation appears naturally, with a time-course of ~300 ms before movement onset. This late rise in preparation doesn't match the longer plateau most people are used to from studies that use a randomized instructed delay, but that actually makes sense. In those studies, the animal does not know when the go cue will be given, and must be ready for it to occur at any time. In contrast, the present study considers the situation where the time of future movement is known internally and is part of the optimization process. This more closely matches situations where the animal chooses when to move, and in those situations, preparation does indeed appear late in most cases. So the predictions of their simulations are qualitatively correct (which is all that is desired, given uncertainty regarding things like the right internal time-constants). Their simulations also successfully predict two bouts of preparation during sequence tasks, matching recent empirical findings.

      The main strength of the study is its ability to elegantly explain well-known features of data in terms of simple normative principles. The study is thorough and careful in key ways. For example, they show that the emergence of preparation, in the service of satisfying the cost function, is a very general property that holds across a broad range of network types (including very simple toy networks and a variety of larger networks of different types). They also go to considerable trouble to show why cost is reduced by preparatory inputs, including illustrating different scenarios with different readout-vector orientations. The result is a conceptually clear study that conveys a fresh perspective on what preparation is and why it exists.

      The main limitation of the study is that it focuses exclusively on one specific constraint - magnitude - that could limit motor-cortex inputs. This isn't unreasonable, but other constraints are at least as likely, if less mathematically tractable. The basic results of this study will probably be robust with regard such issues - generally speaking, any constraint on what can be delivered during execution will favor the strategy of preparing - but this robustness cuts both ways. It isn't clear that the constraint used in the present study - minimizing upstream energy costs - is the one that really matters. Upstream areas are likely to be limited in a variety of ways, including the complexity of inputs they can deliver. Indeed, one generally assumes that there are things that motor cortex can do that upstream areas can't do, which is where the real limitations should come from. Yet in the interest of a tractable cost function, the authors have built a system where motor cortex actually doesn't do anything that couldn't be done equally well by its inputs. The system might actually be better off if motor cortex were removed. About the only thing that motor cortex appears to contribute is some amplification, which is 'good' from the standpoint of the cost function (inputs can be smaller) but hardly satisfying from a scientific standpoint.

      The use of a term that punishes the squared magnitude of control signals has a long history, both because it creates mathematical tractability and because it (somewhat) maps onto the idea that one should minimize the energy expended by muscles and the possibility of damaging them with large inputs. One could make a case that those things apply to neural activity as well, and while that isn't unreasonable, it is far from clear whether this is actually true (and if it were, why punish the square if you are concerned about ATP expenditure?). Even if neural activity magnitude an important cost, any costs should pertain not just to inputs but to motor cortex activity itself. I don't think the authors really wish to propose that squared input magnitude is the key thing to be regularized. Instead, this is simply an easily imposed constraint that is tractable and acts as a stand-in for other forms of regularization / other types of constraints. Put differently, if one could write down the 'true' cost function, it might contain a term related to squared magnitude, but other regularizing terms would by very likely to dominate. Using only squared magnitude is a reasonable way to get started, but there are also ways in which it appears to be limiting the results (see below).

      I would suggest that the study explore this topic a bit. Is it possible to use other forms of regularization? One appealing option is to constrain the complexity of inputs; a long-standing idea is that the role of motor cortex is to take relatively simple inputs and convert them to complex time-evolving inputs suitable for driving outputs. I realize that exploring this idea is not necessarily trivial. The right cost-function term is not clear (should it relate to low-dimensionality across conditions, or to smoothness across time?) and even if it were, it might not produce a convex cost function. Yet while exploring this possibility might be difficult, I think it is important for two reasons. First, this study is an elegant exploration of how preparation emerges due to constraints on inputs, but at present that exploration focuses exclusively on one constraint. Second, at present there are a variety of aspects of the model responses that appear somewhat unrealistic. I suspect most of these flow from the fact that while the magnitude of inputs is constrained, their complexity is not (they can control every motor cortex neuron at both low and high frequencies). Because inputs are not complexity-constrained, preparatory activity appears overly complex and never 'settles' into the plateaus that one often sees in data. To be fair, even in data these plateaus are often imperfect, but they are still a very noticeable feature in the response of many neurons. Furthermore, the top PCs usually contain a nice plateau. Yet we never get to see this in the present study. In part this is because the authors never simulate the situation of an unpredictable delay (more on this below) but it also seems to be because preparatory inputs are themselves strongly time-varying. More realistic forms of regularization would likely remedy this.

      At present, it is also not clear whether preparation always occurs even with no delay. Given only magnitude-based regularization, it wouldn't necessarily have to be. The authors should perform a subspace-based analysis like that in Figure 6, but for different delay durations. I think it is critical to explore whether the model, like monkeys, uses preparation even for zero-delay trials. At present it might or might not. If not, it may be because of the lack of more realistic constraints on inputs. One might then either need to include more realistic constraints to induce zero-delay preparation, or propose that the brain basically never uses a zero delay (it always delays the internal go cue after the preparatory inputs) and that this is a mechanism separate from that being modeled.

      I agree with the authors that the present version of the model, where optimization knows the exact time of movement onset, produces a reasonably realistic timecourse of preparation when compared to data from self-paced movements. At the same time, most readers will want to see that the model can produce realistic looking preparatory activity when presented with an unpredictable delay. I realize this may be an optimization nightmare, but there are probably ways to trick the model into optimizing to move soon, but then forcing it to wait (which is actually what monkeys are probably doing). Doing so would allow the model to produce preparation under the circumstances where most studies have examined it. In some ways this is just window-dressing (showing people something in a format they are used to and can digest) but it is actually more that than, because it would show that the model can produce a reasonable plateau of sustained preparation. At present it isn't clear it can do this, for the reasons noted above. If it can't, regularizing complexity might help (and even if this can't be shown, it could be discussed).

      In summary, I found this to be a very strong study overall, with a conceptually timely message that was well-explained and nicely documented by thorough simulations. I think it is critical to perform the test, noted above, of examining preparatory subspace activity across a range of delay durations (including zero) to see whether preparation endures as it does empirically. I think the issue of a more realistic cost function is also important, both in terms of the conceptual message and in terms of inducing the model to produce more realistic activity. Conceptually it matters because I don't think the central message should be 'preparation reduces upstream ATP usage by allowing motor cortex to be an amplifier'. I think the central message the authors wish to convey is that constraints on inputs make preparation a good strategy. Many of those constraints likely relate to the fact that upstream areas can't do things that motor cortex can do (else you wouldn't need a motor cortex) and it would be good if regularization reflected that assumption. Furthermore, additional forms of regularization would likely improve the realism of model responses, in ways that matter both aesthetically and conceptually. Yet while I think this is an important issue, it is also a deep and tricky one, and I think the authors need considerable leeway in how they address it. Many of the cost-function terms one might want to use may be intractable. The authors may have to do what makes sense given technical limitations. If some things can't be done technically, they may need to be addressed in words or via some other sort of non-optimization-based simulation.

      Specific comments

      As noted above, it would be good to show that preparatory subspace activity occurs similarly across delay durations. It actually might not, at present. For a zero ms delay, the simple magnitude-based regularization may be insufficient to induce preparation. If so, then the authors would either have to argue that a zero delay is actually never used internally (which is a reasonable argument) or show that other forms of regularization can induce zero-delay preparation.

      I agree with the authors that prior modeling work was limited by assuming the inputs to M1, which meant that prior work couldn't address the deep issue (tackled here) of why there should be any preparatory inputs at all. At the same time, the ability to hand-select inputs did provide some advantages. A strong assumption of prior work is that the inputs are 'simple', such that motor cortex must perform meaningful computations to convert them to outputs. This matters because if inputs can be anything, then they can just be the final outputs themselves, and motor cortex would have no job to do. Thus, prior work tried to assume the simplest inputs possible to motor cortex that could still explain the data. Most likely this went too far in the 'simple' direction, yet aspects of the simplicity were important for endowing responses with realistic properties. One such property is a large condition-invariant response just before movement onset. This is a very robust aspect of the data, and is explained by the assumption of a simple trigger signal that conveys information about when to move but is otherwise invariant to condition. Note that this is an implicit form of regularization, and one very different from that used in the present study: the input is allowed to be large, but constrained to be simple. Preparatory inputs are similarly constrained to be simple in the sense that they carry only information about which condition should be executed, but otherwise have little temporal structure. Arguably this produces slightly too simple preparatory-period responses, but the present study appears to go too far in the opposite direction. I would suggest that the authors do what they can to address these issue via simulations and/or discussion. I think it is fine if the conclusion is that there exist many constraints that tend to favor preparation, and that regularizing magnitude is just one easy way of demonstrating that. Ideally, other constraints would be explored. But even if they can't be, there should be some discussion of what is missing - preparatory plateaus, a realistic condition-invariant signal tied to movement onset - under the present modeling assumptions.

      On line 161, and in a few other places, the authors cite prior work as arguing for "autonomous internal dynamics in M1". I think it is worth being careful here because most of that work specifically stated that the dynamics are likely not internal to M1, and presumably involve inter-area loops and (at some latency) sensory feedback. The real claim of such work is that one can observe most of the key state variables in M1, such that there are periods of time where the dynamics are reasonably approximated as autonomous from a mathematical standpoint. This means that you can estimate the state from M1, and then there is some function that predicts the future state. This formal definition of autonomous shouldn't be conflated with an anatomical definition.

    1. Author Response

      We thank the reviewers for their helpful comments and suggestions.

      eLife assessment

      This is an important contribution that extends earlier single-unit work on orientation-specific center-surround interactions to the domain of population responses measured with Voltage Sensitive Dye (VSD) imaging and the first to relate these interactions to orientation-specific perceptual effects of masking. The authors provide convincing evidence of a pattern of results in which the initial effect of the mask seems to run counter to the behavioral effects of the mask, a pattern that reversed in the latter phase of the response. It seems likely that the physiological effects of masking reported here can be attributed to previously described signals from the receptive field surround.

      We thank the reviewers for bringing up the relation of our results to findings from previous orientation-specific center-surround interactions studies. In our revision, we will add a paragraph discussing this important issue. Briefly, for multiple reasons, we believe that the majority of the behavioral and neural masking effects that we observe may be from target-mask interactions at the target location rather than from the effect of the mask in the surround. First, in human subjects, perceptual similarity masking effects are almost entirely accounted for by target-mask interactions at the target location and are recapitulated when the mask has the same size and location as the target (Sebastian et al 2017). Second, in our computational model (Fig. 8), the effect of mask orientation on the dynamics of the response are qualitatively the same if the mask is restricted to the size and location of the target. Third, in our model, our results are qualitatively the same when the spatial pooling region for the normalization signal is the same as that for the excitation signal. These points will be elaborated in the revised manuscript and points 2 and 3 will be demonstrated in a supplementary figure.

      We would also like to point out some key differences between the stimuli that we use and the ones used in most previous center-surround studies. First, in our experiments, the target and the mask were additive, while in most previous center-surround studies the target occludes the background. Such studies therefore restrict the mask effect to the surround, while in our study we allow target-mask interactions at the center. Second, most center-surround studies have a sharp-edged target/surround, while in our experiments no sharp edges were present. Unpublished results form our lab suggest that such sharp edges have a large impact on V1 population responses. We will expand on these issues in the revised manuscript. A third key difference is that our stimuli were flashed for a short interval of 250 ms corresponding to a typical duration of a fixation in natural vision, while most previous center-surround studies used either longer-duration drifting stimuli or very short-duration random-order stimuli for reverse-correlation analysis.

      In addition, we would like to emphasize that our results go beyond previous studies in two important ways. First, we study the effect of similarity masking in behaving animals and quantitatively compare the effect of similarity masking on behavior and physiology in the same subjects and at the same time. Second, VSD imaging allows us to capture the dynamics of superficial V1 population responses over the entire population of millions of neurons activated by the target at two important spatial scales. Such results therefore complement electrophysiological studies that examine the activity of a very small subset of the active neurons.

      Reviewer #1 (Public Review):

      This is a clear account of some interesting work. The experiments and analyses seem well done and the data are useful. It is nice to see that VSDI results square well with those from prior extracellular recordings. But the work may be less original than the authors propose, and their overall framing strikes me as odd. Some additional clarifications could make the contribution more clear.

      Please see our reply above regarding the agreement with previous studies and framing.

      My reading is that this is primarily a study of surround suppression with results that follow pretty directly from what we already know from that literature, and although they engage with some of the literature they do not directly mention surround suppression in the text. Their major effect - what they repeatedly describe as a "paradoxical" result in which the responses initially show a stronger response to matched targets and backgrounds and then reverse - seems to pretty clearly match the expected outcome of a stimulus that initially evokes additional excitation due to increased center contrast followed by slightly delayed surround suppression tuned to the same peak orientation. Their dynamics result seems entirely consistent with previous work, e.g. Henry et al 2020, particularly their Fig. 3 https://elifesciences.org/articles/54264, so it seems like a major oversight to not engage with that work at all, and to explain what exactly is new here.

      We thank the reviewer for the pointing out this previous work which we will cite in the revised version of the manuscript. For the reasons discussed above, while this study is interesting and related to our work, we believe that our results are quite distinct.

      • In the discussion (lines 315-316), they state "in order to account for the reduced neural sensitivity with target-background similarity in the second phase of the response, the divisive normalization signal has to be orientation selective." I wonder whether they observed this in their modeling. That is, how robust were the normalization model results to the values of sigma_e and sigma_n? It would be useful to know how critical their various model parameters were for replicating the experimental effects, rather than just showing that a good account is possible.

      Thank you for this suggestion. In the revised manuscript we will include a supplementary figure that will show how the model’s predictions are affected by the orientation tuning and spatial extent of the normalization signal, and by the size of the mask.

      • The majority of their target/background contrast conditions were collected only in one animal. This is a minor limitation for work of this kind, but it might be an issue for some.

      We agree that this is a limitation of the current study. These are challenging experiments and we were unable to collect all target/background contrast combinations from both monkeys. However, in the common conditions, the results appear similar in the two animals, and the key results seem to be robust to the contrast combination in the animal in which a wider range of contrast combinations was tested. We will add these points to the discussion in the revised manuscript.

      • The authors point out (line 193-195) that "Because the first phase of the response is shorter than the second phase, when V1 response is integrated over both phases, the overall response is positively correlated with the behavioral masking effect." I wonder if this could be explored a bit more at the behavioral level - i.e. does the "similarity masking" they are trying to explain show sensitivity to presentation time?

      We agree that testing the effect of stimulus duration on similarity masking is interesting, but unfortunately, it is beyond the scope of the current study. We would also like to point out that the duration of the presentation was selected to match the typical time of fixation during natural behaviors, so much shorter or much longer stimulus durations would be less relevant for natural vision.

      • From Fig. 3 it looks like the imaging ROI may include some opercular V2. If so, it's plausible that something about the retinotopic or columnar windowing they used in analysis may remove V2 signals, but they don't comment. Maybe they could tell us how they ensured they only included V1?

      We thank the reviewer for this comment. As part of our experiments, we extract a detailed retinotopic map for each chamber, so we were able to ensure that the area used for the decoding analysis lays entirely within V1. We will incorporate this information in the revised manuscript.

      • In the discussion (lines 278-283) they say "The positive correlation between the neural and behavioral masking effects occurred earlier and was more robust at the columnar scale than at the retinotopic scale, suggesting that behavioral performance in our task is dominated by columnar scale signals in the second phase of the response. To the best of our knowledge, this is the first demonstration of such decoupling between V1 responses at the retinotopic and columnar scales, and the first demonstration that columnar scale signals are a better predictor of behavioral performance in a detection task." I am having trouble finding where exactly they demonstrate this in the results. Is this just by comparison of Figs. 4E,K and 5E,K? I may just be missing something here, but the argument needs to be made more clearly since much of their claim to originality rests on it.

      We thank the reviewer for this comment. In the revised manuscript we will be more explicit and refer to the relevant figure panels (Fig 4D, E, J, & K vs. Fig 5D, E, J, & K) and report important values to substantiate this key claim.

      Reviewer #2 (Public Review):

      Summary

      In this experiment, Voltage Sensitive Dye Imaging (VSDI) was used to measure neural activity in macaque primary visual cortex in monkeys trained to detect an oriented grating target that was presented either alone or against an oriented mask. Monkeys' ability to detect the target (indicated by a saccade to its location) was impaired by the mask, with the greatest impairment observed when the mask was matched in orientation to the target, as is also the case in human observers. VSDI signals were examined to test the hypothesis that the target-evoked response would be maximally suppressed by the mask when it matched the orientation of the target. In each recording session, fixation trials were used to map out the spatial response profile and orientation domains that would then be used to decode the responses on detection trials. VSDI signals were analyzed at two different scales: a coarse scale of the retinotopic response to the target and a finer scale of orientation domains within the stimulus-evoked response. Responses were recorded in three conditions: target alone, mask alone, and target presented with mask. Analyses were focused on the target evoked response in the presence of the mask, defined to be the difference in response evoked by the mask with target (target present) versus the mask alone (target absent). These were computed across five 50 msec bins (total, 250 msec, which was the duration of the mask (target present trials, 50% of trials) / mask + target (target present trials, 50% of trials). Analyses revealed that in an initial (transient) phase the target evoked response increased with similarity between target and mask orientation. As the authors note, this is surprising given that this was the condition where the mask maximally impaired detection of the target in behavior. Target evoked responses in a later ('sustained') phase fell off with orientation similarity, consistent with the behavioral effect. When analyzed at the coarser scale the target evoked response, integrated over the full 250 msec period showed a very modest dependence on mask orientation. The same pattern held when the data were analyzed on the finer orientation domain scale, with the effect of the mask in the transient phase running counter to the perceptual effect of the mask and the sustained response correlating the perceptual effect. The effect of the mask was more pronounced when analyzed at the scale.

      Strengths

      The work is on the whole very strong. The experiments are thoughtfully designed, the data collection methods are good, and the results are interesting. The separate analyses of data at a coarse scale that aggregates across orientation domains and a more local scale of orientation domains is a strength and it is reassuring that the effects at the more localized scale are more clearly related to behavior, as one would hope and expect. The results are strengthened by modeling work shown in Figure 8, which provides a sensible account of the population dynamics. The analyses of the relationship between VSDI data and behavior are well thought out and the apparent paradox of the anti-correlation between VSDI and behavior in the initial period of response, followed by a positive correlation in the sustained response period is intriguing.

      Points to Consider / Possible Improvements

      The biphasic nature of the relationship between neural and behavioral modulation by the mask and the surprising finding that the two are anticorrelated in the initial phase are left as a mystery. The paper would be more impactful if this mystery could be resolved.

      We thank the reviewer for the positive comments. In our view, while our results are surprising, there may not be a remaining mystery that needs to be resolved. As our model shows, the biphasic nature of V1’s response can be explained by a delayed orientation-tuned gain control. Our results are consistent with the hypothesis that perception is based on columnar-scale V1 signals that are integrated over an approximately 200 ms long period that incorporates both the early and the late phase of the response, since such decoded V1 signals are positively correlated with the behavioral similarity masking effect (Fig. 5D, J). We will explain this more clearly in the discussion of our revised manuscript.

      The finding is based on analyses of the correlation between behavior and neural responses. This appears in the main body of the manuscript and is detailed in Figures S1 and S2, which show the correlation over time between behavior and target response for the retinotopic and columnar scale.

      One possible way of thinking of this transition from anti- to positive correlation with behavior is that it might reflect the dynamics of a competitive interaction between mask and target, with the initial phase reflecting predominantly the mask response, with the target emerging, on some trials, in the latter phase. On trials when the mask response is stronger, the probability of the target emerging in the latter phase, and triggering a hit, might be lower, potentially explaining the anticorrelation in the initial phase. The sustained response may be a mixture of trials on which the target response is or is not strong enough to overcome the effect of the mask sufficiently to trigger target detection.

      It would, I think, be worth examining this by testing whether target dynamics may vary, depending on whether the monkey detected the target (hit trials) or failed to detect the target (miss trials). Unless I missed it I do not think this analysis was done. Consistent with this possibility, the authors do note (lines 226-229) that "The trajectories in the target plus mask conditions are more complex. For example, when mask orientation is at +/- 45 deg to the target, the population response is initially dominated by the mask, but then in mid-flight, the population response changes direction and turns toward the direction of the target orientation." This suggests (to this reviewer, at least) that the emergence of a positive correlation between behavioral and neural effects in the latter phase of the response could reflect either a perceptual decision that the target is present or perhaps deployment of attention to the location of the target.

      It may be that this transition reflected detection, in which it might be more likely on hit trials than miss trials. Given the SNR it would presumably be difficult to do this analysis on a trial-by-trial basis, but the hit and miss trials (which make each make up about 1/2 of all trials) could be averaged separately to see if the mid-flight transition is more prominent on hit trials. If this is so for the +/- 45 degree case it would be good to see the same analysis for other combinations of target and mask. It would also be interesting to separate correct reject trials from false alarms, to determine whether the mid-flight transition tends to occur on false alarm trials.

      If these analyses do not reveal the predicted pattern, they might still merit a supplemental figure, for the sake of completeness.

      We thank the reviewer for suggesting this interesting possibility. The analysis in the manuscript was based on both correct and incorrect trials, raising the possibility that our results reflect some contribution from decision- and/or attention-related signals rather than from low-level nonlinear encoding mechanisms in V1 that we postulate in our model (Fig. 8). To explore this possibility, we re-examined our results while excluding error trials. We found that our key results from Figs 4 and 5 – namely that there is an early transient phase in which the neural and behavioral similarity effects are anti-correlated, and a later sustained phase in which they are positively correlated – hold even for the subset of correct trials, reducing the possibility that decision/attention-related signals play a major role in explaning our results. We will include the results of this analysis as a supplementary figure in the revised manuscript. This analysis, however, does seem to reveal interesting differences between correct and incorrect trials which we will discuss in the revised manuscript. s

      References

      Sebastian S, Abrams J, Geisler WS. 2017. Constrained sampling experiments reveal principles of detection in natural scenes. Proc Natl Acad Sci U S A 114: E5731-e40

    1. Author Response

      The following is the authors’ response to the original reviews

      Reviewer #1 (Recommendations for the authors):

      Major Concerns:

      1) There are numerous grammatical issues throughout the manuscript, and too much awkward jargon is used, such as "status of energy stresses", "ES-acetate". The characterization of acetate as an "energy stress" gives a negative connotation, which is unnecessary and confusing. Ketones are produced under the same circumstances but are a vital adaptive response, except for ketoacidosis. The terminology used throughout the manuscript is also vague, and some methodology is not adequately described in the Methods section. For example, the meaning of "preprandial" and "postprandial" is unclear, and there is no explanation of the related methodology.

      Thank you for your comments. We have replaced "status of energy stresses" with "energy stresses", in our revised manuscript. We agree with you that acetate and Ketone Bodies are produced under the same circumstances and their production is a result of a vital adaptive response. It is well known that the production of large amount of acetate and Ketone Bodies is an important physiological adaption of body in response to energy stresses such as prolonged starvation and untreated diabetes mellitus. In this context, we use “energy stress-acetate”, a term coined by ourselves to emphasize the condition of acetate production and its role under such condition. Based on your concerns, we have addressed the issues and provided a thorough description of the modifications made in the Methods section.

      2) The authors claim that acetate is a ketone body, which is incorrect. As the authors show, it is not produced by the ketogenic pathway or from the breakdown of ketones. Acetate is a carboxylic acid and specifically a short-chain fatty acid.

      We agree with you that our description of acetate as a ketone body is seemingly incorrect. Indeed, acetate is a short-chain fatty acid in terms of molecular structure. The classic Ketone Bodies include acetone, acetoacetate and beta-hydroxybutyrate, among which acetone and acetoacetate contain carbonyl group and can be considered as ketone, however beta-hydroxybutyrate which contains only hydroxyl and carboxyl groups is actually not a ketone but a short-chain fatty acid. Noteworthily, here our description of acetate as an emerging novel “ketone body” is not aimed to consider it as a real ketone in structure, but to emphasize the high similarity of acetate and the classic Ketone Bodies in the organ (liver) and substrate (fatty acids-derived acetyl-CoA) of their production, the roles they played (as important sources of fuel and energy for many extrahepatic peripheral organs), the feature of their catabolism (converted back to acetyl-CoA and degraded in TCA cycle), as well as the physiological conditions of their production (energy stresses such as prolonged starvation and untreated diabetes mellitus). To prevent any potential misunderstanding, we annotate the usage of "ketone body" with double quotation marks in our revised manuscript.

      3) The human subjects are not sufficiently characterized, and it is unclear whether they are T1DM or T2DM subjects. No information is provided on morphometrics, how and when serum was collected, exclusion criteria, medicines, etc. Proper characterization of human subjects is necessary before publishing such data.

      Thank you very much for your comments. We have added the description of subjects you mentioned in the Methods section.

      4) While Figure 4 is an essential set of experiments that demonstrate that ACOT12 is necessary for the induction of acetate during starvation in mice, the authors do not explain the source of basal levels of acetate that persist in mice lacking ACOT12. It is unclear whether this source is from other tissue or microbiota. Since loss of ACOT by ShRNA treatment resulted in ~25% reduction in acetate, it is very difficult to conceive how this produces the profound neurological and strength deficits presented in Supplemental Figure 8 (see last point below).

      Additionally, it is not clear how the control mice for the knockout studies were generated. Please clarify.

      In normal condition, the serum acetate level in mice is around 200 μM. Hepatic ACOT12 and ACOT8 enzymes seems to provide a serum acetate concentration of 60-90 μM, individually (Figure 4). The intestinal microbiota contributes a serum acetate concentration of 60-80 μM (Figure 2 and Figure supplement 1).

      During energy stress, the protein levels of ACOT12 and ACOT8 in the mouse liver were significantly upregulated (Figure 3 and Figure supplement 1), resulting in an significant increase of serum acetate level to approximate 400 μM. The acetate produced by ACOT12 (~200 μM) and ACOT8 (~200 μM) constitutes the main portion of serum acetate concentration under such condition (Figure 2), while the contribution of intestinal microbiota to serum acetate level is minimized (Figure 2 and Figure supplement 1). Elimination of either ACOT12 or ACOT8 reduces serum acetate level by up to 50% (Figure 4). However, such estimation is only a rough approximation and does not consider the possibility of compensatory upregulation of ACOT12 and ACOT8 in kidney when ACOT12 or ACOT8 is knocked out in liver.

      Acetate assumes the role as an important energy source in the case of reduced glucose utilization associated with diabetes. In this case, knockdown of ACOT12 or ACOT8 (shACOT12 or shACOT8) can remarkably reduce acetate production and consequently influence the Motor Function of mice to a certain extent.

      5) The results presented in Figure 5 are confusing, and the authors' interpretation needs elaboration. The FAO assay detects water-soluble 3H-metabolites and 3H2O, and etimoxir or CPT1 knockout completely inhibits FAO. Therefore, it is unclear how peroxisomes can produce acetate without generating water-soluble intermediates that are detectable in the assay. Further explanation and rationale for the authors' interpretation are necessary.

      Mitochondria serve as the primary organelle for the catabolism of oleic acid. However, in certain instances, fatty acid oxidation (FAO) can occur in the peroxisome, resulting in the production of medium-chain fatty acids and acetyl-CoA. Nevertheless, these medium-chain fatty acids cannot undergo further oxidation within the peroxisome. Instead, they must be transported out of the peroxisome and then into the mitochondria through CPT1 (carnitine palmitoyltransferase 1) for further oxidation.

      To assess FAO, we utilized a detection method based on 3H labeling in H2O in cells treated with [9,10-3H(N)]-oleic acid. The introduction of [9,10-3H(N)]-oleic acid leads to the production of 3H-labeled medium-chain fatty acids and acetyl-CoA within the peroxisome. The further oxidation of 3H-labeled medium-chain fatty acids in the mitochondria was inhibited by impeding the activity of CPT1, leading to the eventual decrease of 3H-labeled H2O. However, acetyl-CoA can still be converted to acetate by ACOT8. As a result, knockdown or etomoxir inhibition of CPT1, decreased more than one-half of U-13C-palmitate-derived U-13C-acetate production, in spite of mitochondria β-oxidation being nearly completely abolished.

      6) Figure 6F, which shows various fatty acyl-CoAs in MPHs, is not helpful on its own. It would be useful to compare this data to loss of function MPH data and to measure these acyl-CoAs in knockout liver. Additionally, since it is normal for liver acetyl-CoA concentration to change by several-fold in fasted and fed liver, this data from snap frozen liver tissue of ACOT12/8 KO mice would help prove the authors' point.

      We are grateful for your valuable advice. As you mentioned there are indeed several outstanding questions that require further clarification. To address these questions, we are currently in the process of developing an experimental mouse model in which ACOT12 and ACOT8 are conditionally knocked out. By virtue of this approach, we aim to acquire more substantial evidence to substantiate the aforementioned conclusions.

      7) Figure 7 suggests that loss of ACOT inhibits ketogenesis by decreasing HMGCS2 expression and increasing its acetylation. However, it is difficult to imagine that this the main mechanism considering the extraordinary ability of liver to handle high rates of acetyl-CoA conversion to ketones during fasting which, as the authors know, is the canonical mechanism by which mitochondrial CoA is preserved during elevated FAO. The manuscript (Figure 6 and 7) argues that it is the conversion of acetyl-CoA to acetate which is more important. A critical limitation of this argument is that ACOT12 is in cytosol (Figure 5), so while it spares CoA for fatty acid activation, it does not spare CoA for beta oxidation in mitochondria. That latter function is carried out by the ketogenic pathway. A second limitation is that the mechanism relies on citrate transport and ACLY activity, which is not generally thought to be very active in the ketogenic states of fasting and T1DM studied here. In essence, the mechanism relies on circular logic, whereby mitochondrial acetyl-CoA accumulates in the setting of impaired FAO, which then impairs ketogenesis and depletes CoA which then impairs FAO without lowering acetyl-CoA. I don't have a solution, but I think it is important to acknowledge the flaws in this proposed mechanism.

      As the Reviewer suggested, ACLY indeed plays a crucial role in fatty acid synthesis. Acetyl-CoA is transported out of the mitochondria in the form of citrate, which is subsequently broken down into acetyl-CoA by ACLY. Under conditions of sufficient nutrition, acetyl-CoA carboxylase 1 further activates acetyl-CoA to participate in fatty acid synthesis.

      In the context of an energy crisis resulting from low glucose utilization, we propose that ACLY might serve another pivotal role in addressing this energy deficit. In conditions such as untreated diabetes or prolonged starvation, glucose utilization is significantly reduced, leading to a reliance of body on fatty acid oxidation in liver to generate Ketone Bodies and acetate to fuels extrahepatic peripheral tissues and thus cope with the energy crisis. However, excessive fatty acid oxidation disrupts the balance between oxidized and reduced CoA, necessitating the production of both acetate and Ketone bodies to restore this equilibrium. Conventionally, fatty acid synthesis is inhibited during this period as AMPK is activated to suppress acetyl-CoA carboxylase 1 activity via phosphorylation in low-energy states. Based on our preliminary experimental results, the activity of ACLY and citrate transporter still appear to work well. It is possible that citrate-ACLY-ACOT12-acetate pathway is important for downregulating the level of mitochondria acetyl-CoA in energy crisis. According to previous studies, cytosolic reduced CoA has the capability to be transported into the mitochondria, thereby replenishing the acetyl-CoA pool within the mitochondria (PMID: 32234503). It is important to note that this remains a hypothesis requiring further testing.

      8) Figure 8 presents some deceptively complex MS data following a 13C-acetate injection. The data is presented in an unorthodox manner, as 13C-metabolite intensities, making it nearly impossible to properly interpret. Enrichment of TCA cycle intermediates are not always easy to interpret, but at minimum, this data needs to be presented as MIDs or fractional enrichments. If the data is not modeled, then it might be useful to at least perform a rudimentary precursor-product analysis (i.e. normalized to plasma acetate enrichment).

      Supplemental Figure 8 also introduces evidence for neurological and strength deficits in shACOT12/8 knockdown mice. It is an interesting observation, but there is no direct link to the metabolic studies in the main figure, which does not present data in the loss of function mice. Nor is this part of the story investigated in liver specific knockout mice. Figure 8 is the least developed part of the manuscript and could be removed without losing the impact of the story.

      We deeply appreciate your valuable suggestions. As mentioned previously, we are currently engaged in the development of an experimental mouse model where ACOT12 and ACOT8 are selectively knocked out. Subsequent experiments will be conducted to validate this model, and the resulting data will be presented in the form of MIDs or fractional enrichments, as per your suggestion.

      The evaluation of anxiety-related behavior is commonly done using the Elevated Plus Maze Test (EPMT), while working memory and cognitive functions are assessed through the Y-maze Test (YMZT) and Novel Object Recognition (NOR) Test. Measures such as forelimb strength and running time in the rotarod test, total distance in YMZT, total entries in YMZT, and total distance in the NOR test are indicators of muscle force and movement ability. Our data demonstrate that acetate plays a significant role in enhancing muscle force and facilitating coordinated neuromuscular movement. Interestingly, we found that ACOT12/8 knockdown in the early stages of diabetes mellitus does not have a pronounced impact on psychiatric, memory, and cognitive behaviors (Figure 8 and figure supplement 2). However, it is important to note that our study primarily focuses on elucidating the utilization of acetate during energy crises, such as untreated diabetes and chronic hunger. Our findings suggest that acetate is primarily utilized to enhance motor capacity rather than cognitive or neural activity.

      Reviewer #2 (Recommendations for the authors):

      The statement that acetate is an emerging ketone body is not correct. It is not a ketone, it is a carboxylic acid or a short-chain fatty acid. In my opinion, to avoid confusion this should be clarified.

      We agree with you that our description of this is not clear enough. Acetate is a short-chain fatty acid in terms of molecular structure indeed.

      The classic Ketone Bodies include acetone, acetoacetate and beta-hydroxybutyrate, among which acetone and acetoacetate contain carbonyl group and can be considered as ketone, however beta-hydroxybutyrate which contains only hydroxyl and carboxyl groups is actually not a ketone but a short-chain fatty acid.

      Noteworthily, here our description of acetate as an emerging novel “ketone body” is not aimed to consider it as a real ketone in structure, but to emphasize the high similarity of acetate and the classic Ketone Bodies in the organ (liver) and substrate (fatty acids-derived acetyl-CoA) of their production, the roles they played (as important sources of fuel and energy for many extrahepatic peripheral organs), the feature of their catabolism (converted back to acetyl-CoA and degraded in TCA cycle), as well as the physiological conditions of their production (energy stresses such as prolonged starvation and untreated diabetes mellitus). To prevent any potential misunderstanding, we annotate the usage of "ketone body" with double quotation marks in our revised manuscript.

      The reason for increased fatty acid delivery to the liver is explained by insulin resistance rather than by reduced carbohydrate availability.

      Patient characteristics should be provided.

      Thank you for your suggestions. We have revised our manuscript accordingly.

      Reviewer #3 (Recommendations for the authors):

      • Please include the rationale for having data from both C57BL/6 and BALC/c. In metabolic research, C57BL/6 is more commonly studied. The data between these two strains are similar, and one could be easily removed to limit redundancy.

      Thank you for bringing this issue to our attention in the manuscript. In metabolic research, C57BL/6 mice are more commonly utilized as a model organism than BALC/c mice indeed. In this study we try to elucidate a characteristic may be shared among different mammalian species, namely the ability to produce a substantial amount of acetate during energy crises. However, given the constraints of our experimental setup, we opted to employ C57BL/6 mice as the main animal model to investigate the underlying mechanism. BALC/c mice were used to confirm the underlying mechanisms governing acetic acid production.

      • In the experiments where ACOT8 and ACOT12 are selectively knocked out or knocked down, please include the levels of other ketone bodies, such as 3-HB and AcAC, from these experiments. While acetate production is diminished, there might or might not be a compensatory increase in the production of these metabolites. This would include experiments related to Figures 3, 4, and 5.

      Thank you for your valuable comments. As you mentioned, in diabetic mice where ACOT12 and ACOT8 are knocked down in liver, there is a significant down-regulation of 3-HB and AcAc (Figure 7B, C). Based on this observation, we hypothesize that ACOT12 and ACOT8 might also play a regulatory role in the formation and metabolism of ketone bodies during an energy crisis. However, the precise regulatory mechanism underlying this phenomenon requires further investigation.

      • From Figure 1 (source data 1), two patients with diabetes have concurrent cancer. Cancer cells have altered metabolism compared to native cells. Thus, it is possible that circulating acetate cells may be altered in these cancer patients, regardless of the presence of diabetes. This should be acknowledged. Otherwise, these two subjects should be taken out.

      Thank you for your suggestions. We have taken out these two subjects in our revised manuscript.

      • Can the authors expand on their thoughts on why some results from the behavioral tests are statistically significant while others are not? For example, many motor tasks such as forelimb strength, running time, total distance, and total entries significantly differ with ACOT8 and ACOT12 knockdown. However, more anxiety-based measures such as time in open arms, correct alteration, and object recognition are not statistically different.

      Thank you for your comments. The evaluation of anxiety-related behavior is commonly done using the Elevated Plus Maze Test (EPMT), while working memory and cognitive functions are assessed through the Y-maze Test (YMZT) and Novel Object Recognition (NOR) Test. Measures such as forelimb strength and running time in the rotarod test, total distance in YMZT, total entries in YMZT and total distance in the NOR test are indicators of muscle force and movement ability. Our data demonstrate that acetate plays a significant role in enhancing muscle force and facilitating coordinated neuromuscular movement. Interestingly, we found that ACOT12/8 knockdown in the early stages of diabetes mellitus does not have a pronounced impact on psychiatric, memory, and cognitive behaviors (Figure 8 and figure supplement 2). However, it is important to note that our study primarily focuses on elucidating the utilization of acetate during energy crises, such as untreated diabetes and chronic hunger. Our findings suggest that acetate is primarily utilized to enhance motor capacity rather than cognitive or neural activity.

    1. Author Response

      Reviewer #1 (Public Review):

      The study was conducted in laboratory conditions with a local population of Cx. quinquefasciatus from Argentina. I'm not sure if there is any evidence for a seasonal shift in the host use pattern in Cx. quinquefasciatus populations from the southern latitudes.

      Unfortunately, studies conducted in South America to understand host use by Culex mosquitoes are very limited, and there are virtually no studies on the seasonal pattern of host use. In Argentina, there is some evidence (Stein et al., 2013; Beranek, 2018) regarding the seasonal change in host use by Culex species, including Culex quinquefasciatus, where the inclusion of mammals during the autumn has been observed. As part of a comprehensive study on characterizing bridge vectors for SLE and WN viruses, our research group is currently working on the molecular identification of blood meals from engorged females to gain deeper insights into the seasonal host use by Culex mosquitoes.

      While the seasonal change in host use by Culex quinquefasciatus has not been reported in Argentina so far, there has been an observed increase in reported cases of SLE virus in humans between summer and autumn (Spinsanti et al., 2008). It is based on this evidence that we hypothesize there is a seasonal change in host use by Culex quinquefasciatus, similar to what occurs in the United States. This is also considering that both countries (Argentina and the United States) have regions with similar climatic conditions (temperate climates with thermal and hydrological seasonality).

      I think the authors need to discuss more about the bigger question they were addressing. I think that the discussion section can be strengthened greatly by elaborating on whether there is evidence for a seasonal shift in host use pattern in Cx. quinquefasciatus in the southern latitudes. If yes, what alternate mechanisms they believe could be driving the seasonal change in host use in this species in the southern latitudes now that they show the 'deriving reproductive advantages' hypothesis to be not true for those populations.

      We will restructure our discussion to align it with our results, as suggested.

      Grammar and writing

      The manuscript will be grammatically revised.

      Reviewer #2 (Public Review):

      There is no replication built into this study. Egg lay is a highly variable trait, even within treatments, so it is important to see replication of the effects of treatment across multiple discrete replicates. It is standard practice to replicate mosquito fitness experiments for this reason. Furthermore, the sample size was particularly small for some groups (e.g. 15 egg rafts for the second gonotrophic cycle of mice in the autumn, which was the only group for which a decrease in fecundity and fertility was detected between 1st and 2nd gonotrophic cycles). Replicates also allow investigators to change around other variables that might impact the results for unknown reasons; for example, the incubators used for fall/summer conditions can be swapped, ensuring that the observed effects are not artifacts of other differences between treatments. While most groups had robust sample sizes, I do not trust the replicability of the results without experimental replication within the study.

      We agree egg lay is a variable trait and so we consider high numbers of mosquitoes and egg lay during experiments compared to our studies of the same topics. Evaluating variables such as fecundity, fertility, or other types of variables (collectively referred to as "life tables") is a challenging issue that depends on several intrinsic and extrinsic factors. Because of all of this, in some experiments, sample sizes might not be very large, and in several articles, lower sample sizes could be found. For instance, in Richards et al. (2012), for Culex quinquefasciatus, during the second gonotrophic cycle, some experiments had 13 or even 6 egg rafts. For species like Aedes aegypti, the sample size for life table analysis is also usually small. As an example, Muttis et al. (2018) reported between 1 and 4 engorged females (without replicates). Because of this, we do find our sample sizes quite robust for our results.

      Regarding the need to repeat the experiments in order to give more robustness to the study we also agree. However, after a review of the literature (articles cited in the original manuscript), it is apparent that similar experiments are not frequently repeated as such. Examples of this are the studies of Richards et al. (2012), Demirci et al. (2014) or Telang & Skinner (2019), which even manipulate several cages at a time as “replicates”, they are not true replicates because they summarise and manipulate all data together, and do not repeat the experiment several times. We see these “replicates” as a way of getting a greater N.

      As it was stated by the reviewer, repetition is a resource and time consuming activity that we are not able to do. Replicating the experiment poses a significant time challenge. The original experiment took over three months to complete, and it is anticipated that a similar timeframe would be necessary for each replication (6 months in total considering two more replicates). Given our existing commitments and obligations, dedicating such an extensive period solely to this would impede progress on other crucial projects and responsibilities. Given the limitations of resources and time and the infrequent use of experimental repetition in this type of studies, we suggest performing a simulation-based analysis. This approach involves generating synthetic data that mimics the expected characteristics of the original experiment and subsequently subjecting it to the same analysis routine. The main goal of this simulation will be to evaluate the potential spuriousness and randomness of the results that might arise due to the experimental conditions. We will introduce this simulation-based analysis in the next revised version of the manuscript.

      Considering the hypothesis is driven by the host switching observed in the field, this phenomenon is discussed very little. I do not believe Cx. quinquefasciatus host switching has been observed in Argentina, only in the northern hemisphere, so it is possible that the species could have an entirely different ecology in Argentina. It would have been helpful to conduct a blood meal analysis prior to this experiment to determine whether using an Argentinian population was appropriate to assess this question. If the Argentinian populations don't experience host switching, then an Argentinian colony would not be the appropriate colony to use to assess this question. Given that this experiment has already been conducted with this population, this possibility should at least be acknowledged in the discussion. Or if a study showing host switching in Argentina has been conducted, it would be helpful to highlight this in the introduction and discussion.

      We are aware that few studies regarding host shifting in South America are available, some such those conducted by Stein et al. (2013) and Beranek (2018) reported a moderate host switch for Culex quinquefasciatus in Argentina. We have already performed a study about seasonal host feeding patterns for this species. As you suggested, we could mention it in the discussion to highlight our partial findings. However, even though there are few studies regarding host shifting, our hypothesis is based mainly in the seasonality of human cases of WNV and SLEV, a pattern that has been demonstrated for our region, see for example the study of Spinsanti et al. (2008).

      The impacts of certain experimental design decisions are not acknowledged in the manuscript and warrant discussion. For example, the larvae were reared under the same conditions to ensure adults of similar sizes and development timing, but this also prevents mechanisms of action that could occur as a result of seasonality experienced by mothers, eggs, and larvae.

      We understand the confusion that may have arisen due to a lack of further details in the methodology. If we are not mistaken, you are referring to our oversight regarding the consideration of carry-over effects of larvae rearing that could potentially impact reproductive traits. When investigating the effects of temperature or other environmental factors on reproductive traits, it is possible to acclimate either larvae or adults. This is due to the significant phenotypic plasticity that mosquitoes exhibit throughout their entire ontogenetic cycle. In our study, we followed an approach similar to that of other authors where the adults are exposed to experimental conditions (temperature and photoperiod). For a similar approach you can refer to the studies conducted by Ferguson et al. (2018) for Cx. pipiens, Garcia Garcia & Londoño Benavides (2007) for Cx. quinquefasciatus and Christiansen-Jucht et al. (2014, 2015) for Anopheles gambiae.

      Beyond the issue of lack of replication limiting trust in the conclusions in general, there is one conclusion reached at the end of the discussion that would not be supported, even if additional replicates are conducted. The results do not show that physiological changes in mosquitoes trigger the selection of new hosts. Host selection is never measured, so this claim cannot be made. The results don't even suggest that fitness might trigger selection because the results show that physiological changes are in the opposite direction as what would be hypothesized to produce observed host switches. Similarly, the last sentence of the abstract is not supported by the results.

      We agree with this observation. However, we did not evaluate the impact of fitness on host selection in this study. Instead, we aimed to investigate the potential influence of seasonality on mosquito fitness as a potential trigger for a shift in host selection. We agree that we have incorrectly used the term “host selection” when we should actually be discussing “host use change”. Our results indicate a seasonal alteration in mosquito fitness in response to temperature and photoperiod changes. Building upon this observation, we will discuss into our hypotheses and theoretical model to explain this seasonal shift in host use.

      Grammar and writing

      The manuscript will be grammatically revised by a professional translator.

    1. Data and dataset

      One reason we may be having difficulty with this section is that "data" can be literally anything from basic facts, which is what lay people think of as "data" to professional works of fiction or visual art, which lay people think of as more than mere data. And those lay intuitions are legally relevant.

      As a result of these distinctions, and the many other rights issues that may arise with certain types of data - e.g., health information or nude pictures of real people, this area seems like the most ethically complicated.

      I don't have a good answer here, I'm just trying to call out why this feels more challenging. Maybe that will help shake some ideas loose as we continue to iterate.

    1. Author Response

      Thank you for your thorough critique and thoughtful suggestions for improving our manuscript, "Homeostatic Synaptic Plasticity of Miniature Excitatory Postsynaptic Currents in Mouse Cortical Cultures Requires Neuronal Rab3A.” The reviewers’ detailed comments suggest that showing multiple types of graphs to demonstrate the presence of divergent scaling of mEPSC amplitudes in cultures from Rab3A wild type, and its disruption in cultures from Rab3A knockout mice, had the unintended consequence of obscuring the major results of our study. Furthermore, our proposal that the difference in characteristics of scaling of GluA2 receptor expression compared to that of mEPSC amplitudes, based on the ratio plots, indicated that a mechanism other than postsynaptic receptors likely contributes to the homeostatic increase in mEPSC amplitude was not convincing to the reviewers. Reviewers 2 and 3 point out these results might be explained by differences in the limitations and artifacts of the two very distinct techniques, electrophysiology and fluorescence imaging. In the revision we will acknowledge that a greater variability in the signal, or, more issues with signal over noise, might be present in imaging experiments compared to electrophysiology. This could explain the lack of identical effects on GluA2 receptors compared to mEPSC amplitudes in the matched experiments, but we maintain it is also possible that a greater variability in GluA2 responses is biologically meaningful. Further, an issue with the accuracy of imaging experiments to report the true receptor effects would also call into question the conclusion that receptors always increase after activity blockade. Finally, the graphs illustrating the detailed characteristics of scaling with rank order and ratio plots required pooling multiple samples per cell, which precludes application of standard statistical methods to determine whether effects or differences reach statistical significance. Therefore, we will remove the cumulative distribution functions, rank order plots, and ratio plots, and show only analyses that involve a single sample per cell. This major change will simplify and clarify the main findings, that homeostatic plasticity of both mEPSC amplitude and GluA2 receptor expression in mouse cortical cultures involves the synaptic vesicle protein Rab3A operating in neurons rather than astrocytes. We will focus our comparison between mEPSC amplitudes and receptors in the same cultures to differences between the magnitude of effects on the mean or median, and will make clear that overall, our data can be explained by two possibilities: 1) the presynaptic vesicle protein is acting via regulation of postsynaptic receptors alone, or, it is regulating both postsynaptic receptors and another contributor to mEPSC amplitude, possibly amount of transmitter released by a single vesicle. Either way, it is very surprising that this presynaptic protein is involved in postsynaptic changes, so our results represent a novel contribution to the field of homeostatic plasticity. In sum, the changes we propose should go a long way towards addressing the majority of the reviewers’ major critiques.

      A related issue raised by the reviewers was that the model describing potential presynaptic mechanisms of Rab3A in homeostatic plasticity was not supported by direct evidence (Figure 10). We meant the model to introduce the possibility of a presynaptic contribution to mEPSC amplitude and to stimulate future research, but clearly did not communicate its speculative nature, neither in the Figure legend nor in our discussion of potential mechanisms. In the revision, we will restrict the model to the direct findings in this study. Additionally, we will state where appropriate, that while previous findings at the mouse NMJ are consistent with a presynaptic role for Rab3A (Wang et al., 2011), in the current study there is no direct evidence for this idea in cortical cultures other than the quantitative differences in the fold increases in mEPSC amplitudes and GluA2 receptors which were assayed in the same cultures.

      We will submit a revised version addressing each of the reviewer’s concerns and suggestions as described above and below; these major modifications will greatly improve the readability of the manuscript and clarify the main results.

      Reviewer #1

      Koesters and colleagues investigated the role of the presynaptic small GTPase Rab3A in homeostatic scaling of miniature synaptic transmission in primary mouse cortical cultures using electrophysiology and immunohistochemistry. The major finding is that TTX incubation for 48 hours does not induce an increase in the amplitude of excitatory synaptic miniature events in neuronal cultures derived from Rab3A KO and Rab3A Earlybird mutant mice. NASPM application had comparable effects on mEPSC amplitude in control and after TTX, implying that Ca2+-permeable glutamate receptors are unlikely modulated during synaptic scaling. Immunohistochemical analysis revealed an increase in GluA2 puncta size and intensity in wild type, but not Rab3A KO cultures. Finally, they provide evidence that loss of Rab3A in neurons, but not astrocytes, blocks homeostatic scaling. Based on these data, the authors propose a model in which presynaptic Rab3A is required for homeostatic scaling of synaptic transmission through GluA2-dependent and independent mechanisms.

      While the title of the manuscript is mostly supported by data of solid quality, many conclusions, as well as the final model, cannot be derived from the results presented. Importantly, the results do not indicate that Rab3A modulates quantal size on both sides of the synapse. Moreover, several analysis approaches seem inappropriate.

      The following points should be addressed:

      1) The model shown in Figure 10 is not supported by the data. The authors neither provide evidence for two different functional states of Rab3A being involved in mEPSC amplitude modulation, nor for a change in glutamate content of vesicles. Furthermore, the data do not fully support the conclusion of a presynaptic role for Rab3A in homeostatic scaling.

      We will revise the model, removing presynaptic mechanisms for Rab3A and restricting it to the direct findings in this study.

      2) The analysis of mEPSC data using quantile sampling followed by ratio calculation is not meaningful under the tested experimental conditions because of the following reasons:

      (i) The analysis implicitly assumes that all events have been detected. The prominent mEPSC frequency increase after TTX suggests that this is not the case, i.e., many (small) mEPSCs are likely missed under control conditions.

      We explicitly addressed the potential contribution of missed mEPSCs that are below threshold in (Hanes et al., 2020). We found that even simulating a threshold of 7 pA, applied to data artificially modified by uniformly multiplying the control data set, did not generate a ratio plot with the increasing ratio over 75% of the data that we observe in the experimental data. Overall, the findings from simulating a threshold and a uniform multiplicative factor illustrate that the threshold issue does not cause major changes to the data. Furthermore, in cultures from Rab3A+/+ mice from the Rab3AEbd/+ colony, the mEPSC amplitudes were significantly smaller than those recorded in cultures from Rab3A+/+ mice from the Rab3A+/- colony (lines 327-329, 11 pa vs 13 pA), indicating that if there were smaller mEPSCs occurring in the Rab3A+/+ data set, we would have detected them. Although for these reasons we feel it is unlikely our ratio plot analysis is invalid, to clarify the result that homeostatic plasticity of mEPSC amplitude requires functioning Rab3A, we will remove the ratio plots.

      (ii) The analysis is used to conclude how events of a certain size are altered by TTX treatment. However, this analysis compares the smallest mEPSCs of the TTX condition with the smallest control mEPSCs, but this is not a pre-post experimental design. Variation between cells and between coverslips will markedly affect the results and lead to misleading interpretations.

      The rank order plot is a well-established plot to examine the mathematical transformation caused by homeostatic plasticity, first used in (Turrigiano et al., 1998). We included it here to facilitate comparison of our findings with previous results. We introduced the ratio plot in (Hanes et al., 2020), finding it shows more clearly differences occurring in the range of small mEPSC values. The reviewer is correct in that we are assuming the smallest mEPSCs before treatment should be matched with the smallest mEPSCs after treatment. It is almost impossible to do a pre-post experimental design for mEPSCs. Even when applying a treatment, for example acute perfusion with a receptor antagonist, to a single cell and recording mEPSCs before and after the treatment, it is not a true pre-post design at the level of mEPSC amplitudes, which come from many different inputs. The power of the method is that different characteristic mathematical transformations for different experimental conditions (e.g., genotype or activity protocol) support the idea that those conditions either involve different mechanisms or have altered the mechanism. Such differences might be missed by only comparing means or medians. However, we found no evidence that loss of Rab3A or expression of the Rab3A Earlybird mutant altered the mathematical transformation due to homeostatic plasticity, other than to reduce its magnitude across all amplitudes. Therefore, including these complex analyses is not adding anything to the finding that Rab3A plays a role in homeostatic plasticity of mEPSC amplitudes and they will be removed in the revision.

      (iii) The ratio (TTX/control) vs. control plots seem to suffer from a division by small value artifact (see Figure 6F).

      The reviewer is referring to findings on the ratio plot for receptor cluster area. Because the large ratios for the smallest control areas occur in the cultures prepared from wild type mice, and to a much lower extent in cultures prepared from Rab3A knockout mice, we think there is a biologically relevant increase in the TTX/CON ratio, since an artifact due to division by small values should be present in both data sets. However, we cannot rule out that the differences in ratio plot behavior between receptors and mEPSC amplitudes result from the different limitations in detection of receptor clusters vs. the limits of detection of mEPSCs, so we will remove the ratio plots and focus on comparison of means or medians.

      Correspondingly, ratio-analysis differs considerably for different control conditions (Fig. 1Giii, Fig. 2Giii, Fig. 6C, Fig. 9A).

      The reviewer is correct to point out that the ratio plot shows differences across control conditions (note, these differences are not obvious with the more standard rank order plot). The magnitude of the 50th percentile ratio differs across control conditions, and behaviors of the largest mEPSCs also differ, with some ratios going down at the highest control amplitudes (1Giii, 6C), and others continuing to increase with increasing control amplitude (2Giii, 9A). They all share the divergent increasing ratio from smallest mEPSC amplitude to around the 20 pA level. We attribute the differences in magnitude to the differences in experimental conditions: 1Giii is Rab3A+/+ from the +/+ colony; 1Giii is Rab3A+/+ from the Ebd/+ colony; 6C is a set of Rab3A+/+ cultures assayed several years after the set in 1Giii; 9A is a different culture condition altogether, with neurons being plated onto an already formed bed of astrocytes. Effects on the largest mEPSCs are likely attributable to the small number and high variability of amplitudes in this range. Since the variability in the very sensitive ratio plot have taken away from the main findings of homeostatic plasticity being disrupted in the absence of functioning Rab3A in neurons, we will remove the rank-order and the ratio plots from the manuscript.

      3) As noted by the authors in a previous publication (Hanes et al. 2020), statistical analysis of CDFs suffers from ninflation. In addition, the quantile sampling method chosen violates an important assumption of the K-S test. Indeed, pvalues for these comparisons are typically several orders of magnitude smaller. Given that the statistical N most likely corresponds to the number of cultures (see, e.g., https://doi.org/10.1371/journal.pbio.2005282), CDF comparisons are not informative and should thus not be used to draw conclusions from the data. The plots can be informative, though.

      As the reviewer acknowledges, we were very careful in (Hanes et al., 2020) to state that the p values could not be used to determine significance in the KS test of cumulative distributions for pooled data because the KS test assumes a single sample per cell. We also suggested in that study that the p values could be used in a comparative way for looking at data sets with similar (inflated) n values to say something about bigger or smaller differences. We failed to reiterate those caveats here. In reviewing the article “What is N” by (Lazic et al., 2018) (which we very much appreciate being shown by the reviewer), we agree that in the current study where we are attempting to show how the effect of homeostatic plasticity is or is not altered by loss of Rab3A function, it is imperative that we be able to make conclusions about statistical significance. The pooling approach is essential for having some sense of the mEPSC amplitude distributions, but that is not necessary for looking at the effect of Rab3A. Therefore, we will remove all analyses that involve pooling of multiple mEPSC amplitudes per cell.

      4) How does recoding noise and the mEPSC amplitude threshold affect "divergent scaling"?

      We addressed this in our 2020 paper (Hanes et al., 2020) where we showed that the experimental homeostatic increase in mEPSC amplitude cannot be simulated with uniform, multiplicative synaptic scaling whether we included or excluded distortion caused by a detection threshold.

      5) What is the justification for the line fits of the ratio data/how was the fit range chosen?

      We are assuming the reviewer is referring to the line fits for the rank-order data. If so, the fit range is the entire range of the data. This issue will be addressed by the removal of the rank-order plots from the manuscript.

      6) TTX application induces a significant increase in mEPSC amplitude in Rab3A-/- mice in two out of three data sets (Figs. 1 and 9). Hence, the major conclusion that Rab3A is required for homeostatic scaling is only partially supported by the data.

      Based on the p-values for comparison of means with a Kruskal-Wallis test, we would argue that TTX application does not show a significant increase in mEPSC amplitude in Rab3A-/- neurons (Figure 1 p-value = .318; Figure 9 p-value = .125) when comparing to untreated control mEPSC amplitude means. It is only when we use the KS test and the inflated n’s that we get a barely significant results, p = 0.042. Based on the Lazic article (Lazic et al., 2018), we would now conclude that we cannot use the KS p value in that analysis. We have tried to be clear that the effect of TTX application on mEPSC amplitude in Rab3A-/- neurons is not completely abolished, but rather is dramatically reduced, which we acknowledge in the manuscript (line 279). This issue will be addressed by removal of CDFs from the manuscript.

      7) Line 289: A comparison of p-values between conditions does not allow any meaningful conclusions.

      Although we feel that comparison of magnitude of effects can be stated in a qualitative way for similar sized pooled data sets with larger or smaller p-values, we agree that statistical significance has no meaning. This issue will be addressed by removing the CDF plots from the manuscript.

      8) There is a significant increase in baseline mEPSC amplitude in Rab3AEbd/Ebd (15 pA) vs. Rab3Aebd/+ (11 pA) cultures, but not in Rab3A-/- (13.6 pA) vs. Rab3A+/- (13.9 pA). Although the nature of scaling was different between Rab3AEbd/Ebd vs. Rab3AEbd/+, and Rab3AEbd/Ebd with vs. without TTX, the question arises whether the increase in mEPSC amplitude in Rab3AEbd/Ebd is Rab3A dependent. Could a Rab3A independent mechanism occlude scaling?

      We have acknowledged in the manuscript that one explanation for a failure to exhibit homeostatic plasticity in the cultures from Rab3A Earlybird mutant mice is that the already large basal amplitude occludes any further increase (line 366). In the revision we will make sure the occlusion possibility is highlighted, but we will also discuss other proteins that have been implicated in homeostatic plasticity that have caused an increase in mEPSC amplitude and/or AMPA receptors at baseline, for example, Arc/Arg3.1 KO (Shepherd et al., 2006; Beique et al., 2011); Homer KO (Hu et al., 2010) and inhibition of mir-186-5p (Silva et al., 2019).

      9) Figure 4: NASPM appears to have a stronger effect on mEPSC frequency in the TTX condition vs. control (-40% vs. 15%). A larger sample size might be necessary to draw definitive conclusions on the contribution of Ca2+-permeable AMPARs.

      We will acknowledge that Ca2+-permeable AMPARs could be contributing to the frequency increase following activity blockade and will also include analyses of frequency throughout the manuscript.

      10) The authors discuss previous papers showing changes in VGLUT1 intensity. Was VGLUT intensity altered in the stainings presented in the manuscript?

      We will perform analyses VGLUT1 intensity and include them in the manuscript.

      11) The change in GluA2 area or fluorescence intensity upon TTX treatment in controls is modest. How does the GluA2 integral change?

      The changes in GluA2 integrals look exactly like the changes in cluster size and were not included to simplify the results. But with the removal of the CDFs, rank order, and ratio plots, we can easily include integral measurements. What we did not observe was an additive effect with intensity and size such that the effects on integral were of greater magnitude or statistical significance than either alone. We will include the integral plots in the revised manuscript.

      12) The quantitative comparison between physiology and microscopy data is problematic. The authors report a mismatch in ratio values between the smallest mEPSC amplitudes and smallest GluA2 receptor cluster sizes (l. 464; Figure 8). Is this comparison affected by the fluorescence intensity threshold?

      What was the rationale for a threshold of 400 a.u. or 450 a.u.?

      We have acquired AOIs of receptor clusters at multiple threshold levels, and can examine whether the results are altered when using a low, medium or high threshold level.

      How does this threshold compare to the mEPSC threshold of 3 pA?

      The issue with values being below threshold in untreated cultures has been the concern in interpreting effects on mEPSC amplitudes, specifically, whether this mismatch contributes to divergent scaling. A problem of values being below a toohighly set threshold in the control and becoming detectable after the homeostatic plasticity produces a lower ratio than expected, because now there are values in the treated condition that were not present in the control condition. Instead, for GluA2 receptor cluster size, we observed higher TTX/CON ratios at the low end of the data set. So, based on this, the thresholds chosen for imaging are not having the same effect, if that is what is being asked. This issue will be addressed by removing ratio plots.

      The conclusion that an increase in AMPAR levels is not fully responsible for the observed mEPSC increase is mainly based on the rank-order analysis of GluA2 intensity, yielding a slope of ~0.9. There are several points to consider here: (i) GluA2 fluorescence intensity did increase on average, as did GluA2 cluster size. (ii) The increase in GluA2 cluster size is very similar to the increase in mEPSC amplitude (each approx. 18-20%). (iii) Are there any reports that fluorescence intensity values are linearly reporting mEPSC amplitudes (in this system)?

      We agree that our data show GluA2 receptors increase as based on cluster size, and did not mean to imply otherwise. Our conclusion that there is another contributor to mEPSC amplitude other than receptors is based on two main findings, 1) that the ratio plots for mEPSC amplitudes and receptor cluster size have distinctively different behaviors, and 2) that there are differences in either magnitude or direction of the TTX effect across 6 matched cultures, 3 from WT animals and 3 from TTX animals (see more explanation of this point below, in response to Reviewer 3). To our knowledge, no one has reported homeostatic plasticity effects on a culture by culture basis, and no one has compared imaging results and physiological results for the same cultures. We will remove the ratio plots and the conclusions based on the differences in behavior for mEPSC amplitudes and receptor cluster size. We will acknowledge in the revision that the differences in magnitude and direction across the 6 matched cultures could be due to the differences in limitations and artifacts of imaging fluorescent antibody staining vs. the limitations and artifacts of detecting mEPSCs electrophysiologically. However, we will continue to state that our results could also be due to the possibility that mEPSC amplitude is not changing in lockstep with receptor levels in every situation. To support this proposal, we will discuss those articles that include both measurements, and point out where mEPSC amplitude measurements and receptor levels match and where they do not.

      Antibody labelling efficiency, and false negatives of mEPSC recordings may influence the results. The latter was already noted by the authors.

      We will add the caveat that antibody labeling efficiency can vary between coverslips. Although we prepared single solutions that were applied to all coverslips in an experiment, this was not possible for the primary antibody to GluA2, which was added to live cultures in individual wells.(iv) It is not entirely clear if their imaging experiments will sample from all synapses. We will add to Materials and Methods that we sample from all the synapses that could be detected by the researcher on the primary dendrite of the pyramidal cell.

      Other AMPAR subtypes than GluA2 could contribute, as could kainate or NMDA receptors.

      This is true, other AMPARs (GluA3 and/or GluA4) could be contributing, but we only looked at the receptors well established to be contributing to homeostatic plasticity (GluA1 and GluA2). We will acknowledge the possible contribution of other AMPARs in the revised manuscript.

      Furthermore, the statement "complete lack of correspondence of TTX/CON ratios" is not supported by the data presented (l. 515ff). First, under the assumption that no scaling occurs in Rab3A-/- , the TTX/CON ratios show a 20-30% change, which indicates the variation of this readout. Second, the two examples shown in Figure 8 for Rab3A+/+ are actually quite similar (culture #1 and #2), particularly when ignoring the leftmost section of the data, which is heavily affected by the raw values approaching zero.

      We will remove the ratio plots from the manuscript and the arguments about differences between GluA2 receptors and mEPSC amplitudes that were based on them. However, we maintain that we have demonstrated a lack of consistent effect for GluA2 receptors and mEPSCs in the matched culture experiments. Yes, the readout of homeostatic plasticity in ratio plots for mEPSCs in the Rab3AKO reach over 1.1 in Figure 1, and as high a 1.2 in the cultures where Rab3AKO neurons were plated on Rab3AWT glia (Figure 9). Our point is that if we had measured GluA2 receptor responses to TTX in those same experiments, the ratios should have been above 1. However, in the experiments in which we measured both mEPSCs and GluA2 receptors, the ratios do not match. In culture #1, the ratio for mEPSCs was at 1 for more than 50% of the data, but for GluA2 receptors, was below 1 for more than 50% of the data. In culture #3, the ratio for mEPSCs was below 1 for more than 50% of the data, but for GluA2 receptors was close to 1.2 for 50% of the data. Only for culture #2 do the ratios appear to match. In the revised manuscript, the evidence that GluA2 receptors and mEPSCs are not changing in parallel will be based on the behavior of means or medians in untreated vs TTXtreated cultures, rather than ratio plots. It could be argued that we need a greater number of matched experiments to make conclusions, but the whole point of a matched experiment is that it should always show the same result—we are no longer dealing with the variability in the homeostatic plasticity itself. We will add a statement that the only three explanations left for the failure of mEPSC amplitudes and GluA2 receptors to change in parallel are 1) a true mismatch, 2) a sampling issue, or 3) technical artifacts that occur in one culture and not another.

      13) Figure 7A: TTX CDF was shifted to smaller mEPSC amplitude values in Rab3A-/- cultures. How can this be explained?

      Figure 7A depicts the pooled data that are shown separately for 3 cultures in Figure 8. We observed mEPSC amplitudes being smaller after TTX treatment in some range of the data for all three Rab3AKO cultures, suggesting that this may be a biological result rather than random variation around no change (which would be a ratio of 1). However, this effect is not significant at the level of means, nor in the KS test (which has the issue of inflated n in any case), so we did not highlight this point. This issue will be addressed by the removal of the CDF plots from the manuscript.

      Reviewer #2

      Technical concerns:

      1) The culture condition is questionable. The authors saw no NMDAR current present during spontaneous recordings, which is worrisome since NMDARs should be active in cultures with normal network activity (Watt et al., 2000; Sutton et al., 2006).

      The (Watt et al., 2000) study recorded mEPSCs in 0 Mg2+ (Figure 1). The (Sutton et al., 2006) study also shows an average mEPSC waveform (Figure 1D) that was recorded from in 0 Mg2+. Our extracellular recording solution contains Mg2+ (1.3 mM) so we likely are not observing NMDA-mediated currents because they are blocked with Mg2+ when strong depolarizations are prevented with TTX in the recording solution. We will add the idea that the NMDA currents are blocked by Mg2+ to Material and Methods.

      It is important to ensure there is enough spiking activity before doing any activity manipulation.

      We agree that it would be best if network spiking activity were monitored alongside mEPSC recordings, for example by culturing on multi-electrode arrays. Data from these measurements might explain culture to culture variability in homeostatic responses. To our knowledge, most other studies investigating homeostatic plasticity do not monitor network spiking activity in the same cultures that assay mEPSC amplitudes. This is something that the field should move towards. We will add the caveat that activity was not directly measured to the manuscript.

      Similarly, it is also unknown whether spiking activity is normal in Rab3A KO/Ebd neurons.

      Since we did not measure spiking activity, we cannot address whether the disruption in homeostatic plasticity in cultures prepared from Rab3A KO and Rab3AEbd/Ebd mutant mice is due to an alteration in network activity. If activity were already low in cultures prepared from these genetically altered mice, we would expect mEPSC amplitudes to be increased, compared to those measured in cultures from WT animals. That is not the case in cultures from Rab3A KO mice, so it is unlikely that network activity is reduced. However, mEPSC amplitudes are increased in Rab3AEbd/Ebd cultures, leaving open this possibility. It would have to be a defect unique to neurons in culture, since the Rab3AEbd/Ebd mouse appears normal in every way, suggesting action potential activity is occurring in the brains of these animals in vivo. We will add the possibility that activity is altered in the cultures from Rab3AKO and Rab3AEbd/Ebd to the manuscript.

      2) Selection of mEPSC events is not conducted in an unbiased manner. Manually selecting events is insufficient for cumulative distribution analysis, where small biases could skew the entire distribution. Since the authors claim their ratio plot is a better method to detect the uniformity of scaling than the well-established rank-order plot, it is important to use an unbiased population to substantiate this claim.

      MiniAnalysis (a standard program used for mEPSC event detection and analysis) selects many false positives with the automated feature (due to the very small sizes of events that are close to the noise level) so manual re-evaluation of the automated process is necessary to eliminate false positives. As soon as there is a manual step, bias is introduced. Interestingly, a manual reevaluation step was applied in a recent study that describes their process as ‘unbiased” (Wu et al., 2020). The alternative is to apply a very large threshold, reducing or eliminating false positives. However, this has the effect of biasing the data towards large events. In sum, we do not believe it is currently possible to perform a completely unbiased detection process. We feel that it is important to include as many small events as possible to reduce the problem of having events in the TTX experimental group that were not matched by events in the control experimental group, for the rank order and ratio plots, so setting the threshold low and manually detecting events accomplishes this. We will add to the Materials and Methods section that the person selecting events did not have information on whether the record was from an untreated or a TTX-treated cell at the time of selection. All of these issues, the potential for skewing the CDFs, and bias potentially interfering in the true rank order and ratio relationships, are addressed by removal of the CDFs, ratio and rank-order plots from the manuscript.

      3) Immunohistochemistry data analysis is problematic. The authors only labeled dendrites without doing cell-fills to look at morphology, so it is questionable how they differentiate branches from pyramidal neurons and interneurons. Since glutamatergic synapses on these two types of neuron scale in the opposite directions, it is crucial to show that only pyramidal neurons are included for analysis.

      MAP2, in addition to labeling dendrites, also labels the cell body, and we used the cell structure revealed by MAP2 staining to select pyramidal-shaped neurons. The selection of the primary dendrite of a pyramidal neuron was stated in lines 239-240 in Materials and Methods and lines 1094 in the figure legend, but we had not explicitly stated how we knew it was a pyramidal neuron. We will include a low power picture of each of the selected pyramidal neurons in the revision.

      Conceptual concerns:

      The only novel finding here is the implicated role for Rab3A in synaptic scaling, but insights into mechanisms behind this observation are lacking. The author claims that Rab3A likely regulates scaling from the presynaptic side, yet there is no direct evidence from data presented. In its current form, this study's contribution to the field is very limited.

      We acknowledge that a presynaptic mechanism is involved in the regulation of homeostatic plasticity by Rab3A is not supported by direct evidence in cortical cultures in this study. But we disagree that the study’s contribution is very limited.

      The revised manuscript will emphasize that there are only two possible mechanisms by which Rab3A is acting in homeostatic plasticity. Either this presynaptic vesicle protein is regulating postsynaptic receptors (an extremely surprising result for which we do have direct evidence), or, it is regulating quantal size from both sides of the synapse (supported by direct evidence from our previous study at the mouse neuromuscular junction in vivo, where receptors are not being upregulated during homeostatic plasticity, and, by indirect evidence in the current study, that receptors and mEPSCs are not being identically regulated in the same cultures). Furthermore, the first idea that follows from the effect of Rab3A on receptors is that it would be regulating release of factors from astrocytes, since this is a mechanism that has been shown to be involved in homeostatic plasticity, and we clearly disprove this hypothesis.

      1) Their major argument for this is that homeostatic effects on mEPSC amplitudes and GluA2 cluster sizes do not match. This is inconsistent with reports from multiple labs showing that upscaling of mEPSC amplitude and GluA2 accumulation occur side by side during scaling (Ibata et al., 2008; Pozo et al., 2012; Tan et al., 2015; Silva et al., 2019).

      We agree with the reviewer that many studies show an increase in receptors and mEPSC amplitudes after activity blockade. This is why we were very surprised in our initial experiments to find that there was not a consistent robust increase in receptors in our cultures. At that point we were only imaging, and we assumed that it was homeostatic plasticity that was not always robust. We decided it was essential to measure mEPSC amplitudes and image receptors in the same cultures. We expected to observe larger and smaller effects on mEPSC amplitudes from culture to culture that were paralleled by larger and smaller effects on receptors, but this is not what happened. We have gone back to the literature to look more closely at whether variability across cultures has ever been shown for mEPSC amplitudes, receptors, or both. In a survey of 14 studies, none report results culture by culture. To our knowledge, we are the first to report this variability in the receptor response, and the lack of correlation between mEPSC amplitudes and receptor responses, in the same cultures. That said, for the 4 examples provided by the reviewer, only 1 reports evidence relevant to our study that receptors and mEPSC amplitudes ‘occur side by side,’ which is the (Ibata et al., 2008) study. Here, 24 hr of TTX treatment of rat cortical cultures causes synaptically localized GluA2 receptors in confocal imaging, and mEPSC amplitudes, to both increase to around 130%. The (Pozo et al., 2012) study is not a study of activity blockade but of the effects of overexpressing beta-integrins in rat hippocampal cultures, and this causes both GluA2 receptors and mEPSC amplitudes to increase, but the GluA2 level is not restricted to synaptic sites, and, is expressed as the surface fraction (surface receptor/total receptor—total receptor being surface intensity plus internalized intensity) which increases from 0.5 to 0.55, or to 110%, while mEPSC amplitude increases to ~180%. The (Tan et al., 2015) study only provides Western blot data to show an increase of receptors to 125% in mouse cortical cultures in response to 48 hr TTX, with mEPSC amplitudes increased to ~140%, but the Western blot technique measures synaptic and nonsynaptic receptors on excitatory and inhibitory neurons, as well as receptors on astrocytes. Finally, in (Silva et al., 2019), the culture conditions for the imaging data and the mEPSC amplitude data are markedly different, with ‘low-density’ Banker cultures being used for the former, and ‘high-density’ cultures used for the latter, and the protocol to induce activity blockade is different from ours (noncompetitive AMPA and NMDA blockers); synaptic GluA2 receptors are increased to ~280% and mEPSC amplitudes to ~170%. In the revision we will carefully summarize the previous evidence for receptors and mEPSC amplitude responses to activity blockade. Since it is known that different protocols trigger different molecular mechanisms, for example, TTX + APV triggers a homeostatic plasticity that can be completely reversed by acute application of blockers of Ca-permeable receptors, whereas TTX alone triggers a plasticity that is insensitive to these blockers (Sutton et al., 2006), Figure 4E; (Soden and Chen, 2010); Figure 4A), we will keep our discussion restricted to studies using TTX alone for at least 24 hr. We will acknowledge that our finding that GluA2 receptors and mEPSC amplitudes are not varying in lockstep from culture to culture suggests there is another contributor to mEPSC amplitude, but that we cannot rule out it is due to a greater variability in signal, or more issues with signal over noise, in imaging experiments compared to electrophysiology experiments.

      Studies surveyed about reporting results by culture:

      (Ju et al., 2004; Stellwagen et al., 2005; Shepherd et al., 2006; Sutton et al., 2006; Cingolani and Goda, 2008; Hou et al., 2008; Ibata et al., 2008; Chang et al., 2010; Hu et al., 2010; Jakawich et al., 2010; Beique et al., 2011; Tatavarty et al., 2013; Diering et al., 2014; Sanderson et al., 2018)

      Further, because the acquisition and quantification methods for mEPSC recordings and immunohistochemistry imaging are entirely different (each with its own limitations in signal detection), it is not convincing that the lack of proportional changes must signify a presynaptic component.

      We agree with the reviewer that there is no way to compare absolute levels from one type of experimental technique to another, but whatever differences in technical issues there are for the two techniques, they should cause systemic errors and should not contribute to the differences between experiments. Most of the issues with imaging come down to variability in the intensity of fluorescence from experiment to experiment, since the antibody solutions are made anew each time, as is the fixation solution. In addition, the confocal microscope function can vary over time and give brighter or dimmer images. But those kinds of artifacts are addressed by using the same solutions on control and TTX-treated coverslips, and imaging control and TTX-treated coverslips in the same single 2-3 hour imaging session, so that whatever issues there are, they cannot contribute to the TTX effect itself. Therefore when we compare the TTX effect (TTX measurements compared to untreated measurements) from culture to culture and find that in one WT culture there was no increase in receptors but there was in mEPSC amplitude, it is difficult to explain how a limitation specific to the antibody imaging technique could produce such a result. Similarly, when we get the opposite result, that in one KO culture, receptors increased but mEPSC amplitudes did not, it is unclear how limitations in signal detection would produce such a result in one culture but not another. The one exception to this is that the primary GluA2 antibody has to be added individually to each coverslip before returning the dishes to the incubator in order to avoid the disruption to live cells that a complete removal of media would have had. The only remaining ‘artifact’ that could explain the results would be a greater variability in the imaging experiments due to limitations in the signal or the signal to noise ratio. In the revision we will report additional characteristics of imaging experiments, such as average intensity for each coverslip, and for each experiment, to address whether variability in fluorescence levels could explain the variability in TTX effects we observe. We will include the possibility that the mismatches in GluA2 receptors and mEPSCs could be caused by greater variability in the imaging experiments.

      2) The authors also speculate in the discussion that presynaptic Rab3A could be interacting with retrograde BDNF signaling to regulate postsynaptic AMPARs. Without data showing Rab3A-dependent presynaptic changes after TTX treatment, this argument is not compelling. In this retrograde pathway, BDNF is synthesized in and released from dendrites (Jakawich et al., 2010; Thapliyal et al., 2022), and it is entirely possible for postsynaptic Rab3A to interfere with this process cell-autonomously.

      In the revision, the model will focus on the direct findings of the manuscript and tone down the speculation about BDNF signaling, but in the Discussion we will add the possibility that a Rab3A-BDNF interaction could occur either presynaptically or postsynaptically. Interestingly, these articles suggest the postsynaptic BDNF is affecting presynaptic function, namely mEPSC frequency. It is conceivable it could presynaptically affect the vesicle’s release of transmitter.

      3) The authors propose that a change in AMPAR subunit composition from GluA2-containing ones to GluA1 homomers may account for the distinct changes in mEPSC amplitudes and GluA2 clusters. However, their data from the Naspm wash-in experiments clearly show that GluA1 homomer contributions have not changed before and after TTX treatment.

      Our apologies to the reviewer that we were not clear on this point. In lines 396 to 400 we were describing the significant effects that NASPM had on mEPSC frequency on both untreated and TTX-treated cells, despite having only modest, and not quite significant effects on mEPSC amplitude. We conclude from these results that there are synaptic sites that have only GluA1 homomers, and the mEPSCs from these sites are blocked 100% by NASPM. There may be an increase in such GluA1-only synapses after activity blockade, but nevertheless, these events do not contribute to the amplitude increase. So we did not mean to suggest that there is a shift from Glua2 containing to GluA1 containing receptors that leads to the amplitude increase and fully agree with the reviewer that the GluA1 homomer contributions to amplitude have not changed before and after TTX. We will clarify the difference between the contribution of GluA1 homomers to amplitude and frequency in the revised manuscript.

      Reviewer #3

      Summary: The authors clearly demonstrate the Rab3A plays a role in HSP at excitatory synapses, with substantially less plasticity occurring in the Rab3A KO neurons. There is also no apparent HSP in the Earlybird Rab3A mutation, although baseline synaptic strength seems already elevated. In this context, it is unclear if the plasticity is absent or just occluded by a ceiling effect due the synapses already being strengthened. The authors do appropriately discuss both options. There are also differences in genetic background between the Rab3A KO and Earlybird mutants that could also impact the results, which are also noted. The authors have solid data showing that Rab3A is unlikely to be active in astrocytes, Finally, they attempt to study the linkage between synaptic strength during HSP and AMPA receptor trafficking, and conclude that trafficking is largely not responsible for the changes in synaptic strength.

      Strengths: This work adds another player into the mechanisms underlying an important form of synaptic plasticity. The plasticity is only reduced, suggesting Rab3A is only partially required and perhaps multiple mechanisms contribute. The authors speculate about some possible novel mechanisms.

      Weaknesses: However, the rather strong conclusions on the dissociation of AMPAR trafficking and synaptic response are made from somewhat weaker data. The key issue is the GluA2 immunostaining in comparison with the mESPC recordings. Their imaging method involves only assessing puncta clearly associated with a MAP2 labeled dendrite. This is a small subset of synapses, judging from the sample micrographs (Fig 5). To my knowledge, this is a new and unvalidated approach that could represent a particular subset of synapses not representative of the synapses contributing to the mEPSC change. (they are also sampling different neurons for the two measurements; an additional unknown detail is how far from the cell body were the analyzed dendrites for immunostaining. While the authors acknowledge that a sampling issue could explain the data, they still use this data to draw strong conclusions about the lack of AMPAR trafficking contribution to the mEPSC amplitude change. This apparent difference may be a methodological issue rather than a biological one, and at this point it is impossible to differentiate these. It will unfortunately be difficult to validate their approach. Perhaps if they were to drive NMDA-dependent LTD or chemLTP, and show alignment of the imaging and ephys, that would help. More helpful would be recordings and imaging from the same neurons but this is challenging. Sampling from identified synapses would of course be ideal, perhaps from 2P uncaging combined with SEP-labeled AMPARs, but this is more challenging still. But without data to validate the method, it seems unwarranted to make such strong conclusions such as that AMPAR trafficking does not underlie the increase in mEPSC amplitude, given the previous data supporting such a model.

      We chose the primary dendrite to ensure we were not assaying dendrites from inhibitory neurons or on axons, but we will add in the revision that it is a limitation of our methods that we are not sampling all the synapses for each neuron. The majority of previous studies that establish that receptors are increased side by side with mEPSCs did not measure receptors and mEPSCs in the same cells, nor even in the same cultures. There is a recent study which employs dual recordings, transfection of GluA2 and VGlut1 constructs, and infusion of dyes to highlight cell morphology (Letellier et al., 2019), so in principle an experiment could be done in which synaptic GluA2 sites are imaged in a cell in which the mEPSCs are also measured. It would be difficult to make these measurements in the same cells before and after TTX treatment, since there is a high likelihood of damaging the cell upon electrode withdrawal and with the imaging process itself. In theory, only a few such experiments would be necessary to establish whether receptors and mEPSC amplitudes are varying in lockstep, and we will consider this for a future study. As stated in response to conceptual concern #1 in Reviewer 2’s comments, we will review the literature on previous studies’ demonstrations of increases in receptors and mEPSC amplitudes following activity blockade in more detail, including how the synaptic sites to be imaged were chosen, to address whether our selection of sites touching the primary dendrite is unvalidated.

      A sample from 3 articles:

      (Ibata et al., 2008), only information is that ‘distal dendrites’ were examined. The authors do not use a dendritic label. (Jakawich et al., 2010), ‘neurons with pyramidal-like morphology were selected for imaging,’ and ‘principal dendrite of each neuron was linearized’—but how these were identified is not clear, since MAP2 or other cellular labels are not described.

      (Silva et al., 2019), ‘dendrites with similar thickness and appearance were randomly selected using MAP2 staining,’ which suggests synaptic sites with GluA2 and VGLUT1 were selected on the basis of being close to or touching the MAP2 positive dendrite, although this is not stated explicitly.

      We can perform length measurements on the dendrites imaged and report this information in the revision, but the primary dendrite is the closest dendrite to the cell body.

      We have addressed the potential contribution of technical artifacts arising from the two distinct methods of measurement, imaging and electrophysiology, in our response to conceptual concern #1 of Reviewer 2.

      Other questions arise from the NASPM experiments, used to justify looking at GluA2 (and not GluA1) in the immunostaining. First, there is a frequency effect that is quite unclear in origin. One would expect NASPM to merely block some fraction of the post-synaptic current, and not affect pre-synaptic release or block whole synapses. It is also unclear why the authors argue this proves that the NASPM was at an effective concentration (lines 399-400).

      We observed a clear effect of NASPM reducing mEPSC frequency. We will state more clearly that we infer from the loss of mEPSCs after NASPM that such mEPSCs were from synaptic sites that had only GluA1 homomers, and acknowledge that this is an interpretation. We will also clarify that if our inference is correct, it would indicate that the dose of NASPM we used was 100% effective at blocking GluA1 homomers. The alternative explanation would be a presynaptic effect of NASPM, which has never been reported, to our knowledge.

      Further, the amplitude data show a strong trend towards smaller amplitude. The p value for both control and TTX neurons was 0.08 - it is very difficult to argue that there is no effect. And the decrease is larger in the TTX neurons. Considering the strong claims for a pre-synaptic and the use of this data to justify only looking at GluA2 by immunostaining, these data do not offer much support of the conclusions. Between the sampling issues and perhaps looking at the wrong GluA subunit, it seems premature to argue that trafficking is not a contributor to the mEPSC amplitude change, especially given the substantial support for that hypothesis. Further, even if trafficking is not the major contributor, there could be shifts in conductance (perhaps due to regulation of auxiliary subunits) that does not necessitate a pre-synaptic locus. While the authors are free to hypothesize such a mechanism, it would be prudent to acknowledge other options and explanations.

      We did not mean to suggest that there is no effect of NASPM on mEPSC amplitude. We will clarify that our data indicate that there is no effect of NASPM on the TTX effect on mEPSC amplitude. We agree with the reviewer that the effect of NASPM on frequency is of larger magnitude after TTX treatment, although the p value is larger than that for untreated cells, likely due to greater variability. We interpret this to mean that TTX treatment increases the proportion of synapses that have only GluA1 homomers. Nevertheless, the increase in GluA1 homomer sites does not appear to contribute to the overall increase in amplitude following TTX treatment, and we wanted to find the mechanism of the amplitude increase. That is why we focused on GluA2 receptors. We will acknowledge the limitation of basing our conclusions on only GluA2 receptors in the revision, as well as the possibility that there is a change in conductance. As stated in our response to Reviewer 2, we do not mean to state that GluA2 receptors do not go up after activity blockade, we find that this is the case. We are proposing an additional mechanism contributing to mEPSC amplitude to explain the different responses for GluA2 receptors vs. mEPSC amplitudes in some of the 6 matched experiments (3 WT and 3 KO).

      The frequency data are missing from the paper, with the exception of the NASPM dataset. The mEPSC frequencies should be reported for all experiments, particularly given that Rab3A is generally viewed as a pre-synaptic protein regulating release. Also, in the NASPM experiments, the average frequency is much higher in the TTX treated cultures. Is this statistically above control values?

      We will report frequency measurements for all experiments shown. Following TTX treatment, frequency variability increases enormously, with cells having as high as > 10 mEPSCs per second, and other TTX-treated cells with frequencies as low as < 1 mEPSC per second, so the TTX effect on frequency, and whether this effect is present or not in Rab3A KO and Rab3AEbd/Ebd is not completely clear, which is why we did not include those results previously.

      Unaddressed issues that would greatly increase the impact of the paper:

      1) Is Rab3A acting pre-synaptically, post-synaptically or both? The authors provide good evidence that Rab3A is acting within neurons and not astrocytes. But where it is acting (pre or post) would aid substantially in understanding its role (and particularly the hypothesized and somewhat novel idea that the amount of glutamate released per vesicle is altered in HSP). They could use sparse knock-down of Rab3A, or simply mix cultures from KO and WT mice (with appropriate tags/labels). The general view in the field has been that HSP is regulated post-synaptically via regulation of AMPAR trafficking, and considerable evidence supports this view. The more support for their suggestion of a pre-synaptic site of control, the better.

      We agree with the reviewer that this is the most important question to answer next. The approach suggested by the reviewer would be to record from Rab3A KO neurons in a culture where the majority of its inputs are Rab3A positive. If the TTX effect is absent from these cells, it would strongly indicate that postsynaptic Rab3A is required for homeostatic plasticity. There are not currently transgenic mice expressing GFP forms of Rab3A, so we would have to create one, or, transiently transfect Rab3A-GFP into Rab3AKO neurons. Given that under our experimental conditions, we require a very high density of neurons to observe the increase in mEPSC amplitude, it would be difficult to get the ratio of Rab3A-expressing neurons high enough using transfection to be sure that a given postsynaptic cell lacking Rab3A had a normal number of Rab3A-positive inputs and almost no Rab3A-negative inputs. It may be that the opposite experiment is more doable—an isolated Rab3A-positive neuron in a sea of Rab3A-negative neurons, which could be accomplished with a very low transfection efficiency. Another approach would be to use the fast off rate antagonist gamma-DGG, which is more effective against low glutamate concentrations than high glutamate concentrations (see (Liu et al., 1999; Wu et al., 2007). If gamma-DGG were less effective at reducing mEPSC amplitude in TTX-treated cells, compared to untreated cells, it would support the hypothesis that activity blockade leads to an increase in the amount of transmitter per vesicle fusion event. Further, if the change in gamma-DGG sensitivity after activity blockade were disrupted in cultures from Rab3A KO cells, it would support a presynaptic role for Rab3A in homeostatic plasticity of mEPSC amplitude. We have begun these experiments but are finding the surprising result that within a single recording, small mEPSCs and large mEPSCs appear to be differentially sensitive to gamma-DGG. To confirm that this is a biological characteristic, rather than an issue with the detection threshold, we will be repeating our experiments with a slow off rate antagonist that has same effect regardless of transmitter concentration. The complexity of these results precludes including them in the current manuscript.

      2) Rab3A is also found at inhibitory synapses. It would be very informative to know if HSP at inhibitory synapses is similarly affected. This is particularly relevant as at inhibitory synapses, one expects a removal of GABARs and/or a decrease of GABA-packaging in vesicles (ie the opposite of whatever is happening at excitatory synapses). If both processes are regulated by Rab3A, this might suggest a role for this protein more upstream in the signaling; an effect only at excitatory synapses would argue for a more specific role just at these synapses.

      The next question, after it is determined where Rab3A is acting, is whether it is required for other forms of homeostatic plasticity. This includes plasticity of GABA mIPSCs on pyramidal neurons, but also mEPSCs on inhibitory neurons, and, the downscaling of mEPSCs (and upscaling of mIPSCs) when activity is increased, by bicuculline for example. We will add a statement about future experiments examining other forms of plasticity to the discussion, and include examples where a molecular mechanism has mediated multiple forms, and those that have been shown to be very specific.

      Beique JC, Na Y, Kuhl D, Worley PF, Huganir RL (2011) Arc-dependent synapse-specific homeostatic plasticity. Proc Natl Acad Sci U S A 108:816-821.

      Chang MC, Park JM, Pelkey KA, Grabenstatter HL, Xu D, Linden DJ, Sutula TP, McBain CJ, Worley PF (2010) Narp regulates homeostatic scaling of excitatory synapses on parvalbumin-expressing interneurons. Nat Neurosci 13:1090-1097.

      Cingolani LA, Goda Y (2008) Differential involvement of beta3 integrin in pre- and postsynaptic forms of adaptation to chronic activity deprivation. Neuron Glia Biol 4:179-187.

      Diering GH, Gustina AS, Huganir RL (2014) PKA-GluA1 coupling via AKAP5 controls AMPA receptor phosphorylation and cell-surface targeting during bidirectional homeostatic plasticity. Neuron 84:790-805.

      Hanes AL, Koesters AG, Fong MF, Altimimi HF, Stellwagen D, Wenner P, Engisch KL (2020) Divergent Synaptic Scaling of Miniature EPSCs following Activity Blockade in Dissociated Neuronal Cultures. J Neurosci 40:4090-4102.

      Hou Q, Zhang D, Jarzylo L, Huganir RL, Man HY (2008) Homeostatic regulation of AMPA receptor expression at single hippocampal synapses. Proc Natl Acad Sci U S A 105:775-780.

      Hu JH, Park JM, Park S, Xiao B, Dehoff MH, Kim S, Hayashi T, Schwarz MK, Huganir RL, Seeburg PH, Linden DJ, Worley PF (2010) Homeostatic scaling requires group I mGluR activation mediated by Homer1a. Neuron 68:1128-1142.

      Ibata K, Sun Q, Turrigiano GG (2008) Rapid synaptic scaling induced by changes in postsynaptic firing. Neuron 57:819826.

      Jakawich SK, Nasser HB, Strong MJ, McCartney AJ, Perez AS, Rakesh N, Carruthers CJ, Sutton MA (2010) Local presynaptic activity gates homeostatic changes in presynaptic function driven by dendritic BDNF synthesis. Neuron 68:1143-1158.

      Ju W, Morishita W, Tsui J, Gaietta G, Deerinck TJ, Adams SR, Garner CC, Tsien RY, Ellisman MH, Malenka RC (2004) Activity-dependent regulation of dendritic synthesis and trafficking of AMPA receptors. Nat Neurosci 7:244-253.

      Lazic SE, Clarke-Williams CJ, Munafo MR (2018) What exactly is 'N' in cell culture and animal experiments? PLoS Biol 16:e2005282.

      Liu G, Choi S, Tsien RW (1999) Variability of neurotransmitter concentration and nonsaturation of postsynaptic AMPA receptors at synapses in hippocampal cultures and slices. Neuron 22:395-409.

      Pozo K, Cingolani LA, Bassani S, Laurent F, Passafaro M, Goda Y (2012) beta3 integrin interacts directly with GluA2 AMPA receptor subunit and regulates AMPA receptor expression in hippocampal neurons. Proc Natl Acad Sci U S A 109:1323-1328.

      Sanderson JL, Scott JD, Dell'Acqua ML (2018) Control of Homeostatic Synaptic Plasticity by AKAP-Anchored Kinase and Phosphatase Regulation of Ca(2+)-Permeable AMPA Receptors. J Neurosci 38:2863-2876.

      Shepherd JD, Rumbaugh G, Wu J, Chowdhury S, Plath N, Kuhl D, Huganir RL, Worley PF (2006) Arc/Arg3.1 mediates homeostatic synaptic scaling of AMPA receptors. Neuron 52:475-484.

      Silva MM, Rodrigues B, Fernandes J, Santos SD, Carreto L, Santos MAS, Pinheiro P, Carvalho AL (2019) MicroRNA186-5p controls GluA2 surface expression and synaptic scaling in hippocampal neurons. Proc Natl Acad Sci U S A 116:5727-5736.

      Soden ME, Chen L (2010) Fragile X protein FMRP is required for homeostatic plasticity and regulation of synaptic strength by retinoic acid. J Neurosci 30:16910-16921. Stellwagen D, Beattie EC, Seo JY, Malenka RC (2005) Differential regulation of AMPA receptor and GABA receptor trafficking by tumor necrosis factor-alpha. J Neurosci 25:3219-3228.

      Sutton MA, Ito HT, Cressy P, Kempf C, Woo JC, Schuman EM (2006) Miniature neurotransmission stabilizes synaptic function via tonic suppression of local dendritic protein synthesis. Cell 125:785-799.

      Tan HL, Queenan BN, Huganir RL (2015) GRIP1 is required for homeostatic regulation of AMPAR trafficking. Proc Natl Acad Sci U S A 112:10026-10031.

      Tatavarty V, Sun Q, Turrigiano GG (2013) How to scale down postsynaptic strength. J Neurosci 33:13179-13189.

      Turrigiano GG, Leslie KR, Desai NS, Rutherford LC, Nelson SB (1998) Activity-dependent scaling of quantal amplitude in neocortical neurons. Nature 391:892-896.

      Wang X, Wang Q, Yang S, Bucan M, Rich MM, Engisch KL (2011) Impaired activity-dependent plasticity of quantal amplitude at the neuromuscular junction of Rab3A deletion and Rab3A earlybird mutant mice. J Neurosci 31:3580-3588.

      Watt AJ, van Rossum MC, MacLeod KM, Nelson SB, Turrigiano GG (2000) Activity coregulates quantal AMPA and NMDA currents at neocortical synapses. Neuron 26:659-670.

      Wu XS, Xue L, Mohan R, Paradiso K, Gillis KD, Wu LG (2007) The origin of quantal size variation: vesicular glutamate concentration plays a significant role. J Neurosci 27:3046-3056.

      Wu YK, Hengen KB, Turrigiano GG, Gjorgjieva J (2020) Homeostatic mechanisms regulate distinct aspects of cortical circuit dynamics. Proc Natl Acad Sci U S A 117:24514-24525.

    1. Reviewer #3 (Public Review):

      The authors evaluate the effect of high-resolution 2D template matching on template bias in reconstructions, and provide a quantitative metric for overfitting. It is an interesting manuscript that made me reevaluate and correct some mistakes in my understanding of overfitting and template bias, and I'm sure it will be of great use to others in the field. However, its main point is to promote high-resolution 2D template matching (2DTM) as a more universal analysis method for in vitro and, more importantly, in situ data. While the experiments performed to that end are sound and well-executed in principle, I fail to make that specific conclusion from their results.

      The authors correctly point out that overfitting is largely enabled by the presence of false-positives in the data set. They go on to perform their in situ experiments with ribosomes, which provide an extremely favorable amount of signal that is unrealistic for the vast majority of the proteome. This seems cherry-picked to keep the number of false-positives and false-negatives low. The relationship between overfitting/false-positive rate and the picking threshold will remain the same for smaller proteins (which is a very useful piece of knowledge from this study). However, the false-negative rate will increase a lot compared to ribosomes if the same high picking threshold is maintained. This will limit the applicability of 2DTM, especially for less-abundant proteins.

      I would like to see an ablation study: Take significantly smaller segments of the ribosome (for which the authors already have particle positions from full-template matching, which are reasonably close to the ground-truth), e.g. 50 kDa, 100 kDa, 200 kDa etc., and calculate the false-negative rate for the same picking threshold. If the resulting number of particles does plummet, it would be very helpful to discuss how that affects the utility of 2DTM for non-ribosomes in situ.

      Another point of concern is the dramatic resolution decrease to 8 A after multiple iterations of refinement against experimental reconstructions described in line 159. Was this a local search from the poses provided by 2DTM, or something more global? While this is not a manifestation of overfitting as the authors have conclusively shown, I think it adds an important point to the ongoing "But do we really need tomograms, or can we just 2D everything?" debate in the field, which is also central to the 2D part of 2DTM. Reaching 8 A with 12k ribosome particles would be considered a rather poor subtomogram averaging result these days. Being in the "we need tilt series to be less affected by non-Gaussian noise" camp myself, I wonder if this indicates 2D images are inherently worse for in situ samples. If they are, the same limitations would extend to template matching. In that case, shouldn't the authors advocate for 3DTM instead of 2DTM? It may not be needed for ribosomes, but could give smaller proteins the necessary edge.

      Right now, this study is also an invitation to practitioners who do not understand the picking threshold used here and cannot relate it to other template-matching programs to do a lot of questionable template matching and claim that the results are true because templates are "unoverfittable". I think such undesirable consequences should be discussed prominently.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      I - General criticisms

      Reviewer #1: My main criticism is unfortunately inherent to the approach: comparative studies are absolutely critical, but they can only provide a very sparse sampling of diversity. Fortunately, thanks to high-throughput sequencing, bioinformatic analyses can now be performed on a large number of species, but experimental validation is typically restricted to two or three species. The consequence of this for the present manuscript is that while the functional conservation of the Gwl site is convincingly shown, the exact mechanisms responsible for the reduced effect of PKA phosphorylation remain relatively vaguely defined. Indeed, in their Discussion the authors list a number of experimental approaches to address this - but I understand that these would all involve substantial efforts to address. In particular, testing chimeric constructs around the consensus PKA site and from multiple species could be very informative.

      We completely agree with the reviewer that comparative approaches are critical to understanding biological mechanisms, and are excited by the increasing possibilities to perform not only sequence and descriptive comparisons but functional studies across a range of emerging model organisms. We hope that more and more researchers in cell and molecular biology will profit from experimental tools and techniques now available in such species, and to pioneer new ones. Of course, and he/she rightly points out, conclusions are currently limited by the number of species studied, but comparisons between two judiciously chosen species can already be very informative. Thus, in our study, the use of Xenopus and Clytia allowed us to make significant progress towards our main objective of understanding the cAMP-PKA paradox in the control of oocyte maturation; specifically by showing both that PKA phosphorylation of Clytia ARPP19 is lower in efficiency and that the phosphorylated protein has a lower effect on oocyte maturation than the Xenopus protein. As the reviewer points out, unravelling the exact mechanisms underlying these differences will require a large amount of additional work and is beyond the scope of the current study. Actually, we have embarked on several series of experiments to this end using some of the approaches listed in the Discussion. Specifically, we are testing the biochemical and functional properties of chimeric constructs containing the consensus PKA site from various species. This is a substantial undertaking which will require one to two years to complete, but is already giving some very interesting findings.

      Reviewer #1: The figures and text could be slightly condensed down to about 6 figures.

      We have reduced the number of figure panels but we prefer to maintain the number of figures, because the experimental data presented in them is essential to the interpretation of our results and the overall conclusions of the article. If the journal editor would like us to reduce the number of figures, we could do this by displacing Figure 4 and some panels of other figures (to then fuse some of them) to supplementary material, but this would be a pity.

      ____________II - Abstract

      As recommended by Reviewer #2, we have reworked the Abstract to make it more accessible to new readers, attempting to bring out more clearly and simply the main results and conclusions of the study. We correspondingly simplified and shortened the title of the article. Changes: Page 2.

      ____________III- Introduction points

      Reviewer #2: I believe that it would be interesting to include some time-references when introducing the prophase arrest of Clytia and Xenopus oocytes. How long is prophase arrest in Xenopus compared to Clytia or other organisms? How can this affect the prophase arrest mechanisms? It seems that the prophase arrest in Xenopus oocytes is found to be significantly more prolonged compared to Clytia and various other organisms, and also meiotic maturation proceeds much more rapidly in Clytia than in Xenopus. This should be indicated in the introduction with a short introduction of why, and not others, were these species chosen for this study.

      Differences in timing of oocyte prophase arrest and in maturation kinetics across animals are indeed highly relevant in relation to the underlying biochemical mechanisms. Unfortunately, not enough information is currently available concerning the duration of the successive phases of oocyte prophase arrest across species to make any meaningful correlations with PKA regulation of maturation initiation. We have nevertheless expanded the Introduction to cover this issue as follows:

      • We start the introduction by mentioning how the length of the prophase arrest varies across species. Changes: Page 3, lines 5-11.
      • We have added examples of species which likely have similar durations of prophase arrest but show cAMP-stimulated vs cAMP-inhibited release. Changes: Page 4, lines 28-35.
      • We have specified the temporal differences in meiotic maturation in Xenopus (3-7 hrs) and Clytia (10-15 min). Changes: Page 5, lines 32-33.

      Reviewer #2: why, and not others, were these species [Xenopus, Clytia] chosen for this study. A brief justification is included in lines 1-page 5 "..a laboratory model hydrozoan species well suited to oogenesis studies", but it does not explain why this and not other hydrozoan species like Hydra, that has also been used for meiosis studies.

      As requested by Reviewer #2, fuller details are now included about the advantages of Clytia compared to other hydrozoan species, citing several articles and recent reviews here and also in the Discussion. Changes: Page 5, lines 21-32 & 37-39.

      Hydra is a classic cnidarian experimental species and has proved an extremely useful model for regeneration and body patterning, but is not suitable for experimental studies on oocyte maturation because spawning is hard to control and fully-grown oocytes cannot easily be obtained, manipulated or observed. In contrast many hydromedusae (including Clytia, Cytaeis, and Cladonema) have daily dark/light induced spawning and accessible gonads, so provide great material for studying oogenesis and maturation. Of these, Clytia has currently by far the most advanced molecular and experimental tools.

      Reviewer #2: The proteins MAPK is not introduced properly, as it is first mentioned in the results section in line 12. Given the importance of the results provided with it, it should be presented in the introduction prior to the results section.

      As requested by Reviewer #2, the involvement of MAPK activation during Xenopus oocyte meiotic maturation is now introduced, explaining how its phosphorylation serves as a marker of Cdk1 activation. Changes: Page 5, lines 1-5.

      Reviewer #2: These sentences need a more elaborate explanation: Page 4 Lines 16-17 "... no role for cAMP has been detected in meiotic resumption, which is mediated by distinct signaling pathways" Which pathways?

      We now give the example of the well-characterized pathway Gbg-PI3K pathway for oocyte maturation initiation in the starfish. Changes: Page 4, lines 1-15.

      Reviewer #2: Page 4 line 34-39. Introduction indicates that the phosphorylation of ARPP19 on S67 by Gwl is a poorly understood molecular signaling cascade (line 34). However, the positive role of ARPP19 on Cdk1 activation, through the S67 phosphorylation by Gwl, appears to be widespread across all eukaryotic mitotic and meiotic divisions studied (lines 36-37). These two sentences seem a little contradictory. If the general pathway has been identified but the signaling cascade is still not well described, please indicate that in a clearer way.

      We apologise that the wording we used was not clear and implied that the mechanisms of PP2A inhibition by Gwl-phosphorylated ARPP19 were poorly understood. On the contrary, they are very well studied. The part that remains mysterious concerns the upstream mechanisms. We have reworded the paragraph to make this point unambiguous. Changes: Page 5, lines 1-8.

      ____________IV - Results

      Reviewer #2: The text of the results is generally well described; however, all the sections start with a long introductory paragraph. I believe this facilitates the contextualization of the experiments, but please try to summarize when possible. For example, in page 5 lines 12-25, or page 7 lines 30-37, are all introduction information.

      As requested by Reviewer #2, we have shortened or removed the introductory passages of the Results section paragraphs, which were redundant with the information given in the introduction. We did not restrict to the two examples cited by the reviewer, but have shortened all the Results passages that repeat information already provided in the Introduction. Changes: Page 7, lines 3-4 & 14-16 & 36-37 - Page 8, lines 12-15 - Page 8, lines 37-40 & Page 9, lines 1-6.

      Reviewer #2: Page 7, Lines 14-19 present a general conclusion of the findings explained in lines 20-27. I think these results are important and they should be explained better, in my opinion they are slightly poorly described.

      We have followed the reviewer's recommendation. The explanation of the experiments and the results are more detailed and the paragraph ends with a general conclusion which came too early in the previous version. Changes: Page 8, lines 22-24 & 32-34.

      Reviewer #2: Page 8, lines 16-17: "It was not possible to increase injection volumes or protein concentrations without inducing high levels of non-specific toxicity". What are the non-specific toxicity effects? How was this addressed? What fundaments this conclusion?

      Clytia oocytes are relatively fragile. Sensitivity of oocytes to injection varies between batches, while in general increasing injection volumes or protein concentrations increases the levels of lysis observed. We do not know exactly what causes this but lysis can happen either immediately following injection or during the natural exaggerated cortical contraction waves that accompany meiotic maturation, suggesting that it relates to mechanical trauma. We have expanded this paragraph and the legend of Fig. 3C to explain these injection experiments more fully in the text and to clarify these issues. Changes: Page 9, lines 16-29 - Page 32, lines 34-41 & Page 33, lines 1-11 - Supplementary Table 1.

      Same paragraph: Lines 25-27 of page 8. Text reads, "These results suggest that PP2A inhibition is not sufficient to induce oocyte maturation in Clytia, although we cannot rule out that the quantity of OA or Gwl thiophosphorylated ARPP proteins delivered was insufficient to trigger GVBD.". Please provide evidence if higher concentrations of OA or Gwl were tested to state this conclusion.

      As explained above, we could not increase the concentrations of ARPP19 protein beyond 4mg/ml. It is important to note that at the same concentration, both Clytia and Xenopus proteins induce activation of Cdk1 and GVBD in the Xenopus oocyte.

      Concerning OA, it is well documented in many systems including Xenopus, starfish and mouse oocytes as well as mammalian cell cultures, that high concentrations lead to cell lysis/apoptosis as a result of a massive deregulation of protein phosphorylation (Goris et al, 1989; Rime & Ozon, 1990; Alexandre et al, 1991; Boe et al, 1991; Gehringer, 2004; Maton el al, 2005; Kleppe et al, 2015). Specific tests in Xenopus oocytes, have shown that injecting 50 nl of 1 or 2 mM OA specifically inhibits PP2A, while injecting 5 mM also targets PP1 and higher OA concentrations inhibit all phosphatases. For these reasons, we did not increase OA concentrations over 2 mM. When injected in Xenopus oocyte at 1 or 2 mM, OA induces Cdk1 activation, GVBD but then the cell dies because PP2A has multiple substrates essential for cell life. When injected at 2 mM in Clytia oocytes, OA does not induce Cdk1 activation nor GVBD but promotes cell lysis. This supports the conclusion that 2 mM OA is sufficient to inhibit PP2A (and possibly other phosphatases) but that PP2A inhibition is not sufficient to induce oocyte maturation in Clytia.

      We have reworded the relevant text to make these points clearer. The previous statement that “we cannot rule out that the quantity of OA or Gwl thiophosphorylated ARPP proteins delivered was insufficient to trigger GVBD” has been removed because it was unnecessarily cautious in the context of the literature cited above, as now fully explained_._ Changes: Page 9, lines 31-35 - Page 32, lines 34-41 & Page 33, lines 1-11 - Supplementary Table 1.

      References: Alexandre et al, 1991, doi: 10.1242/dev.112.4.971; Boe et al, 1991, doi: 10.1016/0014-4827(91)90523-w; Gehringer, 2004, doi: 10.1016/s0014-5793(03)01447-9; Goris et al, 1989, doi: 10.1016/0014-5793(89)80198-x; Kleppe et al, 2015, doi: 10.3390/md13106505; Maton el al, 2005, doi: 10.1242/jcs.02370; Rime & Ozon, 1990, doi: 10.1016/0012-1606(90)90106-s

      Reviewer #2: Lines 12-13: the sentence "This in vitro assay thus places S81 as the sole residue in ClyARPP19 for phosphorylation by PKA." is overstated. As not all residues had been tested, please indicate that "it is likely that" or "among the residues tested", in contrast to "the sole residue in ClyARPP19".

      We realise that we had not explained clearly enough how the thiophosphorylation assay works. In this assay, γ-S-ATP will be incorporated into any amino acid of ClyARPP19 phosphorylatable by PKA. The observed thiophosphorylation of the wild-type protein, demonstrates that one or more residues are phosphorylated by PKA. This thiophosphorylation was completely prevented by mutation of a single residue, S81. This experiment thus shows that S81 is entirely responsible for phosphorylation by PKA in this assay. We have rewritten this section more clearly. Changes: Page 10, lines 18-28.

      ____________V - Figures and text related to the figures

      Figure 1A

      Reviewer #2: Why is mouse not included in Figure 1A? Although it might be very similar to human, given that mouse is the species that is most commonly use as a mammalian model, I believe it could be included. However, this is optional upon decision by the authors.

      We have replaced the human sequence in Figure 1A with the mouse sequence as suggested. The sequences of each of the mouse and human ENSA/ARPP19 proteins are indeed virtually identical across mammals. Changes: Fig. 1A.

      Figure 1C

      Reviewer #2: There should be a better explanation in the text of the results sections for the image included in in Fig1 C. Note that Clytia is not a commonly used species, therefore images should be properly explained for general readers. Please indicate in the text that ClyARPP19 mRNA is expressed in previtellogenic oocytes and not in vitellogenic, plus any additional information needed to understand the image. In addition, the detection of ARPP19 in the nerve rings is intriguing. This is mentioned in the discussion section, any idea of its function there? Please include some additional information or additional references, if they exist.

      We have expanded the explanations of Fig. 1C in the text and in the figure legend. We have also added cartoons to the figure to help readers understand the organisation of the Clytia jellyfish and gonad. As now explained, ClyARPP19 mRNA is detected in oocytes at all stages, but the signal is much stronger in pre-vitellogenic oocytes because all cytoplasmic components including mRNAs are significantly diluted by high quantity of yolk proteins as the oocytes grow to full size. Changes: page 7, line 40 & page 8, lines 1-9 - Fig. 1C - Legend page 31, lines 19-31.

      Nothing is known about the function of ARPP19 in the Clytia nervous system. The only data linking ARPP19 and the nervous system concerns mammalian ARPP16, an alternatively spliced variant of ARPP19. ARPP16 is highly expressed in medium spiny neurons of the striatum and likely mediates effects of the neurotransmitter dopamine acting on these cells (Andrade et al, 2017; Musante et al, 2017). This point is included in the Discussion in relation to the hypothesis that PKA phosphorylation of ARPP19 proteins in animals first arose in the nervous system and only later was coopted into oocyte maturation initiation. Changes: page 16, lines 12-13 & 17-20 - page 19, lines 6-9.

      Figure 2A

      Reviewer #1: Fig. 2A (and similar plots in subsequent figures): is it really necessary to cut the x axis? Would it be possible to indicate the number of oocytes for each experiment (maybe in the legend in brackets)?

      As requested by reviewer #1, the x-axis is no longer cut. The number of oocytes for each experiment is now provided in the legend of Fig. 2A and in similar plots of Fig. 5A and 5D. Changes: Fig. 2A - Legends page 31, lines 37-38 (Fig. 2A), page 33, line 25 (Fig. 5A) - page 33, line 34 (Fig. 5D).

      Figure 2D-E (as well as Figure 6C-D and Figure 8B-C)

      Reviewer #1: Fig. 2D (and all similar plots below): I am lacking the discrete data points that were measured. Without these it is impossible to evaluate the fits. The half-times shown in 2E are somewhat redundant, and the information could be combined on a single plot.

      We added all the data points to the concerned plots: 2D, 6C and 8B. As recommended by reviewer #1, we combined on a single plot the phosphorylation levels and the half-times. 2D-E => 2D, 6C-D => 6C and 8B-C => 8B. Changes: Figs 2D, 6C and 8B - Legends page 32, lines 9-14 (Fig. 2D), page 34, lines 24-30 (Fig. 6C) - page 35, lines 13-18 (Fig. 8B).

      Figure 3A and 3B

      Reviewer #1: Fig. 3: why is the blot for PKA substrates cut into 3 pieces? It would be clearer to show the entire membrane.

      In western blot experiments using Clytia oocytes, the amount of material was limited so the membranes were cut into three parts. The central part was incubated sequentially in distinct antibodies. We finally incubated all three parts of the membrane with the anti-phospho-PKA substrate antibody to reveal the full spectrum of proteins recognized by this antibody. The 3 pieces in Fig. 3A therefore together make up the same original membrane. We had separated them on the figure to make it clear that the membrane had been cut. In the new presentation, the 3 pieces are shown next to each other, making it clear that all the membrane is present, with dotted lines indicating the cut zone as explained in the legend. Changes: Fig. 3A and 3B - Legend page 32, lines 22-25 (Fig. 3A), lines 30-33 (Fig. 3B) - Page 24, lines 3-6 (Methods).

      Figure 3C

      Reviewer #2: Fig. 3C needs a better explanation in the text. The way these graphs are presented is somehow confusing. The meaning of the dots is not self-explanted in the graph, and it seems that each experiment was done independently but then the complete set of results is presented. Legend says that "each dot represents one experiment" but this is difficult to read as in every analysis the figure also indicates the average and the total number of oocytes. If authors wish so, they can keep the figure as it is, but then please explain this graph better in the text, and please include statistical analysis. These results are very robust, but a comparison between the number of oocytes that go through spontaneous GVBD of lysis in the different conditions will benefit their understanding.

      This figure is intended to provide an overview of all the Clytia oocyte injection experiments that we performed, for which full details are given in Supplementary Table 1. Since these experiments were not equivalent in terms of exact timing and types of observation (or films) made and oocyte sensitivity to injection -as ascertained by buffer injections-, it is not justified to make statistical comparisons between groups. We apologise that the presentation was misleading in this respect and hope that the new version is easier to understand. We removed from the figure the average percentage of maturation for each condition between experiments to avoid any misunderstanding of the nature of the data, and rather represent the values of each experiment independently. We also now explain the data included in the figure fully in the text and figure legend. Changes: Page 9, lines 16-39 - Fig. 3C and Supplementary Table 1 - Legend page 32, lines 34-41 & page 33, lines 1-11.

      Reviewer #2: Also, please provide in the text a plausible explanation for the cause of oocyte lysis for all experimental conditions (Fig 3C). Given that in the control experiments with buffer this effect is also observed in some oocytes, please explain if this is caused by a mechanical disruption of the oocyte during the injection. In contrast, okadaic acid induces the lysis in all the 14/14 oocytes analyzed, is this due also to the mechanical approach? Or is there other reason more related to the PP2A inhibition? Please explain.

      These points are treated above in the response to this reviewer concerning the Results section.

      Figure 5

      Reviewer #2: In Figure 5 D-F, cited in page 9 lines 35-35. Can you provide an explanation of why the time course of meiosis resumption was delayed?

      The binding partners/effectors of XeARPP19-S109D that are involved in maintaining the prophase arrest have not yet been identified. The most probable explanation of the delay in meiotic maturation induced by ClyARPP19-S109D is that Clytia protein recognizes less efficiently these unknown ARPP19 effectors that mediate the prophase arrest. As a result, maturation would be delayed, but not blocked. This explanation was provided in the Discussion (page 17, lines 14-17) and is now mentioned in the Results section. Changes: page 11, lines 16-19.

      ____________VI - Discussion

      Reviewer #2: Although it presents highly interesting suggestions, discussion may border on being overly speculative, especially from line 37 of page 15 till the end.

      We agree and have reduced the speculation in this part of the discussion, in particular regrouping and reformulating ideas about evolutionary scenarios in a single paragraph. Changes: page 17, lines 37-41 - page 18, lines 1-41 - page 19, lines 1-18.

      SUMMARY - Point by point responses to individual reviewers’ comments in their order of appearance.

      Reviewer 1

      • The figures and text could be slightly condensed down to about 6 figures.

      We have reduced the number of figure panels but we prefer to maintain the number of figures, because the experimental data presented in them is essential to the interpretation of our results and the overall conclusions of the article. If the journal editor would like us to reduce the number of figures, we could do this by displacing Figure 4 and some panels of other figures (to then fuse some of them) to supplementary material, but this would be a pity.

      • The exact mechanisms responsible for the reduced effect of PKA phosphorylation remain relatively vaguely defined. Indeed, in their Discussion the authors list a number of experimental approaches to address this - but I understand that these would all involve substantial efforts to address. In particular, testing chimeric constructs around the consensus PKA site and from multiple species could be very informative.

      As the reviewer points out, unravelling these exact mechanisms will require a large amount of additional work and is beyond the scope of the current study.

      • 2A (and similar plots in subsequent figures): is it really necessary to cut the x axis? Would it be possible to indicate the number of oocytes for each experiment (maybe in the legend in brackets)?

      Fig. 2A has been changed in line with the reviewer's request (as well as similar plots in Fig. 5A and 5D). Changes: Fig. 2A - Legends page 31, lines 37-38 (Fig. 2A), page 33, line 25 (Fig. 5A) - page 33, line 34 (Fig. 5D).

      • 2D (and all similar plots below): I am lacking the discrete data points that were measured. Without these it is impossible to evaluate the fits. The half-times shown in 2E are somewhat redundant, and the information could be combined on a single plot.

      Fig. 2D has been changed in line with the reviewer's request (as well as similar plots in Figs 6C-D and 8B-C). Changes: Fig. 2D, 6C and 8B - Legends page 32, lines 9-14 (Fig. 2D), page 34, lines 24-30 (Fig. 6C) - page 35, lines 13-18 (Fig. 8B).

      • 3: why is the blot for PKA substrates cut into 3 pieces? It would be clearer to show the entire membrane.

      In western blot experiments using Clytia oocytes, the amount of material was limited so the membranes were cut into three parts. The central part was incubated sequentially in distinct antibodies. We finally incubated all three parts of the membrane with the anti-phospho-PKA substrate antibody to reveal the full spectrum of proteins recognized by this antibody. The 3 pieces in Fig. 3A therefore together make up the same original membrane. In the new presentation, the 3 pieces are shown next to each other, making it clear that all the membrane is present, with dotted lines indicating the cut zone as explained in the legend. Changes: Fig. 3A and 3B - Legend page 32, lines 22-25 (Fig. 3A), lines 30-33 (Fig. 3B) - Page 24, lines 3-6 (Methods).

      Reviewer 2

      • Abstract needs to be simplified if wants to reach a broader range of readers.

      We have reworked the Abstract to make it more accessible to new readers. Changes: Page 2.

      • It would be interesting to include some time-references when introducing the prophase arrest of Clytia and Xenopus oocytes. This should be indicated in the introduction with a short introduction of why, and not others, were these species chosen for this study.

      We have expanded the Introduction to cover the issue of time-references. Fuller details are now included about the advantages of Clytia compared to other hydrozoan species. Changes: Page 3, lines 5-11, page 4, lines 28-35, page 5, lines 32-33, page 5, lines 21-32 & 37-39.

      • The proteins MAPK is not introduced properly, as it is first mentioned in the results section.

      The involvement of MAPK activation during Xenopus oocyte meiotic maturation is now introduced. Changes: Page 5, lines 1-5.

      • Page 4 Lines 16-17 "... no role for cAMP has been detected in meiotic resumption, which is mediated by distinct signaling pathways" Which pathways?

      We now give the example of the well-characterized pathway Gbg-PI3K pathway for oocyte maturation in starfish, also mentioning that in many species the pathways are still unknown. Changes: Page 4, lines 1-15.

      • Page 4 line 34-39. Introduction indicates that the phosphorylation of ARPP19 on S67 by Gwl is a poorly understood molecular signaling cascade (line 34). However, the positive role of ARPP19 on Cdk1 activation, through the S67 phosphorylation by Gwl, appears to be widespread across all eukaryotic mitotic and meiotic divisions studied (lines 36-37). These two sentences seem a little contradictory.

      The mechanisms of PP2A inhibition by Gwl-phosphorylated ARPP19 are very well studied. The part that remains mysterious concerns the upstream mechanisms. We have reworded the paragraph to make this point unambiguous. Changes: Page 5, lines 1-8.

      • Why is mouse not included in Figure 1A?

      We have replaced the human sequence in Figure 1A with the mouse sequence. Changes: Fig. 1A.

      • 1C: There should be a better explanation in the text of the results sections for the image included in in Fig1 C. Please indicate in the text that ClyARPP19 mRNA is expressed in previtellogenic oocytes and not in vitellogenic.

      We have expanded the explanations of Fig. 1C in the text. We have also added cartoons to the figure to help readers understand the organisation of the Clytia jellyfish and gonad. As now explained, ClyARPP19 mRNA is detected in oocytes at all stages, but the signal is much stronger in pre-vitellogenic oocytes because all cytoplasmic components are significantly diluted by high quantity of yolk proteins. Changes: page 7, line 40 & page 8, lines 1-9 - Fig. 1C - Legend page 31, lines 19-31.

      • In addition, the detection of ARPP19 in the nerve rings is intriguing. Any idea of its function there?

      The only data linking ARPP19 and the nervous system concerns a mammalian variant of ARPP19 that is highly expressed in the striatum. This point is included in the Discussion_. Changes: page 16, lines 12-13 & 17-20 - page 19, lines 6-9._

      • Figure 3C. The way these graphs are presented is somehow confusing. If authors wish so, they can keep the figure as it is, but then Also, please provide in the text a plausible explanation for the cause of oocyte lysis for all experimental conditions. please explain this graph better in the text, and please include statistical analysis.

      This figure is intended to provide an overview of all the Clytia oocyte injection experiments, for which full details are given in Supplementary Table 1. We have modified the figure and now clarified this fully in the text and figure legend. Clytia oocytes are relatively fragile. Sensitivity of oocytes to injection varies between batches, while in general increasing injection volumes or protein concentrations increases the levels of lysis observed. We do not know exactly what causes this but it probably relates to mechanical trauma. We now explain these injection experiments more fully in the text. Changes: Page 9, lines 16-39 - Fig. 3C and Supplementary Table 1 - Legend page 32, lines 34-41 & page 33, lines 1-11.

      • In Figure 5 D-F, cited in page 9 lines 35-35. Can you provide an explanation of why the time course of meiosis resumption was delayed?

      The most probable explanation is that Clytia protein recognizes less efficiently the unknown ARPP19 effectors that mediate the prophase arrest in Xenopus. This explanation is provided in the Results section. Changes: page 11, line 16-19.

      • All the sections start with a long introductory paragraph. I believe this facilitates the contextualization of the experiments, but please try to summarize when possible.

      As requested, we have shortened or removed the introductory passages of the Results section paragraphs, which were redundant with the information given in the introduction. Changes: Page 7, lines 3-4 & 14-16 & 36-37 - Page 8, lines 12-15 - Page 8, lines 37-40 & Page 9, lines 1-6.

      • Page 7, Lines 14-19 present a general conclusion of the findings explained in lines 20-27. I think these results are important and they should be explained better, in my opinion they are slightly poorly described.

      The explanation of the experiments and the results are now more detailed and the paragraph ends with a general conclusion which came too early in the previous version. Changes: Page 8, lines 22-24 & 32-34.

      • Page 8, lines 16-17: "It was not possible to increase injection volumes or protein concentrations without inducing high levels of non-specific toxicity". What are the non-specific toxicity effects? How was this addressed? What fundaments this conclusion?

      As explained above, increasing injection volumes or protein concentrations increases the levels of lysis observed due probably to mechanical trauma. But it is important to note that at the same concentration, both Clytia and Xenopus proteins induce activation of Cdk1 and GVBD in the Xenopus oocyte. Changes: Page 9, lines 16-29 - Page 32, lines 34-41 & Page 33, lines 1-11 - Supplementary Table 1.

      • Lines 25-27 of page 8. "These results suggest that PP2A inhibition is not sufficient to induce oocyte maturation in Clytia, although we cannot rule out that the quantity of OA or Gwl thiophosphorylated ARPP proteins delivered was insufficient to trigger GVBD." Please provide evidence if higher concentrations of OA or Gwl were tested to state this conclusion.

      High OA concentrations lead to cell lysis/apoptosis as a result of a massive deregulation of protein phosphorylation. For these reasons, we cannot increase OA concentrations over 2 µM. When injected in Xenopus oocyte at 1 or 2 µM, OA induces Cdk1 activation, but then the cell dies because PP2A has multiple substrates essential for cell life. When injected at 2 µM in Clytia oocytes, OA does not induce Cdk1 activation but promotes cell lysis. This supports the conclusion that 2 µM OA is sufficient to inhibit PP2A but that PP2A inhibition is not sufficient to induce oocyte maturation in Clytia. We have reworded the relevant text. Changes: Page 9, lines 31-35 - Page 32, lines 34-41 & Page 33, lines 1-11 - Supplementary Table 1.

      • Lines 12-13: the sentence "This in vitro assay thus places S81 as the sole residue in ClyARPP19 for phosphorylation by PKA." is overstated. As not all residues had been tested, please indicate that "it is likely that" or "among the residues tested", in contrast to "the sole residue in ClyARPP19".

      The observed thiophosphorylation of the wild-type protein demonstrates that one or more residues are phosphorylated by PKA. This thiophosphorylation was completely prevented by mutation of a single residue, S81. This experiment thus shows that S81 is entirely responsible for phosphorylation by PKA in this assay. We have rewritten this section more clearly. Changes: Page 10, lines 18-28.

      • Some parts of the discussion are a bit speculative.

      We have reduced the speculation in this part of the discussion, in particular regrouping and reformulating ideas about evolutionary scenarios into a single paragraph. Changes: page 17, lines 37-41 - page 18, lines 1-41 - page 19, lines 1-18.

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      Summary of the main findings of the study.

      This work presents very interesting data about the maintenance and release of the prophase arrest of oocytes during sexual reproduction. Authors approach some of the remaining questions about oocyte maturation in animals by taking a comparative approach between two species (Clytia and Xenopus) that use opposing cAMP/PKA signaling pathways to trigger oocyte maturation. To do it they focused on phosphorylation characteristics and function of the regulatory protein ARPP19 from the amphibian Xenopus and its orthologue in the hydrozoan Clytia. Results suggest that the low capacity of Clytia ARPP19 to be phosphorylated by PKA. Moreover, Clytia ARPP19 is inherently a poorer PKA substrate than Xenopus ARPP109 both in vivo and in vitro, despite the presence of a functional PKA site. In addition, the absence of functional interactors mediating its negative effects on Cdk1 activation may provide a double security allowing induction of meiosis resumption in Clytia by elevated PKA activity despite the presence of ARPP19, while additional and yet unidentified mechanisms ensure the Clytia oocyte prophase arrest.

      Minor comments: read detailed review below. Figure 1 and Figure 3 need a better explanation of the results. Abstract needs to be simplified if wants to reach a broader range of readers. Some parts of the discussion are a bit speculative.

      Overall, this work used a robust set of molecular experiments that strongly support the conclusions of the study.

      Significance

      Strengths and limitations of this work:

      The primary strength of this work lies in its innovative use of two distinct species and the integration of molecular experiments to extract conclusions from their different signaling pathways. The well-designed and executed experiments, particularly those of figures 5-9, contribute to an elaborated exploration of the topic, elucidating the underlying mechanisms with clarity. The explanation of each experiment in the results section further adds to the clarity and depth of the study.

      The abstract requires improvement, particularly from lines 10 to 21, as it becomes fully understood only after reading the entire manuscript. To make the work more accessible to new readers, it would be good to present the abstract in a more approachable manner. Figures 1C and 3C need a better explanation in the text. Additionally, some sentences would benefit from citations or further clarification in the results or discussion section. Although is presents highly interesting suggestions, discussion may border on being overly speculative, especially from line 37 of page 15 till the end.

      Detailed review

      Introduction:<br /> I believe that it would be interesting to include some time-references when introducing the prophase arrest of Clytia and Xenopus oocytes. How long is prophase arrest in Xenopus compared to Clytia or other organisms? How can this affect the prophase arrest mechanisms? It seems that the prophase arrest in Xenopus oocytes is found to be significantly more prolonged compared to Clytia and various other organisms, and also meiotic maturation proceeds much more rapidly in Clytia than in Xenopus. This should be indicated in the introduction with a short introduction of why, and not others, were these species chosen for this study. A brief justification is included in lines 1-page 5 "..a laboratory model hydrozoan species well suited to oogenesis studies", but it does not explain why this and not other hydrozoan species like Hydra, that has also been used for meiosis studies.<br /> The proteins MAPK is not introduced properly, as it is first mentioned in the results section in line 12. Given the importance of the results provided with it, it should be presented in the introduction prior to the results section.

      These sentences need a more elaborate explanation:<br /> Page 4 Lines 16-17 "... no role for cAMP has been detected in meiotic resumption, which is mediated by distinct signaling pathways" Which pathways?

      Page 4 line 34-39. Introduction indicates that the phosphorylation of ARPP19 on S67 by Gwl is a poorly understood molecular signaling cascade (line 34). However, the positive role of ARPP19 on Cdk1 activation, through the S67 phosphorylation by Gwl, appears to be widespread across all eukaryotic mitotic and meiotic divisions studied (lines 36-37). These two sentences seem a little contradictory. If the general pathway has been identified but the signaling cascade is still not well described, please indicate that in a clearer way.

      Results section: this review will first comment the figures, and then the text.<br /> Figure 1<br /> Why is mouse not included in Figure 1A? Although it might be very similar to human, given that mouse is the species that is most commonly use as a mammalian model, I believe it could be included. However, this is optional upon decision by the authors.<br /> There should be a better explanation in the text of the results sections for the image included in in Fig1 C. Note that Clytia is not a commonly used species, therefore images should be properly explained for general readers. Please indicate in the text that ClyARPP19 mRNA is expressed in previtellogenic oocytes and not in vitellogenic, plus any additional information needed to understand the image. In addition, the detection of ARPP19 in the nerve rings is intriguing. This is mentioned in the discussion section, any idea of its function there? Please include some additional information or additional references, if they exist.

      Figure 3<br /> The way these graphs are presented is somehow confusing. The meaning of the dots is not self-explanted in the graph, and it seems that each experiment was done independently but then the complete set of results is presented. Legend says that "each dot represents one experiment" but this is difficult to read as in every analysis the figure also indicates the average and the total number of oocytes. If authors wish so, they can keep the figure as it is, but then please explain this graph better in the text, and please include statistical analysis. These results are very robust, but a comparison between the number of oocytes that go through spontaneous GVBD of lysis in the different conditions will benefit their understanding.

      Also, please provide in the text a plausible explanation for the cause of oocyte lysis for all experimental conditions (Fig 3C). Given that in the control experiments with buffer this effect is also observed in some oocytes, please explain if this is caused by a mechanical disruption of the oocyte during the injection. In contrast, okadaic acid induces the lysis in all the 14/14 oocytes analyzed, is this due also to the mechanical approach? Or is there other reason more related to the PP2A inhibition? Please explain.

      Figure 5<br /> In Figure 5 D-F, cited in page 9 lines 35-35. Can you provide an explanation of why the time course of meiosis resumption was delayed?

      • The text of the results is generally well described; however, all the sections start with a long introductory paragraph. I believe this facilitates the contextualization of the experiments, but please try to summarize when possible. For example, in page 5 lines 12-25, or page 7 lines 30-37, are all introduction information.<br /> Page 7, Lines 14-19 present a general conclusion of the findings explained in lines 20-27. I think these results are important and they should be explained better, in my opinion they are slightly poorly described.

      Page 8, lines 16-17: "It was not possible to increase injection volumes or protein concentrations without inducing high levels of non-specific toxicity". What are the non-specific toxicity effects? How was this addressed? What fundaments this conclusion?

      Lines 25-27 of page 8. Text reads, "These results suggest that PP2A inhibition is not sufficient to induce oocyte maturation in Clytia, although we cannot rule out that the quantity of OA or Gwl thiophosphorylated ARPP proteins delivered was insufficient to trigger GVBD.". Please provide evidence if higher concentrations of OA or Gwl were tested to state this conclusion.

      Lines 12-13: the sentence "This in vitro assay thus places S81 as the sole residue in ClyARPP19 for phosphorylation by PKA." is overstated. As not all residues had been tested, please indicate that "it is likely that" or "among the residues tested", in contrast to "the sole residue in ClyARPP19".

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      We thank the Reviewers for their helpful and constructive comments. In response to these suggestions we have performed new experiments and amended the manuscript, as we describe in our detailed response below.

      Reviewer #1:

      1. The Reviewer notes that while our analysis of centrosome size was comprehensive, we provided no analysis of centrosomal MTs, pointing out that while centrosome size declines as the embryos enter mitosis, the ability of centrosomes to organise MTs might not. This is a good point, and we now provide an analysis of centrosomal-MT behaviour (Figure 2). We find that there is a dramatic decline in centrosomal MT fluorescence at NEB, although the pattern of centrosomal MT recruitment prior to NEB is surprisingly complex.

      2. The Reviewer questions how PCM client proteins can be recruited in different ways by the same Cdk/Cyclin oscillator. We apologise for not explaining this properly. It is widely accepted that Cdk/Cyclins drive cell cycle progression, in part, by phosphorylating different substrates at different activity thresholds (e.g. Coudreuse and Nurse, Nature, 2010; Swaffer et al., Cell, 2016). Moreover, it is also clear that Cdk/Cyclins can phosphorylate the same protein at different sites at different activity thresholds (e.g. Koivomagi et al., Nature, 2011; Asafa et al., Curr. Biol., 2022; Ord et al., Nat. Struct. Mol. Biol., 2019). Thus, we hypothesise that rising Cdk/Cyclin cell cycle oscillator (CCO) activity phosphorylates multiple proteins at different times and/or at different sites to generate the complicated kinetics of centrosome growth. We now explain this point more clearly throughout the manuscript.

      3. The Reviewer is puzzled as to how we conclude that Cdk/Cyclins phosphorylate Spd-2 and Cnn at all the potential Cdk/Cyclin phosphorylation sites we mutate in our study. The Reviewer is right that we cannot make this conclusion, and we did not intend to make this claim. As we now clarify (p11, para.1), although it is unclear if Cdk/Cyclins phosphorylate Spd-2 or Cnn on all, some, or none of these sites, if either protein can be phosphorylated by Cdk/Cyclins, then these mutants should not be able to be phosphorylated in this way—allowing us to address the potential significance of any such phosphorylation. We now also note that several of these sites have been shown to be phosphorylated in embryos in Mass Spectroscopy screens (Figure S6).

      4. The Reviewer highlights differences in how Spd-2 and Cnn help recruit γ-tubulin to centrosomes (Figure 6). They ask for a more detailed description, and are puzzled as to how this is compatible with direct regulation by a single oscillator. We now explain our thinking on this important point in much more detail. It appears that Spd-2 helps recruit γ-tubulin throughout S-phase, while Cnn has a more prominent role in late S-phase (Figure 6). This is consistent with our overall hypothesis of CCO regulation, as we postulate that low-level CCO activity promotes the Spd-2/γ-tubulin interaction in early S-phase, while higher CCO activity promotes the Cnn/γ-tubulin interaction in late-S-phase, potentially explaining the increase in the rate of γ-tubulin (but not γ-TuRC) recruitment we observe at this point (see minor comment #1, below, for an explanation of the various γ-tubulin complexes in flies). This is consistent with recent literature showing that CCO activity promotes γ-tubulin (but not γ-TuRC) recruitment by Cnn/SPD-5 in worms and flies (Ohta et al., 2021; Tovey et al., 2021).

      5. The Reviewer was not convinced by our model (Figure 8, now Figure 9), raising two major concerns. First, they were unsure how a single oscillator could generate different patterns of protein recruitment. We addressed this in point #2 and #4, above, where we explain how different thresholds of CCO activity trigger different events, so there is no expectation that we should observe steady changes in recruitment over time as CCO activity rises. Second, they questioned how modest levels of Cdk/Cyclin activity can promote recruitment, while high levels of activity can inhibit recruitment. In point #1, above, we cite several examples where such positive and negative regulation by different Cdk/Cyclin activity levels have been described. We also now explain throughout the manuscript why this hypothesis provides a plausible explanation for our results: with moderate CCO activity promoting Spd-2-dependent PCM-client recruitment in early S-phase; higher CCO activity promoting a decrease in Spd-2 recruitment in mid-late-S-phase (so centrosomal Spd-2 levels decline); and even higher levels of CCO activity leading to a decrease in the interactions between the client proteins and the Spd-2/Cnn scaffold as the embryos enter mitosis (so the client proteins are rapidly released from the centrosome).

      The Reviewer also raised the important point here that our model does not explain why the mutant forms of Spd-2 and Cnn accumulate to higher levels at the start of S-phase, and not just at the end of S-phase/entry into mitosis. We apologise for not explaining this properly. The accumulation of the mutant proteins (particularly Spd-2, Figure 5C) in early-S-phase occurs because the excess mutant protein that accumulates at centrosomes in _late-_S-phase/mitosis is not removed properly from centrosomes during mitosis (presumably because there is insufficient time). Thus, centrosomes still have too much mutant Spd-2 at the start of the next S-phase. We show this in Reviewer Figure 1 (attached to this letter), which tracks Spd-2 behaviour further into mitosis, and now explain this in more detail in the text (p12, para.1).

      1. The Reviewer questions how the CCO can both induce centrosome growth and also switch it off, as it is unclear how an oscillator that only phosphorylates sites to decrease centrosome binding could also promote growth. They ask if we can identify and mutate any Cdk/Cyclin sites in centrosome proteins that promote centrosome recruitment. As we now clarify, we did not intend to claim that the CCO only phosphorylates sites that decrease the centrosome binding of proteins, although we do hypothesise that such phosphorylation is important for switching off centrosome growth in mitosis. In addition, we hypothesise that moderate levels of CCO initially promote centrosome growth, and our data suggests that the CCO does this, at least in part, by promoting Polo recruitment (Figure 8). We speculate that the CCO phosphorylates specific Polo-box-binding sites in Ana1 and Spd-2, the main proteins that recruit Polo to centrioles. We agree that identifying these sites is an important next step, but it is complicated as our studies indicate that multiple sites contribute in a complex manner. Importantly, it is well established that the CCO triggers centrosome growth as cells prepare to enter mitosis, so our hypothesis that moderate levels of CCO activity initiate centrosome growth is not new or controversial.

      Minor Comments

      1. The reviewer asks how we explain the different incorporation profiles we observe for the different subunits of the γ-tubulin ring complex. We apologise for not discussing this point. In flies there is a “core” γ-tubulin-small complex (γ-TuSC) and a larger γ-tubulin-ring complex (γ-TuRC) that contains the Grip71, Grip75 and Grip128 subunits we analyse here (Oegema et al., JCB, 1999). The γ-TuSC functions independently of the γ-TuRC so γ-tubulin and γ-TuRC components can behave differently.

      2. The Reviewer questions why we claim an “inverse-linear” relationship between S-phase length and the centrosome growth rate when the relationship is not linear (Figure 3, now Figure S3). I was originally confused by this as well but, mathematically, a linear relationship means y is proportional to x, whereas an inverse-linear relationship means y is proportional to 1/x. Thus, an inverse-linear relationship between x and y does not plot as a straight line, but rather as the curves we show on the graphs. We now explain this in text (p9, para.2).

      Reviewer #2:

      This Reviewer found the manuscript hard to follow, so we are very grateful that they took the time to try to understand it. We agree that the subject matter is complicated, and that our presentation was not always helpful. The Reviewer’s comments have been very useful in helping us to identify (and hopefully improve) areas of particular difficulty.

      Major points:

      1. The Reviewer highlights that the two experimental approaches underpinning our main conclusions are problematic: (1) Experiments with mutants of Spd-2 and Cnn that theoretically cannot be phosphorylated by Cdk/Cyclins are hard to interpret as these mutations may have other effects; (2) It is unclear whether reducing Cyclin B levels reduces peak CDK activity or simply slows the time it takes to reach peak levels. They suggest a more direct test of our model would be to analyse PCM recruitment in embryos arrested in S-phase or mitosis. (1) We agree that the mutations designed to prevent Cdk/Cyclin phosphorylation could perturb function in other ways, but this is true for any such mutation, and there are many papers that infer a function for Cdk/Cyclin phosphorylation from such experiments. Importantly, the centrosomal accumulation of the phospho-null mutants actually slightly increases compared to WT (Figure 5C and I), and we now show that the centrosomal accumulation of a phosphomimicking Spd-2-Cdk20E mutant slightly decreases (Figure S8). We now acknowledge the potential caveat of a non-specific perturbation of protein function, but feel that the reciprocal behaviour of the phospho-null and phospho-mimicking mutants somewhat mitigates this concern (p12, para.2). (2) Fortunately, and as we now clarify, it has recently been shown that reducing Cyclin levels does not reduce peak Cdk activity, but rather slows the time it takes to reach peak activity (Figure 2A, Hayden et al., Curr. Biol., 2022). Thus, the cyclin half-dose experiments provide an excellent alternative test of our hypothesis as they show that the WT proteins can exhibit similar behaviour to the mutants if the rate of Cdk/Cyclin activation is slowed. We feel the evidence supporting our hypothesis is strong enough that it warrants serious consideration.

      The suggestion to look at PCM recruitment in embryos arrested in either S-phase or M-phase is a good one, but these experiments produce complicated data. In M-phase arrested embryos, for example, Cnn levels continue to rise (see Figure 1G, Conduit et al., Dev. Cell, 2014), but the other PCM proteins do not (unpublished); in S-phase arrested embryos (arrested by mitotic cyclin depletion) centrosomes continue to duplicate, but now do so asynchronously, greatly complicating the analysis (McCleland and O’Farrell, Curr. Biol.., 2008; Aydogan et al., Cell, 2020). The centrosomes that don’t duplicate, however, reach a constant steady-state size (where the rate of centrosome protein addition is balanced by the rate of loss). These observations are consistent with our recent mathematical modelling of mitotic PCM assembly (Wong et al., 2022) if we additionally account for cell cycle regulation (which was not considered in our original model). We believe such analyses are beyond the scope of the current paper and we plan to publish a second paper incorporating our new hypothesis into our mathematical modelling.

      1. The Reviewer questions whether our methods accurately measure centrosomal protein accumulation, pointing out that γ-tubulin and Grip128 occupy different centrosomal areas—which should not be possible if they are part of the same complex. They suspect that our use of different transgenes with different promotors could explain these differences. As we should have described (see point #1 in our response to the minor comments of Reviewer #1), γ-tubulin exists in two complexes in flies, only one of which contains Grip128, so γ-tubulin and Grip128 exhibit different localisations. Moreover, as we now show (Figure S2), using different promotors does not seem to make a difference to overall recruitment kinetics. Thus, we are confident that our methods measure centrosome protein recruitment dynamics accurately.

      2. The Reviewer is concerned that our measurements of centrosome size based on fluorescence intensity (Figure 1) and centrosomal area (Figure S1) do not always match. They suggest a potential reason for this is that proteins are not uniformly distributed within centrosomes, and this may impact our ability to measure protein accumulation based on 2D projections (noting, for example, that Polo and Spd-2 are concentrated at centrioles and in the PCM, potentially explaining the different shape of their growth curves compared to the client proteins). When the centrosome-fluorescence-intensity and centrosome-area recruitment profiles of a protein do not match, the average “centrosome-density” of that protein must be changing over time. In some cases, we understand why density changes. Cnn, for example, stops flaring outwards on the centrosomal MTs during mitosis so its centrosomal area decreases even as its fluorescence intensity increases (leading to an increase in its centrosomal-density). We agree (and now discuss—p19, para.3) that the prominent accumulation of Spd-2 and Polo at centrioles could help to explain why Spd-2 and Polo accumulation dynamics differ from the client proteins.

      Other points:

      1. The Reviewer suggests it would be good to know how much Polo at the centrosome is active. We agree, but although commercial antibodies against PLK1 phosphorylated in its activation loop work in cultured fly cells, we cannot get them to work in embryos. Moreover, the recruitment of Polo/PLK1 to its site of action by its Polo-Box Domain is sufficient to partially activate the kinase independently of phosphorylation (Xu et al., NSMB, 2013). Thus, it seems likely that all the Polo/PLK1 recruited to centrosomes will be at least partially activated, even if it is not necessarily phosphorylated on its activation loop.

      2. The Reviewer asks if it is clear that less Spd-2 and Cnn are recruited to centrosomes in the half gene-dosage embryos. We apologise for not mentioning that this is indeed the case. We showed this previously for Cnn (Conduit et al., Curr. Biol., 2010) and we now state that this is also the case for Spd-2. We do not show the Spd-2 data as we plan to publish a comprehensive dose-response curve of Spd-2 (and Cnn) recruitment in our next modelling paper.

      3. Would it not be relevant to examine Polo ½ dosage embryos? We do have this data (Reviewer Figure 2), attached to this letter, but it is quite complicated to interpret (as we explain in the legend). We feel it would be more appropriate to include this in our next modelling paper where we can properly explain the behaviours we observe. Publishing this data here would distract from our main message without changing any of our conclusions.

      4. The Reviewer asks why the non-phosphorylatable Spd-2 protein is also present at higher levels on centrosomes at the start of S-phase (not just the end of S-phase). This was also raised by Reviewer #1 (point #5), so please see the second paragraph of our response there.

      Minor/Discussion Points:

      1. We thank the Reviewer for highlighting that absolute and relative centrosome size control are different things and we have amended the manuscript accordingly.

      2. The Reviewer questions whether it is accurate to describe Spd-2 and Polo as scaffold proteins, noting that only Cnn has been shown to have scaffolding properties. There is strong evidence that Spd-2 has Cnn-independent scaffolding properties in flies (e.g. Conduit et al., eLife, 2014), but this is a fair point for Polo. We think it is justified to separate Polo from other client proteins as Polo is essential for scaffold assembly, whereas other client proteins are not. We now define our scaffold/client terminology to avoid confusion (p4, para.3).

      3. The Reviewer highlights several points related to differences in recruitment kinetics (also touched on in points #2 and #3, above), noting we don’t discuss properly the idea of two different modes of PCM recruitment. These are all good points, largely addressed in our response to points #2 and #3, above. We now discuss much more prominently the two different modes of client protein recruitment throughout the manuscript.

      4. As we now clarify, in all our experiments we use centrosome separation and nuclear envelope breakdown (NEB) to define the start and end of S-phase, respectively.

      5. The Reviewer quotes the landmark Woodruff paper (Cell, 2017) as showing that the ability to concentrate client proteins (including ZYG-9, the worm homologue of Msps) is an intrinsic property of the PCM scaffold, so how do we explain that Msps departs prior to NEB while Cnn continues to accumulate? It is indeed a striking observation of our study that all PCM client proteins (not just Msps) start to leave the centrosome prior to NEB, even as Cnn levels continue to accumulate. Our hypothesis is that this ‘leaving’ event is triggered by a threshold level of Cdk/Cyclin activity—explaining why these client proteins all start to leave the PCM at the same time (just prior to NEB) irrespective of nuclear cycle length. This is not incompatible with the Woodruff paper, which did not attempt to reconstitute any potential regulation by Cdk/Cyclins in their in vitro studies.

      6. The Reviewer questions why Spd-2 that cannot be phosphorylated by Cdk/Cyclins (Spd-2-Cdk20A) accumulates abnormally at centrosomes in late S-phase, yet γ-tubulin (which is recruited by Spd-2) seems to leave centrosomes more slowly in the presence of the mutant protein. As we now explain more clearly, there is no contradiction here. Spd-2-Cdk20A accumulates to abnormally high levels in late-S-phase/early mitosis (Figure 5C), and this reduces the γ-tubulin dissociation rate, as we would predict (Figure 7B, right most graph). It does not “prevent” dissociation, however, (as the Reviewer seems to suggest it should?), but this is probably because these experiments have to be performed in the presence of large amounts of the WT Spd-2 (Figure 5A).

      7. The referencing error has been corrected.

      8. The Reviewer asks why in Figure 1 not all of the centrosome proteins could be followed for the full time period (as we mention in the legend, but do not explain). There are different reasons for different proteins: (1) Polo cannot be followed in mitosis as it binds to the kinetochores, making it impossible to accurately track centrosomes (so the data for mitosis is missing for Polo); (2) Cnn exhibits extensive flaring at the end of mitosis/early S-phase (Megraw et al., JCS, 1999), so we cannot track individual separating centrosomes labelled with NG-Cnn in early S-phase until they have moved sufficiently far-apart (so the early S-phase time-points are missing for Cnn); (3) In addition, several of the client proteins bind to the mitotic spindle, so although we can still track and measure the centrosomes in late mitosis in the graphs, we don’t show pictures of these late mitosis centrosomes in the montage in Figure 1A as the images look a bit odd. We now explain these reasons in the Materials and Methods.

      9. We now indicate that nuclear cycle 12 (NC12) is being analysed in Figures 4-8.

      10. The reviewer questions why we don’t show the decrease rate for γ-tubulin in Figure 6 (the Spd-2 and Cnn half-dose experiments), when we do show it in Figure 7 (the Spd-2 and Cnn Cdk-mutant experiments), suspecting that it is slowed in both cases. The reviewer is correct and we now show this data for both sets of experiments.

      11. We have corrected the labelling error in Figure S1.

      12. The Reviewer suggest moving some of the data from the main Figures, and the entirety of Figures 2 and 3 to the Supplemental Information. We understand this point, and agree that the amount of data presented in Figures 1-3 is somewhat overwhelming. We have played around with the Figures a lot—in particular trying to show a few examples of the data and moving the rest to Supplementary—but it is hard to pick a “typical” example, and the power of comparing the behaviour of so many different centrosome proteins is somewhat lost. We have tidied up several Figures and, as a compromise, we keep Figure 2 (now Figure 3) in the main text, but have moved Figure 3 to Supplementary (now Figure S5).

      13. The Reviewer suggests that we should repeat the analysis of Spd-2, Polo and Cnn dynamics that we show here, as we already presented this data in a previous publication (Wong et al., EMBO. J, 2022). We understand this point, but feel this would be a less accurate comparison, as essentially all of the data shown in Figure 1 was obtained several years ago during a contiguous ~6month period. Since then, the lasers and software on our microscope system have been updated, so it would probably be less fair of a comparison to obtain new data for a subset of these proteins (and it seems overkill to perform the entire analysis again). We clearly state that this data has been presented previously, so we hope the Reviewer will agree that it is acceptable to present it again here so readers can more easily compare the data.

      Reviewer #3:

      This Reviewer is broadly supportive of the manuscript, but to publish in a prestigious journal they think additional experimental evidence will be required to support our hypothesis.

      The Reviewer notes that our only evidence that Cdk/Cyclins directly phosphorylate Spd-2 comes from our analysis of the Spd-2-Cdk20A mutant, as the effect of reducing Cyclin B dosage on WT Spd-2 behaviour is very modest. They request that we analyse the behaviour of a Spd-2-Cdk20E phospho-mimicking mutant. The effect of halving the dose of Cyclin B on Spd-2 behaviour is modest, but this is what we would predict as all we are doing in this experiment is slowing S-phase by ~15%, so Spd-2 should accumulate at centrosomes for a slightly longer time and to a slightly higher level (as we observe, Figure 5E). A great advantage of the early fly embryo system is that we can compare the behaviour of many hundreds of centrosomes, so even subtle differences like this are usually meaningful. To illustrate this point, we have now repeated the Spd-2 analysis in WT and CycB1/2 embryos (but now using a CRISPR/Cas9 Spd-2-NG knock-in line) and we see the same subtle differences (Figure S9). In addition, as requested, we have now analysed the behaviour of a Spd-2Cdk20E mutant protein using an mRNA injection assay (as it would have taken too long to generate and test new transgenic lines). In this assay we injected embryos with mRNA encoding either WT Spd-2-GFP, Spd-2-Cdk20A-GFP or Spd-2-Cdk20E-GFP. The mRNA is quickly translated, and we computationally measured the fluorescence intensity of the centrosomes in mid-S-phase (i.e. at the Spd-2 peak) (Figure S8). This analysis confirms that Cdk20A accumulates to slightly higher levels, and reveals that Cdk20E accumulates to slightly lower levels, than the WT protein. Together, these new experiments strongly support our original conclusions.

      The Reviewer notes that we propose that the CCO initially promotes centrosome growth by stimulating Polo recruitment to centrosomes, but states that we only provide indirect evidence for this by showing that centrosomal Polo levels are strongly reduced in Cyclin B half-dose embryos. They suggest we determine Spd-2 levels in Polo half-dose embryos, and/or the centrosome levels of mutant forms of Spd-2 that cannot be phosphorylated by Polo. We believe the Cyclin B half-dose experiment provide direct support for our hypothesis that Cdk/Cyclin activity influences Polo recruitment (Figure 8), although, clearly, we have not identified the mechanism. We do, however, suggest a plausible mechanism: Ana1 and Spd-2 are largely responsible for recruiting Polo to centrosomes, and we have previously shown that several of the potential phosphorylation sites in these proteins that help recruit Polo to centrosomes are Cdk/Cyclin or Polo phosphorylation sites (Alvarez-Rodrigo et al., eLife, 2020 and JCS, 2021; Wong et al., EMBO J., 2022). We are currently testing this hypothesis, but progress is slow as it is clear that multiple sites in both proteins can influence this process.

      As the Reviewer requests, we have now also examined how Spd-2 and Cnn behave in Polo half-dose embryos (Reviewer Figure 2, attached to this letter). As we describe in the Figure legend, this data is informative, but is complicated. With relatively minor, but mechanistically important, tweaks to our previous mathematical modelling we can explain these behaviours, but introducing such a significant mathematical modelling element would be beyond the scope of this paper. As described above, these findings will form the basis of a follow-up paper that is more mathematically oriented.

      It is a great idea to look at mutant forms of Spd-2 that cannot be phosphorylated by Polo, but the consensus Polo phosphorylation site (N/D/E-X-S, with the N/D/E at -2 and the S at 0 being preferences, rather than a strict rule) is less well-defined than the consensus Cdk/Cyclin phosphorylation site (where the Pro at -1 is essentially invariant). Thus, we cannot accurately predict which sites would need to be mutated to generate such a mutant.

      The Reviewer requests that we analyse the behaviour of TACC in embryos expressing the Spd-2-Cdk20A and Cnn-Cdk6A (as we do in Figure 7 for γ-tubulin). This is a reasonable request, but we prefer not to show this data as we have recently identified an interesting interaction between TACC, Spd-2 and Aurora A that will be the subject of another paper we hope to submit shortly. This data is hard to interpret without explaining these interactions properly, which is beyond the scope of the current manuscript.

      We hope the Reviewers will agree that these changes have improved the manuscript substantially, and that it is now suitable for publication. We would like to thank them again for taking the time to read this rather complicated paper so thoroughly.

      We look forward to hearing from you.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reviewer #1 (Evidence, reproducibility and clarity):

      In their manuscript „Live-cell super-resolution nanoscopy reveals modulation of cristae<br /> dynamics in bioenergetically compromised mitochondria", Golombek et al. tested the effects of different mitochondrial toxins on cristae dynamics. The main focus of their work lies on live STED imaging, which they use to visualize cristae merging and splitting. They found swelling of mitochondria and reduced cristae density in response to most toxins, but cristae dynamics remained largely unaffected. Depletion of the membrane potential by administration of CCCP increased cyristae dynamics, while inhibition of ANT had a negative effect on cristae dynamics at least in a subset of mitochondria.

      1. The authors state that the used concentrations of mitochondrial toxins commonly result in a change in oxygen consumption. While this is believable, it is not guaranteed that the specific chemicals used for the experiments were working properly (freeze/thawing or simply incorrect storage or aliquotation may have an effect on the compounds). This is even more important in the case of results where no significant change after the administration of the toxins is seen. In Figure 5, the authors report no change in membrane potential after oligomycin administration, this is unexpected. I therefore suggest to include a supplementary figure, in which the functionality of the compounds is verified. This could be done by respiratory measurements (e.g. Seahorse). A Mito Stress Test was performed for Figure 6, but this was done using the Seahorse kit chemicals, which were probably different from the chemicals used in the microscopy experiments.

      Response: We appreciate the valid concerns of the reviewer in this point.

      A) In order to show the functionality of compounds which were used for performing our experiments including STED imaging, we now performed respiratory measurements employing the concentrations of mitochondrial toxins (Oligomycin A, CCCP, rotenone/antimycin A) which were used during imaging conditions as well as commercially available mitochondrial toxins (Oligomycin A, FCCP, rotenone/antimycin A) with respective concentrations used as a standard for the Mito stress Kit. The new figures are included in Fig S1A & B. HeLa cells treated with seahorse compounds or those used during imaging conditions showed similar results including basal, maximal and spare respiratory capacity. Further, in order to overcome the inefficiency of mitochondrial toxins employed, due to freeze/thaw cycles, we used fresh aliquots (stored at -20°C) as a general strategy. This is clearly observed by a drastic reduction of ΔΨm upon treating HeLa cells with CCCP, antimycin A as well as rotenone (Fig S6A & B). A reduction of mitochondrial ATP levels was also observed upon employing rotenone, antimycin A and oligomycin A confirming that active mitochondrial toxins were used. These experiments demonstrate that the mitochondrial toxins employed throughout our manuscript are functional as expected.

      New Figure S1A & B

      B) The Fig 6 (now Fig 5 due to Reviewer # 2, Point 7) respirometry experiments which initially employed seahorse compounds and BKA has now been replaced with new experiments where we used mitochondrial toxins similar to STED imaging. Needless, to say, the results are similar to what were observed with seahorse compounds. The new figures are replaced in Fig 5A & 5B.

      New Figure 5A & B

      C) Oligomycin A inhibits ATP synthase which results in decreased ATP synthesis as observed (Fig 4A & B). Further, oligomycin A is expected to hyperpolarise mitochondria (2). In Fig S6, despite some cells having more ΔΨm, there was no overall significant change when compared to untreated cells. Previous publications also show that there is no significant difference in ΔΨm upon treatment with oligomycin (1) demonstrating that the ΔΨm depends on the concentration of oligomycin, treatment time and cell type.

      1. Figure 1 would benefit from a more detailed description of merging/splitting events. Maybe a cartoon plus a zoomed in image of an exemplary event?

      Response: Thank you for the suggestion. In order to clearly explain/simplify the understanding of cristae merging and splitting events, we added a cartoon in Fig 1B. The green and magenta arrows show sites of imminent merging and splitting with the green and magenta asterisks representing them respectively in the subsequent frames. The zoomed in images in Fig1A (leftmost panel) are shown to the right as time-lapse images.

      New Figure 1B

      1. Could the reduced cristae density be an effect of mitochondrial swelling? It is curious that all toxins appear to have the same effect on mitochondrial architecture. What is the fait of an enlarged mitochondrion over time? Mitophagy? And does the percentage of enlarged mitochondria change with increasing treatment time?

      Response: Thank you for the comment.

      A) We agree that the reduced cristae density is due to mitochondrial swelling. We added the relevant text in the results section ‘Cristae structure is altered in a subset of mammalian cells treated with mitochondrial toxins’. Treatment of HeLa cells, with all the mitochondrial toxins mentioned, uniformly result around 50 % of mitochondria undergoing enlargement (Fig 2B). In enlarged mitochondria where the mitochondrial width is ≥ 650 nm, there is no change in cristae area occupied per mitochondria (Fig S3C & D) and as a result reduced cristae density (Fig 2H). Therefore, it indicates that reduced cristae density occurs due to mitochondrial enlargement.

      Figure 2B-F

      Figure S3C and D

      B) In order to address the fate of mitochondria with increasing time upon treatment with various mitochondrial toxins, we treated the HeLa cells for 4 hrs with mitochondrial toxins. Untreated cells maintained normal mitochondrial morphology while cells treated with various mitochondrial toxins displayed fragmented and swollen mitochondrial morphology. The new Fig S5 is included in the supplementary. Cristae morphology was abnormal displaying interconnected cristae in swollen mitochondria. Since mitochondrial fragmentation is already observed at 4 hours and accompanied by interconnected cristae, the number of cristae merging and splitting were severely reduced.

      Our imaging performed within 30 mins of addition of respective toxins overcomes the additional aberrancy of mitochondrial fragmentation which would not allow a reliable analysis of cristae dynamics as too few cristae would be visible within one mitochondrion.

      New Figure S5

      1. Figure 4C: How was the mitochondrial width determined in the LSM images? Especially in the perinuclear area it will be difficult to determine this parameter without the super-resolution provided by STED. Was this parameter determined manually for selected mitochondria? In the methods part it says that only a maximum of two mitochondria per cell were analyzed. How were these chosen? Was the process blinded?

      Response: Thank you for the comment. We could imagine the reason for the ambiguity in understanding.

      A) For LSM confocal images involving FRET-based microscopy to determine the ATP levels, we calculated the cell population as belonging to either normal or enlarged category. The confocal images of HeLa cells displayed clear separation of mitochondria even in the perinuclear area (representative images are shown in Fig 4A) and thus it was possible to measure the width of individual mitochondria. The methods section ‘FRET-based microscopy to measure ATP levels’ describes that ‘the cut off for swollen mitochondria was set to 650 nm in congruence with STED SR nanoscopy. If 85% of the mitochondrial population featured enlarged mitochondria, the cells were designated as swollen. Similarly, if 85% of the mitochondrial population featured mitochondria whose width was less than 650 nm, the cell was considered as having normal mitochondria’.

      Figure 4A

      B) The cristae morphology of various mitochondria is fairly uniform in individual cells. Thus, the mitochondria are representative of the individual cells. Therefore, in order to increase the coverage of various cells, we considered a maximum of two mitochondria from each cell which were randomly chosen. This part is modified in the methods section ‘Quantification of various parameters related to cristae morphology’ to make it clear. Thus, while the quantification of various parameters including dynamics involved individual mitochondria, various cells were classified as belonging to normal or enlarged category while measuring ATP levels.

      1. What is the average size of all mitochondria per cell? Is this addressed in Figure 2B or are only analyzed mitochondria included? Please carify. Were the mitochondria chosen for analysis representative for the respective cell?

      Response: The data obtained by super-resolution imaging of mitochondria is used for quantifying cristae dynamics which is a very challenging and time-consuming method done in a blind-manner. As mentioned in response 4B, the cristae morphology is fairly uniform in individual cells, therefore, we only included the mitochondria which were analysed for various cristae parameters in our analysis which are really huge data-sets already. Thus, the average size of individual mitochondria per cell are not represented while analysing images obtained with STED SR imaging. Please also check response 4B.

      1. explain the mt-Go-AT team2, what is GFP (green fluorescent protein) and OTP (?)

      Response: GFP is Green Fluorescent Protein and OFP is Orange Fluorescent protein and included in the revised text.

      1. the graphs show in principle, e.g. Fig.1B, 3B-E show events/mitochondrion as far as I understand, not per cristae.

      Response: Thank you for pointing this out. It is actually the average number of events per cristae per mitochondria. We have changed the Y-axis to events/cristae/mito in Fig 1C (previous 1B), Fig 3B-E and wherever applicable for other figures throughout the manuscript.

      Figure 1C

      Figure 3B-E

      1. I would recommend changing the legend of the x-axis of Fig.2B-F to mito-width (y-axis could be probability density function, PDF).

      Response: We have now changed the X-Axis to mito width (originally width) in Fig 2B-F. The Y-axis are still retained as percentage mitochondria where cells treated with few mitochondrial toxins do not show a gaussian distribution of mitochondrial width.

      Figure 2B-F

      Referees cross-commenting

      both expert opinions address similar concerns and therefore a revision should be requested

      Reviewer #1 (Significance):

      The study is thorough and the experiments and results are well described. Overall, however, it remains a descriptive study and does not provide mechanisms. There is also no discussion of how MMP-dependent proteins, such as Opa1, which was previously studied by the Reichert group, might be affected. For swelling mechanisms, the opening of the mitochondrial permeability transition pore was discussed. This could be tested using inhibitors, but perhaps not within the scope of this publication. Nevertheless, the information provided by the study is of interest to the bioenergetics community and should be made available.

      Response: Thank you for the overall inputs.

      We tested the processing of OPA1 forms and found that after 30 mins, only CCCP treatment led to the processing of long isoforms to short forms (Fig S6C). We now included in the discussion that it is possible that short OPA1-forms are correlative to increased cristae merging as well as splitting events upon treatment with CCCP.

      New Figure S6C

      Reviewer #2 (Evidence, reproducibility and clarity):

      Summary:<br /> The authors investigated cristae merging and splitting events using ultra-resolution STED. The goal was to test if cristae membrane remodeling is dependent on OXPHOS complexes, mitochondrial membrane potential (ΔΨm), and the ADP/ATP nucleotide translocator. To do this the authors utilized several mitochondrial toxins with known mechanisms of action. Interestingly, many changed overall cristae density but did not change the cristae remodeling events. Inhibition of ANT did change cristae morphology and cristae dynamics.

      Major Concerns

      1. Many conclusions and concepts need more clarification. For example, a major take home from the abstract is that various ETC inhibitors and protonophores reduce cristae density but not did not change cristae remodeling events. If cristae density is reduced, how can this occur without cristae remodeling events? Remodeling events need to be clearly defined in the introduction and abstract.

      Response: Thank you for pointing out this lack of sharpness in our terminology which indeed can cause a misunderstanding. To avoid this, we have now included ‘changes in cristae morphology’ as well as ‘dynamic merging and splitting events of cristae’ under the broader term cristae remodelling. Thus, we had changed the wording ‘cristae remodeling’ to cristae dynamics in the abstract and wherever appropriate in the manuscript text.

      The cristae morphology analysis showed no change in cristae area (Fig S3C) which was accompanied by mitochondrial enlargement. Therefore, cristae density was reduced. For the purpose of clarity, we added a sentence in the introduction section while giving a peek into our results that ‘cristae dynamic events are ongoing despite reduced cristae density’. In addition, we have now included in the results section the following statement: ‘Cristae membrane remodeling has been used to describe cristae dynamic events (i.e. cristae merging and splitting) as well as overall changes in cristae morphology within a single mitochondrion in this manuscript’.

      Figure S3C and D

      1. Other interpretations are also unclear such as how ETC inhibitors which reduce ATP levels did not impact cristate remodeling events, yet inhibiting ATP/ADP exchange did greatly impact this phenomenon. It seems likely that the inhibition of ANT has nothing to do with ATP/ADP exchange since most of the ETC inhibitors no doubt greatly impact overall ATP/ADP exchange. This interpretation needs clarification.

      Response: We agree that further clarification is needed, in particular to explain why ATP/ADP exchange is actually ongoing even when OXPHOS inhibitors are applied and to explain why reduced ATP levels do not mean that there is no ATP/ADP exchange occuring. Treatment of HeLa cells with various mitochondrial toxins inhibiting the function of OXPHOS complexes leads to decreased ATP levels due to ongoing ATP consumption within the cell (Fig 4). One should also consider that two things can and do happen when most of these toxins are applied regarding ATP exchange. First, the ATPase can act in reverse mode which is a (partial) compensatory mechanism to restore ΔΨm and which will further decrease ATP levels (Note: not in the presence of oligomycin). Second, under these conditions ADP/ATP exchange is still ongoing in order to transport ATP derived from glycolysis in the cytosol to the mitochondrial matrix which also causes an (partial) compensatory increase in membrane potential. After ATP import ATP is hydrolysed to ADP for reverse proton pumping via the F1FO-ATPase or alternatively by the F1-part alone without proton pumping. In all these cases it is essential and possible to exchange ADP with ATP constantly. Therefore, the overall exchange of ADP and ATP is not necessarily grossly expected to be different when compared to untreated cells (due to compensatory glycolysis and subsequent ATP import and hydrolysis in the matrix). On the other hand, BKA treatment which clearly impairs the exchange of ADP and ATP will lead to a completely different situation compared to only treating with OXPHOS inhibitors. With BKA the mitochondrial matrix cannot anymore be resupplemented with ATP derived from glycolysis and metabolite flux is grossly hampered. Consistent with this a strong reduction in ΔΨm and oxygen consumption is accompanied with BKA treatment (Fig. 5AB & SFig 7F). Thus, w.r.t cristae dynamic events, in the time-frame we used for imaging, a reduction of ATP levels does not impede occurrence of cristae merging and splitting events while BKA treatment does (Fig S7). We discuss this indeed interesting and unexpected finding in the discussion section. We propose that rather ongoing metabolite flux (ATP/ADP exchange) is critical for maintaining cristae dynamics and blocking it is detrimental for it. We adapted the discussion in this direction to make it more clear.

      Figure S7A, B and D

      1. Why did the authors wait 30 min to image after the addition of mitochondrial toxins? I would have guessed there is a more rapid change in response to these inhibitors. Is there is a chance he authors missed the most dramatic events?

      Response: Since we were inclined to observe early responses, cells were imaged within the first 30 mins after addition of the respective mitochondrial toxins (Please see methods ‘cell culture transfection and mitochondrial toxin treatment’). Thus, to answer this question we want to emphasize that we did not wait 30 minutes but we restricted our time frame of analysis to 30 min. Therefore, we think that we did not miss out on any rapid changes occurring early on. Regarding this point, Reviewer #1 (Query 3) asked for responses at a later time-point. Please read the Reviewer #1, response 3B.

      1. How do these mitochondrial toxins that are known to cause mitochondrial swelling not induce changes in cristate density?

      Response: Thank you for the question. Probably, there is a misunderstanding. In Fig S3E, we clearly show that as the mitochondrial width increases in cells after treatment with mitochondrial toxins, there is a clear decrease in cristae density. In fact, the reduced cristae density is observed exclusively in enlarged mitochondria. Figure S3E-I

      5. It's interesting that inhibition of the ANT translocator by BKA treatment led to increased percentage of mitochondria with abnormal cristae morphology. It's accepted that inhibition of ANT profoundly reduces mitochondrial swelling. Do the authors have any data suggesting that abnormal cristae morphology actually is a mechanism for reducing cell death events such as permeability transition? Did the authors utilize cyclosporin A concomitantly with any of the mitochondrial toxins?

      Response: This is a very interesting question! As the reviewer might be aware, there is evidence connecting cristae remodelling to induction of apoptosis (3). Cristae transitioned to a highly interconnected state after tBID treatment within minutes. However, it is unclear what is the contribution of cristae dynamics in this regard. Within 30 mins, there were no visual signs of cell death in our experiments as observed under a microscope. Hence, we did not use cyclosporin A in our experiments. In our opinion, this question will form part of a very interesting future study and is currently beyond the scope of this manuscript.

      1. Are the authors confident in the data given many of the experiments utilized quantification of 10-20 mitochondria? How are you sure this sampling is sufficient for phenomenon being studied?

      Response: Please see Reviewer 1, Response 4B. As pointed in the response to reviewer #1, the cristae morphology is fairly uniform in individual cells. Therefore, in order to maximise the cell population covered, we randomly used a maximum of two mitochondria from each cell. In addition, we included cristae analysis from at least three biological replicates in order to observe the reproducibility of the data. Taking these factors into consideration, we are confident that our results reflect a sufficient sample size. Further, we would like to point out while our group performs STED super-resolution imaging routinely, the quantification of cristae merging and splitting events done in a blind yet manual manner is a really laborious and time-consuming process. In the future, we are also looking to optimise this at least in a semi-automated manner.

      1. Figure 4 and 5 merely confirm current dogma and don't really contribute to the overall conclusions and can be moved to supplemental data.

      Response: We agree that Fig 5 is confirming to the current dogma. Therefore, we moved it to Fig S6. Regarding Fig 4, we would like to highlight that there is a decrease of ATP levels before mitochondria enlarge. Thus, we would like to retain it as part of the main figure.

      1. It's interesting that BKA dose dependently decreased ATP-linked respiration and all doses limited maximal respiratory capacity. It would be interesting to know if the BKA normal vs. abnormal mitochondria have differential membrane potential?

      Response: Thank you for the interesting question. Overall, BKA treatment leads to a significant decrease of ΔΨm in the whole cell population (Fig S7). Further, the abnormal cristae morphology is only seen in one-third of the population of mitochondria (Fig shown in Response 2). Thus, a drop in ΔΨm seems to be a very early response upon exposure to BKA and independent of cristae morphology. An ideal experiment to address this question would be to image cristae dynamics and ΔΨm using super-resolution imaging which is challenging according to the state-of-art and available chemicals.

      Figure S7E and F

      1. Overall, this is an interesting study and seems appropriately performed but the results and conclusions are unclear. More discussion should include physiological relevance and impact and how this data influences previous work. Some physiological perturbations beyond the mitochondrial toxins and or utilization of genetic models would strengthen the interpretation and overall impact.

      Response: Thank you. We added an OPA1 blot showing the different L-OPA1 and S-OPA1. (Reviewer #1, response in significance section) where we observed that S-OPA1cleavage is selectively enhanced in CCCP-treated cells which could be correlated with enhanced cristae dynamics. We also included these results in the main text.

      New Figure S6C

      Referees cross-commenting

      Yes, I conclude that given the significant overlap in reviwer comments and general need for clarification of concepts and data that a revision is in order.

      Reviewer #2 (Significance):

      Overall, a highly specialized study with audience limited to mitochondriacs. Although, I'll note tis is a hot area of study and there is high interest in the field. Some of the data interpretation is difficult to understand and overall more context is needed to explain the results, impact and relevance. Defining exactly what a cristae remodeling event is and how this differs from cristae density and how the two aren't directly connected is unclear.

      Review by a mitochondrial biologist specializing in mitochondrial signaling and connection to physiology.

      References:

      1. Baker MJ, Lampe PA, Stojanovski D, Korwitz A, Anand R, et al. 2014. Stress-induced OMA1 activation and autocatalytic turnover regulate OPA1-dependent mitochondrial dynamics. EMBO J 33: 578-93
      2. Farkas DL, Wei MD, Febbroriello P, Carson JH, Loew LM. 1989. Simultaneous imaging of cell and mitochondrial membrane potentials. Biophys J 56: 1053-69
      3. Scorrano L, Ashiya M, Buttle K, Weiler S, Oakes SA, et al. 2002. A distinct pathway remodels mitochondrial cristae and mobilizes cytochrome c during apoptosis. Dev Cell 2: 55-67
    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reviewer #1 (Evidence, reproducibility and clarity):

      Major comments<br /> In the paper "Microtubules under mechanical pressure can breach dense actin networks", the authors showed clear evidence that pressure plays an important role in microtubule breaching into dense actin networks using elegant in vitro reconstitution assays. They have argued that the pressure results from polymerization force of microtubules, which builds up when microtubules are immobilized in the opposite end of breaching, by the means of actin microtubule crosslinking factor Tau.

      Authors answer:

      We thank the reviewer for his/her positive comments on our manuscript.

      It would definitely be interesting to see lack of breaching in the presence of crosslinking deficient Tau construct in order to rule out the off -target effect of Tau on microtubule and actin architecture which may possibly facilitate breaching.

      Authors answer:

      This is an interesting suggestion. Unfortunately, we do not have in hand such crosslinking deficient Tau construct. However, please note that we showed two independent ways to demonstrate the role of pressure. One is indeed by crosslinking microtubule to actin bundle with Tau, but the other is by blocking the two opposite ends of microtubules with two dense actin networks. So, we think our conclusion about the role of pressure is solid.

      The authors have also observed microtubule breaching into dense actin networks in living cells. However, in Figure 1C, better cell/ image processing might have been chosen to increase the visibility of actin structures that microtubules encounter on their way to breaching. In Figure S1D, for example, the similar actin structures in lamellipodia are very nicely visible.

      Authors answer:

      We apologize but we don’t understand reviewer’s comment. In figure 1C images of actin networks are shown in black and white and are more visible than in figure S1D where they are shown in magenta and overlaid with microtubules. In any case, we increased the contrast of images to make fine actin structures at the cell edge clearer.

      It is also interesting that on Figure 6A, actin bundles look different than the rest of the figures on the paper. It almost looks like actin bundles become branched, whereas in the other Figures actin bundles are either singular or two-three bundles joined together at the point very close to the edge of micropatterned lipid bilayer.

      Authors answer:

      This is correct. In this experiment several bundles co-aligned. As mentioned by the reviewer this could also be visible in other conditions without Tau (such as in Figure 4E), and, as shown below, this structure of bundle was not visible in all fields we looked at. So we don’t think this structure is responsible for the changes we measured in the ability of microtubules to penetrate the actin network in the presence of Tau.

      Minor comments<br /> In the legend of Figure 4E, it should be written "white arrow" instead of "yellow arrow".<br /> In the Results section "crosslinking between microtubules and actin bundles increase piercing frequency", in the sentence number 7, it should be written "backwards" instead of "reaward".

      Authors answer: We modified the text and legend according to the reviewer suggestions.

      Reviewer #1 (Significance):

      The experimental setup of the paper is quite significant in the field, given the difficulty of observing dynamics of dense cytoskeletal structures in living cells. Moreover, the paper gives insight into how microtubule behavior can vary depending on different morphological states of actin network.

      Authors answer: We thank the reviewer for his/her overall very positive feedback on our manuscript.

      Reviewer #2 (Evidence, reproducibility and clarity):

      The authors developed a novel in vitro system to investigate the interaction of dynamic microtubules with the F-actin network. While this system does produce some interesting results, it is unclear how exactly this replicates or explains what might happen near a cell's leading edge. There is a limited characterization of the produced F-actin networks. For example, it is unclear to what extent the F-actin networks are similar or different to cell lamellipodial networks. What is the density / expected mesh size of these networks and could that be varied / manipulated? The bottomline observation that microtubules can grow into F-actin networks if they have nowhere else to go does not seem particularly ground-breaking, and the discussion is very shallow. Overall writing could be improved; there are lots of typos and grammatical inconsistencies. The second paragraph of the introduction is a bit convoluted.

      Authors answer:

      We thank the reviewer for his/her comments. Figure 1 was used to illustrate the behavior of microtubules encountering actin networks in cells and the fact that they struggle to penetrate actin network. This is only a way to argue that the penetration of actin network is a relevant question, that cannot be easily addressed in cells. However, it is correct that our in vitro systems, as it is the case for all in vitro reconstituted systems, cannot tend exactly to reproduce a lamellipodial cellular network. But it offers a better way to modulate actin network architecture. We have used in vitro systems to characterize the different behavior of microtubules when they encounter dense actin networks in different conditions, guided or not by actin bundles, constraint or not at the two ends.

      The observation that microtubule can penetrate actin network when pressurized might not be “ground breaking”, still it contradicts previous works showing that microtubule under pressure tend to depolymerize (Janson et al, J Cell Biol, 2003), which would obviously prevent them from penetrating actin networks. So, our conclusion was somehow unexpected.

      We found important to discuss the fact that although the microtubule polymerizing forces is sufficient to breach dense actin network, it must be counteracted by another mechanism immobilizing microtubules. This means that in cells, expression level of actin-microtubule crosslinker modulate the penetration of microtubule into the lamellipodium.

      However, we agree that the second paragraph of the introduction is not absolutely necessary and removed it.

      Specific comments:

      Fig. 1 seems a bit anecdotal. The authors revisit an observation that has been made before. I can see how it is used as rationale for the in vitro system, but not sure that this adds much to the overall story. Clearly different cell types are different, but without some sort of quantification this remains meaningless. It should also be noted in the discussion maybe that there are large differences between cells in 2D and 3D. Microtubules much more frequently grow to the cell edge compared with 2D (see Akhmanova SLAIN2 paper from some years ago).

      Authors answer:

      We agree with these comments. Indeed, Figure 1 is used only as an illustration of the behavior of microtubules encountering actin network in cells. As the reviewer said, microtubule penetration and actin architectures will both vary a lot from one cell type to another. So we believe that quantification for these particular cases will not extend the illustrative purpose of this figure where it is already clear that some microtubules can penetrate and other can’t.

      Fig. 2: While Arp2/3 certainly promotes branched F-actin networks, from the data provided it is not clear to me to what extent the produced F-actin networks replicate F-actin organization at the cell edge. If this a the point the authors are trying to make, the ultrastructure of their in vitro networks needs some additional characterization. As far as it is possible to discern from the data provided, the F-actin meshwork on the stripes in E looks pretty much identical in both panels (and not really like a dendritic network that in a cell also would have a certain polarity with barbed ends facing out), and the bundles on the left don't look like anything that normally occurs in a cell.

      Authors answer:

      We also agree with these comments. The networks we assembled are not lamellipodial-like networks, there are branched network of various densities, with or without bundles. It is true that bundles of filaments do not grow out of lamellipodial network in cells. However, bundles of aligned and linear filaments exist in cells, in the form of radial fibers or transverse arcs, along which microtubule tend to align. And these structures might guide microtubules toward cell protrusions, as it is the case in growth cone for example.

      Fig. 4 It is unclear what is going on here. Given that without F-actin bundles, polymerizing microtubules are freely moving around, it does not come as a surprise that they would never penetrate the F-actin network because as the authors correctly state the growing end will push back from the barrier. So, then why do they sometimes penetrate when bundles are present? In 4A it appears that microtubule growth into f-actin only happens once the microtubule minus ends gets stuck between F-actin bundles on the other side. 4D is the same as 4A; so that makes me think this really does not occur that often. Does the microtubule plus end only penetrate the F-actin meshwork when the minus end gets stuck on the other side? This seems important and also means microtubule penetration may not have anything to do with the F-actin network architecture at the plus end. This needs to be quantified.

      Authors answer:

      This is perfectly correct. In figure 4 the two actin networks are distant, and the microtubules only rarely penetrate them because they are rarely in contact with them at both ends. This occurs only when bundles orient microtubules perpendicular to the edges of the actin network, since in this configuration the distance between the two actin networks is shorter. Hence our motivation to bring actin networks closer to each other in figure 5.

      Fig. 5 I guess that sort of solves my confusion with Fig. 4. The quantification graphs in 5B and 5C are flipped with respect to the figure legend (?).

      Authors answer:

      Indeed, in this figure we distinguished the role of pressure (when both microtubule ends are in contact with actin networks) and the role of alignment with actin bundles. And found that the presence of bundles is useless and that only pressure matters.

      I understand the rationale for not considering microtubules that grow at a shallow angle, but there does not seem to be that much of a difference between 5B and 5D. Wouldn't a better quantification simply compare microtubules that contact F-actin at both ends compared with microtubules were the minus end is free. In this case, I would expect a very large difference in penetration.

      Authors answer:

      This is also correct. The difference is so important that when one end is free the microtubule never penetrate. We mention it in the text but did not plot these data. This is why we measured only microtubule with both ends contacting an actin network and did not consider the one at shallow angles.

      We added the illustration of the condition with short distance and actin bundles (shown below) to make this more clear in the figure.

      The small difference between 5B and 5D shows that by eliminating those microtubules there is no more difference between the conditions with or without bundles. And thus that their contribution in favoring microtubule penetration was to favor optimal orientation to get pressurized at the two ends rather than offering a sort of favorable network organization at their base. However, we agree with the reviewer that the absence of difference between the two populations, with or without actin bundle, when considering only microtubule interacting with actin at angles higher than 30° is not quite striking. We tested all angles (see below) and found that actually the absence of difference is more obvious when considering microtubules interacting with more than 60°. And the analysis of angle distribution, now reported in Figure 5D, showed that in both conditions most microtubules interact with more than 60°, so we only exclude few outliers by considering those that interact with more than 60°. So we changed the presentation of our data in Figure 5C by changing the threshold from 30 to 60°.

      Do microtubules under pressure ever bend/buckle in this in vitro situation. As the authors state, in cells, that happens frequently. This difference is interesting. Why?

      In vitro microtubules buckle homogeneously between their two ends. These long buckling wavelengths are not very spectacular. In cells, microtubules are crosslinked to actin filaments or other structures over shorter distances (see quantification below). This leads to buckling with shorter wavelength, which is more striking.

      It is customary to refer to polymerized actin as F-actin.

      The supplementary videos are not referenced in the manuscript.

      Authors answer:

      We apologize and have now referenced the supplementary video in the manuscript.

      Reviewer #2 (Significance):

      The manuscript describes results from a novel assay to study interactions between F-actin networks and dynamic microtubules in vitro. While of interest to a specialized audience, the overall finding that microtubules can grow into an F-actin meshwork is somewhat incremental especially because of the limited characterization of the F-actin networks used. It remains unclear to what extent this is relevant to a physiological context in cells.

      My field of expertise is related to cytoskeleton dynamics and quantitative microscopy in live cells.

      Authors answer:

      Although intuitive, the demonstration that the density of actin network can prevent microtubule penetration is novel. More importantly, the demonstration that anchoring of microtubule is sufficient to increase the pressure to such a point that microtubule can then penetrate those networks is also novel and significant to appreciate when and how they do so in cells.

      Reviewer #3 (Evidence, reproducibility and clarity):

      In this paper, the authors present an in vitro assay designed to explore the dynamic interaction between growing microtubules and pre-existing actin networks. Notably, the presence of linear actin bundles facilitated the movement of polymerizing microtubules along actin filaments. When microtubules were immobilized to two spatially separated actin networks, they exhibited the ability to breach and penetrate dense actin meshworks. This penetration was attributed to the mechanical pressure generated by microtubule polymerization. The authors tested tau as a microtubule-actin crosslinking protein in this process and found that tau promoted microtubule penetration into dense actin meshwork. Although the findings in this paper are potentially significant, the work is still in its preliminary stage and the scope is limited.

      Authors answer:

      We thank the reviewer to summarize properly the main findings of our manuscript.

      1. The authors observed that the inclusion of tau, a microtubule-associated protein known for its role in promoting microtubule polymerization, significantly facilitated microtubule penetration into dense actin meshworks. This enhancement is likely attributed to tau's ability to promote microtubule polymerization, generating stronger forces within the microtubules that enable them to breach the actin meshworks. To validate the involvement of the crosslinking function in the process, the authors should explore the effects of other microtubule-actin crosslinking proteins in their assay.

      Authors answer:

      We thank the reviewer for this interesting suggestion regarding the role of Tau in our experiments. To address this comment, we have analyzed the rate of growth in our experiments in presence and absence of Tau (see quantification below). We found that the construction of Tau we used reduced microtubule growth rate. Therefore, we believe that microtubule growth was not responsible for the improved penetration of microtubule in dense actin networks in our assay, and that it was rather the crosslinking ability of Tau that played a significant role.

      1. The paper highlights the importance of anchoring both ends of microtubules to two adjacent actin networks for successful penetration into the actin meshworks. However, the precise mechanisms by which these microtubule ends are anchored to actin filaments are not elaborated upon. Providing detailed insights into this anchoring process would enhance the readers' comprehension of the experimental setup and its relevance to the observed results.

      Authors answer:

      We apologize for this lack of clarity. We don’t think that microtubule ends are “anchored” to the actin network. They are simply embedded into it. This embedding prevents them from moving rearward and thus lead to pressure increase as they polymerize.

      1. Additional information on the experimental methods is warranted to improve the reproducibility and clarity of the study. Specifically, the authors should elucidate the process through which nucleation-promoting factors were grafted onto lipid bilayers. This detail is crucial for researchers seeking to replicate or build upon the study's findings.

      Authors answer:

      We apologize for this lack of clarity. There was indeed an error in our description of SUV preparation with lipid-biotin. We have now revised our material and method section. In particular we have described more accurately the various steps we used to micropattern WA-streptavidin onto lipid-biotin.

      1. In Fig. 5D, the authors observed no significant difference in the breaching probability between microtubules that contacted the actin meshwork at an angle higher than 30°, with or without actin bundles. To ensure a better comparison, it is advisable to focus on quantifying the microtubules that are contacting two actin meshworks at both ends (the immobilized microtubules), as they would have similar probabilities of being pressurized by their growth. Moreover, further justification is required to explain the choice of 30° as the threshold angle and its significance in the context of microtubule behavior.

      Authors answer:

      We thank the reviewer for this comment. We apologize for the confusion. The quantification we made is precisely the one described by the reviewer. We made this more clear by adding further illustration of the two conditions and the measurement made.

      1. Fig. 5C appears to depict the "Distribution of the angle of the interaction of microtubules in the presence (10nM of Arp2/3 complex) or absence (100 nM of Arp2/3 complex) of actin bundles" instead of the "proportion of microtubules piercing the branched actin network." The alphabet labels in the figure should be updated accordingly. Additionally, the authors should clarify whether a comparison was conducted between the means of the angles in the two conditions and whether any observed differences were statistically significant.

      Authors answer:

      We apologize for this confusion. We updated the figure legend in which 5C and 5D were inverted.

      1. Investigating the potential significant difference in the mean interaction angles between the absence and presence of actin bundles would be intriguing. The presence of actin bundles might indeed influence the interaction angle or contact position, potentially increasing penetration frequency. This insight would further enrich the findings and provide valuable context for understanding the interplay between microtubules and actin networks.

      Authors answer:

      We apologize for this confusion. We now report the statistical difference. And indeed, it accounts for the difference it the penetration frequency, as shown by the absence of difference when we consider only microtubules that are more or less perpendicular to the network. This is indeed one of the most significant conclusion of our work. We added some schematics to make this clearer.

      1. More comprehensive information about the statistical analyses should be provided. This'd be important for the validity and reliability of the study's conclusions.

      Authors answer:

      We apologize for this lack of clarity. The statistical analysis we performed were not described in the Materials and Methods section but in each figure legend.

      Reviewer #3 (Significance):

      The work represents an advance in understanding the mechanism by which microtubules navigate dense actin meshworks.

      Authors answer:

      We thank the reviewer for this positive evaluation of our work.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reviewer #1 (Evidence, reproducibility and clarity):

      Summary:<br /> In this study, the authors delineate the association of paralog dispensability with the frequency of homozygous deletions (HDs) and thereby show that paralog dispensability can play a significant role in shaping tumor genomes. The authors analyzed the strength of negative selection on the paralogs relative to the singletons using frequencies of the homozygous deletions (HD). The study focused on HDs because they ensure a complete loss of function, unlike other mutational aberrations that can be masked because of haplo-sufficiency. While accounting for potential confounding factors, authors find that paralogs tend to have a relatively high frequency of HDs, suggesting a relaxed negative selection. Furthermore, the authors specifically attribute this association to the dispensable paralogs by analyzing gene inactivation data generated from multiple experimental systems. Overall, the findings of this study can potentially have significant implications in cancer biology field and specifically to the researchers studying cancer genome evolution.

      We thank the reviewer for the careful reading and positive assessment of our manuscript

      Major comments:

      1. To dissect further which dispensable paralogs are more likely to be associated with a high HD frequency, synthetic lethal paralogs could be compared with non-synthetic lethal ones.

      In the section titled 'Homozygous deletion frequency of paralog passengers is influenced by paralog properties' (begins from line #289), authors have shown that paralogs with a high frequency of HDs are more likely to have the properties of dispensability (in Figure 4). It seems that all of those properties are also associated with synthetic lethality as the authors identified in their previous study (DeKegel et al. 2021). Furthermore, as shown in the subsequent section ('Essential paralogs are less frequently homozygously deleted than non-essential paralogs', begins from line #344), the high HD is associated with the dispensable paralogs. Some of those dispensable paralogs are expected to be synthetic lethal. Therefore, the association of paralogs with a high frequency of HDs with experimentally validated or predicted sets of synthetic lethal paralogs could be tested. This may help authors to contextualize their findings in terms of genetic interactions between paralogs.

      We thank the reviewer for highlighting the potential relationship with our previous work. We agree that many of these properties are associated with synthetic lethality, but we note that they are also associated with single gene essentiality. This makes the relationship between synthetic lethality, essentiality, and deletion frequency somewhat difficult to dissect.

      Nonetheless we have tested, in a number of ways, whether there is a relationship between a paralog having a reported/predicted synthetic lethality and being homozygously deleted. We find no obvious connection between the two.

      We first tested using a set of synthetic lethal interactions identified by integrating molecular profiling data with genome wide CRISPR screens in a large panel of cancer cell lines (the data used to train the classifier in De Kegel et al, 2021). As there is an ascertainment bias in this dataset (paralogs must have frequent loss of function alterations / silencing to be tested) we restricted our analysis to only those paralog pairs tested for synthetic lethality. We identified no clear pattern (p>0.05, Fisher's Exact Test).

      We next tested using an integrated set of four combinatorial CRISPR screens (aggregated in De Kegel et al) where we considered a pair to be synthetic lethal if it was a hit in any screen and not synthetic lethal if it was screened at least once and never identified as a hit. Again we restricted our analysis to paralogs that were present in this dataset to prevent issues with ascertainment bias. We found no clear association.

      We further tested using a consensus dataset derived from the same combinatorial screens, where a pair were marked as synthetic lethal if they were identified as a hit in at least two screens and not synthetic lethal if they were screened at least twice and never identified as a hit. Again we restricted our analysis to paralogs that were present in this dataset and found no clear association.

      We finally tested using our predicted synthetic lethal interactions – annotating the top 3% of predictions as synthetic lethal and the remainder as non-synthetic lethal. The 3% threshold is similar to the observed frequency of synthetic lethality in the training set. In this case, as this dataset covers all paralogs considered, no restriction was necessary.

      None of the above analyses revealed a clear relationship between deletion frequency and synthetic lethality. A caveat of these analyses is that none of the experimental datasets are complete (covering only a minority of all paralog pairs) and they are all somewhat noisy. Furthermore, as we show in our modelling analysis (Fig S3) the observed homozygous deletions are far from saturating.

      However we think there may be a simpler explanation, beyond limitations of the data, for why we do not observe a relationship between HDs and synthetic lethality.

      As the reviewer notes, there is evidence in cell lines that one reason paralogs are more dispensable than singletons is because of buffering / redundant relationships as revealed by synthetic lethal interactions. These relationships therefore provide an explanation for why some paralogs are dispensable. As our primary claim is that paralogs are more frequently deleted because they are more dispensable we might anticipate a relationship between deletion frequency and synthetic lethality. However, by definition, synthetic lethal interactions can only be observed for non-essential (dispensable) genes. Therefore when analysing the overlap with synthetic lethal interactions we are primarily restricting our analyses to genes that are already individually dispensable. Consequently we might not anticipate observing any enrichment. The buffering relationship revealed by synthetic lethality provides an explanation for why a paralog is dispensable but once we are restricting our analysis to dispensable paralogs we do not necessarily expect to see further enrichment.

      We think that an ideal way to explore this question further would be to look at selection on deletions of pairs of paralogs – we anticipate that if a gene is dispensable because of paralog buffering then both paralogs should not be deleted simultaneously. However, the current copy number datasets are too small to evaluate such pairwise relationships. This is discussed in manuscript as follows:

      Analyzing the frequency with which two members of a paralog family are lost would provide more direct insight into the contribution of paralog redundancy, but due to the overall rarity of passenger gene HDs, we cannot make a comprehensive assessment of co-deletions here – e.g. among paralog pairs where both genes are non-drivers, and not on the same chromosome, only two pairs are co-deleted in at least one TCGA sample. Larger cohorts would also allow us to search for patterns of mutual exclusivity of HDs to identify genetic interactions – this has been applied for identifying interactions between driver genes [57,58]__, but is more challenging for interactions between non-driver genes, which are much less frequently altered.

      Minor comments:<br /> 1. The number of TCGA and ICGC tumor samples analyzed:<br /> As mentioned in the Results section (line #106), 9966 tumor samples were analyzed. However, the sample size mentioned in Figure 2A is 9951. Is the lower number shown in the figure due to the filtering procedure mentioned in the Methods section (line #455)? The change in sample sizes could be explained. A similar difference in sample sizes exists for the ICGC data also.

      The difference was indeed due to filtering process, but numbers were only provided in the methods. We have now addressed this in the main text :

      After removing a small number of ‘hyper-deleted’ samples (see Methods) we retained 9,951 samples for further analysis.

      1. The rationale behind setting the threshold at 100 HD genes to classify 'hyper-deleted' samples for TCGA (line #462) and ICGC data (line #473) could be explained.

      We excluded hyper-deleted samples to avoid any individual sample having undue influence on the genes observed to be ever deleted or indeed to influence the overall patterns observed. It is also common in analyses of selection in tumours that make use of mutational profiles (rather than copy number profiles) to exclude hypermutated samples (e.g. Martincorena et al, Cell 2017; Lopez et al, Nature 2020). However the exact threshold of 100 samples was somewhat arbitrary and this query prompted us to assess whether it had any significant impact on the results.

      We therefore repeated all analyses using a more stringent threshold (50 samples) and also without thresholding. Although the exact percentages and odds-ratios vary somewhat with the different thresholds, all major conclusions are still supported.

      We appreciate that this was minor comment and that reviewer did not request this new analysis, but in the absence of a strong justification for a single threshold we felt it appropriate to assess multiple thresholds (and none).

      1. Citation for DepMap is missing (caption of Figure 5). We have added the text below to the legend for Figure 5 :

      Essential genes for the DepMap dataset (Meyers et al, 2017) are obtained from a version of the data reprocessed in (De Kegel et al, 2021) to reduce off-target sgRNA effects (see Methods).

      CROSS-CONSULTATION COMMENTS<br /> Along the lines of Reviewer #3's second major comment, I have a suggestion, the possible benefits of which would depend on the target audience to which the authors intend to communicate their study.

      I would suggest including a brief comparison of the findings of this study which deal with human paralogs, with the findings in model organisms such as yeast, perhaps in the discussion section. To facilitate such a comparison, authors could try measuring the enrichments of, for example, molecular functions, gene families, types of genetic interactions, etc., among the paralogs associated with a high frequency of HDs and then discussing their comparison with what is known in the literature for paralogs in other model organisms that tend to be frequently deleted.

      Such a comparison could be of interest to the community of researchers working on other model organisms and put this study in a much broader context. However, as I said before, this would depend on the authors' intended target audience.

      We thank the reviewer for the suggestion. We have added an additional section to the discussion highlighting differences and similarities to the observations from yeast as follows:

      Much of our understanding of the factors that influence gene dispensability comes from studies in model organisms, in particular the budding yeast Saccharomyces cerevisiae [3,9,10,43,44]__. Analyses of the yeast gene deletion collection, a set of gene deletion mutants systematically generated in a single S. cerevisiae strain, revealed that paralogs were less likely to be essential than singleton genes [3,45]__. Furthermore, more detailed analyses of yeast paralogs revealed that paralogs from large families were less likely to be essential as were genes with highly sequence similar paralogs [43,44]__. Previous analyses, including our own, demonstrated that many of these trends are also evident when analyzing gene essentiality from CRISPR screens in cancer cell lines [12,13,15,35]__. Our results here are also consistent with these findings – many of the features that are associated with paralog dispensability in yeast are also associated with gene deletion frequency in tumor genomes.

      The connection between the budding yeast observations and those in cancer is less clear when it comes to the relative dispensability of WGDs and SSDs. Analyses of the yeast gene deletion collection revealed that SSDs are more likely to be essential than WGDs in the single genetic background studied [43,44]__. In our previous analyses of gene essentiality in hundreds of cancer cell lines we found that SSDs were more likely to be broadly essential (essential in most cell lines) than WGDs but that WGDs were less likely to be never essential (i.e. more likely to be essential in at least one cell line)__[13]__. As the analyses of gene essentiality in budding yeast were generated in a single genetic background the concordance with our cancer cell line results was difficult to assess, but as gene deletion collections are now being generated in additional yeast strains it should become possible to perform a more direct comparison__[46–48]__.

      Here we found that WGDs are less likely to be deleted than SSDs in tumors. This is surprising in light of the yeast gene deletion collection results, where SSDs were more likely to be essential than WGDs in the strain studied, but less so in light of the cancer cell line results, where WGDs were less likely to be never essential. It is also worth noting that experimental evolution studies in yeast found that SSDs accumulate protein-altering mutations at a higher rate than WGDs [49,50]__. These results are perhaps especially relevant when analyzing the influence of paralog features on selection in tumors.

      We note that there are many additional differences in the features of WGDs and SSDs in budding yeast that may alter their relative dispensability in tumors. An obvious large scale difference is that in the ancestor of humans there were two rounds of whole genome duplication compared to a single duplication event in yeast__[51,52]__. Less obvious, but potentially of importance for cancer, is that the two classes of paralogs are enriched in pathways in humans that do not have obvious counterparts in yeast. For example, WGDs are highly enriched in signaling pathways involved in development while SSDs are enriched in immune response genes__[53]__. How the membership of these pathways influences the dispensability and selection of genes in tumors and cancer cell lines warrants further study.

      Reviewer #1 (Significance):

      As the authors note in their manuscript, it is expected that paralog dispensability could be associated with the relaxed negative selection in tumor genomes because (1) paralogs are prevalent in the human genome, and (2) many of them are dispensable, as apparent from the large-scale gene inactivation screens in hundreds of cancer cell lines (Blomen et al. 2015, Wang et al. 2015, Dandage and Landry 2019, De Kegel and Ryan 2019). However, direct mapping of this association, while importantly accounting for potential confounding factors, has been lacking.<br /> As a researcher with prior experience in the research topics such as gene duplication and genetic interactions, it appears to me that this study presents formal proof of the important association between paralog dispensability and tumor genome evolution which could be of major implication for the research community of cancer biology field and specifically to the researchers dealing with the topics such as cancer evolution, copy number alterations in cancer genomes, and synthetic lethality-based precision oncology therapeutics.

      Thank you again for the positive assessment.

      Reviewer #2 (Evidence, reproducibility and clarity):

      Summary

      Here, De Kegel & Ryan analyse thousands of tumour samples from the TCGA and ICGC projects to identify homozygously deleted genes, finding that about 40% of protein-coding genes are deleted in at least one sample. They find homozygously deleted genes to be enriched for paralogous genes, and further, more frequently deleted genes are increasingly likely to be paralogs. The authors then test the influence of several factors on the likelihood of being deleted, including gene length, distance to a fragile site or chromosomal region, and distance to a recurrently deleted tumour suppressor gene (TSG). They find that proximity of a TSG, telomere, centromere, and fragile site all increase likelihood of being deleted in a sample, as does gene length. Having a paralog also remains an important predictor of deletion after accounting for these other factors. Additionally, the more similar in sequence the closest paralog is to the gene and having a larger gene family size are also predictive of deletion. Conversely, if a gene is a whole genome duplicate as opposed to a small-scale duplicate, it is less likely to be deleted. Finally, the authors test the hypothesis that paralogs that are deleted in cancer are less likely to be essential and find that this is indeed the case.

      Comments

      The authors have done a good job of identifying trends of paralog deletion in cancer samples and the factors influencing them. The results are well described and presented and support the conclusions. I like the inclusion of the saturation analysis as an estimate of what to expect given current and potential future sample sizes, and I appreciate the inclusion of a WGD/SSD paralog distinction. The data and methods are sufficiently detailed. I have a few minor comments below.

      We thank the reviewer for the careful reading and positive assessment of our manuscript

      1. Around line 160 in the text and supplemental figure 4A, the authors test if the trends they see are observed across individual cancer types. With 9 of 33 cancer types reaching a sample size threshold, 8 of 9 comparisons are significant. The authors do not state correcting for multiple testing.

      We have now also assessed the significance of the results after performing a Holm-Bonferroni correction for multiple hypothesis testing and find that all 8/9 cancer types remain significant.

      1. I initially misunderstood the hemizygously deletion analysis, thinking the analysis in supplement figure 4B/C was asking if a sample has any singleton or any paralog deleted and comparing the number of samples with any deletion of either - given the number of genes deleted per sample this wouldn't make sense as a good test. I think the authors are actually comparing the number of loss-of-hemizygosity events per gene and grouping by paralog/singleton. I think this is a good analysis, but I think it would be helpful to clarify this in the text and figure legend e.g. "Samples w/ gene LOH" could be "LOH events per gene" or something similar.

      As suggested we have now updated the y-axis label in these charts to ‘LOH events per gene’. We note that there are now two additional panels in this figure to address copy neutral LOH, per Reviewer 3’s request.

      1. Occasionally, I wanted some more detail in the text for context, which was sometimes later provided - e.g. I noted when reading about line 125 that I was curious at this point how often TSGs occurred on segments, and this was later provided on line 241. Similarly, around line 114 I was curious how many genes are typically deleted per HD segment, for which the median value was provided on line 206 (and distribution in supplemental figure 1), and again for hemizygous deletions. I think sometimes it would be helpful to provide this context earlier in the text to aid interpretation of the results.

      We thank the reviewer for these suggestions which we have now incorporated into the text.

      On line 115 (previously 114) the relevant sentence now reads:

      Typically an HD that results in the loss of a protein coding gene also results in the loss of several chromosomally adjacent genes – in the TCGA dataset a median of three genes are lost per gene-deleting HD segment

      On line 124 the relevant sentence now reads:

      We found that almost half (49%) of the HDs that result in the loss of at least one protein coding gene overlap a known tumor suppressor.

      1. In the discussion, on line 420, the authors include the point that a paralog might not be required at all in a tumour cell and therefore easily deleted. I think this possibility could be expanded on here and in the introduction/results section, as it is an important point. I think it would be helpful to include more about the possibility that a paralog might be deleted in a tumour cell because it is simply not required or that is more likely to have less of a phenotypic impact compared to a singleton, and that this could be a reason for the observed enrichment of paralogs in deleted genes. A citation to support this point could be Áine N O'Toole, Laurence D Hurst, Aoife McLysaght, Faster Evolving Primate Genes Are More Likely to Duplicate, Molecular Biology and Evolution, Volume 35, Issue 1, January 2018, Pages 107-118, https://doi.org/10.1093/molbev/msx270. Duplicate genes can be duplicates because copy number variation of them has minimal impact.

      We thank the reviewer for raising this important point.

      We have briefly addressed this in the introduction as follows:

      In multiple model organisms, paralogs have been demonstrated to be more dispensable than singletons (genes without a paralog) [3–5]__. There are a number of reasons for why a paralog might be more dispensable than a singleton gene, including preferential retention of duplications of non-essential genes [6,7]__, but perhaps the most obvious explanation is buffering between paralogs.

      Where references 6 and 7 are as follows:

      1. O’Toole ÁN, Hurst LD, McLysaght A. Faster Evolving Primate Genes Are More Likely to Duplicate. Mol Biol Evol. 2018;35: 107–118.
      2. He X, Zhang J. Higher duplicability of less important genes in yeast genomes. Mol Biol Evol. 2006;23: 144–151.

      We discuss this more comprehensively in the discussion as follows:

      In both yeast and cancer there are a number of reasons for why paralogs might be more dispensable than singleton genes. Perhaps the most obvious is the existence of buffering relationships between paralog pairs, such that when one paralog is lost the other paralog can compensate for this loss. Such buffering relationships between paralogs can be revealed through synthetic lethality screens and a number of recurrently deleted paralogs in cancer have already been reported to display synthetic lethal interactions with their paralog (recently reviewed in [54]__). Supporting this model, in previous work analysing essentiality in cancer cell lines we found that buffering relationships between paralogs could explain 13-17% of cases where a paralog was essential in some cell lines but not others__[13]__. This suggests that at least some of the increased dispensability of paralogs in cancer cells can be attributed to buffering relationships between paralog pairs. However this is not the only explanation for paralogs displaying increased dispensability in tumour cells. An additional explanation is that paralogs may perform essential functions in specific contexts (e.g. within specific tissues or at specific developmental stages) but are not required within the specific context of a tumour. Consistent with this model, human paralogs are more likely to display tissue-specific expression patterns [55]__. Finally we note that there is evidence to suggest that genes whose perturbation has a lower phenotypic impact may more ‘duplicable’ – i.e. rather than paralogs being under weaker selection because they are duplicated, their duplication was tolerated because they were already under weaker selection__[6,7]__. Teasing apart the relative contributions of these factors to the increased dispensability of paralogs in cancer will require further research and potentially new data resources such as gene essentiality profiles in diverse non-cancer cell types [56]__.

      CROSS-CONSULTATION COMMENTS<br /> I agree, that's a helpful suggestion from reviewer 1.

      Reviewer 3's suggestion regarding age of the two whole genome duplication events is quite difficult to unpick as the duplication events seem to have happened relatively close in time to each other while rediploidisation of the first was occurring. Additionally, paralogs from SSDs tend to be more similar in sequence simply because the two WGD events are relatively old while SSDs can occur at any time up to present. They're therefore biased by young duplicates that have not had the opportunity to diverged much and decrease in sequence similarity.

      We appreciate these comments.

      Reviewer #2 (Significance):

      This is a novel study as it examines the frequency of paralog deletion in cancer samples and the factors influencing it, building upon work already conducted in cancer cell lines. This study extends the knowledge of the field confirming previous trends observed in cell lines, this time in actual cancer samples. It confirms that paralogs are more dispensable than singletons, likely because they have a similar counterpart that can provide some level of functional redundancy. The more similar the closest paralog, the more likely it is to be deleted provides support for this.<br /> It is certainly limited by the number of samples currently available in the two cancer sample projects included but the authors attempt to quantify how limiting this sample size is by conducting a saturation analysis using down-sampling to estimate how many gene deletions one can expect from different numbers of samples. This is important as the lack of observance of many gene deletions is likely due to the limited sample size and not due to negative selection. This low observance of gene deletions disappointingly limits further testing beyond single paralogs to consider the deletion effects of multiple gene family members and more directly test evidence of functional redundancy between paralogs. The authors provide a good discussion of the limitations of their study.

      The results are of interest to evolutionary biologists and cancer biologists. Those with an interest in duplicate genes, and/or factors affecting gene loss in tumours will be interested in this work.

      My field of expertise is molecular evolution, gene duplication and copy number variation.

      We thank the reviewer for the positive assessment of the significance of our work.

      Reviewer #3 (Evidence, reproducibility and clarity):

      Thank you review "Paralog dispensability shapes homozygous deletion patterns in tumor genomes" by DeKegel et al. This manuscript uses TCGA and ICGC tumor data to show evidence for paralog dispensability. They analyze the rate of homozygous deletions and show that it is higher for paralogs compared to singletons. Their findings are robust to a number of confounding variables that they take into account e.g. distance to tumor suppressor, telomere, centromere or fragile site. They show that paralogs that belong to large families and have higher sequence identity tend to show more dispensability and these dispensable paralogs are less likely to be WGD.

      We thank the reviewer for the time taken to review our manuscript.

      Major comments.<br /> 1. Does the finding pertaining to lack of enrichment of paralogs in regions LOH take into account whether LOH is copy neutral or not i.e. how does dosage affects this finding? Is it possible that there is a difference in paralog rate in LOH that results in total copy 1 and that the presence of copy neutral LOH masks the effect? Also, Integration of gene expression dataset would be helpful to resolve the difference between dosage paralog that compensate of the lack of their sister by upregulating their gene expression.

      In the submitted manuscript we focussed solely on LOH events where the copy number of one allele was 0 and the other allele was ≥1. These include copy loss events (total copy number = 1), copy neutral events (total copy = 2), as well as amplifications (total copy number > 2). The rationale for this approach was that we were interested in understanding whether the mechanism that was generating deletions was preferentially generating deletions in paralog-rich regions.

      However, we agree that understanding the influence of dosage is of interest here. We have therefore expanded the analysis in the paper to separately assess the enrichment of paralogs in copy neutral LOH regions (total copy number = 2) and copy loss LOH regions (total copy number = 1).

      As shown in the new updated Figure S4B we do not find an enrichment of paralogs in genes subject to either copy neutral LOH or copy loss LOH.

      The relevant section of the text on page 6 now reads :

      We do not find that paralogs are more frequently subject to LOH than singletons in either the TCGA or ICGC cohort (Fig. S4B-C); when considering all LOH segments we even see that singletons are slightly more frequently subject to LOH in the ICGC cohort (Fig. S4C, left), but when considering only focal LOH segments – i.e. segments whose length is less than half of the chromosome arm’s length, which is the case for all HD segments – there is no significant difference between paralog and singleton LOH frequency in either cohort. To assess whether gene dosage influenced the observed LOH frequency we further restricted our analysis to copy neutral LOH events (total copy number = 2) and copy loss LOH events (total copy number = 1) and again found no significant increase in deletion frequency of paralogs compared to singletons (Fig. S4B-C).

      Regarding the integration of gene expression to identify dosage compensation between paralogs – we agree that this is extremely interesting. However, it is quite challenging to address properly. Most paralogs are only observed to be homozygously deleted a single time and so statistically identifying how loss of one gene impacts the mRNA abundance of another is challenging. In the minority of cases where a paralog is recurrently deleted, often these deletions occur in samples from different cancer types and so integrating transcriptomic data still presents some technical challenges. Given this complexity, and as the question of dosage compensation is not central to our key observations, we have not integrated transcriptomic data here.

      1. Is the finding that paralogs are depleted among WGD is influenced by the age of WGD since there are 2 WGD events? Do SSD tend to be more or less similar by seq than WGD? This should be explored further since this observation is the opposite of what is observed in model organisms such as yeast whereby SSD are less functionally similar than WGD and often show properties similar to singletons than WGD.

      As noted by reviewer 2 in the cross commentary, it is extremely challenging to age the duplicates that arose from the WGD due to the close temporal proximity of the two whole genome duplication events. In the dataset of paralogs analysed used here, SSDs have lower average sequence identity than WGDs. However we note that both sequence identity and duplication type are included in our regression analysis (Figure 4D) and both are significantly associated with homozygous deletion frequently.

      This should be explored further since this observation is the opposite of what is observed in model organisms such as yeast whereby SSD are less functionally similar than WGD and often show properties similar to singletons than WGD.

      We do not actually think that our results are in opposition to the findings from model organisms. The bulk of studies on the functional consequences of deletions of SSDs/WGDs in model organisms are derived from analyses of the budding yeast gene deletion collection, which is generated in a single strain and grown in lab conditions. Consequently these studies report on which genes can be lost in a single genetic background when grown in rich media. We think it is not fully clear how these findings will apply in the context of a panel of genetically heterogenous tumours derived from multiple different cell types. We note that there are additional complexities when analysing human genes (tissue types, two rounds of WGD, metazoan specific pathways enriched in either WGDs/SSDs) that make a straightforward comparison with yeast challenging. We also note that although the results of analyses of the yeast gene deletion collection suggest that SSDs are more likely to be essential than WGDs, experimental evolution studies have demonstrated that SSDs are more likely to accumulate protein altering mutations than SSDs (Keane et al, Genome Research 2014; Fares et al, PLoS Genetics 2013). This is not what would expect based on the analyses of the yeast gene deletion collection, but is closer to what we observe for tumour genomes where SSDs are more likely to be homozygously deleted.

      We agree that we did not adequately discuss these issues in the previous version of our manuscript and so have added a new section to the discussion where we compare our results here with those from budding yeast:

      Much of our understanding of the factors that influence gene dispensability comes from studies in model organisms, in particular the budding yeast Saccharomyces cerevisiae [3,9,10,43,44]__. Analyses of the yeast gene deletion collection, a set of gene deletion mutants systematically generated in a single S. cerevisiae strain, revealed that paralogs were less likely to be essential than singleton genes [3,45]__. Furthermore, more detailed analyses of yeast paralogs revealed that paralogs from large families were less likely to be essential as were genes with highly sequence similar paralogs [43,44]__. Previous analyses, including our own, demonstrated that many of these trends are also evident when analyzing gene essentiality from CRISPR screens in cancer cell lines [12,13,15,35]__. Our results here are also consistent with these findings – many of the features that are associated with paralog dispensability in yeast are also associated with gene deletion frequency in tumor genomes.

      The connection between the budding yeast observations and those in cancer is less clear when it comes to the relative dispensability of WGDs and SSDs. Analyses of the yeast gene deletion collection revealed that SSDs are more likely to be essential than WGDs in the single genetic background studied [43,44]__. In our previous analyses of gene essentiality in hundreds of cancer cell lines we found that SSDs were more likely to be broadly essential (essential in most cell lines) than WGDs but that WGDs were less likely to be never essential (i.e. more likely to be essential in at least one cell line)__[13]__. As the analyses of gene essentiality in budding yeast were generated in a single genetic background the concordance with our cancer cell line results was difficult to assess, but as gene deletion collections are now being generated in additional yeast strains it should become possible to perform a more direct comparison__[46–48]__.

      Here we found that WGDs are less likely to be deleted than SSDs in tumors. This is surprising in light of the yeast gene deletion collection results, where SSDs were more likely to be essential than WGDs in the strain studied, but less so in light of the cancer cell line results, where WGDs were less likely to be never essential. It is also worth noting that experimental evolution studies in yeast found that SSDs accumulate protein-altering mutations at a higher rate than WGDs [49,50]__. These results are perhaps especially relevant when analyzing the influence of paralog features on selection in tumors.

      We note that there are many additional differences in the features of WGDs and SSDs in budding yeast that may alter their relative dispensability in tumors. An obvious large scale difference is that in the ancestor of humans there were two rounds of whole genome duplication compared to a single duplication event in yeast__[51,52]__. Less obvious, but potentially of importance for cancer, is that the two classes of paralogs are enriched in pathways in humans that do not have obvious counterparts in yeast. For example, WGDs are highly enriched in signaling pathways involved in development while SSDs are enriched in immune response genes__[53]__. How the membership of these pathways influences the dispensability and selection of genes in tumors and cancer cell lines warrants further study.

      Minor comments<br /> 1. There is a missing reference on line 55.

      We thank the reviewer for catching this oversight. We have now added a reference to Zerbino et al, NAR 2018 on this line.

      CROSS-CONSULTATION COMMENTS<br /> That's a good suggestion by reviewer 1. Homozygous deletion collection is available in yeast so these data can be used directly in addition tot he haploid gene deletion collection data.

      Since authors of this manuscript included in their analysis the comparison of WGD and SSD then they should do it more thoroughly. It is not sufficient what they presented here especially given that it contradicts the findings from model organisms.

      As noted above we have now added a significant discussion of the yeast findings and also of the SSD/WGD observations

      Reviewer #3 (Significance):

      This work provides the first systematic assessment of paralog dispensability specifically looking at homozygous deletions of paralogs across primary tumor samples and builds on the existing findings in cancer cell lines. It will be broadly interesting to those studying duplicated gene evolution and genome robustness. My expertise is in complex genetic networks in yeast and human cancer as well as genome evolution.

      We thank the reviewer for the positive assessment of our manuscript.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      We would like to thank all reviewers for taking the time to evaluate our manuscript. Many helpful suggestions and discussion points were raised. These comments were instrumental to provide more data that strengthen our conclusion about the relevance of centrin condensation in vivo, expand our findings to other organisms, and improve the manuscript in general. Details are given in the following individual replies.

      Reviewer #1 (Evidence, reproducibility and clarity):

      Voss and colleagues show calcium-dependent assembly of Plasmodium falciparum centrins in vitro and in parasites. This assembly is dependent on the EF-hands of centrin and an N-terminal disordered region.

      Major concerns:

      1. The very definitive title is not wholly supported by the data. This should be qualified by specifying the conditions under which the centrins can accumulate in this way.

      We understand this comment by the reviewer. There are multiple dimensions to the potential of centrins to condensate, such as the specific centrin family member, in vivo vs in vitro situation, and media conditions. Naturally it is difficult to represent these various conditions in a concise and compelling title but in line with the suggestion by Reviewer 2 we are changing the title to “Malaria parasite centrins can assemble by Ca2+-inducible condensation” to reflect the conditionality of this process.

      1. A major concern is whether this behaviour of centrins represents a biologically relevant mechanism in centriolar plaque formation. Is this limited to high overexpression conditions or in vitro high concentrations? Or is it a result of the tagging of the P. falciparum centrins?...

      Centrin accumulation at the centriolar plaque and assembly of the centriolar plaque itself must be differentiated. Although compelling we are already very careful in the text about extrapolating our findings about centrin accumulation in cells to centriolar plaque or centrosomal assembly in general. We, however, thank the reviewer for this important comment and now have carried out hexanediol treatment of wild type parasites to test the effect on centrin in a native context. After IFA staining we failed to detect any centrin foci at the centriolar plaques, suggesting that they can be resolved by inhibiting weak hydrophobic interactions that are typical for phase separation (now Fig. 6, lines 283ff).

      Concerning the effect of tagging we have generated new data of cells overexpressing an untagged version of PfCen1 in parasites, which still shows formation of ECCAs as revealed by IFA (now Fig. 4H-K, lines 243ff). This significantly alleviates the concern that the observed phenomenon is only a consequence of GFP-tagging. Our in vitro data already showed that native and tagged PfCentrin1 & 3 can undergo condensation.

      Concerning the critical concentration of our in vitro assay we find it to be around 10-15 µM without the addition of crowding agents such as PEG (now Fig. S3C, lines 120ff). To our understanding it is challenging to select an in vitro concentration that is adequate to define a threshold for “biological relevance” due to so many additional factors playing a role in vivo. Those factors can also favor a phase separation locally when total saturation concentration is not reached as we now discuss in more detail (lines 440ff). For reference the critical concentration of FUS, which is one of the most studied phase separating proteins in model system, is around 2 µM, but concentrations below 15 µM are well within the range of what is observed for in vitro LLPS. Additionally, it is important to consider that we find Cen1/3 and HsCen2 LLPS is inducible and reversible and that very homologous proteins i.e. Cen2 and 4 serve as an adequate internal control.

      … A convincing approach to addressing this issue would be to knock-in a fluorescent tag to the centrin loci. Roques et al. (ref. 12 in this submission) report the GFP tagging of centrin-4 in P. berghei, although they note that centrins-1 to -3 were refractory to tagging in this organism. It is unclear whether Voss et al. attempted this tagging in P. falciparum. This should be clarified and relevant data presented.

      We indeed attempted several unsuccessful iterations of tagging Cen1/3 with HA and GFP tag and now explain this in the text more clearly (lines 81ff). We did not attempt tagging Cen2 and 4 as they do not display phase separation in vitro or carry IDRs.

      If the tagged molecules used in the biochemical parts of this study are functional, it is challenging to understand why the centrins cannot be tagged in P. falciparum. If the tags render the P. falciparum centrins dysfunctional, the study becomes significantly less useful.

      Our data shows that in vitro Cen1-GFP can undergo Ca2+-inducible and reversible LLPS and that GFP-tagged centrins can still localize to the centriolar plaque. Centrin function, however, certainly goes beyond its ability to condensate and localize. It is easily conceivable that interaction with critical binding partners at the centriolar plaque is inhibited by tagging a protein as small as centrin, which prohibits tagging the endogenous version, while its ability to phase separate remains unaltered. To dynamically study a protein in cells tagging is, however, unavoidable. Even though tagging affects any proteins function to highly variable degree we are still convinced that studying those proteins still provides useful information. Our mutant versions of PfCen1 in vivo shows that non-condensating version display different localization. Importantly, as mentioned above, we now provide images of cells overexpressing an untagged Cen1 version, which still causes ECCA formation (Fig. 5H-K). Ultimately, even though tagged versions might not be fully functional, our observations are compatible with the ability of centrins to condensate in vivo.

      1. If a knock-in cannot be achieved, it must be shown that the transgenic expression of tagged Plasmodium centrins does not confound the analysis of centrin behaviour. It is known that these proteins can behave anomalously when overexpressed (Yang et al. 2010, PMID: 20980622; Prosser et al. 2009, PMID: 19139275), at least in other species.

      Thank you for this comment. Transgenic expression of proteins can in principle influence their behavior. In the context of this study the overexpression is, however, used intentionally since protein concentration correlates with the phase separation. Here, transgenic overexpression is used as a tool, rather than being a confounding factor, and ECCA formation can be used as quantifiable phenotype. The observation that ECCAs appear significantly earlier the higher they are expressed is in our opinion one of the stronger points of evidence that this result from phase separation in vivo. Yet centrins maintain their centriolar plaque localization and no significant impact on growth is observed. To definitely answer whether phase separation of endogenous centrin is occurring during centriolar plaque accumulation is challenging. These challenges and limitations are now addressed in the significantly extended discussion. As explained above untagged Cen1 also forms ECCAs.

      A previous description of centriolar plaque from the authors' lab (Simon et al. 2021, PMID: 34535568) shows an organized structure of an established size. It should be demonstrated whether the structures formed with the GFP tagged centrins show the same dimensions and dynamics as those in wild-type parasites. The extent of the overexpression of the GFP-tagged centrins should also be demonstrated.

      We thank the reviewer for this suggestion. We have now added spatial measurements of the centrin signal dimensions at the centriolar plaque of mitotic spindle containing nuclei in PfCen1-GFP overexpressing vs non-induced cell lines. We found that the width of the centrin-signal at the centriolar plaque was unaltered while the height only increased by 11% (Fig. S9). Further, we found no significant growth phenotype in overexpressing parasites, which indicates that the centriolar plaque is functional.

      Due to several confounding factors, we were, unfortunately, unable to clearly quantify the extent of overexpression. Most notably the induction of overexpression only works in about 50% of the cells (Fig. S6). The mean intensity after induction further displays quite some variability. Furthermore, the expression kinetics along the IDC of endogenous centrin and our overexpression system that we use as a tool differ. Lastly, our centrin antibodies display crossreactivity (see also Fig. S12) making it impossible to identify how much of the endogenous pool we are labeling in comparison to the GFP- tagged Cen1 protein.

      1. It would also be useful to remove the His tag from the recombinantly expressed and purified centrins for the in vitro analyses, particularly if concern remains about the impact of tags on Plasmodium centrin behaviour.

      Based on the published in vitro studies on other centrins, we did not anticipate the His-tag to change LLPS properties. Also, Cen1 and 3 and Cen2 and 4 would need to be differentially affected by the tag. We further have experimented with N-terminally tagged 6His-Cen3 protein and found no significant differences in our turbidity assays. Nevertheless, we expressed new versions of the recombinant PfCen1-4 proteins with a TEV cleavage site inserted after the His-tag to purify untagged proteins and found no fundamental differences in our LLPS assay aside some slight variation in the kinetics (Fig. S3E).

      1. The discussion is very short and does not consider the findings presented here in the context of the literature, with respect to centrins, Plasmodium MTOC assembly mechanisms, or to general considerations around biological condensates. Andrea Musacchio's recent commentary (ref. 44 in the current submission) advocates caution in ascribing phase separation as an assembly mechanism for organelles in vivo, particularly on the basis of in vitro experiments with high concentrations of homogeneous protein. It is not clear that the concentration dependence of extracentrosomal centrin accumulations (ECCAs) at the onset of schizogony provides sufficient justification of a phase separation model in vivo. The authors' recent description of the involvement of an SFI1-like protein, SIp (Wenz et al. 2023 PMID: 37130129), in the centriolar plaque makes a case for non-homotypic interactions also driving assembly and alternative models for ECCA are not convincingly excluded. The absence of a robust discussion of such considerations is unhelpful to the reader.

      We very much thank the reviewer for this suggestion, which helped to significantly improve the manuscript. We have purposefully included the commentary by Andrea Musacchio to highlight a different (possibly the most antipodal) point of view on the role of biomolecular condensation in membraneless organelle formation for the unfamiliar readers that might be just getting to know the field of phase separation. In the absence of word limitations, the reviewer is right to point out the lack of more extensive discussion. We now have significantly extended this section and address the suggested points including the potential role of the novel centriolar plaque protein Slp, which was not published upon submission of our previous version (lines 450ff.)

      1. It is also unclear whether the analysis of human centrin is suggested to indicate a phase separation mechanism for centrins in human cells. As this is readily testable, this notion could be considered further. Although its experimental examination may lie outside the theme of this study, one would expect some discussion of the significance of the data presented in the study.

      Since it is the first description of phase separation of centrin, it would indeed be interesting to explore the functional relevance in other organisms such as humans. We are considering approaching this in the future. We have, as requested above, significantly extended the discussion and now also include this aspect. Earlier reports have e.g. shown centriole overduplication in human cells upon centrin overexpression.

      Minor points

      1. There are only three centrins in humans. Centrin 4 is a pseudogene (Gene ID: 729338 on NCBI).

      Thank you for detecting this error, which we now corrected (line 60). Centrin 4 seems only to be an expressed gene in mice.

      1. Line 175 should say 'temporally', rather than 'temporarily. The Abstract should say 'evolutionarily conserved', rather than 'evolutionary conserved'. 'To condensate' is not ideal as a phrase- 'to form a condensate' would be clearer.

      Thank you for those suggestions. The text has been modified accordingly.

      Referees cross-commenting

      I think the other 2 reviewers have made fair, cogent and constructive points. There is good convergence between the reviewers on the significant issues around the study. These concern in vivo and in vitro effects of tagging and of high concentrations.

      Reviewer #1 (Significance):

      The biology of the Plasmodium centriolar plaque is of great interest as an alternative MTOC structure, with obvious additional interest deriving from the role of this organism in malaria. Much remains to be learned about this structure, so the topic of this paper is likely to attract a broad readership. Furthermore, the centrins are a widely-expressed and evolutionarily conserved family of eukaryotic proteins, with multiple roles; a new model for their behaviour, such as is suggested here, would be of interest to many cell biologists.

      With that in mind, significant additional data should be provided to substantiate the model proposed by the authors.

      We appreciate that the reviewer considers our manuscript of interest for a broad audience. We feel that our modifications of the text including a more thorough contextualization and addition of some new experimental data now sufficiently supports our claims.

      Reviewer #2 (Evidence, reproducibility and clarity):

      The authors analyzed the properties of the four Centrin proteins of the malaria parasite using a combination of in vitro and in vivo approaches. Their findings indicate that two of the four Plasmodium Centrin proteins, PfCen1 and PfCen3, as well as the human Centrin protein HsCen2, exhibit features of biomolecular condensates. Moreover, analysis of cells overexpressing PfCen1 indicates that such biomolecular condensates become more numerous as cells approach mitosis and are dissolved thereafter.

      Major comments

      A) A critical point that requires clarification is how the protein concentrations used in the in vitro and in vivo assays (20-200 microM in vitro, and not estimated in vivo) compare to that of the endogenous components. This is important because it may well be that 6His-tagged PfCen1, PfCen3 and HsCen2 can form biomolecular condensates when present in vast excess, but not when present in physiological concentrations. The authors should report the estimated cellular concentration of PfCen1-4, as well as that achieved upon PfCen1-GFP overexpression (on top of endogenous PfCen1), for instance using semi-quantitative immunoblotting analysis. Given this limitation, the authors may also want to temper their title by introducing the word "can" after "centrins".

      In the context of phase separation, protein concentration is of course a critical metric. However, in vitro and in vivo concentrations cannot be directly compared as the composition of the surrounding solute has a significant impact on the effective saturation concentration. In vitro we find a saturation concentration for Cen1 of 10-15 µM (Fig. S3C), which is within a range that is frequently found other in vitro studies as listed in the in vitro LLPS data base (PMID: 35025997). We now more explicitly discuss this in the text (lines 422ff). At this point, unfortunately, we have no means of investigating the absolute concentrations of centrin in vivo and to our knowledge no such data is available for apicomplexan. Additionally, one has to keep in mind the presence of other centrin family members in the cell which can interact and co-condensate as well as other centriolar plaque proteins, like PfSlp, but are difficult to separate through analysis. Further we now discuss several contexts that modify the saturation concentration in vivo (lines 440ff).

      As explained above in a response to Reviewer 1, we were not able to produce a satisfactory quantification of the overexpression levels. We are repasting the previous response here:

      “Due to several confounding factors we were, unfortunately, unable to clearly quantify the extent of overexpression. Most notably the induction of overexpression only works in about 50% of the cells (Fig. S6). The mean intensity after induction further displays quite some variability. Lastly the expression kinetics along the IDC of endogenous centrin and our overexpression system that we use as a tool differ. Lastly, our centrin antibodies display crossreactivity (see also Fig. S12) making it impossible to identify how much of the endogenous pool we are labeling in comparison to the GFP- tagged Cen1 protein. “

      Concerning the title, as explained above, we followed the suggestion and added the word “can”.

      B) Movies S1 and S2 (and the related Fig. 1D and 1E) are not the most convincing to support the notion that the observed assemblies are biomolecular condensates, as not much activity is going on during the recordings. Likewise, Movies S3, and even more so Movie S4, as out of focus for a large fraction of the time, making it difficult to assess what happens at the beginning of the process. Moreover, it appears that fusion events, while occurring, are rather rare. The movies should be exchanged for ones that are in focus, and ideally a rough quantification of fusion events as a function of biomolecular condensate size provided.

      We thank the reviewer for requesting clarification. Movies S1 and S2 are by no means direct evidence for biomolecular condensation and we do not claim them to be but rather say that they are “…reminiscent of biomolecular condensates…”. We think that this is an appropriate entry into the subsequent analyses. For Movie S1 it is noteworthy that the shape of the accumulation, which can only be resolved by super-resolution microscopy in live cells, is round as would be expected for a liquid condensate in the absence of forces and on these short time scales. Nevertheless, the centriolar plaque must be duplicated which might be the process partly depicted in Movie S2. The observation that centrin can be still change its shape at least suggests that it is not a solid aggregate. In the context of centriolar plaque biology and the technological advance of applying live cell STED in P. falciparum, we think these data are still worth reporting.

      Concerning Movies S3 and S4 we have carefully selected the focal plane to highlight all the hallmarks of LLPS. Since the protein droplets freely move in 3D throughout the entire imaged liquid volume there is no z-plane that is in focus. Our positioning of the focal plane presents the best compromise between showing round droplet shape, droplet fusion events, and surface wetting. All those observations demonstrate the liquid nature of the condensates. Fusion events are indeed relatively rare, and we do not go beyond this qualitative statement that it can be seen.

      C) An important control is missing from Fig. 2, namely assaying PfCen1-4 without the 6His tag, to ensure that the tag does not contribute to the observed behavior (although it can of course not be sufficient as evidenced by the lack of biomolecular condensates for PfCen2 and PfCen4).

      Thank you for this suggestion. Since reviewer 1 made a similar comment, I’m reiterating our previous reply here: Generally speaking, and based on the published in vitro studies on other centrins, we didn’t anticipate the very small His-tag to change LLPS properties. Also, Cen1 and 3 and Cen2 and 4 would need to be differentially affected by the tag. We further have experimented with N-terminally tagged 6xHis-Cen3 protein and found no significant differences in our turbidity assays. However, we expressed new versions of the recombinant PfCen1-4 proteins with a TEV cleavage site inserted after the His-tag to purify untagged proteins and found no significant differences in our LLPS assay (Fig. S3E).

      D) The authors should test whether the assemblies formed by PfCen1 and PfCen3 are sensitive to 1,6-hexanediol treatment, as expected for biomolecular condensates.

      This is an interesting and helpful suggestion. We now tested 1,6-hexanediol addition to recombinant PfCen1 and wildtype parasites (now Fig. 6). Interestingly the dissolving effect of hexanediol on PfCen1 in vitro was moderate, which we attribute to the polar component in centrin assembly, which has been documented earlier (Tourbez et al. 2004). In vivo, however, only 5 min of treatment caused a striking dissolution of most centrin foci in wild type parasites, which is compatible with the interpretation that centrin or centriolar plaque assembly could be driven by biomolecular condensation.

      E) The fact that HsCen2 also forms biomolecular condensates is very intriguing, but further investigation would be needed to assess the generality of these findings. For instance, the authors could test in vitro also S. cerevisiae Cdc31, the founding member of the Centrin family of proteins to further enhance the impact of their study.

      We thank the reviewer for this suggestion. It would of course be exciting to investigate in more detail how widely this biochemical property of some centrins is conserved. To take a first step in that direction, we have recombinantly expressed centrins containing some N-terminal IDRs from C. reinhardtii, T. brucei and S. cerevisiae to represent organism of significant evolutionary distance. Using our in vitro phase separation assays, we found a very similar behavior to PfCen1 for two centrins while yeast Cdc31, although forming droplets, had a much higher saturation concentration, which could be explained by the significantly lower intrinsic disorder in its sequence (now new Fig. 3).

      Minor comments

      1) For the experiments reported in Fig. 3D, the same concentrations as those used in Fig. 3A-C (namely 10 microM, and not 30 microM as in Fig. 3D) should be used. Moreover, it would be informative to test whether PfCen2 and PfCen4 as PfCen3 when added to PfCen1.

      Unfortunately, this experiment is not feasible since Cen3 does not produce droplets at 10 µM. Hence, in Fig. 3D we aimed to test if Cen1 is incorporated into preformed droplets i.e. whether there is still some interaction between them. We have, however, tested the addition of Cen2 to Cen1 and Cen3 and as expected from the inability PfCen2 to condensate we did not find the same synergistic effect as for Cen1 and 3 together (now Fig. S6). The combination of Cen1/2/3 still enabled co-condensation while addition of Cen4 did not further improve droplet formation. Taken together this strongly suggests that only Cen1 and 3 contribute to the phase separation in vitro (lines 184ff).

      2) The authors mention that the effect of Calcium in inducing biomolecular condensates is specific, as Magnesium was not effective (lines 94-95). However, an examination of Fig. S3B indicates that the Magnesium also exhibits some activity, albeit less potent than Calcium. The authors should discuss this point and rectify the wording in the main text.

      Thank you for pointing this out. While PfCen1 is not reactive to Magnesium, PfCen3 and HsCen2 do display a small reaction, which we now more clearly mention in the text (lines 118ff). Of note Mg2+ and other divalent cation are known to generally promote phase separation.

      3) Do the authors think that PfCen2 and PfCent4 localize to the centriolar plaque in vivo using another mechanism that deployed by PfCen1 and PfCent3? It would be good to discuss this point.

      This is indeed a point worth discussing. Centrins can of course still interact in the absence of biomolecular condensation and their localization to the centriolar plaque is not dependent on their ability to phase-separate as seen for PfCen2 and 4. We have recently described a novel centriolar plaque protein PfSlp that interacts with centrins and might assist recruitment (Wenz et al. 2023). Cellular condensates are, however, often separated into scaffold proteins, which actually phase separate and client protein which get recruited into those condensates. It is easily conceivable that Cen1 and 3 participate in formation of the biomolecular condensate into which Cen2 and 4 as well as other centriolar plaque proteins might be recruited. Unfortunately, we were not yet able to establish a recruitment hierarchy by e.g. dual-labeling of centrins to test whether PfCen1 and 3 might appear prior to PfCen2 and 4. We now include those aspects in the extended discussion.

      4) Given that the EFh-dead mutant exhibits no activity in vitro and fails to localize in vivo, one potential concern is that the protein is misfolded. The authors should conduct a CD spectrum to investigate this.

      Thank you for suggesting this relevant control experiment. We have carried out CD spectroscopy of wild type and EFh-dead PfCen1 and find no difference in secondary structure distribution. We now added these data to the supplemental information (now Fig. S14).

      5) It is not entirely clear from the main text in lines 103-104, as well as from the legend, what Fig. S3B shows. When was EDTA added in this case?

      Thank you for requesting clarification. We will assume the reviewer is referring to Fig S4B. We wanted to show that contrary to PfCen3 that PfCen1 droplets can still be resolved after an elongated period of incubation with calcium but forgot to mark the timepoint of EDTA addition at 180 min in the graph. We have now corrected this and further reworded the sentence for more clarity (lines 132ff).

      6) Fig. S7: the correlation between PfCen1-GFP expression levels and ECCA appearance is modest at best. What statistical test was applied? This should be spelled out. Moreover, the authors should combine the two data sets, as this will provide further statistical power to assess whether a correlation is truly present.

      Indeed, the correlation is modest but statistically significant, which is why we decided to place this data in the supplemental information. The used statistical test was an F-test provided by Prism, which compares two competing regression models, which we now mention in the legend. Combining the two data sets is unfortunately not possible since they arise from two independent sets of measurements where different imaging settings had to be used to adjust for the very different fluorescent protein levels in both lines after induction.

      7) The authors may want to discuss how their findings can be reconciled with the notion that Centrin assemble into a helical polymer on the inside of the centriole (doi: 10.1126/sciadv.aaz4137).

      This is an interesting point. Although centrin does localize to the inside of the centriole (https://doi.org/10.15252/embj.2022112107), more precisely one pool at the distal part and one pool at the core, there is no evidence that it is itself part of the helical inner scaffold described by the authors even though it might localize in close proximity to it. Further, there are several examples where polymers such as microtubules act as seeding point for biomolecular condensates or the other way around, and our work suggest this could be a potential working model for centrins. We have discussed our results extensively with the two corresponding authors of the aforementioned study (i.e. Virginie Hamel and Paul Guichard) and agreed that our data are not conflicting. Nevertheless, we include the inner centriole localization and potential association with polymer structures of centrin in our extended discussion.

      9) Likewise, the authors may want to speculate regarding what their findings signify for the role of Centrin proteins in detection of nucleotide excision repair (doi: 10.1083/jcb.201012093).

      We appreciate the comment by the reviewer. Centrins seem to have many different potential roles that remain to be clarified. While we are excited about this, we think it is too early to speculate about the impact of centrin condensation on less well studied aspects of centrins such as nucleotide excision repair. We, however, now cite this study in the discussion to highlight the functional diversity of centrins.

      Small things

      • Fig. 1A: change color for microtubules as red on red is difficult to discern.

      Throughout our publications we use this shade of magenta to label microtubules in schematics and have therefore opted to use a slightly brighter shade of red for the RBCs instead to improve visibility.

      • Fig. 1C: the indicated boxes in the top row do not seem to correspond exactly to the insets shown in the bottom row.

      We have verified the position of the boxes and found them to be accurate. Possibly the different imaging modality used for both panels (confocal vs STED) creates this impression.

      • line 266: typo, promotor > promoter.

      Has been corrected.

      • line 360: a reference should be provided for the GFP-booster, including the concentration at which it was used.

      Has been added.

      • line 363: "an" missing before "HC".

      Has been corrected.

      • line 428: it would be best to deposit the macros on Github or an analogous repository.

      Macros have been deposited on https://github.com/SeverinaKlaus/ImageJ-Macros (line 737)

      • line 461: "to the" is duplicated.

      Has been corrected.

      • Fig. S5A: maybe draw the lines in red (as red in Fig. S5B correspond to the proteins that do not have IDRs).

      Since we cannot easily change the line colors of the IDR graphs, we have inverted the font color for Fig. S5B instead.

      • Movie S7, legend: left frames shows PfCen1-GFP, not microtubules as currently stated.

      Has been corrected.

      Reviewer #2 (Significance):

      This is a provocative study that extends initial observations regarding self-assembly properties of Centrin proteins, and posits that some members of this evolutionarily conserved family can form biomolecular condensates. After the above outstanding issues have been properly addressed, these data could have important implications for understanding Centrin function in centriole biology and DNA repair. Therefore, these findings will be of interest to a cell biology audience.

      Field of expertise: cell biology.

      Reviewer #3 (Evidence, reproducibility and clarity):

      Summary:

      The authors have provided a comprehensive characterisation of centrin proteins in Plasmodium falciparum. Through expression of episomal GFP-tagged centrin for in vitro, they were able to observe co-localisation of centrin with centriolar plaques during the replicative stage of the parasite. They also utilised live cell STED microscopy to track dynamic changes in centrin morphology. They have also demonstrated calcium-dependent phase separation dynamics in bacterially-expressed P. falciparum centrin and human centrin 2. The formation of liquid-liquid phase separation in PfCen1, 3 and HsCen2 tied well with IUPred3 predictions of intrinsically disordered regions in these proteins. Using an inducible DiCre overexpression system with two promoters of varying strengths, the authors have shown accumulation of centrin1 outside of centrosomes and premature appearance of centriolar plaques. Finally, changes on the centrin1 protein, i.e., N-terminal deletion, and mutations in calcium binding sites in the EFh domains, have shown a reduction in the formation of ECCAs during overexpression and inability to form LLPS in vitro, respectively.

      Major comments:

      1. Given that parasites cannot tolerate endogenous C-terminal tagging of some centrins (but not all, as PbCen4 was successfully tagged), has N-terminal tagging been attempted either by the authors or in previous publications? Note that this is not a request for further experimentation; rather, maybe this can be noted in the manuscript; and line 62 can be rephrased for transparency.

      We have not attempted N-terminal tagging ourselves but through personal communication with Rita Tewari we were informed that neither N- nor C-terminal tagging for PbCen1-3 was successful in the context of the study published by Roques et al 2018. We have only unsuccessfully attempted C-terminal tagging in several iterations. Due to importance of N-terminus for interaction and function in other organisms it is plausible that N-terminal tagging is even more unlikely to work. Since we have not exhaustively attempted every tagging strategy on every centrin we, as suggested, rephrased the text accordingly (lines 81ff).

      1. Is there a possibility that by adding a C-terminal tag, centrin may lose a specific function or cause change in the physicochemical properties of the protein (thus making C-terminal tagging lethal)? Was His tag removal attempted so the native protein can be used in the LLPS experiments? IUPred3 analysis showed potential IDR at the C-terminal end of PfCen4. Could the C-terminal tag have caused the protein to not form droplets in the presence of Ca2+?

      As we could show for PfCen1-GFP, the tag did not impair its ability to undergo LLPS which is at least partly mediated by the N-terminus, and that it could still properly localizes to the centriolar plaque. The fact that some endogenous centrins cannot be tagged suggest that there is a functional relevance to the C-terminus that could e.g. be an interaction with other essential centriolar plaque components. As suggested in a reply to Reviewer 1, we consider a substantial and centrin-specific effect of the small His-tag on phase separation unlikely. To be sure, we have repeated our turbidity assays with tag-free versions of PfCen1-4 and found no change in phase separation properties (now Fig. S3E).

      1. It has been shown by the authors that different tagged centrins co-condense which may support the localisation data (Figure 1C). However, is there a way to show that the episomally- and endogenously-expressed centrin co-localise with each other (e.g., confocal microscopy with anti-centrin vs anti-gfp in PfCen-GFP lines, that is if the authors have access to anti-centrin antibodies)? Has endogenous centrin been demonstrated to form ECCAs (in previous publications or by the authors)?

      These are important questions by the reviewer. Due to the high sequence homology centrin antibodies, even if raised against a specific centrin (such as PfCen3 in this study), will likely cross-react with other centrins. So far, we have not been able to produce a staining were the anti-GFP-positive foci are devoid of anti-centrin3 staining, which limits the interpretation of these data. The outer centriolar plaque compartment containing centrin is, however, well defined by now and the localization pattern of endogenous centrin and Centrin1 and 4-GFP seems identical. In a more recent study from our lab Cen1-GFP IP has identified other endogenous centrins as interaction partners (Wenz et al 2023), like the Roques et al. 2018 study did for PbCen4-GFP indicating that the tag does not abolish interaction between centrins. So far, we have never detected any ECCAs, nor have we identified any similar structure in the literature. This suggest that this is indeed a consequence of excessive centrin concentration. Importantly we now have added data from a new parasite line overexpressing untagged PfCen1 using the T2A skip peptide (pFIO+_GFP-T2A-Cen1) which displays ECCAs upon induction, showing that this effect is not a mere consequence of tagging (now Fig. 5H-K).

      Minor comments:

      1. How were the times (post addition of Ca2+) presented in Figure 2A determined?

      We noted down the time of calcium addition and cross-referenced it with the timestamps available in the metadata of the movie files (e.g. file creation timepoint marks the start of the movie). We now mention this in the legend.

      1. Line 126: Figure 1B should be Figure 1C

      2. Line 145: Figure 1C-D should be Figure 1D-E

      3. Line 151: Figure 3A should be Figure 4A

      Thank you for spotting these mistakes, which now have been corrected.

      1. Line 152: Suggest rephrasing "placing the gene of interest in front of the promoter" to "placing the gene of interest immediately downstream of the promoter" or something similar

      Thank you for this good suggestion.

      1. Any growth phenotype changes observed in the overexpressors?

      The parasite lines seem to silence the Cen1-4-GFP expression plasmids readily, which suggest that there might be a growth disadvantage. However, repeated attempts to quantify a growth phenotype were unsuccessful due to high variability in the data, which might be partly connected to the fact that the fraction of GFP positive cells after induction can vary between lines and replicas.

      1. How often are ECCAs observed in pARL strains, or are they not observed at all? This might be good to mention.

      ECCAs in the pArl strains have been observed on very limited instances but are too rare to be quantified. We now mention this in the text (lines 217ff).

      1. Line 192 and Figure S8: n {less than or equal to} 33 (either a typographical error and should have been {greater than or equal to}, otherwise, it may be expressed as a range)

      It was indeed a typographical error that was now corrected.

      1. Line 258: Methods on the generation of FIO/FIO+ was a bit difficult to understand. Maybe a simple plasmid schematic with the restriction sites (at least for the original plasmid) in the supplementary may help clarify this.

      Cloning strategy has been expanded with additional information for clarity.

      1. Line 295: include abbreviation of cRPMI here rather than in Line 303

      Has been corrected.

      1. Line 322: typographical error on WR99210 working concentration?

      Has been corrected.

      1. Line 372: Last sentence on area and raw integrated density measurement is unclear.

      We have reformulated the sentence for more clarity.

      1. Line 461: typographical error in last sentence

      Has been corrected.

      1. Line 532: Figure 4E should be Figure 4F

      Has been corrected.

      Reviewer #3 (Significance):

      DNA replication is vital to the survival of malaria parasites. A deeper understanding on their unusual form of replication may be exploited to find drug targets uniquely directed to the parasite. Biological insights from this work can also provide a jump-off point for unravelling unusual replication in other organisms. Data on the physicochemical analysis of centrin is not just of great interest for those in the field of parasitology, but also for those in the much wider fields of biology, physics and chemistry. Techniques presented in this work (e.g., DiCre overexpression with different promoters) can definitely be utilised for the elucidation of protein function within and outside the field of parasitology.

      My field of expertise is in Plasmodium spp., particularly in parasite replication, molecular and cellular biology, and epigenetics.

      We thank the reviewer for the appreciation of our work in terms of insight and technology development.

    1. What is this I hear of sorrow and weariness, Anger, discontent and drooping hopes? Degenerate sons and daughters, Life is too strong for you– It takes life to love Life.

      Putting this into my perspective there are many older adults in my life who say we are foolishly discontent and have drooping hopes about the future. I believe they are different from this section. I interpreted this as: Life is full of pain and we can be discontent but do not think that it will feel this way forever, with time we may learn to love the complexities of being alive

    1. In reading a novel, any novel, we have to know perfectly well that the whole thing is nonsense, and then, while reading, believe every word of it. Finally, when we’re done with it, we may find—if it’s a good novel—that we’re a bit different from what we were before we read it, that we have been changed a little, as if by having met a new face, crossed a street we never crossed before. But it’s very hard to say just what we learned, how we were changed.

      This article says that you cannot find truth in fiction. I strongly disagree,fiction is based on our realities; they are the fears and fantasies that we harbor in our minds and can reflect certain aspects of our society. To say that fiction and art are to be taken as lies and just that suggest that we are incapable of understanding and interpreting the metaphor that represents real life. Racism in space is still racism, using current events to try a peek at the future is not going to be accurate. The insite it can provide is however very telling. How the future looks to the individual writing the story and through this we can find the present. The lenses they see through can color the future and this glimpse of life from their perspective is important . Think about all the classic books we read in life. We don't read them for their accuracy, we read them for the insight and thought provoking ideas present.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reviewer #1 (Evidence, reproducibility and clarity):

      Summary: This manuscript describes molecular mechanisms by which ACBD3 is recruited to the Golgi complex. ACBD3 recruits PI4KIIIb which is required to generate PI4P, a phosphoinositide which is key for the recruitment of essential Golgi proteins and hence is key to Golgi identity. The authors have used a combination of mass spectrometry, high quality fluorescence imaging, transient CRISPR knockdowns, and biochemical approaches such as IPs to identify the key determinant for recruitment of ACBD3 to the Golgi complex. They map the interaction between ACBD3 and the Golgi as a unique region (UR) upstream of its GOLD domain, identifying, in particular, an MWT motif as key for this recruitment. Using mass spectrometry they identify several novel interactors of ACBD3 as well as some established binding partners. Knockdown of these interactors reveal a key role for the SNARE, SCFD1, where reduced levels lead to complete loss of ACBD3 localisation to the Golgi without apparent disruption of Golgi structure. They further validate this interaction and that of another SNARE (Sec22b), which is part of the same SNARE complex as SCFD1, mapping the interaction to the longin domain of Sec22b. Surprisingly however they demonstrate that the UR domain does not mediate the interaction between ACBD3 and these SNAREs suggesting an alternative mechanism of recruitment. Previously identified ACBD3 interactors, Golgi proteins giantin and golgin-45 were also identified in the mass spectrometry screen and the authors demonstrate that these two proteins can recruit ACBD2 to the Golgi and this is dependent on the MWT motif identified in the UR domain. By knocking down SCFD1, they show reduced recruitment of ACBD3 leading them to propose a model of sequential recruitment of ACBD3 by SCFD1 followed by interactions with the golgins.

      Major points: This study is a well-executed and rigorous study of the molecular requirements for the recruitment of ACBD3 to the Golgi. The experimental approaches are state-of-the-art and the data are clean and convincing. The only caveat, raised by the authors themselves, is their interpretation that there are two sequential steps for Golgi recruitment of ACBD3. While they show that loss of SCFD1 reduces the interaction of ACBD3 with giantin and golgin 45, their model depends on doing the reverse experiment, i.e. assessing the effects of knocking down either giantin or golgin-45. This is especially relevant given the demonstration that golgin-45 is sufficient to recruit ACBD3 to mitochondria. It may well be that recruitment involves a tripartite complex, which is not uncommon in vesicular transport mechanisms Giantin is not an essential protein do it should be feasible to perform this experiment. The authors are equipped in the quantitative fluorescence microscopy which would be required and which would help resolve whether sequential or redundant mechanisms are required for ACBD3 recruitment.

      We thank the reviewer for the positive comments and are glad that they consider our study "well-executed and rigorous". We totally agree with the reviewer that our conclusions regarding the sequential aspect of the recruitment of ACBD3 in the original submission could be better supported. We have worked to strengthen this in our resubmission. As the reviewer states, this limitation was already discussed in the original submission. To further support our model, we have performed the experiment suggested by the reviewer, in which we test the effects of knocking down both giantin and golgin45 (double knockdown) on the binding of ACBD3 to SCFD1.

      The results of this experiment further support our sequential model with little to no effect of loss of the Golgins on ACBD3. As we already knew, a large effect of SCFD1 KO on the binding of the Golgins to ACBD3 was also observed here. We should note that this was performed in a different cell line than before (HeLa cells rather than HEK cells), as the efficiency of multiple knockdowns was much lower in HEK cells, as determined by qPCR. Taken together, the new data in Figure 7 supports a sequential model for Golgi recruitment. We also agree that other, less likely models could explain our data and have included this openly in the discussion. In conclusion, we thank the reviewer for their comments and have revised the manuscript with a new experiment with the relevant repeats, which supports our model.

      Reviewer #1 (Significance):

      Significance PI4P is a phosphoinositide that is important for the recruitment of Golgi proteins. As with most PIs it is likely to act by coincidence detection in that Golgi associated proteins will recognise PI4P as well as other factors on Golgi membranes. This results in different local membrane environments which will be specific for particular functions. PI4KIII__b_ is key for PI4P production although the absolute levels of PI4P are likely to be determined by a balance of lipid kinases and phosphatases. However, since ACBD3 is key for the recruitment of PI4KIII__b, it is important to understand the molecular mechanisms by which it is recruited. The manuscript thus makes a significant contribution to understanding one of the underlying mechanisms for PI4KIII__b _recruitment although, as indicated above, stops short of establishing a clear model for the roles SCDF1 and Sec22b versus golgin 45 and giantin. For the future it will be of interest to determine why either a sequential or a redundant mechanism is required for the recruitment of ACBD3 as a scaffold protein.

      We thank the reviewer for this set of positive comments on the manuscript and for agreeing that this is a significant contribution. Our revised version further supports our sequential model of ACBD3 recruitment to the Golgi apparatus, and the comments here have helped us further to strengthen the quality and clarity of the manuscript.

      Reviewer #2 (Evidence, reproducibility and clarity):

      Summary This is a very interesting and potentially important paper for the field of membrane biology and membrane trafficking, in which the authors have studied the molecular mechanisms by which ACBD3 (and consequently PI4KIIIb) is recruited to the cis-Golgi membranes. The authors suggest that this recruitment is based on a two-step process, mediated by interactions to, on the one hand, SCFD-1 (SLY1) and, on the other hand, two redundant golgins (golgin-45 and giantin).

      We once again thank the reviewer for the positive comments and are glad that they consider our manuscript important.

      Comments:- Pg.1 : arfaptins, as far as I know, have not been shown to be involved in intra-golgi trafficking but rather in Golgi export (see e.g. ref. 12)

      We thank the reviewer for pointing this out. We have corrected the text accordingly.

      • Pg. 1: reigon --> region

      We thank the reviewer for noticing this typo. We have corrected the text accordingly.

      • Arf1 also recruits PI4KIIIb right?

      This is correct. The De Matteis lab has shown that PI4KIIIβ associates with the Golgi complex in an Arf1-dependent manner (Godi et al. 1999). We think this is excellent work. However, Arf1 is somewhat of a master regulator of the Golgi, affecting the recruitment and localisation of many different Golgi proteins. It has also previously been reported that Arf1 does not directly interact with PI4KIIIβ (Klima et al. 2016). Overall, the molecular relationship between Arf1 and the kinase remains unclear. We do not exclude, however, that there are factors other than ACBD3 important for recruiting and regulating PI4KIIIβ levels at the Golgi. We have changed the wording in the manuscript to reflect that there are multiple ways that PI4KIIIβ is recruited to the Golgi apparatus.

      Fig. S1: the information about the number of cells per experiment is missing. Also, please add the information about what exactly is represented in the box plots (is it the distribution of the mean value of R per experiment? or the total distribution on a cell-by-cell basis of a representative experiment?)

      For each experiment, a minimum of 100 cells per condition were imaged. The Pearson's correlation was then calculated, and the average was taken for each biological repeat. The plot in Fig. S1B represents 3 independent biological repeats. We have included this information in the revised manuscript.

      • The definition of Avg. Golgi int/avg. cell int. (a.u.) in Fig 1E,F is a bit difficult to understand to me. If I understand correctly, the total fl. int in the Golgi mask was computed and divided by the area of the Golgi mask (this is the av. Golgi intensity). A similar computation is done for the entire cell (including the Golgi), i.e., total fl. intensity in the cell mask is computed and divided by the area of the cell mask. Then the two av. intensities are divided (ratio = av. Golgi int / av. cell int.). This ratio, for a protein that is enriched in the Golgi area, should be larger than 1. For a protein that is equally distributed all over the cell, it should be 1, and for a protein that is excluded from the Golgi area, smaller than 1. Then to this value, the authors subtract the value of the ratio found for an inert construct (GFP of Halo alone), which I imagine should have an original ratio value of the order of 1, and hence, after this subtraction, norm. ratio values larger than 0 mean that they are more enriched at the Golgi area than GFP/HaloTag themselves. Is this correct? In principle, I don't see anything entirely wrong with this way of thought, but I just found it a bit difficult to understand, and in general one has to be careful when computing rations (quotients) and then subtract another ratio. Also, the units are not a.u., the value is dimensionless, what is "arbitrary" is the definition of 0 value and the based on this definition, also the actual value. I think it would probably be much clearer for the readers to compute somthing like the relative enrichment in the Golgi area as compared to the rest of the cell (excluding the Golgi area). That is, a value r'=(Int. Golgi mask / Area Golgi mask) / [(Int. Cell mask - Int. Golgi mask)/(Area cell mask - Area Golgi mask)]. This can be computed directly or defining a mask that is the cell mask - the Golgi mask. Also, some maths (unless I made a mistake) give that this r'= r (1-aG)/(1-r aG); where r is the ratio (before subtraction) defined by the authors, and aG=Area cell mask/Area Golgi mask. In any case, I'd suggest the authors to either adopt this other quantitation (without subtraction of the GFP/HAloTAG), which gives directly the fold-enrichment in the intensity density in the Golgi area with respect to the rest of the cell; or explain in more detail the maths of the value they are plotting now.

      We thank the reviewer for these well-reasoned and thoughtful suggestions for our imaging analysis. These are issues that we have also considered when quantifying this dataset. At the heart of it, the second method of calculation (Golgi/outside of Golgi), results in a non-linear distribution, as the pool of proteins re-distribute from inside the Golgi to the cytosol. This is why we have chosen to use the first method of Golgi/total, as it provides a linear distribution.

      The reviewer is also correct that the GFP (inert protein) ratio is 1 without adjustment. We have chosen to normalise to GFP/HaloTag (inert protein) as we think this is the clearest way of conveying our conclusions from these experiments. We have included the non-normalised graph here for the reviewer to see; however we thought that this conveys the key result less clearly. Overall, we agree this was poorly communicated in the manuscript and we have clarified it in the revised version.

      • Fig. 1C&F: Besides the MWT mutant, the FKE mutant also seems to have a somewhat compromised Golgi localization. Have the authors followed on that, or what is the reason that they have just focused on the MWT mutant?

      In contrast to the MWT mutant, the FKE mutant does not affect ACBD3 localisation significantly. In addition, when having a close look at the pdb structure of the GOLD domain of ACBD3 with 3A protein of Aichivirus A (5LZ3), the MWT patch, in particular residues M and T, make clear contact with protein 3A, which is not the case for FKE residues. Therefore we focused on the MWT residues, which we hypothesised to interact with a Golgi resident protein which competes with protein 3A to interact with ACBD3.

      • Very minor point, and without wanting to sound pedant at all, but I think (I might be wrong of course, so apologies if I am) that the plural of apparatus in latin is not apparati, but apparatus (fourth declination). So, I'd change the word in page 2 (or just rephrase the sentence: e.g. "resulting in Golgi fragmentation"). But of course, I'd leave this to the authors' discretion.

      We thank the reviewer for this precision, do not consider it pedantic, and have made the suggested change to the text.

      • Fig. 3A: have the authors tried or been able to perform IF of the endogenous SCFD1 protein?

      As suggested by the reviewer, we attempted to perform IF of endogenous SCFD1, as shown below. Despite trying several different antibodies, we were not satisfied that we were detecting real SCFD1 signal as there was no change in this staining upon SCFD1 CRISPR KO. Please see an example of this IF below (ProteinTech, 12569-1-AP). We have contacted the antibody manufacturers to inform them of this issue.

      • Similarly to what has been done for other panels, could you quantify Fig. 3C? Are PI4KIIIb protein levels affected upon the different KOs?

      As suggested by the reviewer, we are now showing in Figure S2D the percentage of cells with a partial or total loss of PI4KIIIβ at the Golgi in CRISPR-Cas9 KO cells of either PI4KIIIβ, ACBD3 or SCFD1. 3 independent biological repeats were performed and approximately 150 cells were quantified (~50 cells per condition). The results show that the PI4KIIIβ antibody used (BD Bioscience, 611816) is specific (93.22% of cells lose the antibody signal) and that ACBD3 and SCFD1 KO affects PI4KIIIβ recruitment to the Golgi in 88% and 73% of the cells, respectively._-

      The last paragraph of the "SCFD1 and ACBD3 interact upstream of PI4KIIIβ recruitment to the Golgi apparatus" section reads a bit odd placed there. I think it is more appropriate for the discussion or for the intro part on SCFD1.

      Many thanks to the reviewer for pointing this out. We simplified that paragraph to describe the relationship between SCFD1 and SEC22B.

      • I am confused on Fig. 5A/B. The labels in the blots show that 390-528 (without UR) does not bind sec22 or scfd1, but the 368-529 does? Or I guess, judging by the MW seen in the middle blots, that there's some error in the labelling?

      Many thanks to the reviewer for noticing this, which was clearly a labelling error. We corrected this accordingly in Figures 5A and B. We apologise for this oversight.

      also, the IP efficiency of the MWT mutant in the panel A blot is quite low, still sec22 seems to be very efficiently pulled down. Can the authors comment on that please? Would co-IPing against endogenous sec22 and scfd1 would work (so you don't need to rely on HaloTag+ligand?)

      We know that the MWT residues of ACBD3 are important for recruiting ACBD3 to the Golgi (Figure 1C and F). We also know that ACBD3 interacts with SEC22B and SCFD1 (Figure 3B and 4A) and that SCFD1 is important for ACBD3 Golgi recruitment. Therefore we initially speculated that ACBD3 interacts with SEC22B and SCFD1 through the MWT residues. However, as the reviewer points out, Figure 5 shows the opposite. Mutating MWT residues makes the interaction of ACBD3 with SEC22B and SCFD1 stronger. For this reason, we hypothesised that another player(s) also contributes to ACBD3 recruitment through interactions with the MWT residues. We have shown that the second recruitment factors are the 2 golgins, golgin-45 and giantin (Figure 6C). In short, whilst we agree that the IP efficiency is low, the binding is actually stronger, supporting our conclusions. No interaction of ACBD3 with endogenous SEC22B could be detected due to a lack of a sufficiently sensitive antibody (we tried Abcam ab181076 and ProteinTech 14776-1 AP).

      • I really like the experiment 6B. Have the authors tested whether SEC22 is also recruited to mitochondria in those conditions? But not SCFD1?

      We thank the reviewer for the positive comment. We have performed the suggested experiment and are now including this as an additional figure (Figure S3). Ectopic expression of golgin-45 targeted to the mitochondria is not sufficient to redistribute SCFD1-HaloTag or HaloTag-SEC22B to the mitochondria (Figure S3A and B, respectively). We, therefore, speculate that the fraction of ACBD3 that gets redirected in Figure 6B must be the small fraction of ACBD3 that is spontaneously in an open conformation and compatible for interaction with golgin-45.

      • The results shown in Fig 7 might show a partial depletion in the interactions, but to be fully trusted they would need to be quantified and a statistical test used to compare the values. I think this part is important to show very clearly, because even with low binding to golgins (remember, single knockouts do not prevent Golgi localization of ACBD3), one could expect that ACBD3 still localized to the Golgi but it does not in the absence of SCFD1 as shown in this paper. A prediction of the proposed model is that in cells depleted of the two Golgins, SCFD1 and ACBD3 should still bind to one another, right? Did the authors test this?

      We fully agree with the reviewer. As discussed in the replies to reviewer 1, we have repeated this experiment, including both sets of KO. This was not trivial, as a double transient KO is technically challenging and involves validation with qPCR and switching cell types (HEK cells to HeLa). The new data supports our current model and suggests some additional regulatory mechanisms at play.

      • The model presented here (fig 8) seems to suggest that only the conformational variation of ACBD3 that binds Golgins is able to recruit (bind) PI4KIIIb. Is this known, or is there any experimental evidence for that?

      HDX-MS experiments show that the ACBD and GOLD domains undergo conformational changes in the presence of 3A proteins (McPhail et al. 2017). Demonstrating this would require a complicated reconstitution experiment which is technically very challenging and would involve purifying various complex proteins, including SNAREs, SM proteins and golgins. This could perhaps be the subject of several future studies.

      • Have the authors thought about testing the FKE mutant in the experiemnts shown in Fig. 5?

      As mentioned above, since the FKE residues are not making any contact with the protein 3A and since the loss of ACBD3 recruitment to the Golgi is not statistically significant (Figure 1F), we haven't tested the FKE mutant for the binding to SEC22B and SCFD1. We do, however, agree with the reviewer that there might be something interesting happening here. We would like to experimentally interrogate this in future studies and develop more sensitive assays to test if there is a significant effect with the FKE mutant.

      In general, I think the title might be a bit misleading because of the use of PI4Kiiib. I understand what the authors mean, but because they have not thoroughly tested PI4Kiiib recruitment in their experiments, I think they should focuse rather on the mechanism of recruitment of ACBD3 the authors have found.

      We thank the reviewer for their advice regarding the manuscript title, and this is something that we have discussed internally. We chose that title as it highlights the key mechanistic impact of our findings and note that we did include a figure on the recruitment of PI4KIIIβ. However, we remain open to discussing this with advice from the journal editorial team.

      Reviewer #2 (Significance):

      I think, as said above, that this is potentially an important paper for the field of membrane trafficking and membrane biology. Most of the experiments are in general well performed and well controlled, and the paper is clearly written and follows a logical line.

      We once again thank the reviewer for their comments and overall thoughtful and considered review. We believe that the suggestions here have improved the manuscript.

      Reviewer #3 (Evidence, reproducibility and clarity):

      Stalder and colleagues report experiments designed to identify interactors of the Golgi-localized protein ACBD3 (a.k.a. GCP60), and to delineate mechanisms that allow ACBD3 to localize at Golgi compartments. ACBD3 is a 528aa protein with diverse previously reported interactions and functions, both in normal physiology and as a host factor in viral assembly processes. Stalder et al. first map which domains of ACBD3 are required for Golgi localization in HeLa cells, concluding that residues 368-528 are sufficient for localization. This region includes a GOLD (GOLgi Dynamics) domain previously reported to interact with Golgin tethering proteins. Alanine scanning identifies the motif MWT just upstream of the GOLD motif as necessary for Golgi localization. Acute CRISPR knockout identifies two Golgins, Golgin45 and Giantin, as necessary for ACBD3 Golgi localization, and IP indicates that the MWT motif breaks this interaction. These data are a bit scattered around the paper but taken together are reasonably persuasive, particularly when viewed in context with published work. This reader would have found the manuscript easier to follow had the Golgin and MWT motif data been presented en bloc.

      We thank the reviewer for these comments and have considered presenting and rewriting the data as the reviewer suggested. On reflection, we have decided to present it in the original order. We feel that this allows us to highlight the two independent mechanisms individually, bringing them together at the end. In addition, as the experiments were performed in the order presented, it allows for more appropriate controls for each experiment rather than trying to combine them. We hope the reviewer accepts our preferred order.

      In a second set of experiments, IP-mass spec is used to identify ACBD3 interactors that might assist in the protein's localization. The MS data presented are filtered to exclude proteins not already identified as Golgi-localized. This is, I think, a mistake. Even if the authors choose to focus on known Golgi interactors as candidates for a localization function, the biological functions of ACBD3 are far from fully understood, and the full dataset would be of value to both cell biologists and virologists.

      We agree with the reviewer that there are many interesting mysteries surrounding ACBD3 and have therefore included an additional table (table S1) in the revised manuscript, showing the dataset of newly identified ACBD3 interactors before applying the Golgi localisation filter.

      Hits in the filtered dataset include the R-SNARE Sec22B, and the SNARE chaperone Sly1/SCFD1. Acute CRISPR inactivation of Sec22 decreases ACBD3 localization to the Golgi and SCFD1 inactivation more or less abolishes localization. Co-IP experiments are used to argue that ACBD3 interacts with the N-terminal regulatory Longin domain of SEC22B, as well as with SCFD1. The Sec22 data are more detailed and persuasive. No experiments with purified proteins are presented to establish that the detected interactions are direct rather than mediated through a bridging factor or factors. Importantly, SCFD1 is likely to have multiple different client SNARE complexes that operate at different stages of ER and Golgi traffic. Hence its inactivation is likely to be pleiotropic and consequently phenotypes arising must be interpreted with caution.

      We completely agree that studying membrane trafficking in an interconnected system is challenging. We also agree that direct binding experiments in reconstituted systems would be key to proving our model. Our data uses multiple different experimental approaches, including co-localisation, co-immunoprecipitation, CRISPR-KO, and biochemistry, to support our model. In the future, we agree full reconstitution would be necessary to examine this further, and we hope that either ourselves or others can do this in further studies.

      Lastly, the authors perform IP experiments which show that ACBD3-Golgin co-IP efficiency is lower in cells with acute inactivation of SCFD1. This epistatic relationship is used to argue for a sequential model of recruitment with SCFD1 and perhaps client SNARE proteins operating upstream of ACBD3-Golgin interaction. This argument is not persuasive because we do not know whether SCFD1 and its downstream activities increase the rate of ACBD3-Golgin complex asssembly, or alternatively stabilizes ACBD3-Golgin complexes, decreasing the rate of their dissociation.

      We agree with this weakness in our original submission, and it is a comment shared among all reviewers. Overall, we feel that we have chosen the model that best summarises our data. We, of course, accept that there are still components of this pathway that need clarification and are open for further study. This includes the issue raised here by the reviewer, as well as the intriguing observation that both golgins are transcriptionally upregulated upon SCFD1 KO in HeLa cells. In the revised manuscript, we have more clearly laid out the weaknesses of our model in the discussion and suggested future experiments to help clarify some of these issues. We have also modified the model to reflect some of these potential additional regulatory mechanisms.

      In general the methods are fairly clear but that there is room for improvement. The "high throughput" imaging pipeline is not clearly described.

      We agree with the reviewer, and apologise for not clearly explaining this. We feel that this unbiased approach of quantification is particularly rigorous and we have clarified this in the methods section of the updated manuscript.

      Each figure legend should specify the microscopy methods used, and for each result the number of biological replicates and cells analyzed should be specified.

      We agree with the reviewer and have included these details appropriately in the revised manuscript.

      The statistical methods (Student, Tukey, etc.) used for each experiment should be specified. Saying that statistics were calculated using Python 3.7 is useless without additional details. e.g. at least the libraries and codebase used should be indicated or deposited.

      We agree with the reviewer and have updated the manuscript accordingly. In short, all comparisons were made using either Student's t-test or Multiple Comparison of Means - Tukey HSD, FWER=0.05. These were conducted in Python 3.9 using pandas, matplotlib, seaborn and scipy. We used the MultiComparison function in scipy, and the comp.tukeyhsd for the post-hoc adjustment.

      Many figure labels (e.g. Fig. 2) use absurdly small fonts.

      We apologise for this. We believe that this is because we submitted it with in-line formatting. Our resubmission has full-page figures, and we feel the text is clearer now.

      The mass spec hits obtained should be provided both with and without exclusion of non-Golgi-localized proteins.

      We agree with the reviewer. Please see the new Table S1.

      Reviewer #3 (Significance):

      In general I think this is a useful and well controlled set of experiments producing useful insights. However, the interpretations need to be more carefully considered, and alternative interpretations must laid out as clearly as possible. Specifying the limitations of the study will make it more, not less, useful to the field. If the authors want to make the case more robustly that the interactions described are mediated through direct binding, or that the operation of SCFD1 and Golgins operate sequentially to recruit ACBD3, additional wet bench work will be required which will of course take time to complete.

      We once again thank the reviewer for the thoughtful and critical comments. These have helped to strengthen the manuscript. We have performed the additional bench work requested by the reviewer, which has further supported the paper and our model.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      We would like to thank all reviewers for taking the time to evaluate our manuscript fairly and critically. Many helpful suggestions and discussion points were raised. One important group of comments raised concerns whether our proposed timer and counter models were the appropriate conceptual framework to discuss nuclear multiplication in schizogony, whether they were mutually exclusive, and whether other alternatives should be considered. These comments were instrumental for us to uncover some inconsistencies in our previous modeling approach. In the new manuscript, we now define the counter and timer models much more rigorously in the context of Plasmodium cell division. Based on these refined models we now provide a new statistical analysis that goes beyond the previous analysis, significantly improving the statistical support for our conclusions. Details are given in the following individual replies.

      Reviewer #1 (Evidence, reproducibility and clarity):

      Summary

      Malaria parasites replicating in human red blood cells show a striking diversity in the number of progeny per replication cycle. Variation in progeny number can be seen between different species of malaria parasites, between parasite isolates, even between different cells from the same isolate. To date, we have little understanding of what factors influence progeny number, or how mechanistically it is controlled. In this study, the authors try to define how the mechanism that determines progeny number works. They propose two mechanisms, a 'counter' where progeny number is determined by the measurement of some kind of parasite parameter, and a 'timer' where parasite lifecycle length would be proportional to progeny number. Using a combination of long-term live-cell microscopy and mathematical modelling, the authors find consistent support for a 'counter' mechanism. Support for this mechanism was found using both Plasmodium falciparum, the most prominent human malaria parasite, and P. knowlesi, a zoonotic malaria parasite. Of the parameters measured in this study, the only thing that seemed to predict progeny number was parasite size around the onset of mitosis. The authors also found that during their replication inside red blood cells, malaria parasites drastically increase their nuclear to cytoplasmic ratio, a cellular parameter remains consistent in the vast majority of cell-types studied to date.

      Major Comments

      It is stated a few times in this study that P. knowlesi has an ~24 hour lifecycle, and while this is the case for in vivo P. knowlesi, it was established in the study when P. knowlesi A1-H1 was adapted to human RBCs (Moon et al., 2013) that this significantly extended the lifecycle to ~27 hours, which should be made clear in the text. As much of this study revolves around lifecycle length and timing, the authors should consider some of their findings with the context that in vitro adaption can significantly alter lifecycle length.

      The reviewer raises an important point that we didn’t discuss for P. knowlesi. We now mention this directly in the introduction chapter (line 67) and in the discussion (lines 470ff). We are aware that P. knowlesi takes about 27 hours in the lab, which was also communicated by the Moon lab. We now cite relevant studies again in this context. We further address the issue of modified cell cycle time in vitro in the discussion in the sense that absolute values must be taken with caution and the focus of this study is about the relative ratio and correlation between the different cell cycle metrics.

      • The dichotomous distinction between 'timer' and 'counter' as mutually exclusive mechanisms seems to be a drastic oversimplification. Considering the drastic variation we see in merozoite number across species, between isolates, and between cells, it seems much more likely that there are factors controlled by both time-sensed and counter-sensed mechanisms that both influence progeny number.

      The study of progeny regulation in malaria parasites is very much in the early stages. We can agree that our models are simplifications, as is the case with all models. Our choice of just the two models timer and counter was driven by the number of cellular parameters we measure, i.e., duration of division phase and progeny number. These data essentially allow us to test the two competing models we presented. As we quantify more and more cellular parameters, based on the quantitative live cell imaging protocols established here, we will be able to test more complex cell cycle models. With our current data, we believe more complex models are not warranted.

      However, this valuable criticism, in conjunction with related remarks by other reviewers, made us reevaluate the constraints of our model more precisely. We noticed that the criteria used in the previous version in the manuscript contained unnecessary additional assumptions. Briefly, the previous counter model also required that final merozoite number was tightly controlled, while the previous timer model required the growth rate to be tightly controlled. These side assumptions were not made explicit in the manuscript and could bias the support towards one or the other model.

      We now improved the modeling approach substantially by removing implicit side assumptions, and clearly defining timer and counter models in terms of their correlations. The refined formulation of the timer posits that between individual parasites the target duration and the nuclear multiplication rate vary in a statistically independent way; while in a counter, target number and nuclear multiplication rate are statistically independent. We now explain this extended analysis in more detail in the introduction (lines 86ff). We also now more clearly state the dichotomous nature of the model (line 488). A new results paragraph (lines 213ff) and an entirely new Fig. 2 (and Fig. S4) contains the model predictions and statistical comparison between the models.

      This more rigorous treatment showed that including the variance of the multiplication rate was critical to allow a clean discrimination between the models. Also, with the sole exception of P.knowlesi H2B, where no model was clearly favored (Fig. 2G-H,K), the timer model was found to be inconsistent with the data, while the counter was clearly favored. Our new goodness-of-fit analysis also showed that although the counter is strongly simplified, it produced adequate fits, demonstrating that potential model refinements would need to be justified by new, more extensive data.

      It is also important to consider that the degree of variation in merozoite number could rather be an expression of varying growth conditions and does not directly predict which of the proposed models are true. For instance, a counter where the target merozoite number varies strongly depending on growth conditions, would be consistent with all available data. It is an interesting question for future work whether a counter would indeed describe growth across different isolates.

      The biological reality of growth regulation is certainly complex, and the counter model will likely need to be refined in the future, which we acknowledge in a corresponding statement in the discussion (lines 491ff). Nevertheless, we find it encouraging that a simple model can explain the vast majority of our data very well.

      Additionally, the only parasite parameter measured in this study, size at time of first nuclear division, explained only a small proportion of the variance observed in merozoite number.

      It is indeed the case that amongst the measured parasite parameters i.e. schizont stage duration, nuclear volume, and cell size we only found the latter to correlate with the final progeny number. We did not aim to imply that all variation in progeny number is explained by cell size. It is likely that a putative counter relies on a set of factors, which are somehow linked to cell size. In addition, intrinsic stochasticity in nuclear growth is likely to contribute to final merozoite number variability, which is included in our models via a variable growth rate. Defining the actual limiting factor or combination of factors will be an exciting challenge for the future studies building on this one.

      • For modelling of a timer-based mechanism, the designation of t0 is subjective. The authors chose the time of first nuclear division as their t0. It is possible that a timer-based mechanism could not be supported based on this model the chosen t0 differs from when the "parasite's timer" starts. For example, t could also have been designated as the time from merozoite invasion (t0) to egress (tend). It would be unreasonable to suggest the authors repeat experiments with a longer time-frame to address this, but this possibility should be discussed as a limitation of the model. It may also be possible to develop a different model where t0 = merozoite invasion and tend = egress, and test this model against the data already collected in this study.

      This is a valid point. We indeed, considered the time point of invasion as the other relevant time point in the IDC for a possible timer. Due to necessary compromises in imaging protocols between acquisition length, temporal, and spatial resolution we have not been able yet to combine full-length IDC measurements with quantification of progeny number. Given the choice, however, between time point of invasion and the onset of nuclear division as starting point for a potential timer we would still favor the latter: An argument can be made that a timer that regulates offspring number would be more accurate when activated at the moment of the relevant cellular events rather than “running” for a very prolonged growth phase before any “decision” concerning parasite replication. We are still convinced that the entry into the schizont stage, which we analyze here, marks an important cell cycle transition point that has been highlighted in many different studies. As suggested, we now discuss the limitations of our selection of t0 in the text (lines 146ff).

      • The calculation of the multiplication rate is confusingly defined. In Figure 1 it is stated that it is "...based on t and n", which would imply that the multiplication rate is the number of merozoites formed per hour of schizogony, which would give an average value of ~2 for P. falciparum and ~1.5 for P. knowlesi. The averages rate values shown, however, are in the range of 0.15-3. The authors should clarify how these values were determined.

      Thank you for pointing out the need for more clarity. Since the nuclear multiplication, similar to e.g. cell population growth, follows an exponential law, the multiplication rate used (lambda) is in fact a logarithmic growth rate. Therefore, it occurs in the exponent (not as a coefficient) in the exponential growth function ( ), which explains the range. We now mention this more explicitly in the results (lines 163ff).

      • In Figure 2, the time from tend until egress is calculated, and this is interpreted as the time required for segmentation. In the Rudlaff et al., 2020 study cited in this paper, it is shown that segmentation starts before the final round of nuclear divisions are complete. Considering this, the time from tend until egress is not an appropriate proxy for segmentation time. The authors should consider rewording to something akin to "time from final nuclear division until egress" to more accurately reflect these data.

      Thank you for indicating our imprecise use of the nomenclature. Indeed, some essential segmentation-associated structures such as rhoptries and subpellicular microtubules are clearly forming before the last division. We were referring to “segmentation” as the time window where actual ingression of the plasma membrane occurs between nuclei with the concurrent formation of more prominent IMC-associated sub-pellicular microtubules between nuclei (as in Fig. 1A last panel). We can, however, agree that consistently using the term “merozoite formation” is more adequate here. We have now corrected the terminology according to the suggestions of the reviewer (lines 271ff).

      • There is a significant discrepancy between the data in Figure 5 and Supplementary Figure 8. In Supplementary Figure 8, the authors establish that culturing parasites in media diluted 0.5x has a marginal effect on parasite growth, with no discernible change in parasitaemia over 96 hours. By contrast, in Figure 5a the parasitaemia of parasites cultured in 0.5x diluted media is approximately 5-fold lower than those in 1x media. The authors should explain the significant discrepancy between these results.

      The reviewer correctly points out a difference in parasitaemia between two parasite culture experiments, shown in Figs 5a (now 6A) and S8 (now S11), respectively. There were several differences in the experimental setup used in the two experiments that could explain this discrepancy. In Fig. 5a the parasites were synchronized to early ring stages while in Fig. S8 we used asynchronous cultures (maybe with a slight majority of late stages). One could speculate that by the time the synchronized ring stage culture reached egress the effect of nutrient depletion, which started at t = 0 h is more pronounced. This effect could have been exacerbated by the more frequent media change of 24 h in Fig. 5a vs 48h in Fig. S8. Lastly, the starting parasitemia was differently set being higher at around 0.5% in the Fig. 5a while only 0.2% in Fig. S8. Possibly a lack of nutrient is “felt less” by the culture at lower parasitemias. Generally, in Fig. S8 we were more focused on highlighting the difference between 1x/0.5x and the more diluted conditions on the long-term culture and to show that continuous culture is actually possible in 0.5x medium. We have now expanded the legends to highlight those differences more clearly.

      • In Supplementary Figure 4, the mask on the cell at t0 shows two distinct objects, but it seems very unlikely that they are two distinct nuclei as they vary approximately 5-fold in diameter. The authors should provide more detail on how their masking was performed for their volumetric analysis. Specifically, whether size thresholds were also applied during object detection.

      Thank you for requesting clarification here. Fig S4 (now S7) shows only one z-slice (not a projection) of the entire image stack, to illustrate how the thresholding approach was performed on every single image slice. The two objects in the shown cell are indeed two nuclei, but because they are not in the same z-plane appear to be of different size. In particular, only a slice of the upper part of the nucleus on the lower right is visible in the shown slice. Throughout the study, volume determination was realized by adding up the individual slices, as is explained in detail in the Materials and Methods sections. We have now added a more explanation in the figure legend to clarify the procedure.

      Minor Comments

      • Line 45-48 mentions that merozoite number influences growth rate and virulence, but the corresponding reference (Mancio-Silva et al., 2013) only discusses the relationship between merozoite number and growth rate, not virulence.

      We thank the reviewer for requesting this distinction. Merozoite number and virulence have not been correlated in vivo so far. Certainly, because one can’t retrieve late-stage P. falciparum parasites from patients, but maybe partly because merozoite number has not gotten significant attention as a metric in the previous decades. Even if merozoite number is intuitively connected to growth rate which might causes higher parasitemia which is in turn linked to more severe disease outcome it is important to emphasize that those are certainly not equivalent. We have therefore removed the statement about virulence (line 48).

      • Line 59 states that a 48 hour lifecycle is a baseline from which in vitro cultured parasites deviate. Clinical isolates also show variation in lifecycle length and so it is more accurate to just say that 48 hours is an average, rather than a baseline.

      The word “baseline” has been changed to “average” (line 61).

      • Line 63 cites a study for the lifecycle length of P. knowlesi (Lee et al., 2022), but there seems to be no mention of lifecycle length in this reference

      This reference was meant to serve as an introductory review article to research in P. knowlesi. Actually, to the knowledge of the authors, there is no study presenting quantitative data showing that the in vitro cycle of P. knowlesi is actually around 27 h. Our lab experience is however coherent with a 27 h cycle, which was confirmed by personal communication by the Moon lab. We now also cite in the next sentence the inaugural P. knowlesi adaptation publication (Moon et al. 2013) showing some time course data indicating the duration of the IDC to be around ~27h (lines 67ff).

      • If I am interpreting Figure 3B correctly, this is essentially a paired analysis where the same erythrocytes are measured twice, once at t0 and once at tend. If this is the case, this data may be better represented with lines that connect the t0 and tend values.

      Yes, these are the same erythrocytes measured twice. We have modified Figure 3 (now Fig. 4) accordingly.

      • Figure 3A seems to imply that to calculate diameter of the erythrocytes, three measurements were made and averaged for each cell. I think this is a nice way to get a more accurate erythrocyte diameter, but if this is the case, it should be specified in the figure legend or methods.

      This is already described in the figure legend (line 305).

      • In Figure 4I it is shown that in P. falciparum merozoite number doesn't correlate with nucleus size, but for P. knowlesi in Supplementary Figure 7c, a significant anticorrelation is observed. The authors should state this in the text and discuss this discrepancy.

      Contrary to all other graphs, visual inspection of the distribution of data points in Fig. S10C shows that it contains two outlier data points at the bottom right. Those two specific points are also responsible for the significant anticorrelation. We did not filter or remove any quantification results but also didn’t have sufficient confidence in this data distribution (which is further based on the segmentation of the Histone2B not on an NLS mCherry signal) to make substantial claims about anticorrelation. Because we considered it informative we still decided to show it in the supplements. We now briefly mention the issues with the data set and its interpretation in the text (lines 350ff).

      • The authors show that merozoite number roughly correlates with cell size at t0 but it would be interesting to see whether cell size at tend also corresponds with cell size at t0. This might help answer whether the cell is larger because it has more merozoites, or whether it has more merozoites because it is larger.

      Plotting parasite cell volume at t0 against cell volume at tend (as well as between t-2 and tend) indeed shows a positive correlation (see below). While it is an interesting thought we concluded after some discussion that no convincing causal relationship between cell size and merozoite number can be inferred based on this analysis. Since we consider the possible statement that cells that are bigger in the beginning are also bigger in the end unavailing, we decided not to include the data.

      • I don't feel that "nearly identical" is an appropriate summary of erythrocyte indices in Supplementary Figure 9, considering there is a statistically significant increase in mean cell volume. I think it is unlikely that this change is consequential, and performing these haematology analyses is a nice quality control step, but this change should be stated in the text.

      In the modified text we now express the significant change in MCV in terms of percentage, which is around 1.2% (line 381).

      • In Supplementary Figure 8, parasitaemia only increases ~2-fold compared to >5-fold the previous two cycles. It seems likely that at the final timepoint on this graph the parasites are starting to crash, and therefore it may be best to end the graph with the 96 hour timepoint.

      The reviewer suggests that cultures at those parasitemias might not be in perfect health. Our Giemsa stains did not show signs of an unhealthy culture and kept growing. It was, however, important for us to show that cultures can be maintained in culture over a prolonged period of time in 0.5x medium, even when resulting in reduced growth, while this was not possible with lower dilutions. Therefore, we would like to keep the data point. We have added a cautionary comment in the legend.

      • The error bars in Figure 5C aren't easily visible, moving them in front of the datapoints may help their visibility.

      Error bars were moved in front of the data points.

      • In Figure 6D & E, the y-axis labels should be changed to whole integers as all the values in the graph are whole numbers.

      We have changed the y-axis labels accordingly.

      • My interpretation of Figure 6 C-E, is that these are the same cells measured at three time points (t-2, t0 and tend). If this is the case, 6C is missing the cell that has a merozoite number of 8, which is presumably why the y-axes are not equalised for the three graphs.

      It is correct that the same cells are displayed in all three plots, with the exceptions of three cells in 6C (for the timepoint t-2), which are missing for the following reasons: 1) it was not possible to determine the volume at this respective timepoint due to technical issues or 2) the cell was already just before t0 at the start of the movie so that t-2 had already passed. We now note this in the figure legend and have also equalized the y-axes (now Fig. 7C-E).

      Reviewer #1 (Significance):

      In the asexual blood-stage of their lifecycle, malaria parasites replicate through a process called schizogony. During schizogony an initially mononucleated parasite undergoes multiple asynchronous rounds of mitosis followed by nuclear division without cytokinesis, producing a variable number of daughter nuclei. Parasites then undergo a specialised cytokinesis, termed segmentation to where nuclei are packaged into merozoites that go on to invade new host cells. While nucleus, and therefore merozoite, number are known to be varied between cells, across isolates, and across species, little is known about the mechanisms regulating merozoite number. In this study, the authors use live-cell microscopy to understand how parasites determine their progeny number. They suggest that parasites regulate their progeny number using a 'counter' mechanism, which would respond to the size or concentration of a cellular parameter, as opposed to a 'timer' mechanism. Long-term live-cell microscopy experiments using malaria parasites are extremely technically challenging, and the authors should be commended for their efforts in this regard. While I agree that the data generated from these experiments are technically sound, I have some reservations expressed above about the interpretation of some of these results. I would strongly encourage the authors to consider rewording some of their interpretations taking into account some of the caveats listed above. I would also consider fitting/testing an additional mathematical model where the time-frame proposed for the 'timer' mechanism begins following merozoite invasion.

      We thank the reviewer for the appreciation of our work and hope we have sufficiently reworked the manuscript based on the comments listed above. Furthermore, we think the improved model statement and analysis improves the clarity of our conclusions. Indeed, we would like to test additional models including the full IDC once, as mentioned above, we are technically able to generate these data.

      This work is of specific interest to anybody who grows malaria parasites, as the dynamics of their growth is obviously important to understand. Further, this work is of interest more generally to cell biologists who study the regulation of progeny number or cell size. I have no experience with the application of mathematical modelling to understand biological systems, and so I cannot comment on the interest of this work to that field.

      Reviewer #2 (Evidence, reproducibility and clarity):

      This is a solid study that further characterises the dynamics of nuclear division in Plasmodium falciparum and P. knowlesi. Of two, among potentially several, models for how the number of daughter nuclei, and thus parasites - (called merozoites in this genus), are one that posits nuclei divide until a fixed timer ends, and one that posits that nuclei divide to reach a fixed number that is defined by a cellular counter. I find some practical difficulties in definitive measurement of either model, one issue with the former is that experimental definition of the start of the timer is problematic - we may define the starter's gun (eg by the first nuclear division) but it isn't necessary that the cell is using that same start time.

      We are pleased that the Reviewer found our study ‘solid’. Concerning the timer model, we agree that the selection of the starting point is a critical aspect of this study, as also Reviewer 1 pointed out. We selected this particular “t0” because the entry into the mitotic phase marks an important cell cycle transition. Several studies have suggested a “schizogony entry checkpoint” might be active just before (Matthews et al, 2018; Voß et al, 2023; van Biljon et al, 2018; McLean & Jacobs-Lorena, 2020). Once cells are committed to the schizont stage they are less responsive to stimuli. Alternatively, the timepoint of erythrocyte invasion could be a legitimate starting point. Due to necessary compromises in our imaging protocol between acquisition length, temporal, and spatial resolution we have not been able yet to combine full-length IDC measurements with quantification of progeny number, and therefore we leave exploration of an earlier timer start for future work. Within the confines of the model comparison in the current study, we think the selected t0 is already highly informative. We now explain the selection and limitations more explicitly in the text (line 144ff).

      Additionally, as the authors confirm here, being sure when that first nuclear division has occurred is particularly tricky with Plasmodium parasites, in part because the first few nuclei seem to clump together, preventing one from unambiguously calibrating the first division.

      The Reviewer is concerned about difficulties with precise reporting of the time point of first nuclear division. We suspect there was a misunderstanding here. In the text (line 137) we had written the following:

      “Although separating individual nuclei after the first two rounds of division was challenging due to their spatial proximity, the improvements in resolution and 3D image analysis allowed us to count the final number of nuclei routinely and reliably at the transition into the segmenter stage.”

      To clarify, when analyzing 3D image stacks produced by the LSM900 Airyscan the first nuclear division can consistently and unambiguously be detected. In anaphase the nuclei are pushed apart quite substantially before getting a bit closer together afterwards (see e.g. Fig. 1B and C). Hence the precision of the detection is only limited by the 30 min interval of the time lapse. Later, at the four nuclei stage, crowding makes distinction more difficult. In the final segmenter stage, the reorganization and condensation of nuclei makes reliable counting possible again. We have now reformulated the quoted sentence for more clarity (lines 137ff).

      Furthermore, getting decent replicate numbers is hard because of the difficulties of time lapse microscopy, and most Plasmodium studies (including this one) suffer from low enough numbers that it isn't always clear whether the numbers support one model over another.

      The reviewer points out the difficulty of obtaining enough replicates in Plasmodium time-lapse studies. We agree that depending on technology, sufficient replicates can be challenging. In the present study we obtained Ns between 25 and 35 for all conditions in P. falciparum and P. knowlesi from three independent replicas. To gain confidence in the conclusions from a limited, but not austere, data, it is essential to 1) reduce model complexity to a minimum and 2) perform stringent statistical analysis including accounting for small-sample variation. Motivated by this concern of the Reviewer and a similar point raised by Reviewer 1, we have revisited our modeling approach in the revised manuscript. This led us to a corrected, more rigorous definition of what precisely we mean by ‘counter’ and ‘timer’ models: The timer posits that between individual parasites the target duration and the nuclear multiplication rate and vary in a statistically independent way, while in a counter target number and nuclear multiplication rate are statistically independent. With no further adjustable parameters, the two models are thus both mutually exclusive and minimal. Although biological reality is likely to be more complex, we feel that these minimal models are adequate for the amount and resolution of our current, state-of-the art data. The general result remained the same: The counter model is strongly preferred in almost all our experiments data (new Fig. 2), with the sole exception of P. knowlesi H2B, where indeed more data may be needed to come to a clear conclusion. Furthermore, we have taken care to scrutinize these conclusions accounting for goodness-of-fit for the respective sample size N. This analysis showed, surprisingly, that the counter model was sufficient to account for the data: the real dataset was as similar to the counter prediction as synthetic, counter-generated data. We hope that this improved statistical analysis can help the reader judge the robustness of our conclusions.

      Nonetheless, several recent studies, particularly a study from the same institute (Klaus et al., 2022) employing timelapse imaging of nuclei, and timing the nuclear division of parasites, finds poor correlation between the duration of "schizogeny" (although perhaps using a different definition to the one used by the parasite) and the final number or merozoites. They therefore argue that there is poor evidence for a timer, and conclude by elimination that a counter must exist instead. A review by some of the authors of that study and some of this current study (Voß et al 2023), also concludes that the data from Klaus and colleagues "strongly support" a counter model. This current study also concludes that a counter model controls final nuclear/merozoite number in P. falciparum and P. knowlesi. This much at least is not particularly novel given the recent work on this topic, although the addition of the P. knowlesi data is interesting and consistent with the prior P. falciparum work.

      Our present work, indeed, does confirm the previous report of a counter over a timer, through a more targeted approach. While Klaus et al. used timing data of first nuclear cycle vs. the full duration, we now provide, thanks to an improvement microscopy setup and protocol, simultaneous measurements of timing and final progeny number, i.e. counting of merozoites/nuclei. While the preference for a counter model is not fundamentally novel, the additional information that the counter model holds in different strains, conditions and species is, in our opinion, not trivial and points to some degree of evolutionary conservation. We also demonstrate here that the counter model is not only preferred over the timer, it also fits the data adequately, so that it can be considered ‘correct’ at this level of complexity. Another, possibly more important, value of this study lies in the quantitative and time-resolved assessment of multiple important parasite metrics such a cell volume and nuclear volume together with merozoite number at the single cell level. Although descriptive, this has not been achieved in Plasmodium until now.

      As above, the authors concede that it is difficult to determine with strong confidence when the first nuclear division has occurred, so it may well be that there is substantial noisiness in the time that they define schizogeny to commence. If that were the case, this would contribute to the poor correlation observed between schizogeny duration and number of merozoites produced, so this could be an important confounding experimental factor. This deserves some more discussion by the authors.

      Concerning the confidence with which we identify the first nuclear division we could hopefully clarify in the section above that our precision is only limited by the time resolution of the acquired time-lapse. Therefore, the uncertainty about the start time is not particularly high, and moreover, can expected to affect timer and counter (via the growth rate) to a similar degree. We see no unfair advantage for the counter for this reason.

      Alternative methods to count absolute DNA content (rather than trying to count individual nuclei) might be useful ways of independently confirming this phenomenon. Alternative possibilities for what constitutes the "start" of a possible timer are also warranted - it could be for example, the first division of one of the other organelles.

      This is an interesting suggestion. Next generation fluorogenic DNA dyes have been used by us and the Ganter group (Simon et al. 2021, Klaus et al. 2022, Wenz et l. 2023) to assess DNA content of single cells over time. Our experience shows that there are some caveats to using these Hoechst based dyes, some of which we discussed in the aforementioned publications. While they allow some reasonable absolute quantification of DNA content for the very first S-Phase (and subsequent nuclear division), in later stages only relative quantification can be achieved. One underlying reason is the apparent increase of dye permeability, and therefore higher intensity, at late schizont stages. This issue is exacerbated by the asynchronous DNA replication of multiple nuclei. Further, nuclear division itself can be delayed or even inhibited when increasing the concentration of the dye, which suggest an impact on cell physiology (well documented for Hoechst based dyes in other organisms). When reaching the segmenter stage, the resulting variance in fluorescent intensity would make it challenging to assign a reliable number of nuclei required for analysis, a problem that does not occur when counting individual nuclei. Taken together, unfortunately, all these confounding factors make DNA content analysis in live single cells for the entire schizont stage unachievable at this point.

      These and previous authors in any case conclude that a counter model must exist through exclusion of a timer model. I am less convinced that the evidence discounting the timer is conclusive, and that a straight counter model is the only alternative. Indeed I am unconvinced by the suitability of this strictly dichotomous two-model system to categorise the division of unicellular eukaryotes, and these theories are not universally held to be sufficient to describe division.

      We thank the Reviewer for this insightful comment. As already detailed above, we have clarified and corrected our model definitions in the revised manuscript. Further, we want to make the important distinction between organisms, including unicellular ones that undergo binary fission and the ones like Plasmodium that use schizogony. Our model, although inspired by model organisms, is tailored to a multinucleated division mechanism, and clearly defined within those boundaries. The timer and counter models we consider are defined by their correlation structures. They are at two extremes of a continuum of models which could be characterized, for instance, by the ratio of correlations (growth rate - nuclear number) vs. (growth rate – duration) as an additional parameter. As the reviewer points out, excluding the timer model is not equivalent to proving the counter model, and indeed a partially correlated model, or a more complex model entirely, could yield a better fit. However, within the realm of models without additional parameters, and which are testable with the available data, only timer and counter remain, as different timer start points are not experimentally accessible. Importantly and somewhat surprisingly, the counter model also gave a fit that is as good as can be reasonably expected for the experimental sample size (new Fig. 2). So, we maintain that within the current experimental constraints, the counter model is the only viable option for almost all our tested conditions. The observation that in H2B-GFP expressing P. knowlesi parasites no clear distinction can be made between the models, indeed, suggest that the reality of multiplication rate regulation is more complex and may be limited by different constraints in different growth regimes. We now state these limitations and the room for further model adjustments with more data in the Discussion section.

      Nonetheless, if a counter exists, what is being counted that determines the final number? The authors consider that this might be a physical object or resource inside the parasite, or an extrinsic/extracellular resource. They investigate this by comparing the final cell number to a number of factors. First, the authors investigate the size of the RBC (by musing the diameter as an indicator)- little information is given about the source of the blood used, but it appears to be from a single donor of unknown age, who has approximately typical variance in RBC diameter (at least, after manipulation and storage). The authors observe little correlation between these variables.

      We share the curiosity of the reviewer about what might be “counted” by the parasite. This shall be the subject of future studies, and our present study provides the necessary basis for asking this question and defines a framework to investigate it. Concerning the size of the host cell, the blood used was from a different donor for each of the replicas, which we now specify in the figure legend (line 302). No significant difference between the RBC diameters between the donors was observed. A correlation between RBC diameter and progeny number was indeed not observed.

      Second the authors measure parasite size at the onset of schizogeny, and find that bigger parasites result in more daughter merozoites early in schizogeny (perhaps not surprising, given the earlier mentioned technical problems with measuring the first few steps of schizogeny), but that this different initial cell size doesn't result in a different final merozoite number, or as they describe it "not quite significant anymore". Previous p values were taken as cause for rejecting the timer hypothesis and the timer model. In this case the authors instead interpret the data as suggesting "that the setting of the counter might correlate with parasite cell size". This is inconsistent statistical and analytical handling, and highlights the earlier potential pitfall of rejecting timer-based models based on not gathering data that statistically show a correlation. This needs reworking to highlight that these data are inherently noisy, difficult to measure accurately, and aren't necessarily going strongly reveal a trend even where one biologically exists, and that this ought not be used as grounds for confident rejection of a model.

      The Reviewer raises concerns about the consistency of the statistical interpretation of our data. We care deeply about the well-foundedness of our conclusions and hope to eliminate these concerns in the following. First, we hope that the issue about the “technical problems” in measuring the first division has been solved in our response to previous comments. Next, to clarify an apparent misunderstanding: As stated in the text (lines 329ff) and shown in now Fig. 5D-E, cell size at onset of nuclear division or 2 hours prior does significantly correlate with final merozoite number. The lack of significant p-value (0.08) only pertains to the correlation of cell size at the end of the schizont stage (tend) with merozoite number (now Fig. 5F). We have removed the unfortunate wording “not quite significant anymore” in that context. Finally, regarding potential mechanisms, a potential counter must be set before the first nuclear division is completed because only that way it can be set independent of the speed of nuclear multiplication. This observation gives the statistically significant correlation of volume at the onset of division and progeny number its relevance. We have reformulated the marked sentence for more clarity (lines 331ff). Furthermore, we point out that our rejection of the timer is now based on a revisited statistical analysis (Fig. 2), which is no longer based on a simple correlation between final number and duration, as detailed above.

      Finally, the authors grow the parasites in dilute media, and find that they produce fewer daughter parasites. This is anecdotally unsurprising, as most Plasmodium laboratories are aware that sub-optimal growth conditions result in less healthy schizonts with fewer viable merozoites (and lower magnitudes of single-cycle expansion), but is nonetheless an important result that highlights explicitly how much this occurs in the specific conditions of dilute media. Given the lack of investigation of exactly which nutrient, carbon source, or combination thereof leads to the reduced merozoite number, it is unclear if or how much this is relevant to the scenario of a natural infection and realistic levels of that nutrient in a human or primate parasite environment.

      As rightfully pointed out by the reviewer suboptimal growth conditions affecting parasite growth and multiplication rate have been shown in many instances. The number of studies that actually quantify a reduction in merozoite number under different growth conditions is certainly much lower (Brancucci et al. 2017 (lipids), Mancio-Silva et al. 2017 (calorie-restriction in mice), Tinto-Font et al. 2022 (temperature) come to mind). What our study adds to this body of literature is to which extent duration of the schizont stage and cell volume are affected in relation to progeny number at the single cell level. Importantly, we wanted to test whether the counter model still holds under these more adverse conditions, which we found to be the case. Along the lines of the work on calorie restriction and the likely implication of isoleucine in the process investigated in the laboratory of Maria Mota, it will be exciting to identify a “limiting factor” in future studies. Indeed, any study done in complete RPMI culture medium can be questioned regarding its physiological relevance and we added a sentence addressing this aspect in the discussion (lines 514ff). Yet, our medium dilution experiments suggest that at least to some degree an extracellular resource is implicated, which makes sense from a biological function point-of-view.

      Minor issues

      The manuscript confuses the terms "less" and "fewer". Fewer should be used for countable nouns (fewer daughter cells, fewer nuclei, fewer merozoites), less for uncountable nouns (e.g. less speed, less volume).

      Thank you for pointing this out. The words have been replaced accordingly.

      I didn't understand lines 93-95; "This excluded a timer and thereby confirmed a counter as the mechanism regulating termination of nuclear multiplication (Klaus et al., 2022). A direct correlation between duration of schizont stage and merozoite number is, however, still missing." If I understand the first sentence concludes that there ought not be a direct correlation between schizont duration and merozoite number, but the second sentence, says that that correlation is "however" missing. Isn't this expected? Perhaps reword for clarity?

      Thank you for requesting clarification here. The exclusion of the timer by Klaus et al. 2022 was based on the correlation between duration of the first nuclear division cycle and the total duration of all nuclear replication phases. At no point did Klaus et al. count merozoites in live single cells, which was mainly due to lower spatial resolution of their images (M. Ganter, personal communication). Therefore, they could not directly assess the relation between progeny number and schizont stage duration, which we now report for the first time. The sentence was supposed to convey that this type of data was missing and was now reformulated for more clarity (line 114).

      Lines 104

      "We further uncover that throughout schizogony P. falciparum infringes on the otherwise ubiquitously constant N/C-ratio (Cantwell and Nurse, 2019)" This seems obvious to me, and not something uncovered by this study. In most of the numerous apicomplexans that divide by endoschizogeny, the cells achieve a near final size considerably before the final rounds of nuclear division so the N/C ratio must not remain constant - this is a direct corollary of many previous descriptions and not a novel finding of this study, and this claim here should be made more modest.

      We understand the point raised by the reviewer but still think that our claim is justified due to several aspects. There are examples of eukaryotic cells that undergo multinucleated stages during division were the N/C-ratio is constant (Dundon et al. 2016, Cantwell and Nurse, 2019), while we are not aware of any counter-example in the literature. Studies have also shown that e.g. certain mutant yeast that fail to undergo cytokinesis will increase their volume by factor of up to 16 alongside the still replicating and growing nucleus maintain the N/C-ratio (Neumann et al. 2007, Jorgensen et al. 2007). This demonstrates the tremendous plasticity that cells can reveal with respect to nucleus and cell size regulation. Until the contrary was shown, it was conceivable that nuclear compaction, which does occur (Fig. 5H), compensates for the increase in nuclear number while the cell volume is only increasing slightly. Importantly, we are not aware of any literature where nuclear volume has been quantified for blood stage Plasmodium. Cell volume quantifications remain limited to modelling and the study by Waldecker et al., which provides a few datapoints throughout the IDC. Whether this finding is expected or not, formally speaking, our claim is justified, but for more clarity we replace “uncover” with “demonstrate”. We also introduce the N/C-ratio as cellular parameter in P. falciparum pointing out another divergent aspect of its biology and might in the future understand the functional implication of this usually constant ratio, which is still unclear.

      Dundon SE, Chang SS, Kumar A, Occhipinti P, Shroff H, Roper M, Gladfelter AS. Clustered nuclei maintain autonomy and nucleocytoplasmic ratio control in a syncytium. Mol Biol Cell. 2016 Jul 1;27(13):2000-7.

      Neumann FR, and Nurse P. Nuclear size control in fission yeast. J. Cell Biol. 2007; 179: 593–600. pmid:17998401

      Jorgensen P, Edgington NP, Schneider BL, Rupeš I, Tyers M & Futcher B Molecular Biology of the Cell 18 (2007) The size of the nucleus increases as yeast cells grow.

      Helena Cantwell, Paul Nurse; A homeostatic mechanism rapidly corrects aberrant nucleocytoplasmic ratios maintaining nuclear size in fission yeast. J Cell Sci; 132 (22)

      I lack specialist statistical knowledge to comment on the statistical analyses performed on the correlation data, and in particular, whether the high p values for t-Tests for correlation are sufficient to support the argument that there is not a correlation, and whether these observations are sufficiently powered to robustly test that hypothesis.

      We are confident that our reworked model analysis, as explained above, now sufficiently supports our hypotheses.

      Reviewer #2 (Significance):

      The manuscript purports to find a counting mechanism that determines parasite merozoite numbers, and that this coutner is set by an externally provided and diffusible resource. Many nutrients are in excess in normal culture media, but not all. If that counted nutrient(s) were normally in excess in the bloodstream, it could hardly be said to be the factor that is counted and that therefore defines merozoite number. Conversely, if the amount of that nutrient were increased in normal media, would parasites make even more merozoites? Further, if the "counted" item is a freely diffusible compound in the media, it should be equally accessible to each parasite in a culture condition, and isn't a reasonable explanation for the variable merozoite numbers in the normal media conditions. To me, it is unsurprising that parasites that are healthy and well fed are able to produce more merozoites, but I don't see this as being the same as support for a counter model where the parasite senses and counts a set number of merozoites to produce in response to a specific external counter. I think the shoehorning of this phenomenon into a paradigm used to describe some other eukaryotes may not be appropriate, and that the rejection of one overly simplistic timer model should not automatically lead to us dichotomously accepting a simple counter method as the alternative. The authors need to do more to either identify a countable input whose gradual increase leads to a predictable and gradual increase in merozoite number, to show that they do use a counter, or provide substantially more caveats to their argument that the parasites are using a counter based on an externally provided resource to determine merozoite number.

      The reviewer comments on the feasibility of a counter mechanism based on an externally provided and diffusible resource. In fact this is a limited view of how a counter may arise and not the one we subscribe to. Rather, while a resource may be diffusible in the medium, it would need to be consumed during schizogony, and insufficiently replenished, in order to enable counting by dilution in the host cell. Furthermore, the reviewer has doubts that the fact that “healthy and well fed […] produce more merozoites” implies “support for a counter model”. We fully agree, and we argue in the manuscript that it is the correlations between schizogony durations and merozoite counts that support a counter model.

      As we have argued above, the two alternative models we consider are inspired by paradigm from other eukaryotes, but their definitions in the present context are simple enough for them to be considered natural minimal models of schizogony. As the simplest imaginable phenomenological models of multiplication control, we find it natural to compare them, and we hope our new introductory section introduces them appropriately now. Naturally, we hope to expand on this simple model in the future and identify more precisely the limiting resources and describe a more direct response.

      Audience - relatively specialised - likely interested audience would combine apicomplexan cell biologists, as well as theorists of cell division mechanism

      Advance - limited - confirms phenomenon also described by other researchers in their institute, and extends to another related organism.

      We would like to add that the present data are the first quantitative joint measurements of schizogony dynamics and outcome in P.falciparum and knowlesi. They allowed for the first time a direct correlation of duration and merozoite number, thereby accessing the question of growth control head on. Further they provide a quantitative reference of several key cellular parameters for anybody studying asexual blood stage parasites.

      Reviewer #3 (Evidence, reproducibility and clarity):

      Summary:

      Stürmer and colleagues used super-resolution time-lapse microscopy to probe the mechanism regulating the number of merozoites produced by a single cell in Plasmodium falciparum and P. knowlesi. The authors conclude the followings-

      1. P. knowlesi has similar duration of schizont stage to P. falciparum, although having a 24 h intraerythrocytic developmental cycle (IDC) to 48 h of P. falciparum.
      2. Nuclear multiplication dynamics suggests a counter mechanism of division- which is further suggested by a significant relation of merozoite numbers with schizont size at the onset of division.
      3. Nutritional deprivation caused increase in nuclear volume and decrease in merozoite number. For the most part, the experiments that are presented in this manuscript support the conclusion of the authors. The data are presented in a concise and clear manner. However, some clarification and a couple of experiment (listed below) would improve this manuscript.

      Major comments:

      1. The authors generated at least 3 transgenic lines for this study, But the did not present any genetic validation of the lines in the manuscript. For completeness, I recommend to provide genetic validation (either pcr genotyping or whole genome sequencing) of the lines that were generated and used in this study in the supplement.

      Our study exclusively used episomal expression of the respective fluorescent reporter (H2B-GFP, NLS-mCherry, and cytoplasmic GFP). As is customary in the field resistance to selection drugs and distinct fluorescent signals are assumed to sufficiently validate the presence of the plasmids. We now added the schematic maps of the plasmids in a new Fig. S1 to make our approach more visually clear.

      1. In the H2B-GFP lines, the authors episomally GFP-tagged histone 2B to label the nuclear chromatin for both P. falciparum and P. knowlesi. This provides a very useful parasite line which enables the live time-lapse microscopy. Using these parasite lines, the authors first show that despite having a 24 h IDC in P. knowlesi vs 48 h in P. falciparum, both these parasites have a similar duration of the schizont stage (8.s vs 9.4 h). My concern here is whether this GFP-tagging is influencing the growth dynamics as in slowing down the P. knowlesi parasites. However, if that was the case authors should have seen that for P. falciparum too. Also, for the P. falciparum parasites that episomally express cytosolic GFP and Nuclear mCherry have a higher number of merozoites compared to the H2B-GFP P. falciparum and the authors speculate this is probably because of not tagging Histone 2B. Given this, it is important to show that none of the H2B-GFP parasites show any significant fitness cost due to GFP tagging of histone. I recommend a simple experiment to compare the multiplication rate of H2B-GFP lines to the parental lines in identical growth conditions. This suggested experiment was described in PMID: 35164549 to determine fitness cost of knockout lines. This experiment is vital for validation of the H2B-GFP lines and subsequent interpretation of the data that were presented in this manuscript.

      We thank the reviewer for this excellent suggestion. To validate our lines further we now have carried out multiplication rate measurements similar to the one described in the designated publication for all the used lines alongside their parental strains (Fig. S2). We found no significant differences in between the wild type and the episomally expressing parasite lines (lines 131ff), which gives us confidence that episomal expression of tagged proteins do not significantly alter growth dynamics in these cases.

      1. The authors used the microtubule live cell dye SPY555-Tubulin in P. falciparum to validate the findings presented in 1D and 1E. They did not do that for P. knowlesi. If there is no unsurmountable technical difficulty, I suggest doing the same with P. knowlesi. This will also address the concern that I have pointed out in #1.

      Thank you for this suggestion. We have now generated the requested data with P. knowlesi, added it to what is now Supplemental Figure 3 and included it in our new analysis (Fig. 2I-J). The numerical values align well with the observations made when measuring schizont stage dynamics with the H2B-GFP expressing P. knowlesi line (line 158). A notable difference is that the Tubulin data strongly support the (refined) counter model, while the H2B data alone allow no distinction.

      1. The data in Figure 3 shows that merozoite number does not depend on host cell diameter. My question here is, were these data collected using different donor blood? Or were this measured from different biological replicate? These are not clear from the writing. I am not sure about whether blood from various donor would have on the data, however, different preparation of the cells across various biological replicate will have some effect on host cell diameter hence on data. State if these were collected from independent biological replicates and about the donor blood.

      The data results where indeed collected from three independent biological replicates using different donor blood batches. This is now stated in the figure legend. The batches displayed no difference in RBC diameter.

      1. It is interesting to see that nutrient-limited conditions increase average nuclear volume but less merozoite numbers. In this experiment, as I understand, complete media was diluted 0.5x, which basically diluted every component of the media by half. From this experiment I can see nutritional deprivation as a whole having an effect and supports the counter mechanism, it would be intriguing to see if there is any effect of a particular nutrient have any effect on progeny division. For example, parasites can be grown in amino acid deprived media (except isoleucine) which makes the parasites fully dependent on host cell amino acids. This sort of specific nutrient deprivation will probably allow the authors to probe for specific nutrients that plays role as counter mechanism factor.

      This is indeed a very exciting direction we would like to investigate in more detail in follow-up studies. Our aim for this study was to confirm that nutrient deprivation actually affects “counting” and to provide a workflow to investigate individual nutrients. In the meantime the Mota group, in a study we now cite in the discussion (lines 507ff), actually reported that isoleucine (and possibly methionine) levels are linked to progeny number. A follow-up on this topic using our strains and methodology is certainly worthwhile but requires more detailed analysis in the future.

      Minor comments:

      1. P. knowlesi is sometimes just written as knowlesi. Please, write P. Knowlesi.

      Has been corrected.

      1. Supplemental figure 1D, missing x-axis label.

      We added the x-axis label.

      1. In line 105, define N/C.

      Done.

      1. In line 205, I assume the authors mean episomally, not episomally.

      Thank you for pointing this out. We have replaced “ectopically” with “episomally” throughout the text.

      1. In line 275, Duration of Schizont stage was slightly....

      Has been corrected.

      1. All 'ml' or 'µl' should be 'mL' or 'µL'.

      Changes have been made.

      1. Define iRPMI.

      We added a definition (line 610).

      1. In line 475, replace 'as' with 'and'.

      Done.

      Reviewer #3 (Significance):

      The factors that regulate the number of progenies in malaria parasites remain unknown. While there are few previous studies attempting to answer the question, those studies were done on fixed stained cells. In this study, the authors used genetically modified fluorescent P. falciparum and P. knowlesi parasites that enable live microscopy. These parasites coupled with super-resolution time-lapse microscopy the authors attempt to investigate the mechanism(s) at play in regulating progeny division. This manuscript provides data to suggest that external resources might have some role in progeny division and supports the counter mechanism. More careful validation of the transgenic lines that were used to collect data presented needs to be more systematic and rigorous.

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      This is a solid study that further characterises the dynamics of nuclear division in Plasmodium falciparum and P. knowlesi. Of two, among potentially several, models for how the number of daughter nuclei, and thus parasites - (called merozoites in this genus), are one that posits nuclei divide until a fixed timer ends, and one that posits that nuclei divide to reach a fixed number that is defined by a cellular counter. I find some practical difficulties in definitive measurement of either model, one issue with the former is that experimental definition of the start of the timer is problematic - we may define the starter's gun (eg by the first nuclear division) but it isn't necessary that the cell is using that same start time. Additionally, as the authors confirm here, being sure when that first nuclear division has occurred is particularly tricky with Plasmodium parasites, in part because the first few nuclei seem to clump together, preventing one from unambiguously calibrating the first division. Furthermore, getting decent replicate numbers is hard because of the difficulties of time lapse microscopy, and most Plasmodium studies (including this one) suffer from low enough numbers that it isn't always clear whether the numbers support one model over another.

      Nonetheless, several recent studies, particularly a study from the same institute (Klaus et al., 2022) employing timelapse imaging of nuclei, and timing the nuclear division of parasites, finds poor correlation between the duration of "schizogeny" (although perhaps using a different definition to the one used by the parasite) and the final number or merozoites. They therefore argue that there is poor evidence for a timer, and conclude by elimination that a counter must exist instead. A review by some of the authors of that study and some of this current study (Voß et al 2023), also concludes that the data from Klaus and colleagues "strongly support" a counter model. This current study also concludes that a counter model controls final nuclear/merozoite number in P. falciparum and P. knowlesi. This much at least is not particularly novel given the recent work on this topic, although the addition of the P. knowlesi data is interesting and consistent with the prior P. falciparum work. As above, the authors concede that it is difficult to determine with strong confidence when the first nuclear division has occurred, so it may well be that there is substantial noisiness in the time that they define schizogeny to commence. If that were the case, this would contribute to the poor correlation observed between schizogeny duration and number of merozoites produced, so this could be an important confounding experimental factor. This deserves some more discussion by the authors. Alternative methods to count absolute DNA content (rather than trying to count individual nuclei) might be useful ways of independently confirming this phenomenon. Alternative possibilities for what constitutes the "start" of a possible timer are also warranted - it could be for example, the first division of one of the other organelles.

      These and previous authors in any case conclude that a counter model must exist through exclusion of a timer model. I am less convinced that the evidence discounting the timer is conclusive, and that a straight counter model is the only alternative. Indeed I am unconvinced by the suitability of this strictly dichotomous two-model system to categorise the division of unicellular eukaryotes, and these theories are not universally held to be sufficient to describe division. Nonetheless, if a counter exists, what is being counted that determines the final number? The authors consider that this might be a physical object or resource inside the parasite, or an extrinsic/extracellular resource. They investigate this by comparing the final cell number to a number of factors. First, the authors investigate the size of the RBC (by musing the diameter as an indicator)- little information is given about the source of the blood used, but it appears to be from a single donor of unknown age, who has approximately typical variance in RBC diameter (at least, after manipulation and storage). The authors observe little correlation between these variables. Second the authors measure parasite size at the onset of schizogeny, and find that bigger parasites result in more daughter merozoites early in schizogeny (perhaps not surprising, given the earlier mentioned technical problems with measuring the first few steps of schizogeny), but that this different initial cell size doesn't result in a different final merozoite number, or as they describe it "not quite significant anymore". Previous p values were taken as cause for rejecting the timer hypothesis and the timer model. In this case the authors instead interpret the data as suggesting "that the setting of the counter might correlate with parasite cell size". This is inconsistent statistical and analytical handling, and highlights the earlier potential pitfall of rejecting timer-based models based on not gathering data that statistically show a correlation. This needs reworking to highlight that these data are inherently noisy, difficult to measure accurately, and aren't necessarily going strongly reveal a trend even where one biologically exists, and that this ought not be used as grounds for confident rejection of a model.

      Finally, the authors grow the parasites in dilute media, and find that they produce fewer daughter parasites. This is anecdotally unsurprising, as most Plasmodium laboratories are aware that sub-optimal growth conditions result in less healthy schizonts with fewer viable merozoites (and lower magnitudes of single-cycle expansion), but is nonetheless an important result that highlights explicitly how much this occurs in the specific conditions of dilute media. Given the lack of investigation of exactly which nutrient, carbon source, or combination thereof leads to the reduced merozoite number, it is unclear if or how much this is relevant to the scenario of a natural infection and realistic levels of that nutrient in a human or primate parasite environment.

      Minor issues

      The manuscript confuses the terms "less" and "fewer". Fewer should be used for countable nouns (fewer daughter cells, fewer nuclei, fewer merozoites), less for uncountable nouns (e.g. less speed, less volume).

      I didn't understand lines 93-95;<br /> "This excluded a timer and thereby confirmed a counter as the mechanism regulating termination of nuclear multiplication (Klaus et al., 2022). A direct correlation between duration of schizont stage and merozoite number is, however, still missing."<br /> If I understand the first sentence concludes that there ought not be a direct correlation between schizont duration and merozoite number, but the second sentence, says that that correlation is "however" missing. Isn't this expected? Perhaps reword for clarity?

      Lines 104<br /> "We further uncover that throughout schizogony P. falciparum infringes on the otherwise 105 ubiquitously constant N/C-ratio (Cantwell and Nurse, 2019)" This seems obvious to me, and not something uncovered by this study. In most of the numerous apicomplexans that divide by endoschizogeny, the cells achieve a near final size considerably before the final rounds of nuclear division so the N/C ratio must not remain constant - this is a direct corollary of many previous descriptions and not a novel finding of this study, and this claim here should be made more modest.

      I lack specialist statistical knowledge to comment on the statistical analyses performed on the correlation data, and in particular, whether the high p values for t-Tests for correlation are sufficient to support the argument that there is not a correlation, and whether these observations are sufficiently powered to robustly test that hypothesis.

      Significance

      The manuscript purports to find a counting mechanism that determines parasite merozoite numbers, and that this coutner is set by an externally provided and diffusible resource. Many nutrients are in excess in normal culture media, but not all. If that counted nutrient(s) were normally in excess in the bloodstream, it could hardly be said to be the factor that is counted and that therefore defines merozoite number. Conversely, if the amount of that nutrient were increased in normal media, would parasites make even more merozoites? Further, if the "counted" item is a freely diffusible compound in the media, it should be equally accessible to each parasite in a culture condition, and isn't a reasonable explanation for the variable merozoite numbers in the normal media conditions. To me, it is unsurprising that parasites that are healthy and well fed are able to produce more merozoites, but I don't see this as being the same as support for a counter model where the parasite senses and counts a set number of merozoites to produce in response to a specific external counter. I think the shoehorning of this phenomenon into a paradigm used to describe some other eukaryotes may not be appropriate, and that the rejection of one overly simplistic timer model should not automatically lead to us dichotomously accepting a simple counter method as the alternative. The authors need to do more to either identify a countable input whose gradual increase leads to a predictable and gradual increase in merozoite number, to show that they do use a counter, or provide substantially more caveats to their argument that the parasites are using a counter based on an externally provided resource to determine merozoite number.

      Audience - relatively specialised - likely interested audience would combine apicomplexan cell biologists, as well as theorists of cell division mechanism

      Advance - limited - confirms phenomenon also described by other researchers in their institute, and extends to another related organism.

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      Summary

      Malaria parasites replicating in human red blood cells show a striking diversity in the number of progeny per replication cycle. Variation in progeny number can be seen between different species of malaria parasites, between parasite isolates, even between different cells from the same isolate. To date, we have little understanding of what factors influence progeny number, or how mechanistically it is controlled. In this study, the authors try to define how the mechanism that determines progeny number works. They propose two mechanisms, a 'counter' where progeny number is determined by the measurement of some kind of parasite parameter, and a 'timer' where parasite lifecycle length would be proportional to progeny number. Using a combination of long-term live-cell microscopy and mathematical modelling, the authors find consistent support for a 'counter' mechanism. Support for this mechanism was found using both Plasmodium falciparum, the most prominent human malaria parasite, and P. knowlesi, a zoonotic malaria parasite. Of the parameters measured in this study, the only thing that seemed to predict progeny number was parasite size around the onset of mitosis. The authors also found that during their replication inside red blood cells, malaria parasites drastically increase their nuclear to cytoplasmic ratio, a cellular parameter remains consistent in the vast majority of cell-types studied to date.

      Major Comments

      • It is stated a few times in this study that P. knowlesi has an ~24 hour lifecycle, and while this is the case for in vivo P. knowlesi, it was established in the study when P. knowlesi A1-H1 was adapted to human RBCs (Moon et al., 2013) that this significantly extended the lifecycle to ~27 hours, which should be made clear in the text. As much of this study revolves around lifecycle length and timing, the authors should consider some of their findings with the context that in vitro adaption can significantly alter lifecycle length.
      • The dichotomous distinction between 'timer' and 'counter' as mutually exclusive mechanisms seems to be a drastic oversimplification. Considering the drastic variation we see in merozoite number across species, between isolates, and between cells, it seems much more likely that there are factors controlled by both time-sensed and counter-sensed mechanisms that both influence progeny number. Additionally, the only parasite parameter measured in this study, size at time of first nuclear division, explained only a small proportion of the variance observed in merozoite number.
      • For modelling of a timer-based mechanism, the designation of t0 is subjective. The authors chose the time of first nuclear division as their t0. It is possible that a timer-based mechanism could not be supported based on this model the chosen t0 differs from when the "parasite's timer" starts. For example, t could also have been designated as the time from merozoite invasion (t0) to egress (tend). It would be unreasonable to suggest the authors repeat experiments with a longer time-frame to address this, but this possibility should be discussed as a limitation of the model. It may also be possible to develop a different model where t0 = merozoite invasion and tend = egress, and test this model against the data already collected in this study.
      • The calculation of the multiplication rate is confusingly defined. In Figure 1 it is stated that it is "...based on t and n", which would imply that the multiplication rate is the number of merozoites formed per hour of schizogony, which would give an average value of ~2 for P. falciparum and ~1.5 for P. knowlesi. The averages rate values shown, however, are in the range of 0.15-3. The authors should clarify how these values were determined.
      • In Figure 2, the time from tend until egress is calculated, and this is interpreted as the time required for segmentation. In the Rudlaff et al., 2020 study cited in this paper, it is shown that segmentation starts before the final round of nuclear divisions are complete. Considering this, the time from tend until egress is not an appropriate proxy for segmentation time. The authors should consider rewording to something akin to "time from final nuclear division until egress" to more accurately reflect these data.
      • There is a significant discrepancy between the data in Figure 5 and Supplementary Figure 8. In Supplementary Figure 8, the authors establish that culturing parasites in media diluted 0.5x has a marginal effect on parasite growth, with no discernible change in parasitaemia over 96 hours. By contrast, in Figure 5a the parasitaemia of parasites cultured in 0.5x diluted media is approximately 5-fold lower than those in 1x media. The authors should explain the significant discrepancy between these results.
      • In Supplementary Figure 4, the mask on the cell at t0 shows two distinct objects, but it seems very unlikely that they are two distinct nuclei as they vary approximately 5-fold in diameter. The authors should provide more detail on how their masking was performed for their volumetric analysis. Specifically, whether size thresholds were also applied during object detection.

      Minor Comments

      • Line 45-48 mentions that merozoite number influences growth rate and virulence, but the corresponding reference (Mancio-Silva et al., 2013) only discusses the relationship between merozoite number and growth rate, not virulence.
      • Line 59 states that a 48 hour lifecycle is a baseline from which in vitro cultured parasites deviate. Clinical isolates also show variation in lifecycle length and so it is more accurate to just say that 48 hours is an average, rather than a baseline.
      • Line 63 cites a study for the lifecycle length of P. knowlesi (Lee et al., 2022), but there seems to be no mention of lifecycle length in this reference
      • If I am interpreting Figure 3B correctly, this is essentially a paired analysis where the same erythrocytes are measured twice, once at t0 and once at tend. If this is the case, this data may be better represented with lines that connect the t0 and tend values.
      • Figure 3A seems to imply that to calculate diameter of the erythrocytes, three measurements were made and averaged for each cell. I think this is a nice way to get a more accurate erythrocyte diameter, but if this is the case, it should be specified in the figure legend or methods.
      • In Figure 4I it is shown that in P. falciparum merozoite number doesn't correlate with nucleus size, but for P. knowlesi in Supplementary Figure 7c, a significant anticorrelation is observed. The authors should state this in the text and discuss this discrepancy.
      • The authors show that merozoite number roughly correlates with cell size at t0 but it would be interesting to see whether cell size at tend also corresponds with cell size at t0. This might help answer whether the cell is larger because it has more merozoites, or whether it has more merozoites because it is larger.
      • I don't feel that "nearly identical" is an appropriate summary of erythrocyte indices in Supplementary Figure 9, considering there is a statistically significant increase in mean cell volume. I think it is unlikely that this change is consequential, and performing these haematology analyses is a nice quality control step, but this change should be stated in the text.
      • In Supplementary Figure 8, parasitaemia only increases ~2-fold compared to >5-fold the previous two cycles. It seems likely that at the final timepoint on this graph the parasites are starting to crash, and therefore it may be best to end the graph with the 96 hour timepoint.
      • The error bars in Figure 5C aren't easily visible, moving them in front of the datapoints may help their visibility.
      • In Figure 6D & E, the y-axis labels should be changed to whole integers as all the values in the graph are whole numbers.
      • My interpretation of Figure 6 C-E, is that these are the same cells measured at three time points (t-2, t0 and tend). If this is the case, 6C is missing the cell that has a merozoite number of 8, which is presumably why the y-axes are not equalised for the three graphs.

      Significance

      In the asexual blood-stage of their lifecycle, malaria parasites replicate through a process called schizogony. During schizogony an initially mononucleated parasite undergoes multiple asynchronous rounds of mitosis followed by nuclear division without cytokinesis, producing a variable number of daughter nuclei. Parasites then undergo a specialised cytokinesis, termed segmentation to where nuclei are packaged into merozoites that go on to invade new host cells. While nucleus, and therefore merozoite, number are known to be varied between cells, across isolates, and across species, little is known about the mechanisms regulating merozoite number. In this study, the authors use live-cell microscopy to understand how parasites determine their progeny number. They suggest that parasites regulate their progeny number using a 'counter' mechanism, which would respond to the size or concentration of a cellular parameter, as opposed to a 'timer' mechanism. Long-term live-cell microscopy experiments using malaria parasites are extremely technically challenging, and the authors should be commended for their efforts in this regard. While I agree that the data generated from these experiments are technically sound, I have some reservations expressed above about the interpretation of some of these results. I would strongly encourage the authors to consider rewording some of their interpretations taking into account some of the caveats listed above. I would also consider fitting/testing an additional mathematical model where the time-frame proposed for the 'timer' mechanism begins following merozoite invasion.

      This work is of specific interest to anybody who grows malaria parasites, as the dynamics of their growth is obviously important to understand. Further, this work is of interest more generally to cell biologists who study the regulation of progeny number or cell size. I have no experience with the application of mathematical modelling to understand biological systems, and so I cannot comment on the interest of this work to that field.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reviewer #1 (Evidence, reproducibility and clarity):

      In this manuscript the author is presenting a deep-learning model used to predict the development stage of zebrafish embryo. A robust method that can accurately classify a zebrafish into different development stages is highly relevant for many researchers working with zebrafish and hence the importance in developing methods like this is high.

      The manuscript is overall ok. However, more data is needed to convince the reader that the method is robust enough to work with other samples in other labs. This would greatly improve the impact of the publication.

      We agree with the reviewer and have included in our revised manuscripts additional test data that was acquired at a different laboratory to the training data (Figures 5 - 7).

      Page 6.<br /> - How is the data acquired?

      Images used to do initial model training are the same as those used in a previous study - the details of image acquisition are contained in the relevant publication (doi: 10.12688/wellcomeopenres.18313.1). However, we have now added “Zebrafish Husbandry” and “Live Imaging” for newly-acquired images. We have added a table (Table 1) listing details of all image data used in the study.

      Page 8.<br /> "This indicates that whileKimmelNet can be used successfully with noisier test data than that on which it was trained,there is an upper limit to how noisy the data can be."<br /> - This is an obvious statement there will always be an upper limit on noise.

      We agree with the reviewer that this statement is not terribly informative. This section (“KimmelNet’s prediction accuracy is not significantly impacted by moderate levels of additive noise”) has been removed from the revised manuscript in favour of incorporating a section detailing testing of the model on newly-acquired images (“KimmelNet can generalise to previously unseen data”).

      Page 9.<br /> - Are only wildtype embryos used? How would this work on different mutants. To evaluate the robustness of the method this it would be valuable to test on some mutant line with known developmental difference from the wild type.

      We agree with the reviewer that testing on a mutant line would lend more weight to our findings. For example, the p53-/- zebrafish has a reported, published developmental delay, but we did not have access to that line. However, the developmental delay reported for the p53-/- mutant is virtually indistinguishable from that effected by a temperature change. We therefore focussed our efforts on developmental delay affected by altering incubation temperature only.

      Image data.<br /> - I would strongly suggest that the author should include a description of the data in the manuscript. A description of how the data is acquired, microscope, different batches, type of embryos used.

      The image data used in the first draft of the manuscript is the same as that used in a previous publication (Jones et al. 2022), which contains all the relevant details the reviewer seeks. However, we have now added the relevant information for the newly-acquired image data.

      "Random160translation in the y-direction was avoided due to the aspect ratio of the images (width>161height) - any artifacts introduced by translation in the x-direction would be removed by the162centre crop layer, but this would not be the case for translation in the y-direction."<br /> - Could this be solved by using some border method reflection, repetition or fixed value?

      The reviewer is correct that some form of image reflection or repetition could be utilised. However, given the nature of our images, if an embryo is located close to the image boundary, reflection/repetition can result in some odd artefacts, so we minimised the use of such fill methods (also used by the random zoom augmentation layer). We could instead use an arbitrary fixed value, as the reviewer suggested, but finding a value suitable for all images is difficult.

      Page 10.<br /> Addition of Noise to Image Data<br /> - This should be added in the training phase. This would probably improve the robustness of the network and also improve the results on the test data.

      We agree with the reviewer and have now added a random Gaussian noise layer for data augmentation purposes during model training (see Figure 1).

      • Supplementary 3 images with high noise. It is worrying that the network is not able to handle the noise in this figure. Looks like the features that is used to distinguish the developmental stage of the embryo is still clearly seen with this high noise level? Retrain the model with noise as an augmentation to improve this.

      As the reviewer suggested, addition of random noise is now incorporated into model training. The new version of the manuscript does not include the same supplemental figures, but instead includes additional testing on newly-acquired data instead.

      Reviewer #1 (Significance):

      The development of methods like this is highly relevant in the zebrafish community. Staging and evaluating the developmental stage for zebrafish is common and is of interest to the broad community. A lot of this work today is done manually, limiting the throughput, and adding human bias.

      The limit of this study is the dataset used for training and evaluation. Firstly, it is not clear about the structure of the data and how it is acquired, different types of fish or imaging setup etc. For a method to be useful to the community it needs to be robust enough to handle different types of fish (transgenic lines). The manuscript would be greatly improved by adding this to the training and evaluation.

      We have now added additional datasets for the purposes of evaluating the model.

      My expertise is image analysis and machine learning for quantification of biological samples, with focus on zebrafish screening.

      Reviewer #2 (Evidence, reproducibility and clarity):

      Summary<br /> The paper "Automated staging of zebrafish embryos with KimmelNet" by Barry et al., presents a method to automatically stage developmental timepoints of zebrafish embryos based on convolutional neural networks (CNN). The authors show that a CNN trained on ~20k images can determine time post fertilization on test-image sets with an accuracy on the range of a few hours. This technique undoubtedly has the potential to become very useful for any zebrafish researchers interested in developmental timing as it eases analysis and removes potential subjective bias.

      Major comments<br /> In its current form the paper lacks sufficient graph annotations and method descriptions. This makes it hard in places to judge the validity of the claims. I do believe that the presented method can be useful and is likely valid but to be convincing, the authors need to spend more time expanding the methods, justifying their choices of analysis and clarifying figure annotations.

      We believe that we have addressed the reviewer’s concerns in this revised manuscript, as detailed in response to the specific points below.

      Specific points:<br /> 1) The annotation of the training data is not described and specifically it is unclear how valid the staging of the training data itself is. The authors state in the introduction "the hours post fertilization (hpf) [...] provides only and approximation of the actual developmental stage". It is therefore critical to know how this was accounted for in the annotation of the training data. Since the quality of the training data will ultimately limit the best-case quality of Kimmel Net. The authors need to go into some detail here even though the training data appears to be from another published dataset.

      The reviewer raises a valid point – two individual zebrafish embryos that are x hours post-fertilisation are not necessarily at the same developmental stage. However, we believe it is reasonable to assume that two populations of embryos x hours post-fertilisation are, on average, at the same developmental stage and it is this assumption that forms the basis for our approach. Given the inherent variability the reviewer refers to, we are not suggesting that our model would be particularly accurate for staging individual embryos. However, we are very confident (and we believe the data in the manuscript supports this) that given a population of embryos, our model will provide an accurate rate of development. We have added a paragraph (lines 131-141) to address this point.

      2) Why were "test predictions fit to a straight line through the origin". On the one hand this makes sense (since the slope would indicate the correspondence) but it should be clarified why an intercept was omitted in the fit. After all it is unclear if Kimmel net correctly identifies 0Hpf embryos.

      The reviewer makes a valid point – we do not know what predictions KimmelNet would produce for images of embryos closer to 0 hpf. However, we felt an equation of the form y=mx was a reasonable choice for two reasons. First of all, it matches the form of the Kimmel equation, which, despite its flaws, we are using as a benchmark of sorts – the absence of a y intercept makes comparisons with the Kimmel equation straightforward. Secondly, a “perfect” model would produce a straight line fit with y=x, so the lack of a y intercept seemed a reasonable constraint to impose. We have added some brief text (lines 103-105) to clarify this choice.

      3) The methods do not list how the mean of the absolute error was calculated from 3B/C. I think this should be the mean of the absolute error (not the mean of the error) but in that case the numbers listed in the text appear rather small given the histograms in 3 B/C. A clear statement in the methods would clarify this issue.

      We have now added a “Statistical Analysis” section under Materials & Methods to detail exactly what was used to calculate the values given for error analysis. We have calculated the mean of the error, not the mean of the absolute error, as we wish to illustrate that the mean is close to zero. We have used the standard deviation of the errors to illustrate that there is a significant spread in the error values, as depicted in Figure 3C and D.

      Minor comments<br /> 1) The Y-axis in Figure 2B is simply labeled "Loss" - what is the unit of this loss? HPF? Or HPF^2? This is important for judging the quality of the fit

      We thank the reviewer for drawing our attention to this omission. The loss is hpf2 (mean squared error) and we have updated the plot to reflect this.

      2) Figure 3 B. I would suggest changing the labels of the confidence intervals in the legend. "Inner and outer" is already clear from the figure itself, so labels that state that these are derived from n=100 vs. n=20 test image sized samples would be more useful to the reader

      We thank the reviewer for this suggestion – we have updated the figure legend accordingly.

      Referees cross-commenting

      I concur with comments issued by the other reviewers. I think it will be especially important to address the comments related to testing the method on mutants (Reviewer #1) and training the model in the presence of noise to increase its robustness (Reviewers #1 and #3) as well as addressing the overall annotation/generation of the training data (Reviewers #1 and #2).

      We believe we have now addressed all of these concerns. The model has been retrained with additional data augmentation incorporating random noise, tested on newly-acquired data and we have added tables summarising the details of all image data used in this study.

      I think these points will be critical to make the paper useful by increasing transparency and ensuring reproducibility in other labs with different imaging conditions, strains, mutants, etc.

      Reviewer #2 (Significance):

      Developmental delay is a common occurrence that can be caused by genetic and environmental background effects. It is therefore highly desirable to properly quantify this variable. The work presented here makes an important step in this direction, by allowing to quantify developmental timepoints independent of subjective staging. This speeds up analysis, increases reproducibility and enhances rigor. However, as my comments above indicate, the significance also depends on the ability of potential users to judge the quality of the work. Once those issues have been addressed, I think the work will be of broad interest to the developmental biology community, first and foremost labs utilizing the zebrafish model. However, as the authors state, the presented model architecture could be trained with the data from other species as well.

      Expertise: Zebrafish, quantitative analysis, behavior, neuroscience

      We thank the reviewer for their positive feedback.

      Reviewer #3 (Evidence, reproducibility and clarity):

      Summary:

      Properly staging embryos of zebrafish embryos is important, yet provides challenging since it can depend on many factors, such as temperature, water quality, fish population density, etc. Here, the authors provide a deep-learning-based model called KimmelNet that allows the prediction of the age of zebrafish embryos, using 2D brightfield images. The technique is robust to weak measurement noise and can also be used to identify developmental delays from a very small number of experimental data.

      The code is accessible to the reader, open-source and should be useable by experimentalists without huge effort.

      Major comments:

      I suggest retraining the model and application of the model to additional data for the following reasons:<br /> • Why did the authors not train for (high) measurement noise and heterogeneous background illumination? Would that not make the model more robust? In principle, creating training should not be considerably harder than before, since the manipulation of the images has been already shown in the manuscript and the authors just need to run it again on the HPC cluster. If there are no technical or administrative constraints (access to the cluster, computational effort, high costs, etc.), the authors should retrain their model.

      We thank the reviewer for this suggestion. As detailed in Figure 1, with a view to making the model more robust, we have now added several more layers of data augmentation, including the addition of random noise, and retrained our model.

      • For Fig. S2 and S3 it is not clear if there is such a strong deviation from the Kimmel equation due to measurement noise or due to the background illumination. The saliency maps appear as if they are mainly affected by the illumination, and maybe less by the noise. Would it be possible to apply the model to a case without artificial noise, but with heterogeneous background illumination to identify what has a bigger impact?

      We thank the reviewer for this suggestion. We have now replaced the “artificial” examples used in the previous version of the manuscript with newly-acquired data (Figure 5), which exhibits different characteristics to that used for training.

      Additionally, the authors need to clarify what exactly they are comparing in this manuscript and rework their interpretation of their findings:<br /> • When comparing the predictions between KimmelNet and the Kimmel equation, the authors use an equation of the form y=mx. Could the authors please elaborate on why they introduce the constraint of y(0)=0? It might be naturally given by the so-called Kimmel equation, but by looking at Fig 3a, it seems like an equation of the form y=mx+a would be more appropriate and it appears like KimmelNet introduces an offset of around a=2h for 25 Celsius. The authors need to discuss this.

      The main rationale for using an equation of the form y=mx is to be consistent with the Kimmel equation (see lines 103-105). The reviewer is correct that an equation of the form y=mx+c may well produce a better fit to the data, but omitting a y intercept makes comparison with the Kimmel Equation trivial.

      • In lines 5-8 the authors say that developmental stage progression does not only depend on temperature, but also on population density, water quality etc. and they explain that usually not only hpf, but also staging guides based on morphological criteria are used! If that is true, how good is their training data set that only uses hpf and not the other important guides? How did the authors test that these factors have no impact on their training data?

      We have now added a paragraph (lines 131-141) to address this point.

      Since this tool has the potential to have a big impact on zebrafish research, it would be nice to provide some examples of how exactly this could be achieved:<br /> • Could the authors discuss how exactly their tool is useful to experimentalists? Is it the idea that if an experimentalist wants to investigate an embryo of a particular stage, they apply KimmelNet to images of embryos to identify the stage of the embryo and only then undertake their planned experiment? Is that a realistic undertaking?

      As is evidenced by the errors presented in Figure 3C & D, testing KimmelNet on individual images of embryos may well result in a large error in the predicted hpf. As such, it is not appropriate to use the tool in such a manner. However, to modify the example provided by the reviewer, should an experimentalist have a population of embryos they wished to stage, then yes, KimmelNet would certainly be an appropriate tool for doing so.

      • Would it be possible to provide a tutorial (or even video tutorial if such skills are available in the group of authors) that provides real examples of how to apply the technique? This would make it easier for people without advanced Python/Deep-Learning skills to use the tool, hence improving the impact of KimmelNet.

      A lack of user-friendly interfaces for applying deep learning methods in biology is well-documented – basic knowledge of python and tools like jupyter notebooks are often necessary (https://doi.org/10.1038/s41592-023-01900-4). However, we have endeavoured to make the running of KimmelNet as easy as possible for new users. A jupyter notebook instance can be run on Binder with absolutely no set-up required. To run KimmelNet on their own data, biologists just need to download the Git repo and replace the test images with their own data. We have updated the landing page on the GitHub repo to provide more specific step-by-step instructions for each of these tasks. We will also endeavour to upload our model to the BioImage Model Zoo (https://bioimage.io/#/) to further increase accessibility.

      I am very critical towards equation 1. Please note that I don't think this has any impact on the quality of the technique provided in this manuscript and the significant flaws can already be found in Kimmel 1995 (which is not under review here). That is why I suggest rewriting of this manuscript to not support an over-interpretation of this equation.<br /> • I do not think that the Kimmel equation is an established term. At least a Google Scholar Search for "Kimmel equation" only gives one result: the preprint of this manuscript.<br /> • The equation has no mathematical meaning regarding its units (subtracting temperature and a unitless value). I also very rarely see equations with Degrees Celsius and not Kelvin.<br /> • Additionally, the equation provides a linear relationship between the development time and temperature h(T) and in Kimmel et al, it is shown that this is only true for 25-33 Celsius. Such a linearisation is not very surprising for a small temperature range, but I am not sure how true it is for higher temperature differences. Hence, I feel that it is very bold to give a specific name to such an equation, giving it an importance that it does not deserve.

      We appreciate the reviewer’s concerns and have removed explicit references to “The Kimmel Equation”, without substantively changing the content of the manuscript.

      Minor comments:

      • For the measurement noise cases it would be nice to have some example images of fish with the specific noise levels in Fig S1 and Fig S2.

      We have now removed the “synthetic” additive noise test data, previously depicted in Figures S1-3, in favour of newly-acquired images in Figures 5-7.

      • Could the authors hypothesize why they predict a slower dynamic for 25 Celsius than predicted by the Kimmel equation?

      Referring to Figure 2 in Kimmel et al (1995), it is apparent that the straight lines are by no means perfect fits to the datapoints. In Fig 2A in particular, some datapoints for the 25C data fall well below the line fit. While the published equation suggests a rate of development 80.5% of the rate at 28.5C, according to Fig 2A, an alternative line fit could give a developmental rate as low as 70-75%, which would be in agreement with our data.

      Reviewer #3 (Significance):

      Strengths of the study:

      An easy-to-use method to automatically stage zebrafish embryos and identify differences in the developmental stage is very important for the zebrafish community and the technique in this manuscript definitely novel. The tool is can be used without large effort and the authors suggest that it can also find applications beyond zebrafish embryos. Hence, it is not only interesting to the zebrafish community, but to a broader developmental biology audience.

      Weakness of the study:<br /> The main weakness of the manuscript is in the training data used for the deep-learning model and the apparent large impact of heterogeneous background illumination. If that is not solved, it is unclear if this technique will find an application in the zebrafish community.

      We believe this weakness has now been addressed by incorporating additional data augmentation measures in the training process and testing the model on newly-acquired data.

      Field of expertise of the reviewer: Image Analysis, Mathematical Modelling, Biological Physics. While I have limited experience in deep learning, I cannot evaluate the specific details of the network architecture. I also have no experience in zebrafish research.

    1. Reviewer #2 (Public Review):

      This study examines the construct of "cognitive spaces" as they relate to neural coding schemes present in response conflict tasks. The authors use a novel experimental design in which different types of response conflict (spatial Stroop, Simon) are parametrically manipulated. These conflict types are hypothesized to be encoded jointly, within an abstract "cognitive space", in which distances between task conditions depend only on the similarity of conflict types (i.e., where conditions with similar relative proportions of spatial-Stroop versus Simon conflicts are represented with similar activity patterns). Authors contrast such a representational scheme for conflict with several other conceptually distinct schemes, including a domain-general, domain-specific, and two task-specific schemes. The authors conduct a behavioral and fMRI study to test which of these coding schemes is used by prefrontal cortex. Replicating the authors' prior work, this study demonstrates that sequential behavioral adjustments (the congruency sequence effect) are modulated as a function of the similarity between conflict types. In fMRI data, univariate analyses identified activation in left prefrontal and dorsomedial frontal cortex that was modulated by the amount of Stroop or Simon conflict present, and representational similarity analyses (RSA) that identified coding of conflict similarity, as predicted under the cognitive space model, in right lateral prefrontal cortex.

      This study tackles an important question regarding how distinct types of conflict might be encoded in the brain within a computationally efficient representational format. The ideas postulated by the authors are interesting ones and the statistical methods are generally rigorous. The evidence supporting the authors claims, however, is limited by confounds in the experimental design and by lack of clarity in reporting the testing of alternative hypotheses within the method and results.

      (1) Model comparison

      The authors commendably performed a model comparison within their study, in which they formalized alternative hypotheses to their cognitive space hypothesis. We greatly appreciate the motivation for this idea and think that it strengthened the manuscript. Nevertheless, some details of this model comparison were difficult for us to understand, which in turn has limited our understanding of the strength of the findings.

      The text indicates the domain-general model was computed by taking the difference in congruency effects per conflict condition. Does this refer to the "absolute difference" between congruency effects? In the rest of this review, we assume that the absolute difference was indeed used, as using a signed difference would not make sense in this setting. Nevertheless, it may help readers to add this information to the text.

      Regarding the Stroop-Only and Simon-Only models, the motivation for using the Jaccard metric was unclear. From our reading, it seems that all of the other models --- the cognitive space model, the domain-general model, and the domain-specific model --- effectively use a Euclidean distance metric. (Although the cognitive space model is parameterized with cosine similarities, these similarity values are proportional to Euclidean distances because the points all lie on a circle. And, although the domain-general model is parameterized with absolute differences, the absolute difference is equivalent to Euclidean distance in 1D.) Given these considerations, the use of Jaccard seems to differ from the other models, in terms of parameterization, and thus potentially also in terms of underlying assumptions. Could authors help us understand why this distance metric was used instead of Euclidean distance? Additionally, if Jaccard must be used because this metric seems to be non-standard in the use of RSA, it would likely be helpful for many readers to give a little more explanation about how it was calculated.

      When considering parameterizing the Stroop-Only and Simon-Only models with Euclidean distances, one concern we had is that the joint inclusion of these models might render the cognitive space model unidentifiable due to collinearity (i.e., the sum of the Stroop-Only and Simon-Only models could be collinear with the cognitive space model). Could the authors determine whether this is the case? This issue seems to be important, as the presence of such collinearity would suggest to us that the design is incapable of discriminating those hypotheses as parameterized.

      (2) Issue of uniquely identifying conflict coding

      We certainly appreciate the efforts that authors have taken to address potential confounders for encoding of conflict in their original submission. We broach this question not because we wish authors to conduct additional control analyses, but because this issue seems to be central to the thesis of the manuscript and we would value reading the authors' thoughts on this issue in the discussion.

      To summarize our concerns, conflict seems to be a difficult variable to isolate within aggregate neural activity, at least relative to other variables typically studied in cognitive control, such as task-set or rule coding. This is because it seems reasonable to expect that many more nuisance factors covary with conflict --- such as univariate activation, level of cortical recruitment, performance measures, arousal --- than in comparison with, for example, a well-designed rule manipulation. Controlling for some of these factors post-hoc through regression is commendable (as authors have done here), but such a method will likely be incomplete and can provide no guarantees on the false positive rate.

      Relatedly, the neural correlates of conflict coding in fMRI and other aggregate measures of neural activity are likely of heterogeneous provenance, potentially including rate coding (Fu et al., 2022), temporal coding (Smith et al., 2019), modulation of coding of other more concrete variables (Ebitz et al., 2020, 10.1101/2020.03.14.991745; see also discussion and reviews of Tang et al., 2016, 10.7554/eLife.12352), or neuromodulatory effects (e.g., Aston-Jones & Cohen, 2005). Some of these origins would seem to be consistent with "explicit" coding of conflict (conflict as a representation), but others would seem to be more consistent with epiphenomenal coding of conflict (i.e., conflict as an emergent process). Again, these concerns could apply to many variables as measured via fMRI, but at the same time, they seem to be more pernicious in the case of conflict. So, if authors consider these issues to be germane, perhaps they could explicitly state in the discussion whether adopting their cognitive space perspective implies a particular stance on these issues, how they interpret their results with respect to these issues, and if relevant, qualify their conclusions with uncertainty on these issues.

      (3) Interpretation of measured geometry in 8C

      We appreciate the inclusion of the measured similarity matrices of area 8C, the key area the results focus on, to the supplemental, as this allows for a relatively model-agnostic look at a portion of the data. Interestingly, the measured similarity matrix seems to mismatch the cognitive space model in a potentially substantive way. Although the model predicts that the "pure" Stroop and Simon conditions will have maximal self-similarity (i.e., the Stroop-Stroop and Simon-Simon cells on the diagonal), these correlations actually seem to be the lowest, by what appears to be a substantial margin (particularly the Stroop-Stroop similarities). What should readers make of this apparent mismatch? Perhaps authors could offer their interpretation on how this mismatch could fit with their conclusions.

    1. Reviewer #2 (Public Review):

      Summary: The current draft by Deischel et.al., entitled "Inhibition of Notch activity by phosphorylation of CSL in response to parasitization in Drosophila" decribes the role of Pkc53E in the phosphorylation of Su(H) to downregulate its transcriptional activity to mount a successful immune response upon parasitic wasp-infection. Overall, I find the study interesting and relevant especially the identification of Pkc53E in phosphorylation of Su(H) is very nice. However, I have a number of concerns with the manuscript which are central to the idea that link the phosphorylation of Su(H) via Pkc53E to implying its modulation of Notch activity. I enlist them one by one subsequently.

      Strengths: I find the study interesting and relevant especially because of the following:<br /> 1. The identification of Pkc53E in phosphorylation of Su(H) is very interesting.<br /> 2. The role of this interaction in modulating Notch signaling and thereafter its requirement in mounting a strong immune response to wasp infection is also another strong highlight of this study.

      Weaknesses:1. Epistatic interaction with Notch is needed: In the entire draft, the authors claim Pkc53E role in the phosphorylation of Su(H) is down-stream of notch activity. Given the paper title also invokes Notch, I would suggest authors show this in a direct epistatic interaction using a Notch condition. If loss of Notch function makes many more lamellocytes and GOF makes less, then would modulating Pkc53E (and SuH)) in this manifest any change? In homeostasis as well, given gain of Notch function leads to increased crystal cells the same genetic combinations in homeostasis will be nice to see.<br /> While I understand that Su(H) functions downstream of Notch, but it is now increasingly evident that Su(H) also functions independent of Notch. An epistatic relationship between Notch and Pkc will clarify if this phosphorylation event of Su(H) via Pkc is part of the canonical interaction being proposed in the manuscript and not a non-canoncial/Notch pathway independent role of Su(H).

      This is important, as I worry that in the current state, while the data are all discussed inlight of Notch activity, any direct data to show this affirmatively is missing. In our hands we do find Notch independent Su(H) function in immune cells, hence this is a suggestion that stems from our own personal experience.

      2. Temporal regulation of Notch activity in response to wasp-infection and its overlapping dynamics of Su(H) phosphorylation via Pkc is needed: First, I suggest the authors to show how Notch activity post infection in a time course dependent manner is altered. A RT-PCR profile of Notch target genes in hemocytes from infected animals at 6, 12, 24, 48 HPI, to gauge an understanding of dynamics in Notch activity will set the tone for when and how it is being modulated. In parallel, this response in phospho mutant of Su(H) will be good to see and will support the requirement for phosphorylation of Su(H) to manifest a strong immune response. Second, is the dynamics of phosphorylation in a time course experiment is missing. While the increased phosphorylation of Su(H) in response to wasp-infestation shown in Fig.2B is using whole animal, this implies a global down-regulation of Su(H)/Notch activity. The authors need to show this response specifically in immune cells. The reader is left to the assumption that this is also true in immune cells. Given the authors have a good antibody, characterizing this same in circulating immune cells in response to infection will be needed. A time course of the phosphorylation state at 6, 12, 24, 48 HPI, to guage an understanding of this dynamics is needed. The authors suggest, this mechanism may be a quick way to down-regulate Notch, hence a side by side comparison of the dynamics of Notch down-regulation (such as by doing RT-PCR of Notch target genes following different time point post infection) alongside the levels of pS269 will strengthen the central point being proposed. Last, in Fig7. the authors show Co-immuno-precipitation of Pkc53EHA with Su(H)gwt-mCh 994 protein from Hml-gal4 hemocytes. I understand this is in homeostasis but since this interaction is proposed to be sensitive to infection, then a Co-IP of the two in immune cells, upon infection should be incorporated to strengthen their point.

      3. In Fig 5B, the authors show the change in crystal cell numbers as read out of PMA induced activation of Pkc53E and subsequent inhibition of Su(H) transcriptional activity, I would suggest the authors use more direct measures of this read out. RT-PCR of Su(H) target genes, in circulating immune cells, will strengthen this point. Formation of crystal cells is not just limited to Notch, I am not convinced that this treatment or the conditions have other affect on immune cells, such as any impact on Hif expression may also lead to lowering of CC numbers. Hence, the authors need to strengthen this point by showing that effects are direct to Notch and Su(H) and not non-specific to any other pathway also shown to be important for CC development.

      4. In addition to the above mentioned points, the data needs to be strengthened to further support the main conclusions of the manuscript. I would suggest the authors present the infection response with details on the timing of the immune response. Characterization of the immune responses at respective time points (as above or at least 24 and 48 HPI, as norms in the field) will be important. Also, any change in overall cell numbers, other immune cells, plasmatocytes or CC post infection is missing and is needed to present the specificity of the impact. The addition of these will present the data with more rigor in their analysis.

      5. Finally, what is the view of the authors on what leads to activation of Pkc53E, any upstream input is not presented. It will be good to see if wasp infection leads to increased Pkc53 kinase activity.

      Overall, I think the findings in the current state are interesting and fill an important gap, but the authors will need to strengthen the point with more detailed analysis that includes generating new data and also presenting the current data with more rigor in their approach. The data have to showcase the relationship with Notch pathway modulation upon phosphorylation of CSL in a much more comprehensive way, both in homeostasis and in response to infection which is entirely missing in the current draft.

    1. Author Response

      The following is the authors’ response to the original reviews.

      We would like to thank the Editors for the opportunity to submit a revised manuscript, and the Reviewers for their positive evaluations and constructive comments. We feel that the comments and suggestions significantly improved the quality of our manuscript. We addressed all questions and suggestions in a point-by-point fashion below.

      Reviewer #1 (Public Review):

      This paper proposes and evaluates a new approach for the registration of human hippocampal anatomy between individuals. Such registration is an essential step in group analysis of hippocampal structure and function, and in most studies to date, volumetric registration of MRI scans has been employed. However, it is known that volumetric deformable registration, due to its formulation as an optimization problem that minimizes the combination of an image similarity term and relatively simple geometric regularization terms, fails to preserve the topology of complex structures. In the cerebral cortex, surface-based registration of inflated cortical surfaces is broadly preferred over volumetric registration, which often causes voxels of different tissue types to be matched (e.g., voxels belonging to a sulcus in one individual mapping onto voxels belonging to a gurys in another). The authors recognize that hippocampal anatomy is similarly complex, and, with proper tools, can benefit from surface-based registration. They propose to first unfold the hippocampus to a two-dimensional rectangle domain using their prior HippUnfold technique, and then to perform deformable registration in this rectangle domain, matching geometric features (curvature, thickness, gyrification) between individuals. This registration approach is evaluated by comparing how well hippocampal subfields traced by experts using cytoarchitectural information align between individuals after registration. The authors indeed show that surface-based registration aligns subfields better than volumetric registration applied to binary segmentations of the hippocampal gray matter.

      Overall, I find the methods and results in this paper to be convincing. The authors framed the comparison between surface-based and volumetric registration in a fair way, and the results convincingly show the advantage of surface-based registration. One slight limitation of the current study is that it is uncertain whether the benefits demonstrated here translate to in vivo MRI data for which the authors' HippUnfold algorithm is tailored. The current study utilized the unfolding technique used in HippUnfold on manual segmentations of high-resolution ex vivo MRI and blockface 3D volumes, which are likely closer to anatomical ground truth than automated segmentations of in vivo MRI. However, it is reasonable to assume that given that the volumetric registration to which the proposed approach was compared also used this high-detail data, the advantages of surface-based over volumetric registration would extend to in vivo MRI as well. However, I would encourage the authors to perform future evaluations on datasets with available in vivo and ex vivo MRI from the same individuals.

      We thank the Reviewer for the positive evaluation and the thoughtful feedback. We address each comment in the red text below.

      We have considered the Reviewer suggestion for a demonstration of the gains from our proposed method in MRI, and decided to include a new analysis of 7T in-vivo MRI data from 10 healthy participants (Supplementary Materials 1: in-vivo MRI demonstration).

      It is difficult to assess whether changes to the registration methods are indeed an improvement without same-subject “ground-truth” subfield definitions typically obtained from histology. In this new Supplementary Materials section, we demonstrate an overall sharpening of MRI-mapped features as an indirect indication of better inter-subject alignment (similar to the paper referenced in the comment, below). This is an important proof of concept that demonstrates that the gains made in the current project can be translated to in in-vivo MRI. We did not perform a demonstration of these gains in ex-vivo data, since this also comes with a host of challenges including access to such data and deformations and artifacts associated with ev-vivo scanning. However, we believe that the gains provided by our methods are limited mainly by image resolution and so while we note some concern about the gains from this method at 3T MRI, we expect that in ev-vivo gains provided by our method in higher resolution ex-vivo images should be consistent or better.

      We have added the following in-text Discussion of this new analysis (p. 13):

      “Ravikumar et al. (2021) recently performed flat mapping of the medial temporal lobe neocortex using a Laplace coordinate system as employed here, and showed sharpening of group-averaged images following deformable registration in unfolded space. This indirectly suggests better intersubject alignment. We perform a similar group-averaged sharpening analysis in Supplementary Materials 1: in-vivo demonstration. Though the gains in image sharpness observed here were modest, we note that current MRI resolution and automated segmentation methods allow for only imperfect hippocampal feature measures. We thus expect unfolded registration to grow in importance as MRI and segmentation methods continue to advance. “

      I would also like to point out the relevance of the 2021 paper "Unfolding the Medial Temporal Lobe Cortex to Characterize Neurodegeneration Due to Alzheimer's Disease Pathology Using Ex vivo Imaging" by Ravikumar et al. (https://link.springer.com/chapter/10.1007/978-3-030-87586-2_1) to the current work. This paper applied an earlier version of the unfolding method in HippUnfold to ex vivo extrahippocampal cortex and performed registration using curvature features in the rectangular unfolded space, also finding slight improvement with surface-based vs. volumetric registration, so its findings support the current paper.

      Thank you, we agree this is a highly relevant paper and have added a summary of it in the newly added Discussion paragraph which also outlines the new Supplementary Materials section (see previous comment).

      Overall, the paper has the potential to significantly influence future research on hippocampal involvement in cognition and disease. Outside of simple volumetry studies, most hippocampal morphometry studies rely on volumetric deformable registration of some kind, typically applied to whole-brain T1-weighted MRI scans. With HippUnfold available for anyone to use and not requiring manual registration, the paper provides a strong impetus for using this approach in future studies, particularly where one is interested in localizing effects of interest to specific areas of the hippocampus. Additional evaluation of in vivo HippUnfold using in vivo / ex vivo datasets, would make the use of this approach even more appealing.

      We would like to thank the Reviewer for their enthusiasm for the translatability of this work. We hope they are satisfied with our newly added in-vivo evaluation, and we appreciate the thoughtful suggestions.

      Reviewer #1 (Recommendations For The Authors):

      No additional recommendations.

      Reviewer #2 (Public Review):

      DeKraker et al. propose a new method for hippocampal registration using a surface-based approach that preserves the topology of the curvature of the hippocampus and boundaries of hippocampal subfields. The surface-based registration method proved to be more precise and resulted in better alignment compared to traditional volumetric-based registration. Moreover, the authors demonstrated that this method can be performed across image modalities by testing the method with seven different histological samples. While the conclusions of this paper are mostly well supported by data, some aspects of the method need to be clarified. This work has the potential to be a powerful new registration technique that can enable precise hippocampal registration and alignment across subjects, datasets, and image modalities.

      We thank the Reviewer for their thoughtful evaluation of our paper and helpful comments. We address them in the red text below each comment.

      Regarding the methodological clarification of the surfaced-based registration method, the last step of the process needs further clarification. Specifically, after creating the averaged 2D template, it is unclear how each individual sample is registered to sample1's space. If I understand correctly, after creating the averaged 2D template, each individual sample is then registered to sample1's space via the transform from each sample to the averaged template and then the inverse transform from the template to sample1's space. Samples included both left and right hemispheres, so were all samples being propagated to left hemisphere sample 1 space? The authors also note that a measure of the subfield labels overlap with that sample's ground-truth subfield definitions was calculated. Is this a measure of overlap, for example, between sample 3 (registered to sample 1 space) and the ground-truth (unfolded, not registered) sample 3 labels? It would be beneficial to provide a full walkthrough of one example sample to clarify the steps. Clarification of this aspect of the method is critical for understanding the evaluation of the method.

      We would like to thank the Reviewer for the suggestion, and have clarified the passage with the following walkthrough example as suggested by the Reviewer (p. 8):

      “For example, sample3 was unfolded and then registered to the unfolded average, making up two transformations. These were then concatenated with the inverse transformation of unfolded sample1 to the same unfolded average, and the inverse transformation of native sample1 to unfolded space. This concatenated transformation was used to project labels from sample3 native space directly to sample1 native space, which should ideally lead to near-perfect subfield alignment in sample1 native space. Dice overlap between sample1 and sample3 registered to sample1 was then calculated in sample1 native space.”

      Reviewer #2 (Recommendations For The Authors):

      Materials and Methods:

      In the Data section, it would be helpful for the authors to clarify whether each hippocampal histology sample is from a different individual or not. Additionally, for the 3D-PLI sample, the authors mention that the anterior/posterior parts of the hippocampus were cut off and the labels were extrapolated over the missing regions. It would be useful to know whether the extrapolation was done manually.

      Thank you, we have added separate labels (donors 1-4) for each individual from each dataset. We have also added that the 3D-PLI dataset was extrapolated manually. See the revised Materials and Methods: Data section.

      A small clarification, but for the morphological features calculated by HippUnfold, is thickness a measure of how much space each subfield takes up in the 2D unfolded space?

      Thickness is measured via HippUnfold, and we have clarified in-text that it is done in each subject’s native space (p. 6):

      Results:

      In the Results section, a brief summary or description of the Dice overlap metric would be helpful. The authors should also clarify if the Dice metric measures the overlap between an individual sample (e.g., sample3) that has been unfolded and registered/propagated to sample1 compared to the sample1 ground-truth subfields.

      We thank the Reviewer, and hope this is now clarified alongside the Reviewer’s Public comment with the addition of the example as quoted in our response to that comment.

      We also added to our description of Dice overlap as a measurement (p. 8):

      “The Dice overlap metric (Dice, 1945), which can also be considered an overlap fraction ranging from 0-1, was calculated for all subjects’ subfields registered to sample1.”

      Figure 3:

      In Figure 3A, it is unclear what "moving (sample 3)" refers to. Clarification is needed, and it would be helpful to know if this is sample 3 in native space before it has been unfolded/registered. In Figure 3B, there is a missing "native" before "folded" and "(right)" at the end of the sentence. With these edits, the sentence in the caption would read: "Each measure was calculated in unfolded space (left) and again in the first sample's (BigBrain left hemisphere) native folded space (right)."

      We thank the Reviewer, and have now changed “moving” to “sample3 before registration”, and added the suggested caption changes. See the revised Figure 3.

      Discussion:

      In the introduction, the authors provide a detailed description of the traditional 3D volumetric registration technique that utilizes gyral and sucal patterning as the primary feature for registration, along with other features such as thickness and intracortical myelin. Using their surface-based registration, the authors highlight an interesting finding that hippocampal curvature is the most informative individual feature, and thickness and curvature combined are the most informative features for registration and boundary alignment. In the discussion, it would be beneficial for the authors to discuss the relationship between curvature, thickness, and gyrification (e.g., is there overlapping information across these features) and comment on the reliability of these features observed in the current study compared to past work using traditional methods.

      This is an interesting point of discussion, thank you for raising it. We’ve added the following paragraph to the Discussion section (p. 13):

      “The feature most strongly driving surface-based registration in the present study was curvature. Many neocortical surface-based registration methods focus on gyral and sulcal patterning at various levels (e.g. strong alignment of primary sulci, with weaker weighting on secondary and tertiary sulci) (Miller et al., 2021). In the present study, hippocampal gyri are variable between samples and so could perhaps be thought of as similar to tertiary neocortical gyri, and this may help explain why gyrification was not the primary driving feature in aligning hippocampal subfields. The methods used to quantify gyrification are often related to curvature, but differ across studies. In the hippocampus, unlike in the neocortex, the mouth of sulci are wide and so sulcal depth, which is often used in defining neocortical gyrification index, is not straightforward to measure. Using HippUnfold, gyrification is defined by the extent of tissue distortion between folded and unfolded space, and individual gyri/sulci are hard to resolve in unfolded gyrification maps, but are readily visible in curvature maps. Thus, hippocampal curvature may be more informative simply due to higher measurement precision. Future work could also employ measures like quantitative T1 relaxometry or other proxies of intracortical myelin content (e.g. Tardif et al., 2015; Glasser et al., 2016; Paquola et al. 2018) for hippocampal alignment, but this is not possible in cross-modal work as in the various histology stains examined here.”

      Miscellaneous:

      There is a typo on page 11, line 318, with extra parentheses: "(e.g., (Borne et al., 2023;..."

      Thank you, we have corrected this error.

      Reviewer #3 (Public Review):

      Dekraker and colleagues previously developed a new computational tool that creates a "surface representation" of the hippocampal subfields. This surface representation was previously constructed using histology from a single case. However, it was previously unclear how to best register and compare these surface-based representations to other cases with different morphology.

      In the current manuscript, Dekraker and colleagues have demonstrated the ability to align hippocampal subfield parcellations across disparate 3D histology samples that differ in contrast, resolution, and processing/staining methods. In doing so, they validated the previously generated Big-Brain atlas by comparing seven different ground-truth subfield definitions. This is an impressive and valuable effort that provides important groundwork for future in vivo multi-atlas methods.

      We thank the Reviewer for their positive evaluations, and helpful suggestions. We provide responses to the recommendations in the red text below.

      Reviewer #3 (Recommendations For The Authors):

      There are a few points I think the authors should address, listed below.

      1) As the authors are well aware, subfield definitions vary considerably across laboratories. The current paper states that JD labeled the samples using three different atlas references: Ding & Van Hoesen, 2015; Duvernoy et al. ,2013, and Palomero-Gallagher et al., 2020. This is unclear, however, since these three references differ in their subfield definitions. For example, Ding & Van Hoesen and Palomero-Gallagher define a region called the prosubiculum (area between subiculum and CA1) but Duvernoy does not. Please clarify which boundary rules from which particular references were used here. How were discrepancies across these references resolved when applying labels to the current histological samples?

      We thank the Reviewer, and have added the following elaboration (p. 5):

      “Since these sources differ slightly in their boundary criteria, and no prior reference perfectly matches the present samples, subjective judgment was used to draw boundaries after considering all three prior works. The “prosubiculum” label used by Ding & Van Hoesen and Palomero-Gallagher et al. was included as part of the subicular complex. See Supplementary Materials 2: ground-truth segmentation for more details.”

      2) Another comment has to do more with the "style" of how this paper is written, especially given that this paper was submitted to eLIFE (i.e. not a specialty journal). For example, the motivation for the unfolded with and without registration methods was not well described. Similarly, there was almost no justification for the different methods applied in Figure 4 and I fear that the impact of these results will be lost on a non-expert reader.

      We added the following elaboration to the last paragraph of the Introduction section to motivate our benchmark against unfolding without registration (p. 3):

      “We benchmark this new method against unfolding alone, which provides some intrinsic alignment between subjects (DeKraker et al., 2018) but which we believe can be further improved with the present methods, and against more conventional 3D volumetric registration approaches.”

      We also added a Discussion paragraph on the results shown in Figure 4 which we hope helps to make these results more informative and impactful (p. 13):

      “The feature most strongly driving surface-based registration in the present study was curvature. Many neocortical surface-based registration methods focus on gyral and sulcal patterning at various levels (e.g. strong alignment of primary sulci, with weaker weighting on secondary and tertiary sulci) (Miller et al., 2021). In the present study, hippocampal gyri are variable between samples and so could perhaps be thought of as similar to tertiary neocortical gyri, and this may help explain why gyrification was not the primary driving feature in aligning hippocampal subfields. The methods used to quantify gyrification are often related to curvature, but differ across studies. In the hippocampus, unlike in the neocortex, the mouth of sulci are wide and so sulcal depth, which is often used in defining neocortical gyrification index, is not straightforward to measure. Using HippUnfold, gyrification is defined by the extent of tissue distortion between folded and unfolded space, and individual gyri/sulci are hard to resolve in unfolded gyrification maps, but are readily visible in curvature maps. Thus, hippocampal curvature may be more informative simply due to higher measurement precision. Future work could also employ measures like quantitative T1 relaxometry or other proxies of intracortical myelin content (e.g. Tardif et al., 2015; Glasser et al., 2016; Paquola et al. 2018) for hippocampal alignment, but this is not possible in cross-modal work as in the various histology stains examined here.”

      3) Finally, the application of the current work beyond the current dataset needs to be made more clear. From what I understand, the discussion says that using a multi-atlas approach with HippUnfold is unfeasible at this point. What kind of computational or technical developments need to take place in order for these labeled datasets to be used for this purpose? How can the current labeled datasets be used in other contexts?

      The question of translation to other contexts, namely, in-vivo MRI, was also raised by Reviewer 1, and as such we decided to include an additional analysis to explore this question (Supplementary Materials 1: in-vivo MRI demonstration). Validation using ground-truth subfields is not plausible in MRI, and so we show only an indirect validation of intersubject alignment based on the sharpening of group-averaged features following better alignment using the present methods. We believe this new analysis significantly clarifies the applications we have in mind for this work. See the new Supplementary Section for details, and also a summary of this analysis in the Discussion section (p. 13):

      “Ravikumar et al. (2021) recently performed flat mapping of the medial temporal lobe neocortex using a Laplace coordinate system as employed here, and showed sharpening of group-averaged images following deformable registration in unfolded space. This indirectly suggests better intersubject alignment. We perform a similar group-averaged sharpening analysis in Supplementary Materials 1: in-vivo demonstration. Though the gains in image sharpness observed here were modest, we note that current MRI resolution and automated segmentation methods allow for only imperfect hippocampal feature measures. We thus expect unfolded registration to grow in importance as MRI and segmentation methods continue to advance. “

      Multi-atlas approaches are also presently possible, but we believe HippUnfold can apply unfolding and subfield definition with even higher validity. Unfolding of the hippocampus was previously possible in-vivo but still showed limited intersubject alignment. The present work validates a novel alignment method ex-vivo, and now additionally shows that this can be translated to better alignment even at the resolution of in-vivo imaging. We hope the above new Discussion paragraph also helps to clarify this.

      4) A minor comment is that there are three panels (a,b,c) in Figure 4 but the figure legend does not describe them separately.

      We thank the Reviewer, and added a Figure legend for parts B and C.

    1. Author Response

      The following is the authors’ response to the original reviews.

      We thank the reviewers for these helpful and thoughtful comments.

      Reviewer #1 (Recommendations For The Authors):

      Major comments:

      • What was the nature of the 0.1 increase in pH caused by illumination in CheRiff-negative cells? Is this thought to be a temperature effect?

      The increase in pHoran4 fluorescence in CheRiff-negative cells is most likely not from a pH change; rather, it most likely reflects blue light-mediated photoactivation of the mOrange-derived chromophore in pHoran4. Similar photoartifacts have been reported in other fluorescent protein reporters (see e.g. Farhi, Samouil L., et al. "Wide-area all-optical neurophysiology in acute brain slices." Journal of Neuroscience 39.25 (2019): 4889-4908.).

      The baseline measurement in CheRiff-negative cells is to control for this type of artifact. We subtract the mean signal from the CheRiff-negative cells to correct the signals from the CheRiff-positive cells, as described in the Main Text.

      • Does Kir2.1 have a proton conductance? Was the resting pH of HEK cells changed by Kir2.1 expression? Fig 2D suggest basal pH is equivalent +/- Kir2.1 but it would be good to show that data.

      This is an interesting question which our data do not answer conclusively. Since we used an intensiometric (as opposed to ratiometric) pH indicator, our measurements only provide relative pH changes. We assumed a constant initial pH. We have revised the text to make clear that this is an assumption.

      Prior studies of pH-dependent Kir2.1 activity did not find evidence of a proton current (i.e. no change in current upon extracellular acidification), though the channel is closed by intracellular acidification. See: Ye, Wenlei, et al. "The K+ channel KIR2. 1 functions in tandem with proton influx to mediate sour taste transduction." Proceedings of the National Academy of Sciences 113.2 (2016): E229-E238. We added this information to the text.

      The pKa of pHoran4 is 7.5, so a decrease in initial pH would decrease the slope of F vs pH. We observed higher (absolute value) F/F in the Kir2.1 expressing cells than in the non-expressing cells, confirming that the Kir2.1-expressing cells had larger CheRiff-mediated acidification than the Kir2.1-negative cells (Figure 2D). Thus this conclusion remains true regardless of whether Kir2.1 has a proton conductance.

      What channels/transporter mediate proton flux in CheRiff + Kir2.1 experiments? Is the increased proton flux simply due to more H+ ions passing through CheRiff when cells are hyperpolarized or may other voltage-dependent processes effect pH?

      Fig. 2G-M address this question, specifically. We targeted the blue light in a “zebra” pattern to only activate CheRiff in a subset of cells. We then used voltage imaging to show that the induced voltage spread over a much wider area than the blue-illuminated region, due to gap junction coupling between the cells. If protons flowed through some voltage-dependent channel other than CheRiff, then we would expect the acidification to follow the voltage profile. If protons primarily flowed through the CheRiff, then we would expect the acidification to follow the illumination profile. Fig. 2K and the following quantification show clearly that the acidification followed the illumination profile, and hence the proton current was primarily through CheRiff.

      • Is Kir2.1 included in the spatial illumination experiments (Fig. 2G-M)? If so, it would be helpful to note it. The color scheme suggest it is but it would be good to note it explicitly.

      Yes. Clarified in text.

      • Why is the acidification caused by 10 second of illumination smaller in Fig 2L, as compared to the equivalent experiment in 2D? Is this due to the spatial nature of the illumination? It seems that the pH change at the site of illumination should be equivalent between these 2 experiments.

      The illumination protocol between the two experiments has different duty cycles (compare Fig. 2C and 2J), so the time-averaged intensity is different. There can also be batch-to-batch variation in CheRiff expression which would alter the proton flux and thus pH change. To control for this, comparisons were always made between batches of cells prepared together.

      • The authors used 150 second illumination to examine pH changes but only 13.5 seconds to differentiate between pH changes caused by the light-activated conductance and those secondary to depolarization. Would pH changes lose their spatial limitations if a similar 150 second illumination was used? This is important because the pH change seen in the "Blue On" region was quite small.

      Yes, protons can diffuse between cells via gap junctions, smoothing out the spatial structure of the pH over long times. See e.g. Wu, Ling, et al. "PARIS, an optogenetic method for functionally mapping gap junctions." Elife 8 (2019): e43366.

      We used a short (13.5 s) protocol specifically to distinguish CheRiff-mediated acidification from acidification via other conductances in electrically coupled neighboring cells. If we had waited for longer, lateral proton diffusion could have muddied the interpretation of these experiments.

      • How long do action potentials shown in between illuminations in Fig 4H (ChR2 3M) last following cessation of illumination?

      The closing time, τoff, of the Channelrhodopsins are shown in Table 1. The ChR2-3M has an off-time of almost 2 seconds. The duration of post-stimulus persistent firing is expected to depend on the expression level of the ChR2-3M, the strength of the optogenetic stimulus and the excitation threshold of the neurons, i.e. on how far above threshold the neuron is at the moment the blue light turns off. Thus we expect the post-stimulus firing time to be highly variable between cells and also to depend on optogenetic stimulus strength. In our experiments action potentials were observed throughout the 0.5 s dark interval between stimuli.

      • While ChR2-3M construct may have promise for therapeutic applications, those strengths limit its use or basic science applications like circuit mapping. This should be noted in the discussion.

      Ok. We now mention this in the discussion.

      • Please define EPD50 within the text of the results section.

      Ok. Fixed.

      Reviewer #2 (Recommendations For The Authors):

      This is an interesting manuscript investigating a potential limitation of optogenetic manipulation of cell excitability and its solution. The work is conducted rigorously and explained clearly. I only have minor concerns:

      I think the impact of the study could be broadened by examining additional proton permeable opsins for their effects on intracellular pH. A single assay could be used to compare different opsins to CheRiff and show that the problem of intracellular acidification is not limited to CheRiff.

      Yes, this is interesting. There are so many opsins and illumination protocols in use that we could not do an exhaustive characterization; we encourage people to test their own opsin under their conditions if doing chronic simulation. The plasmid constructs used for this work are available on Addgene.

      I am not clear on what Figure S3A is showing because I cannot see a patterning like the one shown in Fig. 2H. Perhaps a higher magnification could solve the problem.

      Figure S3A does not have the zebra-striped pattern of Figure 2H. In Fig S3A, we used just one column of illumination. The point was to test the ability of each opsin to depolarize the HEK cells. We added images of the illumination pattern and adjusted the caption to make this clear.

      When discussing the sustained photocurrent of PsCatCh2.0, a reference to Govorunova et al. J. Biol. Chem. 2013 should be added as the low extent of light induced inactivation appears to be, at least in part, a characteristic of the particular type of opsin from P. subcordiformis.

      Added reference.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1 (Public Review):

      Meta-cognition, and difficulty judgments specifically, is an important part of daily decision-making. When facing two competing tasks, individuals often need to make quick judgments on which task they should approach (whether their goal is to complete an easy or a difficult task).

      In the study, subjects face two perceptual tasks on the same screen. Each task is a cloud of dots with a dominating color (yellow or blue), with a varying degree of domination - so each cloud (as a representation of a task where the subject has to judge which color is dominant) can be seen an easy or a difficult task. Observing both, the subject has to decide which one is easier.

      It is well-known that choices and response times in each separate task can be described by a driftdiffusion model, where the decision maker accumulates evidence toward one of the decisions (”blue” or ”yellow”) over time, making a choice when the accumulated evidence reaches a predetermined bound. However, we do not know what happens when an individual has to make two such judgments at the same time, without actually making a choice, but simply deciding which task would have stronger evidence toward one of the options (so would be easier to solve).

      It is clear that the degree of color dominance (”color strength” in the study’s terms) of both clouds should affect the decision on which task is easier, as well as the total decision time. Experiment 1 clearly shows that color strength has a simple cumulative effect on choice: cloud 1 is more likely to be chosen if it is easier and cloud 2 is harder. Response times, however, show a more complex interactive pattern: when cloud 2 is hard, easier cloud 1 produces faster decisions. When cloud 2 is easy, easier cloud 1 produces slower decisions.

      The study explores several models that explain this effect. The best-fitting model (the Difference model is the paper’s terminology) assumes that the decision-maker accumulates evidence in both clouds simultaneously and makes a difficulty judgment as soon as the difference between the values of these decision variables reaches a certain threshold. Another potential model that provides a slightly worse fit to the data is a two-step model. First, the decision maker evaluates the dominant color of each cloud, then judges the difficulty based on this information.

      Thank you for a very good summary of our work.

      Importantly, the study explores an optimal model based on the Markov decision processes approach. This model shows a very similar qualitative pattern in RT predictions but is too complex to fit to the real data. It is hard to judge from the results of the study how the models identified above are specifically related to the optimal model - possibly, the fact that simple approaches such as the Difference model fit the data best could suggest the existence of some cognitive constraints that play a role in difficulty judgments.

      The reviewer asks “how the models identified above are specifically related to the optimal model”. We did fit the four models to simulations of the optimal model and found that the Difference model was the closest. However, we did not fit the parameters of the optimal model to the data (no easy feat given the complexity of the model) as the experiment was not designed to incentivize maximization of the reward rate and fitting would have been computationally laborious. We therefore focused on the qualitative features of the optimal model and how they compare to our models. We now also include the optimal model for the known color dominance RT experiment (line 420). We have also added a new paragraph in the Discussion on the optimal model at line 503 comparing it qualitatively to the Difference model.

      The Difference model produces a well-defined qualitative prediction: if the dominant color of both clouds is known to the decision maker, the overall RT effect (hard-hard trials are slower than easyeasy trials) should disappear. Essentially, that turns the model into the second stage of the twostage model, where the decision maker learns the dominant colors first. The data from Experiment 2 impressively confirms that prediction and provides a good demonstration of how the model can explain the data out-of-sample with a predicted change in context.

      Overall, the study provides a very coherent and clean set of predictions and analyses that advance our understanding of meta-cognition. The field would benefit from further exploration of differences between the models presented and new competing predictions (for instance, exploring how the sequential presentation of stimuli or attentional behavior can impact such judgments). Finally, the study provides a solid foundation for future neuroimaging investigations.

      Thank you for your positive comments and suggestions.

      Reviewer #2 (Public Review):

      Starting from the observation that difficulty estimation lies at the core of human cognition, the authors acknowledge that despite extensive work focusing on the computational mechanisms of decision-making, little is known about how subjective judgments of task difficulty are made. Instantiating the question with a perceptual decision-making task, the authors found that how humans pick the easiest of two stimuli, and how quickly these difficulty judgments are made, are best described by a simple evidence accumulation model. In this model, perceptual evidence of concurrent stimuli is accumulated and difficulty is determined by the difference between the absolute values of decision variables corresponding to each stimulus, combined with a threshold crossing mechanism. Altogether, these results strengthen the success of evidence accumulation models, and more broadly sequential sampling models, in describing human decision-making, now extending it to judgments of difficulty.

      The manuscript addresses a timely question and is very well written, with its goals, methods and findings clearly explained and directly relating to each other. The authors are specialists in evidence accumulation tasks and models. Their modelling of human behaviour within this framework is state-of-the-art. In particular, their model comparison is guided by qualitative signatures which are diagnostic to tease apart the different models (e.g., the RT criss-cross pattern). Human behaviour is then inspected for these signatures, instead of relying exclusively on quantitative comparison of goodness-of-fit metrics. This work will likely have a wide impact in the field of decisionmaking, and this across species. It will echo in particular with many other studies relying on the similar theoretical account of behaviour (evidence accumulation).

      Thank you for these generous comments.

      A few points nevertheless came to my attention while reading the manuscript, which the authors might find useful to answer or address in a new version of their manuscript.

      1) The authors acknowledge that difficulty estimation occurs notably before exploration (e.g., attempting a new recipe) or learning (e.g., learning a new musical piece) situations. Motivated by the fact that naturalistic tasks make difficult the identification of the inference process underlying difficulty judgments, the authors instead chose a simple perceptual decision-making task to address their question. While I generally agree with the authors’s general diagnostic, I am nevertheless concerned so as to whether the task really captures the cognitive process of interest as described in the introduction. As coined by the authors themselves, the main function of prospective difficulty judgment is to select a task which will then ultimately be performed, or reject one which won’t. However, in the task presented here, participants are asked to produce difficulty judgments without those judgements actually impacting the future in the task. A feature thus key to difficulty judgments thus seems lacking from the task. Furthermore, the trial-by-trial feedback provided to participants also likely differ from difficulty judgments made in real world. This comment is probably difficult to address but it might generally be useful to discuss the limitations of the task, in particular in probing the desired cognitive process as described in introduction. Currently, no limitations are discussed.

      We have added a Limitations paragraph to the Discussion and one item we deal with is the generalization of the model to more complex tasks (line 539).

      2) The authors take their findings as the general indication that humans rely on accumulation evidence mechanisms to probe the difficulty of perceptual decisions. I would probably have been slightly more cautious in excluding alternative explanations. First, only accumulation models are compared. It is thus simply not possible to reach a different conclusion. Second, even though it is particularly compelling to see untested predictions from the winning model in experiment #1 to be directly tested, and validated in a second experiment, that second experiment presents data from only 3 participants (1 of which has slightly different behaviour than the 2 others), thereby limiting the generality of the findings. Third, the winning model in experiment #1 (difference model) is the preferred model on 12 participants, out of the 20 tested ones. Fourth, the raw BIC values are compared against each other in absolute terms without relying on significance testing of the differences in model frequency within the sample of participants (e.g., using exceedance probabilities; see Stephan et al., 2009 and Rigoux et al., 2014). Based on these different observations, I would thus have interpreted the results of the study with a bit more caution and avoided concluding too widely about the generality of the findings.

      Thank you for these suggestions.

      i) We have now make it clear in the Results (line 126) that all four models we examine are accumu-lation models. In addition, we have added a paragraph on Limitations (line 530) in the Discussion where we explain why we only consider accumulation models and acknowledge that there are other non-accumulation models.

      ii) Each of three participants in Experiment 2 performed 18 sessions making it a large and valuabledataset necessary to test our hypothesis. We have now included a mention of the the small number of participants in Experiment 2 in a Limitations paragraph in the Discussion (line 539).

      iii) As suggested, we have now calculated exceedance probabilities for the 4 models which gives[0,0.97,0.03,0]. This shows that there is a 0.97 probability of the Difference model being the most frequent and only a 0.03 probability of the two-step model. We have included this in the results on line 237.

      3) Deriving and describing the optimal model of the task was particularly appreciated. It was however a bit disappointing not to see how well the optimal model explains participants behaviour and whether it does so better than the other considered models. Also, it would have been helpful to see how close each of the 4 models compared in Figures 2 & 3 get to the optimal solution. Note however that neither of these comments are needed to support the authors’ claims.

      The reviewer asks how close each of the four models is to the optimal solution. We did fit the four models to simulations of the optimal model and found that the Difference model was the closest. However, we did not fit the parameters of the optimal model to the data (no easy feat given the complexity of the model) as the experiment was not designed to incentivize maximization of the reward rate and fitting would have been computationally laborious. We therefore focused on the qualitative features of the optimal model and how they compare to our models. We now also include the optimal model for the known color dominance RT experiment (line 420). We have also added a new paragraph in the Discussion on the optimal model at line 503 comparing it qualitatively to the Difference model.

      4) The authors compared the difficulty vs. color judgment conditions to conclude that the accumulation process subtending difficulty judgements is partly distinct from the accumulation process leading to perceptual decisions themselves. To do so, they directly compared reaction times obtained in these two conditions (e.g. ”in other cases, the two perceptual decisions are almost certainly completed before the difficulty decision”). However, I find it difficult to directly compare the ’color’ and ’difficulty’ conditions as the latter entails a single stimulus while the former comprises two stimuli. Any reaction-time difference between conditions could thus I believe only follow from asymmetric perceptual/cognitive load between conditions (at least in the sense RT-color < RT-difficulty). One alternative could have been to present two stimuli in the ’color’ condition as well, and asking participants to judge both (or probe which to judge later in the trial). Implementing this now would however require to run a whole new experiment which is likely too demanding. Perhaps the authors could instead also acknowledge that this a critical difference between their conditions, which makes direct comparison difficult.

      We feel we can rule out that participants make color decisions (as in the color task) to make difficulty decisions. For example, making a color choice for 0% color strength takes longer than a difficulty choice for 0:52% color strengths. Thus, the difficulty judgment does not require completion of the color decisions. Therefore, average reaction time for a single color patch (C𝑆1) can be longer than the reaction time for the difficulty task which contains the same coherence (C𝑆1) for one of the patches. This is true despite the difficulty decision requiring monitoring of two patches (which might be expected to be slower than monitoring one patch). We have added this in to the Discussion at line 449.

      Reviewer #3 (Public Review):

      The manuscript presents novel findings regarding the metacognitive judgment of difficulty of perceptual decisions. In the main task, subjects accumulated evidence over time about two patches of random dot motion, and were asked to report for which patch it would be easier to make a decision about its dominant color, while not explicitly making such decision(s). Using 4 models of difficulty decisions, the authors demonstrate that the reaction time of these decisions are not solely governed by the difference in difficulties between patches (i.e., difference in stimulus strength), but (also) by the difference in absolute accumulated evidence for color judgment of the two stimuli. In an additional experiment, the authors eliminated part of the uncertainty by informing participants about the dominant color of the two stimuli. In this case, reaction times were faster compared to the original task, and only depended on the difference between stimulus strength.

      Overall, the paper is very well written, figures and illustrations clearly and adequately accompanied the text, and the method and modeling are rigor.

      The weakness of the paper is that it does not provide sufficient evidence to rule out the possibility that judging the difficulty of a decision may actually be comparing between levels of confidence about the dominant color of each stimulus. One may claim that an observer makes an implicit color decision about each stimulus, and then compares the confidence levels about the correctness of the decisions. This concern is reflected in the paper in several ways:

      We tested a Difference in confidence model (line 315) in the orginal paper and showed it was inferior to the Difference model. We did this for experiment 2, RT task so that we could fit the unknown color condition and try to predict the known color condition. To emphasize this model (which we think the reviewer may have missed) we have moved the supplementary figure to the main results (now Fig. 6) as we think it is very cool that we were able to discard the confidence model.

      When comparing the confidence model to the Difference we found the difference model was pre-Δ ferred with BIC of 38, 56, 47. We are unsure why the reviewer feels this “does not provide sufficient evidence to rule out the possibility that judging the difficulty of a decision may actually be comparing between levels of confidence about the dominant color of each stimulus.” We regard this as strong evidence.

      1) It is not clear what were the actual instructors to the participants, as two different phrasings appear in the methods: one instructs participants to indicate which stimulus is the easier one and the other instructs them to indicate the patch with the stronger color dominance. If both instructions are the same, it can be assumed that knowing the dominant color of each patch is in fact solving the task, and no judgment of difficulty needs to be made (perhaps a confidence estimation). Since this is not a classical perceptual task where subjects need to address a certain feature of the stimuli, but rather to judge their difficulties, it is important to make it clear.

      We now include the precise words used to instruct the participant (line 604): “Your task is to judge which patch has a stronger majority of yellow or blue dots. In other words: For which patch do you find it easier to decide what the dominant color is? It does not matter what the dominant color of the easier patch is (i.e., whether it is yellow or blue). All that matters is whether the left or right patch is easier to decide”.

      Knowing both colors or the dominant color is not sufficient to solve the task. Knowing both are yellow does not tell you which has more yellow which is what you need to estimate to solve the task. Again, we tested a confidence model in the original version of the paper and showed it was a poor model compared to the Difference model.

      2) Two step model: two issues are a bit puzzling in this model. First, if an observer reaches a decision about the dominant color of each patch, does it mean one has made a color decision about the patches? If so, why should more evidence be accumulated? This may also support the possibility that this is a ”post decision” confidence judgment rather than a ”pre decision” difficulty judgment. Second, the authors assume the time it takes to reach a decision about the dominant color for both patches are equal, i.e., the boundaries for the ”mini decision” are symmetrical. However, it would make sense to assume that patches with lower strength would require a longer time to reach the boundaries.

      In the Two-step model we assume a mini decision is made for the color of each stimulus. However, the assumption is that this is made with a low bound so it is not a full decision as in a typical color decision. Again estimating the colors from the mini decision does not tell you which is easier so you need to accumulate more evidence to make this judgment. In fact the Race model is a version of the two step in which no further accumulation is made after the initial decision and this model fits poorly (we now explain this on line 185). We assume for simplicity that the first stimulus to cross a bound triggers both mini color decisions. So although the bounds are equal the one with stronger color dominance is more likely to hit the bound first.

      We have already addressed this concern about the comparison with confidence above.

      3) Experiment 2: the modification of the Difference model to fit the known condition (Figure 5b),can also be conceptualized as the two-step model, excluding the ”mini” color decision time. These two models (Difference model with known color; two-step model) only differ from each other in a way that in the former the color is known in advance, and in the second, the subject has to infer it. One may wonder if the difference in patterns between the two (Figure 3C vs. Figure 6B) is only due to the inaccuracies of inferring the dominant color in the two-step model.

      In Experiment 2 the participant is explicitly informed as to the color dominance of both stimuli. Therefore, assuming the two-step model skips the first step and uses this explicit information in the second step, the difference and two-step model are identical for modeling Experiment 2. We explain this now on line 277.

      As the reviewer suggests, differences in predictions between the Difference and Two-step arise from trials in which there is a mismatch between the inferred dominant colors from the two-step model and the color associated with the final DVs in the Difference model. We now explain this on line 187. We do not see this as a problem of any sort but just defines the difference between the models. Note that the new exceedance analysis now strongly supports the Difference model as the most common model among the participants.

      An additional concern is about the controlled duration task: Why were these specific durations chosen (0.1-1.65 sec; only a single duration was larger than 1sec), given the much longer reaction times in the main task (Experiment 1), which were all larger on average than 1sec? This seems a bit like an odd choice. Additionally, difficulty decision accuracies in this version of the task differ between known and unknown conditions (Figure 7), while in the reaction time version of the same task there were no detectable differences in performance between known and unknown conditions (Figure 6C), just in the reaction times. This discrepancy is not sufficiently explained in the manuscript. Could this be explained by the short trial durations?

      The reviewer asks about the choice of stimulus durations in Experiment 2. First, RTs in Experiment 1 do not only reflect the time needed to make decisions but also contain non-decision times (0.23-0.47 s). So to compare decision time in RT and controlled duration experiment one must subtract the non-decision time from the RTs (the non-decision time is not relevant to the controlled duration experiment). Second, the model specifically predicts that differences in performance between the known and unknown color dominance conditions are largest for short duration stimulus presentation trials (see Fig. 7). We explain this on line 346. For long durations, performance pretty much plateaus, and many decisions have already terminated (Kiani 2008). We sample stimulus durations from a discrete truncated exponential distribution to get roughly equal changes in accuracy between consecutive durations (which we now explain at line 345).

      Group consensus review

      The reviewers have discussed with each other, and they have discussed a series of revisions which, if carried out, would make their evaluation of your paper even more positive. I outline them below in case you would be interested in revising your paper based on these reviews. You will see below that the reviewers share overall a quite positive evaluation of your study. All three limitations described in the Public Reviews could be addressed explicitly in the discussion which for the moment is limited to description and generalization of findings.

      1) The model selection procedure should be amended and strengthened to provide clearer results. As noted by one of the reviewers during the consultation session, ”the Difference model just barely wins over the two-step model, and the two-step model might produce the same prediction for the next experiment.” You will also see below that Reviewer #2 provides guidance to improve the model selection process: ”[...] the second experiment presents data from only 3 participants (1 of which has slightly different behaviour than the 2 others), thereby limiting the generality of the findings. Third, the winning model in experiment #1 (difference model) is the preferred model on 12 participants, out of the 20 tested ones. Fourth, the raw BIC values are compared against each other in absolute terms without relying on significance testing of the differences in model frequency within the sample of participants (e.g., using exceedance probabilities; see Stephan et al., 2009 and Rigoux et al., 2014).” Altogether, model selection appears currently to be the ’weakest’ part of the paper (Difference model vs. Two-step model, model comparison, how to better incorporate the optional model with the other parts). It would be great if you would improve this section of the Results.

      Thank you for these suggestions.

      i) We have now make it clear in the Results (line 126) that all four models we examine are accumu-lation models. In addition, we have added a paragraph on Limitations (line 530) in the Discussion where we explain why we only consider accumulation models and acknowledge that there are other non-accumulation models.

      ii) Each of three participants in Experiment 2 performed 18 session making it a large and valuabledataset necessary to test our hypothesis. We have now included a mention of the the small number of participants in Experiment 2 in a Limitations paragraph in the Discussion (line 539).

      iii) We have now calculated exceedance probabilities for the 4 models which gave [0,0.97,0.03,0]. This shows that there is a 0.97 probability of the Difference model being the most frequent and only a 0.03 probability of the two-step model. We have included this in the results on line 237.

      2) All reviewers have noted that the relation of the optimal model with the human data and theother models should be clarified and discussed in a revised version of the manuscript. You will find their specific comments in their individual reviews, appended below.

      We now include the optimal model for the known color dominance RT experiment (line 420). We have also added a new paragraph in the Discussion on the optimal model at line 503 comparing it to the Difference model.

      3) Finally, the exclusion strategy is also unclear at the moment and should be clarified and discussed explicitly somewhere in a revised version of the manuscript. Reviewers were wondering why so many participants were excluded from Experiment 1, and only 3 participants were included in Experiment 2. This should also be clarified better in the manuscript.

      We have clarified the exclusion criteria in the Methods at line 651 as a new subsection.

      The data quality problem with MTurk is well documented (Chmielewski, M & Kucker SC. 2020. An MTurk Crisis? Shifts in Data Quality and the Impact on Study Results. Social Psychological and Personality Science, 11, 464-473). Given that this was an online experiment on MTurk, it is hard to know exactly why some participants showed low accuracy, but it’s likely that some may have misunderstood the instructions in the difficulty task or they may have been unmotivated to do well in this highly repetitive task. Either reason would be problematic for our model comparisons that are based on choice-RT patterns. Note that the cut-offs we chose for inclusion were purely based on accuracy, whereas the modeling approach considered RTs, which importantly were not used as a inclusion criterion (see revised methods). Moreover, accuracy cut-offs were fairly lenient and mainly aimed to exclude participants who appeared to be guessing/misunderstood instructions (for reference: mean sensitivity of participants who were included was 2x higher than the cut-offs we used).

      Each of three participants in Experiment 2 performed 18 session making it a large and valuable dataset necessary to test our hypothesis. We have now included a mention of the the small number of participants in Experiment 2 in a Limitations paragraph in the Discussion (line 539).

      Reviewer #1 (Recommendations For The Authors):

      Thank you for an excellent paper, I enjoyed reading it a lot. I have a few questions that could potentially clarify some aspects for the reader.

      (1) It seems from the model fit plots (Figure 3) that the RT predictions of the model tend to overshoot in cases where one of the clouds is very easy. Could you include potential interpretations of this effect?

      We assume the reviewer is examining the Difference Model (i.e. the preferred model) panel when commenting on the overshoot. It is true the predictions for the highest coherence (bottom purple line) for RT is above the data but it is barely outside the data errorbars of 1 s.e. To be honest we regard this as a pretty good fit and would not want to over-interpret this small mismatch.

      (2) On page 4, around line 121, the study discusses the ”criss-crossing” effect in the RT data. You mention that the fact that RTs are long in hard-hard trials compared to easy-easy trials could be important here: ”These tendencies lead to a criss-cross pattern..”. It is confusing since, for instance, the race model does not have a criss-cross, but still exhibits the overall effect. I was intrigued bythe criss-crossing, and after some quick simulations, I found that the equation RT2 ∗ = 2 − 2 ∗ Cs12 − Cs22 + 6 ∗ (Cs1 ∗ Cs2)2 can (very roughly) replicate Figure 1d (bottom panel), so it seems that the criss-crossing effect must be produced by some interactive effect of color strengths on RTs. I wonder if you could provide a better explanation of how this interactive effect is generated by the model, given that it is the main interesting finding in the data. I believe at this point the intuition is not well-outlined.

      The criss cross arises through an interaction of the coherences as the reviewer suspects. That is, for the Difference model the RT related to abs(|Coh1|- |Coh2|). If we replace the first abs with a square we get

      |coh1|2 + |coh2|2 − 2|coh1||coh2|

      The larger this is, the smaller the RT so

      RT = constant − coh12 − coh22 + 2|coh1||coh2|

      which is very similar to the formula the reviewer mentions.

      We now supply an intuition as to why the criss-cross arises in the Difference model (line 167). We do not get a criss-cross in the race model, because there the RT is determined by the Race that that reaches a bound first. Because the races are independent, RTs will be fastest when coherence is high for either stimuli.

      (3) Am I wrong in my intuition that the two-step model would produce very similar predictions as the Difference model for Experiment 2? It would be great to discuss that either way since the twostep model seems to produce very close quantitative and pretty much the same qualitative fit to the data of Experiment 1.

      In Experiment 2 the participant is explicitly informed about the color dominance of both stimuli. Therefore, assuming the two-step model skips the first step and uses this explicit information in the second step, the difference and two-step model are identical for modeling Experiment 2. We explain this now on line 277.

      (4) The inclusion of the optimal model is great. It would be beneficial to provide some more connections to the rest of the paper here. Would this model produce similar predictions for Experiment 2, for instance?

      We now include the optimal model for the known color dominance RT experiment (line 420). We have also added a new paragraph in the Discussion on the optimal model at line 503 comparing it to the Difference model.

      (5) In the Methods, it is quite striking that out of 51 original participants, most were excluded and only 20 were studied. It is not easy to trace through this section why and how and who was excluded, so it would be great if this information was organized and presented more clearly.

      We have clarified this in the Methods at line 651 as a new subsection in the Methods. We also explain that exclusion was not made on RT data which is our main focus in the models.

      Reviewer #2 (Recommendations For The Authors):

      • As detailed in the ’public review’, a more cautious discussion, notably delineating the limitations of the study would be appreciated.

      • In their models, the authors assume that participants sequentially allocate attention between the two stimuli, alternating between them. Did the authors test this assumption and did they consider the possibility that participants could sample from both stimuli in parallel? In particular, does the conclusion of the model comparison also holds under this parallel processing assumption?

      Our results are not affected by whether participants sample the stimulus sequentially through alternation or in a parallel manner (Kang et al., 2021). What does change is the parameters of the model (but not their predictions/fits). In the parallel model, information is acquired at twice the rate of the serial model. We can, therefore, obtain the parameters of parallel models (that has serial and parallel models): 𝜅𝑝 = 𝜅𝑠/√2, 𝑢𝑝 = 𝑢𝑠√2, 𝑎𝑝 = 𝑎𝑠/2 and 𝑑𝑝 = 2𝑑𝑠 (Eq. 2). We now explain𝑠 𝑝 identical predictions to the serial model) directly from the parameters of the current sequential models simply by adjusting the parameters that depend on the time scale (subscripts and for this on line 518.

      • I found the small paragraph corresponding to lines 193-196 particularly difficult to understand. If the authors could think of a better way to phrase their claim, it would probably help.

      We have rewritten this paragraph at line 211

      • I found a type on line 122: ”wheres” instead of ”whereas”.

      Corrected

      • I found a type on line 181: ”or” instead of ”of”.

      Yes corrected

      • Figure #2 is extremely useful in understanding the models and their differences, make sure it remains after addressing the reviews!

      Thank you, this figure is retained.

      Reviewer #3 (Recommendations For The Authors):

      All comments are detailed in the public review, with some clarifications here:

      1) The confusing instructions to the participants are detailed here: under ”overview of experimental tasks” in the methods it says: ”They were instructed... to indicate whether the left or right stimulus was the easier one” (line 520), and below it ”they were required to indicate which patch had the stronger color dominance...” (line 524).

      We have clarified the instructions by providing the actual text displayed to participants in the methods and have ensured consistency in the method to talk about judging the easier stimulus (line 604).

      The instructions were “Your task is to judge which patch has a stronger majority of yellow or blue dots. In other words: For which patch do you find it easier to decide what the dominant color is? It does not matter what the dominant color of the easier patch is (i.e., whether it is yellow or blue). All that matters is whether the left or right patch is easier to decide”.

      2) Minor comments: Line 76: ”that” should be ”than”.

      Thanks, corrected

      Line 574: ”variable duration task” means ”controlled duration task”?

      Yes, corrected

      Line 151: ”or” should be ”of”.

      Corrected

    1. On the basic level of perception and categorization, finally, theinfluence exerted by culture remains rather subtle, but may bepervasive nonetheless. Here, our cognitive processor is trainedby the constant confrontation with information input—eitherdirectly from an environment shaped by cultural activities, orindirectly through the spectacles of a linguistic taxonomy. Whilethe latter has been subject to intense research and continuousdebate (reviewed in Enfield, 2015), the former has been largelyneglected, which is why even the hypotheses on how exactlyculture affects perception have remained speculative.

      Our cognitive processing is constantly shaped by exposure to cultural information, either directly from our environment or indirectly through the lens of language. People have talked a lot about how the language we use affects the way we think. But not many people have paid as much attention to how the culture we live in and the things around us might also change the way we see and understand things.

    1. Author Response

      Reviewer #1 (Public Review):

      Mano et. al. use a combination of behavioral, genetic silencing, and functional imaging experiments to explore the temporal properties of the optomotor response in Drosophila. They find a previously unreported inversion of the behavior under high contrast and luminance conditions and identify potential pathways mediating the effect.

      Strengths:

      Quantifications of optomotor behavior have been performed for many decades. Despite a large number of previous studies, the authors still find something fundamentally novel: under high contrast conditions and extended stimulation periods, the behavior becomes dynamic over time. The turning response shows an initial transient positive following response. The amplitude of the behavior then decreases and even inverts such that animals show an anti-directional rotation response. The authors systematically explore the stimulation feature space, including large ranges of spatial and temporal frequencies and conditions with high and low contrast. They also test two wild-type fly species and even compare experiments across two different labs and setups. From these data, it seems clear that the behavior is robust and largely depends on the brightness of the stimulation, rearing conditions, and genetic background. The authors discuss that these effects have not clearly been reported elsewhere beforehand, and convincingly argue why this may be the case.

      In general, the presented behavioral quantifications illustrate the importance of further experimental studies of the temporal dynamics of behavior in response to dynamically varying stimulus features, across different stimulus types, genetic backgrounds, and model animal systems. It also illustrates the importance of relating the conditions that animals experience in the laboratory to the ones they would experience in the wild. As the authors mention, the brightness during a sunny day can reach values as high as 4000 cd/m2, while experimental stimulation in the lab has so far often been orders of magnitude below that.

      The study then systematically explores potential neural elements involved in the behavior. Through a set of silencing experiments, they find that T4 and T5 neurons, as expected, are required for motion behaviors. On the other hand, silencing HS cells largely abolishes the 'classical' syn-directional response but leaves anti-directional turning intact. On the other hand, silencing CH cells abolishes the anti-directional response but leaves the syn-directional behavior intact. Through functional imaging in T4, T5, HS, and CH neurons, the authors could show that none of these neurons shows a response inversion depending on contrast level. Together, these experiments nicely illustrate that the dynamics do not seem to be computed within the early parts of visual processing, but they must happen on the level of the lobula plate or further downstream.

      Weaknesses:

      While the authors have already explored various parameters of the experiment, it would have been nice to see additional experiments regarding the initial adaptation phase. The experiments in Figure 2e, where the authors show front-to-back or back-to-front gratings before the rotation phase, are a good start. What would the behavioral dynamics look like if they had exposed animals to long periods of static high or low contrast gratings, whole field brightness, or darkness? Such experiments would surely help to better understand the stimulus features on which the adaptation elements operate. It would be interesting to explore to what degree such static stimuli impact the subsequent behavioral dynamics.

      To address this question, we have added a new adaption condition, in which a high contrast, stationary sinusoidal grating is presented for 5 seconds before the high contrast rotational stimulus is presented (new Figure 2 – Supp. Fig. 1). We find that the turning looks identical to the case of a gray adapter. These results drive home the point that the direction of motion of the adapter is what matters most.

      Given the dynamics of the behavior, it would probably also be worth looking at the turning dynamics after the stimulus has stopped. If direction-selective adaptation mechanisms are regulating the turning response, one may find long-lasting biases even in the absence of stimulation. If the authors have more data after the stimulus end, it would be good to further expand the time range by a few seconds to show if this is the case or not (for example, in Figure 1b).

      We now show these dynamics in Figure 1. See Essential Revision #1.

      Another important experiment could be to initially perform experiments in a closed-loop configuration, and then quickly switch to open-loop. The closed-loop configuration should allow the motion computing circuitry to adapt to the chosen environmental conditions. Explorations of the changes in turning response dynamics after such treatments should then enable further dissections of the mechanisms of adaptation. Closed-loop experiments under different contrast conditions have already been performed (for example, Leonhardt et al. 2016), which also showed complex response dynamics after stimulus on- and offset. It would be great to discuss the current open-loop experiments, and maybe some new closed-loop results, in relation to the previous work.

      We have performed these suggested experiments; please see Essential Revision #2.

      The authors mention the different rearing conditions, and there is one experiment in Figure S2 which mentions running experiments at 25 deg C. But it is not clear from the Methods at which temperature all other experiments have been performed. It is also not clear at which temperature the shibire block experiments were performed. As such experiments require elevated temperatures, I assume that all behavioral experiments have been performed at such levels? How high were those?

      Our apologies for leaving out this important information. In DAC’s lab, behavioral experiments are run at 34-36ºC in a room maintaining ~50% relative humidity (this yields ~25% RH in the box with the experiment, as we now note in the methods). These conditions yield high quality, reproducible behavior, especially since this temperature elicits strong walking behavior. In TRC’s lab, behavioral experiments are similarly run at 34ºC in a room maintaining ~50% relative humidity (similarly with ~25% RH in the experimental box), for similar reasons. We have now added these details to the methods sections for each lab’s behavioral experiments.

      What does the fly see before and after the stimulus (i.e. the gray boxes in all figures)? Are these periods of homogenous gray levels or are these non-moving gratings with the luminance and contrast of the subsequent stimulus? It would be important to add this information to the methods and to the figure illustrations or legends.

      In the figures, gray is a uniform luminance screen that appears before and after the stimuli, with luminance matched to the mean stimulus luminance. We have now included this in the methods section where we describe how stimuli were generated in each lab.

      It would be nice to discuss the potential location where the motion adaptation may be implemented in the brain. A small model scheme as an additional figure could further help to discuss how such computations may be mechanistically implemented, helping readers to think about future experimental dissections of the behavior.

      Following this suggestion, we have created a diagram that shows a potential mechanistic implementation of the behavior observed, and summarizes our results (new Figure 6 – Supp. Fig. 2). There are many other possible alternatives that we do not show, including exactly how an opposing signal could ramp up under the conditions of these experiments. In the figure caption, we remind readers what locations have been excluded for this sort of computation. We reference this diagram where we discuss subtraction in the Discussion.

      For setting up similar experiments in other labs, the authors need to better describe how they measured the luminance of the arena. Do they simply report the brightness delivered by the Lightcrafter system, or did they measure this with a lux-meter? If so, at which distance was the measurement performed and with which device? Given that the behavior is sensitive to the specific properties of the stimulus, it will be important to report these numbers carefully to enable other groups to reproduce effects.

      In brief, since these are rear projection screens, we can easily measure light intensity by placing a power meter in front of the screen. This gives us the photon flux in watts, which can be converted to lumens by a standard conversion and then into candelas by making the approximation that our screen scatters into 2π steradians. Dividing by the sensor area gives us our desired candelas per square-meter. We have now added this methodology to the methods section.

    1. we think that even newborn infants may have innate intuitive theories and those theories are subject to revision even in infancy itself

      I support the statement that newborn infants may have innate intuitive theories that are subject to revision even in infancy itself. Infants are born with certain cognitive mechanisms and innate knowledge that help them make sense of the world from a very early age. These intuitive theories, such as those related to object permanence or basic physics, serve as the foundation for their understanding of the environment. However, as infants interact with the world, they continually refine and revise these theories based on their experiences and observations. This process of theory revision is a fundamental aspect of cognitive development, demonstrating the remarkable adaptability and learning capabilities of even the youngest humans.

      References Moore, M. K., & Meltzoff, A. N. (1999, November). New findings on Object permanence: A developmental difference between two types of occlusion. The British journal of developmental psychology.

    1. Author Response

      The following is the authors’ response to the original reviews.

      eLife assessment

      This important manuscript reveals signatures of co-evolution of two nucleosome remodeling factors, Lsh/HELLS and CDCA7, which are involved in the regulation of eukaryotic DNA methylation. The results suggest that the roles for the two factors in DNA methylation maintenance pathways can be traced back to the last eukaryotic common ancestor and that the CDC7A-HELLS-DNMT axis shaped the evolutionary retention of DNA methylation in eukaryotes. The evolutionary analyses are solid, although more refined phylogenetic approaches could have strengthened some of the claims. Overall, this study should be useful for researchers studying DNA methylation pathways in different organisms, and it should be of general interest to colleagues in the fields of evolutionary biology, chromatin biology and genome biology.

      We sincerely appreciate constructive comments and suggestions by the reviewers and a fair and accurate summary by the monitoring editor. Below we made point-by-point responses to reviewers’ comments.

      Reviewer #1 (Public Review):

      Overall, I find the work performed by the authors very interesting. However, the authors have not always included literature that seems relevant to their study. For instance, I do not understand why two papers Dunican et al 2013 and Dunican et al 2015, which provide important insight into Lsh/HELLS function in mouse, frog and fish were not cited. It is also important that the authors are specific about what is known and in particular about what is not known about CDCA7 function in DNA methylation regulation. Unless I am mistaken, there is currently only one study (Velasco et al 2018) investigating the effect of CDCA7 disruption on DNA methylation levels (in ICF3 patient lymphoblastoid cell lines) on a genome-wide scale (Illumina 450K arrays). Unoki et al 2019 report that CDCA7 and HELLS gene knockout in human HEK293T cells moderately and extremely reduces DNA methylation levels at pericentromeric satellite-2 and centromeric alpha-satellite repeats, respectively. No other loci were investigated, and it is therefore not known whether a CDCA7-associated maintenance methylation phenotype extends beyond (peri)centromeric satellites. Thijssen et al performed siRNA- mediated knockdown experiments in mouse embryonic fibroblasts (differentiated cells) and showed that lower levels of Zbtb24, Cdca7 and Hells protein correlate with reduced minor satellite repeat methylation, thereby implicating these factors in mouse minor satellite repeat DNA methylation maintenance. Furthermore, studies that demonstrate a HELLS-CDCA7 interaction are currently limited to Xenopus egg extract (Jenness et al 2018) and the human HEK293 cell line (Unoki et al 2019). Whether such an interaction exists in any other organism and is of relevance to DNA methylation mechanisms remains to be determined. Therefore, in my opinion, the conclusion that "Our co- evolution analysis suggests that DNA methylation-related functionalities of CDCA7 and HELLS are inherited from LECA" should be softened, as the evidence for this scenario is not very compelling and seems premature in the absence of molecular data from more species.

      We appreciate this reviewer’s thorough reading of our manuscript.

      Regarding the citation issues, we will cite Dunican 2013 and Dunican 2015. In addition, we went through the manuscript to update the citations.

      As pointed out by the reviewer, the role of CDCA7 in genome DNA methylation was extensively studied in Velasco et al 2018. The result, together with Thijssen et al (2015), and Unoki et al. (2018), supports the idea that ZBTB24, CDCA7 and HELLS act within the same pathway to promote DNA methylation, the pattern of which is overlapping but distinct from DNMT3B-mediated methylation. This observation suggests that a ZBTB24- CDCA7-HELLS mechanism for DNA methylation may involve an alternative DNMT. Interestingly, our analysis of the gene presence-absence pattern revealed that the presence of CDCA7 coincides with DNMT1 more than DNMT3 genes. Indeed, while CDCA7 is lost from diverse branches of eukaryote species, genomes encoding CDCA7 always encode HELLS, and almost always encode DNMT1. Based on this observation, we speculate the role of CDCA7 is tightly linked to HELLS and DNA methylation throughout evolution.

      As pointed out by Reviewer 1, the link between CDCA7, HELLS and DNA methylation has not been determined experimentally across these species. However, based on our previously published and unpublished data, we are confident about the functional interaction between CDCA7 and HELLS in Xenopus laevis and Homo sapiens.

      Furthermore, the importance of HELLS homologs in DNA methylation has been extensively studied in human, mice and plants. We hope our current study will motivate the field to experimentally test the evolutionary conservation of HELLS-CDCA7 interaction, as well as their importance in DNA methylation, in other species.

      The authors used BLAST searches to characterize the evolutionary conservation of CDCA7 family proteins in vertebrates. From Figure 2A, it seems that they identify a LEDGF binding motif in CDCA7/JPO1. Is this correct and if yes, could you please elaborate and show this result? This is interesting and important to clarify because previous literature (Tesina et al 2015) reports a LEDGF binding motif only in CDCA7L/JPO2.

      We searched for a LEDGF binding motif ({E/D}-X-E-X-F-X-G-F, also known as IBM described in Tesina et al 2015) in vertebrate CDCA7 proteins, and reported their positions in Figure 2A. Examples of identified LEDGF-binding motifs are now presented in Fig. 2C.

      To provide evidence for a potential evolutionary co-selection of CDCA7, HELLS and the DNA methyltransferases (DNMTs) the authors performed CoPAP analysis. Throughout the manuscript, it is unclear to me what the authors mean when referring to "DNMT3". In the Material and Methods section, the authors mention that human DNMT3A was used in BLAST searches to identify proteins with DNA methyltransferase domains. Does this mean that "DNMT3" should be DNMT3A? And if yes, should "DNMT3" be corrected to "DNMT3A"? Is there a reason that "DNMT3A" was chosen for the BLAST searches?

      As described in the Methods section, both Human DNMT1 and DNMT3A were used to initially identify any proteins containing a domain homologous to the DNA methyltransferase catalytic domain. Within Metazoa, if their orthologs exist, the top hit from BLAST search using human DNMT1 and DNMT3A show E-value 0.0, and thus their orthology is robust. This is even true for DNMT1 and DNMT3 homologs in the sponge Amphimedon queenslandica, which is one of the earliest-branching metazoan species. For other DNMTs, such as DNMT2, DNMT4, DNMT5, DNMT6, we conducted separate BLAST searches using those proteins as baits as described in Methods. The methyltransferase domain was then isolated using the NCBI conserved domains search. The selected DNMT domain sequences were aligned with CLUSTALW to generate a phylogenetic tree to further classify DNMTs. In response to reviewer #2’s comments, we also generated another multi-sequence alignment of DNMTs using MUSCLE v5 and conducted maximum-likelihood-based phylogenetic tree assembly using IQ-TREE (new Fig. S6). The overall topology of these trees is consistent except for orphan DNMTs. It has been suggested that vertebrate DNMT3A and DNMT3B are derived from duplication of a DNMT3 gene of chordates ancestor (e.g., Liu et al 2020, PMID 31969623). As such many invertebrates encode only one DNMT3. As previously shown (Yaari et al., 2019, PMID 30962443), plants have two distinct DNMT3-like protein family, the ‘true DNMT3’ and DRM, the plant specific de novo DNMT that is often considered to be a DNMT3 homolog (see Reviewer 2’s comment). Our phylogenetic analysis successfully deviated the clade of DNMT3 and DRM from the rest of DNMTs (Figure S6). Yaari et al noted that PpDNMT3a and PpDNMT3b, the two DNMT3 orthologs encoded by the basal plant Physcomitrella patens, are not orthologs of mammalian DNMT3A and DNMT3B, respectively. Therefore, to minimize such nomenclature confusions, any DNMTs that belong to either the DNMT3 or DRM clades indicated in Figure S6 are collectively referred to as ‘DNMT3’ throughout the paper (see Figure S2 for overview).

      CoPAP analysis revealed that CDCA7 and HELLS are dynamically lost in the Hymenoptera clade and either co-occurs with DNMT3 or DNMT1/UHRF1 loss, which seems important. Unfortunately, the authors do not provide sufficient information in their figures or supplementary data about what is already known regarding DNA methylation levels in the different Hymenoptera species to further consider a potential impact of this observation. What is "the DNA methylation status" of all these organisms? This information cannot be easily retrieved from Table S2. A clearer presentation of what is actually known already would improve this paragraph.

      As the DNA methylation status of the species in the Hymenoptera clade has not been comprehensively tested, we initially did not include this information to Figure 7. However, during the course of the revision, we realized that Bewick et al.2017 (PMID 28025279) reported that DNA methylation is absent from the braconid wasp Aphidius ervi. We originally conducted synteny analysis on Aphidius gifuensis, which has a chromosome-level genome assembly with annotated proteins available in NCBI, whereas annotated proteins for Aphidius ervi protein are not available in NCBI. By conducting tBLASTn search against the Aphidius ervi genome, we now found that the presence/absence pattern of CDCA7, HELLS, DNMT1, DNMT3 and UHRF1 in Aphidius ervi is identical to that of Aphidius gifuensis, with a caveat that genome assembly of Aphidius ervi is at scaffold-level. In other words, DNA methylation, DNMT1 and CDCA7 are absent in Aphidius ervi, where 5mC is undetectable. Additionally, we also realized that the DNA methylation status reported for some species in Bewick et al. 2017 was inferred from the CpG frequency instead of the direct experimental detection of methylated cytosines. Therefore, we have amended Table S3 to indicate the presence of 5mC only for those species where this was experimentally tested. As such, we now consider the DNA methylation status of Fopius arisanus, which lacks DNMT1 and CDCA7, to be unknown.

      Altogether, among the 17 Hymenoptera species that we analyzed (listed in the amended Table S3), the 8 species that have detectable DNA methylation all encode CDCA7, whereas the 2 species that do not have detectable DNA methylation lack CDCA7. We will note this finding in the revised text, and include the known 5mC status in the new Figure 7.

      Furthermore, A. thaliana DDM1, and mouse and human Lsh/Hells are known to preferably promote DNA methylation at satellite repeats, transposable elements and repetitive regions of the genome. On the other hand, DNA methylation in insects and other invertebrates occurs in genic rather than intergenic regions and transposable elements (e.g. Bewick et al 2017; Werren JH PlosGenetics 2013). It would be helpful to elaborate on these differences.

      We were aware of this interesting point, which was discussed in the third paragraph of the Discussion. To better illustrate this point, we now expanded the Discussion (page 14) to speculate about the role of DNA methylation in insects, where emerging evidence indicates the importance of DNMT1 in meiosis. It should be noted that, in the Arabidopsis ddm1 mutant, reduction of CG methylation of gene bodies is common (50% of all methylated euchromatic genes) (Zemach et al, 2013). In addition, hypomethylation is not limited to satellite repeats and transposable elements in ICF patients defective in HELLS or CDCA7 (Velasco et al., 2018).

      Reviewer #2 (Public Review):

      In this manuscript, Funabiki and colleagues investigated the co-evolution of DNA methylation and nucleosome remolding in eukaryotes. This study is motivated by several observations: (1) despite being ancestrally derived, many eukaryotes lost DNA methylation and/or DNA methyltransferases; (2) over many genomic loci, the establishment and maintenance of DNA methylation relies on a conserved nucleosome remodeling complex composed of CDCA7 and HELLS; (3) it remains unknown if/how this functional link influenced the evolution of DNA methylation. The authors hypothesize that if CDCA7-HELLS function was required for DNA methylation in the last eukaryote common ancestor, this should be accompanied by signatures of co-evolution during eukaryote radiation.

      To test this hypothesis, they first set out to investigate the presence/absence of putative functional orthologs of CDCA7, HELLS and DNMTs across major eukaryotic clades. They succeed in identifying homologs of these genes in all clades spanning 180 species. To annotate putative functional orthologs, they use similarity over key functional domains and residues such as ICF related mutations for CDCA7 and SNF2 domains for HELLS. Using established eukaryote phylogenies, the authors conclude that the CDCA7-HELLS-DNMT axis arose in the last common ancestor to all eukaryotes. Importantly, they found recurrent loss events of CDCA7-HELLS-DNMT in at least 40 eukaryotic species, most of them lacking DNA methylation.

      Having identified these factors, they successfully identify signatures of co-evolution between DNMTs, CDCA7 and HELLS using CoPAP analysis - a probabilistic model inferring the likelihood of interactions between genes given a set of presence/absence patterns. As a control, such interactions are not detected with other remodelers or chromatin modifying pathways also found across eukaryotes. Expanding on this analysis, the authors found that CDCA7 was more likely to be lost in species without DNA methylation.

      In conclusion, the authors suggest that the CDCA7-HELLS-DNMT axis is ancestral in eukaryotes and raise the hypothesis that CDCA7 becomes quickly dispensable upon the loss of DNA methylation and/or that CDCA7 might be the first step toward the switch from DNA methylation-based genome regulation to other modes.

      The data and analyses reported are significant and solid. However, using more refined phylogenetic approaches could have strengthened the orthologous relationships presented. Overall, this work is a conceptual advance in our understanding of the evolutionary coupling between nucleosome remolding and DNA methylation. It also provides a useful resource to study the early origins of DNA methylation related molecular process. Finally, it brings forward the interesting hypothesis that since eukaryotes are faced with the challenge of performing DNA methylation in the context of nucleosome packed DNA, loosing factors such as CDCA7-HELLS likely led to recurrent innovations in chromatin-based genome regulation.

      Strengths:

      • The hypothesis linking nucleosome remodeling and the evolution of DNA methylation.

      • Deep mapping of DNA methylation related process in eukaryotes.

      • Identification and evolutionary trajectories of novel homologs/orthologs of CDCA7.

      • Identification of CDCA7-HELLS-DNMT co-evolution across eukaryotes.

      Weaknesses:

      • Orthology assignment based on protein similarity.

      • No statistical support for the topologies of gene/proteins trees (figure S1, S3, S4, S6) which could have strengthened the hypothesis of shared ancestry.

      We appreciate the reviewers’ accurate summary, nicely emphasizing the importance of the our study. We agree that better phylogenetic analysis for orthology assignment will strengthen our conclusion. Having anticipated this weakness, however, we specifically conducted a CoPAP analysis exclusively for Ecdysozoa specieswhich supported our major conclusion, as orthology assignment is straightforward in these species. For example, if we conduct BLAST search against the clonal raider ant Oocerea biroi protein dataset using human HELLS as a query, top 1 hit is a protein sequence annotated as one of three isoforms of ‘lymphoid-specific helicase” (i.e., HELLS), with E value 0.0. Similarly, the top BLAST hit from the Oocerea biroi dataset using human DNMT1 as a query also returns with isoforms of DNMT1 with E value 0.0. As such, there are little disputes in orthology assignment in Ecdysozoa. Outside of Chordata, classification of DNMTs, particularly in Excavata and SAR, require more extensive identification in these supergroups. Our current orthology assignment for the major targets in this study (HELLS, DNMT1, DNMT3, DNMT5) is largely consistent with published results (Ponger et al., 2005 PMID 15689527; Huff et al, 2014 PMID 24630728; Yaari et al., 2019 PMID 30962443; Bewick et al., 2019 PMID 30778188). However, while we are preparing this response and re-crosschecking our assignments with these references, we realized that we had erroneously missed DNMT5 orthologs in Leucosporidium creatinivorum, Postia placenta, Armillaria gallica and Saitoella complicata, and a DNMT6 ortholog in Fragilariopsis cylindrus. We also recognized that DNMT4 orthologs were identified in Fragilariopsis cylindrus and Thalassiosira pseudonana in Huff et al 2014 (PMID 24630728), but in our phylogenetic analysis, these proteins form a distinct clade between DNMT1/Dim-2 and DNMT4 (original Figure S6), although the confidence level of this classification by Huff et al was not strong. To resolve this potential confusion in DNMT annotations, we generated new multiple sequence alignments with MUSCLE v5 and IQ-TREE 2 (maximum likelihood-based method, coupled with selection of optimal substitution model and bootstrapping). The tree topology was not significantly altered between the two methods, except for the unambiguous location of orphan DNMTs and DNMT4-related proteins. To avoid unnecessary confusion in the DNMT annotations, we decided to present MUSCLE-IQ- TREE for the DNMT phylogenetic tree and classification (new Fig. S6). The raw results of IQ-TREE analysis for CDCA7/zf-4CXXC_R1, HELLS SNF2 domain, and DNMTs are included as Dataset S1-S3. We then conducted CoPAP analysis using the corrected classification. As it is not clear a priori if fungal specific CDCA7-like proteins (now referred to as CDCA7F with class II zf-4CXXC_R1) should be considered CDCA7 orthologs, we conducted CoPAP against two lists; the first list includes CDCA7F in the CDCA7 group, whereas the second list includes a separate category of class II zn-4CXXC_R1, which includes CDCA7F. Both results show slightly different topology in the coevolutionary linkages but support our major conclusion that CDCA7 coevolved with DNMT1-UHRF1 and HELLS. These new CoPAP results are shown in Fig. S7.

      Reviewer #1 (Recommendations For The Authors):

      Summary

      Last sentence: "...a unique specialized role of CDCA7 in HELLS-dependent DNA methylation maintenance...". What do the authors mean?

      Our analysis strongly indicates that CDCA7 is dispensable in systems lacking HELLS and DNMT (particularly DNMT1). In other words, species preserve CDCA7 only if it has both HELLS and DNMT1 (or in some cases DNMT5). The importance of HELLS homologs in DNA methylation has been extensively studied in human, mouse and plants. However, in these studies, substantial DNA methylation remains despite the defective HELLS/DDM1 (especially in euchromatic regions). Additionally, there are species (e.g., Bombyx mori) that have DNMT1 and detectable DNA methylation but lacks HELLS and CDCA7. These observations suggest that the role of CDCA7 must be unique and specialized in a way that it is strongly coupled to HELLS-dependent DNA methylation (but not HELLS-independent DNA methylation), and that this function of CDCA7 seems to be inherited from the last eukaryotic common ancestor.

      Introduction

      • page 3: "DNMTs are largely subdivided into maintenance and de novo DNMTs" - Which species are the authors referring to?

      As described in the cited reference (Lyko 2018), maintenance DNA methylation and de novo DNA methylation are well accepted functional classification of DNA methylation. It is also currently accepted that distinct DNMTs execute maintenance DNA methylation or de novo DNA methylation, although crosstalk between these processes has been reported. Therefore, we stated, “DNMTs are largely subdivided into maintenance DNMTs and de novo DNMTs”, and this subdivision is species independent.

      • page 3" "Maintenance DNMTs recognize hemimethylated CpGs. " - Can the authors please define the species and/or literature they are referring to? This seems important to clarify. For instance, mammalian DNMT1 requires a co-factor, UHRF1, which recognizes hemimethylated DNA and H3K9me3 (Bostick et al 2007).

      We meant to describe, “Maintenance DNMTs directly or indirectly recognize hemimethylated CpGs…”. The specific requirement of UHRF1 for DNMT1-mediated maintenance DNA methylation is explained in the subsequent sentence “In animals…”. In the case of Cryptococcus neoformans, DNMT5 recognizes hemimethylated DNA independently of UHRF1 in vitro to execute maintenance methylation.

      • page 3: The authors may want to mention that A. thaliana also has a de novo DNA methyltransferase, DRM2, a homolog of the mammalian DNMT3 methyltransferases. This seems important, since they show in Figure 1 that a de novo methyltransferase is found in A. thaliana. Also, later in their manuscript they mention plant de novo DNA methylation.

      Thanks for pointing this out. As shown in Figure 5, we classified plant DRMs as DNMT3-like proteins, but we now note this in the Introduction.

      • page 3: Sentence starting "In about 50% of ICF patients,..." - Why is DNMT3B referred to as "de novo", is it not a de novo DNA methyltransferase?

      You are correct. Quotation marks are now removed to avoid unnecessary confusion.

      • page 4: Sentence starting "Indeed, the importance of HELLS/CDCA7 in DNA methylation maintenance...", - Which references (Han et al., 2020; Ming et al., 2021; Unoki, 2021; Unoki et al., 2020) provide experimental evidence for a role of CDCA7 in DNA methylation maintenance by DNMT1?

      Thanks for pointing out the typo. “/CDCA7” is now removed.

      • page 5: Sentence starting "Indeed, it has been shown that DNMT3A..." - Should DNMTB be DNMT3B?

      Yes. This is now corrected.

      Results

      • Page 5: Sentence starting "However, we identified a protein..." - No A. thaliana reference?

      We added Zemach et al 2010, and Chan et al 2005.

      • Figure 2B: "ICF4 mutations" should this be "ICF3 mutations"?

      • Figure 3: "ICF4 mutations" should this be "ICF3 mutations"?

      • Figure 4: "ICF4 mutations" should this be "ICF3 mutations"?

      • Figure S1: Orange colored "CDC7L (fish), CDC7e, CDC7, CDC7L" is there an "A" missing?

      • Figure S5: "ICF4 mutations" should this be "ICF3 mutations"?

      These typos are now corrected. Thank you.

      • Figure S7: What is "CDCA7(II)" referring to, "zf-4CXXC_R1 class II (plants)"?

      The original CDCA7 (II) included proteins with class II zf-4CXXC_R1, which are found in plants, fungi, Acanthamoeba castellanii and Amphimedon. Among those species, the prototypical CDCA7 orthologs are absent only in fungi. It has been a priori unclear if fungal proteins with class II zf-4CXXC_R1 (now we term CDCA7F) should be included in CDCA7 for CoPAP analysis. Although we originally included CDCA7F in CDCA7, we now show the results of two analyses. In the first one (Fig. S7A) CDCA7F was included in CDCA7, whereas in in the second one (Fig. S7B) CDCA7F was included in the separate category of class II zf-4CXXC_R1. Topologies of two results are slightly different, but they both show coevolutionary linkage between the CDCA7 and DNMT1- UHRF1 cluster.

      • Figure 4 and 5: In the case of preliminary genome assemblies what is the difference between empty squares with dotted lines and filled squares without dotted lines?

      As it is difficult to be certain of a gene’s absence (did the species lose the gene or is it simply not annotated due to incomplete genome coverage?), we illustrated the absence of a gene in preliminary genome assemblies with an empty square with dotted outline. Since the presence of a gene is evident regardless of the level of genome assembly, the presence of a gene is represented with filled squares with solid lines, even for preliminary genome assemblies.

      • Figure 1: Why was Mus musculus - one of the main model organisms used for many DNA methylation studies not included? Also what are empty and filled squares?

      Filled and empty squares indicate the presence and absence of the indicated genes, respectively. Clarifying statement is now added in the figure legends. Mus musculus is now included in the figure.

      • Figure S2: Adding the existence of DNA methylation and DNMT3 in the bottom right part of the figure (overall no of species) would make this panel more informative

      We included this overview to summarize the co-retention of CDCA7, HELLS and maintenance DNMTs across the analyzed species. We decided not to include DNA methylation, since DNA methylation status is known for only a fraction of the listed species. Inclusion of DNMT3 will introduce too many possible gene presence-absence combinations to convey a clear message. However, we now mention in the revised text (page 11, second paragraph) that unlike the prevalent co-retention of DNMT1 in species with CDCA7, we identified several species that possess CDCA7, HELLS and DNMT1 but lack DNMT3. These examples include insects such as the bed bug Cimex lectularius and the red paper wasp Polistes canadensis.

      • Page 6: Sentence starting "This leucine zipper sequence is highly conserved..." - Figure/Reference missing?

      The sequence alignment of the leucine zipper is now shown in Fig. 2C.

      • page 6: Sentence starting "In contrast to zf-4CXXC_R1 motif-containing proteins..." - The authors may want to mention the role of the CXXC zf domain in KDM2A/B, DNMT1, MLL1/2 and TET1/3 and what the CDCA7 CXXC zf domain is/could be required for.

      The notion that zf-CXXC binds to nonmethylated CpG is now included. Due to the substantial difference between zf-CXXC and zf-4CXXC_R1, we hesitated to relate the function of zf-4CXXC_R1 with zf-CXXC, but we now discuss a potential role of zf- 4CXXC_R1 in sensing DNA methylation status in Discussion (Page 13).

      • page 7: Sentence starting "Second, the fifth cysteine is replaced..."- Zoopagomycota" - Figure 4A does not have this labeling, one has to deduce this from Figure 4B.

      We fixed this by including the list of Zoopagomycota species in the main text.

      • page 7: Sentence containing "Neurospora crassa DMM-1 does not directly regulate DNA methylation or demethylation but rather..." - How does the information about DMM- 1 relate to what is shown in Figure 4B, to CDCA7, HELLS and DNMTs? Please clarify.

      Both Neurospora DMM-1 and Arabidopsis IBM1 contain the JmjC domain and are implicated in an indirect control mechanism of DNA methylation. Since it has never been pointed out that they have a divergent zf-4CXXC_R1 domain, which clearly shares the origin with CDCA7 proteins, we thought that this is important to note. We realized that we did not clearly mark Neurospora XP-956257 as DMM-1 in Fig. 4B. This is now fixed.

      • Heading "Systematic identification of CDCA7, HELLS and DNMT homologs in eukaryotes". When mentioning CDCA7 the authors may want to decide on the use of one consistent definition of "prototypical (Class I) CDCA7-like proteins (i.e. CDCA7 orthologs)" "Class I CDCA7 proteins". Constantly changing the way how they refer to these proteins is very confusing.

      We now make it clear that we call proteins with class I zf-CXXC_R1 motif CDCA7 orthologs. We also define class II zf-4CXXC_R1 (as those with a substitution at ICF- associated glycine residue). Since no clear CDCA7 orthologs can be found in fungi, we now call fungi proteins with class II zf-4CXXC_R1 “CDCA7F”, implying its ambiguous orthology assignment.

      Under this heading there is also no mention of DNMTs. Instead, the authors introduce DNMTs under the heading "Classification of DNMTs in eukaryotes" - Please clarify.

      This is now corrected.

      • page 9: Sentence containing "... presence of DNMT1, UHRF1 and CDCA7 outside of Viridiplantae and Opisthokonta is rare". What does "rare" mean? How is UHRF1 relevant here?

      Among the 32 species outside of Viridiplantae and Opisthokonta, only the Acanthamoeba castellanii genome encodes clear orthologs of DNMT1, UHRF1 and CDCA7. Although it is often difficult to deduce if the selected panel of species is a reasonable representation, we think that it is not unreasonable to state that Acanthamoeba is a rare case to encode this set of proteins outside of Viridiplantae and Opisthokonta. We include UHRF1 since it is a well-established activator of DNMT1, and indeed our CoPAP analysis showed a tight coevolution of UHRF1 with DNMT1. Outside of Viridiplantae and Opisthokonta, only Acanthamoeba castellanii and Naegleria gruberi encode UHRF1. Interestingly, these two species also encode CDCA7 and HELLS.

      Having said that, we rephrased this sentence, which reads; “Species that encode a set of DNMT1, UHRF1, CDCA7 and HELLS are particularly enriched in Viridiplantae and Metazoa.”

      • page 11: Sentence containing "..., that the function of CDCA7-like proteins is strongly linked to HELLS and DNMT1,..." What do the authors mean with "the function of CDCA7-like proteins"? And what happened to DNMT3?

      Our observation that almost all species that contain CDCA7 (including fungal CDCA7F) also have DNMT1 and HELLS, despite the frequent loss of these genes in species that do not contain CDCA7, indicates “that the function of CDCA7-like proteins is strongly linked to HELLS and DNMT1”. We found only 2 species that possesses CDCA7 (class I or class II) but not DNMT1 among the panel of 180 species. These 2 exceptional species, Naegleria gruberi and Taphrina deformans, do encode UHRF1-like proteins and a DNMT (an orphan DNMT in N. gruberi and DNMT4 in T. deformans). In contrast, we found 26 species that possess CDCA7 (or CDCA7F) but not DNMT3 (Table S1), so the linkage between CDCA7 and DNMT3 is weaker.

      • page 11: Sentence containing "..., CDCA7 is lost from this gene cluster in parasitoid wasps, including Ichneumonoidea wasps and chalcid wasps". This sentence is confusing because already in an earlier paragraph the authors say that "Microplitis demolitor lost CDCA7" and in the following sentence they say "...among Ichneumonoidea wasps, CDCA7 appears to be lost in the Braconidae clade, ...". It would greatly help this reader if the authors could streamline these sentences and also decide on whether CDCA7 is lost in M. demolitor or CDCA7 appears to be lost in M.demolitor.

      The confusion was in part due to the difficulty in differentiating between the true loss of a gene versus its apparent absence in a species due to an incomplete genome assembly, including for of M. demolitor. To verify that the loss of CDCA7 was not due to gaps in the genome assembly, we executed the synteny analysis. However, we edited this section to improve the readability (Page 12-13).

      What could be the role for HELLS/CDCA7 in insect DNA methylation? In several cases, the authors analyses reveal co-evolutionary links between DNMT3 (DNMT3A?) and CDCA7/HELLS. I do not understand why this finding is not really discussed by the authors. Instead there is a strong focus on replication-uncoupled DNA methylation maintenance. Could the authors elaborate why?

      The role of DNA methylation in insects is largely unclear, so discussion must be highly speculative. A recent finding in the clonal raider ant, showing that DNMT1 is not essential for development but is critical for oogenesis, pointed toward a possible more universal role of DNA methylation in meiosis. Stimulated from a finding in Neurospora, where DNA methylation is required for homolog pairing during meiosis, we discuss a speculative model that DNA methylation status acts as a hallmark to distinguish between healthy/young DNA and old/mutated (or competitive/pathogenic) DNA at homolog pairing during meiosis (page 14).

      Regarding the cases where CDCA7 and DNMT3 are co-lost, we had discussed about this phenomenon at the last section of Result, stating, “This co-loss of CDCA7 and DNA methylation (together with either DNMT1-UHRF1or DNMT3) in braconid wasps suggests that evolutionary preservation of CDCA7 is more sensitive to DNA methylation status per se than to the presence or absence of a particular DNMT subtype.” Please note that we found several lineages that lacks CDCA7 but has DNMT1 (and DNMT3), whereas almost all species that has CDCA7 also has DNMT1 (but not necessarily DNMT3). Supported with our CoPAP analyses, our results indicate the tight functional link between CDCA7 and DNMT1, but it does not necessarily mean that CDCA7 does not play any role related to DNMT3 or de novo methylation. Clarification of this point and our speculation of how CDCA7 loss is linked to reduced requirement of DNA methylation are discussed in page 13 and 14 with additional texts.

      Discussion

      • page 12: Where is the data supporting. "... the red flour beetle Tribolium castaneum possesses DNMT1 and HELLS, but lost DNMT3 and CDCA7"?

      Figure 5, Figure S2 and Table S1. This is now noted in the text.

      • page 14: Based on which parts of their analyses or evidence from the literature can the authors speculate that "...the evolutionary arrival of HELLS-CDCA7 in eukaryotes might have been required to transmit the original immunity-related role of DNA methylation from prokaryotes to nucleosome-containing (eukaryotic) genomes"? Please clarify.

      This is inferred from the well-known role of DNA methylation in bacteria for defending against phage viruses. However, it was not correct to state that such a function was inherited from prokaryotes. It should be stated that it was inherited from the last universal common ancestor (LUCA). We also admit that it is not clear if such an immunity-related role was inherited from LUCA, or if it emerged through convergent evolution. Therefore, we amended this description to emphasize our hypothesis that the advent of CDCA7 was “a key step to transmit the DNA methylation system from the LUCA to the eukaryotic ancestor with nucleosome-containing genomes”.

      Supplementary Figures/Tables

      • page 26: Table S2 and Table S3, it seems that these tables show data that supports what is shown in Figure 7 and not Figure 5.

      You are correct. Thank you for pointing out the typos.

      Has the methylation status been assessed in C. glomerata, C. typhae, Chelonus insularis, Diachasma alloeum or Aphidius gifuensis? Please clarify in Table S2.

      Not to our knowledge. However, as we realized that absence of DNA methylation in Aphidius ervi was previously reported (Bewick et al 2017), we now included this data together with presence/absence analysis of DNMT1, UHRF1, DNMT3, CDCA7 and HELLS. Known presence/absence of DNA methylation is now shown in Fig.7.

      Reviewer #2 (Recommendations For The Authors):

      Recommendation to strengthen the paper:

      1) Phylogenetics:

      • Test and report the appropriateness of the substitution model used in protein alignments/trees.

      • Use Maximum likelihood methods and/or MCM Bayesian inference to build and report trees with well supported topologies. This is required to properly assign orthology (shared ancestry). This will avoid false interpretation due to technical limitation of similarity-based phylogenies (without statistical support). Figure S1, S3, S4 and S6.

      To address these points, we made new multisequence alignments using MUSCLE v6 and generated phylogenetic trees using the maximum likelihood-based IQ-TREE 2, where multiple models were screened. A consensus tree was generated after 1000 bootstrap replicates from the best alignment and model. The topology and assignment of these new trees were largely consistent with the original trees, except for some corrections in DNMT assignment as discussed below.

      1. We realized that we erroneously missed DNMT5 orthologs of Leucosporidium creatinivorum, Postia placenta, Armillaria gallica and Saitoella complicata., and DNMT6 orthologs from Fragilariopsis cylindrus reported in Huff et al 2014 (PMID 24630728). They are now included in the new list and CoPAP analysis.

      2. DNMT4 orthologs were identified in Fragilariopsis cylindrus and Thalassiosira pseudonana by Huff et al 2014 (PMID 24630728), but in our original phylogenetic analysis, these proteins form a distinct clade between DNMT1/Dim-2 and DNMT4. The new tree and classification are more consistent with Huff et al, so we present the new tree in Fig. S6 and conducted the classification based on this tree.

      Beside Fig. S6, we decided to maintain original Fig. S1, S3 and S4 (with a few adjustments) for better visibility, but we included the results of IQ-TREE analysis as Dataset S1-S3.

      The CoPAP analysis based on the revised assignment slightly changed the topology of coevolutionary linkages. In addition, we obtained a slightly different result depending on whether fungal specific CDCA7 with class II zn-4CXXC_R1 (now referred to as CDCA7F) is included as a CDCA7 ortholog or not. Despite this difference, we reproducibly observed the coevolutionary linkage between CDCA7 and DNMT1- UHRF1.

      • Be more careful with wording: RBH is not sufficient to call gene/proteins orthologs (e.g. Page 8). The above mentioned method will help you support this claim (+ synteny when you can).

      We were aware of this issue. This is why we conducted phylogenetic tree building based on sequence alignment of full-length HELLS (Fig. S3) and SNF2 domain only (Fig. S4), as explained in the text. We found that the RBH criterion is robust in Metazoa; orthologs are easily recognizable with very low E-value (0.0) and extensive homology over the full length of the protein, while synteny is not practical to employ in the diverse set of species.

      • Also, use "co-retention" or "co-evolution" but not "co-selection" when describing CoPAP results - as CoPAP does not test for signature of natural selection.

      This is a good point and is now corrected.

      • The statistics (p-val...) underlying the CoPAP analyses should be explained.

      The explanation is now added in Methods section.

      “A method to calculate p-value for CoPAP was described previously (Cohen et al., 2012, PMID 22962457). Briefly, for each pair of tested genes, Pearson's correlation coefficient was computed. Parametric bootstrapping was used to compute a p-value by comparing it with a simulated correlation coefficient calculated based on a null distribution of independently evolving pairs with a comparable exchangeability (a value reporting the likelihood of gene gain and loss events across the tree).”

      2) Figure S2 and S3 could be improved for readability

      After consideration of this criticism, we decided to keep their original formats for following reasons.

      Figure S2. The purpose of this list is to better visualize the comprehensive list shown in Table S2. A consolidated list is already shown in Figure 5. An alternative choice is to make a diagram where individual species names are unreadable. This kind of presentation is seen in many published papers, but we found that they are not helpful to check the details. As this is a supplementary figure, we prefer to show the detailed data that can be visible without a specialized software.

      Figure S3. This figure is included to show which SNF2 family proteins are more likely to be misassigned as HELLS/DDM1 orthologs. We believe that the figure serves this purpose.

      3) What is the meaning of the coloring patterns of ICF residues in znf?

      ICF residues are highlighted as light blue in the schematics to indicate its conservation. In the alignment, the coloring reflects the level of conservation within the shown set of proteins, and the choice of coloring was set by Jalview.

      4) To improve clarity: the introduction could be more focused on evolutionary considerations and functional link between CDCA7-HELLS and DNMTs.

      We revised the first paragraph of the introduction to illustrate this point.

      5) Could indicate the CDC7A loss / DNA methylation hypothesis in the abstract.

      We now included this hypothesis in the Abstract.

    1. Selectiondevices of this sort willsoon be speeded up fromtheir present rate ofreviewing data at a fewhundred a minute.

      We see these selection devices being used today for more important purposes such as looking at resumes and selecting applicants for job interviews. I think it's important to note that although technology is being utilized for something that has such a big impact on people, it still isn't perfect. These algorithms will not always pick out the best candidates and will exclude those who may be best qualified for the job.

    1. Author Response

      Evaluation Summary:

      The manuscript shows that retinal ganglion cell light responses in awake mice differ substantially from those under two forms for anesthesia and previously attained ex vivo recordings. This difference is central to our understanding of how ganglion cell responses relate to behavior. There are a few technical issues and issues about how the work is presented that could be strengthened.

      We thank the reviewers for their constructive comments. We have addressed all the issues, and added substantially more data and analysis results in the revised manuscript, further supporting our findings that awake responses are larger, faster, and more linearly decodable in the mouse retina than those responses under anesthesia or ex vivo.

      Reviewer #1 (Public Review):

      This paper compares output signals from the mouse retina in three conditions: awake mice, anaesthetized mice, and isolated retinas. The paper reports substantial differences, particularly between awake and either of the other conditions. Retinal signaling has been well studied using ex vivo preparations, with an assumption that the findings from those studies can be carried over to how the retina operates in vivo. The results from this paper at a minimum indicate a need to be cautious about that assumption. There are several technical issues that need testing or further explanation, and several issues about the presentation that could be clarified.

      Spike sorting

      The paper does not describe any control analyses that test for contamination in spike sorting. These are needed to evaluate the work.

      We have reported the details of our spike sorting procedure in the revised manuscript (Data Analysis section in Methods and Figure 1). In short, single-units were identified by clustering in principal component space, followed by manual inspection of spike waveform (triphasic as expected from axonal signals; e.g., revised Figure 1F-H; Barry, 2015) as well as auto- and cross-correlograms (minimal inter-spike interval above 1 ms for a refractory period; e.g., revised Figure 1I-K). A small fraction of visually responsive cells (20/282, awake; 21/325, isoflurane; 1/103, FMM) had a small fraction of interspike intervals below 2 ms; but, whether or not including them in the analysis did not affect our main conclusions.

      Light levels

      The paper argues that differences in light level cannot account for the results. According to the methods, light levels were about two-fold higher at the retina in array recordings as compared to the front of the eye for in vivo recordings. The main text indicates that they differ less, it's not clear why the numbers in the main text and methods are different. Aside from this issue, this comparison does not consider the loss of light between the front of the eye and the retina. It is crucial that the paper provide a more detailed description of light levels. This should include converting those light levels to units that include the spectral output of the light source used (e.g. to isomerizations per rod or cone per second).

      The maximum light intensity of our in vivo setup was 31.3 mW/m2 (with 15.9 mW for UV LED and 15.4 mW/m2 for blue LED). Following the suggestion by the reviewer, we calculated the photon flux on the mouse retina in vivo by taking into account the loss of light by the eye optics. In short, assuming 50% and 68% transmittance at 365 nm and 454 nm, respectively (Jacobs & Williams 2007), the pupil size of 1 mm and the retinal diameter of 4 mm with the stimulus covering 73° in azimuth and 44° in elevation, we obtained the photon flux on the mouse retina in vivo as 3.81×103 and 6.64×103 photons/s/μm2 for UV and blue light, respectively. Assuming a total photon collecting area of 0.2 μm² for cones and 0.5 μm² for rods (Nikonov et al. 2006), and a relative sensitivity of rods, S- and M-cones to be [UV, Blue]=[25, 60], [90, 0], [25, 60]%, respectively (Jacobs & Williams 2007), we then estimated the photoisomerization (R) rate as: 2.5×103 R/rod/s, 0.7×103 R/S-cone/s, and 1.0×103 R/M-cone/s.

      In contrast, the maximum light intensity of the in vitro set up was 36 mW/m2 as reported in Vlasiuk and Asari (2021). The photon flux on the isolated retina was then estimated to be around 9×104 photons/s/μm2 (under the assumption that the white light from a CRT monitor is centered around 500 nm). Assuming the sensitivity of rods, S- and M-cones to be 40, 2 and 40%, respectively, we then obtained 4×104 R/rod/s, 2×103 R/S-cone/s, and 4×104 R*/Scone/s.

      Thus, the light intensity level was about ten times larger for the in vitro recordings than for the in vivo recordings. The amount of light reaching the retina in the awake condition should also be somewhat smaller than that under anesthesia due to pupillary reflexes. Past studies suggest that the darker the stimulus is, the slower the kinetics is and the smaller the response is for RGCs in an isolated retina (Wang et al 2011). Thus, the light intensity difference cannot simply account for the higher firing and faster kinetics in the awake condition than ex vivo or in the anesthestized condition.

      We have revised the manuscript accordingly.

      Comparison with other work

      The authors accurately point out that there is not much prior work on retinal outputs in awake animals. The paper, however, minimally describes the work that does exist. The Hong et al. (2018) paper, in particular, should be discussed. There are several differences between the results of that paper and the present paper. These include the fraction of recorded cells that are DS cells, and the maintained firing rates (though this does not appear to be studied systematically in Hong et al.).

      In the discussion section of the revised manuscript, we clarified connections to the existing studies on the retinal activity in vivo. To our knowledge, none of the past studies provided descriptive statistics on the awake RGC response properties (Hong et al., 2018; Schroeder et al., 2020; Sibille et al., 2022). Nevertheless, consistent with our study, we can see high baseline activity in the reported examples from C57BL6 mice (Figure 3C, Schroeder et al. 2020; Figure S7h, Sibille et al. 2022).

      Hong et al (2018), in contrast, reported somewhat different as pointed out by the reviewer. Firstly, they found a relatively low baseline activity in RGCs of albino CD1 mice. We think that this is likely due to general impairments of the vision/retina associated with albinism. While equipped with normal electroretinogram signals, CD1 mice showed no optomotor response and a reduced number of rods (Abdeljalil et al 2005; Brown et al 2007). This suggests a certain level of retinal dysfunction in these mice. Secondly, Hong et al (2018) reported a higher fraction of direction-selective RGCs in their recordings (>50% at a DS index threshold of 0.3). This is even higher than one would expect from anatomical and physiological studies ex vivo on BL6 mice (about a third; Sanes and Masland, 2015; Baden et al., 2016; Jouty et al 2013). Besides the effect of albinism, we think that this overrepresentation of DS cells in Hong et al (2018) arose as a consequence of the low baseline activity. As discussed above, the higher the baseline activity, the lower the DS/OS index by definition (Eq.(3) in Methods). Indeed we found much more cells with high DS/OS index values in our anesthetized data than in awake ones (42-54% vs 17% at an index value threshold of 0.15; Figure 2), even though these recordings were done in the same experimental set up.

      A related issue is that there are a few comparisons of ex vivo RGC responses with behavioral sensitivity. Smeds et al. (2019) is one example. More generally, the long-standing observation that dark-adapted sensitivity approaches limits set by Poisson fluctuations in photon absorption, and that prior RGC measurements are consistent with this result, is hard to explain if the RGCs are firing at high spontaneous rates under these conditions. RGC responses will certainly change with light level, but this merits discussion in the paper.

      As the reviewer pointed out, the retina may employ different coding principles under different light levels. In a scotopic condition, ex vivo studies reported a high tonic firing rate for OFF RGC types (~50 Hz, OFF sustained alpha cells in mice; Smeds et al 2019; ~20 Hz, OFF parasol cells in primates; Ala-Laurila and Rieke, 2014), while a low tonic firing for ON cell types (<1Hz for both ON sustained alpha in mice and ON parasol in primates). These ON cells were shown to be responsible for light detection by firing in the silent background, hence compatible with the sparse feature detection strategy. In contrast, our recordings were done in a high mesopic / low photopic range where both rods and cones are supposedly active. Unlike the scotopic condition with rod vision, we then found high firing in awake recordings in general, indicating that no visual feature can be readily detectable as brief firing events in the silent background. To explore the implications of such firing patterns on visual coding, we took a modelling approach in the revised manuscript. We found that a latency-based temporal code was not preferable in the awake condition (Figure 7); and that a linear decoder worked significantly better with the population responses in the awake condition to capture the presented random fluctuation of the light intensity (Figure 8). While we have not tested any behavioural relevance in our study besides correlation to locomotion/pupil size, it is then possible that the retina may work in different modes under different light intensity regimes (Tikidji-Hamburyan et al 2015).

      We clarified these points in the revised discussion section.

      Sampling bias

      The paper argues that sampling bias is not likely to contribute substantially to the results because of the wide variety of cell types recorded (line 431). This does not seem like a particularly strong argument, especially given the large degree of overlap in the distributions of most quantities across preparations. The argument about many cell types could be made more strongly if the distributions were completely separated, but that is not the case.

      We cannot deny the presence of a sampling bias in our datasets, and as the reviewer pointed out, we made comparisons only at a population level, but not at the level of individual cells or cell-types. However, the anesthetized and awake recordings were done with the same recording setup and techniques, and thus subject to the same sampling bias. Hence, the difference in the RGC response properties between these conditions cannot be explained by the sampling bias per se.

      Sensitivity

      The firing rates in response to 10% contrast sinusoids are quite low, as are the maximal firing rates for high contrast sinusoids. Relatedly, the modulation produced by the noise stimuli, particularly for the array recordings, is weak. This raises concerns about the health of some of the preparations.

      To our knowledge, in vivo contrast responses reported here were comparable to ex vivo data in previous reports (mouse, Jouty et al 2018, Pearson and Kerschensteiner 2015; rat, Jensen 2017, 2019). Likewise, the static nonlinearity and its upper bound for ex vivo responses were comparable between this study and previous reports (Santina et al. 2013; Kerschensteiner et al 2008; Cantrell et al 2010; Trapani et al 2022).

      We also examined batch effects in the response to the noise stimuli. We found certain variabilities across preparations in each recording condition, but not to the extent to discard any particular data as an obvious outlier (Figure 6 – figure supplement 1). While it is difficult to tell the health status of preparations retrospectively, we thus believe that the effects were negligible.

      Efficient coding

      Sparse firing is not a universal property of retinal ganglion cell responses. Primate midget RGCs, for example, have pretty high maintained firing rates as shown in many past studies. Mouse RGCs have also been reported to operate in a mode similar to the high firing rate On cells reported here (Ke et al. 2014). A more balanced discussion of this past work is needed.

      As the reviewer pointed out, some retinal ganglion cells show high firing under certain conditions. In a scotopic condition, for example, OFF cells have high firing rates, while ON cells fire virtually nothing unless a light stimulus is presented (Ke et al 2014; Smeds et al 2019). At the behavoural level, a single-photon detection above chance level nevertheless relies on the information from the ON but not the OFF pathway (Smeds et al 2019). Thus, the sparse coding framework still works as a valid strategy here, if not universal.

      This is, however, very different from what we report here. In a high-mesopic/low-photopic light level, we found a general increase of firing across all cell categories in the awake condition, compared to the anesthetized or ex vivo recordings (Figures 3 and 6). While this lowers information transfer rate (bits/spike; Figure 7), we found that the awake responses were more linearly decodable than the responses in the other conditions (Figure 8). We also ran a simulation and showed that a latency-based temporal code is not preferable for the awake responses (Figure 7 – figure supplement 1). These results suggest that the retina in awake condition is in favor of a rate code, though we have not tested all light levels or any behavioural relevance here.

      We clarified these points in the revised manuscript.

      Role of eye movements

      Could eye movements be at least partially responsible for the differences in response properties? Specifically, small fixational eye movements might produce a constantly varying input that could modulate firing.

      As described above (Essential Review item #2), eye movements were rarely observed during the head-fixed awake recordings. Eliminating those events from the analysis did not change our overall conclusions, and thus their contributions should be minimal in this study. It should also be noted that we mainly used full-field stimulation, and thus microsaccades should not substantially affect the amount of light impinging on the retina. We clarified these points in the revised manuscript.

      Reviewer #2 (Public Review):

      The technical achievements presented in the manuscript represent a tour de force, as optical tract recordings in awake mice have only rarely been done before. The substantial number of neurons recorded in both awake and anaesthetized conditions form a precious and worldwide unique dataset. However, since the recordings represent a non-standard approach, it would be, in my view, highly beneficial to show more details about the success of the method. How did the authors post-hoc identify electrode contacts located in the optical tract, how did the spike waveforms look like, what were the metrics of spike sorting quality, etc.

      We added more details about our recording and analysis methods in the revised manuscript. Below are answers to the reviewer’s specific questions:

      • The probe was coated with a fluorescent dye (DiI stain) and its location was verified histologically after the recordings (Figure 1E).

      • Spike waveforms typically had a triphasic shape (e.g., Figure 1F-H) as expected from axonal signals (Barry, 2015).

      • Single-units were identified by clustering in principal component space, followed by manual inspection of spike shape as well as auto- and cross-correlograms. Most units had a minimum interspike interval above 2 ms (93%, awake; 94%, isoflurane; 99%, FMM); and no units had the interspike intervals below 1 ms for a refractory period (e.g., Figure 1I-K), except for 1 (out of 103) for FMM-anesthetized recordings.

      We then selected visually responsive cells (SNR>0.15; see Eq.(1) in Methods) for the analyses.

      The authors go a long way in characterising the functional response properties of the recorded neurons and relating them to previous ex-vivo recordings. Based on the responses they find, the authors claim that they identified "... a new response type [which] likely emerged due to high baseline firing in awake mice". Regarding this claim, how do the authors rule out that it corresponds to any of the previously described cell types? For instance, the very sharp transient or brief modulations by the contrast part of the stimulus might have been missed in previous classifications based on calcium responses (e.g. Baden et al. 2016), where a number of cell types seem to respond equally strong to grey and white and have an elevated response throughout the sinusoidal modulation of contrast. I acknowledge that the authors touch upon the possibility that the newly described OFFsuppressive ON cells correspond to a known cell type in the discussion, but I would recommend changing the phrasing of the results to avoid potential misunderstandings.

      We agreed with the reviewer and revised the manuscript accordingly. Here we have two possibilities. Firstly, as the reviewer pointed out, this kind of response dynamics could be overlooked previously because of a difference in the recording modality (Ca imaging; Baden et al 2016) or clustering methods (Jouty et al 2019). Secondly, these cells may belong to one of the cell-types described in the past ex vivo studies, but exhibited distinct response dynamics in vivo as an emerging property of the awake condition. This is an interesting topic to pursue in future studies.

      The manuscript makes the interesting suggestion that "the retinal output characteristics [...] observed in vivo, [...] provide a completely different view on the retinal code". Given that this conclusion would change the way we should think about and do retinal neuroscience, in my view, the authors should take a few more steps to quantitatively demonstrate the implications of their findings on retinal coding, e.g. how much lower is the information transmitted per spike, how much does a temporal code based on spike timing suffer with the latencies observed in vivo. If the authors could quantify through computational modelling approaches the consequences of the observed differences, they might also be able to revise their title / main message, i.e. that "Awake responses SUGGEST inefficient dense coding in the mouse retina".

      To explore functional implications of our findings, we performed three more analyses as suggested by the reviewer. Specifically,

      1) We showed that the information transmitted per spike was significantly lower in awake condition, while the total information rate was comparable (Figure 7).

      2) We tested the performance of a linear decoder applied on the firing rate in response to full-field noise, and showed that it worked significantly better for the awake population responses (Figure 8).

      3) We simulated RGC responses to a full-field contrast change at different intensities in different conditions, and showed that a latency coding did not work well with awake responses, compared to ex vivo or anesthetized responses (Figure 7 – figure supplement 1).

      These results strengthened our conclusion that awake response dynamics were different from anesthetized or ex vivo responses, all arguing against the sparse efficient coding principles at least at a light level we examined. We nevertheless kept the title as is because we have not explored the retinal coding properties per se. Our main claim stays on the visual response characteristics of retinal outputs in awake mice.

      Reviewer #3 (Public Review):

      The manuscript by Boissonnet, Tripodi, and Asari compares retinal ganglion cell (RGC) light responses in awake mice (recorded in the optic nerve) with those under two forms for anaesthesia and previously attained ex vivo recordings. This is a well motivated study looking at a question that is really critical to the field.

      The presentation is generally clear and compelling. My suggestions are relatively minor and aimed at improving an already very strong article.

      1) More cells in the awake condition would help strenghten the conclusions. Only 51 cells are reported, and mouse RGCs comprise more than 40 different types. The authors are well aware of the possible confound of sampling bias, and the best way to mitigate this issue in this experimental paradigm is simply to record more cells. The anesthsia conditions each have about 100 cells, which is better.

      We made substantially more recordings in the awake condition, reaching 282 cells (in 15 animals) in total in the revised manuscript. This does not yet allow for a full cell-type classification as in the past ex vivo studies. Nevertheless, we did our best to broadly classify visual responses, and showed that the overall conclusions remained the same: awake RGCs had higher baseline firing and faster response kinetics in general. For details, see above our response to the Essential Revision item #1.

      2) It took me longer than it should have (had to look up the previous paper cited) to figure out that the ex vivo comparison data were recorded at 37{degree sign}C. This is an important detail since most ex vivo recordings are at 32{degree sign}C. The authors should make this clear in the text and perhaps say something in the Discussion about comparisons to the larger body of literature of ex vivo studies at 32{degree sign}.

      We are aware that most ex vivo studies on the retina were performed at 32 °C, which is lower than physiological body temperature (37 °C). However, the temperature of the ocular surface is around 37 °C (Vogel et al 2016), suggesting that the retina should operate at 37 °C in vivo. This is why we decided to perform ex vivo experiments at 37 °C in our previous study (Vlasiuk and Asari, 2021), allowing us to make a fair comparison between the ex vivo and in vivo recordings.

      We clarified the point in the revised manuscript.

      3) Direction and orientation selectivity should be separated in Fig. 2 and not combined into the confusing term "motion sensitive." Motion sensitivity has another meaning in the literature for RGCs that respond preferentially to moving over static stimuli without direction or orientation preference (Kuo et al., 2016; Manookin et al., 2018)

      We agree with the reviewer. In the revised manuscript, we separated the direction and orientation selective cells (Figure 2), and avoided the term “motion sensitive.”

      4) While I am certainly sympathetic to the argument that the RGC spike code is "inefficient" in the sense that it does not conform to efficient coding theory (ETC), I think it's oversimplified to claim that the present data is a key argument against ETC. Plenty of ex vivo data has already shown ETC to be incomplete at best, and misguided at worst, since it includes the implicit assumption that image reconstruction is the retina's objective function (or even that the experimenter has any idea what that objective function is). For example, OFF sustained alpha (OFF delta in guinea pig) RGCs are not quite sparse feature detectors even ex vivo, and they seem to be optimized to transmit contrast with high SNR (Homann and Freed, 2017). In general, the enormous coverage factor of the RGC population seems to make ETC untenable to begin with, as discussed in (Schwartz, 2021) and elsewhere. I realize that there are still people attached to simplistic forms of ETC as a key principle of retinal computatiion, so I am not asking for the authors to completely remove this angle. Rather, a more nuanced treatment of the issue both in the introduction and the discussion is warranted.

      We totally agree that we are not the first to argue against the efficient coding principles in the retina (Schwartz, 2021). The main argument in this study is that certain aspects of the RGC activity are distinct in an awake condition, such as the baseline firing and response kinetics, and thus we cannot simply translate our knowledge obtained from ex vivo studies into awake animals. To explore the implications on retinal computations, we showed in the revised manuscript that 1) awake responses have a comparable total information transfer rate (in bits per second; Figure 7A) but are less efficient (i.e., lower bits per spikes; Figure 7B); 2) awake responses are not in favor of a latency-based temporal code (Figure 7 – figure supplement 1); and 3) a linear decoder worked significantly better with awake responses (Figure 8), even though an image reconstruction is not necessarily the objective function of the retina. These results point out a need to rethink about retinal function in vivo, including the efficient coding theory.

      We thank the reviewer for the suggestion, and revised the manuscript accordingly.

      References

      Homann, J., and Freed, M.A. (2017). A mammalian retinal ganglion cell implements a neuronal computation that maximizes the SNR of its postsynaptic currents. Journal of Neuroscience 37, 1468-1478.

      Kuo, S.P., Schwartz, G.W., and Rieke, F. (2016). Nonlinear Spatiotemporal Integration by Electrical and Chemical Synapses in the Retina. Neuron 90, 320-332.

      Manookin, M.B., Patterson, S.S., and Linehan, C.M. (2018). Neural Mechanisms Mediating Motion Sensitivity in Parasol Ganglion Cells of the Primate Retina. Neuron 97, 13271340.e4. Schwartz, G.W. (2021). Retinal Computation (Academic Press).