The results you obtain with SpotMAX are impressive compared to those from human annotation and what you've identified as the SOTA solution. I'm left wondering, though, where a method less sophisticated than the SOTA but more automated and convenient than manual annotation (such as e.g., trackpy.locate) would fall in this comparison.

Apologies if I've overlooked it, but I couldn't find more information about how this is done in the Methods section. From my experience, inferring this information from image acquisition parameters is relatively straightforward for any microscope you have data from (because you can find the relevant properties in the metadata), but it's very difficult in general (because every manufacturer outputs metadata in their own way). I'd be interested to know if you have a general solution for this problem using e.g. Bio-Formats for Python.

I understand the logic, but how can you be sure that a plateau in the increase in fluorescence lifetime means that the microtubules have completely depolymerized?

Could you please provide a link to the GitHub repository? Is it publicly available yet?

This is a very cool visualization! The choice of the colormap is, however, not the most intuitive, especially given that the same color is used to represent different concentrations in different panels.

What is meant by "identity" masks? I understand these masks to be based on either the lifetime or the number of photons per pixel, what does identity mean in this context?

This seems like a great case study for showcasing your software! But if you are going to make this claim, could you explain how or why reference [35] is not the first? Given that you also say:

Changes in the fluorescence lifetime of SiR-tubulin following the addition of Nocodazole have been used to quantify the degree of microtubule depolymerisation [35].

While I don't think it has been published yet, there is also PhasorPy, which is an open-source, Python-based library for doing phasor analysis.

Fully agree! Would it be possible to add references to alternative approaches? I am also curious if you considered revising the segmentation based on unmatched nuclei. One could argue that the isolated nucleus in Fig. 2 should be re-labeled as not a nucleus.

As required by both models? Would it be possible to comment briefly on to what extent InstanSeg is scale-invariant?

Is the RGB projection truly random or are the colors evenly spaced?

Is the ground truth training data balanced between nucleus and cell labels or is this not necessary?

I'm curious if your light microscopy data used for cell tracking is, or could also be, made available?

Cool video! I'm curious though if any filtering of the trajectories was done to prevent individual cells from being counted multiple times in the statistics? Relatively faster cells that dip in and out of focus, for instance, could skew the speed distribution if not taken into consideration.

Sorry, but this also confuses me. How can this be considered a global transformation when only one tile is matched at a time for translation? I would have assumed that the tiles are roughly in place from using e.g. stage coordinates as a crude estimate of tile position.

Why do you say the algorithm can be used to "only find the scaling and rotation parameters" when you immediately add translation? Do you mean only scaling and rotation are solved for in the original implementation of the algorithm and your adaptation adds translation?

Your geometric hashing approach sounds similar to RANSAC. I am curious if you compared the two and what the tradeoffs between time and accuracy look like?

Hello, I am not very familiar with this imaging modality but it seems rather strange that the imaging parameters are unknown. Is this typically the case?

This is indeed an impressive field of view, and the apparent SNR is impressive for ~10s exposures. More details on the laser power, diffuser, and detection optics would be appreciated!

Could you annotate the reference line in the plot to make it more clear where the pixel intensities in (c) are extracted from.

Could you provide information on the laser you used for this? It would be great if you could provide a more complete description of your experimental setup in a Methods section.

It's surprising to me that dark current poses more of a problem than autofluorescence. I'm curious if the dark current is somehow exacerbated when detecting in the SWIR region or if it would be mitigated simply with better detector cooling?

Intrinsically denoised, sure, but noisy training data may still lead to a smoothed/blurred prediction. Are there techniques you have experimented with to sharpen predictions or has this not been an issue in your experience?

For many applications the virtual staining could be seen as a means to an end: segmentation. Is the intermediate step of predicting the virtual stain necessary or would it be feasible to skip straight to the segmentation by e.g. merging the Cellpose segmentation model?

not to mention dataset sizes.

Can this claim be quantified without deferring to a figure?

The class representations of cell type 1 and cell type K are not very well differentiated.

IMO Supplemental figures 1 and 2 would be more clear and succinct as heatmaps than line plots.

You provide a clear explanation of how you generate the pseudospectra in the methods, but I question the use of "ideal" in describing them. I get that you mean idealized, but it sounds as if they are perfect and in no way subjective which is misleading.

Could you please clarify if this test was done by using manual segmentation as ground truth? If not, what was the source of ground truth data used to compute F1-scores?

An F1-score of 0.7 is not generally seen as very high. Could emphasize more strongly in your discussion the power of your approach (combining the instance segmentation with class maps for classification) given that this seems to be a non-trivial segmentation problem.

Is this claim quantitatively verified?

How is this a fair comparison for comparing SNR between live and cryofixed conditions? I understand your point that exposure time for live Raman is limited due to photodamage, but would still be interesting to see 30s/line for live Raman (albeit with drift artifacts) for the sake of comparison.

*exposure, compensating

This is a nice example of benchmarks for band widths for certain spectral peaks to differentiate between low and high SNR!

Can you more clearly define what constitutes "high-SNR" Raman? Of course it is high relative to "low-SNR" Raman, but how can someone know if they are doing high- vs low-SNR Raman? Are there thresholds that are (or can be) defined on the width of certain spectral peaks?

Is fused silica necessary to prevent autofluorescence from surface defects in normal glass coverslips? Is it typical/recommended to used fused silica for Raman microscopy generally or only for very high sensitivity measurements?

*show

*wavelength dispersion

Would be helpful to cite a couple specific examples of biological activities and/or molecular species for which fixation is insufficient to bolster motivation for cryogenic freezing.