1,514 Matching Annotations
  1. Last 7 days
    1. Claude: Resources page shortening suggestions:

      1. Remove duplicate tool cards — the Dashboard + Learn page cards are identical to what's on the About page. Replace with a compact one-liner: 'Interactive tools: Dashboard · How CM is Made · TEA Comparison · Technical Docs'

      2. Add TEA Comparison link — the new compare.html page systematically compares Pasitka, Humbird, CE Delft, GFI, and Goodwin. This is directly relevant to the reading list context.

      3. Keep the Shared Reading Collection — it serves a unique purpose (downloadable PDFs) not available elsewhere.

      4. Keep the PQ Database section — it's the canonical link set.

    1. Claude: Workshop page shortening suggestions:

      1. Remove the 'Suggested Reading' fold (lines 103-124) — this duplicates the reading list on resources.html. Replace with: 'See our Resources page for suggested reading and key papers.'

      2. Tighten crux card descriptions — now that the dashboard has a dedicated TEA Comparison page, the crux cards can be 1-2 sentences shorter. Link to compare.html for detail.

      3. Add compare.qmd to the tool cards alongside Dashboard and Learn page.

      Estimated savings: ~40 lines, plus reduced reader burden from not seeing the same reading list twice.

    1. Does gene editing regulation affect growth factor costs?

      Claude: Suggest moving this entire discussion to the workshop site. This is a workshop-specific topic about how to frame CM_01, not dashboard educational content.

      Replace with a one-line link: 'Regulatory implications for growth factor costs and how they affect CM_01 framing are discussed at our workshop site.'

      Same applies to the 'Which market?' section further down. Together these save ~40 visible lines and reduce cross-site duplication.

    2. The Serum-Free Challenge

      Claude: Suggest collapsing this entire FBS subsection into a single fold titled 'Historical note: Why the industry moved to serum-free media.'

      One visible sentence: 'All commercial cultured meat uses serum-free media — here's why the industry moved away from fetal bovine serum.'

      The detailed explanation (what FBS is, why it can't scale, ethical issues) is educational but no longer reflects current practice. Nobody uses FBS. Folding saves ~25 visible lines and keeps the page focused on current cost drivers.

    3. Claude: Content trimming plan for this page (1,147 lines → ~700 target)

      Proposed changes in priority order: 1. Fold FBS/serum-free section — historical context, no longer reflects current practice. One visible sentence + collapsed detail. 2. Move jurisdiction & 'Which market?' discussions to workshop — these are workshop topics, not dashboard content. Replace with one-line links. 3. Fold GF signaling diagram — educational but not cost-relevant. Keep the price/solutions tables visible. 4. Bold audit — reduce bold to headings + key numbers only (addresses multiple reviewer comments). 5. Trim Further Resources — link to workshop resources page for full list. 6. CSS fixes — larger diagrams, less whitespace around SVGs.

      Optional: fold 2-3 SVG diagrams (cell banking, seed train) to reduce scroll length — the text already explains these steps.

      Full plan at .private/content_trimming_plan.md. Feedback welcome here or in chat.

    1. wo-track assessment Criteria weights depend on whether the work is prominent or not:

      Also: Let users choose their own weights with sliders as well

    2. Field-appropriate standards (don’t penalize fields where RCTs aren’t possible): Development/health: RCTs, DiD, regression discontinuity, IV Environmental/climate: Integrated assessment models, panel data, natural experiments AI governance: Mixed methods, surveys, formal models Animal welfare: Stated preference, DCEs, welfare calculations Political science: Quasi-experimental, panel data, surveys Macro/trade: DSGE, gravity equations, synthetic control

      how literally is it using these 'standards' ? This bears some more expansion

    3. In an economy with manual labor, cognitive labor, physical capital, and AI, optimal tax policy can include taxing AI.

      provide tooltip quotes to check for hallucination

    Annotators

    1. Optimistic TEA ($6/lb) — useful comparison but model does not replicate their specific assumptions

      I don't think this is for pure cell mass, this is for a hybrid product

  2. Mar 2026
    1. The diagram compares these two operating modes side-by-side. Batch mode (left) harvests everything at once; perfusion (right) continuously adds fresh media and removes spent media while retaining cells.

      too much white space before and after image

    2. The opportunity: If cultured meat can use simplified food-grade designs (similar to beer brewing at $5-15/L), costs could drop by 10×.

      are they already doing this? If so, maybe adjust the wordking/emphasis here

    3. of cells matters enormously for cost:

      "enormously for cost' Seems potentially too strong here. ... as we have suggested above, the estimated cost share for cell banking is less than 1% of the total cost.

      Am I correct? If so, please moderate this.

    4. Step 1: Cell Banking

      For each step, give a 'tldr' and an estimated cost share, and have the rest be something folded by default, which they can unfold

    5. Today, optimistic projections suggest ~$63/kg (Garrison et al. 2022), with leading companies achieving <$10/kg cell mass.

      Flag a note (more discussion in tooltip) about how this is the cost of pure cell mass, and early/ultimate products might be hybrid CM, plant-based, fungal etc. ... so this overstates the cost, in a sense

      "Achieving $10/kg" is probably too strong. Maybe 'claiming the ability'? And do you have a link to this?

    6. Product

      diagram below a bit small. Last item looks like a drumstick -- maybe make it look like a 'chicken hamburger' instead? (Because early products unlikely to have bones)

    7. key levers

      The high cell density is in blue, but you also put "micros" in blue, which suggests the two have a link. I don't think that's what it is. I think the high cell density will reduce the media cost, which is in green, and maybe other goals like bioreactor and operating expenses so I'm a bit confused.

    8. Typical Cost Breakdown ($/kg chicken)

      Diagram below does not really make sense. Is it a breakdown of the cost components or something having to do with levers that could make the costs go up or down substantially? This needs more clarity.

    9. How Cultured Chicken is Made Code

      Top of this, or maybe on another page, it would be nice to have some sort of mosaic graph with different cost break-downs for different scenarios. Dividing up the cost into different components to get to total cost per kilogram, and then perhaps each of those mosaic elements could link to a different section explaining it.

    10. This reasoning underlies our model’s binary switch approach —

      This part of the model and also define what you mean by "binary switch" specifically in a tooltip.

    11. insulin and transferrin

      I don't think these were mentioned anywhere either - Dash. Are these growth factors? If they're not growth factors, why are you discussing them in this section?

    12. Current Price Target Price

      It doesn't really matter what the price is per gram of inpuy . The question is, what is the likely price per kilogram of chicken meat output. add a column for this.

    13. Key Growth Factors for Cultured Meat

      Why are you telling me about all these different kinds of growth factors? Do they all need to be used? Are they alternatives to each other? Have you defined what the terms in the "function" column mean?

      And how much of them will need to be used per kilogram of chicken meat produced (or whatever weight we are standardizing things to here), what cost implications? Right to always bring things to this standard unit of cost per kilogram of chicken meat.

    14. Cost ($/L)

      How does dollars per liter map into dollars per whatever unit of chicken meat we're using here? It's going to depend on the cellular density. I presume the cellular density is the same for these two types of media, or does one lead to much less dense cells?

    15. Hydrolysates: The Big Win for Amino Acids

      To what extent is it clear that these can just simply be used, and to what extent is this still an important uncertainty? If it's clear that they can be used, We should make that clear-- to flag this so people don't think of it as still an important uncertainty. But we should look for more references here to be sure.

    16. The cultured meat industry must use serum-free media.

      Try not to state things in a very prescriptive way. We're meant to be providing background information, not ordering people around.

    17. This is THE Pivotal Uncertainty (click to expand)

      Again, this really just seems too strong a statement to make. We need a little bit more epistemic modesty and reasoning transparency.

    18. expand

      Maybe rewrite the headline to actually say that the total media cost is predicted to be out 40 to 70% of production cost, or whatever the numbers tell us. I don't need to expand it to get the headline result.

    19. Ethical: Derived from fetal calves — defeats purpose of avoiding animal slaughter Limited supply: ~500,000 L/year globally (van der Valk et al. 2018)

      Where does the supply come from? Are animals being killed here to produce it?

      This might be a folding box. I'm not sure if it enters into the previous narrative. ?

    20. Traditional cell culture uses fetal bovine serum (FBS) — a complex mixture that provides growth factors, hormones, and attachment proteins. Problems:

      So which of the above is this used for? It seems like it covers several of the above things you're calling "media". That's a little bit confusing to have this overlap of some sort.

    21. grade (Sigma-Aldrich pricing)

      Give me some excerpts from that page and explain what it means. You just linked to a sort of commercial page. It's not very helpful or easy to navigate.

    22. Traditional cell culture uses fetal bovine serum (FBS)

      A question mark comes up when I hover over this, but I don't see any tooltip explaining what it is.

      Also, why are you talking about bovine serum if we're thinking about chicken here? At least you should explain the analogy.

    23. Vitamins Metabolic cofactors B-complex, etc. Minerals/salts Osmotic balance, enzyme function

      Maybe group the cheapest things together in one row unless there's some sort of environmental or ethical issue with them.

    24. costs

      Not all costs, just this component of cost. Again, I want to know what share that makes up of the total to put this in perspective. It's only a minor share of total cost. It's not really a pivotal cost driver, is it?

      Try to put these in terms of cost per unit of meat produced in a mature production process, and try to use the same units everywhere so we know how to compare each element and sub-element.

    25. Cell culture media contains everything cells need to grow:

      List these by order of estimated share of cost in a production-scale process. And give a rough estimate of those shares, and those should be on the same scale - expressed per unit of output, in the same units. Give a disclaimer, of course, that this is just based on one particular estimate, and you can link to the actual model.

    26. Hydrolysates vs. pure amino acids

      What share of media costs are these in different models and reports? I thought this was possibly the largest?

    27. media turnover parameter in our model

      Link this part of the model. Backlinks might also be good from the model to this explanation (here and everywhere else. )

    28. sio

      Batch versus perfusion? You haven't given enough narrative here. I don't know why you're telling me this. Are these different bioreactor types, and if so, how does it map into the categories you just gave above?

    29. Simplified designs for food production

      This is a little confusing to me because what do you mean designed for food production? What is the standard food production use of this if not for cultured meat?

    30. Bioreactor Types

      Link some pictures of these types of tanks, or perhaps a folding box showing these pictures. You'll have to do a web search to look these things up.

    31. ou need far fewer reactor transfers

      What's the typical cost of the reactor transfer in an established, larger-scale production process? Would this still be a substantial share of total costs?

    32. often pharma-grade at $5-20/L

      Source for the quote "often pharma grade?" Okay, you're relying heavily on Humbird here. Find some other sources, and I've heard that now most companies are using food grade instead of pharma grade. Look into that and discuss in tooltip footnotes.

    33. Cost Impact

      For each phase, I want you to give some indication of the share of costs, in terms of the total cost per unit of meat, that this could potentially encompass, both at a small scale and at a larger scale.

    34. Seed Train: Progressive Scale-Up Vial 1 mL 10⁶ cells T-Flask 100 mL 10⁷ cells Spinner 1 L 10⁸ cells Small Reactor 10 L 10⁹ cells Medium Reactor 100 L 10¹⁰ cells Production 1,000+ L 10¹¹+ cells

      The text is a bit crowded here, so the numbers overlap the words. Try to adjust to give it a little more space.

    35. Step 1: Cell Banking What Happens

      Give more continuous references, perhaps as tooltips, to where you are getting this information from about the process. Perhaps give citations with links and short quotes.

    36. require regulatory approval.

      Link to this regulatory approval thing - how difficult/Costly is it to get that approval, or do we already have this for the important immortalized cell lines?

    37. one-time setup cost that’s amortized over many production runs. A well-characterized cell bank can support years of production (GFI 2021).

      Doesn't really explain how the costs work. Ultimately, the banked cells are used up, correct? Are you saying that cell banking is just a tiny share of the cost here, if you end up using the whole batch, is that right?

    38. Step 1: Cell Banking

      You did not use the term "cell banking" in the flow chart above. This can be confusing when you change terms. We don't know what Maps to what

    39. Pasitka et al. 2022

      Give the name of the paper and a tooltip, and also explain what aspects of these claims the source provides, perhaps with quick quotes.

    40. Similar FGF-2/IGF-1 requirements to bovine (~10-100 ng/mL optimal)

      Explain, perhaps in a tooltip, why the similarity is helpful here. That I don't really know what these things mean (e.g., what does ng mean?)

    41. ~70 billion chickens slaughtered annually vs ~300 million cattle

      Provide a tooltip/link to discussion from animal welfare advocates about this, perhaps on the EA forum.

    42. Produc

      Can you make an image without a bone in it that still looks like a piece of chicken meat? I don't think bones are happening any time soon in cultured meat.

    43. This is THE pivotal uncertainty. If any of these approaches succeeds at scale, growth factors become negligible (<$1/kg chicken). If none succeed, growth factors could be >$100/kg — making cultured meat uneconomic at scale. See GFI’s analysis for detailed technical roadmaps.

      this seems a bit too strong from my reading. Media costs exceed GF costs in many formulations

    1. This model helps evaluators and forecasters:

      But atm we donm't have confidence in this model. I's more about fixing ideas and giving people a sense of what sort of modeling we want (and surfacing doubts and disagreements on this) so that we can productively collaborate.

      Ideally, we'd also have a page/interface where people could 'build their own models' and we compare them.

    1. New to this topic? How Cultured Chicken is Made | 🎧 Audio Review (22 min MP3)

      Skip this last bit. Try to condense the content at the top a bit more for this page

    2. 💬 We Want Your Feedback! Comment directly on this page using Hypothesis — click the < tab on the right edge. Highlight any equation, parameter, or explanation to annotate it. We actively monitor comments and will respond to questions, incorporate suggestions, and improve the documentation based on your feedback.

      Make this list prominent/folded.

    3. 🔬 Workshop: Cultured Meat Cost Trajectories (Late April / Early May 2026) This model feeds into The Unjournal’s upcoming expert workshop on CM production costs. Workshop details & signup →

      Don't need this at the top of the technical reference page.

    1. Cultured Chicken Production Cost Model CodeShow All CodeHide All CodeView Source

      More caveats about this model ... largely AI generated, as of 27 Mar 2026 we can't vouch for the numbers, provided to give a sense of the sort of modeling we're interested in, and present a framework for discussion and comparison

    2. These are like Squiggle/Guesstimate visualizations - they show the full range of possible values, not just a point estimate.

      Based on which parameters? the user-entered ones above?

    3. Basic Parameters Code viewof plant_capacity = Inputs.range([5, 100], { value: 20, step: 5, label: "Plant Capacity (kTA/yr)" })

      Important -- are these means or medians of a distribution used in simulation or are these simple 'degenerate' numbers. Explain and signpost better

      And do they affect the figures and graphs below? #important

    4. Individual distributions for each cost driver: Code function formatCost(val) { if (val >= 30) return Math.round(val).toString(); if (val >= 1) return val.toFixed(1); if (val >= 0.1) return val.toFixed(2); return val.toFixed(3); } { const allComponents = [ {name: "Media", data: results.cost_media, color: "#27ae60"}, {name: "Micronutrients", data: results.cost_comm_micros, color: "#3498db"}, {name: "Growth Factors", data: results.cost_recf, color: "#9b59b6"}, {name: "Other VOC", data: results.cost_other_var, color: "#7f8c8d"}, {name: "CAPEX (annualized)", data: results.cost_capex, color: "#e74c3c"}, {name: "Fixed OPEX", data: results.cost_fixed, color: "#f39c12"}, {name: "Downstream", data: results.cost_downstream, color: "#1abc9c"} ]; // Filter out components with all zeros (e.g., downstream when not included) const components = allComponents.filter(c => mean(c.data) > 0.001); const plotData = components.map(comp => { const p5 = quantile(comp.data, 0.05); const p50 = quantile(comp.data, 0.50); const p95 = quantile(comp.data, 0.95); const clipVal = Math.max(quantile(comp.data, 0.98), 0.1); const clipped = comp.data.filter(x => x <= clipVal && x >= 0); const plot = Plot.plot({ width: 420, height: 180, marginLeft: 45, marginBottom: 35, marginTop: 10, x: { label: "$/kg", domain: [0, clipVal * 1.1] }, y: { label: null, ticks: [] }, marks: [ Plot.rectY(clipped, Plot.binX({y: "count"}, {x: d => d, fill: comp.color, fillOpacity: 0.7})), Plot.ruleX([p5], {stroke: "black", strokeWidth: 1.5, strokeDasharray: "3,3"}), Plot.ruleX([p50], {stroke: "black", strokeWidth: 2}), Plot.ruleX([p95], {stroke: "black", strokeWidth: 1.5, strokeDasharray: "3,3"}) ] }); const label = `${comp.name}: $${formatCost(p50)} (90% CI: ${formatCost(p5)} – ${formatCost(p95)})`; return {plot, label}; }); return html`<div style="display: grid; grid-template-columns: repeat(2, 1fr); gap: 1rem; margin: 1rem 0;"> ${plotData.map(d => html`<div style="font-size: 0.9em;"> <div style="font-weight: normal; margin-bottom: 0.3rem; color: #333;">${d.label}</div> ${d.plot} </div>`)} </div>`; } formatCost = ƒ(val)

      Do these adjust as I change the sliders above? I changed the 'plant capacity' and I did not see any change here. What's going on? #important

    5. Cost Breakdown by Component (Total: $122.51/kg):where(.plot-d6a7b5) { --plot-background: white; display: block; height: auto; height: intrinsic; max-width: 100%; } :where(.plot-d6a7b5 text), :where(.plot-d6a7b5 tspan) { white-space: pre; }

      make the graph below a bit bigger

    6. Price-competitive with conventional chicken

      Wait -- adjust this to consider/note the CM inclusion rate (%) and cost of plant-based or mycoprotein ingredients ($/kg)

    7. edian Cost (p50)

      Have a separate number for each of these boxes (slightly less prominent) for 'hybrid product cost/kg' ...

      User should be able to input a 'CM inclusion rate (%) and cost of plant-based or mycoprotein ingredients ($/kg) as parameters', and this should do a simple auto adjustment.

      First just a simple adjustment, and later we make this part of the simulation model.

      Also allow user to switch this 'hybrid product' on/off (box below 'Include downstream processing'

    8. Why it matters: If production costs reach ~$10/kg (comparable to conventional chicken), cultured meat could compete at scale. If costs remain >$50/kg, the technology may remain niche

      Caveat/note here about cost of producing the pure cultivated chicken cells, vs cost of the product that will have some percentage of these cells mixed with other (plant, fungal, etc.) ingredients.

    9. What these numbers represent: Simulated production cost per kilogram of cultured chicken (wet weight, unprocessed) in 2036, based on 30,000 Monte Carlo simulations. This is the cost to produce meat in a bioreactor — not retail price, which would include processing, distribution, and margins.

      Make it clear that we're giving the cost/kg for pure chicken cells, not the consumer product, which may (likely?) involve a small to moderate fraction of these cells in the output. Thus the 'price parity with conventional meat' might be easier to attain than the raw numbers suggest.

      Make a prominent note (and unfold further discussion) about the production cost of pure cultured chicken cells versus the cost of the products offered, which are likely to include a mix of chicken cells, plant elements, maybe fungal elements, and other things.

      Thus the cost per kg of pure chicken might not be assessed

    10. A key feature is the latent maturity factor that links:

      provide a reference for this approach, and provide and link a more detailed explanation

    11. Lognormal

      Note that we're open to considering other distributional forms, and making the modeling flexible to allow for different (chosen or simulated) distributions

    12. Probabilities, fractions

      Note that for ~switching parameters, the model samples both from the probabilities of a switch to a different regime (a different discrete state of the world, e.g., a new discovery) and then, in each simulation, uses this probability to select a particular state. (word this better, and be sure I'm correct here)

    13. 🔬 Upcoming Workshop: Cultivated Meat Cost Trajectories

      "!" in red seems like a warning. No need for that. Also, Can you make each of these a folding box, initially folded

    1. ⭐ GFI amino acid report (Dec 2025) — GFI. Based on real quotes from amino acid suppliers and CM manufacturers. Found Humbird's amino acid prices overestimated by 2–10x. GFI cell growth modeling (Nov 2025) — GFI. How to model cell growth more realistically than current TEAs. GFI growth factor costs (2023) — PDF. Anticipated growth factor and recombinant protein costs and volumes for cost-competitive CM. GFI medium cost analysis (2020) — GFI. Foundational analysis of media as the dominant variable cost; identifies recombinant proteins and growth factors as key cost drivers. Some companies report 60% media cost reductions using plant-derived protein homologs. GFI scale-up & bioprocessing trends (2024) — GFI. Industry trends in bioreactor scale, continuous perfusion, and food-grade equipment — relevant to CM_16 (cell density) and CM_20

      too many here (and also all from a single source, GFI. Try to diversify sources, but also use folding and tooltips to reduce the clutter

    2. Note: Believer Meats (the authors' company) shut down Dec 2025.

      this feels a bit too ad-hominem an attack. A tooltip can mention the author's relationship to the company but should not imply that it nullifies the arguments made. See if the author themself made any points about this

    3. Lynch & Pierrehumbert (2019) — "Climate impacts of cultured meat and beef cattle." Early TEA with environmental dimension.

      skip this one maybe? I don't want to focus on Climate

    1. ▸ Context & reference points Optimistic TEAs: Pasitka et al. (2024) claims ~$6.2/lb ($13.7/kg) is achievable with continuous production and animal-free medium. Pessimistic TEAs: Humbird (2020) concluded cost parity is "highly unlikely" given biological and engineering constraints. Current conventional chicken: ~$2-4/kg wholesale in the US. Rethink Priorities (2022): Forecasted limited production through 2050 under most scenarios.

      I don't think I want to show these - these will anchor people based on our own previous review in ways that we might not want

    2. What is the expected-value (and probability distribution) of the impact on animal welfare from funding CM development? Consider marginal funding, very high funding levels, or impact relative to the best alternative interventions.

      Give an (optional) slider for them to state what share of benefit, relative to the next best intervention, is achieved, along with 80% CIs

    1. The answers also inform animal welfare funding decisions, but the workshop focus is on getting the cost evidence right.

      This last sentence seems out of place.

    2. 4. From TEA to reality: Why did Believer Meats fail?

      I haven't wanted to make this central. It's worth mentioning, but I wouldn't make it the 'headline' of the fourth point

    3. spare billions of animals. I

      Tooltip here about how we note there may be a range of other important benefits and perhaps costs here, including environmental benefits, reduction of animal-to-human disease vectors, etc., but we are mainly focused on animal welfare for this conference.

    4. The core question is deceptively simple: What will cultivated meat cost to produce? If costs fall dramatically, CM could displace a substantial share of conventional meat production and spare billions of animals. If costs remain high, funding CM development may have been a poor use of limited animal welfare resources compared to proven interventions.

      This is a bit too simple -- see other discussion pages. For the 'what to fund' question, we need to consider the marginal benefit of funding on the probability and magnitude of success in fostering CM (sooner) and displacing animal products and animal suffering. This is discussed too much more detail in the specific PQ definitions, motivations and resources.

      But "CM is plausibly able to achieve near price parity" seems highly correlated or causally entangled with "funding CM development (and supporting it politically) is likely to have high AW impact per dollar". IN particular, if it seems practically impossible for CM to ever get close to near parity. Then it seems unlikely that the CM project will be successful and thus a near guarantee that additional funding will have little impact.

      But we should note or at least footnote that that's more of a necessary than a sufficient condition. CM funding could have a low impact/$ for other reasons, e.g., if, on the other hand CM is likely to be successful soon irrespective of this funding.

    1. If the price of high-quality plant-based hamburgers fell by 10% everywhere, how would global chicken consumption change?

      Explain why we targeted this 'cross category' substitution. We understand it's initially counter-intuitive. TLDR: Impossible Beef is a defined category with fairly clear pricing and high quality, but chicken consumption is more animal-welfare-relevant than beef. But we have variants of this that are more within-category. Put the TLDR in a tooltip and a longer explanation in a folding box.

      Some more detailed explanation at https://forum.effectivealtruism.org/s/kazWBBYXm2Rvya3y2/p/3Eh8MbqLwFBsD7GK2#Why_focus_on_chicken_consumption_ and https://forum.effectivealtruism.org/s/kazWBBYXm2Rvya3y2/p/3Eh8MbqLwFBsD7GK2#Why_focus_on_Impossible_Beyond_Beef_

    1. Which Potential Segments Interest You?

      Add some other potential segments, perhaps

      • "business, government, and philanthropic environment and the cost of capital."

      • "How is cultured meat produced -- a cost-focused background overview"

      • "Constructing TEAs, uncertainty modeling, and forecasting" -- hands on modeling (post-workshop hack session, 2-5 hours)

    1. Decision RelevanceUnderstanding the nuances of poverty traps and 'trappedness' can inform development policies and interventions aimed at poverty alleviation. This paper could provide insights into where resources and policy changes would be most effective globally.

      This feels a bit vague to me. Are there specific policies that would be affected?

    1. DRAFT — This survey will be available after the workshop takes place. Questions?

      Make this less prominent -- no 'header' until after the workshop

    1. Can reverse cross-population comparisons.

      remember -- we are not focused on cross-population comparisons for this workshop. It's more about 'which interventions yield greater welfare', which would generally involve differences in difference, ideally across comparable populations (but not always)

    2. δ = discount factor for future years

      Where did the discount and time factor come from? Where did these definitional equations come from? I didn't think most emply estimated WELLBY measures considered multi-year collection or impact. And are they really discounting?

    3. what most intervention comparisons need)

      Cut this. I don't think it necessarily holds -- a lot of interventions impact mortality.

      Add to footnote -- the 'incremental' WELLBYs may be captured by observing differences between comparable treated and untreated populations.

    4. UK Government: Official guidance for policy appraisal

      A link to this would be helpful. The "Green Book". (I wonder -- how impactful has this actually been on British policy?)

    5. Neutral point estimation: What is the actual neutral point on the 0-10 scale for different populations? How stable is it across contexts?

      I suspect we don't have any good measures of this? There's the Peasgood paper but I don't think that was in a LMIC and I'm not sure how much it has been vetted?

    6. Annotate & Comment: Double-click any text to add a Hypothes.is annotation. No account needed to read; quick signup for a free account to post.

      We'd especially like pre-session feedback on

      • Are these ~accurate?
      • Are they useful? At the right level
      • What is redundant?
      • Which issues should we skip (as less important to intervention choices for LMIC, mostly-resolved, or intractable?)
      • What is missing?
      • Is there a better overall structure and framing for these?
      • Where does it go into too much detail? Where is it too opinionated in cases where we should leave things open?
      • Are we failing to attribute any important sources for language, arguments, or claims? *
    7. Predictive validity: SWB predicts consequential outcomes systematically

      This was mentioned above, but does it do so in a scale-sensitive way?

      As I suggested, it's not enough to have it be 'somewhat predictive'

    8. Transformation Sensitivity Demo

      This needs more context and explanation. I've forgotten what g of x is here, and what's the actual calculation? Also, this doesn't seem to be illustrating the point that it means to. As I move the slider, population B always seems to be higher, but also it seems like we're getting away from the discussion of the relative impact of different interventions. We don't want to just simply compare populations. If this does pertain to interventions, explain better.

      Exokain a bit more (as a footnote) what the 'transformation' means here and why/when it's used

    9. Magnitude-sensitive cost-effectiveness: Even if signs are stable, cost-effectiveness ratios rely on magnitudes

      Do they? Magnitudes of what? Explain. Give a 1-2 sentence exampls as a footnote

    10. Incremental WELLBY Estimate

      This is simple and perhaps obvious, but good for illustrating the simple WELLBY linear WELLBY concept, but that's already been explained above. I'm not sure what should maybe be put at the top. I'm not sure if it's useful down here. OK put this at the top, in a folding box -- it just helps to make sure we're all in on the same page about the definition of the WELLBY here.

      Perhaps it would also be helpful to include some sort of adjusted WELLBY calculator interface that's a more sophisticated concept people might not appreciate, particularly embodying the approach in Benjamin and others.

    11. What "non-identified" means A parameter is "identified" when data + assumptions pin down a unique value. Ordinal responses only tell us which interval a latent value falls into. Many different latent distributions and transformations can generate the same observed category counts, so rankings of means can change across equally admissible representations.

      This explanation is not clear. It could be improved, it's a bit too literal. Why do ordinal responses only tell us in which interval a latent value falls into?

      This might also be worth folding

    12. Monotonic transformations can reverse conclusions

      An example here would be very helpful. ... Perhaps even an interactive display.

      Monotonic transformations of what?

    13. Bond and Lang (2019) argue that with ordinal response data, comparing "average happiness" between groups is generally not identified without strong assumptions—monotonic transformations can reverse results.[11]

      This should be fleshed out in more detail and rigor, along with some responses to it, and probably belongs earlier on in the discussion.

      ....

      What do you mean, comparing "average happiness between groups is not identified"? What is the thing that is not identified?

    14. Time structure and discounting Later (t>1)Follow-up (t=1)Baseline (t=0)Later (t>1)Follow-up (t=1)Baseline (t=0)#mermaid-1772847441513{font-family:"trebuchet ms",verdana,arial,sans-serif;font-size:16px;fill:#000000;}#mermaid-1772847441513 .error-icon{fill:#552222;}#mermaid-1772847441513 .error-text{fill:#552222;stroke:#552222;}#mermaid-1772847441513 .edge-thickness-normal{stroke-width:2px;}#mermaid-1772847441513 .edge-thickness-thick{stroke-width:3.5px;}#mermaid-1772847441513 .edge-pattern-solid{stroke-dasharray:0;}#mermaid-1772847441513 .edge-pattern-dashed{stroke-dasharray:3;}#mermaid-1772847441513 .edge-pattern-dotted{stroke-dasharray:2;}#mermaid-1772847441513 .marker{fill:#666;stroke:#666;}#mermaid-1772847441513 .marker.cross{stroke:#666;}#mermaid-1772847441513 svg{font-family:"trebuchet ms",verdana,arial,sans-serif;font-size:16px;}#mermaid-1772847441513 .actor{stroke:hsl(0, 0%, 83%);fill:#eee;}#mermaid-1772847441513 text.actor>tspan{fill:#333;stroke:none;}#mermaid-1772847441513 .actor-line{stroke:#666;}#mermaid-1772847441513 .messageLine0{stroke-width:1.5;stroke-dasharray:none;stroke:#333;}#mermaid-1772847441513 .messageLine1{stroke-width:1.5;stroke-dasharray:2,2;stroke:#333;}#mermaid-1772847441513 #arrowhead path{fill:#333;stroke:#333;}#mermaid-1772847441513 .sequenceNumber{fill:white;}#mermaid-1772847441513 #sequencenumber{fill:#333;}#mermaid-1772847441513 #crosshead path{fill:#333;stroke:#333;}#mermaid-1772847441513 .messageText{fill:#333;stroke:none;}#mermaid-1772847441513 .labelBox{stroke:hsl(0, 0%, 83%);fill:#eee;}#mermaid-1772847441513 .labelText,#mermaid-1772847441513 .labelText>tspan{fill:#333;stroke:none;}#mermaid-1772847441513 .loopText,#mermaid-1772847441513 .loopText>tspan{fill:#333;stroke:none;}#mermaid-1772847441513 .loopLine{stroke-width:2px;stroke-dasharray:2,2;stroke:hsl(0, 0%, 83%);fill:hsl(0, 0%, 83%);}#mermaid-1772847441513 .note{stroke:#999;fill:#666;}#mermaid-1772847441513 .noteText,#mermaid-1772847441513 .noteText>tspan{fill:#fff;stroke:none;}#mermaid-1772847441513 .activation0{fill:#f4f4f4;stroke:#666;}#mermaid-1772847441513 .activation1{fill:#f4f4f4;stroke:#666;}#mermaid-1772847441513 .activation2{fill:#f4f4f4;stroke:#666;}#mermaid-1772847441513 .actorPopupMenu{position:absolute;}#mermaid-1772847441513 .actorPopupMenuPanel{position:absolute;fill:#eee;box-shadow:0px 8px 16px 0px rgba(0,0,0,0.2);filter:drop-shadow(3px 5px 2px rgb(0 0 0 / 0.4));}#mermaid-1772847441513 .actor-man line{stroke:hsl(0, 0%, 83%);fill:#eee;}#mermaid-1772847441513 .actor-man circle,#mermaid-1772847441513 line{stroke:hsl(0, 0%, 83%);fill:#eee;stroke-width:2px;}#mermaid-1772847441513 :root{--mermaid-font-family:"trebuchet ms",verdana,arial,sans-serif;}Persistence, decay, response shift?

      This diagram is not fully explained. I don't see how it relates to the rest of the content either.

    15. #mermaid-1772847441491{font-family:"trebuchet ms",verdana,arial,sans-serif;font-size:16px;fill:#000000;}#mermaid-1772847441491 .error-icon{fill:#552222;}#mermaid-1772847441491 .error-text{fill:#552222;stroke:#552222;}#mermaid-1772847441491 .edge-thickness-normal{stroke-width:2px;}#mermaid-1772847441491 .edge-thickness-thick{stroke-width:3.5px;}#mermaid-1772847441491 .edge-pattern-solid{stroke-dasharray:0;}#mermaid-1772847441491 .edge-pattern-dashed{stroke-dasharray:3;}#mermaid-1772847441491 .edge-pattern-dotted{stroke-dasharray:2;}#mermaid-1772847441491 .marker{fill:#666;stroke:#666;}#mermaid-1772847441491 .marker.cross{stroke:#666;}#mermaid-1772847441491 svg{font-family:"trebuchet ms",verdana,arial,sans-serif;font-size:16px;}#mermaid-1772847441491 .label{font-family:"trebuchet ms",verdana,arial,sans-serif;color:#000000;}#mermaid-1772847441491 .cluster-label text{fill:#333;}#mermaid-1772847441491 .cluster-label span,#mermaid-1772847441491 p{color:#333;}#mermaid-1772847441491 .label text,#mermaid-1772847441491 span,#mermaid-1772847441491 p{fill:#000000;color:#000000;}#mermaid-1772847441491 .node rect,#mermaid-1772847441491 .node circle,#mermaid-1772847441491 .node ellipse,#mermaid-1772847441491 .node polygon,#mermaid-1772847441491 .node path{fill:#eee;stroke:#999;stroke-width:1px;}#mermaid-1772847441491 .flowchart-label text{text-anchor:middle;}#mermaid-1772847441491 .node .katex path{fill:#000;stroke:#000;stroke-width:1px;}#mermaid-1772847441491 .node .label{text-align:center;}#mermaid-1772847441491 .node.clickable{cursor:pointer;}#mermaid-1772847441491 .arrowheadPath{fill:#333333;}#mermaid-1772847441491 .edgePath .path{stroke:#666;stroke-width:2.0px;}#mermaid-1772847441491 .flowchart-link{stroke:#666;fill:none;}#mermaid-1772847441491 .edgeLabel{background-color:white;text-align:center;}#mermaid-1772847441491 .edgeLabel rect{opacity:0.5;background-color:white;fill:white;}#mermaid-1772847441491 .labelBkg{background-color:rgba(255, 255, 255, 0.5);}#mermaid-1772847441491 .cluster rect{fill:hsl(0, 0%, 98.9215686275%);stroke:#707070;stroke-width:1px;}#mermaid-1772847441491 .cluster text{fill:#333;}#mermaid-1772847441491 .cluster span,#mermaid-1772847441491 p{color:#333;}#mermaid-1772847441491 div.mermaidTooltip{position:absolute;text-align:center;max-width:200px;padding:2px;font-family:"trebuchet ms",verdana,arial,sans-serif;font-size:12px;background:hsl(-160, 0%, 93.3333333333%);border:1px solid #707070;border-radius:2px;pointer-events:none;z-index:100;}#mermaid-1772847441491 .flowchartTitleText{text-anchor:middle;font-size:18px;fill:#000000;}#mermaid-1772847441491 :root{--mermaid-font-family:"trebuchet ms",verdana,arial,sans-serif;}InterventionStudy designMeasured outcomesLS / DALY / depressionTranslation layermapping, calibrationCommon currencyWELLBY / DALY / $Decision

      This flow chart is too small and it's underexplained. I don't understand what each of these is meant to mean and how they fit together.

    1. We may quote specific responses with attribution unless you request otherwise. If you prefer your responses remain anonymous,

      Adjust this -- "If you prefer your response to remain anonymous, please use a pseudonym and try to use the same one consistently if you're providing multiple responses." If you are fine with internal recognition but don't want any public attribution, please let us know and share any other concerns in the field at the bottom.

    2. How likely is it that the simple WELLBY measure (as defined above) is the best or near-best measure—yielding no less than 80% of the value of the best measure—for cross-intervention comparison in the focal context? (State your best calibrated probability.)

      I'm considering adjusting this one to

      Consider the 'value obtained when using the best feasible measure for cross intervention comparison in contexts like the focal context'. What share of this value is obtained, in expectation, from using the simple linear WELLBY measure for all interventions? Please give your central belief, and 90% credible intervals"

      -- with a slider that goes from zero to one, and two other sliders that allow that allow you to specify the lower and upper bound of the 90% CIs.

    1. emonstrates that small transformations can reverse published findings.

      NotebookLM:

      "they applied their methodology to nine prominent results from the happiness literature—including the Easterlin Paradox, the U-shape of happiness in age, the ranking of countries by happiness, and the effects of marriage and children—and showed that the standard conclusions in all nine areas could be reversed using monotonic (specifically lognormal) scale transformations. They argued that these reversing transformations were "plausible," claiming they were no more skewed than the U.S. wealth distribution

      However, later work questions the plausibility of this. .

    1. Note: human means carry their own variance; correlations here are bounded by human inter-rater noise.

      is this ggplotly? Shouldn't it be dynamic? I don't seem to be able to adjust it

    1. Alberto Prati may contribute via pre-recorded video.

      Not 'video', possibly some written content, or we can extract issues from his evaluation to ask Benjamin et al.

    1. leads to least regret?

      The "least regret" is a formal term in information theory, I believe, or from Bayesian updating. Provide a footnote defining and referencing it. #Implement

    2. Annotate & Comment:

      We'd especially like pre-session feedback on

      • Are these ~accurate?
      • Are they useful? At the right level
      • What is redundant?
      • Which issues should we skip (as less important to intervention choices for LMIC, mostly-resolved, or intractable?)
      • What is missing?
      • Is there a better overall structure and framing for these?
      • Where does it go into too much detail? Where is it too opinionated in cases where we should leave things open?
      • Are we failing to attribute any important sources for language, arguments, or claims? *
    1. Most studies measure outcomes at baseline and one or two follow-ups;

      Give a footnote with some examples here. What do the studies involving LMIC interventions do?

    2. The measurement-to-decision pipeline #mermaid-1772846605552{font-family:"trebuchet ms",verdana,arial,sans-serif;font-size:16px;fill:#000000;}#mermaid-1772846605552 .error-icon{fill:#552222;}#mermaid-1772846605552 .error-text{fill:#552222;stroke:#552222;}#mermaid-1772846605552 .edge-thickness-normal{stroke-width:2px;}#mermaid-1772846605552 .edge-thickness-thick{stroke-width:3.5px;}#mermaid-1772846605552 .edge-pattern-solid{stroke-dasharray:0;}#mermaid-1772846605552 .edge-pattern-dashed{stroke-dasharray:3;}#mermaid-1772846605552 .edge-pattern-dotted{stroke-dasharray:2;}#mermaid-1772846605552 .marker{fill:#666;stroke:#666;}#mermaid-1772846605552 .marker.cross{stroke:#666;}#mermaid-1772846605552 svg{font-family:"trebuchet ms",verdana,arial,sans-serif;font-size:16px;}#mermaid-1772846605552 .label{font-family:"trebuchet ms",verdana,arial,sans-serif;color:#000000;}#mermaid-1772846605552 .cluster-label text{fill:#333;}#mermaid-1772846605552 .cluster-label span,#mermaid-1772846605552 p{color:#333;}#mermaid-1772846605552 .label text,#mermaid-1772846605552 span,#mermaid-1772846605552 p{fill:#000000;color:#000000;}#mermaid-1772846605552 .node rect,#mermaid-1772846605552 .node circle,#mermaid-1772846605552 .node ellipse,#mermaid-1772846605552 .node polygon,#mermaid-1772846605552 .node path{fill:#eee;stroke:#999;stroke-width:1px;}#mermaid-1772846605552 .flowchart-label text{text-anchor:middle;}#mermaid-1772846605552 .node .katex path{fill:#000;stroke:#000;stroke-width:1px;}#mermaid-1772846605552 .node .label{text-align:center;}#mermaid-1772846605552 .node.clickable{cursor:pointer;}#mermaid-1772846605552 .arrowheadPath{fill:#333333;}#mermaid-1772846605552 .edgePath .path{stroke:#666;stroke-width:2.0px;}#mermaid-1772846605552 .flowchart-link{stroke:#666;fill:none;}#mermaid-1772846605552 .edgeLabel{background-color:white;text-align:center;}#mermaid-1772846605552 .edgeLabel rect{opacity:0.5;background-color:white;fill:white;}#mermaid-1772846605552 .labelBkg{background-color:rgba(255, 255, 255, 0.5);}#mermaid-1772846605552 .cluster rect{fill:hsl(0, 0%, 98.9215686275%);stroke:#707070;stroke-width:1px;}#mermaid-1772846605552 .cluster text{fill:#333;}#mermaid-1772846605552 .cluster span,#mermaid-1772846605552 p{color:#333;}#mermaid-1772846605552 div.mermaidTooltip{position:absolute;text-align:center;max-width:200px;padding:2px;font-family:"trebuchet ms",verdana,arial,sans-serif;font-size:12px;background:hsl(-160, 0%, 93.3333333333%);border:1px solid #707070;border-radius:2px;pointer-events:none;z-index:100;}#mermaid-1772846605552 .flowchartTitleText{text-anchor:middle;font-size:18px;fill:#000000;}#mermaid-1772846605552 :root{--mermaid-font-family:"trebuchet ms",verdana,arial,sans-serif;}

      the diagram is too small, and was never explained!

    3. Some influential critiques argue that different monotone transformations can reverse conclusions about "average happiness"

      'influential' -- that's subjective. ///Link to an example

    4. Is "incremental WELLBY" standard terminology? Some literatures talk about WELLBYs as point-years of life satisfaction (UK guidance) and many evaluation contexts are inherently incremental. But "incremental WELLBY" itself is not uniformly a standard term. In this page, we use it as a descriptive label for counterfactual impact calculation, not as established jargon.

      too inside-info for a whole box. -- make this a footnote at most

    5. WELLBY (unit of account): UK Green Book guidance defines a WELLBY as a one-point change in life satisfaction on a 0-10 scale, per person per year.[3]HM Treasury (2021/2024). Wellbeing Guidance for Appraisal: Supplementary Green Book Guidance.

      Missing the standard framing of the LS question here