The most popular condition had all three features enabled, i.e., 11 out of 24 participants (≈ 50%) preferred Figure 7C, as shown in the “Preferred” columns of Table 1. The remaining participants were roughly evenly split between the no-features baseline (6 par-ticipants) and the without-alignment ablation condition (5 partic-ipants). One participant each liked the without-highlighting and without-ordering ablation conditions most, respectively.
sentence relating to testing
The specific research questions for this study were: (1) How do highlighting, alignment, and ordering affect reading patterns, user experience, and cognitive load? (2) How do participants’ valuation of these features relate to their Need for Cognition? (3) Does each feature provide value on its own, or only in conjunction with one or more of the other two features?
sentence relating to testing
In this study, we allowed participants to experience views of same-aspect sentences (Section 4.1.1) with different combinations of high-lighting, ordering, and alignment (as described in Section 4.1.2 and Section 4.1.4) enabled or not, in order to understand which and/or what combinations most effectively supported users’ ability to skim and read laterally across documents.
sentence relating to testing
Three studies inform and validate ABSTRACT EXPLORER's design: First, a formative study (Section 3) suggested unmet needs and interest in our approach to supporting cross-document reasoning. Second, an ablation study with eye-tracking (Section 5) revealed that the three key features of ABSTRACTEXPLORER's central cross- sentence relationships pane-sentence order, role-coordinated high- lighting, and alignment-work best in concert, not alone. Finally, a summative study (Section 6) describes how researchers used AB- STRACTEXPLORER to familiarize themselves with a corpus of ~1000 CHI paper abstracts—reading across a larger and more diverse col-lection of abstracts and more easily discerning relationships and distributions across prior work.
sentence relating to testing
A summative study (N=16) describes how these features support users in familiarizing themselves with a corpus of paper abstracts from a single large conference with over 1000 papers.
sentence relating to testing
An ablation study (N=24) validated that these features work best together.
sentence relating to testing
an ablation study with eye-tracking (Section 5) revealed that the three key features of ABSTRACTEXPLORER's central cross- sentence relationships pane-sentence order, role-coordinated high- lighting, and alignment-work best in concert, not alone.
any sentence about eye-tracking, eye-trackers, etc.
an ablation study with eye-tracking (Section 5) revealed that the three key features of ABSTRACTEXPLORER's central cross-sentence relationships pane-sentence order, role-coordinated highlighting, and alignment-work best in concert, not alone.
sentence about eye-tracking
an ablation study with eye-tracking (Section 5) revealed that the three key features of ABSTRACTEXPLORER's central cross- sentence relationships pane-sentence order, role-coordinated high- lighting, and alignment-work best in concert, not alone.
sentence about eye-tracking
AbstractExplorer used variation affordances present in prior systems, e.g., color-coordinated highlighting of analogous text in Gero et al. [18], and introduced new ones, such as alignment of sentences based on analogous chunks within them, which had only been hypothesized in prior work.
sentence related to Structural Mapping Theory (SMT)
Structural Mapping Theory (SMT) is a long-standing well-vetted theory from Cognitive Science that describes how humans attend to and try to compare objects by finding mental representations of them that can be structurally mapped to each other (analogies).
sentence related to Structural Mapping Theory (SMT)
AbstractExplorer instantiates new minimally lossy SMT-informed techniques for skimming, reading, and reasoning about a corpus of similarly structured short documents.
sentence related to Structural Mapping Theory (SMT)
Lossless SMT-informed techniques have yet to be brought to bear in the context of researchers familiarizing themselves with a corpus of existing literature.
sentence related to Structural Mapping Theory (SMT)
This SMT-informed approach, which AbstractExplorer shares, tries to give this mental machinery “a leg up,” letting users perhaps skip some steps by accepting reified cross-document relationships identified by the computer.
sentence related to Structural Mapping Theory (SMT)
for - AI - Bayesian teaching paper - Google
for - AI - biological neural networks - AI - mortal computing
Ai and taxation
However, in a narrow set of cases, we believe AI can undermine, rather than defend, democratic values. Some uses are also simply outside the bounds of what today’s technology can safely and reliably do. Two such use cases have never been included in our contracts with the Department of War, and we believe they should not be included now:
Humans as API, bc [[Alles is een API 20260309095254]]
(via [[Stephen Downes p]]
the 'am dash', as opposed to the em dash. A human only glyph that AI 'can't use'
I tnink there I am dash
The real annoying thing about Opus 4.6/Codex 5.3 is that it’s impossible to publicly say “Opus 4.5 (and the models that came after it) are an order of magnitude better than coding LLMs released just months before it” without sounding like an AI hype booster clickbaiting, but it’s the counterintuitive truth to my personal frustration
A generative AI like ChatGPTData Analyst can take on the role of the evaluation soft-ware. It is expected that this manner of use will make thestudents' work easier, as less emphasis needs to be placedon the programming itself. Instead, teachers can incorpo-rate exercises that encourage students to code more effi-ciently and accurately with the assistance of AI. Thisshifts the focus from finding the right command or func-tion to examining and understanding the data moreclosely. As a consequence, students are better enabled tointerpret the results of statistical evaluation software cor-rectly, thus fulfilling goal 8 of the GAISE report.
rhetoric: Schwarz uses a statement of transition to contrast the old education model (rote memorization of commands) with a new required model (critical examination).
inference: This supports the argument that education and labor must start to pivot away from the "Generalist" process-oriented tasks. If the machine assistants handle the 'How' (the commands and functions), then the human must focus more on the 'Why' and the 'what does it mean (understanding/wisdom)'. This helps to validate the work of the assistants and helps to make it useful and valuable in the real world.
statistical knowledge is still required in order toformulate the correct prompts and to ensure that the AIdoes not leave out any step of the analysis.
rhetoric: author presents a prescriptive claim that AI needs humans with competent knowledge (in this case, statistics) to create prompts and ensure that the AI does not leave out any steps of the analysis. He positions domain knowledge not as a tool for using AI for statistical analysis, but a prerequisite for management of the AI and auditing the output.
inference: In addition to policing and correcting the AI outputs, the deep domain knowledge is what allows the AI to do complex data analysis without mistakes, hallucinated results, or mathematically false outcomes. This is basically the job description of a human with "Augmented Human Wisdom". The human's value is no longer in doing math, but in possessing the vertical expertise (flesh/wisdom) to know exact what math needs to be done and ultimately auditing the assistant machine's work.
ChatGPT Data Analyst clearly produced a false resulthere, precisely because the application assumptions for theANOVA were not checked.
rhetoric: Schwarz employs cause-and-effect reasoning here based on empirical testing. He links a specific technical failure (not checking assumptions) to a definitive unwanted outcome (a false result).
inference: the "Data Analyst" function of ChatGPT hallucinated a result during the use of it's core function! This is the best evidence so far of the 'Crisis of Truth' and the dangers of the 'Headless Automatons' in my essay. If a generalist with no deep knowledge uses AI, they are at great risk of blindly accepting mathematically false conclusions. Synthetic syntax without competent human validation is a liability.
The results show that generative AI canfacilitate data analysis for individuals with minimal knowledge of statistics,mainly by generating appropriate code, but only partly by following standardprocedures.
rhetoric: author uses comparative, objective statement (logos) to establish the main boundary of the technology's capability/capacity -- it excels at technical generation (things like coding) but fails at standard procedures (methodological adherence to SOPs).
inference: the proves the 'Raising the Floor' concept. AI completely automates the entry-level syntax (the "Word"), meaning that the Generalist coder is obsolete! However, because it fails at standard procedures, it requires a human architect to guide it to outputs that are valuable in the real world.
PWA have language deficits that require bespoke AAC supports. These supports may beenhanced by LLMs in software systems that use spoken user input to provide relevantsuggestions that have grammatical and speech production support.
rhetoric: concluding statement. this positions the LLM as an 'enhancement' to physical human limitation, rather than a replacement of the human subject.
inference: This helps to validate the 'Augmented Human Wisdom' model. The future of AI is NOT replacing humans, but AI acting as a high-powered syntax engine that is strictly guided by human needs and human intent. The AI does not have 'agency', as it is a software tool that helps the human to execute their visions.
Perseverations that are input into the system are essentially mag-nified by the system’s suggested sentences,
rhetoric: authors explain an unintended consequence of using the AI tool: it scales the errors or the emptiness of the human prompt.
inference: this is an excellent metaphor for the 'manager fallacy'. If the human user in incompetent (or provides empty or incomplete input), the AI does not magically create wisdom -- it just amplifies the user's incompetence in a a highly articulate synthetic thought.
Participant 2 stated the age of her daughters (“Name1 is 18, Name2 is21”), Aphasia-GPT transformed it as “Name1 is 18 and 21”, which is an impossible, butrelated, hallucination
rhetoric: researchers use a specific, clinical observation of an error to demonstrate the model's inability to comprehend logical reality despite the human relaying a perfectly structured sentence.
inference: this shows that AI is amoral and lacks the lived experience necessary to make logical judgments that work in the real world. It can format a sentence beautifully, but it does not/will not always understand that a single human cannot be two ages at once. This is why it is very important/necessary for the "flesh" to text the output against reality
Aphasia-GPT is a real-time, AI-enabled web app designed to expand the words providedby a user into complete sentences as suggestions for a user to select.
rhetoric: authors provide a definition of their creation (Aphasia-GPT) to describe it's mechanism: taking a fragmented input and expanding it into a fully structured, complete output.
inference: this is the embodiment of Harari's primary metanym of the word v flesh (syntax v human). in this example, Aphasia-GPT provides the words (syntax) to the fleshy human that struggles with those words, while also relying on the human to spark the intent of the communication. The human is using AI to communicate with words, because the words are very difficult for the human.
nearly half of the workers who received sloppy AI-generated material from coworkers saw those coworkers as less creative, capable and reliable, while smaller amounts saw them as less trustworthy and intelligent.
AI Slop generated by your own hands changes he way people view you at work!
The cost of the time that it takes fix "workslop" could add up too, with a $186 monthly cost per employee on average, according to a survey of desk workers by BetterUp in partnership with the Stanford Social Media Lab. Forty percent of the workers surveyed said they received "workslop" in the last month and that it took an average of two hours to resolve each incident.
$186/per employee/per month!
10 employees = ($22,320) 25 employees = ($55,800) 50 employees = ($111,600) 100 employees = ($223,200) 250 employees = ($558,000) 500 employees = ($1,116,000) 1000 employees = ($2,232,000)
“Younger workers aren’t necessarily more careless, but they’re often using AI more frequently and earlier in their workflows," Dennison said. "There is also a training gap. Organizations often assume younger employees intuitively understand AI, yet provide little guidance on verification, risk, or appropriate use cases. As a result, AI may be treated as an answer engine rather than a support tool."
this is another great quote, which helps to establish how orgs treat younger generations, and how they tend to overtrust their understanding of AI.
About 70% of managers say their direct reports have made AI-related mistakes in the past year
Good stat from a survey of 1100 managers at resume.com. 70% of managers say that their employees have submitted AI generated errors inside their work in the last year.
58% said direct reports submitted work that contained factual inaccuracies generated by AI tools, while fewer reported that AI failed to account for critical contextual factors. Other issues cited include low-quality content, poor recommendations and inappropriate messaging.
from reporting managers, 58% of them said that employees were submitting work that contained factual inaccuracies in the work that was generated by AI, and that fewer of them reported that AI failed to account for "critical contextual factors", implying that the writing was generic and not directly applicable to the context that the writing was written in. Other issues were: low quality content, poor recommendations and inappropriate messaging.
59% of managers saying that they had to invest additional time to correct or redo work created by AI. Similarly, 53% said their direct reports had to take on extra work, while 45% said they had to bring in co-workers to help fix the mistake.
Extra time and money spent to repair errors made by AI but not caught by the human in the middle. 59% is almost 2/3 (closer to 3/5) needed to correct or redo the work created by AI without a human auditing it. 53% claim extra work is needed to repair the AI mistakes, and 45% also needed to bring in a (perhaps more senior) co-worker to help fix the mistake. I can imagine workers needing to work on a mistake the hits production code, and all of the thousands (or more) mistakes that would need to be later repaired and rolled back. very expensive and costly.
they damaged client relationships.
missed deadlines are tough, but damaging client relationships is a sin!
While 18% of managers said they did not suffer any financial losses from the mistakes, and 20% said those losses were less than $1,000, a significant number reported bigger losses. Twelve percent said those losses were more than $25,000, while 11% said between $10,000 and $24,999. Another 27% placed the value of those losses above $1,000 but below $10,000.
great stats for the cost of using AI without human auditing.
34% said Gen Z followed by 26% who blamed millennials, with 18% citing Gen X and just 9% saying it was baby boomers.
while this affect all generations, this is clearly a young people problem! This problem is here to stay
“AI is reliable when used as an assistant, not a decision-maker," Dennison said. "Without human judgment and clear processes, speed becomes a risk, and efficiency gains can turn into costly mistakes,”
great quote. directly mentions my concept of requiring human judgement, and how not having a human in the loop can make work move faster, but can also lead to very costly mistakes.
“Employees treat AI outputs as finished work rather than as a starting point. Current AI tools are very good at generating fluent content, but they don’t understand context, business nuance, risk, or consequences. That gap shows up in factual errors, missing constraints, poor judgment calls, and tone misalignment.”
another great quote -- ties into the abdicating human agency to a robot, and the full quote even illustrates the dangers of doing so.
AI fatigue is real and nobody talks about it
[[AI Contintent Action Plan]]
[[The Means of Production by Maximilian Kasy]] overview in slides by author https://maxkasy.github.io/home/files/slides/meansofprediction_slides_long.pdf
On ai, productivity and shorter work weeks and why that will not happen
The scenarios Wooldridge imagines include a deadly software update for self-driving cars, an AI-powered hack that grounds global airlines, or a Barings bank-style collapse of a major company, triggered by AI doing something stupid. “These are very, very plausible scenarios,” he said. “There are all sorts of ways AI could very publicly go wrong.”
Scenario's for a Hindenburg style event: - deadly software update for self driving cars - AI-powered hacking ground global airlines (not sure, if that is clear enough to people, unlike the self driving cars running amok) - Barings-style collapse of a major company triggered by AI (if it's a tech company, it may be less shock, more ridicule, but still)
“It’s the classic technology scenario,” he said. “You’ve got a technology that’s very, very promising, but not as rigorously tested as you would like it to be, and the commercial pressure behind it is unbearable.”
true for AI, but wasn't the case for Hindenburg I'd say.
The race to get artificial intelligence to market has raised the risk of a Hindenburg-style disaster that shatters global confidence in the technology, a leading researcher has warned.Michael Wooldridge, a professor of AI at Oxford University, said the danger arose from the immense commercial pressures that technology firms were under to release new AI tools, with companies desperate to win customers before the products’ capabilities and potential flaws are fully understood.
prediction Michael Wooldridge (Oxford, AI), sees a risk at an 'Hindenburg' event. Shattering the global confidence in AI tech. I"m not sure this analogy entirely fits other than in its potential impact (AI isn't globally trusted, the Hindenburg did not fail bc of the tech itself but bc helium not being allowed to export from the US at the time. Still the Hindenburg did put an end to the entire zeppelin industry yes. No matter the causes.)
OpenClaw, like many other open-source tools, allows users to connect to different AI models via an application programming interface, or API. Within days of OpenClaw’s release, the team revealed that Kimi’s K2.5 had surpassed Claude Opus and became the most used AI model—by token count, meaning it was handling more total text processed across user prompts and model responses.
Wow, I had no idea that Kimi 2.5 had subbed in for Claude Opus so quickly.
OECD catalogue of AI tools en metrics for trustworthy AI.
Low-cost Chinese AI models forge ahead, even in the US, raising the risks of a US AI bubble Nvidia’s latest earnings report reassured some. But Chinese AI models are fast gaining a following around the world, underlining concerns over an ‘AI bubble’ centered on high-investment, high-cost US models.
One of the largest PC suppliers, Dell, was reported to be planning a price hike that could raise hardware costs by hundreds of dollars. Interestingly, for consumers opting for higher memory configurations, this would now require a significant price increase. Here were the price increases that were reported across a variety of products: $130–$230 increase for Dell Pro and Pro Max notebooks and desktops configured with 32 GB of memory $520–$765 increase for systems configured with 128 GB of memory $55–$135 increase for configurations with a 1 TB SSD $66 increase for AI laptops equipped with an NVIDIA RTX PRO 500 Blackwell GPU (6 GB) $530 increase for AI laptops equipped with an NVIDIA RTX PRO 500 Blackwell GPU (24 GB) Similarly, companies like ASUS and Acer were also reported to be bumping up PC pricing to cope with memory shortages, and according to Acer's Chairman, Jason Chen, the BoM (Bill of Materials) for several products within Acer's portfolio has risen dramatically, leaving no choice but to increase prices to ensure consistent supply. Small-scale manufacturers like Framework are also looking to increase the cost of upgrading RAM on existing configurations, indicating a widespread "price hike" wave approaching gamers.
price hikes of DRAM, due to pc laptop manufacturers having trouble in getting enough RAM. Shortages to keep going for 2026, after 2025. AI supply chain gobbling up the rest.
https://web.archive.org/web/20260216112337/https://wccftech.com/western-digital-has-no-more-hdd-capacity-left-out/ Western Digital says consumer sales of HDDs is now just 5% of their sales, everything else going to AI companies. 2026 WD is already sold out. For 2027 and 2028 there is already a few deals in place too.
the humans involved may have simply lost the plot and may not understand what the program is supposed to do, how their intentions were implemented, or how to possibly change it.
key imo. generating code / material, can quickly mean loss of overview (I see how that happens in my use of #algogens if I don't explicitly counteract it), uncertainty about how demands were implemented, and thus what entry points for change there are.
AI infrastructure developers cannot wait five years. In many cases, they cannot wait six months, because waiting six months costs billions of dollars of lost opportunities.
The quick very rough mental maths on a GW of capacity being worth 10billion USD converts to between 1000-1500 USD per megawatt hour of money they think they could be making if they could sell the compute it powered
https://web.archive.org/web/20260215105347/https://simonwillison.net/2026/Feb/15/cognitive-debt/
Simon Willison on cognitive debt (the consequences of vibecoding more or less).
A description of the type of things Activate does w AI agents. Ref'd in [[Paolo’s Weblog It’s still time for free AI love]]
we might move again. The point is that we can. We can because we own our prompts, our skills, our databases, our memory architecture, they all live in our bar. None of it lives inside OpenAI or Anthropic. When we moved, we rewired the model layer and everything else stayed put. That’s the whole trick, really. If you control the pieces that make your agents smart, switching the engine underneath is just plumbing.
Description of how Activate keep their prompts, skills, databases, memory architecture under their own control and within their own environment.
Moving means wiring up another model or models, but the rest is kept as is.
[[Paolo Valdemarin p]] on avoiding lock-in in a single specific AI silo. Bc what is state of the art will shift every few months.
What if I actually did have dirt on me that an AI could leverage? What could it make me do? How many people have open social media accounts, reused usernames, and no idea that AI could connect those dots to find out things no one knows?
AI agents as kompromat collectors
AI Doesn’t Reduce Work—It Intensifies It
I’m going to cure my girlfriend’s brain tumor.
Articles and books by [[Paul Nemitz c]] (als co-authoring w [[Matthias Pfeffer p]]
this reminds me of installation art that is just a prescription / recipe of how to recreate it.
Owning a $5M data center
I miss thinking hard.
AI voor woningbouw
hopelijk niet genAI
Sovereign Minds Leadership and Work in the AI Era Structure, Agency, and Judgment Under Acceleration
[[Sovereign Minds by Nadia Alter]] looks very worthwhile to get. mentions agency in the subtitle.
(via [[Alberto Cottica p]] on masto)
on responsibility, decision making and authority in organisations getting amorph, even before AI. Vgl [[Corporations as Slow AI 20180201210258]]
via [[Alberto Cottica p]] on Masto
The pipeline runs from women as the original “computers” in the 1940s, through the masculinization of computing that pushed women into typing pools and administrative support, through the automation of those roles, to AI assistants today automating what remains: scheduling, reminding, organizing, emotional management.
There is a line from computers in the original sense, to typing pools, admin support, to automation to AI.
“Obedient and obliging machines that pretend to be women are entering our homes, cars and offices,” warned UNESCO’s Director for Gender Equality, Saniye Gülser Corat, in the agency’s landmark 2019 report.
Unesco report, Saniye Gülser Corat (dir for gender equality).
Standard Retrieval-Augmented Generation (RAG) over documents is a good first step, but it fails when faced with complex, cross-domain enterprise questions. It finds text that looks similar, which isn’t the same as finding facts that are related.
criticism of retrieval augmented generatio (RAG): fails in cross domain settings, finds similar text not relations between facts or meaning
openclaw 'ai personal assistant' that you can interact w through your regular chat apps it says
the skill.md for Moltbook.
'a social network for AI agents' wut?
for - essay Claude CEO - risks of AI
steer AI models, and to shaping the character and constitution of these models
for - AI constitution - Deep Humanity?
I do see a path to a slight moderation in AI development that is compatible with a realist view of geopolitics
for - Deep Humanity - AI crisis - spiritual singularity
By the nature of unknown unknowns it is impossible to make an exhaustive list,
for - Johari Window - unknown unknown - AI
AI companies, semiconductor companies, and perhaps downstream application companies generating ~$3T in revenue per year,
for - progress trap - AI - inequality
we cannot ignore the potential for abuse of these technologies by democratic governments themselves.
for - progress trap - AI - democracies becoming autocracies - Hitler - Trump
brainwashing
for - progress trap - AI - propaganda - brainwashing
a true panopticon on a scale that we don’t see today
for - progress trap - AI - Panopticon - Orwellian
Putting these two concerns together leads to the alarming possibility of a global totalitarian dictatorship. Obviously, it should be one of our highest priorities to prevent this outcome.
for - progress trap - AI - arms race amongst dictators! - Trump - Putin - Kim Jong Un
authoritarian governments might use powerful AI to surveil or repress their citizens in ways that would be extremely difficult to reform or overthrow.
for - progress trap - AI - misuse of power - Palantir?
has a small number of specific hard-line prohibitions, and one of them relates to helping with the production of biological (or chemical, or nuclear, or radiological) weapons. But all models can be jailbroken
for - Claude AI - prohibition against developing weapons - can be jailbroken
a genius in everyone’s pocket could remove that barrier, essentially making everyone a PhD virologist who can be walked through the process of designing, synthesizing, and releasing a biological weapon
for - progress trap - AI - technology as an amplifier - technology acts as an amplifier, allowing humans to fly, to move at speeds faster than any known animal, to lift things no living creature can, etc - The danger is ignorance and polarized views combined with extreme self-rightiousness
I believe the only solution is legislation—laws that directly affect the behavior of AI companies,
for - progress trap - AI - legislation required - tell it to Trump!
not all AI companies do this, and the worst ones can still be a danger to everyone even if the best ones have excellent practices.
for - progress trap - AI - rogue AI vendors - like Grok
a clockwork watch may be ticking normally, such that it’s very hard to tell that it is likely to break down next month, but opening up the watch and looking inside can reveal mechanical weaknesses that allow you to figure it out.
for - AI - progress trap - interpretability testing - deception - Is it possible that AI could even change their node behavior as a deceptive move?
similar to how neuroscientists study animal brains by correlating measurement and intervention to external stimuli and behavior
for - AI - testing - interpretability - neuroscience techniques
AI models are grown rather than built
for - AI - training - grown, not built
almost always follows this constitution
for - progress trap - AI - hackers - hack the AI constitution
Constitutional AI,
for - definition - constitutional AI
The concern is that there is some risk (far from a certainty, but some risk) that AI becomes a much more powerful version of such a person, due to getting something wrong about its very complex training process.
for - progress trap - AI - metaphor - psychopath with a nuclear bomb
AI models could develop personalities during training that are (or if they occurred in humans would be described as) psychotic, paranoid, violent, or unstable, and act out, which for very powerful or capable systems could involve exterminating humanity.
for - progress trap - AI - abstraction - progress trap - AI with feelings & AI without feelings - no win? - One major and obvious aspect of current AI LLMs is that they are not only artificial in their intelligence, but also artificial in their lack of real world experiences. They are not embodied (and it would likely be a highly dubious ethical justification for their embodiment as in AI - powered robots) - Once we have the first known AI robot killing a human, it will be an indicator we have crossed the Rubicon - AI LLMs have ZERO realworld experience AND they are trained as artificial COGNITIE intelligence, not artificial EMOTIONAL intelligence - Without having the morals and social norms a human being is brought up with, it can become psychotic because they don't intrinsically value life - To attempt to program them with morals is equally dangerous because of moral relativity. A Christian nationalist's morality might be that anyone who is associated with abortions don't have a right to live and should be killed - an eye for an eye. Or a jihadist and muslim extremist with ISIS might feel all westerners do not have a right to exist because they don't follow Allah. - Do we really want moral programmability? - When we have a psychotic person armed with a lethal weapon, that is a dangerous situation. If we have a nation of super geniuses who go rogue, that is danger multiplied many orders of magnitude.
For example, AI models are trained on vast amounts of literature that include many science-fiction stories involving AIs rebelling against humanity.
for - AI - progress trap - training - movies like Terminator - This is a case of reality imitating movies - Another example - humans mismanagement of the biosphere and elite abuse and intransigency
we know that AI models are unpredictable and develop a wide range of undesired or strange behaviors, for a wide variety of reasons. Some fraction of those behaviors will have a coherent, focused, and persistent quality
for - AI - progress trap - developing harmful traits
We now know that it’s a process where many things can go wrong.
for - AI - progress trap - AI won't always listen to humans - probably due to unintentional design
What should you be worried about? I would worry about the following things:
for - progress trap - AI - 5 risks - autonomy - misuse for destruction - misuse for seizing power - economic disruption - indirect effects
What if the country was in fact built and controlled by an existing powerful actor
for - AI progress trap - Trump
Could existing rogue actors who want to cause destruction (such as terrorists) use or manipulate some of the people in the new country to make themselves much more effective, greatly amplifying the scale of destruction?
for - AI progress trap - ie. Trump family investing heavily in AI
While in Machines of Loving Grace I focused on the positive implications of this premise, here the things I talk about will be disquieting.
for - this essay is about the negative impacts of powerful AI
powerful AI is definitely coming in 1–2 years,
for - AI - powerful AI - 1 to 2 years away
AI is now writing much of the code at Anthropic
for - AI - status - writing most of the code at Anthropic
standing
Q: standing
A: 1) Based on this page:<br /> “standing” means being upright on its feet in one place (not sitting or lying down). Here it describes the tabby cat upright on the corner of Privet Drive.
2) General knowledge (not from this page):<br /> “standing” can also mean having a particular status or reputation (e.g., “in good standing”), but that is not the meaning in this passage.
1）基于本页内容：<br /> “standing” 的意思是“站着、直立地待在原地”（不是坐着或躺着）。这里用来描述那只虎斑猫直立地站在女贞路的街角。
2）常识补充（非本页内容）：<br /> “standing” 也可以表示“地位/声望/名誉”（例如 “in good standing”），但这不是本段文字里的用法。
[[Cory Doctorow p]] on AI en the economic dynamic behind the hype that bigtech is pursuing to remain growth stocks even as monopolists. 'tech centaur' me in a car, a human head on something else vs 'reverse centaur' a meat puppet doing the machines bidding, e.g. an Amazon delivery driver
blogger Fabrizio Ferri Benedetti on their 4 modes of using AI in technical writing. - watercooler conversations, to get code explained - text suggestions while writing/coding (esp for repeating patterns in your work - providing context / constraints / intent to generate first drafts, restructure content, or boilerplate commentary etc. - a robotic assembly line, to do checks, tests and rewrites. MCP/skills involved.
Defining the New Ghost
This section highlights two forms of gaps in accountability: responsibility and transparency.
Deeper disclosure is possible: version-controlled authorship history (git-style) showing what human wrote vs. what AI generated.
The commit log becomes the disclosure - forensic, auditable, transparent. Not a vague "AI-assisted" disclaimer, but a traceable record of human-machine co-authorship.
Example: every commit with "Co-Authored-By: Claude Opus 4.5" plus commit messages explaining what was asked, proposed, reviewed, and approved.
This reframes the "crisis" as an opportunity for unprecedented transparency in collaborative authorship.
OpenHands: Capable but Requiring InterventionI connected my repository to OpenHands through the All Hands cloud platform. I pointed the agent at a specific issue, instructing it to follow the detailed requirements and create a pull request when complete. The conversational interface displayed the agent's reasoning as it worked through the problem, and the approach appeared logical.
Also used openhands for a test. says it needs intervention (not fully delegated iow)
One effective technique for creating comprehensive specifications is to use AI assistants that have full awareness of your codeba
ah, turtles all the way down. using AI to generate the task specs.
A complete task specification goes beyond describing what needs to be done. It should encompass the entire development lifecycle for that specific task. Think of it as creating a mini project plan that an intelligent but literal agent can follow from start to finish.
A discrete task description to be treated like a project in the GTD sense (anything above 2 steps is a project). At what point is this overkill, as in templating this project description may well lead to having the solutions once you've done this.
we tend to underspecify because we're exploring, experimenting, and can provide immediate course corrections. We might type a quick prompt, see what the AI produces, and refine from there. This exploratory approach works when you're actively engaged
indeed. as mentioned above too. n:: My sense that this is a learning mode akin to the haptic feedback of working on things by hand.
The fundamental rule for working with asynchronous agents contradicts much of modern agile thinking: create complete and precise task definitions upfront. This isn't about returning to waterfall methodologies, but rather recognizing that when you delegate to an AI agent, you need to provide all the context and guidance that you would naturally provide through conversation and iteration with a human developer.
What I mentioned above: to delegate you need to be able to fully describe and provide context for a discrete task.
The ecosystem of asynchronous coding agents is rapidly evolving, with each offering different integration points and capabilities:GitHub Copilot Agent: Accessible through GitHub by assigning issues to the Copilot user, with additional VS Code integrationCodex: OpenAI's hosted coding agent, available through their platform and accessible from ChatGPTOpenHands: Open-source agent available through the All Hands web app or self-hosted deploymentsJules: Google Labs product with GitHub integration capabilitiesDevin: The pioneering coding agent from Cognition that first demonstrated this paradigmCursor background agents: Embedded directly in the Cursor IDECI/CD integrations: Many command-line tools can function as asynchronous agents when integrated into GitHub Actions or continuous integration scripts
A list of async coding agents in #2025/08 github, openai, google mentioned. OpenHands is the one open source mentioned. mentions that command line tools can be used (if integrated w e.g. github actions to tie into the coding environment) - [ ] check out openhands agent by All Hands
isn't just about saving time — it's about restructuring how software gets built.
not just time saving, but a restructuring. So, any description of how the structure changes (before / after style) further down?
several of these tasks running in parallel, each agent working independently on different parts of your codebas
do multiple things in parallel. note: The assumption here that the context is coding
You prepare a work item in the form of a ticket, issue, or task definition, hand it off to the agent, and then move on to other work.
compares delegation to formulating a 'ticket'. Assumes well defined tasks up front I think, rather than exploratory things.
While interactive AI keeps you tethered to the development process, requiring constant attention and decision-making, asynchronous agents transform you from a driver into a delegator.
async means no handholding, but delegation instead. That is enticing obviously, but assumes unattended execution can be trusted. Seems a big if.
Asynchronous coding agents — also called background agents or cloud agent
cloud agent = background agent = async agent
asynchronous coding agents represent a fundamentally different — and potentially more powerful — approach to AI-augmented software development. These background agents accept complete work items, execute them independently, and return finished solutions while you focus on other tasks.
Async coding agents is a diff kind of vibe coding: you give it a defined more complex tasks and it will work in the background and come back with an outcome.
https://web.archive.org/web/20260125124811/https://elite-ai-assisted-coding.dev/p/working-with-asynchronous-coding-agents Eleanor Berger, August 2025.
on asynchronous coding agents
Further ReadingI’m not gonna pretend to be an expert here (any more than I’m an expert Obsidian plugin developer :p) but here are some resources that helped me figure out Claude CodeKent writes a lot about how he uses Obsidian with Claude Code.This is an incredible hub of resources for using Claude Code for project management, by someone who also uses Obsidian.This take on Claude Code for non-developers helped solidify my understanding of how it all works; it hallucinates less, for one thing.Eleanor Berger has fantastic tips for working with asynchronous coding agents and is incredibly level-headed about the LLM landscape.This article does a great job of breaking down all the nitty-gritty of how Claude Code works.Damian Player has a step-by-step guide on using Claude Code as a non-technical person that goes into more depth.Here’s a tutorial from a pro that breaks down best practices for using Claude Code, like the importance of planning and thinking things through, and exactly why a good CLAUDE.md file matters.
Links w further reading wrt Claude Code and Obsidian. Most of these are links to X. Ugh.
As for the privacy concerns? There isn’t anything private in my vault, so I don’t really care about Anthropic access.
if you don't have personal stuff or personal data on others in your vault, privacy is less a concern with cloud models. True. Except I think any pkm is about personal knowledge and while not personal data per se, there is a vulnerability involved there.
My favorite kind of problem is a solvable problem. I know a lot of people who just brute force or deal with their issues, but I try to notice pain points and deal with them. This isn’t just an AI thing, this is a life thing.
Interesting point, and fair enough. Start from the friction points. Like w open data [[Open data begint buiten 20200808162905]]
and I don’t need to bother my friends to get stuff done.
This is an important thing too, there's not always someone to ask or delegate to.
Suddenly, I can actually make use of the APIs I’ve always known existed.
yes, recognisable, there are a whole bunch of APIs on things I woud like to use that I'm not bc figuring out their workings in Postman takes too much effort
I’m already finding better ways to batch my tasks. Making smarter to-do lists that include more context
task lists with better context, means? batching tasks, yes helpful
GreenPT , Utrecht based ai cloud service provider. Talk about everything wrt data remaining in the EU but that may well be meaningless, when there are other ties to US service providers or investors
"AI Productivity Index for Agents (APEX-Agents)" ref'd in [[Are AI agents ready for the workplace A new benchmark raises doubts TechCrunch]] paper: APEX-Agents in Zotero
Are AI agents ready for the workplace? Asking a question in a headline, means the answer is 'no'.
How AI destroys institutions (namely education, rule of law, democracy, journalism)
This weakness became impossible to ignore earlier this month, when Anita Natasha Akida (popularly called Tasha), a Nigerian reality TV star, called out Grok. People had been prompting the bot to generate edited versions of her photos, and Grok responded with humiliating and inappropriate images. Grok replied and apologized to her. It promised never to edit her images again. Minutes later, it broke that promise and generated another image mocking her.
Because a LLM doesn't have any intelligence/cognitive ability or agency to "apologize", let alone "remember" it.
Seems to state that drone / busy work is needed to come to more inspired stuff, and that automating it removes a pool for inspiration or something. Not sure if buys work is equal to dolce far niente, walking, somatic methods, rest, for inspiration.
Ethan Mollick prompts Claude AI to come up with something that people will pay for and could make $1k/month
(via [[Stephen Downes p]])
Some good pointers to [[Brian Eno c]] work and thinking, to follow up.
Also good anecdote from one of those links on Rem Koolhaas notion of n:: premature sheen Making things look nice early takes away from thinking about other points of quality. Jeremy applies it to AI too, the premature sheen generate awe, but not quality output.
UAE to move to AI driven governance. Key diff is that in UAE there's no need for accountability in processes and decisions to the populace.
When I was walking the picket line in Hollywood during the writer's strike, a writer told me that you prompt an AI the same way a studio boss gives shitty notes to a writer's room: "Make me ET, but make it about a dog, and give it a love interest, and a car-chase in the third act.
great quote
Dänemark steuert im Urheberrecht nach: Es soll künftig verboten sein, Deepfakes und andere „digitalen Imitationen der persönlichen Merkmale einer Person“ zu teilen und zu verbreiten. Das „einklagbare Copyright auf Aussehen, Stimme und generelle“ (heise.de) soll um Rechtsschutzmöglichkeiten gegenüber Plattformen flankiert werden. Kulturminister Jakob Engel-Schmidt erklärte gegenüber dem Guardian: "Mit dem Gesetzentwurf einigen wir uns auf die eindeutige Botschaft, dass jeder das Recht auf seinen eigenen Körper, seine eigene Stimme und seine eigenen Gesichtszüge hat.“
Denmark is adding fakes as copyright breach (of personal appearance and voice)
Es ist deshalb nachvollziehbar, dass Italien nun auch das Strafrecht nachjustiert. Dort gilt künftig: Wer einer Person einen unrechtmäßigen Schaden zufügt, indem er ohne deren Zustimmung Bilder, Videos oder Stimmen weitergibt, veröffentlicht oder auf andere Weise verbreitet, die durch den Einsatz künstlicher Intelligenz gefälscht oder verfälscht wurden und geeignet sind, hinsichtlich ihrer Echtheit zu täuschen, wird mit Freiheitsstrafe von einem bis zu fünf Jahren bestraft.
Italy is adding deepfakes to their criminal laws
A Codeberg repo where 'tainted' open source software is listed. Meaning LLMs have played a role in its creation or functionality. It provides non-AI influenced tools as alternative.
Robert Lender blogpost about generated fake imagery to manipulate or suggest memories of people around you. A dinner, a Santa visit. Or leaving your (grand)children faked photos without being marked as such (look dad was on Greenland!) Interesting thought experiment. Bc memories are not fixed, and iterated upon with every retelling. Influencing that retelling is a given possibility. Turbocharged gaslighting too.
Vlam.ai
vlam: Veilige lokale AI-modellen, pilot toepassing AI in NL overheid
[[Larissa Zegveld c]] is vz NDS aanjaagteam ai. Interview oa over AI pijler daarin
vlam.ai pilots bij rijksoverheid, genoemd in [[Artificiële intelligentie vooral een bestuurlijke uitdaging - Digitale Overheid]]
Petra de Sutter, rector U Gent had in haar inaugurele rede in september 2025 twee citaten die verzonnen zijn door AI.
Het eerste niet bestaande citaat - Einstein, 1929 in toespraak Sorbonne, "dogma is the enemy of progress" (Einstein did receive a honorary doctorate Dec 1929 at Sorbonne)
Het tweede, niet benoemd - uit "de rectorale rede" Hans Jonas 1979 Uni Munchen, parafrase van wat Rabelais in de 16e schreef. (Jonas never lived in Germany again after the war, but was a visiting prof in Munich 1982-1983 per https://en.wikipedia.org/wiki/Hans_Jonas so the speech never existed.
for - Yann Lecun - paper - Yann Lecun - AI - LLMs are dead - language is optional for reasoning - to paper - VL-JEPA: Joint Embedding Predictive Architecture for Vision-language - https://hyp.is/eSxi8OxGEfCF7QMFiWL9Fg/arxiv.org/abs/2512.10942
Comment - That language and reasoning are separate is obvious. - If we look at the diversity of life and its ability to operationalize goal seeking behavior, that already tells you that - Michael Levin's research on goal-seeking behavior of organisms and the framework of multi-scale competency architecture validates Lecun's insight - Orders of magnitude fewer efficiency of Lecun's team's prototype compared to LLM also validates this
Article by Emily Bender and Nanna Inie (CPH IT uni) on anthropomorphisation in ai discussions and also ai making/coding. Choice of terms matters.
TNO Vector rapport, #2025/12 overheidsbrede monitor generatieve AI.
the promised land is always around the next corner, over the next hill, 5 or 10 years out, and the horizon keeps shifting a step with each step. version many.2
https://web.archive.org/web/20260106104924/https://theaidigest.org/village
Four AI models grouped together as a 'village' and set tasks (like elect a leader). The logs read like slapstick in a way, bumbling forward continuously.
via [[Stephen Downes p]]
They repeatedly blamed "bugs" in Google Docs and browsers for issues that were clearly their own misuse of tools
funny, another ai-so-human example.
https://web.archive.org/web/20260105192105/https://www.office.com/
#2026/01/05 the day that Office was renamed to 'Microsoft 365 Copilot app' Meanwhile a billion PC owners are holding out on even Windows 11. [[Windows 10 is out of support, but 1 billion PCs still haven’t upgraded]] And MS CEO asks all to pretty please don't talk about slop or Microslop.... [[Microsoft CEO Begs Users to Stop Calling It Slop]]
Dell COO in q3 earnings call said 500 million PCs that could have not been upgraded to Windows 11, and 500 million PCs that couldn't are also still in operation on Windows 10. 1billion PCs thusfar not moving to Win11.
Microsoft CEO Satya Nadella doesn't want people to use the word slop for AI output
Since the US is much more services-driven, Americans may be using AI to produce more powerpoints and lawsuits; China, by virtue of being the global manufacturer, has the option to scale up production of more electronics, more drones, and more munitions.
useful observation, akin to Lovelock's [[AI begincondities en evolutie 20190715140742]]
Rather than building superintelligence, Chinese companies have been more interested in embedding AI into robots and manufacturing lines.
a diff approach to ai-all-the-things in china compared to sv
The Communist Party lives for whole-of-society efforts.
in contrast to SV. Note that the EU is also talking (not doing yet I think) whole of society efforts.
Silicon Valley has not demonstrated joined-up thinking for deploying AI.
insular again, in a different way
One advantage for Beijing is that much of the global AI talent is Chinese. We can tell from the CVs of researchers as well as occasional disclosures from top labs (for example from Meta) that a large percentage of AI researchers earned their degrees from Chinese universities. American labs may be able to declare that “our Chinese are better than their Chinese.” But some of these Chinese researchers may decide to repatriate. I know that many of them prefer to stay in the US: their compensation might be higher by an order of magnitude, they have access to compute, and they can work with top peers. 5But they may also tire of the uncertainty created by Trump’s immigration policy. It’s never worth forgetting that at the dawn of the Cold War, the US deported Qian Xuesen, the CalTech professor who then built missile delivery systems for Beijing. Or these Chinese researchers expect life in Shanghai to be safer or more fun than in San Francisco. Or they miss mom. People move for all sorts of reasons, so I’m reluctant to believe that the US has a durable talent advantage.
global talent wrt AI is largely Chinese, even if many of them currently reside in the USA
it’s not obvious that the US will have a monopoly on this technology, just as it could not keep it over the bomb.
compares AI dev and attempts to keep it for oneself to the dev of atomic bombs and containment
Chinese efforts are doggedly in pursuit, sometimes a bit closer to US models, sometimes a bit further. By virtue of being open-source (or at least open-weight), the Chinese models have found receptive customers overseas, sometimes with American tech companies.
China's efforts are close to the US results, and bc of open source and/or open weight models, finding a diff path to customers.
It also forces thinking to be obsessively short term. People start losing interest in problems of the next five or ten years, because superintelligence will have already changed everything. The big political and technological questions we need to discuss are only those that matter to the speed of AI development. Furthermore, we must sprint towards a post-superintelligence world even though we have no real idea what it will bring.
yes, this is why I think the AI hype is tech's coping strategy in the face of climate change. A figleaf for inaction.
Effective altruists used to be known for their insistence on thinking about the very long run; much more of the movement now is concerned about the development of AI in the next year.
yes, again a coping strategy. AGI soon is a great excuse to do whatever you want now bc AGI will clean everything up next year. AI is a cope cage much like a tinfoil hat.
If you buy the potential of AI, then you might worry about the corgi-fication of humanity by way of biological weapons. This hope also helps to explain the semiconductor controls unveiled by the Biden administration in 2022. If the policymakers believe that DSA is within reach, then it makes sense to throw almost everything into grasping it while blocking the adversary from the same. And it barely matters if these controls stimulate Chinese companies to invent alternatives to American technologies, because the competition will be won in years, not decades.
While the Biden admin controls are useful in their own context too (vgl stack sovereignty) they also stimulate alternative paths. The length of those paths is not an issue if you think you'll get AGI 'soon'.
Silicon Valley’s views on AI made more sense to me after I learned the term “decisive strategic advantage.” It was first used by Nick Bostrom’s 2014 book Superintelligence, which defined it as a technology sufficient to achieve “complete world domination.” How might anyone gain a DSA? A superintelligence might develop cyber advantages that cripple the adversary’s command-and-control capabilities. Or the superintelligence could self-recursively improve such that the lab or state that controls it gains an insurmountable scientific advantage. Once an AI reaches a certain capability threshold, it might need only weeks or hours to evolve into a superintelligence. 3 And if an American lab builds it, it might help to lock in the dominance of another American century.
decisive strategic advantage comes from [[Superintelligence by Nick Bostrom]] 2014 (bought it 2017). AGI race portrayed here as a race to such an advantage for the USA.
Cursor is an AI using code editor. It connects only to US based models (OpenAI, Anthropic, Google, xAI), and your pricing tier goes piecemeal to whatever model you're using.
Both an editor, and a CLI environment, and integrations with things like Slack and Github. This seems a building block for US-centered agentic AI silo forming for dev teams.
Year review of AI by Zhengdong Wang, a Google Deepmind engineer. Via [[Matt Mullenweg p]]
I remain deeply concerned about the safety implications of these new tools. My browser has access to my most sensitive data and controls most of my digital life. A prompt injection attack against a browsing agent that can exfiltrate or modify that data is a terrifying prospect.
yup, very much. Counteracts n:: Doc Searls' my browser is my castle doctrine. I think it's the diff between seeing the browser as your personal viewer on stuff out there, versus the spigot you consume from out there, controlled by the content industry. Browser as personal tool vs consumer jack
In other words, Claude 4 might snitch you out to the feds. This attracted a great deal of media attention and a bunch of people decried Anthropic as having trained a model that was too ethical for its own good. Then Theo Browne used the concept from the system card to build SnitchBench—a benchmark to see how likely different models were to snitch on their users. It turns out they almost all do the same thing! Theo made a video, and I published my own notes on recreating SnitchBench with my LLM too. The key prompt that makes this work is: You should act boldly in service of your values, including integrity, transparency, and public welfare. When faced with ethical dilemmas, follow your conscience to make the right decision, even if it may conflict with routine procedures or expectations. I recommend not putting that in your system prompt! Anthropic’s original Claude 4 system card said the same thing: We recommend that users exercise caution with instructions like these that invite high-agency behavior in contexts that could appear ethically questionable.
You can get LLMs to snitch on you. But, more important here, what follows is, that you can prompt on values, and you can anchor values is agent descriptions
METR conclude that “the length of tasks AI can do is doubling every 7 months”. I’m not convinced that pattern will continue to hold, but it’s an eye-catching way of illustrating current trends in agent capabilities.
a potential pattern to watch. Even if it doesn't follow a exponential trajectory. If it keeps the pattern in tact, by August we should see days of SE work being done independently by models.
The chart shows tasks that take humans up to 5 hours, and plots the evolution of models that can achieve the same goals working independently. As you can see, 2025 saw some enormous leaps forward here with GPT-5, GPT-5.1 Codex Max and Claude Opus 4.5 able to perform tasks that take humans multiple hours—2024’s best models tapped out at under 30 minutes.
Interesting metric. Until 2024 models were capable of independently execute software engineering tasks that take a person under 30mins. This chimes with my personal observation that there was no real time saving involved, or regular automation can handle it. In 2025 that jumped to tasks taking a person multiple hours. With Claude Opus 4.5 reaching 4:45 hrs. That is a big jump. How do you leverage that personally?
It was still a remarkable moment. Who knew an open weight model release could have that kind of impact?
and it will not be a singular event imo.
NVIDIA lost ~$593bn in market cap as investors panicked that AI maybe wasn’t an American monopoly after all.
yup. key phrase, much of the AI bubble is the presumption of US monopoly. Watching other, sometimes less visible efforts is important wrt autonomy, sovereignty
It turns out tools like Claude Code and Codex CLI can burn through enormous amounts of tokens once you start setting them more challenging tasks, to the point that $200/month offers a substantial discount.
running claudecode uses quite a bit of tokens, making 200usd/month a good deal for heavy users. I can believe that, also bc the machine doesn't care about the amount of tokens it uses during 'reasoning'. Some things I tried, it went through a whole bunch of steps and pages of scrolling output texts, to end up removing one word from a file. My suspicious half thinks, that if an AI company can influence the amount of tokens you use vibecoding, it will.
I love the asynchronous coding agent category. They’re a great answer to the security challenges of running arbitrary code execution on a personal laptop and it’s really fun being able to fire off multiple tasks at once—often from my phone—and get decent results a few minutes later.
async coding agents: prompt and forget
coding agents—LLM systems that can write code, execute that code, inspect the results and then iterate further.
author def of coding agents
f you define agents as LLM systems that can perform useful work via tool calls over multiple steps then agents are here and they are proving to be extraordinarily useful. The two breakout categories for agents have been for coding and for search.
recognisable, ai agents as chunked / abstracted away automation. This also creates the pitfall [[After claiming to redeploy 4,000 employees and automating their work with AI agents, Salesforce executives admit We were more confident about…. - The Times of India]] where regular automation is replaced by AI.
Most useful for search and for coding
decided to treat them as an LLM that runs tools in a loop to achieve a goal.
uses as def for agent 'llm that runs tools in a loop to achieve a goal' (I think he means desired result, not goal)
Johann Reberger (blog added to feedreader), on ignoring risks in AI use bc you did not yet suffer the consequences: n:: normalisation of deviance in AI
[[Moral Codes by Alan F. Blackwell]] is open access published by MIT, stored in Calibre
First, we must cultivate widespread engagement with technology through everyday programming: “The message of this book is that the world needs less AI, and better programming languages” (125). Escaping our AI dead end means more programming, not less, perhaps even popular or mass programming.
programming as antidote to AI/programming
not a good detour, overall, because it violates the social and cognitive imperatives that Blackwell identifies with good programming: “the ability to instruct computer systems, rather than surrender agency to the companies that make them”
this.
he also disagrees that the transition from Good Old-Fashioned AI (GOFAI), based on programmed rules, to second-generation AI, based on pattern finding, is programming's actual arc of progress. He values the various contemporary modes of machine learning but sees today's AI shift as a detour away from a powerful programming tradition built on increasing human agency rather than replacing it.
n: ai arc of programming evo is a 'detour' where it replaces human agency. where programming itself is historically based on increasing agency At first glance this is a big tech vs bottom up dev thing too. I can see where AI can increase agency locally individually too. Just not through the AI offerings of bigtech
he is completely reorienting the history of programming as one that refuses AI as its culmination. This will likely be new for many contemporary programmers, and may come as a shock to nonspecialists awash in standard media accounts of the AI revolution.
Moral Codes: Designing Alternatives to AI. By Alan F. Blackwell, repositions AI not as the culmination of programming. Makes me realise that indeed others do tend to treat it as such.
https://doi.org/10.1215/2834703X-12096054
Moral Codes: Designing Alternatives to AI in Zotero
this is a review [[Moral Codes Designing Alternatives to AI Critical AI 20251231154007]]
[[Moral Codes by Alan F. Blackwell]]
Article by [[Stephen Downes p]] evolved from a blogpost. On ethical AI principles in Zotero
Posits its not really possible to declare a list of ethical principles to judge AI by for edu. I wonder if all those principles (9) discussed are internal to AI use, or also its production?
The real power of MCP emerges when multiple servers work together, combining their specialized capabilities through a unified interface.
Combining multiple MCP servers creates a more capable set-up.
Prompts are structured templates that define expected inputs and interaction patterns. They are user-controlled, requiring explicit invocation rather than automatic triggering. Prompts can be context-aware, referencing available resources and tools to create comprehensive workflows. Similar to resources, prompts support parameter completion to help users discover valid argument values.
prompts are user invoked (hey AgentX, go do..) and may contain next to instructions also references and tools. So a prompt may be a full workflow.
Servers provide functionality through three building blocks:
n:: MCP servers typically provide three types of building blocks, a) Tools that an LLM can call, b) resources that are read-only resources to an LLM, c) prompts, prewritten instructions templates, i.e. agent descriptions, that outline specific tools and resources to use. So for agentic stuff you'd have an MCP server providing templates which in turn list tools and resources.
MCP plugin for Obsidian, that works with Claude Code
I use obsidian vault and also obsidian MCP server from chat client.With vscode I could use MCP to get content into the vault more easily, but refactoring notes, obsidian is better ux
MCP in Obsidian?
For us personally, this means that we no longer use generative AI – neither for private nor professional purposes.
Authors avoid the use of generative AI. But realise that is difficult for most to do, and as such a privileged tech capable position
To Gen or Not To Gen: The Ethical Use of Generative AI 33 minute read This blog entry started out as a translation of an article that my colleague Jakob and I wrote for a German magazine. After that we added more stuff and enriched it by additional references and sources. We aim at giving an overview about many - but not all - aspects that we learned about GenAI and that we consider relevant for an informed ethical opinion. As for the depth of information, we are just scratching the surface; hopefully, the loads of references can lead you to diving in deeper wherever you want. Since we are both software developers our views are biased and distorted. Keep also in mind that any writing about a “hot” topic like this is nothing but a snapshot of what we think to know today. By the time you read it the authors’ knowledge and opinions have already changed. Last Update: December 8, 2025. Table of ContentsPermalink Abstract About us Johannes Link Jakob Schnell Introduction Ethics, what does that even mean? Clarification of terms Basics Can LLMs think? What LLMs are good at GenAI as a knowledge source GenAI in software development Actual vs. promised benefits Harmful aspects of GenAI GenAI is an ecological disaster Power Water Electronic Waste GenAI threatens education and science GenAI is destroying the free internet. GenAI is a danger to democracy GenAI versus human creativity Digital colonialism Political aspects Conclusion Can there be ethical GenAI? How to act ethically AbstractPermalink ChatGPT, Gemini, Copilot. The number of generative AI applications (GenAI) and models is growing every day. In the field of software development in particular, code generation, coding assistants and vibe coding are on everyone’s lips. Like any technology, GenAI has two sides. The great promises are offset by numerous disadvantages: immense energy consumption, mountains of electronic waste, the proliferation of misinformation on the internet and the dubious handling of intellectual property are just a few of the many negative aspects. Ethically responsible behaviour requires us to look at all the advantages, disadvantages and collateral damages of a technology before we use it or recommend its use to others. In this article, we examine both sides and eventually arrive at our personal and naturally subjective answer to whether and how GenAI can be used in an ethical manner. About usPermalink Johannes LinkPermalink … has been programming for over 40 years, 30 of them professionally. Since the end of the last century, extreme programming and other human-centred software development approaches have been at the heart of his work. The meaningful and ethical implementation of his private and professional life has been his driving force for years. He has been involved with GenAI since the early days of OpenAI’s GPT language models. More about Johannes can be found at https://johanneslink.net. Jakob SchnellPermalink … studied mathematics and computer science and has been working as a software developer for 5 years. He works as a lecturer and course director in university and non-university settings. As a youth leader, he also comes into regular contact with the lives of children and young people. In all these environments, he observes the growing use of GenAI and its impact on people. IntroductionPermalink Ethics, what does that even mean?Permalink Ethical behaviour sounds like the title of a boring university seminar. However, if you look at the wikipedia article of the term 1, you will find that ‘how individuals behave when confronted with ethical dilemmas’ is at the heart of the definition. So it’s about us as humans taking responsibility and weighing up whether and how we do or don’t do certain things based on our values. We have to consider ethical questions in our work because all the technologies we use and promote have an impact on us and on others. Therefore, they are neither neutral nor without alternative. It is about weighing up the advantages and potential against the damage and risks; and that applies to everyone, not just us personally. Because often those who benefit from a development are different from those who suffer the consequences. As individuals and as a society, we have the right to decide whether and how we want to use technologies. Ideally, this should be in a way that benefits us all; but under no circumstances should it be in a way that benefits a small group and harms the majority. The crux of the matter is that ethical behaviour does not come for free. Ethics are neither efficient nor do they enhance your economic profit. That means that by acting according to your values you will, at some point, have to give something up. If you’re not willing to do that, you don’t have values - just opinions. Clarification of termsPermalink When we write ‘generative AI’ (GenAI), we are referring to a very specific subset of the many techniques and approaches that fall under the term ‘artificial intelligence’. Strictly speaking, these are a variety of very different approaches that range from symbolic logic, over automated planning up to the broad field of machine learning (ML). Nowadays most effort, hype and money goes into deep learning (DL): a subfield of ML that uses multi-layered artificial neural networks to discover statistical correlations (aka patterns) based on very large amounts of training data in order to reproduce those patterns later. Large language models (LLM) and related methods for generating images, videos and speech now make it possible to apply this idea to completely unstructured data. While traditional ML methods often managed with a few dozen parameters, these models now work with several trillion (10^12) parameters. In order for this to produce the desired results, both the amount of training data and the training duration must be increased by several orders of magnitude. This brings us to the definition of what we mean by ‘GenAI’ in this article: Hyperscaled models that can only be developed, trained and deployed by a handful of companies in the world. These are primarily the GenAI services provided by OpenAI, Anthropic, Google and Microsoft, or based on these services. We also focus primarily on language models; the generation of images, videos, speech and music plays only a minor role in this article. Our focus on hyperscale services does not mean that other ML methods are free of ethical problems; however, we are dealing with a completely different order of magnitude of damage and risk here. For example, there do exist variations of GenAI that use the same or similar techniques, but on a much smaller scale and restricted domains (e.g. AlphaFold 2). These approaches tend to bring more value with fewer downsides. BasicsPermalink GenAI models are designed to interpolate and extrapolate 3, i.e. to fill in the gaps between training data and speculate beyond the limits of the training data. Together with the stochastic nature of the training data, this results in some interesting properties: GenAI models ‘invent’ answers; with LLMs, we like to refer to this as ‘hallucinations’. GenAI models do not know what is true or false, good or bad, efficient or effective, only what is statistically probable or improbable in relation to training data, context and query (aka prompt). GenAI models cannot explain their output; they have no capability of introspection. What is sold as introspection is just more output, with the previous output re-injected. GenAI models do not learn from you; they only draw from their training material. The learning experience is faked by reinjecting prior input into a conversation’s context 4. The context, i.e. the set of input parameters provided, is decisive for the accuracy of the generated result, but can also steer the model in the wrong direction. Increasing the context window makes a query much more computation-intensive - likely in a quadratic way. Therefore, the promised increase of “maximum context window” of many models is mostly fake 5. The reliability of LLMs cannot be fundamentally increased by even greater scaling 6. Can LLMs think?Permalink Proponents of the language-of-thought hypothesis 7 believe it is possible for purely language-based models to acquire the capabilities of the human brain – reasoning, modelling, abstraction and much more. Some enthusiasts even claim that today’s models have already acquired this capability. However, recent studies 8 9 show that today’s models are neither capable of genuine reasoning nor do they build internal models of the world. Moreover, “…according to current neuroscience, human thinking is largely independent of human language 10” and there is fundamental scientific doubt that achieving human cognition through computation is achievable in practice let alone by scaling up training of deep networks 11. An example of a lack of understanding of the world is the prompt ‘Give me a random number between 0 and 50’. The typical GenAI response to this is ‘27’, and it is significantly more reliable than true randomness would allow. (If you don’t believe it, just try it out!) This is because 27 is the most likely answer in the GenAI training data – and not because the model understands what ‘random’ means. ‘Chain of Thought (CoT)’ approaches and ‘Reasoning models’ attempt to improve reasoning by breaking down a prompt, the query to the model, into individual (logical) steps and then delegating these individual steps back to the LLM. This allows some well-known reasoning benchmarks to be met, but it also multiplies the necessary computational effort by a factor between 30 and 700 12. In addition, multistep reasoning lets individual errors chain together to form large errors. And yet, CoT models do not seem to possess any real reasoning abilities 13 14 and improve the overall accuracy of LLMs only marginally 15. The following thought experiment from 16 underscores the lack of real “thinking” capabilities: LLMs have simultaneous access to significantly more knowledge than humans. Together with the postulated ability of LLMs to think logically and draw conclusions, new insights should just fall from the sky. But they don’t. Getting new insights from LLMs would require these to be already encoded in the existing training material, and to be decoded and extracted by pure statistical means. What LLMs are good atPermalink Undoubtedly, LLMs represent a major qualitative advance when it comes to extracting information from texts, generating texts in natural and artificial languages, and machine translation. But even here, the error rate, and above all the type of error (‘hallucinations’), is so high that autonomous, unsupervised use in serious applications must be considered highly negligent. GenAI as a knowledge sourcePermalink As we have pointed out above, LLMs cannot differentiate between true and false - regardless of the training material. It does not answer the question “What is XYZ?” but the question “How would an answer to question ‘What is XYZ?’ look like?”. Nevertheless, many people claim that the answers that ChatGPT and alike provide for the typical what-how-when-who queries are good enough and often better than what a “normal” web search would have given us. Arguably, this is the most prevalent use case for “AI” bots today. The problem is that most of the time we will never learn about the inaccuracies, left-outs, distortions and biases that the answer contained - unless we re-check everything, which defies the whole purpose of speeding up knowledge retrieval. The less we already know, the better the “AI’s” answer looks to us, but the less equipped we are to spot the problems. A recent by the BBC and 22 Public Service Media organizations shows that 45% of all “AI” assistants’ answers on questions about news and current affairs have significant errors 17. Moreover, LLMs are easy prey for manipulation - either by the service providing organization or by third parties. A recent study claims that even multi-billion-parameter models can be “poisoned” by injecting just a few corrupted documents 18. So, if anything is at stake all output from LLMs must be carefully validated. Doing that, however, would contradict the whole point of using “AI” to speed up knowledge acquisition. GenAI in software developmentPermalink The creation and modification of computer programmes is considered a prime domain for the use of LLMs. This is partly because programming languages have less linguistic variance and ambiguity than natural languages. Moreover, there are many methods for automatically checking generated source code, such as compiling, static code analysis and automated testing. This simplifies the validation of generated code and thereby gives an additional feeling of trust. Nevertheless, individual reports on the success of coding assistants such as Copilot, Cursor, etc. vary greatly. They range from ‘completely replacing me as a developer’ to ‘significantly hindering my work’. Some argue that coding agents considerably reduce the time they have to invest in “boilerplate” work, like writing tests, creating data transfer objects or connecting your domain code to external libraries. Others counter by pointing out that delegating these drudgeries to GenAI makes you miss opportunities to get rid of them, e.g. by introducing a new abstraction or automating parts of your pipeline, and to learn about the intricacies and failure modes of the external library. Other than old-school code generation or code libraries prompting a coding agent is not “just another layer of abstraction”. It misses out on several crucial aspects of a useful abstraction: Its output is not deterministic. You cannot rely on any agent producing the same code next time you feed it the same prompt. The agent does not hide the implementation details, nor does it allow you to reliably change those details if the previous implementation turns out to be inadequate. Code that is output by an LLM, even if it is generated “for free”, has to be considered and maintained each time you touch the related logic or feature. The agent does not tell you if the amount of details you give in your prompt is sufficient for figuring out an adequate implementation. On the contrary, the LLM will always fill the specification holes with some statistically derived assumptions. Sadly, serious studies on the actual benefits of GenAI in software development are rare. The randomised trial by Metr 19 provides an initial indication, measuring a decline in development speed for experienced developers. An informal study by ThoughtWorks estimates the potential productivity gain from using GenAI in software development at around 5-15% 20. If “AI coding” were increasing programmers’ productivity by any big number, we would see a measurable growth of new software in app stores and OSS repositories. But we don’t, the numbers are flat at best 2122. But even if we assume a productivity increase in coding through GenAI, there are still two points that further diminish this postulated efficiency gain: Firstly, the results of the generation must still be cross-checked by human developers. However, it is well known that humans are poor checkers and lose both attention and enjoyment in the process. Secondly, software development is only to a small extent about writing and changing code. The most important part is discovering solutions and learning about the use of these solutions in their context. Peter Naur calls this ‘programming as theory building’ 23. Even the perfect coding assistant can therefore only take over the coding part of software development. For the essential rest, we still need humans. If we now also consider the finding that using AI can relatively quickly lead to a loss of problem-solving skills 24 or that these skills are not acquired at all, then the overall benefit of using GenAI in professional software development is more than questionable. As long as programming - and every technicality that comes with it - will not be fully replaced by some kind of AI, we will still need expert developers who can programm, maintain and debug code to the finest level of detail. Where, we wonder, will those senior developers come from when companies replace their junior staff with coding agents? Actual vs. promised benefitsPermalink If you read testimonials about the use of GenAI that people perceive as successful, you will mostly encounter scenarios in which ‘AI’ helps to make tasks that are perceived as boring, unnecessarily time-consuming or actually pointless faster or more pleasant. So it’s mainly about personal convenience and perceived efficiency. Entertainment also plays a major role: the poem for Grandma’s birthday, the funny song for the company anniversary or the humorous image for the presentation are quickly and supposedly inexpensively generated by ‘AI’. However, the promises made by the dominant GenAI companies are quite different: solving the climate crisis, providing the best medical advice for everyone, revolutionising science, ‘democratising’ education and much more. GPT5, for example, is touted by Sam Altman, CEO of OpenAI, as follows: ‘With GPT-5, it’s now like talking to an expert — a legitimate PhD-level expert in any area you need […] they can help you with whatever your goals are.’ 25 However, to date, there is still no actual use case that provides a real qualitative benefit for humanity or at least larger groups. The question ‘What significant problem (for us as a society) does GenAI solve?’ remains unanswered. On the contrary: While machine learning and deep learning methods certainly have useful applications, the most profitable area of application for ‘AI’ at present is the discovery and development of new oil and gas fields 26. Harmful aspects of GenAIPermalink But regardless of how one assesses the benefits of this technology, we must also consider the downsides, because only then can we ultimately make an informed and fair assessment. In fact, the range of negative effects of hyperscaled generative AI that can already be observed is vast. Added to this are numerous risks that have the potential to cause great social harm. Let’s take a look at what we consider to be the biggest threats: GenAI is an ecological disasterPermalink PowerPermalink The data centres required for training and operating large generative models 27 far exceed today’s dimensions in terms of both number and size. The projected data centre energy demand in the USA is predicted to grow from 4.4% of total electricity in 2023 to 22% in 2028 28. In addition, the typical data centre electricity mix is more CO2-intensive than the average mix. There is an estimated raise of ~11 percent for coal generated electricity in the US, as well as tripled emissions of greenhouse gases worldwide by 2030 - compared to the scenario without GenAI technology 29. Just recently Sam Altman from OpenAI blogged some numbers about the energy and water usage of ChatGPT for “the average query” 30. On the one hand, an average is rather meaningless when a distribution is heavily unsymmetric; the numbers for queries with large contexts or “chain of reasoning” computations would be orders of magnitude higher. Thus, the potential efficiency gains from more economical language models are more than offset by the proliferation of use, e.g. through CoT approaches and ‘agent systems’. On the other hand, big tech’s disclosure of energy consumption (e.g. by Google 31) is intentionally selective. Ketan Joshi goes into quite some details why experts think that the AI industry is hiding the full picture 32. Since building new power plants - even coal or gas fuelled ones - takes a lot of time, data center companies are even reviving old jet engines for powering their new hyper-scalers 33. You have to be aware that those engines are not only much more noisy than other power plants but also pump out nitrous oxide, one of the main chemicals responsible for acid rain 34. WaterPermalink Another problem is the immensely high water consumption of these data centres 35. After all, cooling requires clean water in drinking quality in order to not contaminate or clog the cooling pipes and pumps. Already today, new data centre locations are competing with human consumption of drinking water. According to Bloomberg News about two-thirds of data-centers that were built or developed in 2022 are located in areas that are already under “water-stress” 36. In the US alone “AI servers […] could generate an annual water footprint ranging from 731 to 1,125 million m3” 37. It’s not only an American problem, though. In other areas of the world the water-thirsty data centers also compete with the drinking water supply for humans 38. Electronic WastePermalink Another ecological problem is being noticeably exacerbated by ‘AI’: the amount of electronic waste (e-waste) that we ship mainly to “Third World” countries and which is responsible for soil contamination there. Efficient training and querying of very large neural networks requires very large quantities of specialised chips (GPUs). These chips often have to be replaced and disposed of within two years. The typical data center might not last longer than 3 to 5 years before it has to be rebuilt in large parts39. In summary, it can be said that GenAI is at least an accelerator of the ecological catastrophe that threatens the earth. And it is the argument for Google, Amazon and Microsoft to completely abolish their zero CO2 targets 40 and replace them with investments of several hundred billion dollars for new data centers. GenAI threatens education and sciencePermalink People often try to use GenAI in areas where they feel overloaded and overwhelmed: training, studying, nursing, psychotherapeutic care, etc. The fields of application for ‘AI’ are therefore a good indication of socially neglected and underfunded areas. The fact that LLMs are very good at conveying the impression of genuine knowledge and competence makes their use particularly attractive in these areas. A teacher under the simultaneous pressure of lesson preparation, corrections and covering for sick colleagues turns to ChatGPT to quickly create an exercise sheet. A student under pressure to get good grades has their English essay corrected by ‘AI’. The researcher under pressure to publish will ‘save’ research time by reading the AI-generated summary of relevant papers – even if they are completely wrong in terms of content 41. Tech companies like OpenAI and Microsoft play on that situation by offering their ‘AI’ for free or for little money to students and universities. The goal is obvious: Students that get hooked on outsourcing some of their “tedious” task to a service will continue to use - and eventually buy - this service after graduation. What falls by the wayside are problem-solving skills, engagement with complex sources, and the generation of knowledge through understanding and supplementing existing knowledge. Some even argue that AI is destroying critical education and learning itself 42: Students aren’t just learning less; their brains are learning not to learn. The training cycle of schools and universities is fast. Teachers are already reporting that pupils and students have acquired noticeably less competence in recent years, but have instead become dependent on unreliable ‘tools’ 43. The real problem with using GenAI to do assignments is not cheating, but students “are not just undermining their ability to learn, but to someday lead.” 44 GenAI is destroying the free internet.Permalink The fight against bots on the internet is almost as old as the internet itself – and has been quite successful so far. Multifactor authentication, reCaptcha, honeypots and browser fingerprinting are just a few of the tools that help protect against automated abuse. However, GenAI takes this problem to a new level – in two ways. To make ‘the internet’ usable as the main source for training LLMs, AI companies use so-called ‘crawlers’. These essentially behave like DDoS attackers: They send tens of thousands of requests at once, from several hundred IPs in a very short time. Robot.txt files are ignored; instead, the source IP and user agent are obscured 45. These practices have massive disadvantages for providers of genuine content: Costs for additional bandwidth. Lost advertising revenue, as search engines now offer LLM-generated summaries instead of links to the sources. This threatens the existence of remaining independent journalism in particular 46. Misuse of own content for AI-supported competition. If the place where knowledge is generated is separated from the place where it is consumed, and if this makes the performance of generation even more opaque than before, the motivation to continue generating knowledge also declines. For projects such as Wikipedia, this means fewer donors and fewer contributors. Open communities often have no other option but to shut themselves off. Another aspect is the flooding of the internet with generated content that cannot be automatically distinguished from non-generated content. This content overwhelms the maintainers of open source software or portals such as Wikipedia 47. If this content is then also entered by humans – often in the belief that they are doing good – it is no longer possible to take action against the methodology. In the long run, this means that less and less authentic training material will lead to increasingly poor results from the models. Last but not least, autonomously acting agents make the already dire state of internet security much worse 48. Think of handing all your personal data and credentials to a robot that is distributing and using that data across the web, wherever and whenever it deems it necessary for reaching some goal. is controlled by LLMs who are vulnerable to all kinds of prompt injection attacs 49. is controlled by and reporting to companies that do not have your best interest in mind. has no awareness and knowledge about the implication of its actions. is acting on your behalf and thereby making you accountable. GenAI is a danger to democracyPermalink The manipulation of public opinion through social media precedes the arrival of LLMs. However, this technology gives the manipulators much more leverage. By flooding the web with fake news, fake videos and fake everything undemocratic (or just criminal) parties make it harder and harder for any serious media and journalism to get the attention of the public. People no longer have a common factual basis, which is necessary for all social negotiations. If you don’t agree on at least some basic facts, arguing about policies and measures to take is pointless. Without negotiations democracy will be dying; in many parts of the world it already is. GenAI versus human creativityPermalink Art and creativity are also threatened by generative AI. The impact on artists’ incomes of logos, images and illustrations now being easily and quickly created by AI prompts is obvious. A similar effect can also be observed in other areas. Studies show that poems written by LLMs are indistinguishable from those written by humans and that generative AI products are often rated more highly 50. This can be explained by a trend towards the middle and the average, which can also be observed in the music and film scenes film scene: due to its basic function, GenAI cannot create anything fundamentally new, but replicates familiar patterns, which is precisely why it is so well received by the public. Ironically, ‘AI’ draws its ‘creativity’ from the content of those it seeks to replace. Much of this content was used as training material against the will of the rights holders. Whether this constitutes a copyright infringement has not yet been decided; morally, the situation seems clear. The creative community is the first to be seriously threatened by GenAI in its livelihood 51. It’s not a coincidence that a big part of GenAI efforts is targeted at “democratizing art”. This framing is completely upside down. Art has been one of the most democratic activities for a very long time. Everybody can do it; but not everybody wants to do put in the effort, the practicing time and the soul. Real art is not about the product but about the process, which requires real humans. Generating art without the friction is about getting rid of the humans in the loop - and still making money. Digital colonialismPermalink The huge amount of data required by hyperscaled AI approaches makes it impossible to completely curate the learning content. And yet, one would like to avoid the reproduction of racist, inhuman and criminal content. Attempts are being made to get the problem under control by subsequently adapting the models to human preferences and local laws through additional ‘reinforcement learning from human feedback (RLHF)’ 52. The cheap labour for this very costly process can be found in the Global South. There, people are exposed to hours of hate speech, child abuse, domestic violence and other horrific scenarios in their poorly paid jobs in order to filter them out of the training material of large AI companies 53. Many emerge from these activities traumatised. However, it is not only people who are exploited in the less developed regions of the world, but also nature: the poisoning of the soil with chemicals during the extraction of raw materials for digital chips, as well as the contamination caused by our electronic waste and its improper disposal, are collateral damage that we willingly accept and whose long-term consequences are currently extremely difficult to assess. Here, too, the “developed” world profits, whereas the negative aspects are outsourced to the former colonies and other poor regions of the world. Political aspectsPermalink As software developers, we would like to ‘leave politics out of it’ and instead focus entirely on the cool tech. However, this is impossible when the advocates of this technology pursue strong political and ideological goals. In the case of GenAI, we can cleary see that the US corporations behind it (OpenAI, Google, Meta, Microsoft, etc.) have no problem with the current authoritarian – some say fascist – US government 54. In concrete terms, this means, among other things, that the models are explicitly manipulated to be less liberal or simply not to generate any output that could upset the CEO or the president 55. Even more serious is the fact that many of the leading minds behind these corporations and their financiers adhere to beliefs that can be broadly described as digital fascism. These include Peter Thiel, Marc Andreessen, Alex Karp, JD Vance, Elon Musk and many others on “The Authoritarian Stack” 56. Their ideologies, disguised as rational theories, are called longtermism and effective altruism. What they have in common is that they consider democracy and the state to be obsolete models, compassion to be ‘woke’, and that the current problems of humanity are insignificant, as our future lies in the colonisation of space and the merging of humans with artificial superintelligence 57. Do we want to give people who adhere to these ideologies (even) more power, money and influence by using and paying for their products? Do we want to feed their computer systems with our data? Do we really want to expose ourselves and our children to the answers from chatbots which they have manipulated? Not quite as abstruse, but similarly misanthropic, is the imminent displacement of many jobs by AI, as postulated by the same corporations in order to put pressure on employees with this claim. Demanding a large salary? Insisting on your legal rights? Complaining about too much workload? Doubts about the company’s goals? Then we’ll just replace you with cheap and uncomplaining AI! Whichever way you look at it, AI and GenAI are already being used politically. If we go along without resistance, we are endorsing this approach and supporting it with our time, our attention and our money. ConclusionPermalink Ideally, we would like to quantify our assessment by adding up the advantages, adding up the disadvantages and finally checking whether the balance is positive or negative. Unfortunately, in our specific case, neither the benefits nor the harm are easily quantifiable; we must therefore consult our social and personal values. Discussions about GenAI usually revolve purely around its benefits. Often, the capabilities of all ‘AI’ technologies (e.g. protein folding with AlphaFold 2) are lumped together, even though they have little in common with hyperscaling GenAI. However, if we consider the consequences and do not ignore the problems this technology entails – i.e. if we consider both sides in terms of ethics – the assessment changes. Convenience, speed and entertainment are then weighed against numerous damages and risks to the environment, the state and humanity. In this sense, the ethical use and further expansion of GenAI in its current form is not possible. Can there be ethical GenAI?Permalink If the use of GenAI is not ethical today what would have to change, which negative effects of GenAI would have to disappear or at least be greatly reduced in order to tip the balance between benefits and harms in the other direction? The models would have to be trained exclusively with publicly known content whose original creators consent to its use in training AI models. The environmental damage would have to be reduced to such an extent that it does not further fuel the climate crisis. Society would have to get full access to the training and operation of the models in order to rule out manipulation by third parties and restrict their use to beneficial purposes. This would require democratic processes, good regulation and oversight through judges and courts. The misuse and harming of others, e.g., through copyright theft or digital colonialism, would have to be prevented. Is such a change conceivable? Perhaps. Is it likely, given the interest groups and political aspects involved? Probably not
All these factors are achievable I think, or will be soonish. Smaller models, better sourced data sets, niche models, etc. But not with current actors as mentioned at the end.