Holy See: ‘No algorithm can make war morally acceptable’
By Lorenzo Freggiaro
The Holy See has submitted a working paper on Lethal Autonomous Weapons Systems (LAWS) to the Seventh Review Conference of the CCW, taking place in Geneva on November 16-20.
The document notes that the questions raised by LAWS have been examined for over a decade. It points to the final report of the Group of Governmental Experts, adopted on September 3, as proof of a broad convergence.
“The time has now come” to turn this shared knowledge into a concrete, operational framework, the paper says. It echoes the invitation of Pope Leo XIV in his encyclical Magnifica humanitas to curb the technological arms race and protect civilians.
Machines calculate, humans judgeAt the heart of the paper is an anthropological claim: machines can only perform calculations, while moral judgement involves conscience and the recognition of others as persons.
For this reason, the Holy See argues, irreversible decisions such as those concerning life and death cannot be entrusted to artificial systems.
Beyond compliance with humanitarian lawThe paper stresses that respect for international humanitarian law is indispensable, but not enough. Compliance does not answer the prior question of whether lethal force can be delegated at all.
Some conduct, it notes, may not be explicitly prohibited yet remains contrary to the dictates of public conscience, as the Martens Clause recognizes.
Concepts such as proportionality and unnecessary suffering also require interpretation, good faith and prudent judgement, which are “uniquely irreplaceable human virtues.”
The document further warns about unpredictability. Self-learning systems, programming errors, biased data, cyberattacks or unforeseen interactions between opposing algorithms could trigger rapid and uncontrollable escalation.
Control, time and accountabilityThe Holy See insists that human control must be effective, self-aware and responsible.
Authorization should take into account the context, the system’s limitations and the foreseeable consequences, and limits must remain enforceable even when communications are degraded.
Speed must not become the supreme criterion. Interfaces and procedures must give human authorities a genuine chance to question a recommendation and withhold force.
Where the pace of operations makes this impossible, the paper says, nominal oversight is not real control.
Responsibility, finally, cannot be transferred to “the machine.” Those who design, train, authorise and use these technologies must answer for them, supported by documented roles, system records and operational logs.
The way forwardThe paper reiterates the Holy See’s call for a moratorium on the development and use of LAWS, with a clear prohibition on systems that target human beings or can be expected to cause accidental casualties.
It invokes the “disarming” of technology, which does not mean opposing progress. AI can still serve the protection of civilians, early warning, and the verification of arms control agreements.
The Holy See also revives its 2021 proposal for an International Organization for Artificial Intelligence. It suggests exploring a body to monitor the peaceful use of AI, similar to those that oversee outer space activities.
Read at the source
This article was originally published on Vatican News