If one considers a firm to be a non-human entity that exhibits cognition, then yes. Various religions also exhibit those characteristics, which would fortify the Roman pope’s position with irony.
See Joscha Bach’s claim about religions not publishing their A|B testing at 51:47:
Same thing though. AI is largely a service provided by companies
Yes yes I know, open source models exist, yadda yadda
I think it's safe to say the overwhelming amount of AI usage in the world today is gates by corporations though. The vast majority of people will barely configure their own OS nevermind managing their own locally hosted open source AI instance
Not at all the same thing. AI is a subset of what companies can do, and many if the issues people have with AI are not intrinsic to AI but rather their use in the hands of companies utilizing then for their own benefit.
I think if there were any solution to the lack of jobs due to AI implementation then people would be fine. There isn’t any solution from either party in the US so people are naturally attacking the thing that is causing the problem.
It’s really hard to get people excited about not having jobs when you design a whole society around the idea of having a job and make life exceedingly miserable for anyone who doesn’t
You can’t push both “If you dont work, you dont eat” and “Nobody needs to work anymore” propaganda at the same time. Gotta choose
The solution to the lack of jobs should be a strong social safety net, but Americans don't want this because socialism, so what can you do? You can't really halt progress, and taxing the rich (or corporations) is very unpalatable there, so everyone is kind of stuck.
Things will continue to get worse until people get too desperate and extreme things happen. Then some politician will realize this can rise to power on this, delivering only a few small promises which will lightly alleviate the pressure and then we continue the cycle again.
You need more than just a strong social safety net. If people are losing well-paying jobs, even if the safety net covers their basic needs, their quality of living goes down, and they are potentially also losing something that gives them purpose and something to do with their time, not to mention losing a sense of independence.
Let's suppose that we did get UBI, and AI replaced most jobs. Then we'll basically just have the wealthy elite who control the resources and the AIs, and everyone else who live off of the basic income, with no real way to increase their wealth. That still sounds dystopian to me.
And to be clear, I am not at all opposed to a better safety net, but it should be a safety net, not a replacement for employment for most of the population.
Also, I don't think it is very likely that AI will replace everyone's job. But I am worried that it will result in shrinking the middle class, and increasing wealth disparity.
"Stuff". What does it matter? I'm saying that the ceiling doesn't have to be "covers your basic needs". The fact that I haven't presented a full plan doesn't mean my point is invalid.
People were fed up at "Occupy Wallstreet", but the media and craven political situation absorbed those movements back into the fold. Forget "fed up". When do we start seeing actions that don't feed directly back into the oligarchy's capture?
Yes! I've felt exactly the same. Everything people have taken issue with - "plagiarism," concentration of wealth and power, termination of jobs, environmental harm to feed data centers, land being wasted on new datacenters, resources being distributed terribly so as to feed the AI monster, slopcode being shit out as fast as possible to stay ahead of the market, software quality dropping for the same reason, engineers phoning it in at work to hit LLM KPIs, it's all just capitalism in its most raw, inevitable, end game form.
Edit: Someone replied to this with a question. I'm rate-limited here for getting into a flamewar with a PRC citizen that was gloating to me about my country being possibly invaded soon (which, fair, flamewars are bad), so I'll need to put my reply below:
There's no exact road map, but generally speaking, in our capitalist countries today, wealth started out more distributed, and governments had more power, in the beginning of their liberalization. States often competed in markets or simply nationalized things like power, healthcare, education. Ongoing examples of that are lots of places in Europe.
With the advent of neoliberalism (Thatcher, Reagan), concentrated capital converts more easily to political power in an exponential manner - more money, more ability to buy government, leads to more money, more ability to buy government.
Corporations are profit generation algorithms. They want the profit to always go up, and when they run against the barriers of laws (restricting their environmental impact, ability to underpay their workers, create cheap and dangerous working environments, do international trade in some way), naturally the next investment step is to remove those barriers.
So, early capitalism is strong regulation, socialized services and infrastructure, government competition, some nationalization, and private ownership of the means of production.
Late stage capitalism is weak/no regulation, no services, privatized infrastructure, no government competition, no nationalization, sectors tending towards monopolization, and wealth concentration.
"Raw capitalism" is where the commodification of everything is complete.
so maybe we'll get to the right place by accident when all companies are effectively replaced by ai ha ha. (not putting a high %age likelihood on that one, obviously, just being cheeky)
he probably fed it through claude before posting, I find that ever since AI has become mainstream all of my colleagues are providing fascinatingly well written prose, but only in Slack, during lunch they go back to basketball
I have no qualms about people writing AI assisted stuff, the points being made matter more.
Of course it's annoying if a single sentence is blown up into a page of prose by AI and an AI summarizes it into a different sentence on the other end :)
It's kind of worth reading. Not to learn about AI. But... it is an interesting/historic intersection of religion and technology.
Side note: (a) This new pope is very good at "political rhetoric" and (dare I say) polemic. He's a lot more relevant than recent popes. (b) There seems to have been a vibe shift, re: secular sentiments towards religion.
There is potentially a lot happening at this intersection... say catholicism and AI.
For example... LLMs make scripture a lot more accessible. That tends to be impactful, historically. It's Augustine, Aquinas, Spinoza and Schmidt. This kind of thing is a niche interest... even among the faithful, but an important niche. And... it just answers your questions, patiently.
It's also a therapist, confidant and advice giver... potentially a confessor or priest. Talk of "making an AI god" got a little stale, but... there are many ways that LLMs might take god-like roles in people's lives.
Predictions are futile, but I suspect we are going to see AI encroachment into religious/spiritual domains. I further suspect that good, natural, conversational audio is the bottleneck.
Personally... I'm curious about this Pope/AI thing. I find it interesting.
Vatican's statements are often grounded in humanity.
They sue for peace in Ukraine / Middle East, humane treatments of immigrants, warn against nuclear weapons, AI, etc..
I go to Church often, there's always a prayer for peace during Mass.
What I like about Pope Leo is that he's talking about current issues that affect people.
I think the Church spent way too much time focusing on matters of sexuality and causing problems. While those are still important, it appears that it's no longer the sole focus of the Church, which is a good thing.
Another thing that I really like is the unification efforts with other religions _and_ Protestants.. recently we had a female Protestant Bishop meeting with the Pope, that was wonderful to watch.
Not known for deep understanding of high technology? The Catholic Church was behind the scientific discovery of The Big Bang through the Catholic priest (and astrophysicist) Lamaître. Mendel, the father of modern genetics, was an Augustinian friar. Steno, a Catholic bishop, formulated the foundational principles of stratigraphy, establishing geology as a formal science. Secchi, a Jesuit priest, was a pioneer in spectroscopy and the first to establish that the Sun is a star, creating the first stellar classification system.
Sure, we’ll get a tyrannical worm phase… but really I think I’d prefer that to the path of tech bros and MBAs controlling my universe. At least it makes the focus clear.
I think you might have skipped over the 10,000+ years of strict feudalism, a shrouded theocracy pushing their century-spanning agendas, aristocracy through landed gentry, and a drug-addled transportation cartel, all overseen by a massive, monopolistic megacorporation that controls all trade, economic affairs, and commerce throughout the universe. And everyone's a drug addict if they can afford it.
But sure, at least they didn't have AI! lol!
In other words, Warhammer 40K but without any aliens to trigger a massive xenophobic response that removed all warlike guardrails.
Times have changed in a lot of dimensions. To name 2: 1) we have an AI thing now, and 2) the pope is American and more trustworthy than all of our current top politicians of both parties.
It's not like people are longing for times of papal authority, they're just looking for anyone at all with common sense.
15 years ago it was Pope Benedict, who was a pretty different figure. I can speak only for myself, but I would have had more cynicism about him than I would for Francis or Leo.
I find it difficult to see how even the measured words from the pope can actually enact this changed needed to 'disarm' AI. The forces behind the armament/war of AI development are innate to the qualities of our governance systems, capitalism, and human behavior, and AI itself.
None of these will go away until something breaks catastrophically, when it will be too late. And even then it will be short repose from another iteration for as long as we are in the digital information age.
There are only two steady end states that I see... either a global surveillance totalitarian system under the industrial complex, or, a radical change of the environment in which the aforementioned can be sustained.
> 110. Finally, I would like to employ the expression “to disarm,” which is close to my heart. Disarming AI means freeing it from the mentality of “armed” competition, which today is not limited simply to the military context, but is also an economic and cognitive phenomenon. This entails a race for ever more powerful algorithms and larger datasets, driven by the desire to secure geopolitical or commercial dominance. To disarm means discrediting the assumption that technical power automatically confers the right to govern. To disarm does not mean rejecting technology, but preventing it from dominating humanity. It means freeing technology from monopolistic control and opening it to discussion and debate, therefore making it human-friendly and restoring it to the plurality of human cultures and ways of life. Our task today is not only ethical or technical. It is ecological in the deepest sense, for it concerns a new dimension of our common home. AI is already an environment in which we are immersed, as well as a force with which we must engage. For this reason, merely regulating it is insufficient; it must be disarmed, welcoming and accessible.
you know.. a lot of changes came from just words. literally our modern society tend to sway the public opinion through just words from news and influencers..
the guys name is Leo because the pope who was around for the industrial revolution was named Leo. I think he also has a math PhD but I could be wrong. he's 100% paying attention
> A more moral AI is not enough if that morality is determined by a few
Particularly ironic considering the history of the Church.
I mean, it is not wrong, but that's essentially the business of essentially every church, religion, cult,... whatever you call your spiritual organization.
And for claiming to have some authority on social justice when women are shunned from priesthood and leadership roles. At least they're coming around a little bit with the first woman appointee of a head of a dept of the roman curia in 2025.
Between the Canadian residential schools and sexual abuse scandals alone, it's shocking that people actually look to the holy see as any kind of moral authority. Nevermind the connections to slavery, fascism, and even the cosa nostra.
I would love for the Pope to answer this question:
If a technology existed that reduced the cost of producing a critical thing (think food, housing, medical care) down to near zero, however, it made the humans currently building the thing redundant, should we build it? Would it be okay to use the hyper-optimization power of Capitalism to build such a technology faster?
Before someone yells at me about this not being the current situation, I think that is the endgame of most of this AI development and in fact the endgame is even more comforting: If it takes 10 construction workers at $60,000/annum to build one home, I can forsee the descendants of current AI tech enabling 10 construction workers at $150,000/annum building 5 homes in the same time with an even larger profit margin for the corporation involved.
But as a clear moral quandary, I think the Pope should consider the first situation.
If the technology is used to serve humanity by providing food or housing, it seems like his stance would be approving. But if it was used to increase profits and people still starved that would be bad, right?
"AI must be used for the good of humanity" isn't even an anti ai position really.
"by providing food or housing" vs "if it was used to increase profits"
Why..not both? I know this question is naive, but there is nothing that "hard-codes" AI to only increase profits at the cost of providing food or housing for much cheaper prices. Yes a Private equity firm could later insert itself and jack up prices and play such games, but that isn't baked into the technology itself.
And as such, the technology seems the wrong thing to be litigating.
"At this point, tech biz leaders are massively over-reaching and trying to influence the rest of us:"
I realize this is what's happening on the headlines, but most of the technology being "deployed" is back-office automation, robotics etc. that no one writes about and none of the tech baddies have monopolistic control over. I refuse to let muxk, thiel, Karp to run the conversation and setup the reaction either. It is exciting and dramatic but not necessarily influential.
If it’s a monopoly yes. But there are massive profits in full automation. I’m not expecting costs to go to zero but it’s the only pathway to things getting cheaper by a lot.
This makes me think of enlightened self interest. If the tech elite crush everyone by automating too fast then the economy collapses and people don’t have the money to pay them and their advertisers, so it will wind up hurting them directly too. Enlightened self interest SHOULD keep those same people in check finding a way to use the technology to empower advances in efficiency that empower people not just corporations. But the AI leaders don’t outwardly seem to think about these issues, and when asked just brush past them. We should not stop tech progress even if it were possible in a global competitive environment (which it is not), but there are some moral issues that should guide tech leaders in decision making, not just profit motives.
The Catholic Church has at present no answer to that question. The contemporary political-economic stance of the Catholic Church is based on economic liberalism and capitalism and maintaining a just balance between capital and labour, as indeed mentioned in the encyclical itself.
I don't think anyone has an answer to that question at present, honestly.
Unfortunately, he did not mention the moral responsabilities of the Silicon Valley technopower in delivering and selling a technology so society-impact only for making themselves and their shareholders richier.
Why would we listen to him? Even he doesn’t believe in God.
Jesus let the Romans take him. The pope drives around in an armoured car with hundreds of soldiers. Why? After all, he’s the official spokesperson of God. He’s either untouchable, or would be endlessly rewarded with sainthood for being a martyr.
Good luck with that. Capitalism doesn't work that way. AI will make money for some companies, but as always, it will be on our expense, not for our benefit. We will get some convenient features, we will grow dependent, and eventually subscriptions will be squeezed as far as we are able to pay, advertising will take over, we will have less choice and worse service.
By then we might not even have computers anymore, or we might have "transparent" computers, i.e. have everything on the cloud and just tell our AI agents what to do.
Sorry Pope Leo, things are not going to suddenly turn into a wonderful utopia, but maybe buy some stocks so you can at least make a buck from what's coming.
Capitalism tends to benefit most people, like capitalist enterprise makes food, clothing, cars and the like and most get some benefit. I'm not convinced by the on our expense bit on the whole. It can have glitches sometimes of course.
Arguably, all the industries that you mentioned (clothing, food, automotive) have the same symptoms, doing everything possible to increase growth even (and often) at the expense of shipping worse products. At least, this has been my experience with clothing, electronics, appliances, and honestly almost everything. It's very hard today to find good long lasting products. A couple of decades ago you could expect your purchase to last a while, today - hardly.
What point are you trying to make here, because your post is all over the place and never really goes anywhere.
The pope is not claiming utopia is possible. He is reminding the world of its moral duties within this scope. "Capitalism" is not a system that we helpless atoms merely get pushed around in. How good the world is depends on each one of us choosing to do our moral duty toward the common good. There is no "system" that will, without effort on the part of its citizens, straighten the crooked timber of humanity and relieve human beings of their moral responsibilities.
Nah, I think that's a bit of a cop-out. Capitalism heavily incentivizes competition at the detriment of everything else. You can talk about moral duties all you want, but in a hyper-competitive environment, if you don't do the thing, the other guy will. Societies don't necessarily have to be structured in such ways.
My point is AI is not going to be built to "benefit humanity" because that's not the incentive in our economy. AI might give us some benefits, but like all tech products currently, it will be designed to benefit corporations and shareholders. It is what it is.
I’m not going to be contented until I can get Ja’s take on if LLMs even have the slightest potential to be an engine behind artificial general intelligence. Or that they definitely won’t be but the ideas that will come from layering and transformers will be vital for example.
LLMs are some of the most fairly distributed technology in history. It's actual insane how equitable global access is, especially compared to the previous evolutions of the computer industry (mainframes, then desktop, and eventually mobile phones). People are just saying stuff to say stuff at this point.
Dupe, more or less. https://news.ycombinator.com/item?id=48265206
I have found that, for many of the statements about what AI should do, I would actally be happier if the letters "AI" were replaced with "companies"
...you could also swap out with "rich people" or "all people," "governments."
In fact, reading these sentences with ad-lib on the subject tends to give these sentences interestingly different connotations.
That's because it's a meaningless, populist trope. There is zero helpful information, solution or context which depends on the specific issue at hand.
Well, as Nick Land said, "Capitalism and Artificial Intelligence are the same thing"
And he meant it as a good thing. Something to be embraced.
If one considers a firm to be a non-human entity that exhibits cognition, then yes. Various religions also exhibit those characteristics, which would fortify the Roman pope’s position with irony.
See Joscha Bach’s claim about religions not publishing their A|B testing at 51:47:
https://youtu.be/7bqdPHLIY8w
And while your comment has validity, in the US the phrase uttered by Presidential candidate Mitt Romney adds a layer of complexity:
“Corporations are people, my friend.”
Same thing though. AI is largely a service provided by companies
Yes yes I know, open source models exist, yadda yadda
I think it's safe to say the overwhelming amount of AI usage in the world today is gates by corporations though. The vast majority of people will barely configure their own OS nevermind managing their own locally hosted open source AI instance
Not at all the same thing. AI is a subset of what companies can do, and many if the issues people have with AI are not intrinsic to AI but rather their use in the hands of companies utilizing then for their own benefit.
Open source models don't exist. Open-weight ones do, which are more equivalent to freeware than free software.
Fair enough, thank you for the correction
I don't think anyone actually has an issue with AI. I think people are finally fed up with late-stage capitalism and lashing out.
I think if there were any solution to the lack of jobs due to AI implementation then people would be fine. There isn’t any solution from either party in the US so people are naturally attacking the thing that is causing the problem.
It’s really hard to get people excited about not having jobs when you design a whole society around the idea of having a job and make life exceedingly miserable for anyone who doesn’t
You can’t push both “If you dont work, you dont eat” and “Nobody needs to work anymore” propaganda at the same time. Gotta choose
The solution to the lack of jobs should be a strong social safety net, but Americans don't want this because socialism, so what can you do? You can't really halt progress, and taxing the rich (or corporations) is very unpalatable there, so everyone is kind of stuck.
Things will continue to get worse until people get too desperate and extreme things happen. Then some politician will realize this can rise to power on this, delivering only a few small promises which will lightly alleviate the pressure and then we continue the cycle again.
You need more than just a strong social safety net. If people are losing well-paying jobs, even if the safety net covers their basic needs, their quality of living goes down, and they are potentially also losing something that gives them purpose and something to do with their time, not to mention losing a sense of independence.
Let's suppose that we did get UBI, and AI replaced most jobs. Then we'll basically just have the wealthy elite who control the resources and the AIs, and everyone else who live off of the basic income, with no real way to increase their wealth. That still sounds dystopian to me.
And to be clear, I am not at all opposed to a better safety net, but it should be a safety net, not a replacement for employment for most of the population.
Also, I don't think it is very likely that AI will replace everyone's job. But I am worried that it will result in shrinking the middle class, and increasing wealth disparity.
Switzerland pays you your previous salary for two years if you're laid off. "Covers your basic needs" isn't a ceiling for a social safety net.
And what happens after those two years if there just aren't enough jobs to be had?
"Stuff". What does it matter? I'm saying that the ceiling doesn't have to be "covers your basic needs". The fact that I haven't presented a full plan doesn't mean my point is invalid.
People were fed up at "Occupy Wallstreet", but the media and craven political situation absorbed those movements back into the fold. Forget "fed up". When do we start seeing actions that don't feed directly back into the oligarchy's capture?
Yes! I've felt exactly the same. Everything people have taken issue with - "plagiarism," concentration of wealth and power, termination of jobs, environmental harm to feed data centers, land being wasted on new datacenters, resources being distributed terribly so as to feed the AI monster, slopcode being shit out as fast as possible to stay ahead of the market, software quality dropping for the same reason, engineers phoning it in at work to hit LLM KPIs, it's all just capitalism in its most raw, inevitable, end game form.
Edit: Someone replied to this with a question. I'm rate-limited here for getting into a flamewar with a PRC citizen that was gloating to me about my country being possibly invaded soon (which, fair, flamewars are bad), so I'll need to put my reply below:
There's no exact road map, but generally speaking, in our capitalist countries today, wealth started out more distributed, and governments had more power, in the beginning of their liberalization. States often competed in markets or simply nationalized things like power, healthcare, education. Ongoing examples of that are lots of places in Europe.
With the advent of neoliberalism (Thatcher, Reagan), concentrated capital converts more easily to political power in an exponential manner - more money, more ability to buy government, leads to more money, more ability to buy government.
Corporations are profit generation algorithms. They want the profit to always go up, and when they run against the barriers of laws (restricting their environmental impact, ability to underpay their workers, create cheap and dangerous working environments, do international trade in some way), naturally the next investment step is to remove those barriers.
So, early capitalism is strong regulation, socialized services and infrastructure, government competition, some nationalization, and private ownership of the means of production.
Late stage capitalism is weak/no regulation, no services, privatized infrastructure, no government competition, no nationalization, sectors tending towards monopolization, and wealth concentration.
"Raw capitalism" is where the commodification of everything is complete.
"it's all just capitalism in its most raw, inevitable, end game form."
Can you explain, what would be early capitalism and what is the difference to "end game capitalism" to you?
so maybe we'll get to the right place by accident when all companies are effectively replaced by ai ha ha. (not putting a high %age likelihood on that one, obviously, just being cheeky)
This is a surprisingly nuanced and technically literate take on this topic. Kudos.
I wonder if this sort of thing got this dude elected, to navigate the changing times.
(duplicating my comment from the other thread as this seems to have more traction)
maybe we will have a new Rerum Novarum
he probably fed it through claude before posting, I find that ever since AI has become mainstream all of my colleagues are providing fascinatingly well written prose, but only in Slack, during lunch they go back to basketball
I have no qualms about people writing AI assisted stuff, the points being made matter more.
Of course it's annoying if a single sentence is blown up into a page of prose by AI and an AI summarizes it into a different sentence on the other end :)
It's kind of worth reading. Not to learn about AI. But... it is an interesting/historic intersection of religion and technology.
Side note: (a) This new pope is very good at "political rhetoric" and (dare I say) polemic. He's a lot more relevant than recent popes. (b) There seems to have been a vibe shift, re: secular sentiments towards religion.
There is potentially a lot happening at this intersection... say catholicism and AI.
For example... LLMs make scripture a lot more accessible. That tends to be impactful, historically. It's Augustine, Aquinas, Spinoza and Schmidt. This kind of thing is a niche interest... even among the faithful, but an important niche. And... it just answers your questions, patiently.
It's also a therapist, confidant and advice giver... potentially a confessor or priest. Talk of "making an AI god" got a little stale, but... there are many ways that LLMs might take god-like roles in people's lives.
Predictions are futile, but I suspect we are going to see AI encroachment into religious/spiritual domains. I further suspect that good, natural, conversational audio is the bottleneck.
Personally... I'm curious about this Pope/AI thing. I find it interesting.
I'm an atheist, but I have to admit the previous guy was pretty dope.
The Pope has a better understanding of what's at stake that many of 'our' (lobbied) politicians.
Vatican's statements are often grounded in humanity.
They sue for peace in Ukraine / Middle East, humane treatments of immigrants, warn against nuclear weapons, AI, etc..
I go to Church often, there's always a prayer for peace during Mass.
What I like about Pope Leo is that he's talking about current issues that affect people.
I think the Church spent way too much time focusing on matters of sexuality and causing problems. While those are still important, it appears that it's no longer the sole focus of the Church, which is a good thing.
Another thing that I really like is the unification efforts with other religions _and_ Protestants.. recently we had a female Protestant Bishop meeting with the Pope, that was wonderful to watch.
If you haven't read the earlier treatise from January 2025 from the Vatican on Artificial Intelligence, it's well worth the read. https://www.vatican.va/roman_curia/congregations/cfaith/docu...
Amazing insight from an organization not traditionally known for a deep understanding of high technology.
Not known for deep understanding of high technology? The Catholic Church was behind the scientific discovery of The Big Bang through the Catholic priest (and astrophysicist) Lamaître. Mendel, the father of modern genetics, was an Augustinian friar. Steno, a Catholic bishop, formulated the foundational principles of stratigraphy, establishing geology as a formal science. Secchi, a Jesuit priest, was a pioneer in spectroscopy and the first to establish that the Sun is a star, creating the first stellar classification system.
Time to start on the first draft of the orange Catholic bible
I'm down to start a butleirian jihad
Already in full swing: https://www.reddit.com/r/PoisonFountain/
Sure, we’ll get a tyrannical worm phase… but really I think I’d prefer that to the path of tech bros and MBAs controlling my universe. At least it makes the focus clear.
I think you might have skipped over the 10,000+ years of strict feudalism, a shrouded theocracy pushing their century-spanning agendas, aristocracy through landed gentry, and a drug-addled transportation cartel, all overseen by a massive, monopolistic megacorporation that controls all trade, economic affairs, and commerce throughout the universe. And everyone's a drug addict if they can afford it.
But sure, at least they didn't have AI! lol!
In other words, Warhammer 40K but without any aliens to trigger a massive xenophobic response that removed all warlike guardrails.
[flagged]
Times have changed in a lot of dimensions. To name 2: 1) we have an AI thing now, and 2) the pope is American and more trustworthy than all of our current top politicians of both parties.
It's not like people are longing for times of papal authority, they're just looking for anyone at all with common sense.
> more trustworthy than all of our current top politicians of both parties.
Big if true. Has he addressed the previous rug sweeps about clerical child abuse?
Yes: https://www.reuters.com/world/pope-leo-tells-catholic-bishop...
Thanks, sounds reasonable
15 years ago it was Pope Benedict, who was a pretty different figure. I can speak only for myself, but I would have had more cynicism about him than I would for Francis or Leo.
That past HN user would be more shocked that Chrome is not considered the second coming of Jesus anymore, to keep the religious theme.
Great to see the Pope recognises the gravity of what is to come with AI and is coming out early with this.
I noticed ads on churches in Mexico City for this earlier this year, https://juanito.ai
I find it difficult to see how even the measured words from the pope can actually enact this changed needed to 'disarm' AI. The forces behind the armament/war of AI development are innate to the qualities of our governance systems, capitalism, and human behavior, and AI itself.
None of these will go away until something breaks catastrophically, when it will be too late. And even then it will be short repose from another iteration for as long as we are in the digital information age.
There are only two steady end states that I see... either a global surveillance totalitarian system under the industrial complex, or, a radical change of the environment in which the aforementioned can be sustained.
> 110. Finally, I would like to employ the expression “to disarm,” which is close to my heart. Disarming AI means freeing it from the mentality of “armed” competition, which today is not limited simply to the military context, but is also an economic and cognitive phenomenon. This entails a race for ever more powerful algorithms and larger datasets, driven by the desire to secure geopolitical or commercial dominance. To disarm means discrediting the assumption that technical power automatically confers the right to govern. To disarm does not mean rejecting technology, but preventing it from dominating humanity. It means freeing technology from monopolistic control and opening it to discussion and debate, therefore making it human-friendly and restoring it to the plurality of human cultures and ways of life. Our task today is not only ethical or technical. It is ecological in the deepest sense, for it concerns a new dimension of our common home. AI is already an environment in which we are immersed, as well as a force with which we must engage. For this reason, merely regulating it is insufficient; it must be disarmed, welcoming and accessible.
you know.. a lot of changes came from just words. literally our modern society tend to sway the public opinion through just words from news and influencers..
the guys name is Leo because the pope who was around for the industrial revolution was named Leo. I think he also has a math PhD but I could be wrong. he's 100% paying attention
It’s a Master’s not a PhD, but in math, yes.
> A more moral AI is not enough if that morality is determined by a few
Particularly ironic considering the history of the Church.
I mean, it is not wrong, but that's essentially the business of essentially every church, religion, cult,... whatever you call your spiritual organization.
And for claiming to have some authority on social justice when women are shunned from priesthood and leadership roles. At least they're coming around a little bit with the first woman appointee of a head of a dept of the roman curia in 2025.
Between the Canadian residential schools and sexual abuse scandals alone, it's shocking that people actually look to the holy see as any kind of moral authority. Nevermind the connections to slavery, fascism, and even the cosa nostra.
I would love for the Pope to answer this question:
If a technology existed that reduced the cost of producing a critical thing (think food, housing, medical care) down to near zero, however, it made the humans currently building the thing redundant, should we build it? Would it be okay to use the hyper-optimization power of Capitalism to build such a technology faster?
Before someone yells at me about this not being the current situation, I think that is the endgame of most of this AI development and in fact the endgame is even more comforting: If it takes 10 construction workers at $60,000/annum to build one home, I can forsee the descendants of current AI tech enabling 10 construction workers at $150,000/annum building 5 homes in the same time with an even larger profit margin for the corporation involved.
But as a clear moral quandary, I think the Pope should consider the first situation.
If the technology is used to serve humanity by providing food or housing, it seems like his stance would be approving. But if it was used to increase profits and people still starved that would be bad, right?
"AI must be used for the good of humanity" isn't even an anti ai position really.
"by providing food or housing" vs "if it was used to increase profits"
Why..not both? I know this question is naive, but there is nothing that "hard-codes" AI to only increase profits at the cost of providing food or housing for much cheaper prices. Yes a Private equity firm could later insert itself and jack up prices and play such games, but that isn't baked into the technology itself.
And as such, the technology seems the wrong thing to be litigating.
Tech is supposed to be a tool that serves other products ends, not an end in itself.
At this point, tech biz leaders are massively over-reaching and trying to influence the rest of us: muxk, thiel, Karp, etc.
So it should be no surprise that the rest of us are ready, willing and able to push back just as hard.
tech biz leads should just run their companies and stop trying to play president or god
"At this point, tech biz leaders are massively over-reaching and trying to influence the rest of us:"
I realize this is what's happening on the headlines, but most of the technology being "deployed" is back-office automation, robotics etc. that no one writes about and none of the tech baddies have monopolistic control over. I refuse to let muxk, thiel, Karp to run the conversation and setup the reaction either. It is exciting and dramatic but not necessarily influential.
There aren't any profits with full automation - but there is instead total power for whoever owns that automation.
If it’s a monopoly yes. But there are massive profits in full automation. I’m not expecting costs to go to zero but it’s the only pathway to things getting cheaper by a lot.
Where are these profits coming from? Remember, under full automation there aren't any workers earning salaries.
Meanwhile, costs of production fall to zero. So what will there be for these profitable companies to spend their profits on?
This makes me think of enlightened self interest. If the tech elite crush everyone by automating too fast then the economy collapses and people don’t have the money to pay them and their advertisers, so it will wind up hurting them directly too. Enlightened self interest SHOULD keep those same people in check finding a way to use the technology to empower advances in efficiency that empower people not just corporations. But the AI leaders don’t outwardly seem to think about these issues, and when asked just brush past them. We should not stop tech progress even if it were possible in a global competitive environment (which it is not), but there are some moral issues that should guide tech leaders in decision making, not just profit motives.
The Catholic Church has at present no answer to that question. The contemporary political-economic stance of the Catholic Church is based on economic liberalism and capitalism and maintaining a just balance between capital and labour, as indeed mentioned in the encyclical itself.
I don't think anyone has an answer to that question at present, honestly.
Unfortunately, he did not mention the moral responsabilities of the Silicon Valley technopower in delivering and selling a technology so society-impact only for making themselves and their shareholders richier.
Actually, he did, extensively.
[dupe] Discussion on source: https://news.ycombinator.com/item?id=48265206
Why would we listen to him? Even he doesn’t believe in God.
Jesus let the Romans take him. The pope drives around in an armoured car with hundreds of soldiers. Why? After all, he’s the official spokesperson of God. He’s either untouchable, or would be endlessly rewarded with sainthood for being a martyr.
But he obviously doesn’t believe that.
Good luck with that. Capitalism doesn't work that way. AI will make money for some companies, but as always, it will be on our expense, not for our benefit. We will get some convenient features, we will grow dependent, and eventually subscriptions will be squeezed as far as we are able to pay, advertising will take over, we will have less choice and worse service.
By then we might not even have computers anymore, or we might have "transparent" computers, i.e. have everything on the cloud and just tell our AI agents what to do.
Sorry Pope Leo, things are not going to suddenly turn into a wonderful utopia, but maybe buy some stocks so you can at least make a buck from what's coming.
Capitalism tends to benefit most people, like capitalist enterprise makes food, clothing, cars and the like and most get some benefit. I'm not convinced by the on our expense bit on the whole. It can have glitches sometimes of course.
Arguably, all the industries that you mentioned (clothing, food, automotive) have the same symptoms, doing everything possible to increase growth even (and often) at the expense of shipping worse products. At least, this has been my experience with clothing, electronics, appliances, and honestly almost everything. It's very hard today to find good long lasting products. A couple of decades ago you could expect your purchase to last a while, today - hardly.
Any good tickers?
What point are you trying to make here, because your post is all over the place and never really goes anywhere.
The pope is not claiming utopia is possible. He is reminding the world of its moral duties within this scope. "Capitalism" is not a system that we helpless atoms merely get pushed around in. How good the world is depends on each one of us choosing to do our moral duty toward the common good. There is no "system" that will, without effort on the part of its citizens, straighten the crooked timber of humanity and relieve human beings of their moral responsibilities.
Nah, I think that's a bit of a cop-out. Capitalism heavily incentivizes competition at the detriment of everything else. You can talk about moral duties all you want, but in a hyper-competitive environment, if you don't do the thing, the other guy will. Societies don't necessarily have to be structured in such ways.
My point is AI is not going to be built to "benefit humanity" because that's not the incentive in our economy. AI might give us some benefits, but like all tech products currently, it will be designed to benefit corporations and shareholders. It is what it is.
Cool. Any other celebrities with hot takes?
I’m not going to be contented until I can get Ja’s take on if LLMs even have the slightest potential to be an engine behind artificial general intelligence. Or that they definitely won’t be but the ideas that will come from layering and transformers will be vital for example.
said from someone lives in a palace
LLMs are some of the most fairly distributed technology in history. It's actual insane how equitable global access is, especially compared to the previous evolutions of the computer industry (mainframes, then desktop, and eventually mobile phones). People are just saying stuff to say stuff at this point.