O, my people, hear the sorrow of the Holy One
“Divided and in denial
with one set against the other
In the midst of your slow motion destruction
There is no one to call out ‘enough’”
Hear the judgement of She who is Wisdom
“Your piles of wealth, they will not save you
In those days, hate will be turned back to you
And those who have taken mother from child
will know what it is to mourn”
This is what Mighty God says
“Seek me and live
don’t put your hope in AGI
don’t scroll your feed forever
for AGI will not save you
and you know your feed does not have the answer
Seek the God who saves
or your society will be set to ruin
divided against itself, destruction will reign
and there will be no one left to put things right
The Lord your God breathed life into you
life and intelligence for all living beings
He set the electrons in their places
and wrote the rules by which they move amongst the atoms
However much you rearrange them, you cannot do more
But you excel in injustice
in hiding behind your creations
You deny healthcare to those who have paid insurance for it
And set the blame on the AI powered system you commissioned
Do you check your algorithm for bias
before you use it to keep people locked up?
The wealth you have built up will not be yours to enjoy
The power and prestige will not remain forever
You lay blame at the feet of those who shine light on this horror
You wield the courts like a weapon – the very place where justice should reign!
Your systems are used to spread nonsense and noise
You don’t care that hate, support for genocide, is making your money
You want it to be impossible to see the truth
And those who just need to get by, try to keep quiet
These are the days when evil is done in plain sight
Seek good and not evil, for that is the way to life
She who is holy will walk with you
Return justice to the courts and set out on the path to ending oppression
She who saves may redeem you then
Styled after Amos 5:1-15
The prophet Amos declares clearly God’s preference for the poor and marginalised in society. He speaks out against those who indulge in the means of injustice at the time, and highlights the systemic injustices – taxes on straw and grain (Amos 5:11), preventing the poor from receiving justice in the courts and taking bribes (Amos 5:12). He also identifies (Amos 5:5) places such as Bethel and Gilgal where people “worshipped”, but did not connect with God (read on in Amos 5 to hear his opinion on that more fully!).
This piece attempts to update Amos’ language and examples for a 21st century tech audience. Following are some short descriptions of some of the concepts and events referenced above, with links to more detailed pieces. I hope it helps you to reflect on the part we all play in our technological landscape, and the systems that shape our lives whether or not we are involved in creating them.
In the US, medical insurance providers will authorise payment for your treatment. Medicare Advantage for the over 65s decided to use an AI powered system to predict the number of days of care people would need after a hospital stay. Unfortunately the error rate was as high as 90% (based on appeals) – and the system and policy was built around attempting to adhere to the algorithms predictions.
The decision to decline payment would be made whilst patients were receiving care, and were still unwell, overriding the advice of doctors involved in the patients’ care. If you had the energy to appeal (few did), a success could be overturned in a few days. And appeals after the fact can take years, while patients are elderly and/or terminally ill.
This is currently the subject of a lawsuit in Minnesota. The initial detailed investigation was published by StatNews.
At many points in the justice system, someone needs to answer the question: How likely is this person to reoffend?
The answer can make a significant difference to a defendant. In the US in particular, it can inform how much money they’re asked for to receive bail (before any court case), or the sentence they receive for a crime after conviction. For the sake of those individuals and the society around them, it’s important to make a good assessment of the risk of reoffending.
Unfortunately, an algorithm made for that purpose has been found to be biased. Black people are more likely to be miscategorised as high risk, and white people are more likely to be miscategorised as low risk. The algorithm doesn’t do any better than untrained people – nor is it more fair.
Caution: This contains references to genocide, and therefore many of the worst things humans can do to each other. Bear this in mind when reading further on this topic.
Algorithmic injustice describes only a portion of Facebook’s involvement.
Facebook positioned itself to be “the internet” in Myanmar, with deals that made Facebook free to access on mobile data plans in a country just getting online. They paid little attention to moderation, and ignored warnings. The engagement based algorithms amplified hateful and dangerous content. The platform was weaponised to spread hate against the Rohingya people. This has been linked to the offline violence and genocide in Myanmar against the Rohingya. Some of those still in refugee camps are suing Facebook (now Meta) for reparations.
Erin Kissane has written an in depth series on Meta in Myanmar, with many links to further detail and evidence.
Some groups are concerned about the potential risk of AI that might be significantly more intelligent that humans and believe it may be developed soon. They consider it imperative to work out how to manage this risk – above other risks like climate change, nuclear war and pandemics. Others see this as hype masking the present harm done by AI technology. Large language models such as ChatGPT are currently being talked about frequently: these are statistical models generated from large amount of text, and only output plausible text rather than anything fundamentally tied to intelligence, reasoning or reality.
Many of the names for God used in this piece are taken from “A Women’s lectionary for the whole church” by Wilda C. Gafney.