Sunday 6 June 2021

Slaughterbot #1

Killer drones hit the headlines recently in the Nagorno-Karabakh region, when Azerbaijani drones seem to have decisively defeated Armenian mechanised forces. The evidence that drones played a decisive role in Azerbaijan's victory seems pretty convincing (although others have denied that this really is an extinction-level event for the charismatic megafauna of the battlefield, as Charlie Stross called tanks).

Whoever's right on the state of play in the drones vs. tanks arms race, in one sense this isn't a paradigm shift. The drones being used in Nagorno-Karabakh weren't autonomous, but remotely controlled by humans. In that sense they're just another incremental step in a process of humans being able to kill other humans ever more remotely. The process had already gone far enough for George Orwell to comment on how far we as a species had anonymised killing through technology eighty years ago:

As I write, highly civilized human beings are flying overhead, trying to kill me.

They do not feel any enmity against me as an individual, nor I against them. They are ‘only doing their duty’, as the saying goes. Most of them, I have no doubt, are kind-hearted law-abiding men who would never dream of committing murder in private life. On the other hand, if one of them succeeds in blowing me to pieces with a well-placed bomb, he will never sleep any the worse for it. He is serving his country, which has the power to absolve him from evil.

To quote again that old passage from Ecclesiastes, which was a favourite of Orwell's for its simple, resonant language:

The thing that hath been, it is that which shall be; and that which is done is that which shall be done: and there is no new thing under the sun. The thing that hath been, it is that which shall be; and that which is done is that which shall be done: and there is no new thing under the sun. 

Except, maybe there is a new thing under the sun. Remote killing where no human directly identifies a target and an algorithm decides who's friend or foe, who lives and who dies. Concerned AI researchers have been making a noise about this possibility for some time. The recent sci fi short film Slaughterbots highlighted the danger. Slaughterbots is fiction, but according to a UN report cited by Ed Nash, a Slaughterbot-style autonomous drone may have already killed without any human being directly involved in the target selection. Last year.

If you didn't already think 2020 was unsettling enough, this five minute video might change your mind:


0 comments: