Raging Against the Algorithm: Google and Persuasive Technology

Binoy Kampmark

“The founder of Netscape said software is going to eat the world.”
Tristan Harris, Centre for Humane Technology, June 25 2019

Monsters and titans share the stage of mythology across cultures as the necessary realisations of the human imagination. From stone cave to urban dwelling, the theme is unremitting; kept in the imagination, such creatures perform, innocently enough, benign functions. The catch here is the human tendency to realise such creatures. They take the form of social engineering and utopia.

Folly bound, such projects and ventures wind up corrupting and degrading. The monster is born, and the awful truth comes to the fore: the concentration camp, the surveillance state, newspeak, the armies of censorship.

The technology giants of the current era are the modern utopians, indulging human hunger and interests by shaping them. One company gives us the archetype. It is Google, which has the unusual distinction of being both noun and verb, entity and action.

Google’s power is disproportionately vast, a creepy sprawl that cherishes transparency while lacking it, and treasuring information while regulating its reach. It is also an entity that has gone beyond being a mere repository of searches and data, an attempt to induce behavioural change on the part of users.

Google always gives the impression that its users are in the lead, autonomous, independent in a verdant land of digital frolicking. The idea that the company itself fosters such change, teasing out alterations in behaviour, is placed to one side.

There are no Svengalis in Googleland, because we are all free. Free, but needing assistance amidst chaos and “multitasking”.

People have what the company calls “micro-moments”, those, as behavioural economist Dan Ariely describes as “on-the-go mobile moments” where decisions are reached by a user while engaged, simultaneously, in a range of tasks: hotels to book, travel choices to make, work schedules to fulfil.

While Ariely is writing more broadly from the perspective of the ubiquitous digital marketer, the language is pure Googleleese, smacking of part persuasion and part imposition.

“Want to develop a strategy to shape your consumer decisions?” asks Google. “Start by understanding the key micro-moments in their journey.” Understand them; feed their mind; hold their hand.

The addiction to Google produces what can no longer be seen as retarding, but fostering. A generation is growing up without a hard copy research library, a ready-to-hand list of classics, and the means to search through records without resorting to those damnable digital keys.

Debates are bound to be had (some already pollute the digital space) about whether this is necessarily a condition to lament. Embrace digital amnesia! To Google is to exist.

What is undeniable is that the means to find information – instantaneous, glut-filled, desperately quick – has created users who inhabit a space that guides their thinking, pre-empting, cajoling and adjusting. One form of literacy, we might kindly say, is being supplanted by another: the Google imbecile is upon us.

Given the nature of such effects, it is little wonder that politicians find Google threatening to their mouldy and rusted on craft. The politician’s preserve is sound – or unsound – communication; success at the next election is dependent upon the idea that the electors understand, and approve, what has been relayed to them (whether that material is factual, or not, a lie or otherwise, is beside the point: the politician yearns to convince in order to win).

The old search engine titan supplies something of a snag in this regard. On the one hand, it offers the political classes the means to reach a global audience, an avenue to screech and promote the next hair-brained scheme that comes into the mind of the political apparat. But what if the message stymies on the way, finding delays in the means of what is called “search engine optimisation”?

Is Google to blame, or bog standard ordinariness on the part of the politician?

US politicians think they have an answer. Only they are permitted control of the narrative and disseminating the lie. Of late they have been trying to sketch out a path they are not used to: regulating industries once hailed as sentinels of freedom, promoters of liberty. Their complaints tend to lack consistency.

On the one hand, they find various Google algorithms problematic (preference for alt-right sites, conspiratorial gruel as damaging), but their slant is wonky and skewed. Had these algorithms been driving favourable search terms (conformist, steady, unquestioning, anti-Trump), the matter would be a non-starter. Our message, they would say, is getting out there.

This week, the US Senate Committee on Commerce, Science and Transportation tried to make sense, in rather accusing fashion, of “persuasive technology”.

Nanette Byrnes furnishes us with a definition:

the idea that computers, mobile phones, websites, and other technologies could be designed to influence people’s behaviour and even attitudes”

The Pope does remain resolutely Catholic.

The committee hearing featured such opinions as those of Senator John Thune (R-SD), who wished to use the proceedings to draft legislation that would “require internet platforms to give consumers the option to engage with the platform without having the experience shaped by algorithms.”

The Senator is happy to accept that artificial intelligence “powers automations to display content to optimize engagement” but sees a devil in the works, as “AI algorithms can have an unintended and possibly even dangerous downside”.

This is tantamount to wanting a Formula One Grand Prix without fast cars and an athletics competition in slow motion.

Facing the senators, from Google’s side, was Maggie Stanphill, director of Google User Experience. Her testimony was couched in words more akin to the glossiness of a travel brochure with a complimentary sprinkling of cocaine.

Google’s Digital Wellbeing Initiative is a top company goal, focusing on providing our users with insights about their digital habits and tools to support an intentional relationship with technology.”

Google merely “creates products that improve the lives of the people who use them.”

The company has provided access that has “democratized information and provided services for billions of people around the world.”

When asked about whether Google was doing its bit in the persuasion business, Stanphill was unequivocal.

We do not use persuasive technology.”

The session’s theme was clear: oodles and masses of content are good, but must be appropriate.

In Information Utopia, where digital Adam and Eve still run naked, wickedness will not be allowed. If people want to seek content that is “negative” (this horrendous arbitrary nature keeps appearing), they should not be allowed to do so.

Gag them, and make sure the popular terms sought are whitewashed of any offensive or dangerous import. Impose upon the tech titans a responsibility to control the negative.

Senator Brian Schatz (D-Hawaii) complained of those companies “letting these algorithms run wild […] leaving humans to clean up the mess. Algorithms are amoral.”

Tristan Harris, co-founder and executive director of the Centre for Humane Technology, spoke of the competition between companies to use algorithms which “more accurately predict what will keep users there the longest.”

If you want to maximise the time spent searching terms or, in the case of YouTube, watching a video, focus “the entire ant colony of humanity towards crazytown.” For Harris, “technology hacks human weaknesses.”

The moral? Do not give people what they want.

The rage against the algorithm, and the belief that no behavioural pushing is taking place in search technology, is misplaced on a few fronts. On a certain level, all accept how such modes of retrieving information work. Disagreement arises as to their consequences, a concession, effectively, to the Google user as imbecile.

Stanphill is being disingenuous for assuming that persuasive technology is not a function of Google’s work (it patently is, given the company’s intention of improving the “intentional relationship with technology”).

In her testimony, she spoke of building “products with privacy, transparency and control for the users, and we build a lifelong relationship with the user, which is primary.”

The Senators, in turn, are concerned that the users, diapered by encouragements in their search interests, are incapable of making their own fragile minds up.

The nature of managed information in the digital experience is not, as Google, YouTube and like companies show, a case of broadening knowledge but reaffirming existing assumptions. The echo chamber bristles with confirmations, not challenges, with the comforts of prejudice rather than the discomforts of heavy-artillery learning. But the elected citizens on the Hill, and the cyber utopians, continue to struggle and flounder in the digital jungle they had seen as an information utopia equal to all.

For the Big Tech giants, it’s all rather simple: the attention-grabbing spectacle, bums on seats, and downloads galore.

Dr. Binoy Kampmark was a Commonwealth Scholar at Selwyn College, Cambridge. He lectures at RMIT University, Melbourne. You can email him at [email protected]


For direct-transfer bank details click here.

0 0 votes
Article Rating
Notify of

oldest most voted
Inline Feedbacks
View all comments
Mar 11, 2021 10:38 AM

Software doesn’t eat up the world, it makes it better. It makes many things easier and more accessible that previously seemed impossible. For example, could people have thought before that you can run a business on a smartphone? Just a business in your pocket. Through an app fieldworkhq that saves paper and it saves thousands of trees around the world. It turns out that the software does not eat up the world, but helps it to be itself.

Oct 28, 2019 5:22 PM

Monsters and titans share the stage of mythology across cultures as the necessary realisations of the human imagination. From stone cave to urban dwelling, the theme is unremitting; kept in the imagination, such creatures perform, innocently enough, benign functions: shell shockers full version. The catch here is the human tendency to realise such creatures. They take the form of social engineering and utopia.

Gerry Bolger
Gerry Bolger
Oct 4, 2019 1:26 PM

I think this is a spot on piece as google et al consume your interest and thn use your data against you (advertising etc etc) , but the irony is in the last line of the piece; his email is with google 🙂

Jul 2, 2019 2:11 PM

The pattern is indeed the same deceiver as ever.
But only through our willingness to listen there.

You will find what you are looking for because that is the active purpose that aligns and filters to fulfil desire.
The ego’s creed is ‘seek but do not find’ – that is go through all the forms or motions of seeking but as a cover story for allegiance and funding or sacrifice.
Feeding a sense of lack-seeking-validation-and-control grows the belief and experience in lack that becomes dependent and subject to controls.

But wholeness seeks and finds from the extension of worth – and recognises resonance in worth across apparent differences and grows true worth-ship and true with-ness in place of persuasive deceits seeking suckers with sweets.

People buy themselves into slavery here.

I cant altogether articulate it, but the ‘enemy’ of deceiver is upstream and way faster than anything we can think we think alone. In another post on OG today I said this:

1. We can act out the script of thinking.
2. Watch the thought and observe the script instead of automatically reacting.
3 (we can) Abide in the thought-less as an intimacy of direct appreciation.

The second allows a shift to a healing or awakening recognition, and alignment. In this the mind becomes a willing service rather than running off ahead – to lose our head in emotional reactivity in place of the heart’s knowing.

To those who have yet to look within and be changed by what is revealed only 1. exists; the world as we think it.
It does not seem so – but all perception is a subjective interpretive overlay, where the rules that set the selection are effectively hidden from the found results. We know not what we do.

The script of ‘must do something’ is always feeding the ‘doer’ with a sense of self-becoming but the recognition ‘I need do nothing’ is the release of a drive to become yourself. I don’t mean passivity so much as the ‘overcontrol’ of a narrative overly that gets in our own way with all kinds of things that have to be done or sorted before we can Live and know we love in the being of it.

A negative harvest will seem otherwise to those that choose it.
These times are here now and what we accept or choose is setting our willingness.
Free willingness is freedom to truly feel and be moved of an integrity of being – as well as to desist from feeding a disintegrity of being that seems to move of itself but only as robotic habit or conditioned response.

Education, rehabilitation and shared appreciation.
Notice, recognize and align in a true movement already joined.

Regardless the brand, supermarkets embody logistical delivery systems to a corporately infrastuctured consumer.
The internet is replicating the quantitative thinking to corporately infrastructure the target.
But consciousness in its literal conscious appreciation is a qualitative gift of giving and receiving, sowing and reaping, seeking and finding.
If you are not grounded in your peace you are vulnerable to every kind of error and deceit.
Your peace is unconflicted and qualitative. Even a moment of such a willingness to receive allows a shift of your day.

We see what we are willing to see.
Looking upon evil is only helpful to recognise where NOT to give worth and allegiance so as to be whole in what we are now free to give our full attention. This is not a goal to achieve but a truth to embody in the moment of noticing.

I started this with Tolkien references and changed my mind. But Saruman was the motif for seeking to understand evil – and so of course he lost his mind to deceit.

Another way of depicting eating the apple of the tree of judgement of good and evil is – “if you look there you will no longer know who you are, where you are or why you are. And will seek answer where it cant be found from that which does not know, but keeps you in false premises while you persist in listening to the voice that told you to look there.

Fair dinkum
Fair dinkum
Jul 2, 2019 7:07 AM

Google is more than a noun and a verb Binoy.
It’s become one of the ugliest pejoratives of the 21st century.

Nov 12, 2020 2:42 PM
Reply to  Fair dinkum

Be proud of the fact that you have the ability to rise above any situation and deliver the best no matter what the circumstances could be. barbeque grill for home Excellent article! Thank you for your tremendous efforts in this wonderful piece of work.