Surveillance Capitalism, Social media and Polarisation (Overview)

This is neither a Service Page nor a blog post: it's my first effort at a Zettelkasten Permanent Note in support of an upcoming interview for Trond Undheim's Futurized podcast, as explained here.
Created 5 July 2020.
Key tags: surveillance, polarization.


Surveillance capitalism & state

So pervasive, difficult to see from the inside. Term coined by Shoshana Zuboff: latest form of capitalism, familiar in some ways, unique in others. From total control over production (industrial capitalism) to: total control over every aspect of everyday life, including what you think:

the totality of information about our every thought, word and deed... traded for profit in new markets based on predicting our every need – or producing it.

Profoundly undemocratic and dehumanising. Recast this from privacy issue (we willingly traded for nice things) to realise we're giving up

“decision rights”... fundamentally usurped by predictive, data-driven systems...

Not inevitable - technology enables this, but we chose not to regulate it, and the tech giants spend billions lobbying to keep it that way.

This is not just about tech giants - big tech & government:

the twin demons relating to attention... unwanted attention paid to us ... versus our own attention being unwittingly diverted ... living in a Panopticon versus the specter of our personal cognitive resources being fragmented ... by too many competing digital factions that exploit intimate knowledge of their users

Governments rolling out systems to "nudge" us. More data = more effective nudging. Where do you draw the line? Who does it? Who checks/enforces?

"government shouldn’t make up social norms... mislead people for a secondary purpose...

Then throw in augmented reality:

mirrorworld will affect us all at a deeply personal level... severe physiological and psychological synchronize the virtual ... with the real ... while rendering it visible to millions—will require tracking people and things to a degree that can only be called a total surveillance state

Polarised society

Key linked result: increased polarisation of society. Possibly most important problem: if we can't agree on our problems, or show the slightest respect for each other or the democratic elections we hold, we won't solve any of our problems.

"the US will fracture into something new, unrecognizable, and unstable"


  • Social media optimises for outrage because outrage creates engagement
  • engagement = you volunteering more data about you
  • = more money for surveillance capitalists & control for governments

Regulate all you like: they'll find a way around it, based on behaviour to date. Today's efforts (factchecking, moderation) are small bandaids applied to huge wounds, by the creators of those wounds.

Facebook drives misinformation and radicalization, encourages hate speech, and incites violence... my friends at Facebook have remained true believers
The rage-engage cycle is a key part of how malign narratives gain traction on social media
a platform designed for one result (cannot) be fixed to produce another

When our Feeds are optimised for enragement, politics becomes tribal, creating a perfect environment for disinformation:

"when people... have nonoverlapping lenses, the process by which people make sense of events is more important than the event itself"
social media has the potential to bridge these gaps in ideology, but the way these Facebook discussions take place is ultimately too polarizing and makes others, even witnesses, gun-shy
when people feel they have nowhere trustworthy and independent they can rely on is that they will turn inward ... It then becomes easier for malevolent forces to degrade institutions.
In less than a year... weekly church-attending white Protestants convinced that Donald Trump was anointed by God to be president grew from 29.6 percent to 49.5 percent
shortly after the 2016 election, 14 percent of US adults reported sharing a political news story online that they knew at the time was made up

Filter bubbles are still an open question - probably exist, but not equally strong for everyone at all times. Echo chambers created by 'old media' are indisputable, and not new

homogeneous online networks help conspiracy theories persist and grow online.... creates an ecosystem in which the truth value of the information doesn’t matter.
Facebook and Google... may in fact currently contribute to more diverse news diets... Whether they will still do so after the next algorithm update only they know.
polarization is accelerating fastest among those using the internet the least... Trump’s use of Twitter ... setting the agenda for more traditional news outlets, particularly cable news and talk radio.

Death of independent journalism

Above made much worse by another result of these platforms: destruction of independent journalism.

Journalism as we know it a recent phenomenon, financed by bundling journalism with advertising:

the entire egalitarian economy of the post-war 20th century was more historical anomaly than the rule. In 1820 and 1920, we were a deeply unequal society informed by sharply partisan media. Why should 2020 be any different?

Internet, particularly social media, unbundled everything:

  • people consume articles in their feed, not entire newspapers (article bundles with a reputation to safeguard)
  • increased content supply, with each article looking as professional as the next (credibility signalling broken)
  • advertising unbundled onto craigslist and then facebook - newspaper revenue crashed
search engines and social media have blown apart newspapers’ bundles ... an endless stream of items from all over the web ... Peddlers of fake stories have no reputation to maintain and no incentive to stay honest

Some media will thrive with subscriptions, but internet a winner-take-all environment & many may not outlast Trump bump.

  • most people cant afford to buy multiple subscriptions, so subscription model will reinforce polarisation.
  • most media will disappear without a new business model, particularly local media: good news for local politicians and local crime

Bottom line

In the future we will be less will informed, more polarised, massively manipulated, living in more corrupt and less democratic societies, unable to solve the challenges we face.

Two paths:

Path No. 1: We stay in our silos, passively allowing media moguls and tech platforms to drag us deeper into our corners... algorithms and micro-targeting mechanisms deliver us belief-confirming disinformation and culturally-divisive tropes... language and packaging that we like best... as our political party preferences increasingly overlap... we find ourselves rage-fueled... a war between a socially constructed us that hates the also-socially constructed them... we will be…ungovernable.
Path No. 2: We actively work to disrupt the infrastructure, logic, and economic model ...


Stuff I (Really) like

Here are the latest 9 resources I've Highlighted about Surveillance Capitalism, Social media and Polarisation (Overview). There's more reading over here.

How Some Conservatives Have Switched to Parler, Rumble and Newsmax (FN)
Card image

Fleeting Note (FN): the creation of Fediverse-based alternatives might suddenly become an urgency.

Opinion | Facebook serves as an echo chamber, especially for conservatives. Blame its algorithm. - The Washington Post

Summary of peer-reviewed research - “Understanding Echo Chambers and Filter Bubbles: The Impact of Social Media on Diversification and Partisan Shifts in News Consumption” - by its authors, who found:more time spent on Facebook, the more polarized their online news consumption becomes...Facebook usage is five times more polarizing for conservative…

Domestic v. foreign disinformation: A question of timing (US2020 Disinformation news, ed. 4)
Card image

There are two possible reasons why we are not talking as much about foreign interference. Both could be true. Only one is good news.

Is Russian Meddling as Dangerous as We Think?  | The New Yorker
Card image

Literature note: “How to Lose the Information War,” ... on disinformation as a geopolitical strategy...Mueller report: I.R.A.-created groups and accounts reached tens of millions... the troll factory found “authentic, local voices,” to foment large-scale distrust in government and democracy... and managed to get into the heads of powerful politici…

China’s Artificial Intelligence Surveillance State Goes Global - The Atlantic
Card image

Xi Jinping is using artificial intelligence to enhance his government’s totalitarian control... exporting ... to regimes around the globe... all-seeing digital system of social control... precog algorithms that identify potential dissenters in real time ... every person ... identified, instantly, by AI matching them to an ocean of personal data..…

The 2020 Election Will Be a War of Disinformation - The Atlantic
Card image

The president’s reelection campaign ... multimillion-dollar ad blitz ... shaping Americans’ understanding of ... impeachment ... micro-targeted ads ... portraying Trump as a heroic reformer ... while Democrats plotted a coup... An alternate information ecosystem was taking shape ... I wanted to see it from the inside...I was surprised by the effec…

AI-Generated Text Is the Scariest Deepfake of All | WIRED
Card image

GPT-3... AI that can produce shockingly human-sounding (if at times surreal) sentences... imagine a future in which the vast majority of the written content ... is produced by machines... adjust, and adapt, to a new level of unreality may turn out to be the easiest to detect ... Politicians will now be able to dismiss real, scandalous vid…

Designing social platforms fit for the future
Card image

For the 6th episode of his Futurized podcast, Trond Undheim asked me why surveillance capitalism inevitably leads to polarised, undemocratic and dysfunctional societies, and what we must do about it... If we don’t change course, in the future we will be less will informed, more polarised, massively manipulated, living in more corrupt and less demo…

The Age of Surveillance Capitalism by Shoshana Zuboff
Card image

all recorded, rendered as data, processed, analysed, bought, bundled and resold like sub-prime mortgages...not some dystopian imagining of the future, but the present... the totality of information about our every thought, word and deed... traded for profit in new markets based on predicting our every need – or producing it... tech giants unilate…

Get More Resources, More Services or Just Get in Touch

Cookies disclaimer saves very few cookies onto your device: we need some to monitor site traffic using Google Analytics, while another protects you from a cross-site request forgeries. Nevertheless, you can disable the usage of cookies by changing the settings of your browser. By browsing our website without changing the browser settings, you grant us permission to store that information on your device. More details in our Privacy Policy.

I agree