Pluralistic: AI is a WMD (09 May 2024)

doctorow · 9 May 2024 08:59

Originally published at: Pluralistic: AI is a WMD (09 May 2024) – Pluralistic: Daily links from Cory Doctorow

Today's links

AI is a WMD: Advon is a force-multiplier for enshittification.
Hey look at this: Delights to delectate.
This day in history: 2004, 2009, 2014, 2019, 2023
Upcoming appearances: Where to find me.
Recent appearances: Where I've been.
Latest books: You keep readin' em, I'll keep writin' 'em.
Upcoming books: Like I said, I'll keep writin' 'em.
Colophon: All the rest.

AI is a WMD (permalink)

Fun fact: "The Tragedy Of the Commons" is a hoax created by the white nationalist Garrett Hardin to justify stealing land from colonized people and moving it from collective ownership, "rescuing" it from the inevitable tragedy by putting it in the hands of a private owner, who will care for it properly, thanks to "rational self-interest":

https://pluralistic.net/2023/05/04/analytical-democratic-theory/#epistocratic-delusions

Get that? If control over a key resource is diffused among the people who rely on it, then (Garrett claims) those people will all behave like selfish assholes, overusing and undermaintaining the commons. It's only when we let someone own that commons and charge rent for its use that (Hardin says) we will get sound management.

By that logic, Google should be the internet's most competent and reliable manager. After all, the company used its access to the capital markets to buy control over the internet, spending billions every year to make sure that you never try a search-engine other than its own, thus guaranteeing it a 90% market share:

https://pluralistic.net/2024/02/21/im-feeling-unlucky/#not-up-to-the-task

Google seems to think it's got the problem of deciding what we see on the internet licked. Otherwise, why would the company flush $80b down the toilet with a giant stock-buyback, and then do multiple waves of mass layoffs, from last year's 12,000 person bloodbath to this year's deep cuts to the company's "core teams"?

https://qz.com/google-is-laying-off-hundreds-as-it-moves-core-jobs-abr-1851449528

And yet, Google is overrun with scams and spam, which find their way to the very top of the first page of its search results:

https://pluralistic.net/2023/02/24/passive-income/#swiss-cheese-security

The entire internet is shaped by Google's decisions about what shows up on that first page of listings. When Google decided to prioritize shopping site results over informative discussions and other possible matches, the entire internet shifted its focus to producing affiliate-link-strewn "reviews" that would show up on Google's front door:

https://pluralistic.net/2024/04/24/naming-names/#prabhakar-raghavan

This was catnip to the kind of sociopath who a) owns a hedge-fund and b) hates journalists for being pain-in-the-ass, stick-in-the-mud sticklers for "truth" and "facts" and other impediments to the care and maintenance of a functional reality-distortion field. These dickheads started buying up beloved news sites and converting them to spam-farms, filled with garbage "reviews" and other Google-pleasing, affiliate-fee-generating nonsense.

(These news-sites were vulnerable to acquisition in large part thanks to Google, whose dominance of ad-tech lets it cream 51 cents off every ad dollar and whose mobile OS monopoly lets it steal 30 cents off every in-app subscriber dollar):

https://www.eff.org/deeplinks/2023/04/saving-news-big-tech

Now, the spam on these sites didn't write itself. Much to the chagrin of the tech/finance bros who bought up Sports Illustrated and other venerable news sites, they still needed to pay actual human writers to produce plausible word-salads. This was a waste of money that could be better spent on reverse-engineering Google's ranking algorithm and getting pride-of-place on search results pages:

https://housefresh.com/david-vs-digital-goliaths/

That's where AI comes in. Spicy autocomplete absolutely can't replace journalists. The planet-destroying, next-word-guessing programs from Openai and its competitors are incorrigible liars that require so much "supervision" that they cost more than they save in a newsroom:

https://pluralistic.net/2024/04/29/what-part-of-no/#dont-you-understand

But while a chatbot can't produce truthful and informative articles, it can produce bullshit – at unimaginable scale. Chatbots are the workers that hedge-fund wreckers dream of: tireless, uncomplaining, compliant and obedient producers of nonsense on demand.

That's why the capital class is so insatiably horny for chatbots. Chatbots aren't going to write Hollywood movies, but studio bosses hyperventilated at the prospect of a "writer" that would accept your brilliant idea and diligently turned it into a movie. You prompt an LLM in exactly the same way a studio exec gives writers notes. The difference is that the LLM won't roll its eyes and make sarcastic remarks about your brainwaves like "ET, but starring a dog, with a love plot in the second act and a big car-chase at the end":

https://pluralistic.net/2023/10/01/how-the-writers-guild-sunk-ais-ship/

Similarly, chatbots are a dream come true for a hedge fundie who ends up running a beloved news site, only to have to fight with their own writers to get the profitable nonsense produced at a scale and velocity that will guarantee a high Google ranking and millions in "passive income" from affiliate links.

One of the premier profitable nonsense companies is Advon, which helped usher in an era in which sites from Forbes to Money to USA Today create semi-secret "review" sites that are stuffed full of badly researched top-ten lists for products from air purifiers to cat beds:

https://housefresh.com/how-google-decimated-housefresh/

Advon swears that it only uses living humans to produce nonsense, and not AI. This isn't just wildly implausible, it's also belied by easily uncovered evidence, like its own employees' Linkedin profiles, which boast of using AI to create "content":

https://housefresh.com/wp-content/uploads/2024/05/Advon-AI-LinkedIn.jpg

It's not true. Advon uses AI to produce its nonsense, at scale. In an excellent, deeply reported piece for Futurism, Maggie Harrison Dupré brings proof that Advon replaced its miserable human nonsense-writers with tireless chatbots:

https://futurism.com/advon-ai-content

Dupré describes how Advon's ability to create botshit at scale contributed to the enshittification of clients from Yoga Journal to the LA Times, "Us Weekly" to the Miami Herald.

All of this is very timely, because this is the week that Google finally bestirred itself to commence downranking publishers who engage in "site reputation abuse" – creating these SEO-stuffed fake reviews with the help of third parties like Advon:

https://pluralistic.net/2024/05/03/keyword-swarming/#site-reputation-abuse

(Google's policy only forbids site reputation abuse with the help of third parties; if these publishers take their nonsense production in-house, Google may allow them to continue to dominate its search listings):

https://developers.google.com/search/blog/2024/03/core-update-spam-policies#site-reputation

There's a reason so many people believed Hardin's racist "Tragedy of the Commons" hoax. We have an intuitive understanding that commons are fragile. All it takes is one monster to start shitting in the well where the rest of us get our drinking water and we're all poisoned.

The financial markets love these monsters. Mark Zuckerberg's key insight was that he could make billions by assembling vast dossiers of compromising, sensitive personal information on half the world's population without their consent, but only if he kept his costs down by failing to safeguard that data and the systems for exploiting it. He's like a guy who figures out that if he accumulates enough oily rags, he can extract so much low-grade oil from them that he can grow rich, but only if he doesn't waste money on fire-suppression:

https://locusmag.com/2018/07/cory-doctorow-zucks-empire-of-oily-rags/

Now Zuckerberg and the wealthy, powerful monsters who seized control over our commons are getting a comeuppance. The weak countermeasures they created to maintain the minimum levels of quality to maintain their platforms as viable, going concerns are being overwhelmed by AI. This was a totally foreseeable outcome: the history of the internet is a story of bad actors who upended the assumptions built into our security systems by automating their attacks, transforming an assault that wouldn't be economically viable into a global, high-speed crime wave:

https://pluralistic.net/2022/04/24/automation-is-magic/

But it is possible for a community to maintain a commons. This is something Hardin could have discovered by studying actual commons, instead of inventing imaginary histories in which commons turned tragic. As it happens, someone else did exactly that: Nobel Laureate Elinor Ostrom:

https://www.onthecommons.org/magazine/elinor-ostroms-8-principles-managing-commmons/

Ostrom described how commons can be wisely managed, over very long timescales, by communities that self-governed. Part of her work concerns how users of a commons must have the ability to exclude bad actors from their shared resources.

When that breaks down, commons can fail – because there's always someone who thinks it's fine to shit in the well rather than walk 100 yards to the outhouse.

Enshittification is the process by which control over the internet moved from self-governance by members of the commons to acts of wanton destruction committed by despicable, greedy assholes who shit in the well over and over again.

It's not just the spammers who take advantage of Google's lazy incompetence, either. Take "copyleft trolls," who post images using outdated Creative Commons licenses that allow them to terminate the CC license if a user makes minor errors in attributing the images they use:

https://pluralistic.net/2022/01/24/a-bug-in-early-creative-commons-licenses-has-enabled-a-new-breed-of-superpredator/

The first copyleft trolls were individuals, but these days, the racket is dominated by a company called Pixsy, which pretends to be a "rights protection" agency that helps photographers track down copyright infringers. In reality, the company is committed to helping copyleft trolls entrap innocent Creative Commons users into paying hundreds or even thousands of dollars to use images that are licensed for free use. Just as Advon upends the economics of spam and deception through automation, Pixsy has figured out how to send legal threats at scale, robolawyering demand letters that aren't signed by lawyers; the company refuses to say whether any lawyer ever reviews these threats:

https://pluralistic.net/2022/02/13/an-open-letter-to-pixsy-ceo-kain-jones-who-keeps-sending-me-legal-threats/

This is shitting in the well, at scale. It's an online WMD, designed to wipe out the commons. Creative Commons has allowed millions of creators to produce a commons with billions of works in it, and Pixsy exploits a minor error in the early versions of CC licenses to indiscriminately manufacture legal land-mines, wantonly blowing off innocent commons-users' legs and laughing all the way to the bank:

https://pluralistic.net/2023/04/02/commafuckers-versus-the-commons/

We can have an online commons, but only if it's run by and for its users. Google has shown us that any "benevolent dictator" who amasses power in the name of defending the open internet will eventually grow too big to care, and will allow our commons to be demolished by well-shitters:

https://pluralistic.net/2024/04/04/teach-me-how-to-shruggie/#kagi

(Image: Cryteria, CC BY 3.0; Catherine Poh Huay Tan, Laia Balagueró, CC BY 2.0; modified)

Hey look at this (permalink)

Sony overturns Helldivers 2 PSN requirement following backlash https://www.eurogamer.net/sony-overturns-helldivers-2-psn-requirement-following-backlash (h/t Slashdot)
They Bought Tablets in Prison—and Found a Broken Promise https://www.wired.com/story/electronic-tablets-in-federal-prisons-chat-apps-disabled/
The material consequences of “chipification”: The case of software-embedded cars https://journals.sagepub.com/doi/full/10.1177/20539517221095429 (h/t Things and People)

A Wayback Machine banner.

This day in history (permalink)

#20yrsago Japan jails academic for writing P2P app https://web.archive.org/web/20040512194433/http://straitstimes.asia1.com.sg/latest/story/0,4390,250207,00.htmlhttps://stopdesign.com/journal/2004/05/09/blogger.html

#20yrsago TheyRule: applying information design to corporate directorships https://theyrule.net

#20yrsago Don’t just protect the unconceived: protect the inanimate! https://fafblog.blogspot.com/2004_05_02_fafblog_archive.html#108411098508640046

#15yrsago Brit MP saw undercover cops egging crowd to riot at G20 https://www.theguardian.com/politics/2009/may/10/g20-policing-agent-provacateurs

#15yrsago Elsevier has an entire division dedicated to publishing fake advertorial “peer-reviewed” journals https://science.slashdot.org/story/09/05/09/1514235/more-fake-journals-from-elsevier

#15yrsago New York Times webteam nukes the careers of many journalists https://web.archive.org/web/20090511024122/http://www.thomascrampton.com/newspapers/reporter-to-ny-times-publisher-you-erased-my-career/

#15yrsago It’s Useful to Have a Duck/It’s Useful to Have a Boy: great board-book tells the story from two points of view https://memex.craphound.com/2009/05/08/its-useful-to-have-a-duck-its-useful-to-have-a-boy-great-board-book-tells-the-story-from-two-points-of-view/

#10yrsago Fast food workers around the world to strike on May 15 http://america.aljazeera.com/articles/2014/5/7/fast-food-workersuniteactivistsannounceglobalprotest.html

#10yrsago Former NSA boss defends breaking computer security (in the name of national security) https://www.wired.com/2014/05/alexander-defends-use-of-zero-days/

#10yrsago Tor: network security for domestic abuse survivors https://web.archive.org/web/20140509221534/http://betaboston.com/news/2014/05/07/as-domestic-abuse-goes-digital-shelters-turn-to-counter-surveillance-with-tor/

#10yrsago The Oversight: conspiracies, magic, and the end of the world https://memex.craphound.com/2014/05/08/the-oversight-conspiracies-magic-and-the-end-of-the-world/

#10yrsago Charlie Stross on NSA network sabotage https://www.antipope.org/charlie/blog-static/2014/05/the-snowden-leaks-a-meta-narra.html

#10yrsago Peter “brokep” Sunde launches campaign for Finnish Pirate Party MEP https://www.youtube.com/watch?v=fModmx3U8HI

#10yrsago Against the instrumental argument for surveillance https://www.theguardian.com/technology/blog/2014/may/09/cybersecurity-begins-with-integrity-not-surveillance

#10yrsago Congressmen ask ad companies to pretend SOPA is law, violate antitrust https://www.eff.org/deeplinks/2014/05/pols-ad-networks-pretend-we-passed-sopa-and-never-mind-about-antitrust

#10yrsago Japanese man arrested for 3D printing and firing guns https://kotaku.com/japanese-man-arrested-for-having-guns-made-with-a-3d-pr-1573358490

#5yrsago Americans with diabetes are forming caravans to buy Canadian insulin at 90% off https://www.cbc.ca/news/canada/nova-scotia/americans-diabetes-cross-canada-border-insulin-1.5125988

#5yrsago Big Tech is deleting evidence needed to prosecute war crimes, and governments want them to do more of it https://www.theatlantic.com/ideas/archive/2019/05/facebook-algorithms-are-making-it-harder/588931/

#5yrsago Buried in Uber’s IPO, an aggressive plan to destroy all public transit https://48hills.org/2019/05/ubers-plans-include-attacking-public-transit/

#5yrsago Test your understanding of evolutionary psychology with this rigorous quiz https://www.currentaffairs.org/2019/05/evolutionary-psychology-quiz

#5yrsago Why “collapse” (not “rot”) is the way to think about software problems https://hal.science/hal-02117588/document

#5yrsago Human Rights Watch reverse-engineered the app that the Chinese state uses to spy on people in Xinjiang https://www.hrw.org/video-photos/interactive/2019/05/02/china-how-mass-surveillance-works-xinjiang

#5yrsago Google will now delete your account activity on a rolling basis https://myactivity.google.com/activitycontrols/webandapp?view=item&otzr=1&pli=1

#5yrsago Charter’s new way to be terrible: no more prorated cancellations https://arstechnica.com/information-technology/2019/05/charter-squeezes-more-money-out-of-internet-users-with-new-cancellation-policy/

#1yrago KPMG audits the nursing homes it advises on how to beat audits https://pluralistic.net/2023/05/09/dingo-babysitter/#maybe-the-dingos-ate-your-nan

#1yrago California to smash prison e-profiteers https://pluralistic.net/2023/05/08/captive-audience/#good-at-their-jobs

Upcoming appearances (permalink)

A photo of me onstage, giving a speech, holding a mic.

Tartu Prima Vista Literary Festival, May 8-10
https://tartu2024.ee/en/kirjandusfestival/
Tim O’Reilly and Cory Doctorow on “Enshittification” and the Future of AI, May 14
https://www.oreilly.com/live-events/tim-oreilly-and-cory-doctorow-on-enshittification-and-the-future-of-ai/0642572001651/
"Finding the Money" screening (LA), May 15
https://www.laemmle.com/film/finding-money?date=2024-05-15
Media Ecology Association keynote (Amherst, NY), Jun 6-9
https://media-ecology.org/convention
HOPE XV, Jul 14 (Queens, NY)
https://www.hope.net/talks.html
American Association of Law Libraries keynote (Chicago), Jul 21
https://www.aallnet.org/conference/agenda/keynote-speaker/

A screenshot of me at my desk, doing a livecast.

Recent appearances (permalink)

That Word Chat
https://www.youtube.com/watch?v=miwEy_mACEY
Come sfuggire al “Merdocene” e costruire un Internet migliore (Torino Biennale Tecnologia)
https://www.youtube.com/watch?v=Z5NC2EZCYBg
Show Me The Money Club (The Rideshare Guy)
https://www.youtube.com/watch?v=ZCETi3XqSds

A grid of my books with Will Stahle covers..

Latest books (permalink)

The Bezzle: a sequel to "Red Team Blues," about prison-tech and other grifts, Tor Books (US), Head of Zeus (UK), February 2024 (the-bezzle.org). Signed, personalized copies at Dark Delicacies (https://www.darkdel.com/store/p3062/Available_Feb_20th%3A_The_Bezzle_HB.html#/).
"The Lost Cause:" a solarpunk novel of hope in the climate emergency, Tor Books (US), Head of Zeus (UK), November 2023 (http://lost-cause.org). Signed, personalized copies at Dark Delicacies (https://www.darkdel.com/store/p3007/Pre-Order_Signed_Copies%3A_The_Lost_Cause_HB.html#/)
"The Internet Con": A nonfiction book about interoperability and Big Tech (Verso) September 2023 (http://seizethemeansofcomputation.org). Signed copies at Book Soup (https://www.booksoup.com/book/9781804291245).
"Red Team Blues": "A grabby, compulsive thriller that will leave you knowing more about how the world works than you did before." Tor Books http://redteamblues.com. Signed copies at Dark Delicacies (US): and Forbidden Planet (UK): https://forbiddenplanet.com/385004-red-team-blues-signed-edition-hardcover/.
"Chokepoint Capitalism: How to Beat Big Tech, Tame Big Content, and Get Artists Paid, with Rebecca Giblin", on how to unrig the markets for creative labor, Beacon Press/Scribe 2022 https://chokepointcapitalism.com
"Attack Surface": The third Little Brother novel, a standalone technothriller for adults. The Washington Post called it "a political cyberthriller, vigorous, bold and savvy about the limits of revolution and resistance." Order signed, personalized copies from Dark Delicacies https://www.darkdel.com/store/p1840/Available_Now%3A_Attack_Surface.html
"How to Destroy Surveillance Capitalism": an anti-monopoly pamphlet analyzing the true harms of surveillance capitalism and proposing a solution. https://onezero.medium.com/how-to-destroy-surveillance-capitalism-8135e6744d59?sk=f6cd10e54e20a07d4c6d0f3ac011af6b) (signed copies: https://www.darkdel.com/store/p2024/Available_Now%3A__How_to_Destroy_Surveillance_Capitalism.html)
"Little Brother/Homeland": A reissue omnibus edition with a new introduction by Edward Snowden: https://us.macmillan.com/books/9781250774583; personalized/signed copies here: https://www.darkdel.com/store/p1750/July%3A__Little_Brother_%26_Homeland.html
"Poesy the Monster Slayer" a picture book about monsters, bedtime, gender, and kicking ass. Order here: https://us.macmillan.com/books/9781626723627. Get a personalized, signed copy here: https://www.darkdel.com/store/p2682/Corey_Doctorow%3A_Poesy_the_Monster_Slayer_HB.html#/.

A cardboard book box with the Macmillan logo.

Upcoming books (permalink)

Picks and Shovels: a sequel to "Red Team Blues," about the heroic era of the PC, Tor Books, February 2025
Unauthorized Bread: a graphic novel adapted from my novella about refugees, toasters and DRM, FirstSecond, 2025

Colophon (permalink)

Today's top sources: Jon Christian (https://futurism.com/).

Currently writing:

A Little Brother short story about DIY insulin PLANNING
Picks and Shovels, a Martin Hench noir thriller about the heroic era of the PC. FORTHCOMING TOR BOOKS JAN 2025
Vigilant, Little Brother short story about remote invigilation. FORTHCOMING ON TOR.COM
Spill, a Little Brother short story about pipeline protests. FORTHCOMING ON TOR.COM

Latest podcast: Precaratize Bosses https://craphound.com/news/2024/04/28/precaratize-bosses/

This work – excluding any serialized fiction – is licensed under a Creative Commons Attribution 4.0 license. That means you can use it any way you like, including commercially, provided that you attribute it to me, Cory Doctorow, and include a link to pluralistic.net.

https://creativecommons.org/licenses/by/4.0/

Quotations and images are not included in this license; they are included either under a limitation or exception to copyright, or on the basis of a separate license. Please exercise caution.