A feedback loop of nonsense and violence
Unless you’ve been living under a rock for the past few days, you should by now be aware of the news that Meta products, including Facebook and Instagram, will replace teams of content moderators with ‘community notes’.
People on social media seem to think that merely linking to a bad news story and telling their network that “this is bad” is in any way a form of protest or activism. Not using stuff is protest; doing something about Meta’s influence in the world is activism.
Anyway, the best take I’ve seen on this whole thing is, unsurprisingly, from Ryan Broderick, who not only diagnoses what’s happened over the last four years, but predicts what will happen as a result. The only good thing to come of this whole debacle is that there have been some fantastic parody news stories, including this one.
[C]ontent moderation, as we’ve understood, it effectively ended on January 6th, 2021… [T]he way I look at it is that the Insurrection was the first time Americans could truly see the radicalizing effects of algorithmic platforms like Facebook and YouTube that other parts of the world, particularly the Global South, had dealt with for years. A moment of political violence Silicon Valley could no longer ignore or obfuscate the way it had with similar incidents in countries like Myanmar, India, Ethiopia, or Brazil. And once faced with the cold, hard truth of what their platforms had been facilitating, companies like Google and Meta, at least internally, accepted that they would never be able to moderate them at scale. And so they just stopped.
This explains Meta’s pivot to, first, the metaverse, which failed, and, more recently, AI, which hasn’t yet, but will. It explains YouTube’s own doomed embrace of AI and its broader transition into a Netflix competitor, rather than a platform for true user-generated content. Same with Twitter’s willingness to sell to Elon Musk, Google’s enshittification, and, relatedly, Reddit’s recent stagnant googlification. After 2021, the major tech platforms we’ve relied on since the 2010s could no longer pretend that they would ever be able to properly manage the amount of users, the amount of content, the amount of influence they “need” to exist at the size they “need” to exist at to make the amount of money they “need” to exist.
And after sleepwalking through the Biden administration and doing the bare minimum to avoid any fingers pointed their direction about election interference last year, the companies are now fully giving up. Knowing the incoming Trump administration will not only not care, but will even reward them for it.
[…]
[I]t is also safe to assume that the majority of internet users right now — both ones too young to remember a pre-moderated internet and ones too normie to have used it at the time — do not actually understand what that is going to look and feel like. But I can tell you where this is all headed, though much of this is already happening.
Under Zuckerberg’s new “censorship”-free plan, Meta’s social networks will immediately fill up with hatred and harassment. Which will make a fertile ground for terrorism and extremism. Scams and spam will clog comments and direct messages. And illicit content, like non-consensual sexual material, will proliferate in private corners of networks like group messages and private Groups. Algorithms will mindlessly spread this slop, boosted by the loudest, dumbest, most reactionary users on the platform, helping it evolve and metastasize into darker, stickier social movements. And the network will effectively break down. But Meta is betting that the average user won’t care or notice. AI profiles will like their posts, comment on them, and even make content for them. A feedback loop of nonsense and violence. Our worst, unmoderated impulses, shared by algorithm and reaffirmed by AI. Where nothing has to be true and everything is popular. A world where if Meta does inspire conspiracy theories, race riots, or insurrections, no one will actually notice. Or, at the very least, be so divided on what happened that Meta doesn’t get blamed for it again.
Source: Garbage Day
Image: Hartono Creative Studio