Will Twitter Soon Be Overrun With Silicon Trolls?

Fight disinformation: Sign up for the free Mother Jones Daily newsletter and follow the news that matters.


Hugh Hancock muses today about the remarkable effectiveness of efforts to turn Microsoft’s (now) infamous Tay chatbot into an asshole. It didn’t take much. Mostly the people who did it were just having a laugh, and Tay took it from there. It turns out that being an asshole is a pretty easy thing to emulate.

So what does this mean for the future? Not the far future, mind you, but next year. Hancock has an unnerving answer:

Everyone Can Have Their Own Twitter Mob

Right now, if you want to have someone attacked by a horde of angry strangers, you need to be a celebrity. That’s a real problem on Twitter and Facebook both, with a few users in particular becoming well-known for abusing their power to send their fans after people with whom they disagree.

But remember, the Internet’s about democratising power, and this is the latest frontier. With a trollbot and some planning, this power will soon be accessible to anyone.

There’s a further twist, too: the bots will get better. Attacking someone on the Internet is a task eminently suited to deep learning. Give the bots a large corpus of starter insults and a win condition, and let them do what trolls do — find the most effective, most unpleasant ways to attack someone online. No matter how impervious you think you are to abuse, a swarm of learning robots can probably find your weak spot.

There are some details to be worked out, of course, like setting up all the accounts your trollbot would need. Hancock addresses that. He figures the bots will be pretty good at this stuff too.

The unnerving part of this is that although Hancock is writing in a chatty tone, this is all very plausible. And for something like Twitter, where a bot doesn’t need much intelligence to fit right in, it’s a pretty serious near-term possibility.

So what happens? Behind Door 1, Twitter becomes an abattoir of filth and verbal war. Only the bravest dare enter. Behind Door 2, Twitter mobs become so frequent that no one cares about them anymore. Even the most sensitive among us just shrug them off. Behind Door 3, it all becomes a tedious war between semi-intelligent trollbots and semi-intelligent trollbot filters. It’s just Act II of the online production that began with email spam.

On the bright side, this might put actual trolls out of commission. How can they compete? And what will they do with all their newfound free time?

THIS IS BIG

A generous board member just chipped in a $50,000 digital matching gift, and we need your help to make the most of it. Any donation you make online from now until September 30 will be matched dollar-for-dollar.

In an all-important election season, we’re reaching millions of Americans with fearless, kickass, truth-telling reporting.

With your support going twice as far, we can lead the way these next 60 days in showing the corporate media how to cover the unique danger that Trump represents and not make the same mistakes they did in 2016 and 2020.

Please help with a gift of any amount if you can right now. And know that it will be doubled—and that we’ll be so grateful.

payment methods

THIS IS BIG

A generous board member just chipped in a $50,000 digital matching gift, and we need your help to make the most of it. Any donation you make online from now until September 30 will be matched dollar-for-dollar.

In an all-important election season, we’re reaching millions of Americans with fearless, kickass, truth-telling reporting.

With your support going twice as far, we can lead the way these next 60 days in showing the corporate media how to cover the unique danger that Trump represents and not make the same mistakes they did in 2016 and 2020.

Please help with a gift of any amount if you can right now. And know that it will be doubled—and that we’ll be so grateful.

payment methods

We Recommend

Latest

Sign up for our free newsletter

Subscribe to the Mother Jones Daily to have our top stories delivered directly to your inbox.

Get our award-winning magazine

Save big on a full year of investigations, ideas, and insights.

Subscribe

Support our journalism

Help Mother Jones' reporters dig deep with a tax-deductible donation.

Donate