Skip to content
Naked Security Naked Security

AI filter launched to block Twitter cyberflashing

A small but determined group of Twitter users think it is a good idea to direct message (DM) pictures of male genitals to complete strangers.

It seems strange to report, yet a small but determined group of Twitter users think it is a good idea to direct message (DM) pictures of male genitals to complete strangers.
Does this sound a bit like street flashing harassment in digital form?
It did to developer Kelsey Bressler after she received such an unsolicited image as a DM via Twitter last August. She later told the BBC:

You’re not giving them a chance to consent, you are forcing the image on them, and that is never okay.

Instead of shrugging it off, she and a friend had the idea of using AI pattern recognition to screen the pictures out before they were seen. But that AI still needed a set of – ahem – images to train itself on, which Bressler requested via Twitter.


Bressler has reportedly received over 4,000 pictures in response – enough to train the system to a state where it has just been released as a Safe DM service that anyone can sign up for.
Media site Buzzfeed tested Safe DM against a selection of images taken from Wikimedia Commons and found that it works well, albeit with a lag of a few minutes.
In tests, the filter blocked penises in a range of states, including full body shots and condoms and drawings. It even blocked examples that looked like a penis without being one.
Conclusion: recipients might see an image if they open it immediately but otherwise should be safe. Bressler told Naked Security that it will also block pictures of female genitals although no tests of its effectiveness at doing this have yet been made public.
For now, Safe DM is only on Twitter but other platforms might be included in future releases, she told Buzzfeed.
The filter asks for a lot of permissions but does not read the text content of DMs, she said. That was because:

Unfortunately, Twitter doesn’t allow us to pick and choose. It’s all or nothing.

Cyberflashing appears to be a growing hazard on many platforms. The Huffington Post UK published an article last May that quoted dozens of women who’d experienced it via email, SnapChat, Instagram, Twitter, Facebook Messenger, and – the most often mentioned channel – AirDrop (which has been in trouble for this sort of abuse before).
Despite more laws on general harassment, the chances of prosecution for cyberflashing remain somewhere between very low and non-existent. But at least with Safe DM, Twitter users now have something to turn to.


Latest Naked Security podcast

LISTEN NOW

Click-and-drag on the soundwaves below to skip to any point in the podcast. You can also listen directly on Soundcloud.

5 Comments

If she thought a couple were bad “received over 4,000 pictures ” lol
On a more serious note; this is very sexist, it should be blocking both genders (tripped and opened a can of worms)

Mahhn, did you miss this bit?
“Bressler told Naked Security that it will also block pictures of female genitals although no tests of its effectiveness at doing this have yet been made public.”

I have never heard of women sending unsolicited pics of private parts. Beyond scammers (I presume they’re scammers anyway. Never actually clicked through one of them, but they usually have a shady sounding service they advertise), that is.

There was someone on Reddit complaining that a “seller” on Discogs claiming to have a rare vinyl record the user was after was sent this nasty kind of picture when they asked for proof that they in fact had the record they were advertising for sale. Needless to say, this disgusting behavior is now moving off of social media unfortunately!

Comments are closed.

Subscribe to get the latest updates in your inbox.
Which categories are you interested in?