Instagram and Facebook users are taking to these platforms to voice their outrage and dismay. Just as many accuse Meta of irresponsibly reinstating accounts. Recent incidents involving minor children have involved multiple victims and focus on the platform’s artificial intelligence-based moderation tools. Together, these events highlight the dangerous impacts of wrongful accusations.
26-year-old Yassmine Boussihmed, of the Netherlands, is one of the influencers who has had their Instagram account, and messaging, suspended. The suspension followed claims of violating Meta’s guidelines regarding child sexual exploitation, abuse, and nudity. She speculates that the one of her and her 21-year-old friend in bikini tops may have triggered the AI moderation system. That’s a route she’s at least opened the door to exploring. Boussihmed’s suspension lasted just over two weeks before Meta issued an apology, stating, “We’re sorry we’ve got this wrong,” confirming that she had done nothing wrong.
In neighbouring Cheshire, 55-year-old Duncan Edmonstone suffered the same tragic fate. As such, accused of infringing CSE regulations, he was banned from using both Instagram and Facebook. Currently Edmonstone is fighting stage four ALK+ lung cancer. He enjoys some comfort through private Facebook groups, joining those who face the same hurdles as him.
Another user, whose legal name is only listed as Ryan, received a ban in May after being reported for breaking the CSE policy. After a month challenging the decision, he was reinstated at the end of July. His experience left him feeling devastated. “Sorry we called you a paedophile for two months – here is your account back,” he stated, highlighting the emotional toll of the false accusations.
Lucia, who was initially banned from Instagram in April, was banned again. This occurred shortly after the BBC contacted to ask about her plight. She expressed her frustration: “I am appalled to have been suspended for something I know I did not do and would never do.” The repeated bans have raised questions about the reliability of Meta’s moderation systems and their implications on users’ lives.
These cases are not isolated. Over 36 thousand people have signed a petition charging Meta with unjustly banning accounts. In the meantime, thousands of others are chronicling their experiences with it on Reddit and across other social media pages. Over 500 individuals have already contacted the BBC. That’s because they’re heartbroken at the prospect of losing important game-day photos and videos and seeing their businesses disrupted by these bans.
Back in July, Meta made a surprising move in enforcement, leading the way by getting tougher on rule violations. They deleted 635,000 accounts associated with sexualized comments and imagery related to minors. In pursuing this crackdown, they’ve created disastrous consequences for the true, innocent users.
Boussihmed articulated her disappointment with social media platforms: “I put all of my trust in social media, and social media helped me grow, but it has let me down.” Her sentiment rings true for many who have seen their lives thrown into disarray by these broad strokes measures.
Edmonstone affirmed the importance of social media for those in need, stating, “The support groups are my lifeline, and there are actual examples of where advice from group members has made a difference to other patient’s treatment.” His experience further illustrates just how essential these platforms can be for people in the midst of an often overwhelming health crisis.
Meta has not responded publicly to the BBC about the account bans or the increasing user backlash. Boussihmed’s, Edmonstone’s, Ryan’s, Lucia’s — these stories are popping up everywhere. These stories have understandably left many wondering whether automated moderation systems are equitable or effective.