Tech

Facebook banned 583 million fake accounts over 3 months, in an unprecedented display of transparency

facebook ceo mark zuckerberg
Facebook co-founder, Chairman and CEO Mark Zuckerberg testifies before the House Energy and Commerce Committee in the Rayburn House Office Building on Capitol Hill April 11, 2018 in Washington, DC. Chip Somodevilla/Getty Images
Read in app

Facebook banned 583 million fake accounts in the first three months of 2018, the social network has revealed. It's a major effort towards transparency from Facebook in the wake of the Cambridge Analytica scandal.

The Silicon Valley social networking giant announced on Tuesday that it will publish data about the scale and effectiveness of its content moderation efforts — offering outsiders an unprecedented look at Facebook's efforts to keep its platform free from objectionable, rule-breaking, and sometimes illegal content.

Here are some of the key numbers for the first three months of 2018: 

  • Facebook "took action" on 3.4 million pieces of content that contained graphic violence. In this particular case, the "action" consisted of placing a warning over the content rather than removing it — at least, in the "vast majority" of cases. Of all the content viewed by users, between 0.22-0.27% of views was of rule-breaking content showing graphic violence. Which is to say, this doesn't mean that 0.22% of the content posted on Facebook contained graphic violence; just that the graphic content posted accounted for 0.22% of total views.
  • It took action on 21 million pieces of content containing nudity and sexual activity. 0.07-0.09% of views were of the content.
  • Facebook took action on 1.9 million pieces of content over terrorist propaganda. The company didn't provide a number of views, but said it was "extremely low."
  • Facebook took action on 2.5 million pieces of content over hate speech, but doesn't have view numbers as it is still "developing measurement methods for this violation type."
  • It took action on 837 million pieces of spam, though it didn't have view numbers.
  • It disabled 583 million fake accounts. It estimates that overall, 3-4% of its monthly active users are fake.

The data also illustrates where Facebook's AI moderation systems are effectively identifying and taking down problematic content — and the areas where it still struggles to identify problems. 99.5% of terrorist content was detected and taken down by Facebook before users reported it, for example, while just 38% of hate speech was detected without user-submitted reports.

The company plans to release the data periodically in the future, the same way it already releases reports on the numbers of government data requests and intellectual property takedown requests it receives.

The new disclosures come after Facebook published for the first time its full "Community Standards": The internal rules it uses to determine exactly what is and isn't allowed on the social network. The full guidelines are about 8,500 words long, and and go into explicit detail around what is and isn't acceptable in terms of violent, sexual, or otherwise controversial content, along with hate speech and threatening language.

These releases come in the wake of the Cambridge Analytica scandal, which has left the company battling to restore its reputation with users and developers — though employees have said the decision to release the Community Standards was not driven by recent events.

 

Do you work at Facebook? Got a tip? Contact the author at rprice@jkmperu.com, via Twitter DM at @robaeprice, or via Signal/WhatsApp at 650-636-6268. Anonymity guaranteed.

Read next

Rob Price was a senior correspondent at Business Insider, based in San Francisco. He wrote investigations and long-form features about platforms, people, and power in Silicon Valley.His stories variously led to attorney general investigations, large-scale internal reviews at major tech companies, high-profile personnel departures, citation by state and federal lawmakers, and the closure of a well-funded startup. His 2022 story on the Bitfinex hack is being adapted into a feature film, and in 2024 he received an SPJ NorCal Excellence in Journalism award for his reporting on AI and relationships.Rob's scoops and exclusive stories were cited by The New York Times, Bloomberg, the BBC, Associated Press, Reuters, CNBC, Politico, The Guardian, Axios, and many other national and international publications. His writing has also been published in or syndicated by The Washington Post, The Independent, Vice, Slate, and elsewhere, and he appeared on CNN, the BBC, CBS, Reuters, ABC Australia, and other broadcast media to discuss technology, business, and culture.He worked for Business Insider from 2015 to 2025. Prior to joining the features team, Rob covered Facebook and Silicon Valley, and before that wrote about tech business, policy, and the gig economy in London. Between September and October 2019, he was acting executive editor for Business Insider's UK bureau. He also sat on the board of directors for the San Francisco Press Club, the leading non-profit media advocacy group in the Bay Area, and was a volunteer crew member at the Marine Mammal Center, the world's largest animal hospital for marine mammals. You can contact Rob Price via email at robaeprice@gmail.com, or +1 650-636-6268 (Signal / WhatsApp / Cell). Selected stories:— They spoke out against their employer. Then they were hit with trade secrets suits. The rise of 'shadow stand-ins'App, Lover, Muse: Inside a 47-year-old Minnesota man's three-year relationship with an AI chatbotDeel Speed: The inside story of a $12 billion HR startup's breakneck growthPrivate islands, flying cars, and psychedelic parties: Inside the wild post-Google lives of Larry Page and Sergey Brin'I want your Instagram account': First came the threatening texts, followed by the SWAT teams. Then someone wound up dead.Inside Iconiq: How Mark Zuckerberg's banker built a secret Silicon Valley empire and made billionsGaia was a wildly popular yoga brand. Now it's a publicly traded Netflix rival pushing conspiracy theories while employees fear the CEO is invading their dreamsA drunken late-night assault allegation has roiled the secretive world of Mark Zuckerberg's private family office. Personal aides are speaking out about claims that household staff endured sexual harassment and racism from their colleagues.