Social Media Manipulation

The Twitter Files revealed that multiple government agencies maintained regular communication channels with social media platforms to flag content for review or removal. The FBI held weekly meetings with Twitter and other platforms where they flagged specific accounts and posts.

The DHS established a Disinformation Governance Board (quickly disbanded after public backlash) and maintained contacts with platforms through CISA (Cybersecurity and Infrastructure Security Agency). White House officials sent direct messages to platform employees requesting the removal of specific posts, including satirical content.

Defenders argue that government agencies were flagging genuine foreign influence operations and dangerous health misinformation. Critics counter that the scale and nature of the flagging — particularly targeting domestic political speech and legitimate debate about COVID policies — amounted to a censorship apparatus that circumvented the First Amendment by using private companies as intermediaries.

Facebook's own internal research, leaked by Frances Haugen, showed that the company's algorithm changes in 2018 amplified divisive and inflammatory content. The company's researchers found that "misinformation, toxicity, and violent content are inordinately prevalent among reshares" and that the algorithm's emphasis on engagement disproportionately promoted this content.

Instagram's internal research found that 32% of teen girls said that when they felt bad about their bodies, Instagram made them feel worse. The company's researchers wrote that "we make body image issues worse for one in three teen girls." This research was concealed from the public and from Congress.

The fundamental design choice — optimizing for engagement rather than user wellbeing or information accuracy — is a business decision, not a technical inevitability. Engagement-optimized algorithms generate more advertising revenue but systematically favor emotional, extreme, and divisive content. Every platform that has publicly discussed its algorithmic choices has confirmed this tradeoff.

The 2018 Cambridge Analytica scandal revealed that data from 87 million Facebook users had been harvested without consent through a personality quiz app. The data was used by Cambridge Analytica, a political consulting firm, for voter profiling and targeted political advertising in the 2016 US presidential election and the Brexit referendum.

Facebook had known about the data harvesting since 2015 but did not inform users or take significant action until the Guardian and New York Times published their investigations in 2018. The FTC fined Facebook $5 billion — the largest privacy fine in history, but less than one month of the company's revenue.

Cambridge Analytica's parent company, SCL Group, had contracts with the UK Ministry of Defence and had conducted political campaigns in developing countries using similar psychographic targeting techniques. The company dissolved after the scandal, but its techniques and personnel dispersed into the broader political consulting industry.