My Institute for the Future colleagues Douglas Rushkoff, Jake Dunagan, and I wrote a research paper on the "Biology of Disinformation" and how media viruses, bots and computational propaganda have redefined how information is weaponized for propaganda campaigns. While technological solutions may seem like the most practical and effective remedy, fortifying social relationships that define human communication may be the best way to combat “ideological warfare” that is designed to push us toward isolation. As Rushkoff says, "adding more AI's and algorithms to protect users from bad social media is counterproductive: how about increasing our cultural immune response to destructively virulent memes, instead?" From The Biology of Disinformation:
The specter of widespread computational propaganda that leverages memetics through persuasive technologies looms large. Already, artificially intelligent software can evolve false political and social constructs highly targeted to sway specific audiences. Users find themselves in highly individualized, algorithmically determined news and information feeds, intentionally designed to: isolate them from conflicting evidence or opinions, create self-reinforcing feedback loops of confirmation, and untether them from fact-based reality. And these are just early days. If memes and disinformation have been weaponized on social media, it is still in the musket stage. Sam Woolley, director of the Institute for the Future’s (IFTF) Digital Intelligence Lab, has concluded that defenders of anything approaching “objective” truth are woefully behind in dealing with computational propaganda. This is the case in both technological responses and neuro-cultural defenses. Moreover, the 2018 and 2020 US election cycles are going to see this kind of cognitive warfare on an unprecedented scale and reach.
But these mechanisms, however powerful, are only as much a threat to human reason as the memetic material they transmit, and the impact of weaponized memetics itself on the social and political landscape. Memes serve as both probes of collective cultural conflicts, and ways of inflaming social divisions. Virulent ideas and imagery only take hold if they effectively trigger a cultural immune response, leading to widespread contagion. This is less a question of technological delivery systems and more a question of human vulnerability. The urgent question we all face is not how to disengage from the modern social media landscape, but rather how do we immunize ourselves against media viruses, fake news, and propaganda?
"The Biology OfDisinformation: Memes, Media Viruses, And Cultural Inoculation" (IFTF.org)
