Unless you\u2019re a moderator for a local community group discussing garbage collections or dog park etiquette, you are unlikely to fully understand the sheer volume and scale of abuse directed at people online.<\/p>\n
But when social media moderation and community management is part and parcel of your daily work, the toll on people and their loved ones can be enormous. Journalists, often early in their careers, can be on the receiving end<\/a> of torrents of abuse.<\/p>\n If they come from culturally or linguistically diverse backgrounds, that reluctance to report can be even higher<\/a> than other colleagues.<\/p>\n There\u2019s growing employer concern about how moderating confronting content can affect people\u2019s wellbeing. Employers also have a duty to keep their staff safe at work, including online.<\/p>\n The ABC wanted to understand what this looked like in practice. Its internal survey data shows just how bad the problem has become for moderators who are employed to keep audience members safe when contributing to online discussions. <\/p>\n What did the ABC find?<\/p>\n In 2022, the ABC asked 111 staff who were engaged in online moderation as part of their jobs to self-report the frequency of exposure to potentially harmful experiences.<\/p>\n First it was important to understand just how long people were spending online moderating content. For those who had to moderate content every day, 63% they did it for less than an hour and a half, and 88% moderated for less than three hours. <\/p>\n The majority of staff surveyed saw potentially harmful content every week.<\/p>\n 71% of moderators reported seeing denigration of their work weekly, with 25% seeing this daily.<\/p>\n Read more: Half reported seeing misogynistic content weekly, while more than half said they saw racist content weekly.<\/p>\n Around a third reported seeing homophobic content every week. <\/p>\n In the case of abusive language, 20% said they encountered it weekly.<\/p>\n It\u2019s a confronting picture on its own, but many see more than one type of this content at a time. This compounds the situation.<\/p>\n It is important to note the survey did not define specifically what was meant by racist, homophobic or misogynistic content, so that was open to interpretation from the moderators.<\/p>\n A global issue<\/p>\n We\u2019ve known for a few years about the mental health problems faced by moderators<\/a> in other countries.<\/p>\n Some people employed by Facebook to filter out the most toxic material and have gone on to take the company to court.<\/p>\n In one case in the United States, Facebook reached a settlement<\/a> with more than 10,000 content moderators that included U$52 million (A$77.8 million) for mental health treatment.<\/p>\n In Kenya<\/a>, 184 moderators contracted by Facebook are suing the company for poor working conditions, including a lack of mental health support. They\u2019re seeking U$1.6 billion (A$2.3 billion) in compensation. <\/p>\n The case is ongoing and so too are other separate cases<\/a> against Meta in Kenya.<\/p>\n In Australia, moderators during the height of the COVID pandemic reported<\/a> how confronting it could be to deal with social media users\u2019 misinformation and threats.<\/p>\n A 2023 report<\/a> by Australian Community Managers, the peak body for online moderators, found 50% of people surveyed said a key challenge of their job was maintaining good mental health.<\/p>\n What\u2019s being done?<\/p>\n Although it is not without its own issues, the ABC is leading the way in protecting its moderators from harm. <\/p>\n It has long worked to protect its staff from trauma exposure with a variety of programs, including a peer support program for journalists. The program was supported by the Dart Centre for Journalism and Trauma Asia Pacific<\/a>.<\/p>\n But as the level of abuse directed at staff increased in tone and intensity, the national broadcaster appointed a full-time Social Media Wellbeing Advisor<\/a>. Nicolle White manages the workplace health and safety risk generated by social media. She\u2019s believed to be the first in the world in such a role.<\/p>\n As part of the survey, the ABC\u2019s moderators were asked about ways they could be better supported.<\/p>\n Turning off comments was unsurprisingly rated as the most helpful technique to promote wellbeing, followed by support from management, peer support, and preparing responses to anticipated audience reactions.<\/p>\n Turning off the comments<\/a>, however, often leads to complaints from at least some people that their views are being censored. This is despite the fact media publishers are legally liable for comments on their content, following a 2021 High Court decision<\/a>.<\/p>\n Educating staff about why people comment on news content has been an important part of harm reduction.<\/p>\n Some of the other changes implemented after the survey included encouraging staff not to moderate comments when it related to their own lived experience or identity, unless they feel empowered in doing so.<\/p>\n The peer support program also links staff others with moderation experience.<\/p>\n Managers were urged to ensure that self-care plans were completed by staff to prepare for high-risk moderation days (such as the Voice referendum). These includes documenting positive coping mechanisms, how to implement boundaries at the end of a news shift, debriefing and asking staff to reflect on the value in their work. <\/p>\n
\n Can human moderators ever really rein in harmful online content? New research says yes<\/a><\/p>\n