AI proves it’s a poor substitute for human content checkers during lockdown

The spread of the novel coronavirus around the world has been unprecedented and rapid. In response, tech companies have scrambled to ensure their services are still available to their users, while also transitioning thousands of their employees to teleworking. However, due to privacy and security concerns, social media companies have been unable to transition all of their content moderators to remote work. As a result, they have become more reliant on artificial intelligence to make content moderation decisions. Facebook and YouTube admitted as much in their public announcements over the last couple of months, and Twitter appears to be taking a similar tack. This new sustained reliance on AI due to the coronavirus crisis is concerning as it has significant and ongoing consequences for the free expression rights of online users.

The broad use of AI for content moderation is troubling because in many cases, these automated tools have been found to be inaccurate. This is partly because there is a lack of diversity in the training samples that algorithmic models are trained on. In addition, human speech is fluid, and intention is important. That makes it difficult to train an algorithm to detect nuances in speech, like a human would. Also, context is important when moderating content. Researchers have documented instances in which automated content moderation tools on platforms such as YouTube mistakenly categorized videos posted by NGOs documenting human rights abuses by ISIS in Syria as extremist content and removed them. It was well-documented even before the current pandemic: Without a human in the loop, these tools are often unable to accurately understand and make decisions on speech-related cases across different languages, communities, regions, contexts, and cultures. The use of AI-only content moderation compounds the problem.

Internet platforms have recognized the risks that the reliance on AI poses to online speech during this period, and have warned users that they should expect more mistakes related to content moderation, particularly related to “false positives”, which is content that is removed or prevented from being shared despite not actually violating a platform’s policy. These statements, however, conflict with some platforms’ defenses of their automated tools, which they have argued only remove content if they are highly confident the content violates the platform’s policies. For example, Facebook’s automated system threatened to ban the organizers of a group working to hand-sew masks on the platform from commenting or posting. The system also flagged that the group could be deleted altogether. More problematic yet, YouTube’s automated system has been unable to detect and remove a significant number of videos advertising overpriced face masks and fraudulent vaccines and cures. These AI-driven errors underscore the importance of keeping a human in the loop when making content-related decisions.

During the current shift toward increased automated moderation, platforms like Twitter and Facebook have also shared that they will be triaging and prioritizing takedowns of certain categories of content, including COVID-19-related misinformation and disinformation. Facebook has also specifically listed that it will prioritize takedown of content that could pose imminent threat or harm to users, such as content related to child safety, suicide and self-injury, and terrorism, and that human review of these high-priority categories of content has been transitioned to some full-time employees. However, Facebook shared that due to this prioritization approach, reports in other categories of content that are not reviewed within 48 hours of being reported are automatically closed, meaning the content is left up. This could result in a significant amount of harmful content remaining on the platform.

In addition to expanding the use of AI for moderating content, some companies have also responded to strains on capacity by rolling back their appeals processes, compounding the threat to free expression. Facebook, for example, no longer enables users to appeal moderation decisions. Rather, users can now indicate that they disagree with a decision, and Facebook merely collects this data for future analysis. YouTube and Twitter still offer appeals processes, although YouTube shared that given resource constraints, users will see delays. Timely appeals processes serve as a vital mechanism for users to gain redress when their content is erroneously removed, and given that users have been told to expect more mistakes during this period, the lack of a meaningful remedy process is a significant blow to users’ free expression rights.

Further, during this period, companies such as Facebook have decided to rely more heavily on automated tools to screen and review advertisements, which has proven a challenging process as companies have introduced policies to prevent advertisers and sellers from profiting off of public fears related to the pandemic and from selling bogus items. For example, CNBC found fraudulent ads for face masks on Google that promised protection against the virus and claimed they were “government approved to block up to 95% of airborne viruses and bacteria. Limited Stock.” This raises concerns about whether these automated tools are robust enough to catch harmful content and about what the consequences are of harmful ads slipping through the cracks.

Issues of online content governance and online free expression have never been more important. Billions of individuals are now confined to their homes and are relying on the internet to connect with others and access vital information. Errors in moderation caused by automated tools could result in the removal of non-violating, authoritative, or important information, thus preventing users from expressing themselves and accessing legitimate information during a crisis. In addition, as the volume of information available online has grown during this time period, so has the amount of misinformation and disinformation. This has magnified the need for responsible and effective moderation that can identify and remove harmful content.

The proliferation of COVID-19 has sparked a crisis, and tech companies, like the rest of us, have had to adjust and respond quickly without advanced notice. But there are lessons we can extract from what is happening right now. Policymakers and companies have continuously touted automated tools as a silver bullet solution to online content governance problems, despite pushback from civil society groups. As companies rely more on algorithmic decision-making during this time, these civil society groups should work to document specific examples of the limitations of these automated tools in order to understand the need for increased involvement of humans in the future.

In addition, companies should use this time to identify best practices and failures in the content governance space and to devise a rights-respecting crisis response plan for future crises. It is understandable that there will be some unfortunate lapses in remedies and resources available to users during this unprecedented time. But companies should ensure these emergency responses are limited to the duration of this public health crisis and do not become the norm.

 

Original post: https://venturebeat.com/2020/05/23/ai-proves-its-a-poor-substitute-for-human-content-checkers-during-lockdown/

109 comentários em “AI proves it’s a poor substitute for human content checkers during lockdown

  1. We stumbled over here from a different page and thought I should check things out.
    I like what I see so i am just following you. Look forward to exploring your web page again.

  2. Thank you for some other wonderful article. The place else may just anyone get that
    type of info in such an ideal manner of writing? I’ve a presentation subsequent week,
    and I’m on the search for such information.

  3. Yesterday, while I was at work, my sister stole my iPad and tested to
    see if it can survive a twenty five foot drop,
    just so she can be a youtube sensation. My apple ipad is now
    broken and she has 83 views. I know this is entirely off topic but I had to
    share it with someone!

  4. With havin so much content and articles do you ever run into any issues of plagorism or
    copyright infringement? My website has a lot of exclusive content I’ve either authored myself or outsourced but it
    looks like a lot of it is popping it up all over the web without my agreement.
    Do you know any methods to help stop content from being ripped off?
    I’d genuinely appreciate it.

  5. Undeniably imagine that which you stated. Your favorite reason appeared to be on the net the simplest factor to bear in mind of.
    I say to you, I definitely get annoyed at the same time as people think
    about issues that they plainly do not recognise about.
    You controlled to hit the nail upon the highest and also outlined
    out the whole thing with no need side effect
    , people can take a signal. Will likely be again to get more.
    Thanks

  6. I’m the co-founder of JustCBD company (justcbdstore.com) and am seeking to grow my wholesale side of business. I am hoping someone at targetdomain share some guidance . I considered that the most ideal way to do this would be to reach out to vape companies and cbd retailers. I was really hoping if anyone could suggest a qualified web-site where I can buy Vape Shop B2B Data List I am presently considering creativebeartech.com, theeliquidboutique.co.uk and wowitloveithaveit.com. Not exactly sure which one would be the most suitable selection and would appreciate any support on this. Or would it be simpler for me to scrape my own leads? Suggestions?

  7. I am the co-founder of JustCBD company (justcbdstore.com) and I am currently planning to grow my wholesale side of business. I really hope that anybody at targetdomain share some guidance 🙂 I thought that the very best way to accomplish this would be to connect to vape stores and cbd stores. I was hoping if anybody at all could suggest a trustworthy web-site where I can purchase CBD Shops Business Leads I am currently reviewing creativebeartech.com, theeliquidboutique.co.uk and wowitloveithaveit.com. Not exactly sure which one would be the most suitable choice and would appreciate any assistance on this. Or would it be easier for me to scrape my own leads? Ideas?

  8. Having read this I believed it was really informative. I appreciate you taking the time and energy to put this article together. I once again find myself spending a significant amount of time both reading and commenting. But so what, it was still worthwhile!

  9. hi!,I like your writing very a lot! percentage we be in contact more approximately your post on AOL?

    I need a specialist on this area to unravel my problem. May be that is you!

    Looking ahead to peer you.

  10. Can I simply say what a comfort to uncover someone who genuinely understands what they’re discussing on the web. You definitely realize how to bring a problem to light and make it important. More and more people must look at this and understand this side of your story. I was surprised that you aren’t more popular because you surely possess the gift.

  11. I’m impressed, I must say. Seldom do I come across a blog that’s both educative and interesting, and let me tell you, you’ve hit the nail on the head. The problem is something too few people are speaking intelligently about. Now i’m very happy I found this in my search for something regarding this.

  12. I have to thank you for the efforts you have put in penning this blog. I’m hoping to see the same high-grade content by you later on as well. In fact, your creative writing abilities has inspired me to get my very own website now 😉

  13. I truly love your blog.. Great colors & theme. Did you create this web site yourself? Please reply back as I’m trying to create my own personal blog and want to find out where you got this from or just what the theme is named. Thank you!

  14. I’d like to thank you for the efforts you’ve put in penning this website. I really hope to check out the same high-grade blog posts by you later on as well. In truth, your creative writing abilities has inspired me to get my very own blog now 😉

  15. I think everything published was actually very reasonable.

    However, what about this? suppose you added a little content?
    I ain’t suggesting your content isn’t good, but what if you
    added a headline that makes people want more? I mean AI proves it’s a poor substitute
    for human content checkers during lockdown – Adolfo Eliazàt
    – Artificial Intelligence – AI News is a little
    plain. You should look at Yahoo’s front page and watch how they write post headlines to get people to click.
    You might add a related video or a pic or two to grab people interested about everything’ve got to
    say. Just my opinion, it would bring your posts a little livelier.

  16. May I simply say what a comfort to discover a person that truly knows
    what they’re talking about online. You definitely understand how to bring a problem to light and make it
    important. A lot more people need to read this and
    understand this side of the story. It’s surprising you aren’t more popular since you
    most certainly possess the gift.

  17. I blog often and I genuinely thank you for your content. The article has truly peaked my interest. I am going to take a note of your website and keep checking for new details about once a week. I subscribed to your RSS feed too.

  18. I’m very pleased to discover this great site. I want to to thank you for your time due to this fantastic read!! I definitely loved every bit of it and i also have you book-marked to see new stuff on your web site.

  19. I needed to thank you for this very good read!! I certainly enjoyed every little bit of it. I’ve got you bookmarked to check out new stuff you post…

  20. After I initially left a comment I seem to have clicked the -Notify me when new comments are added- checkbox and now every time a comment is added I recieve 4 emails with the exact same comment. Perhaps there is an easy method you are able to remove me from that service? Cheers!

  21. Hi there! I simply wish to offer you a big thumbs up for your excellent information you’ve got here on this post. I will be returning to your site for more soon.

  22. Unquestionably imagine that that you stated. Your favorite justification seemed to be on the internet the easiest factor to
    remember of. I say to you, I definitely get irked at the same time as people think about worries
    that they plainly do not realize about. You controlled to hit the nail upon the top and also outlined out the whole thing without having side effect , people could take
    a signal. Will probably be back to get more. Thanks

  23. When I initially commented I appear to have clicked on the -Notify me when new comments are added- checkbox and now whenever a comment is added I receive four emails with the exact same comment. Perhaps there is an easy method you are able to remove me from that service? Cheers!

  24. Next time I read a blog, Hopefully it does not fail me as much as this one. I mean, I know it was my choice to read through, but I truly thought you would probably have something interesting to say. All I hear is a bunch of whining about something you could fix if you were not too busy seeking attention.

  25. I seriously love your blog.. Very nice colors & theme. Did you make this web site yourself? Please reply back as I’m looking to create my own blog and want to learn where you got this from or just what the theme is called. Thanks!

  26. Oh my goodness! Awesome article dude! Thanks, However I am having difficulties with your RSS. I don’t understand the reason why I cannot join it. Is there anyone else getting similar RSS issues? Anyone who knows the answer can you kindly respond? Thanks!!

  27. An impressive share! I have just forwarded this onto a coworker who has been doing a little research on this. And he in fact ordered me dinner because I found it for him… lol. So allow me to reword this…. Thank YOU for the meal!! But yeah, thanx for spending time to discuss this issue here on your site.

  28. I seriously love your blog.. Very nice colors & theme. Did you develop this website yourself? Please reply back as I’m looking to create my own blog and want to learn where you got this from or exactly what the theme is named. Appreciate it!

  29. This is a really good tip especially to those fresh to the blogosphere. Brief but very accurate information… Many thanks for sharing this one. A must read post!

  30. Hello, There’s no doubt that your website may be having browser compatibility issues. When I take a look at your site in Safari, it looks fine however, if opening in Internet Explorer, it has some overlapping issues. I merely wanted to provide you with a quick heads up! Apart from that, excellent blog!

  31. I’m impressed, I have to admit. Seldom do I come across a blog that’s both educative and interesting, and let me tell you, you’ve hit the nail on the head. The issue is something that not enough people are speaking intelligently about. I’m very happy I came across this in my search for something relating to this.

  32. Nice post. I learn something totally new and challenging on blogs I stumbleupon on a daily basis. It will always be useful to read through content from other authors and use something from other web sites.

  33. Can I simply just say what a relief to discover somebody who genuinely understands what they’re talking about on the net. You certainly know how to bring an issue to light and make it important. More people have to look at this and understand this side of the story. I was surprised that you aren’t more popular given that you certainly have the gift.

  34. Achieving your fitness goal does not need a certified personal trainer or an expensive gym memberships, it’s not hard to exercise at home. It is easy to go down a training and fitness rabbit hole, however, when you are looking for the best home exercise equipment to outfit your personal home gym.

  35. Outstanding post but I was wondering if you could write a litte more on this topic?
    I’d be very thankful if you could elaborate a little
    bit more. Bless you! 32hvAj4 cheap flights

  36. Howdy, I do think your web site could be having web browser compatibility problems. When I take a look at your web site in Safari, it looks fine but when opening in Internet Explorer, it has some overlapping issues. I simply wanted to provide you with a quick heads up! Apart from that, excellent blog!

  37. Its like you read my mind! You seem to know a lot about this, like you wrote the book in it
    or something. I think that you could do with a few pics
    to drive the message home a little bit, but instead of that,
    this is great blog. An excellent read. I’ll certainly be back.

  38. Spot on with this write-up, I absolutely feel this website needs far more attention. I’ll probably be back again to read more, thanks for the info!

  39. Everything is very open with a precise clarification of the challenges. It was really informative. Your website is very useful. Thanks for sharing!

  40. Hello there, just became aware of your blog through Google, and
    found that it’s truly informative. I am going to watch out for brussels.
    I’ll be grateful if you continue this in future.
    A lot of people will be benefited from your writing. Cheers!
    3aN8IMa cheap flights

  41. I blog quite often and I really thank you for your content. This great article has truly peaked my interest. I am going to bookmark your site and keep checking for new information about once a week. I subscribed to your Feed too.

  42. Right here is the perfect web site for everyone who really wants to find out about this topic. You understand a whole lot its almost tough to argue with you (not that I actually will need to…HaHa). You certainly put a new spin on a subject that has been discussed for ages. Wonderful stuff, just excellent!

  43. I truly love your website.. Excellent colors & theme. Did you make this website yourself? Please reply back as I’m looking to create my very own website and would love to find out where you got this from or just what the theme is named. Kudos!

  44. I’m amazed, I must say. Rarely do I come across a blog that’s both educative and amusing, and let me tell you, you’ve hit the nail on the head. The issue is something that not enough men and women are speaking intelligently about. I am very happy I stumbled across this during my hunt for something relating to this.

  45. After I initially left a comment I seem to have clicked on the -Notify me when new comments are added- checkbox and from now on each time a comment is added I receive four emails with the same comment. There has to be a means you are able to remove me from that service? Thanks!

  46. Howdy! This article could not be written much better! Going through this article reminds me of my previous roommate! He always kept talking about this. I’ll send this article to him. Fairly certain he’s going to have a good read. Thanks for sharing!

  47. Aw, this was an extremely good post. Finding the time and actual effort to produce a good article… but what can I say… I hesitate a lot and don’t seem to get nearly anything done.

  48. After I initially commented I appear to have clicked the -Notify me when new comments are added- checkbox and from now on each time a comment is added I receive 4 emails with the same comment. Is there a means you are able to remove me from that service? Appreciate it!

  49. After I originally commented I seem to have clicked the -Notify me when new comments are added- checkbox and now whenever a comment is added I get four emails with the exact same comment. There has to be a means you can remove me from that service? Thank you!

  50. I absolutely love your website.. Very nice colors & theme. Did you create this amazing site yourself? Please reply back as I’m wanting to create my own blog and would love to learn where you got this from or exactly what the theme is called. Thanks!

  51. After exploring a few of the blog posts on your blog, I seriously like your technique of blogging. I book marked it to my bookmark site list and will be checking back in the near future. Please visit my website as well and let me know how you feel.

  52. Having read this I believed it was extremely enlightening. I appreciate you taking the time and energy to put this short article together. I once again find myself personally spending a significant amount of time both reading and posting comments. But so what, it was still worth it!

  53. Having read this I thought it was very enlightening. I appreciate you spending some time and effort to put this article together. I once again find myself personally spending a lot of time both reading and commenting. But so what, it was still worthwhile!

  54. You’re so cool! I do not think I’ve truly read through something like that before. So great to find somebody with some original thoughts on this issue. Really.. many thanks for starting this up. This site is one thing that’s needed on the web, someone with a little originality!

Leave a Reply

Your email address will not be published. Required fields are marked *