Perfectly Imperfect: Coping With The ‘Flaws’ Of Artificial Intelligence (AI)

What is the acceptable failure rate of an airplane? Well, it is not zero… no matter what how hard we want to believe otherwise. There is a number, and it is a very low number. When it comes to machines, computers, artificial intelligence, etc., they are perfectly imperfect. Mistakes will be made. Poor recommendations will occur. AI will never be perfect. That does not mean they do not provide value. People need to understand why machines may mistakes and set their beliefs accordingly. This means understanding the three key areas on why AI fails: implicit bias, poor data, and expectations.

The first challenge is implicit bias, which are the unconscious perceptions people have that cloud thoughts and actions. Consider, the recent protests on racial justice and police brutality and the powerful message that Black Lives Matter. The Forbes article AI Taking A Knee: Action To Improve Equal Treatment Under The Law is a great example of how implicit bias has played a role in the discrimination  and just how hard (but not impossible) it is to use AI to reduce prejudice in our law enforcement and judicial systems. AI learns from people. If implicit bias is in the training, then the AI will learn this bias. Moreover, when the AI performs work, that work will reflect this bias… even if the work is for social good.

Take for example the Allegheny Family Screening Tool. It is meant to predict which welfare children might be at risk from foster parent abuse. The initial rollout of this solution had some challenges though. The local Department of Human Services acknowledged that the tool might have racial and income bias.  Triggers like neglect were often confused or misconstrued by associating foster parents who lived in poverty with inattention or mistreatment. Since learning of these problems, tremendous steps were taken to reduce the implicit bias in the screening tool. Elimination is much harder. When it comes to bias, how do people manage the unknown unknowns? How is social context addressed? What does “right” or “fair” behavior mean? If people cannot identify, define, and resolve these questions, then how will they teach the machine? This is a major driver AI will be perfectly imperfect because of implicit bias.

 

 

 

 

 

 

 

 

 

 

 

 

 

 

The second challenge is data. Data is the fuel for AI. The machine trains through ground truth (i.e. rules on how to make decisions, not the decisions themselves) and from lots of big data to learn the patterns and relationships within the data. If our data is incomplete or flawed, then AI cannot learn well. Consider COVID-19. John HopkinsThe COVID Tracking ProjectU.S. Centers for Disease Control (CDC), and the World Health Organization all report different numbers. With such variation, it is very difficult for an AI to gleam meaningful patterns from the data let alone find those hidden insights. More challenging, what about incomplete or erroneous data? Imagine teaching an AI about healthcare but only providing data on women’s health. That impedes how we can use AI in healthcare.

Then there is a challenge in that people may provide too much data. It could be irrelevant, unmeaningful, or even a distraction. Consider when IBM had Watson read the Urban Dictionary, and then it could not distinguish when to use normal language or to use slang and curse words. The problem got so bad that IBM had to erase the Urban Dictionary from Watson’s memory. Similarly, an AI system needs to hear about 100 million words to become fluent in a language. However, a human child only seems to need around 15 million words to become fluent. This implies that we may not know what data is meaningful. Thus, AI trainers may actually focus on superfluous information that could lead the AI to waste time, or even worse, identify false patterns.

The third challenge is expectations. Even though humans make mistakes, people still expect machines to be perfect. In healthcare, experts have estimated that the misdiagnosis rate may be as high as 20%, which means potentially one out of five patients are misdiagnosed. Given this data as well as a scenario where an AI assisted diagnosis may have an error rate of one out of one hundred thousand, most people still prefer to see only the human doctor. Why? One of the most common reasons given is that the misdiagnosis rate of the AI is too high (even though it is much lower than a human doctor.) People expect AI to be perfect. Potentially even worse, people expect the human AI trainers to be perfect too.

On March 23, 2016, Microsoft launched Tay (Thinking About You), a Twitter bot. Microsoft had trained its AI to the level of language and interaction of a 19-year-old, American girl. In a grand social experiment, Tay was released to the world. 96,000 tweets later, Microsoft had to shut Tay down about 16 hours after launch because it had turned sexist, racist, and promoted Nazism. Regrettably, some individuals decided to teach Tay about seditious language to corrupt it. In conjunction, Microsoft did not think to teach Tay about inappropriate behavior so it had no basis (or reason) to know that something like inappropriate behavior and malicious intent might exist. The grand social experiment resulted in failure, and sadly, was probably a testament more about human society than the limitations of AI.

Implicit bias, poor data, and people expectations show that AI will never be perfect. It is not the magic bullet solution many people hope to have. AI can still do some extraordinary things for humans like restore mobility to a lost limb or improve food production while using less resources. People should not discount the value we can get. We should always remember: AI is perfectly imperfect, just like us.

Original post: https://www.forbes.com/sites/cognitiveworld/2020/06/15/perfectly-imperfect-coping-with-the-flaws-of-artificial-intelligence-ai/

82 comentários em “Perfectly Imperfect: Coping With The ‘Flaws’ Of Artificial Intelligence (AI)

  1. I am the owner of JustCBD Store label (justcbdstore.com) and I am currently trying to broaden my wholesale side of business. I am hoping anybody at targetdomain can help me 🙂 I considered that the most ideal way to do this would be to talk to vape stores and cbd retailers. I was really hoping if anybody could suggest a trustworthy site where I can buy CBD Shops B2B Data List I am currently looking at creativebeartech.com, theeliquidboutique.co.uk and wowitloveithaveit.com. Unsure which one would be the most suitable solution and would appreciate any advice on this. Or would it be much simpler for me to scrape my own leads? Ideas?

  2. I am the co-founder of JustCBD label (justcbdstore.com) and I’m presently trying to broaden my wholesale side of company. It would be great if anybody at targetdomain share some guidance ! I considered that the most effective way to do this would be to reach out to vape companies and cbd retail stores. I was really hoping if anybody could recommend a trustworthy web-site where I can purchase Vape Shop Business Contact Details I am currently checking out creativebeartech.com, theeliquidboutique.co.uk and wowitloveithaveit.com. Not exactly sure which one would be the most ideal choice and would appreciate any support on this. Or would it be easier for me to scrape my own leads? Suggestions?

  3. Hi, I do believe this is an excellent web site. I stumbledupon it 😉 I will return yet again since I book-marked it. Money and freedom is the best way to change, may you be rich and continue to guide other people.

  4. Oh my goodness! Amazing article dude! Thank you, However I am encountering issues with your RSS. I don’t know why I am unable to join it. Is there anybody else having similar RSS issues? Anybody who knows the answer can you kindly respond? Thanx!!

  5. You are so interesting! I don’t suppose I have read anything like this before. So wonderful to discover another person with a few original thoughts on this subject matter. Seriously.. thank you for starting this up. This web site is one thing that is needed on the internet, someone with a little originality!

  6. Next time I read a blog, I hope that it does not fail me as much as this one. I mean, I know it was my choice to read, but I truly believed you would have something interesting to talk about. All I hear is a bunch of moaning about something that you can fix if you were not too busy seeking attention.

  7. You are so interesting! I don’t believe I’ve truly read a single thing like this before. So good to discover someone with some unique thoughts on this topic. Really.. thanks for starting this up. This web site is something that is needed on the internet, someone with a bit of originality!

  8. Hi, I do believe your blog may be having web browser compatibility problems. When I take a look at your web site in Safari, it looks fine however when opening in I.E., it’s got some overlapping issues. I just wanted to give you a quick heads up! Besides that, great site!

  9. Howdy! I could have sworn I’ve visited this website before but after browsing through some of the posts I realized it’s new to me. Nonetheless, I’m definitely pleased I found it and I’ll be book-marking it and checking back often!

  10. I blog quite often and I really appreciate your content. This great article has truly peaked my interest. I am going to bookmark your website and keep checking for new information about once a week. I subscribed to your Feed too.

  11. I blog frequently and I seriously thank you for your content. This great article has really peaked my interest. I will book mark your blog and keep checking for new details about once a week. I opted in for your RSS feed too.

  12. Howdy! This post could not be written much better! Looking at this post reminds me of my previous roommate! He continually kept talking about this. I most certainly will forward this article to him. Pretty sure he’ll have a very good read. Thank you for sharing!

  13. After exploring a number of the articles on your website, I truly like your way of blogging. I book marked it to my bookmark webpage list and will be checking back soon. Please check out my website too and tell me your opinion.

  14. I blog often and I truly thank you for your information. The article has really peaked my interest. I will book mark your blog and keep checking for new information about once per week. I opted in for your RSS feed as well.

  15. Right here is the right site for anybody who would like to understand this topic. You understand a whole lot its almost tough to argue with you (not that I actually will need to…HaHa). You certainly put a new spin on a subject which has been written about for decades. Great stuff, just wonderful!

  16. Right here is the perfect site for everyone who wants to find out about this topic. You know a whole lot its almost tough to argue with you (not that I personally will need to…HaHa). You definitely put a new spin on a topic that’s been discussed for a long time. Wonderful stuff, just wonderful!

  17. Your style is unique compared to other people I’ve read stuff from. Many thanks for posting when you have the opportunity, Guess I will just book mark this page.

  18. Hi there! This post could not be written much better! Reading through this post reminds me of my previous roommate! He constantly kept preaching about this. I most certainly will send this information to him. Fairly certain he’s going to have a very good read. Thanks for sharing!

  19. Greetings from California! I’m bored to tears at work so
    I decided to browse your site on my iphone during lunch break.
    I love the info you present here and can’t wait to take a look
    when I get home. I’m amazed at how fast your
    blog loaded on my mobile .. I’m not even using WIFI, just 3G ..
    Anyhow, great site! adreamoftrains web hosting sites

  20. I really love your blog.. Pleasant colors & theme. Did you make this amazing site yourself? Please reply back as I’m looking to create my own personal site and want to learn where you got this from or just what the theme is called. Kudos!

  21. I must thank you for the efforts you have put in writing this website. I really hope to see the same high-grade blog posts by you in the future as well. In truth, your creative writing abilities has motivated me to get my own, personal website now 😉

  22. After looking into a handful of the blog posts on your web site, I really appreciate your way of writing a blog. I book marked it to my bookmark site list and will be checking back soon. Please visit my website as well and let me know what you think.

  23. Having read this I believed it was rather enlightening. I appreciate you finding the time and effort to put this short article together. I once again find myself personally spending way too much time both reading and leaving comments. But so what, it was still worthwhile!

  24. I was more than happy to discover this site. I wanted to thank you for ones time due to this wonderful read!! I definitely liked every bit of it and i also have you book marked to see new stuff on your web site.

  25. An impressive share! I’ve just forwarded this onto a co-worker who had been conducting a little homework on this. And he in fact ordered me breakfast due to the fact that I stumbled upon it for him… lol. So let me reword this…. Thank YOU for the meal!! But yeah, thanx for spending the time to discuss this subject here on your web page.

  26. I would like to thank you for the efforts you’ve put in writing this website. I really hope to see the same high-grade content from you in the future as well. In truth, your creative writing abilities has inspired me to get my own, personal blog now 😉

  27. A fascinating discussion is worth comment. There’s no doubt that that you need to publish more about this issue, it might not be a taboo subject but typically people do not talk about such issues. To the next! Cheers!!

  28. Hi! I could have sworn I’ve visited this website before but after going through many of the posts I realized it’s new to me. Regardless, I’m certainly happy I stumbled upon it and I’ll be book-marking it and checking back frequently!

  29. Hi there, I do believe your site could possibly be having internet browser compatibility problems. Whenever I take a look at your site in Safari, it looks fine however, if opening in I.E., it’s got some overlapping issues. I simply wanted to provide you with a quick heads up! Besides that, wonderful blog!

  30. Next time I read a blog, Hopefully it does not disappoint me as much as this one. After all, Yes, it was my choice to read, however I really thought you’d have something helpful to say. All I hear is a bunch of moaning about something you could possibly fix if you weren’t too busy looking for attention.

  31. You are so cool! I do not believe I have read through a single thing like that before. So great to find another person with unique thoughts on this issue. Really.. many thanks for starting this up. This website is something that is required on the internet, someone with a little originality!

  32. An outstanding share! I have just forwarded this onto a colleague who was conducting a little research on this. And he actually bought me breakfast due to the fact that I found it for him… lol. So let me reword this…. Thanks for the meal!! But yeah, thanx for spending the time to discuss this subject here on your website.

  33. An outstanding share! I’ve just forwarded this onto a friend who has been conducting a little homework on this. And he actually ordered me lunch simply because I found it for him… lol. So allow me to reword this…. Thank YOU for the meal!! But yeah, thanks for spending some time to talk about this subject here on your website.

  34. Oh my goodness! Impressive article dude! Thank you, However I am going through issues with your RSS. I don’t know why I can’t subscribe to it. Is there anyone else getting similar RSS issues? Anyone that knows the answer will you kindly respond? Thanx!!

  35. Achieving your fitness goals does not need a certified personal trainer or an expensive gym membership, it is not hard to exercise at home. It’s easy to go down a training and fitness rabbit hole, however, when you’re looking for the best home exercise equipment to outfit your personal home gym.

  36. An outstanding share! I have just forwarded this onto a coworker who was conducting a little research on this. And he actually ordered me lunch due to the fact that I stumbled upon it for him… lol. So allow me to reword this…. Thank YOU for the meal!! But yeah, thanks for spending time to discuss this topic here on your web page.

  37. After looking over a handful of the blog articles on your blog, I seriously like your technique of blogging. I book-marked it to my bookmark site list and will be checking back in the near future. Take a look at my website as well and let me know what you think.

  38. Oh my goodness! Awesome article dude! Many thanks, However I am having problems with your RSS. I don’t understand why I am unable to join it. Is there anyone else getting identical RSS problems? Anyone that knows the solution will you kindly respond? Thanks!!

  39. Good day! I simply would like to give you a huge thumbs up for the excellent information you have got right here on this post. I’ll be coming back to your site for more soon.

  40. Hello there! I could have sworn I’ve been to your blog before but after going through many of the posts I realized it’s new to me. Anyways, I’m definitely pleased I stumbled upon it and I’ll be bookmarking it and checking back often!

  41. I am really impressed with your writing skills and also with the layout on your weblog. Is this a paid theme or did you customize it yourself? Anyway keep up the nice quality writing, it is rare to see a nice blog like this one nowadays.|

Leave a Reply

Your email address will not be published. Required fields are marked *