Scaling AI: 3 Reasons Why Explainability Matters

As artificial intelligence and machine learning-based systems become more ubiquitous in decision-making, should we expect our confidence in the outcomes to remain like that of its human collaborators? When humans make decisions, we’re able to rationalize the outcomes through inquiry and conversation around how expert judgment, experience and use of available information led to the decision. Unfortunately, engaging in a similar conversation with a machine isn’t possible yet. To borrow the words of former Secretary of Defense Ash Carter when speaking at a 2019 SXSW panel about post-analysis of an AI-enabled decision, “’the machine did it’ won’t fly.”

As we evolve human and machine collaboration, establishing trust, transparency and accountability at the onset of decision support system and algorithm design is paramount. Without it, people may be hesitant to trust AI recommendations because of a lack of transparency into how the machine reached its outcome. Fortunately, we’re beginning to see some light at the end of the “AI is a black box” tunnel as research on AI explainability is commercialized in the market. These early-stage AI explainability solutions are essential for leaders to ensure trust in, and to govern and scale, their AI applications across the enterprise.

Defining Explainable AI 

As AI becomes more embedded into our lives, a crucial part of our adoption journey stems from our ability to understand how AI makes decisions, why it comes to certain conclusions, and how to be confident in the results achieved. That’s explainability in a nutshell—a new “-ility” added to quality attributes used to evaluate the performance of a system. Current explainable AI solutions attempt to show how AI models make decisions in terms that humans understand, translating the process AI uses to transform data into real insights and value.

Explainability is not a new phenomenon. IT systems developers have grappled with it for decades, finding ways to explain complex topics in ways non-technical stakeholders can understand. Likewise, AI developers grapple with how to describe complex machine learning and AI models in a way that resonates with a wide range of audiences. In fact, there isn’t consensus on how to define explainable AI, however, most people agree that there should be a way to examine and trace AI decision-making provenance.

As AI permeates everyday life, explainability is becoming increasingly vital. Here are three reasons why explainability matters:

  1. People need to understand not just outcomes, but details behind the model (data provenance, performance metrics, etc.) to have confidence in the outputs.
  2. Once people trust how AI makes decisions, they can implement appropriate governance and accountability procedures needed to comply with requirements for their industries.
  3. Rather than accepting “black box” AI, people should be empowered to make decisions about what level of explainability is acceptable for their AI applications.

Explainability emerged as one solution to the problem of “black box” AI models, which are difficult to understand why they reached a decision. In highly regulated industries, stakeholders are legally required to show work and prove how an AI system reached a decision. Explainability becomes a proxy for model interpretability and auditability for non-data scientists.

Getting AI Models Ready for Prime Time  

We live in an era where data availability drives demand for trusted facts and informed decision-making. As we scale solutions and comply with regulations like the European Union’s General Data Protection Regulation, the AI community will be pressed to make AI systems easy to use, explain and defend. Stakeholders need to understand how a model generates its results and when to question those results before they can be confident of widely deploying a model.

Not all models can be explained, nor should they be. Different AI applications have diverging levels of requirement for explainability, from privacy concerns to risk tolerance. For example, we don’t require our GPS systems to “explain” driving directions, but we will likely have higher standards for systems used in medical diagnoses or treatment recommendations. In the absence of full explainability, software developers look to other methods to validate AI model performance.

The Beginning is a Great Place to Start 

Explainable processes and outcomes are the foundation for crucial elements to building trustworthy AI, such as transparency and governance. Data scientists and software engineers should build explainability features into their workflow from the beginning.

From there, governance and accountability mechanisms can easily be established to ensure that your organization is compliant with regulations for your industry. These measures are also safeguards against some of the stickier issues with deploying and managing AI, such as amplifying bias in data or having an overwhelming impact on marginalized populations. Organizations must be empowered to strike the right balance between accuracy, transparency, and risk in their AI, as there will always be tradeoffs.

It’s all part of the process of developing reliable solutions that deliver real value.

Josh Elliot is head of operations at Modzy.

 

Original post: https://www.nextgov.com/ideas/2020/05/scaling-ai-3-reasons-why-explainability-matters/165606/

86 comentários em “Scaling AI: 3 Reasons Why Explainability Matters

  1. Thanks , I have recently been looking for info about this topic for ages and yours is the
    best I’ve came upon so far. But, what in regards to the bottom line?
    Are you sure concerning the supply?

  2. Excellent goods from you, man. I’ve understand your
    stuff previous to and you are just too great.
    I actually like what you’ve acquired here, really like what you are stating and the way in which you say it.
    You make it entertaining and you still take care of to keep
    it sensible. I can not wait to read far more from you.
    This is actually a tremendous site.

  3. I’m the co-founder of JustCBD Store company (justcbdstore.com) and I am currently looking to grow my wholesale side of business. I really hope that someone at targetdomain can help me 🙂 I thought that the most suitable way to do this would be to reach out to vape shops and cbd retailers. I was really hoping if someone could recommend a trusted site where I can get Vape Shop Business Data I am already taking a look at creativebeartech.com, theeliquidboutique.co.uk and wowitloveithaveit.com. Unsure which one would be the very best option and would appreciate any guidance on this. Or would it be simpler for me to scrape my own leads? Suggestions?

  4. I am the manager of JustCBD brand (justcbdstore.com) and am seeking to grow my wholesale side of business. It would be great if someone at targetdomain is able to provide some guidance . I thought that the most effective way to do this would be to reach out to vape companies and cbd stores. I was hoping if anyone could suggest a trustworthy website where I can get CBD Shops B2B Database I am currently examining creativebeartech.com, theeliquidboutique.co.uk and wowitloveithaveit.com. Not exactly sure which one would be the very best solution and would appreciate any support on this. Or would it be simpler for me to scrape my own leads? Suggestions?

  5. I’m more than happy to find this site. I wanted to thank you for your time for this fantastic read!! I definitely savored every little bit of it and I have you book marked to look at new information on your web site.

  6. I was pretty pleased to discover this page. I want to to thank you for your time for this wonderful read!! I definitely enjoyed every little bit of it and I have you bookmarked to look at new things in your web site.

  7. Hi, I think your web site might be having web browser compatibility problems. Whenever I look at your website in Safari, it looks fine however, when opening in Internet Explorer, it’s got some overlapping issues. I simply wanted to give you a quick heads up! Other than that, excellent site!

  8. Aw, this was an extremely good post. Spending some time and actual effort to generate a very good article… but what can I say… I procrastinate a whole lot and never seem to get nearly anything done.

  9. Spot on with this write-up, I seriously believe that this website needs far more attention. I’ll probably be back again to read through more, thanks for the info!

  10. That is a good tip particularly to those fresh to the blogosphere. Short but very accurate information… Appreciate your sharing this one. A must read post!

  11. Can I simply just say what a comfort to discover somebody that really knows what they’re talking about on the net. You actually understand how to bring an issue to light and make it important. More and more people have to read this and understand this side of the story. I was surprised you are not more popular since you most certainly have the gift.

  12. A motivating discussion is definitely worth comment. I believe that you should write more about this subject matter, it might not be a taboo subject but usually people don’t speak about these topics. To the next! Cheers!!

  13. I truly love your website.. Excellent colors & theme. Did you build this site yourself? Please reply back as I’m trying to create my own blog and would like to know where you got this from or exactly what the theme is named. Appreciate it!

  14. Oh my goodness! Impressive article dude! Many thanks, However I am having difficulties with your RSS. I don’t understand the reason why I can’t subscribe to it. Is there anyone else having the same RSS problems? Anybody who knows the answer will you kindly respond? Thanx!!

  15. Having read this I thought it was very informative. I appreciate you taking the time and effort to put this information together. I once again find myself personally spending a lot of time both reading and posting comments. But so what, it was still worth it!

  16. After looking into a few of the blog articles on your site, I honestly like your technique of blogging. I book-marked it to my bookmark website list and will be checking back soon. Please check out my website as well and let me know how you feel.

  17. I blog often and I really thank you for your content. This great article has truly peaked my interest. I’m going to bookmark your site and keep checking for new information about once per week. I subscribed to your Feed as well.

  18. Everything is very open with a precise clarification of the issues. It was definitely informative. Your site is extremely helpful. Many thanks for sharing!

  19. An intriguing discussion is worth comment. I do believe that you need to publish more on this issue, it may not be a taboo subject but generally people don’t discuss such issues. To the next! All the best!!

  20. I am curious to find out what blog platform you’re using?
    I’m having some small security issues with my latest site and I would like to find something more safeguarded.
    Do you have any solutions?

  21. An intriguing discussion is worth comment. I do think
    that you need to publish more on this subject matter, it may not be a taboo subject but generally people do
    not talk about such subjects. To the next! Cheers!!

  22. Hi, I do believe this is a great web site. I stumbledupon it 😉 I am going to revisit once again since i have saved as a favorite it. Money and freedom is the greatest way to change, may you be rich and continue to guide others.

  23. I’m very happy to find this page. I need to to thank you for your time due to this fantastic read!! I definitely appreciated every little bit of it and I have you book-marked to check out new information in your web site.

  24. I’m impressed, I have to admit. Rarely do I come across a blog that’s both equally educative and engaging, and without a doubt, you have hit the nail on the head. The issue is something that not enough men and women are speaking intelligently about. Now i’m very happy I found this during my search for something concerning this.

  25. Aw, this was a very good post. Taking a few minutes and actual effort to create a top notch article… but what can I say… I hesitate a whole lot and never seem to get anything done.

  26. An intriguing discussion is definitely worth comment. I believe that you should publish more on this topic, it might not be a taboo matter but usually people do not talk about these subjects. To the next! All the best!!

  27. Aw, this was an incredibly nice post. Spending some time and actual effort to create a top notch article… but what can I say… I hesitate a lot and never seem to get nearly anything done.

  28. Having read this I thought it was rather informative. I appreciate you spending some time and effort to put this content together. I once again find myself personally spending a significant amount of time both reading and leaving comments. But so what, it was still worthwhile!

  29. You are so awesome! I do not suppose I’ve read something like this before. So wonderful to discover somebody with a few unique thoughts on this subject. Seriously.. many thanks for starting this up. This website is one thing that is required on the web, someone with a bit of originality!

  30. I’m excited to uncover this page. I want to to thank you for your time due to this fantastic read!! I definitely loved every part of it and i also have you book-marked to look at new stuff in your website.

  31. Aw, this was a very nice post. Spending some time and actual effort to make a top notch article… but what can I say… I hesitate a lot and never manage to get anything done.

  32. Hi, I do believe your web site could be having internet browser compatibility issues. When I look at your site in Safari, it looks fine however, if opening in Internet Explorer, it’s got some overlapping issues. I simply wanted to give you a quick heads up! Besides that, fantastic site!

  33. Hi, I do believe this is a great site. I stumbledupon it 😉 I may come back once again since I book-marked it. Money and freedom is the greatest way to change, may you be rich and continue to help others.

  34. A motivating discussion is definitely worth comment. I do believe that you ought to publish more on this issue, it might not be a taboo subject but generally people don’t speak about such subjects. To the next! Many thanks!!

  35. Next time I read a blog, I hope that it doesn’t disappoint me just as much as this one. I mean, I know it was my choice to read, but I truly thought you’d have something helpful to talk about. All I hear is a bunch of moaning about something that you could fix if you weren’t too busy looking for attention.

  36. An outstanding share! I have just forwarded this onto a colleague who was doing a little research on this. And he actually bought me dinner simply because I stumbled upon it for him… lol. So allow me to reword this…. Thanks for the meal!! But yeah, thanx for spending some time to talk about this topic here on your site.

  37. Achieving your fitness goal doesn’t need a certified personal trainer or an expensive gym memberships, especially if you have the budget and the space to consider practically every workout machine on the market.

  38. Your style is really unique compared to other folks I’ve read stuff from. Many thanks for posting when you’ve got the opportunity, Guess I will just book mark this page.

  39. Your style is really unique in comparison to other folks I’ve read stuff from. Thanks for posting when you’ve got the opportunity, Guess I’ll just bookmark this blog.

  40. May I simply say what a comfort to find a person that actually understands what they are talking about on the internet. You definitely realize how to bring a problem to light and make it important. More people should check this out and understand this side of your story. I was surprised you aren’t more popular since you most certainly possess the gift.

  41. I have to thank you for the efforts you have put in writing this site. I’m hoping to see the same high-grade blog posts by you in the future as well. In truth, your creative writing abilities has motivated me to get my own website now 😉

  42. You’re so interesting! I do not think I’ve read something like that before. So great to discover somebody with a few genuine thoughts on this subject matter. Really.. many thanks for starting this up. This site is something that’s needed on the web, someone with a little originality!

  43. An impressive share! I have just forwarded this onto a coworker who had been conducting a little homework on this. And he actually bought me breakfast because I discovered it for him… lol. So let me reword this…. Thank YOU for the meal!! But yeah, thanx for spending time to talk about this matter here on your website.

  44. Howdy! I could have sworn I’ve visited this blog before but after browsing through some of the articles I realized it’s new to me. Nonetheless, I’m definitely pleased I discovered it and I’ll be book-marking it and checking back often!

  45. I’m impressed, I have to admit. Rarely do I come across a blog that’s both equally educative and interesting, and let me tell you, you’ve hit the nail on the head. The issue is an issue that not enough people are speaking intelligently about. Now i’m very happy I found this in my hunt for something relating to this.

Leave a Reply

Your email address will not be published. Required fields are marked *