AI and ethics aren’t mutually exclusive, says this data scientist

As a data scientist and professor at Marquette University, Shion Guha knows computer science isn’t just about math. There are “lots and lots of issues” with artificial intelligence (AI), he says. He lists plenty of examples of AI that have had unintended consequences, from hiring filters to criminal sentencing decisions made by privately designed software.

These growing ethical issues in AI have provoked a movement among data scientists to promote better ethics education for scientists. Guha is one of the scientists in the United States encouraging AI-specific ethical training for students that goes beyond core ethics and theology courses—making sure that future computer and data scientists consider the common good when designing new technologies. “Broadly, the field of computer science is starting to take notice of the fact that we can’t pretend to be neutral technology designers,” he says. “There’s no such thing as a neutral technology designer.”

Guha saw a need for an AI-specific ethics course in his department, so he created one, thinking a few graduate students might sign up. But the course quickly filled—and had a waiting list. “I think our students are smart,” he says. “They felt that there was this intersectional hole in their curriculum that needed to be filled.”

He’s also busy developing AI that works for the public good. At Marquette, Guha is glad his goal aligns with the Catholic university’s mission. “The basic mission at Marquette—social justice—very much aligns with my research program,” he says.

Marquette isn’t alone in encouraging this type of research and work. To address the growing need for ethics in tech, the theme of the Vatican’s Pontifical Academy for Life’s plenary meeting this month is artificial intelligence. Pope Francis has stated that, “Artificial intelligence, robotics and other technological innovations must be so employed that they contribute to the service of humanity and to the protection of our common home, rather than to the contrary.”

Together, Guha and his students are working to answer the pope’s call.

What is AI?

There’s a difference between the popular narrative of AI and what we actually have in the world right now. The popular narrative of AI is driven by the imagination and derived from things like science fiction—such as Star Trek with its Ultimate Computer or Isaac Asimov’s anthropomorphic robots, which have their own intelligence. In general, that kind of AI is known as “hard AI,” which is something that we have not been able to accomplish yet. We are nowhere near that.

Nowadays we have what we call “soft AI,” or the ability to build a predictive system that simulates intelligence. So, something like Apple’s Siri is not actually intelligent but simulates intelligence and gives us the perception of intelligence. Or, for instance, think about your humble Roomba vacuum. Roomba is a robot, but it does not have true intelligence. Roomba is a good example of “soft AI,” because it has these underlying predictive systems that enable it to map out where it should travel in your house and vacuum up dirt.

There’s a lot of debate about where AI is going, but at the end of the day we don’t have true AI. Instead, what we call AI right now is this backbone of large amounts of data stored in databases and extremely sophisticated and complicated algorithms that derive inferences from that data to try to provide value to our lives. That’s the definition of AI that I work with.

You’ve spoken about the need for “holistic computer scientists.” Why is it important that computer scientists broaden their skill set?

There are lots and lots of issues with computing technology—and with big technology companies, period. Many of these issues have arisen from a historical tendency for computer scientists to say things like, “Oh, we’re just engineers, we just develop a system, we don’t know how it’s going to be used.”

However, every system that is built will reflect societal norms as well as the biases and values of the designers and developers. So if we just train computer scientists to write code and build systems, and if we don’t train them to understand how they engage in the design of these systems and what potential implications their design, deployment, and implementation may have down the line, then we’re not doing our job properly.

What’s an example of AI gone wrong?

A few months ago Amazon received bad press because the company for years used algorithms to make initial hiring ilters, because they receive a lot of applicants since everyone wants to work at Amazon. So they built an internal algorithm to help filter applicants and used it for hiring.

But then they found that the algorithm over time became insanely sexist. Amazon’s computer models were trained to vet applicants by observing patterns in résumés submitted to the company over 10 years. But what they didn’t realize is that most of those applications came from men because of male dominance across the tech industry. So Amazon’s system taught itself that male candidates are preferable. This is a bad thing, because no one thought about it critically and considered the possibility that this could happen.

How can AI that’s become racist or sexist affect society more broadly?

There was a Wisconsin Supreme Court case a few years ago, Loomis v. Wisconsin. The case challenged the State of Wisconsin’s use of private risk assessment software in the sentencing of a man named Eric Loomis to six years in prison. This was the first time that a case went in front of the criminal justice system and asked whether it’s constitutional to use an algorithm developed by a private third party to make sentencing decisions.

If you consider the Sixth, Seventh, and Eighth Amendments, there are definitely some concerns with an algorithm deciding sentencing. The Wisconsin Supreme Court agreed with the plaintiff and retracted that sentencing decision. And the reason for the issue is that in our court system, lawyers and judges have little to no empirical training. They don’t know anything about statistics or data or algorithms, yet as we increasingly apply more and more of these types of predictive systems in public policy, we are going to see these types of issues.

So on the one hand you have issues in the private sector, like the sexist Amazon hiring algorithm, but on the other hand you also have algorithms being used for sentencing in the criminal justice system. And this is not just a Wisconsin issue. This is a nationwide issue, where anecdotally we have established that these algorithms are incredibly racist, yet they continue to be employed.

I’m not suggesting that anyone is doing anything with malicious intent. One of the biggest reasons algorithms are used in public policy is because of cost. The underlying rationale is that most of our public services—be it the criminal justice system, the education system, or the child welfare system—are overburdened and understaffed in most states. And so one way in which we get over this is by using algorithms to make decisions. Then you don’t have to depend on people.

On the face of it, that’s fine. I believe in a data-driven world. But I also believe in a data-driven world where we do things properly, where we do things ethically. And that’s not quite what’s happening right now.

Can AI ever work for the social good?

Right now I’m working with the Wisconsin Department of Children and Families, which is the child welfare services department in Wisconsin. That department has been under an American Civil Liberties Union (ACLU) lawsuit for the past 20 years because the outcomes have been very poor in Wisconsin. The department has been using various data-driven assessments for a long time trying to get out of this lawsuit.

The ACLU settlement proposed 13 different things that the department has to achieve. The department has been able to do most of them in the past 20 years, but unfortunately it’s had trouble with something called “placement stability.” So I work with one of the department’s private nonprofit partners, and we are trying to look at this particular issue using better AI.

If you make a decision to remove a child from their home to put them in a foster home, you only want to put them in one foster home. You don’t want to constantly bounce them around from home to home. It has really bad outcomes for a child down the line. So we decided to think about a data-driven project that will develop a predictive system that might give us better results for placement stability yet guard against some of these ethical issues that arise whenever you use any of these algorithms.

How can AI help solve this problem?

One way in which we’re approaching this is that, historically, there have been a lot of social workers and case workers who know exactly what’s happening on the ground. They know exactly the right conditions under which a child thrives. Unfortunately, if you use data-driven systems, you can’t quite take these messy qualitative perceptions of social workers into account in your algorithm. Most algorithms work well when based on data that is easily quantifiable. But here we’re talking about data that’s not easily quantifiable.

However, these social workers write detailed narratives about each case that are then stored in a system. A lot of this data has been stored in the system for the past 25 years, and no one’s ever used it. Remember, this is not quantitative data, this is qualitative data—written narratives about the kids in which the social workers describe what worked well and what didn’t work well.

But AI has evolved so much that we can now use it to look at these unstructured qualitative pieces of text. And if we have enough of this information over time, then we can quantify what these workers say works well or doesn’t work well in the context of the child welfare system. We can actually get the context of the case workers, and we can develop a predictive system that could incorporate this qualitative context, like these social worker narratives, in a quantitative form.

We don’t want to repeat the same mistakes that people have made over and over, because data that is easily quantifiable is also data that usually doesn’t tend to work very well. We want to look at what’s hard—we want to look at the professionals on the ground and what has worked for them. And if we can quantify what has worked for them in these types of data-driven systems, we can have a positive impact. It’s something that I’m pretty passionate about.

You created a course on ethics for your computer science students at Marquette. What made you interested in this?

Catholic and Jesuit schools, especially in the United States, have been leaders in the field of ethics education. However, there’s a big difference between a few radical studies of ethics or even an applied study of ethics and the types of ethical implications that we deal with, especially in terms of data and algorithms. This demands an intersectional knowledge of computing systems. It demands an intersectional knowledge of the technical underpinnings of algorithms and data. And it also demands an appreciation for learning about these theoretical ethical frameworks and how they integrate with algorithms and data.

When I first proposed the course, it was welcomed at Marquette because we have both an undergraduate and graduate data science curriculum that we’ve developed in the last three years. And our computer science majors and our data science majors take other ethics courses from the theology and philosophy departments, because it’s part of the core curriculum at Marquette. You can’t graduate with a Marquette education without having a rigorous liberal arts curriculum that is informed by different ethics courses.

However, our computer science and data science majors also learn a lot of technical systems. They have a lot of technical proficiency about computing, technology systems, data algorithms, etc. And they need and want to know more about the specific ethical consequences and implications that arise from designing, building, deploying, and maintaining these types of systems. So I wanted to propose the course and see what the interest was.

The interest in the course was pretty high—it had a waiting list!

It did. And to be perfectly honest, I didn’t really try to advertise or popularize the course. I was thinking, “All right, we’re going to have 10 people sitting around a table and we are going to discuss things.” And lo and behold the entire class filled up, and more and more people were emailing me about it. It makes a lot of sense, because in the past few years our computer science and data science majors have seen a tremendous surge in enrollment. Marquette has invested more resources into computing, computer science, and data science because of it.

Ultimately, I think that if we do not inculcate our computer science and data science majors with ethical training, then we’re really doing them a disservice. The world is a lot more complicated, and therefore we have to help them think in complicated ways.

This article also appears in the February 2020 issue of U.S. Catholic (Vol. 85, No. 2, pages 26–29). Click here to subscribe to the magazine.

Image: Courtesy of Shion Guha

Original post:

79 comentários em “AI and ethics aren’t mutually exclusive, says this data scientist

  1. I am the owner of JustCBD brand ( and I am currently trying to develop my wholesale side of business. It would be great if someone at targetdomain is able to provide some guidance ! I considered that the very best way to accomplish this would be to reach out to vape stores and cbd retail stores. I was hoping if anyone could recommend a trustworthy website where I can get Vape Shop B2B Data List I am presently checking out, and Unsure which one would be the best option and would appreciate any guidance on this. Or would it be easier for me to scrape my own leads? Ideas?

  2. I am the manager of JustCBD company ( and am looking to broaden my wholesale side of business. It would be great if someone at targetdomain can help me 🙂 I considered that the most ideal way to do this would be to connect to vape shops and cbd retail stores. I was really hoping if anyone could suggest a qualified site where I can purchase CBD Shops Business Data I am already reviewing, and On the fence which one would be the best choice and would appreciate any guidance on this. Or would it be much simpler for me to scrape my own leads? Suggestions?

  3. Hi there! This blog post couldn’t be written much better! Going through this post reminds me of my previous roommate! He always kept preaching about this. I most certainly will send this information to him. Pretty sure he will have a great read. Thanks for sharing!

  4. Your style is very unique compared to other people I’ve read stuff from. Thanks for posting when you have the opportunity, Guess I’ll just book mark this web site.

  5. Hi, I do think this is a great website. I stumbledupon it 😉 I will revisit yet again since i have bookmarked it. Money and freedom is the best way to change, may you be rich and continue to help other people.

  6. Aw, this was a really good post. Finding the time and actual effort to produce a top notch article… but what can I say… I put things off a lot and never seem to get anything done.

  7. Aw, this was an exceptionally good post. Spending some time and actual effort to generate a really good article… but what can I say… I hesitate a whole lot and never manage to get anything done.

  8. After looking into a few of the blog posts on your website, I seriously appreciate your way of blogging. I saved it to my bookmark website list and will be checking back in the near future. Please check out my web site as well and let me know your opinion.

  9. Right here is the right website for everyone who hopes to understand this topic. You realize so much its almost tough to argue with you (not that I actually would want to…HaHa). You certainly put a brand new spin on a subject that’s been written about for a long time. Excellent stuff, just excellent!

  10. I blog often and I genuinely appreciate your content. This article has really peaked my interest. I’m going to book mark your blog and keep checking for new information about once a week. I subscribed to your Feed as well.

  11. I must thank you for the efforts you’ve put in penning this website. I really hope to see the same high-grade blog posts from you later on as well. In truth, your creative writing abilities has encouraged me to get my very own site now 😉

  12. Good post. I learn something new and challenging on blogs I stumbleupon on a daily basis. It’s always useful to read through articles from other authors and use something from other web sites.

  13. The next time I read a blog, I hope that it does not fail me just as much as this particular one. After all, I know it was my choice to read, nonetheless I actually believed you’d have something useful to say. All I hear is a bunch of moaning about something you could possibly fix if you weren’t too busy looking for attention.

  14. An impressive share! I have just forwarded this onto a friend who has been doing a little homework on this. And he in fact ordered me breakfast due to the fact that I stumbled upon it for him… lol. So allow me to reword this…. Thanks for the meal!! But yeah, thanks for spending the time to discuss this issue here on your blog.

  15. Oh my goodness! Impressive article dude! Thank you, However I am going through difficulties with your RSS. I don’t know the reason why I am unable to subscribe to it. Is there anybody else having identical RSS issues? Anyone who knows the answer will you kindly respond? Thanks!!

  16. Howdy, I believe your site may be having internet browser compatibility problems. When I take a look at your web site in Safari, it looks fine however, if opening in IE, it has some overlapping issues. I merely wanted to give you a quick heads up! Aside from that, great site!

  17. Aw, this was an extremely nice post. Spending some time and actual effort to make a top notch article… but what can I say… I hesitate a lot and never seem to get nearly anything done.

  18. Spot on with this write-up, I honestly believe that this web site needs much more attention. I’ll probably be back again to read more, thanks for the info!

  19. Next time I read a blog, I hope that it does not disappoint me as much as this one. After all, I know it was my choice to read through, nonetheless I genuinely believed you would probably have something useful to say. All I hear is a bunch of complaining about something you can fix if you were not too busy looking for attention.

  20. Oh my goodness! Incredible article dude! Thank you, However I am having difficulties with your RSS. I don’t understand why I cannot join it. Is there anybody else having the same RSS problems? Anyone who knows the answer will you kindly respond? Thanks!!

  21. I blog quite often and I truly thank you for your information. The article has truly peaked my interest. I am going to book mark your blog and keep checking for new details about once a week. I opted in for your Feed too.

  22. Howdy! I could have sworn I’ve been to your blog before but after looking at some of the articles I realized it’s new to me. Anyways, I’m definitely pleased I found it and I’ll be book-marking it and checking back regularly!

  23. Right here is the perfect web site for anyone who wishes to find out about this topic. You know a whole lot its almost tough to argue with you (not that I actually would want to…HaHa). You certainly put a fresh spin on a subject that’s been discussed for ages. Great stuff, just great!

  24. I truly love your website.. Great colors & theme. Did you make this amazing site yourself? Please reply back as I’m hoping to create my very own blog and would like to find out where you got this from or just what the theme is called. Many thanks!

  25. I have been browsing online more than 2 hours today, yet I never found any interesting article like yours. It is pretty worth enough for me. Personally, if all web owners and bloggers made good content as you did, the net will be a lot more useful than ever before.|

  26. Hello! I could have sworn I’ve visited this site before but after going through many of the articles I realized it’s new to me. Anyways, I’m definitely pleased I found it and I’ll be book-marking it and checking back frequently!

  27. Howdy, I do think your website could be having internet browser compatibility problems. When I look at your site in Safari, it looks fine but when opening in IE, it’s got some overlapping issues. I just wanted to provide you with a quick heads up! Apart from that, fantastic blog!

  28. I’m amazed, I must say. Seldom do I encounter a blog that’s both equally educative and entertaining, and let me tell you, you have hit the nail on the head. The problem is an issue that too few folks are speaking intelligently about. I’m very happy I came across this in my search for something relating to this.

  29. This is a great tip particularly to those new to the blogosphere. Short but very precise information… Many thanks for sharing this one. A must read post!

  30. Having read this I believed it was rather informative. I appreciate you spending some time and effort to put this article together. I once again find myself personally spending way too much time both reading and commenting. But so what, it was still worth it!

  31. Achieving your fitness goals doesn’t need a certified personal trainer or an expensive gym memberships, especially when you have the budget and the space to consider practically every workout machine on the market.

  32. I really love your blog.. Excellent colors & theme. Did you create this web site yourself? Please reply back as I’m looking to create my very own website and would love to find out where you got this from or what the theme is named. Thanks!

  33. I absolutely love your website.. Very nice colors & theme. Did you build this amazing site yourself? Please reply back as I’m planning to create my very own site and want to learn where you got this from or exactly what the theme is named. Kudos!

  34. Having read this I thought it was extremely enlightening. I appreciate you taking the time and energy to put this information together. I once again find myself spending way too much time both reading and posting comments. But so what, it was still worthwhile!

  35. Nice post. I learn something totally new and challenging on websites I stumbleupon everyday. It will always be exciting to read through articles from other authors and practice a little something from their web sites.

Leave a Reply

Your email address will not be published. Required fields are marked *