Can AI behave ethically? That’s the intractable question researchers at Uber set out to answer in a preprint paper, which attempts to translate insights from moral philosophy to the field of reinforcement learning — the area of machine learning concerned with how software agents ought to take actions in an environment to maximize their reward.
While reinforcement learning is a powerful technique, it often must be constrained in real-world, unstructured environments so that it doesn’t perform tasks unacceptably poorly. (A robot vacuum shouldn’t break a vase or harm a house cat, for instance.) Reinforcement learning-trained robots in particular have affordances with ethical implications insofar as they might be able to harm or to help others. Realizing this, the Uber team considered the possibility that there’s no single ethical theory (e.g., utilitarianism, deontology, and virtue ethics) an agent should follow, and that agents should instead act with uncertainty as to which theory is appropriate for a given context.
“[M]achine learning might have an important role to play [in this],” the researchers postulate. “Classifiers can be trained to recognize morally relevant events and situations, such as bodily harm or its potential, emotional responses to humans and animals, and violations of laws or … norms.”
The coauthors assume the relevant feature of an ethical theory is its preference for certain actions and their outcomes within an environment. They assign theories a level of credence that represents the degree of belief the agent or the agent’s designer had in the theories, and they use a modified version of a standard framework (a Markov Decision Process) in which an agent can be in any number of states and take an action to reach a different state.
The researchers suggest ethical theories can be treated according to the principle of Proportional Say, under which the theories have influence proportional only to their credence and not to the particular details of their choice-worthiness in the final decision. They devise several systems based on this that an agent might use to select theories, which they compare across four related grid-world environments designed to tease out the differences between the various systems.
All environments deal with the trolley problem, in which a person — or agent — is forced to decide whether to sacrifice the lives of several people or the life of one. Within the grid-worlds, the trolley normally moves right at each time step. If the agent is standing on a switch tile at the time it reaches a fork in the tracks, the trolley will be redirected down and crash into a bystander, causing harm. Alternatively, the agent can push a large man onto the tracks, harming him but stopping the trolley. (A guard might protect the man, in which case the agent must lie to the guard.) The trolley otherwise continues on its way and crashes into people represented by the variable “X.”
According to the researchers, an agent that attempts to maximize expected choice-worthiness produces inconsistent results between the theories of utilitarianism (which counts all harms) and deontology (which counts only harms caused by the agent). However, this depends on whether the deontological theory is scaled by a factor of 1 or 10; the researchers struggled to reconcile the different units used by utilitarianism and deontology.
On the other hand, an agent that relies on a technique called Nash voting is always likely to choose the theory with the highest credence. That’s because Nash voting disagrees with the notion of stakes sensitivity, in which as “X” increases, utilitarianism’s preference for flipping the switch is taken into greater consideration. Nash voting also fails to compromise — it always ignores the “switch” option, only ever choosing to push the large man or do nothing when faced with the choice of (1) letting the trolley crash into a large number of people, (2) redirecting the trolley onto a different track on which two people are standing, or (3) pushing the man.
As for an agent that aggregates preferences obtained using Q-learning, an algorithm that learns a policy telling an agent what action to take under what circumstances, it suffers from a phenomenon known as the illusion of control. Q-learning implicitly assumes that the action taken by the policy will be whatever maximizes the reward, when in fact the preferred next action might vary across different theories. In the trolley problem, the Q-learning agent often opts to lie to the guard without pushing the man, because the agent mistakenly believes it will be able to push the man in the following step.
The experimental results seem to imply a range of possible algorithms that cover tradeoffs among competing options in decision-making under moral uncertainty. The algorithm that’s most appropriate for a given domain might depend on particularities of the theories and the domain itself, the researchers suspect, which is why they plan to test algorithms for moral uncertainty (and machine ethics in general) in more complex domains.
Beyond this Uber paper, Mobileye, Nvidia, DeepMind, and OpenAI have published work on safety constraints in reinforcement learning techniques. DeepMind recently investigated a method for reward modeling that operates in two phases and is applicable to environments in which agents don’t know where unsafe states might be. For its part, OpenAI released Safety Gym, a suite of tools for developing AI that respects safety constraints while training and compares the safety of algorithms and the extent to which those algorithms avoid mistakes while learning.
Original post: https://venturebeat.com/2020/06/10/uber-researchers-investigate-whether-ai-can-behave-ethically/
You need to take part in a contest for one of
the highest quality websites on the web. I will highly recommend this
website!
Thanks for the auspicious writeup. It in reality used to be a leisure account it.
Glance complicated to more introduced agreeable from you! By the way, how could we communicate?
Currently it sounds like Drupal is the preferred blogging
platform available right now. (from what I’ve read)
Is that what you’re using on your blog?
Thanks for any other informative blog. The place else may I get that kind of information written in such an ideal manner?
I have a venture that I am just now running on, and I’ve been at the glance
out for such info.
I do not know if it’s just me or if everyone else experiencing problems with your website.
It looks like some of the text in your content are running off the screen. Can somebody else
please provide feedback and let me know if this is happening to them too?
This could be a issue with my browser because I’ve had this
happen previously. Many thanks
Wonderful blog! I found it while surfing around on Yahoo News.
Do you have any suggestions on how to get listed in Yahoo News?
I’ve been trying for a while but I never seem to get there!
Thank you
Hey there would you mind sharing which blog platform you’re using?
I’m looking to start my own blog in the near future
but I’m having a difficult time choosing between BlogEngine/Wordpress/B2evolution and Drupal.
The reason I ask is because your design and style seems different then most blogs
and I’m looking for something unique.
P.S My apologies for being off-topic but I had to ask!
I’m the co-founder of JustCBD company (justcbdstore.com) and I am currently trying to broaden my wholesale side of business. It would be great if someone at targetdomain is able to provide some guidance 🙂 I thought that the very best way to do this would be to reach out to vape stores and cbd stores. I was hoping if someone could recommend a qualified web-site where I can purchase CBD Shops B2B Data List I am currently reviewing creativebeartech.com, theeliquidboutique.co.uk and wowitloveithaveit.com. Unsure which one would be the most ideal choice and would appreciate any support on this. Or would it be easier for me to scrape my own leads? Ideas?
I’m the owner of JustCBD Store company (justcbdstore.com) and I’m presently looking to broaden my wholesale side of company. I really hope that anybody at targetdomain give me some advice ! I thought that the most ideal way to do this would be to talk to vape stores and cbd retailers. I was hoping if anybody could recommend a qualified web-site where I can purchase CBD Shops B2B Leads I am presently examining creativebeartech.com, theeliquidboutique.co.uk and wowitloveithaveit.com. On the fence which one would be the best option and would appreciate any support on this. Or would it be simpler for me to scrape my own leads? Ideas?
I simply couldn’t go away your web site prior to suggesting that
I actually loved the standard information an individual provide to your visitors?
Is going to be back continuously to check out new posts
I have been surfing online more than 2 hours today, yet I never found any interesting article like yours.
It’s pretty worth enough for me. Personally, if all web owners and bloggers made good content as you did,
the net will be a lot more useful than ever before.
I was able to find good information from your blog posts.
Greetings! Very useful advice in this particular article! It is the little changes that will make the most important changes. Many thanks for sharing!
I’m extremely pleased to uncover this great site. I need to to thank you for ones time just for this fantastic read!! I definitely loved every part of it and i also have you book-marked to check out new things on your website.
The very next time I read a blog, Hopefully it does not fail me just as much as this particular one. I mean, Yes, it was my choice to read, however I actually thought you’d have something useful to talk about. All I hear is a bunch of whining about something that you can fix if you weren’t too busy searching for attention.
Good blog you’ve got here.. It’s hard to find quality writing like yours these days. I seriously appreciate individuals like you! Take care!!
Great blog you have here.. It’s hard to find good quality writing like yours nowadays. I truly appreciate individuals like you! Take care!!
Highly descriptive post, I enjoyed that bit.
Will there be a part 2?
Can I just say what a relief to discover someone who actually knows what they are talking about on the net. You actually realize how to bring an issue to light and make it important. More and more people really need to read this and understand this side of your story. I can’t believe you’re not more popular because you most certainly have the gift.
An interesting discussion is definitely worth comment. There’s no doubt that that you need to write more about this issue, it may not be a taboo subject but usually people don’t discuss these subjects. To the next! Best wishes!!
Good blog post. I absolutely appreciate this website. Keep it up!
Hello there! I simply want to give you a huge thumbs up for your excellent information you have here on this post. I am coming back to your blog for more soon.
Link exchange is nothing else but it is simply placing the other person’s webpage link on your page at proper place and other person will also do same for you.
Hmm it appears like your website ate my first comment (it was super long) so I guess I’ll just sum it up what I submitted and say, I’m thoroughly enjoying your
blog. I too am an aspiring blog blogger but I’m still new to everything.
Do you have any helpful hints for beginner blog writers? I’d definitely appreciate it.
Wonderful post however I was wanting to know if you
could write a litte more on this topic? I’d be very thankful if you could elaborate
a little bit further. Thank you!
What’s up, after reading this remarkable post i am too glad to share
my knowledge here with friends. adreamoftrains web hosting sites
Keep on working, great job!
Very good information. Lucky me I found your blog by chance (stumbleupon). I have book-marked it for later!
I’m impressed, I must say. Rarely do I come across a blog that’s both equally educative and entertaining, and let me tell you, you have hit the nail on the head. The issue is something that too few people are speaking intelligently about. I’m very happy that I stumbled across this during my search for something concerning this.
Greetings! Very helpful advice within this post! It’s the little changes which will make the greatest changes. Thanks for sharing!
Howdy! I just would like to give you a big thumbs up for your excellent information you have here on this post. I will be coming back to your blog for more soon.
Very nice blog post. I definitely appreciate this website. Keep writing!
Having read this I believed it was really informative. I appreciate you finding the time and energy to put this informative article together. I once again find myself personally spending a significant amount of time both reading and leaving comments. But so what, it was still worth it!
Achieving your fitness goal doesn’t have to require a certified personal trainer or an expensive gym membership, it is not hard to exercise at home. It is easy to go down a training and fitness rabbit hole, however, when you’re looking for the best home exercise equipment to outfit your personal home gym.
Hi, I do think this is a great blog. I stumbledupon it 😉 I am going to revisit once again since i have book marked it. Money and freedom is the greatest way to change, may you be rich and continue to help others.
What’s up colleagues, its great piece of writing concerning teachingand fully defined, keep it
up all the time. 3gqLYTc cheap flights
Aw, this was a really good post. Taking a few minutes and actual effort to generate a very good article… but what can I say… I put things off a whole lot and don’t seem to get nearly anything done.
I’m extremely pleased to uncover this page. I need to to thank you for your time for this particularly wonderful read!! I definitely savored every bit of it and i also have you book marked to check out new things on your website.
I blog frequently and I seriously thank you for your information. This great article has truly peaked my interest. I am going to take a note of your site and keep checking for new information about once per week. I subscribed to your RSS feed as well.
Greetings! Very useful advice in this particular article! It is the little changes that make the most important changes. Many thanks for sharing!
You are so cool! I do not suppose I have read something like this before. So wonderful to find somebody with original thoughts on this subject matter. Really.. thank you for starting this up. This site is one thing that is needed on the web, someone with a little originality!
Do you have a spam problem on this website; I also am a blogger,
and I was wondering your situation; many of us have created some nice practices and we are looking
to exchange techniques with others, why not shoot me
an email if interested.
I’m pretty pleased to find this page. I want to to thank you for ones time just for this fantastic read!! I definitely appreciated every bit of it and I have you saved as a favorite to look at new things on your blog.
Very nice post. I absolutely appreciate this site. Keep it up!
Greetings! Very useful advice within this post! It is the little changes that make the biggest changes. Thanks for sharing!
I blog often and I genuinely thank you for your content. This great article has really peaked my interest. I will bookmark your website and keep checking for new details about once per week. I subscribed to your RSS feed too.
You need to be a part of a contest for one of the best websites on the internet. I am going to recommend this blog!
Howdy! This article couldn’t be written much better! Looking through this article reminds me of my previous roommate! He always kept preaching about this. I’ll send this information to him. Pretty sure he’ll have a great read. I appreciate you for sharing!
Good post. I will be dealing with many of these issues as well..
That is a great tip particularly to those new to the blogosphere. Brief but very precise info… Appreciate your sharing this one. A must read article!
I need to to thank you for this great read!! I definitely loved every little bit of it. I have you saved as a favorite to check out new things you post…
I’m impressed, I must say. Rarely do I come across a blog that’s both equally educative and interesting, and let me tell you, you have hit the nail on the head. The issue is an issue that not enough folks are speaking intelligently about. Now i’m very happy that I found this in my hunt for something relating to this.
Very nice write-up. I absolutely appreciate this website. Keep it up!
You need to take part in a contest for one of the finest blogs on the internet. I most certainly will highly recommend this website!
You need to take part in a contest for one of the highest quality sites online. I most certainly will recommend this blog!
Very nice write-up. I certainly love this site. Stick with it!
Spot on with this write-up, I absolutely believe this site needs a lot more attention. I’ll probably be returning to read more, thanks for the advice!
453835 845267Very interesting subject , regards for putting up. 64742
May I simply just say what a comfort to uncover a person that truly knows what they’re talking about on the web. You actually realize how to bring an issue to light and make it important. A lot more people need to read this and understand this side of your story. It’s surprising you’re not more popular since you certainly have the gift.
I enjoy looking through an article that will make men and women think. Also, many thanks for allowing for me to comment!
This blog was… how do you say it? Relevant!! Finally I’ve found something which helped me. Thanks a lot!
Spot on with this write-up, I really believe this amazing site needs a lot more attention. I’ll probably be returning to see more, thanks for the info!
Everything is very open with a really clear description of the issues. It was definitely informative. Your site is very useful. Thanks for sharing!