Art is subjective and everyone has their own opinion about it. When I saw the expressionist painting Blue Poles, by Jackson Pollock, I was reminded of the famous quote by Rudyard Kipling, “It’s clever, but is it Art?” Pollock’s piece looks like paint messily spilled onto a drop sheet protecting the floor. The debate of what constitutes art has a long history that will probably never be settled, there is no definitive definition of art. Similarly, there is no broadly accepted objective definition for the quality of a piece of art, with the closest definition being from Orson Welles, “I don’t know anything about art but I know what I like.”
Blue Poles by Jackson Pollock
Similarly, people recognize unfair bias when they see it, but it is quite difficult to create a single objective definition. That’s because there are key considerations that vary from case to case. Many have attempted to define fairness for algorithms, resulting in multiple candidate definitions. Arvind Narayanan, an associate professor at Princeton, lists 21 different definitions for fairness in an algorithm and concludes that there is no single definition that applies in all cases. In this blog post, rather than defining a unique solution, I will list the four key questions that you need to answer in order to derive a definition of unfair bias that matches your particular needs.
Which Attributes Should be Protected?
Your AI must obey the law. Most countries have discrimination laws, under which it is unlawful to treat a person less favorably on the basis of particular legally protected attributes, such as a person’s sex, race, disability, or age. However, there is no universal set of protected attributes that apply under all circumstances, in all countries, for all uses. For example, it may be illegal to discriminate on the basis of gender for employment hiring purposes but legal to charge different prices for different ages.
But there’s more to unfair bias than obeying the law. You must also consider reputation risk and ethics. An organization may have data containing sensitive attributes, such as a person’s health records or personal activities, whose values the person does not want to be disclosed and may not want to be used in decision making. Reputation risk arises when your AI is using sensitive features in a manner that society considers inappropriate, such as using data that was originally collected for a different purpose. A reputation risk exists when the public revelation of a behavior or process would potentially cause embarrassment or loss of brand value. Ethical issues arise when your AI is using sensitive features, often in situations involving vulnerable groups, asymmetries of power, or when AI is being used for purposes that are dishonest or not in society’s interests.
Equal Opportunity or Equal Outcome?
Equal opportunity is a state of fairness in which humans are treated similarly, regardless of their protected features. This concept is closely related to disparate treatment, which is defined as unequal behavior towards an individual or group relating to a protected feature (i.e., treating them as if we were blind to their protected features). Equal opportunity is often a regulatory requirement, particularly in employment law. The philosophy behind equal opportunity is that people should not be penalized for protected attributes that are not related to the decision being made (e.g., the best person should be hired for the job, regardless of their race). Problems with disparate treatment can arise in AIs when they are trained on historical data that contains human biases or when minority groups are insufficiently represented in the data.
Equal outcome is a concept of fairness in which humans, grouped by their protected features, have similar outcomes on average, regardless of the protected features. This concept is closely related to disparate impact and adverse impact, which is defined as practices that adversely affect one group of people with a protected attribute more than another, even in situations where the rules applied by employers or landlords are formally neutral (i.e., the rules don’t explicitly involve the protected attribute but do use attributes that are correlated with the protected attribute). Equal outcomes may be a regulatory requirement (e.g., California mandates women on corporate boards), or an organizational strategy (e.g., seeking diversity). The philosophy behind equal outcomes is threefold:
- proxies for protected attributes should not be used to avoid regulatory fairness regulations
- a person should not be penalized for historic disadvantage
- diversity is good for organizations
Problems with disparate impact can arise in AIs when they are trained on historical data that contains human biases, when minority groups are insufficiently represented in the data, or when the prevalence of negative outcomes varies between groups within the population. It is common for individuals to have unfair outcomes even when the group achieves equal outcomes.
Note that it in real-life data, it is not possible to achieve both equal outcomes and equal opportunities. The two goals are mathematically incompatible. You will need to choose which definition of fairness to apply to your task.
Groups or Individuals?
Fairness can be measured at group levels or at the individual level. Do you wish to ensure that on average you don’t discriminate against a protected group or apply the protection to each and every individual? For example, you may hire female job applicants with the same average probability that you hire male applicants. That would achieve group fairness. However, you may be biased by giving junior roles with higher probability to females and senior jobs with higher probability to males. Achieving individual fairness is more difficult than achieving group fairness. It takes more time and effort to ensure that each and every individual is treated no differently according to their protected attributes. Algorithmic AI decision making (decisions made by a machine without human intervention) may make individual fairness easier to achieve than in the past because you can do what-if analysis and objectively check whether replacing protected attributes (and related proxies) changes the decision. This was not possible in the past when humans made those decisions.
The choice of group fairness versus individual fairness is related to the decision of whether to target equal opportunity or equal outcomes. If you choose to target equal outcomes, then you cannot ensure individual fairness.
Note that achieving individual fairness ensures that you have achieved group fairness.
Direct or Indirect Bias?
Direct bias is when you directly use a protected attribute to make a decision. This is relatively easy to achieve in an AI. If your AI does not use the protected attribute in its decision making, then it has successfully avoided direct bias. In DataRobot, you can check for direct bias by viewing the feature impact, the feature effects, and the prediction explanations.
Indirect bias can occur when the value of other attributes is correlated with the value of a protected attribute (e.g., a person’s height is related to their age, gender, and race). A person may be indirectly discriminated against if such a proxy attribute is used to make a decision about them. This can occur subtly and is much more difficult to discover and remove than direct discrimination. The solution is a four-stage process involving
- finding correlated attributes,
- measuring the effects of correlated attributes,
- deciding whether those correlated attributes are true effects or mere proxies, and
- removing the proxy attributes, or transforming the data to negate the unfair bias.
DataRobot provides human-friendly insights that make the process of discovering and addressing indirect bias quicker and simpler.
Conclusion
There’s more to building an AI than just predictive accuracy. Unfair bias can cost your organization via suboptimal hiring or marketing, reputation damage, or even legal action. Unfair bias is a complex issue that will require consensus within your organization and which is most effectively managed within the early stages of an AI project. Before you start your next AI project, ensure that your organization has an AI ethics statement that defines:
- ethical purposes and uses of AI,
- which personal attributes an AI can use for decisions and which will be protected,
- what details will be disclosed to all AI stakeholders,
- audibility of AI systems, and
- a process of accountability governance for AI systems.
The path to trusting that an AI is acting fairly includes knowing whether the patterns it is using are suitable and reasonable and knowing which input features the model is using to make its decisions. The latest generation of AI gives you human-friendly explanations of what patterns it uses and why it made a particular decision. If your current AI cannot provide human-friendly explanations, then it’s time to update to DataRobot for AI that you can trust. Click here to arrange for a demonstration of DataRobot, showing how you can trust an AI.
Original post: https://www.datarobot.com/blog/how-do-you-define-unfair-bias-in-ai/
Yes! Finally something about g a.
Thanks for the good writeup. It in truth used to be a enjoyment account it.
Glance complicated to more introduced agreeable from you!
However, how can we be in contact?
I’m impressed, I must say. Seldom do I encounter a blog
that’s both equally educative and engaging, and without a doubt,
you’ve hit the nail on the head. The issue is
an issue that not enough folks are speaking intelligently about.
I am very happy that I found this in my search for something concerning this.
There’s definately a great deal to know about this subject.
I like all of the points you made.
Magnificent goods from you, man. I have remember your stuff previous to and you
are simply extremely magnificent. I actually like what you have received here, really like what you are saying and the way by
which you say it. You make it entertaining and you continue to take care
of to stay it wise. I cant wait to learn much
more from you. This is actually a great website.
I was suggested this website by my cousin. I’m not sure whether this post is written by him as no
one else know such detailed about my problem. You’re
wonderful! Thanks!
This is a topic that’s close to my heart… Take care! Where are your contact details though?
Hello there! I know this is kinda off topic nevertheless I’d figured
I’d ask. Would you be interested in trading links or maybe guest writing a blog post or vice-versa?
My blog discusses a lot of the same topics as yours and I feel we could greatly benefit from
each other. If you are interested feel free to send me an e-mail.
I look forward to hearing from you! Excellent blog
by the way!
When someone writes an article he/she keeps the plan of a user in his/her
mind that how a user can be aware of it. Thus that’s why this article is great.
Thanks!
I’m the co-founder of JustCBD label (justcbdstore.com) and I’m presently looking to expand my wholesale side of business. It would be great if anybody at targetdomain share some guidance 🙂 I considered that the most ideal way to do this would be to reach out to vape companies and cbd stores. I was really hoping if someone could suggest a qualified web-site where I can purchase CBD Shops Business Data I am currently considering creativebeartech.com, theeliquidboutique.co.uk and wowitloveithaveit.com. On the fence which one would be the best solution and would appreciate any guidance on this. Or would it be much simpler for me to scrape my own leads? Ideas?
I’m the co-founder of JustCBD brand (justcbdstore.com) and I am currently seeking to develop my wholesale side of business. I am hoping someone at targetdomain share some guidance 🙂 I thought that the best way to accomplish this would be to talk to vape shops and cbd retailers. I was hoping if anyone could suggest a reputable website where I can purchase Vape Shop BUSINESS DATA I am presently considering creativebeartech.com, theeliquidboutique.co.uk and wowitloveithaveit.com. Not exactly sure which one would be the best solution and would appreciate any guidance on this. Or would it be simpler for me to scrape my own leads? Ideas?
It’s the best time to make some plans for the future and it is time to be happy.
I’ve read this post and if I could I desire to suggest you few interesting things or advice.
Maybe you could write next articles referring to this
article. I want to read more things about it!
Excellent post. I was checking constantly this blog and I am inspired!
Extremely helpful info particularly the closing part 🙂 I care for such info much.
I was seeking this certain info for a long time. Thank you and best of luck.
I always spent my half an hour to read this webpage’s content daily along with a
mug of coffee.
Excellent post but I was wanting to know if you could write
a litte more on this subject? I’d be very grateful if you could elaborate a little bit more.
Thank you!
Way cool! Some extremely valid points! I appreciate you writing this article and the rest of the site is extremely good.
Saved as a favorite, I love your website!
This is a topic that’s near to my heart… Cheers! Exactly where are your contact details though?
I really love your site.. Very nice colors & theme. Did you build this amazing site yourself? Please reply back as I’m wanting to create my own blog and want to know where you got this from or what the theme is called. Kudos!
I blog frequently and I truly thank you for your information. Your article has truly peaked my interest. I am going to take a note of your website and keep checking for new information about once per week. I opted in for your Feed too.
Having read this I thought it was very enlightening. I appreciate you spending some time and effort to put this content together. I once again find myself spending way too much time both reading and posting comments. But so what, it was still worthwhile!
You’ve made some decent points there. I checked on the web for additional information about the issue and found most people will go along with your views on this website.
Good day! I could have sworn I’ve visited your blog before but after going through some of the posts I realized it’s new to me. Regardless, I’m definitely pleased I stumbled upon it and I’ll be bookmarking it and checking back often!
Hmm is anyone else encountering problems with the pictures on this blog loading?
I’m trying to determine if its a problem on my end or if it’s the blog.
Any responses would be greatly appreciated.
Heya i am for the first time here. I came across this board and I
find It really useful & it helped me out much.
I hope to give something back and aid others like you aided me.
I used to be suggested this web site by my cousin. I am not
sure whether this publish is written via him as nobody else understand such targeted approximately
my difficulty. You’re incredible! Thank you!
Very good post! We will be linking to this particularly
great article on our website. Keep up the great writing.
Howdy just wanted to give you a quick heads up and let you know a few
of the images aren’t loading correctly. I’m not sure why but I think
its a linking issue. I’ve tried it in two different web browsers and both show
the same results.
Howdy! This blog post could not be written much better! Reading through this post reminds me of my previous roommate! He continually kept talking about this. I’ll send this information to him. Pretty sure he’s going to have a good read. Thank you for sharing!
This is a topic that’s close to my heart… Cheers! Exactly where are your contact details though?
This site was… how do you say it? Relevant!! Finally I have found something which helped me. Thank you!
May I simply just say what a relief to uncover someone who truly knows what they’re discussing over the internet. You certainly understand how to bring a problem to light and make it important. More people should look at this and understand this side of your story. I was surprised that you’re not more popular because you most certainly have the gift.
I couldn’t resist commenting. Perfectly written!
Greetings! Very useful advice within this article! It is the little changes that produce the most important changes. Many thanks for sharing!
Achieving your fitness goal does not have to require a certified personal trainer or an expensive gym memberships, especially when you have the budget and the space to consider practically every workout machine on the market.
Hmm it appears like your site ate my first comment (it was extremely
long) so I guess I’ll just sum it up what I submitted and say, I’m thoroughly enjoying your blog.
I as well am an aspiring blog writer but I’m still new to the whole thing.
Do you have any tips for newbie blog writers? I’d definitely
appreciate it.
Hi, i think that i saw you visited my weblog so i came to “return the favor”.I am
trying to find things to improve my web site!I
suppose its ok to use a few of your ideas!! cheap flights 32hvAj4
This website really has all the information and facts I needed concerning this subject and didn’t know who to ask.
Oh my goodness! Incredible article dude! Many thanks, However I am experiencing difficulties with your RSS. I don’t know why I am unable to subscribe to it. Is there anybody else getting the same RSS problems? Anyone who knows the solution can you kindly respond? Thanks!!
I think that is among the most vital info for me. And i’m glad reading your article.
But wanna observation on some normal things, The
site style is wonderful, the articles is truly excellent :
D. Just right job, cheers cheap flights 3aN8IMa
Greetings, I believe your website might be having web browser compatibility problems. Whenever I look at your web site in Safari, it looks fine however, if opening in I.E., it’s got some overlapping issues. I simply wanted to provide you with a quick heads up! Besides that, fantastic site!
Having read this I thought it was extremely informative. I appreciate you spending some time and energy to put this content together. I once again find myself personally spending a lot of time both reading and leaving comments. But so what, it was still worth it!
Can I simply say what a relief to discover somebody that truly knows what they’re discussing on the internet. You certainly realize how to bring a problem to light and make it important. A lot more people need to look at this and understand this side of your story. I was surprised you are not more popular because you certainly possess the gift.
Good site you’ve got here.. It’s hard to find high-quality writing like yours these days. I seriously appreciate people like you! Take care!!
Can I simply say what a relief to discover an individual who truly understands what they’re discussing on the internet. You actually know how to bring an issue to light and make it important. More and more people must look at this and understand this side of your story. I was surprised that you are not more popular given that you surely have the gift.
Hello There. I discovered your weblog the usage of msn. That is an extremely neatly written article.
I’ll make sure to bookmark it and come back to learn more of your useful info.
Thanks for the post. I will definitely return.
Hello there! This article couldn’t be written any better! Reading through this post reminds me of my previous roommate! He constantly kept talking about this. I most certainly will forward this article to him. Pretty sure he’s going to have a good read. Thank you for sharing!
You ought to take part in a contest for one of the highest quality sites on the internet. I will highly recommend this site!
Howdy! This blog post could not be written much better! Going through this post reminds me of my previous roommate! He continually kept preaching about this. I will send this post to him. Pretty sure he’s going to have a very good read. Thank you for sharing!
I really like it when people get together and share views. Great website, continue the good work!
Great info. Lucky me I ran across your website by chance (stumbleupon). I have book-marked it for later!
Pretty! This was an incredibly wonderful article. Thanks for supplying these details.
Hello there! This blog post couldn’t be written any better! Looking at this post reminds me of my previous roommate! He always kept talking about this. I’ll send this information to him. Fairly certain he’ll have a very good read. Thank you for sharing!
Everything is very open with a precise explanation of the challenges. It was truly informative. Your website is useful. Many thanks for sharing!
Hello there! I just want to give you a huge thumbs up for your great information you’ve got here on this post. I’ll be coming back to your website for more soon.
Pretty! This was an extremely wonderful article. Thank you for supplying this info.
An outstanding share! I’ve just forwarded this onto a colleague who has been doing a little homework on this. And he actually ordered me dinner simply because I discovered it for him… lol. So allow me to reword this…. Thank YOU for the meal!! But yeah, thanks for spending the time to discuss this subject here on your website.
I was able to find good advice from your articles.
This is a very good tip particularly to those fresh to the blogosphere. Simple but very accurate info… Thank you for sharing this one. A must read post!
An impressive share! I have just forwarded this onto a colleague who was conducting a little research on this. And he actually ordered me dinner due to the fact that I found it for him… lol. So allow me to reword this…. Thanks for the meal!! But yeah, thanx for spending time to talk about this matter here on your internet site.
Hi there! This article could not be written any better! Going through this article reminds me of my previous roommate! He continually kept preaching about this. I’ll forward this information to him. Fairly certain he’ll have a great read. I appreciate you for sharing!
Your style is very unique in comparison to other people I have read stuff from. Thank you for posting when you have the opportunity, Guess I’ll just book mark this site.
bookmarked!!, I like your website!
This web site truly has all the information I wanted about this subject and didn’t know who to ask.