Artificial intelligence (AI) has the potential to help every sector of the economy. There is a challenge, though, in sectors that have fuzzier analysis and the potential to train with data that can continue human biases. A couple of years ago, I described the problem with bias in an article about machine learning (ML) applied to criminal recidivism. It’s worth revisiting the sector as time have changed in how bias is addressed. One way is to look at sectors in the legal profession where bias is a much smaller factor.
Tax law has a lot more explicit rules than, for instance, do many criminal laws. As much as there have been issues with ML applied to human resource systems (Amazon’s canceled HR system), employment law is another area where states and nations have created explicit rules. The key in choosing the right legal area. What seems to be the focus, according to conversations with people at Blue J Legal, is the to focus on areas with strong rules as opposed to standards. The former provide the ability to have clear feature engineering while that later don’t have the specificity to train an accurate model.”
Blue J Legal arose from a University of Toronto course started by the founders, combining legal and computer science skills to try to predict cases. The challenge was, as it has always been in software, to understand the features of the data set in the detail needed to properly analyze the problem. As mentioned, the choice of the tax system was picked for the first focus. Tax law has a significant set of rules that can be designed. The data can then be appropriately labeled. After their early work on tax, they moved to employment.
The products are aimed at lawyers who are evaluating their cases. The goal is to provide the attorneys statistical analysis about the strength and weaknesses of each case.
The Feature Engineering Challenge
It is important to note that “employment” is a category of legal issues. Each issue must be looked at separately, and each issue has its own set of features. For instance, in today’s gig economy, “Is the worker a contractor or an employee?” is a single issue. The Blue J Legal team mentioned that they found between twenty and seventy features for each issue they’ve addressed.
That makes clear that feature engineering is a larger challenge than is the training of the ML system. That has been mentioned by many people but still too many folks have focused on the inference engine because it’s cool. Turning data into information is a more critical part of the ML challenge.
Once the system is trained, the next challenge is to get the lawyers to provide the right information in order to analyze their current cases. They must enter (or their clerks must enter…) information about each case that match the features to be analyzed.
On a slightly technical note, their model uses decision trees. They did try the Random Forest model, of interest in other fields, but found their accuracy dropped.
Blue J Legal claims their early version provides 80-90% accuracy.
Removing Bias: A Plus And A Minus
By removing variables that can drive bias, such as male v female, they are able to train a more general system. That’s good from a pure law point of view, but unlike the parole system mentioned above, that could cause problems in a lawyer’s analysis of a problem. For instance, if a minority candidate is treated more poorly in the legal system, a lawyer should know about that. The Blue J Legal team says they did look at bias, both in their Canadian and USA legal data, but state that the two areas they are addressing don’t see bias that would change the results in a significant way.
One area of bias they’ve also ignored is that of judges, for the same reason as above. I’m sure it’s also ignored for marketing reasons. As they move to legal areas with fewer rules and more standards, I could see a strong value for lawyers in knowing if the judge to whom the case has been assigned has strong biases based on features of the case or the plaintiff. Still, if they analyzed the judges, I could see other bias being added as judges might be biased against lawyers using the system. It’s an interesting conundrum that will have to be addressed in the future.
How The System Should Be Used By Lawyers
There is a clear ethical challenge in front of lawyers that exists regardless of bias. For instance, if the system comes back and tells the lawyer that 70% of cases that are similar go against the plaintiff, should the lawyer take the case? Law is a fluid profession with many cases being similar but not identical. How does the lawyer decide if the specific client is in the 70% or the 30%? How can a system provide information help a lawyer decide to take a case with lower probability or reject one with a higher probability? The hope is, as with any other profession, that the lawyer would carefully evaluate the results. However, as in all industries, busy people take shortcuts and far too many people have taken the old acronym of GIGO to no longer mean “garbage in, garbage out,” but rather “garbage in, gospel out.”
One way to help is to provide a legal memo. The Blue J Legal system provides a list of lawyer provided answers and similar cases for each answer. Not being a lawyer, I can’t tell how well that has been done, but it is a critical part of the system. Just as too many developers focus on the engine rather than feature engineering, they focus on the engine while minimizing the need to explain the engine. In all areas where machine learning is applied, but especially in professions, black box systems can’t be trusted. Analysis must be supported in order for lawyers to understand and evaluate how the generic decision impacts their specific cases.
Law is an interesting avenue in which to test the integration between AI and people. Automation won’t be replacing the lawyer any time soon, but as AI evolves it will be able to increasingly assist the people in the industry, to become more educated about their options and to use their time more efficiently. It’s the balance between the two that will be interesting to watch.
Follow me on Twitter or LinkedIn. Check out my website.
Original post: https://www.forbes.com/sites/davidteich/2020/02/18/artificial-intelligence-ai-and-the-law-helping-lawyers-while-avoiding-biased-algorithms/amp/?ss=ai&__twitter_impression=true
14 comentários em “Artificial Intelligence (AI) And The Law: Helping Lawyers While Avoiding Biased Algorithms”
This piece of writing is genuinely a good one it assists new internet visitors, who are wishing in favor of blogging.
I am regular reader, how are you everybody?
This paragraph posted at this web site is really nice.
Hi, this weekend is nice in favor of me, for the reason that this point in time i am reading this impressive educational
post here at my home.
I am the manager of JustCBD Store brand (justcbdstore.com) and I’m presently looking to grow my wholesale side of company. I am hoping anybody at targetdomain is able to provide some guidance 🙂 I thought that the very best way to accomplish this would be to connect to vape companies and cbd retail stores. I was hoping if someone could suggest a reputable website where I can buy Vape Shop Contact Details I am already taking a look at creativebeartech.com, theeliquidboutique.co.uk and wowitloveithaveit.com. Unsure which one would be the most suitable selection and would appreciate any support on this. Or would it be easier for me to scrape my own leads? Ideas?
I’m the proprietor of JustCBD Store brand (justcbdstore.com) and I am currently planning to grow my wholesale side of company. I am hoping someone at targetdomain share some guidance . I considered that the most ideal way to accomplish this would be to connect to vape shops and cbd stores. I was hoping if anybody at all could suggest a qualified web-site where I can purchase CBD Shops B2B Marketing List I am currently looking at creativebeartech.com, theeliquidboutique.co.uk and wowitloveithaveit.com. Unsure which one would be the most suitable solution and would appreciate any advice on this. Or would it be much simpler for me to scrape my own leads? Ideas?
Can I simply say what a relief to uncover someone who actually understands what they are talking about over the internet. You actually understand how to bring an issue to light and make it important. More and more people must look at this and understand this side of the story. I can’t believe you’re not more popular because you surely possess the gift.
Way cool! Some extremely valid points! I appreciate you penning this write-up and the rest of the website is also really good.
This excellent website truly has all the information and facts I needed about this subject and didn’t know who to ask.
Good post. I learn something new and challenging on websites I stumbleupon everyday. It will always be helpful to read through articles from other writers and use a little something from their websites.
Great article. I will be facing some of these issues as well..
Right here is the perfect webpage for anyone who hopes to understand this topic. You realize so much its almost tough to argue with you (not that I personally will need to…HaHa). You certainly put a brand new spin on a subject which has been discussed for ages. Wonderful stuff, just excellent!
Oh my goodness! Incredible article dude! Thanks, However I am having problems with your RSS. I don’t know why I cannot subscribe to it. Is there anybody getting similar RSS problems? Anyone who knows the answer will you kindly respond? Thanks!!
Hello there! This article couldn’t be written any better! Looking through this post reminds me of my previous roommate! He continually kept preaching about this. I most certainly will send this article to him. Fairly certain he will have a very good read. I appreciate you for sharing!
You’ve made some decent points there. I checked on the web to learn more about the issue and found most individuals will go along with your views on this site.