While the COVID-19 crisis got most folks thinking about face masks and toilet paper, Chris Calabrese was pondering artificial intelligence and its implications for public policy. His aha moment came when he realized Facebook had sent home most of its human overseers and put AI in charge of policing the social forum for inappropriate content.
“The result has been systems that don’t work as well. They are taking down groups dedicated to sewing masks, just because they are falsely flagged,” said Calabrese, vice president of policy at the Center for Democracy and Technology. “That’s automation being used by one of the most influential companies in the world, and it’s still not up to snuff. That gives me a sense of how far we have to go.”
Facebook’s stuttering steps into automation reflect broader ethical challenges faced by public tech leaders as AI, biometrics and surveillance technologies increasingly enter the mainstream. CIOs are considering everything from the moral implications of cameras on light posts to the ethical fallout from allowing AI to set prisoners’ bail.
Will there be bias in AI systems? Will facial recognition erode privacy rights? Around the nation, city-sponsored commissions and academic task forces are trying to tackle some of these tough ethical questions.
New York City was an early entrant into the fray. In 2018, local legislation created the Automated Decision Systems (ADS) Task Force to develop policies and procedures aimed at guiding agencies in their use of AI and related technologies.
“The ADS Task Force tackled the complex issues surrounding automated decisions systems … to ensure these systems align with the goal of making New York City a fairer and more equitable place,” said the mayor’s Deputy Press Secretary Laura Feyer.
The resulting 36-page report, issued in November 2019, recommended broadening the public discussion around ADS and urged city leaders to formalize management functions. The report was explicit in laying out emerging ethical concerns.
“We know that certain decisions, whether made by a human or a computer, carry with them a risk of certain implicit or explicit biases,” the authors wrote. They called on the city to investigate these risks in order to use ADS “most effectively and responsibly.”
The city has since followed up on those early recommendations with institutional means to further safeguard society. “After the report was released, the mayor created the position ofâ€¯algorithms management and policy officer to continue the work of the task force,” Feyer said. That officer “will work with all agencies to identify and evaluate ADS though the lens of fairness, equity and transparency.
At the Center for Democracy and Technology, Chris Calabrese and his colleagues work to understand the potential policy impacts of new technologies.
As New York has pursued its foray into issues of fairness and equality in an AI-driven world, various non-government entities have been pursuing a similar track. Drawing from academia, industry and the public sector, several groups are delving deep into these issues in an effort to guide effective policymaking.
The Center for Democracy and Technology has generally focused its efforts on understanding policy challenges surrounding the Internet. More recently, the group has taken a deep dive into the ethics of AI. “The impact of that across the board is going to be one of the guiding challenges of the 21st century,” Calabrese said.
The center’s thinkers are especially concerned about the algorithms that drive automated decision-making. “That means making sure facial recognition works as well on a white face as it does on an African-American face,” he said. They’re also exploring the implementation of these technologies. “Looking at facial recognition again, that can be used to track people in public, thanks to the power of AI. There are all sorts of issues that arise from that.”
More than just a theoretical exploration, the center is focused on the practical applications of new technology. There is, for example, an immediate concern around the growing use of commercial AI products to set bail levels and determine who should or should not be released on bond.
Calabrese isn’t just worried about the error rate of these decisions — about 30 percent, according to the center’s findings. He’s also concerned about the nature of those errors. “What’s troubling from our perspective is that it tends to skew differently for different populations,” he said. “It makes it more likely that African Americans will be incarcerated while high-danger white people will be let out.”
To address such potential hazards, the center has developed “digital decision tools” for schools and policymakers to help them determine whether algorithms are being used appropriately.
“Policymakers need to be very conservative in how they deploy these technologies,” Calabrese said. “If something is new or experimental, you need to have a lot of skepticism about how it is going to do its job. You can’t just defer to the computer.”
A similar effort is underway at Harvard’s Berkman Klein Center for Internet and Society, a 20-year-old interdisciplinary research center. Originally focused on the intersection of law and technology, the center lately has been delving deep into ethical issues. Its Ethics and Governance of AI initiative looks at the challenges that stakeholders face in developing, using and regulating this technology.
“We are looking at not just the technological side of AI, but at the ways in which these emerging technologies impact everything — from the education of young people, to law and policy, to business, and even issues like democratic engagement and information-sharing online,” said Ryan Budish, assistant director for research.
Researchers here are asking tough questions about AI deployments. How is the system trained? How is it validated? What biases were present in the underlying training data? How can policymakers test the system to be sure it’s not just replicating existing biases?
Budish, too, points to criminal justice as a point of urgent concern. “There are a lot of different organizations out there, some very well intended and some just trying to sell snake oil,” he said. “If you are the IT person in the county court and your administrator wants you to choose a technology to help with this, you might not have the right background to evaluate the different systems. You might not even know the right questions to ask.”
The Berkman Klein Center has looked at a range of state and local issues in which AI could play a part. The technology might be used to detect fraud in welfare benefits, or it could be used to identify which properties should be prioritized for fire-code inspections. Each scenario carries not just practical but moral implications as well.
To assist state and local leaders in their search for answers, the Berkman Klein Center shares best practices. Its researchers have looked at various real-world AI implementation policies, looking for common ground and also highlighting points of divergence. “That helps folks who are trying to think about their own approach to these questions, when they can see what issues other folks are thinking about,” Budish said.
The center also works directly with state attorneys general, helping them to craft policy that responds to the nuanced inner workings of artificial intelligence.
“One of the big challenges with AI is that it can be really technical, and then folks just throw up their hands. It seems like magic,” Budish said. “It’s not magic; it is something that people can understand. We can educate folks and put them in touch with experts who can help them to think critically about the way it impacts the work they are doing.”
On the global front, the Berkman Klein Center collaborates with the Organization for Economic Cooperation and Development, and with the International Telecommunications Union, an agency of the United Nations. Through those efforts, the center has helped to develop AI governing principles that have been adopted by 42 countries.
Budish envisions the center as a potential bridge between civic leaders, who may be new to the conversation around the ethics of AI, and academics who have been exploring these issues for years. “There are a lot of places where those conversations are happening, but those conversations are perhaps not always reaching policymakers,” he said.
A NATURAL FIT
Philadelphia began addressing these issues in 2017 with the launch of GovLabPHL, a multi-agency collaboration using studies of human behavior to shape how the city interacts with residents. That effort led to the creation of a road map in early 2019, and those findings in turn are being leveraged today to help guide Philly’s smart city initiatives.
Smart city development is a natural place to put into action the ethical precepts surrounding AI, said Philadelphia Smart Cities Director Emily Yates. All those cameras on light posts, the smart sensors and other apparatuses of civic improvement — these are the front lines of AI implementation.
Philadelphia Smart Cities Director Emily Yates balances the usefulness of data collected by connected devices with citizen privacy.
“We are drilling down into specific topics. What do you attach to a smart street pole? Is AI going to be a surveillance program? And what happens to the data that we are pulling down? We are still fleshing out all of that,” she said.
Yates’ office is developing a deep governance structure to ensure that key learnings are incorporated as AI usage increases. This includes executive leadership, an advisory committee, an internal working group and various subcommittees drawn from across city government.
This governmental infrastructure is key to the city’s efforts to be responsible in its use of technology.
As the big thinkers address weighty questions around ethical usage, “that information has to move up the ladder and across the ladder so that everyone in government is aware of these issues,” Yates said. “It’s incumbent on the working group and the subcommittees to communicate to the relevant individuals and also to the mayor’s office, in order to put citywide policies in place.”
In Philadelphia that effort includes deep engagement with the city’s data network and security group, whose experts have weighed in on some of the most pressing issues. “There is a tension of how granular and effective you can get with the data, while still respecting the boundaries of privacy and security,” Yates said.
As cities and states continue to wrangle with the use and potential misuse of new technologies, Yates offers a practical vision. When it comes to the responsible use of data — from automated decisions to biometric-informed surveillance — government will be most successful when it is most transparent.
“If you are going to put up a camera facing a mosque, you need to communicate what you are doing, who has ownership of that data, whether it is public,” she said. “That’s why we have the communications and marketing team as a subgroup working on this. We need to address the community so that they know what we are doing and why we are doing it in a specific way.”
Serious peril looms for cities that fail to address the risks, or that come up with answers but fail to engage the community. Yates points to the big civic projects of the 1960s and ’70s that tried to serve a greater good but ended up sowing distrust.
“The worst case is that you spend a significant amount of money, the community gets concerned and then we have to shut it down,” she said. “We don’t want to step backward and deploy technology in a way that makes people worry we might be using it in a way that could harm them.”
Those with a firm grasp of the technological underpinnings as well as community sentiment may be best positioned to help government to state its case as it moves ahead to incorporate emerging innovations.
It’s especially helpful to understand the cyclical nature of an AI deployment: The power of this technology lies in the algorithmic ability to learn over time. Civic leaders can take advantage of that to constantly improve upon their uses of the new tools.
“In each stage of that process you need to interrogate your assumptions,” Calabrese said. “Is my data representative of the whole population? Will my assumptions impact everybody fairly? As a government official you can build fairness into the process, and you do that by understanding how this process works.”
Original post: https://www.govtech.com/policy/Ethics-in-the-Balance-AIs-Implications-for-Government.html
36 comentários em “Ethics in the Balance AI’s Implications for Government”
I am the co-founder of JustCBD company (justcbdstore.com) and I’m presently aiming to develop my wholesale side of business. I am hoping anybody at targetdomain is able to provide some guidance ! I thought that the most effective way to accomplish this would be to reach out to vape shops and cbd stores. I was hoping if someone could recommend a trusted website where I can purchase Vape Shop Business Email Addresses I am currently examining creativebeartech.com, theeliquidboutique.co.uk and wowitloveithaveit.com. Unsure which one would be the very best choice and would appreciate any support on this. Or would it be much simpler for me to scrape my own leads? Suggestions?
I’m the owner of JustCBD company (justcbdstore.com) and I’m presently looking to grow my wholesale side of business. I really hope that anybody at targetdomain is able to provide some guidance 🙂 I thought that the most ideal way to accomplish this would be to connect to vape shops and cbd stores. I was really hoping if anyone could recommend a dependable web-site where I can purchase Vape Shop B2B DATA I am presently considering creativebeartech.com, theeliquidboutique.co.uk and wowitloveithaveit.com. On the fence which one would be the most suitable choice and would appreciate any advice on this. Or would it be easier for me to scrape my own leads? Suggestions?
Pretty! This has been a really wonderful article. Many thanks for providing these details.
You are so cool! I don’t believe I’ve read through something like this before. So nice to discover someone with a few genuine thoughts on this subject matter. Really.. many thanks for starting this up. This website is one thing that is required on the web, someone with a bit of originality!
You’re so awesome! I do not believe I have read something like this before. So nice to discover another person with a few unique thoughts on this subject. Seriously.. thank you for starting this up. This web site is one thing that is required on the internet, someone with a little originality!
You’re so awesome! I don’t suppose I’ve read through anything like that before. So great to discover someone with a few original thoughts on this subject. Seriously.. many thanks for starting this up. This site is something that is required on the internet, someone with some originality!
This site was… how do I say it? Relevant!! Finally I’ve found something which helped me. Thank you!
I blog frequently and I truly appreciate your information. The article has truly peaked my interest. I am going to bookmark your site and keep checking for new information about once a week. I subscribed to your Feed as well.
Your style is unique in comparison to other folks I have read stuff from. I appreciate you for posting when you have the opportunity, Guess I will just bookmark this site.
Great information. Lucky me I ran across your website by accident (stumbleupon). I have book marked it for later!
You should take part in a contest for one of the highest quality blogs on the internet. I’m going to highly recommend this web site!
I’m impressed, I have to admit. Seldom do I encounter a blog that’s both educative and entertaining, and let me tell you, you have hit the nail on the head. The issue is something that not enough people are speaking intelligently about. Now i’m very happy I came across this during my hunt for something regarding this.
Oh my goodness! Incredible article dude! Thanks, However I am going through troubles with your RSS. I don’t know the reason why I cannot join it. Is there anybody else getting identical RSS issues? Anyone that knows the answer can you kindly respond? Thanx!!
Spot on with this write-up, I truly believe that this website needs a lot more attention. I’ll probably be back again to read through more, thanks for the advice!
This web site really has all the information and facts I needed about this subject and didn’t know who to ask.
You are so interesting! I do not suppose I’ve truly read anything like that before. So nice to find another person with some unique thoughts on this issue. Really.. thank you for starting this up. This website is one thing that’s needed on the web, someone with some originality!
Achieving your fitness goal doesn’t need a certified personal trainer or an expensive gym memberships, it’s not hard to exercise at home. It is easy to go down a training and fitness rabbit hole, however, when you’re looking for the best home exercise equipment to outfit your personal home gym.
Can I just say what a relief to discover an individual who really knows what they’re talking about over the internet. You definitely understand how to bring a problem to light and make it important. A lot more people must read this and understand this side of your story. It’s surprising you’re not more popular since you most certainly have the gift.
There’s certainly a lot to know about this issue. I like all of the points you have made.
Having read this I thought it was very enlightening. I appreciate you finding the time and effort to put this content together. I once again find myself personally spending way too much time both reading and commenting. But so what, it was still worth it!
Aw, this was an incredibly good post. Spending some time and actual effort to create a very good article… but what can I say… I procrastinate a whole lot and don’t seem to get nearly anything done.
Hi! I could have sworn I’ve been to this site before but after going through a few of the articles I realized it’s new to me. Anyhow, I’m certainly pleased I stumbled upon it and I’ll be bookmarking it and checking back often!
Oh my goodness! Incredible article dude! Many thanks, However I am going through difficulties with your RSS. I don’t understand the reason why I am unable to join it. Is there anybody else having the same RSS problems? Anyone who knows the answer will you kindly respond? Thanx!!
You should take part in a contest for one of the highest quality sites on the internet. I most certainly will recommend this blog!
That is a great tip particularly to those fresh to the blogosphere. Brief but very precise info… Appreciate your sharing this one. A must read post!
Hi there, There’s no doubt that your website could be having browser compatibility issues. Whenever I look at your blog in Safari, it looks fine but when opening in Internet Explorer, it’s got some overlapping issues. I merely wanted to give you a quick heads up! Apart from that, excellent blog!
Saved as a favorite, I really like your blog!
Aw, this was an extremely nice post. Finding the time and actual effort to make a really good article… but what can I say… I put things off a lot and never seem to get anything done.
Very good information. Lucky me I ran across your site by chance (stumbleupon). I’ve book marked it for later!
Greetings! Very helpful advice within this article! It’s the little changes that will make the greatest changes. Thanks a lot for sharing!
I could not refrain from commenting. Very well written!
That is a very good tip especially to those fresh to the blogosphere. Simple but very precise info… Appreciate your sharing this one. A must read post!
Hi there! This blog post couldn’t be written much better! Going through this article reminds me of my previous roommate! He always kept talking about this. I most certainly will forward this post to him. Pretty sure he’ll have a great read. Many thanks for sharing!
I was more than happy to uncover this web site. I wanted to thank you for your time just for this fantastic read!! I definitely really liked every little bit of it and i also have you saved to fav to look at new things on your website.
I could not resist commenting. Very well written!
I like reading through an article that will make people think. Also, many thanks for allowing for me to comment!