There is a saying that has emerged among the tech set in recent years: AI is the new electricity. The platitude refers to the disruptive power of artificial intelligence for driving advances in everything from transportation to predicting the weather.
Of course, the computers and data centers that support AI’s complex algorithms are very much dependent on electricity. While that may seem pretty obvious, it may be surprising to learn that AI can be extremely power-hungry, especially when it comes to training the models that enable machines to recognise your face in a photo or for Alexa to understand a voice command.
The scale of the problem is difficult to measure, but there have been some attempts to put hard numbers on the environmental cost.
For instance, one paper published on the open-access repository arXiv claimed that the carbon emissions for training a basic natural language processing (NLP) model — algorithms that process and understand language-based data — are equal to the CO2 produced by the average American lifestyle over two years. A more robust model required the equivalent of about 17 years’ worth of emissions.
The authors noted that about a decade ago, NLP models could do the job on a regular commercial laptop. Today, much more sophisticated AI models use specialised hardware like graphics processing units, or GPUs, a chip technology popularised by Nvidia for gaming that also proved capable of supporting computing tasks for AI.
OpenAI, a nonprofit research organisation co-founded by tech prophet and profiteer Elon Musk, said that the computing power “used in the largest AI training runs has been increasing exponentially with a 3.4-month doubling time” since 2012. That’s about the time that GPUs started making their way into AI computing systems.
Getting smarter about AI chip design
While GPUs from Nvidia remain the gold standard in AI hardware today, a number of startups have emerged to challenge the company’s industry dominance. Many are building chipsets designed to work more like the human brain, an area that’s been dubbed neuromorphic computing.
One of the leading companies in this arena is Graphcore, a UK startup that has raised more than $450 million and boasts a valuation of $1.95 billion. The company’s version of the GPU is an IPU, which stands for intelligence processing unit.
To build a computer brain more akin to a human one, the big brains at Graphcore are bypassing the precise but time-consuming number-crunching typical of a conventional microprocessor with one that’s content to get by on less precise arithmetic.
The results are essentially the same, but IPUs get the job done much quicker. Graphcore claimed it was able to train the popular BERT NLP model in just 56 hours, while tripling throughput and reducing latency by 20%.
An article in Bloomberg compared the approach to the “human brain shifting from calculating the exact GPS coordinates of a restaurant to just remembering its name and neighborhood.”
Graphcore’s hardware architecture also features more built-in memory processing, boosting efficiency because there’s less need to send as much data back and forth between chips. That’s similar to an approach adopted by a team of researchers in Italy that recently published a paper about a new computing circuit.
The novel circuit uses a device called a memristor that can execute a mathematical function known as a regression in just one operation. The approach attempts to mimic the human brain by processing data directly within the memory.
Daniele Ielmini at Politecnico di Milano, co-author of the Science Advances paper, said that the main advantage of in-memory computing is the lack of any data movement, which is the main bottleneck of conventional digital computers, as well as the parallel processing of data that enables the intimate interactions among various currents and voltages within the memory array.
Ielmini explained that in-memory computing can have a “tremendous impact on energy efficiency of AI, as it can accelerate very advanced tasks by physical computation within the memory circuit.” He added that such “radical ideas” in hardware design will be needed in order to make a quantum leap in energy efficiency and time.
It’s not just a hardware problem
The emphasis on designing more efficient chip architecture might suggest that AI’s power hunger is essentially a hardware problem. That’s not the case, Ielmini noted.
“We believe that significant progress could be made by similar breakthroughs at the algorithm and dataset levels,” he said.
He’s not the only one.
One of the key research areas at Qualcomm’s AI research lab is energy efficiency. Max Welling, vice president of Qualcomm Technology R&D division, has written about the need for more power-efficient algorithms. He has gone so far as to suggest that AI algorithms will be measured by the amount of intelligence they provide per joule.
One emerging area being studied, Welling wrote, is the use of Bayesian deep learning for deep neural networks.
It’s all pretty heady stuff and easily the subject of a PhD thesis. The main thing to understand in this context is that Bayesian deep learning is another attempt to mimic how the brain processes information by introducing random values into the neural network. A benefit of Bayesian deep learning is that it compresses and quantifies data in order to reduce the complexity of a neural network. In turn, that reduces the number of “steps” required to recognise a dog as a dog — and the energy required to get the right result.
A team at Oak Ridge National Laboratory has previously demonstrated another way to improve AI energy efficiency by converting deep learning neural networks into what’s called a spiking neural network. The researchers spiked their deep spiking neural network (DSNN) by introducing a stochastic process that adds random values like Bayesian deep learning.
The DSNN actually imitates the way neurons interact with synapses, which send signals between brain cells. Individual “spikes” in the network indicate where to perform computations, lowering energy consumption because it disregards unnecessary computations.
The system is being used by cancer researchers to scan millions of clinical reports to unearth insights on causes and treatments of the disease.
Helping battle cancer is only one of many rewards we may reap from artificial intelligence in the future, as long as the benefits of those algorithms outweigh the costs of using them.
As Ielmini said: “Making AI more energy-efficient is an overarching objective that spans the fields of algorithms, systems, architecture, circuits, and devices.”
This article is curated from Singularity Hub.
Original post: https://www.themandarin.com.au/126302-opinion-ai-is-an-energy-guzzler-we-need-to-re-think-its-design-and-soon/
I’m the owner of JustCBD brand (justcbdstore.com) and am seeking to expand my wholesale side of company. It would be great if someone at targetdomain share some guidance 🙂 I considered that the best way to do this would be to reach out to vape shops and cbd stores. I was really hoping if anybody at all could suggest a reliable site where I can buy CBD Shops B2B Database I am presently considering creativebeartech.com, theeliquidboutique.co.uk and wowitloveithaveit.com. On the fence which one would be the most suitable option and would appreciate any support on this. Or would it be easier for me to scrape my own leads? Suggestions?
I am the owner of JustCBD Store company (justcbdstore.com) and I am currently looking to expand my wholesale side of company. It would be great if someone at targetdomain is able to provide some guidance . I considered that the very best way to do this would be to talk to vape stores and cbd retail stores. I was hoping if anyone could recommend a qualified web site where I can purchase CBD Shops B2B Mailing List I am already taking a look at creativebeartech.com, theeliquidboutique.co.uk and wowitloveithaveit.com. Not exactly sure which one would be the very best solution and would appreciate any guidance on this. Or would it be much simpler for me to scrape my own leads? Suggestions?
Your style is so unique compared to other people I have read stuff from. Many thanks for posting when you’ve got the opportunity, Guess I will just book mark this site.
Spot on with this write-up, I seriously believe this site needs a lot more attention. I’ll probably be back again to read through more, thanks for the information!
This website was… how do you say it? Relevant!! Finally I’ve found something which helped me. Kudos!
The next time I read a blog, Hopefully it does not fail me as much as this one. I mean, Yes, it was my choice to read, however I actually thought you would have something interesting to talk about. All I hear is a bunch of complaining about something you can fix if you were not too busy searching for attention.
Good info. Lucky me I found your blog by accident (stumbleupon). I have book marked it for later!
You need to take part in a contest for one of the finest sites online. I most certainly will recommend this blog!
This page really has all the information I wanted about this subject and didn’t know who to ask.
This page really has all the info I needed concerning this subject and didn’t know who to ask.
I needed to thank you for this very good read!! I certainly enjoyed every little bit of it. I have you saved as a favorite to check out new stuff you post…
I was able to find good info from your blog posts.
I’m amazed, I have to admit. Rarely do I come across a blog that’s equally educative and interesting, and without a doubt, you have hit the nail on the head. The issue is something which not enough men and women are speaking intelligently about. Now i’m very happy I stumbled across this in my hunt for something concerning this.
Aw, this was an extremely good post. Taking a few minutes and actual effort to generate a very good article… but what can I say… I hesitate a whole lot and don’t manage to get anything done.
Way cool! Some extremely valid points! I appreciate you penning this write-up and the rest of the website is also really good.
Achieving your fitness goals does not need a certified personal trainer or an expensive gym membership, it’s not hard to exercise at home. It’s easy to go down a training and fitness rabbit hole, however, when you are looking for the best home exercise equipment to outfit your personal home gym.
Oh my goodness! Amazing article dude! Thank you, However I am experiencing problems with your RSS. I don’t know why I can’t subscribe to it. Is there anybody getting similar RSS issues? Anybody who knows the solution can you kindly respond? Thanx!!
Hi there! This blog post could not be written much better! Looking at this article reminds me of my previous roommate! He continually kept preaching about this. I most certainly will send this information to him. Fairly certain he’ll have a great read. Thank you for sharing!
Howdy! I could have sworn I’ve been to this website before but after browsing through some of the posts I realized it’s new to me. Anyhow, I’m certainly delighted I came across it and I’ll be book-marking it and checking back frequently!
You have made some decent points there. I looked on the net to learn more about the issue and found most individuals will go along with your views on this website.
Pretty! This was an extremely wonderful post. Many thanks for providing this info.
A motivating discussion is definitely worth comment. I do believe that you ought to write more about this subject matter, it might not be a taboo matter but typically people don’t speak about such issues. To the next! Many thanks!!
The very next time I read a blog, Hopefully it doesn’t disappoint me as much as this one. I mean, Yes, it was my choice to read through, nonetheless I genuinely thought you would have something interesting to say. All I hear is a bunch of whining about something you could possibly fix if you weren’t too busy looking for attention.
Greetings! Very helpful advice within this article! It’s the little changes that make the greatest changes. Many thanks for sharing!
Everyone loves it when folks get together and share opinions. Great site, continue the good work!
After looking at a handful of the blog posts on your website, I truly appreciate your technique of blogging. I book-marked it to my bookmark site list and will be checking back soon. Please check out my website too and let me know your opinion.
This is a great tip especially to those fresh to the blogosphere. Short but very precise info… Thank you for sharing this one. A must read article!