Why we need Tiny AI?

We all know that algorithms are getting smarter every day, but are they also getting greener?

Not at all, and that’s becoming a significant problem. As a result, researchers are working hard to discover new ways for developing smaller algorithms. In this article, we’re going to discuss why Tiny AI is an important step to secure a future for AI.

Artificial intelligence has demonstrated many breakthroughs over the last few years. Deep learning is one of those breakthroughs that powers many A.I. systems that deliver high accuracies. Thanks to deep learning, algorithms can scan medical images and identify tumors, navigate autonomous cars even in complex traffic patterns, and translate literature from almost any language to another.

Every day A.I. gets more accurate, but there is a hidden environmental cost to high accuracy.

Researchers at the University of Massachusetts Amherst recently conducted a study that revealed how energy intensive training an algorithm is. According to the study, training one single algorithm might consume 5x the lifetime carbon dioxide emissions of an average car, or the equivalent of about 300 round-trip flights between New York and San Francisco. In search of high accuracy, we seem to have lost our focus on energy efficiency.

Roy Schwartz, a research scientist at the Allen Institute, and his co-authors suggest in a paper called Green A.I., that A.I. researchers should strive to make energy efficiency an evaluation criterion alongside accuracy and other measures.

A recent Slate article quotes Schwartz saying “We don’t want to reach a state where A.I. will be become a significant contributor to global warming.”

That’s where Tiny A.I. might help.

What is Tiny AI?

Tiny AI is the term that is used to describe the efforts of the AI research community to reduce the size of algorithms, especially those that require large amounts of datasets and computational power. Tiny AI Researchers develop methods, called distillation methods, that not only reduce the size of a model but do so while accelerating inference and maintaining high levels of accuracy. Using these distillation methods, a model can be scaled down significantly, by factors reaching up to 10x. Besides, a much smaller algorithm can be deployed on the edge without sending data to the cloud, rather making decisions on the device.

Take BERT as an example. BERT is a pre-trained language model (PLM) developed by Jacob Devlin and his team at Google. This algorithm is very useful, because it helps you write. It can do that, because unlike previous models, BERT understands the words and the context. As a result, BERT can make writing suggestions or finish your sentences.

But BERT is a large model. MIT Technology Review reported that the larger version of BERT had 340 million data parameters. Furthermore, training it one time required as much as electricity as would be sufficient to power a U.S. household for 50 days.

BERT became a perfect target for Tiny A.I. researchers. In a recent article, researchers at Huawei claimed that they were able to reduce the size of BERT by 7.5x while improving the speed by 9.4x.

They called their new model, TinyBERT. But, how good is TinyBERT in comparison to BERT? The authors claim that TinyBERT achieves 96% of the performance of its teacher, BERT.

As these advances evolve, we will see many benefits of Tiny A.I. On the one hand, existing services like voice assistants, and cameras won’t need to transfer data between the cloud and local devices.

On the other hand, Tiny AI will make it possible for us to deploy complex algorithms at edge devices. For example, medical image analysis using a smartphone. Or autonomous driving without a cloud. On top of it, having your data stored on edge improves data privacy and security, as well.

Considering the explosive growth of A.I., it’s important to have researchers and engineers who study and measure the environmental implications of training and deploying their algorithms.

Let’s not just strive to build more accurate models. Let’s also consider the impact of them on the environment. If not, we may find ourselves with one more technology that damages our planet.

 

Original post: https://www.rapiddigital.ventures/what-is-tiny-ai/

114 comentários em “Why we need Tiny AI?

  1. Howdy, I believe your blog might be having web browser compatibility issues.
    When I take a look at your site in Safari,
    it looks fine but when opening in Internet Explorer, it has some overlapping issues.
    I merely wanted to give you a quick heads up! Besides that,
    fantastic website!

  2. Oh my goodness! Impressive article dude! Thank you so much, However I am going through difficulties with
    your RSS. I don’t know the reason why I am unable to join it.
    Is there anyone else having the same RSS issues? Anyone who knows the answer will you kindly respond?
    Thanx!!

  3. Wonderful goods from you, man. I have take into account your stuff previous to and you’re just too fantastic.
    I really like what you have bought here, really like
    what you are stating and the way in which wherein you assert it.

    You’re making it entertaining and you continue to care for to stay it sensible.
    I can not wait to read far more from you. This is actually
    a wonderful website.

  4. It is appropriate time to make a few plans for the long
    run and it’s time to be happy. I’ve read this submit and if I may
    I wish to suggest you few attention-grabbing things or
    advice. Maybe you could write next articles referring
    to this article. I wish to learn even more issues approximately
    it!

  5. Woah! I’m really enjoying the template/theme of this website.
    It’s simple, yet effective. A lot of times it’s very difficult to get that “perfect balance” between user
    friendliness and visual appearance. I must say you have done a very good
    job with this. Also, the blog loads super quick for me on Opera.
    Excellent Blog!

  6. hello!,I love your writing so a lot! proportion we keep up a correspondence extra about your post on AOL?

    I need an expert on this area to unravel my problem.

    Maybe that’s you! Taking a look ahead to see you.

  7. I am the owner of JustCBD label (justcbdstore.com) and I’m presently seeking to expand my wholesale side of company. It would be great if anybody at targetdomain share some guidance 🙂 I thought that the most suitable way to do this would be to talk to vape shops and cbd stores. I was hoping if anyone could recommend a trustworthy site where I can purchase CBD Shops B2B Database with Emails I am presently taking a look at creativebeartech.com, theeliquidboutique.co.uk and wowitloveithaveit.com. Unsure which one would be the very best choice and would appreciate any advice on this. Or would it be easier for me to scrape my own leads? Suggestions?

  8. Right here is the perfect blog for anyone who wants to
    understand this topic. You understand a whole lot its almost tough to argue
    with you (not that I personally will need to…HaHa). You certainly put a new spin on a topic that’s been written about for many years.
    Excellent stuff, just excellent!

  9. I’m the owner of JustCBD Store brand (justcbdstore.com) and I am currently aiming to develop my wholesale side of business. I am hoping someone at targetdomain can help me 🙂 I considered that the best way to accomplish this would be to connect to vape companies and cbd retailers. I was hoping if anyone could recommend a reputable website where I can buy CBD Shops Business Data I am currently checking out creativebeartech.com, theeliquidboutique.co.uk and wowitloveithaveit.com. Not sure which one would be the most ideal option and would appreciate any assistance on this. Or would it be much simpler for me to scrape my own leads? Suggestions?

  10. I blog frequently and I genuinely appreciate your information. Your article has truly peaked my interest. I am going to bookmark your site and keep checking for new details about once a week. I opted in for your RSS feed too.

  11. I seriously love your blog.. Very nice colors & theme. Did you create this amazing site yourself? Please reply back as I’m attempting to create my very own website and would like to know where you got this from or exactly what the theme is called. Cheers!

  12. I’d like to thank you for the efforts you have put in penning this site. I really hope to check out the same high-grade blog posts from you later on as well. In truth, your creative writing abilities has motivated me to get my own, personal site now 😉

  13. Aw, this was a really good post. Taking the time and actual effort to produce a great article… but what can I say… I procrastinate a whole lot and don’t manage to get nearly anything done.

  14. Pretty portion of content. I simply stumbled upon your blog and in accession capital to assert that I acquire in fact loved account your blog posts.
    Any way I’ll be subscribing for your augment and even I achievement you
    get right of entry to persistently quickly.

  15. After checking out a few of the blog posts on your website, I truly like your technique of blogging. I added it to my bookmark site list and will be checking back in the near future. Take a look at my website as well and tell me your opinion.

  16. That is a very good tip especially to those new to the blogosphere. Brief but very precise information… Appreciate your sharing this one. A must read article!

  17. Hey there! I just would like to give you a huge thumbs up for your excellent info you have here on this post. I will be coming back to your web site for more soon.

  18. The next time I read a blog, Hopefully it does not disappoint me just as much as this particular one. I mean, I know it was my choice to read through, but I actually believed you would probably have something useful to say. All I hear is a bunch of moaning about something you could possibly fix if you were not too busy searching for attention.

  19. Howdy! This blog post couldn’t be written much better! Looking at this article reminds me of my previous roommate! He always kept preaching about this. I am going to send this article to him. Fairly certain he’s going to have a very good read. Thanks for sharing!

  20. Right here is the perfect blog for anyone who would like to find out about this topic. You understand a whole lot its almost hard to argue with you (not that I really would want to…HaHa). You definitely put a brand new spin on a subject which has been discussed for ages. Excellent stuff, just great!

  21. I’m truly enjoying the design and layout of your blog.
    It’s a very easy on the eyes which makes it much more pleasant for me to come here and visit more often. Did you hire out a designer to create
    your theme? Excellent work!

  22. You made some really good points there. I checked on the web for more information about the issue and found most people will go along with your views on this site.

  23. Hello! I just want to offer you a huge thumbs up for the great info you have got right here on this post. I will be returning to your site for more soon.

  24. You made some decent points there. I checked on the net for more information about the issue and found most people will go along with your views on this web site.

  25. I seriously love your site.. Excellent colors & theme. Did you build this web site yourself? Please reply back as I’m planning to create my own personal site and would love to find out where you got this from or what the theme is called. Many thanks!

  26. I’m really enjoying the theme/design of your website.
    Do you ever run into any web browser compatibility problems?
    A few of my blog audience have complained about my website
    not working correctly in Explorer but looks great in Firefox.

    Do you have any solutions to help fix this issue?

  27. I believe everything wrote made a lot of sense.
    But, think about this, what if you added a little content?
    I ain’t saying your information is not good., however suppose you added
    something that grabbed folk’s attention? I mean Why we need Tiny AI?
    – Adolfo Eliazàt – Artificial Intelligence – AI News
    is kinda plain. You should glance at Yahoo’s home page and see how they create article titles to
    grab viewers to click. You might add a video or a
    pic or two to get readers interested about what you’ve written. Just
    my opinion, it could make your blog a little
    livelier.

  28. Greetings! I know this is kinda off topic however , I’d figured I’d ask.
    Would you be interested in exchanging links or maybe guest authoring a
    blog post or vice-versa? My website addresses a lot of the
    same topics as yours and I think we could greatly benefit from
    each other. If you’re interested feel free to shoot me an e-mail.
    I look forward to hearing from you! Terrific blog by the
    way!

  29. The next time I read a blog, I hope that it won’t fail me as much as this one. After all, Yes, it was my choice to read through, but I genuinely believed you would have something interesting to say. All I hear is a bunch of whining about something you could possibly fix if you weren’t too busy looking for attention.

  30. Next time I read a blog, I hope that it doesn’t disappoint me as much as this particular one. I mean, Yes, it was my choice to read, but I truly believed you would have something interesting to say. All I hear is a bunch of whining about something you can fix if you were not too busy looking for attention.

  31. Having read this I believed it was really informative. I appreciate you finding the time and energy to put this short article together. I once again find myself personally spending a lot of time both reading and commenting. But so what, it was still worthwhile!

  32. Aw, this was a very good post. Taking a few minutes and actual effort to make a really good article… but what can I say… I hesitate a lot and don’t seem to get nearly anything done.

  33. I have to thank you for the efforts you’ve put in penning this site. I’m hoping to see the same high-grade blog posts by you later on as well. In fact, your creative writing abilities has inspired me to get my very own blog now 😉

  34. The very next time I read a blog, I hope that it does not disappoint me just as much as this particular one. I mean, I know it was my choice to read, nonetheless I actually thought you would probably have something interesting to say. All I hear is a bunch of whining about something that you could possibly fix if you weren’t too busy seeking attention.

  35. An impressive share! I have just forwarded this onto a coworker who has been conducting a little homework on this. And he in fact bought me breakfast simply because I stumbled upon it for him… lol. So let me reword this…. Thank YOU for the meal!! But yeah, thanks for spending some time to talk about this matter here on your blog.

  36. I absolutely love your site.. Very nice colors & theme. Did you create this site yourself? Please reply back as I’m wanting to create my very own blog and want to learn where you got this from or what the theme is named. Cheers!

  37. I blog often and I truly appreciate your information. The article has truly peaked my interest. I’m going to bookmark your website and keep checking for new information about once per week. I opted in for your Feed too.

  38. The very next time I read a blog, I hope that it doesn’t fail me as much as this one. After all, Yes, it was my choice to read, however I really believed you would probably have something helpful to say. All I hear is a bunch of moaning about something that you could possibly fix if you were not too busy looking for attention.

  39. This is the right blog for anyone who hopes to understand this topic. You understand so much its almost tough to argue with you (not that I personally will need to…HaHa). You definitely put a fresh spin on a topic that has been discussed for many years. Great stuff, just wonderful!

  40. Achieving your fitness goal doesn’t have to require a certified personal trainer or an expensive gym memberships, it is not hard to exercise at home. It is easy to go down a training and fitness rabbit hole, however, when you’re looking for the best home exercise equipment to outfit your personal home gym.

  41. Heya i am for the primary time here. I came across this
    board and I in finding It truly useful & it helped me
    out much. I am hoping to offer something again and help others such as
    you helped me.

  42. I was very pleased to uncover this web site. I wanted
    to thank you for your time for this particularly fantastic read!!
    I definitely really liked every little bit of it and i also have you bookmarked to look at new information in your web
    site.

  43. When I originally commented I appear to have clicked on the -Notify me when new comments are added- checkbox and now whenever a comment is added I receive 4 emails with the same comment. Perhaps there is an easy method you are able to remove me from that service? Kudos!

  44. Good day very nice blog!! Man .. Beautiful .. Superb ..
    I will bookmark your web site and take the feeds additionally?
    I am happy to search out a lot of useful info right here in the post, we want work out extra
    strategies in this regard, thank you for sharing. . . . . .
    31muvXS cheap flights

  45. Have you ever thought about publishing an ebook or guest authoring on other websites?
    I have a blog based upon on the same topics you discuss and would really like to have you share some stories/information. I know my subscribers would appreciate
    your work. If you are even remotely interested, feel free to shoot me an e mail.

    cheap flights 3aN8IMa

  46. Howdy! This post couldn’t be written any better! Going through this post reminds me of my previous roommate! He continually kept talking about this. I am going to send this information to him. Pretty sure he’s going to have a great read. Many thanks for sharing!

  47. Howdy! This blog post could not be written much better! Reading through this post reminds me of my previous roommate! He constantly kept talking about this. I most certainly will send this post to him. Pretty sure he’ll have a great read. Thanks for sharing!

  48. You’re so cool! I don’t suppose I’ve truly read anything like this before. So good to find another person with a few unique thoughts on this subject matter. Seriously.. thanks for starting this up. This site is something that’s needed on the internet, someone with a little originality!

  49. Hi, I do believe your site may be having internet browser compatibility issues. When I look at your web site in Safari, it looks fine however when opening in I.E., it’s got some overlapping issues. I just wanted to give you a quick heads up! Apart from that, excellent blog!

  50. Hi there! This article couldn’t be written any better! Looking at this post reminds me of my previous roommate! He continually kept talking about this. I most certainly will forward this information to him. Pretty sure he’ll have a very good read. Many thanks for sharing!

  51. You’re so cool! I do not believe I have read something like that before. So great to find another person with genuine thoughts on this subject matter. Really.. many thanks for starting this up. This site is one thing that is needed on the internet, someone with a little originality!

  52. I must thank you for the efforts you have put in writing this website. I really hope to check out the same high-grade content by you in the future as well. In fact, your creative writing abilities has encouraged me to get my own website now 😉

  53. After going over a few of the articles on your web page, I really like your technique of writing a blog. I saved it to my bookmark site list and will be checking back soon. Please check out my website too and tell me how you feel.

  54. You are so cool! I don’t believe I have read a single thing like this before. So great to find somebody with genuine thoughts on this topic. Really.. many thanks for starting this up. This website is something that is required on the web, someone with a little originality!

  55. Having read this I thought it was very informative. I appreciate you taking the time and energy to put this short article together. I once again find myself personally spending way too much time both reading and leaving comments. But so what, it was still worth it!

  56. I’m amazed, I must say. Seldom do I encounter a blog that’s equally educative and engaging, and without a doubt, you have hit the nail on the head. The issue is something which not enough men and women are speaking intelligently about. Now i’m very happy I stumbled across this during my search for something concerning this.

  57. You are so interesting! I do not suppose I’ve read a single thing like that before. So good to discover somebody with some unique thoughts on this subject matter. Seriously.. thanks for starting this up. This web site is something that’s needed on the internet, someone with a little originality!

  58. I absolutely love your website.. Very nice colors & theme. Did you develop this amazing site yourself? Please reply back as I’m planning to create my very own website and want to find out where you got this from or exactly what the theme is called. Many thanks!

  59. When I initially commented I appear to have clicked the -Notify me when new comments are added- checkbox and from now on each time a comment is added I get four emails with the exact same comment. Perhaps there is an easy method you are able to remove me from that service? Thank you!

Leave a Reply

Your email address will not be published. Required fields are marked *